-- Logs begin at Mon 2022-07-25 11:52:13 UTC, end at Mon 2022-07-25 14:16:23 UTC. -- Jul 25 12:27:40.207003 n-d-848886-15 systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 12:27:40.216127 n-d-848886-15 devstack@n-api.service[104095]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 12:27:40.218131 n-d-848886-15 devstack@n-api.service[104095]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 12:27:40 2022] *** Jul 25 12:27:40.218131 n-d-848886-15 devstack@n-api.service[104095]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 12:27:40.218131 n-d-848886-15 devstack@n-api.service[104095]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 12:27:40.218131 n-d-848886-15 devstack@n-api.service[104095]: nodename: n-d-848886-15 Jul 25 12:27:40.218131 n-d-848886-15 devstack@n-api.service[104095]: machine: x86_64 Jul 25 12:27:40.218131 n-d-848886-15 devstack@n-api.service[104095]: clock source: unix Jul 25 12:27:40.218131 n-d-848886-15 devstack@n-api.service[104095]: pcre jit disabled Jul 25 12:27:40.218131 n-d-848886-15 devstack@n-api.service[104095]: detected number of CPU cores: 4 Jul 25 12:27:40.218131 n-d-848886-15 devstack@n-api.service[104095]: current working directory: / Jul 25 12:27:40.218131 n-d-848886-15 devstack@n-api.service[104095]: detected binary path: /usr/bin/uwsgi-core Jul 25 12:27:40.218756 n-d-848886-15 devstack@n-api.service[104095]: your processes number limit is 47680 Jul 25 12:27:40.218756 n-d-848886-15 devstack@n-api.service[104095]: your memory page size is 4096 bytes Jul 25 12:27:40.218756 n-d-848886-15 devstack@n-api.service[104095]: detected max file descriptor number: 2048 Jul 25 12:27:40.218756 n-d-848886-15 devstack@n-api.service[104095]: lock engine: pthread robust mutexes Jul 25 12:27:40.218756 n-d-848886-15 devstack@n-api.service[104095]: thunder lock: enabled Jul 25 12:27:40.218756 n-d-848886-15 devstack@n-api.service[104095]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 12:27:40.218756 n-d-848886-15 devstack@n-api.service[104095]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 12:27:40.256493 n-d-848886-15 devstack@n-api.service[104095]: Python main interpreter initialized at 0x55c361db59c0 Jul 25 12:27:40.256493 n-d-848886-15 devstack@n-api.service[104095]: python threads support enabled Jul 25 12:27:40.256493 n-d-848886-15 devstack@n-api.service[104095]: your server socket listen backlog is limited to 100 connections Jul 25 12:27:40.256493 n-d-848886-15 devstack@n-api.service[104095]: your mercy for graceful operations on workers is 90 seconds Jul 25 12:27:40.256836 n-d-848886-15 devstack@n-api.service[104095]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 12:27:40.256915 n-d-848886-15 devstack@n-api.service[104095]: *** Operational MODE: preforking *** Jul 25 12:27:40.257156 n-d-848886-15 devstack@n-api.service[104095]: *** uWSGI is running in multiple interpreter mode *** Jul 25 12:27:40.257156 n-d-848886-15 devstack@n-api.service[104095]: spawned uWSGI master process (pid: 104095) Jul 25 12:27:40.257358 n-d-848886-15 systemd[1]: Started Devstack devstack@n-api.service. Jul 25 12:27:40.258459 n-d-848886-15 devstack@n-api.service[104095]: spawned uWSGI worker 1 (pid: 104096, cores: 1) Jul 25 12:27:40.258459 n-d-848886-15 devstack@n-api.service[104095]: spawned uWSGI worker 2 (pid: 104097, cores: 1) Jul 25 12:27:40.258459 n-d-848886-15 devstack@n-api.service[104095]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 12:27:40.895572 n-d-848886-15 devstack@n-api.service[104096]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 12:27:40.899145 n-d-848886-15 devstack@n-api.service[104097]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 12:27:41.952684 n-d-848886-15 devstack@n-api.service[104096]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:27:41.952684 n-d-848886-15 devstack@n-api.service[104096]: from cryptography.utils import int_from_bytes Jul 25 12:27:41.953351 n-d-848886-15 devstack@n-api.service[104096]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:27:41.953351 n-d-848886-15 devstack@n-api.service[104096]: from cryptography.utils import int_from_bytes Jul 25 12:27:41.956901 n-d-848886-15 devstack@n-api.service[104097]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:27:41.956901 n-d-848886-15 devstack@n-api.service[104097]: from cryptography.utils import int_from_bytes Jul 25 12:27:41.957357 n-d-848886-15 devstack@n-api.service[104097]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:27:41.957357 n-d-848886-15 devstack@n-api.service[104097]: from cryptography.utils import int_from_bytes Jul 25 12:27:44.380489 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 12:27:44.381051 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 12:27:44.381141 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 12:27:44.381492 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 12:27:44.381624 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 12:27:44.382044 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 12:27:44.382146 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 12:27:44.382225 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.382319 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 12:27:44.382392 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.382673 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 12:27:44.382822 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.382990 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 12:27:44.383066 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.383303 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.383437 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.383603 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.383723 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.383935 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.384078 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.384244 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.384378 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.384560 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.384703 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.384791 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.384878 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.385108 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.385242 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.385420 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-848886-15 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.385554 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.385731 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.385911 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.386009 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.386098 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.386341 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.386476 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.386631 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.386722 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-848886-15 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.386926 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.387029 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.387246 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.387336 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.387540 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.387629 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.387850 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.388027 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.388439 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.388439 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.388676 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.388782 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.388897 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.389083 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.389260 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.389388 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.389569 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.389698 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.389908 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.390027 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.390194 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.390345 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.390534 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.390626 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.390844 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.390935 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.391150 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.391236 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.391465 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.391615 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-848886-15 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.391753 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.391932 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.392081 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.392220 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.392380 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.392508 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.392766 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-848886-15 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.392896 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.393085 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.393203 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.393396 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.393504 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.393709 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.393809 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.394133 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.394230 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.394435 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.394601 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.394742 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.394835 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.395053 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.395138 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.395363 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.395459 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.395665 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.395750 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.396020 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.396162 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.396280 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.396391 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.396540 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.396636 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.396850 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.396944 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.397146 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.397234 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.397444 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.397531 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.397686 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.397772 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.398010 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.398101 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.398322 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.398407 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.398630 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.398732 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.398893 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.398985 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.399172 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.399266 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.399412 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.399512 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.399720 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.399815 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.400031 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.400118 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.400329 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.400419 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.400579 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.400665 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.400893 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.400989 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.401198 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.401284 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.401494 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.401580 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.401790 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.401926 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.402111 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.402198 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.402411 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.402505 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.402715 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.402852 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.403021 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.403108 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.403322 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.403406 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.403974 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.404075 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.404284 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.404371 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.404667 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.404781 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.404964 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.405061 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.405274 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.405360 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.405589 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.405675 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.405964 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.406055 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.406258 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.406343 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.406565 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.406652 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.406876 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.406974 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.407176 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.407273 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.407480 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.407566 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.407778 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.407865 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.408089 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.408176 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.408391 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.408487 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.408690 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.408777 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.408931 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.409018 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.409225 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.409311 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.409519 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.409613 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.409839 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.409939 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.410138 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.410233 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.410435 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.410519 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.410732 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.410826 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.411021 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.411115 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.411317 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.411411 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.411615 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.411701 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.411911 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.412006 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.412207 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.412292 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.412500 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.412585 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.412795 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.413281 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.413454 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.413555 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.413749 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.413885 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.414071 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.414159 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.414370 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.414455 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.414676 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.414761 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.414972 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.415057 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.415269 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.415353 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.415563 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.415657 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.415860 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.415948 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.416171 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.416255 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.416470 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.416553 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.416767 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.416895 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.417066 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.417160 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.417368 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.417453 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.417661 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.417749 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.417982 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.418070 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.418290 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.418374 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.418590 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.418677 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.418890 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.418976 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.419180 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.419264 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.419479 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.419566 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.419781 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.419865 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.420076 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.420160 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.420395 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.420492 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.420688 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.420775 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.420983 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.421145 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.421275 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.421362 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.421569 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.421654 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.421880 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.421997 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.422176 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.422263 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.422464 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.422550 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.422762 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.422857 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.423065 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.423158 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.423359 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.423452 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.423651 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.423745 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.423942 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.424027 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.424252 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.424341 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.424554 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.424639 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.424857 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.424952 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.425159 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.425256 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.425473 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:27:44.425561 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.425805 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.425908 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.426149 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.426245 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.426456 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.426544 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.426758 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.426845 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.427064 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.427154 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.427386 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.427481 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.427687 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.427772 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.427987 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.428085 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.428288 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.428374 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.428596 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.428688 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.428908 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.429008 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.429211 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.429298 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.429520 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.429630 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.429824 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.430005 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.430160 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.430248 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.430463 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.430556 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.430773 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.430868 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.431083 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.431168 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.431392 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.431476 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.431693 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.431789 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.432007 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.432112 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.432332 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.432419 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.432634 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.432732 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.432967 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.433060 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.433251 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.433340 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.433553 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.433641 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.433876 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.433978 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.434183 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.434269 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.434496 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.434651 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.434820 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.434952 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.435125 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.435213 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.435430 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.435524 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.435734 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.435819 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.436117 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.436204 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.436420 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.436544 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.436724 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.436812 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.437027 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.437126 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.437335 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.437420 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.437642 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.437728 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.437972 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.438087 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.438280 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.438366 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.438588 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.438674 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.438895 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.438993 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.439199 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.439293 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.439501 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.439587 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.439796 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.439894 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.440091 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.440179 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.440386 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.440473 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.440686 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.440790 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.440983 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.441070 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.441281 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.441366 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.441580 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.441668 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.441905 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.441996 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.442204 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.442289 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.442518 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.442605 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.442820 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.442915 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.443122 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.443208 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.443426 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.443517 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.443720 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.443818 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.444024 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.444111 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.444325 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.444421 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.444620 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.444716 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.444920 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.445016 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.445222 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.445315 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.445516 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.445610 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.445812 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.445972 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.446137 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.446229 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.446434 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.446528 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.446734 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.446832 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.447032 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.447151 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.447341 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.447426 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.447639 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.447734 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.447939 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.448025 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.448241 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.448333 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.448549 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.448643 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.448862 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.448948 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.449167 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.449252 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.449487 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.449575 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.449781 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.449895 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.450119 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.450205 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.450451 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.450539 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.450757 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.450842 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.451053 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.451148 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.451354 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.451448 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.451673 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.451766 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.451969 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.452064 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.452264 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.452350 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.452565 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.452650 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.452859 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.452953 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.453154 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.453248 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.453450 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.453571 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.453745 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.453863 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.454069 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.454155 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.454370 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.454458 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.454669 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.454764 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.454963 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.455050 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.455260 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.455344 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.455551 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.455637 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.455866 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.455952 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.456167 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.456253 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.456468 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.456555 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.456765 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.456858 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.457103 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.457191 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.457408 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.457503 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.457715 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.457801 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.458047 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.458146 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.458350 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.458445 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.458655 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.458743 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.458959 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.459054 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.459262 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.459349 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.459575 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.459670 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.459880 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.459975 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.460187 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.460272 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.460486 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.460570 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.460801 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.460900 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.461102 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.461194 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.461414 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.461500 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.461709 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.461812 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.462041 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.462129 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.462352 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.462439 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.462672 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.462771 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.462974 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.463059 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.463283 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.463367 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.463586 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.463718 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.463891 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.463976 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.464190 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.464276 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.464493 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.464589 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.464798 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.464885 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.465104 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.465189 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.465416 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.465504 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.465717 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.465812 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.466047 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.466136 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.466345 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.466431 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.466659 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.466751 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.466956 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.467050 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.467319 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.467406 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.467622 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.467708 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.467944 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.468039 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.468249 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.468335 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.468563 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.468649 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.468862 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.468958 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.469167 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.469251 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.469486 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.469571 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.469793 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.469911 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.470122 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.470210 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.470428 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.470515 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.470731 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.470819 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.471025 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.471114 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.471327 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.471417 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.471630 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.471718 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.471928 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.472026 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.472228 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.472315 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.472521 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.472608 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.472828 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.472914 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.473128 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.473215 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.473423 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.473511 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.473715 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.473801 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.474043 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.474152 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.474347 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.474440 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.474647 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.474741 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.474945 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.475039 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.475254 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.475343 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.475547 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.475632 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.475843 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.475938 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.476156 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.476243 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.476457 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.476543 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.476753 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.476853 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.477050 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.477151 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.477347 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.477491 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.477658 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.477747 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.477981 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.478088 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.478277 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.478363 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.478577 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.478671 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.478887 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.478971 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.479187 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.479280 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.479491 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.479578 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.479787 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.479878 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.480086 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.480173 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.480396 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.480482 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.480698 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.480793 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.481002 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.481096 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.481308 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.481411 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.481607 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.481692 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.481929 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.482036 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.482232 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.482319 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.482538 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.482651 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.482870 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.482966 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.483173 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.483258 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.483478 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.483566 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.483778 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.483922 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.484083 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.484170 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.484385 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.484470 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.484692 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.484945 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.485033 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.485272 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.485358 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.485580 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.485677 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.485915 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.486165 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.486252 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.486497 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.486582 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.486815 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.486910 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.487130 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.487217 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.487451 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.487596 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.487762 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.487869 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.488067 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.488154 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.488368 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.488453 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.488665 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.488763 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.488970 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.489065 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.489268 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.489366 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.489565 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.489659 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.489878 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.489972 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.490186 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.490284 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.490480 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.490566 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.490777 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.490865 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.491074 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.491165 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.491366 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.491459 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.491667 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.491759 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.491959 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.492045 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.492255 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.492349 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.492547 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.492632 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.492854 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.492938 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.493150 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.493244 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.493446 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.493538 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.493741 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.493845 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.494060 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.494162 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.494371 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.494456 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.494669 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.494755 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.494967 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.495063 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.495265 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.495351 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.495599 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.495692 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.495903 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.495991 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.496201 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.496287 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.496516 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.496609 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.496809 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.496896 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.497105 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.497191 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.497405 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.497498 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.497704 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.497879 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.498028 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.498115 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.498397 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.498499 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.498698 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.498783 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.498994 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.499088 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.499294 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.499390 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.499591 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.499677 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.499881 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.499973 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.500179 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.500274 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.500472 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.500559 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.500774 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.500858 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.501072 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.501170 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.501367 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.501466 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.501663 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.501755 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.501995 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.502085 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.502296 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.502380 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.502587 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.502674 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.502887 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.502982 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.503176 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.503261 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.503479 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.503565 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.503773 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.503859 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.504072 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.504158 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.504376 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.504461 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.504667 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.504762 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.504964 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.505050 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.505296 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.505410 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.505551 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.505643 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.505871 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.505963 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.506173 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.506273 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.506471 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.506601 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.506778 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.506873 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.507068 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.507163 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.507363 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.507454 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.507681 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.507778 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.507968 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.508081 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.508266 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.508356 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.508556 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.508642 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.508856 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.508945 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.509150 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.509236 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.509443 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.509528 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.509736 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.509824 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.510060 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.510149 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.510357 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.510441 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.510647 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.510734 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.510940 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.511028 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.511233 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.511319 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.511526 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.511612 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.511823 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.511910 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.512120 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.512217 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.512411 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.512499 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.512707 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.512792 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.512996 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.513094 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.513319 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.513404 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.513610 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.513694 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.513956 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.514065 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.514257 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.514355 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.514579 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.514665 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.514882 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.514976 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.515183 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.515268 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.515485 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.515570 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.515786 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.515873 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.516081 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.516168 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.516385 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.516472 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.516690 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.516785 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.516996 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.517089 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.517293 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.517378 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.517585 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.517679 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.517962 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.518062 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.518212 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.518298 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.518508 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.518596 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.518807 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.518894 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.519118 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.519206 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.519425 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.519511 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.519715 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.519800 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.520012 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.520106 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.520312 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.520406 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.520609 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.520694 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.520921 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.521031 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.521208 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.521296 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.521509 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.521595 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.521811 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.521969 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.522134 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.522220 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.522436 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.522523 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.522739 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.522911 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.523037 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.523124 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.523336 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.523432 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.523634 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.523722 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.523926 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.524012 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.524227 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.524313 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.524527 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.524615 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.524822 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.524908 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.525118 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.525203 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.525410 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.525496 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.525713 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.525799 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.526038 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.526125 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.526343 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.526437 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.526646 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.526733 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.526957 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.527052 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.527258 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.527344 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.527609 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.527694 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.527929 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.528160 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.528252 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.528333 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.528511 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.528606 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.528805 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.528909 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.529147 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.529233 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.529458 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.529588 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.529818 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.529965 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.530145 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.530232 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.530477 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.530571 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.530773 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.530860 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.531076 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.531162 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.531396 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.531482 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.531696 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.531784 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.531993 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.532079 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.532290 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.532382 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.532603 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.532691 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.532901 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.532988 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.533207 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.533295 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.533508 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.533595 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.533850 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.533940 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.534152 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.534250 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.534469 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.534598 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.534882 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.534968 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.535185 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.535285 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.535486 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.535570 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.535800 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.535892 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.536117 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.536212 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.536414 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.536508 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.536717 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.536802 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.537017 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.537197 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.537336 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.537432 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.537652 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.537738 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.538345 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.538447 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.538650 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.538756 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.538947 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.539034 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.539260 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.539348 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.539573 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.539662 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.539875 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.539961 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.540177 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.540260 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.540495 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.540593 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.540817 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.540903 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.541127 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.541214 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.541447 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.541535 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.541772 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.541882 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.542096 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.542183 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.542392 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.542482 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.542692 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.542779 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.542987 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.543088 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.543284 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.543392 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.543595 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.543686 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.543888 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.543983 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.544192 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.544278 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.544492 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.544620 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.544790 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.544887 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.545082 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.545191 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.545402 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.545496 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.545712 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.545808 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.546031 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.546118 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.546343 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.546431 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.546639 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.546726 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.546950 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.547035 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.547248 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.547333 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.547549 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.547642 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.547857 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.547943 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.548152 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.548238 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.548449 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.548549 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.548743 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.548832 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.549036 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.549130 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.549362 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.549450 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.549657 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.549742 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.549977 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.550090 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.550277 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.550366 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.550608 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.550700 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.550909 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.551004 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.551225 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.551320 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.551539 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.551632 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.551851 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.551947 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.552158 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.552244 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.552472 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.552558 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.552769 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.552864 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.553063 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.553150 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.553362 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.553457 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.553655 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.553743 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.553979 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.554069 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.554276 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.554375 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.554575 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.554664 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.554868 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.554954 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.555160 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.555254 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.555453 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.555542 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.555756 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.555842 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.556049 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.556143 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.556345 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.556432 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.556645 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.556731 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.556940 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.557035 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.557243 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.557330 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.557538 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.557633 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.557880 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.557985 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.558171 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.558260 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.558512 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.558612 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.558769 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.558866 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.559088 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.559175 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.559393 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.559479 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.559696 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.559800 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.560009 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.560105 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.560318 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.560417 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.560624 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.560713 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.560979 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.561067 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.561301 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.561388 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.561607 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.561696 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.561937 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.562029 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.562251 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.562341 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.562552 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.562640 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.562858 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.562945 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.563165 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.563251 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.563475 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.563571 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.563782 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.563983 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.564119 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.564307 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.564404 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.564615 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.564738 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.564921 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.565194 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.565291 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.565517 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.565604 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.565823 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.565954 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.566147 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.566243 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.566450 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.566538 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.566752 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.566839 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.567052 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.567141 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.567357 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.567442 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.567665 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.567753 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.567972 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.568060 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.568276 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.568373 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.568620 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.568718 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.568900 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.568989 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.569210 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.569297 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.569518 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.569617 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.569856 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.569947 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.570175 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.570264 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.570475 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.570571 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.570783 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.570871 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.571091 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.571177 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.571395 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.571483 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.571700 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.571794 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.572007 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.572094 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.572312 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.572400 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.572616 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.572702 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.572917 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.573005 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.573218 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.573307 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.573522 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.573608 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.573843 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.573951 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.574169 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.574256 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.574474 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.574569 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.574784 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.574881 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.575089 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.575175 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.575396 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.575491 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.575705 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.575806 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.576026 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.576214 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.576343 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.576549 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.576678 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.576876 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.576989 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.577194 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.577506 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.577593 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.577812 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.577947 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.578144 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.578246 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.578467 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.578561 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.578768 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.578868 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.579064 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.579152 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.579367 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.579454 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.579671 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.579759 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.579967 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.580062 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.580280 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.580375 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.580580 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.580665 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.580876 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.580963 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.581174 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.581269 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.581476 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.581572 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.581784 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.582033 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.582122 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.582371 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.582459 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.582678 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.582765 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.582996 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.583220 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.583317 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.583561 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.583649 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.583874 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.583960 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.584194 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.584290 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.584490 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.584576 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.584792 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.584887 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.585100 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.585186 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.585402 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.585488 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.585703 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.585791 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.586025 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.586117 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.586329 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.586417 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.586630 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.586731 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.586928 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.587023 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.587224 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.587311 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.587519 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.587618 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.587820 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.587906 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.588120 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.588208 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.588415 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.588509 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.588712 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.588813 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.589019 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.589117 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.589314 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.589411 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.589607 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.589695 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.589926 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.590016 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.590220 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.590310 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.590521 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.590616 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.590817 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.590905 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.591115 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.591202 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.591408 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.591494 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.591710 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.591796 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.592000 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.592132 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.592356 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.592442 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.592657 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.592743 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.592965 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.593053 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.593267 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.593354 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.593569 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.593663 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.593899 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.593992 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.594201 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.594300 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.594516 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.594612 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.594817 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.594912 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.595117 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.595210 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.595418 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.595513 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.595737 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.595823 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.596044 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.596258 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.596345 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.596587 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.596675 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.596898 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.596986 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.597222 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.597496 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.597605 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.597847 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.597938 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.598153 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.598239 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.598452 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.598540 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.598766 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.598860 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.599086 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.599176 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.599388 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.599476 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.599689 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.599775 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.599989 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.600076 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.600292 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.600380 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.600593 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.600679 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.600895 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.600991 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.601196 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.601283 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.601496 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.601584 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.601795 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.601940 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.602122 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.602210 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.602424 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.602510 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.602722 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.602820 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.603026 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.603114 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.603330 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.603425 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.603634 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.603729 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.603938 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.604024 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.604245 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.604332 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.604551 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.604638 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.604854 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.604956 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.605155 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.605242 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.605455 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.605543 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.605754 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.605860 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.606087 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.606185 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.606391 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.606487 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.606697 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.606786 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.606991 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.607087 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.607302 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.607389 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.607644 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.607735 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.607962 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.608059 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.608264 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.608351 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.608606 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.608690 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.608919 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.609008 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.609233 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.609331 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.609535 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.609631 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.609876 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.609970 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.610175 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.610263 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.610497 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.610584 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.610804 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.610893 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.611120 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.611206 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.611429 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.611515 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.611728 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.611815 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.612024 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.612111 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.612319 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.612420 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.612621 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.612710 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.612931 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.613025 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.613233 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.613333 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.613529 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.613617 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.613824 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.613928 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.614144 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.614245 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.614440 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.614528 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.614738 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.614865 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.615034 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.615122 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.615330 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.615415 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.615627 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.615720 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.615918 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.616005 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.616214 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.616308 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.616508 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.616595 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.616802 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.616891 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.617097 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.617191 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.617394 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.617487 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.617691 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.617778 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.618009 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.618097 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.618307 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.618474 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.618599 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.618694 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.618892 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.618987 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.619187 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.619344 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.619488 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.619574 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.619785 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.619885 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.620084 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.620181 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.620382 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.620469 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.620708 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.620793 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.621020 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.621117 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.621320 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.621408 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.621632 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.621719 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.621964 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.622057 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.622269 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.622357 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.622568 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.622655 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.622884 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.622971 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.623182 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.623287 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.623558 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.623646 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.623859 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.623946 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.624162 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.624249 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.624461 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.624556 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.624761 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.624858 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.625066 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.625155 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.625372 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.625469 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.625669 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.625755 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.625994 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.626096 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.626320 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.626416 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.626629 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.626714 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.626934 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.627027 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.627239 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.627339 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.627558 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.627644 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.627862 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.627946 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.628165 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.628261 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.628466 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.628553 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.628773 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.628871 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.629074 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.629162 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.629382 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.629471 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.629682 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.629767 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.630010 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.630102 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.630320 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.630406 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.630671 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.630775 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.630932 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.631019 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.631240 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.631326 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.631538 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.631633 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.631852 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.631950 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.632168 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.632255 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.632491 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.632586 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.632796 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.632891 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.633126 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.633219 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.633441 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.633529 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.633745 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.633857 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.634084 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.634171 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.634381 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.634470 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.634622 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 12:27:44.634742 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.635051 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.635362 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.635663 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:27:44.635904 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 12:27:44.790764 n-d-848886-15 devstack@n-api.service[104096]: INFO dbcounter [None req-df1ecad5-7f22-48b1-8637-50468999b03f None None] Registered counter for database nova_api Jul 25 12:27:44.792236 n-d-848886-15 devstack@n-api.service[104097]: INFO dbcounter [None req-19174e80-0dec-4918-b260-15eaa1286afe None None] Registered counter for database nova_api Jul 25 12:27:44.811662 n-d-848886-15 devstack@n-api.service[104096]: DEBUG oslo_db.sqlalchemy.engines [None req-df1ecad5-7f22-48b1-8637-50468999b03f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:27:44.814037 n-d-848886-15 devstack@n-api.service[104097]: DEBUG oslo_db.sqlalchemy.engines [None req-19174e80-0dec-4918-b260-15eaa1286afe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:27:44.818345 n-d-848886-15 devstack@n-api.service[104096]: DEBUG dbcounter [-] [104096] Writer thread running {{(pid=104096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:27:44.821329 n-d-848886-15 devstack@n-api.service[104097]: DEBUG dbcounter [-] [104097] Writer thread running {{(pid=104097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:27:44.872593 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.context [None req-df1ecad5-7f22-48b1-8637-50468999b03f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),44375b4d-91c4-48bf-9056-56d6e14223f5(cell1) {{(pid=104096) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 12:27:44.876589 n-d-848886-15 devstack@n-api.service[104096]: DEBUG oslo_concurrency.lockutils [None req-df1ecad5-7f22-48b1-8637-50468999b03f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:44.876723 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.context [None req-19174e80-0dec-4918-b260-15eaa1286afe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),44375b4d-91c4-48bf-9056-56d6e14223f5(cell1) {{(pid=104097) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 12:27:44.878168 n-d-848886-15 devstack@n-api.service[104096]: DEBUG oslo_concurrency.lockutils [None req-df1ecad5-7f22-48b1-8637-50468999b03f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:44.878943 n-d-848886-15 devstack@n-api.service[104096]: DEBUG oslo_concurrency.lockutils [None req-df1ecad5-7f22-48b1-8637-50468999b03f None None] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:44.880638 n-d-848886-15 devstack@n-api.service[104097]: DEBUG oslo_concurrency.lockutils [None req-19174e80-0dec-4918-b260-15eaa1286afe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:44.880952 n-d-848886-15 devstack@n-api.service[104096]: DEBUG oslo_concurrency.lockutils [None req-df1ecad5-7f22-48b1-8637-50468999b03f None None] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:44.882248 n-d-848886-15 devstack@n-api.service[104097]: DEBUG oslo_concurrency.lockutils [None req-19174e80-0dec-4918-b260-15eaa1286afe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:44.882909 n-d-848886-15 devstack@n-api.service[104096]: INFO dbcounter [None req-df1ecad5-7f22-48b1-8637-50468999b03f None None] Registered counter for database nova_cell0 Jul 25 12:27:44.883040 n-d-848886-15 devstack@n-api.service[104097]: DEBUG oslo_concurrency.lockutils [None req-19174e80-0dec-4918-b260-15eaa1286afe None None] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:44.885011 n-d-848886-15 devstack@n-api.service[104097]: DEBUG oslo_concurrency.lockutils [None req-19174e80-0dec-4918-b260-15eaa1286afe None None] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:44.887067 n-d-848886-15 devstack@n-api.service[104097]: INFO dbcounter [None req-19174e80-0dec-4918-b260-15eaa1286afe None None] Registered counter for database nova_cell0 Jul 25 12:27:44.888218 n-d-848886-15 devstack@n-api.service[104096]: INFO dbcounter [None req-df1ecad5-7f22-48b1-8637-50468999b03f None None] Registered counter for database nova_cell1 Jul 25 12:27:44.892568 n-d-848886-15 devstack@n-api.service[104097]: INFO dbcounter [None req-19174e80-0dec-4918-b260-15eaa1286afe None None] Registered counter for database nova_cell1 Jul 25 12:27:44.895602 n-d-848886-15 devstack@n-api.service[104096]: DEBUG oslo_db.sqlalchemy.engines [None req-df1ecad5-7f22-48b1-8637-50468999b03f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:27:44.897363 n-d-848886-15 devstack@n-api.service[104096]: DEBUG oslo_db.sqlalchemy.engines [None req-df1ecad5-7f22-48b1-8637-50468999b03f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:27:44.901024 n-d-848886-15 devstack@n-api.service[104097]: DEBUG oslo_db.sqlalchemy.engines [None req-19174e80-0dec-4918-b260-15eaa1286afe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:27:44.903556 n-d-848886-15 devstack@n-api.service[104096]: DEBUG dbcounter [-] [104096] Writer thread running {{(pid=104096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:27:44.905031 n-d-848886-15 devstack@n-api.service[104096]: DEBUG dbcounter [-] [104096] Writer thread running {{(pid=104096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:27:44.906714 n-d-848886-15 devstack@n-api.service[104097]: DEBUG dbcounter [-] [104097] Writer thread running {{(pid=104097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:27:44.907409 n-d-848886-15 devstack@n-api.service[104097]: DEBUG oslo_db.sqlalchemy.engines [None req-19174e80-0dec-4918-b260-15eaa1286afe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:27:45.044914 n-d-848886-15 devstack@n-api.service[104096]: INFO dbcounter [None req-df1ecad5-7f22-48b1-8637-50468999b03f None None] Registered counter for database nova_cell0 Jul 25 12:27:45.050850 n-d-848886-15 devstack@n-api.service[104097]: DEBUG dbcounter [-] [104097] Writer thread running {{(pid=104097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:27:45.053028 n-d-848886-15 devstack@n-api.service[104096]: DEBUG oslo_db.sqlalchemy.engines [None req-df1ecad5-7f22-48b1-8637-50468999b03f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:27:45.059087 n-d-848886-15 devstack@n-api.service[104096]: DEBUG dbcounter [-] [104096] Writer thread running {{(pid=104096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:27:45.060453 n-d-848886-15 devstack@n-api.service[104097]: INFO dbcounter [None req-19174e80-0dec-4918-b260-15eaa1286afe None None] Registered counter for database nova_cell0 Jul 25 12:27:45.069690 n-d-848886-15 devstack@n-api.service[104097]: DEBUG oslo_db.sqlalchemy.engines [None req-19174e80-0dec-4918-b260-15eaa1286afe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:27:45.075663 n-d-848886-15 devstack@n-api.service[104097]: DEBUG dbcounter [-] [104097] Writer thread running {{(pid=104097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:27:45.392913 n-d-848886-15 devstack@n-api.service[104096]: WARNING keystonemiddleware.auth_token [None req-df1ecad5-7f22-48b1-8637-50468999b03f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:27:45.400215 n-d-848886-15 devstack@n-api.service[104096]: WARNING keystonemiddleware.auth_token [None req-df1ecad5-7f22-48b1-8637-50468999b03f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:27:45.401585 n-d-848886-15 devstack@n-api.service[104097]: WARNING keystonemiddleware.auth_token [None req-19174e80-0dec-4918-b260-15eaa1286afe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:27:45.408873 n-d-848886-15 devstack@n-api.service[104097]: WARNING keystonemiddleware.auth_token [None req-19174e80-0dec-4918-b260-15eaa1286afe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:27:45.740558 n-d-848886-15 devstack@n-api.service[104096]: WARNING keystonemiddleware.auth_token [None req-df1ecad5-7f22-48b1-8637-50468999b03f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:27:45.746540 n-d-848886-15 devstack@n-api.service[104096]: WARNING keystonemiddleware.auth_token [None req-df1ecad5-7f22-48b1-8637-50468999b03f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:27:45.751811 n-d-848886-15 devstack@n-api.service[104096]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c361db59c0 pid: 104096 (default app) Jul 25 12:27:45.751962 n-d-848886-15 devstack@n-api.service[104097]: WARNING keystonemiddleware.auth_token [None req-19174e80-0dec-4918-b260-15eaa1286afe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:27:45.753891 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-df1ecad5-7f22-48b1-8637-50468999b03f None None] Calling method '>' {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:27:45.755093 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-df1ecad5-7f22-48b1-8637-50468999b03f None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001770 Jul 25 12:27:45.755504 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Mon Jul 25 12:27:45 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:27:45.757868 n-d-848886-15 devstack@n-api.service[104097]: WARNING keystonemiddleware.auth_token [None req-19174e80-0dec-4918-b260-15eaa1286afe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:27:45.763062 n-d-848886-15 devstack@n-api.service[104097]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c361db59c0 pid: 104097 (default app) Jul 25 12:29:01.432134 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-df1ecad5-7f22-48b1-8637-50468999b03f None None] Calling method '>' {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:01.433142 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-df1ecad5-7f22-48b1-8637-50468999b03f None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 25 12:29:01.433724 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 25 12:29:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:29:01.446401 n-d-848886-15 devstack@n-api.service[104097]: DEBUG dbcounter [-] [104097] Writing DB stats nova_api:SELECT=3 {{(pid=104097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:29:01.447570 n-d-848886-15 devstack@n-api.service[104097]: DEBUG dbcounter [-] [104097] Writing DB stats nova_cell0:SELECT=3 {{(pid=104097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:29:01.448417 n-d-848886-15 devstack@n-api.service[104097]: DEBUG dbcounter [-] [104097] Writing DB stats nova_cell1:SELECT=3 {{(pid=104097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:29:01.449251 n-d-848886-15 devstack@n-api.service[104097]: DEBUG dbcounter [-] [104097] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:29:02.426085 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-d5e6cfb8-fae3-4406-857d-d6ec871a2040 admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:02.459097 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-d5e6cfb8-fae3-4406-857d-d6ec871a2040 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.018223 Jul 25 12:29:02.469912 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1291 bytes} [Mon Jul 25 12:29:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:29:04.626000 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-df1ecad5-7f22-48b1-8637-50468999b03f None None] Calling method '>' {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:04.627016 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-df1ecad5-7f22-48b1-8637-50468999b03f None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 25 12:29:04.627571 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 25 12:29:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:29:05.075307 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-7803146a-235b-4bec-9c12-3e61d58a6976 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "id": "c1", "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0}} {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:05.095516 n-d-848886-15 devstack@n-api.service[104097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:29:05.095516 n-d-848886-15 devstack@n-api.service[104097]: warnings.warn(msg) Jul 25 12:29:05.126014 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-7803146a-235b-4bec-9c12-3e61d58a6976 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.492210 Jul 25 12:29:05.126955 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 25 12:29:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:29:05.343781 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-88acf973-a321-4bb8-835e-9b094ad57c86 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:05.348254 n-d-848886-15 devstack@n-api.service[104096]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:29:05.348254 n-d-848886-15 devstack@n-api.service[104096]: warnings.warn(msg) Jul 25 12:29:05.367244 n-d-848886-15 devstack@n-api.service[104096]: DEBUG dbcounter [-] [104096] Writing DB stats nova_api:SELECT=3 {{(pid=104096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:29:05.368303 n-d-848886-15 devstack@n-api.service[104096]: DEBUG dbcounter [-] [104096] Writing DB stats nova_cell0:SELECT=3 {{(pid=104096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:29:05.368957 n-d-848886-15 devstack@n-api.service[104096]: DEBUG dbcounter [-] [104096] Writing DB stats nova_cell1:SELECT=3 {{(pid=104096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:29:05.369796 n-d-848886-15 devstack@n-api.service[104096]: DEBUG dbcounter [-] [104096] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:29:05.414147 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-88acf973-a321-4bb8-835e-9b094ad57c86 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.277342 Jul 25 12:29:05.426692 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1335 bytes} [Mon Jul 25 12:29:05 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:29:07.628875 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-7803146a-235b-4bec-9c12-3e61d58a6976 admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:07.629861 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-7803146a-235b-4bec-9c12-3e61d58a6976 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Jul 25 12:29:07.630274 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 25 12:29:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:29:08.455486 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-74c09a93-9f7b-4fce-b5e4-3a70e46d8fab admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "id": "d1"}} {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:08.474404 n-d-848886-15 devstack@n-api.service[104096]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:29:08.474404 n-d-848886-15 devstack@n-api.service[104096]: warnings.warn(msg) Jul 25 12:29:08.494780 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-74c09a93-9f7b-4fce-b5e4-3a70e46d8fab admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.858101 Jul 25 12:29:08.495550 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 25 12:29:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:29:08.507945 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-768f7110-3c14-4653-ac18-e6d61bc305c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:08.511080 n-d-848886-15 devstack@n-api.service[104097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:29:08.511080 n-d-848886-15 devstack@n-api.service[104097]: warnings.warn(msg) Jul 25 12:29:08.547111 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-768f7110-3c14-4653-ac18-e6d61bc305c8 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043174 Jul 25 12:29:08.547977 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1335 bytes} [Mon Jul 25 12:29:08 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:29:10.948246 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-74c09a93-9f7b-4fce-b5e4-3a70e46d8fab admin admin] Calling method '>' {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:10.950406 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-74c09a93-9f7b-4fce-b5e4-3a70e46d8fab admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002317 Jul 25 12:29:10.951485 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 25 12:29:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:29:11.535240 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-2f9b8d00-5c3d-4c95-9acc-d39d73425368 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "name": "ds1G", "disk": 10, "id": "d2", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:11.557863 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-2f9b8d00-5c3d-4c95-9acc-d39d73425368 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.597970 Jul 25 12:29:11.561871 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 25 12:29:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:29:11.572695 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-db9039ac-ca5a-4d7f-a0b0-7ecf8fb05bd7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:11.603115 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-db9039ac-ca5a-4d7f-a0b0-7ecf8fb05bd7 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035032 Jul 25 12:29:11.612154 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1335 bytes} [Mon Jul 25 12:29:11 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:29:14.031558 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-2f9b8d00-5c3d-4c95-9acc-d39d73425368 admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:14.032592 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-2f9b8d00-5c3d-4c95-9acc-d39d73425368 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Jul 25 12:29:14.032994 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 25 12:29:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:29:14.427018 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-c50a1d5f-ba95-4057-915e-d3bfabaa76a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "rxtx_factor": 1.0, "swap": 0, "name": "ds2G", "disk": 10}} {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:14.452993 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-c50a1d5f-ba95-4057-915e-d3bfabaa76a1 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.413507 Jul 25 12:29:14.466592 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-f13f3fe3-9083-4606-9adf-71408b012f96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:14.474556 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 25 12:29:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:29:14.503289 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-f13f3fe3-9083-4606-9adf-71408b012f96 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041231 Jul 25 12:29:14.506450 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1335 bytes} [Mon Jul 25 12:29:14 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:29:16.743086 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-c50a1d5f-ba95-4057-915e-d3bfabaa76a1 admin admin] Calling method '>' {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:16.744045 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-c50a1d5f-ba95-4057-915e-d3bfabaa76a1 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Jul 25 12:29:16.744463 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 25 12:29:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:29:17.209491 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-10c4b517-bf45-4dd8-80a8-9d4d7dd1fd1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 4, "os-flavor-access:is_public": true, "id": "d4", "disk": 20, "swap": 0}} {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:17.230540 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-10c4b517-bf45-4dd8-80a8-9d4d7dd1fd1d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.480314 Jul 25 12:29:17.238305 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 25 12:29:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:29:17.243647 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-8bd280c1-1da6-407d-9212-743a74287ff9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:17.274473 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-8bd280c1-1da6-407d-9212-743a74287ff9 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034659 Jul 25 12:29:17.275219 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1335 bytes} [Mon Jul 25 12:29:17 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:29:19.500776 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-10c4b517-bf45-4dd8-80a8-9d4d7dd1fd1d admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:19.502584 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-10c4b517-bf45-4dd8-80a8-9d4d7dd1fd1d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002356 Jul 25 12:29:19.508252 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 25 12:29:19 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:29:19.983766 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-7e9cd61a-2e59-4c1a-8e18-fc296d7fc8ea admin admin] Calling method '>' {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:20.017370 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-7e9cd61a-2e59-4c1a-8e18-fc296d7fc8ea admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.507708 Jul 25 12:29:20.026817 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1291 bytes} [Mon Jul 25 12:29:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:29:22.290604 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-10c4b517-bf45-4dd8-80a8-9d4d7dd1fd1d admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:22.291586 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-10c4b517-bf45-4dd8-80a8-9d4d7dd1fd1d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001728 Jul 25 12:29:22.292041 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 25 12:29:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:29:22.794752 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-32c0d0e5-7d13-40d4-b355-58df034bece0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "ram": 512}} {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:22.815868 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-32c0d0e5-7d13-40d4-b355-58df034bece0 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.517286 Jul 25 12:29:22.816682 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 25 12:29:22 2022] POST /compute/v2.1/flavors => generated 402 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:29:22.829643 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-f910257c-aa50-4307-a4a1-8f0fd6924564 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:22.857124 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-f910257c-aa50-4307-a4a1-8f0fd6924564 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031665 Jul 25 12:29:22.857753 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1332 bytes} [Mon Jul 25 12:29:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:29:25.071023 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-32c0d0e5-7d13-40d4-b355-58df034bece0 admin admin] Calling method '>' {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:25.072130 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-32c0d0e5-7d13-40d4-b355-58df034bece0 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001647 Jul 25 12:29:25.072556 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 25 12:29:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:29:25.514134 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-0285010a-adfe-4f85-a62a-14693e20bdca admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "name": "m1.small", "id": "2", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:25.535014 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-0285010a-adfe-4f85-a62a-14693e20bdca admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.456337 Jul 25 12:29:25.535818 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 25 12:29:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:29:25.548937 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-5c6a6ced-6857-4964-b892-cac4a0e4b8b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:25.573416 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-5c6a6ced-6857-4964-b892-cac4a0e4b8b7 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028469 Jul 25 12:29:25.574029 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1332 bytes} [Mon Jul 25 12:29:25 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:29:27.815680 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-0285010a-adfe-4f85-a62a-14693e20bdca admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:27.816875 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-0285010a-adfe-4f85-a62a-14693e20bdca admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Jul 25 12:29:27.817348 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 25 12:29:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:29:28.220831 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-1e2a4938-0281-49a7-b939-4e2fe837e043 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "vcpus": 2, "name": "m1.medium", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:28.241861 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-1e2a4938-0281-49a7-b939-4e2fe837e043 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.418632 Jul 25 12:29:28.242423 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 25 12:29:27 2022] POST /compute/v2.1/flavors => generated 406 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:29:28.254577 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-d32f0757-1b6d-48e2-89e8-bca23b53bb23 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:28.280644 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-d32f0757-1b6d-48e2-89e8-bca23b53bb23 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029710 Jul 25 12:29:28.281235 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1332 bytes} [Mon Jul 25 12:29:28 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:29:30.468446 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-1e2a4938-0281-49a7-b939-4e2fe837e043 admin admin] Calling method '>' {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:30.469457 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-1e2a4938-0281-49a7-b939-4e2fe837e043 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 25 12:29:30.470086 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 25 12:29:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:29:30.902756 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-11f90f83-5a6c-4c30-a44a-880aa6433112 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "swap": 0, "disk": 80, "id": "4", "ram": 8192}} {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:30.922167 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-11f90f83-5a6c-4c30-a44a-880aa6433112 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.446245 Jul 25 12:29:30.922763 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 25 12:29:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:29:30.935161 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-c5ac35f3-ab78-4ede-b210-34ae677f77f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:30.960940 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-c5ac35f3-ab78-4ede-b210-34ae677f77f9 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029680 Jul 25 12:29:30.961598 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1332 bytes} [Mon Jul 25 12:29:30 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:29:33.345700 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-11f90f83-5a6c-4c30-a44a-880aa6433112 admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:33.346681 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-11f90f83-5a6c-4c30-a44a-880aa6433112 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Jul 25 12:29:33.347078 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 25 12:29:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:29:33.772410 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-10928b80-7435-4053-b654-731752d4bf91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "disk": 160, "name": "m1.xlarge", "os-flavor-access:is_public": true, "id": "5"}} {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:33.796262 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-10928b80-7435-4053-b654-731752d4bf91 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.443200 Jul 25 12:29:33.797096 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 25 12:29:33 2022] POST /compute/v2.1/flavors => generated 408 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:29:33.809189 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-4a885269-e4b8-4ba7-9188-d928d3bf38a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:33.818012 n-d-848886-15 devstack@n-api.service[104097]: DEBUG dbcounter [-] [104097] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=104097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:29:33.836050 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-4a885269-e4b8-4ba7-9188-d928d3bf38a7 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030668 Jul 25 12:29:33.836868 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1332 bytes} [Mon Jul 25 12:29:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:29:57.547124 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-10928b80-7435-4053-b654-731752d4bf91 admin admin] Calling method '>' {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:57.548155 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-10928b80-7435-4053-b654-731752d4bf91 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 25 12:29:57.548537 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 25 12:29:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:29:57.559104 n-d-848886-15 devstack@n-api.service[104097]: DEBUG dbcounter [-] [104097] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=104097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:29:57.979214 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-08ac9e84-f98b-4ff7-944d-fe6d48032930 admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:57.997133 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-08ac9e84-f98b-4ff7-944d-fe6d48032930 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.442516 Jul 25 12:29:57.997654 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1291 bytes} [Mon Jul 25 12:29:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:29:59.079300 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-10928b80-7435-4053-b654-731752d4bf91 admin admin] Calling method '>' {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:59.080631 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-10928b80-7435-4053-b654-731752d4bf91 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001853 Jul 25 12:29:59.081119 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 25 12:29:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:29:59.651401 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-a3d87a91-1c06-4ab0-ab19-28487080475b admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:59.659912 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.wsgi [None req-a3d87a91-1c06-4ab0-ab19-28487080475b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 12:29:59.665378 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-a3d87a91-1c06-4ab0-ab19-28487080475b admin admin] Request method failure captured: Jul 25 12:29:59.665378 n-d-848886-15 devstack@n-api.service[104097]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 12:29:59.665378 n-d-848886-15 devstack@n-api.service[104097]: Accept: application/json Jul 25 12:29:59.665378 n-d-848886-15 devstack@n-api.service[104097]: Accept-Encoding: gzip, deflate Jul 25 12:29:59.665378 n-d-848886-15 devstack@n-api.service[104097]: Connection: keep-alive Jul 25 12:29:59.665378 n-d-848886-15 devstack@n-api.service[104097]: Content-Length: 0 Jul 25 12:29:59.665378 n-d-848886-15 devstack@n-api.service[104097]: Host: 10.222.0.49 Jul 25 12:29:59.665378 n-d-848886-15 devstack@n-api.service[104097]: Openstack-Api-Version: compute 2.90 Jul 25 12:29:59.665378 n-d-848886-15 devstack@n-api.service[104097]: Openstack-System-Scope: None Jul 25 12:29:59.665378 n-d-848886-15 devstack@n-api.service[104097]: User-Agent: python-novaclient Jul 25 12:29:59.665378 n-d-848886-15 devstack@n-api.service[104097]: X-Auth-Token: gAAAAABi3ozGtmblSG7RWRJufgH5Zt7AWlIJk_oabA3aDYT5BI2xfCnyWAPd1OclkRWFVT4TvTdOU00cn-uekhpz9YrS1qKhs_03WGw48-4VJShfdfoQZ9ZroMVL69zthzImjdLaKscW7cHcXeVENQtcByQxsmc6nY4llH37la4Vm5TWLUmrKS0 Jul 25 12:29:59.665378 n-d-848886-15 devstack@n-api.service[104097]: X-Domain-Id: None Jul 25 12:29:59.665378 n-d-848886-15 devstack@n-api.service[104097]: X-Domain-Name: None Jul 25 12:29:59.665378 n-d-848886-15 devstack@n-api.service[104097]: X-Identity-Status: Confirmed Jul 25 12:29:59.665378 n-d-848886-15 devstack@n-api.service[104097]: X-Is-Admin-Project: True Jul 25 12:29:59.665378 n-d-848886-15 devstack@n-api.service[104097]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 12:29:59.665378 n-d-848886-15 devstack@n-api.service[104097]: X-Project-Domain-Id: default Jul 25 12:29:59.665378 n-d-848886-15 devstack@n-api.service[104097]: X-Project-Domain-Name: Default Jul 25 12:29:59.665378 n-d-848886-15 devstack@n-api.service[104097]: X-Project-Id: 9deaa296c3444e41a6b0e1a83a614213 Jul 25 12:29:59.665378 n-d-848886-15 devstack@n-api.service[104097]: X-Project-Name: admin Jul 25 12:29:59.665378 n-d-848886-15 devstack@n-api.service[104097]: X-Role: reader,admin,member Jul 25 12:29:59.665378 n-d-848886-15 devstack@n-api.service[104097]: X-Roles: reader,admin,member Jul 25 12:29:59.666947 n-d-848886-15 devstack@n-api.service[104097]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9deaa296c3444e41a6b0e1a83a614213", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9deaa296c3444e41a6b0e1a83a614213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9deaa296c3444e41a6b0e1a83a614213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9deaa296c3444e41a6b0e1a83a614213"}]}] Jul 25 12:29:59.666947 n-d-848886-15 devstack@n-api.service[104097]: X-Tenant: admin Jul 25 12:29:59.666947 n-d-848886-15 devstack@n-api.service[104097]: X-Tenant-Id: 9deaa296c3444e41a6b0e1a83a614213 Jul 25 12:29:59.666947 n-d-848886-15 devstack@n-api.service[104097]: X-Tenant-Name: admin Jul 25 12:29:59.666947 n-d-848886-15 devstack@n-api.service[104097]: X-User: admin Jul 25 12:29:59.666947 n-d-848886-15 devstack@n-api.service[104097]: X-User-Domain-Id: default Jul 25 12:29:59.666947 n-d-848886-15 devstack@n-api.service[104097]: X-User-Domain-Name: Default Jul 25 12:29:59.666947 n-d-848886-15 devstack@n-api.service[104097]: X-User-Id: e3793a524ef746688847532c50ff0047 Jul 25 12:29:59.666947 n-d-848886-15 devstack@n-api.service[104097]: X-User-Name: admin Jul 25 12:29:59.666947 n-d-848886-15 devstack@n-api.service[104097]: method: > Jul 25 12:29:59.666947 n-d-848886-15 devstack@n-api.service[104097]: exception: Flavor 42 could not be found. Jul 25 12:29:59.666947 n-d-848886-15 devstack@n-api.service[104097]: action_args: {'id': '42'} Jul 25 12:29:59.666947 n-d-848886-15 devstack@n-api.service[104097]: {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:29:59.666947 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:29:59.668089 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 12:29:59.668089 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 12:29:59.668089 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 12:29:59.668089 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 12:29:59.668089 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:29:59.668089 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:29:59.668089 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 12:29:59.668089 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 12:29:59.668089 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 12:29:59.668089 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:29:59.668089 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 12:29:59.668089 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 12:29:59.668089 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 12:29:59.668089 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Jul 25 12:29:59.668089 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:29:59.668089 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Jul 25 12:29:59.668089 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:29:59.668089 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:29:59.668089 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:29:59.669759 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:29:59.669759 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:29:59.669759 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:29:59.669759 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:29:59.669759 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 12:29:59.669759 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:29:59.669759 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 12:29:59.669759 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Jul 25 12:29:59.669759 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:29:59.669759 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Jul 25 12:29:59.669759 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:29:59.669759 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:29:59.669759 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:29:59.669759 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:29:59.669759 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:29:59.669759 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 12:29:59.669759 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Jul 25 12:29:59.669759 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-a3d87a91-1c06-4ab0-ab19-28487080475b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:29:59.671310 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-a3d87a91-1c06-4ab0-ab19-28487080475b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.432241 Jul 25 12:29:59.671310 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Jul 25 12:29:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 434 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:29:59.676947 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-ed1196fc-0570-49b4-a01c-51dca1ab4212 admin admin] Calling method '>' {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:59.681069 n-d-848886-15 devstack@n-api.service[104096]: DEBUG dbcounter [-] [104096] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:29:59.706029 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-ed1196fc-0570-49b4-a01c-51dca1ab4212 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.032547 Jul 25 12:29:59.706820 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Jul 25 12:29:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:29:59.728094 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-7d24ebee-e712-435c-acb1-1877741201bb admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:59.752239 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-7d24ebee-e712-435c-acb1-1877741201bb admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027890 Jul 25 12:29:59.752777 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Jul 25 12:29:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:29:59.765155 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-3a1346b2-6fe1-4192-a942-19cc53086d0e admin admin] Calling method '>' {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:59.772714 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.wsgi [None req-3a1346b2-6fe1-4192-a942-19cc53086d0e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 12:29:59.775972 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-3a1346b2-6fe1-4192-a942-19cc53086d0e admin admin] Request method failure captured: Jul 25 12:29:59.775972 n-d-848886-15 devstack@n-api.service[104096]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 12:29:59.775972 n-d-848886-15 devstack@n-api.service[104096]: Accept: application/json Jul 25 12:29:59.775972 n-d-848886-15 devstack@n-api.service[104096]: Accept-Encoding: gzip, deflate Jul 25 12:29:59.775972 n-d-848886-15 devstack@n-api.service[104096]: Connection: keep-alive Jul 25 12:29:59.775972 n-d-848886-15 devstack@n-api.service[104096]: Content-Length: 0 Jul 25 12:29:59.775972 n-d-848886-15 devstack@n-api.service[104096]: Host: 10.222.0.49 Jul 25 12:29:59.775972 n-d-848886-15 devstack@n-api.service[104096]: Openstack-Api-Version: compute 2.90 Jul 25 12:29:59.775972 n-d-848886-15 devstack@n-api.service[104096]: Openstack-System-Scope: None Jul 25 12:29:59.775972 n-d-848886-15 devstack@n-api.service[104096]: User-Agent: python-novaclient Jul 25 12:29:59.775972 n-d-848886-15 devstack@n-api.service[104096]: X-Auth-Token: gAAAAABi3ozGtmblSG7RWRJufgH5Zt7AWlIJk_oabA3aDYT5BI2xfCnyWAPd1OclkRWFVT4TvTdOU00cn-uekhpz9YrS1qKhs_03WGw48-4VJShfdfoQZ9ZroMVL69zthzImjdLaKscW7cHcXeVENQtcByQxsmc6nY4llH37la4Vm5TWLUmrKS0 Jul 25 12:29:59.775972 n-d-848886-15 devstack@n-api.service[104096]: X-Domain-Id: None Jul 25 12:29:59.775972 n-d-848886-15 devstack@n-api.service[104096]: X-Domain-Name: None Jul 25 12:29:59.775972 n-d-848886-15 devstack@n-api.service[104096]: X-Identity-Status: Confirmed Jul 25 12:29:59.775972 n-d-848886-15 devstack@n-api.service[104096]: X-Is-Admin-Project: True Jul 25 12:29:59.775972 n-d-848886-15 devstack@n-api.service[104096]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 12:29:59.775972 n-d-848886-15 devstack@n-api.service[104096]: X-Project-Domain-Id: default Jul 25 12:29:59.775972 n-d-848886-15 devstack@n-api.service[104096]: X-Project-Domain-Name: Default Jul 25 12:29:59.775972 n-d-848886-15 devstack@n-api.service[104096]: X-Project-Id: 9deaa296c3444e41a6b0e1a83a614213 Jul 25 12:29:59.775972 n-d-848886-15 devstack@n-api.service[104096]: X-Project-Name: admin Jul 25 12:29:59.775972 n-d-848886-15 devstack@n-api.service[104096]: X-Role: reader,admin,member Jul 25 12:29:59.775972 n-d-848886-15 devstack@n-api.service[104096]: X-Roles: reader,admin,member Jul 25 12:29:59.777463 n-d-848886-15 devstack@n-api.service[104096]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9deaa296c3444e41a6b0e1a83a614213", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9deaa296c3444e41a6b0e1a83a614213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9deaa296c3444e41a6b0e1a83a614213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9deaa296c3444e41a6b0e1a83a614213"}]}] Jul 25 12:29:59.777463 n-d-848886-15 devstack@n-api.service[104096]: X-Tenant: admin Jul 25 12:29:59.777463 n-d-848886-15 devstack@n-api.service[104096]: X-Tenant-Id: 9deaa296c3444e41a6b0e1a83a614213 Jul 25 12:29:59.777463 n-d-848886-15 devstack@n-api.service[104096]: X-Tenant-Name: admin Jul 25 12:29:59.777463 n-d-848886-15 devstack@n-api.service[104096]: X-User: admin Jul 25 12:29:59.777463 n-d-848886-15 devstack@n-api.service[104096]: X-User-Domain-Id: default Jul 25 12:29:59.777463 n-d-848886-15 devstack@n-api.service[104096]: X-User-Domain-Name: Default Jul 25 12:29:59.777463 n-d-848886-15 devstack@n-api.service[104096]: X-User-Id: e3793a524ef746688847532c50ff0047 Jul 25 12:29:59.777463 n-d-848886-15 devstack@n-api.service[104096]: X-User-Name: admin Jul 25 12:29:59.777463 n-d-848886-15 devstack@n-api.service[104096]: method: > Jul 25 12:29:59.777463 n-d-848886-15 devstack@n-api.service[104096]: exception: Flavor 42 could not be found. Jul 25 12:29:59.777463 n-d-848886-15 devstack@n-api.service[104096]: action_args: {'id': '42'} Jul 25 12:29:59.777463 n-d-848886-15 devstack@n-api.service[104096]: {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:29:59.777463 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:29:59.778446 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 12:29:59.778446 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 12:29:59.778446 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 12:29:59.778446 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 12:29:59.778446 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:29:59.778446 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:29:59.778446 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 12:29:59.778446 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 12:29:59.778446 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 12:29:59.778446 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:29:59.778446 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 12:29:59.778446 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 12:29:59.778446 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 12:29:59.778446 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Jul 25 12:29:59.778446 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:29:59.778446 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Jul 25 12:29:59.778446 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:29:59.778446 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:29:59.778446 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:29:59.779709 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:29:59.779709 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:29:59.779709 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:29:59.779709 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:29:59.779709 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 12:29:59.779709 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:29:59.779709 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 12:29:59.779709 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Jul 25 12:29:59.779709 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:29:59.779709 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Jul 25 12:29:59.779709 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:29:59.779709 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:29:59.779709 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:29:59.779709 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:29:59.779709 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:29:59.779709 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 12:29:59.779709 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Jul 25 12:29:59.779709 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-3a1346b2-6fe1-4192-a942-19cc53086d0e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:29:59.780936 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-3a1346b2-6fe1-4192-a942-19cc53086d0e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.018337 Jul 25 12:29:59.780936 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Jul 25 12:29:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:30:00.742486 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-7d24ebee-e712-435c-acb1-1877741201bb admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:30:00.743505 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-7d24ebee-e712-435c-acb1-1877741201bb admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jul 25 12:30:00.743892 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 25 12:30:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:30:01.300538 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-d1c62114-285f-450b-a103-26589248b405 admin admin] Calling method '>' {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:30:01.306394 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.wsgi [None req-d1c62114-285f-450b-a103-26589248b405 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 12:30:01.307916 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-d1c62114-285f-450b-a103-26589248b405 admin admin] Request method failure captured: Jul 25 12:30:01.307916 n-d-848886-15 devstack@n-api.service[104096]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 12:30:01.307916 n-d-848886-15 devstack@n-api.service[104096]: Accept: application/json Jul 25 12:30:01.307916 n-d-848886-15 devstack@n-api.service[104096]: Accept-Encoding: gzip, deflate Jul 25 12:30:01.307916 n-d-848886-15 devstack@n-api.service[104096]: Connection: keep-alive Jul 25 12:30:01.307916 n-d-848886-15 devstack@n-api.service[104096]: Content-Length: 0 Jul 25 12:30:01.307916 n-d-848886-15 devstack@n-api.service[104096]: Host: 10.222.0.49 Jul 25 12:30:01.307916 n-d-848886-15 devstack@n-api.service[104096]: Openstack-Api-Version: compute 2.90 Jul 25 12:30:01.307916 n-d-848886-15 devstack@n-api.service[104096]: Openstack-System-Scope: None Jul 25 12:30:01.307916 n-d-848886-15 devstack@n-api.service[104096]: User-Agent: python-novaclient Jul 25 12:30:01.307916 n-d-848886-15 devstack@n-api.service[104096]: X-Auth-Token: gAAAAABi3ozIvgtEcSQfkQXb00HfGUOC1tOVBI8l-LT-ZxyTMmyOZQsiJPv0-4RGzPShNu30yN_klmhDkiBugZSCmEkjKmkay9Fv3-nOCE5U-xjaouUJ-LnVYKReTHwBJsRqyPy0ZoaI7ehsEF-b_S4pgMwzftmNcuBw059SlOyAAHztnpNNUoQ Jul 25 12:30:01.307916 n-d-848886-15 devstack@n-api.service[104096]: X-Domain-Id: None Jul 25 12:30:01.307916 n-d-848886-15 devstack@n-api.service[104096]: X-Domain-Name: None Jul 25 12:30:01.307916 n-d-848886-15 devstack@n-api.service[104096]: X-Identity-Status: Confirmed Jul 25 12:30:01.307916 n-d-848886-15 devstack@n-api.service[104096]: X-Is-Admin-Project: True Jul 25 12:30:01.307916 n-d-848886-15 devstack@n-api.service[104096]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 12:30:01.307916 n-d-848886-15 devstack@n-api.service[104096]: X-Project-Domain-Id: default Jul 25 12:30:01.307916 n-d-848886-15 devstack@n-api.service[104096]: X-Project-Domain-Name: Default Jul 25 12:30:01.307916 n-d-848886-15 devstack@n-api.service[104096]: X-Project-Id: 9deaa296c3444e41a6b0e1a83a614213 Jul 25 12:30:01.307916 n-d-848886-15 devstack@n-api.service[104096]: X-Project-Name: admin Jul 25 12:30:01.307916 n-d-848886-15 devstack@n-api.service[104096]: X-Role: reader,admin,member Jul 25 12:30:01.307916 n-d-848886-15 devstack@n-api.service[104096]: X-Roles: reader,admin,member Jul 25 12:30:01.309492 n-d-848886-15 devstack@n-api.service[104096]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9deaa296c3444e41a6b0e1a83a614213", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9deaa296c3444e41a6b0e1a83a614213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9deaa296c3444e41a6b0e1a83a614213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9deaa296c3444e41a6b0e1a83a614213"}]}] Jul 25 12:30:01.309492 n-d-848886-15 devstack@n-api.service[104096]: X-Tenant: admin Jul 25 12:30:01.309492 n-d-848886-15 devstack@n-api.service[104096]: X-Tenant-Id: 9deaa296c3444e41a6b0e1a83a614213 Jul 25 12:30:01.309492 n-d-848886-15 devstack@n-api.service[104096]: X-Tenant-Name: admin Jul 25 12:30:01.309492 n-d-848886-15 devstack@n-api.service[104096]: X-User: admin Jul 25 12:30:01.309492 n-d-848886-15 devstack@n-api.service[104096]: X-User-Domain-Id: default Jul 25 12:30:01.309492 n-d-848886-15 devstack@n-api.service[104096]: X-User-Domain-Name: Default Jul 25 12:30:01.309492 n-d-848886-15 devstack@n-api.service[104096]: X-User-Id: e3793a524ef746688847532c50ff0047 Jul 25 12:30:01.309492 n-d-848886-15 devstack@n-api.service[104096]: X-User-Name: admin Jul 25 12:30:01.309492 n-d-848886-15 devstack@n-api.service[104096]: method: > Jul 25 12:30:01.309492 n-d-848886-15 devstack@n-api.service[104096]: exception: Flavor 84 could not be found. Jul 25 12:30:01.309492 n-d-848886-15 devstack@n-api.service[104096]: action_args: {'id': '84'} Jul 25 12:30:01.309492 n-d-848886-15 devstack@n-api.service[104096]: {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:30:01.309492 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:30:01.310359 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 12:30:01.310359 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 12:30:01.310359 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 12:30:01.310359 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 12:30:01.310359 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:30:01.310359 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:30:01.310359 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 12:30:01.310359 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 12:30:01.310359 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 12:30:01.310359 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:30:01.310359 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 12:30:01.310359 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 12:30:01.310359 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 12:30:01.310359 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Jul 25 12:30:01.310359 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:30:01.310359 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Jul 25 12:30:01.310359 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:30:01.310359 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:30:01.310359 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:30:01.311493 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:30:01.311493 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:30:01.311493 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:30:01.311493 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:30:01.311493 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 12:30:01.311493 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:30:01.311493 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 12:30:01.311493 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Jul 25 12:30:01.311493 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:30:01.311493 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Jul 25 12:30:01.311493 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:30:01.311493 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:30:01.311493 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:30:01.311493 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:30:01.311493 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:30:01.311493 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 12:30:01.311493 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Jul 25 12:30:01.311493 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-d1c62114-285f-450b-a103-26589248b405 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:30:01.312511 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-d1c62114-285f-450b-a103-26589248b405 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.432007 Jul 25 12:30:01.312511 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Jul 25 12:30:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:30:01.319298 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-a3690908-97d0-41ce-9f05-91766a7683dc admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:30:01.334618 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-a3690908-97d0-41ce-9f05-91766a7683dc admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019036 Jul 25 12:30:01.335177 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Jul 25 12:30:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:30:01.344913 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-f3bf0501-5216-4cc8-85f8-275dc5476e47 admin admin] Calling method '>' {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:30:01.361905 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-f3bf0501-5216-4cc8-85f8-275dc5476e47 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020530 Jul 25 12:30:01.362478 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Jul 25 12:30:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:30:01.372070 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-5a60c910-426d-4131-b693-9ba789e33cac admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:30:01.377591 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.wsgi [None req-5a60c910-426d-4131-b693-9ba789e33cac admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 12:30:01.379346 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-5a60c910-426d-4131-b693-9ba789e33cac admin admin] Request method failure captured: Jul 25 12:30:01.379346 n-d-848886-15 devstack@n-api.service[104097]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 12:30:01.379346 n-d-848886-15 devstack@n-api.service[104097]: Accept: application/json Jul 25 12:30:01.379346 n-d-848886-15 devstack@n-api.service[104097]: Accept-Encoding: gzip, deflate Jul 25 12:30:01.379346 n-d-848886-15 devstack@n-api.service[104097]: Connection: keep-alive Jul 25 12:30:01.379346 n-d-848886-15 devstack@n-api.service[104097]: Content-Length: 0 Jul 25 12:30:01.379346 n-d-848886-15 devstack@n-api.service[104097]: Host: 10.222.0.49 Jul 25 12:30:01.379346 n-d-848886-15 devstack@n-api.service[104097]: Openstack-Api-Version: compute 2.90 Jul 25 12:30:01.379346 n-d-848886-15 devstack@n-api.service[104097]: Openstack-System-Scope: None Jul 25 12:30:01.379346 n-d-848886-15 devstack@n-api.service[104097]: User-Agent: python-novaclient Jul 25 12:30:01.379346 n-d-848886-15 devstack@n-api.service[104097]: X-Auth-Token: gAAAAABi3ozIvgtEcSQfkQXb00HfGUOC1tOVBI8l-LT-ZxyTMmyOZQsiJPv0-4RGzPShNu30yN_klmhDkiBugZSCmEkjKmkay9Fv3-nOCE5U-xjaouUJ-LnVYKReTHwBJsRqyPy0ZoaI7ehsEF-b_S4pgMwzftmNcuBw059SlOyAAHztnpNNUoQ Jul 25 12:30:01.379346 n-d-848886-15 devstack@n-api.service[104097]: X-Domain-Id: None Jul 25 12:30:01.379346 n-d-848886-15 devstack@n-api.service[104097]: X-Domain-Name: None Jul 25 12:30:01.379346 n-d-848886-15 devstack@n-api.service[104097]: X-Identity-Status: Confirmed Jul 25 12:30:01.379346 n-d-848886-15 devstack@n-api.service[104097]: X-Is-Admin-Project: True Jul 25 12:30:01.379346 n-d-848886-15 devstack@n-api.service[104097]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 12:30:01.379346 n-d-848886-15 devstack@n-api.service[104097]: X-Project-Domain-Id: default Jul 25 12:30:01.379346 n-d-848886-15 devstack@n-api.service[104097]: X-Project-Domain-Name: Default Jul 25 12:30:01.379346 n-d-848886-15 devstack@n-api.service[104097]: X-Project-Id: 9deaa296c3444e41a6b0e1a83a614213 Jul 25 12:30:01.379346 n-d-848886-15 devstack@n-api.service[104097]: X-Project-Name: admin Jul 25 12:30:01.379346 n-d-848886-15 devstack@n-api.service[104097]: X-Role: reader,admin,member Jul 25 12:30:01.379346 n-d-848886-15 devstack@n-api.service[104097]: X-Roles: reader,admin,member Jul 25 12:30:01.380812 n-d-848886-15 devstack@n-api.service[104097]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9deaa296c3444e41a6b0e1a83a614213", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9deaa296c3444e41a6b0e1a83a614213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9deaa296c3444e41a6b0e1a83a614213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9deaa296c3444e41a6b0e1a83a614213"}]}] Jul 25 12:30:01.380812 n-d-848886-15 devstack@n-api.service[104097]: X-Tenant: admin Jul 25 12:30:01.380812 n-d-848886-15 devstack@n-api.service[104097]: X-Tenant-Id: 9deaa296c3444e41a6b0e1a83a614213 Jul 25 12:30:01.380812 n-d-848886-15 devstack@n-api.service[104097]: X-Tenant-Name: admin Jul 25 12:30:01.380812 n-d-848886-15 devstack@n-api.service[104097]: X-User: admin Jul 25 12:30:01.380812 n-d-848886-15 devstack@n-api.service[104097]: X-User-Domain-Id: default Jul 25 12:30:01.380812 n-d-848886-15 devstack@n-api.service[104097]: X-User-Domain-Name: Default Jul 25 12:30:01.380812 n-d-848886-15 devstack@n-api.service[104097]: X-User-Id: e3793a524ef746688847532c50ff0047 Jul 25 12:30:01.380812 n-d-848886-15 devstack@n-api.service[104097]: X-User-Name: admin Jul 25 12:30:01.380812 n-d-848886-15 devstack@n-api.service[104097]: method: > Jul 25 12:30:01.380812 n-d-848886-15 devstack@n-api.service[104097]: exception: Flavor 84 could not be found. Jul 25 12:30:01.380812 n-d-848886-15 devstack@n-api.service[104097]: action_args: {'id': '84'} Jul 25 12:30:01.380812 n-d-848886-15 devstack@n-api.service[104097]: {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:30:01.380812 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:30:01.381696 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 12:30:01.381696 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 12:30:01.381696 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 12:30:01.381696 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 12:30:01.381696 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:30:01.381696 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:30:01.381696 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 12:30:01.381696 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 12:30:01.381696 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 12:30:01.381696 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:30:01.381696 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 12:30:01.381696 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 12:30:01.381696 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 12:30:01.381696 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Jul 25 12:30:01.381696 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:30:01.381696 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Jul 25 12:30:01.381696 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:30:01.381696 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:30:01.381696 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:30:01.383087 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:30:01.383087 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:30:01.383087 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:30:01.383087 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:30:01.383087 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 12:30:01.383087 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:30:01.383087 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 12:30:01.383087 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Jul 25 12:30:01.383087 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:30:01.383087 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Jul 25 12:30:01.383087 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:30:01.383087 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:30:01.383087 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:30:01.383087 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:30:01.383087 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:30:01.383087 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 12:30:01.383087 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Jul 25 12:30:01.383087 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-5a60c910-426d-4131-b693-9ba789e33cac admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:30:01.384316 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-5a60c910-426d-4131-b693-9ba789e33cac admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012283 Jul 25 12:30:01.384316 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Jul 25 12:30:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 25 12:30:02.363540 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-f3bf0501-5216-4cc8-85f8-275dc5476e47 admin admin] Calling method '>' {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:30:02.364774 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-f3bf0501-5216-4cc8-85f8-275dc5476e47 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001987 Jul 25 12:30:02.365303 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 25 12:30:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:30:02.914405 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-79a3e533-4eb0-4241-a12e-fff6ff696abb admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:30:02.920444 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.wsgi [None req-79a3e533-4eb0-4241-a12e-fff6ff696abb admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 12:30:02.921982 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-79a3e533-4eb0-4241-a12e-fff6ff696abb admin admin] Request method failure captured: Jul 25 12:30:02.921982 n-d-848886-15 devstack@n-api.service[104097]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 12:30:02.921982 n-d-848886-15 devstack@n-api.service[104097]: Accept: application/json Jul 25 12:30:02.921982 n-d-848886-15 devstack@n-api.service[104097]: Accept-Encoding: gzip, deflate Jul 25 12:30:02.921982 n-d-848886-15 devstack@n-api.service[104097]: Connection: keep-alive Jul 25 12:30:02.921982 n-d-848886-15 devstack@n-api.service[104097]: Content-Length: 0 Jul 25 12:30:02.921982 n-d-848886-15 devstack@n-api.service[104097]: Host: 10.222.0.49 Jul 25 12:30:02.921982 n-d-848886-15 devstack@n-api.service[104097]: Openstack-Api-Version: compute 2.90 Jul 25 12:30:02.921982 n-d-848886-15 devstack@n-api.service[104097]: Openstack-System-Scope: None Jul 25 12:30:02.921982 n-d-848886-15 devstack@n-api.service[104097]: User-Agent: python-novaclient Jul 25 12:30:02.921982 n-d-848886-15 devstack@n-api.service[104097]: X-Auth-Token: gAAAAABi3ozKBGEuhL65CQWMetdveQf8g-XQpPSLhRx69HPN87-vdlqpgJbETUA9-clplu2RU9nNlPJqlh9gsUW59ozOm_IypXPObQ8LGkOT8COdzbpWjBnGpaym7rYtW858gNwin84PzKALRLlRuX3w9fR9g98Ij0rsmvoDHLqYoVsZLh8bfLc Jul 25 12:30:02.921982 n-d-848886-15 devstack@n-api.service[104097]: X-Domain-Id: None Jul 25 12:30:02.921982 n-d-848886-15 devstack@n-api.service[104097]: X-Domain-Name: None Jul 25 12:30:02.921982 n-d-848886-15 devstack@n-api.service[104097]: X-Identity-Status: Confirmed Jul 25 12:30:02.921982 n-d-848886-15 devstack@n-api.service[104097]: X-Is-Admin-Project: True Jul 25 12:30:02.921982 n-d-848886-15 devstack@n-api.service[104097]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 12:30:02.921982 n-d-848886-15 devstack@n-api.service[104097]: X-Project-Domain-Id: default Jul 25 12:30:02.921982 n-d-848886-15 devstack@n-api.service[104097]: X-Project-Domain-Name: Default Jul 25 12:30:02.921982 n-d-848886-15 devstack@n-api.service[104097]: X-Project-Id: 9deaa296c3444e41a6b0e1a83a614213 Jul 25 12:30:02.921982 n-d-848886-15 devstack@n-api.service[104097]: X-Project-Name: admin Jul 25 12:30:02.921982 n-d-848886-15 devstack@n-api.service[104097]: X-Role: reader,admin,member Jul 25 12:30:02.921982 n-d-848886-15 devstack@n-api.service[104097]: X-Roles: reader,admin,member Jul 25 12:30:02.923640 n-d-848886-15 devstack@n-api.service[104097]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9deaa296c3444e41a6b0e1a83a614213", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9deaa296c3444e41a6b0e1a83a614213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9deaa296c3444e41a6b0e1a83a614213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9deaa296c3444e41a6b0e1a83a614213"}]}] Jul 25 12:30:02.923640 n-d-848886-15 devstack@n-api.service[104097]: X-Tenant: admin Jul 25 12:30:02.923640 n-d-848886-15 devstack@n-api.service[104097]: X-Tenant-Id: 9deaa296c3444e41a6b0e1a83a614213 Jul 25 12:30:02.923640 n-d-848886-15 devstack@n-api.service[104097]: X-Tenant-Name: admin Jul 25 12:30:02.923640 n-d-848886-15 devstack@n-api.service[104097]: X-User: admin Jul 25 12:30:02.923640 n-d-848886-15 devstack@n-api.service[104097]: X-User-Domain-Id: default Jul 25 12:30:02.923640 n-d-848886-15 devstack@n-api.service[104097]: X-User-Domain-Name: Default Jul 25 12:30:02.923640 n-d-848886-15 devstack@n-api.service[104097]: X-User-Id: e3793a524ef746688847532c50ff0047 Jul 25 12:30:02.923640 n-d-848886-15 devstack@n-api.service[104097]: X-User-Name: admin Jul 25 12:30:02.923640 n-d-848886-15 devstack@n-api.service[104097]: method: > Jul 25 12:30:02.923640 n-d-848886-15 devstack@n-api.service[104097]: exception: Flavor 451 could not be found. Jul 25 12:30:02.923640 n-d-848886-15 devstack@n-api.service[104097]: action_args: {'id': '451'} Jul 25 12:30:02.923640 n-d-848886-15 devstack@n-api.service[104097]: {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:30:02.923640 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:30:02.924568 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 12:30:02.924568 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 12:30:02.924568 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 12:30:02.924568 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 12:30:02.924568 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:30:02.924568 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:30:02.924568 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 12:30:02.924568 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 12:30:02.924568 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 12:30:02.924568 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:30:02.924568 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 12:30:02.924568 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 12:30:02.924568 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 12:30:02.924568 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Jul 25 12:30:02.924568 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:30:02.924568 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Jul 25 12:30:02.924568 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:30:02.924568 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:30:02.924568 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:30:02.925792 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:30:02.925792 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:30:02.925792 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:30:02.925792 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:30:02.925792 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 12:30:02.925792 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:30:02.925792 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 12:30:02.925792 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Jul 25 12:30:02.925792 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:30:02.925792 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Jul 25 12:30:02.925792 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:30:02.925792 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:30:02.925792 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:30:02.925792 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:30:02.925792 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:30:02.925792 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 12:30:02.925792 n-d-848886-15 devstack@n-api.service[104097]: ERROR nova.api.openstack.wsgi Jul 25 12:30:02.925792 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-79a3e533-4eb0-4241-a12e-fff6ff696abb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:30:02.927157 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-79a3e533-4eb0-4241-a12e-fff6ff696abb admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.417724 Jul 25 12:30:02.927157 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Jul 25 12:30:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:30:02.933549 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-9e1390bd-eb8b-4b94-bdd9-12031d91f559 admin admin] Calling method '>' {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:30:02.948918 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-9e1390bd-eb8b-4b94-bdd9-12031d91f559 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019110 Jul 25 12:30:02.949433 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Jul 25 12:30:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:30:02.959104 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-7abfdf35-9c00-4b82-8186-6ad896b2a49a admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:30:02.975648 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-7abfdf35-9c00-4b82-8186-6ad896b2a49a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020124 Jul 25 12:30:02.976168 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Jul 25 12:30:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:30:02.985418 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-461116a4-95fc-4cae-aba5-c1b9a313aeb1 admin admin] Calling method '>' {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:30:02.990905 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.wsgi [None req-461116a4-95fc-4cae-aba5-c1b9a313aeb1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 12:30:02.992408 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-461116a4-95fc-4cae-aba5-c1b9a313aeb1 admin admin] Request method failure captured: Jul 25 12:30:02.992408 n-d-848886-15 devstack@n-api.service[104096]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 12:30:02.992408 n-d-848886-15 devstack@n-api.service[104096]: Accept: application/json Jul 25 12:30:02.992408 n-d-848886-15 devstack@n-api.service[104096]: Accept-Encoding: gzip, deflate Jul 25 12:30:02.992408 n-d-848886-15 devstack@n-api.service[104096]: Connection: keep-alive Jul 25 12:30:02.992408 n-d-848886-15 devstack@n-api.service[104096]: Content-Length: 0 Jul 25 12:30:02.992408 n-d-848886-15 devstack@n-api.service[104096]: Host: 10.222.0.49 Jul 25 12:30:02.992408 n-d-848886-15 devstack@n-api.service[104096]: Openstack-Api-Version: compute 2.90 Jul 25 12:30:02.992408 n-d-848886-15 devstack@n-api.service[104096]: Openstack-System-Scope: None Jul 25 12:30:02.992408 n-d-848886-15 devstack@n-api.service[104096]: User-Agent: python-novaclient Jul 25 12:30:02.992408 n-d-848886-15 devstack@n-api.service[104096]: X-Auth-Token: gAAAAABi3ozKBGEuhL65CQWMetdveQf8g-XQpPSLhRx69HPN87-vdlqpgJbETUA9-clplu2RU9nNlPJqlh9gsUW59ozOm_IypXPObQ8LGkOT8COdzbpWjBnGpaym7rYtW858gNwin84PzKALRLlRuX3w9fR9g98Ij0rsmvoDHLqYoVsZLh8bfLc Jul 25 12:30:02.992408 n-d-848886-15 devstack@n-api.service[104096]: X-Domain-Id: None Jul 25 12:30:02.992408 n-d-848886-15 devstack@n-api.service[104096]: X-Domain-Name: None Jul 25 12:30:02.992408 n-d-848886-15 devstack@n-api.service[104096]: X-Identity-Status: Confirmed Jul 25 12:30:02.992408 n-d-848886-15 devstack@n-api.service[104096]: X-Is-Admin-Project: True Jul 25 12:30:02.992408 n-d-848886-15 devstack@n-api.service[104096]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 12:30:02.992408 n-d-848886-15 devstack@n-api.service[104096]: X-Project-Domain-Id: default Jul 25 12:30:02.992408 n-d-848886-15 devstack@n-api.service[104096]: X-Project-Domain-Name: Default Jul 25 12:30:02.992408 n-d-848886-15 devstack@n-api.service[104096]: X-Project-Id: 9deaa296c3444e41a6b0e1a83a614213 Jul 25 12:30:02.992408 n-d-848886-15 devstack@n-api.service[104096]: X-Project-Name: admin Jul 25 12:30:02.992408 n-d-848886-15 devstack@n-api.service[104096]: X-Role: reader,admin,member Jul 25 12:30:02.992408 n-d-848886-15 devstack@n-api.service[104096]: X-Roles: reader,admin,member Jul 25 12:30:02.993905 n-d-848886-15 devstack@n-api.service[104096]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9deaa296c3444e41a6b0e1a83a614213", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9deaa296c3444e41a6b0e1a83a614213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9deaa296c3444e41a6b0e1a83a614213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9deaa296c3444e41a6b0e1a83a614213"}]}] Jul 25 12:30:02.993905 n-d-848886-15 devstack@n-api.service[104096]: X-Tenant: admin Jul 25 12:30:02.993905 n-d-848886-15 devstack@n-api.service[104096]: X-Tenant-Id: 9deaa296c3444e41a6b0e1a83a614213 Jul 25 12:30:02.993905 n-d-848886-15 devstack@n-api.service[104096]: X-Tenant-Name: admin Jul 25 12:30:02.993905 n-d-848886-15 devstack@n-api.service[104096]: X-User: admin Jul 25 12:30:02.993905 n-d-848886-15 devstack@n-api.service[104096]: X-User-Domain-Id: default Jul 25 12:30:02.993905 n-d-848886-15 devstack@n-api.service[104096]: X-User-Domain-Name: Default Jul 25 12:30:02.993905 n-d-848886-15 devstack@n-api.service[104096]: X-User-Id: e3793a524ef746688847532c50ff0047 Jul 25 12:30:02.993905 n-d-848886-15 devstack@n-api.service[104096]: X-User-Name: admin Jul 25 12:30:02.993905 n-d-848886-15 devstack@n-api.service[104096]: method: > Jul 25 12:30:02.993905 n-d-848886-15 devstack@n-api.service[104096]: exception: Flavor 451 could not be found. Jul 25 12:30:02.993905 n-d-848886-15 devstack@n-api.service[104096]: action_args: {'id': '451'} Jul 25 12:30:02.993905 n-d-848886-15 devstack@n-api.service[104096]: {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:30:02.993905 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:30:02.994936 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 12:30:02.994936 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 12:30:02.994936 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 12:30:02.994936 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 12:30:02.994936 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:30:02.994936 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:30:02.994936 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 12:30:02.994936 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 12:30:02.994936 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 12:30:02.994936 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:30:02.994936 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 12:30:02.994936 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 12:30:02.994936 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 12:30:02.994936 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Jul 25 12:30:02.994936 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:30:02.994936 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Jul 25 12:30:02.994936 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:30:02.994936 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:30:02.994936 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:30:02.996164 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:30:02.996164 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:30:02.996164 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:30:02.996164 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:30:02.996164 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 12:30:02.996164 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:30:02.996164 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 12:30:02.996164 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Jul 25 12:30:02.996164 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:30:02.996164 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Jul 25 12:30:02.996164 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:30:02.996164 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:30:02.996164 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:30:02.996164 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:30:02.996164 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:30:02.996164 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 12:30:02.996164 n-d-848886-15 devstack@n-api.service[104096]: ERROR nova.api.openstack.wsgi Jul 25 12:30:02.996164 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-461116a4-95fc-4cae-aba5-c1b9a313aeb1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:30:02.997419 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-461116a4-95fc-4cae-aba5-c1b9a313aeb1 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011914 Jul 25 12:30:02.997419 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Jul 25 12:30:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:30:03.985876 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-7abfdf35-9c00-4b82-8186-6ad896b2a49a admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:30:03.987194 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-7abfdf35-9c00-4b82-8186-6ad896b2a49a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001974 Jul 25 12:30:03.987788 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 25 12:30:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:30:04.538690 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-714225a7-564d-47a4-884d-17c48f80bea9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:30:04.559420 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-714225a7-564d-47a4-884d-17c48f80bea9 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.436977 Jul 25 12:30:04.559953 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Jul 25 12:30:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:30:05.533072 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-7abfdf35-9c00-4b82-8186-6ad896b2a49a admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:30:05.534237 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-7abfdf35-9c00-4b82-8186-6ad896b2a49a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jul 25 12:30:05.534645 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 25 12:30:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:30:06.085236 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-c3d7a15d-6e79-4974-81bd-8523b9964ecf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:30:06.110252 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-c3d7a15d-6e79-4974-81bd-8523b9964ecf admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.436533 Jul 25 12:30:06.110991 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Jul 25 12:30:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:30:07.103517 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-7abfdf35-9c00-4b82-8186-6ad896b2a49a admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:30:07.104526 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-7abfdf35-9c00-4b82-8186-6ad896b2a49a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 25 12:30:07.104896 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 25 12:30:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:30:07.662009 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-4758f277-6c85-4d6a-af7a-ac5b327e9694 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:30:07.683719 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-4758f277-6c85-4d6a-af7a-ac5b327e9694 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.444508 Jul 25 12:30:07.684236 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Jul 25 12:30:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:30:08.670515 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-7abfdf35-9c00-4b82-8186-6ad896b2a49a admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:30:08.671835 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-7abfdf35-9c00-4b82-8186-6ad896b2a49a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001979 Jul 25 12:30:08.672357 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 25 12:30:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:30:09.239595 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-c1561bd2-e194-4a87-9659-893d39394d50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:30:09.261027 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-c1561bd2-e194-4a87-9659-893d39394d50 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.450206 Jul 25 12:30:09.261570 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Jul 25 12:30:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:30:10.362430 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-7abfdf35-9c00-4b82-8186-6ad896b2a49a admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:30:10.363743 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-7abfdf35-9c00-4b82-8186-6ad896b2a49a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Jul 25 12:30:10.364084 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 25 12:30:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:30:10.931710 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-3f710f58-3aed-4c9e-9c89-e95d010f5179 admin admin] Calling method '>' {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:30:10.952876 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-3f710f58-3aed-4c9e-9c89-e95d010f5179 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.441563 Jul 25 12:30:10.953397 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Mon Jul 25 12:30:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:31:02.950364 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-7abfdf35-9c00-4b82-8186-6ad896b2a49a admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:31:02.951616 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-7abfdf35-9c00-4b82-8186-6ad896b2a49a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002032 Jul 25 12:31:02.952139 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 25 12:31:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:31:02.969203 n-d-848886-15 devstack@n-api.service[104096]: DEBUG dbcounter [-] [104096] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:03.370077 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-25b9b67b-006d-4370-818a-c3ad0d7d7b6e admin admin] Calling method '>' {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:31:03.390720 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-25b9b67b-006d-4370-818a-c3ad0d7d7b6e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.429850 Jul 25 12:31:03.391264 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1291 bytes} [Mon Jul 25 12:31:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:31:03.412509 n-d-848886-15 devstack@n-api.service[104097]: DEBUG dbcounter [-] [104097] Writing DB stats nova_api:SELECT=14 {{(pid=104097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:03.416399 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-c4d3014a-994f-4109-bfb6-d8fda3736d88 admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:31:03.424395 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-c4d3014a-994f-4109-bfb6-d8fda3736d88 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013300 Jul 25 12:31:03.424920 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 32/65] 10.222.0.49 () {60 vars in 1282 bytes} [Mon Jul 25 12:31:03 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:31:03.436608 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-00f7ef9a-fcb5-4304-a331-44e08bf5cb33 admin admin] Calling method '>' {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:31:03.444500 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-00f7ef9a-fcb5-4304-a331-44e08bf5cb33 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011553 Jul 25 12:31:03.445015 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1285 bytes} [Mon Jul 25 12:31:03 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:31:03.456248 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-74fb2c12-66c4-4753-a79d-d94bb0bbc596 admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:31:03.464359 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-74fb2c12-66c4-4753-a79d-d94bb0bbc596 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011708 Jul 25 12:31:03.464868 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1285 bytes} [Mon Jul 25 12:31:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:31:03.476403 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-d1bf4814-42f3-4fe7-83de-64c002deb414 admin admin] Calling method '>' {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:31:03.484472 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-d1bf4814-42f3-4fe7-83de-64c002deb414 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011624 Jul 25 12:31:03.484979 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1282 bytes} [Mon Jul 25 12:31:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:36:17.410071 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-74fb2c12-66c4-4753-a79d-d94bb0bbc596 admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:36:17.411099 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-74fb2c12-66c4-4753-a79d-d94bb0bbc596 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Jul 25 12:36:17.411497 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 25 12:36:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:36:17.550752 n-d-848886-15 devstack@n-api.service[104096]: DEBUG dbcounter [-] [104096] Writing DB stats nova_api:SELECT=6 {{(pid=104096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:36:17.708679 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-c32e74a9-4473-44df-bacd-e9035068b7a1 admin admin] Calling method '>' {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:36:17.711140 n-d-848886-15 devstack@n-api.service[104096]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:36:17.711140 n-d-848886-15 devstack@n-api.service[104096]: warnings.warn(msg) Jul 25 12:36:17.712344 n-d-848886-15 devstack@n-api.service[104096]: DEBUG oslo_concurrency.lockutils [None req-c32e74a9-4473-44df-bacd-e9035068b7a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:36:17.712750 n-d-848886-15 devstack@n-api.service[104096]: DEBUG oslo_concurrency.lockutils [None req-c32e74a9-4473-44df-bacd-e9035068b7a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:36:17.713559 n-d-848886-15 devstack@n-api.service[104096]: DEBUG oslo_concurrency.lockutils [None req-c32e74a9-4473-44df-bacd-e9035068b7a1 admin admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:36:17.714022 n-d-848886-15 devstack@n-api.service[104096]: DEBUG oslo_concurrency.lockutils [None req-c32e74a9-4473-44df-bacd-e9035068b7a1 admin admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:36:17.760767 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-c32e74a9-4473-44df-bacd-e9035068b7a1 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.211517 Jul 25 12:36:17.761370 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 36/70] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Jul 25 12:36:17 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:36:18.607883 n-d-848886-15 devstack@n-api.service[104097]: DEBUG nova.api.openstack.wsgi [None req-74fb2c12-66c4-4753-a79d-d94bb0bbc596 admin admin] Calling method '>' {{(pid=104097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:36:18.608907 n-d-848886-15 devstack@n-api.service[104097]: INFO nova.api.openstack.requestlog [None req-74fb2c12-66c4-4753-a79d-d94bb0bbc596 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 25 12:36:18.609297 n-d-848886-15 devstack@n-api.service[104097]: [pid: 104097|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 25 12:36:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:36:18.805662 n-d-848886-15 devstack@n-api.service[104096]: DEBUG nova.api.openstack.wsgi [None req-8c638e83-023c-44de-961c-5698f528a203 admin admin] Calling method '>' {{(pid=104096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:36:18.808188 n-d-848886-15 devstack@n-api.service[104096]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:36:18.808188 n-d-848886-15 devstack@n-api.service[104096]: warnings.warn(msg) Jul 25 12:36:18.809343 n-d-848886-15 devstack@n-api.service[104096]: DEBUG oslo_concurrency.lockutils [None req-8c638e83-023c-44de-961c-5698f528a203 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:36:18.809773 n-d-848886-15 devstack@n-api.service[104096]: DEBUG oslo_concurrency.lockutils [None req-8c638e83-023c-44de-961c-5698f528a203 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:36:18.811095 n-d-848886-15 devstack@n-api.service[104096]: DEBUG oslo_concurrency.lockutils [None req-8c638e83-023c-44de-961c-5698f528a203 admin admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:36:18.811524 n-d-848886-15 devstack@n-api.service[104096]: DEBUG oslo_concurrency.lockutils [None req-8c638e83-023c-44de-961c-5698f528a203 admin admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:36:18.833356 n-d-848886-15 devstack@n-api.service[104096]: INFO nova.api.openstack.requestlog [None req-8c638e83-023c-44de-961c-5698f528a203 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.084862 Jul 25 12:36:18.833915 n-d-848886-15 devstack@n-api.service[104096]: [pid: 104096|app: 0|req: 37/72] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Jul 25 12:36:18 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:37:02.941638 n-d-848886-15 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 25 12:37:02.942293 n-d-848886-15 devstack@n-api.service[104095]: Mon Jul 25 12:37:02 2022 - graceful shutdown triggered... Jul 25 12:37:02.942870 n-d-848886-15 devstack@n-api.service[104096]: Gracefully killing worker 1 (pid: 104096)... Jul 25 12:37:02.943461 n-d-848886-15 devstack@n-api.service[104097]: Gracefully killing worker 2 (pid: 104097)... Jul 25 12:37:03.943247 n-d-848886-15 devstack@n-api.service[104095]: worker 1 buried after 1 seconds Jul 25 12:37:03.943247 n-d-848886-15 devstack@n-api.service[104095]: worker 2 buried after 1 seconds Jul 25 12:37:03.943247 n-d-848886-15 devstack@n-api.service[104095]: goodbye to uWSGI. Jul 25 12:37:03.945745 n-d-848886-15 systemd[1]: devstack@n-api.service: Succeeded. Jul 25 12:37:03.946713 n-d-848886-15 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 25 12:37:03.951158 n-d-848886-15 systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 12:37:03.970328 n-d-848886-15 devstack@n-api.service[125869]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 12:37:04.002578 n-d-848886-15 devstack@n-api.service[125869]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 12:37:03 2022] *** Jul 25 12:37:04.002578 n-d-848886-15 devstack@n-api.service[125869]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 12:37:04.002578 n-d-848886-15 devstack@n-api.service[125869]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 12:37:04.002578 n-d-848886-15 devstack@n-api.service[125869]: nodename: n-d-848886-15 Jul 25 12:37:04.002578 n-d-848886-15 devstack@n-api.service[125869]: machine: x86_64 Jul 25 12:37:04.002578 n-d-848886-15 devstack@n-api.service[125869]: clock source: unix Jul 25 12:37:04.002578 n-d-848886-15 devstack@n-api.service[125869]: pcre jit disabled Jul 25 12:37:04.002578 n-d-848886-15 devstack@n-api.service[125869]: detected number of CPU cores: 4 Jul 25 12:37:04.002578 n-d-848886-15 devstack@n-api.service[125869]: current working directory: / Jul 25 12:37:04.002578 n-d-848886-15 devstack@n-api.service[125869]: detected binary path: /usr/bin/uwsgi-core Jul 25 12:37:04.002578 n-d-848886-15 devstack@n-api.service[125869]: your processes number limit is 47680 Jul 25 12:37:04.002578 n-d-848886-15 devstack@n-api.service[125869]: your memory page size is 4096 bytes Jul 25 12:37:04.002578 n-d-848886-15 devstack@n-api.service[125869]: detected max file descriptor number: 2048 Jul 25 12:37:04.002578 n-d-848886-15 devstack@n-api.service[125869]: lock engine: pthread robust mutexes Jul 25 12:37:04.003590 n-d-848886-15 devstack@n-api.service[125869]: thunder lock: enabled Jul 25 12:37:04.003590 n-d-848886-15 devstack@n-api.service[125869]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 12:37:04.003590 n-d-848886-15 devstack@n-api.service[125869]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 12:37:04.045388 n-d-848886-15 devstack@n-api.service[125869]: Python main interpreter initialized at 0x55d63df099c0 Jul 25 12:37:04.045388 n-d-848886-15 devstack@n-api.service[125869]: python threads support enabled Jul 25 12:37:04.045388 n-d-848886-15 devstack@n-api.service[125869]: your server socket listen backlog is limited to 100 connections Jul 25 12:37:04.045388 n-d-848886-15 devstack@n-api.service[125869]: your mercy for graceful operations on workers is 90 seconds Jul 25 12:37:04.045809 n-d-848886-15 devstack@n-api.service[125869]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 12:37:04.045809 n-d-848886-15 devstack@n-api.service[125869]: *** Operational MODE: preforking *** Jul 25 12:37:04.046178 n-d-848886-15 devstack@n-api.service[125869]: *** uWSGI is running in multiple interpreter mode *** Jul 25 12:37:04.046178 n-d-848886-15 devstack@n-api.service[125869]: spawned uWSGI master process (pid: 125869) Jul 25 12:37:04.046361 n-d-848886-15 systemd[1]: Started Devstack devstack@n-api.service. Jul 25 12:37:04.047585 n-d-848886-15 devstack@n-api.service[125869]: spawned uWSGI worker 1 (pid: 125883, cores: 1) Jul 25 12:37:04.047585 n-d-848886-15 devstack@n-api.service[125869]: spawned uWSGI worker 2 (pid: 125884, cores: 1) Jul 25 12:37:04.047585 n-d-848886-15 devstack@n-api.service[125869]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 12:37:04.698718 n-d-848886-15 devstack@n-api.service[125883]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 12:37:04.715350 n-d-848886-15 devstack@n-api.service[125884]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 12:37:05.867746 n-d-848886-15 devstack@n-api.service[125883]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:37:05.867746 n-d-848886-15 devstack@n-api.service[125883]: from cryptography.utils import int_from_bytes Jul 25 12:37:05.868416 n-d-848886-15 devstack@n-api.service[125883]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:37:05.868416 n-d-848886-15 devstack@n-api.service[125883]: from cryptography.utils import int_from_bytes Jul 25 12:37:05.868543 n-d-848886-15 devstack@n-api.service[125884]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:37:05.868543 n-d-848886-15 devstack@n-api.service[125884]: from cryptography.utils import int_from_bytes Jul 25 12:37:05.868953 n-d-848886-15 devstack@n-api.service[125884]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:37:05.868953 n-d-848886-15 devstack@n-api.service[125884]: from cryptography.utils import int_from_bytes Jul 25 12:37:08.288331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 12:37:08.288943 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 12:37:08.289103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 12:37:08.289487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 12:37:08.289740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 12:37:08.290147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.290445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.290764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.291081 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.291409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.291715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.292036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.292356 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.292681 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.292939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.293250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.293568 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-848886-15 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.293907 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.294364 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.294680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.295023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.295327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.295668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.295921 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.296406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.297990 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.298121 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 12:37:08.298513 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.298620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 12:37:08.298709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.298709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.298873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 12:37:08.298969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.299068 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 12:37:08.299163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.299263 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 12:37:08.299355 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.299355 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.299573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.299676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.299769 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.299861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.299953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.299953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.300110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-848886-15 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.300196 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.300290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.300505 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.300632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.300850 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.301009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.301116 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.301229 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.301477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.301621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.301729 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.301818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.302138 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.302293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.302440 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-848886-15 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.302558 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.302797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.303009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.303166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.303259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.303395 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.303498 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.303734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.303884 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.304028 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.304140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.304343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.304502 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.304604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.304699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.304932 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.305227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.305388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.305560 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.305662 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.305762 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.305895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.306073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.306227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.306412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.306661 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.306768 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.306864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.306957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.307050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.307267 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.307460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.307556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.307644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.307743 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.307941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.308070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.308248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.308379 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.308610 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.308721 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-848886-15 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.308913 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.309008 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.309213 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.309309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.309517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.309613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.309821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.309955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.310143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.310292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.310451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.310575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.310740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.310898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.311065 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.311229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.311371 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.311530 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.311692 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.311862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.311996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.312178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.312290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.312497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.312686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.312789 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.312916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.313088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.313223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.313395 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.313554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.313701 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.313884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.314052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.314191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.314357 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.314502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.314660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.314818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.314924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.315123 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.315215 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.315423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.315526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.315725 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.315832 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.316036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.316139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.316354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.316457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.316630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.316778 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.316878 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.316963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.317162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.317252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.317461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.317556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.317770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.318002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.318104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.318205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.318440 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.318538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.318739 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.318871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.319035 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.319138 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.319336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.319439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.319639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.319741 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.319942 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.320055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.320239 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.320333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.320538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.320627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.320858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.321011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.321147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.321253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.321443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.321543 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.321743 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.321874 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.322088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.322181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.322395 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.322496 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.322697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.322799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.323001 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.323109 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.323304 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.323405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.323607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.323706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.323913 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.324019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.324213 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.324315 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.324514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.324605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.324829 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.324933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.325131 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.325233 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.325433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.325524 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.325685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.325790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.326013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.326117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.326319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.326421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.326636 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.326760 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.326925 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.327018 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.327225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.327316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.327562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.327672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.327821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.327921 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.328119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.328209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.328417 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.328522 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.328713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.328816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.329011 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.329145 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.329307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.329401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.329602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.329693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.329920 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.330037 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.330217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.330320 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.330519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.330617 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.330829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.331003 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.331137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.331252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.331437 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.331536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.331734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.331909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.332041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.332154 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.332348 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.332449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.332666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.332765 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.332975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.333066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.333281 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.333381 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.333602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.333695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.333968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.334062 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.334280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.334372 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.334584 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.334682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.334895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.334998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.335204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.335300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.335511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.335601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.335807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.335909 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.336113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.336202 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.336425 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.336523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.336732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.336866 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.337038 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.337131 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.337340 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.337466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.337667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.337787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.337968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.338076 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.338274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.338364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.338573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.338664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.338876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.338967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.339177 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.339364 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.339529 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.339644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.339796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.339889 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.340103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.340206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.340408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.340503 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.340712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.340811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.341024 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.341149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:37:08.341335 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.341478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.341642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.341748 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.341974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.342076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.342294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.342419 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.342621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.342720 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.342933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.343033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.343245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.343343 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.343554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.343651 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.343861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.343960 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.344165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.344276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.344476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.344601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.344783 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.344901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.345117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.345210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.345426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.345517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.345736 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.345843 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.346070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.346172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.346381 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.346481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.346692 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.346792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.347036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.347172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.347304 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.347444 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.347605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.347728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.347906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.348017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.348203 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.348294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.348508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.348618 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.348809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.348900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.349126 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.349219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.349449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.349549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.349802 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.350010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.350150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.350251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.350493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.350611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.350756 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.350857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.351061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.351196 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.351367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.351519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.351667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.351758 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.351979 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.352094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.352285 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.352380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.352590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.352688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.352901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.353005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.353206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.353306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.353510 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.353602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.353817 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.353993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.354141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.354232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.354442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.354541 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.354758 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.354898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.355061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.355161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.355375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.355465 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.355680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.355785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.355985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.356085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.356296 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.356386 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.356601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.356700 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.356905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.356997 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.357207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.357301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.357517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.357618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.357821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.358006 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.358163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.358277 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.358492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.358639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.358799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.358923 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.359093 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.359193 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.359399 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.359503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.359697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.359789 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.359997 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.360140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.360305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.360403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.360598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.360698 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.360898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.361006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.361197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.361291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.361495 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.361630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.361791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.361937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.362113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.362214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.362427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.362519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.362733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.362838 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.363032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.363126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.363329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.363460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.363629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.363730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.363940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.364037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.364252 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.364352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.364563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.364654 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.364874 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.364965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.365217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.365315 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.365531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.365621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.365863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.365958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.366172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.366272 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.366480 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.366579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.366788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.366879 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.367094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.367197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.367400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.367508 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.367718 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.367820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.368025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.368117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.368341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.368434 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.368647 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.368737 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.368947 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.369047 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.369251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.369341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.369559 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.369661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.369872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.369988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.370182 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.370302 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.370491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.370600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.370791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.370893 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.371097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.371198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.371414 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.371555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.371719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.371850 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.372021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.372145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.372322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.372426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.372624 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.372717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.372929 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.373019 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.373233 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.373325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.373545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.373646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.373865 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.373972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.374183 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.374303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.374486 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.374580 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.374802 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.374938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.375113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.375204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.375427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.375519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.375727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.375825 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.376035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.376139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.376352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.376443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.376677 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.376765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.376982 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.377132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.377289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.377433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.377595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.377719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.377920 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.378034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.378229 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.378337 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.378536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.378642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.378838 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.378937 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.379135 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.379225 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.379441 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.379533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.379752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.379853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.380059 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.380151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.380365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.380456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.380665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.380758 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.381023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.381119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.381330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.381459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.381629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.381733 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.381956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.382054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.382264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.382358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.382579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.382674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.382886 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.382977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.383199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.383290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.383505 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.383596 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.383805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.383906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.384103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.384209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.384417 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.384509 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.384716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.384816 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.385016 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.385121 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.385321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.385412 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.385623 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.385714 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.385978 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.386202 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.386298 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.386383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.386580 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.386680 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.386884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.386992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.387190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.387293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.387495 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.387585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.387802 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.387900 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.388105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.388243 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.388408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.388532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.388718 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.388817 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.389024 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.389114 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.389329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.389419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.389631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.389731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.389965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.390073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.390277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.390375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.390576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.390685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.390876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.390968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.391178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.391286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.391486 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.391612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.391791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.391886 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.392090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.392197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.392394 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.392485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.392699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.392791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.393001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.393270 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.393363 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.393599 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.393690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.393925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.394035 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.394230 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.394322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.394533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.394632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.394846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.394950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.395168 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.395259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.395470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.395568 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.395785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.395887 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.396085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.396185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.396410 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.396590 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.396759 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.396899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.397043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.397147 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.397350 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.397450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.397649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.397739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.397971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.398067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.398271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.398364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.398578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.398678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.398878 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.398978 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.399178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.399279 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.399477 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.399568 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.399776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.399885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.400083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.400185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.400381 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.400472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.400687 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.400789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.400984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.401084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.401292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.401390 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.401597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.401750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.401931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.402193 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.402286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.402488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.402579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.402824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.402932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.403125 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.403260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.403443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.403551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.403761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.403851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.404085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.404175 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.404746 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.404851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.405044 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.405145 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.405366 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.405470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.405667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.405760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.405987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.406093 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.406288 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.406389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.406592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.406691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.406895 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.406987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.407192 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.407285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.407492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.407594 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.407795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.407888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.408098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.408197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.408397 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.408487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.408693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.408785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.408992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.409091 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.409287 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.409377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.409592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.409690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.409920 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.410052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.410220 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.410348 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.410518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.410620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.410824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.410927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.411125 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.411225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.411424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.411524 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.411723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.411822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.412047 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.412144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.412367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.412517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.412668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.412805 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.412967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.413070 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.413265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.413359 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.413570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.413670 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.413898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.414041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.414202 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.414322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.414517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.414611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.414823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.414923 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.415125 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.415226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.415420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.415510 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.415724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.415823 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.416023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.416116 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.416320 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.416420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.416625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.416725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.416929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.417055 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.417238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.417389 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.417526 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.417633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.417849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.417946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.418147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.418247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.418448 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.418549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.418747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.418892 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.419047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.419137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.419344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.419444 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.419641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.419741 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.419940 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.420039 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.420238 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.420331 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.420537 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.420629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.420839 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.420936 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.421140 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.421232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.421440 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.421539 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.421737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.421869 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.422066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.422174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.422371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.422462 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.422683 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.422778 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.422987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.423082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.423309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.423408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.423616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.423721 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.423915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.424006 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.424220 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.424311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.424523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.424623 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.424824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.424916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.425126 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.425218 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.425432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.425532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.425739 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.425861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.426069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.426174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.426368 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.426470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.426664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.426764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.426967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.427058 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.427270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.427370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.427574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.427699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.427953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.428089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.428253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.428346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.428557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.428648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.428862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.428954 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.429167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.429268 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.429470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.429561 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.429770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.429928 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.430103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.430207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.430405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.430495 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.430708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.430801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.431010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.431110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.431318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.431420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.431626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.431728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.431933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.432026 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.432236 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.432328 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.432539 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.432640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.432843 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.432945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.433142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.433243 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.433461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.433564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.433765 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.433878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.434090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.434183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.434393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.434496 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.434695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.434814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.435001 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.435105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.435303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.435402 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.435606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.435706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.435926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.436019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.436239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.436332 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.436553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.436654 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.436873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.436966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.437187 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.437292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.437503 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.437605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.437807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.437976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.438128 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.438220 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.438442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.438532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.438750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.438851 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.439059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.439150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.439372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.439471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.439686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.439786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.439987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.440143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.440295 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.440389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.440604 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.440709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.440902 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.440992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.441201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.441334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.441498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.441633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.442083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.442222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.442222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.442433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.442530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.442626 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.442745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.442871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.443047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.443173 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.443375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.443472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.443683 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.443834 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.443992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.444145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.444294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.444455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.444718 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.444820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.445029 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.445129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.445337 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.445439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.445638 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.445739 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.445972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.446086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.446279 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.446370 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.446597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.446697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.446909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.447016 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.447211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.447304 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.447517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.447615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.447817 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.447923 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.448134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.448228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.448456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.448591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.448761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.448868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.449076 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.449176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.449400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.449491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.449724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.449817 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.450056 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.450157 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.450364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.450477 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.450667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.450763 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.450987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.451086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.451290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.451382 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.451597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.451689 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.451900 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.452002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.452200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.452293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.452515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.452615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.452813 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.452992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.453119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.453304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.453424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.453616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.453716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.453962 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.454075 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.454286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.454386 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.454609 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.454702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.454902 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.454994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.455211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.455310 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.455515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.455606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.455831 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.455932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.456149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.456242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.456453 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.456556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.456766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.456859 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.457071 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.457178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.457373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.457466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.457673 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.457774 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.457996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.458092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.458338 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.458445 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.458638 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.458751 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.458966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.459135 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.459327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.459669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.459951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.460076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.460280 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.460602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.460910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.461002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.461224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.461362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.461546 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.461683 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.461975 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.462138 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.462270 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.462392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.462523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.462659 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.462806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.462944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.463073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.463261 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.463449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.463597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.463754 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.463881 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.464007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.464132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.464310 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.464473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.464621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.464749 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.464882 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.465026 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.465159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.465301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.465454 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.465599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.465732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.465887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.466038 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.466190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.466327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.466454 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.466588 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.466714 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.466845 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.466982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.467106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.467303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.467442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.467616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.467815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.467965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.468102 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.468244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.468438 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.468582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.468711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.468849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.468977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.469131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.469263 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.469453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.469604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.469785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.470003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.470134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.470275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.470414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.470554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.470703 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.470845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.471018 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.471136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.471330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.471500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.471641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.471837 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.471969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.472096 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.472221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.472418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.472557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.472751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.472883 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.473061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.473206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.473387 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.473573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.473713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.473870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.474001 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.474146 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.474285 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.474412 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.474593 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.474731 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.474904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.475051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.475234 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.475378 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.475507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.475642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.475805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.475955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.476094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.476228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.476405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.476546 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.476691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.476819 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.476998 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.477202 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.477365 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.477534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.477712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.477916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.478049 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.478226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.478372 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.478513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.478652 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.478778 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.478912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.479045 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.479183 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.479476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.479640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.479786 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.480023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.480175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.480341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.480493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.480644 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.480793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.480933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.481130 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.481340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.481509 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.481651 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.481813 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.482006 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.482187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.482340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.482503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.482658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.482805 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.482995 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.483195 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.483395 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.483581 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.483761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.483761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.484049 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.484189 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.484373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.484517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.484667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.484817 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.484958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.484958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.485249 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.485400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.485562 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.485702 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.485873 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.486049 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.486193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.486349 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.486494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.486663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.486832 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.486979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.487152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.487311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.487472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.487623 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.487771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.487900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.487987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.488073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.488166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.488299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.488407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.488501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.488576 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.488646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.488730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.488844 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.488990 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.489203 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.489307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.489518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.489617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.489821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.489984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.490160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.490532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.490675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.490868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.490991 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.491183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.491276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.491495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.491587 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.491811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.491913 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.492122 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.492223 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.492427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.492528 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.492736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.492837 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.493035 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.493127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.493337 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.493436 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.493650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.493782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.493984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.494092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.494411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.494574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.494729 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.494866 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.495000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.495137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.495368 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.495603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.495758 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.495964 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.496167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.496333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.496521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.496721 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.496934 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.497145 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.497267 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.497357 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.497444 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.497543 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.497718 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.497820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.498037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.498144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.498330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.498476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.498630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.498757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.498931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.499062 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.499238 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.499381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.499535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.499692 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.499841 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.499997 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.500143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.500319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.500453 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.500633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.500756 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.500941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.501132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.501315 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.501463 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.501560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.501707 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.502033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.502148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.502336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.502474 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.502651 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.502779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.503067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.503174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.503388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.503489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.503697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.503790 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.504006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.504101 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.504330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.504432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.504639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.504740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.504945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.505191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.505283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.505519 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.505612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.505869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.505987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.506188 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.506280 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.506500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.506601 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.506809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.506921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.507112 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.507219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.507413 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.507514 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.507715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.507813 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.508026 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.508155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.508335 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.508435 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.508637 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.508740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.508943 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.509037 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.509250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.509344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.509555 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.509648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.509876 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.509972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.510184 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.510274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.510487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.510580 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.510793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.510895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.511097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.511231 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.511396 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.511487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.511700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.511913 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.512013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.512304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.512449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.512613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.512706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.512976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.513068 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.513300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.513401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.513607 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.513699 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.513934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.514049 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.514245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.514340 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.514551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.514653 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.514857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.514960 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.515168 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.515269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.515484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.515576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.515805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.515909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.516115 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.516208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.516416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.516725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.516818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.517064 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.517165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.545533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.545689 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.545761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.545819 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.545819 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.545959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.545959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.546136 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.546246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.546354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.546461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.546574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.546668 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.546798 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.546798 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.546987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.546987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.547158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.547288 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.547408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.547539 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.547680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.547771 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.547846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.547944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.548037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.548232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.548317 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.548391 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.548472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.548541 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.548620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.548715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.548808 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.548887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.549030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.549192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.549437 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.549675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.549991 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.550196 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.551188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.551370 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.551575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.551788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.551987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.553452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.553688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.553976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.554188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.554395 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.554600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.554891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.555033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.555196 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.555331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.555462 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.555594 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.555726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.555857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.556064 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.556064 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.556064 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.556314 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.556430 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.556430 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.556628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.556708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.556821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.556821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.556821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.556821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.556821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.556821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.556821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.556821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.557535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.557535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.557535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.557535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.557535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.557535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.557535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.558514 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.558718 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.558921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.559099 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.559270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.559475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.559693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.559907 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.560133 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.560326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.560488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.560717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.560717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.561204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.561406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.561608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.561754 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.561960 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.562184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.562399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.562581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.562765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.562977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.563171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.563385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.563554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.563726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.563922 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.564119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.564325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.564492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.564629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.564927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.565327 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.565630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.565882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.566133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.566439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.566635 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.566784 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.566877 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.567116 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.567290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.567388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.567525 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.567652 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.567831 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.567993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.568139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.568337 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.568430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.568497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.568634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.568703 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.568786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.568853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.568911 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.568969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.569030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.569106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.569173 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.569416 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.569527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.569613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.569784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.569973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.570081 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.570196 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.570275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.570380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.570458 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.570551 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.570631 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.570631 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.570631 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.570631 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.570631 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 12:37:08.571047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.571047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.571047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.571047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.571047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.571047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.571047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.571047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.571471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.571471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.571471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.571471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.571471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.571471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.571471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.571471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.571989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.571989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.571989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.571989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.571989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.571989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.571989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.571989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.572403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.572403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.572403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.572403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.572403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.572403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.572403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.572403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.572932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.572932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.572932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.572932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.572932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.572932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.572932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.572932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.573389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.573389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.573389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.573389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.573389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.573389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.573389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.573389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.573788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.573788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.573788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:37:08.573788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 12:37:08.611208 n-d-848886-15 devstack@n-api.service[125883]: INFO dbcounter [None req-10529a10-71ec-42aa-8921-25b71d28a12c None None] Registered counter for database nova_api Jul 25 12:37:08.631878 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_db.sqlalchemy.engines [None req-10529a10-71ec-42aa-8921-25b71d28a12c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:37:08.633165 n-d-848886-15 devstack@n-api.service[125884]: INFO dbcounter [None req-2df59ebe-7b2e-4316-aacc-d113a54287e8 None None] Registered counter for database nova_api Jul 25 12:37:08.639066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writer thread running {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:37:08.653494 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_db.sqlalchemy.engines [None req-2df59ebe-7b2e-4316-aacc-d113a54287e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:37:08.661166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writer thread running {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:37:08.694817 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.context [None req-10529a10-71ec-42aa-8921-25b71d28a12c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),44375b4d-91c4-48bf-9056-56d6e14223f5(cell1) {{(pid=125883) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 12:37:08.698956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10529a10-71ec-42aa-8921-25b71d28a12c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:08.700549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10529a10-71ec-42aa-8921-25b71d28a12c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:08.701302 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10529a10-71ec-42aa-8921-25b71d28a12c None None] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:08.703383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10529a10-71ec-42aa-8921-25b71d28a12c None None] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:08.705409 n-d-848886-15 devstack@n-api.service[125883]: INFO dbcounter [None req-10529a10-71ec-42aa-8921-25b71d28a12c None None] Registered counter for database nova_cell0 Jul 25 12:37:08.709557 n-d-848886-15 devstack@n-api.service[125883]: INFO dbcounter [None req-10529a10-71ec-42aa-8921-25b71d28a12c None None] Registered counter for database nova_cell1 Jul 25 12:37:08.716516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.context [None req-2df59ebe-7b2e-4316-aacc-d113a54287e8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),44375b4d-91c4-48bf-9056-56d6e14223f5(cell1) {{(pid=125884) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 12:37:08.717000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_db.sqlalchemy.engines [None req-10529a10-71ec-42aa-8921-25b71d28a12c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:37:08.718707 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_db.sqlalchemy.engines [None req-10529a10-71ec-42aa-8921-25b71d28a12c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:37:08.720880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2df59ebe-7b2e-4316-aacc-d113a54287e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:08.722522 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2df59ebe-7b2e-4316-aacc-d113a54287e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:08.723325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2df59ebe-7b2e-4316-aacc-d113a54287e8 None None] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:08.723925 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writer thread running {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:37:08.725414 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2df59ebe-7b2e-4316-aacc-d113a54287e8 None None] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:08.726882 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writer thread running {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:37:08.727490 n-d-848886-15 devstack@n-api.service[125884]: INFO dbcounter [None req-2df59ebe-7b2e-4316-aacc-d113a54287e8 None None] Registered counter for database nova_cell0 Jul 25 12:37:08.731637 n-d-848886-15 devstack@n-api.service[125884]: INFO dbcounter [None req-2df59ebe-7b2e-4316-aacc-d113a54287e8 None None] Registered counter for database nova_cell1 Jul 25 12:37:08.738925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_db.sqlalchemy.engines [None req-2df59ebe-7b2e-4316-aacc-d113a54287e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:37:08.741467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_db.sqlalchemy.engines [None req-2df59ebe-7b2e-4316-aacc-d113a54287e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:37:08.748375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writer thread running {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:37:08.749699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writer thread running {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:37:08.869107 n-d-848886-15 devstack@n-api.service[125883]: INFO dbcounter [None req-10529a10-71ec-42aa-8921-25b71d28a12c None None] Registered counter for database nova_cell0 Jul 25 12:37:08.876465 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_db.sqlalchemy.engines [None req-10529a10-71ec-42aa-8921-25b71d28a12c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:37:08.881023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writer thread running {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:37:08.895238 n-d-848886-15 devstack@n-api.service[125884]: INFO dbcounter [None req-2df59ebe-7b2e-4316-aacc-d113a54287e8 None None] Registered counter for database nova_cell0 Jul 25 12:37:08.902765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_db.sqlalchemy.engines [None req-2df59ebe-7b2e-4316-aacc-d113a54287e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:37:08.908078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writer thread running {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:37:09.190219 n-d-848886-15 devstack@n-api.service[125883]: WARNING keystonemiddleware.auth_token [None req-10529a10-71ec-42aa-8921-25b71d28a12c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:37:09.197533 n-d-848886-15 devstack@n-api.service[125883]: WARNING keystonemiddleware.auth_token [None req-10529a10-71ec-42aa-8921-25b71d28a12c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:37:09.218756 n-d-848886-15 devstack@n-api.service[125884]: WARNING keystonemiddleware.auth_token [None req-2df59ebe-7b2e-4316-aacc-d113a54287e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:37:09.226104 n-d-848886-15 devstack@n-api.service[125884]: WARNING keystonemiddleware.auth_token [None req-2df59ebe-7b2e-4316-aacc-d113a54287e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:37:09.537320 n-d-848886-15 devstack@n-api.service[125883]: WARNING keystonemiddleware.auth_token [None req-10529a10-71ec-42aa-8921-25b71d28a12c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:37:09.544137 n-d-848886-15 devstack@n-api.service[125883]: WARNING keystonemiddleware.auth_token [None req-10529a10-71ec-42aa-8921-25b71d28a12c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:37:09.549549 n-d-848886-15 devstack@n-api.service[125883]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d63df099c0 pid: 125883 (default app) Jul 25 12:37:09.568402 n-d-848886-15 devstack@n-api.service[125884]: WARNING keystonemiddleware.auth_token [None req-2df59ebe-7b2e-4316-aacc-d113a54287e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:37:09.574554 n-d-848886-15 devstack@n-api.service[125884]: WARNING keystonemiddleware.auth_token [None req-2df59ebe-7b2e-4316-aacc-d113a54287e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:37:09.579924 n-d-848886-15 devstack@n-api.service[125884]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d63df099c0 pid: 125884 (default app) Jul 25 12:37:54.319739 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:37:54.320667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:37:54.322032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:37:54.323595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:37:56.014342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:37:56.016181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:37:56.018244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:37:56.019232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:37:56.112017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c5567911-00a7-4fef-a5d1-655457271681 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-150426362", "id": 848816783, "os-flavor-access:is_public": "True"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:37:56.164328 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:56.164328 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:37:56.213279 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c5567911-00a7-4fef-a5d1-655457271681 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 1.905200 Jul 25 12:37:56.214435 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:37:54 2022] POST /compute/v2.1/flavors => generated 426 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:37:56.231828 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1bed739e-bf08-4576-8c10-0f5eb20148c8 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:56.233463 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:56.233463 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:37:56.307489 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1bed739e-bf08-4576-8c10-0f5eb20148c8 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/848816783" status: 202 len: 0 microversion: 2.1 time: 0.082247 Jul 25 12:37:56.309730 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2/2] 10.222.0.49 () {58 vars in 1158 bytes} [Mon Jul 25 12:37:56 2022] DELETE /compute/v2.1/flavors/848816783 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:37:56.704316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-eb8252d4-6efe-416a-a64b-bb717e8989d1 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Calling method '.version_select at 0x7efcfc4a9d30>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:56.705184 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:56.705184 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:37:56.714769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-eb8252d4-6efe-416a-a64b-bb717e8989d1 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),44375b4d-91c4-48bf-9056-56d6e14223f5(cell1) {{(pid=125883) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 25 12:37:56.715596 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb8252d4-6efe-416a-a64b-bb717e8989d1 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:56.719989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb8252d4-6efe-416a-a64b-bb717e8989d1 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:56.762505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb8252d4-6efe-416a-a64b-bb717e8989d1 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:56.763855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb8252d4-6efe-416a-a64b-bb717e8989d1 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:56.797578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb8252d4-6efe-416a-a64b-bb717e8989d1 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:56.798060 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb8252d4-6efe-416a-a64b-bb717e8989d1 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:56.811809 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-eb8252d4-6efe-416a-a64b-bb717e8989d1 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.500587 Jul 25 12:37:56.818937 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3/3] 10.222.0.49 () {58 vars in 1167 bytes} [Mon Jul 25 12:37:56 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:37:56.826547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8b661dc5-8271-492b-8287-95ee5275a34d tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:56.873609 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8b661dc5-8271-492b-8287-95ee5275a34d tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053484 Jul 25 12:37:56.874359 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 4/4] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:37:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:37:57.076926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d65b5cd2-c682-4bc9-b634-8856e1ab5829 tempest-AZAdminNegativeTestJSON-2089796953 tempest-AZAdminNegativeTestJSON-2089796953-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:57.078147 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:57.078147 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:37:57.079247 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d65b5cd2-c682-4bc9-b634-8856e1ab5829 tempest-AZAdminNegativeTestJSON-2089796953 tempest-AZAdminNegativeTestJSON-2089796953-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '00648cd3d0dc4a12b318e9564a255907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefea20754446109fd6886dae89c963', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:37:57.083940 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d65b5cd2-c682-4bc9-b634-8856e1ab5829 tempest-AZAdminNegativeTestJSON-2089796953 tempest-AZAdminNegativeTestJSON-2089796953-project] Request method failure captured: Jul 25 12:37:57.083940 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 25 12:37:57.083940 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:37:57.083940 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:37:57.083940 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:37:57.083940 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:37:57.083940 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:37:57.083940 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:37:57.083940 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:37:57.083940 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:37:57.083940 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6hcbbMPSIN-RF7HmyEWn3wpeQt34465UcYK1UVNkt04jk7tW0UV9geQ5-6h9YZ-GttIz6T151zRHiJaArunbyl21vaIRRxgKbQGwH8w0qJIpFzb_p12vlKu61WkNvNyq-hGqA-sKAivj4hBW8SFEH2XFe1H8y7rXa8Lr9J1uoo7Pw Jul 25 12:37:57.083940 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:37:57.083940 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:37:57.083940 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:37:57.083940 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:37:57.083940 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:37:57.083940 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:37:57.083940 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 4cefea20754446109fd6886dae89c963 Jul 25 12:37:57.083940 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AZAdminNegativeTestJSON-2089796953 Jul 25 12:37:57.083940 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:37:57.083940 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:37:57.085241 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4cefea20754446109fd6886dae89c963", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4cefea20754446109fd6886dae89c963"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4cefea20754446109fd6886dae89c963"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4cefea20754446109fd6886dae89c963"}]}] Jul 25 12:37:57.085241 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AZAdminNegativeTestJSON-2089796953 Jul 25 12:37:57.085241 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 4cefea20754446109fd6886dae89c963 Jul 25 12:37:57.085241 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-2089796953 Jul 25 12:37:57.085241 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AZAdminNegativeTestJSON-2089796953-project Jul 25 12:37:57.085241 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:37:57.085241 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:37:57.085241 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 00648cd3d0dc4a12b318e9564a255907 Jul 25 12:37:57.085241 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AZAdminNegativeTestJSON-2089796953-project Jul 25 12:37:57.085241 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:37:57.085241 n-d-848886-15 devstack@n-api.service[125883]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 25 12:37:57.085241 n-d-848886-15 devstack@n-api.service[125883]: action_args: {} Jul 25 12:37:57.085856 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:37:57.085856 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:37:57.085856 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:37:57.085856 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:37:57.085856 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:37:57.085856 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:37:57.085856 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:37:57.085856 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:37:57.085856 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 25 12:37:57.085856 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 25 12:37:57.085856 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:37:57.085856 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:37:57.085856 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:37:57.085856 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:37:57.085856 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:37:57.085856 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:37:57.085856 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:37:57.085856 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:37:57.085856 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:37:57.087067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:37:57.087067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:37:57.087067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:37:57.087067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:37:57.087067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:37:57.087067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 25 12:37:57.087067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:37:57.087067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:37:57.087067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:37:57.087067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:37:57.087067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:37:57.087067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:37:57.087067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:37:57.087067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:37:57.087067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 25 12:37:57.087067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:37:57.089271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d65b5cd2-c682-4bc9-b634-8856e1ab5829 tempest-AZAdminNegativeTestJSON-2089796953 tempest-AZAdminNegativeTestJSON-2089796953-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:37:57.095106 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d65b5cd2-c682-4bc9-b634-8856e1ab5829 tempest-AZAdminNegativeTestJSON-2089796953 tempest-AZAdminNegativeTestJSON-2089796953-project] 10.222.0.49 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.206224 Jul 25 12:37:57.097214 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 5/5] 10.222.0.49 () {58 vars in 1185 bytes} [Mon Jul 25 12:37:56 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 222 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:37:57.309097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5bcbe357-f6c6-49d2-99f6-9198915780bd tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Calling method '.version_select at 0x7efcfc5ea4c0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:57.311208 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:57.311208 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:37:57.331653 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1acc2803-7dfb-4e4a-81c9-efecbbee81d8 tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-226938191", "ram": 512, "vcpus": 1, "disk": 10, "id": 495894981, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:37:57.335744 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:57.335744 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:37:57.336227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5bcbe357-f6c6-49d2-99f6-9198915780bd tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),44375b4d-91c4-48bf-9056-56d6e14223f5(cell1) {{(pid=125884) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 25 12:37:57.337790 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5bcbe357-f6c6-49d2-99f6-9198915780bd tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:57.338940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5bcbe357-f6c6-49d2-99f6-9198915780bd tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:57.360439 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1acc2803-7dfb-4e4a-81c9-efecbbee81d8 tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.261582 Jul 25 12:37:57.361185 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 6/6] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:37:57 2022] POST /compute/v2.1/flavors => generated 412 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:37:57.398222 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5bcbe357-f6c6-49d2-99f6-9198915780bd tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:57.398850 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5bcbe357-f6c6-49d2-99f6-9198915780bd tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:57.416174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5bcbe357-f6c6-49d2-99f6-9198915780bd tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:57.416857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5bcbe357-f6c6-49d2-99f6-9198915780bd tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:57.424957 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5bcbe357-f6c6-49d2-99f6-9198915780bd tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 1.431818 Jul 25 12:37:57.425936 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1/7] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:37:55 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:37:57.645409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-497de4f1-393b-47bc-95e5-5f5ba2ec218c tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:57.648349 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:57.648349 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:37:57.651812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-497de4f1-393b-47bc-95e5-5f5ba2ec218c tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:57.652436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-497de4f1-393b-47bc-95e5-5f5ba2ec218c tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:57.654593 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-497de4f1-393b-47bc-95e5-5f5ba2ec218c tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:57.655134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-497de4f1-393b-47bc-95e5-5f5ba2ec218c tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:57.705774 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-497de4f1-393b-47bc-95e5-5f5ba2ec218c tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.343160 Jul 25 12:37:57.715298 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 7/8] 10.222.0.49 () {58 vars in 1176 bytes} [Mon Jul 25 12:37:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:37:57.720907 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e30cfcf4-4c91-4649-a8e9-523241205d07 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1114651453", "name": "tempest-test_aggregate-1750391110"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:37:57.743543 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:57.743543 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:37:57.745588 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.aggregate [None req-e30cfcf4-4c91-4649-a8e9-523241205d07 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Generated uuid 04b139a3-6486-49e7-b9d1-de674323e9c3 for aggregate {{(pid=125883) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 12:37:57.863956 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e30cfcf4-4c91-4649-a8e9-523241205d07 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.146210 Jul 25 12:37:57.864625 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 8/9] 10.222.0.49 () {60 vars in 1165 bytes} [Mon Jul 25 12:37:57 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:37:57.880602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f7b35120-eee8-4f1a-a836-b6ba6fd0b436 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-56173015", "id": 137418905, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:37:57.886634 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:57.886634 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:37:57.920413 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f7b35120-eee8-4f1a-a836-b6ba6fd0b436 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.045939 Jul 25 12:37:57.921483 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 9/10] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:37:57 2022] POST /compute/v2.1/flavors => generated 412 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:37:57.926898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0d8fa3fb-7e16-4a7c-b086-2bf8ed5b35eb tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:37:57.936881 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:57.936881 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:37:57.950404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b122e869-ec7a-4154-bc37-5fbe23a856ab tempest-AZAdminV2TestJSON-1262187238 tempest-AZAdminV2TestJSON-1262187238-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:57.952147 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b122e869-ec7a-4154-bc37-5fbe23a856ab tempest-AZAdminV2TestJSON-1262187238 tempest-AZAdminV2TestJSON-1262187238-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:57.952591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b122e869-ec7a-4154-bc37-5fbe23a856ab tempest-AZAdminV2TestJSON-1262187238 tempest-AZAdminV2TestJSON-1262187238-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:57.953381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b122e869-ec7a-4154-bc37-5fbe23a856ab tempest-AZAdminV2TestJSON-1262187238 tempest-AZAdminV2TestJSON-1262187238-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:57.953920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b122e869-ec7a-4154-bc37-5fbe23a856ab tempest-AZAdminV2TestJSON-1262187238 tempest-AZAdminV2TestJSON-1262187238-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:58.003828 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0d8fa3fb-7e16-4a7c-b086-2bf8ed5b35eb tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/495894981/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.079596 Jul 25 12:37:58.007281 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 10/11] 10.222.0.49 () {60 vars in 1221 bytes} [Mon Jul 25 12:37:57 2022] POST /compute/v2.1/flavors/495894981/os-extra_specs => generated 66 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:37:58.019386 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4add743d-1cd8-43f7-b755-3465c48a5e16 tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Calling method '.version_select at 0x7efcfbb0a4c0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:58.021921 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:58.021921 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:37:58.024197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4add743d-1cd8-43f7-b755-3465c48a5e16 tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:58.026243 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4add743d-1cd8-43f7-b755-3465c48a5e16 tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:58.051172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4add743d-1cd8-43f7-b755-3465c48a5e16 tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:58.051847 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4add743d-1cd8-43f7-b755-3465c48a5e16 tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:58.070265 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b122e869-ec7a-4154-bc37-5fbe23a856ab tempest-AZAdminV2TestJSON-1262187238 tempest-AZAdminV2TestJSON-1262187238-project-admin] 10.222.0.49 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.643019 Jul 25 12:37:58.078717 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2/12] 10.222.0.49 () {58 vars in 1164 bytes} [Mon Jul 25 12:37:57 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:37:58.095920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1f8d54fb-3cfe-471d-83a3-55f65f225454 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:58.096718 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:58.096718 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:37:58.107717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4add743d-1cd8-43f7-b755-3465c48a5e16 tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:58.108387 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4add743d-1cd8-43f7-b755-3465c48a5e16 tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:58.116591 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4add743d-1cd8-43f7-b755-3465c48a5e16 tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/n-h2-848886-15/servers" status: 200 len: 105 microversion: 2.1 time: 0.106703 Jul 25 12:37:58.119313 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1f8d54fb-3cfe-471d-83a3-55f65f225454 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.044060 Jul 25 12:37:58.122580 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 11/13] 10.222.0.49 () {58 vars in 1215 bytes} [Mon Jul 25 12:37:58 2022] GET /compute/v2.1/os-hypervisors/n-h2-848886-15/servers => generated 105 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:37:58.123825 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3/14] 10.222.0.49 () {58 vars in 1143 bytes} [Mon Jul 25 12:37:58 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:37:58.128078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-20828ab7-dc89-4491-9b9e-508d46fbc4c4 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:58.182667 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-20828ab7-dc89-4491-9b9e-508d46fbc4c4 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5795 microversion: 2.1 time: 0.059005 Jul 25 12:37:58.199174 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 12/15] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:37:58 2022] GET /compute/v2.1/flavors/detail => generated 5795 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:37:58.209388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8709515c-2c66-4366-b0c7-3f90af1ba820 tempest-AZAdminV2TestJSON-1262187238 tempest-AZAdminV2TestJSON-1262187238-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:58.210356 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:58.210356 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:37:58.213713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8709515c-2c66-4366-b0c7-3f90af1ba820 tempest-AZAdminV2TestJSON-1262187238 tempest-AZAdminV2TestJSON-1262187238-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:58.215332 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8709515c-2c66-4366-b0c7-3f90af1ba820 tempest-AZAdminV2TestJSON-1262187238 tempest-AZAdminV2TestJSON-1262187238-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:58.217917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8709515c-2c66-4366-b0c7-3f90af1ba820 tempest-AZAdminV2TestJSON-1262187238 tempest-AZAdminV2TestJSON-1262187238-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:58.219165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8709515c-2c66-4366-b0c7-3f90af1ba820 tempest-AZAdminV2TestJSON-1262187238 tempest-AZAdminV2TestJSON-1262187238-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:58.273393 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8709515c-2c66-4366-b0c7-3f90af1ba820 tempest-AZAdminV2TestJSON-1262187238 tempest-AZAdminV2TestJSON-1262187238-project-admin] 10.222.0.49 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.072891 Jul 25 12:37:58.282999 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 13/16] 10.222.0.49 () {58 vars in 1185 bytes} [Mon Jul 25 12:37:58 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:37:58.282999 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0d03f946-06d7-4322-bd85-6424017c8636 tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Calling method '.version_select at 0x7efcfaae1ca0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:58.282999 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:58.282999 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:37:58.282999 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d03f946-06d7-4322-bd85-6424017c8636 tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:58.283409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d03f946-06d7-4322-bd85-6424017c8636 tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:58.299842 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d03f946-06d7-4322-bd85-6424017c8636 tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:58.300294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d03f946-06d7-4322-bd85-6424017c8636 tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:58.312913 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d03f946-06d7-4322-bd85-6424017c8636 tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:58.313374 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d03f946-06d7-4322-bd85-6424017c8636 tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:58.321235 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0d03f946-06d7-4322-bd85-6424017c8636 tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.045299 Jul 25 12:37:58.327473 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 14/17] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:37:58 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:37:58.327473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5e016cbc-6556-4782-b2f7-389cb1d9097d tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-848886-15"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:37:58.330144 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:58.330144 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:37:58.351863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5e016cbc-6556-4782-b2f7-389cb1d9097d tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:58.352572 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5e016cbc-6556-4782-b2f7-389cb1d9097d tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:58.467990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-47a65ad2-1a68-4b2b-a628-40a79cdc9d5e tempest-FlavorsExtraSpecsTestJSON-782855277 tempest-FlavorsExtraSpecsTestJSON-782855277-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:58.517222 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-47a65ad2-1a68-4b2b-a628-40a79cdc9d5e tempest-FlavorsExtraSpecsTestJSON-782855277 tempest-FlavorsExtraSpecsTestJSON-782855277-project] 10.222.0.49 "GET /compute/v2.1/flavors/495894981/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.391634 Jul 25 12:37:58.534223 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 4/18] 10.222.0.49 () {58 vars in 1200 bytes} [Mon Jul 25 12:37:58 2022] GET /compute/v2.1/flavors/495894981/os-extra_specs => generated 66 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:37:58.562349 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cd81551f-25db-4b8b-ad43-da25a602b233 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:58.564086 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:58.564086 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:37:58.608290 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cd81551f-25db-4b8b-ad43-da25a602b233 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/137418905" status: 202 len: 0 microversion: 2.1 time: 0.071512 Jul 25 12:37:58.609614 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 5/19] 10.222.0.49 () {58 vars in 1158 bytes} [Mon Jul 25 12:37:58 2022] DELETE /compute/v2.1/flavors/137418905 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:37:58.615404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9412932f-1e09-4e35-b7c5-e40a5c929315 tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Calling method '.version_select at 0x7efcfc3fa790>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:58.618268 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:58.618268 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:37:58.621778 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9412932f-1e09-4e35-b7c5-e40a5c929315 tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:58.623931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9412932f-1e09-4e35-b7c5-e40a5c929315 tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:58.666192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9412932f-1e09-4e35-b7c5-e40a5c929315 tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:58.667110 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9412932f-1e09-4e35-b7c5-e40a5c929315 tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:58.677403 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9412932f-1e09-4e35-b7c5-e40a5c929315 tempest-HypervisorAdminUnderV252Test-2017676872 tempest-HypervisorAdminUnderV252Test-2017676872-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/n-h2-848886-15/search" status: 200 len: 105 microversion: 2.1 time: 0.065897 Jul 25 12:37:58.679541 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 6/20] 10.222.0.49 () {58 vars in 1212 bytes} [Mon Jul 25 12:37:58 2022] GET /compute/v2.1/os-hypervisors/n-h2-848886-15/search => generated 105 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:37:58.690774 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6c1ed97c-b33a-40b4-abd6-9abfd305cce2 tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:37:58.696735 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:58.696735 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:37:58.745742 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6c1ed97c-b33a-40b4-abd6-9abfd305cce2 tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/495894981/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.063686 Jul 25 12:37:58.752690 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 7/21] 10.222.0.49 () {60 vars in 1221 bytes} [Mon Jul 25 12:37:58 2022] POST /compute/v2.1/flavors/495894981/os-extra_specs => generated 66 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:37:58.756728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0a301f1e-eb64-476a-ba7e-4e3f54478c8c tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:58.788818 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0a301f1e-eb64-476a-ba7e-4e3f54478c8c tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5393 microversion: 2.1 time: 0.035923 Jul 25 12:37:58.789962 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 8/22] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:37:58 2022] GET /compute/v2.1/flavors/detail => generated 5393 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:37:58.797884 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ac0f1a20-26d6-45e5-81f7-697da081352c tempest-FlavorsExtraSpecsTestJSON-782855277 tempest-FlavorsExtraSpecsTestJSON-782855277-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:58.812055 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ac0f1a20-26d6-45e5-81f7-697da081352c tempest-FlavorsExtraSpecsTestJSON-782855277 tempest-FlavorsExtraSpecsTestJSON-782855277-project] 10.222.0.49 "GET /compute/v2.1/flavors/495894981/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.020136 Jul 25 12:37:58.815860 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 9/23] 10.222.0.49 () {58 vars in 1242 bytes} [Mon Jul 25 12:37:58 2022] GET /compute/v2.1/flavors/495894981/os-extra_specs/hw:numa_nodes => generated 22 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:37:58.823845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ee564716-be5e-4657-9080-8cd4c3ae5b95 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1353022269", "id": 1391034166, "os-flavor-access:is_public": "True"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:37:58.853148 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:58.853148 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:37:58.884449 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ee564716-be5e-4657-9080-8cd4c3ae5b95 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.065857 Jul 25 12:37:58.885080 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 10/24] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:37:58 2022] POST /compute/v2.1/flavors => generated 429 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:37:58.894292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0de50beb-475c-4dee-818e-a405a7faa687 tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:37:58.919256 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0de50beb-475c-4dee-818e-a405a7faa687 tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/495894981/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.033058 Jul 25 12:37:58.919873 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 11/25] 10.222.0.49 () {60 vars in 1221 bytes} [Mon Jul 25 12:37:58 2022] POST /compute/v2.1/flavors/495894981/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:37:58.924507 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-977b7698-c29a-4b0a-839e-0a09d48268a0 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:58.925512 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:58.925512 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:37:58.944206 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-977b7698-c29a-4b0a-839e-0a09d48268a0 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1391034166" status: 202 len: 0 microversion: 2.1 time: 0.022881 Jul 25 12:37:58.945898 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 12/26] 10.222.0.49 () {58 vars in 1161 bytes} [Mon Jul 25 12:37:58 2022] DELETE /compute/v2.1/flavors/1391034166 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:37:58.954367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6471999b-b6bb-43cb-b24e-ca373a4d9237 tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:58.965184 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6471999b-b6bb-43cb-b24e-ca373a4d9237 tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/495894981/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.016922 Jul 25 12:37:58.966192 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 13/27] 10.222.0.49 () {58 vars in 1200 bytes} [Mon Jul 25 12:37:58 2022] GET /compute/v2.1/flavors/495894981/os-extra_specs => generated 66 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:37:58.975034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c3e722b2-cd5a-4033-a99d-5a57aaeb2f9b tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:59.019220 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c3e722b2-cd5a-4033-a99d-5a57aaeb2f9b tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5393 microversion: 2.1 time: 0.051566 Jul 25 12:37:59.019817 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 14/28] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:37:58 2022] GET /compute/v2.1/flavors/detail => generated 5393 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:37:59.024313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b8140830-cef2-44e6-9652-8270814d044a tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:37:59.043324 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:59.043324 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:37:59.076519 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b8140830-cef2-44e6-9652-8270814d044a tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] 10.222.0.49 "PUT /compute/v2.1/flavors/495894981/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.055548 Jul 25 12:37:59.078088 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 15/29] 10.222.0.49 () {60 vars in 1262 bytes} [Mon Jul 25 12:37:59 2022] PUT /compute/v2.1/flavors/495894981/os-extra_specs/hw:numa_nodes => generated 22 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:37:59.085084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b2fecb46-98d2-462e-ba26-b925def2bc2d tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2137852333", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:37:59.107411 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b2fecb46-98d2-462e-ba26-b925def2bc2d tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.027798 Jul 25 12:37:59.115684 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 16/30] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:37:59 2022] POST /compute/v2.1/flavors => generated 507 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:37:59.135894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-615f6402-0f67-4309-97f4-85dd1627a937 tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:59.144397 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-615f6402-0f67-4309-97f4-85dd1627a937 tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/495894981/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.026317 Jul 25 12:37:59.145909 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 17/31] 10.222.0.49 () {58 vars in 1200 bytes} [Mon Jul 25 12:37:59 2022] GET /compute/v2.1/flavors/495894981/os-extra_specs => generated 66 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:37:59.151113 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-daf42375-aeef-461b-8857-a490fafa82e2 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:59.171401 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-daf42375-aeef-461b-8857-a490fafa82e2 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/5fe38319-5136-4204-8fb7-8a2399d81d29" status: 202 len: 0 microversion: 2.1 time: 0.023920 Jul 25 12:37:59.173257 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 18/32] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:37:59 2022] DELETE /compute/v2.1/flavors/5fe38319-5136-4204-8fb7-8a2399d81d29 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:37:59.184492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-353cdcf1-d572-41df-b6a2-3804124733fe tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:59.185442 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:59.185442 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:37:59.246702 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-353cdcf1-d572-41df-b6a2-3804124733fe tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/495894981/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.068519 Jul 25 12:37:59.247285 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 19/33] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Jul 25 12:37:59 2022] DELETE /compute/v2.1/flavors/495894981/os-extra_specs/hw:numa_nodes => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 12:37:59.258121 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5e61378f-b32f-44e9-9cf5-021f85afad49 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:59.314303 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5e61378f-b32f-44e9-9cf5-021f85afad49 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5393 microversion: 2.1 time: 0.059711 Jul 25 12:37:59.323188 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 20/34] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:37:59 2022] GET /compute/v2.1/flavors/detail => generated 5393 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:37:59.335818 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e3c26515-631d-4272-870e-c12965ab5bfc tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:59.354301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=10,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:37:59.392610 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e3c26515-631d-4272-870e-c12965ab5bfc tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/495894981/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.067234 Jul 25 12:37:59.397249 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 21/35] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Jul 25 12:37:59 2022] DELETE /compute/v2.1/flavors/495894981/os-extra_specs/hw:cpu_policy => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 12:37:59.407792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f9aeb574-4c2f-40fa-b42a-2854a099e0ef tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1580605618", "id": "241230df-af1e-47ee-855d-0faa1b4b5f31", "os-flavor-access:is_public": "True"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:37:59.451247 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f9aeb574-4c2f-40fa-b42a-2854a099e0ef tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.051483 Jul 25 12:37:59.458112 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 22/36] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:37:59 2022] POST /compute/v2.1/flavors => generated 507 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:37:59.467798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-20aac0f9-b61c-4651-9ea8-636a7ea77c88 tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:59.491808 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-20aac0f9-b61c-4651-9ea8-636a7ea77c88 tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/495894981/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.027601 Jul 25 12:37:59.493703 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 23/37] 10.222.0.49 () {58 vars in 1200 bytes} [Mon Jul 25 12:37:59 2022] GET /compute/v2.1/flavors/495894981/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:37:59.507841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4b67d19c-d39e-4c6e-b9c2-7f272fd732f0 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:59.548514 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4b67d19c-d39e-4c6e-b9c2-7f272fd732f0 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/241230df-af1e-47ee-855d-0faa1b4b5f31" status: 202 len: 0 microversion: 2.1 time: 0.050511 Jul 25 12:37:59.549212 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 24/38] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:37:59 2022] DELETE /compute/v2.1/flavors/241230df-af1e-47ee-855d-0faa1b4b5f31 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:37:59.557976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d54c5b4e-c12b-4c95-8f11-b83ec83ad9fd tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:59.627704 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d54c5b4e-c12b-4c95-8f11-b83ec83ad9fd tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/495894981" status: 202 len: 0 microversion: 2.1 time: 0.077441 Jul 25 12:37:59.641208 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 25/39] 10.222.0.49 () {58 vars in 1158 bytes} [Mon Jul 25 12:37:59 2022] DELETE /compute/v2.1/flavors/495894981 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:37:59.648042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7f022575-9c9e-4858-b970-997842edd1d6 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:59.739370 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7f022575-9c9e-4858-b970-997842edd1d6 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.097175 Jul 25 12:37:59.744883 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 26/40] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:37:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:37:59.755115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-835aff41-b54a-482a-9251-1b4c27c2605f tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:59.804244 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-835aff41-b54a-482a-9251-1b4c27c2605f tempest-FlavorsExtraSpecsTestJSON-1679012098 tempest-FlavorsExtraSpecsTestJSON-1679012098-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058169 Jul 25 12:37:59.806488 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5e016cbc-6556-4782-b2f7-389cb1d9097d tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 316 microversion: 2.1 time: 1.482728 Jul 25 12:37:59.807839 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 15/41] 10.222.0.49 () {60 vars in 1191 bytes} [Mon Jul 25 12:37:58 2022] POST /compute/v2.1/os-aggregates/1/action => generated 316 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:37:59.810396 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 27/42] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:37:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:37:59.820713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6f2eca0f-0b87-4250-a428-a6dfd8d9f1eb tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-425574576", "id": 319302845, "os-flavor-access:is_public": "True"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:37:59.830595 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:59.830595 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:37:59.876935 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6f2eca0f-0b87-4250-a428-a6dfd8d9f1eb tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.067673 Jul 25 12:37:59.877924 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 16/43] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:37:59 2022] POST /compute/v2.1/flavors => generated 410 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:37:59.889274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cb9289cc-a2b6-4659-85ff-305ea082dd42 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:59.904167 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cb9289cc-a2b6-4659-85ff-305ea082dd42 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/319302845" status: 200 len: 410 microversion: 2.1 time: 0.015445 Jul 25 12:37:59.906046 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 28/44] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Jul 25 12:37:59 2022] GET /compute/v2.1/flavors/319302845 => generated 410 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:00.409008 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b664dcc3-5361-4c55-bf65-1cbebac0023e tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-43903115", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "availability_zone": "tempest-test_az-1114651453"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:00.436714 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b664dcc3-5361-4c55-bf65-1cbebac0023e tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:00.437487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b664dcc3-5361-4c55-bf65-1cbebac0023e tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:00.439164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b664dcc3-5361-4c55-bf65-1cbebac0023e tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:00.439866 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b664dcc3-5361-4c55-bf65-1cbebac0023e tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:00.544231 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4ecc4aaf-e0f5-43eb-afdd-9ff1f0891c91 tempest-FlavorsAdminTestJSON-1592262416 tempest-FlavorsAdminTestJSON-1592262416-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:00.609319 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4ecc4aaf-e0f5-43eb-afdd-9ff1f0891c91 tempest-FlavorsAdminTestJSON-1592262416 tempest-FlavorsAdminTestJSON-1592262416-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.696049 Jul 25 12:38:00.610138 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 17/45] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:37:59 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:00.627737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b17ecc70-e4c0-4aaa-a5f8-b343f8b7f449 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:00.628510 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:00.628510 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:00.685673 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b17ecc70-e4c0-4aaa-a5f8-b343f8b7f449 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/319302845" status: 202 len: 0 microversion: 2.1 time: 0.059662 Jul 25 12:38:00.688066 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 18/46] 10.222.0.49 () {58 vars in 1158 bytes} [Mon Jul 25 12:38:00 2022] DELETE /compute/v2.1/flavors/319302845 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:38:00.698877 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-60932240-cd5b-4fec-8ec9-e14e5b25abbb tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:00.737646 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-60932240-cd5b-4fec-8ec9-e14e5b25abbb tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044535 Jul 25 12:38:00.739921 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 19/47] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:38:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:00.761896 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-06815050-ced1-4d56-9440-3b2d7dba1abf tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-508817702", "id": 913885856, "os-flavor-access:is_public": "False"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:00.797297 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-06815050-ced1-4d56-9440-3b2d7dba1abf tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.040176 Jul 25 12:38:00.801174 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 20/48] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:38:00 2022] POST /compute/v2.1/flavors => generated 426 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:38:00.816526 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2df7e7e8-481e-45bc-9884-63c007a8b8f3 tempest-FlavorsAdminTestJSON-1592262416 tempest-FlavorsAdminTestJSON-1592262416-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "913885856"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:00.866493 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-2df7e7e8-481e-45bc-9884-63c007a8b8f3 tempest-FlavorsAdminTestJSON-1592262416 tempest-FlavorsAdminTestJSON-1592262416-project] HTTP exception thrown: Flavor 913885856 could not be found. Jul 25 12:38:00.883877 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2df7e7e8-481e-45bc-9884-63c007a8b8f3 tempest-FlavorsAdminTestJSON-1592262416 tempest-FlavorsAdminTestJSON-1592262416-project] Request method failure captured: Jul 25 12:38:00.883877 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 12:38:00.883877 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:00.883877 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:00.883877 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:00.883877 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 106 Jul 25 12:38:00.883877 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:00.883877 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:00.883877 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:00.883877 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:00.883877 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6fcFbrWVKGX1ZvT_MBey8zGetiMcpflpTFZPP5fYN_knxIywY7IyTYMdG_CbrodvB66SRyVQS_rzDBETYcApCD2AFMZ9PcG1PtWCEZgEpWJbstYuTra2uxZwMq5qHsSQrFOh9bRqU_Qg5rFQoddzxdXWoIt9ZyQYhGyoCDqapFre4 Jul 25 12:38:00.883877 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:00.883877 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:00.883877 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:00.883877 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:00.883877 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:00.883877 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:00.883877 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 4facef0563264fafad90812529e785fc Jul 25 12:38:00.883877 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-FlavorsAdminTestJSON-1592262416 Jul 25 12:38:00.883877 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:38:00.883877 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:38:00.886433 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4facef0563264fafad90812529e785fc", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4facef0563264fafad90812529e785fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4facef0563264fafad90812529e785fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4facef0563264fafad90812529e785fc"}]}] Jul 25 12:38:00.886433 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-FlavorsAdminTestJSON-1592262416 Jul 25 12:38:00.886433 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 4facef0563264fafad90812529e785fc Jul 25 12:38:00.886433 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1592262416 Jul 25 12:38:00.886433 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-FlavorsAdminTestJSON-1592262416-project Jul 25 12:38:00.886433 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:00.886433 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:00.886433 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 9344b6c3e97a4a6d959183a33c5ec4ed Jul 25 12:38:00.886433 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-FlavorsAdminTestJSON-1592262416-project Jul 25 12:38:00.886433 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:38:00.886433 n-d-848886-15 devstack@n-api.service[125883]: {"server": {"name": "test", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "913885856"}} Jul 25 12:38:00.886433 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:38:00.886433 n-d-848886-15 devstack@n-api.service[125883]: exception: Flavor 913885856 could not be found. Jul 25 12:38:00.887169 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '913885856'}}} Jul 25 12:38:00.887169 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:00.887169 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:00.887169 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 25 12:38:00.887169 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 25 12:38:00.887169 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 12:38:00.887169 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 12:38:00.887169 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:38:00.887169 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:38:00.887169 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 12:38:00.887169 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 12:38:00.887169 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 12:38:00.887169 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:00.887169 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 12:38:00.887169 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 12:38:00.887169 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 913885856 could not be found. Jul 25 12:38:00.887169 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:00.887169 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:00.887169 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:00.887169 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:00.888166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:00.888166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:00.888166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:00.888166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:00.888166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:00.888166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:00.888166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:38:00.888166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:38:00.888166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:38:00.888166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:38:00.888166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:38:00.888166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:38:00.888166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 12:38:00.888166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 25 12:38:00.888166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 25 12:38:00.888166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 913885856 could not be found. Jul 25 12:38:00.888166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:00.888166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:00.888166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:00.888166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:00.888166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:00.889218 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:00.889218 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:00.889218 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:00.889218 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 913885856 could not be found. Jul 25 12:38:00.889218 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:00.889218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2df7e7e8-481e-45bc-9884-63c007a8b8f3 tempest-FlavorsAdminTestJSON-1592262416 tempest-FlavorsAdminTestJSON-1592262416-project] Returning 400 to user: Flavor 913885856 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:00.891328 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2df7e7e8-481e-45bc-9884-63c007a8b8f3 tempest-FlavorsAdminTestJSON-1592262416 tempest-FlavorsAdminTestJSON-1592262416-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.076081 Jul 25 12:38:00.894314 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 21/49] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:38:00 2022] POST /compute/v2.1/servers => generated 80 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:38:00.911288 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d2bfc5e9-4e3e-47c5-b0c9-6a4c0c9648bb tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:00.924009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=10,nova_api:DELETE=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:38:00.958546 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d2bfc5e9-4e3e-47c5-b0c9-6a4c0c9648bb tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/913885856" status: 202 len: 0 microversion: 2.1 time: 0.060193 Jul 25 12:38:00.960163 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 22/50] 10.222.0.49 () {58 vars in 1158 bytes} [Mon Jul 25 12:38:00 2022] DELETE /compute/v2.1/flavors/913885856 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 12:38:00.970397 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b619c0b5-5904-4063-a66c-9e2a58a679d3 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:01.017293 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b619c0b5-5904-4063-a66c-9e2a58a679d3 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053549 Jul 25 12:38:01.017931 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 23/51] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:38:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:38:01.040934 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-16c0dd79-4394-448b-99db-121181ab4d6b tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1265812777", "id": 895285242, "os-flavor-access:is_public": "False"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:01.081515 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-16c0dd79-4394-448b-99db-121181ab4d6b tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.048187 Jul 25 12:38:01.086348 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 24/52] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:38:01 2022] POST /compute/v2.1/flavors => generated 412 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:01.094639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6265b148-bf47-4889-b765-52144835b2b3 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-397578176", "id": 1062588275, "os-flavor-access:is_public": "True"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:01.141742 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6265b148-bf47-4889-b765-52144835b2b3 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.051705 Jul 25 12:38:01.143469 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 25/53] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:38:01 2022] POST /compute/v2.1/flavors => generated 413 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:01.164643 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-da5962e1-c100-4118-87fd-ca024edda594 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:01.199820 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-da5962e1-c100-4118-87fd-ca024edda594 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.045338 Jul 25 12:38:01.201213 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 26/54] 10.222.0.49 () {58 vars in 1169 bytes} [Mon Jul 25 12:38:01 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:01.229576 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ae7e5402-37a8-4389-9382-4ecee32d46ea tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:01.252889 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ae7e5402-37a8-4389-9382-4ecee32d46ea tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.040690 Jul 25 12:38:01.257500 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 27/55] 10.222.0.49 () {58 vars in 1177 bytes} [Mon Jul 25 12:38:01 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:01.270802 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f31782bf-d440-4103-90fc-c8b0ab510275 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:01.285328 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f31782bf-d440-4103-90fc-c8b0ab510275 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.019411 Jul 25 12:38:01.286785 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 28/56] 10.222.0.49 () {58 vars in 1171 bytes} [Mon Jul 25 12:38:01 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:38:01.304650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5234c824-7bbb-429a-82ae-a796a2e98b63 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:01.329016 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5234c824-7bbb-429a-82ae-a796a2e98b63 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.032851 Jul 25 12:38:01.330098 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 29/57] 10.222.0.49 () {58 vars in 1169 bytes} [Mon Jul 25 12:38:01 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:01.350910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d55e72af-b72d-4bd4-8633-b54700de430b tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:01.407143 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d55e72af-b72d-4bd4-8633-b54700de430b tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.068152 Jul 25 12:38:01.408497 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 30/58] 10.222.0.49 () {58 vars in 1169 bytes} [Mon Jul 25 12:38:01 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:01.425523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0d39094e-5890-4491-a5d9-de4af441535f tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:01.463202 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0d39094e-5890-4491-a5d9-de4af441535f tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.041162 Jul 25 12:38:01.463803 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 31/59] 10.222.0.49 () {58 vars in 1175 bytes} [Mon Jul 25 12:38:01 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:38:01.490988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c01be693-fcab-4622-99a0-87809bad3a9f tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:01.522203 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c01be693-fcab-4622-99a0-87809bad3a9f tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.034804 Jul 25 12:38:01.535496 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 32/60] 10.222.0.49 () {58 vars in 1173 bytes} [Mon Jul 25 12:38:01 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:01.540354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d1587f94-0d67-46d9-89b0-ab267eb51af2 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:01.564180 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d1587f94-0d67-46d9-89b0-ab267eb51af2 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.027478 Jul 25 12:38:01.564977 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 33/61] 10.222.0.49 () {58 vars in 1169 bytes} [Mon Jul 25 12:38:01 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:01.582070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-53e762f8-cd0c-4d80-ad0e-eec0127b4ec9 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:01.602224 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-53e762f8-cd0c-4d80-ad0e-eec0127b4ec9 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1062588275" status: 202 len: 0 microversion: 2.1 time: 0.023600 Jul 25 12:38:01.603073 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 34/62] 10.222.0.49 () {58 vars in 1161 bytes} [Mon Jul 25 12:38:01 2022] DELETE /compute/v2.1/flavors/1062588275 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:38:01.615875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2a131ab0-8297-49a8-a91e-da7f5abb3605 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:01.645512 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2a131ab0-8297-49a8-a91e-da7f5abb3605 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037556 Jul 25 12:38:01.646395 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 35/63] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:38:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:01.664172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-70cf0097-6bff-438c-9cb8-8ea0712af621 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:01.686005 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-70cf0097-6bff-438c-9cb8-8ea0712af621 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/895285242" status: 202 len: 0 microversion: 2.1 time: 0.025145 Jul 25 12:38:01.690926 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 36/64] 10.222.0.49 () {58 vars in 1158 bytes} [Mon Jul 25 12:38:01 2022] DELETE /compute/v2.1/flavors/895285242 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 12:38:01.696697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-46902471-7243-46be-9409-deef5877a8be tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:01.742334 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-46902471-7243-46be-9409-deef5877a8be tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050013 Jul 25 12:38:01.759352 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 37/65] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:38:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:01.764397 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-25c84d07-0b98-4fd3-b584-5132c8a7bfdb tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1095338319", "id": 531900925, "os-flavor-access:is_public": "False"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:01.796054 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-25c84d07-0b98-4fd3-b584-5132c8a7bfdb tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.032840 Jul 25 12:38:01.805484 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 38/66] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:38:01 2022] POST /compute/v2.1/flavors => generated 412 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:01.810292 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dda037c6-777f-4dd2-ab87-6081c94a1a01 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:01.853864 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dda037c6-777f-4dd2-ab87-6081c94a1a01 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047092 Jul 25 12:38:01.878886 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 39/67] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:38:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:01.885119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5ade2826-270c-49b3-abd5-b052362857c7 tempest-FlavorsAdminTestJSON-1592262416 tempest-FlavorsAdminTestJSON-1592262416-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:01.914715 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5ade2826-270c-49b3-abd5-b052362857c7 tempest-FlavorsAdminTestJSON-1592262416 tempest-FlavorsAdminTestJSON-1592262416-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034333 Jul 25 12:38:01.932162 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 40/68] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:38:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:01.937145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-705aa280-31ce-4b7c-852c-f943cf88ee17 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:01.992042 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-705aa280-31ce-4b7c-852c-f943cf88ee17 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/531900925" status: 202 len: 0 microversion: 2.1 time: 0.058358 Jul 25 12:38:01.996800 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 41/69] 10.222.0.49 () {58 vars in 1158 bytes} [Mon Jul 25 12:38:01 2022] DELETE /compute/v2.1/flavors/531900925 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:38:02.002232 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8fa988eb-9b74-4035-9217-b075a627f521 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:02.052236 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8fa988eb-9b74-4035-9217-b075a627f521 tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053955 Jul 25 12:38:02.070164 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 42/70] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:38:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:02.080400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9215c5df-e3f3-40e1-8bf3-55d1586745db tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1420068452", "id": 1965918466, "os-flavor-access:is_public": "True"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:02.123596 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9215c5df-e3f3-40e1-8bf3-55d1586745db tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.042453 Jul 25 12:38:02.125914 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 43/71] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:38:02 2022] POST /compute/v2.1/flavors => generated 414 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:38:02.145379 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5b3ad08d-d66e-42cc-8ddc-ff0c55b67fb4 tempest-FlavorsAdminTestJSON-1592262416 tempest-FlavorsAdminTestJSON-1592262416-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:02.197435 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5b3ad08d-d66e-42cc-8ddc-ff0c55b67fb4 tempest-FlavorsAdminTestJSON-1592262416 tempest-FlavorsAdminTestJSON-1592262416-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.062999 Jul 25 12:38:02.214097 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 44/72] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:38:02 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:02.225699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-b664dcc3-5361-4c55-bf65-1cbebac0023e tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] validate_networks() for None {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:38:02.227569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d2d2cda6-e178-47e2-a912-8d536a2e052d tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:02.273642 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d2d2cda6-e178-47e2-a912-8d536a2e052d tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1965918466" status: 202 len: 0 microversion: 2.1 time: 0.051109 Jul 25 12:38:02.277954 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 45/73] 10.222.0.49 () {58 vars in 1161 bytes} [Mon Jul 25 12:38:02 2022] DELETE /compute/v2.1/flavors/1965918466 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 12:38:02.284037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d60caacc-5f31-4114-b753-8f7ef6d8860f tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:02.351556 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d60caacc-5f31-4114-b753-8f7ef6d8860f tempest-FlavorsAdminTestJSON-654135123 tempest-FlavorsAdminTestJSON-654135123-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071826 Jul 25 12:38:02.353445 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 46/74] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:38:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:03.406252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-b664dcc3-5361-4c55-bf65-1cbebac0023e tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:38:03.406696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-b664dcc3-5361-4c55-bf65-1cbebac0023e tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:38:03.407189 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-b664dcc3-5361-4c55-bf65-1cbebac0023e tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:38:03.407604 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-b664dcc3-5361-4c55-bf65-1cbebac0023e tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:38:03.409347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-b664dcc3-5361-4c55-bf65-1cbebac0023e tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:38:03.454156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b664dcc3-5361-4c55-bf65-1cbebac0023e tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:03.454504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b664dcc3-5361-4c55-bf65-1cbebac0023e tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:03.461516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b664dcc3-5361-4c55-bf65-1cbebac0023e tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:03.461892 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b664dcc3-5361-4c55-bf65-1cbebac0023e tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:03.559572 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-b664dcc3-5361-4c55-bf65-1cbebac0023e tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Getting quotas for project 2056d16864614f9587078e33c8ce795b. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:38:03.575561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-b664dcc3-5361-4c55-bf65-1cbebac0023e tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Getting quotas for user 3b2cfc6122c9496992160b7c0c64dab3 and project 2056d16864614f9587078e33c8ce795b. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:38:03.612415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b664dcc3-5361-4c55-bf65-1cbebac0023e tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:38:03.615313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b664dcc3-5361-4c55-bf65-1cbebac0023e tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:38:03.873336 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b664dcc3-5361-4c55-bf65-1cbebac0023e tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.838739 Jul 25 12:38:03.874463 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 29/75] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:38:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:38:03.886612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-90dd91b3-5a62-43fb-a61a-8bd834687d1c tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:03.887989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-90dd91b3-5a62-43fb-a61a-8bd834687d1c tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:05.528222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-90dd91b3-5a62-43fb-a61a-8bd834687d1c tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2cfc6122c9496992160b7c0c64dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2056d16864614f9587078e33c8ce795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:05.560940 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-90dd91b3-5a62-43fb-a61a-8bd834687d1c tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 200 len: 1241 microversion: 2.1 time: 1.676197 Jul 25 12:38:05.561594 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 47/76] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:03 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 1241 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:06.584475 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a2ab78f5-522c-4a03-ae6e-b3552cac7ef9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:06.585895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a2ab78f5-522c-4a03-ae6e-b3552cac7ef9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:06.614922 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a2ab78f5-522c-4a03-ae6e-b3552cac7ef9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:06.615712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a2ab78f5-522c-4a03-ae6e-b3552cac7ef9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:06.616709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a2ab78f5-522c-4a03-ae6e-b3552cac7ef9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:06.622528 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a2ab78f5-522c-4a03-ae6e-b3552cac7ef9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:06.964938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a2ab78f5-522c-4a03-ae6e-b3552cac7ef9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2cfc6122c9496992160b7c0c64dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2056d16864614f9587078e33c8ce795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:06.988401 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a2ab78f5-522c-4a03-ae6e-b3552cac7ef9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 200 len: 1233 microversion: 2.1 time: 0.408615 Jul 25 12:38:06.989313 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 30/77] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:06 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 1233 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:07.303699 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-31a975bb-663c-4b7b-bd53-9a9ecd32d7fa tempest-HypervisorAdminV228Test-917812486 tempest-HypervisorAdminV228Test-917812486-project-admin] Calling method '.version_select at 0x7efcfaa43c10>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:07.305249 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:07.305249 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:07.307251 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31a975bb-663c-4b7b-bd53-9a9ecd32d7fa tempest-HypervisorAdminV228Test-917812486 tempest-HypervisorAdminV228Test-917812486-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:07.307845 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31a975bb-663c-4b7b-bd53-9a9ecd32d7fa tempest-HypervisorAdminV228Test-917812486 tempest-HypervisorAdminV228Test-917812486-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:07.329607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31a975bb-663c-4b7b-bd53-9a9ecd32d7fa tempest-HypervisorAdminV228Test-917812486 tempest-HypervisorAdminV228Test-917812486-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:07.331082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31a975bb-663c-4b7b-bd53-9a9ecd32d7fa tempest-HypervisorAdminV228Test-917812486 tempest-HypervisorAdminV228Test-917812486-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:07.386346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31a975bb-663c-4b7b-bd53-9a9ecd32d7fa tempest-HypervisorAdminV228Test-917812486 tempest-HypervisorAdminV228Test-917812486-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:07.389255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31a975bb-663c-4b7b-bd53-9a9ecd32d7fa tempest-HypervisorAdminV228Test-917812486 tempest-HypervisorAdminV228Test-917812486-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:07.400016 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-31a975bb-663c-4b7b-bd53-9a9ecd32d7fa tempest-HypervisorAdminV228Test-917812486 tempest-HypervisorAdminV228Test-917812486-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.724481 Jul 25 12:38:07.403040 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 48/78] 10.222.0.49 () {60 vars in 1187 bytes} [Mon Jul 25 12:38:06 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:38:07.416107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-39a431b2-0ae2-487c-902e-41bb56c0c484 tempest-HypervisorAdminV228Test-917812486 tempest-HypervisorAdminV228Test-917812486-project-admin] Calling method '.version_select at 0x7efcfb271b80>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:07.418923 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:07.418923 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:07.422151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-39a431b2-0ae2-487c-902e-41bb56c0c484 tempest-HypervisorAdminV228Test-917812486 tempest-HypervisorAdminV228Test-917812486-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:07.423640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-39a431b2-0ae2-487c-902e-41bb56c0c484 tempest-HypervisorAdminV228Test-917812486 tempest-HypervisorAdminV228Test-917812486-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:07.479806 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-39a431b2-0ae2-487c-902e-41bb56c0c484 tempest-HypervisorAdminV228Test-917812486 tempest-HypervisorAdminV228Test-917812486-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:07.480245 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-39a431b2-0ae2-487c-902e-41bb56c0c484 tempest-HypervisorAdminV228Test-917812486 tempest-HypervisorAdminV228Test-917812486-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:07.488420 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-39a431b2-0ae2-487c-902e-41bb56c0c484 tempest-HypervisorAdminV228Test-917812486 tempest-HypervisorAdminV228Test-917812486-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.077360 Jul 25 12:38:07.489057 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 31/79] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Jul 25 12:38:07 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:38:08.010102 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-01f82c26-cea7-40c1-898b-6bfd479227fc tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:08.011046 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-01f82c26-cea7-40c1-898b-6bfd479227fc tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:08.020910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01f82c26-cea7-40c1-898b-6bfd479227fc tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:08.021707 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01f82c26-cea7-40c1-898b-6bfd479227fc tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:08.025123 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01f82c26-cea7-40c1-898b-6bfd479227fc tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:08.025759 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01f82c26-cea7-40c1-898b-6bfd479227fc tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:08.222715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-01f82c26-cea7-40c1-898b-6bfd479227fc tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2cfc6122c9496992160b7c0c64dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2056d16864614f9587078e33c8ce795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:08.235594 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:38:08.239430 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-01f82c26-cea7-40c1-898b-6bfd479227fc tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 200 len: 1295 microversion: 2.1 time: 0.232405 Jul 25 12:38:08.254138 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 49/80] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:08 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 1295 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:08.668098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-690632b3-3c6f-4722-b926-eada834146e0 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:08.682920 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-690632b3-3c6f-4722-b926-eada834146e0 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.497043 Jul 25 12:38:08.683532 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 32/81] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:38:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:09.263026 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-50671a98-372e-4d90-bbab-d20b9de28a53 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:09.264060 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-50671a98-372e-4d90-bbab-d20b9de28a53 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:09.282179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50671a98-372e-4d90-bbab-d20b9de28a53 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:09.287223 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50671a98-372e-4d90-bbab-d20b9de28a53 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:09.289365 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50671a98-372e-4d90-bbab-d20b9de28a53 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:09.294700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50671a98-372e-4d90-bbab-d20b9de28a53 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:09.492035 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a0426acc-099c-4a9d-ab25-ad8ca460ff42 tempest-ServersWithSpecificFlavorTestJSON-890992005 tempest-ServersWithSpecificFlavorTestJSON-890992005-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1266700462", "id": 1596786347, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:09.496180 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:09.496180 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:09.546710 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a0426acc-099c-4a9d-ab25-ad8ca460ff42 tempest-ServersWithSpecificFlavorTestJSON-890992005 tempest-ServersWithSpecificFlavorTestJSON-890992005-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.853175 Jul 25 12:38:09.551016 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 50/82] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:38:08 2022] POST /compute/v2.1/flavors => generated 425 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:09.563417 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7955b5df-bca2-43a7-a2d8-aa0526ab6c5b tempest-ServersWithSpecificFlavorTestJSON-890992005 tempest-ServersWithSpecificFlavorTestJSON-890992005-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:09.632580 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7955b5df-bca2-43a7-a2d8-aa0526ab6c5b tempest-ServersWithSpecificFlavorTestJSON-890992005 tempest-ServersWithSpecificFlavorTestJSON-890992005-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.073910 Jul 25 12:38:09.638420 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 51/83] 10.222.0.49 () {58 vars in 1182 bytes} [Mon Jul 25 12:38:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 12:38:09.656531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-076ba5a0-90b5-4ef3-9db4-d12285934dcd tempest-ServersWithSpecificFlavorTestJSON-890992005 tempest-ServersWithSpecificFlavorTestJSON-890992005-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1372242286", "id": 1130049463, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:09.703384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:DELETE=14,nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:38:09.708607 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-076ba5a0-90b5-4ef3-9db4-d12285934dcd tempest-ServersWithSpecificFlavorTestJSON-890992005 tempest-ServersWithSpecificFlavorTestJSON-890992005-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.065591 Jul 25 12:38:09.719604 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 52/84] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:38:09 2022] POST /compute/v2.1/flavors => generated 425 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:09.727848 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0830b573-35ac-47e5-af8d-cb76de0754cf tempest-ServersWithSpecificFlavorTestJSON-890992005 tempest-ServersWithSpecificFlavorTestJSON-890992005-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:09.750160 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0830b573-35ac-47e5-af8d-cb76de0754cf tempest-ServersWithSpecificFlavorTestJSON-890992005 tempest-ServersWithSpecificFlavorTestJSON-890992005-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.026006 Jul 25 12:38:09.753397 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 53/85] 10.222.0.49 () {58 vars in 1182 bytes} [Mon Jul 25 12:38:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:38:09.776345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1131198e-db54-4543-8fd0-df1c9d345163 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Action: 'create', calling method: .version_select at 0x7efcfa90cd30>, body: {"keypair": {"name": "tempest-keypair-1722192819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaYgpKLdNmSL/jpwkOcMruKClCWO9+GpufmijVD7WCQmabChKsAGqDAR7cEZLnicRm+3AtrHHVLPfjUR4ht4KxRtxF8Q8L/e+EM1rSLbYHI4X3NPqGufXOcmgtyvvdNkA=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:09.879377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-1131198e-db54-4543-8fd0-df1c9d345163 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Getting quotas for project 4ded56ca1da44b65a227d978f927d9db. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:38:09.908890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-1131198e-db54-4543-8fd0-df1c9d345163 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Getting quotas for user ef5e681ba263436099656b879c77162b and project 4ded56ca1da44b65a227d978f927d9db. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:38:09.949685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-50671a98-372e-4d90-bbab-d20b9de28a53 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2cfc6122c9496992160b7c0c64dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2056d16864614f9587078e33c8ce795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:09.967424 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-50671a98-372e-4d90-bbab-d20b9de28a53 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 200 len: 1337 microversion: 2.1 time: 0.704148 Jul 25 12:38:09.968095 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 33/86] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:09 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 1337 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:10.011671 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1131198e-db54-4543-8fd0-df1c9d345163 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.244015 Jul 25 12:38:10.013568 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 54/87] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:38:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:10.989341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b2fba21d-5db9-4153-ae37-b1ea3e1b1d86 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:10.990340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b2fba21d-5db9-4153-ae37-b1ea3e1b1d86 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:10.999197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b2fba21d-5db9-4153-ae37-b1ea3e1b1d86 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:10.999388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b2fba21d-5db9-4153-ae37-b1ea3e1b1d86 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:11.000181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b2fba21d-5db9-4153-ae37-b1ea3e1b1d86 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:11.000619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b2fba21d-5db9-4153-ae37-b1ea3e1b1d86 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:11.413135 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b2fba21d-5db9-4153-ae37-b1ea3e1b1d86 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2cfc6122c9496992160b7c0c64dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2056d16864614f9587078e33c8ce795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:11.429535 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b2fba21d-5db9-4153-ae37-b1ea3e1b1d86 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 200 len: 1337 microversion: 2.1 time: 0.444283 Jul 25 12:38:11.444158 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 55/88] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:10 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 1337 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:11.764777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-59b66688-3ed9-4c1d-adc7-f9ce43bf9ca3 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-958319412", "ram": 512, "vcpus": 1, "disk": 10, "id": 2095673050, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:11.771917 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:11.771917 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:11.801105 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-59b66688-3ed9-4c1d-adc7-f9ce43bf9ca3 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 1.180629 Jul 25 12:38:11.803112 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 34/89] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:38:10 2022] POST /compute/v2.1/flavors => generated 415 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:12.285052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-68f66aab-273a-46ba-861e-bd545bf5a1e1 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:12.307279 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-68f66aab-273a-46ba-861e-bd545bf5a1e1 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project] HTTP exception thrown: Flavor 2095673050 has no extra specs with key hw:cpu_thread_policy. Jul 25 12:38:12.318464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-68f66aab-273a-46ba-861e-bd545bf5a1e1 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project] Request method failure captured: Jul 25 12:38:12.318464 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/flavors/2095673050/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 25 12:38:12.318464 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:12.318464 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:12.318464 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:12.318464 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:12.318464 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:12.318464 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:12.318464 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:12.318464 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:12.318464 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6uWiDsDFslz-xIvtyvhxv_3S7TsoKqIpyck0O4nANvLG8vIelLl7AlEH_wvWEsW2yNIRTYkPUSak9azFg50VdUC8ACPpMljs54fE4wIfgkymLUXpVOC9fLSNIYja5YwHfrQ638GfpPhSROU9eUNTlkecbwjWk9XljQiRM77S9EoA8 Jul 25 12:38:12.318464 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:12.318464 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:12.318464 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:12.318464 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:12.318464 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:12.318464 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:12.318464 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 717a68eaf6b94f38a2754b7c650a4078 Jul 25 12:38:12.318464 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 Jul 25 12:38:12.318464 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:38:12.318464 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:38:12.319816 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_717a68eaf6b94f38a2754b7c650a4078", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/717a68eaf6b94f38a2754b7c650a4078"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/717a68eaf6b94f38a2754b7c650a4078"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/717a68eaf6b94f38a2754b7c650a4078"}]}] Jul 25 12:38:12.319816 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 Jul 25 12:38:12.319816 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 717a68eaf6b94f38a2754b7c650a4078 Jul 25 12:38:12.319816 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 Jul 25 12:38:12.319816 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project Jul 25 12:38:12.319816 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:12.319816 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:12.319816 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: e90bef71ef624dc2b2920b2e3ccde23b Jul 25 12:38:12.319816 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project Jul 25 12:38:12.319816 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:38:12.319816 n-d-848886-15 devstack@n-api.service[125883]: exception: Flavor 2095673050 has no extra specs with key hw:cpu_thread_policy. Jul 25 12:38:12.320489 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'flavor_id': '2095673050', 'id': 'hw:cpu_thread_policy'} Jul 25 12:38:12.320489 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:12.320489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:12.320489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 25 12:38:12.320489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 25 12:38:12.320489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 25 12:38:12.320489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:12.320489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:12.320489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:12.320489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:12.320489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:12.320489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:12.320489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:12.320489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:12.320489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:12.320489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:12.320489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 25 12:38:12.320489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 12:38:12.320489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2095673050 has no extra specs with key hw:cpu_thread_policy. Jul 25 12:38:12.320489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:12.320489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:12.320489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:12.321746 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:12.321746 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:12.321746 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:12.321746 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:12.321746 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:12.321746 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2095673050 has no extra specs with key hw:cpu_thread_policy. Jul 25 12:38:12.321746 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:12.325482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-68f66aab-273a-46ba-861e-bd545bf5a1e1 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project] Returning 404 to user: Flavor 2095673050 has no extra specs with key hw:cpu_thread_policy. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:12.332065 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-68f66aab-273a-46ba-861e-bd545bf5a1e1 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project] 10.222.0.49 "GET /compute/v2.1/flavors/2095673050/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.518349 Jul 25 12:38:12.336634 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 56/90] 10.222.0.49 () {58 vars in 1266 bytes} [Mon Jul 25 12:38:11 2022] GET /compute/v2.1/flavors/2095673050/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 525 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:12.349757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f637a601-a72b-4f3c-9b39-1ac36bb779a9 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:12.358584 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:12.358584 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:12.359588 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f637a601-a72b-4f3c-9b39-1ac36bb779a9 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'e90bef71ef624dc2b2920b2e3ccde23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717a68eaf6b94f38a2754b7c650a4078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:12.361191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f637a601-a72b-4f3c-9b39-1ac36bb779a9 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project] Request method failure captured: Jul 25 12:38:12.361191 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/flavors/2095673050/os-extra_specs HTTP/1.1 Jul 25 12:38:12.361191 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:12.361191 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:12.361191 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:12.361191 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 66 Jul 25 12:38:12.361191 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:12.361191 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:12.361191 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:12.361191 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:12.361191 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6uWiDsDFslz-xIvtyvhxv_3S7TsoKqIpyck0O4nANvLG8vIelLl7AlEH_wvWEsW2yNIRTYkPUSak9azFg50VdUC8ACPpMljs54fE4wIfgkymLUXpVOC9fLSNIYja5YwHfrQ638GfpPhSROU9eUNTlkecbwjWk9XljQiRM77S9EoA8 Jul 25 12:38:12.361191 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:12.361191 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:12.361191 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:12.361191 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:12.361191 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:12.361191 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:12.361191 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 717a68eaf6b94f38a2754b7c650a4078 Jul 25 12:38:12.361191 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 Jul 25 12:38:12.361191 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:38:12.361191 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:38:12.362598 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_717a68eaf6b94f38a2754b7c650a4078", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/717a68eaf6b94f38a2754b7c650a4078"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/717a68eaf6b94f38a2754b7c650a4078"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/717a68eaf6b94f38a2754b7c650a4078"}]}] Jul 25 12:38:12.362598 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 Jul 25 12:38:12.362598 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 717a68eaf6b94f38a2754b7c650a4078 Jul 25 12:38:12.362598 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 Jul 25 12:38:12.362598 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project Jul 25 12:38:12.362598 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:12.362598 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:12.362598 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: e90bef71ef624dc2b2920b2e3ccde23b Jul 25 12:38:12.362598 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project Jul 25 12:38:12.362598 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:38:12.362598 n-d-848886-15 devstack@n-api.service[125883]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 25 12:38:12.362598 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:38:12.363743 n-d-848886-15 devstack@n-api.service[125883]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 25 12:38:12.363743 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'flavor_id': '2095673050', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 25 12:38:12.363743 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:12.363743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:12.363743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:12.363743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:12.363743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:12.363743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:12.363743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:12.363743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:12.363743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:38:12.363743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:38:12.363743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 25 12:38:12.363743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 25 12:38:12.363743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:12.363743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:12.363743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:12.363743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:12.363743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:12.367287 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:12.367287 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:12.367287 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:12.367287 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:12.367287 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:12.367287 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:12.367287 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:12.367287 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:12.367287 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:12.367287 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 25 12:38:12.367287 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:12.367287 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:12.367287 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:12.367287 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:12.367287 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:12.367287 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:12.367287 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:12.367287 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:12.367287 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 25 12:38:12.367287 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:12.370803 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f637a601-a72b-4f3c-9b39-1ac36bb779a9 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:12.380787 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f637a601-a72b-4f3c-9b39-1ac36bb779a9 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project] 10.222.0.49 "POST /compute/v2.1/flavors/2095673050/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.032714 Jul 25 12:38:12.383585 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 57/91] 10.222.0.49 () {60 vars in 1224 bytes} [Mon Jul 25 12:38:12 2022] POST /compute/v2.1/flavors/2095673050/os-extra_specs => generated 124 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:12.404237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7ba38302-d592-4341-b74e-132c6ca73a50 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:12.502881 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7ba38302-d592-4341-b74e-132c6ca73a50 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/2095673050/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.099988 Jul 25 12:38:12.510081 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 58/92] 10.222.0.49 () {60 vars in 1224 bytes} [Mon Jul 25 12:38:12 2022] POST /compute/v2.1/flavors/2095673050/os-extra_specs => generated 66 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:38:12.518067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-30d28247-cb68-4adc-bca4-13e7a85befe9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:12.519449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-30d28247-cb68-4adc-bca4-13e7a85befe9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:12.528895 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30d28247-cb68-4adc-bca4-13e7a85befe9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:12.531625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30d28247-cb68-4adc-bca4-13e7a85befe9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:12.533537 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30d28247-cb68-4adc-bca4-13e7a85befe9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:12.535066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30d28247-cb68-4adc-bca4-13e7a85befe9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:12.631493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9e34f1c0-9c99-4bec-9d79-3b10cadcf143 tempest-FlavorsV255TestJSON-1258343127 tempest-FlavorsV255TestJSON-1258343127-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1183724662", "id": 82028835, "os-flavor-access:is_public": "True"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:12.692271 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9e34f1c0-9c99-4bec-9d79-3b10cadcf143 tempest-FlavorsV255TestJSON-1258343127 tempest-FlavorsV255TestJSON-1258343127-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 443 microversion: 2.55 time: 0.636806 Jul 25 12:38:12.706984 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 35/93] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Jul 25 12:38:12 2022] POST /compute/v2.1/flavors => generated 443 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:38:12.720353 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0cb49e49-e98c-4226-a6a3-589959079068 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:12.720353 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:12.720353 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:12.720353 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0cb49e49-e98c-4226-a6a3-589959079068 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'e90bef71ef624dc2b2920b2e3ccde23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717a68eaf6b94f38a2754b7c650a4078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:12.733373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0cb49e49-e98c-4226-a6a3-589959079068 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project] Request method failure captured: Jul 25 12:38:12.733373 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/flavors/2095673050/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 25 12:38:12.733373 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:38:12.733373 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:38:12.733373 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:38:12.733373 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:38:12.733373 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:38:12.733373 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:38:12.733373 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:38:12.733373 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:12.733373 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o6uWiDsDFslz-xIvtyvhxv_3S7TsoKqIpyck0O4nANvLG8vIelLl7AlEH_wvWEsW2yNIRTYkPUSak9azFg50VdUC8ACPpMljs54fE4wIfgkymLUXpVOC9fLSNIYja5YwHfrQ638GfpPhSROU9eUNTlkecbwjWk9XljQiRM77S9EoA8 Jul 25 12:38:12.733373 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:38:12.733373 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:38:12.733373 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:38:12.733373 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:38:12.733373 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:38:12.733373 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:38:12.733373 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 717a68eaf6b94f38a2754b7c650a4078 Jul 25 12:38:12.733373 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 Jul 25 12:38:12.733373 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:38:12.733373 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:38:12.735073 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_717a68eaf6b94f38a2754b7c650a4078", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/717a68eaf6b94f38a2754b7c650a4078"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/717a68eaf6b94f38a2754b7c650a4078"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/717a68eaf6b94f38a2754b7c650a4078"}]}] Jul 25 12:38:12.735073 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 Jul 25 12:38:12.735073 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 717a68eaf6b94f38a2754b7c650a4078 Jul 25 12:38:12.735073 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 Jul 25 12:38:12.735073 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project Jul 25 12:38:12.735073 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:38:12.735073 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:38:12.735073 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: e90bef71ef624dc2b2920b2e3ccde23b Jul 25 12:38:12.735073 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project Jul 25 12:38:12.735073 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:38:12.735073 n-d-848886-15 devstack@n-api.service[125884]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 25 12:38:12.735647 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'flavor_id': '2095673050', 'id': 'hw:numa_nodes'} Jul 25 12:38:12.735647 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:12.735647 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:12.735647 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:12.735647 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:12.735647 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:12.735647 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:12.735647 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:12.735647 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:12.735647 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 25 12:38:12.735647 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 25 12:38:12.735647 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:12.735647 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:12.735647 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:12.735647 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:12.735647 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:12.735647 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:12.735647 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:12.735647 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:12.735647 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:12.738353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:12.738353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:12.738353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:12.738353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:12.738353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:12.738353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 25 12:38:12.738353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:12.738353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:12.738353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:12.738353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:12.738353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:12.738353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:12.738353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:12.738353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:12.738353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 25 12:38:12.738353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:12.738353 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0cb49e49-e98c-4226-a6a3-589959079068 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:12.741744 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0cb49e49-e98c-4226-a6a3-589959079068 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project] 10.222.0.49 "DELETE /compute/v2.1/flavors/2095673050/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.026704 Jul 25 12:38:12.749444 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 36/94] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Jul 25 12:38:12 2022] DELETE /compute/v2.1/flavors/2095673050/os-extra_specs/hw:numa_nodes => generated 124 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:13.023221 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cb0037c7-ddbf-4539-9521-ec94a1eda5a2 tempest-FlavorsV255TestJSON-1456107113 tempest-FlavorsV255TestJSON-1456107113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:13.051399 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cb0037c7-ddbf-4539-9521-ec94a1eda5a2 tempest-FlavorsV255TestJSON-1456107113 tempest-FlavorsV255TestJSON-1456107113-project] 10.222.0.49 "GET /compute/v2.1/flavors/82028835" status: 200 len: 443 microversion: 2.55 time: 0.300362 Jul 25 12:38:13.053997 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 37/95] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Jul 25 12:38:12 2022] GET /compute/v2.1/flavors/82028835 => generated 443 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:38:13.073277 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cc606de7-09f8-4652-8328-f7947eedaae0 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:13.082077 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:13.082077 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:13.111489 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cc606de7-09f8-4652-8328-f7947eedaae0 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/2095673050/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.055990 Jul 25 12:38:13.113970 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 38/96] 10.222.0.49 () {60 vars in 1224 bytes} [Mon Jul 25 12:38:13 2022] POST /compute/v2.1/flavors/2095673050/os-extra_specs => generated 66 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:38:13.140829 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-25b970c2-fe38-41d3-996a-4e19724108eb tempest-FlavorsV255TestJSON-1258343127 tempest-FlavorsV255TestJSON-1258343127-project-admin] Action: 'update', calling method: .version_select at 0x7efcfc9a8b80>, body: {"flavor": {"description": "new"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:13.158393 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:13.158393 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:13.197679 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-25b970c2-fe38-41d3-996a-4e19724108eb tempest-FlavorsV255TestJSON-1258343127 tempest-FlavorsV255TestJSON-1258343127-project-admin] 10.222.0.49 "PUT /compute/v2.1/flavors/82028835" status: 200 len: 444 microversion: 2.55 time: 0.082106 Jul 25 12:38:13.204088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-30d28247-cb68-4adc-bca4-13e7a85befe9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2cfc6122c9496992160b7c0c64dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2056d16864614f9587078e33c8ce795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:13.208896 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 39/97] 10.222.0.49 () {62 vars in 1213 bytes} [Mon Jul 25 12:38:13 2022] PUT /compute/v2.1/flavors/82028835 => generated 444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:38:13.212908 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-30d28247-cb68-4adc-bca4-13e7a85befe9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 200 len: 1337 microversion: 2.1 time: 0.701328 Jul 25 12:38:13.213488 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 59/98] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:12 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 1337 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:13.213887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4393b2e6-61dd-45d2-baf3-18e82afe1ced tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:13.226263 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:13.226263 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:13.230579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4393b2e6-61dd-45d2-baf3-18e82afe1ced tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'e90bef71ef624dc2b2920b2e3ccde23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717a68eaf6b94f38a2754b7c650a4078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:13.232569 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4393b2e6-61dd-45d2-baf3-18e82afe1ced tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project] Request method failure captured: Jul 25 12:38:13.232569 n-d-848886-15 devstack@n-api.service[125884]: request: PUT /compute/v2.1/flavors/2095673050/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 25 12:38:13.232569 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:38:13.232569 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:38:13.232569 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:38:13.232569 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 22 Jul 25 12:38:13.232569 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:38:13.232569 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:38:13.232569 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:38:13.232569 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:13.232569 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o6uWiDsDFslz-xIvtyvhxv_3S7TsoKqIpyck0O4nANvLG8vIelLl7AlEH_wvWEsW2yNIRTYkPUSak9azFg50VdUC8ACPpMljs54fE4wIfgkymLUXpVOC9fLSNIYja5YwHfrQ638GfpPhSROU9eUNTlkecbwjWk9XljQiRM77S9EoA8 Jul 25 12:38:13.232569 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:38:13.232569 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:38:13.232569 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:38:13.232569 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:38:13.232569 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:38:13.232569 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:38:13.232569 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 717a68eaf6b94f38a2754b7c650a4078 Jul 25 12:38:13.232569 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 Jul 25 12:38:13.232569 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:38:13.232569 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:38:13.233783 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_717a68eaf6b94f38a2754b7c650a4078", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/717a68eaf6b94f38a2754b7c650a4078"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/717a68eaf6b94f38a2754b7c650a4078"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/717a68eaf6b94f38a2754b7c650a4078"}]}] Jul 25 12:38:13.233783 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 Jul 25 12:38:13.233783 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 717a68eaf6b94f38a2754b7c650a4078 Jul 25 12:38:13.233783 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 Jul 25 12:38:13.233783 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project Jul 25 12:38:13.233783 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:38:13.233783 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:38:13.233783 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: e90bef71ef624dc2b2920b2e3ccde23b Jul 25 12:38:13.233783 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project Jul 25 12:38:13.233783 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:38:13.233783 n-d-848886-15 devstack@n-api.service[125884]: {"hw:numa_nodes": "1"} Jul 25 12:38:13.233783 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:38:13.233783 n-d-848886-15 devstack@n-api.service[125884]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 25 12:38:13.234501 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'flavor_id': '2095673050', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 25 12:38:13.234501 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:13.234501 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:13.234501 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:13.234501 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:13.234501 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:13.234501 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:13.234501 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:13.234501 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:13.234501 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:38:13.234501 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:38:13.234501 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 25 12:38:13.234501 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 25 12:38:13.234501 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:13.234501 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:13.234501 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:13.234501 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:13.234501 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:13.234501 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:13.235682 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:13.235682 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:13.235682 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:13.235682 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:13.235682 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:13.235682 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:13.235682 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:13.235682 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:13.235682 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 25 12:38:13.235682 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:13.235682 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:13.235682 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:13.235682 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:13.235682 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:13.235682 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:13.235682 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:13.235682 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:13.235682 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 25 12:38:13.235682 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:13.236896 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4393b2e6-61dd-45d2-baf3-18e82afe1ced tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:13.236896 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4393b2e6-61dd-45d2-baf3-18e82afe1ced tempest-FlavorsExtraSpecsNegativeTestJSON-695065663 tempest-FlavorsExtraSpecsNegativeTestJSON-695065663-project] 10.222.0.49 "PUT /compute/v2.1/flavors/2095673050/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.024025 Jul 25 12:38:13.241156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d3b3b88e-4593-4918-9c6e-0f2114e9f45d tempest-FlavorsV255TestJSON-1456107113 tempest-FlavorsV255TestJSON-1456107113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:13.249005 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 40/99] 10.222.0.49 () {60 vars in 1265 bytes} [Mon Jul 25 12:38:13 2022] PUT /compute/v2.1/flavors/2095673050/os-extra_specs/hw:numa_nodes => generated 124 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:13.254517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7fd2577c-d2b0-4dc4-b639-53c78881a709 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:13.280239 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-7fd2577c-d2b0-4dc4-b639-53c78881a709 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] HTTP exception thrown: Flavor 2095673050 has no extra specs with key hw:cpu_thread_policy. Jul 25 12:38:13.281676 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7fd2577c-d2b0-4dc4-b639-53c78881a709 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] Request method failure captured: Jul 25 12:38:13.281676 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/flavors/2095673050/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 25 12:38:13.281676 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:38:13.281676 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:38:13.281676 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:38:13.281676 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:38:13.281676 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:38:13.281676 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:38:13.281676 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:38:13.281676 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:13.281676 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o6ycGTp0sF7X-L0MXRhzr6JvTES23H5DwSu_DCZK_voWPlcTDQZRvKFpQGsDj-UE7te9eLrO6mMCncgWoHH29DD6T0c9jhcnulvFaxZ-_bvDgbcqpVsY-r8H_fyS7peYJvR7qLA00m6x4q55np-I-Ake4SzmcyGlNi3d6Z6WYCHNEI Jul 25 12:38:13.281676 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:38:13.281676 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:38:13.281676 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:38:13.281676 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:38:13.281676 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:38:13.281676 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:38:13.281676 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 00caf5142dc14877bb63f96df4aad9e4 Jul 25 12:38:13.281676 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 Jul 25 12:38:13.281676 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,admin,member Jul 25 12:38:13.281676 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,admin,member Jul 25 12:38:13.283131 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_00caf5142dc14877bb63f96df4aad9e4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/00caf5142dc14877bb63f96df4aad9e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00caf5142dc14877bb63f96df4aad9e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00caf5142dc14877bb63f96df4aad9e4"}]}] Jul 25 12:38:13.283131 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 Jul 25 12:38:13.283131 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 00caf5142dc14877bb63f96df4aad9e4 Jul 25 12:38:13.283131 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 Jul 25 12:38:13.283131 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin Jul 25 12:38:13.283131 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:38:13.283131 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:38:13.283131 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 9030b7b4cfc64108b735dbbe5e547e09 Jul 25 12:38:13.283131 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin Jul 25 12:38:13.283131 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:38:13.283131 n-d-848886-15 devstack@n-api.service[125884]: exception: Flavor 2095673050 has no extra specs with key hw:cpu_thread_policy. Jul 25 12:38:13.283842 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'flavor_id': '2095673050', 'id': 'hw:cpu_thread_policy'} Jul 25 12:38:13.283842 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:13.283842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:13.283842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 25 12:38:13.283842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 25 12:38:13.283842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 25 12:38:13.283842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:13.283842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:13.283842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:13.283842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:13.283842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:13.283842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:13.283842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:13.283842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:13.283842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:13.283842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:13.283842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 25 12:38:13.283842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 12:38:13.283842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2095673050 has no extra specs with key hw:cpu_thread_policy. Jul 25 12:38:13.283842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:13.283842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:13.283842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:13.285350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:13.285350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:13.285350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:13.285350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:13.285350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:13.285350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2095673050 has no extra specs with key hw:cpu_thread_policy. Jul 25 12:38:13.285350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:13.285350 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7fd2577c-d2b0-4dc4-b639-53c78881a709 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] Returning 404 to user: Flavor 2095673050 has no extra specs with key hw:cpu_thread_policy. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:13.285350 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7fd2577c-d2b0-4dc4-b639-53c78881a709 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/2095673050/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.033028 Jul 25 12:38:13.298886 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 41/100] 10.222.0.49 () {58 vars in 1269 bytes} [Mon Jul 25 12:38:13 2022] DELETE /compute/v2.1/flavors/2095673050/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:13.315790 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d75a8cdc-6843-4c4b-a644-4854850a3ad7 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:13.319760 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-d75a8cdc-6843-4c4b-a644-4854850a3ad7 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 25 12:38:13.321101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d75a8cdc-6843-4c4b-a644-4854850a3ad7 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] Request method failure captured: Jul 25 12:38:13.321101 n-d-848886-15 devstack@n-api.service[125884]: request: PUT /compute/v2.1/flavors/2095673050/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 25 12:38:13.321101 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:38:13.321101 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:38:13.321101 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:38:13.321101 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 27 Jul 25 12:38:13.321101 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:38:13.321101 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:38:13.321101 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:38:13.321101 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:13.321101 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o6ycGTp0sF7X-L0MXRhzr6JvTES23H5DwSu_DCZK_voWPlcTDQZRvKFpQGsDj-UE7te9eLrO6mMCncgWoHH29DD6T0c9jhcnulvFaxZ-_bvDgbcqpVsY-r8H_fyS7peYJvR7qLA00m6x4q55np-I-Ake4SzmcyGlNi3d6Z6WYCHNEI Jul 25 12:38:13.321101 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:38:13.321101 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:38:13.321101 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:38:13.321101 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:38:13.321101 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:38:13.321101 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:38:13.321101 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 00caf5142dc14877bb63f96df4aad9e4 Jul 25 12:38:13.321101 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 Jul 25 12:38:13.321101 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,admin,member Jul 25 12:38:13.321101 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,admin,member Jul 25 12:38:13.322171 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_00caf5142dc14877bb63f96df4aad9e4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/00caf5142dc14877bb63f96df4aad9e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00caf5142dc14877bb63f96df4aad9e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00caf5142dc14877bb63f96df4aad9e4"}]}] Jul 25 12:38:13.322171 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 Jul 25 12:38:13.322171 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 00caf5142dc14877bb63f96df4aad9e4 Jul 25 12:38:13.322171 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 Jul 25 12:38:13.322171 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin Jul 25 12:38:13.322171 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:38:13.322171 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:38:13.322171 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 9030b7b4cfc64108b735dbbe5e547e09 Jul 25 12:38:13.322171 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin Jul 25 12:38:13.322171 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:38:13.322171 n-d-848886-15 devstack@n-api.service[125884]: {"hw:cpu_policy": "shared"} Jul 25 12:38:13.322171 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:38:13.322171 n-d-848886-15 devstack@n-api.service[125884]: exception: Request body and URI mismatch Jul 25 12:38:13.323023 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'flavor_id': '2095673050', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 25 12:38:13.323023 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:13.323023 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:13.323023 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:13.323023 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:13.323023 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:13.323023 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:13.323023 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:13.323023 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:13.323023 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:38:13.323023 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:38:13.323023 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 25 12:38:13.323023 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 25 12:38:13.323023 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 25 12:38:13.323023 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:13.323023 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:13.323023 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:13.323023 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:13.323023 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:13.323023 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:13.324025 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:13.324025 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:13.324025 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 25 12:38:13.324025 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:13.324025 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d75a8cdc-6843-4c4b-a644-4854850a3ad7 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:13.340031 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d75a8cdc-6843-4c4b-a644-4854850a3ad7 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] 10.222.0.49 "PUT /compute/v2.1/flavors/2095673050/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.039873 Jul 25 12:38:13.350886 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 42/101] 10.222.0.49 () {60 vars in 1265 bytes} [Mon Jul 25 12:38:13 2022] PUT /compute/v2.1/flavors/2095673050/os-extra_specs/hw:numa_nodes => generated 73 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:38:13.355420 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d3b3b88e-4593-4918-9c6e-0f2114e9f45d tempest-FlavorsV255TestJSON-1456107113 tempest-FlavorsV255TestJSON-1456107113-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 7017 microversion: 2.55 time: 0.137682 Jul 25 12:38:13.357859 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 60/102] 10.222.0.49 () {60 vars in 1187 bytes} [Mon Jul 25 12:38:13 2022] GET /compute/v2.1/flavors/detail => generated 7017 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:38:13.389118 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-20dbbbba-f863-453d-931f-712bf43289c7 tempest-FlavorsV255TestJSON-1456107113 tempest-FlavorsV255TestJSON-1456107113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:13.391465 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-18a1c0c8-ffe5-441d-8f6b-ff4e56124dc6 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:13.396410 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-18a1c0c8-ffe5-441d-8f6b-ff4e56124dc6 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] Request method failure captured: Jul 25 12:38:13.396410 n-d-848886-15 devstack@n-api.service[125884]: request: PUT /compute/v2.1/flavors/2095673050/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 25 12:38:13.396410 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:38:13.396410 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:38:13.396410 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:38:13.396410 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 49 Jul 25 12:38:13.396410 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:38:13.396410 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:38:13.396410 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:38:13.396410 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:13.396410 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o6ycGTp0sF7X-L0MXRhzr6JvTES23H5DwSu_DCZK_voWPlcTDQZRvKFpQGsDj-UE7te9eLrO6mMCncgWoHH29DD6T0c9jhcnulvFaxZ-_bvDgbcqpVsY-r8H_fyS7peYJvR7qLA00m6x4q55np-I-Ake4SzmcyGlNi3d6Z6WYCHNEI Jul 25 12:38:13.396410 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:38:13.396410 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:38:13.396410 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:38:13.396410 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:38:13.396410 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:38:13.396410 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:38:13.396410 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 00caf5142dc14877bb63f96df4aad9e4 Jul 25 12:38:13.396410 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 Jul 25 12:38:13.396410 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,admin,member Jul 25 12:38:13.396410 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,admin,member Jul 25 12:38:13.397536 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_00caf5142dc14877bb63f96df4aad9e4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/00caf5142dc14877bb63f96df4aad9e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00caf5142dc14877bb63f96df4aad9e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00caf5142dc14877bb63f96df4aad9e4"}]}] Jul 25 12:38:13.397536 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 Jul 25 12:38:13.397536 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 00caf5142dc14877bb63f96df4aad9e4 Jul 25 12:38:13.397536 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 Jul 25 12:38:13.397536 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin Jul 25 12:38:13.397536 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:38:13.397536 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:38:13.397536 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 9030b7b4cfc64108b735dbbe5e547e09 Jul 25 12:38:13.397536 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin Jul 25 12:38:13.397536 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:38:13.397536 n-d-848886-15 devstack@n-api.service[125884]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 25 12:38:13.397536 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:38:13.398587 n-d-848886-15 devstack@n-api.service[125884]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 25 12:38:13.398587 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'flavor_id': '2095673050', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 25 12:38:13.398587 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:13.398587 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:13.398587 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:38:13.398587 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:38:13.398587 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:38:13.398587 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:38:13.398587 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 25 12:38:13.398587 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:13.398587 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 25 12:38:13.398587 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 12:38:13.398587 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 25 12:38:13.398587 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 25 12:38:13.398587 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 12:38:13.398587 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 25 12:38:13.398587 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 25 12:38:13.398587 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 12:38:13.398587 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:13.398587 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi On instance: Jul 25 12:38:13.398587 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 25 12:38:13.398587 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:13.399689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:13.399689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:13.399689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:13.399689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:13.399689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:13.399689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:13.399689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:13.399689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:13.399689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:13.399689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:38:13.399689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:38:13.399689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:38:13.399689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:38:13.399689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:38:13.399689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:38:13.399689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 25 12:38:13.399689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:13.399689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:13.399689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:13.399689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:13.400979 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:13.400979 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:13.400979 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:38:13.400979 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:38:13.400979 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 25 12:38:13.400979 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:13.400979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-18a1c0c8-ffe5-441d-8f6b-ff4e56124dc6 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:13.400979 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-18a1c0c8-ffe5-441d-8f6b-ff4e56124dc6 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] 10.222.0.49 "PUT /compute/v2.1/flavors/2095673050/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.045605 Jul 25 12:38:13.411514 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 43/103] 10.222.0.49 () {60 vars in 1265 bytes} [Mon Jul 25 12:38:13 2022] PUT /compute/v2.1/flavors/2095673050/os-extra_specs/hw:numa_nodes => generated 117 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:38:13.426415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0a68887b-3d92-4b00-8baf-a117a5e2ea0d tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:13.427726 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:13.427726 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:13.484515 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0a68887b-3d92-4b00-8baf-a117a5e2ea0d tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/2095673050" status: 202 len: 0 microversion: 2.1 time: 0.070820 Jul 25 12:38:13.485108 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 44/104] 10.222.0.49 () {58 vars in 1161 bytes} [Mon Jul 25 12:38:13 2022] DELETE /compute/v2.1/flavors/2095673050 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:38:13.508218 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fd2fcb00-23fc-48ee-9e45-c0dcbaa6a90f tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:13.533994 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-20dbbbba-f863-453d-931f-712bf43289c7 tempest-FlavorsV255TestJSON-1456107113 tempest-FlavorsV255TestJSON-1456107113-project] 10.222.0.49 "GET /compute/v2.1/flavors" status: 200 len: 3933 microversion: 2.55 time: 0.144889 Jul 25 12:38:13.535695 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 61/105] 10.222.0.49 () {60 vars in 1166 bytes} [Mon Jul 25 12:38:13 2022] GET /compute/v2.1/flavors => generated 3933 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:38:13.547790 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:38:13.554841 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-877112e0-ec51-4dfc-b93a-65378ac944a4 tempest-FlavorsV255TestJSON-1258343127 tempest-FlavorsV255TestJSON-1258343127-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:13.581187 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:13.581187 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:13.629031 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fd2fcb00-23fc-48ee-9e45-c0dcbaa6a90f tempest-FlavorsExtraSpecsNegativeTestJSON-656828044 tempest-FlavorsExtraSpecsNegativeTestJSON-656828044-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 6233 microversion: 2.1 time: 0.132201 Jul 25 12:38:13.646497 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 45/106] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:38:13 2022] GET /compute/v2.1/flavors/detail => generated 6233 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:13.661927 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-877112e0-ec51-4dfc-b93a-65378ac944a4 tempest-FlavorsV255TestJSON-1258343127 tempest-FlavorsV255TestJSON-1258343127-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/82028835" status: 202 len: 0 microversion: 2.55 time: 0.111975 Jul 25 12:38:13.667727 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 62/107] 10.222.0.49 () {60 vars in 1196 bytes} [Mon Jul 25 12:38:13 2022] DELETE /compute/v2.1/flavors/82028835 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 25 12:38:13.676548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8356a497-75ca-426f-b41a-98b583d1dfa9 tempest-FlavorsV255TestJSON-1258343127 tempest-FlavorsV255TestJSON-1258343127-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:13.683199 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:38:13.737592 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8356a497-75ca-426f-b41a-98b583d1dfa9 tempest-FlavorsV255TestJSON-1258343127 tempest-FlavorsV255TestJSON-1258343127-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 6157 microversion: 2.55 time: 0.065824 Jul 25 12:38:13.738803 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 46/108] 10.222.0.49 () {60 vars in 1187 bytes} [Mon Jul 25 12:38:13 2022] GET /compute/v2.1/flavors/detail => generated 6157 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:38:14.235949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-24dfc3ad-a132-445f-9704-2ede2a59c2cc tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:14.237446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-24dfc3ad-a132-445f-9704-2ede2a59c2cc tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:14.240715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=10,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:38:14.258247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24dfc3ad-a132-445f-9704-2ede2a59c2cc tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:14.261522 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24dfc3ad-a132-445f-9704-2ede2a59c2cc tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:14.263693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24dfc3ad-a132-445f-9704-2ede2a59c2cc tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:14.273762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24dfc3ad-a132-445f-9704-2ede2a59c2cc tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:15.115839 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-132e9365-a9c1-4f77-88b7-0b8e16931667 req-73e5db45-0206-4310-8480-97f20586e47f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b37efd8-e1e0-4c52-8e97-9ddae0c05a70", "tag": "50ed9c56-94a0-4acb-bf2d-60d1b5554567"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:15.178176 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-132e9365-a9c1-4f77-88b7-0b8e16931667 req-73e5db45-0206-4310-8480-97f20586e47f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:15.178641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-132e9365-a9c1-4f77-88b7-0b8e16931667 req-73e5db45-0206-4310-8480-97f20586e47f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:15.270507 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-132e9365-a9c1-4f77-88b7-0b8e16931667 req-73e5db45-0206-4310-8480-97f20586e47f service nova] Creating event network-changed:50ed9c56-94a0-4acb-bf2d-60d1b5554567 for instance 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 on n-h2-848886-15 Jul 25 12:38:15.281513 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-132e9365-a9c1-4f77-88b7-0b8e16931667 req-73e5db45-0206-4310-8480-97f20586e47f service nova] Acquired lock "compute-rpcapi-router" {{(pid=125883) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 12:38:15.282799 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62cfa696-99a7-40f3-9b0d-cad0c7d3a801 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:15.291655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62cfa696-99a7-40f3-9b0d-cad0c7d3a801 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:15.292609 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62cfa696-99a7-40f3-9b0d-cad0c7d3a801 None None] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:15.293042 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62cfa696-99a7-40f3-9b0d-cad0c7d3a801 None None] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:15.343743 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.compute.rpcapi [None req-62cfa696-99a7-40f3-9b0d-cad0c7d3a801 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 12:38:15.354666 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62cfa696-99a7-40f3-9b0d-cad0c7d3a801 None None] Releasing lock "compute-rpcapi-router" {{(pid=125883) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 12:38:15.413665 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-62cfa696-99a7-40f3-9b0d-cad0c7d3a801 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.263656 Jul 25 12:38:15.415486 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 63/109] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:15.836365 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-24dfc3ad-a132-445f-9704-2ede2a59c2cc tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2cfc6122c9496992160b7c0c64dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2056d16864614f9587078e33c8ce795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:15.853559 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-24dfc3ad-a132-445f-9704-2ede2a59c2cc tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 200 len: 1337 microversion: 2.1 time: 1.617381 Jul 25 12:38:15.855313 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 47/110] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:14 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 1337 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:38:16.065084 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-20d065b6-1dfe-4040-872b-6c804f3123cb tempest-FlavorMetadataValidation-1470333032 tempest-FlavorMetadataValidation-1470333032-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-901209020", "id": 854982077, "os-flavor-access:is_public": "True"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:16.068648 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:16.068648 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:16.104033 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-20d065b6-1dfe-4040-872b-6c804f3123cb tempest-FlavorMetadataValidation-1470333032 tempest-FlavorMetadataValidation-1470333032-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.687255 Jul 25 12:38:16.113669 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 64/111] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Jul 25 12:38:15 2022] POST /compute/v2.1/flavors => generated 467 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:38:16.118835 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-43abcf95-d864-4f32-b4ce-03454bbca2b0 tempest-FlavorMetadataValidation-1470333032 tempest-FlavorMetadataValidation-1470333032-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:16.121749 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:16.121749 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:16.452097 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-43abcf95-d864-4f32-b4ce-03454bbca2b0 tempest-FlavorMetadataValidation-1470333032 tempest-FlavorMetadataValidation-1470333032-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/854982077/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.337324 Jul 25 12:38:16.459914 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 48/112] 10.222.0.49 () {62 vars in 1262 bytes} [Mon Jul 25 12:38:16 2022] POST /compute/v2.1/flavors/854982077/os-extra_specs => generated 62 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:16.467680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5cb2b927-ee26-462b-b7be-909cd944a2e3 tempest-FlavorMetadataValidation-1470333032 tempest-FlavorMetadataValidation-1470333032-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:16.468451 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:16.468451 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:16.508368 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5cb2b927-ee26-462b-b7be-909cd944a2e3 tempest-FlavorMetadataValidation-1470333032 tempest-FlavorMetadataValidation-1470333032-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/854982077" status: 202 len: 0 microversion: 2.86 time: 0.044667 Jul 25 12:38:16.509584 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 65/113] 10.222.0.49 () {60 vars in 1199 bytes} [Mon Jul 25 12:38:16 2022] DELETE /compute/v2.1/flavors/854982077 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:38:16.522383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-426907d3-a76d-41d2-bb9f-cc32c74bdd0a tempest-FlavorMetadataValidation-1470333032 tempest-FlavorMetadataValidation-1470333032-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:16.577531 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-426907d3-a76d-41d2-bb9f-cc32c74bdd0a tempest-FlavorMetadataValidation-1470333032 tempest-FlavorMetadataValidation-1470333032-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 6685 microversion: 2.86 time: 0.061876 Jul 25 12:38:16.578586 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 49/114] 10.222.0.49 () {60 vars in 1187 bytes} [Mon Jul 25 12:38:16 2022] GET /compute/v2.1/flavors/detail => generated 6685 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:38:16.891637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b5918bad-ce41-4470-b410-eea9acf3fea5 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:16.893610 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b5918bad-ce41-4470-b410-eea9acf3fea5 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:16.917345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b5918bad-ce41-4470-b410-eea9acf3fea5 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:16.918181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b5918bad-ce41-4470-b410-eea9acf3fea5 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:16.919217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b5918bad-ce41-4470-b410-eea9acf3fea5 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:16.922637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b5918bad-ce41-4470-b410-eea9acf3fea5 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:17.488050 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b5918bad-ce41-4470-b410-eea9acf3fea5 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2cfc6122c9496992160b7c0c64dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2056d16864614f9587078e33c8ce795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:17.505625 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b5918bad-ce41-4470-b410-eea9acf3fea5 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 200 len: 1337 microversion: 2.1 time: 0.629127 Jul 25 12:38:17.522178 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 66/115] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:16 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 1337 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:17.928791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-682d4388-7717-4e07-ac3f-b8de22955fea tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-799376189", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "1130049463", "adminPass": "***", "networks": [{"uuid": "a739ecf8-3705-46b6-bd48-c554faa6484d"}], "security_groups": [{"name": "tempest-securitygroup--1628136432"}], "key_name": "tempest-keypair-1722192819", "user_data": "}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:18.529824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-03fabe0a-9469-4c19-9b61-f518e8d8b92c tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:18.530616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-03fabe0a-9469-4c19-9b61-f518e8d8b92c tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:18.547607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-03fabe0a-9469-4c19-9b61-f518e8d8b92c tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:18.548440 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-03fabe0a-9469-4c19-9b61-f518e8d8b92c tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:18.549504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-03fabe0a-9469-4c19-9b61-f518e8d8b92c tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:18.550208 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-03fabe0a-9469-4c19-9b61-f518e8d8b92c tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:18.742643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-682d4388-7717-4e07-ac3f-b8de22955fea tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] validate_networks() for [('a739ecf8-3705-46b6-bd48-c554faa6484d', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:38:19.686384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-03fabe0a-9469-4c19-9b61-f518e8d8b92c tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2cfc6122c9496992160b7c0c64dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2056d16864614f9587078e33c8ce795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:19.709265 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-03fabe0a-9469-4c19-9b61-f518e8d8b92c tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 200 len: 1337 microversion: 2.1 time: 1.184438 Jul 25 12:38:19.710958 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 67/116] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:18 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 1337 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:20.734419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-60104457-00c9-4d78-a4f0-cd088d536941 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:20.736127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-60104457-00c9-4d78-a4f0-cd088d536941 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:20.740350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:38:20.752849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-60104457-00c9-4d78-a4f0-cd088d536941 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:20.754812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-60104457-00c9-4d78-a4f0-cd088d536941 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:20.757885 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-60104457-00c9-4d78-a4f0-cd088d536941 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:20.758715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-60104457-00c9-4d78-a4f0-cd088d536941 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:21.134353 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-682d4388-7717-4e07-ac3f-b8de22955fea tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:38:21.135725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-682d4388-7717-4e07-ac3f-b8de22955fea tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:38:21.136401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-682d4388-7717-4e07-ac3f-b8de22955fea tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:38:21.137060 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-682d4388-7717-4e07-ac3f-b8de22955fea tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:38:21.137738 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-682d4388-7717-4e07-ac3f-b8de22955fea tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:38:21.168777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-682d4388-7717-4e07-ac3f-b8de22955fea tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:21.169229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-682d4388-7717-4e07-ac3f-b8de22955fea tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:21.170058 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-682d4388-7717-4e07-ac3f-b8de22955fea tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:21.170772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-682d4388-7717-4e07-ac3f-b8de22955fea tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:21.191673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-682d4388-7717-4e07-ac3f-b8de22955fea tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Getting quotas for project 4ded56ca1da44b65a227d978f927d9db. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:38:21.196419 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-682d4388-7717-4e07-ac3f-b8de22955fea tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Getting quotas for user ef5e681ba263436099656b879c77162b and project 4ded56ca1da44b65a227d978f927d9db. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:38:21.234204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-682d4388-7717-4e07-ac3f-b8de22955fea tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:38:21.238993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-682d4388-7717-4e07-ac3f-b8de22955fea tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:38:21.325520 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-682d4388-7717-4e07-ac3f-b8de22955fea tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.402516 Jul 25 12:38:21.333725 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 50/117] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:38:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 3411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:38:21.340132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2db3385e-8d8f-4a32-8340-2f8b070f1d76 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:21.341136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2db3385e-8d8f-4a32-8340-2f8b070f1d76 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:21.445688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-60104457-00c9-4d78-a4f0-cd088d536941 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2cfc6122c9496992160b7c0c64dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2056d16864614f9587078e33c8ce795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:21.456016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2db3385e-8d8f-4a32-8340-2f8b070f1d76 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:21.457274 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-60104457-00c9-4d78-a4f0-cd088d536941 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 200 len: 1337 microversion: 2.1 time: 0.728279 Jul 25 12:38:21.461249 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 68/118] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:20 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 1337 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:21.509011 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2db3385e-8d8f-4a32-8340-2f8b070f1d76 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 200 len: 1264 microversion: 2.1 time: 0.155849 Jul 25 12:38:21.525979 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 51/119] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:21 2022] GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:22.484834 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-be07cf3b-4a86-498f-90e3-dcd5772a7c3d tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:22.485612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-be07cf3b-4a86-498f-90e3-dcd5772a7c3d tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:22.500294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-be07cf3b-4a86-498f-90e3-dcd5772a7c3d tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:22.500752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-be07cf3b-4a86-498f-90e3-dcd5772a7c3d tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:22.501545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-be07cf3b-4a86-498f-90e3-dcd5772a7c3d tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:22.514393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-be07cf3b-4a86-498f-90e3-dcd5772a7c3d tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:22.532507 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ac162268-800b-43ea-82c6-cb075bf2c624 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:22.534096 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ac162268-800b-43ea-82c6-cb075bf2c624 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:22.821765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ac162268-800b-43ea-82c6-cb075bf2c624 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:22.833603 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ac162268-800b-43ea-82c6-cb075bf2c624 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 200 len: 1264 microversion: 2.1 time: 0.305765 Jul 25 12:38:22.837043 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 52/120] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:22 2022] GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 1264 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:38:23.414605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-be07cf3b-4a86-498f-90e3-dcd5772a7c3d tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2cfc6122c9496992160b7c0c64dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2056d16864614f9587078e33c8ce795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:23.425711 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-be07cf3b-4a86-498f-90e3-dcd5772a7c3d tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 200 len: 1337 microversion: 2.1 time: 0.945893 Jul 25 12:38:23.438694 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 69/121] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:22 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 1337 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:23.857174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1ccd6f12-e9ca-431c-95cf-ce3b13c1074f tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:23.861213 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1ccd6f12-e9ca-431c-95cf-ce3b13c1074f tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:23.870647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ccd6f12-e9ca-431c-95cf-ce3b13c1074f tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:23.871099 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ccd6f12-e9ca-431c-95cf-ce3b13c1074f tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:23.871878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ccd6f12-e9ca-431c-95cf-ce3b13c1074f tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:23.880912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ccd6f12-e9ca-431c-95cf-ce3b13c1074f tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:24.033670 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1ccd6f12-e9ca-431c-95cf-ce3b13c1074f tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:24.044747 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1ccd6f12-e9ca-431c-95cf-ce3b13c1074f tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 200 len: 1316 microversion: 2.1 time: 0.188103 Jul 25 12:38:24.059133 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 53/122] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:23 2022] GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 1316 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:24.450648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-581c5dc7-25c3-4743-be80-8746f938cc28 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:24.451509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-581c5dc7-25c3-4743-be80-8746f938cc28 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:24.462900 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-581c5dc7-25c3-4743-be80-8746f938cc28 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:24.463723 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-581c5dc7-25c3-4743-be80-8746f938cc28 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:24.474233 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-581c5dc7-25c3-4743-be80-8746f938cc28 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:24.475110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-581c5dc7-25c3-4743-be80-8746f938cc28 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:24.523589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=79 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:38:25.331007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:38:25.339847 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-581c5dc7-25c3-4743-be80-8746f938cc28 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2cfc6122c9496992160b7c0c64dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2056d16864614f9587078e33c8ce795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:25.353920 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-581c5dc7-25c3-4743-be80-8746f938cc28 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 200 len: 1337 microversion: 2.1 time: 0.903768 Jul 25 12:38:25.371116 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 70/123] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:24 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 1337 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:25.384331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-68fcd0df-87e4-413e-a26d-3a9cf6e45473 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:25.385286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-68fcd0df-87e4-413e-a26d-3a9cf6e45473 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:25.398900 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68fcd0df-87e4-413e-a26d-3a9cf6e45473 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:25.403965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68fcd0df-87e4-413e-a26d-3a9cf6e45473 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:25.403965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68fcd0df-87e4-413e-a26d-3a9cf6e45473 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:25.409241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68fcd0df-87e4-413e-a26d-3a9cf6e45473 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:25.565161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a84d4de1-fd8c-43ec-bbdd-080d4e0c097b tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Calling method '.version_select at 0x7efcfb18ca60>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:25.568907 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:25.568907 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:25.570533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a84d4de1-fd8c-43ec-bbdd-080d4e0c097b tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:25.573792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a84d4de1-fd8c-43ec-bbdd-080d4e0c097b tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:25.576857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a84d4de1-fd8c-43ec-bbdd-080d4e0c097b tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:25.578646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a84d4de1-fd8c-43ec-bbdd-080d4e0c097b tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:25.631250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-68fcd0df-87e4-413e-a26d-3a9cf6e45473 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:25.648314 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-68fcd0df-87e4-413e-a26d-3a9cf6e45473 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 200 len: 1322 microversion: 2.1 time: 0.275793 Jul 25 12:38:25.657931 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 71/124] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:25 2022] GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:25.680640 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a84d4de1-fd8c-43ec-bbdd-080d4e0c097b tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 0.740018 Jul 25 12:38:25.681504 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 54/125] 10.222.0.49 () {58 vars in 1128 bytes} [Mon Jul 25 12:38:24 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:38:26.431121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cf98a6f2-c5d9-45a6-8b59-74331f96e472 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Calling method '.version_select at 0x7efcfa830e50>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:26.437602 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:26.437602 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:26.438868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cf98a6f2-c5d9-45a6-8b59-74331f96e472 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'e747e5d5de86452dae33b5d8a9facd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7a48a3a9dc4c0399a8b39f8604ff20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:26.440857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cf98a6f2-c5d9-45a6-8b59-74331f96e472 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Request method failure captured: Jul 25 12:38:26.440857 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 25 12:38:26.440857 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:26.440857 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:26.440857 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:26.440857 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:26.440857 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:26.440857 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:26.440857 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:26.440857 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:26.440857 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6-QziErsNJpGSIALbhUTryze1ysETSZ8i4aQBQQp-z1LYAf5RA0rKD_n9QGdoWp-DvDv-4FYWB6yZFkh9FcOprPBQ1mZiCb2HW1Thv4j_ikYpdNn3w1tVDYM9GIksz7RctTlZkoD02EPa_xmn-w8wyu1xoU1WhbHtCRtF7v01Bx1k Jul 25 12:38:26.440857 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:26.440857 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:26.440857 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:26.440857 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:26.440857 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:26.440857 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:26.440857 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 3a7a48a3a9dc4c0399a8b39f8604ff20 Jul 25 12:38:26.440857 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-516019400 Jul 25 12:38:26.440857 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:38:26.440857 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:38:26.442129 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3a7a48a3a9dc4c0399a8b39f8604ff20", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3a7a48a3a9dc4c0399a8b39f8604ff20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3a7a48a3a9dc4c0399a8b39f8604ff20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3a7a48a3a9dc4c0399a8b39f8604ff20"}]}] Jul 25 12:38:26.442129 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-HostsAdminNegativeTestJSON-516019400 Jul 25 12:38:26.442129 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 3a7a48a3a9dc4c0399a8b39f8604ff20 Jul 25 12:38:26.442129 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-516019400 Jul 25 12:38:26.442129 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-HostsAdminNegativeTestJSON-516019400-project Jul 25 12:38:26.442129 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:26.442129 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:26.442129 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: e747e5d5de86452dae33b5d8a9facd3f Jul 25 12:38:26.442129 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-HostsAdminNegativeTestJSON-516019400-project Jul 25 12:38:26.442129 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:38:26.442129 n-d-848886-15 devstack@n-api.service[125883]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 25 12:38:26.442129 n-d-848886-15 devstack@n-api.service[125883]: action_args: {} Jul 25 12:38:26.442129 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:26.442993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:26.442993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:26.442993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:26.442993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:26.442993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:26.442993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:26.442993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:26.442993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 12:38:26.442993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:38:26.442993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:26.442993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:26.442993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 25 12:38:26.442993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 25 12:38:26.442993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:26.442993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:26.442993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:26.442993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:26.442993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:26.442993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:26.444054 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:26.444054 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:26.444054 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:26.444054 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:26.444054 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:26.444054 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:26.444054 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:26.444054 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:26.444054 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 25 12:38:26.444054 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:26.444054 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:26.444054 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:26.444054 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:26.444054 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:26.444054 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:26.444054 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:26.444054 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:26.444054 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 25 12:38:26.444054 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:26.448006 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cf98a6f2-c5d9-45a6-8b59-74331f96e472 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:26.448751 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cf98a6f2-c5d9-45a6-8b59-74331f96e472 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] 10.222.0.49 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.759528 Jul 25 12:38:26.454366 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 72/126] 10.222.0.49 () {58 vars in 1128 bytes} [Mon Jul 25 12:38:25 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 765 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:26.479023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8a9f260d-7bb5-4054-a047-4631967bb2f9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:26.485930 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8a9f260d-7bb5-4054-a047-4631967bb2f9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:26.497615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8a9f260d-7bb5-4054-a047-4631967bb2f9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:26.514476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4121d4b7-6cb9-4286-aad7-7025b5360a7e tempest-FlavorsV261TestJSON-1709597932 tempest-FlavorsV261TestJSON-1709597932-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1821321495", "id": 755072277, "os-flavor-access:is_public": "True"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:26.519486 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:26.519486 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:26.521793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8a9f260d-7bb5-4054-a047-4631967bb2f9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:26.523508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8a9f260d-7bb5-4054-a047-4631967bb2f9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:26.525950 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8a9f260d-7bb5-4054-a047-4631967bb2f9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:26.576553 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4121d4b7-6cb9-4286-aad7-7025b5360a7e tempest-FlavorsV261TestJSON-1709597932 tempest-FlavorsV261TestJSON-1709597932-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.678287 Jul 25 12:38:26.588741 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 55/127] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Jul 25 12:38:25 2022] POST /compute/v2.1/flavors => generated 465 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:38:26.599287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c0eb1553-fc9f-4fdb-9c70-a1e9e3410793 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Calling method '.version_select at 0x7efcfb0915e0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:26.607617 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:26.607617 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:26.610642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c0eb1553-fc9f-4fdb-9c70-a1e9e3410793 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'e747e5d5de86452dae33b5d8a9facd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7a48a3a9dc4c0399a8b39f8604ff20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:26.621961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c0eb1553-fc9f-4fdb-9c70-a1e9e3410793 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Request method failure captured: Jul 25 12:38:26.621961 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/os-hosts/n-d-848886-15/reboot HTTP/1.1 Jul 25 12:38:26.621961 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:38:26.621961 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:38:26.621961 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:38:26.621961 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:38:26.621961 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:38:26.621961 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:38:26.621961 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:38:26.621961 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:26.621961 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o6-QziErsNJpGSIALbhUTryze1ysETSZ8i4aQBQQp-z1LYAf5RA0rKD_n9QGdoWp-DvDv-4FYWB6yZFkh9FcOprPBQ1mZiCb2HW1Thv4j_ikYpdNn3w1tVDYM9GIksz7RctTlZkoD02EPa_xmn-w8wyu1xoU1WhbHtCRtF7v01Bx1k Jul 25 12:38:26.621961 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:38:26.621961 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:38:26.621961 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:38:26.621961 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:38:26.621961 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:38:26.621961 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:38:26.621961 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 3a7a48a3a9dc4c0399a8b39f8604ff20 Jul 25 12:38:26.621961 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-516019400 Jul 25 12:38:26.621961 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:38:26.621961 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:38:26.623272 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3a7a48a3a9dc4c0399a8b39f8604ff20", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3a7a48a3a9dc4c0399a8b39f8604ff20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3a7a48a3a9dc4c0399a8b39f8604ff20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3a7a48a3a9dc4c0399a8b39f8604ff20"}]}] Jul 25 12:38:26.623272 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-HostsAdminNegativeTestJSON-516019400 Jul 25 12:38:26.623272 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 3a7a48a3a9dc4c0399a8b39f8604ff20 Jul 25 12:38:26.623272 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-516019400 Jul 25 12:38:26.623272 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-HostsAdminNegativeTestJSON-516019400-project Jul 25 12:38:26.623272 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:38:26.623272 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:38:26.623272 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: e747e5d5de86452dae33b5d8a9facd3f Jul 25 12:38:26.623272 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-HostsAdminNegativeTestJSON-516019400-project Jul 25 12:38:26.623272 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:38:26.623272 n-d-848886-15 devstack@n-api.service[125884]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 25 12:38:26.623272 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'n-d-848886-15'} Jul 25 12:38:26.623272 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:26.623948 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:26.623948 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:26.623948 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:26.623948 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:26.623948 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:26.623948 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:26.623948 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:26.623948 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:26.623948 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:26.623948 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 25 12:38:26.623948 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 25 12:38:26.623948 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:26.623948 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:26.623948 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:26.623948 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:26.623948 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:26.623948 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:26.623948 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:26.623948 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:26.624894 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:26.624894 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:26.624894 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:26.624894 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:26.624894 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:26.624894 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:26.624894 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 25 12:38:26.624894 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:26.624894 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:26.624894 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:26.624894 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:26.624894 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:26.624894 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:26.624894 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:26.624894 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:26.624894 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 25 12:38:26.624894 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:26.628274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c0eb1553-fc9f-4fdb-9c70-a1e9e3410793 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:26.630861 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c0eb1553-fc9f-4fdb-9c70-a1e9e3410793 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] 10.222.0.49 "GET /compute/v2.1/os-hosts/n-d-848886-15/reboot" status: 403 len: 111 microversion: 2.1 time: 0.038674 Jul 25 12:38:26.634452 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 56/128] 10.222.0.49 () {58 vars in 1191 bytes} [Mon Jul 25 12:38:26 2022] GET /compute/v2.1/os-hosts/n-d-848886-15/reboot => generated 111 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:26.931290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6ae9e94f-9b11-4022-9288-d6afea319682 tempest-FlavorsV261TestJSON-1696104663 tempest-FlavorsV261TestJSON-1696104663-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:26.953754 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8a9f260d-7bb5-4054-a047-4631967bb2f9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2cfc6122c9496992160b7c0c64dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2056d16864614f9587078e33c8ce795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:26.965018 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8a9f260d-7bb5-4054-a047-4631967bb2f9 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 200 len: 1337 microversion: 2.1 time: 0.507365 Jul 25 12:38:26.970973 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 73/129] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:26 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 1337 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:26.972414 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6ae9e94f-9b11-4022-9288-d6afea319682 tempest-FlavorsV261TestJSON-1696104663 tempest-FlavorsV261TestJSON-1696104663-project] 10.222.0.49 "GET /compute/v2.1/flavors/755072277" status: 200 len: 465 microversion: 2.61 time: 0.336542 Jul 25 12:38:26.975453 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 57/130] 10.222.0.49 () {60 vars in 1196 bytes} [Mon Jul 25 12:38:26 2022] GET /compute/v2.1/flavors/755072277 => generated 465 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:38:26.986311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d79ba973-d737-4e32-a6d8-b2b67ffac0e4 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Calling method '.version_select at 0x7efcfa84be50>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:26.987530 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:26.987530 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:26.988750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-45fb6165-9c0f-4f1b-9013-eedde774f5ac tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:26.994701 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-45fb6165-9c0f-4f1b-9013-eedde774f5ac tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:27.008710 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45fb6165-9c0f-4f1b-9013-eedde774f5ac tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:27.011570 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45fb6165-9c0f-4f1b-9013-eedde774f5ac tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:27.021323 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45fb6165-9c0f-4f1b-9013-eedde774f5ac tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:27.024110 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-d79ba973-d737-4e32-a6d8-b2b67ffac0e4 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.025318 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45fb6165-9c0f-4f1b-9013-eedde774f5ac tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:27.040108 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d79ba973-d737-4e32-a6d8-b2b67ffac0e4 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Request method failure captured: Jul 25 12:38:27.040108 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 25 12:38:27.040108 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:27.040108 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:27.040108 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:27.040108 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:27.040108 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:27.040108 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:27.040108 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:27.040108 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:27.040108 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7Afa2RUUuCjknOrJG8v3Cpb7S_tN1-7jDKp1jybWGo4etc2UBLkwHrPAeRV6Jc2IUUkDThyGq3xxZ5tGyILTKMEReQLVvWPUiNJAiG9hjoZx2dLKNwmAQzDYY6AZ4sNyk5CFj4zW6bpr4oSGNqMKnag5Kcp8bToMAuYyyiGxYNlxo Jul 25 12:38:27.040108 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:27.040108 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:27.040108 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:27.040108 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:27.040108 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:27.040108 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:27.040108 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: c18ad1efc46a446b90bc8eaf9a273243 Jul 25 12:38:27.040108 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.040108 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:38:27.040108 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:38:27.041892 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c18ad1efc46a446b90bc8eaf9a273243", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c18ad1efc46a446b90bc8eaf9a273243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c18ad1efc46a446b90bc8eaf9a273243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c18ad1efc46a446b90bc8eaf9a273243"}]}] Jul 25 12:38:27.041892 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.041892 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: c18ad1efc46a446b90bc8eaf9a273243 Jul 25 12:38:27.041892 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.041892 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-HostsAdminNegativeTestJSON-182094255-project-admin Jul 25 12:38:27.041892 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:27.041892 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:27.041892 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 02baa6eb34d247afab10be80537c4aaa Jul 25 12:38:27.041892 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-HostsAdminNegativeTestJSON-182094255-project-admin Jul 25 12:38:27.041892 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:38:27.041892 n-d-848886-15 devstack@n-api.service[125883]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.041892 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'nonexistent_hostname'} Jul 25 12:38:27.041892 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:27.042769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.042769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 25 12:38:27.042769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 25 12:38:27.042769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 12:38:27.042769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 12:38:27.042769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:27.042769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:27.042769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:27.042769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:27.042769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 12:38:27.042769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 12:38:27.042769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 25 12:38:27.042769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 25 12:38:27.042769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:38:27.042769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:38:27.042769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 12:38:27.042769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 12:38:27.042769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:38:27.042769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:38:27.044045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 12:38:27.044045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 12:38:27.044045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.044045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.044045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:27.044045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.044045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.044045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.044045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.044045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:27.044045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:27.044045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:27.044045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:27.044045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:27.044045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:27.044045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 25 12:38:27.044045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 25 12:38:27.044045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 25 12:38:27.044045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:38:27.045232 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.045232 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.045232 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:27.045232 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.045232 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.045232 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.045232 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.045232 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:27.045232 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:27.045232 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.045232 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.049025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d79ba973-d737-4e32-a6d8-b2b67ffac0e4 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:27.049971 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d79ba973-d737-4e32-a6d8-b2b67ffac0e4 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.075814 Jul 25 12:38:27.050526 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 74/131] 10.222.0.49 () {58 vars in 1212 bytes} [Mon Jul 25 12:38:26 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:38:27.076989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=49 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:38:27.154501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-45fb6165-9c0f-4f1b-9013-eedde774f5ac tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:27.174514 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-45fb6165-9c0f-4f1b-9013-eedde774f5ac tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 200 len: 1322 microversion: 2.1 time: 0.197095 Jul 25 12:38:27.175332 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 58/132] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:26 2022] GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:27.189856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9a91118e-0604-453b-815a-5bd56be257e8 tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Calling method '.version_select at 0x7efcfa762d30>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:27.196692 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:27.196692 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:27.198399 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a91118e-0604-453b-815a-5bd56be257e8 tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:27.198846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a91118e-0604-453b-815a-5bd56be257e8 tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:27.202705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-43a82437-9fd2-49e4-9b66-5cbc47877a3f tempest-FlavorsV261TestJSON-1709597932 tempest-FlavorsV261TestJSON-1709597932-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:27.232380 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:27.232380 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:27.234911 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a91118e-0604-453b-815a-5bd56be257e8 tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:27.235352 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a91118e-0604-453b-815a-5bd56be257e8 tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:27.260198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a91118e-0604-453b-815a-5bd56be257e8 tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:27.261279 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a91118e-0604-453b-815a-5bd56be257e8 tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:27.286245 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9a91118e-0604-453b-815a-5bd56be257e8 tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.233741 Jul 25 12:38:27.287414 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-43a82437-9fd2-49e4-9b66-5cbc47877a3f tempest-FlavorsV261TestJSON-1709597932 tempest-FlavorsV261TestJSON-1709597932-project-admin] 10.222.0.49 "PUT /compute/v2.1/flavors/755072277" status: 200 len: 466 microversion: 2.61 time: 0.108571 Jul 25 12:38:27.287951 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 75/133] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:38:27 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:27.289743 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 59/134] 10.222.0.49 () {62 vars in 1216 bytes} [Mon Jul 25 12:38:27 2022] PUT /compute/v2.1/flavors/755072277 => generated 466 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:38:27.302987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d4803081-50a9-4af8-bf69-030d913a8dc0 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Calling method '.version_select at 0x7efcfa830dc0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:27.304301 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:27.304301 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:27.305688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d4803081-50a9-4af8-bf69-030d913a8dc0 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'e747e5d5de86452dae33b5d8a9facd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7a48a3a9dc4c0399a8b39f8604ff20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:27.307472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d4803081-50a9-4af8-bf69-030d913a8dc0 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Request method failure captured: Jul 25 12:38:27.307472 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-hosts/n-d-848886-15 HTTP/1.1 Jul 25 12:38:27.307472 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:27.307472 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:27.307472 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:27.307472 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:27.307472 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:27.307472 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:27.307472 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:27.307472 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:27.307472 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6-QziErsNJpGSIALbhUTryze1ysETSZ8i4aQBQQp-z1LYAf5RA0rKD_n9QGdoWp-DvDv-4FYWB6yZFkh9FcOprPBQ1mZiCb2HW1Thv4j_ikYpdNn3w1tVDYM9GIksz7RctTlZkoD02EPa_xmn-w8wyu1xoU1WhbHtCRtF7v01Bx1k Jul 25 12:38:27.307472 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:27.307472 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:27.307472 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:27.307472 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:27.307472 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:27.307472 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:27.307472 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 3a7a48a3a9dc4c0399a8b39f8604ff20 Jul 25 12:38:27.307472 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-516019400 Jul 25 12:38:27.307472 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:38:27.307472 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:38:27.308933 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3a7a48a3a9dc4c0399a8b39f8604ff20", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3a7a48a3a9dc4c0399a8b39f8604ff20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3a7a48a3a9dc4c0399a8b39f8604ff20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3a7a48a3a9dc4c0399a8b39f8604ff20"}]}] Jul 25 12:38:27.308933 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-HostsAdminNegativeTestJSON-516019400 Jul 25 12:38:27.308933 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 3a7a48a3a9dc4c0399a8b39f8604ff20 Jul 25 12:38:27.308933 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-516019400 Jul 25 12:38:27.308933 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-HostsAdminNegativeTestJSON-516019400-project Jul 25 12:38:27.308933 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:27.308933 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:27.308933 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: e747e5d5de86452dae33b5d8a9facd3f Jul 25 12:38:27.308933 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-HostsAdminNegativeTestJSON-516019400-project Jul 25 12:38:27.308933 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:38:27.308933 n-d-848886-15 devstack@n-api.service[125883]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 25 12:38:27.308933 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'n-d-848886-15'} Jul 25 12:38:27.308933 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:27.309869 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.309869 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.309869 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.309869 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:27.309869 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:27.309869 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:27.309869 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:27.309869 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:27.309869 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:27.309869 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 25 12:38:27.309869 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 25 12:38:27.309869 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:27.309869 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:27.309869 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:27.309869 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:27.309869 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:27.309869 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:27.309869 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:27.309869 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:27.311471 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:27.311471 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:27.311471 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:27.311471 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:27.311471 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:27.311471 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:27.311471 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 25 12:38:27.311471 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.311471 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:27.311471 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.311471 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.311471 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.311471 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.311471 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:27.311471 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:27.311471 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 25 12:38:27.311471 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.313530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d4803081-50a9-4af8-bf69-030d913a8dc0 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:27.315749 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d4803081-50a9-4af8-bf69-030d913a8dc0 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] 10.222.0.49 "GET /compute/v2.1/os-hosts/n-d-848886-15" status: 403 len: 109 microversion: 2.1 time: 0.026596 Jul 25 12:38:27.323039 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 76/135] 10.222.0.49 () {58 vars in 1170 bytes} [Mon Jul 25 12:38:27 2022] GET /compute/v2.1/os-hosts/n-d-848886-15 => generated 109 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:27.328702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0f556a04-491a-44f6-88d1-0f96bfaaa025 tempest-FlavorsV261TestJSON-1696104663 tempest-FlavorsV261TestJSON-1696104663-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:27.376425 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0f556a04-491a-44f6-88d1-0f96bfaaa025 tempest-FlavorsV261TestJSON-1696104663 tempest-FlavorsV261TestJSON-1696104663-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 7157 microversion: 2.61 time: 0.051961 Jul 25 12:38:27.377384 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 77/136] 10.222.0.49 () {60 vars in 1187 bytes} [Mon Jul 25 12:38:27 2022] GET /compute/v2.1/flavors/detail => generated 7157 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:38:27.382852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-45f2f988-c3f5-48e6-a212-bed957c95f28 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Calling method '.version_select at 0x7efcfa84b4c0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:27.397862 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-45f2f988-c3f5-48e6-a212-bed957c95f28 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.401024 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-45f2f988-c3f5-48e6-a212-bed957c95f28 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Request method failure captured: Jul 25 12:38:27.401024 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 25 12:38:27.401024 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:27.401024 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:27.401024 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:27.401024 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:27.401024 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:27.401024 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:27.401024 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:27.401024 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:27.401024 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7Afa2RUUuCjknOrJG8v3Cpb7S_tN1-7jDKp1jybWGo4etc2UBLkwHrPAeRV6Jc2IUUkDThyGq3xxZ5tGyILTKMEReQLVvWPUiNJAiG9hjoZx2dLKNwmAQzDYY6AZ4sNyk5CFj4zW6bpr4oSGNqMKnag5Kcp8bToMAuYyyiGxYNlxo Jul 25 12:38:27.401024 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:27.401024 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:27.401024 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:27.401024 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:27.401024 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:27.401024 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:27.401024 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: c18ad1efc46a446b90bc8eaf9a273243 Jul 25 12:38:27.401024 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.401024 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:38:27.401024 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:38:27.402330 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c18ad1efc46a446b90bc8eaf9a273243", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c18ad1efc46a446b90bc8eaf9a273243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c18ad1efc46a446b90bc8eaf9a273243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c18ad1efc46a446b90bc8eaf9a273243"}]}] Jul 25 12:38:27.402330 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.402330 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: c18ad1efc46a446b90bc8eaf9a273243 Jul 25 12:38:27.402330 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.402330 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-HostsAdminNegativeTestJSON-182094255-project-admin Jul 25 12:38:27.402330 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:27.402330 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:27.402330 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 02baa6eb34d247afab10be80537c4aaa Jul 25 12:38:27.402330 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-HostsAdminNegativeTestJSON-182094255-project-admin Jul 25 12:38:27.402330 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:38:27.402330 n-d-848886-15 devstack@n-api.service[125883]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.402330 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'nonexistent_hostname'} Jul 25 12:38:27.402330 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:27.403014 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.403014 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 25 12:38:27.403014 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 25 12:38:27.403014 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:38:27.403014 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:38:27.403014 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 12:38:27.403014 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 12:38:27.403014 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:38:27.403014 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:38:27.403014 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 12:38:27.403014 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 12:38:27.403014 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.403014 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.403014 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:27.403014 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.403014 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.403014 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.403014 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.403014 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:27.404349 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:27.404349 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:27.404349 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:27.404349 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:27.404349 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:27.404349 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 25 12:38:27.404349 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:38:27.404349 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.404349 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.404349 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:27.404349 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.404349 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.404349 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.404349 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.404349 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:27.404349 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:27.404349 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.404349 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.406412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-45f2f988-c3f5-48e6-a212-bed957c95f28 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:27.407408 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-45f2f988-c3f5-48e6-a212-bed957c95f28 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.028933 Jul 25 12:38:27.412542 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 78/137] 10.222.0.49 () {58 vars in 1191 bytes} [Mon Jul 25 12:38:27 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:38:27.420100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-117f5c90-1eb4-4aaa-a034-e1032abfe13e tempest-FlavorsV261TestJSON-1696104663 tempest-FlavorsV261TestJSON-1696104663-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:27.445050 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-117f5c90-1eb4-4aaa-a034-e1032abfe13e tempest-FlavorsV261TestJSON-1696104663 tempest-FlavorsV261TestJSON-1696104663-project] 10.222.0.49 "GET /compute/v2.1/flavors" status: 200 len: 3684 microversion: 2.61 time: 0.031075 Jul 25 12:38:27.448766 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 79/138] 10.222.0.49 () {60 vars in 1166 bytes} [Mon Jul 25 12:38:27 2022] GET /compute/v2.1/flavors => generated 3684 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:38:27.453792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e8721652-90cd-4511-b488-274c2a721792 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Calling method '.version_select at 0x7efcfa762940>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:27.454814 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:27.454814 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:27.456466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e8721652-90cd-4511-b488-274c2a721792 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'e747e5d5de86452dae33b5d8a9facd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7a48a3a9dc4c0399a8b39f8604ff20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:27.458464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e8721652-90cd-4511-b488-274c2a721792 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Request method failure captured: Jul 25 12:38:27.458464 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-hosts/n-d-848886-15/shutdown HTTP/1.1 Jul 25 12:38:27.458464 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:27.458464 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:27.458464 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:27.458464 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:27.458464 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:27.458464 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:27.458464 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:27.458464 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:27.458464 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6-QziErsNJpGSIALbhUTryze1ysETSZ8i4aQBQQp-z1LYAf5RA0rKD_n9QGdoWp-DvDv-4FYWB6yZFkh9FcOprPBQ1mZiCb2HW1Thv4j_ikYpdNn3w1tVDYM9GIksz7RctTlZkoD02EPa_xmn-w8wyu1xoU1WhbHtCRtF7v01Bx1k Jul 25 12:38:27.458464 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:27.458464 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:27.458464 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:27.458464 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:27.458464 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:27.458464 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:27.458464 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 3a7a48a3a9dc4c0399a8b39f8604ff20 Jul 25 12:38:27.458464 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-516019400 Jul 25 12:38:27.458464 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:38:27.458464 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:38:27.459745 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3a7a48a3a9dc4c0399a8b39f8604ff20", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3a7a48a3a9dc4c0399a8b39f8604ff20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3a7a48a3a9dc4c0399a8b39f8604ff20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3a7a48a3a9dc4c0399a8b39f8604ff20"}]}] Jul 25 12:38:27.459745 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-HostsAdminNegativeTestJSON-516019400 Jul 25 12:38:27.459745 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 3a7a48a3a9dc4c0399a8b39f8604ff20 Jul 25 12:38:27.459745 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-516019400 Jul 25 12:38:27.459745 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-HostsAdminNegativeTestJSON-516019400-project Jul 25 12:38:27.459745 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:27.459745 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:27.459745 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: e747e5d5de86452dae33b5d8a9facd3f Jul 25 12:38:27.459745 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-HostsAdminNegativeTestJSON-516019400-project Jul 25 12:38:27.459745 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:38:27.459745 n-d-848886-15 devstack@n-api.service[125883]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 25 12:38:27.459745 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'n-d-848886-15'} Jul 25 12:38:27.459745 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:27.460683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.460683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.460683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.460683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:27.460683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:27.460683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:27.460683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:27.460683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:27.460683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:27.460683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 25 12:38:27.460683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 25 12:38:27.460683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:27.460683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:27.460683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:27.460683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:27.460683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:27.460683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:27.460683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:27.460683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:27.461942 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:27.461942 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:27.461942 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:27.461942 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:27.461942 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:27.461942 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:27.461942 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 25 12:38:27.461942 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.461942 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:27.461942 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.461942 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.461942 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.461942 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.461942 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:27.461942 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:27.461942 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 25 12:38:27.461942 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.464098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e8721652-90cd-4511-b488-274c2a721792 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:27.465106 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e8721652-90cd-4511-b488-274c2a721792 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] 10.222.0.49 "GET /compute/v2.1/os-hosts/n-d-848886-15/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.015151 Jul 25 12:38:27.471218 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 80/139] 10.222.0.49 () {58 vars in 1197 bytes} [Mon Jul 25 12:38:27 2022] GET /compute/v2.1/os-hosts/n-d-848886-15/shutdown => generated 113 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:27.476488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d016171c-c6bc-4d2c-b049-bad15d910c17 tempest-FlavorsV261TestJSON-1709597932 tempest-FlavorsV261TestJSON-1709597932-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:27.477357 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:27.477357 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:27.502193 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d016171c-c6bc-4d2c-b049-bad15d910c17 tempest-FlavorsV261TestJSON-1709597932 tempest-FlavorsV261TestJSON-1709597932-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/755072277" status: 202 len: 0 microversion: 2.61 time: 0.028573 Jul 25 12:38:27.503399 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 81/140] 10.222.0.49 () {60 vars in 1199 bytes} [Mon Jul 25 12:38:27 2022] DELETE /compute/v2.1/flavors/755072277 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:38:27.508888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-93de97da-e158-4872-9375-88a581ece86d tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Calling method '.version_select at 0x7efcfaaeb0d0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:27.531606 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-93de97da-e158-4872-9375-88a581ece86d tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.533288 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-93de97da-e158-4872-9375-88a581ece86d tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Request method failure captured: Jul 25 12:38:27.533288 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 25 12:38:27.533288 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:27.533288 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:27.533288 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:27.533288 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:27.533288 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:27.533288 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:27.533288 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:27.533288 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:27.533288 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7Afa2RUUuCjknOrJG8v3Cpb7S_tN1-7jDKp1jybWGo4etc2UBLkwHrPAeRV6Jc2IUUkDThyGq3xxZ5tGyILTKMEReQLVvWPUiNJAiG9hjoZx2dLKNwmAQzDYY6AZ4sNyk5CFj4zW6bpr4oSGNqMKnag5Kcp8bToMAuYyyiGxYNlxo Jul 25 12:38:27.533288 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:27.533288 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:27.533288 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:27.533288 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:27.533288 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:27.533288 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:27.533288 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: c18ad1efc46a446b90bc8eaf9a273243 Jul 25 12:38:27.533288 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.533288 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:38:27.533288 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:38:27.534826 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c18ad1efc46a446b90bc8eaf9a273243", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c18ad1efc46a446b90bc8eaf9a273243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c18ad1efc46a446b90bc8eaf9a273243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c18ad1efc46a446b90bc8eaf9a273243"}]}] Jul 25 12:38:27.534826 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.534826 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: c18ad1efc46a446b90bc8eaf9a273243 Jul 25 12:38:27.534826 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.534826 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-HostsAdminNegativeTestJSON-182094255-project-admin Jul 25 12:38:27.534826 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:27.534826 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:27.534826 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 02baa6eb34d247afab10be80537c4aaa Jul 25 12:38:27.534826 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-HostsAdminNegativeTestJSON-182094255-project-admin Jul 25 12:38:27.534826 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:38:27.534826 n-d-848886-15 devstack@n-api.service[125883]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.534826 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'nonexistent_hostname'} Jul 25 12:38:27.534826 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:27.535675 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.535675 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 25 12:38:27.535675 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 25 12:38:27.535675 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 12:38:27.535675 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 12:38:27.535675 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:27.535675 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:27.535675 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:27.535675 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:27.535675 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 12:38:27.535675 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 12:38:27.535675 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 25 12:38:27.535675 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 25 12:38:27.535675 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:38:27.535675 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:38:27.535675 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 12:38:27.535675 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 12:38:27.535675 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:38:27.535675 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:38:27.537098 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 12:38:27.537098 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 12:38:27.537098 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.537098 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.537098 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:27.537098 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.537098 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.537098 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.537098 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.537098 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:27.537098 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:27.537098 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:27.537098 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:27.537098 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:27.537098 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:27.537098 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 25 12:38:27.537098 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 25 12:38:27.537098 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 25 12:38:27.537098 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:38:27.538928 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.538928 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.538928 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:27.538928 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.538928 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.538928 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.538928 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.538928 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:27.538928 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:27.538928 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.538928 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.538928 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-93de97da-e158-4872-9375-88a581ece86d tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:27.538928 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-93de97da-e158-4872-9375-88a581ece86d tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.030376 Jul 25 12:38:27.540873 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 82/141] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Jul 25 12:38:27 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:38:27.546613 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-62f495ff-4646-403a-bd8f-596ff0742aaa tempest-FlavorsV261TestJSON-1709597932 tempest-FlavorsV261TestJSON-1709597932-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:27.572939 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-62f495ff-4646-403a-bd8f-596ff0742aaa tempest-FlavorsV261TestJSON-1709597932 tempest-FlavorsV261TestJSON-1709597932-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 6701 microversion: 2.61 time: 0.030465 Jul 25 12:38:27.574124 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 83/142] 10.222.0.49 () {60 vars in 1187 bytes} [Mon Jul 25 12:38:27 2022] GET /compute/v2.1/flavors/detail => generated 6701 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:38:27.580341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f20e0b22-445b-4e40-895b-54077d180d47 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Calling method '.version_select at 0x7efcfa800af0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:27.581281 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:27.581281 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:27.582605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f20e0b22-445b-4e40-895b-54077d180d47 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'e747e5d5de86452dae33b5d8a9facd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7a48a3a9dc4c0399a8b39f8604ff20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:27.584332 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f20e0b22-445b-4e40-895b-54077d180d47 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Request method failure captured: Jul 25 12:38:27.584332 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-hosts/n-d-848886-15/startup HTTP/1.1 Jul 25 12:38:27.584332 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:27.584332 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:27.584332 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:27.584332 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:27.584332 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:27.584332 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:27.584332 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:27.584332 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:27.584332 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6-QziErsNJpGSIALbhUTryze1ysETSZ8i4aQBQQp-z1LYAf5RA0rKD_n9QGdoWp-DvDv-4FYWB6yZFkh9FcOprPBQ1mZiCb2HW1Thv4j_ikYpdNn3w1tVDYM9GIksz7RctTlZkoD02EPa_xmn-w8wyu1xoU1WhbHtCRtF7v01Bx1k Jul 25 12:38:27.584332 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:27.584332 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:27.584332 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:27.584332 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:27.584332 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:27.584332 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:27.584332 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 3a7a48a3a9dc4c0399a8b39f8604ff20 Jul 25 12:38:27.584332 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-516019400 Jul 25 12:38:27.584332 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:38:27.584332 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:38:27.585727 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3a7a48a3a9dc4c0399a8b39f8604ff20", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3a7a48a3a9dc4c0399a8b39f8604ff20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3a7a48a3a9dc4c0399a8b39f8604ff20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3a7a48a3a9dc4c0399a8b39f8604ff20"}]}] Jul 25 12:38:27.585727 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-HostsAdminNegativeTestJSON-516019400 Jul 25 12:38:27.585727 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 3a7a48a3a9dc4c0399a8b39f8604ff20 Jul 25 12:38:27.585727 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-516019400 Jul 25 12:38:27.585727 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-HostsAdminNegativeTestJSON-516019400-project Jul 25 12:38:27.585727 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:27.585727 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:27.585727 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: e747e5d5de86452dae33b5d8a9facd3f Jul 25 12:38:27.585727 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-HostsAdminNegativeTestJSON-516019400-project Jul 25 12:38:27.585727 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:38:27.585727 n-d-848886-15 devstack@n-api.service[125883]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 25 12:38:27.585727 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'n-d-848886-15'} Jul 25 12:38:27.585727 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:27.586591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.586591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.586591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.586591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:27.586591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:27.586591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:27.586591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:27.586591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:27.586591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:27.586591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 25 12:38:27.586591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 25 12:38:27.586591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:27.586591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:27.586591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:27.586591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:27.586591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:27.586591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:27.586591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:27.586591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:27.587735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:27.587735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:27.587735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:27.587735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:27.587735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:27.587735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:27.587735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 25 12:38:27.587735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.587735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:27.587735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.587735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.587735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.587735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.587735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:27.587735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:27.587735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 25 12:38:27.587735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.589581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f20e0b22-445b-4e40-895b-54077d180d47 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:27.590559 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f20e0b22-445b-4e40-895b-54077d180d47 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] 10.222.0.49 "GET /compute/v2.1/os-hosts/n-d-848886-15/startup" status: 403 len: 110 microversion: 2.1 time: 0.015177 Jul 25 12:38:27.596219 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 84/143] 10.222.0.49 () {58 vars in 1194 bytes} [Mon Jul 25 12:38:27 2022] GET /compute/v2.1/os-hosts/n-d-848886-15/startup => generated 110 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:27.602830 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3398cf25-6c9c-4137-ba85-44f3dd2fda70 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Calling method '.version_select at 0x7efcfa84bb80>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:27.613010 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-3398cf25-6c9c-4137-ba85-44f3dd2fda70 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.614942 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3398cf25-6c9c-4137-ba85-44f3dd2fda70 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Request method failure captured: Jul 25 12:38:27.614942 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 25 12:38:27.614942 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:27.614942 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:27.614942 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:27.614942 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:27.614942 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:27.614942 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:27.614942 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:27.614942 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:27.614942 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7Afa2RUUuCjknOrJG8v3Cpb7S_tN1-7jDKp1jybWGo4etc2UBLkwHrPAeRV6Jc2IUUkDThyGq3xxZ5tGyILTKMEReQLVvWPUiNJAiG9hjoZx2dLKNwmAQzDYY6AZ4sNyk5CFj4zW6bpr4oSGNqMKnag5Kcp8bToMAuYyyiGxYNlxo Jul 25 12:38:27.614942 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:27.614942 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:27.614942 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:27.614942 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:27.614942 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:27.614942 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:27.614942 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: c18ad1efc46a446b90bc8eaf9a273243 Jul 25 12:38:27.614942 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.614942 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:38:27.614942 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:38:27.616334 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c18ad1efc46a446b90bc8eaf9a273243", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c18ad1efc46a446b90bc8eaf9a273243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c18ad1efc46a446b90bc8eaf9a273243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c18ad1efc46a446b90bc8eaf9a273243"}]}] Jul 25 12:38:27.616334 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.616334 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: c18ad1efc46a446b90bc8eaf9a273243 Jul 25 12:38:27.616334 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.616334 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-HostsAdminNegativeTestJSON-182094255-project-admin Jul 25 12:38:27.616334 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:27.616334 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:27.616334 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 02baa6eb34d247afab10be80537c4aaa Jul 25 12:38:27.616334 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-HostsAdminNegativeTestJSON-182094255-project-admin Jul 25 12:38:27.616334 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:38:27.616334 n-d-848886-15 devstack@n-api.service[125883]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.616334 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'nonexistent_hostname'} Jul 25 12:38:27.616334 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:27.617176 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.617176 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 25 12:38:27.617176 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 25 12:38:27.617176 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 12:38:27.617176 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 12:38:27.617176 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:27.617176 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:27.617176 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:27.617176 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:27.617176 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 12:38:27.617176 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 12:38:27.617176 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 25 12:38:27.617176 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 25 12:38:27.617176 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:38:27.617176 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:38:27.617176 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 12:38:27.617176 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 12:38:27.617176 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:38:27.617176 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:38:27.618416 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 12:38:27.618416 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 12:38:27.618416 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.618416 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.618416 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:27.618416 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.618416 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.618416 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.618416 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.618416 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:27.618416 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:27.618416 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:27.618416 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:27.618416 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:27.618416 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:27.618416 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 25 12:38:27.618416 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 25 12:38:27.618416 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 25 12:38:27.618416 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:38:27.619553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.619553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.619553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:27.619553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.619553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.619553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.619553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.619553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:27.619553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:27.619553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.619553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.621542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3398cf25-6c9c-4137-ba85-44f3dd2fda70 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:27.623190 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3398cf25-6c9c-4137-ba85-44f3dd2fda70 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.025788 Jul 25 12:38:27.628674 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 85/144] 10.222.0.49 () {58 vars in 1215 bytes} [Mon Jul 25 12:38:27 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:38:27.636297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a882af73-4785-4a0a-91e7-2452eb697820 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Action: 'update', calling method: .version_select at 0x7efcfa84b700>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:27.652247 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a882af73-4785-4a0a-91e7-2452eb697820 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Request method failure captured: Jul 25 12:38:27.652247 n-d-848886-15 devstack@n-api.service[125883]: request: PUT /compute/v2.1/os-hosts/n-d-848886-15 HTTP/1.1 Jul 25 12:38:27.652247 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:27.652247 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:27.652247 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:27.652247 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 51 Jul 25 12:38:27.652247 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:27.652247 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:27.652247 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:27.652247 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:27.652247 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7Afa2RUUuCjknOrJG8v3Cpb7S_tN1-7jDKp1jybWGo4etc2UBLkwHrPAeRV6Jc2IUUkDThyGq3xxZ5tGyILTKMEReQLVvWPUiNJAiG9hjoZx2dLKNwmAQzDYY6AZ4sNyk5CFj4zW6bpr4oSGNqMKnag5Kcp8bToMAuYyyiGxYNlxo Jul 25 12:38:27.652247 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:27.652247 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:27.652247 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:27.652247 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:27.652247 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:27.652247 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:27.652247 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: c18ad1efc46a446b90bc8eaf9a273243 Jul 25 12:38:27.652247 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.652247 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:38:27.652247 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:38:27.653752 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c18ad1efc46a446b90bc8eaf9a273243", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c18ad1efc46a446b90bc8eaf9a273243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c18ad1efc46a446b90bc8eaf9a273243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c18ad1efc46a446b90bc8eaf9a273243"}]}] Jul 25 12:38:27.653752 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.653752 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: c18ad1efc46a446b90bc8eaf9a273243 Jul 25 12:38:27.653752 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.653752 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-HostsAdminNegativeTestJSON-182094255-project-admin Jul 25 12:38:27.653752 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:27.653752 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:27.653752 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 02baa6eb34d247afab10be80537c4aaa Jul 25 12:38:27.653752 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-HostsAdminNegativeTestJSON-182094255-project-admin Jul 25 12:38:27.653752 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:38:27.653752 n-d-848886-15 devstack@n-api.service[125883]: {"status": "enable", "maintenance_mode": "invalid"} Jul 25 12:38:27.653752 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:38:27.653752 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'n-d-848886-15', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'disable', Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'Enable', Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'Disable', Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance: Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'invalid' Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.654483 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.655733 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.655733 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:27.655733 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:27.655733 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:27.655733 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:27.655733 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:27.655733 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:27.655733 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:38:27.655733 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:38:27.655733 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:38:27.655733 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:38:27.655733 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:38:27.655733 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:38:27.655733 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 12:38:27.655733 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.655733 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:27.655733 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.655733 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.655733 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.657194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.657194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:38:27.657194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:38:27.657194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 12:38:27.657194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.657194 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a882af73-4785-4a0a-91e7-2452eb697820 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:27.657194 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a882af73-4785-4a0a-91e7-2452eb697820 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-hosts/n-d-848886-15" status: 400 len: 199 microversion: 2.1 time: 0.024114 Jul 25 12:38:27.657194 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 86/145] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Jul 25 12:38:27 2022] PUT /compute/v2.1/os-hosts/n-d-848886-15 => generated 199 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:38:27.667663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-662882b6-7a80-4ad3-96d7-a73915fd0231 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Action: 'update', calling method: .version_select at 0x7efcfa762b80>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:27.677733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-662882b6-7a80-4ad3-96d7-a73915fd0231 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Request method failure captured: Jul 25 12:38:27.677733 n-d-848886-15 devstack@n-api.service[125883]: request: PUT /compute/v2.1/os-hosts/n-d-848886-15 HTTP/1.1 Jul 25 12:38:27.677733 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:27.677733 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:27.677733 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:27.677733 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 51 Jul 25 12:38:27.677733 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:27.677733 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:27.677733 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:27.677733 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:27.677733 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7Afa2RUUuCjknOrJG8v3Cpb7S_tN1-7jDKp1jybWGo4etc2UBLkwHrPAeRV6Jc2IUUkDThyGq3xxZ5tGyILTKMEReQLVvWPUiNJAiG9hjoZx2dLKNwmAQzDYY6AZ4sNyk5CFj4zW6bpr4oSGNqMKnag5Kcp8bToMAuYyyiGxYNlxo Jul 25 12:38:27.677733 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:27.677733 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:27.677733 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:27.677733 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:27.677733 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:27.677733 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:27.677733 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: c18ad1efc46a446b90bc8eaf9a273243 Jul 25 12:38:27.677733 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.677733 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:38:27.677733 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:38:27.678968 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c18ad1efc46a446b90bc8eaf9a273243", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c18ad1efc46a446b90bc8eaf9a273243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c18ad1efc46a446b90bc8eaf9a273243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c18ad1efc46a446b90bc8eaf9a273243"}]}] Jul 25 12:38:27.678968 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.678968 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: c18ad1efc46a446b90bc8eaf9a273243 Jul 25 12:38:27.678968 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.678968 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-HostsAdminNegativeTestJSON-182094255-project-admin Jul 25 12:38:27.678968 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:27.678968 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:27.678968 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 02baa6eb34d247afab10be80537c4aaa Jul 25 12:38:27.678968 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-HostsAdminNegativeTestJSON-182094255-project-admin Jul 25 12:38:27.678968 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:38:27.678968 n-d-848886-15 devstack@n-api.service[125883]: {"status": "invalid", "maintenance_mode": "enable"} Jul 25 12:38:27.678968 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:38:27.678968 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'n-d-848886-15', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'disable', Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'Enable', Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'Disable', Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance: Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'invalid' Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.679671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.680984 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.680984 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:27.680984 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:27.680984 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:27.680984 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:27.680984 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:27.680984 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:27.680984 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:38:27.680984 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:38:27.680984 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:38:27.680984 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:38:27.680984 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:38:27.680984 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:38:27.680984 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 12:38:27.680984 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.680984 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:27.680984 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.680984 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.680984 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.682138 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.682138 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:38:27.682138 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:38:27.682138 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 12:38:27.682138 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.686032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-662882b6-7a80-4ad3-96d7-a73915fd0231 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:27.687106 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-662882b6-7a80-4ad3-96d7-a73915fd0231 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-hosts/n-d-848886-15" status: 400 len: 189 microversion: 2.1 time: 0.024477 Jul 25 12:38:27.688083 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 87/146] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Jul 25 12:38:27 2022] PUT /compute/v2.1/os-hosts/n-d-848886-15 => generated 189 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 12:38:27.697809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e3158dce-dc46-4c62-86dd-3ac1dcb4b471 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Action: 'update', calling method: .version_select at 0x7efcfa6b54c0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:27.711035 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:27.711035 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:27.712745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e3158dce-dc46-4c62-86dd-3ac1dcb4b471 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'e747e5d5de86452dae33b5d8a9facd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7a48a3a9dc4c0399a8b39f8604ff20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:27.716431 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e3158dce-dc46-4c62-86dd-3ac1dcb4b471 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Request method failure captured: Jul 25 12:38:27.716431 n-d-848886-15 devstack@n-api.service[125883]: request: PUT /compute/v2.1/os-hosts/n-d-848886-15 HTTP/1.1 Jul 25 12:38:27.716431 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:27.716431 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:27.716431 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:27.716431 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 50 Jul 25 12:38:27.716431 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:27.716431 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:27.716431 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:27.716431 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:27.716431 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6-QziErsNJpGSIALbhUTryze1ysETSZ8i4aQBQQp-z1LYAf5RA0rKD_n9QGdoWp-DvDv-4FYWB6yZFkh9FcOprPBQ1mZiCb2HW1Thv4j_ikYpdNn3w1tVDYM9GIksz7RctTlZkoD02EPa_xmn-w8wyu1xoU1WhbHtCRtF7v01Bx1k Jul 25 12:38:27.716431 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:27.716431 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:27.716431 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:27.716431 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:27.716431 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:27.716431 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:27.716431 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 3a7a48a3a9dc4c0399a8b39f8604ff20 Jul 25 12:38:27.716431 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-516019400 Jul 25 12:38:27.716431 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:38:27.716431 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:38:27.717609 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3a7a48a3a9dc4c0399a8b39f8604ff20", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3a7a48a3a9dc4c0399a8b39f8604ff20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3a7a48a3a9dc4c0399a8b39f8604ff20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3a7a48a3a9dc4c0399a8b39f8604ff20"}]}] Jul 25 12:38:27.717609 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-HostsAdminNegativeTestJSON-516019400 Jul 25 12:38:27.717609 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 3a7a48a3a9dc4c0399a8b39f8604ff20 Jul 25 12:38:27.717609 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-516019400 Jul 25 12:38:27.717609 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-HostsAdminNegativeTestJSON-516019400-project Jul 25 12:38:27.717609 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:27.717609 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:27.717609 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: e747e5d5de86452dae33b5d8a9facd3f Jul 25 12:38:27.717609 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-HostsAdminNegativeTestJSON-516019400-project Jul 25 12:38:27.717609 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:38:27.717609 n-d-848886-15 devstack@n-api.service[125883]: {"status": "enable", "maintenance_mode": "enable"} Jul 25 12:38:27.717609 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:38:27.717609 n-d-848886-15 devstack@n-api.service[125883]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 25 12:38:27.717609 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'n-d-848886-15', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 25 12:38:27.718366 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:27.718366 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.718366 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.718366 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.718366 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:27.718366 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:27.718366 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:27.718366 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:27.718366 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:27.718366 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:27.718366 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:38:27.718366 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:38:27.718366 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 25 12:38:27.718366 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 25 12:38:27.718366 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:27.718366 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:27.718366 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:27.718366 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:27.718366 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:27.718366 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:27.719358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:27.719358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:27.719358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:27.719358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:27.719358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:27.719358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:27.719358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:27.719358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:27.719358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 25 12:38:27.719358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.719358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:27.719358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.719358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.719358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.719358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.719358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:27.719358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:27.719358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 25 12:38:27.719358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.724768 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e3158dce-dc46-4c62-86dd-3ac1dcb4b471 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:27.726072 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e3158dce-dc46-4c62-86dd-3ac1dcb4b471 tempest-HostsAdminNegativeTestJSON-516019400 tempest-HostsAdminNegativeTestJSON-516019400-project] 10.222.0.49 "PUT /compute/v2.1/os-hosts/n-d-848886-15" status: 403 len: 111 microversion: 2.1 time: 0.032320 Jul 25 12:38:27.730306 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 88/147] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Jul 25 12:38:27 2022] PUT /compute/v2.1/os-hosts/n-d-848886-15 => generated 111 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:27.739482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-343e88ff-070d-472d-a1ce-2f221739c723 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Action: 'update', calling method: .version_select at 0x7efcfa8004c0>, body: {"status": null, "maintenance_mode": null} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:27.747628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-343e88ff-070d-472d-a1ce-2f221739c723 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Request method failure captured: Jul 25 12:38:27.747628 n-d-848886-15 devstack@n-api.service[125883]: request: PUT /compute/v2.1/os-hosts/n-d-848886-15 HTTP/1.1 Jul 25 12:38:27.747628 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:27.747628 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:27.747628 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:27.747628 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 42 Jul 25 12:38:27.747628 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:27.747628 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:27.747628 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:27.747628 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:27.747628 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7Afa2RUUuCjknOrJG8v3Cpb7S_tN1-7jDKp1jybWGo4etc2UBLkwHrPAeRV6Jc2IUUkDThyGq3xxZ5tGyILTKMEReQLVvWPUiNJAiG9hjoZx2dLKNwmAQzDYY6AZ4sNyk5CFj4zW6bpr4oSGNqMKnag5Kcp8bToMAuYyyiGxYNlxo Jul 25 12:38:27.747628 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:27.747628 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:27.747628 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:27.747628 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:27.747628 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:27.747628 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:27.747628 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: c18ad1efc46a446b90bc8eaf9a273243 Jul 25 12:38:27.747628 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.747628 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:38:27.747628 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:38:27.748842 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c18ad1efc46a446b90bc8eaf9a273243", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c18ad1efc46a446b90bc8eaf9a273243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c18ad1efc46a446b90bc8eaf9a273243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c18ad1efc46a446b90bc8eaf9a273243"}]}] Jul 25 12:38:27.748842 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.748842 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: c18ad1efc46a446b90bc8eaf9a273243 Jul 25 12:38:27.748842 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.748842 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-HostsAdminNegativeTestJSON-182094255-project-admin Jul 25 12:38:27.748842 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:27.748842 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:27.748842 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 02baa6eb34d247afab10be80537c4aaa Jul 25 12:38:27.748842 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-HostsAdminNegativeTestJSON-182094255-project-admin Jul 25 12:38:27.748842 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:38:27.748842 n-d-848886-15 devstack@n-api.service[125883]: {"status": null, "maintenance_mode": null} Jul 25 12:38:27.748842 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:38:27.748842 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 25 12:38:27.748842 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'n-d-848886-15', 'body': {'status': None, 'maintenance_mode': None}} Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'disable', Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'Enable', Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'Disable', Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance: Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi None Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.749693 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.750982 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:27.750982 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:27.750982 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:27.750982 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:27.750982 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:27.750982 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:27.750982 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:38:27.750982 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:38:27.750982 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:38:27.750982 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:38:27.750982 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:38:27.750982 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:38:27.750982 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 25 12:38:27.750982 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.750982 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:27.750982 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.750982 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.750982 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.750982 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.751921 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:38:27.751921 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:38:27.751921 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 25 12:38:27.751921 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.759797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-343e88ff-070d-472d-a1ce-2f221739c723 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:27.764833 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-343e88ff-070d-472d-a1ce-2f221739c723 tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-hosts/n-d-848886-15" status: 400 len: 127 microversion: 2.1 time: 0.028759 Jul 25 12:38:27.765628 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 89/148] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Jul 25 12:38:27 2022] PUT /compute/v2.1/os-hosts/n-d-848886-15 => generated 127 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:38:27.783989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b1ce6e8b-a67a-43bd-8b8a-86c79d4f415c tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Action: 'update', calling method: .version_select at 0x7efcfa6b55e0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:27.800364 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.hosts [None req-b1ce6e8b-a67a-43bd-8b8a-86c79d4f415c tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Enabling host nonexistent_hostname. Jul 25 12:38:27.816726 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-b1ce6e8b-a67a-43bd-8b8a-86c79d4f415c tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.827069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b1ce6e8b-a67a-43bd-8b8a-86c79d4f415c tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Request method failure captured: Jul 25 12:38:27.827069 n-d-848886-15 devstack@n-api.service[125883]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 25 12:38:27.827069 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:27.827069 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:27.827069 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:27.827069 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 50 Jul 25 12:38:27.827069 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:27.827069 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:27.827069 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:27.827069 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:27.827069 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7Afa2RUUuCjknOrJG8v3Cpb7S_tN1-7jDKp1jybWGo4etc2UBLkwHrPAeRV6Jc2IUUkDThyGq3xxZ5tGyILTKMEReQLVvWPUiNJAiG9hjoZx2dLKNwmAQzDYY6AZ4sNyk5CFj4zW6bpr4oSGNqMKnag5Kcp8bToMAuYyyiGxYNlxo Jul 25 12:38:27.827069 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:27.827069 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:27.827069 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:27.827069 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:27.827069 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:27.827069 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:27.827069 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: c18ad1efc46a446b90bc8eaf9a273243 Jul 25 12:38:27.827069 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.827069 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:38:27.827069 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:38:27.828465 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c18ad1efc46a446b90bc8eaf9a273243", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c18ad1efc46a446b90bc8eaf9a273243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c18ad1efc46a446b90bc8eaf9a273243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c18ad1efc46a446b90bc8eaf9a273243"}]}] Jul 25 12:38:27.828465 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.828465 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: c18ad1efc46a446b90bc8eaf9a273243 Jul 25 12:38:27.828465 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-182094255 Jul 25 12:38:27.828465 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-HostsAdminNegativeTestJSON-182094255-project-admin Jul 25 12:38:27.828465 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:27.828465 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:27.828465 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 02baa6eb34d247afab10be80537c4aaa Jul 25 12:38:27.828465 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-HostsAdminNegativeTestJSON-182094255-project-admin Jul 25 12:38:27.828465 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:38:27.828465 n-d-848886-15 devstack@n-api.service[125883]: {"status": "enable", "maintenance_mode": "enable"} Jul 25 12:38:27.828465 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:38:27.828465 n-d-848886-15 devstack@n-api.service[125883]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.828465 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 25 12:38:27.829206 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:27.829206 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.829206 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 25 12:38:27.829206 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 25 12:38:27.829206 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 12:38:27.829206 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 12:38:27.829206 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:27.829206 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:27.829206 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:27.829206 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:27.829206 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 12:38:27.829206 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 12:38:27.829206 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 25 12:38:27.829206 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 25 12:38:27.829206 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:38:27.829206 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:38:27.829206 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 12:38:27.829206 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 12:38:27.830270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:38:27.830270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:38:27.830270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 12:38:27.830270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 12:38:27.830270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.830270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.830270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:27.830270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.830270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.830270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.830270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.830270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:27.830270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:27.830270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:27.830270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:27.830270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:27.830270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:27.830270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:38:27.830270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:38:27.830270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 25 12:38:27.831276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 25 12:38:27.831276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 25 12:38:27.831276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:38:27.831276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.831276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.831276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:27.831276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.831276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.831276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.831276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.831276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:27.831276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:27.831276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 12:38:27.831276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.834129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b1ce6e8b-a67a-43bd-8b8a-86c79d4f415c tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:27.839446 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b1ce6e8b-a67a-43bd-8b8a-86c79d4f415c tempest-HostsAdminNegativeTestJSON-182094255 tempest-HostsAdminNegativeTestJSON-182094255-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.066437 Jul 25 12:38:27.842133 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 90/149] 10.222.0.49 () {60 vars in 1211 bytes} [Mon Jul 25 12:38:27 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:38:27.918557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d86bc69b-4be0-449d-8bbf-dd5de7781865 tempest-HypervisorAdminNegativeUnderV252Test-815808751 tempest-HypervisorAdminNegativeUnderV252Test-815808751-project] Calling method '.version_select at 0x7efcfb091a60>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:27.919490 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:27.919490 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:27.921263 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d86bc69b-4be0-449d-8bbf-dd5de7781865 tempest-HypervisorAdminNegativeUnderV252Test-815808751 tempest-HypervisorAdminNegativeUnderV252Test-815808751-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '1d611d8aac4948c7ade757f1fdab6195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cfd84be3b3442c805a49c3569d6057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:27.923496 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d86bc69b-4be0-449d-8bbf-dd5de7781865 tempest-HypervisorAdminNegativeUnderV252Test-815808751 tempest-HypervisorAdminNegativeUnderV252Test-815808751-project] Request method failure captured: Jul 25 12:38:27.923496 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/os-hypervisors/n-h2-848886-15/search HTTP/1.1 Jul 25 12:38:27.923496 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:38:27.923496 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:38:27.923496 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:38:27.923496 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:38:27.923496 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:38:27.923496 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:38:27.923496 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:38:27.923496 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:27.923496 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o7ALvyMPX4Wph3hoLRCP3n_Ncl3JJxutbmHqofT7QdmPxe7ZjTZotzQA7K4G_u-DkZE7EL2FfY-yooTWE48aq1WBQeRnLH7z0Zc8cPMFHZnF1mt9eIsYLpfOyCKxG0O4LcmG4YeIH98LLmU3SSx0konqkWRNyIRgC78ZT1Nzni_Hd0 Jul 25 12:38:27.923496 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:38:27.923496 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:38:27.923496 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:38:27.923496 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:38:27.923496 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:38:27.923496 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:38:27.923496 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 90cfd84be3b3442c805a49c3569d6057 Jul 25 12:38:27.923496 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-815808751 Jul 25 12:38:27.923496 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:38:27.923496 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:38:27.924633 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_90cfd84be3b3442c805a49c3569d6057", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/90cfd84be3b3442c805a49c3569d6057"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/90cfd84be3b3442c805a49c3569d6057"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/90cfd84be3b3442c805a49c3569d6057"}]}] Jul 25 12:38:27.924633 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-815808751 Jul 25 12:38:27.924633 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 90cfd84be3b3442c805a49c3569d6057 Jul 25 12:38:27.924633 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-815808751 Jul 25 12:38:27.924633 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-815808751-project Jul 25 12:38:27.924633 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:38:27.924633 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:38:27.924633 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 1d611d8aac4948c7ade757f1fdab6195 Jul 25 12:38:27.924633 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-815808751-project Jul 25 12:38:27.924633 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:38:27.924633 n-d-848886-15 devstack@n-api.service[125884]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 25 12:38:27.924633 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'n-h2-848886-15'} Jul 25 12:38:27.925289 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:27.925289 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.925289 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.925289 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.925289 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:27.925289 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:27.925289 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:27.925289 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:27.925289 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:27.925289 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:27.925289 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 25 12:38:27.925289 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 25 12:38:27.925289 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:27.925289 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:27.925289 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:27.925289 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:27.925289 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:27.925289 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:27.925289 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:27.926283 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:27.926283 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:27.926283 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:27.926283 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:27.926283 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:27.926283 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:27.926283 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:27.926283 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 25 12:38:27.926283 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.926283 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:27.926283 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.926283 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.926283 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.926283 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.926283 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:27.926283 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:27.926283 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 25 12:38:27.926283 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.928226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d86bc69b-4be0-449d-8bbf-dd5de7781865 tempest-HypervisorAdminNegativeUnderV252Test-815808751 tempest-HypervisorAdminNegativeUnderV252Test-815808751-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:27.928226 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d86bc69b-4be0-449d-8bbf-dd5de7781865 tempest-HypervisorAdminNegativeUnderV252Test-815808751 tempest-HypervisorAdminNegativeUnderV252Test-815808751-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/n-h2-848886-15/search" status: 403 len: 117 microversion: 2.1 time: 0.630765 Jul 25 12:38:27.936969 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 60/150] 10.222.0.49 () {58 vars in 1212 bytes} [Mon Jul 25 12:38:27 2022] GET /compute/v2.1/os-hypervisors/n-h2-848886-15/search => generated 117 bytes in 639 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:27.943707 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-168727fd-d7bf-405a-a2c4-ec3e56fa3710 tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Calling method '.version_select at 0x7efcfa84b4c0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:27.944515 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:27.944515 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:27.949773 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-168727fd-d7bf-405a-a2c4-ec3e56fa3710 tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:27.950251 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-168727fd-d7bf-405a-a2c4-ec3e56fa3710 tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:27.961359 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-168727fd-d7bf-405a-a2c4-ec3e56fa3710 tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 25 12:38:27.966937 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-168727fd-d7bf-405a-a2c4-ec3e56fa3710 tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Request method failure captured: Jul 25 12:38:27.966937 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 25 12:38:27.966937 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:27.966937 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:27.966937 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:27.966937 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:27.966937 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:27.966937 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:27.966937 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:27.966937 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:27.966937 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7CJJhepd7VrN-T6f_FrbebnE5mDUqQFQmhv7ADRbrVDmY95yFePLwFBQmJ_ap7nhI93rtRB9j0q1JVnPl0ayDPtkdn2i36fnM2EiaLyqyITXijBgmH31G6bOlPjp8Jl8eyM5Vu7cLofn30iwxAnTS-tjcPRVz8LcCUNzPyIm9oy20 Jul 25 12:38:27.966937 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:27.966937 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:27.966937 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:27.966937 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:27.966937 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:27.966937 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:27.966937 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 9b3a6c799bc44a3b8ce5f0faceb217f9 Jul 25 12:38:27.966937 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-162437163 Jul 25 12:38:27.966937 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:38:27.966937 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:38:27.968083 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9b3a6c799bc44a3b8ce5f0faceb217f9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9b3a6c799bc44a3b8ce5f0faceb217f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b3a6c799bc44a3b8ce5f0faceb217f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b3a6c799bc44a3b8ce5f0faceb217f9"}]}] Jul 25 12:38:27.968083 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-162437163 Jul 25 12:38:27.968083 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 9b3a6c799bc44a3b8ce5f0faceb217f9 Jul 25 12:38:27.968083 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-162437163 Jul 25 12:38:27.968083 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin Jul 25 12:38:27.968083 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:27.968083 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:27.968083 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: c6b3e689e8f24879b1730d3bb782f7ba Jul 25 12:38:27.968083 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin Jul 25 12:38:27.968083 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:38:27.968083 n-d-848886-15 devstack@n-api.service[125883]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 25 12:38:27.968083 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 25 12:38:27.968742 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:27.968742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.968742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.968742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.968742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:27.968742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:27.968742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:27.968742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:27.968742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:27.968742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:27.968742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 25 12:38:27.968742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 25 12:38:27.968742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 25 12:38:27.968742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 12:38:27.968742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 25 12:38:27.968742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.968742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:27.968742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.968742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:27.968742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:27.969773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:27.969773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:27.969773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:27.969773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 25 12:38:27.969773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:27.969773 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-168727fd-d7bf-405a-a2c4-ec3e56fa3710 tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:27.969773 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-168727fd-d7bf-405a-a2c4-ec3e56fa3710 tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.030302 Jul 25 12:38:27.977812 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 91/151] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Jul 25 12:38:27 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:27.978991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-82e8031f-022d-4c3d-8594-439a84baf37d tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Calling method '.version_select at 0x7efcfb0bc8b0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:27.979796 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:27.979796 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:27.983987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82e8031f-022d-4c3d-8594-439a84baf37d tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:27.986969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82e8031f-022d-4c3d-8594-439a84baf37d tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:27.991147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e8ee2524-47b6-49f0-be7b-75d6ce88aff1 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:27.991761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e8ee2524-47b6-49f0-be7b-75d6ce88aff1 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:28.015100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e8ee2524-47b6-49f0-be7b-75d6ce88aff1 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:28.015547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e8ee2524-47b6-49f0-be7b-75d6ce88aff1 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:28.016324 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e8ee2524-47b6-49f0-be7b-75d6ce88aff1 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:28.022820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e8ee2524-47b6-49f0-be7b-75d6ce88aff1 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:28.051073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82e8031f-022d-4c3d-8594-439a84baf37d tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:28.051969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82e8031f-022d-4c3d-8594-439a84baf37d tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:28.070500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82e8031f-022d-4c3d-8594-439a84baf37d tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:28.071476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82e8031f-022d-4c3d-8594-439a84baf37d tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:28.112351 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-82e8031f-022d-4c3d-8594-439a84baf37d tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.129174 Jul 25 12:38:28.115032 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 61/152] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:38:27 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:38:28.136010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-60a682ed-eab0-4abc-b515-d25b58b4b70d tempest-HypervisorAdminNegativeUnderV252Test-815808751 tempest-HypervisorAdminNegativeUnderV252Test-815808751-project] Calling method '.version_select at 0x7efcfb17b430>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:28.138917 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:28.138917 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:28.142538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-60a682ed-eab0-4abc-b515-d25b58b4b70d tempest-HypervisorAdminNegativeUnderV252Test-815808751 tempest-HypervisorAdminNegativeUnderV252Test-815808751-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '1d611d8aac4948c7ade757f1fdab6195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cfd84be3b3442c805a49c3569d6057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:28.147235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-60a682ed-eab0-4abc-b515-d25b58b4b70d tempest-HypervisorAdminNegativeUnderV252Test-815808751 tempest-HypervisorAdminNegativeUnderV252Test-815808751-project] Request method failure captured: Jul 25 12:38:28.147235 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 25 12:38:28.147235 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:38:28.147235 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:38:28.147235 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:38:28.147235 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:38:28.147235 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:38:28.147235 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:38:28.147235 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:38:28.147235 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:28.147235 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o7ALvyMPX4Wph3hoLRCP3n_Ncl3JJxutbmHqofT7QdmPxe7ZjTZotzQA7K4G_u-DkZE7EL2FfY-yooTWE48aq1WBQeRnLH7z0Zc8cPMFHZnF1mt9eIsYLpfOyCKxG0O4LcmG4YeIH98LLmU3SSx0konqkWRNyIRgC78ZT1Nzni_Hd0 Jul 25 12:38:28.147235 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:38:28.147235 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:38:28.147235 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:38:28.147235 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:38:28.147235 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:38:28.147235 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:38:28.147235 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 90cfd84be3b3442c805a49c3569d6057 Jul 25 12:38:28.147235 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-815808751 Jul 25 12:38:28.147235 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:38:28.147235 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:38:28.148484 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_90cfd84be3b3442c805a49c3569d6057", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/90cfd84be3b3442c805a49c3569d6057"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/90cfd84be3b3442c805a49c3569d6057"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/90cfd84be3b3442c805a49c3569d6057"}]}] Jul 25 12:38:28.148484 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-815808751 Jul 25 12:38:28.148484 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 90cfd84be3b3442c805a49c3569d6057 Jul 25 12:38:28.148484 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-815808751 Jul 25 12:38:28.148484 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-815808751-project Jul 25 12:38:28.148484 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:38:28.148484 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:38:28.148484 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 1d611d8aac4948c7ade757f1fdab6195 Jul 25 12:38:28.148484 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-815808751-project Jul 25 12:38:28.148484 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:38:28.148484 n-d-848886-15 devstack@n-api.service[125884]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 25 12:38:28.148484 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '1'} Jul 25 12:38:28.148484 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:28.149167 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:28.149167 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:28.149167 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:28.149167 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:28.149167 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:28.149167 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:28.149167 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:28.149167 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:28.149167 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:28.149167 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 25 12:38:28.149167 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 25 12:38:28.149167 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:28.149167 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:28.149167 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:28.149167 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:28.149167 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:28.149167 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:28.149167 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:28.149167 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:28.150174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:28.150174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:28.150174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:28.150174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:28.150174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:28.150174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:28.150174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 25 12:38:28.150174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:28.150174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:28.150174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:28.150174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:28.150174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:28.150174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:28.150174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:28.150174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:28.150174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 25 12:38:28.150174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:28.153808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-60a682ed-eab0-4abc-b515-d25b58b4b70d tempest-HypervisorAdminNegativeUnderV252Test-815808751 tempest-HypervisorAdminNegativeUnderV252Test-815808751-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:28.155342 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-60a682ed-eab0-4abc-b515-d25b58b4b70d tempest-HypervisorAdminNegativeUnderV252Test-815808751 tempest-HypervisorAdminNegativeUnderV252Test-815808751-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.034564 Jul 25 12:38:28.158957 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 62/153] 10.222.0.49 () {58 vars in 1176 bytes} [Mon Jul 25 12:38:28 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:28.171705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ab9f3065-4994-484b-9639-6917472a4044 tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Calling method '.version_select at 0x7efcfb18c310>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:28.175991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ab9f3065-4994-484b-9639-6917472a4044 tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:28.180559 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ab9f3065-4994-484b-9639-6917472a4044 tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:28.192380 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-ab9f3065-4994-484b-9639-6917472a4044 tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] HTTP exception thrown: No hypervisor matching '83d13131-2c40-4f92-a872-d04cb48bd99d' could be found. Jul 25 12:38:28.194761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ab9f3065-4994-484b-9639-6917472a4044 tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Request method failure captured: Jul 25 12:38:28.194761 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/os-hypervisors/83d13131-2c40-4f92-a872-d04cb48bd99d/servers HTTP/1.1 Jul 25 12:38:28.194761 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:38:28.194761 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:38:28.194761 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:38:28.194761 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:38:28.194761 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:38:28.194761 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:38:28.194761 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:38:28.194761 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:28.194761 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o7CJJhepd7VrN-T6f_FrbebnE5mDUqQFQmhv7ADRbrVDmY95yFePLwFBQmJ_ap7nhI93rtRB9j0q1JVnPl0ayDPtkdn2i36fnM2EiaLyqyITXijBgmH31G6bOlPjp8Jl8eyM5Vu7cLofn30iwxAnTS-tjcPRVz8LcCUNzPyIm9oy20 Jul 25 12:38:28.194761 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:38:28.194761 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:38:28.194761 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:38:28.194761 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:38:28.194761 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:38:28.194761 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:38:28.194761 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 9b3a6c799bc44a3b8ce5f0faceb217f9 Jul 25 12:38:28.194761 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-162437163 Jul 25 12:38:28.194761 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,admin,member Jul 25 12:38:28.194761 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,admin,member Jul 25 12:38:28.195958 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9b3a6c799bc44a3b8ce5f0faceb217f9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9b3a6c799bc44a3b8ce5f0faceb217f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b3a6c799bc44a3b8ce5f0faceb217f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b3a6c799bc44a3b8ce5f0faceb217f9"}]}] Jul 25 12:38:28.195958 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-162437163 Jul 25 12:38:28.195958 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 9b3a6c799bc44a3b8ce5f0faceb217f9 Jul 25 12:38:28.195958 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-162437163 Jul 25 12:38:28.195958 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin Jul 25 12:38:28.195958 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:38:28.195958 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:38:28.195958 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: c6b3e689e8f24879b1730d3bb782f7ba Jul 25 12:38:28.195958 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin Jul 25 12:38:28.195958 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:38:28.195958 n-d-848886-15 devstack@n-api.service[125884]: exception: No hypervisor matching '83d13131-2c40-4f92-a872-d04cb48bd99d' could be found. Jul 25 12:38:28.195958 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '83d13131-2c40-4f92-a872-d04cb48bd99d'} Jul 25 12:38:28.196595 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:28.196595 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:28.196595 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:28.196595 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:28.196595 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:28.196595 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:28.196595 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:28.196595 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:28.196595 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:28.196595 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:28.196595 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 25 12:38:28.196595 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 25 12:38:28.196595 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 25 12:38:28.196595 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 12:38:28.196595 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '83d13131-2c40-4f92-a872-d04cb48bd99d' could be found. Jul 25 12:38:28.196595 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:28.196595 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:28.196595 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:28.196595 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:28.197589 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:28.197589 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:28.197589 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:28.197589 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:28.197589 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '83d13131-2c40-4f92-a872-d04cb48bd99d' could be found. Jul 25 12:38:28.197589 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:28.200160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ab9f3065-4994-484b-9639-6917472a4044 tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] Returning 404 to user: No hypervisor matching '83d13131-2c40-4f92-a872-d04cb48bd99d' could be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:28.201261 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ab9f3065-4994-484b-9639-6917472a4044 tempest-HypervisorAdminNegativeUnderV252Test-162437163 tempest-HypervisorAdminNegativeUnderV252Test-162437163-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/83d13131-2c40-4f92-a872-d04cb48bd99d/servers" status: 404 len: 123 microversion: 2.1 time: 0.036880 Jul 25 12:38:28.202999 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 63/154] 10.222.0.49 () {58 vars in 1281 bytes} [Mon Jul 25 12:38:28 2022] GET /compute/v2.1/os-hypervisors/83d13131-2c40-4f92-a872-d04cb48bd99d/servers => generated 123 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:28.216160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0c0f8cd8-d3d2-4404-9197-3d3eb9048745 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:28.217178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0c0f8cd8-d3d2-4404-9197-3d3eb9048745 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:28.225019 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0c0f8cd8-d3d2-4404-9197-3d3eb9048745 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:28.225783 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0c0f8cd8-d3d2-4404-9197-3d3eb9048745 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:28.227090 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0c0f8cd8-d3d2-4404-9197-3d3eb9048745 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:28.227745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0c0f8cd8-d3d2-4404-9197-3d3eb9048745 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:28.352863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0c0f8cd8-d3d2-4404-9197-3d3eb9048745 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:28.369433 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0c0f8cd8-d3d2-4404-9197-3d3eb9048745 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 200 len: 1322 microversion: 2.1 time: 0.164727 Jul 25 12:38:28.374624 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 64/155] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:28 2022] GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:28.414774 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e8ee2524-47b6-49f0-be7b-75d6ce88aff1 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2cfc6122c9496992160b7c0c64dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2056d16864614f9587078e33c8ce795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:28.426866 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e8ee2524-47b6-49f0-be7b-75d6ce88aff1 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 200 len: 1337 microversion: 2.1 time: 0.438221 Jul 25 12:38:28.428693 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 92/156] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:27 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 1337 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:29.400604 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4ba4693b-70f4-4c5b-8d5a-2257a90c4488 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:29.401223 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4ba4693b-70f4-4c5b-8d5a-2257a90c4488 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:29.418390 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4ba4693b-70f4-4c5b-8d5a-2257a90c4488 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:29.421240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4ba4693b-70f4-4c5b-8d5a-2257a90c4488 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:29.426134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4ba4693b-70f4-4c5b-8d5a-2257a90c4488 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:29.427725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4ba4693b-70f4-4c5b-8d5a-2257a90c4488 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:29.449153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ddbb4659-6b81-4673-8979-c7abea797c5c tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:29.450131 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ddbb4659-6b81-4673-8979-c7abea797c5c tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:29.452120 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=9 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:38:29.475868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ddbb4659-6b81-4673-8979-c7abea797c5c tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:29.482935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ddbb4659-6b81-4673-8979-c7abea797c5c tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:29.483951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ddbb4659-6b81-4673-8979-c7abea797c5c tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:29.484385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ddbb4659-6b81-4673-8979-c7abea797c5c tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:29.769386 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4ba4693b-70f4-4c5b-8d5a-2257a90c4488 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:29.777869 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4ba4693b-70f4-4c5b-8d5a-2257a90c4488 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 200 len: 1322 microversion: 2.1 time: 0.381479 Jul 25 12:38:29.799163 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 65/157] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:29 2022] GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 1322 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:30.572476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ddbb4659-6b81-4673-8979-c7abea797c5c tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2cfc6122c9496992160b7c0c64dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2056d16864614f9587078e33c8ce795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:30.586474 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ddbb4659-6b81-4673-8979-c7abea797c5c tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 200 len: 1337 microversion: 2.1 time: 1.141276 Jul 25 12:38:30.587294 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 93/158] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:29 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 1337 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:30.821617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0efcfb51-b2e8-4529-ad2f-d4f03a4d2b50 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:30.822267 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0efcfb51-b2e8-4529-ad2f-d4f03a4d2b50 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:30.833264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0efcfb51-b2e8-4529-ad2f-d4f03a4d2b50 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:30.833727 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0efcfb51-b2e8-4529-ad2f-d4f03a4d2b50 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:30.834559 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0efcfb51-b2e8-4529-ad2f-d4f03a4d2b50 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:30.835009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0efcfb51-b2e8-4529-ad2f-d4f03a4d2b50 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:31.149910 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0efcfb51-b2e8-4529-ad2f-d4f03a4d2b50 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:31.163480 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0efcfb51-b2e8-4529-ad2f-d4f03a4d2b50 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 200 len: 1322 microversion: 2.1 time: 0.351640 Jul 25 12:38:31.170346 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 66/159] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:30 2022] GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 1322 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:31.267775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-30034b66-a52d-4407-bc37-de690f35e2c0 req-2585e2a0-bee4-49f3-8c78-c81d19d16127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b37efd8-e1e0-4c52-8e97-9ddae0c05a70", "name": "network-vif-plugged", "status": "completed", "tag": "50ed9c56-94a0-4acb-bf2d-60d1b5554567"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:31.287763 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-30034b66-a52d-4407-bc37-de690f35e2c0 req-2585e2a0-bee4-49f3-8c78-c81d19d16127 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:31.289996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-30034b66-a52d-4407-bc37-de690f35e2c0 req-2585e2a0-bee4-49f3-8c78-c81d19d16127 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:31.316539 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-30034b66-a52d-4407-bc37-de690f35e2c0 req-2585e2a0-bee4-49f3-8c78-c81d19d16127 service nova] Creating event network-vif-plugged:50ed9c56-94a0-4acb-bf2d-60d1b5554567 for instance 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 on n-h2-848886-15 Jul 25 12:38:31.335540 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-30034b66-a52d-4407-bc37-de690f35e2c0 req-2585e2a0-bee4-49f3-8c78-c81d19d16127 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.304331 Jul 25 12:38:31.337166 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 94/160] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:38:31.609454 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-15e58a27-49b7-4921-8f56-49f0d166254d tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:31.610596 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-15e58a27-49b7-4921-8f56-49f0d166254d tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:31.623862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-15e58a27-49b7-4921-8f56-49f0d166254d tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:31.624485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-15e58a27-49b7-4921-8f56-49f0d166254d tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:31.625337 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-15e58a27-49b7-4921-8f56-49f0d166254d tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:31.626050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-15e58a27-49b7-4921-8f56-49f0d166254d tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:31.970727 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-15e58a27-49b7-4921-8f56-49f0d166254d tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2cfc6122c9496992160b7c0c64dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2056d16864614f9587078e33c8ce795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:31.982504 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-15e58a27-49b7-4921-8f56-49f0d166254d tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 200 len: 1337 microversion: 2.1 time: 0.378422 Jul 25 12:38:31.984160 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 67/161] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:31 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 1337 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:32.193699 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c1bf79d4-6866-435b-a6f9-9f1637767678 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:32.195159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c1bf79d4-6866-435b-a6f9-9f1637767678 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:32.203886 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c1bf79d4-6866-435b-a6f9-9f1637767678 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:32.204712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c1bf79d4-6866-435b-a6f9-9f1637767678 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:32.206474 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c1bf79d4-6866-435b-a6f9-9f1637767678 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:32.207625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c1bf79d4-6866-435b-a6f9-9f1637767678 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:32.920883 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c1bf79d4-6866-435b-a6f9-9f1637767678 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:32.931143 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c1bf79d4-6866-435b-a6f9-9f1637767678 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 200 len: 1390 microversion: 2.1 time: 0.742530 Jul 25 12:38:32.936462 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 95/162] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:32 2022] GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 1390 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:33.005042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1348eeb8-206f-4c02-8946-78817b03cd78 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:33.006214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1348eeb8-206f-4c02-8946-78817b03cd78 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:33.016121 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=10 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:38:33.020938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1348eeb8-206f-4c02-8946-78817b03cd78 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:33.032304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1348eeb8-206f-4c02-8946-78817b03cd78 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:33.034916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1348eeb8-206f-4c02-8946-78817b03cd78 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:33.039616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1348eeb8-206f-4c02-8946-78817b03cd78 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:33.518363 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1348eeb8-206f-4c02-8946-78817b03cd78 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2cfc6122c9496992160b7c0c64dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2056d16864614f9587078e33c8ce795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:33.531020 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1348eeb8-206f-4c02-8946-78817b03cd78 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 200 len: 1337 microversion: 2.1 time: 0.530239 Jul 25 12:38:33.550999 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 68/163] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:32 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 1337 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:33.955781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-46aa970f-2972-4726-bd79-0a609ffeeb58 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:33.956509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-46aa970f-2972-4726-bd79-0a609ffeeb58 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:33.966139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-46aa970f-2972-4726-bd79-0a609ffeeb58 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:33.968652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-46aa970f-2972-4726-bd79-0a609ffeeb58 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:33.971712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-46aa970f-2972-4726-bd79-0a609ffeeb58 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:33.974695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-46aa970f-2972-4726-bd79-0a609ffeeb58 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:34.552097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b5a46ec4-63d9-46c1-a4b4-94f773cabbd2 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:34.552829 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b5a46ec4-63d9-46c1-a4b4-94f773cabbd2 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:34.560645 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5a46ec4-63d9-46c1-a4b4-94f773cabbd2 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:34.561515 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5a46ec4-63d9-46c1-a4b4-94f773cabbd2 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:34.563344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5a46ec4-63d9-46c1-a4b4-94f773cabbd2 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:34.564785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5a46ec4-63d9-46c1-a4b4-94f773cabbd2 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:34.890396 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-46aa970f-2972-4726-bd79-0a609ffeeb58 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:34.904217 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-46aa970f-2972-4726-bd79-0a609ffeeb58 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 200 len: 1390 microversion: 2.1 time: 0.951251 Jul 25 12:38:34.904817 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 96/164] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:33 2022] GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 1390 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:35.142949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b5a46ec4-63d9-46c1-a4b4-94f773cabbd2 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2cfc6122c9496992160b7c0c64dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2056d16864614f9587078e33c8ce795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:35.156453 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b5a46ec4-63d9-46c1-a4b4-94f773cabbd2 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 200 len: 1487 microversion: 2.1 time: 0.608787 Jul 25 12:38:35.157044 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 69/165] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:34 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 1487 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:35.196310 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d136e689-55b9-469c-8d05-bcdfda486647 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:35.197163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d136e689-55b9-469c-8d05-bcdfda486647 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:35.218543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d136e689-55b9-469c-8d05-bcdfda486647 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:35.221519 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d136e689-55b9-469c-8d05-bcdfda486647 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:35.222345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d136e689-55b9-469c-8d05-bcdfda486647 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:35.222791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d136e689-55b9-469c-8d05-bcdfda486647 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:35.927052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7daf885e-4d8f-4456-bb38-ed34a857d4cd tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:35.929519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7daf885e-4d8f-4456-bb38-ed34a857d4cd tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:35.944935 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:38:35.951049 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7daf885e-4d8f-4456-bb38-ed34a857d4cd tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:35.954204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7daf885e-4d8f-4456-bb38-ed34a857d4cd tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:35.956377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7daf885e-4d8f-4456-bb38-ed34a857d4cd tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:35.957171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7daf885e-4d8f-4456-bb38-ed34a857d4cd tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:36.458224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7daf885e-4d8f-4456-bb38-ed34a857d4cd tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:36.466618 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7daf885e-4d8f-4456-bb38-ed34a857d4cd tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 200 len: 1390 microversion: 2.1 time: 0.545322 Jul 25 12:38:36.470166 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 70/166] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:35 2022] GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 1390 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:36.474883 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-cfcaf365-20a0-416f-ba45-4ac1f4096add req-3fa0ad30-8c4e-4ced-b2bd-81a1794447a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36fa069d-9aaa-4804-a21f-8526cbe9d728", "tag": "bee090ea-f3af-4297-9530-9c09fda48a76"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:36.515730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-cfcaf365-20a0-416f-ba45-4ac1f4096add req-3fa0ad30-8c4e-4ced-b2bd-81a1794447a7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:36.516208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-cfcaf365-20a0-416f-ba45-4ac1f4096add req-3fa0ad30-8c4e-4ced-b2bd-81a1794447a7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:36.579994 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-cfcaf365-20a0-416f-ba45-4ac1f4096add req-3fa0ad30-8c4e-4ced-b2bd-81a1794447a7 service nova] Creating event network-changed:bee090ea-f3af-4297-9530-9c09fda48a76 for instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 on n-h1-848886-15 Jul 25 12:38:36.580544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-cfcaf365-20a0-416f-ba45-4ac1f4096add req-3fa0ad30-8c4e-4ced-b2bd-81a1794447a7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 12:38:36.581705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fbe9ec9d-3f71-4268-830a-b9079be64aea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:36.582189 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fbe9ec9d-3f71-4268-830a-b9079be64aea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:36.583056 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fbe9ec9d-3f71-4268-830a-b9079be64aea None None] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:36.583490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fbe9ec9d-3f71-4268-830a-b9079be64aea None None] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:36.608930 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d136e689-55b9-469c-8d05-bcdfda486647 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 200 len: 1640 microversion: 2.1 time: 1.430964 Jul 25 12:38:36.627204 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.compute.rpcapi [None req-fbe9ec9d-3f71-4268-830a-b9079be64aea None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 12:38:36.627766 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 97/167] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:35 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 1640 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:36.628525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fbe9ec9d-3f71-4268-830a-b9079be64aea None None] Releasing lock "compute-rpcapi-router" {{(pid=125884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 12:38:36.632103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d136e689-55b9-469c-8d05-bcdfda486647 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:36.633389 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d136e689-55b9-469c-8d05-bcdfda486647 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004663 Jul 25 12:38:36.635113 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 98/168] 10.222.0.49 () {56 vars in 886 bytes} [Mon Jul 25 12:38:36 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 25 12:38:36.665961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5feb8ee9-403c-477f-a6ce-65b4ba73ba6a tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:36.667010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5feb8ee9-403c-477f-a6ce-65b4ba73ba6a tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:36.671053 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fbe9ec9d-3f71-4268-830a-b9079be64aea None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199523 Jul 25 12:38:36.671949 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 71/169] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:36.687189 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5feb8ee9-403c-477f-a6ce-65b4ba73ba6a tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:36.687922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5feb8ee9-403c-477f-a6ce-65b4ba73ba6a tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:36.688887 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5feb8ee9-403c-477f-a6ce-65b4ba73ba6a tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:36.690261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5feb8ee9-403c-477f-a6ce-65b4ba73ba6a tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:36.727391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5feb8ee9-403c-477f-a6ce-65b4ba73ba6a tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:38:36.931886 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5feb8ee9-403c-477f-a6ce-65b4ba73ba6a tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 204 len: 0 microversion: 2.1 time: 0.273926 Jul 25 12:38:36.939133 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 99/170] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:38:36 2022] DELETE /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:38:36.959196 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6b9e985b-6e87-413d-9fe1-c26c88218173 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:36.959920 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6b9e985b-6e87-413d-9fe1-c26c88218173 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:36.984370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b9e985b-6e87-413d-9fe1-c26c88218173 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:36.985291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b9e985b-6e87-413d-9fe1-c26c88218173 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:36.987475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b9e985b-6e87-413d-9fe1-c26c88218173 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:36.989850 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b9e985b-6e87-413d-9fe1-c26c88218173 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:37.431192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6d741e17-564c-4e70-b272-60a41300b285 tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] Calling method '.version_select at 0x7efcfb1c7c10>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:37.432837 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:37.432837 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:37.434235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6d741e17-564c-4e70-b272-60a41300b285 tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '04cadc8ac3e044e6bf322efe5088180b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cd33c6f3474ede83859c9c2075a0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:37.436064 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6d741e17-564c-4e70-b272-60a41300b285 tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] Request method failure captured: Jul 25 12:38:37.436064 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 25 12:38:37.436064 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:38:37.436064 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:38:37.436064 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:38:37.436064 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:38:37.436064 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:38:37.436064 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:38:37.436064 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:38:37.436064 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:37.436064 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o7KRSi06FyDTAiC2p4Errb9hbCgrq4O_9GjvevdybtpVriQ0XZX5uTjxLrpB4Nsq1IoxyFtuUvH_hjfYq7lAxNyM8pUJMs8QepmxBwb8QKxmGjKJxmKC_l2HIJG8oYnhWeggGKM9eswL4Yuo_ySdVjAfczB2Mdi4jEAOjKhMc6PmNU Jul 25 12:38:37.436064 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:38:37.436064 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:38:37.436064 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:38:37.436064 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:38:37.436064 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:38:37.436064 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:38:37.436064 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: e0cd33c6f3474ede83859c9c2075a0c8 Jul 25 12:38:37.436064 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1035040385 Jul 25 12:38:37.436064 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:38:37.436064 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:38:37.437432 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e0cd33c6f3474ede83859c9c2075a0c8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e0cd33c6f3474ede83859c9c2075a0c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0cd33c6f3474ede83859c9c2075a0c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0cd33c6f3474ede83859c9c2075a0c8"}]}] Jul 25 12:38:37.437432 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1035040385 Jul 25 12:38:37.437432 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: e0cd33c6f3474ede83859c9c2075a0c8 Jul 25 12:38:37.437432 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1035040385 Jul 25 12:38:37.437432 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-HypervisorAdminNegativeTestJSON-1035040385-project Jul 25 12:38:37.437432 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:38:37.437432 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:38:37.437432 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 04cadc8ac3e044e6bf322efe5088180b Jul 25 12:38:37.437432 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1035040385-project Jul 25 12:38:37.437432 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:38:37.437432 n-d-848886-15 devstack@n-api.service[125884]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 25 12:38:37.437432 n-d-848886-15 devstack@n-api.service[125884]: action_args: {} Jul 25 12:38:37.437432 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:37.438303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:37.438303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:37.438303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:37.438303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:37.438303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:37.438303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:37.438303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:37.438303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:37.438303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:37.438303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 25 12:38:37.438303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 25 12:38:37.438303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 25 12:38:37.438303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 25 12:38:37.438303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:37.438303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:37.438303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:37.438303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:37.438303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:37.438303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:37.439502 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:37.439502 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:37.439502 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:37.439502 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:37.439502 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:37.439502 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:37.439502 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:37.439502 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:37.439502 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 25 12:38:37.439502 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:37.439502 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:37.439502 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:37.439502 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:37.439502 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:37.439502 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:37.439502 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:37.439502 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:37.439502 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 25 12:38:37.439502 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:37.445997 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6d741e17-564c-4e70-b272-60a41300b285 tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:37.447162 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6d741e17-564c-4e70-b272-60a41300b285 tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.597980 Jul 25 12:38:37.447854 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 72/171] 10.222.0.49 () {58 vars in 1167 bytes} [Mon Jul 25 12:38:36 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 600 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 25 12:38:37.457392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1e0b8f6c-f4c4-4bcb-893a-048c881fc48c tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] Calling method '.version_select at 0x7efcfb091af0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:37.461102 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:37.461102 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:37.467595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6b9e985b-6e87-413d-9fe1-c26c88218173 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2cfc6122c9496992160b7c0c64dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2056d16864614f9587078e33c8ce795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:37.472418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1e0b8f6c-f4c4-4bcb-893a-048c881fc48c tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '04cadc8ac3e044e6bf322efe5088180b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cd33c6f3474ede83859c9c2075a0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:37.476636 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1e0b8f6c-f4c4-4bcb-893a-048c881fc48c tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] Request method failure captured: Jul 25 12:38:37.476636 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 25 12:38:37.476636 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:38:37.476636 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:38:37.476636 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:38:37.476636 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:38:37.476636 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:38:37.476636 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:38:37.476636 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:38:37.476636 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:37.476636 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o7KRSi06FyDTAiC2p4Errb9hbCgrq4O_9GjvevdybtpVriQ0XZX5uTjxLrpB4Nsq1IoxyFtuUvH_hjfYq7lAxNyM8pUJMs8QepmxBwb8QKxmGjKJxmKC_l2HIJG8oYnhWeggGKM9eswL4Yuo_ySdVjAfczB2Mdi4jEAOjKhMc6PmNU Jul 25 12:38:37.476636 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:38:37.476636 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:38:37.476636 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:38:37.476636 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:38:37.476636 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:38:37.476636 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:38:37.476636 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: e0cd33c6f3474ede83859c9c2075a0c8 Jul 25 12:38:37.476636 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1035040385 Jul 25 12:38:37.476636 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:38:37.476636 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:38:37.477872 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e0cd33c6f3474ede83859c9c2075a0c8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e0cd33c6f3474ede83859c9c2075a0c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0cd33c6f3474ede83859c9c2075a0c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0cd33c6f3474ede83859c9c2075a0c8"}]}] Jul 25 12:38:37.477872 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1035040385 Jul 25 12:38:37.477872 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: e0cd33c6f3474ede83859c9c2075a0c8 Jul 25 12:38:37.477872 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1035040385 Jul 25 12:38:37.477872 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-HypervisorAdminNegativeTestJSON-1035040385-project Jul 25 12:38:37.477872 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:38:37.477872 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:38:37.477872 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 04cadc8ac3e044e6bf322efe5088180b Jul 25 12:38:37.477872 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1035040385-project Jul 25 12:38:37.477872 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:38:37.477872 n-d-848886-15 devstack@n-api.service[125884]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 25 12:38:37.477872 n-d-848886-15 devstack@n-api.service[125884]: action_args: {} Jul 25 12:38:37.477872 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:37.478602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:37.478602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:37.478602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:37.478602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:37.478602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:37.478602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:37.478602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:37.478602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:37.478602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:37.478602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 25 12:38:37.478602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 25 12:38:37.478602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 25 12:38:37.478602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 25 12:38:37.478602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:37.478602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:37.478602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:37.478602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:37.478602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:37.478602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:37.479668 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:37.479668 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:37.479668 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:37.479668 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:37.479668 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:37.479668 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:37.479668 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:37.479668 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:37.479668 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 25 12:38:37.479668 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:37.479668 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:37.479668 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:37.479668 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:37.479668 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:37.479668 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:37.479668 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:37.479668 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:37.479668 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 25 12:38:37.479668 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:37.484587 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6b9e985b-6e87-413d-9fe1-c26c88218173 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 200 len: 1493 microversion: 2.1 time: 0.536786 Jul 25 12:38:37.487282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1e0b8f6c-f4c4-4bcb-893a-048c881fc48c tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:37.487726 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 100/172] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:36 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 1493 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:37.493552 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1e0b8f6c-f4c4-4bcb-893a-048c881fc48c tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.040069 Jul 25 12:38:37.498637 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 73/173] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:38:37 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 25 12:38:37.506381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-31b2f489-4c92-4801-adc8-1bb3106a0fc5 tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] Calling method '.version_select at 0x7efcfb0913a0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:37.508435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-55e52343-69c8-48ff-9f5d-8189104b6393 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:37.510383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-55e52343-69c8-48ff-9f5d-8189104b6393 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:37.519155 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:37.519155 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:37.521578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-31b2f489-4c92-4801-adc8-1bb3106a0fc5 tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '04cadc8ac3e044e6bf322efe5088180b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cd33c6f3474ede83859c9c2075a0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:37.528620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55e52343-69c8-48ff-9f5d-8189104b6393 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:37.531538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-31b2f489-4c92-4801-adc8-1bb3106a0fc5 tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] Request method failure captured: Jul 25 12:38:37.531538 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 25 12:38:37.531538 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:38:37.531538 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:38:37.531538 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:38:37.531538 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:38:37.531538 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:38:37.531538 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:38:37.531538 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:38:37.531538 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:37.531538 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o7KRSi06FyDTAiC2p4Errb9hbCgrq4O_9GjvevdybtpVriQ0XZX5uTjxLrpB4Nsq1IoxyFtuUvH_hjfYq7lAxNyM8pUJMs8QepmxBwb8QKxmGjKJxmKC_l2HIJG8oYnhWeggGKM9eswL4Yuo_ySdVjAfczB2Mdi4jEAOjKhMc6PmNU Jul 25 12:38:37.531538 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:38:37.531538 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:38:37.531538 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:38:37.531538 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:38:37.531538 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:38:37.531538 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:38:37.531538 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: e0cd33c6f3474ede83859c9c2075a0c8 Jul 25 12:38:37.531538 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1035040385 Jul 25 12:38:37.531538 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:38:37.531538 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:38:37.533770 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e0cd33c6f3474ede83859c9c2075a0c8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e0cd33c6f3474ede83859c9c2075a0c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0cd33c6f3474ede83859c9c2075a0c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0cd33c6f3474ede83859c9c2075a0c8"}]}] Jul 25 12:38:37.533770 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1035040385 Jul 25 12:38:37.533770 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: e0cd33c6f3474ede83859c9c2075a0c8 Jul 25 12:38:37.533770 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1035040385 Jul 25 12:38:37.533770 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-HypervisorAdminNegativeTestJSON-1035040385-project Jul 25 12:38:37.533770 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:38:37.533770 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:38:37.533770 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 04cadc8ac3e044e6bf322efe5088180b Jul 25 12:38:37.533770 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1035040385-project Jul 25 12:38:37.533770 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:38:37.533770 n-d-848886-15 devstack@n-api.service[125884]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 25 12:38:37.533770 n-d-848886-15 devstack@n-api.service[125884]: action_args: {} Jul 25 12:38:37.533770 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:37.534492 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:37.534492 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:37.534492 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:37.534492 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:37.534492 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:37.534492 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:37.534492 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:37.534492 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:37.534492 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:37.534492 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 25 12:38:37.534492 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 25 12:38:37.534492 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:37.534492 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:37.534492 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:37.534492 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:37.534492 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:37.534492 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:37.534492 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:37.534492 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:37.535469 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:37.535469 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:37.535469 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:37.535469 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:37.535469 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:37.535469 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:37.535469 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 25 12:38:37.535469 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:37.535469 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:37.535469 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:37.535469 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:37.535469 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:37.535469 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:37.535469 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:37.535469 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:37.535469 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 25 12:38:37.535469 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:37.537845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-31b2f489-4c92-4801-adc8-1bb3106a0fc5 tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:37.548947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55e52343-69c8-48ff-9f5d-8189104b6393 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:37.550394 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-31b2f489-4c92-4801-adc8-1bb3106a0fc5 tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.050387 Jul 25 12:38:37.555462 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55e52343-69c8-48ff-9f5d-8189104b6393 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:37.556957 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 74/174] 10.222.0.49 () {58 vars in 1179 bytes} [Mon Jul 25 12:38:37 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 58 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:37.557704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55e52343-69c8-48ff-9f5d-8189104b6393 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:38.076674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-55e52343-69c8-48ff-9f5d-8189104b6393 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:38.095944 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-55e52343-69c8-48ff-9f5d-8189104b6393 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 200 len: 1390 microversion: 2.1 time: 0.606884 Jul 25 12:38:38.101982 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 101/175] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:37 2022] GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 1390 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:38.312306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-44007a72-f70c-4233-acc8-fd536e789eae tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] Calling method '.version_select at 0x7efcfb18caf0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:38.314612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44007a72-f70c-4233-acc8-fd536e789eae tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:38.316035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44007a72-f70c-4233-acc8-fd536e789eae tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:38.364883 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44007a72-f70c-4233-acc8-fd536e789eae tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:38.370055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44007a72-f70c-4233-acc8-fd536e789eae tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:38.406129 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44007a72-f70c-4233-acc8-fd536e789eae tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:38.406837 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44007a72-f70c-4233-acc8-fd536e789eae tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:38.424100 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-44007a72-f70c-4233-acc8-fd536e789eae tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.858063 Jul 25 12:38:38.426809 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 75/176] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:38:37 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:38.446805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a81f72b8-8516-4674-b092-c086863dc1c9 tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] Calling method '.version_select at 0x7efcfa61c310>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:38.448404 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:38.448404 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:38.453166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a81f72b8-8516-4674-b092-c086863dc1c9 tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '04cadc8ac3e044e6bf322efe5088180b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cd33c6f3474ede83859c9c2075a0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:38.468732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a81f72b8-8516-4674-b092-c086863dc1c9 tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] Request method failure captured: Jul 25 12:38:38.468732 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 25 12:38:38.468732 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:38.468732 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:38.468732 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:38.468732 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:38.468732 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:38.468732 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:38.468732 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:38.468732 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:38.468732 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7KRSi06FyDTAiC2p4Errb9hbCgrq4O_9GjvevdybtpVriQ0XZX5uTjxLrpB4Nsq1IoxyFtuUvH_hjfYq7lAxNyM8pUJMs8QepmxBwb8QKxmGjKJxmKC_l2HIJG8oYnhWeggGKM9eswL4Yuo_ySdVjAfczB2Mdi4jEAOjKhMc6PmNU Jul 25 12:38:38.468732 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:38.468732 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:38.468732 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:38.468732 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:38.468732 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:38.468732 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:38.468732 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: e0cd33c6f3474ede83859c9c2075a0c8 Jul 25 12:38:38.468732 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1035040385 Jul 25 12:38:38.468732 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:38:38.468732 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:38:38.470225 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e0cd33c6f3474ede83859c9c2075a0c8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e0cd33c6f3474ede83859c9c2075a0c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0cd33c6f3474ede83859c9c2075a0c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0cd33c6f3474ede83859c9c2075a0c8"}]}] Jul 25 12:38:38.470225 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1035040385 Jul 25 12:38:38.470225 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: e0cd33c6f3474ede83859c9c2075a0c8 Jul 25 12:38:38.470225 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1035040385 Jul 25 12:38:38.470225 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-HypervisorAdminNegativeTestJSON-1035040385-project Jul 25 12:38:38.470225 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:38.470225 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:38.470225 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 04cadc8ac3e044e6bf322efe5088180b Jul 25 12:38:38.470225 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1035040385-project Jul 25 12:38:38.470225 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:38:38.470225 n-d-848886-15 devstack@n-api.service[125883]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 25 12:38:38.470225 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '1'} Jul 25 12:38:38.470225 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:38.471090 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:38.471090 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:38.471090 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:38.471090 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:38.471090 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:38.471090 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:38.471090 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:38.471090 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:38.471090 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:38.471090 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 25 12:38:38.471090 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 25 12:38:38.471090 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:38.471090 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:38.471090 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:38.471090 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:38.471090 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:38.471090 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:38.471090 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:38.471090 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:38.472344 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:38.472344 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:38.472344 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:38.472344 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:38.472344 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:38.472344 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:38.472344 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 25 12:38:38.472344 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:38.472344 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:38.472344 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:38.472344 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:38.472344 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:38.472344 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:38.472344 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:38.472344 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:38.472344 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 25 12:38:38.472344 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:38.476342 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a81f72b8-8516-4674-b092-c086863dc1c9 tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:38.477686 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a81f72b8-8516-4674-b092-c086863dc1c9 tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.043708 Jul 25 12:38:38.478883 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 102/177] 10.222.0.49 () {58 vars in 1173 bytes} [Mon Jul 25 12:38:38 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:38.491483 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-54009d9f-4974-4925-a5be-9fc6ea69285e tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] Calling method '.version_select at 0x7efcfb18c1f0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:38.491483 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:38.491483 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:38.500252 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-54009d9f-4974-4925-a5be-9fc6ea69285e tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] HTTP exception thrown: Hypervisor with ID '6165fa71-e204-4b95-9442-f6d7f381fdd0' could not be found. Jul 25 12:38:38.521472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-54009d9f-4974-4925-a5be-9fc6ea69285e tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] Request method failure captured: Jul 25 12:38:38.521472 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/os-hypervisors/6165fa71-e204-4b95-9442-f6d7f381fdd0/uptime HTTP/1.1 Jul 25 12:38:38.521472 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:38:38.521472 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:38:38.521472 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:38:38.521472 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:38:38.521472 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:38:38.521472 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:38:38.521472 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:38:38.521472 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:38.521472 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o7MeNWPyR9cSHJFxcaa84hhmHklhtFpB4vl9f592XXsKatN2KqKSLpURP2Ao7L-04SzhLflO9FlFssYneRS-FOcItxf3AMxGFQeSDE0yNcCmU0HVWOf4uuYiDdHda58O69NjSNFNKLweB1vU-vLoldjtoE4j6pr3uO7oCD2oyS99P0 Jul 25 12:38:38.521472 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:38:38.521472 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:38:38.521472 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:38:38.521472 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:38:38.521472 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:38:38.521472 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:38:38.521472 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 150d71eaa4ab4aa384d0c8d78c828500 Jul 25 12:38:38.521472 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-804393251 Jul 25 12:38:38.521472 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,admin,member Jul 25 12:38:38.521472 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,admin,member Jul 25 12:38:38.522796 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_150d71eaa4ab4aa384d0c8d78c828500", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/150d71eaa4ab4aa384d0c8d78c828500"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/150d71eaa4ab4aa384d0c8d78c828500"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/150d71eaa4ab4aa384d0c8d78c828500"}]}] Jul 25 12:38:38.522796 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-804393251 Jul 25 12:38:38.522796 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 150d71eaa4ab4aa384d0c8d78c828500 Jul 25 12:38:38.522796 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-804393251 Jul 25 12:38:38.522796 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin Jul 25 12:38:38.522796 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:38:38.522796 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:38:38.522796 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: cdb9d952d3d941388a51c87b268b09b2 Jul 25 12:38:38.522796 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin Jul 25 12:38:38.522796 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:38:38.522796 n-d-848886-15 devstack@n-api.service[125884]: exception: Hypervisor with ID '6165fa71-e204-4b95-9442-f6d7f381fdd0' could not be found. Jul 25 12:38:38.522796 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '6165fa71-e204-4b95-9442-f6d7f381fdd0'} Jul 25 12:38:38.523448 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:38.523448 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:38.523448 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 25 12:38:38.523448 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 25 12:38:38.523448 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '6165fa71-e204-4b95-9442-f6d7f381fdd0' Jul 25 12:38:38.523448 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:38.523448 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:38.523448 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:38.523448 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:38.523448 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 25 12:38:38.523448 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 25 12:38:38.523448 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 25 12:38:38.523448 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 25 12:38:38.523448 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 25 12:38:38.523448 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:38.523448 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:38.523448 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:38.523448 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:38.523448 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 25 12:38:38.523448 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 25 12:38:38.523448 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 25 12:38:38.523448 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 25 12:38:38.524572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 25 12:38:38.524572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:38.524572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:38.524572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:38.524572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:38.524572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:38.524572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:38.524572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:38.524572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:38.524572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:38.524572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:38.524572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:38.524572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:38.524572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 25 12:38:38.524572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 25 12:38:38.524572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 25 12:38:38.524572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 12:38:38.524572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '6165fa71-e204-4b95-9442-f6d7f381fdd0' could not be found. Jul 25 12:38:38.524572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:38.524572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:38.524572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:38.527733 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:38.527733 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:38.527733 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:38.527733 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:38.527733 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:38.527733 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '6165fa71-e204-4b95-9442-f6d7f381fdd0' could not be found. Jul 25 12:38:38.527733 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:38.532606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-54009d9f-4974-4925-a5be-9fc6ea69285e tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] Returning 404 to user: Hypervisor with ID '6165fa71-e204-4b95-9442-f6d7f381fdd0' could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:38.533575 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-54009d9f-4974-4925-a5be-9fc6ea69285e tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/6165fa71-e204-4b95-9442-f6d7f381fdd0/uptime" status: 404 len: 123 microversion: 2.1 time: 0.046067 Jul 25 12:38:38.534813 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 76/178] 10.222.0.49 () {58 vars in 1278 bytes} [Mon Jul 25 12:38:38 2022] GET /compute/v2.1/os-hypervisors/6165fa71-e204-4b95-9442-f6d7f381fdd0/uptime => generated 123 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:38.543238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c35299d7-69ed-4051-8f0c-2b08b8a67ab7 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:38.546487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c35299d7-69ed-4051-8f0c-2b08b8a67ab7 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:38.570404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c35299d7-69ed-4051-8f0c-2b08b8a67ab7 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:38.571113 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c35299d7-69ed-4051-8f0c-2b08b8a67ab7 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:38.573586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c35299d7-69ed-4051-8f0c-2b08b8a67ab7 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:38.575969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c35299d7-69ed-4051-8f0c-2b08b8a67ab7 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:38.664634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-af022e19-78e2-4ffe-8317-a11461206845 tempest-InstanceUsageAuditLogNegativeTestJSON-1701824275 tempest-InstanceUsageAuditLogNegativeTestJSON-1701824275-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:38.665495 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:38.665495 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:38.668840 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-af022e19-78e2-4ffe-8317-a11461206845 tempest-InstanceUsageAuditLogNegativeTestJSON-1701824275 tempest-InstanceUsageAuditLogNegativeTestJSON-1701824275-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 25 12:38:38.681990 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-af022e19-78e2-4ffe-8317-a11461206845 tempest-InstanceUsageAuditLogNegativeTestJSON-1701824275 tempest-InstanceUsageAuditLogNegativeTestJSON-1701824275-project-admin] Request method failure captured: Jul 25 12:38:38.681990 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 25 12:38:38.681990 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:38.681990 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:38.681990 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:38.681990 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:38.681990 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:38.681990 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:38.681990 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:38.681990 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:38.681990 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7OxbztauPSELCkdNguBmF1Nwcpit98AMH_kMjh224BdH1KWDN2VVcMrvlocZRO80X32KngonmslXmdLSyMoysvYtlr8UG7V2OTfhrc0ppn9Mt3ney1jDVdXvtfzSbFqn5N1mPAKwLKaDE32bM2ZTF5wuvYF_ZosPuVjxUjB3QtuDQ Jul 25 12:38:38.681990 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:38.681990 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:38.681990 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:38.681990 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:38.681990 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:38.681990 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:38.681990 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: c32555a146224dee944c4b6474ab98ca Jul 25 12:38:38.681990 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1701824275 Jul 25 12:38:38.681990 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:38:38.681990 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:38:38.683467 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c32555a146224dee944c4b6474ab98ca", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c32555a146224dee944c4b6474ab98ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c32555a146224dee944c4b6474ab98ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c32555a146224dee944c4b6474ab98ca"}]}] Jul 25 12:38:38.683467 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1701824275 Jul 25 12:38:38.683467 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: c32555a146224dee944c4b6474ab98ca Jul 25 12:38:38.683467 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1701824275 Jul 25 12:38:38.683467 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1701824275-project-admin Jul 25 12:38:38.683467 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:38.683467 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:38.683467 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 04ede0954aeb4f82abd8e4bf763fbb60 Jul 25 12:38:38.683467 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1701824275-project-admin Jul 25 12:38:38.683467 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:38:38.683467 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid timestamp for date invalid_time Jul 25 12:38:38.684198 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'invalid_time'} Jul 25 12:38:38.684198 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:38.684198 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:38.684198 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 25 12:38:38.684198 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 25 12:38:38.684198 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 25 12:38:38.684198 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 25 12:38:38.684198 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 25 12:38:38.684198 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 25 12:38:38.684198 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 25 12:38:38.684198 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:38.684198 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:38.684198 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:38.684198 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:38.684198 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:38.684198 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:38.684198 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:38.684198 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:38.684198 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:38.684198 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:38.685512 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 25 12:38:38.685512 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 25 12:38:38.685512 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 25 12:38:38.685512 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:38.685512 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:38.685512 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:38.685512 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:38.685512 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:38.685512 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:38.685512 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:38.685512 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:38.685512 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 25 12:38:38.685512 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:38.685512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-af022e19-78e2-4ffe-8317-a11461206845 tempest-InstanceUsageAuditLogNegativeTestJSON-1701824275 tempest-InstanceUsageAuditLogNegativeTestJSON-1701824275-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:38.685512 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-af022e19-78e2-4ffe-8317-a11461206845 tempest-InstanceUsageAuditLogNegativeTestJSON-1701824275 tempest-InstanceUsageAuditLogNegativeTestJSON-1701824275-project-admin] 10.222.0.49 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.190561 Jul 25 12:38:38.689691 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 103/179] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Jul 25 12:38:38 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 197 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:38:38.700137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-33fb7b9e-1bdc-44ba-86b3-9970c7351b38 tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] Calling method '.version_select at 0x7efcfa71db80>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:38.700970 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:38.700970 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:38.702252 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-33fb7b9e-1bdc-44ba-86b3-9970c7351b38 tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:38.702699 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-33fb7b9e-1bdc-44ba-86b3-9970c7351b38 tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:38.754977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-33fb7b9e-1bdc-44ba-86b3-9970c7351b38 tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:38.757265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-33fb7b9e-1bdc-44ba-86b3-9970c7351b38 tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:38.782932 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-33fb7b9e-1bdc-44ba-86b3-9970c7351b38 tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:38.783392 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-33fb7b9e-1bdc-44ba-86b3-9970c7351b38 tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:38.800902 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-33fb7b9e-1bdc-44ba-86b3-9970c7351b38 tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.109911 Jul 25 12:38:38.801554 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 104/180] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:38:38 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:39.056199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ce13e15f-fd6e-449d-9226-ef4ef0ce27ff tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690 tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:39.057062 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:39.057062 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:39.060095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ce13e15f-fd6e-449d-9226-ef4ef0ce27ff tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690 tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '6bad466b59a84a6e99d1efe9af2235b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09ad1086ec040cd876f517496b8ef25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:39.062112 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ce13e15f-fd6e-449d-9226-ef4ef0ce27ff tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690 tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690-project] Request method failure captured: Jul 25 12:38:39.062112 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 25 12:38:39.062112 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:39.062112 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:39.062112 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:39.062112 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:39.062112 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:39.062112 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:39.062112 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:39.062112 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:39.062112 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7LnBZmUXxbZX7BjB-hHFT99n4_IAtakcjDepx2HfXxmbK7cNexZ89t8aqKjXNHJwekWLFznJ-TTjnwnzK7y4v4S4MkUywSMnqp3VWGQjCH_3SPymOpy5r2pX96RJ8iWlh9Dv_1qaDug6O2NS2Q3XDR5Ztz_vfcH3mjrrmgtq0EkD0 Jul 25 12:38:39.062112 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:39.062112 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:39.062112 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:39.062112 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:39.062112 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:39.062112 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:39.062112 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: f09ad1086ec040cd876f517496b8ef25 Jul 25 12:38:39.062112 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690 Jul 25 12:38:39.062112 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:38:39.062112 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:38:39.063553 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f09ad1086ec040cd876f517496b8ef25", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f09ad1086ec040cd876f517496b8ef25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f09ad1086ec040cd876f517496b8ef25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f09ad1086ec040cd876f517496b8ef25"}]}] Jul 25 12:38:39.063553 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690 Jul 25 12:38:39.063553 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: f09ad1086ec040cd876f517496b8ef25 Jul 25 12:38:39.063553 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690 Jul 25 12:38:39.063553 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690-project Jul 25 12:38:39.063553 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:39.063553 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:39.063553 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 6bad466b59a84a6e99d1efe9af2235b2 Jul 25 12:38:39.063553 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690-project Jul 25 12:38:39.063553 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:38:39.063553 n-d-848886-15 devstack@n-api.service[125883]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 25 12:38:39.064289 n-d-848886-15 devstack@n-api.service[125883]: action_args: {} Jul 25 12:38:39.064289 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:39.064289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:39.064289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:39.064289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:39.064289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:39.064289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:39.064289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:39.064289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:39.064289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 25 12:38:39.064289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 25 12:38:39.064289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:39.064289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:39.064289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:39.064289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:39.064289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:39.064289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:39.064289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:39.064289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:39.064289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:39.065544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:39.065544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:39.065544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:39.065544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:39.065544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:39.065544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 25 12:38:39.065544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:39.065544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:39.065544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:39.065544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:39.065544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:39.065544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:39.065544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:39.065544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:39.065544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 25 12:38:39.065544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:39.067759 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ce13e15f-fd6e-449d-9226-ef4ef0ce27ff tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690 tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:39.071290 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ce13e15f-fd6e-449d-9226-ef4ef0ce27ff tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690 tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690-project] 10.222.0.49 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.260922 Jul 25 12:38:39.081096 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 105/181] 10.222.0.49 () {58 vars in 1185 bytes} [Mon Jul 25 12:38:38 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 274 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:39.087457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a593a116-6227-4aea-9e8c-88a74961327f tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] Calling method '.version_select at 0x7efcfa692d30>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:39.089196 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:39.089196 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:39.090966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a593a116-6227-4aea-9e8c-88a74961327f tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '04cadc8ac3e044e6bf322efe5088180b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cd33c6f3474ede83859c9c2075a0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:39.096194 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a593a116-6227-4aea-9e8c-88a74961327f tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] Request method failure captured: Jul 25 12:38:39.096194 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 25 12:38:39.096194 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:39.096194 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:39.096194 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:39.096194 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:39.096194 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:39.096194 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:39.096194 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:39.096194 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:39.096194 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7KRSi06FyDTAiC2p4Errb9hbCgrq4O_9GjvevdybtpVriQ0XZX5uTjxLrpB4Nsq1IoxyFtuUvH_hjfYq7lAxNyM8pUJMs8QepmxBwb8QKxmGjKJxmKC_l2HIJG8oYnhWeggGKM9eswL4Yuo_ySdVjAfczB2Mdi4jEAOjKhMc6PmNU Jul 25 12:38:39.096194 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:39.096194 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:39.096194 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:39.096194 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:39.096194 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:39.096194 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:39.096194 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: e0cd33c6f3474ede83859c9c2075a0c8 Jul 25 12:38:39.096194 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1035040385 Jul 25 12:38:39.096194 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:38:39.096194 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:38:39.097747 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e0cd33c6f3474ede83859c9c2075a0c8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e0cd33c6f3474ede83859c9c2075a0c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0cd33c6f3474ede83859c9c2075a0c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0cd33c6f3474ede83859c9c2075a0c8"}]}] Jul 25 12:38:39.097747 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1035040385 Jul 25 12:38:39.097747 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: e0cd33c6f3474ede83859c9c2075a0c8 Jul 25 12:38:39.097747 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1035040385 Jul 25 12:38:39.097747 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-HypervisorAdminNegativeTestJSON-1035040385-project Jul 25 12:38:39.097747 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:39.097747 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:39.097747 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 04cadc8ac3e044e6bf322efe5088180b Jul 25 12:38:39.097747 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1035040385-project Jul 25 12:38:39.097747 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:38:39.097747 n-d-848886-15 devstack@n-api.service[125883]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 25 12:38:39.097747 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '1'} Jul 25 12:38:39.097747 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:39.098872 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:39.098872 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:39.098872 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:39.098872 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:39.098872 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:39.098872 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:39.098872 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:39.098872 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:39.098872 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:39.098872 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 25 12:38:39.098872 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 25 12:38:39.098872 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 25 12:38:39.098872 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 25 12:38:39.098872 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:39.098872 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:39.098872 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:39.098872 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:39.098872 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:39.098872 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:39.100292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:39.100292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:39.100292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:39.100292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:39.100292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:39.100292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:39.100292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:39.100292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:39.100292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 25 12:38:39.100292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:39.100292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:39.100292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:39.100292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:39.100292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:39.100292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:39.100292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:39.100292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:39.100292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 25 12:38:39.100292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:39.103171 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a593a116-6227-4aea-9e8c-88a74961327f tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:39.104274 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a593a116-6227-4aea-9e8c-88a74961327f tempest-HypervisorAdminNegativeTestJSON-1035040385 tempest-HypervisorAdminNegativeTestJSON-1035040385-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.021131 Jul 25 12:38:39.104997 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 106/182] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:38:39 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:39.116165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e5b52f31-dca8-4b79-a4f6-9f36a0ca04c1 tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690 tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:39.117309 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:39.117309 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:39.118686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e5b52f31-dca8-4b79-a4f6-9f36a0ca04c1 tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690 tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '6bad466b59a84a6e99d1efe9af2235b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09ad1086ec040cd876f517496b8ef25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:39.120929 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e5b52f31-dca8-4b79-a4f6-9f36a0ca04c1 tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690 tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690-project] Request method failure captured: Jul 25 12:38:39.120929 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-25%2012:38:39 HTTP/1.1 Jul 25 12:38:39.120929 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:39.120929 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:39.120929 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:39.120929 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:39.120929 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:39.120929 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:39.120929 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:39.120929 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:39.120929 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7LnBZmUXxbZX7BjB-hHFT99n4_IAtakcjDepx2HfXxmbK7cNexZ89t8aqKjXNHJwekWLFznJ-TTjnwnzK7y4v4S4MkUywSMnqp3VWGQjCH_3SPymOpy5r2pX96RJ8iWlh9Dv_1qaDug6O2NS2Q3XDR5Ztz_vfcH3mjrrmgtq0EkD0 Jul 25 12:38:39.120929 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:39.120929 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:39.120929 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:39.120929 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:39.120929 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:39.120929 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:39.120929 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: f09ad1086ec040cd876f517496b8ef25 Jul 25 12:38:39.120929 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690 Jul 25 12:38:39.120929 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:38:39.120929 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:38:39.122272 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f09ad1086ec040cd876f517496b8ef25", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f09ad1086ec040cd876f517496b8ef25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f09ad1086ec040cd876f517496b8ef25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f09ad1086ec040cd876f517496b8ef25"}]}] Jul 25 12:38:39.122272 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690 Jul 25 12:38:39.122272 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: f09ad1086ec040cd876f517496b8ef25 Jul 25 12:38:39.122272 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690 Jul 25 12:38:39.122272 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690-project Jul 25 12:38:39.122272 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:39.122272 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:39.122272 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 6bad466b59a84a6e99d1efe9af2235b2 Jul 25 12:38:39.122272 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690-project Jul 25 12:38:39.122272 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:38:39.122272 n-d-848886-15 devstack@n-api.service[125883]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 25 12:38:39.123165 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '2022-07-25 12:38:39'} Jul 25 12:38:39.123165 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:39.123165 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:39.123165 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:39.123165 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:39.123165 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:39.123165 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:39.123165 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:39.123165 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:39.123165 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 25 12:38:39.123165 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 25 12:38:39.123165 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:39.123165 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:39.123165 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:39.123165 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:39.123165 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:39.123165 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:39.123165 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:39.123165 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:39.123165 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:39.124544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:39.124544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:39.124544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:39.124544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:39.124544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:39.124544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 25 12:38:39.124544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:39.124544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:39.124544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:39.124544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:39.124544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:39.124544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:39.124544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:39.124544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:39.124544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 25 12:38:39.124544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:39.127855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e5b52f31-dca8-4b79-a4f6-9f36a0ca04c1 tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690 tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:39.130761 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e5b52f31-dca8-4b79-a4f6-9f36a0ca04c1 tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690 tempest-InstanceUsageAuditLogNegativeTestJSON-1845126690-project] 10.222.0.49 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-25 12:38:39" status: 403 len: 128 microversion: 2.1 time: 0.020105 Jul 25 12:38:39.134899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c35299d7-69ed-4051-8f0c-2b08b8a67ab7 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2cfc6122c9496992160b7c0c64dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2056d16864614f9587078e33c8ce795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:39.142522 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 107/183] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Jul 25 12:38:39 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-25%2012%3A38%3A39 => generated 128 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:39.144061 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c35299d7-69ed-4051-8f0c-2b08b8a67ab7 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 200 len: 1493 microversion: 2.1 time: 0.607946 Jul 25 12:38:39.149703 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 77/184] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:38 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 1493 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:39.162301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f6da4730-b880-434a-9f0f-3808bec4d579 tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] Calling method '.version_select at 0x7efcfa61c5e0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:39.166589 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-f6da4730-b880-434a-9f0f-3808bec4d579 tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] HTTP exception thrown: Hypervisor with ID 'bfa2ed58-8df9-4cad-bcd5-325cba6f4694' could not be found. Jul 25 12:38:39.168010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5bc8ea9f-4883-4300-b579-88c845503293 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:39.168860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5bc8ea9f-4883-4300-b579-88c845503293 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:39.181300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f6da4730-b880-434a-9f0f-3808bec4d579 tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] Request method failure captured: Jul 25 12:38:39.181300 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-hypervisors/bfa2ed58-8df9-4cad-bcd5-325cba6f4694 HTTP/1.1 Jul 25 12:38:39.181300 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:39.181300 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:39.181300 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:39.181300 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:39.181300 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:39.181300 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:39.181300 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:39.181300 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:39.181300 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7MeNWPyR9cSHJFxcaa84hhmHklhtFpB4vl9f592XXsKatN2KqKSLpURP2Ao7L-04SzhLflO9FlFssYneRS-FOcItxf3AMxGFQeSDE0yNcCmU0HVWOf4uuYiDdHda58O69NjSNFNKLweB1vU-vLoldjtoE4j6pr3uO7oCD2oyS99P0 Jul 25 12:38:39.181300 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:39.181300 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:39.181300 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:39.181300 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:39.181300 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:39.181300 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:39.181300 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 150d71eaa4ab4aa384d0c8d78c828500 Jul 25 12:38:39.181300 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-804393251 Jul 25 12:38:39.181300 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:38:39.181300 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:38:39.182514 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_150d71eaa4ab4aa384d0c8d78c828500", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/150d71eaa4ab4aa384d0c8d78c828500"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/150d71eaa4ab4aa384d0c8d78c828500"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/150d71eaa4ab4aa384d0c8d78c828500"}]}] Jul 25 12:38:39.182514 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-804393251 Jul 25 12:38:39.182514 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 150d71eaa4ab4aa384d0c8d78c828500 Jul 25 12:38:39.182514 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-804393251 Jul 25 12:38:39.182514 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin Jul 25 12:38:39.182514 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:39.182514 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:39.182514 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: cdb9d952d3d941388a51c87b268b09b2 Jul 25 12:38:39.182514 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin Jul 25 12:38:39.182514 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:38:39.182514 n-d-848886-15 devstack@n-api.service[125883]: exception: Hypervisor with ID 'bfa2ed58-8df9-4cad-bcd5-325cba6f4694' could not be found. Jul 25 12:38:39.182514 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'bfa2ed58-8df9-4cad-bcd5-325cba6f4694'} Jul 25 12:38:39.183156 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:39.183156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:39.183156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 25 12:38:39.183156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 25 12:38:39.183156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'bfa2ed58-8df9-4cad-bcd5-325cba6f4694' Jul 25 12:38:39.183156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:39.183156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:39.183156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:39.183156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:39.183156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 25 12:38:39.183156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 25 12:38:39.183156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 25 12:38:39.183156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 25 12:38:39.183156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 25 12:38:39.183156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:39.183156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:39.183156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:39.183156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:39.183156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 25 12:38:39.183156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 25 12:38:39.183156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 25 12:38:39.183156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 25 12:38:39.184271 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 25 12:38:39.184271 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:39.184271 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:39.184271 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:39.184271 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:39.184271 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:39.184271 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:39.184271 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:39.184271 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:39.184271 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:38:39.184271 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:38:39.184271 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:39.184271 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:39.184271 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 25 12:38:39.184271 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 25 12:38:39.184271 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 25 12:38:39.184271 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 25 12:38:39.184271 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 25 12:38:39.184271 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 12:38:39.184271 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'bfa2ed58-8df9-4cad-bcd5-325cba6f4694' could not be found. Jul 25 12:38:39.185421 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:39.185421 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:39.185421 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:39.185421 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:39.185421 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:39.185421 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:39.185421 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:39.185421 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:39.185421 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'bfa2ed58-8df9-4cad-bcd5-325cba6f4694' could not be found. Jul 25 12:38:39.185421 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:39.187443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f6da4730-b880-434a-9f0f-3808bec4d579 tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] Returning 404 to user: Hypervisor with ID 'bfa2ed58-8df9-4cad-bcd5-325cba6f4694' could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:39.190213 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f6da4730-b880-434a-9f0f-3808bec4d579 tempest-HypervisorAdminNegativeTestJSON-804393251 tempest-HypervisorAdminNegativeTestJSON-804393251-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/bfa2ed58-8df9-4cad-bcd5-325cba6f4694" status: 404 len: 123 microversion: 2.1 time: 0.044784 Jul 25 12:38:39.191201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5bc8ea9f-4883-4300-b579-88c845503293 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:39.191728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5bc8ea9f-4883-4300-b579-88c845503293 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:39.194495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5bc8ea9f-4883-4300-b579-88c845503293 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:39.195220 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5bc8ea9f-4883-4300-b579-88c845503293 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:39.197295 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 108/185] 10.222.0.49 () {58 vars in 1257 bytes} [Mon Jul 25 12:38:39 2022] GET /compute/v2.1/os-hypervisors/bfa2ed58-8df9-4cad-bcd5-325cba6f4694 => generated 123 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:39.679074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5bc8ea9f-4883-4300-b579-88c845503293 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:39.695828 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5bc8ea9f-4883-4300-b579-88c845503293 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 200 len: 1390 microversion: 2.1 time: 0.543586 Jul 25 12:38:39.701749 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 78/186] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:39 2022] GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 1390 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:40.641082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-59cfafec-c798-450d-9d9b-fcf27f4ec13a tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:40.643413 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-59cfafec-c798-450d-9d9b-fcf27f4ec13a tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:40.666515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59cfafec-c798-450d-9d9b-fcf27f4ec13a tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:40.668137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59cfafec-c798-450d-9d9b-fcf27f4ec13a tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:40.671256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59cfafec-c798-450d-9d9b-fcf27f4ec13a tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:40.673667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59cfafec-c798-450d-9d9b-fcf27f4ec13a tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:40.724111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e3ffedbe-13f4-4858-9deb-5285f0ac39ae tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:40.735363 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e3ffedbe-13f4-4858-9deb-5285f0ac39ae tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:40.755703 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e3ffedbe-13f4-4858-9deb-5285f0ac39ae tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:40.760046 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e3ffedbe-13f4-4858-9deb-5285f0ac39ae tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:40.761467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e3ffedbe-13f4-4858-9deb-5285f0ac39ae tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:40.763933 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e3ffedbe-13f4-4858-9deb-5285f0ac39ae tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:41.857755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-59cfafec-c798-450d-9d9b-fcf27f4ec13a tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2cfc6122c9496992160b7c0c64dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2056d16864614f9587078e33c8ce795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:41.867015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e3ffedbe-13f4-4858-9deb-5285f0ac39ae tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:41.870588 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-59cfafec-c798-450d-9d9b-fcf27f4ec13a tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 200 len: 1493 microversion: 2.1 time: 1.699540 Jul 25 12:38:41.887766 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 109/187] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:40 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 1493 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:41.890901 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e3ffedbe-13f4-4858-9deb-5285f0ac39ae tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 200 len: 1390 microversion: 2.1 time: 1.172926 Jul 25 12:38:41.894496 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 79/188] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:40 2022] GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 1390 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:41.898158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-e842cafa-eef1-4894-848d-753139f946bd req-f06b129b-c293-4dbc-a5e5-775891c6b6bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b37efd8-e1e0-4c52-8e97-9ddae0c05a70", "name": "network-vif-deleted", "tag": "50ed9c56-94a0-4acb-bf2d-60d1b5554567"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:41.930322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e842cafa-eef1-4894-848d-753139f946bd req-f06b129b-c293-4dbc-a5e5-775891c6b6bf service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:41.930974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e842cafa-eef1-4894-848d-753139f946bd req-f06b129b-c293-4dbc-a5e5-775891c6b6bf service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:41.973443 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-e842cafa-eef1-4894-848d-753139f946bd req-f06b129b-c293-4dbc-a5e5-775891c6b6bf service nova] Creating event network-vif-deleted:50ed9c56-94a0-4acb-bf2d-60d1b5554567 for instance 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 on n-h2-848886-15 Jul 25 12:38:41.991851 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-e842cafa-eef1-4894-848d-753139f946bd req-f06b129b-c293-4dbc-a5e5-775891c6b6bf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102325 Jul 25 12:38:41.993178 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 110/189] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:42.894228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8342714e-0b3c-4576-baf2-34ea55f80c56 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:42.897014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8342714e-0b3c-4576-baf2-34ea55f80c56 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:42.912553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8342714e-0b3c-4576-baf2-34ea55f80c56 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:42.913311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8342714e-0b3c-4576-baf2-34ea55f80c56 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:42.916551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2e9ce6f0-0c98-4021-8de3-5946bdd6147c tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:42.917176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8342714e-0b3c-4576-baf2-34ea55f80c56 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:42.917322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2e9ce6f0-0c98-4021-8de3-5946bdd6147c tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:42.918294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8342714e-0b3c-4576-baf2-34ea55f80c56 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:42.932866 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e9ce6f0-0c98-4021-8de3-5946bdd6147c tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:42.935665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e9ce6f0-0c98-4021-8de3-5946bdd6147c tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:42.937259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e9ce6f0-0c98-4021-8de3-5946bdd6147c tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:42.941479 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e9ce6f0-0c98-4021-8de3-5946bdd6147c tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:42.957242 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-8342714e-0b3c-4576-baf2-34ea55f80c56 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] HTTP exception thrown: Instance 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 could not be found. Jul 25 12:38:42.962745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8342714e-0b3c-4576-baf2-34ea55f80c56 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Request method failure captured: Jul 25 12:38:42.962745 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 HTTP/1.1 Jul 25 12:38:42.962745 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:38:42.962745 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:38:42.962745 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:38:42.962745 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:38:42.962745 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:38:42.962745 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:38:42.962745 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:38:42.962745 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:42.962745 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o6g2g76HlDaz2HU2FhmXoKpsY7NLPsWg6wr-ck5TRj_Agvl5CVdBxXbf6uhhbFog8lMNtrhK1QZeaZCuGNTJ0Jz6vN6MDVLhzMgWF6l2FhBJjjrlC4tnbJMId1MoKsQrucnvwxJmJbEUzyabjBkhQDDpS00ycEnkymxY4RlJIIPIdw Jul 25 12:38:42.962745 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:38:42.962745 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:38:42.962745 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:38:42.962745 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:38:42.962745 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:38:42.962745 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:38:42.962745 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 2056d16864614f9587078e33c8ce795b Jul 25 12:38:42.962745 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-AggregatesAdminTestJSON-100420954 Jul 25 12:38:42.962745 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:38:42.962745 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:38:42.964610 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2056d16864614f9587078e33c8ce795b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2056d16864614f9587078e33c8ce795b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2056d16864614f9587078e33c8ce795b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2056d16864614f9587078e33c8ce795b"}]}] Jul 25 12:38:42.964610 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-AggregatesAdminTestJSON-100420954 Jul 25 12:38:42.964610 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 2056d16864614f9587078e33c8ce795b Jul 25 12:38:42.964610 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-100420954 Jul 25 12:38:42.964610 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-AggregatesAdminTestJSON-100420954-project Jul 25 12:38:42.964610 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:38:42.964610 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:38:42.964610 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 3b2cfc6122c9496992160b7c0c64dab3 Jul 25 12:38:42.964610 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-AggregatesAdminTestJSON-100420954-project Jul 25 12:38:42.964610 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:38:42.964610 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 could not be found. Jul 25 12:38:42.964610 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '2b37efd8-e1e0-4c52-8e97-9ddae0c05a70'} Jul 25 12:38:42.965319 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:42.965319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:42.965319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:38:42.965319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:38:42.965319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:38:42.965319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:38:42.965319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:38:42.965319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:38:42.965319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:38:42.965319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:38:42.965319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 could not be found. Jul 25 12:38:42.965319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:42.965319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:42.965319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:42.965319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:42.965319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:42.965319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:42.965319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:42.965319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:42.965319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:42.966511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:42.966511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:38:42.966511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:38:42.966511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:38:42.966511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:38:42.966511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:38:42.966511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:38:42.966511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 could not be found. Jul 25 12:38:42.966511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:42.966511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:42.966511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:42.966511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:42.966511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:42.966511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:42.966511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:42.966511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:42.966511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 could not be found. Jul 25 12:38:42.966511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:42.969442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8342714e-0b3c-4576-baf2-34ea55f80c56 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Returning 404 to user: Instance 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:42.971134 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8342714e-0b3c-4576-baf2-34ea55f80c56 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 404 len: 111 microversion: 2.1 time: 0.081852 Jul 25 12:38:42.972496 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 80/190] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:42 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:42.983887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1baff49b-b4c8-429f-8296-b0b47aece7b5 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-848886-15"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:42.992747 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:42.992747 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:43.010531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:38:43.059701 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1baff49b-b4c8-429f-8296-b0b47aece7b5 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:43.060246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1baff49b-b4c8-429f-8296-b0b47aece7b5 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:43.444565 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2e9ce6f0-0c98-4021-8de3-5946bdd6147c tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:43.460873 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2e9ce6f0-0c98-4021-8de3-5946bdd6147c tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 200 len: 1390 microversion: 2.1 time: 0.548604 Jul 25 12:38:43.464403 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 111/191] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:42 2022] GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 1390 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:38:44.113734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b640d955-e2d3-476d-be18-4fbf7c9c7094 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-976590128", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "6ff0fb68-b414-4b82-96bf-e15dd2a7af95"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:44.273053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-b640d955-e2d3-476d-be18-4fbf7c9c7094 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] validate_networks() for [('6ff0fb68-b414-4b82-96bf-e15dd2a7af95', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:38:44.369094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=88,nova_api:SAVEPOINT=2,nova_api:INSERT=6,nova_api:RELEASE=2,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:38:44.421370 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1baff49b-b4c8-429f-8296-b0b47aece7b5 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 1.441194 Jul 25 12:38:44.429755 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 81/192] 10.222.0.49 () {60 vars in 1191 bytes} [Mon Jul 25 12:38:42 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:44.435562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-625beff6-a6be-471c-8970-c50e63f633e3 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:44.436660 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:44.436660 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:44.478771 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-625beff6-a6be-471c-8970-c50e63f633e3 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.047319 Jul 25 12:38:44.484322 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 82/193] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:38:44 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 12:38:44.491867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-21abdf6e-b7df-45b2-aad9-2ac62e4424fd tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:44.493736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-21abdf6e-b7df-45b2-aad9-2ac62e4424fd tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:44.504001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-21abdf6e-b7df-45b2-aad9-2ac62e4424fd tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:44.504928 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-21abdf6e-b7df-45b2-aad9-2ac62e4424fd tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:44.506111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-21abdf6e-b7df-45b2-aad9-2ac62e4424fd tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:44.506723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-21abdf6e-b7df-45b2-aad9-2ac62e4424fd tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:44.989354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-21abdf6e-b7df-45b2-aad9-2ac62e4424fd tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:45.003483 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-21abdf6e-b7df-45b2-aad9-2ac62e4424fd tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 200 len: 1390 microversion: 2.1 time: 0.516660 Jul 25 12:38:45.006019 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 83/194] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:44 2022] GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 1390 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:45.013673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6aa35a28-7d74-4c4a-b962-3727fdbb4f54 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-25818246"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:45.026862 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:45.026862 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:45.029872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.aggregate [None req-6aa35a28-7d74-4c4a-b962-3727fdbb4f54 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Generated uuid b9da86d8-fab4-4c5d-bb79-0066be88b4fb for aggregate {{(pid=125884) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 12:38:45.101457 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6aa35a28-7d74-4c4a-b962-3727fdbb4f54 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.092563 Jul 25 12:38:45.104398 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 84/195] 10.222.0.49 () {60 vars in 1164 bytes} [Mon Jul 25 12:38:45 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:45.126216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-df1fb68c-d4a6-43b9-91f5-7298bdecc309 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-848886-15"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:45.138598 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:45.138598 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:45.164260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-df1fb68c-d4a6-43b9-91f5-7298bdecc309 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:45.165160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-df1fb68c-d4a6-43b9-91f5-7298bdecc309 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:45.450796 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-df1fb68c-d4a6-43b9-91f5-7298bdecc309 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.338969 Jul 25 12:38:45.452379 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 85/196] 10.222.0.49 () {60 vars in 1191 bytes} [Mon Jul 25 12:38:45 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:38:45.460973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-9fae5bcd-9230-4652-87c8-29e3c6b96ec9 req-461b089b-9363-4489-997a-80aff601eb2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36fa069d-9aaa-4804-a21f-8526cbe9d728", "name": "network-vif-plugged", "status": "completed", "tag": "bee090ea-f3af-4297-9530-9c09fda48a76"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:45.488281 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9fae5bcd-9230-4652-87c8-29e3c6b96ec9 req-461b089b-9363-4489-997a-80aff601eb2f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:45.489913 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9fae5bcd-9230-4652-87c8-29e3c6b96ec9 req-461b089b-9363-4489-997a-80aff601eb2f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:45.498640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:38:45.518095 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-9fae5bcd-9230-4652-87c8-29e3c6b96ec9 req-461b089b-9363-4489-997a-80aff601eb2f service nova] Creating event network-vif-plugged:bee090ea-f3af-4297-9530-9c09fda48a76 for instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 on n-h1-848886-15 Jul 25 12:38:45.531587 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-9fae5bcd-9230-4652-87c8-29e3c6b96ec9 req-461b089b-9363-4489-997a-80aff601eb2f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077218 Jul 25 12:38:45.534685 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 86/197] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:45.546057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-69447e14-ff24-4bf6-9aa2-af5023f089e5 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:45.546864 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:45.546864 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:45.567234 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-69447e14-ff24-4bf6-9aa2-af5023f089e5 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.030691 Jul 25 12:38:45.574674 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 87/198] 10.222.0.49 () {58 vars in 1149 bytes} [Mon Jul 25 12:38:45 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:45.586126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b90297eb-28dc-4ab6-b8e4-50dfee4dbaf5 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-848886-15"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:45.589934 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:45.589934 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:45.611601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b90297eb-28dc-4ab6-b8e4-50dfee4dbaf5 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:45.612050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b90297eb-28dc-4ab6-b8e4-50dfee4dbaf5 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:45.902600 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b90297eb-28dc-4ab6-b8e4-50dfee4dbaf5 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 225 microversion: 2.1 time: 0.322790 Jul 25 12:38:45.904875 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 88/199] 10.222.0.49 () {60 vars in 1191 bytes} [Mon Jul 25 12:38:45 2022] POST /compute/v2.1/os-aggregates/2/action => generated 225 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:45.917403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c3633043-7381-4490-8f4a-56b42dc4f7b1 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:45.918652 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:45.918652 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:45.961521 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c3633043-7381-4490-8f4a-56b42dc4f7b1 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.049616 Jul 25 12:38:45.962769 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 89/200] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:38:45 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 12:38:45.976109 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aa5cab59-0c46-4899-a4a6-cbaf96039dcc tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1896681586"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:45.984586 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:45.984586 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:45.985648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.aggregate [None req-aa5cab59-0c46-4899-a4a6-cbaf96039dcc tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Generated uuid 4b9866eb-0cb5-4d70-b59a-847773442908 for aggregate {{(pid=125884) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 12:38:46.055301 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-aa5cab59-0c46-4899-a4a6-cbaf96039dcc tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.085704 Jul 25 12:38:46.056097 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 90/201] 10.222.0.49 () {60 vars in 1164 bytes} [Mon Jul 25 12:38:45 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:46.077290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-77a55573-f257-4999-a92d-0a77e85d4942 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:46.078095 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-77a55573-f257-4999-a92d-0a77e85d4942 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:46.094428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-77a55573-f257-4999-a92d-0a77e85d4942 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:46.095428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-77a55573-f257-4999-a92d-0a77e85d4942 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:46.096242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-77a55573-f257-4999-a92d-0a77e85d4942 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:46.096687 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-77a55573-f257-4999-a92d-0a77e85d4942 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:46.618488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:38:46.631803 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-77a55573-f257-4999-a92d-0a77e85d4942 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:46.647547 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-77a55573-f257-4999-a92d-0a77e85d4942 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 200 len: 1390 microversion: 2.1 time: 0.583351 Jul 25 12:38:46.653545 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 91/202] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:46 2022] GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 1390 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:46.670209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2e2a3ddc-dd7d-492c-a586-32b70774ecd6 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-848886-15"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:46.682055 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:46.682055 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:46.697731 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2e2a3ddc-dd7d-492c-a586-32b70774ecd6 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:46.699483 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2e2a3ddc-dd7d-492c-a586-32b70774ecd6 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:46.777703 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-b640d955-e2d3-476d-be18-4fbf7c9c7094 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:38:46.778615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-b640d955-e2d3-476d-be18-4fbf7c9c7094 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:38:46.779120 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-b640d955-e2d3-476d-be18-4fbf7c9c7094 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:38:46.779685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-b640d955-e2d3-476d-be18-4fbf7c9c7094 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:38:46.780922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-b640d955-e2d3-476d-be18-4fbf7c9c7094 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:38:46.814273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b640d955-e2d3-476d-be18-4fbf7c9c7094 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:46.814273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b640d955-e2d3-476d-be18-4fbf7c9c7094 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:46.814273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b640d955-e2d3-476d-be18-4fbf7c9c7094 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:46.814273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b640d955-e2d3-476d-be18-4fbf7c9c7094 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:46.884001 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-b640d955-e2d3-476d-be18-4fbf7c9c7094 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Getting quotas for project bdce4da5878543a4a609dc35e389763c. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:38:46.894431 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-b640d955-e2d3-476d-be18-4fbf7c9c7094 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Getting quotas for user fa79a472f31b4e8eb0a6ad709bc84c01 and project bdce4da5878543a4a609dc35e389763c. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:38:46.919017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b640d955-e2d3-476d-be18-4fbf7c9c7094 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:38:46.921888 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2e2a3ddc-dd7d-492c-a586-32b70774ecd6 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 243 microversion: 2.1 time: 0.264367 Jul 25 12:38:46.923022 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 92/203] 10.222.0.49 () {60 vars in 1191 bytes} [Mon Jul 25 12:38:46 2022] POST /compute/v2.1/os-aggregates/3/action => generated 243 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:46.925269 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b640d955-e2d3-476d-be18-4fbf7c9c7094 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:38:47.027434 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b640d955-e2d3-476d-be18-4fbf7c9c7094 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.518821 Jul 25 12:38:47.032821 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 112/204] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Jul 25 12:38:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3522 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 12:38:47.043720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ba68e5b8-ecd6-41d3-9f39-34221d607822 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-848886-15"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:47.050962 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:47.050962 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:47.067356 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba68e5b8-ecd6-41d3-9f39-34221d607822 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:47.068800 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba68e5b8-ecd6-41d3-9f39-34221d607822 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:47.144809 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-ba68e5b8-ecd6-41d3-9f39-34221d607822 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] HTTP exception thrown: Aggregate 3 already has host n-h2-848886-15. Jul 25 12:38:47.168984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ba68e5b8-ecd6-41d3-9f39-34221d607822 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Request method failure captured: Jul 25 12:38:47.168984 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Jul 25 12:38:47.168984 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:47.168984 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:47.168984 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:47.168984 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 40 Jul 25 12:38:47.168984 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:47.168984 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:47.168984 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:47.168984 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:47.168984 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6kth2toETqk8XfAtW9X1g1wUL6QI8ueZl2Ky5pLyC8OAnKLAdcNOpA8tNYA3Kb7rTMgeeWEEOMcNvmIjR2KV95zU48hABdu3wo7NI6b3eJIyVdUgI1F3VfC1SKsggZ-Sv4P2kbj-mc5JGI7GndLwklx7_Q8Dd085meZQ2Eb4IioGQ Jul 25 12:38:47.168984 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:47.168984 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:47.168984 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:47.168984 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:47.168984 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:47.168984 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:47.168984 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 0e658a3895a948af95d8e167a029e207 Jul 25 12:38:47.168984 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:47.168984 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:38:47.168984 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:38:47.170298 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0e658a3895a948af95d8e167a029e207", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0e658a3895a948af95d8e167a029e207"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0e658a3895a948af95d8e167a029e207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0e658a3895a948af95d8e167a029e207"}]}] Jul 25 12:38:47.170298 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:47.170298 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 0e658a3895a948af95d8e167a029e207 Jul 25 12:38:47.170298 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:47.170298 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin Jul 25 12:38:47.170298 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:47.170298 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:47.170298 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8f2f67a1e4dd407b8fcad1d75460134f Jul 25 12:38:47.170298 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin Jul 25 12:38:47.170298 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:38:47.170298 n-d-848886-15 devstack@n-api.service[125883]: {"add_host": {"host": "n-h2-848886-15"}} Jul 25 12:38:47.170298 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:38:47.170298 n-d-848886-15 devstack@n-api.service[125883]: exception: Aggregate 3 already has host n-h2-848886-15. Jul 25 12:38:47.171049 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h2-848886-15'}}} Jul 25 12:38:47.171049 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:47.171049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:47.171049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 12:38:47.171049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 12:38:47.171049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 12:38:47.171049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 12:38:47.171049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 12:38:47.171049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 12:38:47.171049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 12:38:47.171049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 12:38:47.171049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 12:38:47.171049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 12:38:47.171049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 12:38:47.171049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result.read() Jul 25 12:38:47.171049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 12:38:47.171049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 12:38:47.171049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 12:38:47.171049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 12:38:47.172072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 12:38:47.172072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 12:38:47.172072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 12:38:47.172072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 12:38:47.172072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-848886-15-3' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 25 12:38:47.172072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:47.172072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 25 12:38:47.172072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:47.172072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:47.172072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 25 12:38:47.172072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 25 12:38:47.172072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 25 12:38:47.172072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi session.flush() Jul 25 12:38:47.172072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 12:38:47.172072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 25 12:38:47.172072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 12:38:47.172072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 25 12:38:47.172072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 12:38:47.172072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 25 12:38:47.173073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 12:38:47.173073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception Jul 25 12:38:47.173073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 12:38:47.173073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 25 12:38:47.173073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 12:38:47.173073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 25 12:38:47.173073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 12:38:47.173073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 25 12:38:47.173073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 12:38:47.173073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 25 12:38:47.173073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 12:38:47.173073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 25 12:38:47.173073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 12:38:47.173073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 12:38:47.173073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 12:38:47.173073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 25 12:38:47.173073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 12:38:47.173073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 25 12:38:47.174462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 12:38:47.174462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 25 12:38:47.174462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 12:38:47.174462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 12:38:47.174462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 12:38:47.174462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception Jul 25 12:38:47.174462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 12:38:47.174462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 12:38:47.174462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 12:38:47.174462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 12:38:47.174462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 12:38:47.174462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 12:38:47.174462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 12:38:47.174462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 12:38:47.174462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 12:38:47.174462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 12:38:47.174462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 12:38:47.174462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result.read() Jul 25 12:38:47.175591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 12:38:47.175591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 12:38:47.175591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 12:38:47.175591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 12:38:47.175591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 12:38:47.175591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 12:38:47.175591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 12:38:47.175591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 12:38:47.175591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-848886-15-3' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 25 12:38:47.175591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 25 12:38:47.175591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 25, 12, 38, 47, 122602), 'updated_at': None, 'host': 'n-h2-848886-15', 'aggregate_id': 3}] Jul 25 12:38:47.175591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 12:38:47.175591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:47.175591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:47.175591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:47.175591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:47.175591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 25 12:38:47.176749 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 25 12:38:47.176749 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 12:38:47.176749 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 12:38:47.176749 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:47.176749 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:47.176749 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:47.176749 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:47.176749 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 12:38:47.176749 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 12:38:47.176749 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 25 12:38:47.176749 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 25 12:38:47.176749 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 12:38:47.176749 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 12:38:47.176749 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 25 12:38:47.176749 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 25 12:38:47.176749 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 25 12:38:47.176749 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 25 12:38:47.176749 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 3 already has host n-h2-848886-15. Jul 25 12:38:47.176749 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:47.176749 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:47.178223 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:47.178223 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:47.178223 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:47.178223 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:47.178223 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:47.178223 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:47.178223 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:47.178223 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:47.178223 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:38:47.178223 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:38:47.178223 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 25 12:38:47.178223 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 25 12:38:47.178223 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 3 already has host n-h2-848886-15. Jul 25 12:38:47.178223 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:47.178223 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:47.178223 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:47.178223 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:47.178223 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:47.178223 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:47.178223 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:47.178223 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:47.181914 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 3 already has host n-h2-848886-15. Jul 25 12:38:47.181914 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:47.183340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ba68e5b8-ecd6-41d3-9f39-34221d607822 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Returning 409 to user: Aggregate 3 already has host n-h2-848886-15. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:47.184483 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ba68e5b8-ecd6-41d3-9f39-34221d607822 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/3/action" status: 409 len: 96 microversion: 2.1 time: 0.150288 Jul 25 12:38:47.186821 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 113/205] 10.222.0.49 () {60 vars in 1191 bytes} [Mon Jul 25 12:38:47 2022] POST /compute/v2.1/os-aggregates/3/action => generated 96 bytes in 153 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 25 12:38:47.195671 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-58f76766-8049-4a84-b01f-c99ccb2e02f6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:47.197386 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-58f76766-8049-4a84-b01f-c99ccb2e02f6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:47.345148 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-58f76766-8049-4a84-b01f-c99ccb2e02f6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:47.370092 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-58f76766-8049-4a84-b01f-c99ccb2e02f6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:47.371628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-58f76766-8049-4a84-b01f-c99ccb2e02f6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:47.374658 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-58f76766-8049-4a84-b01f-c99ccb2e02f6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 1261 microversion: 2.25 time: 0.186263 Jul 25 12:38:47.376222 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 114/206] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:38:47 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 1261 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:38:47.386449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dd79afec-ff2f-4b9f-833a-86c78ccf4e13 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-848886-15"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:47.389381 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:47.389381 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:47.419927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dd79afec-ff2f-4b9f-833a-86c78ccf4e13 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:47.420479 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dd79afec-ff2f-4b9f-833a-86c78ccf4e13 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:47.605278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f62a091f-67a0-4a8c-8818-4a12414b44b2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-124427717", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:47.674911 n-d-848886-15 devstack@n-api.service[125883]: WARNING nova.scheduler.client.report [None req-dd79afec-ff2f-4b9f-833a-86c78ccf4e13 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] [req-bfddf590-9395-4f99-97ce-552fb6e74b22] Failed to update aggregates to [] for resource provider with UUID cf7960e8-f236-4154-86e5-a6121b681c9e. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Update conflict: Another thread concurrently updated the resource provider data. Please retry your update ", "request_id": "req-bfddf590-9395-4f99-97ce-552fb6e74b22"}]} Jul 25 12:38:47.736011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-f62a091f-67a0-4a8c-8818-4a12414b44b2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] validate_networks() for None {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:38:47.875492 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dd79afec-ff2f-4b9f-833a-86c78ccf4e13 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.495337 Jul 25 12:38:47.876319 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 115/207] 10.222.0.49 () {60 vars in 1191 bytes} [Mon Jul 25 12:38:47 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:47.889607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-854a462e-c5dd-4308-8ce2-32aed368df41 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:47.894888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-854a462e-c5dd-4308-8ce2-32aed368df41 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:47.919072 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-854a462e-c5dd-4308-8ce2-32aed368df41 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:47.923472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-854a462e-c5dd-4308-8ce2-32aed368df41 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:47.928219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-854a462e-c5dd-4308-8ce2-32aed368df41 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:47.929290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-854a462e-c5dd-4308-8ce2-32aed368df41 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:48.176119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-f62a091f-67a0-4a8c-8818-4a12414b44b2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:38:48.176956 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-f62a091f-67a0-4a8c-8818-4a12414b44b2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:38:48.177604 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-f62a091f-67a0-4a8c-8818-4a12414b44b2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:38:48.178487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-f62a091f-67a0-4a8c-8818-4a12414b44b2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:38:48.179145 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-f62a091f-67a0-4a8c-8818-4a12414b44b2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:38:48.200413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f62a091f-67a0-4a8c-8818-4a12414b44b2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:48.204228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f62a091f-67a0-4a8c-8818-4a12414b44b2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:48.205376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f62a091f-67a0-4a8c-8818-4a12414b44b2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:48.206366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f62a091f-67a0-4a8c-8818-4a12414b44b2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:48.290334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-f62a091f-67a0-4a8c-8818-4a12414b44b2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Getting quotas for project 5220cb7ebe7b4a89a8d1edabad2391a7. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:38:48.310766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-f62a091f-67a0-4a8c-8818-4a12414b44b2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Getting quotas for user 045d03491c1046609caffee111db48fc and project 5220cb7ebe7b4a89a8d1edabad2391a7. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:38:48.364990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f62a091f-67a0-4a8c-8818-4a12414b44b2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:38:48.367736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f62a091f-67a0-4a8c-8818-4a12414b44b2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:38:48.465040 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-854a462e-c5dd-4308-8ce2-32aed368df41 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:48.487254 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-854a462e-c5dd-4308-8ce2-32aed368df41 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 200 len: 1390 microversion: 2.1 time: 0.609578 Jul 25 12:38:48.489930 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 116/208] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:47 2022] GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 1390 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:48.500473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aa1dacab-a3f4-4140-bb86-7a258dd19101 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:48.501892 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f62a091f-67a0-4a8c-8818-4a12414b44b2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.563762 Jul 25 12:38:48.511929 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:48.511929 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:48.516126 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 93/209] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:38:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:38:48.540071 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-66c05d87-3c0d-460d-a02e-710b6785a89b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:48.540629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-66c05d87-3c0d-460d-a02e-710b6785a89b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:48.564150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-66c05d87-3c0d-460d-a02e-710b6785a89b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:48.565340 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-66c05d87-3c0d-460d-a02e-710b6785a89b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:48.568529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-66c05d87-3c0d-460d-a02e-710b6785a89b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:48.570344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-66c05d87-3c0d-460d-a02e-710b6785a89b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:48.625070 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aa1dacab-a3f4-4140-bb86-7a258dd19101 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.132393 Jul 25 12:38:48.625653 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 117/210] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:38:48 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 12:38:48.658102 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-754e2b23-0232-4c59-8693-a100a5d20cc0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:48.659688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-754e2b23-0232-4c59-8693-a100a5d20cc0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:48.721612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-66c05d87-3c0d-460d-a02e-710b6785a89b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:48.730666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-66c05d87-3c0d-460d-a02e-710b6785a89b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:48.746973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-66c05d87-3c0d-460d-a02e-710b6785a89b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:48.753155 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-66c05d87-3c0d-460d-a02e-710b6785a89b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 1313 microversion: 2.25 time: 0.231026 Jul 25 12:38:48.754175 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 94/211] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:38:48 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:38:48.771371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6494d118-ad47-40bf-81c9-d5529fdd69ea tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-547337587"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:48.791569 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:48.791569 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:48.792628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.aggregate [None req-6494d118-ad47-40bf-81c9-d5529fdd69ea tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Generated uuid 50a6522a-1219-45f4-9d2a-a0233518cdd6 for aggregate {{(pid=125884) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 12:38:48.860977 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6494d118-ad47-40bf-81c9-d5529fdd69ea tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.105502 Jul 25 12:38:48.862822 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 95/212] 10.222.0.49 () {60 vars in 1164 bytes} [Mon Jul 25 12:38:48 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:48.868450 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ef665510-266b-4fdf-8dfd-e94505bb4cc0 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1343510209"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:48.868879 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-754e2b23-0232-4c59-8693-a100a5d20cc0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:48.871641 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:48.871641 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:48.873176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.aggregate [None req-ef665510-266b-4fdf-8dfd-e94505bb4cc0 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Generated uuid 198c5f5d-15fa-4932-ac6f-29694caae27d for aggregate {{(pid=125884) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 12:38:48.876782 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-754e2b23-0232-4c59-8693-a100a5d20cc0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1212 microversion: 2.1 time: 0.238201 Jul 25 12:38:48.885011 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 118/213] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:48 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1212 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:48.939318 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ef665510-266b-4fdf-8dfd-e94505bb4cc0 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.074669 Jul 25 12:38:48.940741 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 96/214] 10.222.0.49 () {60 vars in 1164 bytes} [Mon Jul 25 12:38:48 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:48.953050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-15d73857-d069-409d-88f0-2a3dccede682 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-848886-15"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:48.956757 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:48.956757 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:48.982428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-15d73857-d069-409d-88f0-2a3dccede682 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:48.984679 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-15d73857-d069-409d-88f0-2a3dccede682 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:49.281085 n-d-848886-15 devstack@n-api.service[125884]: WARNING nova.scheduler.client.report [None req-15d73857-d069-409d-88f0-2a3dccede682 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] [req-9717a36d-e31c-4b5d-b9b1-f3a51eced52f] Failed to update aggregates to [198c5f5d-15fa-4932-ac6f-29694caae27d] for resource provider with UUID cf7960e8-f236-4154-86e5-a6121b681c9e. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Update conflict: Another thread concurrently updated the resource provider data. Please retry your update ", "request_id": "req-9717a36d-e31c-4b5d-b9b1-f3a51eced52f"}]} Jul 25 12:38:49.440024 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-15d73857-d069-409d-88f0-2a3dccede682 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 243 microversion: 2.1 time: 0.492481 Jul 25 12:38:49.448186 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 97/215] 10.222.0.49 () {60 vars in 1191 bytes} [Mon Jul 25 12:38:48 2022] POST /compute/v2.1/os-aggregates/5/action => generated 243 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:49.555230 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f1c426e6-92a5-4465-8f2f-7f76534ac67b tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Calling method '.version_select at 0x7efcfa6cf430>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:49.613330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-812a6043-5510-43c1-84d6-5a804a63d8e0 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-848886-15"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:49.617985 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:49.617985 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:49.620661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-812a6043-5510-43c1-84d6-5a804a63d8e0 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '8a8f11ae292f457fa9dfb26feda9cc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b6275d104eaca4ea47aebf814610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:49.624785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-812a6043-5510-43c1-84d6-5a804a63d8e0 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Request method failure captured: Jul 25 12:38:49.624785 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Jul 25 12:38:49.624785 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:49.624785 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:49.624785 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:49.624785 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 40 Jul 25 12:38:49.624785 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:49.624785 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:49.624785 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:49.624785 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:49.624785 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6hrA4aZedgta8e_3cEgQGQqSp7YL4Xb7u52c5qPL8OVcp8kYYQpzmXunX5w0L8ZtzsL0bSEwHEeWaUTyMiLQv2wAvrdcty5J2siXLiIA99ygKWJj4npk6LedNjPlXFsR43qEhCjgdRsmEHrS-XQYqs4NsY1SHAh98V8iskw_c9v6o Jul 25 12:38:49.624785 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:49.624785 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:49.624785 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:49.624785 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:49.624785 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:49.624785 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:49.624785 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: aa09b6275d104eaca4ea47aebf814610 Jul 25 12:38:49.624785 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1884950486 Jul 25 12:38:49.624785 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:38:49.624785 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:38:49.626327 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aa09b6275d104eaca4ea47aebf814610", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aa09b6275d104eaca4ea47aebf814610"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa09b6275d104eaca4ea47aebf814610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa09b6275d104eaca4ea47aebf814610"}]}] Jul 25 12:38:49.626327 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1884950486 Jul 25 12:38:49.626327 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: aa09b6275d104eaca4ea47aebf814610 Jul 25 12:38:49.626327 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1884950486 Jul 25 12:38:49.626327 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AggregatesAdminNegativeTestJSON-1884950486-project Jul 25 12:38:49.626327 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:49.626327 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:49.626327 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8a8f11ae292f457fa9dfb26feda9cc53 Jul 25 12:38:49.626327 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1884950486-project Jul 25 12:38:49.626327 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:38:49.626327 n-d-848886-15 devstack@n-api.service[125883]: {"add_host": {"host": "n-h2-848886-15"}} Jul 25 12:38:49.626327 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:38:49.626327 n-d-848886-15 devstack@n-api.service[125883]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 25 12:38:49.627108 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '4', 'body': {'add_host': {'host': 'n-h2-848886-15'}}} Jul 25 12:38:49.627108 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:49.627108 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:49.627108 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:49.627108 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:49.627108 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:49.627108 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:49.627108 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:49.627108 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:49.627108 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:38:49.627108 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:38:49.627108 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 25 12:38:49.627108 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 25 12:38:49.627108 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:49.627108 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:49.627108 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:49.627108 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:49.627108 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:49.627108 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:49.628139 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:49.628139 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:49.628139 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:49.628139 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:49.628139 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:49.628139 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:49.628139 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:49.628139 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:49.628139 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 25 12:38:49.628139 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:49.628139 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:49.628139 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:49.628139 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:49.628139 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:49.628139 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:49.628139 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:49.628139 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:49.628139 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 25 12:38:49.628139 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:49.629149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-812a6043-5510-43c1-84d6-5a804a63d8e0 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:49.629149 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-812a6043-5510-43c1-84d6-5a804a63d8e0 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] 10.222.0.49 "POST /compute/v2.1/os-aggregates/4/action" status: 403 len: 118 microversion: 2.1 time: 0.740341 Jul 25 12:38:49.629149 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 119/216] 10.222.0.49 () {60 vars in 1191 bytes} [Mon Jul 25 12:38:48 2022] POST /compute/v2.1/os-aggregates/4/action => generated 118 bytes in 741 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:49.635617 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b81a59f9-0399-4c13-8b2e-609f18a3dc05 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:49.647613 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:49.647613 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:49.671747 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b81a59f9-0399-4c13-8b2e-609f18a3dc05 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 200 len: 459 microversion: 2.1 time: 0.039565 Jul 25 12:38:49.679782 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 120/217] 10.222.0.49 () {58 vars in 1143 bytes} [Mon Jul 25 12:38:49 2022] GET /compute/v2.1/os-aggregates => generated 459 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:49.680726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1242cb5e-3e82-47d1-9aa3-3e1e971f21e7 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:49.681398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1242cb5e-3e82-47d1-9aa3-3e1e971f21e7 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:49.688391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1242cb5e-3e82-47d1-9aa3-3e1e971f21e7 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:49.688844 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1242cb5e-3e82-47d1-9aa3-3e1e971f21e7 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:49.689623 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1242cb5e-3e82-47d1-9aa3-3e1e971f21e7 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:49.690088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1242cb5e-3e82-47d1-9aa3-3e1e971f21e7 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:49.701077 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f1c426e6-92a5-4465-8f2f-7f76534ac67b tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/262834c845ea40599da06298207f4a52" status: 200 len: 371 microversion: 2.1 time: 0.256992 Jul 25 12:38:49.702143 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 98/218] 10.222.0.49 () {58 vars in 1242 bytes} [Mon Jul 25 12:38:49 2022] GET /compute/v2.1/os-quota-sets/262834c845ea40599da06298207f4a52 => generated 371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:49.714615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c68a03bf-1428-46fe-8fec-f088698b78ce tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:49.715797 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:49.715797 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:49.754775 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c68a03bf-1428-46fe-8fec-f088698b78ce tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.043961 Jul 25 12:38:49.755686 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 99/219] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:38:49 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 12:38:49.762693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bbd532f2-b50d-45c3-92c4-108af50b9e04 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-848886-15"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:49.766560 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:49.766560 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:49.779642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bbd532f2-b50d-45c3-92c4-108af50b9e04 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:49.780093 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bbd532f2-b50d-45c3-92c4-108af50b9e04 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:49.880465 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1242cb5e-3e82-47d1-9aa3-3e1e971f21e7 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:49.890249 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1242cb5e-3e82-47d1-9aa3-3e1e971f21e7 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 200 len: 1589 microversion: 2.1 time: 0.214923 Jul 25 12:38:49.893649 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 121/220] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:49 2022] GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 1589 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:49.909735 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8b0ca9a4-7788-4c82-83d1-ef071a0e1df5 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Action: 'update', calling method: .version_select at 0x7efcfa3d6ee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:49.954906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=7,nova_api:INSERT=10 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:38:49.984377 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bbd532f2-b50d-45c3-92c4-108af50b9e04 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.227312 Jul 25 12:38:49.989587 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 100/221] 10.222.0.49 () {60 vars in 1191 bytes} [Mon Jul 25 12:38:49 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:49.994239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a8a31840-1c4b-48e6-b6a3-0ba3d0a3ba68 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-422179170"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:49.999729 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:49.999729 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:50.001643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.aggregate [None req-a8a31840-1c4b-48e6-b6a3-0ba3d0a3ba68 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Generated uuid de37186d-376a-4914-b51c-f234b9e2c6d6 for aggregate {{(pid=125884) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 12:38:50.035756 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a8a31840-1c4b-48e6-b6a3-0ba3d0a3ba68 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.048481 Jul 25 12:38:50.038554 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 101/222] 10.222.0.49 () {60 vars in 1164 bytes} [Mon Jul 25 12:38:49 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:50.051525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ed4f3e3b-ed63-404e-9bba-1eafb48f02d6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:50.052239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ed4f3e3b-ed63-404e-9bba-1eafb48f02d6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:50.061103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed4f3e3b-ed63-404e-9bba-1eafb48f02d6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:50.061601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed4f3e3b-ed63-404e-9bba-1eafb48f02d6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:50.062537 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed4f3e3b-ed63-404e-9bba-1eafb48f02d6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:50.063033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed4f3e3b-ed63-404e-9bba-1eafb48f02d6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:50.079150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b0ca9a4-7788-4c82-83d1-ef071a0e1df5 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:50.079606 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b0ca9a4-7788-4c82-83d1-ef071a0e1df5 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:50.080576 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b0ca9a4-7788-4c82-83d1-ef071a0e1df5 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:50.081187 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b0ca9a4-7788-4c82-83d1-ef071a0e1df5 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:50.156405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ed4f3e3b-ed63-404e-9bba-1eafb48f02d6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:50.170726 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8b0ca9a4-7788-4c82-83d1-ef071a0e1df5 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/262834c845ea40599da06298207f4a52" status: 200 len: 328 microversion: 2.1 time: 0.270603 Jul 25 12:38:50.172614 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 122/223] 10.222.0.49 () {60 vars in 1262 bytes} [Mon Jul 25 12:38:49 2022] PUT /compute/v2.1/os-quota-sets/262834c845ea40599da06298207f4a52 => generated 328 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:50.176112 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ed4f3e3b-ed63-404e-9bba-1eafb48f02d6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:50.178055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ed4f3e3b-ed63-404e-9bba-1eafb48f02d6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:50.179392 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ed4f3e3b-ed63-404e-9bba-1eafb48f02d6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 1319 microversion: 2.25 time: 0.139568 Jul 25 12:38:50.180032 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 102/224] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:38:50 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 1319 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:38:50.180659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a245ea7f-120d-42fe-a78f-477948ba4935 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:50.181546 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a245ea7f-120d-42fe-a78f-477948ba4935 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:50.185710 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-93594b54-6a1a-4d1a-be85-ec96bf09d61f tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:50.186234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-93594b54-6a1a-4d1a-be85-ec96bf09d61f tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:50.190142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a245ea7f-120d-42fe-a78f-477948ba4935 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:50.190837 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a245ea7f-120d-42fe-a78f-477948ba4935 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:50.192367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a245ea7f-120d-42fe-a78f-477948ba4935 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:50.193007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a245ea7f-120d-42fe-a78f-477948ba4935 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:50.193450 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93594b54-6a1a-4d1a-be85-ec96bf09d61f tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:50.194322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93594b54-6a1a-4d1a-be85-ec96bf09d61f tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:50.195093 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93594b54-6a1a-4d1a-be85-ec96bf09d61f tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:50.195830 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93594b54-6a1a-4d1a-be85-ec96bf09d61f tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:50.307377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a245ea7f-120d-42fe-a78f-477948ba4935 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:50.330315 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a245ea7f-120d-42fe-a78f-477948ba4935 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1264 microversion: 2.1 time: 0.155964 Jul 25 12:38:50.331239 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 123/225] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:50 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:50.341578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9134a650-9191-4e09-a2b9-cc6c40921c11 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:50.347370 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:50.347370 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:50.379124 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:38:50.404588 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9134a650-9191-4e09-a2b9-cc6c40921c11 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.071570 Jul 25 12:38:50.405193 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 124/226] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:38:50 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 12:38:50.417385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d9a96b01-e748-4b13-916e-4c9f9861f78c tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1031699856"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:50.423236 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:50.423236 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:50.441625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9a96b01-e748-4b13-916e-4c9f9861f78c tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:50.442135 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9a96b01-e748-4b13-916e-4c9f9861f78c tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:50.468064 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9a96b01-e748-4b13-916e-4c9f9861f78c tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:50.468502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9a96b01-e748-4b13-916e-4c9f9861f78c tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:50.494866 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-d9a96b01-e748-4b13-916e-4c9f9861f78c tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1031699856 could not be found. Jul 25 12:38:50.496975 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d9a96b01-e748-4b13-916e-4c9f9861f78c tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Request method failure captured: Jul 25 12:38:50.496975 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Jul 25 12:38:50.496975 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:50.496975 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:50.496975 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:50.496975 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 58 Jul 25 12:38:50.496975 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:50.496975 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:50.496975 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:50.496975 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:50.496975 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6kth2toETqk8XfAtW9X1g1wUL6QI8ueZl2Ky5pLyC8OAnKLAdcNOpA8tNYA3Kb7rTMgeeWEEOMcNvmIjR2KV95zU48hABdu3wo7NI6b3eJIyVdUgI1F3VfC1SKsggZ-Sv4P2kbj-mc5JGI7GndLwklx7_Q8Dd085meZQ2Eb4IioGQ Jul 25 12:38:50.496975 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:50.496975 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:50.496975 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:50.496975 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:50.496975 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:50.496975 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:50.496975 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 0e658a3895a948af95d8e167a029e207 Jul 25 12:38:50.496975 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:50.496975 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:38:50.496975 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:38:50.500176 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0e658a3895a948af95d8e167a029e207", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0e658a3895a948af95d8e167a029e207"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0e658a3895a948af95d8e167a029e207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0e658a3895a948af95d8e167a029e207"}]}] Jul 25 12:38:50.500176 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:50.500176 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 0e658a3895a948af95d8e167a029e207 Jul 25 12:38:50.500176 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:50.500176 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin Jul 25 12:38:50.500176 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:50.500176 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:50.500176 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8f2f67a1e4dd407b8fcad1d75460134f Jul 25 12:38:50.500176 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin Jul 25 12:38:50.500176 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:38:50.500176 n-d-848886-15 devstack@n-api.service[125883]: {"add_host": {"host": "tempest-nonexist_host-1031699856"}} Jul 25 12:38:50.500176 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:38:50.500176 n-d-848886-15 devstack@n-api.service[125883]: exception: Compute host tempest-nonexist_host-1031699856 could not be found. Jul 25 12:38:50.501469 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '6', 'body': {'add_host': {'host': 'tempest-nonexist_host-1031699856'}}} Jul 25 12:38:50.501469 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:50.501469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:50.501469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 25 12:38:50.501469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 25 12:38:50.501469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:38:50.501469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:38:50.501469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 12:38:50.501469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 12:38:50.501469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:38:50.501469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:38:50.501469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 12:38:50.501469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 12:38:50.501469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1031699856' is not mapped to any cell Jul 25 12:38:50.501469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.501469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:50.501469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.501469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:50.501469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 25 12:38:50.503407 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 25 12:38:50.503407 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 25 12:38:50.503407 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 25 12:38:50.503407 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 25 12:38:50.503407 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.503407 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:50.503407 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.503407 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:50.503407 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 25 12:38:50.503407 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 25 12:38:50.503407 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 12:38:50.503407 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 12:38:50.503407 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:50.503407 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:50.503407 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:50.503407 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:50.503407 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 12:38:50.503407 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 12:38:50.503407 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 25 12:38:50.503407 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 25 12:38:50.506678 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 25 12:38:50.506678 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 25 12:38:50.506678 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1031699856 could not be found. Jul 25 12:38:50.506678 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.506678 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:50.506678 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.506678 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:50.506678 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:50.506678 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:50.506678 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:50.506678 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:50.506678 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:50.506678 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:50.506678 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:38:50.506678 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:38:50.506678 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 25 12:38:50.506678 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:38:50.506678 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1031699856 could not be found. Jul 25 12:38:50.506678 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.506678 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:50.506678 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.508357 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:50.508357 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:50.508357 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:50.508357 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:50.508357 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:50.508357 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1031699856 could not be found. Jul 25 12:38:50.508357 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.508357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d9a96b01-e748-4b13-916e-4c9f9861f78c tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1031699856 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:50.508357 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d9a96b01-e748-4b13-916e-4c9f9861f78c tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/6/action" status: 404 len: 111 microversion: 2.1 time: 0.092108 Jul 25 12:38:50.508357 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 125/227] 10.222.0.49 () {60 vars in 1191 bytes} [Mon Jul 25 12:38:50 2022] POST /compute/v2.1/os-aggregates/6/action => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:50.509136 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-73dd468b-f37b-4be5-af87-3f6c0a7112b7 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:50.540719 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-93594b54-6a1a-4d1a-be85-ec96bf09d61f tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.359354 Jul 25 12:38:50.541933 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 103/228] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 12:38:50 2022] GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728/os-interface => generated 285 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:50.551443 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-73dd468b-f37b-4be5-af87-3f6c0a7112b7 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-quota-sets/262834c845ea40599da06298207f4a52" status: 202 len: 0 microversion: 2.1 time: 0.051277 Jul 25 12:38:50.552028 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 126/229] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Jul 25 12:38:50 2022] DELETE /compute/v2.1/os-quota-sets/262834c845ea40599da06298207f4a52 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:38:50.553580 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8421523e-d552-4e08-bac9-aba170283b96 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-274495202"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:50.556888 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:50.556888 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:50.558050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.aggregate [None req-8421523e-d552-4e08-bac9-aba170283b96 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Generated uuid 9beb735e-aa51-4d8d-957c-efff3d2bc6f3 for aggregate {{(pid=125884) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 12:38:50.558911 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d4f7fcbb-8adb-4db2-8672-3e869c8983c3 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:50.559642 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:50.559642 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:50.602635 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d4f7fcbb-8adb-4db2-8672-3e869c8983c3 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.048852 Jul 25 12:38:50.604915 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 127/230] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:38:50 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 12:38:50.616273 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8421523e-d552-4e08-bac9-aba170283b96 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.073094 Jul 25 12:38:50.616880 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 104/231] 10.222.0.49 () {60 vars in 1164 bytes} [Mon Jul 25 12:38:50 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:50.618505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5e2022c6-67cf-4f42-878b-ab1fbf48c7ba tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Calling method '.version_select at 0x7efcfa38a940>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:50.626560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7ebf6fbe-7024-4801-a18c-8c4c8378ee52 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:50.635369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7ebf6fbe-7024-4801-a18c-8c4c8378ee52 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Request method failure captured: Jul 25 12:38:50.635369 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 25 12:38:50.635369 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:38:50.635369 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:38:50.635369 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:38:50.635369 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 283 Jul 25 12:38:50.635369 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:38:50.635369 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:38:50.635369 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:38:50.635369 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:50.635369 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o6kth2toETqk8XfAtW9X1g1wUL6QI8ueZl2Ky5pLyC8OAnKLAdcNOpA8tNYA3Kb7rTMgeeWEEOMcNvmIjR2KV95zU48hABdu3wo7NI6b3eJIyVdUgI1F3VfC1SKsggZ-Sv4P2kbj-mc5JGI7GndLwklx7_Q8Dd085meZQ2Eb4IioGQ Jul 25 12:38:50.635369 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:38:50.635369 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:38:50.635369 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:38:50.635369 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:38:50.635369 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:38:50.635369 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:38:50.635369 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 0e658a3895a948af95d8e167a029e207 Jul 25 12:38:50.635369 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:50.635369 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,admin,member Jul 25 12:38:50.635369 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,admin,member Jul 25 12:38:50.636663 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0e658a3895a948af95d8e167a029e207", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0e658a3895a948af95d8e167a029e207"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0e658a3895a948af95d8e167a029e207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0e658a3895a948af95d8e167a029e207"}]}] Jul 25 12:38:50.636663 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:50.636663 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 0e658a3895a948af95d8e167a029e207 Jul 25 12:38:50.636663 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:50.636663 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin Jul 25 12:38:50.636663 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:38:50.636663 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:38:50.636663 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 8f2f67a1e4dd407b8fcad1d75460134f Jul 25 12:38:50.636663 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin Jul 25 12:38:50.636663 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:38:50.636663 n-d-848886-15 devstack@n-api.service[125884]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 25 12:38:50.637282 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:38:50.637282 n-d-848886-15 devstack@n-api.service[125884]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 12:38:50.637282 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 25 12:38:50.637282 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:50.637282 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:50.637282 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:38:50.637282 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:38:50.637282 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:38:50.637282 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:38:50.637282 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 12:38:50.637282 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.637962 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 25 12:38:50.637962 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 12:38:50.637962 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.637962 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 25 12:38:50.637962 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 25 12:38:50.637962 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.637962 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:50.637962 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.637962 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:50.637962 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:50.637962 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:50.637962 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:50.637962 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:50.637962 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:50.637962 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:50.637962 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:38:50.637962 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:38:50.637962 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:38:50.637962 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:38:50.638969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:38:50.638969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:38:50.638969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:38:50.638969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:38:50.638969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 12:38:50.638969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.638969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:50.638969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.638969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:50.638969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:50.638969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:50.638969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:38:50.638969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:38:50.640872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 12:38:50.640872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.644610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7ebf6fbe-7024-4801-a18c-8c4c8378ee52 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:50.646711 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7ebf6fbe-7024-4801-a18c-8c4c8378ee52 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.024336 Jul 25 12:38:50.651832 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 105/232] 10.222.0.49 () {60 vars in 1165 bytes} [Mon Jul 25 12:38:50 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:38:50.662441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4bc74eb2-8c2c-4f7d-b6cd-390f7d993410 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-848886-15"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:50.665535 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:50.665535 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:50.674711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4bc74eb2-8c2c-4f7d-b6cd-390f7d993410 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:50.675552 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4bc74eb2-8c2c-4f7d-b6cd-390f7d993410 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:50.762943 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5e2022c6-67cf-4f42-878b-ab1fbf48c7ba tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/262834c845ea40599da06298207f4a52" status: 200 len: 371 microversion: 2.1 time: 0.154536 Jul 25 12:38:50.763211 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 128/233] 10.222.0.49 () {58 vars in 1242 bytes} [Mon Jul 25 12:38:50 2022] GET /compute/v2.1/os-quota-sets/262834c845ea40599da06298207f4a52 => generated 371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:50.774421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f57e5b14-f36a-4652-98de-1ee7c34e3e4a tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:50.781334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f57e5b14-f36a-4652-98de-1ee7c34e3e4a tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Request method failure captured: Jul 25 12:38:50.781334 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 25 12:38:50.781334 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:50.781334 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:50.781334 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:50.781334 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 27 Jul 25 12:38:50.781334 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:50.781334 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:50.781334 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:50.781334 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:50.781334 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6kth2toETqk8XfAtW9X1g1wUL6QI8ueZl2Ky5pLyC8OAnKLAdcNOpA8tNYA3Kb7rTMgeeWEEOMcNvmIjR2KV95zU48hABdu3wo7NI6b3eJIyVdUgI1F3VfC1SKsggZ-Sv4P2kbj-mc5JGI7GndLwklx7_Q8Dd085meZQ2Eb4IioGQ Jul 25 12:38:50.781334 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:50.781334 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:50.781334 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:50.781334 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:50.781334 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:50.781334 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:50.781334 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 0e658a3895a948af95d8e167a029e207 Jul 25 12:38:50.781334 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:50.781334 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:38:50.781334 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:38:50.782584 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0e658a3895a948af95d8e167a029e207", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0e658a3895a948af95d8e167a029e207"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0e658a3895a948af95d8e167a029e207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0e658a3895a948af95d8e167a029e207"}]}] Jul 25 12:38:50.782584 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:50.782584 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 0e658a3895a948af95d8e167a029e207 Jul 25 12:38:50.782584 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:50.782584 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin Jul 25 12:38:50.782584 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:50.782584 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:50.782584 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8f2f67a1e4dd407b8fcad1d75460134f Jul 25 12:38:50.782584 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin Jul 25 12:38:50.782584 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:38:50.782584 n-d-848886-15 devstack@n-api.service[125883]: {"aggregate": {"name": ""}} Jul 25 12:38:50.782584 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:38:50.782584 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 25 12:38:50.783524 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 25 12:38:50.783524 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:50.783524 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:50.783524 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:38:50.783524 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:38:50.783524 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:38:50.783524 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:38:50.783524 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 25 12:38:50.783524 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.783524 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 25 12:38:50.783524 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 12:38:50.783524 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.783524 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 25 12:38:50.783524 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi '' Jul 25 12:38:50.783524 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.783524 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:50.783524 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.783524 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:50.783524 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:50.783524 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:50.783524 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:50.783524 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:50.783524 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:50.785113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:50.785113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:38:50.785113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:38:50.785113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:38:50.785113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:38:50.785113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:38:50.785113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:38:50.785113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:38:50.785113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:38:50.785113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 25 12:38:50.785113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.785113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:50.785113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.785113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:50.785113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:50.785113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:50.785113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:38:50.785113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:38:50.785113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 25 12:38:50.785113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.794218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f57e5b14-f36a-4652-98de-1ee7c34e3e4a tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:50.795525 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f57e5b14-f36a-4652-98de-1ee7c34e3e4a tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.030911 Jul 25 12:38:50.796566 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 129/234] 10.222.0.49 () {60 vars in 1164 bytes} [Mon Jul 25 12:38:50 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:38:50.815219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7cd80bbf-b279-4d21-8d37-ad2347cf84c4 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1735636181"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:50.825695 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:50.825695 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:50.828212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7cd80bbf-b279-4d21-8d37-ad2347cf84c4 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '8a8f11ae292f457fa9dfb26feda9cc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b6275d104eaca4ea47aebf814610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:50.833499 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7cd80bbf-b279-4d21-8d37-ad2347cf84c4 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Request method failure captured: Jul 25 12:38:50.833499 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 25 12:38:50.833499 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:50.833499 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:50.833499 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:50.833499 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 60 Jul 25 12:38:50.833499 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:50.833499 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:50.833499 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:50.833499 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:50.833499 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6hrA4aZedgta8e_3cEgQGQqSp7YL4Xb7u52c5qPL8OVcp8kYYQpzmXunX5w0L8ZtzsL0bSEwHEeWaUTyMiLQv2wAvrdcty5J2siXLiIA99ygKWJj4npk6LedNjPlXFsR43qEhCjgdRsmEHrS-XQYqs4NsY1SHAh98V8iskw_c9v6o Jul 25 12:38:50.833499 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:50.833499 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:50.833499 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:50.833499 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:50.833499 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:50.833499 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:50.833499 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: aa09b6275d104eaca4ea47aebf814610 Jul 25 12:38:50.833499 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1884950486 Jul 25 12:38:50.833499 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:38:50.833499 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:38:50.834947 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aa09b6275d104eaca4ea47aebf814610", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aa09b6275d104eaca4ea47aebf814610"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa09b6275d104eaca4ea47aebf814610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa09b6275d104eaca4ea47aebf814610"}]}] Jul 25 12:38:50.834947 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1884950486 Jul 25 12:38:50.834947 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: aa09b6275d104eaca4ea47aebf814610 Jul 25 12:38:50.834947 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1884950486 Jul 25 12:38:50.834947 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AggregatesAdminNegativeTestJSON-1884950486-project Jul 25 12:38:50.834947 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:50.834947 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:50.834947 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8a8f11ae292f457fa9dfb26feda9cc53 Jul 25 12:38:50.834947 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1884950486-project Jul 25 12:38:50.834947 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:38:50.834947 n-d-848886-15 devstack@n-api.service[125883]: {"aggregate": {"name": "tempest-test_aggregate-1735636181"}} Jul 25 12:38:50.834947 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:38:50.834947 n-d-848886-15 devstack@n-api.service[125883]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 25 12:38:50.835800 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1735636181'}}} Jul 25 12:38:50.835800 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:50.835800 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:50.835800 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:50.835800 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:50.835800 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:50.835800 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:50.835800 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:50.835800 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:50.835800 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:38:50.835800 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:38:50.835800 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:38:50.835800 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:38:50.835800 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 25 12:38:50.835800 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 25 12:38:50.835800 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:50.835800 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:50.835800 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:50.835800 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:50.837062 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:50.837062 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:50.837062 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:50.837062 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:50.837062 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:50.837062 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:50.837062 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:50.837062 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:50.837062 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:50.837062 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:50.837062 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 25 12:38:50.837062 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.837062 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:50.837062 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.837062 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:50.837062 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:50.837062 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:50.837062 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:50.837062 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:50.837062 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 25 12:38:50.838698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.838698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7cd80bbf-b279-4d21-8d37-ad2347cf84c4 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:50.838698 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7cd80bbf-b279-4d21-8d37-ad2347cf84c4 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.034695 Jul 25 12:38:50.840130 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 130/235] 10.222.0.49 () {60 vars in 1164 bytes} [Mon Jul 25 12:38:50 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:50.848167 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-759ce025-ac3d-443d-950f-9e84dca2125d tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-996133530"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:50.852632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.aggregate [None req-759ce025-ac3d-443d-950f-9e84dca2125d tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Generated uuid 446fa7b3-41ca-483c-8a06-12248911085e for aggregate {{(pid=125883) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 12:38:50.862881 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4bc74eb2-8c2c-4f7d-b6cd-390f7d993410 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 242 microversion: 2.1 time: 0.209258 Jul 25 12:38:50.864540 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 106/236] 10.222.0.49 () {60 vars in 1191 bytes} [Mon Jul 25 12:38:50 2022] POST /compute/v2.1/os-aggregates/7/action => generated 242 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:50.876667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c80f2707-34d1-4c34-bcbf-34f62e3aa558 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-848886-15"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:50.887627 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:50.887627 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:50.887939 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-759ce025-ac3d-443d-950f-9e84dca2125d tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.043279 Jul 25 12:38:50.888674 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 131/237] 10.222.0.49 () {60 vars in 1164 bytes} [Mon Jul 25 12:38:50 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:50.899610 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-67ce8587-679e-4a8a-9280-a76162a2bb91 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-996133530"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:50.903997 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:50.903997 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:50.908042 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.aggregate [None req-67ce8587-679e-4a8a-9280-a76162a2bb91 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Generated uuid 5e2e6be6-3b53-40a6-be60-f6ba07362b13 for aggregate {{(pid=125883) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 12:38:50.917074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c80f2707-34d1-4c34-bcbf-34f62e3aa558 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:50.918525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c80f2707-34d1-4c34-bcbf-34f62e3aa558 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:50.931313 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-67ce8587-679e-4a8a-9280-a76162a2bb91 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-996133530 already exists. Jul 25 12:38:50.934702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-67ce8587-679e-4a8a-9280-a76162a2bb91 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Request method failure captured: Jul 25 12:38:50.934702 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 25 12:38:50.934702 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:50.934702 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:50.934702 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:50.934702 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 59 Jul 25 12:38:50.934702 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:50.934702 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:50.934702 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:50.934702 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:50.934702 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6kth2toETqk8XfAtW9X1g1wUL6QI8ueZl2Ky5pLyC8OAnKLAdcNOpA8tNYA3Kb7rTMgeeWEEOMcNvmIjR2KV95zU48hABdu3wo7NI6b3eJIyVdUgI1F3VfC1SKsggZ-Sv4P2kbj-mc5JGI7GndLwklx7_Q8Dd085meZQ2Eb4IioGQ Jul 25 12:38:50.934702 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:50.934702 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:50.934702 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:50.934702 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:50.934702 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:50.934702 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:50.934702 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 0e658a3895a948af95d8e167a029e207 Jul 25 12:38:50.934702 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:50.934702 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:38:50.934702 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:38:50.936371 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0e658a3895a948af95d8e167a029e207", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0e658a3895a948af95d8e167a029e207"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0e658a3895a948af95d8e167a029e207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0e658a3895a948af95d8e167a029e207"}]}] Jul 25 12:38:50.936371 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:50.936371 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 0e658a3895a948af95d8e167a029e207 Jul 25 12:38:50.936371 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:50.936371 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin Jul 25 12:38:50.936371 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:50.936371 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:50.936371 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8f2f67a1e4dd407b8fcad1d75460134f Jul 25 12:38:50.936371 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin Jul 25 12:38:50.936371 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:38:50.936371 n-d-848886-15 devstack@n-api.service[125883]: {"aggregate": {"name": "tempest-test_aggregate-996133530"}} Jul 25 12:38:50.936371 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:38:50.936371 n-d-848886-15 devstack@n-api.service[125883]: exception: Aggregate tempest-test_aggregate-996133530 already exists. Jul 25 12:38:50.937585 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-996133530'}}} Jul 25 12:38:50.937585 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:50.937585 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:50.937585 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 25 12:38:50.937585 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 25 12:38:50.937585 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 12:38:50.937585 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 12:38:50.937585 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:50.937585 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:50.937585 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:50.937585 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:50.937585 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 12:38:50.937585 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 12:38:50.937585 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 25 12:38:50.937585 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 25 12:38:50.937585 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 12:38:50.937585 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 12:38:50.937585 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 25 12:38:50.937585 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 25 12:38:50.938947 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:38:50.938947 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:38:50.938947 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 25 12:38:50.938947 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 25 12:38:50.938947 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-996133530 already exists. Jul 25 12:38:50.938947 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.938947 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:50.938947 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.938947 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:50.938947 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:50.938947 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:50.938947 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:50.938947 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:50.938947 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:50.938947 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:50.938947 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:38:50.938947 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:38:50.938947 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:38:50.938947 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:38:50.938947 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 25 12:38:50.941333 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 25 12:38:50.941333 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-996133530 already exists. Jul 25 12:38:50.941333 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.941333 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:50.941333 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.941333 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:50.941333 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:50.941333 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:50.941333 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:50.941333 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:50.941333 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-996133530 already exists. Jul 25 12:38:50.941333 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:50.941333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-67ce8587-679e-4a8a-9280-a76162a2bb91 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-996133530 already exists. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:50.941333 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-67ce8587-679e-4a8a-9280-a76162a2bb91 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.043072 Jul 25 12:38:50.942342 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 132/238] 10.222.0.49 () {60 vars in 1164 bytes} [Mon Jul 25 12:38:50 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 25 12:38:50.951171 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-916b72ac-13f7-4f09-9759-9550e8663bb7 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:50.952079 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:50.952079 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:51.002443 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-916b72ac-13f7-4f09-9759-9550e8663bb7 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.058507 Jul 25 12:38:51.005409 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 133/239] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:38:50 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 12:38:51.016632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4ec9cb7d-486a-4003-902c-3346636e6ce6 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2064431502"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:51.019494 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:51.019494 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:51.021465 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.aggregate [None req-4ec9cb7d-486a-4003-902c-3346636e6ce6 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Generated uuid 49a6a67b-4048-4d81-af7d-4b2745444f4f for aggregate {{(pid=125883) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 12:38:51.059576 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4ec9cb7d-486a-4003-902c-3346636e6ce6 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.047507 Jul 25 12:38:51.061610 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 134/240] 10.222.0.49 () {60 vars in 1164 bytes} [Mon Jul 25 12:38:51 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:51.098230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ecfe50a5-cb7a-4d5e-8844-f58c5f4c9cc5 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:51.099212 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:51.099212 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:51.101033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ecfe50a5-cb7a-4d5e-8844-f58c5f4c9cc5 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '8a8f11ae292f457fa9dfb26feda9cc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b6275d104eaca4ea47aebf814610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:51.102844 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ecfe50a5-cb7a-4d5e-8844-f58c5f4c9cc5 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Request method failure captured: Jul 25 12:38:51.102844 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/os-aggregates/9 HTTP/1.1 Jul 25 12:38:51.102844 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:51.102844 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:51.102844 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:51.102844 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:51.102844 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:51.102844 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:51.102844 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:51.102844 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:51.102844 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6hrA4aZedgta8e_3cEgQGQqSp7YL4Xb7u52c5qPL8OVcp8kYYQpzmXunX5w0L8ZtzsL0bSEwHEeWaUTyMiLQv2wAvrdcty5J2siXLiIA99ygKWJj4npk6LedNjPlXFsR43qEhCjgdRsmEHrS-XQYqs4NsY1SHAh98V8iskw_c9v6o Jul 25 12:38:51.102844 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:51.102844 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:51.102844 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:51.102844 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:51.102844 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:51.102844 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:51.102844 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: aa09b6275d104eaca4ea47aebf814610 Jul 25 12:38:51.102844 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1884950486 Jul 25 12:38:51.102844 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:38:51.102844 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:38:51.104300 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aa09b6275d104eaca4ea47aebf814610", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aa09b6275d104eaca4ea47aebf814610"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa09b6275d104eaca4ea47aebf814610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa09b6275d104eaca4ea47aebf814610"}]}] Jul 25 12:38:51.104300 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1884950486 Jul 25 12:38:51.104300 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: aa09b6275d104eaca4ea47aebf814610 Jul 25 12:38:51.104300 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1884950486 Jul 25 12:38:51.104300 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AggregatesAdminNegativeTestJSON-1884950486-project Jul 25 12:38:51.104300 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:51.104300 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:51.104300 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8a8f11ae292f457fa9dfb26feda9cc53 Jul 25 12:38:51.104300 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1884950486-project Jul 25 12:38:51.104300 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:38:51.104300 n-d-848886-15 devstack@n-api.service[125883]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 25 12:38:51.104300 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '9'} Jul 25 12:38:51.105111 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:51.105111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:51.105111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:51.105111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:51.105111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:51.105111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:51.105111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:51.105111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:51.105111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 25 12:38:51.105111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 25 12:38:51.105111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:51.105111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:51.105111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:51.105111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:51.105111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:51.105111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:51.105111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:51.105111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:51.105111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:51.106498 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:51.106498 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:51.106498 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:51.106498 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:51.106498 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:51.106498 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 25 12:38:51.106498 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.106498 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:51.106498 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.106498 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:51.106498 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:51.106498 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:51.106498 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:51.106498 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:51.106498 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 25 12:38:51.106498 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.108880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ecfe50a5-cb7a-4d5e-8844-f58c5f4c9cc5 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:51.110057 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ecfe50a5-cb7a-4d5e-8844-f58c5f4c9cc5 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/9" status: 403 len: 116 microversion: 2.1 time: 0.041279 Jul 25 12:38:51.114759 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 135/241] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:38:51 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 116 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:51.133703 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-abcd896f-9287-4ece-91a9-18d6d07f4cd0 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Calling method '.version_select at 0x7efcfa37caf0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:51.168892 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c80f2707-34d1-4c34-bcbf-34f62e3aa558 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 226 microversion: 2.1 time: 0.297126 Jul 25 12:38:51.170163 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 107/242] 10.222.0.49 () {60 vars in 1191 bytes} [Mon Jul 25 12:38:50 2022] POST /compute/v2.1/os-aggregates/7/action => generated 226 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:38:51.176028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4776fb34-872b-45ab-861f-10447c13df42 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:51.177192 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:51.177192 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:51.206051 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4776fb34-872b-45ab-861f-10447c13df42 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.034386 Jul 25 12:38:51.211492 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 108/243] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:38:51 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 12:38:51.219337 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a6a236aa-2d55-42f1-91ae-c9bc7f38a820 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:51.222175 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:51.222175 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:51.263264 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a6a236aa-2d55-42f1-91ae-c9bc7f38a820 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.050209 Jul 25 12:38:51.264248 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 109/244] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:38:51 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 12:38:51.274473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e542bd4b-89d7-492f-aa6e-7e4be1d257c0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:51.275722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e542bd4b-89d7-492f-aa6e-7e4be1d257c0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:51.289402 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e542bd4b-89d7-492f-aa6e-7e4be1d257c0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:51.290906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e542bd4b-89d7-492f-aa6e-7e4be1d257c0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:51.293715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e542bd4b-89d7-492f-aa6e-7e4be1d257c0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:51.294473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e542bd4b-89d7-492f-aa6e-7e4be1d257c0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:51.487809 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-abcd896f-9287-4ece-91a9-18d6d07f4cd0 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/76c46e5c24de416b92d25b54c1c940b1/defaults" status: 200 len: 371 microversion: 2.1 time: 0.371420 Jul 25 12:38:51.488886 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 136/245] 10.222.0.49 () {58 vars in 1269 bytes} [Mon Jul 25 12:38:51 2022] GET /compute/v2.1/os-quota-sets/76c46e5c24de416b92d25b54c1c940b1/defaults => generated 371 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:51.496468 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-afc69c4d-bcdf-40b0-b154-2f61ef8ee825 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:51.519440 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-afc69c4d-bcdf-40b0-b154-2f61ef8ee825 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 25 12:38:51.522890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-afc69c4d-bcdf-40b0-b154-2f61ef8ee825 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Request method failure captured: Jul 25 12:38:51.522890 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 25 12:38:51.522890 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:51.522890 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:51.522890 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:51.522890 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:51.522890 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:51.522890 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:51.522890 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:51.522890 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:51.522890 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6kth2toETqk8XfAtW9X1g1wUL6QI8ueZl2Ky5pLyC8OAnKLAdcNOpA8tNYA3Kb7rTMgeeWEEOMcNvmIjR2KV95zU48hABdu3wo7NI6b3eJIyVdUgI1F3VfC1SKsggZ-Sv4P2kbj-mc5JGI7GndLwklx7_Q8Dd085meZQ2Eb4IioGQ Jul 25 12:38:51.522890 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:51.522890 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:51.522890 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:51.522890 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:51.522890 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:51.522890 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:51.522890 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 0e658a3895a948af95d8e167a029e207 Jul 25 12:38:51.522890 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:51.522890 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:38:51.522890 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:38:51.524103 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0e658a3895a948af95d8e167a029e207", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0e658a3895a948af95d8e167a029e207"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0e658a3895a948af95d8e167a029e207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0e658a3895a948af95d8e167a029e207"}]}] Jul 25 12:38:51.524103 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:51.524103 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 0e658a3895a948af95d8e167a029e207 Jul 25 12:38:51.524103 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:51.524103 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin Jul 25 12:38:51.524103 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:51.524103 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:51.524103 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8f2f67a1e4dd407b8fcad1d75460134f Jul 25 12:38:51.524103 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin Jul 25 12:38:51.524103 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:38:51.524103 n-d-848886-15 devstack@n-api.service[125883]: exception: Aggregate -1 could not be found. Jul 25 12:38:51.524103 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '-1'} Jul 25 12:38:51.524789 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:51.524789 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:51.524789 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 25 12:38:51.524789 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 25 12:38:51.524789 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 12:38:51.524789 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 12:38:51.524789 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:51.524789 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:51.524789 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:51.524789 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:51.524789 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 12:38:51.524789 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 12:38:51.524789 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 25 12:38:51.524789 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 12:38:51.524789 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:38:51.524789 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:38:51.524789 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 12:38:51.524789 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 12:38:51.524789 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:38:51.526930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:38:51.526930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 12:38:51.526930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 12:38:51.526930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 25 12:38:51.526930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.526930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:51.526930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.526930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:51.526930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:51.526930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:51.526930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:51.526930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:51.526930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:51.526930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:51.526930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 25 12:38:51.526930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:38:51.526930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 25 12:38:51.526930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.526930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:51.526930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.526930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:51.528933 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:51.528933 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:51.528933 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:51.528933 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:51.528933 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 25 12:38:51.528933 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.530737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-afc69c4d-bcdf-40b0-b154-2f61ef8ee825 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:51.532365 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-afc69c4d-bcdf-40b0-b154-2f61ef8ee825 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.041538 Jul 25 12:38:51.537358 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 137/246] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Jul 25 12:38:51 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:38:51.547622 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c1aebd56-099f-4648-8cc4-fb1120f5398d tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1678851649"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:51.553307 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:51.553307 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:51.555208 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.aggregate [None req-c1aebd56-099f-4648-8cc4-fb1120f5398d tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Generated uuid ffbeea6b-7f8e-451a-bb11-81f7630c80c5 for aggregate {{(pid=125883) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 12:38:51.593550 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c1aebd56-099f-4648-8cc4-fb1120f5398d tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.056304 Jul 25 12:38:51.594777 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 138/247] 10.222.0.49 () {60 vars in 1164 bytes} [Mon Jul 25 12:38:51 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:51.612853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0c9f818c-7d9a-4f3e-af36-5a3703ba6f59 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:51.613950 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0c9f818c-7d9a-4f3e-af36-5a3703ba6f59 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:51.622745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c9f818c-7d9a-4f3e-af36-5a3703ba6f59 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:51.623342 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c9f818c-7d9a-4f3e-af36-5a3703ba6f59 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:51.626638 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c9f818c-7d9a-4f3e-af36-5a3703ba6f59 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:51.627332 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c9f818c-7d9a-4f3e-af36-5a3703ba6f59 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:51.630900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e542bd4b-89d7-492f-aa6e-7e4be1d257c0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:51.647927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e542bd4b-89d7-492f-aa6e-7e4be1d257c0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:51.649629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e542bd4b-89d7-492f-aa6e-7e4be1d257c0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:51.650920 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e542bd4b-89d7-492f-aa6e-7e4be1d257c0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 1319 microversion: 2.25 time: 0.385561 Jul 25 12:38:51.653206 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 110/248] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:38:51 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 1319 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:38:51.661329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8b61be23-c39f-4033-aece-eb3448c97873 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1147857542"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:51.671884 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:51.671884 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:51.673106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.aggregate [None req-8b61be23-c39f-4033-aece-eb3448c97873 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Generated uuid 2b1f86bd-88c6-4123-a4e8-282cf3cfe79f for aggregate {{(pid=125884) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 12:38:51.723993 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8b61be23-c39f-4033-aece-eb3448c97873 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.066297 Jul 25 12:38:51.730456 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 111/249] 10.222.0.49 () {60 vars in 1164 bytes} [Mon Jul 25 12:38:51 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:51.735478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-db817d1b-1a2d-49f6-8116-0658a8663c74 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:51.736988 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:51.736988 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:51.773619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0c9f818c-7d9a-4f3e-af36-5a3703ba6f59 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:51.790935 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-db817d1b-1a2d-49f6-8116-0658a8663c74 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.064236 Jul 25 12:38:51.791390 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0c9f818c-7d9a-4f3e-af36-5a3703ba6f59 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1270 microversion: 2.1 time: 0.195145 Jul 25 12:38:51.791979 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 139/250] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:51 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1270 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:51.794891 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 112/251] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Jul 25 12:38:51 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 12:38:51.806035 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-df6f6c7b-7c1f-4988-b2b3-a87ccff1fff7 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:51.807239 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:51.807239 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:51.807517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5b2a582d-923b-4a80-9905-d44a603c17ac tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:51.808261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-df6f6c7b-7c1f-4988-b2b3-a87ccff1fff7 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '8a8f11ae292f457fa9dfb26feda9cc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b6275d104eaca4ea47aebf814610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:51.810049 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-df6f6c7b-7c1f-4988-b2b3-a87ccff1fff7 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Request method failure captured: Jul 25 12:38:51.810049 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Jul 25 12:38:51.810049 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:51.810049 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:51.810049 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:51.810049 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:51.810049 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:51.810049 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:51.810049 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:51.810049 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:51.810049 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6hrA4aZedgta8e_3cEgQGQqSp7YL4Xb7u52c5qPL8OVcp8kYYQpzmXunX5w0L8ZtzsL0bSEwHEeWaUTyMiLQv2wAvrdcty5J2siXLiIA99ygKWJj4npk6LedNjPlXFsR43qEhCjgdRsmEHrS-XQYqs4NsY1SHAh98V8iskw_c9v6o Jul 25 12:38:51.810049 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:51.810049 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:51.810049 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:51.810049 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:51.810049 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:51.810049 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:51.810049 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: aa09b6275d104eaca4ea47aebf814610 Jul 25 12:38:51.810049 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1884950486 Jul 25 12:38:51.810049 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:38:51.810049 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:38:51.811484 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aa09b6275d104eaca4ea47aebf814610", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aa09b6275d104eaca4ea47aebf814610"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa09b6275d104eaca4ea47aebf814610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa09b6275d104eaca4ea47aebf814610"}]}] Jul 25 12:38:51.811484 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1884950486 Jul 25 12:38:51.811484 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: aa09b6275d104eaca4ea47aebf814610 Jul 25 12:38:51.811484 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1884950486 Jul 25 12:38:51.811484 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AggregatesAdminNegativeTestJSON-1884950486-project Jul 25 12:38:51.811484 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:51.811484 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:51.811484 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8a8f11ae292f457fa9dfb26feda9cc53 Jul 25 12:38:51.811484 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1884950486-project Jul 25 12:38:51.811484 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:38:51.811484 n-d-848886-15 devstack@n-api.service[125883]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 25 12:38:51.811484 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '11'} Jul 25 12:38:51.812522 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:51.812522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:51.812522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:51.812522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:51.812522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:51.812522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:51.812522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:51.812522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:51.812522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 25 12:38:51.812522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 25 12:38:51.812522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:51.812522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:51.812522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:51.812522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:51.812522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:51.812522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:51.812522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:51.812522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:51.812522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:51.813867 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:51.813867 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:51.813867 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:51.813867 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:51.813867 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:51.813867 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 25 12:38:51.813867 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.813867 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:51.813867 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.813867 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:51.813867 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:51.813867 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:51.813867 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:51.813867 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:51.813867 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 25 12:38:51.813867 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.815188 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:51.815188 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:51.815438 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-df6f6c7b-7c1f-4988-b2b3-a87ccff1fff7 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:51.815438 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-df6f6c7b-7c1f-4988-b2b3-a87ccff1fff7 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] 10.222.0.49 "GET /compute/v2.1/os-aggregates/11" status: 403 len: 114 microversion: 2.1 time: 0.019256 Jul 25 12:38:51.818533 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 140/252] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:38:51 2022] GET /compute/v2.1/os-aggregates/11 => generated 114 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:51.822317 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-5b2a582d-923b-4a80-9905-d44a603c17ac tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] HTTP exception thrown: Aggregate 10 could not be found. Jul 25 12:38:51.828853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5b2a582d-923b-4a80-9905-d44a603c17ac tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Request method failure captured: Jul 25 12:38:51.828853 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/os-aggregates/10 HTTP/1.1 Jul 25 12:38:51.828853 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:38:51.828853 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:38:51.828853 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:38:51.828853 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:38:51.828853 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:38:51.828853 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:38:51.828853 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:38:51.828853 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:51.828853 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o6kFI4DJbbMZls4viqDnwFOJNEEyNMMCoM7E8lDUIf3k6QEFxXcozxLfTDLNCobSjgQt7In-nB1CEz1VERr8d2wPvhHJd9jbXBSqXM5YIvekTycqv7d8AscAprppJmVDgRCPcjLazprYJ49uML7LAdVUZ5_PmS10leEmOvzCxMOrms Jul 25 12:38:51.828853 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:38:51.828853 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:38:51.828853 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:38:51.828853 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:38:51.828853 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:38:51.828853 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:38:51.828853 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: aacd1f7d39e84f348b261c6f55d9cd5c Jul 25 12:38:51.828853 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-AggregatesAdminTestJSON-565305655 Jul 25 12:38:51.828853 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,admin,member Jul 25 12:38:51.828853 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,admin,member Jul 25 12:38:51.830425 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aacd1f7d39e84f348b261c6f55d9cd5c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aacd1f7d39e84f348b261c6f55d9cd5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aacd1f7d39e84f348b261c6f55d9cd5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aacd1f7d39e84f348b261c6f55d9cd5c"}]}] Jul 25 12:38:51.830425 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-AggregatesAdminTestJSON-565305655 Jul 25 12:38:51.830425 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: aacd1f7d39e84f348b261c6f55d9cd5c Jul 25 12:38:51.830425 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-565305655 Jul 25 12:38:51.830425 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-AggregatesAdminTestJSON-565305655-project-admin Jul 25 12:38:51.830425 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:38:51.830425 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:38:51.830425 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 77fe111203734b3e866110fa9bc70c37 Jul 25 12:38:51.830425 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-AggregatesAdminTestJSON-565305655-project-admin Jul 25 12:38:51.830425 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:38:51.830425 n-d-848886-15 devstack@n-api.service[125884]: exception: Aggregate 10 could not be found. Jul 25 12:38:51.830425 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '10'} Jul 25 12:38:51.830425 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:51.831347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:51.831347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 25 12:38:51.831347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 25 12:38:51.831347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 25 12:38:51.831347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 12:38:51.831347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:38:51.831347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:38:51.831347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 12:38:51.831347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 12:38:51.831347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:38:51.831347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:38:51.831347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 12:38:51.831347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 12:38:51.831347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 10 could not be found. Jul 25 12:38:51.831347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.831347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:51.831347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.831347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:51.831347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:51.832658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:51.832658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:51.832658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:51.832658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:51.832658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:51.832658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 25 12:38:51.832658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:38:51.832658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 10 could not be found. Jul 25 12:38:51.832658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.832658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:51.832658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.832658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:51.832658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:51.832658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:51.832658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:51.832658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:51.832658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 10 could not be found. Jul 25 12:38:51.832658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.833804 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5b2a582d-923b-4a80-9905-d44a603c17ac tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Returning 404 to user: Aggregate 10 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:51.833804 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5b2a582d-923b-4a80-9905-d44a603c17ac tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/10" status: 404 len: 78 microversion: 2.1 time: 0.026575 Jul 25 12:38:51.834517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2431fb54-56a1-45af-9c6e-0bcb54a92f09 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:51.835154 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:51.835154 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:51.835862 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 113/253] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:38:51 2022] GET /compute/v2.1/os-aggregates/10 => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 25 12:38:51.845862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bee9a636-28a8-41bb-8062-cf3537a73668 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:51.848994 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:51.848994 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:51.876638 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-bee9a636-28a8-41bb-8062-cf3537a73668 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] HTTP exception thrown: Aggregate 10 could not be found. Jul 25 12:38:51.877871 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2431fb54-56a1-45af-9c6e-0bcb54a92f09 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.058246 Jul 25 12:38:51.881556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bee9a636-28a8-41bb-8062-cf3537a73668 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Request method failure captured: Jul 25 12:38:51.881556 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/os-aggregates/10 HTTP/1.1 Jul 25 12:38:51.881556 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:38:51.881556 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:38:51.881556 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:38:51.881556 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:38:51.881556 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:38:51.881556 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:38:51.881556 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:38:51.881556 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:51.881556 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o6kFI4DJbbMZls4viqDnwFOJNEEyNMMCoM7E8lDUIf3k6QEFxXcozxLfTDLNCobSjgQt7In-nB1CEz1VERr8d2wPvhHJd9jbXBSqXM5YIvekTycqv7d8AscAprppJmVDgRCPcjLazprYJ49uML7LAdVUZ5_PmS10leEmOvzCxMOrms Jul 25 12:38:51.881556 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:38:51.881556 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:38:51.881556 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:38:51.881556 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:38:51.881556 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:38:51.881556 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:38:51.881556 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: aacd1f7d39e84f348b261c6f55d9cd5c Jul 25 12:38:51.881556 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-AggregatesAdminTestJSON-565305655 Jul 25 12:38:51.881556 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,admin,member Jul 25 12:38:51.881556 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,admin,member Jul 25 12:38:51.882804 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aacd1f7d39e84f348b261c6f55d9cd5c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aacd1f7d39e84f348b261c6f55d9cd5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aacd1f7d39e84f348b261c6f55d9cd5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aacd1f7d39e84f348b261c6f55d9cd5c"}]}] Jul 25 12:38:51.882804 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-AggregatesAdminTestJSON-565305655 Jul 25 12:38:51.882804 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: aacd1f7d39e84f348b261c6f55d9cd5c Jul 25 12:38:51.882804 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-565305655 Jul 25 12:38:51.882804 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-AggregatesAdminTestJSON-565305655-project-admin Jul 25 12:38:51.882804 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:38:51.882804 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:38:51.882804 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 77fe111203734b3e866110fa9bc70c37 Jul 25 12:38:51.882804 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-AggregatesAdminTestJSON-565305655-project-admin Jul 25 12:38:51.882804 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:38:51.882804 n-d-848886-15 devstack@n-api.service[125884]: exception: Aggregate 10 could not be found. Jul 25 12:38:51.882804 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '10'} Jul 25 12:38:51.882804 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:51.883597 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:51.883597 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 25 12:38:51.883597 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 25 12:38:51.883597 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 12:38:51.883597 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 12:38:51.883597 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:51.883597 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:51.883597 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:51.883597 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:51.883597 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 12:38:51.883597 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 12:38:51.883597 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 25 12:38:51.883597 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 12:38:51.883597 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:38:51.883597 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:38:51.883597 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 12:38:51.883597 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 12:38:51.883597 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:38:51.883597 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:38:51.885403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 12:38:51.885403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 12:38:51.885403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 10 could not be found. Jul 25 12:38:51.885403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.885403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:51.885403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.885403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:51.885403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:51.885403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:51.885403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:51.885403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:51.885403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:51.885403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:51.885403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 25 12:38:51.885403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:38:51.885403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 10 could not be found. Jul 25 12:38:51.885403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.885403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:51.885403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.885403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:51.885403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:51.887031 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:51.887031 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:51.887031 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:51.887031 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 10 could not be found. Jul 25 12:38:51.887031 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.887363 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 141/254] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Jul 25 12:38:51 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 12:38:51.891000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bee9a636-28a8-41bb-8062-cf3537a73668 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Returning 404 to user: Aggregate 10 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:51.894305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fcee19e6-41a1-4554-bdc6-3fbcbe4d9039 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:51.896960 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:51.896960 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:51.898393 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bee9a636-28a8-41bb-8062-cf3537a73668 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/10" status: 404 len: 78 microversion: 2.1 time: 0.052731 Jul 25 12:38:51.905461 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 114/255] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Jul 25 12:38:51 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 78 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:38:51.909739 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-fcee19e6-41a1-4554-bdc6-3fbcbe4d9039 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 25 12:38:51.914047 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fcee19e6-41a1-4554-bdc6-3fbcbe4d9039 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Request method failure captured: Jul 25 12:38:51.914047 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 25 12:38:51.914047 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:51.914047 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:51.914047 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:51.914047 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:51.914047 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:51.914047 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:51.914047 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:51.914047 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:51.914047 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6kth2toETqk8XfAtW9X1g1wUL6QI8ueZl2Ky5pLyC8OAnKLAdcNOpA8tNYA3Kb7rTMgeeWEEOMcNvmIjR2KV95zU48hABdu3wo7NI6b3eJIyVdUgI1F3VfC1SKsggZ-Sv4P2kbj-mc5JGI7GndLwklx7_Q8Dd085meZQ2Eb4IioGQ Jul 25 12:38:51.914047 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:51.914047 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:51.914047 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:51.914047 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:51.914047 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:51.914047 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:51.914047 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 0e658a3895a948af95d8e167a029e207 Jul 25 12:38:51.914047 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:51.914047 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:38:51.914047 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:38:51.915592 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0e658a3895a948af95d8e167a029e207", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0e658a3895a948af95d8e167a029e207"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0e658a3895a948af95d8e167a029e207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0e658a3895a948af95d8e167a029e207"}]}] Jul 25 12:38:51.915592 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:51.915592 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 0e658a3895a948af95d8e167a029e207 Jul 25 12:38:51.915592 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:51.915592 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin Jul 25 12:38:51.915592 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:51.915592 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:51.915592 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8f2f67a1e4dd407b8fcad1d75460134f Jul 25 12:38:51.915592 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin Jul 25 12:38:51.915592 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:38:51.915592 n-d-848886-15 devstack@n-api.service[125883]: exception: Aggregate -1 could not be found. Jul 25 12:38:51.915592 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '-1'} Jul 25 12:38:51.916402 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:51.916402 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:51.916402 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 25 12:38:51.916402 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 25 12:38:51.916402 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 25 12:38:51.916402 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 12:38:51.916402 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:38:51.916402 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:38:51.916402 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 12:38:51.916402 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 12:38:51.916402 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:38:51.916402 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:38:51.916402 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 12:38:51.916402 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 12:38:51.916402 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 25 12:38:51.916402 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.916402 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:51.916402 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.916402 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:51.916402 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:51.917689 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:51.917689 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:51.917689 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:51.917689 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:51.917689 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:51.917689 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 25 12:38:51.917689 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:38:51.917689 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 25 12:38:51.917689 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.917689 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:51.917689 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.917689 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:51.917689 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:51.917689 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:51.917689 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:51.917689 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:51.917689 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 25 12:38:51.917689 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.919505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fcee19e6-41a1-4554-bdc6-3fbcbe4d9039 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:51.920933 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-631d5879-90e7-4e1a-bf39-fb0b7533a21d tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-471343308", "name": "tempest-test_aggregate-939601714"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:51.922420 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fcee19e6-41a1-4554-bdc6-3fbcbe4d9039 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.036558 Jul 25 12:38:51.927784 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 142/256] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:38:51 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:38:51.938650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7c1fec5f-02f7-43db-be73-a59c180d5ede tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:51.943978 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:51.943978 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:51.945823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7c1fec5f-02f7-43db-be73-a59c180d5ede tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '8a8f11ae292f457fa9dfb26feda9cc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b6275d104eaca4ea47aebf814610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:51.948042 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7c1fec5f-02f7-43db-be73-a59c180d5ede tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Request method failure captured: Jul 25 12:38:51.948042 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 25 12:38:51.948042 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:51.948042 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:51.948042 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:51.948042 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:51.948042 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:51.948042 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:51.948042 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:51.948042 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:51.948042 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6hrA4aZedgta8e_3cEgQGQqSp7YL4Xb7u52c5qPL8OVcp8kYYQpzmXunX5w0L8ZtzsL0bSEwHEeWaUTyMiLQv2wAvrdcty5J2siXLiIA99ygKWJj4npk6LedNjPlXFsR43qEhCjgdRsmEHrS-XQYqs4NsY1SHAh98V8iskw_c9v6o Jul 25 12:38:51.948042 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:51.948042 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:51.948042 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:51.948042 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:51.948042 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:51.948042 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:51.948042 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: aa09b6275d104eaca4ea47aebf814610 Jul 25 12:38:51.948042 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1884950486 Jul 25 12:38:51.948042 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:38:51.948042 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:38:51.950541 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aa09b6275d104eaca4ea47aebf814610", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aa09b6275d104eaca4ea47aebf814610"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa09b6275d104eaca4ea47aebf814610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa09b6275d104eaca4ea47aebf814610"}]}] Jul 25 12:38:51.950541 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1884950486 Jul 25 12:38:51.950541 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: aa09b6275d104eaca4ea47aebf814610 Jul 25 12:38:51.950541 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1884950486 Jul 25 12:38:51.950541 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AggregatesAdminNegativeTestJSON-1884950486-project Jul 25 12:38:51.950541 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:51.950541 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:51.950541 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8a8f11ae292f457fa9dfb26feda9cc53 Jul 25 12:38:51.950541 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1884950486-project Jul 25 12:38:51.950541 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:38:51.950541 n-d-848886-15 devstack@n-api.service[125883]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 25 12:38:51.950541 n-d-848886-15 devstack@n-api.service[125883]: action_args: {} Jul 25 12:38:51.951914 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:51.951914 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:51.951914 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:51.951914 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:51.951914 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:51.951914 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:51.951914 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:51.951914 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:51.951914 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 25 12:38:51.951914 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 25 12:38:51.951914 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:51.951914 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:51.951914 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:51.951914 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:51.951914 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:51.951914 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:51.951914 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:51.951914 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:51.951914 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:51.954085 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:51.954085 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:51.954085 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:51.954085 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:51.954085 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:51.954085 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 25 12:38:51.954085 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.954085 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:51.954085 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.954085 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:51.954085 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:51.954085 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:51.954085 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:51.954085 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:51.954085 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 25 12:38:51.954085 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:51.954085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7c1fec5f-02f7-43db-be73-a59c180d5ede tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:51.956201 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7c1fec5f-02f7-43db-be73-a59c180d5ede tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.020975 Jul 25 12:38:51.957747 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:51.957747 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:51.958088 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 143/257] 10.222.0.49 () {58 vars in 1143 bytes} [Mon Jul 25 12:38:51 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 25 12:38:51.959655 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.aggregate [None req-631d5879-90e7-4e1a-bf39-fb0b7533a21d tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Generated uuid f1131338-15bd-4c3e-a62c-163d4cc414cb for aggregate {{(pid=125884) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 12:38:51.977953 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f00ad7a6-ad94-4b20-9b1b-90b88deacf15 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Action: 'update', calling method: .version_select at 0x7efcfa926280>, body: {"quota_set": {"ram": "5120"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:52.002852 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-631d5879-90e7-4e1a-bf39-fb0b7533a21d tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.096025 Jul 25 12:38:52.003915 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 115/258] 10.222.0.49 () {60 vars in 1165 bytes} [Mon Jul 25 12:38:51 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:52.022434 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7e573ac4-ad3f-403d-b1fa-99d8cbca3ebf tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-542438435"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:52.025436 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:52.025436 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:52.026743 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.aggregate [None req-7e573ac4-ad3f-403d-b1fa-99d8cbca3ebf tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Generated uuid 027a0399-2f4c-4efa-9076-21c775a7b652 for aggregate {{(pid=125884) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 12:38:52.063368 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7e573ac4-ad3f-403d-b1fa-99d8cbca3ebf tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.046962 Jul 25 12:38:52.064011 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 116/259] 10.222.0.49 () {60 vars in 1164 bytes} [Mon Jul 25 12:38:52 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:52.079395 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6ecec717-58d9-4d1f-9897-cba5dfcad31a tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:52.080557 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:52.080557 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:52.137605 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6ecec717-58d9-4d1f-9897-cba5dfcad31a tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.061706 Jul 25 12:38:52.138558 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 117/260] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Jul 25 12:38:52 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 12:38:52.143301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ea5031a9-e3cd-4774-88f9-dc6be299f3da tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-848886-15"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:52.145939 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:52.145939 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:52.173336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea5031a9-e3cd-4774-88f9-dc6be299f3da tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:52.174041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea5031a9-e3cd-4774-88f9-dc6be299f3da tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:52.298653 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f00ad7a6-ad94-4b20-9b1b-90b88deacf15 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:52.299085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f00ad7a6-ad94-4b20-9b1b-90b88deacf15 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:52.303165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f00ad7a6-ad94-4b20-9b1b-90b88deacf15 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:52.305500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f00ad7a6-ad94-4b20-9b1b-90b88deacf15 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:52.477339 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ea5031a9-e3cd-4774-88f9-dc6be299f3da tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.338140 Jul 25 12:38:52.477988 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 118/261] 10.222.0.49 () {60 vars in 1194 bytes} [Mon Jul 25 12:38:52 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:52.490352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-38dcf9f1-a546-46ff-aa5d-7392907a95e3 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:52.491129 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:52.491129 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:52.492553 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f00ad7a6-ad94-4b20-9b1b-90b88deacf15 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/0a3259d01520470199ce46d2b368a2af" status: 200 len: 328 microversion: 2.1 time: 0.527658 Jul 25 12:38:52.493511 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 144/262] 10.222.0.49 () {60 vars in 1262 bytes} [Mon Jul 25 12:38:51 2022] PUT /compute/v2.1/os-quota-sets/0a3259d01520470199ce46d2b368a2af => generated 328 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:52.499405 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bcdccb18-60b3-4eac-8092-a90831b3d9e5 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-848886-15"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:52.504842 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:52.504842 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:52.506871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bcdccb18-60b3-4eac-8092-a90831b3d9e5 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '8a8f11ae292f457fa9dfb26feda9cc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b6275d104eaca4ea47aebf814610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:52.509158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bcdccb18-60b3-4eac-8092-a90831b3d9e5 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Request method failure captured: Jul 25 12:38:52.509158 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Jul 25 12:38:52.509158 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:52.509158 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:52.509158 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:52.509158 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 43 Jul 25 12:38:52.509158 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:52.509158 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:52.509158 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:52.509158 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:52.509158 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6hrA4aZedgta8e_3cEgQGQqSp7YL4Xb7u52c5qPL8OVcp8kYYQpzmXunX5w0L8ZtzsL0bSEwHEeWaUTyMiLQv2wAvrdcty5J2siXLiIA99ygKWJj4npk6LedNjPlXFsR43qEhCjgdRsmEHrS-XQYqs4NsY1SHAh98V8iskw_c9v6o Jul 25 12:38:52.509158 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:52.509158 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:52.509158 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:52.509158 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:52.509158 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:52.509158 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:52.509158 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: aa09b6275d104eaca4ea47aebf814610 Jul 25 12:38:52.509158 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1884950486 Jul 25 12:38:52.509158 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:38:52.509158 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:38:52.510837 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aa09b6275d104eaca4ea47aebf814610", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aa09b6275d104eaca4ea47aebf814610"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa09b6275d104eaca4ea47aebf814610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa09b6275d104eaca4ea47aebf814610"}]}] Jul 25 12:38:52.510837 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1884950486 Jul 25 12:38:52.510837 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: aa09b6275d104eaca4ea47aebf814610 Jul 25 12:38:52.510837 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1884950486 Jul 25 12:38:52.510837 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AggregatesAdminNegativeTestJSON-1884950486-project Jul 25 12:38:52.510837 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:52.510837 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:52.510837 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8a8f11ae292f457fa9dfb26feda9cc53 Jul 25 12:38:52.510837 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1884950486-project Jul 25 12:38:52.510837 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:38:52.510837 n-d-848886-15 devstack@n-api.service[125883]: {"remove_host": {"host": "n-h2-848886-15"}} Jul 25 12:38:52.510837 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:38:52.510837 n-d-848886-15 devstack@n-api.service[125883]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 25 12:38:52.511637 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h2-848886-15'}}} Jul 25 12:38:52.511637 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:52.511637 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:52.511637 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:52.511637 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:52.511637 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:52.511637 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:52.511637 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:52.511637 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:52.511637 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:38:52.511637 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:38:52.511637 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 25 12:38:52.511637 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 25 12:38:52.511637 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:38:52.511637 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:38:52.511637 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:38:52.511637 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:38:52.511637 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:52.511637 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:52.512653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:52.512653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:52.512653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:38:52.512653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:38:52.512653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:38:52.512653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:38:52.512653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:38:52.512653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:38:52.512653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 25 12:38:52.512653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:52.512653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:52.512653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:52.512653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:52.512653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:52.512653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:52.512653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:38:52.512653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:38:52.512653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 25 12:38:52.512653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:52.514135 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-38dcf9f1-a546-46ff-aa5d-7392907a95e3 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jul 25 12:38:52.515253 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bcdccb18-60b3-4eac-8092-a90831b3d9e5 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:52.516524 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bcdccb18-60b3-4eac-8092-a90831b3d9e5 tempest-AggregatesAdminNegativeTestJSON-1884950486 tempest-AggregatesAdminNegativeTestJSON-1884950486-project] 10.222.0.49 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.021801 Jul 25 12:38:52.517608 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 145/263] 10.222.0.49 () {60 vars in 1194 bytes} [Mon Jul 25 12:38:52 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:52.522635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-38dcf9f1-a546-46ff-aa5d-7392907a95e3 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Request method failure captured: Jul 25 12:38:52.522635 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Jul 25 12:38:52.522635 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:38:52.522635 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:38:52.522635 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:38:52.522635 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:38:52.522635 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:38:52.522635 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:38:52.522635 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:38:52.522635 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:52.522635 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o6kFI4DJbbMZls4viqDnwFOJNEEyNMMCoM7E8lDUIf3k6QEFxXcozxLfTDLNCobSjgQt7In-nB1CEz1VERr8d2wPvhHJd9jbXBSqXM5YIvekTycqv7d8AscAprppJmVDgRCPcjLazprYJ49uML7LAdVUZ5_PmS10leEmOvzCxMOrms Jul 25 12:38:52.522635 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:38:52.522635 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:38:52.522635 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:38:52.522635 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:38:52.522635 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:38:52.522635 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:38:52.522635 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: aacd1f7d39e84f348b261c6f55d9cd5c Jul 25 12:38:52.522635 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-AggregatesAdminTestJSON-565305655 Jul 25 12:38:52.522635 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,admin,member Jul 25 12:38:52.522635 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,admin,member Jul 25 12:38:52.523873 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aacd1f7d39e84f348b261c6f55d9cd5c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aacd1f7d39e84f348b261c6f55d9cd5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aacd1f7d39e84f348b261c6f55d9cd5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aacd1f7d39e84f348b261c6f55d9cd5c"}]}] Jul 25 12:38:52.523873 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-AggregatesAdminTestJSON-565305655 Jul 25 12:38:52.523873 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: aacd1f7d39e84f348b261c6f55d9cd5c Jul 25 12:38:52.523873 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-565305655 Jul 25 12:38:52.523873 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-AggregatesAdminTestJSON-565305655-project-admin Jul 25 12:38:52.523873 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:38:52.523873 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:38:52.523873 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 77fe111203734b3e866110fa9bc70c37 Jul 25 12:38:52.523873 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-AggregatesAdminTestJSON-565305655-project-admin Jul 25 12:38:52.523873 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:38:52.523873 n-d-848886-15 devstack@n-api.service[125884]: exception: Aggregate 12 could not be found. Jul 25 12:38:52.523873 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '12'} Jul 25 12:38:52.523873 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:52.524790 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:52.524790 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 25 12:38:52.524790 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 25 12:38:52.524790 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 25 12:38:52.524790 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 12:38:52.524790 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:38:52.524790 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:38:52.524790 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 12:38:52.524790 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 12:38:52.524790 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:38:52.524790 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:38:52.524790 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 12:38:52.524790 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 12:38:52.524790 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Jul 25 12:38:52.524790 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:52.524790 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:52.524790 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:52.524790 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:52.524790 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:52.525809 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:52.525809 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:52.525809 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:52.525809 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:52.525809 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:52.525809 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 25 12:38:52.525809 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:38:52.525809 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Jul 25 12:38:52.525809 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:52.525809 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:52.525809 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:52.525809 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:52.525809 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:52.525809 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:52.525809 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:52.525809 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:52.525809 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Jul 25 12:38:52.525809 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:52.526797 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-38dcf9f1-a546-46ff-aa5d-7392907a95e3 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:52.526797 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-38dcf9f1-a546-46ff-aa5d-7392907a95e3 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.038178 Jul 25 12:38:52.529364 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8f2858c8-a5ee-402a-8381-44f7d699ae11 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Calling method '.version_select at 0x7efcfa3819d0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:52.529516 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 119/264] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:38:52 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:38:52.545946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6e620850-9b67-49c7-8387-edc4545f9da1 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-848886-15"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:52.548505 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:52.548505 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:52.567173 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e620850-9b67-49c7-8387-edc4545f9da1 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:52.568166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e620850-9b67-49c7-8387-edc4545f9da1 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:52.636886 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f2858c8-a5ee-402a-8381-44f7d699ae11 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:52.660692 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f2858c8-a5ee-402a-8381-44f7d699ae11 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:52.662390 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f2858c8-a5ee-402a-8381-44f7d699ae11 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:52.663891 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f2858c8-a5ee-402a-8381-44f7d699ae11 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:52.749378 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8f2858c8-a5ee-402a-8381-44f7d699ae11 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/0a3259d01520470199ce46d2b368a2af/detail" status: 200 len: 916 microversion: 2.1 time: 0.230377 Jul 25 12:38:52.750838 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 146/265] 10.222.0.49 () {58 vars in 1263 bytes} [Mon Jul 25 12:38:52 2022] GET /compute/v2.1/os-quota-sets/0a3259d01520470199ce46d2b368a2af/detail => generated 916 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:52.761532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e01d679b-4158-4b71-a341-91ffdb5a32d8 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:52.762811 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:52.762811 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:52.801046 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6e620850-9b67-49c7-8387-edc4545f9da1 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.270334 Jul 25 12:38:52.802529 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 120/266] 10.222.0.49 () {60 vars in 1194 bytes} [Mon Jul 25 12:38:52 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:52.812885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d053cb80-7604-45dd-be35-4c0fa5b8ea30 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:52.818253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d053cb80-7604-45dd-be35-4c0fa5b8ea30 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:52.824831 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-e01d679b-4158-4b71-a341-91ffdb5a32d8 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jul 25 12:38:52.832270 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e01d679b-4158-4b71-a341-91ffdb5a32d8 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Request method failure captured: Jul 25 12:38:52.832270 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Jul 25 12:38:52.832270 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:52.832270 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:52.832270 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:52.832270 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:52.832270 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:52.832270 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:52.832270 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:52.832270 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:52.832270 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6kFI4DJbbMZls4viqDnwFOJNEEyNMMCoM7E8lDUIf3k6QEFxXcozxLfTDLNCobSjgQt7In-nB1CEz1VERr8d2wPvhHJd9jbXBSqXM5YIvekTycqv7d8AscAprppJmVDgRCPcjLazprYJ49uML7LAdVUZ5_PmS10leEmOvzCxMOrms Jul 25 12:38:52.832270 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:52.832270 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:52.832270 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:52.832270 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:52.832270 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:52.832270 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:52.832270 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: aacd1f7d39e84f348b261c6f55d9cd5c Jul 25 12:38:52.832270 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AggregatesAdminTestJSON-565305655 Jul 25 12:38:52.832270 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:38:52.832270 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:38:52.833799 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aacd1f7d39e84f348b261c6f55d9cd5c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aacd1f7d39e84f348b261c6f55d9cd5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aacd1f7d39e84f348b261c6f55d9cd5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aacd1f7d39e84f348b261c6f55d9cd5c"}]}] Jul 25 12:38:52.833799 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AggregatesAdminTestJSON-565305655 Jul 25 12:38:52.833799 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: aacd1f7d39e84f348b261c6f55d9cd5c Jul 25 12:38:52.833799 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-565305655 Jul 25 12:38:52.833799 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AggregatesAdminTestJSON-565305655-project-admin Jul 25 12:38:52.833799 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:52.833799 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:52.833799 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 77fe111203734b3e866110fa9bc70c37 Jul 25 12:38:52.833799 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AggregatesAdminTestJSON-565305655-project-admin Jul 25 12:38:52.833799 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:38:52.833799 n-d-848886-15 devstack@n-api.service[125883]: exception: Aggregate 12 could not be found. Jul 25 12:38:52.833799 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '12'} Jul 25 12:38:52.833799 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:52.834876 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:52.834876 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 25 12:38:52.834876 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 25 12:38:52.834876 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 12:38:52.834876 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 12:38:52.834876 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:52.834876 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:52.834876 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:52.834876 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:52.834876 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 12:38:52.834876 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 12:38:52.834876 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 25 12:38:52.834876 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 12:38:52.834876 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:38:52.834876 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:38:52.834876 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 12:38:52.834876 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 12:38:52.834876 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:38:52.834876 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:38:52.836150 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 12:38:52.836150 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 12:38:52.836150 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Jul 25 12:38:52.836150 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:52.836150 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:52.836150 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:52.836150 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:52.836150 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:52.836150 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:52.836150 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:52.836150 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:52.836150 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:52.836150 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:52.836150 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 25 12:38:52.836150 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:38:52.836150 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Jul 25 12:38:52.836150 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:52.836150 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:52.836150 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:52.836150 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:52.836150 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:52.837623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:52.837623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:52.837623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:52.837623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Jul 25 12:38:52.837623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:52.837623 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e01d679b-4158-4b71-a341-91ffdb5a32d8 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:52.838304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d053cb80-7604-45dd-be35-4c0fa5b8ea30 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:52.838304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d053cb80-7604-45dd-be35-4c0fa5b8ea30 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:52.838490 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e01d679b-4158-4b71-a341-91ffdb5a32d8 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.083220 Jul 25 12:38:52.838621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d053cb80-7604-45dd-be35-4c0fa5b8ea30 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:52.840398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d053cb80-7604-45dd-be35-4c0fa5b8ea30 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:52.840977 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 147/267] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Jul 25 12:38:52 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:38:52.851810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6cf82634-05a1-4cc2-963c-adf374d8800c tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:52.899251 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6cf82634-05a1-4cc2-963c-adf374d8800c tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.056472 Jul 25 12:38:52.904617 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 148/268] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Jul 25 12:38:52 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 12:38:52.906437 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8c7162dc-1418-4401-8fd4-2ee52ac829b7 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:52.907265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8c7162dc-1418-4401-8fd4-2ee52ac829b7 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:52.914881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c7162dc-1418-4401-8fd4-2ee52ac829b7 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:52.915614 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c7162dc-1418-4401-8fd4-2ee52ac829b7 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:52.916560 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c7162dc-1418-4401-8fd4-2ee52ac829b7 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:52.917189 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c7162dc-1418-4401-8fd4-2ee52ac829b7 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:53.219139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8c7162dc-1418-4401-8fd4-2ee52ac829b7 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:53.229111 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8c7162dc-1418-4401-8fd4-2ee52ac829b7 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1270 microversion: 2.1 time: 0.327548 Jul 25 12:38:53.231840 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 149/269] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:52 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1270 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:53.262824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1dfc2bb6-feec-4cac-b83f-b9fc962edb44 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-446568640"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:53.266402 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:53.266402 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:53.268019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.aggregate [None req-1dfc2bb6-feec-4cac-b83f-b9fc962edb44 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Generated uuid 0c77e977-eda5-4105-afba-da145a5c17b5 for aggregate {{(pid=125883) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 12:38:53.310863 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1dfc2bb6-feec-4cac-b83f-b9fc962edb44 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.052310 Jul 25 12:38:53.318686 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 150/270] 10.222.0.49 () {60 vars in 1164 bytes} [Mon Jul 25 12:38:53 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:53.319925 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-81431dbb-ca40-491c-872c-766ee91794fa tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-710738295"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:53.326952 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:53.326952 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:53.332217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.aggregate [None req-81431dbb-ca40-491c-872c-766ee91794fa tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Generated uuid 2b412334-9b68-4fb8-8a6e-15b23cad3866 for aggregate {{(pid=125883) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 12:38:53.387914 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-81431dbb-ca40-491c-872c-766ee91794fa tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.074534 Jul 25 12:38:53.389396 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 151/271] 10.222.0.49 () {60 vars in 1164 bytes} [Mon Jul 25 12:38:53 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:53.398046 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6343aa48-acef-4c96-bbdf-ab8ddfd3c94b tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Action: 'update', calling method: .version_select at 0x7efcfa3dfc10>, body: {"quota_set": {"ram": "2048"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:53.494663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6343aa48-acef-4c96-bbdf-ab8ddfd3c94b tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:53.499171 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6343aa48-acef-4c96-bbdf-ab8ddfd3c94b tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:53.500403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6343aa48-acef-4c96-bbdf-ab8ddfd3c94b tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:53.501128 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6343aa48-acef-4c96-bbdf-ab8ddfd3c94b tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:53.534846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d053cb80-7604-45dd-be35-4c0fa5b8ea30 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:53.554721 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d053cb80-7604-45dd-be35-4c0fa5b8ea30 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:53.556360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d053cb80-7604-45dd-be35-4c0fa5b8ea30 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:53.557530 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d053cb80-7604-45dd-be35-4c0fa5b8ea30 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 1361 microversion: 2.25 time: 0.753889 Jul 25 12:38:53.567821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6343aa48-acef-4c96-bbdf-ab8ddfd3c94b tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:53.568512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6343aa48-acef-4c96-bbdf-ab8ddfd3c94b tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:53.569494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6343aa48-acef-4c96-bbdf-ab8ddfd3c94b tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:53.570113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6343aa48-acef-4c96-bbdf-ab8ddfd3c94b tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:53.575334 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 121/272] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:38:52 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 1361 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:38:53.583802 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-94138c8a-fbfc-4bab-89f8-e0bdc92dc713 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:53.584666 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:53.584666 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:53.596644 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-94138c8a-fbfc-4bab-89f8-e0bdc92dc713 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 227 microversion: 2.1 time: 0.020107 Jul 25 12:38:53.597471 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 122/273] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:38:53 2022] GET /compute/v2.1/os-aggregates/14 => generated 227 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:53.603481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bd07f243-0e3c-4abc-8871-86044ba5665e tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:53.608948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:DELETE=11,nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:38:53.620814 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:53.620814 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:53.642661 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd07f243-0e3c-4abc-8871-86044ba5665e tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:53.643115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd07f243-0e3c-4abc-8871-86044ba5665e tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:53.665588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd07f243-0e3c-4abc-8871-86044ba5665e tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:53.666338 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd07f243-0e3c-4abc-8871-86044ba5665e tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:53.674147 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6343aa48-acef-4c96-bbdf-ab8ddfd3c94b tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/0a3259d01520470199ce46d2b368a2af?user_id=1aa378917df343c6b60c39a8762ac15c" status: 200 len: 328 microversion: 2.1 time: 0.283425 Jul 25 12:38:53.675580 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 152/274] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Jul 25 12:38:53 2022] PUT /compute/v2.1/os-quota-sets/0a3259d01520470199ce46d2b368a2af?user_id=1aa378917df343c6b60c39a8762ac15c => generated 328 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:53.682547 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.compute.aggregates [None req-bd07f243-0e3c-4abc-8871-86044ba5665e tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 25 12:38:53.688107 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-bd07f243-0e3c-4abc-8871-86044ba5665e tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Jul 25 12:38:53.692197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a88b47e1-b031-404e-b4b7-641b0f738b73 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:53.693603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bd07f243-0e3c-4abc-8871-86044ba5665e tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Request method failure captured: Jul 25 12:38:53.693603 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Jul 25 12:38:53.693603 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:38:53.693603 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:38:53.693603 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:38:53.693603 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 42 Jul 25 12:38:53.693603 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:38:53.693603 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:38:53.693603 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:38:53.693603 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:53.693603 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o6kth2toETqk8XfAtW9X1g1wUL6QI8ueZl2Ky5pLyC8OAnKLAdcNOpA8tNYA3Kb7rTMgeeWEEOMcNvmIjR2KV95zU48hABdu3wo7NI6b3eJIyVdUgI1F3VfC1SKsggZ-Sv4P2kbj-mc5JGI7GndLwklx7_Q8Dd085meZQ2Eb4IioGQ Jul 25 12:38:53.693603 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:38:53.693603 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:38:53.693603 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:38:53.693603 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:38:53.693603 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:38:53.693603 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:38:53.693603 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 0e658a3895a948af95d8e167a029e207 Jul 25 12:38:53.693603 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:53.693603 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,admin,member Jul 25 12:38:53.693603 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,admin,member Jul 25 12:38:53.695548 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0e658a3895a948af95d8e167a029e207", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0e658a3895a948af95d8e167a029e207"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0e658a3895a948af95d8e167a029e207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0e658a3895a948af95d8e167a029e207"}]}] Jul 25 12:38:53.695548 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:53.695548 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 0e658a3895a948af95d8e167a029e207 Jul 25 12:38:53.695548 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624 Jul 25 12:38:53.695548 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin Jul 25 12:38:53.695548 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:38:53.695548 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:38:53.695548 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 8f2f67a1e4dd407b8fcad1d75460134f Jul 25 12:38:53.695548 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin Jul 25 12:38:53.695548 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:38:53.695548 n-d-848886-15 devstack@n-api.service[125884]: {"remove_host": {"host": "nonexist_host"}} Jul 25 12:38:53.695548 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:38:53.695548 n-d-848886-15 devstack@n-api.service[125884]: exception: Cannot remove host nonexist_host in aggregate 15 Jul 25 12:38:53.696431 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 25 12:38:53.696431 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:53.696431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:53.696431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 25 12:38:53.696431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 25 12:38:53.696431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:38:53.696431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:38:53.696431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 12:38:53.696431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 12:38:53.696431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:38:53.696431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:38:53.696431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 12:38:53.696431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 12:38:53.696431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 25 12:38:53.696431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:53.696431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:53.696431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:53.696431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:53.696431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 25 12:38:53.696431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 25 12:38:53.697769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 25 12:38:53.697769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 25 12:38:53.697769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 25 12:38:53.697769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:53.697769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:53.697769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:53.697769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:53.697769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 25 12:38:53.697769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 25 12:38:53.697769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 12:38:53.697769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 12:38:53.697769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:38:53.697769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:38:53.697769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:38:53.697769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:38:53.697769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 12:38:53.697769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 12:38:53.697769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 25 12:38:53.697769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 25 12:38:53.697769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 25 12:38:53.699225 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 25 12:38:53.699225 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 25 12:38:53.699225 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:53.699225 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:53.699225 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:53.699225 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:53.699225 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:53.699225 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:53.699225 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:53.699225 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:53.699225 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:53.699225 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:53.699225 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:38:53.699225 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:38:53.699225 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 25 12:38:53.699225 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 12:38:53.699225 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Jul 25 12:38:53.699225 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:53.699225 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:53.699225 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:53.699225 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:53.700703 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:53.700703 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:53.700703 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:53.700703 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:53.700703 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Jul 25 12:38:53.700703 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:38:53.709415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bd07f243-0e3c-4abc-8871-86044ba5665e tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:53.710439 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bd07f243-0e3c-4abc-8871-86044ba5665e tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.111711 Jul 25 12:38:53.716840 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:53.716840 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:53.719297 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 123/275] 10.222.0.49 () {60 vars in 1194 bytes} [Mon Jul 25 12:38:53 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:38:53.733673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ec6885d1-ec9d-4d45-9aba-4ed577919cc8 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Calling method '.version_select at 0x7efcfa6e1f70>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:53.773804 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a88b47e1-b031-404e-b4b7-641b0f738b73 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 265 microversion: 2.1 time: 0.095557 Jul 25 12:38:53.775589 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 153/276] 10.222.0.49 () {60 vars in 1194 bytes} [Mon Jul 25 12:38:53 2022] POST /compute/v2.1/os-aggregates/14/action => generated 265 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:53.784550 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5a016147-77d7-4ee2-b588-aa6fbec0c996 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:53.785639 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:53.785639 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:53.818609 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5a016147-77d7-4ee2-b588-aa6fbec0c996 tempest-AggregatesAdminNegativeTestJSON-1531771624 tempest-AggregatesAdminNegativeTestJSON-1531771624-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.040497 Jul 25 12:38:53.819786 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 154/277] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Jul 25 12:38:53 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 12:38:53.834573 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a288213c-6063-4b35-b082-996382aa7fbe tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:53.835435 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:53.835435 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:53.855311 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a288213c-6063-4b35-b082-996382aa7fbe tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 241 microversion: 2.1 time: 0.034239 Jul 25 12:38:53.861554 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 155/278] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:38:53 2022] GET /compute/v2.1/os-aggregates/14 => generated 241 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:53.890142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-08473c3b-4cdc-4062-856e-2e2ace3a7b0d tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:53.892037 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:53.892037 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:53.895196 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=11,nova_api:INSERT=8 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:38:53.928043 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ec6885d1-ec9d-4d45-9aba-4ed577919cc8 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/0a3259d01520470199ce46d2b368a2af?user_id=1aa378917df343c6b60c39a8762ac15c" status: 200 len: 370 microversion: 2.1 time: 0.206927 Jul 25 12:38:53.928958 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 124/279] 10.222.0.49 () {58 vars in 1323 bytes} [Mon Jul 25 12:38:53 2022] GET /compute/v2.1/os-quota-sets/0a3259d01520470199ce46d2b368a2af?user_id=1aa378917df343c6b60c39a8762ac15c => generated 370 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:53.953003 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-08473c3b-4cdc-4062-856e-2e2ace3a7b0d tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.088226 Jul 25 12:38:53.957019 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 156/280] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Jul 25 12:38:53 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 12:38:53.968340 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1c800107-5a91-4f67-b7bd-686020fc1339 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-623433472", "availability_zone": "tempest-test_az-420893632"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:53.978433 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:53.978433 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:53.983904 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.aggregate [None req-1c800107-5a91-4f67-b7bd-686020fc1339 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Generated uuid 7be804bc-10c4-499b-a8a4-2de27ce54a3e for aggregate {{(pid=125884) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 12:38:54.073053 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1c800107-5a91-4f67-b7bd-686020fc1339 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.109141 Jul 25 12:38:54.073861 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 125/281] 10.222.0.49 () {60 vars in 1165 bytes} [Mon Jul 25 12:38:53 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:54.086234 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ccc9eb37-15af-477a-b080-401178329f93 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-623433472_new", "availability_zone": "tempest-test_az-420893632_new"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:54.252412 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-85756737-9084-4806-beb8-2ba6951acb71 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:54.253315 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-85756737-9084-4806-beb8-2ba6951acb71 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:54.264870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85756737-9084-4806-beb8-2ba6951acb71 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:54.272280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85756737-9084-4806-beb8-2ba6951acb71 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:54.273509 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85756737-9084-4806-beb8-2ba6951acb71 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:54.276552 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85756737-9084-4806-beb8-2ba6951acb71 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:54.289303 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:54.289303 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:54.366521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ccc9eb37-15af-477a-b080-401178329f93 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:54.366521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ccc9eb37-15af-477a-b080-401178329f93 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:54.437227 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ccc9eb37-15af-477a-b080-401178329f93 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 334 microversion: 2.1 time: 0.355165 Jul 25 12:38:54.437747 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 157/282] 10.222.0.49 () {60 vars in 1173 bytes} [Mon Jul 25 12:38:54 2022] PUT /compute/v2.1/os-aggregates/16 => generated 334 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:54.449647 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ed33941c-473d-4560-96cc-8e15deaeb4ae tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:54.451907 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:54.451907 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:54.472807 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ed33941c-473d-4560-96cc-8e15deaeb4ae tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.027318 Jul 25 12:38:54.477992 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 158/283] 10.222.0.49 () {58 vars in 1143 bytes} [Mon Jul 25 12:38:54 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:38:54.485106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c23f2edf-bb80-45e4-bbef-86f6a0e1eea8 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:54.485905 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:54.485905 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:54.536673 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c23f2edf-bb80-45e4-bbef-86f6a0e1eea8 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.055476 Jul 25 12:38:54.537557 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 159/284] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Jul 25 12:38:54 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 25 12:38:54.548299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-228ed3d0-718e-4d24-bbe1-af2322bb3a03 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-648531245"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:54.551478 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:54.551478 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:54.552436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.aggregate [None req-228ed3d0-718e-4d24-bbe1-af2322bb3a03 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Generated uuid 38382985-79a3-4e6f-96fa-1854e89953c8 for aggregate {{(pid=125883) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 12:38:54.595023 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-228ed3d0-718e-4d24-bbe1-af2322bb3a03 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.050370 Jul 25 12:38:54.595898 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 160/285] 10.222.0.49 () {60 vars in 1164 bytes} [Mon Jul 25 12:38:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:38:54.610040 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-eaefee04-c5b6-494b-ae6d-4871fe69db13 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:54.613714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-eaefee04-c5b6-494b-ae6d-4871fe69db13 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:54.631480 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eaefee04-c5b6-494b-ae6d-4871fe69db13 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:54.635003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eaefee04-c5b6-494b-ae6d-4871fe69db13 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:54.636077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eaefee04-c5b6-494b-ae6d-4871fe69db13 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:54.636678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eaefee04-c5b6-494b-ae6d-4871fe69db13 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:54.956987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-85756737-9084-4806-beb8-2ba6951acb71 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:54.965537 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-85756737-9084-4806-beb8-2ba6951acb71 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1270 microversion: 2.1 time: 0.717068 Jul 25 12:38:54.968947 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 126/286] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:54 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1270 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:38:54.977037 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-edfd80b5-848e-4587-a760-108c2124c0ea tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:54.982732 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:54.982732 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:38:55.016800 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-edfd80b5-848e-4587-a760-108c2124c0ea tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.046540 Jul 25 12:38:55.018166 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 127/287] 10.222.0.49 () {58 vars in 1143 bytes} [Mon Jul 25 12:38:54 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:55.028426 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-18efb295-02fa-486a-ac30-95c400fa4006 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Calling method '.version_select at 0x7efcfa6cf940>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:55.292895 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-eaefee04-c5b6-494b-ae6d-4871fe69db13 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:55.305591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-eaefee04-c5b6-494b-ae6d-4871fe69db13 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:55.307234 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-eaefee04-c5b6-494b-ae6d-4871fe69db13 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:55.308389 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-eaefee04-c5b6-494b-ae6d-4871fe69db13 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 1361 microversion: 2.25 time: 0.711762 Jul 25 12:38:55.329478 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 161/288] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:38:54 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 1361 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:38:55.343528 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f6b9f718-7283-4918-b09e-6b30d89b7db1 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:55.345702 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:38:55.345702 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:38:55.396827 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f6b9f718-7283-4918-b09e-6b30d89b7db1 tempest-AggregatesAdminTestJSON-565305655 tempest-AggregatesAdminTestJSON-565305655-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.066072 Jul 25 12:38:55.397665 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 162/289] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Jul 25 12:38:55 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 12:38:55.408009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c7ea8f24-5e4f-45fa-812a-98d20e8cf2e3 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:55.410734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c7ea8f24-5e4f-45fa-812a-98d20e8cf2e3 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:55.422852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c7ea8f24-5e4f-45fa-812a-98d20e8cf2e3 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:55.425253 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c7ea8f24-5e4f-45fa-812a-98d20e8cf2e3 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:55.426301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c7ea8f24-5e4f-45fa-812a-98d20e8cf2e3 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:55.429294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c7ea8f24-5e4f-45fa-812a-98d20e8cf2e3 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:55.462752 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-c7ea8f24-5e4f-45fa-812a-98d20e8cf2e3 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] HTTP exception thrown: Instance 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 could not be found. Jul 25 12:38:55.464679 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c7ea8f24-5e4f-45fa-812a-98d20e8cf2e3 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Request method failure captured: Jul 25 12:38:55.464679 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 HTTP/1.1 Jul 25 12:38:55.464679 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:55.464679 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:55.464679 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:55.464679 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:55.464679 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:55.464679 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:55.464679 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:55.464679 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:55.464679 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6g2g76HlDaz2HU2FhmXoKpsY7NLPsWg6wr-ck5TRj_Agvl5CVdBxXbf6uhhbFog8lMNtrhK1QZeaZCuGNTJ0Jz6vN6MDVLhzMgWF6l2FhBJjjrlC4tnbJMId1MoKsQrucnvwxJmJbEUzyabjBkhQDDpS00ycEnkymxY4RlJIIPIdw Jul 25 12:38:55.464679 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:55.464679 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:55.464679 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:55.464679 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:55.464679 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:55.464679 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:55.464679 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 2056d16864614f9587078e33c8ce795b Jul 25 12:38:55.464679 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AggregatesAdminTestJSON-100420954 Jul 25 12:38:55.464679 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:38:55.464679 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:38:55.466352 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2056d16864614f9587078e33c8ce795b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2056d16864614f9587078e33c8ce795b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2056d16864614f9587078e33c8ce795b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2056d16864614f9587078e33c8ce795b"}]}] Jul 25 12:38:55.466352 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AggregatesAdminTestJSON-100420954 Jul 25 12:38:55.466352 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 2056d16864614f9587078e33c8ce795b Jul 25 12:38:55.466352 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-100420954 Jul 25 12:38:55.466352 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AggregatesAdminTestJSON-100420954-project Jul 25 12:38:55.466352 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:55.466352 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:55.466352 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 3b2cfc6122c9496992160b7c0c64dab3 Jul 25 12:38:55.466352 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AggregatesAdminTestJSON-100420954-project Jul 25 12:38:55.466352 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:38:55.466352 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 could not be found. Jul 25 12:38:55.466352 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '2b37efd8-e1e0-4c52-8e97-9ddae0c05a70'} Jul 25 12:38:55.467185 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:55.467185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:55.467185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:38:55.467185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:38:55.467185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:38:55.467185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:38:55.467185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:38:55.467185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:38:55.467185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:38:55.467185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:38:55.467185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 could not be found. Jul 25 12:38:55.467185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:55.467185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:55.467185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:55.467185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:55.467185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:55.467185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:55.467185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:55.467185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:55.467185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:55.468443 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:55.468443 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:38:55.468443 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:38:55.468443 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:38:55.468443 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:38:55.468443 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:38:55.468443 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:38:55.468443 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:38:55.468443 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:38:55.468443 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 could not be found. Jul 25 12:38:55.468443 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:55.468443 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:55.468443 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:55.468443 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:55.468443 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:55.468443 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:55.468443 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:55.468443 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:55.468443 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 could not be found. Jul 25 12:38:55.468443 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:55.469782 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c7ea8f24-5e4f-45fa-812a-98d20e8cf2e3 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Returning 404 to user: Instance 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:55.470947 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c7ea8f24-5e4f-45fa-812a-98d20e8cf2e3 tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 404 len: 111 microversion: 2.1 time: 0.061965 Jul 25 12:38:55.473859 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 163/290] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:38:55 2022] DELETE /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:55.479623 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d29a03f1-4177-443b-a516-e6df5730e91b tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:55.480352 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d29a03f1-4177-443b-a516-e6df5730e91b tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] [instance: 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:55.506134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d29a03f1-4177-443b-a516-e6df5730e91b tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:55.506777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d29a03f1-4177-443b-a516-e6df5730e91b tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:55.509545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d29a03f1-4177-443b-a516-e6df5730e91b tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:55.511522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d29a03f1-4177-443b-a516-e6df5730e91b tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:55.516895 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-18efb295-02fa-486a-ac30-95c400fa4006 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/76c46e5c24de416b92d25b54c1c940b1/defaults" status: 200 len: 371 microversion: 2.1 time: 0.495614 Jul 25 12:38:55.524517 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 128/291] 10.222.0.49 () {58 vars in 1269 bytes} [Mon Jul 25 12:38:55 2022] GET /compute/v2.1/os-quota-sets/76c46e5c24de416b92d25b54c1c940b1/defaults => generated 371 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:55.538050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b596d6a1-c058-4a0d-a2c0-d56310062578 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Action: 'update', calling method: .version_select at 0x7efcfa6cd790>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:55.550751 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-d29a03f1-4177-443b-a516-e6df5730e91b tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] HTTP exception thrown: Instance 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 could not be found. Jul 25 12:38:55.555177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d29a03f1-4177-443b-a516-e6df5730e91b tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Request method failure captured: Jul 25 12:38:55.555177 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 HTTP/1.1 Jul 25 12:38:55.555177 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:38:55.555177 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:38:55.555177 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:38:55.555177 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:38:55.555177 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:38:55.555177 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:38:55.555177 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:38:55.555177 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:38:55.555177 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6g2g76HlDaz2HU2FhmXoKpsY7NLPsWg6wr-ck5TRj_Agvl5CVdBxXbf6uhhbFog8lMNtrhK1QZeaZCuGNTJ0Jz6vN6MDVLhzMgWF6l2FhBJjjrlC4tnbJMId1MoKsQrucnvwxJmJbEUzyabjBkhQDDpS00ycEnkymxY4RlJIIPIdw Jul 25 12:38:55.555177 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:38:55.555177 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:38:55.555177 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:38:55.555177 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:38:55.555177 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:38:55.555177 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:38:55.555177 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 2056d16864614f9587078e33c8ce795b Jul 25 12:38:55.555177 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AggregatesAdminTestJSON-100420954 Jul 25 12:38:55.555177 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:38:55.555177 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:38:55.556961 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2056d16864614f9587078e33c8ce795b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2056d16864614f9587078e33c8ce795b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2056d16864614f9587078e33c8ce795b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2056d16864614f9587078e33c8ce795b"}]}] Jul 25 12:38:55.556961 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AggregatesAdminTestJSON-100420954 Jul 25 12:38:55.556961 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 2056d16864614f9587078e33c8ce795b Jul 25 12:38:55.556961 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-100420954 Jul 25 12:38:55.556961 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AggregatesAdminTestJSON-100420954-project Jul 25 12:38:55.556961 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:38:55.556961 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:38:55.556961 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 3b2cfc6122c9496992160b7c0c64dab3 Jul 25 12:38:55.556961 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AggregatesAdminTestJSON-100420954-project Jul 25 12:38:55.556961 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:38:55.556961 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 could not be found. Jul 25 12:38:55.556961 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '2b37efd8-e1e0-4c52-8e97-9ddae0c05a70'} Jul 25 12:38:55.557786 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:38:55.557786 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:55.557786 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:38:55.557786 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:38:55.557786 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:38:55.557786 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:38:55.557786 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:38:55.557786 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:38:55.557786 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:38:55.557786 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:38:55.557786 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 could not be found. Jul 25 12:38:55.557786 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:55.557786 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:55.557786 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:55.557786 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:55.557786 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:55.557786 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:55.557786 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:38:55.557786 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:38:55.557786 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:38:55.560441 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:38:55.560441 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:38:55.560441 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:38:55.560441 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:38:55.560441 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:38:55.560441 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:38:55.560441 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:38:55.560441 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 could not be found. Jul 25 12:38:55.560441 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:55.560441 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:38:55.560441 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:55.560441 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:38:55.560441 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:38:55.560441 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:38:55.560441 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:38:55.560441 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:38:55.560441 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 could not be found. Jul 25 12:38:55.560441 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:38:55.562029 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d29a03f1-4177-443b-a516-e6df5730e91b tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] Returning 404 to user: Instance 2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:38:55.562029 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d29a03f1-4177-443b-a516-e6df5730e91b tempest-AggregatesAdminTestJSON-100420954 tempest-AggregatesAdminTestJSON-100420954-project] 10.222.0.49 "GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70" status: 404 len: 111 microversion: 2.1 time: 0.083853 Jul 25 12:38:55.568665 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 164/292] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:55 2022] GET /compute/v2.1/servers/2b37efd8-e1e0-4c52-8e97-9ddae0c05a70 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:38:55.742031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b596d6a1-c058-4a0d-a2c0-d56310062578 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:55.747383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b596d6a1-c058-4a0d-a2c0-d56310062578 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:55.751881 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b596d6a1-c058-4a0d-a2c0-d56310062578 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:55.755154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b596d6a1-c058-4a0d-a2c0-d56310062578 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:55.992183 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4e5bc06f-3f27-4629-9080-df6e765adb4e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:55.993037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4e5bc06f-3f27-4629-9080-df6e765adb4e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:56.008709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e5bc06f-3f27-4629-9080-df6e765adb4e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:56.012521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e5bc06f-3f27-4629-9080-df6e765adb4e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:56.013570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e5bc06f-3f27-4629-9080-df6e765adb4e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:56.023022 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e5bc06f-3f27-4629-9080-df6e765adb4e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:56.352823 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b596d6a1-c058-4a0d-a2c0-d56310062578 tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/76c46e5c24de416b92d25b54c1c940b1" status: 200 len: 329 microversion: 2.1 time: 0.827030 Jul 25 12:38:56.353475 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 129/293] 10.222.0.49 () {60 vars in 1263 bytes} [Mon Jul 25 12:38:55 2022] PUT /compute/v2.1/os-quota-sets/76c46e5c24de416b92d25b54c1c940b1 => generated 329 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:56.371922 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2eba24d8-0c4d-4cff-b02b-c897f1df149d tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:56.373241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2eba24d8-0c4d-4cff-b02b-c897f1df149d tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:56.390315 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2eba24d8-0c4d-4cff-b02b-c897f1df149d tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:56.391260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2eba24d8-0c4d-4cff-b02b-c897f1df149d tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:56.392805 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2eba24d8-0c4d-4cff-b02b-c897f1df149d tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:56.396707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2eba24d8-0c4d-4cff-b02b-c897f1df149d tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:56.908163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4e5bc06f-3f27-4629-9080-df6e765adb4e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:56.923807 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4e5bc06f-3f27-4629-9080-df6e765adb4e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1312 microversion: 2.1 time: 0.940390 Jul 25 12:38:56.937311 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 165/294] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:55 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1312 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:56.937311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5f6fb888-c7fa-4f04-9ab2-8dab20c26aee tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:56.937311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5f6fb888-c7fa-4f04-9ab2-8dab20c26aee tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:56.939112 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f6fb888-c7fa-4f04-9ab2-8dab20c26aee tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:56.939957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f6fb888-c7fa-4f04-9ab2-8dab20c26aee tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:56.943329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f6fb888-c7fa-4f04-9ab2-8dab20c26aee tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:56.945132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f6fb888-c7fa-4f04-9ab2-8dab20c26aee tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:57.174344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2eba24d8-0c4d-4cff-b02b-c897f1df149d tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:57.185422 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2eba24d8-0c4d-4cff-b02b-c897f1df149d tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 200 len: 1589 microversion: 2.1 time: 0.830807 Jul 25 12:38:57.187280 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 130/295] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:56 2022] GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 1589 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:38:57.193002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-207e45e2-d50a-4d72-8a79-d4614122bc7c tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Action: 'update', calling method: .version_select at 0x7efcfa6cdca0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:57.400217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5f6fb888-c7fa-4f04-9ab2-8dab20c26aee tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:57.410813 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5f6fb888-c7fa-4f04-9ab2-8dab20c26aee tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:57.417391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5f6fb888-c7fa-4f04-9ab2-8dab20c26aee tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:57.438534 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5f6fb888-c7fa-4f04-9ab2-8dab20c26aee tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 1361 microversion: 2.25 time: 0.495700 Jul 25 12:38:57.454532 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 166/296] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:38:56 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 1361 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:38:57.595510 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-fca01efa-63c4-43b4-9c72-df7133ffdede req-40750319-b390-461d-969e-444d05950d57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36fa069d-9aaa-4804-a21f-8526cbe9d728", "tag": "bee090ea-f3af-4297-9530-9c09fda48a76"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:57.618658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fca01efa-63c4-43b4-9c72-df7133ffdede req-40750319-b390-461d-969e-444d05950d57 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:57.621046 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fca01efa-63c4-43b4-9c72-df7133ffdede req-40750319-b390-461d-969e-444d05950d57 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:57.661506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-207e45e2-d50a-4d72-8a79-d4614122bc7c tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:57.662620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-207e45e2-d50a-4d72-8a79-d4614122bc7c tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:57.663005 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-fca01efa-63c4-43b4-9c72-df7133ffdede req-40750319-b390-461d-969e-444d05950d57 service nova] Creating event network-changed:bee090ea-f3af-4297-9530-9c09fda48a76 for instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 on n-h1-848886-15 Jul 25 12:38:57.663729 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-207e45e2-d50a-4d72-8a79-d4614122bc7c tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:57.664304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-207e45e2-d50a-4d72-8a79-d4614122bc7c tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:57.679744 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-fca01efa-63c4-43b4-9c72-df7133ffdede req-40750319-b390-461d-969e-444d05950d57 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.223796 Jul 25 12:38:57.680644 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 167/297] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:57.686976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-8ffd2a3e-32b4-41a2-b51b-700943bdd659 req-e911d857-819e-46af-a325-9928ecef6466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc20036c-d36c-4fef-a606-0d1820814320", "tag": "92cf7b8c-f2ba-49cf-9e6d-a32bdb600392"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:57.718294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-8ffd2a3e-32b4-41a2-b51b-700943bdd659 req-e911d857-819e-46af-a325-9928ecef6466 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:57.719187 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-8ffd2a3e-32b4-41a2-b51b-700943bdd659 req-e911d857-819e-46af-a325-9928ecef6466 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:57.743445 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-8ffd2a3e-32b4-41a2-b51b-700943bdd659 req-e911d857-819e-46af-a325-9928ecef6466 service nova] Creating event network-changed:92cf7b8c-f2ba-49cf-9e6d-a32bdb600392 for instance dc20036c-d36c-4fef-a606-0d1820814320 on n-h2-848886-15 Jul 25 12:38:57.763680 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-8ffd2a3e-32b4-41a2-b51b-700943bdd659 req-e911d857-819e-46af-a325-9928ecef6466 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081441 Jul 25 12:38:57.764291 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 168/298] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:57.945418 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cfa2a817-4ec8-489e-9296-fc601bb67f90 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:57.947682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cfa2a817-4ec8-489e-9296-fc601bb67f90 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:57.966079 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cfa2a817-4ec8-489e-9296-fc601bb67f90 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:57.966716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cfa2a817-4ec8-489e-9296-fc601bb67f90 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:57.967674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cfa2a817-4ec8-489e-9296-fc601bb67f90 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:57.968279 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cfa2a817-4ec8-489e-9296-fc601bb67f90 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:58.111304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=25,nova_api:UPDATE=8 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:38:58.376078 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-207e45e2-d50a-4d72-8a79-d4614122bc7c tempest-QuotasAdminTestJSON-944413861 tempest-QuotasAdminTestJSON-944413861-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/76c46e5c24de416b92d25b54c1c940b1" status: 200 len: 329 microversion: 2.1 time: 1.186903 Jul 25 12:38:58.377206 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 131/299] 10.222.0.49 () {60 vars in 1263 bytes} [Mon Jul 25 12:38:57 2022] PUT /compute/v2.1/os-quota-sets/76c46e5c24de416b92d25b54c1c940b1 => generated 329 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:38:58.378855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cfa2a817-4ec8-489e-9296-fc601bb67f90 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:58.391694 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cfa2a817-4ec8-489e-9296-fc601bb67f90 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1312 microversion: 2.1 time: 0.450462 Jul 25 12:38:58.392276 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 169/300] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:57 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1312 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:38:58.469371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8e15b212-fcf1-402f-9833-b77781a789ea tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:58.471136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8e15b212-fcf1-402f-9833-b77781a789ea tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:58.484207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e15b212-fcf1-402f-9833-b77781a789ea tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:58.486358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e15b212-fcf1-402f-9833-b77781a789ea tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:58.487659 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e15b212-fcf1-402f-9833-b77781a789ea tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:58.490138 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e15b212-fcf1-402f-9833-b77781a789ea tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:59.415698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e03ab879-d778-4e71-a046-3cfd94f2d6ba tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:38:59.416904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e03ab879-d778-4e71-a046-3cfd94f2d6ba tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:38:59.427094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e03ab879-d778-4e71-a046-3cfd94f2d6ba tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:59.427815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e03ab879-d778-4e71-a046-3cfd94f2d6ba tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:59.428848 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e03ab879-d778-4e71-a046-3cfd94f2d6ba tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:59.429491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e03ab879-d778-4e71-a046-3cfd94f2d6ba tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:59.869586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8e15b212-fcf1-402f-9833-b77781a789ea tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:59.883237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8e15b212-fcf1-402f-9833-b77781a789ea tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:59.885224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8e15b212-fcf1-402f-9833-b77781a789ea tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:38:59.886723 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8e15b212-fcf1-402f-9833-b77781a789ea tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 1361 microversion: 2.25 time: 1.422694 Jul 25 12:38:59.887847 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 132/301] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:38:58 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 1361 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:38:59.896632 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-c642ed67-3ff5-4a64-9e0e-2535697a45eb req-0ce8f939-b7d2-4ab5-acda-67abfe548922 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73d77295-bfd7-4ff9-b2f9-09d175f81696", "tag": "ed3b7b89-f69c-4f30-b4f9-ecff648c112d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:38:59.923312 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c642ed67-3ff5-4a64-9e0e-2535697a45eb req-0ce8f939-b7d2-4ab5-acda-67abfe548922 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:59.923824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c642ed67-3ff5-4a64-9e0e-2535697a45eb req-0ce8f939-b7d2-4ab5-acda-67abfe548922 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:59.942615 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-c642ed67-3ff5-4a64-9e0e-2535697a45eb req-0ce8f939-b7d2-4ab5-acda-67abfe548922 service nova] Creating event network-changed:ed3b7b89-f69c-4f30-b4f9-ecff648c112d for instance 73d77295-bfd7-4ff9-b2f9-09d175f81696 on n-h2-848886-15 Jul 25 12:38:59.950278 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-c642ed67-3ff5-4a64-9e0e-2535697a45eb req-0ce8f939-b7d2-4ab5-acda-67abfe548922 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060740 Jul 25 12:38:59.951445 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 133/302] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:00.173088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e03ab879-d778-4e71-a046-3cfd94f2d6ba tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:00.182362 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e03ab879-d778-4e71-a046-3cfd94f2d6ba tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1312 microversion: 2.1 time: 0.773577 Jul 25 12:39:00.183559 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 170/303] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:38:59 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1312 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:39:00.912853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c1d25002-1ab2-4651-9c50-9f28f0c1e89f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:00.914133 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c1d25002-1ab2-4651-9c50-9f28f0c1e89f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:00.930628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1d25002-1ab2-4651-9c50-9f28f0c1e89f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:00.931097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1d25002-1ab2-4651-9c50-9f28f0c1e89f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:00.934177 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1d25002-1ab2-4651-9c50-9f28f0c1e89f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:00.935493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1d25002-1ab2-4651-9c50-9f28f0c1e89f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:01.209884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6cdba9e1-deac-452c-ae41-18b0ebfb762e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:01.211627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6cdba9e1-deac-452c-ae41-18b0ebfb762e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:01.247346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6cdba9e1-deac-452c-ae41-18b0ebfb762e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:01.250155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6cdba9e1-deac-452c-ae41-18b0ebfb762e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:01.251951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6cdba9e1-deac-452c-ae41-18b0ebfb762e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:01.252910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6cdba9e1-deac-452c-ae41-18b0ebfb762e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:01.294949 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:01.715637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6cdba9e1-deac-452c-ae41-18b0ebfb762e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:01.726654 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6cdba9e1-deac-452c-ae41-18b0ebfb762e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1312 microversion: 2.1 time: 0.523378 Jul 25 12:39:01.727268 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 171/304] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:01 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1312 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:39:02.079317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c1d25002-1ab2-4651-9c50-9f28f0c1e89f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:02.084066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:02.094823 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c1d25002-1ab2-4651-9c50-9f28f0c1e89f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:02.096545 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c1d25002-1ab2-4651-9c50-9f28f0c1e89f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:02.097882 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c1d25002-1ab2-4651-9c50-9f28f0c1e89f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 1361 microversion: 2.25 time: 1.190447 Jul 25 12:39:02.104051 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 134/305] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:00 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 1361 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:02.751961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5a8e05f6-2b18-4721-904e-3980d2faa90e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:02.753327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5a8e05f6-2b18-4721-904e-3980d2faa90e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:02.768013 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a8e05f6-2b18-4721-904e-3980d2faa90e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:02.770271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a8e05f6-2b18-4721-904e-3980d2faa90e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:02.773768 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a8e05f6-2b18-4721-904e-3980d2faa90e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:02.774549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a8e05f6-2b18-4721-904e-3980d2faa90e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:03.128090 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-01126012-91fc-451a-b932-add03ac79037 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:03.128732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-01126012-91fc-451a-b932-add03ac79037 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:03.143911 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01126012-91fc-451a-b932-add03ac79037 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:03.147503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01126012-91fc-451a-b932-add03ac79037 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:03.148429 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01126012-91fc-451a-b932-add03ac79037 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:03.148878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01126012-91fc-451a-b932-add03ac79037 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:03.602574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=15 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:03.669352 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=42 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:04.421240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5a8e05f6-2b18-4721-904e-3980d2faa90e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:04.434430 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5a8e05f6-2b18-4721-904e-3980d2faa90e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1312 microversion: 2.1 time: 1.689692 Jul 25 12:39:04.438173 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 172/306] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:02 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1312 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:04.454263 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-01126012-91fc-451a-b932-add03ac79037 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:04.463844 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-01126012-91fc-451a-b932-add03ac79037 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:04.469426 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-01126012-91fc-451a-b932-add03ac79037 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:04.475222 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-01126012-91fc-451a-b932-add03ac79037 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 1361 microversion: 2.25 time: 1.351391 Jul 25 12:39:04.490599 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 135/307] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:03 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 1361 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:04.876253 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c8085048-1048-456d-8354-e63b2dc510a1 tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] Calling method '.version_select at 0x7efcfa3c38b0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:04.879998 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:39:04.879998 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:39:04.885811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8085048-1048-456d-8354-e63b2dc510a1 tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:04.886401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8085048-1048-456d-8354-e63b2dc510a1 tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:04.924329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8085048-1048-456d-8354-e63b2dc510a1 tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:04.924858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8085048-1048-456d-8354-e63b2dc510a1 tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:04.965319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8085048-1048-456d-8354-e63b2dc510a1 tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:04.967379 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8085048-1048-456d-8354-e63b2dc510a1 tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:04.992344 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c8085048-1048-456d-8354-e63b2dc510a1 tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1429 microversion: 2.41 time: 0.543241 Jul 25 12:39:05.008668 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 173/308] 10.222.0.49 () {60 vars in 1208 bytes} [Mon Jul 25 12:39:04 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1429 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:05.015068 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5a7bff20-b764-4802-b39e-69504893d4b3 tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1537463174"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:05.022263 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:39:05.022263 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:39:05.028591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.aggregate [None req-5a7bff20-b764-4802-b39e-69504893d4b3 tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] Generated uuid f3238862-de8a-40a1-b6f4-ce3dd0c8a700 for aggregate {{(pid=125884) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 12:39:05.090222 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5a7bff20-b764-4802-b39e-69504893d4b3 tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.080424 Jul 25 12:39:05.091446 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 136/309] 10.222.0.49 () {62 vars in 1205 bytes} [Mon Jul 25 12:39:05 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:39:05.107964 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-778dd9f3-5215-449b-8fec-93aaf5749f59 tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-472090341"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:05.111508 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:39:05.111508 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:39:05.222175 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-778dd9f3-5215-449b-8fec-93aaf5749f59 tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-aggregates/18" status: 200 len: 299 microversion: 2.41 time: 0.121408 Jul 25 12:39:05.235680 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 174/310] 10.222.0.49 () {62 vars in 1213 bytes} [Mon Jul 25 12:39:05 2022] PUT /compute/v2.1/os-aggregates/18 => generated 299 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:39:05.249481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ff53f4e7-2c11-4986-9672-1dd6f605e7ac tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:05.250423 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:39:05.250423 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:39:05.269018 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ff53f4e7-2c11-4986-9672-1dd6f605e7ac tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/18" status: 200 len: 299 microversion: 2.41 time: 0.024273 Jul 25 12:39:05.269623 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 137/311] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Jul 25 12:39:05 2022] GET /compute/v2.1/os-aggregates/18 => generated 299 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:39:05.282286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-775c93c1-fd7a-4d26-9cb8-bbe7f5877d9f tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-848886-15"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:05.285071 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:39:05.285071 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:39:05.306791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-775c93c1-fd7a-4d26-9cb8-bbe7f5877d9f tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:05.307276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-775c93c1-fd7a-4d26-9cb8-bbe7f5877d9f tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:05.459686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fa5f0019-208e-4ed5-9291-1adb2c8658cf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:05.460355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fa5f0019-208e-4ed5-9291-1adb2c8658cf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:05.470575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa5f0019-208e-4ed5-9291-1adb2c8658cf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:05.471141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa5f0019-208e-4ed5-9291-1adb2c8658cf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:05.474185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa5f0019-208e-4ed5-9291-1adb2c8658cf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:05.474592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa5f0019-208e-4ed5-9291-1adb2c8658cf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:05.565702 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-775c93c1-fd7a-4d26-9cb8-bbe7f5877d9f tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 315 microversion: 2.41 time: 0.288031 Jul 25 12:39:05.567858 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 175/312] 10.222.0.49 () {62 vars in 1235 bytes} [Mon Jul 25 12:39:05 2022] POST /compute/v2.1/os-aggregates/18/action => generated 315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:39:05.592514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-02e4aa44-19e0-4ae6-9e5e-f55d6a8af3d0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:05.593335 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-02e4aa44-19e0-4ae6-9e5e-f55d6a8af3d0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:05.612319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02e4aa44-19e0-4ae6-9e5e-f55d6a8af3d0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:05.614262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02e4aa44-19e0-4ae6-9e5e-f55d6a8af3d0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:05.616910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02e4aa44-19e0-4ae6-9e5e-f55d6a8af3d0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:05.617680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02e4aa44-19e0-4ae6-9e5e-f55d6a8af3d0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:05.838401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fa5f0019-208e-4ed5-9291-1adb2c8658cf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:05.846302 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fa5f0019-208e-4ed5-9291-1adb2c8658cf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1312 microversion: 2.1 time: 0.391101 Jul 25 12:39:05.851074 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 138/313] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:05 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1312 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:39:05.858312 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e33a2f49-d1cc-402f-96a4-cd463054987d tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-848886-15"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:05.861271 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:39:05.861271 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:39:05.871919 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e33a2f49-d1cc-402f-96a4-cd463054987d tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:05.872626 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e33a2f49-d1cc-402f-96a4-cd463054987d tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:05.917469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-02e4aa44-19e0-4ae6-9e5e-f55d6a8af3d0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:05.928370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-02e4aa44-19e0-4ae6-9e5e-f55d6a8af3d0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:05.930490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-02e4aa44-19e0-4ae6-9e5e-f55d6a8af3d0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:05.932031 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-02e4aa44-19e0-4ae6-9e5e-f55d6a8af3d0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 1361 microversion: 2.25 time: 0.362164 Jul 25 12:39:05.951926 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 176/314] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:05 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 1361 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:06.022813 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e33a2f49-d1cc-402f-96a4-cd463054987d tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 299 microversion: 2.41 time: 0.169166 Jul 25 12:39:06.024319 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 139/315] 10.222.0.49 () {62 vars in 1235 bytes} [Mon Jul 25 12:39:05 2022] POST /compute/v2.1/os-aggregates/18/action => generated 299 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:39:06.037493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dfab8a08-faf9-4347-8559-12c2d41a4d18 tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:06.038567 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:39:06.038567 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:39:06.044922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:DELETE=8,nova_api:UPDATE=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:06.087597 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dfab8a08-faf9-4347-8559-12c2d41a4d18 tempest-AggregatesAdminTestV241-1734961373 tempest-AggregatesAdminTestV241-1734961373-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.41 time: 0.055115 Jul 25 12:39:06.089849 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 177/316] 10.222.0.49 () {60 vars in 1196 bytes} [Mon Jul 25 12:39:06 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:06.871675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-db064887-427a-4d4b-8aad-19ba75f81172 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:06.873039 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-db064887-427a-4d4b-8aad-19ba75f81172 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:06.883396 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-db064887-427a-4d4b-8aad-19ba75f81172 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:06.884055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-db064887-427a-4d4b-8aad-19ba75f81172 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:06.885160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-db064887-427a-4d4b-8aad-19ba75f81172 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:06.885639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-db064887-427a-4d4b-8aad-19ba75f81172 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:06.958906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f7bbd202-e0e0-40d5-8b9d-54bef11bc7e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:06.960160 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f7bbd202-e0e0-40d5-8b9d-54bef11bc7e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:06.966923 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7bbd202-e0e0-40d5-8b9d-54bef11bc7e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:06.981174 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7bbd202-e0e0-40d5-8b9d-54bef11bc7e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:06.986691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7bbd202-e0e0-40d5-8b9d-54bef11bc7e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:06.990847 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7bbd202-e0e0-40d5-8b9d-54bef11bc7e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:07.367733 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-db064887-427a-4d4b-8aad-19ba75f81172 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:07.375558 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-db064887-427a-4d4b-8aad-19ba75f81172 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1312 microversion: 2.1 time: 0.508004 Jul 25 12:39:07.376765 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 140/317] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:06 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1312 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:07.517521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f7bbd202-e0e0-40d5-8b9d-54bef11bc7e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:07.528760 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f7bbd202-e0e0-40d5-8b9d-54bef11bc7e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:07.539533 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f7bbd202-e0e0-40d5-8b9d-54bef11bc7e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:07.541262 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f7bbd202-e0e0-40d5-8b9d-54bef11bc7e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 1361 microversion: 2.25 time: 0.586539 Jul 25 12:39:07.543327 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 178/318] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:06 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 1361 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:07.759640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-4ec30ef4-46e3-4e65-b40f-9c3e8c38666d req-bdb8f9f2-e414-42a2-b7af-c302c7733f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc20036c-d36c-4fef-a606-0d1820814320", "name": "network-vif-plugged", "status": "completed", "tag": "92cf7b8c-f2ba-49cf-9e6d-a32bdb600392"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:07.775869 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=8 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:07.779501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4ec30ef4-46e3-4e65-b40f-9c3e8c38666d req-bdb8f9f2-e414-42a2-b7af-c302c7733f73 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:07.780119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4ec30ef4-46e3-4e65-b40f-9c3e8c38666d req-bdb8f9f2-e414-42a2-b7af-c302c7733f73 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:07.799791 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-4ec30ef4-46e3-4e65-b40f-9c3e8c38666d req-bdb8f9f2-e414-42a2-b7af-c302c7733f73 service nova] Creating event network-vif-plugged:92cf7b8c-f2ba-49cf-9e6d-a32bdb600392 for instance dc20036c-d36c-4fef-a606-0d1820814320 on n-h2-848886-15 Jul 25 12:39:07.811126 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-4ec30ef4-46e3-4e65-b40f-9c3e8c38666d req-bdb8f9f2-e414-42a2-b7af-c302c7733f73 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059094 Jul 25 12:39:07.812555 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 141/319] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:08.399217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0d79a7fb-00b8-4778-a919-c1c1fa68835d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:08.403232 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0d79a7fb-00b8-4778-a919-c1c1fa68835d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:08.432797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d79a7fb-00b8-4778-a919-c1c1fa68835d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:08.433262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d79a7fb-00b8-4778-a919-c1c1fa68835d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:08.440037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d79a7fb-00b8-4778-a919-c1c1fa68835d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:08.440511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d79a7fb-00b8-4778-a919-c1c1fa68835d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:08.577240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-35ca9a70-b6c4-44b9-8283-fc54e722381d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:08.580956 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-35ca9a70-b6c4-44b9-8283-fc54e722381d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:08.606186 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=80 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:08.613136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-35ca9a70-b6c4-44b9-8283-fc54e722381d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:08.613136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-35ca9a70-b6c4-44b9-8283-fc54e722381d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:08.644635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-35ca9a70-b6c4-44b9-8283-fc54e722381d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:08.644635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-35ca9a70-b6c4-44b9-8283-fc54e722381d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:09.467823 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-35ca9a70-b6c4-44b9-8283-fc54e722381d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:09.475995 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0d79a7fb-00b8-4778-a919-c1c1fa68835d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:09.486261 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-35ca9a70-b6c4-44b9-8283-fc54e722381d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:09.487832 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0d79a7fb-00b8-4778-a919-c1c1fa68835d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1312 microversion: 2.1 time: 1.093921 Jul 25 12:39:09.488446 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 179/320] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:08 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1312 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:09.489293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-35ca9a70-b6c4-44b9-8283-fc54e722381d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:09.490717 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-35ca9a70-b6c4-44b9-8283-fc54e722381d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 1361 microversion: 2.25 time: 0.923116 Jul 25 12:39:09.493472 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 142/321] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:08 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 1361 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:10.510428 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bccf5382-cfdb-4797-ae7c-da7573ff0f9d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:10.513093 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bccf5382-cfdb-4797-ae7c-da7573ff0f9d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:10.528294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-72e18400-988b-4a99-b19e-5f45a36e43d8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:10.529745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-72e18400-988b-4a99-b19e-5f45a36e43d8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:10.551537 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-72e18400-988b-4a99-b19e-5f45a36e43d8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:10.552228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-72e18400-988b-4a99-b19e-5f45a36e43d8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:10.553264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-72e18400-988b-4a99-b19e-5f45a36e43d8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:10.554078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-72e18400-988b-4a99-b19e-5f45a36e43d8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:10.580795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bccf5382-cfdb-4797-ae7c-da7573ff0f9d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:10.583316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bccf5382-cfdb-4797-ae7c-da7573ff0f9d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:10.584797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bccf5382-cfdb-4797-ae7c-da7573ff0f9d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:10.587295 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bccf5382-cfdb-4797-ae7c-da7573ff0f9d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:11.165009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bccf5382-cfdb-4797-ae7c-da7573ff0f9d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:11.174868 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bccf5382-cfdb-4797-ae7c-da7573ff0f9d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1312 microversion: 2.1 time: 0.670037 Jul 25 12:39:11.175023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-72e18400-988b-4a99-b19e-5f45a36e43d8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:11.181261 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 180/322] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:10 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1312 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:11.205741 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-72e18400-988b-4a99-b19e-5f45a36e43d8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:11.210846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-72e18400-988b-4a99-b19e-5f45a36e43d8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:11.219497 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-72e18400-988b-4a99-b19e-5f45a36e43d8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 1556 microversion: 2.25 time: 0.700063 Jul 25 12:39:11.221092 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 143/323] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:10 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 1556 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:39:11.771437 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fc42eb6d-8eb2-4398-b10f-cc1eb77ce2c9 tempest-KeyPairsV210TestJSON-1002293989 tempest-KeyPairsV210TestJSON-1002293989-project-admin] Action: 'create', calling method: .version_select at 0x7efcfa550f70>, body: {"keypair": {"name": "tempest-keypair-2102505622", "type": "ssh", "user_id": "5332128f294f485e8fa0422ebffe0b85", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZUyb5d7USkMji1dm2HH5EdxDNk9GEct/znTOCJdQ/oDEMWAJSajs54jeBfeeRD1cPdXEWpR1kuLvT6nXWFuG95rGpPlgSxkv6yEFfIWpwf+XS+56uvjK9p2ArcLCphMQ=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:11.785344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2865e133-efaa-41a5-974b-ea808e5ece0e tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:11.786055 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2865e133-efaa-41a5-974b-ea808e5ece0e tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:11.795177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2865e133-efaa-41a5-974b-ea808e5ece0e tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:11.795633 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2865e133-efaa-41a5-974b-ea808e5ece0e tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:11.796425 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2865e133-efaa-41a5-974b-ea808e5ece0e tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:11.796864 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2865e133-efaa-41a5-974b-ea808e5ece0e tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:11.842027 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-fc42eb6d-8eb2-4398-b10f-cc1eb77ce2c9 tempest-KeyPairsV210TestJSON-1002293989 tempest-KeyPairsV210TestJSON-1002293989-project-admin] Getting quotas for project 7e4992292b8b47d8b3bb8578cc4d9868. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:39:11.874147 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-fc42eb6d-8eb2-4398-b10f-cc1eb77ce2c9 tempest-KeyPairsV210TestJSON-1002293989 tempest-KeyPairsV210TestJSON-1002293989-project-admin] Getting quotas for user a5d4df5e7ea949c4a58ed4f9e36ee92b and project 7e4992292b8b47d8b3bb8578cc4d9868. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:39:11.936171 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fc42eb6d-8eb2-4398-b10f-cc1eb77ce2c9 tempest-KeyPairsV210TestJSON-1002293989 tempest-KeyPairsV210TestJSON-1002293989-project-admin] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.615250 Jul 25 12:39:11.937822 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 144/324] 10.222.0.49 () {62 vars in 1200 bytes} [Mon Jul 25 12:39:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 617 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 12:39:11.959645 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-66abccfe-c049-400e-a5c7-df0a6dbdbe00 tempest-KeyPairsV210TestJSON-1002293989 tempest-KeyPairsV210TestJSON-1002293989-project-admin] Action: 'create', calling method: .version_select at 0x7efcfa550940>, body: {"keypair": {"name": "tempest-keypair-1838758103", "type": "ssh", "user_id": "5332128f294f485e8fa0422ebffe0b85", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrJrsPY6VM3mYMU+oDDFdiq3zcDg+2+1aOj3sGa+UC6A5vQyGk9zWbFe87rZLZanfDxLTGBY/NFHX3wsuJbpflZ3s+oszl1i16BlfLSS5BrLl2xEJb3lrWOt5I0oR+sHw=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:12.003283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-66abccfe-c049-400e-a5c7-df0a6dbdbe00 tempest-KeyPairsV210TestJSON-1002293989 tempest-KeyPairsV210TestJSON-1002293989-project-admin] Getting quotas for project 7e4992292b8b47d8b3bb8578cc4d9868. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:39:12.014026 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-66abccfe-c049-400e-a5c7-df0a6dbdbe00 tempest-KeyPairsV210TestJSON-1002293989 tempest-KeyPairsV210TestJSON-1002293989-project-admin] Getting quotas for user a5d4df5e7ea949c4a58ed4f9e36ee92b and project 7e4992292b8b47d8b3bb8578cc4d9868. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:39:12.045871 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-66abccfe-c049-400e-a5c7-df0a6dbdbe00 tempest-KeyPairsV210TestJSON-1002293989 tempest-KeyPairsV210TestJSON-1002293989-project-admin] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.098733 Jul 25 12:39:12.047433 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 145/325] 10.222.0.49 () {62 vars in 1200 bytes} [Mon Jul 25 12:39:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 101 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 12:39:12.060166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5ade9178-e0b0-45f8-93fe-9fbdb024522c tempest-KeyPairsV210TestJSON-1002293989 tempest-KeyPairsV210TestJSON-1002293989-project-admin] Calling method '.version_select at 0x7efcfb091c10>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:12.073268 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5ade9178-e0b0-45f8-93fe-9fbdb024522c tempest-KeyPairsV210TestJSON-1002293989 tempest-KeyPairsV210TestJSON-1002293989-project-admin] 10.222.0.49 "GET /compute/v2.1/os-keypairs/tempest-keypair-2102505622?user_id=5332128f294f485e8fa0422ebffe0b85" status: 200 len: 512 microversion: 2.10 time: 0.019454 Jul 25 12:39:12.074591 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 146/326] 10.222.0.49 () {60 vars in 1340 bytes} [Mon Jul 25 12:39:12 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2102505622?user_id=5332128f294f485e8fa0422ebffe0b85 => generated 512 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:39:12.103639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-2865e133-efaa-41a5-974b-ea808e5ece0e tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lazy-loading 'services' on Instance uuid dc20036c-d36c-4fef-a606-0d1820814320 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:39:12.107590 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e7370dbc-d2b6-414e-b0b0-b25de44d1719 tempest-KeyPairsV210TestJSON-1002293989 tempest-KeyPairsV210TestJSON-1002293989-project-admin] Action: 'create', calling method: .version_select at 0x7efcfb0918b0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-940170465", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATEmilr/iTJB5DbqvwA/XL6hgrV9c8EbOSM1VK+YXaKlGfgA/lqbtuq6Qw8nY5HZJLXNLr0EIZ7kCoCznQV0SKhGeopPpVje0K7r2OY9TOe4RvVoCFSZcoRMNa8NZVZSA=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:12.166593 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-e7370dbc-d2b6-414e-b0b0-b25de44d1719 tempest-KeyPairsV210TestJSON-1002293989 tempest-KeyPairsV210TestJSON-1002293989-project-admin] Getting quotas for project 7e4992292b8b47d8b3bb8578cc4d9868. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:39:12.177185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-e7370dbc-d2b6-414e-b0b0-b25de44d1719 tempest-KeyPairsV210TestJSON-1002293989 tempest-KeyPairsV210TestJSON-1002293989-project-admin] Getting quotas for user a5d4df5e7ea949c4a58ed4f9e36ee92b and project 7e4992292b8b47d8b3bb8578cc4d9868. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:39:12.242331 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e7370dbc-d2b6-414e-b0b0-b25de44d1719 tempest-KeyPairsV210TestJSON-1002293989 tempest-KeyPairsV210TestJSON-1002293989-project-admin] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.156435 Jul 25 12:39:12.243902 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 147/327] 10.222.0.49 () {62 vars in 1200 bytes} [Mon Jul 25 12:39:12 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 159 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 12:39:12.252610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d200e275-a00e-4720-b926-ba9b9a8f387f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:12.254698 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d200e275-a00e-4720-b926-ba9b9a8f387f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:12.272480 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d200e275-a00e-4720-b926-ba9b9a8f387f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:12.277478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d200e275-a00e-4720-b926-ba9b9a8f387f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:12.278490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d200e275-a00e-4720-b926-ba9b9a8f387f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:12.286467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d200e275-a00e-4720-b926-ba9b9a8f387f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:12.295012 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2865e133-efaa-41a5-974b-ea808e5ece0e tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 2050 microversion: 2.25 time: 1.046939 Jul 25 12:39:12.297168 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 181/328] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:11 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 2050 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:12.331620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2627f601-ccb7-41b3-9a60-e4f0c66c5db3 tempest-KeyPairsV210TestJSON-1002293989 tempest-KeyPairsV210TestJSON-1002293989-project-admin] Calling method '.version_select at 0x7efcfa3df4c0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:12.341190 n-d-848886-15 devstack@n-api.service[125883]: WARNING oslo_db.sqlalchemy.utils [None req-2627f601-ccb7-41b3-9a60-e4f0c66c5db3 tempest-KeyPairsV210TestJSON-1002293989 tempest-KeyPairsV210TestJSON-1002293989-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 12:39:12.352186 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2627f601-ccb7-41b3-9a60-e4f0c66c5db3 tempest-KeyPairsV210TestJSON-1002293989 tempest-KeyPairsV210TestJSON-1002293989-project-admin] 10.222.0.49 "GET /compute/v2.1/os-keypairs?user_id=5332128f294f485e8fa0422ebffe0b85" status: 200 len: 726 microversion: 2.10 time: 0.036107 Jul 25 12:39:12.354181 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 182/329] 10.222.0.49 () {60 vars in 1259 bytes} [Mon Jul 25 12:39:12 2022] GET /compute/v2.1/os-keypairs?user_id=5332128f294f485e8fa0422ebffe0b85 => generated 726 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:39:12.360344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2be50e7d-2e02-40d9-9047-d0c4fa087c07 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:12.361315 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2be50e7d-2e02-40d9-9047-d0c4fa087c07 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:12.378030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2be50e7d-2e02-40d9-9047-d0c4fa087c07 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:12.378578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2be50e7d-2e02-40d9-9047-d0c4fa087c07 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:12.379440 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2be50e7d-2e02-40d9-9047-d0c4fa087c07 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:12.379886 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2be50e7d-2e02-40d9-9047-d0c4fa087c07 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:12.579576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d200e275-a00e-4720-b926-ba9b9a8f387f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:12.592234 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d200e275-a00e-4720-b926-ba9b9a8f387f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1312 microversion: 2.1 time: 0.345118 Jul 25 12:39:12.593063 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 148/330] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:12 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1312 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:12.616769 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d618e834-b329-476e-b7bc-4ab13f184c6d tempest-KeyPairsV210TestJSON-1002293989 tempest-KeyPairsV210TestJSON-1002293989-project-admin] Calling method '.version_select at 0x7efcfb0a4550>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:12.629418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=6,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:12.668427 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d618e834-b329-476e-b7bc-4ab13f184c6d tempest-KeyPairsV210TestJSON-1002293989 tempest-KeyPairsV210TestJSON-1002293989-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-940170465" status: 204 len: 0 microversion: 2.10 time: 0.055535 Jul 25 12:39:12.669024 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 149/331] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 25 12:39:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-940170465 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 12:39:12.677233 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-91bd5d71-3e37-40f1-834e-263d03d366a4 tempest-KeyPairsV210TestJSON-1002293989 tempest-KeyPairsV210TestJSON-1002293989-project-admin] Calling method '.version_select at 0x7efcfa586ee0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:12.726308 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-91bd5d71-3e37-40f1-834e-263d03d366a4 tempest-KeyPairsV210TestJSON-1002293989 tempest-KeyPairsV210TestJSON-1002293989-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1838758103?user_id=5332128f294f485e8fa0422ebffe0b85" status: 204 len: 0 microversion: 2.10 time: 0.052649 Jul 25 12:39:12.727741 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 150/332] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Jul 25 12:39:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1838758103?user_id=5332128f294f485e8fa0422ebffe0b85 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 12:39:12.735952 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3e342e44-e389-4773-8299-43632173f380 tempest-KeyPairsV210TestJSON-1002293989 tempest-KeyPairsV210TestJSON-1002293989-project-admin] Calling method '.version_select at 0x7efcfa6cfdc0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:12.778947 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3e342e44-e389-4773-8299-43632173f380 tempest-KeyPairsV210TestJSON-1002293989 tempest-KeyPairsV210TestJSON-1002293989-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2102505622?user_id=5332128f294f485e8fa0422ebffe0b85" status: 204 len: 0 microversion: 2.10 time: 0.046748 Jul 25 12:39:12.779544 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 151/333] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Jul 25 12:39:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2102505622?user_id=5332128f294f485e8fa0422ebffe0b85 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 12:39:12.838094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-2be50e7d-2e02-40d9-9047-d0c4fa087c07 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lazy-loading 'services' on Instance uuid dc20036c-d36c-4fef-a606-0d1820814320 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:39:12.871975 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2be50e7d-2e02-40d9-9047-d0c4fa087c07 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 2050 microversion: 2.25 time: 0.514994 Jul 25 12:39:12.872717 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 183/334] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:12 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 2050 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:12.899088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ccfc9c0a-e80a-4e47-8a0d-bca46267c72b tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:12.901710 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:39:12.901710 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:39:12.903490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccfc9c0a-e80a-4e47-8a0d-bca46267c72b tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:12.903941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccfc9c0a-e80a-4e47-8a0d-bca46267c72b tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:12.904743 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccfc9c0a-e80a-4e47-8a0d-bca46267c72b tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:12.905176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccfc9c0a-e80a-4e47-8a0d-bca46267c72b tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:12.956550 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-12d55a1a-8f5c-485a-b57f-f2d1d2402f8c req-08a5be24-44b4-4893-9ba5-547ac2d854fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73d77295-bfd7-4ff9-b2f9-09d175f81696", "name": "network-vif-plugged", "status": "completed", "tag": "ed3b7b89-f69c-4f30-b4f9-ecff648c112d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:12.958923 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ccfc9c0a-e80a-4e47-8a0d-bca46267c72b tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.063509 Jul 25 12:39:12.971799 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 152/335] 10.222.0.49 () {60 vars in 1217 bytes} [Mon Jul 25 12:39:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:39:12.975287 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-12d55a1a-8f5c-485a-b57f-f2d1d2402f8c req-08a5be24-44b4-4893-9ba5-547ac2d854fa service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:12.975719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-12d55a1a-8f5c-485a-b57f-f2d1d2402f8c req-08a5be24-44b4-4893-9ba5-547ac2d854fa service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:12.978584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0ded7868-fa7b-4fd0-a6e1-718552694802 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-848886-15", "block_migration": "auto"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:12.981316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0ded7868-fa7b-4fd0-a6e1-718552694802 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:12.988322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ded7868-fa7b-4fd0-a6e1-718552694802 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:12.989242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ded7868-fa7b-4fd0-a6e1-718552694802 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:12.990307 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ded7868-fa7b-4fd0-a6e1-718552694802 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:12.990891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ded7868-fa7b-4fd0-a6e1-718552694802 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:13.010785 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-12d55a1a-8f5c-485a-b57f-f2d1d2402f8c req-08a5be24-44b4-4893-9ba5-547ac2d854fa service nova] Creating event network-vif-plugged:ed3b7b89-f69c-4f30-b4f9-ecff648c112d for instance 73d77295-bfd7-4ff9-b2f9-09d175f81696 on n-h2-848886-15 Jul 25 12:39:13.028016 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-12d55a1a-8f5c-485a-b57f-f2d1d2402f8c req-08a5be24-44b4-4893-9ba5-547ac2d854fa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079622 Jul 25 12:39:13.032576 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 184/336] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:13.145785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-0ded7868-fa7b-4fd0-a6e1-718552694802 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lazy-loading 'flavor' on Instance uuid dc20036c-d36c-4fef-a606-0d1820814320 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:39:13.288053 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0ded7868-fa7b-4fd0-a6e1-718552694802 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Going to try to live migrate instance to n-h1-848886-15 {{(pid=125884) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 12:39:13.616608 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0e4b8edf-21b8-4041-a588-05f6a5fecc10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:13.618773 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0e4b8edf-21b8-4041-a588-05f6a5fecc10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:13.666677 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e4b8edf-21b8-4041-a588-05f6a5fecc10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:13.677623 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e4b8edf-21b8-4041-a588-05f6a5fecc10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:13.688162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e4b8edf-21b8-4041-a588-05f6a5fecc10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:13.693179 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e4b8edf-21b8-4041-a588-05f6a5fecc10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:14.154271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0e4b8edf-21b8-4041-a588-05f6a5fecc10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:14.168976 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0e4b8edf-21b8-4041-a588-05f6a5fecc10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1312 microversion: 2.1 time: 0.558756 Jul 25 12:39:14.169570 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 185/337] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:13 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1312 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:14.938536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6e8757c1-ff91-4d9d-a1ad-47ae1c43a1c9 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-791933845", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:15.050259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-6e8757c1-ff91-4d9d-a1ad-47ae1c43a1c9 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] validate_networks() for None {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:39:15.589193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-6e8757c1-ff91-4d9d-a1ad-47ae1c43a1c9 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:39:15.590322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-6e8757c1-ff91-4d9d-a1ad-47ae1c43a1c9 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:39:15.591068 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-6e8757c1-ff91-4d9d-a1ad-47ae1c43a1c9 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:39:15.591698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-6e8757c1-ff91-4d9d-a1ad-47ae1c43a1c9 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:39:15.592258 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-6e8757c1-ff91-4d9d-a1ad-47ae1c43a1c9 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:39:15.610670 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6e8757c1-ff91-4d9d-a1ad-47ae1c43a1c9 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:15.611419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6e8757c1-ff91-4d9d-a1ad-47ae1c43a1c9 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:15.614048 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6e8757c1-ff91-4d9d-a1ad-47ae1c43a1c9 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:15.614512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6e8757c1-ff91-4d9d-a1ad-47ae1c43a1c9 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:15.662861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-6e8757c1-ff91-4d9d-a1ad-47ae1c43a1c9 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Getting quotas for project 78c5541f51c149278aad62c55bb62d8f. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:39:15.671964 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-6e8757c1-ff91-4d9d-a1ad-47ae1c43a1c9 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Getting quotas for user 78a553e32dbb4f3d8e362d67bc1ba55f and project 78c5541f51c149278aad62c55bb62d8f. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:39:15.697998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6e8757c1-ff91-4d9d-a1ad-47ae1c43a1c9 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:39:15.703574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6e8757c1-ff91-4d9d-a1ad-47ae1c43a1c9 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 5d7df5ea-519f-4020-8467-cbe9423e3560] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:39:15.836945 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6e8757c1-ff91-4d9d-a1ad-47ae1c43a1c9 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.581009 Jul 25 12:39:15.844876 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 186/338] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:39:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:39:15.860149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e52db699-e70c-4461-8b90-bd599b9d8ef4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:15.860149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e52db699-e70c-4461-8b90-bd599b9d8ef4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:15.878844 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e52db699-e70c-4461-8b90-bd599b9d8ef4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:15.880154 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e52db699-e70c-4461-8b90-bd599b9d8ef4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:15.880958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e52db699-e70c-4461-8b90-bd599b9d8ef4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:15.885320 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e52db699-e70c-4461-8b90-bd599b9d8ef4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:16.390367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e52db699-e70c-4461-8b90-bd599b9d8ef4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:16.404656 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e52db699-e70c-4461-8b90-bd599b9d8ef4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1461 microversion: 2.1 time: 0.555651 Jul 25 12:39:16.406544 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 187/339] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:15 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1461 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:16.427388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f86e80f1-da9b-4367-9064-2c1fb0f4e834 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:16.428455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f86e80f1-da9b-4367-9064-2c1fb0f4e834 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 5d7df5ea-519f-4020-8467-cbe9423e3560] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:16.614253 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f86e80f1-da9b-4367-9064-2c1fb0f4e834 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a553e32dbb4f3d8e362d67bc1ba55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c5541f51c149278aad62c55bb62d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:16.621546 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f86e80f1-da9b-4367-9064-2c1fb0f4e834 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560" status: 200 len: 1219 microversion: 2.1 time: 0.207582 Jul 25 12:39:16.624378 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 188/340] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:16 2022] GET /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560 => generated 1219 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:17.336563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0ff4b342-1e36-4cb9-8999-036e7cb32c10 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:17.337350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0ff4b342-1e36-4cb9-8999-036e7cb32c10 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:17.352538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ff4b342-1e36-4cb9-8999-036e7cb32c10 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:17.353014 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ff4b342-1e36-4cb9-8999-036e7cb32c10 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:17.356034 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ff4b342-1e36-4cb9-8999-036e7cb32c10 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:17.357340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ff4b342-1e36-4cb9-8999-036e7cb32c10 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:18.753169 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0ff4b342-1e36-4cb9-8999-036e7cb32c10 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1614 microversion: 2.1 time: 2.124934 Jul 25 12:39:18.755001 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 189/341] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:16 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1614 bytes in 2127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:19.422055 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0ded7868-fa7b-4fd0-a6e1-718552694802 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320/action" status: 202 len: 0 microversion: 2.25 time: 6.448843 Jul 25 12:39:19.422948 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 153/342] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Jul 25 12:39:12 2022] POST /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320/action => generated 0 bytes in 6450 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:39:19.672482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-13dc854f-bb0b-41fa-9767-187bd282027c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-661966241", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:19.804718 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-13dc854f-bb0b-41fa-9767-187bd282027c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] validate_networks() for None {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:39:19.887745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b9ff9ab5-f957-42b2-b84a-7c9f9f73cf62 tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] Action: 'create', calling method: .version_select at 0x7efcfa6e1a60>, body: {"pool": null} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:20.706415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-13dc854f-bb0b-41fa-9767-187bd282027c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:39:20.707381 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-13dc854f-bb0b-41fa-9767-187bd282027c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:39:20.708240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-13dc854f-bb0b-41fa-9767-187bd282027c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:39:20.709007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-13dc854f-bb0b-41fa-9767-187bd282027c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:39:20.709620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-13dc854f-bb0b-41fa-9767-187bd282027c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:39:20.736789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13dc854f-bb0b-41fa-9767-187bd282027c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:20.738931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13dc854f-bb0b-41fa-9767-187bd282027c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:20.739943 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13dc854f-bb0b-41fa-9767-187bd282027c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:20.742551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13dc854f-bb0b-41fa-9767-187bd282027c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:20.776425 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-13dc854f-bb0b-41fa-9767-187bd282027c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Getting quotas for project 441bc4b2a9f241b8bcb74a18e3741ca0. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:39:20.790114 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-13dc854f-bb0b-41fa-9767-187bd282027c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Getting quotas for user 896d3b06fb2446ca99333ce426e52d4b and project 441bc4b2a9f241b8bcb74a18e3741ca0. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:39:20.802280 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-13dc854f-bb0b-41fa-9767-187bd282027c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:39:20.804896 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-13dc854f-bb0b-41fa-9767-187bd282027c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: a35d467a-2c77-4821-9799-f7873a144436] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:39:20.911831 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-13dc854f-bb0b-41fa-9767-187bd282027c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.155410 Jul 25 12:39:20.918759 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 190/343] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:39:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:39:20.923183 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ada08032-12ed-4b86-996a-e242ca3a77d1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:20.923949 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ada08032-12ed-4b86-996a-e242ca3a77d1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 5d7df5ea-519f-4020-8467-cbe9423e3560] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:20.934577 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ada08032-12ed-4b86-996a-e242ca3a77d1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:20.935274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ada08032-12ed-4b86-996a-e242ca3a77d1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:20.936771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ada08032-12ed-4b86-996a-e242ca3a77d1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:20.937431 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ada08032-12ed-4b86-996a-e242ca3a77d1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:21.494502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ada08032-12ed-4b86-996a-e242ca3a77d1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a553e32dbb4f3d8e362d67bc1ba55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c5541f51c149278aad62c55bb62d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:21.508857 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ada08032-12ed-4b86-996a-e242ca3a77d1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560" status: 200 len: 1319 microversion: 2.1 time: 0.594320 Jul 25 12:39:21.512859 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 191/344] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:20 2022] GET /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560 => generated 1319 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:21.517596 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6aebe57c-4f0f-4f33-9688-5b7f93d755f0 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:21.521643 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6aebe57c-4f0f-4f33-9688-5b7f93d755f0 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:21.536853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6aebe57c-4f0f-4f33-9688-5b7f93d755f0 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:21.537309 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6aebe57c-4f0f-4f33-9688-5b7f93d755f0 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:21.538119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6aebe57c-4f0f-4f33-9688-5b7f93d755f0 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:21.538535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6aebe57c-4f0f-4f33-9688-5b7f93d755f0 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:21.788423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6aebe57c-4f0f-4f33-9688-5b7f93d755f0 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f1d6eca33052491a9601c2bd454dd5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda37bacac5a405f86d02897dd9b0388', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:21.796578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6aebe57c-4f0f-4f33-9688-5b7f93d755f0 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] flavor_id is None. Assuming migration. {{(pid=125883) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 25 12:39:21.797124 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6aebe57c-4f0f-4f33-9688-5b7f93d755f0 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125883) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 12:39:22.200872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=12 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:22.380771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:22.462946 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6aebe57c-4f0f-4f33-9688-5b7f93d755f0 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696/action" status: 202 len: 0 microversion: 2.1 time: 0.948173 Jul 25 12:39:22.465729 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 192/345] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:39:21 2022] POST /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696/action => generated 0 bytes in 952 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:39:22.473424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2549b153-963c-465d-b90e-50125124d285 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:22.475023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2549b153-963c-465d-b90e-50125124d285 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:22.483900 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2549b153-963c-465d-b90e-50125124d285 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:22.484638 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2549b153-963c-465d-b90e-50125124d285 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:22.485715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2549b153-963c-465d-b90e-50125124d285 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:22.487012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2549b153-963c-465d-b90e-50125124d285 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:22.911174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:23.359617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:23.420246 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2549b153-963c-465d-b90e-50125124d285 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:23.431403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2549b153-963c-465d-b90e-50125124d285 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:23.439505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2549b153-963c-465d-b90e-50125124d285 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:23.441117 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2549b153-963c-465d-b90e-50125124d285 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 1566 microversion: 2.25 time: 0.973925 Jul 25 12:39:23.455336 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 193/346] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:22 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 1566 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:23.606136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:23.622577 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b9ff9ab5-f957-42b2-b84a-7c9f9f73cf62 tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.198497 Jul 25 12:39:23.623253 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 154/347] 10.222.0.49 () {60 vars in 1170 bytes} [Mon Jul 25 12:39:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:23.650094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9c82f303-c0a4-4b81-bc36-ebadc7a0272a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:23.651003 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9c82f303-c0a4-4b81-bc36-ebadc7a0272a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: a35d467a-2c77-4821-9799-f7873a144436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:23.688499 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9c82f303-c0a4-4b81-bc36-ebadc7a0272a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:23.689062 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9c82f303-c0a4-4b81-bc36-ebadc7a0272a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:23.689928 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9c82f303-c0a4-4b81-bc36-ebadc7a0272a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:23.690361 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9c82f303-c0a4-4b81-bc36-ebadc7a0272a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:23.798776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-52e729f8-8004-4abe-aa6e-89a385986542 tempest-SecurityGroupsTestAdminJSON-2112763349 tempest-SecurityGroupsTestAdminJSON-2112763349-project] Action: 'create', calling method: .version_select at 0x7efcfa3ae790>, body: {"security_group": {"name": "tempest-securitygroup-2013143145", "description": "tempest-description-1132392871"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:23.870493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9c82f303-c0a4-4b81-bc36-ebadc7a0272a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:23.899773 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9c82f303-c0a4-4b81-bc36-ebadc7a0272a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436" status: 200 len: 1276 microversion: 2.1 time: 0.263935 Jul 25 12:39:23.900542 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 155/348] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:23 2022] GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436 => generated 1276 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:23.913776 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9117a102-0669-4184-97c8-efa9d7169318 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:23.920499 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9117a102-0669-4184-97c8-efa9d7169318 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:23.938476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9117a102-0669-4184-97c8-efa9d7169318 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:23.939349 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9117a102-0669-4184-97c8-efa9d7169318 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:23.940266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9117a102-0669-4184-97c8-efa9d7169318 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:23.941099 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9117a102-0669-4184-97c8-efa9d7169318 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:24.004871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9117a102-0669-4184-97c8-efa9d7169318 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:39:24.165044 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9117a102-0669-4184-97c8-efa9d7169318 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "DELETE /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 204 len: 0 microversion: 2.1 time: 0.259506 Jul 25 12:39:24.165925 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 156/349] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:39:23 2022] DELETE /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:39:24.322163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0ef78508-fc33-477c-9bc5-62ed0b6dc274 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-321044613", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "2f06aa7d-4566-4383-a6d0-5dee93546175"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:24.392973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-0ef78508-fc33-477c-9bc5-62ed0b6dc274 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] validate_networks() for [('2f06aa7d-4566-4383-a6d0-5dee93546175', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:39:24.886042 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-52e729f8-8004-4abe-aa6e-89a385986542 tempest-SecurityGroupsTestAdminJSON-2112763349 tempest-SecurityGroupsTestAdminJSON-2112763349-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.429138 Jul 25 12:39:24.886650 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 194/350] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:39:23 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:24.895531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9f916c84-1bd4-42f5-b553-2c0db051d008 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:24.896473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9f916c84-1bd4-42f5-b553-2c0db051d008 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:24.918735 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9f916c84-1bd4-42f5-b553-2c0db051d008 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:24.919702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9f916c84-1bd4-42f5-b553-2c0db051d008 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:24.923154 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9f916c84-1bd4-42f5-b553-2c0db051d008 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:24.925100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9f916c84-1bd4-42f5-b553-2c0db051d008 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:25.197612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9f916c84-1bd4-42f5-b553-2c0db051d008 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:25.208040 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9f916c84-1bd4-42f5-b553-2c0db051d008 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1470 microversion: 2.1 time: 0.317003 Jul 25 12:39:25.208781 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 195/351] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:24 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1470 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:25.213676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-50f45307-5383-42c1-a6b3-b0794acc816c tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:25.214649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-50f45307-5383-42c1-a6b3-b0794acc816c tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 5d7df5ea-519f-4020-8467-cbe9423e3560] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:25.222096 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50f45307-5383-42c1-a6b3-b0794acc816c tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:25.223722 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50f45307-5383-42c1-a6b3-b0794acc816c tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:25.224592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50f45307-5383-42c1-a6b3-b0794acc816c tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:25.225102 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50f45307-5383-42c1-a6b3-b0794acc816c tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:25.386364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-0ef78508-fc33-477c-9bc5-62ed0b6dc274 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:39:25.387153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-0ef78508-fc33-477c-9bc5-62ed0b6dc274 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:39:25.387827 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-0ef78508-fc33-477c-9bc5-62ed0b6dc274 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:39:25.388436 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-0ef78508-fc33-477c-9bc5-62ed0b6dc274 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:39:25.389203 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-0ef78508-fc33-477c-9bc5-62ed0b6dc274 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:39:25.400371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ef78508-fc33-477c-9bc5-62ed0b6dc274 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:25.402947 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ef78508-fc33-477c-9bc5-62ed0b6dc274 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:25.405954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ef78508-fc33-477c-9bc5-62ed0b6dc274 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:25.406973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ef78508-fc33-477c-9bc5-62ed0b6dc274 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:25.441103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-0ef78508-fc33-477c-9bc5-62ed0b6dc274 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Getting quotas for project 4946a18b68e146278158ac991143a243. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:39:25.447599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-0ef78508-fc33-477c-9bc5-62ed0b6dc274 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Getting quotas for user a02530d4c6384518b3f45515208e83d8 and project 4946a18b68e146278158ac991143a243. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:39:25.468165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-50f45307-5383-42c1-a6b3-b0794acc816c tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a553e32dbb4f3d8e362d67bc1ba55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c5541f51c149278aad62c55bb62d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:25.473131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0ef78508-fc33-477c-9bc5-62ed0b6dc274 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:39:25.477235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0ef78508-fc33-477c-9bc5-62ed0b6dc274 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:39:25.479386 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-50f45307-5383-42c1-a6b3-b0794acc816c tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560" status: 200 len: 1319 microversion: 2.1 time: 0.269320 Jul 25 12:39:25.480646 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 196/352] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:25 2022] GET /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:25.485699 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-2576a20d-c8d2-4e29-aad3-d08c4608d4d5 req-20365a35-03e1-4320-9743-06325d809d5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d7df5ea-519f-4020-8467-cbe9423e3560", "tag": "7a275690-625b-4abe-bc6d-d7ad2c9a860e"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:25.495588 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2576a20d-c8d2-4e29-aad3-d08c4608d4d5 req-20365a35-03e1-4320-9743-06325d809d5a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:25.496348 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2576a20d-c8d2-4e29-aad3-d08c4608d4d5 req-20365a35-03e1-4320-9743-06325d809d5a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:25.522136 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-2576a20d-c8d2-4e29-aad3-d08c4608d4d5 req-20365a35-03e1-4320-9743-06325d809d5a service nova] Creating event network-changed:7a275690-625b-4abe-bc6d-d7ad2c9a860e for instance 5d7df5ea-519f-4020-8467-cbe9423e3560 on n-h1-848886-15 Jul 25 12:39:25.535009 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-2576a20d-c8d2-4e29-aad3-d08c4608d4d5 req-20365a35-03e1-4320-9743-06325d809d5a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052657 Jul 25 12:39:25.539065 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 197/353] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:25.551774 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e1d9b0c1-7a3d-4a00-872f-74c56de3507e tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] Calling method '.version_select at 0x7efcfa2c9dc0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:25.593918 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0ef78508-fc33-477c-9bc5-62ed0b6dc274 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.421707 Jul 25 12:39:25.601423 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 157/354] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:39:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1435 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:39:25.607697 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f8ed5241-19fa-4888-8feb-881a0ed1adf0 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2102566104", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "1596786347", "adminPass": "***", "networks": [{"uuid": "a739ecf8-3705-46b6-bd48-c554faa6484d"}], "security_groups": [{"name": "tempest-securitygroup--1628136432"}], "key_name": "tempest-keypair-1722192819", "user_data": "}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:25.945797 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-f8ed5241-19fa-4888-8feb-881a0ed1adf0 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] validate_networks() for [('a739ecf8-3705-46b6-bd48-c554faa6484d', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:39:26.115392 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e1d9b0c1-7a3d-4a00-872f-74c56de3507e tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips/59a738ed-3614-4d40-bd6b-3de2c3bd8885" status: 200 len: 142 microversion: 2.1 time: 0.574963 Jul 25 12:39:26.140443 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 198/355] 10.222.0.49 () {58 vars in 1260 bytes} [Mon Jul 25 12:39:25 2022] GET /compute/v2.1/os-floating-ips/59a738ed-3614-4d40-bd6b-3de2c3bd8885 => generated 142 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:26.145511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6b3cc183-f3fc-4938-9910-2b1fcafd6791 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:26.146598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6b3cc183-f3fc-4938-9910-2b1fcafd6791 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:26.154545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b3cc183-f3fc-4938-9910-2b1fcafd6791 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:26.155250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b3cc183-f3fc-4938-9910-2b1fcafd6791 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:26.156879 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b3cc183-f3fc-4938-9910-2b1fcafd6791 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:26.158072 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b3cc183-f3fc-4938-9910-2b1fcafd6791 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:26.685222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6b3cc183-f3fc-4938-9910-2b1fcafd6791 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:26.698688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6b3cc183-f3fc-4938-9910-2b1fcafd6791 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:26.703480 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6b3cc183-f3fc-4938-9910-2b1fcafd6791 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:26.707413 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6b3cc183-f3fc-4938-9910-2b1fcafd6791 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 1566 microversion: 2.25 time: 0.565849 Jul 25 12:39:26.710718 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 199/356] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:26 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 1566 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:26.735790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-df548ea6-d6fc-4675-b534-58dd7b60e784 tempest-SecurityGroupsTestAdminJSON-2112763349 tempest-SecurityGroupsTestAdminJSON-2112763349-project] Action: 'create', calling method: .version_select at 0x7efcfa2c9280>, body: {"security_group": {"name": "tempest-securitygroup-1023524229", "description": "tempest-description-1061447640"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:27.139587 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-f8ed5241-19fa-4888-8feb-881a0ed1adf0 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:39:27.140154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-f8ed5241-19fa-4888-8feb-881a0ed1adf0 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:39:27.140798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-f8ed5241-19fa-4888-8feb-881a0ed1adf0 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:39:27.141943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-f8ed5241-19fa-4888-8feb-881a0ed1adf0 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:39:27.142559 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-f8ed5241-19fa-4888-8feb-881a0ed1adf0 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:39:27.163041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8ed5241-19fa-4888-8feb-881a0ed1adf0 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:27.163597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8ed5241-19fa-4888-8feb-881a0ed1adf0 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:27.165194 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8ed5241-19fa-4888-8feb-881a0ed1adf0 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:27.166092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8ed5241-19fa-4888-8feb-881a0ed1adf0 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:27.195037 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-f8ed5241-19fa-4888-8feb-881a0ed1adf0 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Getting quotas for project 4ded56ca1da44b65a227d978f927d9db. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:39:27.204034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-f8ed5241-19fa-4888-8feb-881a0ed1adf0 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Getting quotas for user ef5e681ba263436099656b879c77162b and project 4ded56ca1da44b65a227d978f927d9db. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:39:27.255488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f8ed5241-19fa-4888-8feb-881a0ed1adf0 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:39:27.259119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f8ed5241-19fa-4888-8feb-881a0ed1adf0 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: fefcb083-ed47-4de2-9c77-0bdb30d0aa6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:39:27.385199 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f8ed5241-19fa-4888-8feb-881a0ed1adf0 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.782012 Jul 25 12:39:27.386169 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 158/357] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:39:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:39:27.395760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-62577efd-03fc-40e6-9c5a-bf3d3acba668 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:27.396871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-62577efd-03fc-40e6-9c5a-bf3d3acba668 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: a35d467a-2c77-4821-9799-f7873a144436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:27.406922 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-62577efd-03fc-40e6-9c5a-bf3d3acba668 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:27.408877 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-62577efd-03fc-40e6-9c5a-bf3d3acba668 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:27.409738 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-62577efd-03fc-40e6-9c5a-bf3d3acba668 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:27.410659 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-62577efd-03fc-40e6-9c5a-bf3d3acba668 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:27.483473 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-df548ea6-d6fc-4675-b534-58dd7b60e784 tempest-SecurityGroupsTestAdminJSON-2112763349 tempest-SecurityGroupsTestAdminJSON-2112763349-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.757838 Jul 25 12:39:27.485517 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 200/358] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:39:26 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:27.491245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7c9b1946-993d-4c3d-a399-4f92065c0862 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:27.493377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7c9b1946-993d-4c3d-a399-4f92065c0862 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:27.504238 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c9b1946-993d-4c3d-a399-4f92065c0862 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:27.505149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c9b1946-993d-4c3d-a399-4f92065c0862 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:27.506172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c9b1946-993d-4c3d-a399-4f92065c0862 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:27.506973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c9b1946-993d-4c3d-a399-4f92065c0862 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:27.668061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7c9b1946-993d-4c3d-a399-4f92065c0862 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:27.683516 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7c9b1946-993d-4c3d-a399-4f92065c0862 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 200 len: 1270 microversion: 2.1 time: 0.196673 Jul 25 12:39:27.697214 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 201/359] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:27 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 1270 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:27.697214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8bda2e04-311e-4da1-9e02-ae2b45be402c tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] Calling method '.version_select at 0x7efcfa3aeb80>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:28.608846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-62577efd-03fc-40e6-9c5a-bf3d3acba668 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:28.624361 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-62577efd-03fc-40e6-9c5a-bf3d3acba668 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436" status: 200 len: 1318 microversion: 2.1 time: 1.235606 Jul 25 12:39:28.626029 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 159/360] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:27 2022] GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436 => generated 1318 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:28.632181 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8bda2e04-311e-4da1-9e02-ae2b45be402c tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.946595 Jul 25 12:39:28.632756 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 202/361] 10.222.0.49 () {58 vars in 1149 bytes} [Mon Jul 25 12:39:27 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:28.638961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b57eda1e-afb7-4f0e-9ff9-a45e4d3adf84 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:28.639591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b57eda1e-afb7-4f0e-9ff9-a45e4d3adf84 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 5d7df5ea-519f-4020-8467-cbe9423e3560] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:28.640210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ee475c60-00ba-480a-bd59-bcacd211fdcf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:28.658807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ee475c60-00ba-480a-bd59-bcacd211fdcf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:28.672389 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b57eda1e-afb7-4f0e-9ff9-a45e4d3adf84 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:28.674037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b57eda1e-afb7-4f0e-9ff9-a45e4d3adf84 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:28.680284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b57eda1e-afb7-4f0e-9ff9-a45e4d3adf84 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:28.680816 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b57eda1e-afb7-4f0e-9ff9-a45e4d3adf84 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:28.686228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee475c60-00ba-480a-bd59-bcacd211fdcf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:28.693938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee475c60-00ba-480a-bd59-bcacd211fdcf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:28.694932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee475c60-00ba-480a-bd59-bcacd211fdcf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:28.700138 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee475c60-00ba-480a-bd59-bcacd211fdcf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:29.209151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b57eda1e-afb7-4f0e-9ff9-a45e4d3adf84 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a553e32dbb4f3d8e362d67bc1ba55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c5541f51c149278aad62c55bb62d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:29.218588 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b57eda1e-afb7-4f0e-9ff9-a45e4d3adf84 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560" status: 200 len: 1319 microversion: 2.1 time: 0.584761 Jul 25 12:39:29.223119 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 203/362] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:28 2022] GET /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560 => generated 1319 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:29.223671 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ee475c60-00ba-480a-bd59-bcacd211fdcf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:29.229658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-c7905610-a7ea-4244-97e7-089e5d06c6e7 req-39cedcf5-56e5-4677-958a-8a61359a776c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a35d467a-2c77-4821-9799-f7873a144436", "tag": "896ea210-b59a-4cf5-8f4d-a412adf1854e"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:29.242383 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ee475c60-00ba-480a-bd59-bcacd211fdcf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1470 microversion: 2.1 time: 0.614902 Jul 25 12:39:29.242975 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 160/363] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:28 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1470 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:29.253580 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-05bf03c4-5399-4006-8d13-23a1a7daeee5 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:29.261908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-05bf03c4-5399-4006-8d13-23a1a7daeee5 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: fefcb083-ed47-4de2-9c77-0bdb30d0aa6f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:29.270473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c7905610-a7ea-4244-97e7-089e5d06c6e7 req-39cedcf5-56e5-4677-958a-8a61359a776c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:29.270917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c7905610-a7ea-4244-97e7-089e5d06c6e7 req-39cedcf5-56e5-4677-958a-8a61359a776c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:29.282798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05bf03c4-5399-4006-8d13-23a1a7daeee5 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:29.283329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05bf03c4-5399-4006-8d13-23a1a7daeee5 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:29.284298 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05bf03c4-5399-4006-8d13-23a1a7daeee5 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:29.284891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05bf03c4-5399-4006-8d13-23a1a7daeee5 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:29.314500 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-c7905610-a7ea-4244-97e7-089e5d06c6e7 req-39cedcf5-56e5-4677-958a-8a61359a776c service nova] Creating event network-changed:896ea210-b59a-4cf5-8f4d-a412adf1854e for instance a35d467a-2c77-4821-9799-f7873a144436 on n-h2-848886-15 Jul 25 12:39:29.327705 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-c7905610-a7ea-4244-97e7-089e5d06c6e7 req-39cedcf5-56e5-4677-958a-8a61359a776c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102700 Jul 25 12:39:29.337714 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 204/364] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:29.397537 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-29b1d06e-cf09-4e34-ad4b-518341774d07 tempest-SecurityGroupsTestAdminJSON-731968293 tempest-SecurityGroupsTestAdminJSON-731968293-project-admin] Action: 'create', calling method: .version_select at 0x7efcfa3df820>, body: {"security_group": {"name": "tempest-securitygroup-588637409", "description": "tempest-description-1405221318"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:29.475963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-05bf03c4-5399-4006-8d13-23a1a7daeee5 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:29.486829 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-05bf03c4-5399-4006-8d13-23a1a7daeee5 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f" status: 200 len: 1335 microversion: 2.1 time: 0.236952 Jul 25 12:39:29.487536 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 161/365] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:29 2022] GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f => generated 1335 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:29.512794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-6b90b676-2964-42ee-843e-46437542a072 req-515def67-5dd2-47b9-8040-88b751c4b6b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc20036c-d36c-4fef-a606-0d1820814320", "name": "network-vif-unplugged", "status": "completed", "tag": "92cf7b8c-f2ba-49cf-9e6d-a32bdb600392"}, {"name": "network-changed", "server_uuid": "dc20036c-d36c-4fef-a606-0d1820814320", "tag": "92cf7b8c-f2ba-49cf-9e6d-a32bdb600392"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:29.532638 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6b90b676-2964-42ee-843e-46437542a072 req-515def67-5dd2-47b9-8040-88b751c4b6b5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:29.533520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6b90b676-2964-42ee-843e-46437542a072 req-515def67-5dd2-47b9-8040-88b751c4b6b5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:29.554600 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-6b90b676-2964-42ee-843e-46437542a072 req-515def67-5dd2-47b9-8040-88b751c4b6b5 service nova] Creating event network-vif-unplugged:92cf7b8c-f2ba-49cf-9e6d-a32bdb600392 for instance dc20036c-d36c-4fef-a606-0d1820814320 on n-h2-848886-15 Jul 25 12:39:29.555464 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-6b90b676-2964-42ee-843e-46437542a072 req-515def67-5dd2-47b9-8040-88b751c4b6b5 service nova] Creating event network-changed:92cf7b8c-f2ba-49cf-9e6d-a32bdb600392 for instance dc20036c-d36c-4fef-a606-0d1820814320 on n-h2-848886-15 Jul 25 12:39:29.565800 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-6b90b676-2964-42ee-843e-46437542a072 req-515def67-5dd2-47b9-8040-88b751c4b6b5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.057873 Jul 25 12:39:29.567353 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 162/366] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:29.577414 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-13107a19-a6d6-4e84-b58b-9927d72d97a7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:29.579337 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-13107a19-a6d6-4e84-b58b-9927d72d97a7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:29.589362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-13107a19-a6d6-4e84-b58b-9927d72d97a7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:29.590625 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-13107a19-a6d6-4e84-b58b-9927d72d97a7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:29.592102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-13107a19-a6d6-4e84-b58b-9927d72d97a7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:29.593167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-13107a19-a6d6-4e84-b58b-9927d72d97a7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:29.965015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-13107a19-a6d6-4e84-b58b-9927d72d97a7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:29.983379 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-13107a19-a6d6-4e84-b58b-9927d72d97a7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:29.985372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-13107a19-a6d6-4e84-b58b-9927d72d97a7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:29.987013 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-13107a19-a6d6-4e84-b58b-9927d72d97a7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 1566 microversion: 2.25 time: 0.416855 Jul 25 12:39:29.987837 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 163/367] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:29 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 1566 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:29.998851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-06d18fc2-a8c2-4b8d-b83e-590538355429 tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] Calling method '.version_select at 0x7efcfa5a8280>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:30.471653 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-29b1d06e-cf09-4e34-ad4b-518341774d07 tempest-SecurityGroupsTestAdminJSON-731968293 tempest-SecurityGroupsTestAdminJSON-731968293-project-admin] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.132521 Jul 25 12:39:30.472755 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 205/368] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:39:29 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:30.483485 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-118819c5-3a1b-4dee-8766-03859f84cebd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:30.484604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-118819c5-3a1b-4dee-8766-03859f84cebd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:30.493037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-118819c5-3a1b-4dee-8766-03859f84cebd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:30.493900 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-118819c5-3a1b-4dee-8766-03859f84cebd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:30.495119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-118819c5-3a1b-4dee-8766-03859f84cebd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:30.495703 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-118819c5-3a1b-4dee-8766-03859f84cebd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:30.756110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:30.797553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=14 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:30.824247 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-118819c5-3a1b-4dee-8766-03859f84cebd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:30.832798 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-118819c5-3a1b-4dee-8766-03859f84cebd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 200 len: 1310 microversion: 2.1 time: 0.358530 Jul 25 12:39:30.834050 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 206/369] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:30 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 1310 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:30.838667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-c5694cc3-230e-441c-a7aa-1543ad518301 req-d57dd81b-896f-404e-b08f-d5c6e906b222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d7df5ea-519f-4020-8467-cbe9423e3560", "name": "network-vif-plugged", "status": "completed", "tag": "7a275690-625b-4abe-bc6d-d7ad2c9a860e"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:30.853482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c5694cc3-230e-441c-a7aa-1543ad518301 req-d57dd81b-896f-404e-b08f-d5c6e906b222 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:30.853951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c5694cc3-230e-441c-a7aa-1543ad518301 req-d57dd81b-896f-404e-b08f-d5c6e906b222 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:30.865739 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-c5694cc3-230e-441c-a7aa-1543ad518301 req-d57dd81b-896f-404e-b08f-d5c6e906b222 service nova] Creating event network-vif-plugged:7a275690-625b-4abe-bc6d-d7ad2c9a860e for instance 5d7df5ea-519f-4020-8467-cbe9423e3560 on n-h1-848886-15 Jul 25 12:39:30.871314 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-c5694cc3-230e-441c-a7aa-1543ad518301 req-d57dd81b-896f-404e-b08f-d5c6e906b222 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036556 Jul 25 12:39:30.876883 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 207/370] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:30.886561 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5d3485bb-75b1-4009-9020-8c8634388be1 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:30.888838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5d3485bb-75b1-4009-9020-8c8634388be1 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: a35d467a-2c77-4821-9799-f7873a144436] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:30.897615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d3485bb-75b1-4009-9020-8c8634388be1 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:30.898216 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d3485bb-75b1-4009-9020-8c8634388be1 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:30.899143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d3485bb-75b1-4009-9020-8c8634388be1 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:30.901747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d3485bb-75b1-4009-9020-8c8634388be1 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:31.727200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5d3485bb-75b1-4009-9020-8c8634388be1 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:31.736773 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5d3485bb-75b1-4009-9020-8c8634388be1 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436" status: 200 len: 1318 microversion: 2.1 time: 0.858339 Jul 25 12:39:31.754034 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 208/371] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:30 2022] GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436 => generated 1318 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:31.784054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3fc6ab93-d817-4a9c-8c53-04b8f1e70dba tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:31.785199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3fc6ab93-d817-4a9c-8c53-04b8f1e70dba tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 5d7df5ea-519f-4020-8467-cbe9423e3560] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:31.794309 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3fc6ab93-d817-4a9c-8c53-04b8f1e70dba tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:31.795170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3fc6ab93-d817-4a9c-8c53-04b8f1e70dba tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:31.796130 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3fc6ab93-d817-4a9c-8c53-04b8f1e70dba tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:31.796706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3fc6ab93-d817-4a9c-8c53-04b8f1e70dba tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:32.339462 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3fc6ab93-d817-4a9c-8c53-04b8f1e70dba tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a553e32dbb4f3d8e362d67bc1ba55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c5541f51c149278aad62c55bb62d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:32.352825 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3fc6ab93-d817-4a9c-8c53-04b8f1e70dba tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560" status: 200 len: 1319 microversion: 2.1 time: 0.596970 Jul 25 12:39:32.368817 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 209/372] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:31 2022] GET /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560 => generated 1319 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:32.375482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c5c2b697-8bf1-4b0e-b1d5-6d6bb3ecc4fa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:32.376408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c5c2b697-8bf1-4b0e-b1d5-6d6bb3ecc4fa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:32.401962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5c2b697-8bf1-4b0e-b1d5-6d6bb3ecc4fa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:32.402835 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5c2b697-8bf1-4b0e-b1d5-6d6bb3ecc4fa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:32.404041 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5c2b697-8bf1-4b0e-b1d5-6d6bb3ecc4fa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:32.404483 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5c2b697-8bf1-4b0e-b1d5-6d6bb3ecc4fa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:32.564249 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-06d18fc2-a8c2-4b8d-b83e-590538355429 tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/59a738ed-3614-4d40-bd6b-3de2c3bd8885" status: 202 len: 0 microversion: 2.1 time: 2.574994 Jul 25 12:39:32.564855 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 164/373] 10.222.0.49 () {58 vars in 1263 bytes} [Mon Jul 25 12:39:29 2022] DELETE /compute/v2.1/os-floating-ips/59a738ed-3614-4d40-bd6b-3de2c3bd8885 => generated 0 bytes in 2576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:39:32.572869 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-efa619e2-f008-4c51-b107-e4655c2b34d4 tempest-SecurityGroupsTestAdminJSON-731968293 tempest-SecurityGroupsTestAdminJSON-731968293-project-admin] Action: 'create', calling method: .version_select at 0x7efcfa470ee0>, body: {"security_group": {"name": "tempest-securitygroup-1768504997", "description": "tempest-description-1944264312"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:32.806846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c5c2b697-8bf1-4b0e-b1d5-6d6bb3ecc4fa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:32.814920 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c5c2b697-8bf1-4b0e-b1d5-6d6bb3ecc4fa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1475 microversion: 2.1 time: 0.444670 Jul 25 12:39:32.815582 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 210/374] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:32 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1475 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:32.831711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f83606a9-154f-479c-9044-5fa3147f9010 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:32.833285 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f83606a9-154f-479c-9044-5fa3147f9010 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: fefcb083-ed47-4de2-9c77-0bdb30d0aa6f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:32.841140 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f83606a9-154f-479c-9044-5fa3147f9010 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:32.841582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f83606a9-154f-479c-9044-5fa3147f9010 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:32.842449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f83606a9-154f-479c-9044-5fa3147f9010 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:32.842915 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f83606a9-154f-479c-9044-5fa3147f9010 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:33.136331 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-efa619e2-f008-4c51-b107-e4655c2b34d4 tempest-SecurityGroupsTestAdminJSON-731968293 tempest-SecurityGroupsTestAdminJSON-731968293-project-admin] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.569822 Jul 25 12:39:33.137311 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 165/375] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:39:32 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:33.141675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4e87f596-9a4d-4603-9fef-2204aeac2b30 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:33.144932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4e87f596-9a4d-4603-9fef-2204aeac2b30 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:33.152682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e87f596-9a4d-4603-9fef-2204aeac2b30 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:33.153442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e87f596-9a4d-4603-9fef-2204aeac2b30 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:33.154641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e87f596-9a4d-4603-9fef-2204aeac2b30 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:33.156111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e87f596-9a4d-4603-9fef-2204aeac2b30 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:33.371074 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f83606a9-154f-479c-9044-5fa3147f9010 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:33.382979 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f83606a9-154f-479c-9044-5fa3147f9010 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f" status: 200 len: 1391 microversion: 2.1 time: 0.558771 Jul 25 12:39:33.383951 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 211/376] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:32 2022] GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f => generated 1391 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:33.389966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-7d4fb6bd-d5da-43ef-b192-5d491e397762 req-9315ac28-fc2b-4568-a41e-b6b5ef3d2892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36fa069d-9aaa-4804-a21f-8526cbe9d728", "name": "network-vif-deleted", "tag": "bee090ea-f3af-4297-9530-9c09fda48a76"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:33.400984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-7d4fb6bd-d5da-43ef-b192-5d491e397762 req-9315ac28-fc2b-4568-a41e-b6b5ef3d2892 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:33.401747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-7d4fb6bd-d5da-43ef-b192-5d491e397762 req-9315ac28-fc2b-4568-a41e-b6b5ef3d2892 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:33.416721 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-7d4fb6bd-d5da-43ef-b192-5d491e397762 req-9315ac28-fc2b-4568-a41e-b6b5ef3d2892 service nova] Creating event network-vif-deleted:bee090ea-f3af-4297-9530-9c09fda48a76 for instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 on n-h1-848886-15 Jul 25 12:39:33.429573 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-7d4fb6bd-d5da-43ef-b192-5d491e397762 req-9315ac28-fc2b-4568-a41e-b6b5ef3d2892 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043766 Jul 25 12:39:33.430324 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 212/377] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:33.435729 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f10808b9-16d8-4e3e-879e-a517891361a0 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:33.436422 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f10808b9-16d8-4e3e-879e-a517891361a0 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:33.442884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f10808b9-16d8-4e3e-879e-a517891361a0 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:33.443356 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f10808b9-16d8-4e3e-879e-a517891361a0 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:33.444117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f10808b9-16d8-4e3e-879e-a517891361a0 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:33.444591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f10808b9-16d8-4e3e-879e-a517891361a0 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:33.627455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4e87f596-9a4d-4603-9fef-2204aeac2b30 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:33.635966 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4e87f596-9a4d-4603-9fef-2204aeac2b30 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:33.637553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4e87f596-9a4d-4603-9fef-2204aeac2b30 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:33.638865 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4e87f596-9a4d-4603-9fef-2204aeac2b30 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 1566 microversion: 2.25 time: 0.500931 Jul 25 12:39:33.639490 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 166/378] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:33 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 1566 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:33.645559 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-484f7d30-47f2-4c8e-9b34-947657a7bdb1 tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] Action: 'create', calling method: .version_select at 0x7efcfa470430>, body: {"pool": null} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:33.831505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f10808b9-16d8-4e3e-879e-a517891361a0 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:33.840158 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f10808b9-16d8-4e3e-879e-a517891361a0 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 200 len: 1310 microversion: 2.1 time: 0.408515 Jul 25 12:39:33.840967 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 213/379] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:33 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 1310 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:33.845939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-dacd7191-50da-434c-8e4d-573a857b955e req-d78987c7-2826-4b6b-aed7-686697c17872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc20036c-d36c-4fef-a606-0d1820814320", "name": "network-vif-unplugged", "status": "completed", "tag": "92cf7b8c-f2ba-49cf-9e6d-a32bdb600392"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:33.858448 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-dacd7191-50da-434c-8e4d-573a857b955e req-d78987c7-2826-4b6b-aed7-686697c17872 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:33.861393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-dacd7191-50da-434c-8e4d-573a857b955e req-d78987c7-2826-4b6b-aed7-686697c17872 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:33.873607 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-dacd7191-50da-434c-8e4d-573a857b955e req-d78987c7-2826-4b6b-aed7-686697c17872 service nova] Creating event network-vif-unplugged:92cf7b8c-f2ba-49cf-9e6d-a32bdb600392 for instance dc20036c-d36c-4fef-a606-0d1820814320 on n-h2-848886-15 Jul 25 12:39:33.878438 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-dacd7191-50da-434c-8e4d-573a857b955e req-d78987c7-2826-4b6b-aed7-686697c17872 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036044 Jul 25 12:39:33.879143 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 214/380] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:33.884383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1202c289-98ff-495f-86fd-4db382f5da37 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:33.885544 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1202c289-98ff-495f-86fd-4db382f5da37 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: a35d467a-2c77-4821-9799-f7873a144436] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:33.887259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:33.892730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1202c289-98ff-495f-86fd-4db382f5da37 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:33.893286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1202c289-98ff-495f-86fd-4db382f5da37 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:33.893962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1202c289-98ff-495f-86fd-4db382f5da37 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:33.894446 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1202c289-98ff-495f-86fd-4db382f5da37 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:34.191402 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1202c289-98ff-495f-86fd-4db382f5da37 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:34.199863 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1202c289-98ff-495f-86fd-4db382f5da37 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436" status: 200 len: 1318 microversion: 2.1 time: 0.319189 Jul 25 12:39:34.200509 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 215/381] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:33 2022] GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436 => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:34.205162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6a0eca8d-1a3e-4e88-b4e5-061e3c270abd tempest-SecurityGroupsTestAdminJSON-731968293 tempest-SecurityGroupsTestAdminJSON-731968293-project-admin] Calling method '.version_select at 0x7efcfa156280>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:35.904552 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-484f7d30-47f2-4c8e-9b34-947657a7bdb1 tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.263758 Jul 25 12:39:35.905531 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 167/382] 10.222.0.49 () {60 vars in 1170 bytes} [Mon Jul 25 12:39:33 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:35.909961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7edb9ac1-c650-44fc-85dc-70d790986fe8 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:35.910597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7edb9ac1-c650-44fc-85dc-70d790986fe8 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 5d7df5ea-519f-4020-8467-cbe9423e3560] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:35.916856 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7edb9ac1-c650-44fc-85dc-70d790986fe8 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:35.917360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7edb9ac1-c650-44fc-85dc-70d790986fe8 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:35.918141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7edb9ac1-c650-44fc-85dc-70d790986fe8 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:35.918565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7edb9ac1-c650-44fc-85dc-70d790986fe8 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:36.095549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7edb9ac1-c650-44fc-85dc-70d790986fe8 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a553e32dbb4f3d8e362d67bc1ba55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c5541f51c149278aad62c55bb62d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:36.104398 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7edb9ac1-c650-44fc-85dc-70d790986fe8 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560" status: 200 len: 1468 microversion: 2.1 time: 0.198012 Jul 25 12:39:36.105637 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 168/383] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:35 2022] GET /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560 => generated 1468 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:36.111127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8bb3af73-33d8-4587-88b1-8ad25fcecacc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:36.112031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8bb3af73-33d8-4587-88b1-8ad25fcecacc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:36.129109 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8bb3af73-33d8-4587-88b1-8ad25fcecacc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:36.129754 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8bb3af73-33d8-4587-88b1-8ad25fcecacc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:36.130803 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8bb3af73-33d8-4587-88b1-8ad25fcecacc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:36.131338 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8bb3af73-33d8-4587-88b1-8ad25fcecacc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:36.323988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8bb3af73-33d8-4587-88b1-8ad25fcecacc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:36.331958 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8bb3af73-33d8-4587-88b1-8ad25fcecacc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1475 microversion: 2.1 time: 0.224694 Jul 25 12:39:36.332516 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 169/384] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:36 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1475 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:36.337452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-02d010d6-1eab-46dc-be0d-75a258c8a8df tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:36.338503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-02d010d6-1eab-46dc-be0d-75a258c8a8df tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: fefcb083-ed47-4de2-9c77-0bdb30d0aa6f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:36.344540 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02d010d6-1eab-46dc-be0d-75a258c8a8df tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:36.344929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02d010d6-1eab-46dc-be0d-75a258c8a8df tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:36.345707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02d010d6-1eab-46dc-be0d-75a258c8a8df tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:36.346199 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02d010d6-1eab-46dc-be0d-75a258c8a8df tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:36.537181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-02d010d6-1eab-46dc-be0d-75a258c8a8df tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:36.545457 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-02d010d6-1eab-46dc-be0d-75a258c8a8df tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f" status: 200 len: 1391 microversion: 2.1 time: 0.211955 Jul 25 12:39:36.546388 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 170/385] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:36 2022] GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f => generated 1391 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:36.551501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-2e903e4e-6da6-4528-a894-e257e62ab2a4 req-686b739e-89d4-4f1f-8e9e-f76d2d8948d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a35d467a-2c77-4821-9799-f7873a144436", "name": "network-vif-plugged", "status": "completed", "tag": "896ea210-b59a-4cf5-8f4d-a412adf1854e"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:36.561906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-2e903e4e-6da6-4528-a894-e257e62ab2a4 req-686b739e-89d4-4f1f-8e9e-f76d2d8948d9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:36.562763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-2e903e4e-6da6-4528-a894-e257e62ab2a4 req-686b739e-89d4-4f1f-8e9e-f76d2d8948d9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:36.578856 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-2e903e4e-6da6-4528-a894-e257e62ab2a4 req-686b739e-89d4-4f1f-8e9e-f76d2d8948d9 service nova] Creating event network-vif-plugged:896ea210-b59a-4cf5-8f4d-a412adf1854e for instance a35d467a-2c77-4821-9799-f7873a144436 on n-h2-848886-15 Jul 25 12:39:36.584565 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-2e903e4e-6da6-4528-a894-e257e62ab2a4 req-686b739e-89d4-4f1f-8e9e-f76d2d8948d9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036769 Jul 25 12:39:36.585333 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 171/386] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:36.591726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6688c3e5-197c-49ce-bb76-1583b0a69f8a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:36.593324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6688c3e5-197c-49ce-bb76-1583b0a69f8a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:36.600333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6688c3e5-197c-49ce-bb76-1583b0a69f8a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:36.600681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6688c3e5-197c-49ce-bb76-1583b0a69f8a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:36.601584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6688c3e5-197c-49ce-bb76-1583b0a69f8a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:36.602067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6688c3e5-197c-49ce-bb76-1583b0a69f8a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:36.853196 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6688c3e5-197c-49ce-bb76-1583b0a69f8a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:36.861816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6688c3e5-197c-49ce-bb76-1583b0a69f8a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:36.863486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6688c3e5-197c-49ce-bb76-1583b0a69f8a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:36.864605 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6688c3e5-197c-49ce-bb76-1583b0a69f8a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 1556 microversion: 2.25 time: 0.277370 Jul 25 12:39:36.865166 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 172/387] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:36 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 1556 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:36.869922 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c111d48f-7c4b-4704-bbcd-74aef89ae5d6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:36.870763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c111d48f-7c4b-4704-bbcd-74aef89ae5d6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:36.876890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c111d48f-7c4b-4704-bbcd-74aef89ae5d6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:36.877581 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c111d48f-7c4b-4704-bbcd-74aef89ae5d6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:36.878384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c111d48f-7c4b-4704-bbcd-74aef89ae5d6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:36.878904 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c111d48f-7c4b-4704-bbcd-74aef89ae5d6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:37.050878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c111d48f-7c4b-4704-bbcd-74aef89ae5d6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:37.058478 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c111d48f-7c4b-4704-bbcd-74aef89ae5d6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 200 len: 1310 microversion: 2.1 time: 0.192109 Jul 25 12:39:37.059054 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 173/388] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:36 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 1310 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:37.063626 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d35ce2c9-4b91-46b6-97db-2f203b6efdf6 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:37.064416 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d35ce2c9-4b91-46b6-97db-2f203b6efdf6 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: a35d467a-2c77-4821-9799-f7873a144436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:37.070500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d35ce2c9-4b91-46b6-97db-2f203b6efdf6 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:37.071162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d35ce2c9-4b91-46b6-97db-2f203b6efdf6 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:37.072146 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d35ce2c9-4b91-46b6-97db-2f203b6efdf6 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:37.072572 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d35ce2c9-4b91-46b6-97db-2f203b6efdf6 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:37.182381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:37.217993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=12 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:37.266100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d35ce2c9-4b91-46b6-97db-2f203b6efdf6 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:37.274138 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d35ce2c9-4b91-46b6-97db-2f203b6efdf6 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436" status: 200 len: 1318 microversion: 2.1 time: 0.213886 Jul 25 12:39:37.274711 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 174/389] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:37 2022] GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:37.279452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-b38adc9d-62a3-47ef-b1a6-18e3506bfc74 req-d87010b4-eeac-4664-8e01-e41e2feacecf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fefcb083-ed47-4de2-9c77-0bdb30d0aa6f", "tag": "3ebd7fbe-3aa1-4cae-a6fe-f0d6422bd74b"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:37.288882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b38adc9d-62a3-47ef-b1a6-18e3506bfc74 req-d87010b4-eeac-4664-8e01-e41e2feacecf service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:37.289313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b38adc9d-62a3-47ef-b1a6-18e3506bfc74 req-d87010b4-eeac-4664-8e01-e41e2feacecf service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:37.300732 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-b38adc9d-62a3-47ef-b1a6-18e3506bfc74 req-d87010b4-eeac-4664-8e01-e41e2feacecf service nova] Creating event network-changed:3ebd7fbe-3aa1-4cae-a6fe-f0d6422bd74b for instance fefcb083-ed47-4de2-9c77-0bdb30d0aa6f on n-h2-848886-15 Jul 25 12:39:37.305635 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-b38adc9d-62a3-47ef-b1a6-18e3506bfc74 req-d87010b4-eeac-4664-8e01-e41e2feacecf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029816 Jul 25 12:39:37.306237 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 175/390] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:37.311054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-56082e91-5b2e-4c5d-b6f5-a01c8b520b6b req-7b87b780-21ad-4dbe-a2cf-76cb710a7595 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daf4e818-31a5-4311-87b2-eb63a90f7bc0", "tag": "64524d32-78e7-4db4-bec6-a6228c8ab21c"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:37.320609 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-56082e91-5b2e-4c5d-b6f5-a01c8b520b6b req-7b87b780-21ad-4dbe-a2cf-76cb710a7595 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:37.321059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-56082e91-5b2e-4c5d-b6f5-a01c8b520b6b req-7b87b780-21ad-4dbe-a2cf-76cb710a7595 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:37.324941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:37.332426 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-56082e91-5b2e-4c5d-b6f5-a01c8b520b6b req-7b87b780-21ad-4dbe-a2cf-76cb710a7595 service nova] Creating event network-changed:64524d32-78e7-4db4-bec6-a6228c8ab21c for instance daf4e818-31a5-4311-87b2-eb63a90f7bc0 on n-h1-848886-15 Jul 25 12:39:37.337192 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-56082e91-5b2e-4c5d-b6f5-a01c8b520b6b req-7b87b780-21ad-4dbe-a2cf-76cb710a7595 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029741 Jul 25 12:39:37.337795 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 176/391] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:37.342660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-068c6d10-7484-4dcc-adb4-18c60ac2c110 tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] Calling method '.version_select at 0x7efcfa4940d0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:37.884904 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6a0eca8d-1a3e-4e88-b4e5-061e3c270abd tempest-SecurityGroupsTestAdminJSON-731968293 tempest-SecurityGroupsTestAdminJSON-731968293-project-admin] 10.222.0.49 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12430 microversion: 2.1 time: 3.682938 Jul 25 12:39:37.886781 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 216/392] 10.222.0.49 () {58 vars in 1191 bytes} [Mon Jul 25 12:39:34 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12430 bytes in 3685 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:39:38.029706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-956f547e-17ef-4f51-af19-368707e99677 tempest-DeleteServersAdminTestJSON-1684326943 tempest-DeleteServersAdminTestJSON-1684326943-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:38.030265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-956f547e-17ef-4f51-af19-368707e99677 tempest-DeleteServersAdminTestJSON-1684326943 tempest-DeleteServersAdminTestJSON-1684326943-project-admin] [instance: 5d7df5ea-519f-4020-8467-cbe9423e3560] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:38.038144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-956f547e-17ef-4f51-af19-368707e99677 tempest-DeleteServersAdminTestJSON-1684326943 tempest-DeleteServersAdminTestJSON-1684326943-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:38.038709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-956f547e-17ef-4f51-af19-368707e99677 tempest-DeleteServersAdminTestJSON-1684326943 tempest-DeleteServersAdminTestJSON-1684326943-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:38.039591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-956f547e-17ef-4f51-af19-368707e99677 tempest-DeleteServersAdminTestJSON-1684326943 tempest-DeleteServersAdminTestJSON-1684326943-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:38.040221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-956f547e-17ef-4f51-af19-368707e99677 tempest-DeleteServersAdminTestJSON-1684326943 tempest-DeleteServersAdminTestJSON-1684326943-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:38.067276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-956f547e-17ef-4f51-af19-368707e99677 tempest-DeleteServersAdminTestJSON-1684326943 tempest-DeleteServersAdminTestJSON-1684326943-project-admin] [instance: 5d7df5ea-519f-4020-8467-cbe9423e3560] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:39:38.105857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:38.192890 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-956f547e-17ef-4f51-af19-368707e99677 tempest-DeleteServersAdminTestJSON-1684326943 tempest-DeleteServersAdminTestJSON-1684326943-project-admin] 10.222.0.49 "DELETE /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560" status: 204 len: 0 microversion: 2.1 time: 0.302867 Jul 25 12:39:38.194005 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 217/393] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:39:37 2022] DELETE /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:39:38.200031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a17fb8dd-8e72-485b-a3a6-099690deb490 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Calling method '.version_select at 0x7efcfa2b9280>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:38.203714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a17fb8dd-8e72-485b-a3a6-099690deb490 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:38.204166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a17fb8dd-8e72-485b-a3a6-099690deb490 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:38.220056 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a17fb8dd-8e72-485b-a3a6-099690deb490 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 868 microversion: 2.25 time: 0.024604 Jul 25 12:39:38.220763 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 218/394] 10.222.0.49 () {60 vars in 1184 bytes} [Mon Jul 25 12:39:38 2022] GET /compute/v2.1/os-migrations => generated 868 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:39:38.225214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-49a08094-4e6c-4239-8f4b-9cca040b525d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:38.225981 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-49a08094-4e6c-4239-8f4b-9cca040b525d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:38.232621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-49a08094-4e6c-4239-8f4b-9cca040b525d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:38.233077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-49a08094-4e6c-4239-8f4b-9cca040b525d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:38.233904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-49a08094-4e6c-4239-8f4b-9cca040b525d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:38.234338 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-49a08094-4e6c-4239-8f4b-9cca040b525d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:38.603351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-49a08094-4e6c-4239-8f4b-9cca040b525d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:38.612025 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-49a08094-4e6c-4239-8f4b-9cca040b525d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1475 microversion: 2.1 time: 0.390305 Jul 25 12:39:38.612859 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 219/395] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:38 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1475 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:38.620889 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0329f159-c0ea-4092-b511-638b5c6fadcb tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:38.622241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0329f159-c0ea-4092-b511-638b5c6fadcb tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: fefcb083-ed47-4de2-9c77-0bdb30d0aa6f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:38.630331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0329f159-c0ea-4092-b511-638b5c6fadcb tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:38.630996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0329f159-c0ea-4092-b511-638b5c6fadcb tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:38.631951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0329f159-c0ea-4092-b511-638b5c6fadcb tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:38.632382 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0329f159-c0ea-4092-b511-638b5c6fadcb tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:38.919303 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0329f159-c0ea-4092-b511-638b5c6fadcb tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:38.928676 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0329f159-c0ea-4092-b511-638b5c6fadcb tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f" status: 200 len: 1391 microversion: 2.1 time: 0.314539 Jul 25 12:39:38.929439 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 220/396] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:38 2022] GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f => generated 1391 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:38.934422 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f12c5d92-451b-471d-9007-e815cffd8bd0 tempest-SecurityGroupsTestAdminJSON-2112763349 tempest-SecurityGroupsTestAdminJSON-2112763349-project] Calling method '.version_select at 0x7efcfa192ca0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:39.200526 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-068c6d10-7484-4dcc-adb4-18c60ac2c110 tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/65ac24d0-13c7-4583-a5cf-4bf7e2108bd1" status: 202 len: 0 microversion: 2.1 time: 1.861500 Jul 25 12:39:39.201120 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 177/397] 10.222.0.49 () {58 vars in 1263 bytes} [Mon Jul 25 12:39:37 2022] DELETE /compute/v2.1/os-floating-ips/65ac24d0-13c7-4583-a5cf-4bf7e2108bd1 => generated 0 bytes in 1863 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:39:39.205772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-50130b37-d6b8-4db3-b5b5-1ce309311624 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:39.206522 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-50130b37-d6b8-4db3-b5b5-1ce309311624 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:39.212928 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50130b37-d6b8-4db3-b5b5-1ce309311624 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:39.213368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50130b37-d6b8-4db3-b5b5-1ce309311624 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:39.214155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50130b37-d6b8-4db3-b5b5-1ce309311624 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:39.214579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50130b37-d6b8-4db3-b5b5-1ce309311624 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:39.244958 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f12c5d92-451b-471d-9007-e815cffd8bd0 tempest-SecurityGroupsTestAdminJSON-2112763349 tempest-SecurityGroupsTestAdminJSON-2112763349-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1113 microversion: 2.1 time: 0.313979 Jul 25 12:39:39.245851 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 221/398] 10.222.0.49 () {58 vars in 1191 bytes} [Mon Jul 25 12:39:38 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1113 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:39.251529 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5948f60c-3dab-46f4-9693-477f322dd1a2 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:39.252634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5948f60c-3dab-46f4-9693-477f322dd1a2 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 5d7df5ea-519f-4020-8467-cbe9423e3560] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:39.259524 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5948f60c-3dab-46f4-9693-477f322dd1a2 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:39.260235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5948f60c-3dab-46f4-9693-477f322dd1a2 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:39.261183 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5948f60c-3dab-46f4-9693-477f322dd1a2 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:39.261859 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5948f60c-3dab-46f4-9693-477f322dd1a2 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:39.451260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-50130b37-d6b8-4db3-b5b5-1ce309311624 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:39.459099 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-50130b37-d6b8-4db3-b5b5-1ce309311624 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 200 len: 1310 microversion: 2.1 time: 0.256876 Jul 25 12:39:39.459755 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 178/399] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:39 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 1310 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:39.477084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-489fb50f-66f2-49e0-bb2b-7a1845d7bdb9 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:39.477702 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-489fb50f-66f2-49e0-bb2b-7a1845d7bdb9 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:39.484071 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-489fb50f-66f2-49e0-bb2b-7a1845d7bdb9 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:39.484774 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-489fb50f-66f2-49e0-bb2b-7a1845d7bdb9 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:39.485844 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-489fb50f-66f2-49e0-bb2b-7a1845d7bdb9 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:39.486366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-489fb50f-66f2-49e0-bb2b-7a1845d7bdb9 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:39.490587 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5948f60c-3dab-46f4-9693-477f322dd1a2 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a553e32dbb4f3d8e362d67bc1ba55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c5541f51c149278aad62c55bb62d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:39.498603 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5948f60c-3dab-46f4-9693-477f322dd1a2 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560" status: 200 len: 1474 microversion: 2.1 time: 0.251441 Jul 25 12:39:39.499602 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 222/400] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:39 2022] GET /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560 => generated 1474 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:39.504626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dfa0079a-421f-4362-9384-cb5c4edda0c5 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:39.505228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dfa0079a-421f-4362-9384-cb5c4edda0c5 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: a35d467a-2c77-4821-9799-f7873a144436] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:39.512057 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dfa0079a-421f-4362-9384-cb5c4edda0c5 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:39.512504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dfa0079a-421f-4362-9384-cb5c4edda0c5 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:39.513269 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dfa0079a-421f-4362-9384-cb5c4edda0c5 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:39.513696 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dfa0079a-421f-4362-9384-cb5c4edda0c5 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:39.794823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dfa0079a-421f-4362-9384-cb5c4edda0c5 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:39.806722 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dfa0079a-421f-4362-9384-cb5c4edda0c5 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436" status: 200 len: 1468 microversion: 2.1 time: 0.305670 Jul 25 12:39:39.806982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-489fb50f-66f2-49e0-bb2b-7a1845d7bdb9 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lazy-loading 'services' on Instance uuid dc20036c-d36c-4fef-a606-0d1820814320 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:39:39.815369 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 223/401] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:39 2022] GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436 => generated 1468 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:39.815369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-b00df0c8-7ceb-431c-ac0c-58d1012a8076 req-57d75210-0ea2-4b9d-9f46-1e40590d17f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefcb083-ed47-4de2-9c77-0bdb30d0aa6f", "name": "network-vif-plugged", "status": "completed", "tag": "3ebd7fbe-3aa1-4cae-a6fe-f0d6422bd74b"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:39.823168 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b00df0c8-7ceb-431c-ac0c-58d1012a8076 req-57d75210-0ea2-4b9d-9f46-1e40590d17f2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:39.823168 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b00df0c8-7ceb-431c-ac0c-58d1012a8076 req-57d75210-0ea2-4b9d-9f46-1e40590d17f2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:39.835791 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-b00df0c8-7ceb-431c-ac0c-58d1012a8076 req-57d75210-0ea2-4b9d-9f46-1e40590d17f2 service nova] Creating event network-vif-plugged:3ebd7fbe-3aa1-4cae-a6fe-f0d6422bd74b for instance fefcb083-ed47-4de2-9c77-0bdb30d0aa6f on n-h2-848886-15 Jul 25 12:39:39.840810 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-b00df0c8-7ceb-431c-ac0c-58d1012a8076 req-57d75210-0ea2-4b9d-9f46-1e40590d17f2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031638 Jul 25 12:39:39.841584 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 224/402] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:39.846432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-60692fd8-457e-4b33-8804-e203dfdc11e2 tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] Calling method '.version_select at 0x7efcfa112ee0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:39.871671 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-489fb50f-66f2-49e0-bb2b-7a1845d7bdb9 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 2050 microversion: 2.25 time: 0.398174 Jul 25 12:39:39.872910 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 179/403] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:39 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 2050 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:39.877459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d79281c3-a0fb-4927-b283-3bdff5afc68a tempest-SecurityGroupsTestAdminJSON-731968293 tempest-SecurityGroupsTestAdminJSON-731968293-project-admin] Calling method '.version_select at 0x7efcfa446700>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:39.891968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG neutronclient.v2_0.client [None req-60692fd8-457e-4b33-8804-e203dfdc11e2 tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 65ac24d0-13c7-4583-a5cf-4bf7e2108bd1 could not be found", "detail": ""}} {{(pid=125883) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:39:39.892672 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-60692fd8-457e-4b33-8804-e203dfdc11e2 tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] HTTP exception thrown: Floating IP not found for ID 65ac24d0-13c7-4583-a5cf-4bf7e2108bd1 Jul 25 12:39:39.911003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-60692fd8-457e-4b33-8804-e203dfdc11e2 tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] Request method failure captured: Jul 25 12:39:39.911003 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-floating-ips/65ac24d0-13c7-4583-a5cf-4bf7e2108bd1 HTTP/1.1 Jul 25 12:39:39.911003 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:39:39.911003 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:39:39.911003 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:39:39.911003 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:39:39.911003 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:39:39.911003 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:39:39.911003 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:39:39.911003 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:39:39.911003 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o70Qqp-wx_dW1BXlYSpnU1mNWWd9QT4WaVdcOXLt1TZPtf4_f3MIlsyD6Qxvji5CMQeEoDRYAuraGf33q7MPmi3CvrotiRIUSjLp_JhU7uIYMF9STqPv9a0CiM9PRHVEwU_vhajfpjJLa0ww2WSRNJ11ihwqspt4VobqNiqs8OpBl8 Jul 25 12:39:39.911003 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:39:39.911003 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:39:39.911003 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:39:39.911003 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:39:39.911003 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:39:39.911003 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:39:39.911003 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 9954b5a23fac489e9376ceb3319d3b83 Jul 25 12:39:39.911003 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-FloatingIPsTestJSON-1229163626 Jul 25 12:39:39.911003 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:39:39.911003 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:39:39.912637 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9954b5a23fac489e9376ceb3319d3b83", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9954b5a23fac489e9376ceb3319d3b83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9954b5a23fac489e9376ceb3319d3b83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9954b5a23fac489e9376ceb3319d3b83"}]}] Jul 25 12:39:39.912637 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-FloatingIPsTestJSON-1229163626 Jul 25 12:39:39.912637 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 9954b5a23fac489e9376ceb3319d3b83 Jul 25 12:39:39.912637 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1229163626 Jul 25 12:39:39.912637 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-FloatingIPsTestJSON-1229163626-project Jul 25 12:39:39.912637 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:39:39.912637 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:39:39.912637 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 2d6b105db52a43a9821d3273b2fc6f90 Jul 25 12:39:39.912637 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-FloatingIPsTestJSON-1229163626-project Jul 25 12:39:39.912637 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:39:39.912637 n-d-848886-15 devstack@n-api.service[125883]: exception: Floating IP not found for ID 65ac24d0-13c7-4583-a5cf-4bf7e2108bd1 Jul 25 12:39:39.912637 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '65ac24d0-13c7-4583-a5cf-4bf7e2108bd1'} Jul 25 12:39:39.912637 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:39:39.913578 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:39.913578 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 25 12:39:39.913578 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 25 12:39:39.913578 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:39:39.913578 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:39:39.913578 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 25 12:39:39.913578 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 25 12:39:39.913578 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:39:39.913578 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:39:39.913578 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 12:39:39.913578 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 12:39:39.913578 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:39:39.913578 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:39:39.913578 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:39:39.913578 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:39:39.913578 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:39:39.913578 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:39:39.913578 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:39:39.913578 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:39:39.914881 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:39:39.914881 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:39:39.914881 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:39:39.914881 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:39:39.914881 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:39:39.914881 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:39:39.914881 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 65ac24d0-13c7-4583-a5cf-4bf7e2108bd1 could not be found Jul 25 12:39:39.914881 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab698d50-083d-4d86-85c4-ed209241af85'] Jul 25 12:39:39.914881 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:39:39.914881 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:39.914881 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:39:39.914881 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:39.914881 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 25 12:39:39.914881 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 25 12:39:39.914881 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 25 12:39:39.914881 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 25 12:39:39.914881 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 65ac24d0-13c7-4583-a5cf-4bf7e2108bd1. Jul 25 12:39:39.914881 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:39:39.914881 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:39.914881 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:39:39.916561 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:39.916561 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:39.916561 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:39.916561 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:39:39.916561 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:39:39.916561 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:39:39.916561 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:39:39.916561 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:39:39.916561 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:39:39.916561 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 25 12:39:39.916561 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 12:39:39.916561 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 65ac24d0-13c7-4583-a5cf-4bf7e2108bd1 Jul 25 12:39:39.916561 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:39:39.916561 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:39.916561 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:39:39.916561 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:39.916561 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:39.916561 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:39.916561 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:39:39.916561 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:39:39.918131 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 65ac24d0-13c7-4583-a5cf-4bf7e2108bd1 Jul 25 12:39:39.918131 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:39:39.918131 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-60692fd8-457e-4b33-8804-e203dfdc11e2 tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] Returning 404 to user: Floating IP not found for ID 65ac24d0-13c7-4583-a5cf-4bf7e2108bd1 {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:39:39.918131 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-60692fd8-457e-4b33-8804-e203dfdc11e2 tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips/65ac24d0-13c7-4583-a5cf-4bf7e2108bd1" status: 404 len: 111 microversion: 2.1 time: 0.073349 Jul 25 12:39:39.919766 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 225/404] 10.222.0.49 () {58 vars in 1260 bytes} [Mon Jul 25 12:39:39 2022] GET /compute/v2.1/os-floating-ips/65ac24d0-13c7-4583-a5cf-4bf7e2108bd1 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:39:39.926363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d27ea193-aae3-4ea4-be0a-56773086ea86 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:39.927467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d27ea193-aae3-4ea4-be0a-56773086ea86 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:39.942556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d27ea193-aae3-4ea4-be0a-56773086ea86 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:39.943184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d27ea193-aae3-4ea4-be0a-56773086ea86 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:39.944100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d27ea193-aae3-4ea4-be0a-56773086ea86 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:39.944711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d27ea193-aae3-4ea4-be0a-56773086ea86 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:40.196745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d27ea193-aae3-4ea4-be0a-56773086ea86 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:40.210017 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d27ea193-aae3-4ea4-be0a-56773086ea86 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1475 microversion: 2.1 time: 0.288857 Jul 25 12:39:40.211326 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 226/405] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:39 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1475 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:40.257655 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d79281c3-a0fb-4927-b283-3bdff5afc68a tempest-SecurityGroupsTestAdminJSON-731968293 tempest-SecurityGroupsTestAdminJSON-731968293-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/3ac81808-0133-417a-a2f5-03fbfcf27f3b" status: 202 len: 0 microversion: 2.1 time: 0.383523 Jul 25 12:39:40.259158 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 180/406] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:39:39 2022] DELETE /compute/v2.1/os-security-groups/3ac81808-0133-417a-a2f5-03fbfcf27f3b => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:39:40.264075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1b1b50fc-38cb-4aaa-9e56-139e9a96d5f1 tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] Calling method '.version_select at 0x7efcfa470ca0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:40.338657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG neutronclient.v2_0.client [None req-1b1b50fc-38cb-4aaa-9e56-139e9a96d5f1 tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 65ac24d0-13c7-4583-a5cf-4bf7e2108bd1 could not be found", "detail": ""}} {{(pid=125884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:39:40.339444 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-1b1b50fc-38cb-4aaa-9e56-139e9a96d5f1 tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] HTTP exception thrown: Floating IP not found for ID 65ac24d0-13c7-4583-a5cf-4bf7e2108bd1 Jul 25 12:39:40.343831 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1b1b50fc-38cb-4aaa-9e56-139e9a96d5f1 tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] Request method failure captured: Jul 25 12:39:40.343831 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/os-floating-ips/65ac24d0-13c7-4583-a5cf-4bf7e2108bd1 HTTP/1.1 Jul 25 12:39:40.343831 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:39:40.343831 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:39:40.343831 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:39:40.343831 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:39:40.343831 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:39:40.343831 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:39:40.343831 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:39:40.343831 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:39:40.343831 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o70Qqp-wx_dW1BXlYSpnU1mNWWd9QT4WaVdcOXLt1TZPtf4_f3MIlsyD6Qxvji5CMQeEoDRYAuraGf33q7MPmi3CvrotiRIUSjLp_JhU7uIYMF9STqPv9a0CiM9PRHVEwU_vhajfpjJLa0ww2WSRNJ11ihwqspt4VobqNiqs8OpBl8 Jul 25 12:39:40.343831 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:39:40.343831 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:39:40.343831 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:39:40.343831 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:39:40.343831 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:39:40.343831 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:39:40.343831 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 9954b5a23fac489e9376ceb3319d3b83 Jul 25 12:39:40.343831 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-FloatingIPsTestJSON-1229163626 Jul 25 12:39:40.343831 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:39:40.343831 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:39:40.345259 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9954b5a23fac489e9376ceb3319d3b83", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9954b5a23fac489e9376ceb3319d3b83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9954b5a23fac489e9376ceb3319d3b83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9954b5a23fac489e9376ceb3319d3b83"}]}] Jul 25 12:39:40.345259 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-FloatingIPsTestJSON-1229163626 Jul 25 12:39:40.345259 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 9954b5a23fac489e9376ceb3319d3b83 Jul 25 12:39:40.345259 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1229163626 Jul 25 12:39:40.345259 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-FloatingIPsTestJSON-1229163626-project Jul 25 12:39:40.345259 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:39:40.345259 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:39:40.345259 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 2d6b105db52a43a9821d3273b2fc6f90 Jul 25 12:39:40.345259 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-FloatingIPsTestJSON-1229163626-project Jul 25 12:39:40.345259 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:39:40.345259 n-d-848886-15 devstack@n-api.service[125884]: exception: Floating IP not found for ID 65ac24d0-13c7-4583-a5cf-4bf7e2108bd1 Jul 25 12:39:40.345259 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '65ac24d0-13c7-4583-a5cf-4bf7e2108bd1'} Jul 25 12:39:40.345259 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:39:40.346018 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:40.346018 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 25 12:39:40.346018 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 25 12:39:40.346018 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:39:40.346018 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:39:40.346018 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 25 12:39:40.346018 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 25 12:39:40.346018 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:39:40.346018 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:39:40.346018 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 12:39:40.346018 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 12:39:40.346018 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:39:40.346018 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:39:40.346018 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:39:40.346018 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:39:40.346018 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:39:40.346018 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:39:40.346018 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:39:40.346018 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:39:40.347066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:39:40.347066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:39:40.347066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:39:40.347066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:39:40.347066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:39:40.347066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:39:40.347066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 65ac24d0-13c7-4583-a5cf-4bf7e2108bd1 could not be found Jul 25 12:39:40.347066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d761a62f-3d4c-47de-904a-6ac912449706'] Jul 25 12:39:40.347066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:39:40.347066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:40.347066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:39:40.347066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:40.347066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 25 12:39:40.347066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 25 12:39:40.347066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 25 12:39:40.347066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 25 12:39:40.347066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 65ac24d0-13c7-4583-a5cf-4bf7e2108bd1. Jul 25 12:39:40.347066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:39:40.347066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:40.347066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:39:40.348299 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:40.348299 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:40.348299 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:40.348299 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:39:40.348299 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:39:40.348299 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:39:40.348299 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:39:40.348299 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:39:40.348299 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:39:40.348299 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 25 12:39:40.348299 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 12:39:40.348299 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 65ac24d0-13c7-4583-a5cf-4bf7e2108bd1 Jul 25 12:39:40.348299 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:39:40.348299 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:40.348299 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:39:40.348299 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:40.348299 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:40.348299 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:40.348299 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:39:40.348299 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:39:40.349380 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 65ac24d0-13c7-4583-a5cf-4bf7e2108bd1 Jul 25 12:39:40.349380 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:39:40.351295 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1b1b50fc-38cb-4aaa-9e56-139e9a96d5f1 tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] Returning 404 to user: Floating IP not found for ID 65ac24d0-13c7-4583-a5cf-4bf7e2108bd1 {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:39:40.352347 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1b1b50fc-38cb-4aaa-9e56-139e9a96d5f1 tempest-FloatingIPsTestJSON-1229163626 tempest-FloatingIPsTestJSON-1229163626-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/65ac24d0-13c7-4583-a5cf-4bf7e2108bd1" status: 404 len: 111 microversion: 2.1 time: 0.092119 Jul 25 12:39:40.357358 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 181/407] 10.222.0.49 () {58 vars in 1263 bytes} [Mon Jul 25 12:39:40 2022] DELETE /compute/v2.1/os-floating-ips/65ac24d0-13c7-4583-a5cf-4bf7e2108bd1 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:39:40.362836 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-370e0cea-e7e6-4752-a20f-4e08cff63971 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:40.363692 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-370e0cea-e7e6-4752-a20f-4e08cff63971 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: fefcb083-ed47-4de2-9c77-0bdb30d0aa6f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:40.371036 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-370e0cea-e7e6-4752-a20f-4e08cff63971 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:40.371941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-370e0cea-e7e6-4752-a20f-4e08cff63971 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:40.372711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-370e0cea-e7e6-4752-a20f-4e08cff63971 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:40.373371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-370e0cea-e7e6-4752-a20f-4e08cff63971 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:40.379052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fed84b3e-68a0-4df9-a5b9-48f7ad6f704f tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-692115244", "block_migration": true, "disk_over_commit": false}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:40.382711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fed84b3e-68a0-4df9-a5b9-48f7ad6f704f tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] [instance: a35d467a-2c77-4821-9799-f7873a144436] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:40.392053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fed84b3e-68a0-4df9-a5b9-48f7ad6f704f tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:40.392517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fed84b3e-68a0-4df9-a5b9-48f7ad6f704f tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:40.393505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fed84b3e-68a0-4df9-a5b9-48f7ad6f704f tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:40.394265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fed84b3e-68a0-4df9-a5b9-48f7ad6f704f tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:40.486346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-fed84b3e-68a0-4df9-a5b9-48f7ad6f704f tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Lazy-loading 'flavor' on Instance uuid a35d467a-2c77-4821-9799-f7873a144436 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:39:40.554290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fed84b3e-68a0-4df9-a5b9-48f7ad6f704f tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] [instance: a35d467a-2c77-4821-9799-f7873a144436] Going to try to live migrate instance to tempest-host-692115244 {{(pid=125883) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 12:39:40.562628 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-fed84b3e-68a0-4df9-a5b9-48f7ad6f704f tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] HTTP exception thrown: Compute host tempest-host-692115244 could not be found. Jul 25 12:39:40.568702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fed84b3e-68a0-4df9-a5b9-48f7ad6f704f tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Request method failure captured: Jul 25 12:39:40.568702 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436/action HTTP/1.1 Jul 25 12:39:40.568702 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:39:40.568702 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:39:40.568702 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:39:40.568702 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 106 Jul 25 12:39:40.568702 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:39:40.568702 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:39:40.568702 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:39:40.568702 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:39:40.568702 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o70UJL9C-UkWN4gOJyCc63sQrWbcajMqRYWAXg9igR_O5d9aD6jk8jqnUputTlFKLOK6iTtsKXX4_ZYW_InI-wOSaxDfOpvv2luzyqnv-MhGFl9xwW4Fke92lXc2xyYC4Is5-_MZOkwKAI1p9CxQzNlDUNhcElN1BMOMBSyaSs0xoE Jul 25 12:39:40.568702 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:39:40.568702 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:39:40.568702 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:39:40.568702 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:39:40.568702 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:39:40.568702 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:39:40.568702 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 452c49d630d1484bb6cc1126ff0a5dfc Jul 25 12:39:40.568702 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-LiveMigrationNegativeTest-2144619248 Jul 25 12:39:40.568702 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:39:40.568702 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:39:40.570384 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_452c49d630d1484bb6cc1126ff0a5dfc", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/452c49d630d1484bb6cc1126ff0a5dfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/452c49d630d1484bb6cc1126ff0a5dfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/452c49d630d1484bb6cc1126ff0a5dfc"}]}] Jul 25 12:39:40.570384 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-LiveMigrationNegativeTest-2144619248 Jul 25 12:39:40.570384 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 452c49d630d1484bb6cc1126ff0a5dfc Jul 25 12:39:40.570384 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2144619248 Jul 25 12:39:40.570384 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-LiveMigrationNegativeTest-2144619248-project-admin Jul 25 12:39:40.570384 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:39:40.570384 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:39:40.570384 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: c436a097a80f4eaeb2a034397ab20444 Jul 25 12:39:40.570384 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-LiveMigrationNegativeTest-2144619248-project-admin Jul 25 12:39:40.570384 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:39:40.570384 n-d-848886-15 devstack@n-api.service[125883]: {"os-migrateLive": {"host": "tempest-host-692115244", "block_migration": true, "disk_over_commit": false}} Jul 25 12:39:40.570384 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:39:40.571259 n-d-848886-15 devstack@n-api.service[125883]: exception: Compute host tempest-host-692115244 could not be found. Jul 25 12:39:40.571259 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'a35d467a-2c77-4821-9799-f7873a144436', 'body': {'os-migrateLive': {'host': 'tempest-host-692115244', 'block_migration': True, 'disk_over_commit': False}}} Jul 25 12:39:40.571259 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:39:40.571259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:40.571259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 25 12:39:40.571259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 25 12:39:40.571259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 12:39:40.571259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 12:39:40.571259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 12:39:40.571259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 12:39:40.571259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 12:39:40.571259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 12:39:40.571259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 12:39:40.571259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 12:39:40.571259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 25 12:39:40.571259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 12:39:40.571259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 25 12:39:40.571259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 12:39:40.571259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 12:39:40.572522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 12:39:40.572522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 12:39:40.572522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 12:39:40.572522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 25 12:39:40.572522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 25 12:39:40.572522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:39:40.572522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:39:40.572522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 25 12:39:40.572522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 25 12:39:40.572522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 25 12:39:40.572522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:39:40.572522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 25 12:39:40.572522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 25 12:39:40.572522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 25 12:39:40.572522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 25 12:39:40.572522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 25 12:39:40.572522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 25 12:39:40.572522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-692115244 could not be found. Jul 25 12:39:40.572522 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:39:40.573744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:40.573744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:39:40.573744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:40.573744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:40.573744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:40.573744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:39:40.573744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:39:40.573744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:39:40.573744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:39:40.573744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:39:40.573744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:39:40.573744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:39:40.573744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:39:40.573744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:39:40.573744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:39:40.573744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 12:39:40.573744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 25 12:39:40.573744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 12:39:40.573744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-692115244 could not be found. Jul 25 12:39:40.573744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:39:40.574995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:40.574995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:39:40.574995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:40.574995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:40.574995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:40.574995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:39:40.574995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:39:40.574995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-692115244 could not be found. Jul 25 12:39:40.574995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:39:40.578649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fed84b3e-68a0-4df9-a5b9-48f7ad6f704f tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Returning 400 to user: Compute host tempest-host-692115244 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:39:40.579791 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fed84b3e-68a0-4df9-a5b9-48f7ad6f704f tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436/action" status: 400 len: 99 microversion: 2.1 time: 0.367225 Jul 25 12:39:40.580657 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 227/408] 10.222.0.49 () {60 vars in 1279 bytes} [Mon Jul 25 12:39:40 2022] POST /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436/action => generated 99 bytes in 369 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:39:40.590586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-39555196-efee-497c-8428-06cad4bcc0ef tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-751700479", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "6ff0fb68-b414-4b82-96bf-e15dd2a7af95"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:40.670366 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-39555196-efee-497c-8428-06cad4bcc0ef tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] validate_networks() for [('6ff0fb68-b414-4b82-96bf-e15dd2a7af95', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:39:40.671763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-370e0cea-e7e6-4752-a20f-4e08cff63971 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:40.682245 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-370e0cea-e7e6-4752-a20f-4e08cff63971 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f" status: 200 len: 1391 microversion: 2.1 time: 0.323211 Jul 25 12:39:40.696099 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 182/409] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:40 2022] GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f => generated 1391 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:40.701087 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4b353935-443f-4e2f-bcd8-99450e5daa64 tempest-SecurityGroupsTestAdminJSON-731968293 tempest-SecurityGroupsTestAdminJSON-731968293-project-admin] Calling method '.version_select at 0x7efcfa446c10>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:41.671190 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4b353935-443f-4e2f-bcd8-99450e5daa64 tempest-SecurityGroupsTestAdminJSON-731968293 tempest-SecurityGroupsTestAdminJSON-731968293-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/2cabd5f4-22de-4096-a6a9-8925b2b6fbec" status: 202 len: 0 microversion: 2.1 time: 0.973624 Jul 25 12:39:41.671767 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 183/410] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:39:40 2022] DELETE /compute/v2.1/os-security-groups/2cabd5f4-22de-4096-a6a9-8925b2b6fbec => generated 0 bytes in 975 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:39:41.676849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-03ea544f-c9f9-4d8e-8795-6fcf3527e196 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:41.677459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-03ea544f-c9f9-4d8e-8795-6fcf3527e196 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:41.684260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-03ea544f-c9f9-4d8e-8795-6fcf3527e196 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:41.684820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-03ea544f-c9f9-4d8e-8795-6fcf3527e196 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:41.685676 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-03ea544f-c9f9-4d8e-8795-6fcf3527e196 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:41.686160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-03ea544f-c9f9-4d8e-8795-6fcf3527e196 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:41.809621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-39555196-efee-497c-8428-06cad4bcc0ef tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:39:41.810188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-39555196-efee-497c-8428-06cad4bcc0ef tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:39:41.810555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-39555196-efee-497c-8428-06cad4bcc0ef tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:39:41.810943 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-39555196-efee-497c-8428-06cad4bcc0ef tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:39:41.811344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-39555196-efee-497c-8428-06cad4bcc0ef tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:39:41.821490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39555196-efee-497c-8428-06cad4bcc0ef tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:41.822444 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39555196-efee-497c-8428-06cad4bcc0ef tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:41.823492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39555196-efee-497c-8428-06cad4bcc0ef tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:41.823926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39555196-efee-497c-8428-06cad4bcc0ef tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:41.845018 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-39555196-efee-497c-8428-06cad4bcc0ef tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Getting quotas for project bdce4da5878543a4a609dc35e389763c. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:39:41.849330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-39555196-efee-497c-8428-06cad4bcc0ef tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Getting quotas for user fa79a472f31b4e8eb0a6ad709bc84c01 and project bdce4da5878543a4a609dc35e389763c. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:39:41.862371 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-39555196-efee-497c-8428-06cad4bcc0ef tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:39:41.864753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-39555196-efee-497c-8428-06cad4bcc0ef tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:39:41.909690 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-39555196-efee-497c-8428-06cad4bcc0ef tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.327785 Jul 25 12:39:41.910428 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 228/411] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Jul 25 12:39:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1329 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 12:39:41.915015 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-d0309857-3637-4039-b292-354d34e8e9d7 req-d90deec2-d635-4bfa-94c4-23267f4029be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d7df5ea-519f-4020-8467-cbe9423e3560", "name": "network-vif-deleted", "tag": "7a275690-625b-4abe-bc6d-d7ad2c9a860e"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:41.925023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d0309857-3637-4039-b292-354d34e8e9d7 req-d90deec2-d635-4bfa-94c4-23267f4029be service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:41.925462 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d0309857-3637-4039-b292-354d34e8e9d7 req-d90deec2-d635-4bfa-94c4-23267f4029be service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:41.931981 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-03ea544f-c9f9-4d8e-8795-6fcf3527e196 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:41.939204 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-d0309857-3637-4039-b292-354d34e8e9d7 req-d90deec2-d635-4bfa-94c4-23267f4029be service nova] Creating event network-vif-deleted:7a275690-625b-4abe-bc6d-d7ad2c9a860e for instance 5d7df5ea-519f-4020-8467-cbe9423e3560 on n-h1-848886-15 Jul 25 12:39:41.940673 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-03ea544f-c9f9-4d8e-8795-6fcf3527e196 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 200 len: 1310 microversion: 2.1 time: 0.267868 Jul 25 12:39:41.945751 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-d0309857-3637-4039-b292-354d34e8e9d7 req-d90deec2-d635-4bfa-94c4-23267f4029be service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034030 Jul 25 12:39:41.947029 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 229/412] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:41.955260 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 184/413] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:41 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 1310 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:41.960345 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4adb7f81-b3cf-43bf-8b59-5c67ec70f2ea tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:41.961123 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4adb7f81-b3cf-43bf-8b59-5c67ec70f2ea tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: a35d467a-2c77-4821-9799-f7873a144436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:41.964183 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5c126a20-5465-49ce-951d-63f9c4f60fc4 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:41.965066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5c126a20-5465-49ce-951d-63f9c4f60fc4 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 5d7df5ea-519f-4020-8467-cbe9423e3560] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:41.968066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4adb7f81-b3cf-43bf-8b59-5c67ec70f2ea tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:41.969086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4adb7f81-b3cf-43bf-8b59-5c67ec70f2ea tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:41.970071 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4adb7f81-b3cf-43bf-8b59-5c67ec70f2ea tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:41.970654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4adb7f81-b3cf-43bf-8b59-5c67ec70f2ea tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:41.973777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c126a20-5465-49ce-951d-63f9c4f60fc4 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:41.974287 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c126a20-5465-49ce-951d-63f9c4f60fc4 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:41.975427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c126a20-5465-49ce-951d-63f9c4f60fc4 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:41.975859 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c126a20-5465-49ce-951d-63f9c4f60fc4 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:41.994123 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-5c126a20-5465-49ce-951d-63f9c4f60fc4 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] HTTP exception thrown: Instance 5d7df5ea-519f-4020-8467-cbe9423e3560 could not be found. Jul 25 12:39:41.996855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5c126a20-5465-49ce-951d-63f9c4f60fc4 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Request method failure captured: Jul 25 12:39:41.996855 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560 HTTP/1.1 Jul 25 12:39:41.996855 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:39:41.996855 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:39:41.996855 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:39:41.996855 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:39:41.996855 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:39:41.996855 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:39:41.996855 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:39:41.996855 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:39:41.996855 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7w08v32_Vz2hupbkhzEg97Arxgd21UGdQdTxd2XVtAmk2VjyFvUplXRnBBwWwhyorLRX8Bo0OcyBTc6gIcDu5Hc3hReBGm9ut7aP3Q3Se5p6EC6unspmbgoQHnRM-JxBDXa_tDanSc-EzrkSNn721EBN2my-QUMSWQgg6gp3OAcNM Jul 25 12:39:41.996855 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:39:41.996855 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:39:41.996855 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:39:41.996855 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:39:41.996855 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:39:41.996855 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:39:41.996855 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 78c5541f51c149278aad62c55bb62d8f Jul 25 12:39:41.996855 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1016230751 Jul 25 12:39:41.996855 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:39:41.996855 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:39:41.998453 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_78c5541f51c149278aad62c55bb62d8f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/78c5541f51c149278aad62c55bb62d8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/78c5541f51c149278aad62c55bb62d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/78c5541f51c149278aad62c55bb62d8f"}]}] Jul 25 12:39:41.998453 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-DeleteServersAdminTestJSON-1016230751 Jul 25 12:39:41.998453 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 78c5541f51c149278aad62c55bb62d8f Jul 25 12:39:41.998453 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1016230751 Jul 25 12:39:41.998453 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-DeleteServersAdminTestJSON-1016230751-project Jul 25 12:39:41.998453 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:39:41.998453 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:39:41.998453 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 78a553e32dbb4f3d8e362d67bc1ba55f Jul 25 12:39:41.998453 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-DeleteServersAdminTestJSON-1016230751-project Jul 25 12:39:41.998453 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:39:41.998453 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 5d7df5ea-519f-4020-8467-cbe9423e3560 could not be found. Jul 25 12:39:41.998453 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '5d7df5ea-519f-4020-8467-cbe9423e3560'} Jul 25 12:39:41.999181 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:39:41.999181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:41.999181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:39:41.999181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:39:41.999181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:39:41.999181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:39:41.999181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:39:41.999181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:39:41.999181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:39:41.999181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:39:41.999181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d7df5ea-519f-4020-8467-cbe9423e3560 could not be found. Jul 25 12:39:41.999181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:39:41.999181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:41.999181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:39:41.999181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:41.999181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:41.999181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:41.999181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:39:41.999181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:39:41.999181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:39:42.010823 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:39:42.010823 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:39:42.010823 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:39:42.010823 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:39:42.010823 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:39:42.010823 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:39:42.010823 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:39:42.010823 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d7df5ea-519f-4020-8467-cbe9423e3560 could not be found. Jul 25 12:39:42.010823 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:39:42.010823 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:42.010823 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:39:42.010823 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:42.010823 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:42.010823 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:42.010823 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:39:42.010823 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:39:42.010823 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d7df5ea-519f-4020-8467-cbe9423e3560 could not be found. Jul 25 12:39:42.010823 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:39:42.012543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5c126a20-5465-49ce-951d-63f9c4f60fc4 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Returning 404 to user: Instance 5d7df5ea-519f-4020-8467-cbe9423e3560 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:39:42.012543 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5c126a20-5465-49ce-951d-63f9c4f60fc4 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560" status: 404 len: 111 microversion: 2.1 time: 0.050601 Jul 25 12:39:42.012543 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 230/414] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:41 2022] GET /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:39:42.015454 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9386219b-a31f-4b7e-a9de-59025ac33633 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:42.016703 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9386219b-a31f-4b7e-a9de-59025ac33633 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:42.024503 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9386219b-a31f-4b7e-a9de-59025ac33633 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:42.024954 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9386219b-a31f-4b7e-a9de-59025ac33633 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:42.027005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9386219b-a31f-4b7e-a9de-59025ac33633 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:42.027818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9386219b-a31f-4b7e-a9de-59025ac33633 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:42.303614 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4adb7f81-b3cf-43bf-8b59-5c67ec70f2ea tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:42.312169 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9386219b-a31f-4b7e-a9de-59025ac33633 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:42.317294 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4adb7f81-b3cf-43bf-8b59-5c67ec70f2ea tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436" status: 200 len: 1468 microversion: 2.1 time: 0.360793 Jul 25 12:39:42.325375 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9386219b-a31f-4b7e-a9de-59025ac33633 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1475 microversion: 2.1 time: 0.324612 Jul 25 12:39:42.334639 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 185/415] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:41 2022] GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436 => generated 1468 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:42.343560 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 231/416] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:41 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1475 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:42.346871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d9bf6b53-7550-46bc-bfbd-efdd67d159f1 tempest-SecurityGroupsTestAdminJSON-2112763349 tempest-SecurityGroupsTestAdminJSON-2112763349-project] Calling method '.version_select at 0x7efcfa446e50>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:42.348104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-df3e881a-95c2-42ee-980f-7ff8226d0b49 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:42.348872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-df3e881a-95c2-42ee-980f-7ff8226d0b49 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: fefcb083-ed47-4de2-9c77-0bdb30d0aa6f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:42.355629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-df3e881a-95c2-42ee-980f-7ff8226d0b49 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:42.356308 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-df3e881a-95c2-42ee-980f-7ff8226d0b49 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:42.357077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-df3e881a-95c2-42ee-980f-7ff8226d0b49 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:42.357755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-df3e881a-95c2-42ee-980f-7ff8226d0b49 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:42.667184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-df3e881a-95c2-42ee-980f-7ff8226d0b49 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:42.677684 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-df3e881a-95c2-42ee-980f-7ff8226d0b49 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f" status: 200 len: 1590 microversion: 2.1 time: 0.337868 Jul 25 12:39:42.678326 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 232/417] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:42 2022] GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f => generated 1590 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:42.683409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-c3c1e26d-6231-45b8-977a-19b8d39c2cd7 req-4e3b43a0-9da1-4d5a-8f2f-17b90af8974e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daf4e818-31a5-4311-87b2-eb63a90f7bc0", "name": "network-vif-plugged", "status": "completed", "tag": "64524d32-78e7-4db4-bec6-a6228c8ab21c"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:42.694237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c3c1e26d-6231-45b8-977a-19b8d39c2cd7 req-4e3b43a0-9da1-4d5a-8f2f-17b90af8974e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:42.694680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c3c1e26d-6231-45b8-977a-19b8d39c2cd7 req-4e3b43a0-9da1-4d5a-8f2f-17b90af8974e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:42.706963 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-c3c1e26d-6231-45b8-977a-19b8d39c2cd7 req-4e3b43a0-9da1-4d5a-8f2f-17b90af8974e service nova] Creating event network-vif-plugged:64524d32-78e7-4db4-bec6-a6228c8ab21c for instance daf4e818-31a5-4311-87b2-eb63a90f7bc0 on n-h1-848886-15 Jul 25 12:39:42.712163 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-c3c1e26d-6231-45b8-977a-19b8d39c2cd7 req-4e3b43a0-9da1-4d5a-8f2f-17b90af8974e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032349 Jul 25 12:39:42.712993 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 233/418] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:42.718371 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0c86ff3e-249a-49d1-8f34-efd1cb672ba9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:42.719051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0c86ff3e-249a-49d1-8f34-efd1cb672ba9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:42.726119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c86ff3e-249a-49d1-8f34-efd1cb672ba9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:42.726570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c86ff3e-249a-49d1-8f34-efd1cb672ba9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:42.727342 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c86ff3e-249a-49d1-8f34-efd1cb672ba9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:42.727775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c86ff3e-249a-49d1-8f34-efd1cb672ba9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:42.813687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0c86ff3e-249a-49d1-8f34-efd1cb672ba9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:42.823899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0c86ff3e-249a-49d1-8f34-efd1cb672ba9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:42.826469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0c86ff3e-249a-49d1-8f34-efd1cb672ba9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:42.827793 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0c86ff3e-249a-49d1-8f34-efd1cb672ba9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 1313 microversion: 2.25 time: 0.113563 Jul 25 12:39:42.828705 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 234/419] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:42 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 1313 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:42.841721 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d8a33657-b6ef-4d49-b6d4-4deb55cfe0b1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1605741174", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:42.904409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-d8a33657-b6ef-4d49-b6d4-4deb55cfe0b1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] validate_networks() for None {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:39:42.936401 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d9bf6b53-7550-46bc-bfbd-efdd67d159f1 tempest-SecurityGroupsTestAdminJSON-2112763349 tempest-SecurityGroupsTestAdminJSON-2112763349-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/e3966672-2db3-4f75-8e1d-7c22ba5dda4b" status: 202 len: 0 microversion: 2.1 time: 0.600180 Jul 25 12:39:42.937774 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 186/420] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:39:42 2022] DELETE /compute/v2.1/os-security-groups/e3966672-2db3-4f75-8e1d-7c22ba5dda4b => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:39:42.944863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-535b288c-0177-4c2e-b038-bf661ec16f68 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1039210509", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:43.072031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-535b288c-0177-4c2e-b038-bf661ec16f68 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] validate_networks() for None {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:39:43.439371 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-d8a33657-b6ef-4d49-b6d4-4deb55cfe0b1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:39:43.439841 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-d8a33657-b6ef-4d49-b6d4-4deb55cfe0b1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:39:43.440601 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-d8a33657-b6ef-4d49-b6d4-4deb55cfe0b1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:39:43.441114 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-d8a33657-b6ef-4d49-b6d4-4deb55cfe0b1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:39:43.441608 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-d8a33657-b6ef-4d49-b6d4-4deb55cfe0b1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:39:43.451992 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d8a33657-b6ef-4d49-b6d4-4deb55cfe0b1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:43.452434 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d8a33657-b6ef-4d49-b6d4-4deb55cfe0b1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:43.453226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d8a33657-b6ef-4d49-b6d4-4deb55cfe0b1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:43.453649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d8a33657-b6ef-4d49-b6d4-4deb55cfe0b1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:43.472062 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-d8a33657-b6ef-4d49-b6d4-4deb55cfe0b1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Getting quotas for project 78c5541f51c149278aad62c55bb62d8f. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:39:43.480367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-d8a33657-b6ef-4d49-b6d4-4deb55cfe0b1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Getting quotas for user 78a553e32dbb4f3d8e362d67bc1ba55f and project 78c5541f51c149278aad62c55bb62d8f. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:39:43.495942 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d8a33657-b6ef-4d49-b6d4-4deb55cfe0b1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:39:43.498994 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d8a33657-b6ef-4d49-b6d4-4deb55cfe0b1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 2bbf13c4-4a58-4656-9223-a60c053d9e44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:39:43.561439 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d8a33657-b6ef-4d49-b6d4-4deb55cfe0b1 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.722564 Jul 25 12:39:43.571547 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 235/421] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:39:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:39:43.586136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-535b288c-0177-4c2e-b038-bf661ec16f68 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:39:43.586560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-535b288c-0177-4c2e-b038-bf661ec16f68 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:39:43.587044 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-535b288c-0177-4c2e-b038-bf661ec16f68 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:39:43.587460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-535b288c-0177-4c2e-b038-bf661ec16f68 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:39:43.587853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-535b288c-0177-4c2e-b038-bf661ec16f68 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:39:43.590607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5139563a-d8f1-4465-b395-327d33227747 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:43.591121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5139563a-d8f1-4465-b395-327d33227747 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: fefcb083-ed47-4de2-9c77-0bdb30d0aa6f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:43.597867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-535b288c-0177-4c2e-b038-bf661ec16f68 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:43.598240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-535b288c-0177-4c2e-b038-bf661ec16f68 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:43.599283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-535b288c-0177-4c2e-b038-bf661ec16f68 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:43.599947 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-535b288c-0177-4c2e-b038-bf661ec16f68 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:43.600074 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5139563a-d8f1-4465-b395-327d33227747 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:43.600516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5139563a-d8f1-4465-b395-327d33227747 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:43.601294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5139563a-d8f1-4465-b395-327d33227747 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:43.601733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5139563a-d8f1-4465-b395-327d33227747 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:43.619726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-535b288c-0177-4c2e-b038-bf661ec16f68 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Getting quotas for project 441bc4b2a9f241b8bcb74a18e3741ca0. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:39:43.624253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-535b288c-0177-4c2e-b038-bf661ec16f68 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Getting quotas for user 896d3b06fb2446ca99333ce426e52d4b and project 441bc4b2a9f241b8bcb74a18e3741ca0. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:39:43.637302 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-535b288c-0177-4c2e-b038-bf661ec16f68 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:39:43.639716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-535b288c-0177-4c2e-b038-bf661ec16f68 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: 589e9ead-d99c-43de-98e8-da7ed1536b95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:39:43.668813 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:43.699547 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-535b288c-0177-4c2e-b038-bf661ec16f68 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760364 Jul 25 12:39:43.706242 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 187/422] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:39:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:39:43.711627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5ce9c041-8e3f-40c8-8e92-497b2bc7fc23 tempest-SecurityGroupsTestAdminJSON-2112763349 tempest-SecurityGroupsTestAdminJSON-2112763349-project] Calling method '.version_select at 0x7efcfa4700d0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:43.766498 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5139563a-d8f1-4465-b395-327d33227747 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.192755 Jul 25 12:39:43.768615 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 236/423] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 12:39:43 2022] GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f/os-interface => generated 285 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:43.777926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7c96534e-ba84-4c16-b8ad-e24ee1adde41 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:43.778537 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7c96534e-ba84-4c16-b8ad-e24ee1adde41 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:43.786577 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c96534e-ba84-4c16-b8ad-e24ee1adde41 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:43.787419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c96534e-ba84-4c16-b8ad-e24ee1adde41 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:43.788395 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c96534e-ba84-4c16-b8ad-e24ee1adde41 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:43.790065 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c96534e-ba84-4c16-b8ad-e24ee1adde41 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:44.227719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7c96534e-ba84-4c16-b8ad-e24ee1adde41 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:44.235623 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7c96534e-ba84-4c16-b8ad-e24ee1adde41 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 200 len: 1310 microversion: 2.1 time: 0.465754 Jul 25 12:39:44.237171 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 237/424] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:43 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 1310 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:44.246129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-161b6a3d-4014-4642-ad48-b14986568596 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:44.248610 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-161b6a3d-4014-4642-ad48-b14986568596 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:44.262359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-161b6a3d-4014-4642-ad48-b14986568596 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:44.268413 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-161b6a3d-4014-4642-ad48-b14986568596 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:44.269386 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-161b6a3d-4014-4642-ad48-b14986568596 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:44.269864 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-161b6a3d-4014-4642-ad48-b14986568596 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:44.598124 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5ce9c041-8e3f-40c8-8e92-497b2bc7fc23 tempest-SecurityGroupsTestAdminJSON-2112763349 tempest-SecurityGroupsTestAdminJSON-2112763349-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/3c703e52-1000-483a-86f3-22b08bc049b6" status: 202 len: 0 microversion: 2.1 time: 0.890388 Jul 25 12:39:44.599143 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 188/425] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:39:43 2022] DELETE /compute/v2.1/os-security-groups/3c703e52-1000-483a-86f3-22b08bc049b6 => generated 0 bytes in 892 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:39:44.610101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c3b08539-49a1-4e30-86c5-6817aa36b71f tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:44.613183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c3b08539-49a1-4e30-86c5-6817aa36b71f tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 2bbf13c4-4a58-4656-9223-a60c053d9e44] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:44.631098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c3b08539-49a1-4e30-86c5-6817aa36b71f tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:44.631579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c3b08539-49a1-4e30-86c5-6817aa36b71f tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:44.632374 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c3b08539-49a1-4e30-86c5-6817aa36b71f tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:44.632806 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c3b08539-49a1-4e30-86c5-6817aa36b71f tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:44.658851 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-161b6a3d-4014-4642-ad48-b14986568596 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:44.681266 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-161b6a3d-4014-4642-ad48-b14986568596 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1475 microversion: 2.1 time: 0.442271 Jul 25 12:39:44.710340 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 238/426] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:44 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1475 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:44.716004 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5b04ba1a-c633-44aa-96de-77166ddecf80 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:44.721942 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5b04ba1a-c633-44aa-96de-77166ddecf80 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: 589e9ead-d99c-43de-98e8-da7ed1536b95] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:44.734940 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5b04ba1a-c633-44aa-96de-77166ddecf80 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:44.735397 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5b04ba1a-c633-44aa-96de-77166ddecf80 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:44.736183 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5b04ba1a-c633-44aa-96de-77166ddecf80 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:44.736624 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5b04ba1a-c633-44aa-96de-77166ddecf80 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:44.818042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c3b08539-49a1-4e30-86c5-6817aa36b71f tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a553e32dbb4f3d8e362d67bc1ba55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c5541f51c149278aad62c55bb62d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:44.826395 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c3b08539-49a1-4e30-86c5-6817aa36b71f tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44" status: 200 len: 1216 microversion: 2.1 time: 0.226161 Jul 25 12:39:44.837157 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 189/427] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:44 2022] GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44 => generated 1216 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:44.843248 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5b04ba1a-c633-44aa-96de-77166ddecf80 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:44.850705 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:44.853931 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5b04ba1a-c633-44aa-96de-77166ddecf80 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95" status: 200 len: 1215 microversion: 2.1 time: 0.142093 Jul 25 12:39:44.857859 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-53fe7a31-acbb-4454-9156-1a5328e5b31b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:44.859067 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 239/428] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:44 2022] GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95 => generated 1215 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:44.860259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-53fe7a31-acbb-4454-9156-1a5328e5b31b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:44.878795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53fe7a31-acbb-4454-9156-1a5328e5b31b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:44.879206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53fe7a31-acbb-4454-9156-1a5328e5b31b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:44.879994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53fe7a31-acbb-4454-9156-1a5328e5b31b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:44.880475 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53fe7a31-acbb-4454-9156-1a5328e5b31b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:45.259466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e943f98f-1af2-43a2-aa07-f1f87155422a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:45.260211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e943f98f-1af2-43a2-aa07-f1f87155422a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:45.280302 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e943f98f-1af2-43a2-aa07-f1f87155422a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:45.280713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e943f98f-1af2-43a2-aa07-f1f87155422a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:45.281580 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e943f98f-1af2-43a2-aa07-f1f87155422a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:45.282020 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e943f98f-1af2-43a2-aa07-f1f87155422a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:45.903336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-53fe7a31-acbb-4454-9156-1a5328e5b31b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:45.912667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-53fe7a31-acbb-4454-9156-1a5328e5b31b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:45.914779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-53fe7a31-acbb-4454-9156-1a5328e5b31b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:45.915904 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-53fe7a31-acbb-4454-9156-1a5328e5b31b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 1361 microversion: 2.25 time: 1.075077 Jul 25 12:39:45.917288 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 190/429] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:44 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 1361 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:45.931890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-00f45812-6d96-4d10-b574-613e2411bdcb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:45.933698 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-00f45812-6d96-4d10-b574-613e2411bdcb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:45.944957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-00f45812-6d96-4d10-b574-613e2411bdcb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:45.946704 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-00f45812-6d96-4d10-b574-613e2411bdcb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:45.947767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-00f45812-6d96-4d10-b574-613e2411bdcb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:45.948206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-00f45812-6d96-4d10-b574-613e2411bdcb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:45.973691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e943f98f-1af2-43a2-aa07-f1f87155422a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:45.989377 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e943f98f-1af2-43a2-aa07-f1f87155422a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 200 len: 1493 microversion: 2.1 time: 0.733667 Jul 25 12:39:45.997780 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 240/430] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:45 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 1493 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:39:46.034678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bc77cb98-83a2-4961-bda5-6cef0f191e66 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:46.035597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bc77cb98-83a2-4961-bda5-6cef0f191e66 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 2bbf13c4-4a58-4656-9223-a60c053d9e44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:46.045106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc77cb98-83a2-4961-bda5-6cef0f191e66 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:46.045693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc77cb98-83a2-4961-bda5-6cef0f191e66 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:46.046525 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc77cb98-83a2-4961-bda5-6cef0f191e66 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:46.046960 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc77cb98-83a2-4961-bda5-6cef0f191e66 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:46.213595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bc77cb98-83a2-4961-bda5-6cef0f191e66 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a553e32dbb4f3d8e362d67bc1ba55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c5541f51c149278aad62c55bb62d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:46.225411 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bc77cb98-83a2-4961-bda5-6cef0f191e66 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44" status: 200 len: 1278 microversion: 2.1 time: 0.203342 Jul 25 12:39:46.241760 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 241/431] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:46 2022] GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44 => generated 1278 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:46.247605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a3b6add0-1392-41ac-a238-a32800e0193a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:46.248219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a3b6add0-1392-41ac-a238-a32800e0193a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: 589e9ead-d99c-43de-98e8-da7ed1536b95] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:46.259548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a3b6add0-1392-41ac-a238-a32800e0193a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:46.260221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a3b6add0-1392-41ac-a238-a32800e0193a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:46.261017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a3b6add0-1392-41ac-a238-a32800e0193a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:46.261457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a3b6add0-1392-41ac-a238-a32800e0193a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:46.452384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a3b6add0-1392-41ac-a238-a32800e0193a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:46.467859 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a3b6add0-1392-41ac-a238-a32800e0193a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95" status: 200 len: 1277 microversion: 2.1 time: 0.223303 Jul 25 12:39:46.469552 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 242/432] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:46 2022] GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95 => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:46.544535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-00f45812-6d96-4d10-b574-613e2411bdcb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:46.562372 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-00f45812-6d96-4d10-b574-613e2411bdcb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1475 microversion: 2.1 time: 0.643761 Jul 25 12:39:46.562961 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 191/433] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:45 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1475 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:46.763278 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-960a810a-7350-4b01-8920-6950361f257b tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:46.763895 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-960a810a-7350-4b01-8920-6950361f257b tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:46.770097 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-960a810a-7350-4b01-8920-6950361f257b tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:46.770462 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-960a810a-7350-4b01-8920-6950361f257b tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:46.771235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-960a810a-7350-4b01-8920-6950361f257b tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:46.771687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-960a810a-7350-4b01-8920-6950361f257b tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:46.940795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0a02f352-339e-4d80-a040-24cf51d47608 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:46.941627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0a02f352-339e-4d80-a040-24cf51d47608 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:46.950450 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a02f352-339e-4d80-a040-24cf51d47608 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:46.951203 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a02f352-339e-4d80-a040-24cf51d47608 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:46.952826 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a02f352-339e-4d80-a040-24cf51d47608 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:46.953435 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a02f352-339e-4d80-a040-24cf51d47608 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:47.369943 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-960a810a-7350-4b01-8920-6950361f257b tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 200 len: 1646 microversion: 2.1 time: 0.898909 Jul 25 12:39:47.370828 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 243/434] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:46 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 1646 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:47.376393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-30e3c817-0726-4479-96d2-61358ad6e8ee tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:47.377646 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-30e3c817-0726-4479-96d2-61358ad6e8ee tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 2bbf13c4-4a58-4656-9223-a60c053d9e44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:47.387252 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30e3c817-0726-4479-96d2-61358ad6e8ee tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:47.388178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30e3c817-0726-4479-96d2-61358ad6e8ee tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:47.389208 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30e3c817-0726-4479-96d2-61358ad6e8ee tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:47.389917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30e3c817-0726-4479-96d2-61358ad6e8ee tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:47.547674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-30e3c817-0726-4479-96d2-61358ad6e8ee tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a553e32dbb4f3d8e362d67bc1ba55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c5541f51c149278aad62c55bb62d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:47.586526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0a02f352-339e-4d80-a040-24cf51d47608 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:47.603270 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-30e3c817-0726-4479-96d2-61358ad6e8ee tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44" status: 200 len: 1278 microversion: 2.1 time: 0.231258 Jul 25 12:39:47.622764 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 244/435] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:47 2022] GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44 => generated 1278 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:47.637015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0a02f352-339e-4d80-a040-24cf51d47608 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:47.648371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0a02f352-339e-4d80-a040-24cf51d47608 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:47.652643 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0a02f352-339e-4d80-a040-24cf51d47608 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 1361 microversion: 2.25 time: 0.714065 Jul 25 12:39:47.655635 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b397b04a-ebe1-4eb1-be92-0f31b3716ca7 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:47.671719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b397b04a-ebe1-4eb1-be92-0f31b3716ca7 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:47.674550 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 192/436] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:46 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 1361 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:39:47.684922 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0680072a-3379-4a15-9b58-73c9a87f9269 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:47.691288 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0680072a-3379-4a15-9b58-73c9a87f9269 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: 589e9ead-d99c-43de-98e8-da7ed1536b95] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:47.699617 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b397b04a-ebe1-4eb1-be92-0f31b3716ca7 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:47.702112 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b397b04a-ebe1-4eb1-be92-0f31b3716ca7 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:47.704569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b397b04a-ebe1-4eb1-be92-0f31b3716ca7 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:47.707254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b397b04a-ebe1-4eb1-be92-0f31b3716ca7 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:47.711106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0680072a-3379-4a15-9b58-73c9a87f9269 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:47.711543 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0680072a-3379-4a15-9b58-73c9a87f9269 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:47.714562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0680072a-3379-4a15-9b58-73c9a87f9269 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:47.715009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0680072a-3379-4a15-9b58-73c9a87f9269 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:47.888129 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0680072a-3379-4a15-9b58-73c9a87f9269 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:47.900740 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0680072a-3379-4a15-9b58-73c9a87f9269 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95" status: 200 len: 1277 microversion: 2.1 time: 0.223928 Jul 25 12:39:47.903089 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 193/437] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:47 2022] GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95 => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:47.919175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f8d941fe-862a-46b4-9b16-706a3bad430f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:47.921160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f8d941fe-862a-46b4-9b16-706a3bad430f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:47.938413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8d941fe-862a-46b4-9b16-706a3bad430f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:47.940556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8d941fe-862a-46b4-9b16-706a3bad430f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:47.941677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8d941fe-862a-46b4-9b16-706a3bad430f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:47.942309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8d941fe-862a-46b4-9b16-706a3bad430f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:48.126140 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b397b04a-ebe1-4eb1-be92-0f31b3716ca7 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 200 len: 1646 microversion: 2.1 time: 0.500279 Jul 25 12:39:48.126538 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 245/438] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:47 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 1646 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:48.137316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3112ba8e-bc82-4869-928d-e445b6883ee1 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:48.142816 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3112ba8e-bc82-4869-928d-e445b6883ee1 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: fefcb083-ed47-4de2-9c77-0bdb30d0aa6f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:48.159097 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3112ba8e-bc82-4869-928d-e445b6883ee1 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:48.159548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3112ba8e-bc82-4869-928d-e445b6883ee1 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:48.160365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3112ba8e-bc82-4869-928d-e445b6883ee1 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:48.160803 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3112ba8e-bc82-4869-928d-e445b6883ee1 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:48.888988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f8d941fe-862a-46b4-9b16-706a3bad430f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:48.950447 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f8d941fe-862a-46b4-9b16-706a3bad430f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1474 microversion: 2.1 time: 1.036936 Jul 25 12:39:48.961863 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 194/439] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:47 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1474 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:48.968529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-192a3952-c410-4762-95ff-3f75e478ff86 req-0a7ecea0-7d5b-42a8-8b5d-451ce2311e74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fefcb083-ed47-4de2-9c77-0bdb30d0aa6f", "tag": "3ebd7fbe-3aa1-4cae-a6fe-f0d6422bd74b"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:49.009582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-192a3952-c410-4762-95ff-3f75e478ff86 req-0a7ecea0-7d5b-42a8-8b5d-451ce2311e74 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:49.013124 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-192a3952-c410-4762-95ff-3f75e478ff86 req-0a7ecea0-7d5b-42a8-8b5d-451ce2311e74 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:49.040150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3112ba8e-bc82-4869-928d-e445b6883ee1 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:49.060860 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3112ba8e-bc82-4869-928d-e445b6883ee1 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f" status: 200 len: 1590 microversion: 2.1 time: 0.927459 Jul 25 12:39:49.061465 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 246/440] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:48 2022] GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f => generated 1590 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:49.064292 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-192a3952-c410-4762-95ff-3f75e478ff86 req-0a7ecea0-7d5b-42a8-8b5d-451ce2311e74 service nova] Creating event network-changed:3ebd7fbe-3aa1-4cae-a6fe-f0d6422bd74b for instance fefcb083-ed47-4de2-9c77-0bdb30d0aa6f on n-h2-848886-15 Jul 25 12:39:49.079744 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-39ee3502-72ad-410c-b243-c3477bde81f0 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:49.082539 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:39:49.082539 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:39:49.083803 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39ee3502-72ad-410c-b243-c3477bde81f0 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:49.084929 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-192a3952-c410-4762-95ff-3f75e478ff86 req-0a7ecea0-7d5b-42a8-8b5d-451ce2311e74 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130817 Jul 25 12:39:49.086501 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39ee3502-72ad-410c-b243-c3477bde81f0 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:49.087455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39ee3502-72ad-410c-b243-c3477bde81f0 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:49.087894 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39ee3502-72ad-410c-b243-c3477bde81f0 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:49.091940 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 195/441] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:49.110795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-66f7bd8f-cf7b-4c63-b0cc-46de16840dad tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:49.145597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-66f7bd8f-cf7b-4c63-b0cc-46de16840dad tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 2bbf13c4-4a58-4656-9223-a60c053d9e44] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:49.155628 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-39ee3502-72ad-410c-b243-c3477bde81f0 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.093019 Jul 25 12:39:49.169947 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 247/442] 10.222.0.49 () {58 vars in 1176 bytes} [Mon Jul 25 12:39:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:49.177192 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-36164d6c-a732-4379-b578-64534156acd4 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:49.178140 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-36164d6c-a732-4379-b578-64534156acd4 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:49.179221 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-66f7bd8f-cf7b-4c63-b0cc-46de16840dad tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:49.180090 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-66f7bd8f-cf7b-4c63-b0cc-46de16840dad tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:49.181903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-66f7bd8f-cf7b-4c63-b0cc-46de16840dad tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:49.182546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-66f7bd8f-cf7b-4c63-b0cc-46de16840dad tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:49.193610 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36164d6c-a732-4379-b578-64534156acd4 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:49.194096 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36164d6c-a732-4379-b578-64534156acd4 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:49.194877 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36164d6c-a732-4379-b578-64534156acd4 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:49.195310 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36164d6c-a732-4379-b578-64534156acd4 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:49.517549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-66f7bd8f-cf7b-4c63-b0cc-46de16840dad tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a553e32dbb4f3d8e362d67bc1ba55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c5541f51c149278aad62c55bb62d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:49.527878 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-66f7bd8f-cf7b-4c63-b0cc-46de16840dad tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44" status: 200 len: 1278 microversion: 2.1 time: 0.428248 Jul 25 12:39:49.529242 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 196/443] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:49 2022] GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44 => generated 1278 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:49.535168 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2af25c5d-9e27-4380-afab-9ab0256023a0 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:49.535859 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2af25c5d-9e27-4380-afab-9ab0256023a0 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: 589e9ead-d99c-43de-98e8-da7ed1536b95] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:49.542979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2af25c5d-9e27-4380-afab-9ab0256023a0 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:49.543699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2af25c5d-9e27-4380-afab-9ab0256023a0 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:49.545002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2af25c5d-9e27-4380-afab-9ab0256023a0 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:49.545648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2af25c5d-9e27-4380-afab-9ab0256023a0 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:50.076557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-36164d6c-a732-4379-b578-64534156acd4 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:50.092178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-36164d6c-a732-4379-b578-64534156acd4 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:50.099864 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-36164d6c-a732-4379-b578-64534156acd4 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:50.101356 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-36164d6c-a732-4379-b578-64534156acd4 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 1361 microversion: 2.25 time: 0.933530 Jul 25 12:39:50.101974 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 248/444] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:49 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 1361 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:50.118977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-a3596bb2-511d-4286-91a5-6388aa6bba3a req-c5de10eb-9b8f-4286-978f-b9c4c4f58f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31a28091-c9d3-44c2-8289-828c66b56c2b", "tag": "5abc676c-0f69-43cf-b469-5e02f591bcab"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:50.144738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a3596bb2-511d-4286-91a5-6388aa6bba3a req-c5de10eb-9b8f-4286-978f-b9c4c4f58f95 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:50.145436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a3596bb2-511d-4286-91a5-6388aa6bba3a req-c5de10eb-9b8f-4286-978f-b9c4c4f58f95 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:50.159801 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-a3596bb2-511d-4286-91a5-6388aa6bba3a req-c5de10eb-9b8f-4286-978f-b9c4c4f58f95 service nova] Creating event network-changed:5abc676c-0f69-43cf-b469-5e02f591bcab for instance 31a28091-c9d3-44c2-8289-828c66b56c2b on n-h1-848886-15 Jul 25 12:39:50.166323 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-a3596bb2-511d-4286-91a5-6388aa6bba3a req-c5de10eb-9b8f-4286-978f-b9c4c4f58f95 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062531 Jul 25 12:39:50.167525 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 249/445] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:50.173623 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0b52523b-5bd4-4004-a995-5cd7162f7098 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-848886-15", "block_migration": true, "disk_over_commit": false}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:50.176856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0b52523b-5bd4-4004-a995-5cd7162f7098 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:50.185761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0b52523b-5bd4-4004-a995-5cd7162f7098 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:50.186422 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0b52523b-5bd4-4004-a995-5cd7162f7098 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:50.187363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0b52523b-5bd4-4004-a995-5cd7162f7098 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:50.187952 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0b52523b-5bd4-4004-a995-5cd7162f7098 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:50.215802 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-0b52523b-5bd4-4004-a995-5cd7162f7098 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lazy-loading 'flavor' on Instance uuid daf4e818-31a5-4311-87b2-eb63a90f7bc0 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:39:50.231982 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0b52523b-5bd4-4004-a995-5cd7162f7098 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Going to try to live migrate instance to n-h2-848886-15 {{(pid=125883) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 12:39:50.247436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:50.421526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2af25c5d-9e27-4380-afab-9ab0256023a0 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:50.431156 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2af25c5d-9e27-4380-afab-9ab0256023a0 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95" status: 200 len: 1319 microversion: 2.1 time: 0.900461 Jul 25 12:39:50.433168 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 197/446] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:49 2022] GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95 => generated 1319 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:50.439923 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-de8a06b0-7cd1-44d5-ba71-2b841004517c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:50.450836 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-de8a06b0-7cd1-44d5-ba71-2b841004517c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:50.457265 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de8a06b0-7cd1-44d5-ba71-2b841004517c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:50.467419 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de8a06b0-7cd1-44d5-ba71-2b841004517c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:50.468553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de8a06b0-7cd1-44d5-ba71-2b841004517c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:50.472271 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de8a06b0-7cd1-44d5-ba71-2b841004517c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:50.840013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-de8a06b0-7cd1-44d5-ba71-2b841004517c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:50.856666 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-de8a06b0-7cd1-44d5-ba71-2b841004517c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1474 microversion: 2.1 time: 0.422167 Jul 25 12:39:50.858697 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 198/447] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:50 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1474 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:51.181502 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-021c402a-df38-4142-abf2-a2986b433dec tempest-TenantUsagesNegativeTestJSON-1128202477 tempest-TenantUsagesNegativeTestJSON-1128202477-project-admin] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-24T12%3A39%3A50.390977&end=2022-07-26T12%3A39%3A50.390977" status: 404 len: 112 microversion: - time: 0.321675 Jul 25 12:39:51.182393 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 199/448] 10.222.0.49 () {58 vars in 1316 bytes} [Mon Jul 25 12:39:50 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-24T12%3A39%3A50.390977&end=2022-07-26T12%3A39%3A50.390977 => generated 112 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 12:39:51.189868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cf5d9bef-8b88-4b14-b625-89b04fa91613 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:51.190848 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cf5d9bef-8b88-4b14-b625-89b04fa91613 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 2bbf13c4-4a58-4656-9223-a60c053d9e44] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:51.200075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf5d9bef-8b88-4b14-b625-89b04fa91613 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:51.200896 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf5d9bef-8b88-4b14-b625-89b04fa91613 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:51.202478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf5d9bef-8b88-4b14-b625-89b04fa91613 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:51.204442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf5d9bef-8b88-4b14-b625-89b04fa91613 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:51.570275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cf5d9bef-8b88-4b14-b625-89b04fa91613 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a553e32dbb4f3d8e362d67bc1ba55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c5541f51c149278aad62c55bb62d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:51.581881 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cf5d9bef-8b88-4b14-b625-89b04fa91613 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44" status: 200 len: 1320 microversion: 2.1 time: 0.397960 Jul 25 12:39:51.586441 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 200/449] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:51 2022] GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44 => generated 1320 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:51.592301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a0e853af-c868-40f9-8dfd-4103191875b5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:51.595972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a0e853af-c868-40f9-8dfd-4103191875b5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:51.604681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0e853af-c868-40f9-8dfd-4103191875b5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:51.605527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0e853af-c868-40f9-8dfd-4103191875b5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:51.606572 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0e853af-c868-40f9-8dfd-4103191875b5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:51.607269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0e853af-c868-40f9-8dfd-4103191875b5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:51.635298 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:51.894714 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a0e853af-c868-40f9-8dfd-4103191875b5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:51.904547 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a0e853af-c868-40f9-8dfd-4103191875b5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:51.906407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a0e853af-c868-40f9-8dfd-4103191875b5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:51.907546 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a0e853af-c868-40f9-8dfd-4103191875b5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 1361 microversion: 2.25 time: 0.319781 Jul 25 12:39:51.918193 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 201/450] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:51 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 1361 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:51.924585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8b5338b0-2899-480a-bcb1-12947f099313 tempest-TenantUsagesNegativeTestJSON-1128202477 tempest-TenantUsagesNegativeTestJSON-1128202477-project-admin] Calling method '.version_select at 0x7efcfa2db0d0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:51.934121 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-8b5338b0-2899-480a-bcb1-12947f099313 tempest-TenantUsagesNegativeTestJSON-1128202477 tempest-TenantUsagesNegativeTestJSON-1128202477-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 25 12:39:51.936324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8b5338b0-2899-480a-bcb1-12947f099313 tempest-TenantUsagesNegativeTestJSON-1128202477 tempest-TenantUsagesNegativeTestJSON-1128202477-project-admin] Request method failure captured: Jul 25 12:39:51.936324 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/os-simple-tenant-usage/ab60a6352f294964ae9597d037c280bd?start=2022-07-26T12%3A39%3A50.390977&end=2022-07-24T12%3A39%3A50.390977 HTTP/1.1 Jul 25 12:39:51.936324 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:39:51.936324 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:39:51.936324 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:39:51.936324 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:39:51.936324 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:39:51.936324 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:39:51.936324 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:39:51.936324 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:39:51.936324 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o8Wp8zCADlghBa0XiNtzqXgCvJeZp1pFHwQ1q2Ad8ixBJbMaM8pLLkBhE2JhRqH-icD2bdKkjvgnA6iG8nHbzCctOHyVSDUk9WSoY6-SuKvh-qNvXaAfE3yGheI9M1LX3W-duRIkcAuG5SLNuS_f9dVJUv7SIp0iRP5tIrPOKToLmo Jul 25 12:39:51.936324 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:39:51.936324 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:39:51.936324 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:39:51.936324 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:39:51.936324 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:39:51.936324 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:39:51.936324 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: e824ad2e93e4446fa7351510f504e576 Jul 25 12:39:51.936324 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1128202477 Jul 25 12:39:51.936324 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,admin,member Jul 25 12:39:51.936324 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,admin,member Jul 25 12:39:51.938031 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e824ad2e93e4446fa7351510f504e576", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e824ad2e93e4446fa7351510f504e576"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e824ad2e93e4446fa7351510f504e576"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e824ad2e93e4446fa7351510f504e576"}]}] Jul 25 12:39:51.938031 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1128202477 Jul 25 12:39:51.938031 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: e824ad2e93e4446fa7351510f504e576 Jul 25 12:39:51.938031 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1128202477 Jul 25 12:39:51.938031 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TenantUsagesNegativeTestJSON-1128202477-project-admin Jul 25 12:39:51.938031 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:39:51.938031 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:39:51.938031 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 86305587a0f04128b756a7b960158d89 Jul 25 12:39:51.938031 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1128202477-project-admin Jul 25 12:39:51.938031 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:39:51.938031 n-d-848886-15 devstack@n-api.service[125884]: exception: Invalid start time. The start time cannot occur after the end time. Jul 25 12:39:51.938031 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'ab60a6352f294964ae9597d037c280bd'} Jul 25 12:39:51.939151 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:39:51.939151 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:51.939151 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:51.939151 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:51.939151 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:39:51.939151 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:39:51.939151 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:39:51.939151 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:39:51.939151 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 12:39:51.939151 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:39:51.939151 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:39:51.939151 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:39:51.939151 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 25 12:39:51.939151 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 25 12:39:51.939151 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 25 12:39:51.939151 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 25 12:39:51.939151 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 25 12:39:51.939151 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 25 12:39:51.939151 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 25 12:39:51.940646 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:39:51.940646 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:51.940646 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:39:51.940646 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:51.940646 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:51.940646 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:51.940646 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:39:51.940646 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:39:51.940646 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 25 12:39:51.940646 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:39:51.940646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8b5338b0-2899-480a-bcb1-12947f099313 tempest-TenantUsagesNegativeTestJSON-1128202477 tempest-TenantUsagesNegativeTestJSON-1128202477-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:39:51.942927 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8b5338b0-2899-480a-bcb1-12947f099313 tempest-TenantUsagesNegativeTestJSON-1128202477 tempest-TenantUsagesNegativeTestJSON-1128202477-project-admin] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage/ab60a6352f294964ae9597d037c280bd?start=2022-07-26T12%3A39%3A50.390977&end=2022-07-24T12%3A39%3A50.390977" status: 400 len: 111 microversion: 2.1 time: 0.018721 Jul 25 12:39:51.942927 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 202/451] 10.222.0.49 () {58 vars in 1412 bytes} [Mon Jul 25 12:39:51 2022] GET /compute/v2.1/os-simple-tenant-usage/ab60a6352f294964ae9597d037c280bd?start=2022-07-26T12%3A39%3A50.390977&end=2022-07-24T12%3A39%3A50.390977 => generated 111 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:39:51.948264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-4d520ace-f8c3-4a40-90ea-afcb95b43051 req-4d88c01a-f529-4c84-b895-454b141b0b0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "589e9ead-d99c-43de-98e8-da7ed1536b95", "tag": "c0a35ea1-b5c8-40a8-bb95-4e65c57d81d1"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:51.962711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4d520ace-f8c3-4a40-90ea-afcb95b43051 req-4d88c01a-f529-4c84-b895-454b141b0b0c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:51.963166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4d520ace-f8c3-4a40-90ea-afcb95b43051 req-4d88c01a-f529-4c84-b895-454b141b0b0c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:51.975305 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-4d520ace-f8c3-4a40-90ea-afcb95b43051 req-4d88c01a-f529-4c84-b895-454b141b0b0c service nova] Creating event network-changed:c0a35ea1-b5c8-40a8-bb95-4e65c57d81d1 for instance 589e9ead-d99c-43de-98e8-da7ed1536b95 on n-h1-848886-15 Jul 25 12:39:51.980440 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-4d520ace-f8c3-4a40-90ea-afcb95b43051 req-4d88c01a-f529-4c84-b895-454b141b0b0c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036509 Jul 25 12:39:51.981493 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 203/452] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:51.988732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c1fd852f-ed60-469f-8969-cf7252d3e4b2 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:51.989568 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c1fd852f-ed60-469f-8969-cf7252d3e4b2 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: 589e9ead-d99c-43de-98e8-da7ed1536b95] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:51.996880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1fd852f-ed60-469f-8969-cf7252d3e4b2 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:51.997719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1fd852f-ed60-469f-8969-cf7252d3e4b2 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:51.998568 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1fd852f-ed60-469f-8969-cf7252d3e4b2 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:51.999146 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1fd852f-ed60-469f-8969-cf7252d3e4b2 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:52.149915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c1fd852f-ed60-469f-8969-cf7252d3e4b2 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:52.158832 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c1fd852f-ed60-469f-8969-cf7252d3e4b2 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95" status: 200 len: 1319 microversion: 2.1 time: 0.176106 Jul 25 12:39:52.171997 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 204/453] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:51 2022] GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:52.177863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-64a96144-944e-4bb2-aaf4-1834d318d7a1 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:52.178466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-64a96144-944e-4bb2-aaf4-1834d318d7a1 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:52.184548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64a96144-944e-4bb2-aaf4-1834d318d7a1 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:52.184993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64a96144-944e-4bb2-aaf4-1834d318d7a1 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:52.185758 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64a96144-944e-4bb2-aaf4-1834d318d7a1 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:52.186212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64a96144-944e-4bb2-aaf4-1834d318d7a1 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:52.329186 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-64a96144-944e-4bb2-aaf4-1834d318d7a1 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:52.337008 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-64a96144-944e-4bb2-aaf4-1834d318d7a1 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1474 microversion: 2.1 time: 0.162982 Jul 25 12:39:52.337533 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 205/454] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:52 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1474 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:52.703459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-64ba0cb8-04e5-4a01-af7e-11cacba0d654 tempest-TenantUsagesNegativeTestJSON-1468457060 tempest-TenantUsagesNegativeTestJSON-1468457060-project] Calling method '.version_select at 0x7efcfa2933a0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:52.721603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-64ba0cb8-04e5-4a01-af7e-11cacba0d654 tempest-TenantUsagesNegativeTestJSON-1468457060 tempest-TenantUsagesNegativeTestJSON-1468457060-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'd0de735232a344858b45f0d8f3612031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab60a6352f294964ae9597d037c280bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:52.725592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-64ba0cb8-04e5-4a01-af7e-11cacba0d654 tempest-TenantUsagesNegativeTestJSON-1468457060 tempest-TenantUsagesNegativeTestJSON-1468457060-project] Request method failure captured: Jul 25 12:39:52.725592 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-24T12%3A39%3A50.390977&end=2022-07-26T12%3A39%3A50.390977&detailed=1 HTTP/1.1 Jul 25 12:39:52.725592 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:39:52.725592 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:39:52.725592 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:39:52.725592 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:39:52.725592 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:39:52.725592 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:39:52.725592 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:39:52.725592 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:39:52.725592 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o8VtcH4_xdVkXT9zgCQgb1axXilO4v2JYomHFwKnspTIEXKUZS-MfByM8a5fs48STVhD4EWU9dv6JddpWvw1DEe3q6In6D4YBQvXc0vyOMkiZApnEL4_aAn4SIpZUmSh6M2RXi9Kx_iuiPyHY3xiua0I0sC6EoYVBHlLevZ0T7NUcE Jul 25 12:39:52.725592 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:39:52.725592 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:39:52.725592 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:39:52.725592 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:39:52.725592 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:39:52.725592 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:39:52.725592 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: ab60a6352f294964ae9597d037c280bd Jul 25 12:39:52.725592 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1468457060 Jul 25 12:39:52.725592 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:39:52.725592 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:39:52.727252 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ab60a6352f294964ae9597d037c280bd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ab60a6352f294964ae9597d037c280bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ab60a6352f294964ae9597d037c280bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ab60a6352f294964ae9597d037c280bd"}]}] Jul 25 12:39:52.727252 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1468457060 Jul 25 12:39:52.727252 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: ab60a6352f294964ae9597d037c280bd Jul 25 12:39:52.727252 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1468457060 Jul 25 12:39:52.727252 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TenantUsagesNegativeTestJSON-1468457060-project Jul 25 12:39:52.727252 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:39:52.727252 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:39:52.727252 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: d0de735232a344858b45f0d8f3612031 Jul 25 12:39:52.727252 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1468457060-project Jul 25 12:39:52.727252 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:39:52.727252 n-d-848886-15 devstack@n-api.service[125884]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 25 12:39:52.727252 n-d-848886-15 devstack@n-api.service[125884]: action_args: {} Jul 25 12:39:52.727252 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:39:52.728194 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:52.728194 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:52.728194 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:52.728194 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:39:52.728194 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:39:52.728194 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:39:52.728194 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:39:52.728194 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 12:39:52.728194 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:39:52.728194 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:39:52.728194 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:39:52.728194 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 25 12:39:52.728194 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 25 12:39:52.728194 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 25 12:39:52.728194 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 25 12:39:52.728194 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:39:52.728194 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:39:52.728194 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:39:52.728194 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:39:52.729511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:39:52.729511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:39:52.729511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:39:52.729511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:39:52.729511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:39:52.729511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:39:52.729511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:39:52.729511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:39:52.729511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:39:52.729511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:39:52.729511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 25 12:39:52.729511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:39:52.729511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:52.729511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:39:52.729511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:52.729511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:52.729511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:52.729511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:39:52.729511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:39:52.730671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 25 12:39:52.730671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:39:52.734505 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-64ba0cb8-04e5-4a01-af7e-11cacba0d654 tempest-TenantUsagesNegativeTestJSON-1468457060 tempest-TenantUsagesNegativeTestJSON-1468457060-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:39:52.738534 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-64ba0cb8-04e5-4a01-af7e-11cacba0d654 tempest-TenantUsagesNegativeTestJSON-1468457060 tempest-TenantUsagesNegativeTestJSON-1468457060-project] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-24T12%3A39%3A50.390977&end=2022-07-26T12%3A39%3A50.390977&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.392678 Jul 25 12:39:52.743185 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 206/455] 10.222.0.49 () {58 vars in 1335 bytes} [Mon Jul 25 12:39:52 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-24T12%3A39%3A50.390977&end=2022-07-26T12%3A39%3A50.390977&detailed=1 => generated 123 bytes in 405 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:39:52.755231 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-ab86d1ba-a6d5-4390-8c4c-0c28fd930836 req-0885650d-f406-4dfa-94c7-abd57b85d128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73d77295-bfd7-4ff9-b2f9-09d175f81696", "name": "network-vif-unplugged", "status": "completed", "tag": "ed3b7b89-f69c-4f30-b4f9-ecff648c112d"}, {"name": "network-changed", "server_uuid": "73d77295-bfd7-4ff9-b2f9-09d175f81696", "tag": "ed3b7b89-f69c-4f30-b4f9-ecff648c112d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:52.783136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-ab86d1ba-a6d5-4390-8c4c-0c28fd930836 req-0885650d-f406-4dfa-94c7-abd57b85d128 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:52.783586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-ab86d1ba-a6d5-4390-8c4c-0c28fd930836 req-0885650d-f406-4dfa-94c7-abd57b85d128 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:52.819105 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-ab86d1ba-a6d5-4390-8c4c-0c28fd930836 req-0885650d-f406-4dfa-94c7-abd57b85d128 service nova] Creating event network-vif-unplugged:ed3b7b89-f69c-4f30-b4f9-ecff648c112d for instance 73d77295-bfd7-4ff9-b2f9-09d175f81696 on n-h1-848886-15 Jul 25 12:39:52.821589 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-ab86d1ba-a6d5-4390-8c4c-0c28fd930836 req-0885650d-f406-4dfa-94c7-abd57b85d128 service nova] Creating event network-changed:ed3b7b89-f69c-4f30-b4f9-ecff648c112d for instance 73d77295-bfd7-4ff9-b2f9-09d175f81696 on n-h1-848886-15 Jul 25 12:39:52.856273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [req-ab86d1ba-a6d5-4390-8c4c-0c28fd930836 req-0885650d-f406-4dfa-94c7-abd57b85d128 service nova] Instance 73d77295-bfd7-4ff9-b2f9-09d175f81696 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 12:39:52.903100 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-ab86d1ba-a6d5-4390-8c4c-0c28fd930836 req-0885650d-f406-4dfa-94c7-abd57b85d128 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.154462 Jul 25 12:39:52.903769 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 207/456] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:52.940613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8494768d-3bcb-4f72-b620-81fc0a7a51e0 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:52.942439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8494768d-3bcb-4f72-b620-81fc0a7a51e0 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 2bbf13c4-4a58-4656-9223-a60c053d9e44] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:52.964265 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8494768d-3bcb-4f72-b620-81fc0a7a51e0 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:52.965014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8494768d-3bcb-4f72-b620-81fc0a7a51e0 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:52.970155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8494768d-3bcb-4f72-b620-81fc0a7a51e0 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:52.970611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8494768d-3bcb-4f72-b620-81fc0a7a51e0 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:53.494793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=12 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:53.611807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:53.633212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:53.641483 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8494768d-3bcb-4f72-b620-81fc0a7a51e0 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a553e32dbb4f3d8e362d67bc1ba55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c5541f51c149278aad62c55bb62d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:53.651657 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8494768d-3bcb-4f72-b620-81fc0a7a51e0 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44" status: 200 len: 1320 microversion: 2.1 time: 0.744549 Jul 25 12:39:53.666387 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 208/457] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:52 2022] GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44 => generated 1320 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:53.672052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b1c1f28d-4a74-4ac5-9f09-c4594067f4c9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:53.672730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b1c1f28d-4a74-4ac5-9f09-c4594067f4c9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:53.687955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b1c1f28d-4a74-4ac5-9f09-c4594067f4c9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:53.688553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b1c1f28d-4a74-4ac5-9f09-c4594067f4c9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:53.689663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b1c1f28d-4a74-4ac5-9f09-c4594067f4c9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:53.690345 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b1c1f28d-4a74-4ac5-9f09-c4594067f4c9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:54.119002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b1c1f28d-4a74-4ac5-9f09-c4594067f4c9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:54.150719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b1c1f28d-4a74-4ac5-9f09-c4594067f4c9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:54.155625 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b1c1f28d-4a74-4ac5-9f09-c4594067f4c9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:54.157054 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b1c1f28d-4a74-4ac5-9f09-c4594067f4c9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 1361 microversion: 2.25 time: 0.489515 Jul 25 12:39:54.157613 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 209/458] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:53 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 1361 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:54.162464 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b7bedc0d-067d-4c89-a837-2729300723df tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:54.163506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b7bedc0d-067d-4c89-a837-2729300723df tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: 589e9ead-d99c-43de-98e8-da7ed1536b95] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:54.169527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7bedc0d-067d-4c89-a837-2729300723df tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:54.170093 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7bedc0d-067d-4c89-a837-2729300723df tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:54.170855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7bedc0d-067d-4c89-a837-2729300723df tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:54.171489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7bedc0d-067d-4c89-a837-2729300723df tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:54.376110 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0b52523b-5bd4-4004-a995-5cd7162f7098 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0/action" status: 202 len: 0 microversion: 2.1 time: 4.207170 Jul 25 12:39:54.377140 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 250/459] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:39:50 2022] POST /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0/action => generated 0 bytes in 4209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:39:54.383255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3e09adb6-5ebf-49fa-adc6-74cd134dcac4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:54.383883 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3e09adb6-5ebf-49fa-adc6-74cd134dcac4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:54.404192 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3e09adb6-5ebf-49fa-adc6-74cd134dcac4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:54.404931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3e09adb6-5ebf-49fa-adc6-74cd134dcac4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:54.406005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3e09adb6-5ebf-49fa-adc6-74cd134dcac4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:54.406433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3e09adb6-5ebf-49fa-adc6-74cd134dcac4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:54.753776 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b7bedc0d-067d-4c89-a837-2729300723df tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:54.766063 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b7bedc0d-067d-4c89-a837-2729300723df tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95" status: 200 len: 1319 microversion: 2.1 time: 0.606395 Jul 25 12:39:54.767051 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 210/460] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:54 2022] GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95 => generated 1319 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:54.775421 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-6b2694b5-48fd-4deb-99e3-71b170cbd9a4 req-ea262a83-586a-4d71-90fa-3d55c56e7e09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bbf13c4-4a58-4656-9223-a60c053d9e44", "tag": "c1c4c318-da17-46d9-b300-247d4737db29"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:54.795065 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3e09adb6-5ebf-49fa-adc6-74cd134dcac4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:54.798535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6b2694b5-48fd-4deb-99e3-71b170cbd9a4 req-ea262a83-586a-4d71-90fa-3d55c56e7e09 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:54.799260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6b2694b5-48fd-4deb-99e3-71b170cbd9a4 req-ea262a83-586a-4d71-90fa-3d55c56e7e09 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:54.812293 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-6b2694b5-48fd-4deb-99e3-71b170cbd9a4 req-ea262a83-586a-4d71-90fa-3d55c56e7e09 service nova] Creating event network-changed:c1c4c318-da17-46d9-b300-247d4737db29 for instance 2bbf13c4-4a58-4656-9223-a60c053d9e44 on n-h1-848886-15 Jul 25 12:39:54.819223 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-6b2694b5-48fd-4deb-99e3-71b170cbd9a4 req-ea262a83-586a-4d71-90fa-3d55c56e7e09 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049451 Jul 25 12:39:54.820229 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 211/461] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:54.823784 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3e09adb6-5ebf-49fa-adc6-74cd134dcac4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1474 microversion: 2.1 time: 0.445137 Jul 25 12:39:54.825722 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 251/462] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:54 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1474 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:54.834694 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-df2b0405-960c-4d33-bd64-905a9bf25503 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:54.834694 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-df2b0405-960c-4d33-bd64-905a9bf25503 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:54.834694 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-df2b0405-960c-4d33-bd64-905a9bf25503 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:54.834694 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-df2b0405-960c-4d33-bd64-905a9bf25503 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:54.835411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-df2b0405-960c-4d33-bd64-905a9bf25503 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:54.836225 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-df2b0405-960c-4d33-bd64-905a9bf25503 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:54.858947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1c4648d5-7408-45b3-b611-99f82c1cd1ec tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:54.859823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1c4648d5-7408-45b3-b611-99f82c1cd1ec tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 2bbf13c4-4a58-4656-9223-a60c053d9e44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:54.868997 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1c4648d5-7408-45b3-b611-99f82c1cd1ec tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:54.869912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1c4648d5-7408-45b3-b611-99f82c1cd1ec tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:54.870966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1c4648d5-7408-45b3-b611-99f82c1cd1ec tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:54.871557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1c4648d5-7408-45b3-b611-99f82c1cd1ec tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:55.062783 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-df2b0405-960c-4d33-bd64-905a9bf25503 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:55.075644 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-df2b0405-960c-4d33-bd64-905a9bf25503 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 200 len: 1503 microversion: 2.1 time: 0.253205 Jul 25 12:39:55.077665 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 212/463] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:54 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 1503 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:55.106866 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1c4648d5-7408-45b3-b611-99f82c1cd1ec tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a553e32dbb4f3d8e362d67bc1ba55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c5541f51c149278aad62c55bb62d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:55.117100 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1c4648d5-7408-45b3-b611-99f82c1cd1ec tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44" status: 200 len: 1320 microversion: 2.1 time: 0.265720 Jul 25 12:39:55.118432 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 252/464] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:54 2022] GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44 => generated 1320 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:55.182710 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-009a066a-475e-4dd1-bdf9-dcb978a5a349 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:55.183312 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-009a066a-475e-4dd1-bdf9-dcb978a5a349 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:55.190279 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-009a066a-475e-4dd1-bdf9-dcb978a5a349 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:55.191187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-009a066a-475e-4dd1-bdf9-dcb978a5a349 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:55.192010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-009a066a-475e-4dd1-bdf9-dcb978a5a349 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:55.192778 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-009a066a-475e-4dd1-bdf9-dcb978a5a349 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:55.603619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-009a066a-475e-4dd1-bdf9-dcb978a5a349 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:55.622755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-009a066a-475e-4dd1-bdf9-dcb978a5a349 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:55.624277 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-009a066a-475e-4dd1-bdf9-dcb978a5a349 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:55.629008 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-009a066a-475e-4dd1-bdf9-dcb978a5a349 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 1361 microversion: 2.25 time: 0.450632 Jul 25 12:39:55.642572 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 213/465] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:55 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 1361 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:55.789024 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-96a8c981-ea23-4a36-8f35-ae94973c37b8 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:55.789653 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-96a8c981-ea23-4a36-8f35-ae94973c37b8 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: 589e9ead-d99c-43de-98e8-da7ed1536b95] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:55.825483 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-96a8c981-ea23-4a36-8f35-ae94973c37b8 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:55.827559 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-96a8c981-ea23-4a36-8f35-ae94973c37b8 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:55.829388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-96a8c981-ea23-4a36-8f35-ae94973c37b8 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:55.831021 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-96a8c981-ea23-4a36-8f35-ae94973c37b8 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:55.859504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4fba7985-ebc8-4269-80d4-8ad82324d37f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:55.860949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4fba7985-ebc8-4269-80d4-8ad82324d37f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:55.881008 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4fba7985-ebc8-4269-80d4-8ad82324d37f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:55.884604 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4fba7985-ebc8-4269-80d4-8ad82324d37f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:55.886301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4fba7985-ebc8-4269-80d4-8ad82324d37f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:55.890069 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4fba7985-ebc8-4269-80d4-8ad82324d37f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:56.317882 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-96a8c981-ea23-4a36-8f35-ae94973c37b8 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:56.333516 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-96a8c981-ea23-4a36-8f35-ae94973c37b8 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95" status: 200 len: 1319 microversion: 2.1 time: 0.547079 Jul 25 12:39:56.349913 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 253/466] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:55 2022] GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95 => generated 1319 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:56.358292 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a1f43a0c-c223-4d0e-8cf8-c220844ae31a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:56.360088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a1f43a0c-c223-4d0e-8cf8-c220844ae31a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:56.369469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a1f43a0c-c223-4d0e-8cf8-c220844ae31a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:56.370617 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a1f43a0c-c223-4d0e-8cf8-c220844ae31a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:56.371692 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a1f43a0c-c223-4d0e-8cf8-c220844ae31a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:56.372443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a1f43a0c-c223-4d0e-8cf8-c220844ae31a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:56.376364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4fba7985-ebc8-4269-80d4-8ad82324d37f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:56.389737 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4fba7985-ebc8-4269-80d4-8ad82324d37f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1474 microversion: 2.1 time: 0.535866 Jul 25 12:39:56.394716 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 214/467] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:55 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1474 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:56.402508 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-037a3315-2fea-4885-8970-8c2292b936e8 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:56.403274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-037a3315-2fea-4885-8970-8c2292b936e8 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 2bbf13c4-4a58-4656-9223-a60c053d9e44] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:56.410471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-037a3315-2fea-4885-8970-8c2292b936e8 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:56.410896 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-037a3315-2fea-4885-8970-8c2292b936e8 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:56.411884 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-037a3315-2fea-4885-8970-8c2292b936e8 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:56.412488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-037a3315-2fea-4885-8970-8c2292b936e8 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:57.010380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a1f43a0c-c223-4d0e-8cf8-c220844ae31a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:57.026738 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a1f43a0c-c223-4d0e-8cf8-c220844ae31a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 200 len: 1503 microversion: 2.1 time: 0.674455 Jul 25 12:39:57.027691 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 254/468] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:56 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 1503 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:57.054094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a9c0b7d9-121f-4965-b9e9-45ba9aa52c47 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:57.054725 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a9c0b7d9-121f-4965-b9e9-45ba9aa52c47 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:57.068889 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9c0b7d9-121f-4965-b9e9-45ba9aa52c47 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:57.070511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9c0b7d9-121f-4965-b9e9-45ba9aa52c47 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:57.073643 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9c0b7d9-121f-4965-b9e9-45ba9aa52c47 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:57.075299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9c0b7d9-121f-4965-b9e9-45ba9aa52c47 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:57.215563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-037a3315-2fea-4885-8970-8c2292b936e8 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a553e32dbb4f3d8e362d67bc1ba55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c5541f51c149278aad62c55bb62d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:57.233402 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-037a3315-2fea-4885-8970-8c2292b936e8 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44" status: 200 len: 1320 microversion: 2.1 time: 0.837483 Jul 25 12:39:57.247435 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 215/469] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:56 2022] GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44 => generated 1320 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:57.355591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8738532f-360f-4440-85b8-f868e110093f tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:57.357250 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8738532f-360f-4440-85b8-f868e110093f tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: 589e9ead-d99c-43de-98e8-da7ed1536b95] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:57.357594 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a9c0b7d9-121f-4965-b9e9-45ba9aa52c47 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:57.363119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:57.367777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8738532f-360f-4440-85b8-f868e110093f tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:57.368723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8738532f-360f-4440-85b8-f868e110093f tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:57.373352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8738532f-360f-4440-85b8-f868e110093f tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:57.374042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8738532f-360f-4440-85b8-f868e110093f tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:57.374715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a9c0b7d9-121f-4965-b9e9-45ba9aa52c47 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:57.399200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a9c0b7d9-121f-4965-b9e9-45ba9aa52c47 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:57.400638 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a9c0b7d9-121f-4965-b9e9-45ba9aa52c47 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 1361 microversion: 2.25 time: 0.358460 Jul 25 12:39:57.401386 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 255/470] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:57 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 1361 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:57.422245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-478942aa-13b1-405b-b35e-f2cc4bb8b591 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:57.423504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-478942aa-13b1-405b-b35e-f2cc4bb8b591 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:57.437938 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-478942aa-13b1-405b-b35e-f2cc4bb8b591 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:57.442527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-478942aa-13b1-405b-b35e-f2cc4bb8b591 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:57.443583 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-478942aa-13b1-405b-b35e-f2cc4bb8b591 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:57.444274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-478942aa-13b1-405b-b35e-f2cc4bb8b591 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:58.291972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8738532f-360f-4440-85b8-f868e110093f tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:58.306054 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8738532f-360f-4440-85b8-f868e110093f tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95" status: 200 len: 1319 microversion: 2.1 time: 0.954217 Jul 25 12:39:58.307472 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 216/471] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:57 2022] GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95 => generated 1319 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:39:58.317684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3b07a161-36ec-475b-8f0d-7977bc58098c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:58.321286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3b07a161-36ec-475b-8f0d-7977bc58098c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:58.334650 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b07a161-36ec-475b-8f0d-7977bc58098c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:58.337083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b07a161-36ec-475b-8f0d-7977bc58098c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:58.340527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b07a161-36ec-475b-8f0d-7977bc58098c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:58.341137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b07a161-36ec-475b-8f0d-7977bc58098c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:58.477723 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-478942aa-13b1-405b-b35e-f2cc4bb8b591 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:58.486437 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-478942aa-13b1-405b-b35e-f2cc4bb8b591 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1472 microversion: 2.1 time: 1.069778 Jul 25 12:39:58.489887 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 256/472] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:57 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1472 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:39:58.506832 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9ebf2f50-0db0-4502-826d-4d560d6b039b tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:58.507533 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9ebf2f50-0db0-4502-826d-4d560d6b039b tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 2bbf13c4-4a58-4656-9223-a60c053d9e44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:58.520485 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ebf2f50-0db0-4502-826d-4d560d6b039b tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:58.521229 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ebf2f50-0db0-4502-826d-4d560d6b039b tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:58.522133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ebf2f50-0db0-4502-826d-4d560d6b039b tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:58.522807 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ebf2f50-0db0-4502-826d-4d560d6b039b tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:59.110859 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:59.130477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3b07a161-36ec-475b-8f0d-7977bc58098c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:59.144837 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3b07a161-36ec-475b-8f0d-7977bc58098c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 200 len: 1503 microversion: 2.1 time: 0.836057 Jul 25 12:39:59.145694 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 217/473] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:58 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 1503 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:59.156374 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-a5924f0f-4484-49ef-84e6-4e9abd55e4a1 req-368236f9-534e-47ec-bca7-b109617451ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a28091-c9d3-44c2-8289-828c66b56c2b", "name": "network-vif-plugged", "status": "completed", "tag": "5abc676c-0f69-43cf-b469-5e02f591bcab"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:59.177308 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9ebf2f50-0db0-4502-826d-4d560d6b039b tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a553e32dbb4f3d8e362d67bc1ba55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c5541f51c149278aad62c55bb62d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:59.184943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a5924f0f-4484-49ef-84e6-4e9abd55e4a1 req-368236f9-534e-47ec-bca7-b109617451ad service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:59.185306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a5924f0f-4484-49ef-84e6-4e9abd55e4a1 req-368236f9-534e-47ec-bca7-b109617451ad service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:59.193779 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9ebf2f50-0db0-4502-826d-4d560d6b039b tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44" status: 200 len: 1320 microversion: 2.1 time: 0.702692 Jul 25 12:39:59.202219 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 257/474] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:58 2022] GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44 => generated 1320 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:59.207285 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b674005d-221a-471c-803e-6dcbdfa9e09a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:59.207894 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b674005d-221a-471c-803e-6dcbdfa9e09a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:59.224288 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-a5924f0f-4484-49ef-84e6-4e9abd55e4a1 req-368236f9-534e-47ec-bca7-b109617451ad service nova] Creating event network-vif-plugged:5abc676c-0f69-43cf-b469-5e02f591bcab for instance 31a28091-c9d3-44c2-8289-828c66b56c2b on n-h1-848886-15 Jul 25 12:39:59.230172 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-a5924f0f-4484-49ef-84e6-4e9abd55e4a1 req-368236f9-534e-47ec-bca7-b109617451ad service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081757 Jul 25 12:39:59.231352 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 218/475] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:59.233522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b674005d-221a-471c-803e-6dcbdfa9e09a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:59.234007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b674005d-221a-471c-803e-6dcbdfa9e09a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:59.234797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b674005d-221a-471c-803e-6dcbdfa9e09a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:59.235223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b674005d-221a-471c-803e-6dcbdfa9e09a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:59.329464 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d8f5e709-00ce-40d2-8f88-17a90dac3775 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:59.330196 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d8f5e709-00ce-40d2-8f88-17a90dac3775 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: 589e9ead-d99c-43de-98e8-da7ed1536b95] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:59.343789 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8f5e709-00ce-40d2-8f88-17a90dac3775 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:59.344156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8f5e709-00ce-40d2-8f88-17a90dac3775 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:59.345000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8f5e709-00ce-40d2-8f88-17a90dac3775 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:59.345432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8f5e709-00ce-40d2-8f88-17a90dac3775 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:00.037626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b674005d-221a-471c-803e-6dcbdfa9e09a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:00.055225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b674005d-221a-471c-803e-6dcbdfa9e09a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:00.058588 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b674005d-221a-471c-803e-6dcbdfa9e09a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:00.060421 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b674005d-221a-471c-803e-6dcbdfa9e09a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 1361 microversion: 2.25 time: 0.857076 Jul 25 12:40:00.076469 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 258/476] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:59 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 1361 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:00.086513 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fb5b279a-e67a-4fe5-93c3-9585f043691f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:00.087409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fb5b279a-e67a-4fe5-93c3-9585f043691f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:00.131213 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb5b279a-e67a-4fe5-93c3-9585f043691f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:00.133342 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb5b279a-e67a-4fe5-93c3-9585f043691f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:00.134906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb5b279a-e67a-4fe5-93c3-9585f043691f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:00.135590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb5b279a-e67a-4fe5-93c3-9585f043691f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:00.193257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d8f5e709-00ce-40d2-8f88-17a90dac3775 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:00.201316 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d8f5e709-00ce-40d2-8f88-17a90dac3775 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95" status: 200 len: 1319 microversion: 2.1 time: 0.876105 Jul 25 12:40:00.211247 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 219/477] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:59 2022] GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95 => generated 1319 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:00.211247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-642e2681-1edc-4062-8324-ee78d28039ef req-3c4d1dc7-817d-4ad9-a292-5ab6c964fe27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daf4e818-31a5-4311-87b2-eb63a90f7bc0", "name": "network-vif-unplugged", "status": "completed", "tag": "64524d32-78e7-4db4-bec6-a6228c8ab21c"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:00.218174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-642e2681-1edc-4062-8324-ee78d28039ef req-3c4d1dc7-817d-4ad9-a292-5ab6c964fe27 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:00.218985 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-642e2681-1edc-4062-8324-ee78d28039ef req-3c4d1dc7-817d-4ad9-a292-5ab6c964fe27 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:00.233059 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-642e2681-1edc-4062-8324-ee78d28039ef req-3c4d1dc7-817d-4ad9-a292-5ab6c964fe27 service nova] Creating event network-vif-unplugged:64524d32-78e7-4db4-bec6-a6228c8ab21c for instance daf4e818-31a5-4311-87b2-eb63a90f7bc0 on n-h1-848886-15 Jul 25 12:40:00.238940 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-642e2681-1edc-4062-8324-ee78d28039ef req-3c4d1dc7-817d-4ad9-a292-5ab6c964fe27 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035352 Jul 25 12:40:00.240402 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 220/478] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:00.246705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-88d44b00-e14b-4c2f-a114-51d5c1da28e7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:00.247708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-88d44b00-e14b-4c2f-a114-51d5c1da28e7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:00.254479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88d44b00-e14b-4c2f-a114-51d5c1da28e7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:00.255423 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88d44b00-e14b-4c2f-a114-51d5c1da28e7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:00.256537 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88d44b00-e14b-4c2f-a114-51d5c1da28e7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:00.257235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88d44b00-e14b-4c2f-a114-51d5c1da28e7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:00.881312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fb5b279a-e67a-4fe5-93c3-9585f043691f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:00.904517 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fb5b279a-e67a-4fe5-93c3-9585f043691f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1469 microversion: 2.1 time: 0.823160 Jul 25 12:40:00.911557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-88d44b00-e14b-4c2f-a114-51d5c1da28e7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:00.919867 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 259/479] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:00 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1469 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:00.925957 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-88d44b00-e14b-4c2f-a114-51d5c1da28e7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 200 len: 1503 microversion: 2.1 time: 0.683373 Jul 25 12:40:00.927193 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 221/480] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:00 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 1503 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:00.930288 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1b7913a1-825a-4a66-b7c1-c729eb6242fa tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:00.931142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1b7913a1-825a-4a66-b7c1-c729eb6242fa tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 2bbf13c4-4a58-4656-9223-a60c053d9e44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:00.944349 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b7913a1-825a-4a66-b7c1-c729eb6242fa tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:00.944992 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b7913a1-825a-4a66-b7c1-c729eb6242fa tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:00.945787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b7913a1-825a-4a66-b7c1-c729eb6242fa tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:00.946264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b7913a1-825a-4a66-b7c1-c729eb6242fa tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:01.105701 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-98a436c2-bb2d-471f-aeb1-b1dfe0693f65 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-990834283", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "3d3f75ac-0896-4f36-8b3a-23fa2957e06c"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:01.210112 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-98a436c2-bb2d-471f-aeb1-b1dfe0693f65 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] validate_networks() for [('3d3f75ac-0896-4f36-8b3a-23fa2957e06c', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:40:01.343683 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1b7913a1-825a-4a66-b7c1-c729eb6242fa tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a553e32dbb4f3d8e362d67bc1ba55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c5541f51c149278aad62c55bb62d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:01.355549 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1b7913a1-825a-4a66-b7c1-c729eb6242fa tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44" status: 200 len: 1320 microversion: 2.1 time: 0.434455 Jul 25 12:40:01.356941 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 260/481] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:00 2022] GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44 => generated 1320 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:01.362652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5cb97d33-586f-4c15-8a22-9e62090a4959 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:01.363419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5cb97d33-586f-4c15-8a22-9e62090a4959 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:01.385631 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cb97d33-586f-4c15-8a22-9e62090a4959 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:01.386328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cb97d33-586f-4c15-8a22-9e62090a4959 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:01.387307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cb97d33-586f-4c15-8a22-9e62090a4959 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:01.387903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cb97d33-586f-4c15-8a22-9e62090a4959 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:01.518342 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5cb97d33-586f-4c15-8a22-9e62090a4959 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "POST /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696/action" status: 204 len: 0 microversion: 2.1 time: 0.159795 Jul 25 12:40:01.522594 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 261/482] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:40:01 2022] POST /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696/action => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:40:01.533753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-de037c38-fe91-4256-a12b-77230e5c005d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:01.534494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-de037c38-fe91-4256-a12b-77230e5c005d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:01.555163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de037c38-fe91-4256-a12b-77230e5c005d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:01.555410 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de037c38-fe91-4256-a12b-77230e5c005d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:01.556145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de037c38-fe91-4256-a12b-77230e5c005d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:01.556579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de037c38-fe91-4256-a12b-77230e5c005d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:02.127883 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-de037c38-fe91-4256-a12b-77230e5c005d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:02.136978 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-de037c38-fe91-4256-a12b-77230e5c005d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:02.139306 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-de037c38-fe91-4256-a12b-77230e5c005d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:02.140716 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-de037c38-fe91-4256-a12b-77230e5c005d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 1556 microversion: 2.25 time: 0.616111 Jul 25 12:40:02.141294 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 262/483] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:01 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 1556 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:02.149488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fdb60f9e-4caf-4d13-8c44-4e7dc0c35d77 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:02.158945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fdb60f9e-4caf-4d13-8c44-4e7dc0c35d77 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: 589e9ead-d99c-43de-98e8-da7ed1536b95] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:02.169412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fdb60f9e-4caf-4d13-8c44-4e7dc0c35d77 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:02.170085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fdb60f9e-4caf-4d13-8c44-4e7dc0c35d77 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:02.174716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fdb60f9e-4caf-4d13-8c44-4e7dc0c35d77 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:02.175539 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fdb60f9e-4caf-4d13-8c44-4e7dc0c35d77 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:02.434000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-98a436c2-bb2d-471f-aeb1-b1dfe0693f65 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:40:02.434520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-98a436c2-bb2d-471f-aeb1-b1dfe0693f65 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:40:02.434897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-98a436c2-bb2d-471f-aeb1-b1dfe0693f65 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:40:02.435320 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-98a436c2-bb2d-471f-aeb1-b1dfe0693f65 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:40:02.435733 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-98a436c2-bb2d-471f-aeb1-b1dfe0693f65 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:40:02.457148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-98a436c2-bb2d-471f-aeb1-b1dfe0693f65 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:02.457888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-98a436c2-bb2d-471f-aeb1-b1dfe0693f65 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:02.458904 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-98a436c2-bb2d-471f-aeb1-b1dfe0693f65 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:02.459634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-98a436c2-bb2d-471f-aeb1-b1dfe0693f65 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:02.486205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-98a436c2-bb2d-471f-aeb1-b1dfe0693f65 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Getting quotas for project 5334f5e32ffb4d49a20d4b7e532cd16e. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:40:02.492144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-98a436c2-bb2d-471f-aeb1-b1dfe0693f65 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Getting quotas for user efe0a455bf5d4a25b517de628c642f68 and project 5334f5e32ffb4d49a20d4b7e532cd16e. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:40:02.513373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-98a436c2-bb2d-471f-aeb1-b1dfe0693f65 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:40:02.516576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-98a436c2-bb2d-471f-aeb1-b1dfe0693f65 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:40:02.582284 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-98a436c2-bb2d-471f-aeb1-b1dfe0693f65 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.653390 Jul 25 12:40:02.588600 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 222/484] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:40:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:40:02.589052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9c5aef1d-44c0-4a2c-89cf-10cc4426e9ee tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:02.589681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9c5aef1d-44c0-4a2c-89cf-10cc4426e9ee tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:02.598570 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9c5aef1d-44c0-4a2c-89cf-10cc4426e9ee tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:02.599054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9c5aef1d-44c0-4a2c-89cf-10cc4426e9ee tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:02.599858 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9c5aef1d-44c0-4a2c-89cf-10cc4426e9ee tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:02.600295 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9c5aef1d-44c0-4a2c-89cf-10cc4426e9ee tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:02.811907 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fdb60f9e-4caf-4d13-8c44-4e7dc0c35d77 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:02.835635 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fdb60f9e-4caf-4d13-8c44-4e7dc0c35d77 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95" status: 200 len: 1319 microversion: 2.1 time: 0.690304 Jul 25 12:40:02.836544 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 263/485] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:02 2022] GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95 => generated 1319 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:02.849872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f8117aef-d5a6-4a3c-a639-293ede9dd986 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:02.850742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f8117aef-d5a6-4a3c-a639-293ede9dd986 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:02.859840 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8117aef-d5a6-4a3c-a639-293ede9dd986 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:02.860522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8117aef-d5a6-4a3c-a639-293ede9dd986 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:02.861551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8117aef-d5a6-4a3c-a639-293ede9dd986 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:02.864091 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8117aef-d5a6-4a3c-a639-293ede9dd986 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:02.952598 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9c5aef1d-44c0-4a2c-89cf-10cc4426e9ee tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:02.957356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:02.966100 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9c5aef1d-44c0-4a2c-89cf-10cc4426e9ee tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1469 microversion: 2.1 time: 0.381605 Jul 25 12:40:02.981863 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 223/486] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:02 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1469 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:02.981863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-998879ea-d5b6-428b-a83a-9ae3aa7f7344 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:02.983657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-998879ea-d5b6-428b-a83a-9ae3aa7f7344 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:02.991966 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-998879ea-d5b6-428b-a83a-9ae3aa7f7344 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:02.991966 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-998879ea-d5b6-428b-a83a-9ae3aa7f7344 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:02.994042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-998879ea-d5b6-428b-a83a-9ae3aa7f7344 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:02.994042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-998879ea-d5b6-428b-a83a-9ae3aa7f7344 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:03.462548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-998879ea-d5b6-428b-a83a-9ae3aa7f7344 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lazy-loading 'services' on Instance uuid 31a28091-c9d3-44c2-8289-828c66b56c2b {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:40:03.492612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f8117aef-d5a6-4a3c-a639-293ede9dd986 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:03.501940 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f8117aef-d5a6-4a3c-a639-293ede9dd986 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 200 len: 1503 microversion: 2.1 time: 0.664244 Jul 25 12:40:03.503159 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 264/487] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:02 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 1503 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:03.510879 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-5cef2d4e-1b13-417f-bed7-df3d122155df req-5edace7b-ed90-438c-9e3c-9ab5632b988b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "589e9ead-d99c-43de-98e8-da7ed1536b95", "name": "network-vif-plugged", "status": "completed", "tag": "c0a35ea1-b5c8-40a8-bb95-4e65c57d81d1"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:03.517709 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-998879ea-d5b6-428b-a83a-9ae3aa7f7344 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 2050 microversion: 2.25 time: 0.547033 Jul 25 12:40:03.521408 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 224/488] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:02 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 2050 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:03.523112 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-5cef2d4e-1b13-417f-bed7-df3d122155df req-5edace7b-ed90-438c-9e3c-9ab5632b988b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:03.523741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-5cef2d4e-1b13-417f-bed7-df3d122155df req-5edace7b-ed90-438c-9e3c-9ab5632b988b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:03.541933 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c7314879-e5fe-4beb-b1a3-3727e178032d tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:03.544540 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c7314879-e5fe-4beb-b1a3-3727e178032d tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 2bbf13c4-4a58-4656-9223-a60c053d9e44] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:03.549309 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-5cef2d4e-1b13-417f-bed7-df3d122155df req-5edace7b-ed90-438c-9e3c-9ab5632b988b service nova] Creating event network-vif-plugged:c0a35ea1-b5c8-40a8-bb95-4e65c57d81d1 for instance 589e9ead-d99c-43de-98e8-da7ed1536b95 on n-h1-848886-15 Jul 25 12:40:03.559048 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7314879-e5fe-4beb-b1a3-3727e178032d tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:03.561427 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-5cef2d4e-1b13-417f-bed7-df3d122155df req-5edace7b-ed90-438c-9e3c-9ab5632b988b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056496 Jul 25 12:40:03.563785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7314879-e5fe-4beb-b1a3-3727e178032d tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:03.564625 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7314879-e5fe-4beb-b1a3-3727e178032d tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:03.565244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7314879-e5fe-4beb-b1a3-3727e178032d tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:03.566256 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 265/489] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:03.579606 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-34cd8bea-b4a2-425d-81a8-7e4a2c4904a6 req-f21a78ad-66f3-4c2b-81c8-c5f3382c6994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daf4e818-31a5-4311-87b2-eb63a90f7bc0", "tag": "64524d32-78e7-4db4-bec6-a6228c8ab21c"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:03.594290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-34cd8bea-b4a2-425d-81a8-7e4a2c4904a6 req-f21a78ad-66f3-4c2b-81c8-c5f3382c6994 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:03.595356 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-34cd8bea-b4a2-425d-81a8-7e4a2c4904a6 req-f21a78ad-66f3-4c2b-81c8-c5f3382c6994 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:03.610951 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-34cd8bea-b4a2-425d-81a8-7e4a2c4904a6 req-f21a78ad-66f3-4c2b-81c8-c5f3382c6994 service nova] Creating event network-changed:64524d32-78e7-4db4-bec6-a6228c8ab21c for instance daf4e818-31a5-4311-87b2-eb63a90f7bc0 on n-h1-848886-15 Jul 25 12:40:03.620463 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-34cd8bea-b4a2-425d-81a8-7e4a2c4904a6 req-f21a78ad-66f3-4c2b-81c8-c5f3382c6994 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051131 Jul 25 12:40:03.621533 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 266/490] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:03.631524 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fda70cd5-a44c-4ecf-b611-6cd82168eb28 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:03.632862 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fda70cd5-a44c-4ecf-b611-6cd82168eb28 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:03.640992 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fda70cd5-a44c-4ecf-b611-6cd82168eb28 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:03.641962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fda70cd5-a44c-4ecf-b611-6cd82168eb28 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:03.642995 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fda70cd5-a44c-4ecf-b611-6cd82168eb28 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:03.644166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fda70cd5-a44c-4ecf-b611-6cd82168eb28 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:04.060963 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fda70cd5-a44c-4ecf-b611-6cd82168eb28 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe0a455bf5d4a25b517de628c642f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334f5e32ffb4d49a20d4b7e532cd16e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:04.075170 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fda70cd5-a44c-4ecf-b611-6cd82168eb28 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972" status: 200 len: 1283 microversion: 2.1 time: 0.450913 Jul 25 12:40:04.078419 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 267/491] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:03 2022] GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972 => generated 1283 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:04.089208 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4de2229d-03ac-44eb-9e9f-5fb9c5a840ca tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:04.090193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4de2229d-03ac-44eb-9e9f-5fb9c5a840ca tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:04.098604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4de2229d-03ac-44eb-9e9f-5fb9c5a840ca tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:04.099281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4de2229d-03ac-44eb-9e9f-5fb9c5a840ca tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:04.100265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4de2229d-03ac-44eb-9e9f-5fb9c5a840ca tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:04.100891 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4de2229d-03ac-44eb-9e9f-5fb9c5a840ca tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:04.298115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c7314879-e5fe-4beb-b1a3-3727e178032d tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a553e32dbb4f3d8e362d67bc1ba55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c5541f51c149278aad62c55bb62d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:04.306664 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c7314879-e5fe-4beb-b1a3-3727e178032d tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44" status: 200 len: 1320 microversion: 2.1 time: 0.768783 Jul 25 12:40:04.307154 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 225/492] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:03 2022] GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44 => generated 1320 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:04.319263 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6e0a38ff-9811-48fb-bd65-641cdf56e502 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:04.323198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6e0a38ff-9811-48fb-bd65-641cdf56e502 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: 589e9ead-d99c-43de-98e8-da7ed1536b95] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:04.330137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e0a38ff-9811-48fb-bd65-641cdf56e502 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:04.330738 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e0a38ff-9811-48fb-bd65-641cdf56e502 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:04.331680 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e0a38ff-9811-48fb-bd65-641cdf56e502 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:04.332257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e0a38ff-9811-48fb-bd65-641cdf56e502 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:04.769296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-4de2229d-03ac-44eb-9e9f-5fb9c5a840ca tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lazy-loading 'services' on Instance uuid 31a28091-c9d3-44c2-8289-828c66b56c2b {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:40:04.823363 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4de2229d-03ac-44eb-9e9f-5fb9c5a840ca tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 2050 microversion: 2.25 time: 0.740881 Jul 25 12:40:04.824283 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 268/493] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:04 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 2050 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:04.835179 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6070c229-d047-4eee-aeaa-3a984fe2b05e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:04.835899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6070c229-d047-4eee-aeaa-3a984fe2b05e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:04.845004 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6070c229-d047-4eee-aeaa-3a984fe2b05e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:04.845487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6070c229-d047-4eee-aeaa-3a984fe2b05e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:04.846728 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6070c229-d047-4eee-aeaa-3a984fe2b05e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:04.847496 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6070c229-d047-4eee-aeaa-3a984fe2b05e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:04.864252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6e0a38ff-9811-48fb-bd65-641cdf56e502 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:04.875542 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6e0a38ff-9811-48fb-bd65-641cdf56e502 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95" status: 200 len: 1319 microversion: 2.1 time: 0.560378 Jul 25 12:40:04.892164 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 226/494] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:04 2022] GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95 => generated 1319 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:04.898275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-684cdc2d-3226-467b-a0f1-acd12ec80b85 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:04.899022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-684cdc2d-3226-467b-a0f1-acd12ec80b85 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:04.908439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-684cdc2d-3226-467b-a0f1-acd12ec80b85 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:04.909163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-684cdc2d-3226-467b-a0f1-acd12ec80b85 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:04.910120 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-684cdc2d-3226-467b-a0f1-acd12ec80b85 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:04.910709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-684cdc2d-3226-467b-a0f1-acd12ec80b85 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:05.285970 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6070c229-d047-4eee-aeaa-3a984fe2b05e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:05.297201 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6070c229-d047-4eee-aeaa-3a984fe2b05e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1469 microversion: 2.1 time: 0.469888 Jul 25 12:40:05.297755 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 269/495] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:04 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1469 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:05.303590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-06e6c66b-d706-439f-a60c-23fcfc14bdb9 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:05.306977 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:40:05.306977 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:40:05.308753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06e6c66b-d706-439f-a60c-23fcfc14bdb9 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:05.309357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06e6c66b-d706-439f-a60c-23fcfc14bdb9 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:05.310461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06e6c66b-d706-439f-a60c-23fcfc14bdb9 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:05.311580 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06e6c66b-d706-439f-a60c-23fcfc14bdb9 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:05.340445 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-684cdc2d-3226-467b-a0f1-acd12ec80b85 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:05.367319 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-684cdc2d-3226-467b-a0f1-acd12ec80b85 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 200 len: 1503 microversion: 2.1 time: 0.473574 Jul 25 12:40:05.381875 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-06e6c66b-d706-439f-a60c-23fcfc14bdb9 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.082583 Jul 25 12:40:05.387199 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 227/496] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:04 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 1503 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:05.398096 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 270/497] 10.222.0.49 () {60 vars in 1217 bytes} [Mon Jul 25 12:40:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:40:05.404087 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-80e1b11b-6905-4f11-847d-8a9137c10d85 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:05.407466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-04d5d5a6-1f9e-4a92-838b-f6c0e1412fdb tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:05.408538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-80e1b11b-6905-4f11-847d-8a9137c10d85 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:05.411010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-04d5d5a6-1f9e-4a92-838b-f6c0e1412fdb tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 2bbf13c4-4a58-4656-9223-a60c053d9e44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:05.424491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-04d5d5a6-1f9e-4a92-838b-f6c0e1412fdb tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:05.424947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-04d5d5a6-1f9e-4a92-838b-f6c0e1412fdb tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:05.425790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-04d5d5a6-1f9e-4a92-838b-f6c0e1412fdb tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:05.426172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-80e1b11b-6905-4f11-847d-8a9137c10d85 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:05.426289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-04d5d5a6-1f9e-4a92-838b-f6c0e1412fdb tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:05.426626 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-80e1b11b-6905-4f11-847d-8a9137c10d85 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:05.429751 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-80e1b11b-6905-4f11-847d-8a9137c10d85 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:05.438243 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-80e1b11b-6905-4f11-847d-8a9137c10d85 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:05.701733 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-80e1b11b-6905-4f11-847d-8a9137c10d85 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe0a455bf5d4a25b517de628c642f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334f5e32ffb4d49a20d4b7e532cd16e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:05.714413 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-80e1b11b-6905-4f11-847d-8a9137c10d85 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972" status: 200 len: 1289 microversion: 2.1 time: 0.325601 Jul 25 12:40:05.731125 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 228/498] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:05 2022] GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972 => generated 1289 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:05.739372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-15d60d87-5650-4934-8c9b-5768fd15970e tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:05.740301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-15d60d87-5650-4934-8c9b-5768fd15970e tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:05.749501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-15d60d87-5650-4934-8c9b-5768fd15970e tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:05.750226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-15d60d87-5650-4934-8c9b-5768fd15970e tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:05.751643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-15d60d87-5650-4934-8c9b-5768fd15970e tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:05.752941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-15d60d87-5650-4934-8c9b-5768fd15970e tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:05.886798 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-15d60d87-5650-4934-8c9b-5768fd15970e tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b/action" status: 202 len: 0 microversion: 2.25 time: 0.153350 Jul 25 12:40:05.890647 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 229/499] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Jul 25 12:40:05 2022] POST /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:40:05.899773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-a215694f-81a1-4a1f-9ead-984bae652aee req-3e48fca6-0107-4f20-a529-75b0d6208a35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73d77295-bfd7-4ff9-b2f9-09d175f81696", "name": "network-vif-plugged", "status": "completed", "tag": "ed3b7b89-f69c-4f30-b4f9-ecff648c112d"}, {"server_uuid": "2bbf13c4-4a58-4656-9223-a60c053d9e44", "name": "network-vif-plugged", "status": "completed", "tag": "c1c4c318-da17-46d9-b300-247d4737db29"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:05.937427 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a215694f-81a1-4a1f-9ead-984bae652aee req-3e48fca6-0107-4f20-a529-75b0d6208a35 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:05.939030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a215694f-81a1-4a1f-9ead-984bae652aee req-3e48fca6-0107-4f20-a529-75b0d6208a35 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:05.977429 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-a215694f-81a1-4a1f-9ead-984bae652aee req-3e48fca6-0107-4f20-a529-75b0d6208a35 service nova] Creating event network-vif-plugged:ed3b7b89-f69c-4f30-b4f9-ecff648c112d for instance 73d77295-bfd7-4ff9-b2f9-09d175f81696 on n-h1-848886-15 Jul 25 12:40:05.981541 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-a215694f-81a1-4a1f-9ead-984bae652aee req-3e48fca6-0107-4f20-a529-75b0d6208a35 service nova] Creating event network-vif-plugged:c1c4c318-da17-46d9-b300-247d4737db29 for instance 2bbf13c4-4a58-4656-9223-a60c053d9e44 on n-h1-848886-15 Jul 25 12:40:05.993253 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-a215694f-81a1-4a1f-9ead-984bae652aee req-3e48fca6-0107-4f20-a529-75b0d6208a35 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.103958 Jul 25 12:40:05.996910 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 230/500] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:06.010142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d754ddee-6bdb-40c5-8c4b-71d8e56333f8 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:06.010850 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d754ddee-6bdb-40c5-8c4b-71d8e56333f8 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:06.031594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d754ddee-6bdb-40c5-8c4b-71d8e56333f8 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:06.032051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d754ddee-6bdb-40c5-8c4b-71d8e56333f8 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:06.032866 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d754ddee-6bdb-40c5-8c4b-71d8e56333f8 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:06.033282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d754ddee-6bdb-40c5-8c4b-71d8e56333f8 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:06.200636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-04d5d5a6-1f9e-4a92-838b-f6c0e1412fdb tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a553e32dbb4f3d8e362d67bc1ba55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c5541f51c149278aad62c55bb62d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:06.209083 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-04d5d5a6-1f9e-4a92-838b-f6c0e1412fdb tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44" status: 200 len: 1320 microversion: 2.1 time: 0.809591 Jul 25 12:40:06.209673 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 271/501] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:05 2022] GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44 => generated 1320 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:06.219315 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d42d9265-fbee-4ee3-af4b-bf701ba04edd tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:06.219932 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d42d9265-fbee-4ee3-af4b-bf701ba04edd tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: 589e9ead-d99c-43de-98e8-da7ed1536b95] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:06.237240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d42d9265-fbee-4ee3-af4b-bf701ba04edd tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:06.237730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d42d9265-fbee-4ee3-af4b-bf701ba04edd tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:06.238535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d42d9265-fbee-4ee3-af4b-bf701ba04edd tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:06.239031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d42d9265-fbee-4ee3-af4b-bf701ba04edd tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:06.557181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d42d9265-fbee-4ee3-af4b-bf701ba04edd tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:06.571606 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d42d9265-fbee-4ee3-af4b-bf701ba04edd tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95" status: 200 len: 1468 microversion: 2.1 time: 0.360695 Jul 25 12:40:06.572550 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 272/502] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:06 2022] GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95 => generated 1468 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:06.582482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-23fdc6d0-f93a-4c7e-ba38-3ba441013b85 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:06.583192 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-23fdc6d0-f93a-4c7e-ba38-3ba441013b85 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:06.595773 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-23fdc6d0-f93a-4c7e-ba38-3ba441013b85 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:06.596223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-23fdc6d0-f93a-4c7e-ba38-3ba441013b85 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:06.601967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-23fdc6d0-f93a-4c7e-ba38-3ba441013b85 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:06.602592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-23fdc6d0-f93a-4c7e-ba38-3ba441013b85 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:06.612509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:06.713138 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-d754ddee-6bdb-40c5-8c4b-71d8e56333f8 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lazy-loading 'services' on Instance uuid 31a28091-c9d3-44c2-8289-828c66b56c2b {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:40:06.742318 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d754ddee-6bdb-40c5-8c4b-71d8e56333f8 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 2055 microversion: 2.25 time: 0.742984 Jul 25 12:40:06.744027 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 231/503] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:05 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 2055 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:06.749370 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f6786861-6022-4108-83fb-ca7b20aec70c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:06.750255 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f6786861-6022-4108-83fb-ca7b20aec70c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:06.774473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f6786861-6022-4108-83fb-ca7b20aec70c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:06.787230 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f6786861-6022-4108-83fb-ca7b20aec70c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:06.788407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f6786861-6022-4108-83fb-ca7b20aec70c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:06.789788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f6786861-6022-4108-83fb-ca7b20aec70c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:07.173881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-23fdc6d0-f93a-4c7e-ba38-3ba441013b85 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:07.184385 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-23fdc6d0-f93a-4c7e-ba38-3ba441013b85 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1461 microversion: 2.1 time: 0.609463 Jul 25 12:40:07.185074 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 273/504] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:06 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1461 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:07.193902 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fb9181e3-555a-4667-8054-bcbac5a246a9 tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:07.198885 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fb9181e3-555a-4667-8054-bcbac5a246a9 tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] [instance: 589e9ead-d99c-43de-98e8-da7ed1536b95] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:07.212295 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb9181e3-555a-4667-8054-bcbac5a246a9 tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:07.222607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb9181e3-555a-4667-8054-bcbac5a246a9 tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:07.228375 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb9181e3-555a-4667-8054-bcbac5a246a9 tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:07.229003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb9181e3-555a-4667-8054-bcbac5a246a9 tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:07.284220 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-fb9181e3-555a-4667-8054-bcbac5a246a9 tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Lazy-loading 'flavor' on Instance uuid 589e9ead-d99c-43de-98e8-da7ed1536b95 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:40:07.295305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f6786861-6022-4108-83fb-ca7b20aec70c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:07.305471 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f6786861-6022-4108-83fb-ca7b20aec70c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 200 len: 1503 microversion: 2.1 time: 0.559191 Jul 25 12:40:07.307180 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 232/505] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:06 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 1503 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:07.347903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b0d6d71a-311a-4a2d-9fda-e2f52a9beacc tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:07.350186 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b0d6d71a-311a-4a2d-9fda-e2f52a9beacc tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:07.384358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0d6d71a-311a-4a2d-9fda-e2f52a9beacc tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:07.384874 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0d6d71a-311a-4a2d-9fda-e2f52a9beacc tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:07.386817 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0d6d71a-311a-4a2d-9fda-e2f52a9beacc tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:07.389267 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0d6d71a-311a-4a2d-9fda-e2f52a9beacc tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:07.451778 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fb9181e3-555a-4667-8054-bcbac5a246a9 tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95/action" status: 202 len: 0 microversion: 2.1 time: 0.264352 Jul 25 12:40:07.454087 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 274/506] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:40:07 2022] POST /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:40:07.462249 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fb257370-2bb3-4861-9730-9ad54dcf027d tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:07.464665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fb257370-2bb3-4861-9730-9ad54dcf027d tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:07.474629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb257370-2bb3-4861-9730-9ad54dcf027d tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:07.475777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb257370-2bb3-4861-9730-9ad54dcf027d tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:07.478547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb257370-2bb3-4861-9730-9ad54dcf027d tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:07.480415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb257370-2bb3-4861-9730-9ad54dcf027d tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:08.216099 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b0d6d71a-311a-4a2d-9fda-e2f52a9beacc tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe0a455bf5d4a25b517de628c642f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334f5e32ffb4d49a20d4b7e532cd16e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:08.228302 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b0d6d71a-311a-4a2d-9fda-e2f52a9beacc tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972" status: 200 len: 1331 microversion: 2.1 time: 0.919459 Jul 25 12:40:08.251534 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 233/507] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:07 2022] GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972 => generated 1331 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:08.256727 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-87cb62cf-eb9d-4b09-bdf4-94adbc7b2bfd tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:08.257467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-87cb62cf-eb9d-4b09-bdf4-94adbc7b2bfd tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 2bbf13c4-4a58-4656-9223-a60c053d9e44] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:08.260900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:08.266785 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fb257370-2bb3-4861-9730-9ad54dcf027d tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1614 microversion: 2.1 time: 0.811136 Jul 25 12:40:08.271759 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 275/508] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:07 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1614 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:08.272470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87cb62cf-eb9d-4b09-bdf4-94adbc7b2bfd tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:08.273014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87cb62cf-eb9d-4b09-bdf4-94adbc7b2bfd tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:08.273914 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87cb62cf-eb9d-4b09-bdf4-94adbc7b2bfd tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:08.274573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87cb62cf-eb9d-4b09-bdf4-94adbc7b2bfd tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:08.280590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6079b775-b5cd-4ba4-8262-3329f43cd59f tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:08.283993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6079b775-b5cd-4ba4-8262-3329f43cd59f tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: 589e9ead-d99c-43de-98e8-da7ed1536b95] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:08.297781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6079b775-b5cd-4ba4-8262-3329f43cd59f tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:08.298517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6079b775-b5cd-4ba4-8262-3329f43cd59f tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:08.301572 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6079b775-b5cd-4ba4-8262-3329f43cd59f tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:08.302621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6079b775-b5cd-4ba4-8262-3329f43cd59f tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:08.716016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-87cb62cf-eb9d-4b09-bdf4-94adbc7b2bfd tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a553e32dbb4f3d8e362d67bc1ba55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c5541f51c149278aad62c55bb62d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:08.731482 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-87cb62cf-eb9d-4b09-bdf4-94adbc7b2bfd tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44" status: 200 len: 1469 microversion: 2.1 time: 0.476445 Jul 25 12:40:08.737137 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 234/509] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:08 2022] GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44 => generated 1469 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:08.739420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-45d5c284-3c65-46b6-81f7-cf0773429deb req-7eb7133f-32ba-4abc-9180-5c37643a9d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daf4e818-31a5-4311-87b2-eb63a90f7bc0", "name": "network-vif-unplugged", "status": "completed", "tag": "64524d32-78e7-4db4-bec6-a6228c8ab21c"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:08.773301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-45d5c284-3c65-46b6-81f7-cf0773429deb req-7eb7133f-32ba-4abc-9180-5c37643a9d20 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:08.786872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-45d5c284-3c65-46b6-81f7-cf0773429deb req-7eb7133f-32ba-4abc-9180-5c37643a9d20 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:08.814145 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-45d5c284-3c65-46b6-81f7-cf0773429deb req-7eb7133f-32ba-4abc-9180-5c37643a9d20 service nova] Creating event network-vif-unplugged:64524d32-78e7-4db4-bec6-a6228c8ab21c for instance daf4e818-31a5-4311-87b2-eb63a90f7bc0 on n-h1-848886-15 Jul 25 12:40:08.822388 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-45d5c284-3c65-46b6-81f7-cf0773429deb req-7eb7133f-32ba-4abc-9180-5c37643a9d20 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086103 Jul 25 12:40:08.823475 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 235/510] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:08.828908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e6ea37c8-7e02-4cf5-8a2a-ec3d38363cdd tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:08.829944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e6ea37c8-7e02-4cf5-8a2a-ec3d38363cdd tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:08.839217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e6ea37c8-7e02-4cf5-8a2a-ec3d38363cdd tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:08.839943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e6ea37c8-7e02-4cf5-8a2a-ec3d38363cdd tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:08.841247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e6ea37c8-7e02-4cf5-8a2a-ec3d38363cdd tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:08.841872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e6ea37c8-7e02-4cf5-8a2a-ec3d38363cdd tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:08.985141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6079b775-b5cd-4ba4-8262-3329f43cd59f tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:08.998429 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6079b775-b5cd-4ba4-8262-3329f43cd59f tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95" status: 200 len: 1459 microversion: 2.1 time: 0.725483 Jul 25 12:40:08.999019 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 276/511] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:08 2022] GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95 => generated 1459 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:09.005177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-58670368-975f-437a-9879-e94c1c207120 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Calling method '.version_select at 0x7efcf9eb8310>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:09.018121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-58670368-975f-437a-9879-e94c1c207120 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:09.019190 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-58670368-975f-437a-9879-e94c1c207120 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:09.037224 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-58670368-975f-437a-9879-e94c1c207120 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 1187 microversion: 2.1 time: 0.037123 Jul 25 12:40:09.037862 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 277/512] 10.222.0.49 () {58 vars in 1143 bytes} [Mon Jul 25 12:40:08 2022] GET /compute/v2.1/os-migrations => generated 1187 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:09.054601 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4417adab-b9c7-427e-8f7d-3b4f2980033a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:09.055500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4417adab-b9c7-427e-8f7d-3b4f2980033a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:09.071837 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4417adab-b9c7-427e-8f7d-3b4f2980033a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:09.074767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4417adab-b9c7-427e-8f7d-3b4f2980033a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:09.075786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4417adab-b9c7-427e-8f7d-3b4f2980033a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:09.078468 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4417adab-b9c7-427e-8f7d-3b4f2980033a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:09.387237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-e6ea37c8-7e02-4cf5-8a2a-ec3d38363cdd tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lazy-loading 'services' on Instance uuid 31a28091-c9d3-44c2-8289-828c66b56c2b {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:40:09.409787 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e6ea37c8-7e02-4cf5-8a2a-ec3d38363cdd tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 2035 microversion: 2.25 time: 0.584737 Jul 25 12:40:09.411023 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 236/513] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:08 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 2035 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:09.419119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fc89ca77-7cc4-44fe-82c1-f18e347f562b tempest-DeleteServersAdminTestJSON-1684326943 tempest-DeleteServersAdminTestJSON-1684326943-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:09.432933 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fc89ca77-7cc4-44fe-82c1-f18e347f562b tempest-DeleteServersAdminTestJSON-1684326943 tempest-DeleteServersAdminTestJSON-1684326943-project-admin] [instance: 2bbf13c4-4a58-4656-9223-a60c053d9e44] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:09.443294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc89ca77-7cc4-44fe-82c1-f18e347f562b tempest-DeleteServersAdminTestJSON-1684326943 tempest-DeleteServersAdminTestJSON-1684326943-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:09.445766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc89ca77-7cc4-44fe-82c1-f18e347f562b tempest-DeleteServersAdminTestJSON-1684326943 tempest-DeleteServersAdminTestJSON-1684326943-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:09.446926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc89ca77-7cc4-44fe-82c1-f18e347f562b tempest-DeleteServersAdminTestJSON-1684326943 tempest-DeleteServersAdminTestJSON-1684326943-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:09.447781 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc89ca77-7cc4-44fe-82c1-f18e347f562b tempest-DeleteServersAdminTestJSON-1684326943 tempest-DeleteServersAdminTestJSON-1684326943-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:09.484137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4417adab-b9c7-427e-8f7d-3b4f2980033a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:09.496065 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4417adab-b9c7-427e-8f7d-3b4f2980033a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 200 len: 1503 microversion: 2.1 time: 0.448970 Jul 25 12:40:09.496752 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 278/514] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:09 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 1503 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:09.522730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2be3feb6-a634-4147-9e2d-6f02d0a5d1e7 tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:09.523509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2be3feb6-a634-4147-9e2d-6f02d0a5d1e7 tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] [instance: 589e9ead-d99c-43de-98e8-da7ed1536b95] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:09.538485 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2be3feb6-a634-4147-9e2d-6f02d0a5d1e7 tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:09.539211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2be3feb6-a634-4147-9e2d-6f02d0a5d1e7 tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:09.540211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2be3feb6-a634-4147-9e2d-6f02d0a5d1e7 tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:09.540801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2be3feb6-a634-4147-9e2d-6f02d0a5d1e7 tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:09.564849 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fc89ca77-7cc4-44fe-82c1-f18e347f562b tempest-DeleteServersAdminTestJSON-1684326943 tempest-DeleteServersAdminTestJSON-1684326943-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44/action" status: 202 len: 0 microversion: 2.1 time: 0.152380 Jul 25 12:40:09.570916 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 237/515] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:40:09 2022] POST /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:40:09.654133 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b0ae7a47-bfa2-47de-8288-d979eb9f05cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-229964008", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "e35876fc-c9c4-48b7-9074-6fd9241d1669"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:09.730675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-b0ae7a47-bfa2-47de-8288-d979eb9f05cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] validate_networks() for [('e35876fc-c9c4-48b7-9074-6fd9241d1669', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:40:10.549619 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2be3feb6-a634-4147-9e2d-6f02d0a5d1e7 tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95" status: 200 len: 1612 microversion: 2.1 time: 1.037080 Jul 25 12:40:10.551713 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 279/516] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:09 2022] GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95 => generated 1612 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:10.558578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aad035d7-eaf7-44da-bd18-f7c3a1bbd0ec tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1014788899", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:10.635709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-aad035d7-eaf7-44da-bd18-f7c3a1bbd0ec tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] validate_networks() for None {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:40:11.152878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-b0ae7a47-bfa2-47de-8288-d979eb9f05cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:40:11.153912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-b0ae7a47-bfa2-47de-8288-d979eb9f05cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:40:11.154564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-b0ae7a47-bfa2-47de-8288-d979eb9f05cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:40:11.154973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-b0ae7a47-bfa2-47de-8288-d979eb9f05cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:40:11.155381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-b0ae7a47-bfa2-47de-8288-d979eb9f05cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:40:11.164900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0ae7a47-bfa2-47de-8288-d979eb9f05cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:11.165357 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0ae7a47-bfa2-47de-8288-d979eb9f05cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:11.166202 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0ae7a47-bfa2-47de-8288-d979eb9f05cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:11.166645 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0ae7a47-bfa2-47de-8288-d979eb9f05cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:11.193227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-b0ae7a47-bfa2-47de-8288-d979eb9f05cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Getting quotas for project 85c0dc3e0d894a5a95b1628cbd20df9f. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:40:11.197606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-b0ae7a47-bfa2-47de-8288-d979eb9f05cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Getting quotas for user 53f799c73ceb4c189329bc86056bc048 and project 85c0dc3e0d894a5a95b1628cbd20df9f. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:40:11.220657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b0ae7a47-bfa2-47de-8288-d979eb9f05cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:40:11.223308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b0ae7a47-bfa2-47de-8288-d979eb9f05cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: 913f3154-bc36-46f9-8dda-b29d58dd7903] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:40:11.281052 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b0ae7a47-bfa2-47de-8288-d979eb9f05cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.708437 Jul 25 12:40:11.282289 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 238/517] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:40:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:40:11.287278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cb70847a-d1da-4526-a095-49e6699ef240 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:11.288212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cb70847a-d1da-4526-a095-49e6699ef240 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:11.295697 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb70847a-d1da-4526-a095-49e6699ef240 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:11.296400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb70847a-d1da-4526-a095-49e6699ef240 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:11.297340 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb70847a-d1da-4526-a095-49e6699ef240 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:11.298106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb70847a-d1da-4526-a095-49e6699ef240 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:11.314759 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:11.438449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-aad035d7-eaf7-44da-bd18-f7c3a1bbd0ec tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:40:11.438871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-aad035d7-eaf7-44da-bd18-f7c3a1bbd0ec tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:40:11.439355 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-aad035d7-eaf7-44da-bd18-f7c3a1bbd0ec tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:40:11.439768 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-aad035d7-eaf7-44da-bd18-f7c3a1bbd0ec tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:40:11.440312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-aad035d7-eaf7-44da-bd18-f7c3a1bbd0ec tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:40:11.459626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aad035d7-eaf7-44da-bd18-f7c3a1bbd0ec tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:11.462965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aad035d7-eaf7-44da-bd18-f7c3a1bbd0ec tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:11.464063 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aad035d7-eaf7-44da-bd18-f7c3a1bbd0ec tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:11.466668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aad035d7-eaf7-44da-bd18-f7c3a1bbd0ec tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:11.494174 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-aad035d7-eaf7-44da-bd18-f7c3a1bbd0ec tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Getting quotas for project 5220cb7ebe7b4a89a8d1edabad2391a7. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:40:11.501767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-aad035d7-eaf7-44da-bd18-f7c3a1bbd0ec tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Getting quotas for user 045d03491c1046609caffee111db48fc and project 5220cb7ebe7b4a89a8d1edabad2391a7. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:40:11.530050 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-aad035d7-eaf7-44da-bd18-f7c3a1bbd0ec tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:40:11.538252 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-aad035d7-eaf7-44da-bd18-f7c3a1bbd0ec tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:40:11.598597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cb70847a-d1da-4526-a095-49e6699ef240 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe0a455bf5d4a25b517de628c642f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334f5e32ffb4d49a20d4b7e532cd16e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:11.610290 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cb70847a-d1da-4526-a095-49e6699ef240 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972" status: 200 len: 1331 microversion: 2.1 time: 0.324838 Jul 25 12:40:11.611460 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 239/518] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:11 2022] GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972 => generated 1331 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:11.618898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1fa87002-b92b-4105-9add-baada5423d54 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-848886-15", "block_migration": "auto"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:11.622345 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1fa87002-b92b-4105-9add-baada5423d54 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:11.632117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1fa87002-b92b-4105-9add-baada5423d54 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:11.632610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1fa87002-b92b-4105-9add-baada5423d54 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:11.633367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1fa87002-b92b-4105-9add-baada5423d54 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:11.633795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1fa87002-b92b-4105-9add-baada5423d54 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:11.654027 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aad035d7-eaf7-44da-bd18-f7c3a1bbd0ec tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.097696 Jul 25 12:40:11.664480 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 280/519] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:40:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:40:11.681531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-811ead46-a44b-438e-97f8-559601c15d40 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:11.682493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-811ead46-a44b-438e-97f8-559601c15d40 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 2bbf13c4-4a58-4656-9223-a60c053d9e44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:11.711444 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-811ead46-a44b-438e-97f8-559601c15d40 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:11.712293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-811ead46-a44b-438e-97f8-559601c15d40 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:11.713343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-811ead46-a44b-438e-97f8-559601c15d40 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:11.715398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-811ead46-a44b-438e-97f8-559601c15d40 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:11.716930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-1fa87002-b92b-4105-9add-baada5423d54 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lazy-loading 'flavor' on Instance uuid 31a28091-c9d3-44c2-8289-828c66b56c2b {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:40:11.775253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1fa87002-b92b-4105-9add-baada5423d54 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Going to try to live migrate instance to n-h2-848886-15 {{(pid=125884) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 12:40:11.817557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-811ead46-a44b-438e-97f8-559601c15d40 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:11.818153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-811ead46-a44b-438e-97f8-559601c15d40 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:11.818616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-811ead46-a44b-438e-97f8-559601c15d40 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lazy-loading 'fault' on Instance uuid 2bbf13c4-4a58-4656-9223-a60c053d9e44 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:40:12.012792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-811ead46-a44b-438e-97f8-559601c15d40 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a553e32dbb4f3d8e362d67bc1ba55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c5541f51c149278aad62c55bb62d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:12.031421 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-811ead46-a44b-438e-97f8-559601c15d40 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44" status: 200 len: 1452 microversion: 2.1 time: 0.357601 Jul 25 12:40:12.042242 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 281/520] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:11 2022] GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44 => generated 1452 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:12.068405 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-8b8bfeac-d632-4a42-ace3-4f2921eb38a6 req-e42b4ad9-91ea-45e1-b7c4-86fc62289b25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79221042-a6d8-42f5-8431-5ecfe1fc1972", "tag": "c946b3f1-88fd-42a0-a6b5-cb0bde2dca0b"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:12.091005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-8b8bfeac-d632-4a42-ace3-4f2921eb38a6 req-e42b4ad9-91ea-45e1-b7c4-86fc62289b25 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:12.093510 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-8b8bfeac-d632-4a42-ace3-4f2921eb38a6 req-e42b4ad9-91ea-45e1-b7c4-86fc62289b25 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:12.110146 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-8b8bfeac-d632-4a42-ace3-4f2921eb38a6 req-e42b4ad9-91ea-45e1-b7c4-86fc62289b25 service nova] Creating event network-changed:c946b3f1-88fd-42a0-a6b5-cb0bde2dca0b for instance 79221042-a6d8-42f5-8431-5ecfe1fc1972 on n-h2-848886-15 Jul 25 12:40:12.115809 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-8b8bfeac-d632-4a42-ace3-4f2921eb38a6 req-e42b4ad9-91ea-45e1-b7c4-86fc62289b25 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071075 Jul 25 12:40:12.132909 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 282/521] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:12.139690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-16f0fd29-d58f-41c2-898a-7f5c169a0827 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:12.140406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-16f0fd29-d58f-41c2-898a-7f5c169a0827 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:12.148465 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16f0fd29-d58f-41c2-898a-7f5c169a0827 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:12.148916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16f0fd29-d58f-41c2-898a-7f5c169a0827 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:12.149693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16f0fd29-d58f-41c2-898a-7f5c169a0827 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:12.150191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16f0fd29-d58f-41c2-898a-7f5c169a0827 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:12.321590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-16f0fd29-d58f-41c2-898a-7f5c169a0827 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:12.332061 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-16f0fd29-d58f-41c2-898a-7f5c169a0827 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 200 len: 1493 microversion: 2.1 time: 0.197800 Jul 25 12:40:12.333535 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 283/522] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:12 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 1493 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:12.346774 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5871c39a-1afe-4ffc-954f-338c0f615dcd tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:12.353439 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:40:12.353439 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:40:12.355930 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5871c39a-1afe-4ffc-954f-338c0f615dcd tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:12.356884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5871c39a-1afe-4ffc-954f-338c0f615dcd tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:12.358112 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5871c39a-1afe-4ffc-954f-338c0f615dcd tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:12.358612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5871c39a-1afe-4ffc-954f-338c0f615dcd tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:12.430791 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5871c39a-1afe-4ffc-954f-338c0f615dcd tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.092313 Jul 25 12:40:12.439395 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 284/523] 10.222.0.49 () {58 vars in 1176 bytes} [Mon Jul 25 12:40:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:12.446545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7d7db891-b1f5-490d-8ea5-c8836860ae5d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:12.448309 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7d7db891-b1f5-490d-8ea5-c8836860ae5d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: 913f3154-bc36-46f9-8dda-b29d58dd7903] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:12.454825 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7d7db891-b1f5-490d-8ea5-c8836860ae5d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:12.455289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7d7db891-b1f5-490d-8ea5-c8836860ae5d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:12.456098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7d7db891-b1f5-490d-8ea5-c8836860ae5d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:12.456537 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7d7db891-b1f5-490d-8ea5-c8836860ae5d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:12.625704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7d7db891-b1f5-490d-8ea5-c8836860ae5d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:12.638134 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7d7db891-b1f5-490d-8ea5-c8836860ae5d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903" status: 200 len: 1203 microversion: 2.1 time: 0.195982 Jul 25 12:40:12.656059 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 285/524] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:12 2022] GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903 => generated 1203 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:12.662656 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8756ea76-5c5b-4aaf-a057-c8745dbfee4c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:12.664410 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8756ea76-5c5b-4aaf-a057-c8745dbfee4c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:12.673002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8756ea76-5c5b-4aaf-a057-c8745dbfee4c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:12.673501 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8756ea76-5c5b-4aaf-a057-c8745dbfee4c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:12.674493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8756ea76-5c5b-4aaf-a057-c8745dbfee4c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:12.677054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8756ea76-5c5b-4aaf-a057-c8745dbfee4c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:12.783305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8756ea76-5c5b-4aaf-a057-c8745dbfee4c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:12.803077 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8756ea76-5c5b-4aaf-a057-c8745dbfee4c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1209 microversion: 2.1 time: 0.144772 Jul 25 12:40:12.805289 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 286/525] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:12 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1209 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:12.811578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4f959fc0-b2ac-42d8-80b3-c52db5534064 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:12.812071 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4f959fc0-b2ac-42d8-80b3-c52db5534064 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 2bbf13c4-4a58-4656-9223-a60c053d9e44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:12.823629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4f959fc0-b2ac-42d8-80b3-c52db5534064 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:12.826805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4f959fc0-b2ac-42d8-80b3-c52db5534064 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:12.827680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4f959fc0-b2ac-42d8-80b3-c52db5534064 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:12.828116 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4f959fc0-b2ac-42d8-80b3-c52db5534064 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:12.865759 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4f959fc0-b2ac-42d8-80b3-c52db5534064 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 2bbf13c4-4a58-4656-9223-a60c053d9e44] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:40:12.960328 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4f959fc0-b2ac-42d8-80b3-c52db5534064 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44" status: 204 len: 0 microversion: 2.1 time: 0.152161 Jul 25 12:40:12.966268 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 287/526] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:40:12 2022] DELETE /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:40:12.975127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-37d43ab6-8b18-41cf-a9da-90e982eb4f8c tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Calling method '.version_select at 0x7efcf9fe3ee0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:12.979490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37d43ab6-8b18-41cf-a9da-90e982eb4f8c tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:12.980586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37d43ab6-8b18-41cf-a9da-90e982eb4f8c tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:12.992653 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-37d43ab6-8b18-41cf-a9da-90e982eb4f8c tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 1526 microversion: 2.1 time: 0.024449 Jul 25 12:40:13.002743 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 288/527] 10.222.0.49 () {58 vars in 1143 bytes} [Mon Jul 25 12:40:12 2022] GET /compute/v2.1/os-migrations => generated 1526 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:13.005915 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0050bdae-8e18-4c0f-9b7f-fb4c13bece1d tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-848886-15", "block_migration": true, "disk_over_commit": false}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:13.013243 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0050bdae-8e18-4c0f-9b7f-fb4c13bece1d tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] [instance: 589e9ead-d99c-43de-98e8-da7ed1536b95] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:13.020215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:13.027876 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0050bdae-8e18-4c0f-9b7f-fb4c13bece1d tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:13.028808 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0050bdae-8e18-4c0f-9b7f-fb4c13bece1d tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:13.034063 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0050bdae-8e18-4c0f-9b7f-fb4c13bece1d tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:13.034873 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0050bdae-8e18-4c0f-9b7f-fb4c13bece1d tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:13.061552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:13.076267 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-0050bdae-8e18-4c0f-9b7f-fb4c13bece1d tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Lazy-loading 'flavor' on Instance uuid 589e9ead-d99c-43de-98e8-da7ed1536b95 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:40:13.090739 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-0050bdae-8e18-4c0f-9b7f-fb4c13bece1d tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 589e9ead-d99c-43de-98e8-da7ed1536b95 while it is in vm_state suspended Jul 25 12:40:13.092580 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0050bdae-8e18-4c0f-9b7f-fb4c13bece1d tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Request method failure captured: Jul 25 12:40:13.092580 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95/action HTTP/1.1 Jul 25 12:40:13.092580 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:40:13.092580 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:40:13.092580 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:40:13.092580 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 98 Jul 25 12:40:13.092580 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:40:13.092580 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:40:13.092580 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:40:13.092580 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:40:13.092580 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o70UJL9C-UkWN4gOJyCc63sQrWbcajMqRYWAXg9igR_O5d9aD6jk8jqnUputTlFKLOK6iTtsKXX4_ZYW_InI-wOSaxDfOpvv2luzyqnv-MhGFl9xwW4Fke92lXc2xyYC4Is5-_MZOkwKAI1p9CxQzNlDUNhcElN1BMOMBSyaSs0xoE Jul 25 12:40:13.092580 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:40:13.092580 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:40:13.092580 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:40:13.092580 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:40:13.092580 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:40:13.092580 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:40:13.092580 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 452c49d630d1484bb6cc1126ff0a5dfc Jul 25 12:40:13.092580 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-LiveMigrationNegativeTest-2144619248 Jul 25 12:40:13.092580 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:40:13.092580 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:40:13.094156 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_452c49d630d1484bb6cc1126ff0a5dfc", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/452c49d630d1484bb6cc1126ff0a5dfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/452c49d630d1484bb6cc1126ff0a5dfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/452c49d630d1484bb6cc1126ff0a5dfc"}]}] Jul 25 12:40:13.094156 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-LiveMigrationNegativeTest-2144619248 Jul 25 12:40:13.094156 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 452c49d630d1484bb6cc1126ff0a5dfc Jul 25 12:40:13.094156 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2144619248 Jul 25 12:40:13.094156 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-LiveMigrationNegativeTest-2144619248-project-admin Jul 25 12:40:13.094156 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:40:13.094156 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:40:13.094156 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: c436a097a80f4eaeb2a034397ab20444 Jul 25 12:40:13.094156 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-LiveMigrationNegativeTest-2144619248-project-admin Jul 25 12:40:13.094156 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:40:13.094156 n-d-848886-15 devstack@n-api.service[125883]: {"os-migrateLive": {"host": "n-h2-848886-15", "block_migration": true, "disk_over_commit": false}} Jul 25 12:40:13.094156 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:40:13.099739 n-d-848886-15 devstack@n-api.service[125883]: exception: Cannot 'os-migrateLive' instance 589e9ead-d99c-43de-98e8-da7ed1536b95 while it is in vm_state suspended Jul 25 12:40:13.099739 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '589e9ead-d99c-43de-98e8-da7ed1536b95', 'body': {'os-migrateLive': {'host': 'n-h2-848886-15', 'block_migration': True, 'disk_over_commit': False}}} Jul 25 12:40:13.099739 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:40:13.099739 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:13.099739 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 25 12:40:13.099739 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 25 12:40:13.099739 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 12:40:13.099739 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 12:40:13.099739 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 12:40:13.099739 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 12:40:13.099739 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 12:40:13.099739 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 12:40:13.099739 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 12:40:13.099739 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 12:40:13.099739 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 25 12:40:13.099739 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 12:40:13.099739 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 25 12:40:13.099739 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 12:40:13.101231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 12:40:13.101231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 12:40:13.101231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 12:40:13.101231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 12:40:13.101231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 589e9ead-d99c-43de-98e8-da7ed1536b95 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 25 12:40:13.101231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:13.101231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:13.101231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:13.101231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:13.101231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:13.101231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:13.101231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:40:13.101231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:40:13.101231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:40:13.101231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:40:13.101231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:40:13.101231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:40:13.101231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:40:13.101231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:40:13.101231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:40:13.102769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:40:13.102769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 12:40:13.102769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 25 12:40:13.102769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 12:40:13.102769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 12:40:13.102769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 12:40:13.102769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 589e9ead-d99c-43de-98e8-da7ed1536b95 while it is in vm_state suspended Jul 25 12:40:13.102769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:13.102769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:13.102769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:13.102769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:13.102769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:13.102769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:13.102769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:40:13.102769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:40:13.102769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 589e9ead-d99c-43de-98e8-da7ed1536b95 while it is in vm_state suspended Jul 25 12:40:13.102769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:13.103913 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0050bdae-8e18-4c0f-9b7f-fb4c13bece1d tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 589e9ead-d99c-43de-98e8-da7ed1536b95 while it is in vm_state suspended {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:40:13.103913 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0050bdae-8e18-4c0f-9b7f-fb4c13bece1d tempest-LiveMigrationNegativeTest-2144619248 tempest-LiveMigrationNegativeTest-2144619248-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95/action" status: 409 len: 155 microversion: 2.1 time: 0.098920 Jul 25 12:40:13.103913 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 289/528] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:40:12 2022] POST /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95/action => generated 155 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:40:13.104144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9245b073-4bc5-4d8f-9550-0c05eb38dd76 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:13.104580 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9245b073-4bc5-4d8f-9550-0c05eb38dd76 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:13.111199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9245b073-4bc5-4d8f-9550-0c05eb38dd76 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:13.111416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9245b073-4bc5-4d8f-9550-0c05eb38dd76 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:13.112127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9245b073-4bc5-4d8f-9550-0c05eb38dd76 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:13.112597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9245b073-4bc5-4d8f-9550-0c05eb38dd76 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:13.261582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9245b073-4bc5-4d8f-9550-0c05eb38dd76 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe0a455bf5d4a25b517de628c642f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334f5e32ffb4d49a20d4b7e532cd16e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:13.269710 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9245b073-4bc5-4d8f-9550-0c05eb38dd76 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972" status: 200 len: 1331 microversion: 2.1 time: 0.173542 Jul 25 12:40:13.270327 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 290/529] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:13 2022] GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972 => generated 1331 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:13.283125 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0f2c27d1-f976-49a4-8b8b-a8e0c9562cb4 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:13.288540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0f2c27d1-f976-49a4-8b8b-a8e0c9562cb4 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 2bbf13c4-4a58-4656-9223-a60c053d9e44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:13.300794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f2c27d1-f976-49a4-8b8b-a8e0c9562cb4 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:13.301373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f2c27d1-f976-49a4-8b8b-a8e0c9562cb4 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:13.302191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f2c27d1-f976-49a4-8b8b-a8e0c9562cb4 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:13.302635 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f2c27d1-f976-49a4-8b8b-a8e0c9562cb4 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:13.382016 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f2c27d1-f976-49a4-8b8b-a8e0c9562cb4 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:13.382922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f2c27d1-f976-49a4-8b8b-a8e0c9562cb4 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:13.382922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-0f2c27d1-f976-49a4-8b8b-a8e0c9562cb4 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lazy-loading 'fault' on Instance uuid 2bbf13c4-4a58-4656-9223-a60c053d9e44 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:40:13.807698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0f2c27d1-f976-49a4-8b8b-a8e0c9562cb4 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a553e32dbb4f3d8e362d67bc1ba55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c5541f51c149278aad62c55bb62d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:13.818097 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0f2c27d1-f976-49a4-8b8b-a8e0c9562cb4 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44" status: 200 len: 1458 microversion: 2.1 time: 0.546339 Jul 25 12:40:13.818834 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 291/530] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:13 2022] GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44 => generated 1458 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:13.838317 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-181c9322-8b58-4b06-b6f9-4986a36167a3 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:13.839192 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-181c9322-8b58-4b06-b6f9-4986a36167a3 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:13.846297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-181c9322-8b58-4b06-b6f9-4986a36167a3 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:13.847054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-181c9322-8b58-4b06-b6f9-4986a36167a3 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:13.847972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-181c9322-8b58-4b06-b6f9-4986a36167a3 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:13.848569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-181c9322-8b58-4b06-b6f9-4986a36167a3 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:14.075732 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-181c9322-8b58-4b06-b6f9-4986a36167a3 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 200 len: 1646 microversion: 2.1 time: 0.241834 Jul 25 12:40:14.090093 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 292/531] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:13 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 1646 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:14.105765 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ed4ce52c-e00a-4377-a772-8637e103843b tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:14.106413 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ed4ce52c-e00a-4377-a772-8637e103843b tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: 589e9ead-d99c-43de-98e8-da7ed1536b95] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:14.113816 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ed4ce52c-e00a-4377-a772-8637e103843b tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:14.114905 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ed4ce52c-e00a-4377-a772-8637e103843b tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:14.115967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ed4ce52c-e00a-4377-a772-8637e103843b tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:14.116775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ed4ce52c-e00a-4377-a772-8637e103843b tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:14.154350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ed4ce52c-e00a-4377-a772-8637e103843b tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: 589e9ead-d99c-43de-98e8-da7ed1536b95] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:40:14.280604 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ed4ce52c-e00a-4377-a772-8637e103843b tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "DELETE /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95" status: 204 len: 0 microversion: 2.1 time: 0.188820 Jul 25 12:40:14.281738 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 293/532] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:40:14 2022] DELETE /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:40:14.298373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-478a80f8-bd18-419e-a33c-dba15bf7826c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:14.299204 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-478a80f8-bd18-419e-a33c-dba15bf7826c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: 913f3154-bc36-46f9-8dda-b29d58dd7903] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:14.322993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-478a80f8-bd18-419e-a33c-dba15bf7826c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:14.323211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-478a80f8-bd18-419e-a33c-dba15bf7826c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:14.323960 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-478a80f8-bd18-419e-a33c-dba15bf7826c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:14.324391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-478a80f8-bd18-419e-a33c-dba15bf7826c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:14.683210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-478a80f8-bd18-419e-a33c-dba15bf7826c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:14.691713 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-478a80f8-bd18-419e-a33c-dba15bf7826c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903" status: 200 len: 1307 microversion: 2.1 time: 0.408525 Jul 25 12:40:14.697197 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 294/533] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:14 2022] GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903 => generated 1307 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:14.702288 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-da1137aa-9a26-4d66-9d5e-0aa610d2fcc5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:14.709089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-da1137aa-9a26-4d66-9d5e-0aa610d2fcc5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:14.725133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da1137aa-9a26-4d66-9d5e-0aa610d2fcc5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:14.725589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da1137aa-9a26-4d66-9d5e-0aa610d2fcc5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:14.726594 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da1137aa-9a26-4d66-9d5e-0aa610d2fcc5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:14.727047 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da1137aa-9a26-4d66-9d5e-0aa610d2fcc5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:14.972111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-da1137aa-9a26-4d66-9d5e-0aa610d2fcc5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:14.990507 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-da1137aa-9a26-4d66-9d5e-0aa610d2fcc5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1313 microversion: 2.1 time: 0.292021 Jul 25 12:40:14.991315 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 295/534] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:14 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:14.997647 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c8121233-7d0c-4422-b778-20e899f8c325 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1048474612", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "2f06aa7d-4566-4383-a6d0-5dee93546175"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:15.074230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-c8121233-7d0c-4422-b778-20e899f8c325 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] validate_networks() for [('2f06aa7d-4566-4383-a6d0-5dee93546175', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:40:15.975497 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c8121233-7d0c-4422-b778-20e899f8c325 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:40:15.976582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c8121233-7d0c-4422-b778-20e899f8c325 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:40:15.977302 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c8121233-7d0c-4422-b778-20e899f8c325 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:40:15.977889 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c8121233-7d0c-4422-b778-20e899f8c325 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:40:15.978460 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c8121233-7d0c-4422-b778-20e899f8c325 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:40:15.988516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8121233-7d0c-4422-b778-20e899f8c325 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:15.989653 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8121233-7d0c-4422-b778-20e899f8c325 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:15.990657 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8121233-7d0c-4422-b778-20e899f8c325 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:15.991272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8121233-7d0c-4422-b778-20e899f8c325 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:16.016991 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-c8121233-7d0c-4422-b778-20e899f8c325 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Getting quotas for project 4946a18b68e146278158ac991143a243. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:40:16.021689 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-c8121233-7d0c-4422-b778-20e899f8c325 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Getting quotas for user a02530d4c6384518b3f45515208e83d8 and project 4946a18b68e146278158ac991143a243. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:40:16.035679 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c8121233-7d0c-4422-b778-20e899f8c325 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:40:16.038336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c8121233-7d0c-4422-b778-20e899f8c325 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 742583f4-0949-418b-a666-dc715ab936d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:40:16.089284 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c8121233-7d0c-4422-b778-20e899f8c325 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.096752 Jul 25 12:40:16.090355 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 296/535] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:40:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:40:16.095058 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-457434d3-238b-47d3-90ad-a21916f54925 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:16.096214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-457434d3-238b-47d3-90ad-a21916f54925 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: 589e9ead-d99c-43de-98e8-da7ed1536b95] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:16.103471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-457434d3-238b-47d3-90ad-a21916f54925 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:16.104206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-457434d3-238b-47d3-90ad-a21916f54925 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:16.105162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-457434d3-238b-47d3-90ad-a21916f54925 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:16.105745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-457434d3-238b-47d3-90ad-a21916f54925 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:16.912522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-457434d3-238b-47d3-90ad-a21916f54925 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:16.922077 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-457434d3-238b-47d3-90ad-a21916f54925 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95" status: 200 len: 1465 microversion: 2.1 time: 0.830433 Jul 25 12:40:16.935814 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 297/536] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:16 2022] GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95 => generated 1465 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:16.941400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c0981932-b888-40be-970b-9ab211e361af tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:16.942276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c0981932-b888-40be-970b-9ab211e361af tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:16.950411 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0981932-b888-40be-970b-9ab211e361af tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:16.951272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0981932-b888-40be-970b-9ab211e361af tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:16.952215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0981932-b888-40be-970b-9ab211e361af tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:16.952802 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0981932-b888-40be-970b-9ab211e361af tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:16.993392 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1fa87002-b92b-4105-9add-baada5423d54 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b/action" status: 202 len: 0 microversion: 2.25 time: 5.380557 Jul 25 12:40:16.994251 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 240/537] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Jul 25 12:40:11 2022] POST /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b/action => generated 0 bytes in 5382 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:40:17.004109 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-38949432-ff2b-4144-a638-fa38ee771717 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:17.004685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-38949432-ff2b-4144-a638-fa38ee771717 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 2bbf13c4-4a58-4656-9223-a60c053d9e44] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:17.016521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38949432-ff2b-4144-a638-fa38ee771717 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:17.018813 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38949432-ff2b-4144-a638-fa38ee771717 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:17.019707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38949432-ff2b-4144-a638-fa38ee771717 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:17.020110 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38949432-ff2b-4144-a638-fa38ee771717 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:17.036503 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-38949432-ff2b-4144-a638-fa38ee771717 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] HTTP exception thrown: Instance 2bbf13c4-4a58-4656-9223-a60c053d9e44 could not be found. Jul 25 12:40:17.038170 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-38949432-ff2b-4144-a638-fa38ee771717 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Request method failure captured: Jul 25 12:40:17.038170 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44 HTTP/1.1 Jul 25 12:40:17.038170 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:40:17.038170 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:40:17.038170 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:40:17.038170 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:40:17.038170 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:40:17.038170 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:40:17.038170 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:40:17.038170 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:40:17.038170 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o7w08v32_Vz2hupbkhzEg97Arxgd21UGdQdTxd2XVtAmk2VjyFvUplXRnBBwWwhyorLRX8Bo0OcyBTc6gIcDu5Hc3hReBGm9ut7aP3Q3Se5p6EC6unspmbgoQHnRM-JxBDXa_tDanSc-EzrkSNn721EBN2my-QUMSWQgg6gp3OAcNM Jul 25 12:40:17.038170 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:40:17.038170 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:40:17.038170 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:40:17.038170 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:40:17.038170 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:40:17.038170 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:40:17.038170 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 78c5541f51c149278aad62c55bb62d8f Jul 25 12:40:17.038170 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1016230751 Jul 25 12:40:17.038170 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:40:17.038170 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:40:17.039709 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_78c5541f51c149278aad62c55bb62d8f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/78c5541f51c149278aad62c55bb62d8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/78c5541f51c149278aad62c55bb62d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/78c5541f51c149278aad62c55bb62d8f"}]}] Jul 25 12:40:17.039709 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-DeleteServersAdminTestJSON-1016230751 Jul 25 12:40:17.039709 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 78c5541f51c149278aad62c55bb62d8f Jul 25 12:40:17.039709 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1016230751 Jul 25 12:40:17.039709 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-DeleteServersAdminTestJSON-1016230751-project Jul 25 12:40:17.039709 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:40:17.039709 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:40:17.039709 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 78a553e32dbb4f3d8e362d67bc1ba55f Jul 25 12:40:17.039709 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-DeleteServersAdminTestJSON-1016230751-project Jul 25 12:40:17.039709 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:40:17.039709 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 2bbf13c4-4a58-4656-9223-a60c053d9e44 could not be found. Jul 25 12:40:17.039709 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '2bbf13c4-4a58-4656-9223-a60c053d9e44'} Jul 25 12:40:17.040475 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:40:17.040475 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:17.040475 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:40:17.040475 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:40:17.040475 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:40:17.040475 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:40:17.040475 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:40:17.040475 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:40:17.040475 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:40:17.040475 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:40:17.040475 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bbf13c4-4a58-4656-9223-a60c053d9e44 could not be found. Jul 25 12:40:17.040475 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:17.040475 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:17.040475 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:17.040475 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:17.040475 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:17.040475 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:17.040475 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:40:17.040475 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:40:17.040475 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:40:17.041715 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:40:17.041715 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:40:17.041715 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:40:17.041715 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:40:17.041715 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:40:17.041715 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:40:17.041715 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:40:17.041715 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bbf13c4-4a58-4656-9223-a60c053d9e44 could not be found. Jul 25 12:40:17.041715 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:17.041715 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:17.041715 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:17.041715 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:17.041715 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:17.041715 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:17.041715 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:40:17.041715 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:40:17.041715 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bbf13c4-4a58-4656-9223-a60c053d9e44 could not be found. Jul 25 12:40:17.041715 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:17.042829 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-38949432-ff2b-4144-a638-fa38ee771717 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Returning 404 to user: Instance 2bbf13c4-4a58-4656-9223-a60c053d9e44 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:40:17.042829 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-38949432-ff2b-4144-a638-fa38ee771717 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44" status: 404 len: 111 microversion: 2.1 time: 0.040705 Jul 25 12:40:17.042829 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 241/538] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:16 2022] GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:40:17.044995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-805155e6-5e87-4c49-a5c9-dc30b15d2aa9 req-5dea6c43-73e4-4eb2-aa5f-2260e0f59a9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed7807bb-d3da-4dc2-baf9-e547d671f324", "tag": "6ef3a05b-5303-4d72-9ec0-6eeee9be1d2a"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:17.055253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-805155e6-5e87-4c49-a5c9-dc30b15d2aa9 req-5dea6c43-73e4-4eb2-aa5f-2260e0f59a9b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:17.055684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-805155e6-5e87-4c49-a5c9-dc30b15d2aa9 req-5dea6c43-73e4-4eb2-aa5f-2260e0f59a9b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:17.068358 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-805155e6-5e87-4c49-a5c9-dc30b15d2aa9 req-5dea6c43-73e4-4eb2-aa5f-2260e0f59a9b service nova] Creating event network-changed:6ef3a05b-5303-4d72-9ec0-6eeee9be1d2a for instance ed7807bb-d3da-4dc2-baf9-e547d671f324 on n-h2-848886-15 Jul 25 12:40:17.075348 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-805155e6-5e87-4c49-a5c9-dc30b15d2aa9 req-5dea6c43-73e4-4eb2-aa5f-2260e0f59a9b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033620 Jul 25 12:40:17.076156 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 242/539] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:17.082110 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aa5a96e9-04fa-4cbe-a3be-a4327a21e257 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:17.082913 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-aa5a96e9-04fa-4cbe-a3be-a4327a21e257 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: 913f3154-bc36-46f9-8dda-b29d58dd7903] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:17.090291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa5a96e9-04fa-4cbe-a3be-a4327a21e257 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:17.091231 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa5a96e9-04fa-4cbe-a3be-a4327a21e257 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:17.092045 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa5a96e9-04fa-4cbe-a3be-a4327a21e257 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:17.092479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa5a96e9-04fa-4cbe-a3be-a4327a21e257 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:17.369276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c0981932-b888-40be-970b-9ab211e361af tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe0a455bf5d4a25b517de628c642f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334f5e32ffb4d49a20d4b7e532cd16e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:17.378811 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c0981932-b888-40be-970b-9ab211e361af tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972" status: 200 len: 1331 microversion: 2.1 time: 0.441397 Jul 25 12:40:17.379565 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 298/540] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:16 2022] GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972 => generated 1331 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:17.391791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3b7c38f2-303d-44b7-9399-58206a125a52 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:17.393344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3b7c38f2-303d-44b7-9399-58206a125a52 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:17.411085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b7c38f2-303d-44b7-9399-58206a125a52 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:17.411761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b7c38f2-303d-44b7-9399-58206a125a52 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:17.412714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b7c38f2-303d-44b7-9399-58206a125a52 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:17.413158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b7c38f2-303d-44b7-9399-58206a125a52 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:17.638404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-aa5a96e9-04fa-4cbe-a3be-a4327a21e257 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:17.662360 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-aa5a96e9-04fa-4cbe-a3be-a4327a21e257 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903" status: 200 len: 1307 microversion: 2.1 time: 0.584781 Jul 25 12:40:17.664533 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 243/541] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:17 2022] GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903 => generated 1307 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:17.672258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-08d3c297-bbca-4445-acc5-c71108d2fb1a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:17.673006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-08d3c297-bbca-4445-acc5-c71108d2fb1a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:17.680245 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-08d3c297-bbca-4445-acc5-c71108d2fb1a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:17.684015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-08d3c297-bbca-4445-acc5-c71108d2fb1a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:17.685208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-08d3c297-bbca-4445-acc5-c71108d2fb1a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:17.685873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-08d3c297-bbca-4445-acc5-c71108d2fb1a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:17.849686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-08d3c297-bbca-4445-acc5-c71108d2fb1a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:17.862243 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-08d3c297-bbca-4445-acc5-c71108d2fb1a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 200 len: 1281 microversion: 2.1 time: 0.196449 Jul 25 12:40:17.863102 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 244/542] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:17 2022] GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 1281 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:17.868591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-9f9d65b8-710d-4b01-a885-28bf77d023b1 req-7a240e9a-b91e-49ad-883c-825c059f61db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "913f3154-bc36-46f9-8dda-b29d58dd7903", "tag": "20e3356f-efe0-42e1-8e21-b04bba18de4c"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:17.880247 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3b7c38f2-303d-44b7-9399-58206a125a52 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:17.888573 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3b7c38f2-303d-44b7-9399-58206a125a52 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1313 microversion: 2.1 time: 0.507088 Jul 25 12:40:17.889238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9f9d65b8-710d-4b01-a885-28bf77d023b1 req-7a240e9a-b91e-49ad-883c-825c059f61db service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:17.889949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9f9d65b8-710d-4b01-a885-28bf77d023b1 req-7a240e9a-b91e-49ad-883c-825c059f61db service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:17.893011 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 299/543] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:17 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1313 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:17.900288 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-c3292a85-902f-4ec2-bf12-56dade72df58 req-71a3e728-6813-41f1-9792-583e1a12aed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79221042-a6d8-42f5-8431-5ecfe1fc1972", "name": "network-vif-plugged", "status": "completed", "tag": "c946b3f1-88fd-42a0-a6b5-cb0bde2dca0b"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:17.913531 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-9f9d65b8-710d-4b01-a885-28bf77d023b1 req-7a240e9a-b91e-49ad-883c-825c059f61db service nova] Creating event network-changed:20e3356f-efe0-42e1-8e21-b04bba18de4c for instance 913f3154-bc36-46f9-8dda-b29d58dd7903 on n-h2-848886-15 Jul 25 12:40:17.916633 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c3292a85-902f-4ec2-bf12-56dade72df58 req-71a3e728-6813-41f1-9792-583e1a12aed7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:17.917284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c3292a85-902f-4ec2-bf12-56dade72df58 req-71a3e728-6813-41f1-9792-583e1a12aed7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:17.920883 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-9f9d65b8-710d-4b01-a885-28bf77d023b1 req-7a240e9a-b91e-49ad-883c-825c059f61db service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056383 Jul 25 12:40:17.921553 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 245/544] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:17.928287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8f959141-818f-453b-beff-7865b4f08d3f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:17.929211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8f959141-818f-453b-beff-7865b4f08d3f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:17.929441 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-c3292a85-902f-4ec2-bf12-56dade72df58 req-71a3e728-6813-41f1-9792-583e1a12aed7 service nova] Creating event network-vif-plugged:c946b3f1-88fd-42a0-a6b5-cb0bde2dca0b for instance 79221042-a6d8-42f5-8431-5ecfe1fc1972 on n-h2-848886-15 Jul 25 12:40:17.938288 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-c3292a85-902f-4ec2-bf12-56dade72df58 req-71a3e728-6813-41f1-9792-583e1a12aed7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041446 Jul 25 12:40:17.939076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8f959141-818f-453b-beff-7865b4f08d3f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:17.939800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8f959141-818f-453b-beff-7865b4f08d3f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:17.940750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8f959141-818f-453b-beff-7865b4f08d3f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:17.941579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8f959141-818f-453b-beff-7865b4f08d3f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:17.942313 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 300/545] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:17.947555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e8842987-6eb8-4495-8c8a-a63f5657314a tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:17.948320 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e8842987-6eb8-4495-8c8a-a63f5657314a tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 2bbf13c4-4a58-4656-9223-a60c053d9e44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:17.955059 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e8842987-6eb8-4495-8c8a-a63f5657314a tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:17.955770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e8842987-6eb8-4495-8c8a-a63f5657314a tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:17.956776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e8842987-6eb8-4495-8c8a-a63f5657314a tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:17.957391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e8842987-6eb8-4495-8c8a-a63f5657314a tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:17.972081 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-e8842987-6eb8-4495-8c8a-a63f5657314a tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] HTTP exception thrown: Instance 2bbf13c4-4a58-4656-9223-a60c053d9e44 could not be found. Jul 25 12:40:17.974131 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e8842987-6eb8-4495-8c8a-a63f5657314a tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Request method failure captured: Jul 25 12:40:17.974131 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44 HTTP/1.1 Jul 25 12:40:17.974131 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:40:17.974131 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:40:17.974131 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:40:17.974131 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:40:17.974131 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:40:17.974131 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:40:17.974131 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:40:17.974131 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:40:17.974131 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7w08v32_Vz2hupbkhzEg97Arxgd21UGdQdTxd2XVtAmk2VjyFvUplXRnBBwWwhyorLRX8Bo0OcyBTc6gIcDu5Hc3hReBGm9ut7aP3Q3Se5p6EC6unspmbgoQHnRM-JxBDXa_tDanSc-EzrkSNn721EBN2my-QUMSWQgg6gp3OAcNM Jul 25 12:40:17.974131 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:40:17.974131 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:40:17.974131 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:40:17.974131 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:40:17.974131 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:40:17.974131 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:40:17.974131 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 78c5541f51c149278aad62c55bb62d8f Jul 25 12:40:17.974131 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1016230751 Jul 25 12:40:17.974131 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:40:17.974131 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:40:17.975525 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_78c5541f51c149278aad62c55bb62d8f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/78c5541f51c149278aad62c55bb62d8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/78c5541f51c149278aad62c55bb62d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/78c5541f51c149278aad62c55bb62d8f"}]}] Jul 25 12:40:17.975525 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-DeleteServersAdminTestJSON-1016230751 Jul 25 12:40:17.975525 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 78c5541f51c149278aad62c55bb62d8f Jul 25 12:40:17.975525 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1016230751 Jul 25 12:40:17.975525 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-DeleteServersAdminTestJSON-1016230751-project Jul 25 12:40:17.975525 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:40:17.975525 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:40:17.975525 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 78a553e32dbb4f3d8e362d67bc1ba55f Jul 25 12:40:17.975525 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-DeleteServersAdminTestJSON-1016230751-project Jul 25 12:40:17.975525 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:40:17.975525 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 2bbf13c4-4a58-4656-9223-a60c053d9e44 could not be found. Jul 25 12:40:17.975525 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '2bbf13c4-4a58-4656-9223-a60c053d9e44'} Jul 25 12:40:17.976374 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:40:17.976374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:17.976374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:40:17.976374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:40:17.976374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:40:17.976374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:40:17.976374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:40:17.976374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:40:17.976374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:40:17.976374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:40:17.976374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bbf13c4-4a58-4656-9223-a60c053d9e44 could not be found. Jul 25 12:40:17.976374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:17.976374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:17.976374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:17.976374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:17.976374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:17.976374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:17.976374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:40:17.976374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:40:17.976374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:40:17.977782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:40:17.977782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:40:17.977782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:40:17.977782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:40:17.977782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:40:17.977782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:40:17.977782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:40:17.977782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:40:17.977782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:40:17.977782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bbf13c4-4a58-4656-9223-a60c053d9e44 could not be found. Jul 25 12:40:17.977782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:17.977782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:17.977782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:17.977782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:17.977782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:17.977782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:17.977782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:40:17.977782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:40:17.977782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bbf13c4-4a58-4656-9223-a60c053d9e44 could not be found. Jul 25 12:40:17.977782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:17.979947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e8842987-6eb8-4495-8c8a-a63f5657314a tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Returning 404 to user: Instance 2bbf13c4-4a58-4656-9223-a60c053d9e44 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:40:17.980966 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e8842987-6eb8-4495-8c8a-a63f5657314a tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44" status: 404 len: 111 microversion: 2.1 time: 0.037531 Jul 25 12:40:17.981682 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 301/546] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:40:17 2022] DELETE /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:40:17.990058 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-02361e8e-2125-491b-84eb-8b3655dae080 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:17.990929 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-02361e8e-2125-491b-84eb-8b3655dae080 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: 589e9ead-d99c-43de-98e8-da7ed1536b95] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:17.997906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02361e8e-2125-491b-84eb-8b3655dae080 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:17.998581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02361e8e-2125-491b-84eb-8b3655dae080 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:17.999510 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02361e8e-2125-491b-84eb-8b3655dae080 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.000090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02361e8e-2125-491b-84eb-8b3655dae080 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:18.035772 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02361e8e-2125-491b-84eb-8b3655dae080 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.036285 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02361e8e-2125-491b-84eb-8b3655dae080 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:18.036952 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-02361e8e-2125-491b-84eb-8b3655dae080 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lazy-loading 'fault' on Instance uuid 589e9ead-d99c-43de-98e8-da7ed1536b95 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:40:18.146735 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-02361e8e-2125-491b-84eb-8b3655dae080 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:18.156101 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-02361e8e-2125-491b-84eb-8b3655dae080 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95" status: 200 len: 1309 microversion: 2.1 time: 0.170272 Jul 25 12:40:18.157248 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 302/547] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:17 2022] GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95 => generated 1309 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:18.162145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-89a5dcb5-b15a-4ddf-b402-c1bd8e12ea53 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:18.162903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-89a5dcb5-b15a-4ddf-b402-c1bd8e12ea53 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 2bbf13c4-4a58-4656-9223-a60c053d9e44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:18.169675 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89a5dcb5-b15a-4ddf-b402-c1bd8e12ea53 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.173525 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89a5dcb5-b15a-4ddf-b402-c1bd8e12ea53 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:18.176792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89a5dcb5-b15a-4ddf-b402-c1bd8e12ea53 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.178412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89a5dcb5-b15a-4ddf-b402-c1bd8e12ea53 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:18.204094 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-89a5dcb5-b15a-4ddf-b402-c1bd8e12ea53 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] HTTP exception thrown: Instance 2bbf13c4-4a58-4656-9223-a60c053d9e44 could not be found. Jul 25 12:40:18.207890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-89a5dcb5-b15a-4ddf-b402-c1bd8e12ea53 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Request method failure captured: Jul 25 12:40:18.207890 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44 HTTP/1.1 Jul 25 12:40:18.207890 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:40:18.207890 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:40:18.207890 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:40:18.207890 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:40:18.207890 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:40:18.207890 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:40:18.207890 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:40:18.207890 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:40:18.207890 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7w08v32_Vz2hupbkhzEg97Arxgd21UGdQdTxd2XVtAmk2VjyFvUplXRnBBwWwhyorLRX8Bo0OcyBTc6gIcDu5Hc3hReBGm9ut7aP3Q3Se5p6EC6unspmbgoQHnRM-JxBDXa_tDanSc-EzrkSNn721EBN2my-QUMSWQgg6gp3OAcNM Jul 25 12:40:18.207890 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:40:18.207890 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:40:18.207890 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:40:18.207890 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:40:18.207890 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:40:18.207890 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:40:18.207890 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 78c5541f51c149278aad62c55bb62d8f Jul 25 12:40:18.207890 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1016230751 Jul 25 12:40:18.207890 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:40:18.207890 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:40:18.209337 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_78c5541f51c149278aad62c55bb62d8f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/78c5541f51c149278aad62c55bb62d8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/78c5541f51c149278aad62c55bb62d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/78c5541f51c149278aad62c55bb62d8f"}]}] Jul 25 12:40:18.209337 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-DeleteServersAdminTestJSON-1016230751 Jul 25 12:40:18.209337 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 78c5541f51c149278aad62c55bb62d8f Jul 25 12:40:18.209337 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1016230751 Jul 25 12:40:18.209337 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-DeleteServersAdminTestJSON-1016230751-project Jul 25 12:40:18.209337 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:40:18.209337 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:40:18.209337 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 78a553e32dbb4f3d8e362d67bc1ba55f Jul 25 12:40:18.209337 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-DeleteServersAdminTestJSON-1016230751-project Jul 25 12:40:18.209337 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:40:18.209337 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 2bbf13c4-4a58-4656-9223-a60c053d9e44 could not be found. Jul 25 12:40:18.209337 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '2bbf13c4-4a58-4656-9223-a60c053d9e44'} Jul 25 12:40:18.210219 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:40:18.210219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:18.210219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:40:18.210219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:40:18.210219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:40:18.210219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:40:18.210219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:40:18.210219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:40:18.210219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:40:18.210219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:40:18.210219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bbf13c4-4a58-4656-9223-a60c053d9e44 could not be found. Jul 25 12:40:18.210219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:18.210219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:18.210219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:18.210219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:18.210219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:18.210219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:18.210219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:40:18.210219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:40:18.210219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:40:18.212725 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:40:18.212725 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:40:18.212725 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:40:18.212725 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:40:18.212725 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:40:18.212725 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:40:18.212725 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:40:18.212725 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bbf13c4-4a58-4656-9223-a60c053d9e44 could not be found. Jul 25 12:40:18.212725 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:18.212725 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:18.212725 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:18.212725 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:18.212725 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:18.212725 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:18.212725 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:40:18.212725 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:40:18.212725 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bbf13c4-4a58-4656-9223-a60c053d9e44 could not be found. Jul 25 12:40:18.212725 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:18.216315 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-89a5dcb5-b15a-4ddf-b402-c1bd8e12ea53 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Returning 404 to user: Instance 2bbf13c4-4a58-4656-9223-a60c053d9e44 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:40:18.217349 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-89a5dcb5-b15a-4ddf-b402-c1bd8e12ea53 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44" status: 404 len: 111 microversion: 2.1 time: 0.058878 Jul 25 12:40:18.221643 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 303/548] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:18 2022] GET /compute/v2.1/servers/2bbf13c4-4a58-4656-9223-a60c053d9e44 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:40:18.230289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7e00cfcb-1254-49b0-811b-499b3ddb0480 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:18.234512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7e00cfcb-1254-49b0-811b-499b3ddb0480 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 5d7df5ea-519f-4020-8467-cbe9423e3560] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:18.252116 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e00cfcb-1254-49b0-811b-499b3ddb0480 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.254319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e00cfcb-1254-49b0-811b-499b3ddb0480 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:18.256481 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e00cfcb-1254-49b0-811b-499b3ddb0480 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.257363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e00cfcb-1254-49b0-811b-499b3ddb0480 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:18.283108 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-7e00cfcb-1254-49b0-811b-499b3ddb0480 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] HTTP exception thrown: Instance 5d7df5ea-519f-4020-8467-cbe9423e3560 could not be found. Jul 25 12:40:18.285262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7e00cfcb-1254-49b0-811b-499b3ddb0480 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Request method failure captured: Jul 25 12:40:18.285262 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560 HTTP/1.1 Jul 25 12:40:18.285262 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:40:18.285262 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:40:18.285262 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:40:18.285262 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:40:18.285262 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:40:18.285262 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:40:18.285262 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:40:18.285262 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:40:18.285262 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7w08v32_Vz2hupbkhzEg97Arxgd21UGdQdTxd2XVtAmk2VjyFvUplXRnBBwWwhyorLRX8Bo0OcyBTc6gIcDu5Hc3hReBGm9ut7aP3Q3Se5p6EC6unspmbgoQHnRM-JxBDXa_tDanSc-EzrkSNn721EBN2my-QUMSWQgg6gp3OAcNM Jul 25 12:40:18.285262 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:40:18.285262 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:40:18.285262 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:40:18.285262 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:40:18.285262 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:40:18.285262 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:40:18.285262 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 78c5541f51c149278aad62c55bb62d8f Jul 25 12:40:18.285262 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1016230751 Jul 25 12:40:18.285262 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:40:18.285262 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:40:18.286611 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_78c5541f51c149278aad62c55bb62d8f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/78c5541f51c149278aad62c55bb62d8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/78c5541f51c149278aad62c55bb62d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/78c5541f51c149278aad62c55bb62d8f"}]}] Jul 25 12:40:18.286611 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-DeleteServersAdminTestJSON-1016230751 Jul 25 12:40:18.286611 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 78c5541f51c149278aad62c55bb62d8f Jul 25 12:40:18.286611 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1016230751 Jul 25 12:40:18.286611 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-DeleteServersAdminTestJSON-1016230751-project Jul 25 12:40:18.286611 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:40:18.286611 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:40:18.286611 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 78a553e32dbb4f3d8e362d67bc1ba55f Jul 25 12:40:18.286611 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-DeleteServersAdminTestJSON-1016230751-project Jul 25 12:40:18.286611 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:40:18.286611 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 5d7df5ea-519f-4020-8467-cbe9423e3560 could not be found. Jul 25 12:40:18.286611 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '5d7df5ea-519f-4020-8467-cbe9423e3560'} Jul 25 12:40:18.287413 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:40:18.287413 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:18.287413 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:40:18.287413 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:40:18.287413 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:40:18.287413 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:40:18.287413 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:40:18.287413 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:40:18.287413 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:40:18.287413 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:40:18.287413 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d7df5ea-519f-4020-8467-cbe9423e3560 could not be found. Jul 25 12:40:18.287413 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:18.287413 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:18.287413 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:18.287413 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:18.287413 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:18.287413 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:18.287413 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:40:18.287413 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:40:18.287413 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:40:18.288595 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:40:18.288595 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:40:18.288595 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:40:18.288595 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:40:18.288595 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:40:18.288595 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:40:18.288595 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:40:18.288595 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:40:18.288595 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:40:18.288595 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d7df5ea-519f-4020-8467-cbe9423e3560 could not be found. Jul 25 12:40:18.288595 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:18.288595 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:18.288595 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:18.288595 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:18.288595 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:18.288595 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:18.288595 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:40:18.288595 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:40:18.288595 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d7df5ea-519f-4020-8467-cbe9423e3560 could not be found. Jul 25 12:40:18.288595 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:18.289775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7e00cfcb-1254-49b0-811b-499b3ddb0480 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Returning 404 to user: Instance 5d7df5ea-519f-4020-8467-cbe9423e3560 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:40:18.289775 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7e00cfcb-1254-49b0-811b-499b3ddb0480 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560" status: 404 len: 111 microversion: 2.1 time: 0.061434 Jul 25 12:40:18.296864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8f959141-818f-453b-beff-7865b4f08d3f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:18.304862 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 304/549] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:40:18 2022] DELETE /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:40:18.309731 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8f959141-818f-453b-beff-7865b4f08d3f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:18.312004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8f959141-818f-453b-beff-7865b4f08d3f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:18.314420 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8f959141-818f-453b-beff-7865b4f08d3f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 1566 microversion: 2.25 time: 0.391015 Jul 25 12:40:18.315791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-186a24a6-aae7-404b-8307-619b64f60a83 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:18.316130 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 246/550] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:17 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 1566 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:18.316945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-186a24a6-aae7-404b-8307-619b64f60a83 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] [instance: 5d7df5ea-519f-4020-8467-cbe9423e3560] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:18.323984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-186a24a6-aae7-404b-8307-619b64f60a83 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.325209 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-186a24a6-aae7-404b-8307-619b64f60a83 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:18.326257 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-186a24a6-aae7-404b-8307-619b64f60a83 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.326906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-186a24a6-aae7-404b-8307-619b64f60a83 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:18.343360 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-186a24a6-aae7-404b-8307-619b64f60a83 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] HTTP exception thrown: Instance 5d7df5ea-519f-4020-8467-cbe9423e3560 could not be found. Jul 25 12:40:18.345025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-186a24a6-aae7-404b-8307-619b64f60a83 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Request method failure captured: Jul 25 12:40:18.345025 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560 HTTP/1.1 Jul 25 12:40:18.345025 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:40:18.345025 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:40:18.345025 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:40:18.345025 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:40:18.345025 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:40:18.345025 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:40:18.345025 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:40:18.345025 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:40:18.345025 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7w08v32_Vz2hupbkhzEg97Arxgd21UGdQdTxd2XVtAmk2VjyFvUplXRnBBwWwhyorLRX8Bo0OcyBTc6gIcDu5Hc3hReBGm9ut7aP3Q3Se5p6EC6unspmbgoQHnRM-JxBDXa_tDanSc-EzrkSNn721EBN2my-QUMSWQgg6gp3OAcNM Jul 25 12:40:18.345025 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:40:18.345025 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:40:18.345025 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:40:18.345025 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:40:18.345025 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:40:18.345025 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:40:18.345025 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 78c5541f51c149278aad62c55bb62d8f Jul 25 12:40:18.345025 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1016230751 Jul 25 12:40:18.345025 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:40:18.345025 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:40:18.346393 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_78c5541f51c149278aad62c55bb62d8f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/78c5541f51c149278aad62c55bb62d8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/78c5541f51c149278aad62c55bb62d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/78c5541f51c149278aad62c55bb62d8f"}]}] Jul 25 12:40:18.346393 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-DeleteServersAdminTestJSON-1016230751 Jul 25 12:40:18.346393 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 78c5541f51c149278aad62c55bb62d8f Jul 25 12:40:18.346393 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1016230751 Jul 25 12:40:18.346393 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-DeleteServersAdminTestJSON-1016230751-project Jul 25 12:40:18.346393 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:40:18.346393 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:40:18.346393 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 78a553e32dbb4f3d8e362d67bc1ba55f Jul 25 12:40:18.346393 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-DeleteServersAdminTestJSON-1016230751-project Jul 25 12:40:18.346393 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:40:18.346393 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 5d7df5ea-519f-4020-8467-cbe9423e3560 could not be found. Jul 25 12:40:18.346393 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '5d7df5ea-519f-4020-8467-cbe9423e3560'} Jul 25 12:40:18.347155 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:40:18.347155 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:18.347155 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:40:18.347155 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:40:18.347155 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:40:18.347155 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:40:18.347155 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:40:18.347155 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:40:18.347155 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:40:18.347155 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:40:18.347155 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d7df5ea-519f-4020-8467-cbe9423e3560 could not be found. Jul 25 12:40:18.347155 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:18.347155 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:18.347155 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:18.347155 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:18.347155 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:18.347155 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:18.347155 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:40:18.347155 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:40:18.347155 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:40:18.348309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:40:18.348309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:40:18.348309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:40:18.348309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:40:18.348309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:40:18.348309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:40:18.348309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:40:18.348309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d7df5ea-519f-4020-8467-cbe9423e3560 could not be found. Jul 25 12:40:18.348309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:18.348309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:18.348309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:18.348309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:18.348309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:18.348309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:18.348309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:40:18.348309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:40:18.348309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d7df5ea-519f-4020-8467-cbe9423e3560 could not be found. Jul 25 12:40:18.348309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:18.349438 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-186a24a6-aae7-404b-8307-619b64f60a83 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] Returning 404 to user: Instance 5d7df5ea-519f-4020-8467-cbe9423e3560 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:40:18.349438 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-186a24a6-aae7-404b-8307-619b64f60a83 tempest-DeleteServersAdminTestJSON-1016230751 tempest-DeleteServersAdminTestJSON-1016230751-project] 10.222.0.49 "GET /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560" status: 404 len: 111 microversion: 2.1 time: 0.038552 Jul 25 12:40:18.349438 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 305/551] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:18 2022] GET /compute/v2.1/servers/5d7df5ea-519f-4020-8467-cbe9423e3560 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:40:18.401127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f8f1ce43-e22a-430f-aa21-c407a9b8ff3e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:18.402111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f8f1ce43-e22a-430f-aa21-c407a9b8ff3e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:18.409355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8f1ce43-e22a-430f-aa21-c407a9b8ff3e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.409934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8f1ce43-e22a-430f-aa21-c407a9b8ff3e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:18.410712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8f1ce43-e22a-430f-aa21-c407a9b8ff3e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.411144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8f1ce43-e22a-430f-aa21-c407a9b8ff3e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:18.554163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f8f1ce43-e22a-430f-aa21-c407a9b8ff3e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe0a455bf5d4a25b517de628c642f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334f5e32ffb4d49a20d4b7e532cd16e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:18.562411 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f8f1ce43-e22a-430f-aa21-c407a9b8ff3e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972" status: 200 len: 1331 microversion: 2.1 time: 0.165086 Jul 25 12:40:18.563250 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 247/552] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:18 2022] GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972 => generated 1331 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:18.688027 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f1833a78-c5e3-49d9-9524-4707e416ef54 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:18.688744 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f1833a78-c5e3-49d9-9524-4707e416ef54 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: 913f3154-bc36-46f9-8dda-b29d58dd7903] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:18.695143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f1833a78-c5e3-49d9-9524-4707e416ef54 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.695672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f1833a78-c5e3-49d9-9524-4707e416ef54 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:18.696499 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f1833a78-c5e3-49d9-9524-4707e416ef54 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.697000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f1833a78-c5e3-49d9-9524-4707e416ef54 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:18.884560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8a6ea907-43c8-448f-ad6f-14db7dafc595 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:18.885454 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8a6ea907-43c8-448f-ad6f-14db7dafc595 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:18.894164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a6ea907-43c8-448f-ad6f-14db7dafc595 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.894945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a6ea907-43c8-448f-ad6f-14db7dafc595 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:18.896517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a6ea907-43c8-448f-ad6f-14db7dafc595 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.897232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a6ea907-43c8-448f-ad6f-14db7dafc595 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:18.949924 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f1833a78-c5e3-49d9-9524-4707e416ef54 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:18.961460 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f1833a78-c5e3-49d9-9524-4707e416ef54 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903" status: 200 len: 1307 microversion: 2.1 time: 0.277887 Jul 25 12:40:18.968151 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 306/553] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:18 2022] GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903 => generated 1307 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:18.978115 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c3297f0d-ad39-4142-a112-0acc7d9d223c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:18.979026 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c3297f0d-ad39-4142-a112-0acc7d9d223c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:18.987400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3297f0d-ad39-4142-a112-0acc7d9d223c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.988439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3297f0d-ad39-4142-a112-0acc7d9d223c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:18.989579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3297f0d-ad39-4142-a112-0acc7d9d223c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.990566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3297f0d-ad39-4142-a112-0acc7d9d223c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:19.190473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8a6ea907-43c8-448f-ad6f-14db7dafc595 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:19.204802 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8a6ea907-43c8-448f-ad6f-14db7dafc595 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 200 len: 1311 microversion: 2.1 time: 0.325942 Jul 25 12:40:19.206850 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 248/554] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:18 2022] GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 1311 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:19.212477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-7d2a9c61-4da7-4425-ad45-8411211e640f req-f9113f88-849f-4f81-9ede-15d1e3a03429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bbf13c4-4a58-4656-9223-a60c053d9e44", "name": "network-vif-deleted", "tag": "c1c4c318-da17-46d9-b300-247d4737db29"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:19.221676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c3297f0d-ad39-4142-a112-0acc7d9d223c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:19.225011 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:19.234427 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c3297f0d-ad39-4142-a112-0acc7d9d223c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1313 microversion: 2.1 time: 0.265016 Jul 25 12:40:19.241579 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 307/555] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:18 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:19.241750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-7d2a9c61-4da7-4425-ad45-8411211e640f req-f9113f88-849f-4f81-9ede-15d1e3a03429 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:19.241750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-7d2a9c61-4da7-4425-ad45-8411211e640f req-f9113f88-849f-4f81-9ede-15d1e3a03429 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:19.246661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0ffa5616-c5ce-4f50-ac82-98b521bb7794 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:19.247885 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0ffa5616-c5ce-4f50-ac82-98b521bb7794 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: 589e9ead-d99c-43de-98e8-da7ed1536b95] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:19.256128 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ffa5616-c5ce-4f50-ac82-98b521bb7794 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:19.256871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ffa5616-c5ce-4f50-ac82-98b521bb7794 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:19.257008 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-7d2a9c61-4da7-4425-ad45-8411211e640f req-f9113f88-849f-4f81-9ede-15d1e3a03429 service nova] Creating event network-vif-deleted:c1c4c318-da17-46d9-b300-247d4737db29 for instance 2bbf13c4-4a58-4656-9223-a60c053d9e44 on n-h1-848886-15 Jul 25 12:40:19.258566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ffa5616-c5ce-4f50-ac82-98b521bb7794 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:19.259304 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ffa5616-c5ce-4f50-ac82-98b521bb7794 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:19.265631 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-7d2a9c61-4da7-4425-ad45-8411211e640f req-f9113f88-849f-4f81-9ede-15d1e3a03429 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057100 Jul 25 12:40:19.266054 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 249/556] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:19.287147 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-0ffa5616-c5ce-4f50-ac82-98b521bb7794 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] HTTP exception thrown: Instance 589e9ead-d99c-43de-98e8-da7ed1536b95 could not be found. Jul 25 12:40:19.290167 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0ffa5616-c5ce-4f50-ac82-98b521bb7794 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Request method failure captured: Jul 25 12:40:19.290167 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95 HTTP/1.1 Jul 25 12:40:19.290167 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:40:19.290167 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:40:19.290167 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:40:19.290167 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:40:19.290167 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:40:19.290167 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:40:19.290167 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:40:19.290167 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:40:19.290167 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7yUvCGA5FvL8o_3lcoRKgGqPnMxWYXzwlrO8cJf1hiNOm41A9dsaeqyGJH9XIm5PdossudrOKLjEb-kXa_pOjh_n2T88CwFtvNP1uIjEq0aSA5RNCFn9R3DEavD_gSmWVoVwcsJv7y2ksm62nOvFWus1P-JFz9rLcPu-_AL8-OCtk Jul 25 12:40:19.290167 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:40:19.290167 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:40:19.290167 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:40:19.290167 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:40:19.290167 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:40:19.290167 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:40:19.290167 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 441bc4b2a9f241b8bcb74a18e3741ca0 Jul 25 12:40:19.290167 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-LiveMigrationNegativeTest-180151972 Jul 25 12:40:19.290167 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:40:19.290167 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:40:19.291711 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_441bc4b2a9f241b8bcb74a18e3741ca0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/441bc4b2a9f241b8bcb74a18e3741ca0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/441bc4b2a9f241b8bcb74a18e3741ca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/441bc4b2a9f241b8bcb74a18e3741ca0"}]}] Jul 25 12:40:19.291711 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-LiveMigrationNegativeTest-180151972 Jul 25 12:40:19.291711 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 441bc4b2a9f241b8bcb74a18e3741ca0 Jul 25 12:40:19.291711 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-180151972 Jul 25 12:40:19.291711 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-LiveMigrationNegativeTest-180151972-project Jul 25 12:40:19.291711 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:40:19.291711 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:40:19.291711 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 896d3b06fb2446ca99333ce426e52d4b Jul 25 12:40:19.291711 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-LiveMigrationNegativeTest-180151972-project Jul 25 12:40:19.291711 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:40:19.291711 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 589e9ead-d99c-43de-98e8-da7ed1536b95 could not be found. Jul 25 12:40:19.291711 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '589e9ead-d99c-43de-98e8-da7ed1536b95'} Jul 25 12:40:19.292593 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:40:19.292593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:19.292593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:40:19.292593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:40:19.292593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:40:19.292593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:40:19.292593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:40:19.292593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:40:19.292593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:40:19.292593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:40:19.292593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 589e9ead-d99c-43de-98e8-da7ed1536b95 could not be found. Jul 25 12:40:19.292593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:19.292593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:19.292593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:19.292593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:19.292593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:19.292593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:19.292593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:40:19.292593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:40:19.292593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:40:19.294026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:40:19.294026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:40:19.294026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:40:19.294026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:40:19.294026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:40:19.294026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:40:19.294026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:40:19.294026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 589e9ead-d99c-43de-98e8-da7ed1536b95 could not be found. Jul 25 12:40:19.294026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:19.294026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:19.294026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:19.294026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:19.294026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:19.294026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:19.294026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:40:19.294026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:40:19.294026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 589e9ead-d99c-43de-98e8-da7ed1536b95 could not be found. Jul 25 12:40:19.294026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:19.295290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0ffa5616-c5ce-4f50-ac82-98b521bb7794 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Returning 404 to user: Instance 589e9ead-d99c-43de-98e8-da7ed1536b95 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:40:19.295290 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0ffa5616-c5ce-4f50-ac82-98b521bb7794 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95" status: 404 len: 111 microversion: 2.1 time: 0.055670 Jul 25 12:40:19.295796 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 308/557] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:19 2022] GET /compute/v2.1/servers/589e9ead-d99c-43de-98e8-da7ed1536b95 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:40:19.301499 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cc066566-74bc-468a-a49e-700a1fec4c7c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:19.302275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cc066566-74bc-468a-a49e-700a1fec4c7c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: a35d467a-2c77-4821-9799-f7873a144436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:19.312146 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc066566-74bc-468a-a49e-700a1fec4c7c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:19.312682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc066566-74bc-468a-a49e-700a1fec4c7c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:19.313533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc066566-74bc-468a-a49e-700a1fec4c7c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:19.314217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc066566-74bc-468a-a49e-700a1fec4c7c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:19.338736 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-74cf8bd0-7dae-49de-903d-61975fcf104e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:19.340082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-74cf8bd0-7dae-49de-903d-61975fcf104e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:19.344252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cc066566-74bc-468a-a49e-700a1fec4c7c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: a35d467a-2c77-4821-9799-f7873a144436] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:40:19.355952 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74cf8bd0-7dae-49de-903d-61975fcf104e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:19.356524 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74cf8bd0-7dae-49de-903d-61975fcf104e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:19.357869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74cf8bd0-7dae-49de-903d-61975fcf104e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:19.363621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74cf8bd0-7dae-49de-903d-61975fcf104e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:19.459464 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cc066566-74bc-468a-a49e-700a1fec4c7c tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436" status: 204 len: 0 microversion: 2.1 time: 0.161968 Jul 25 12:40:19.460544 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 250/558] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:40:19 2022] DELETE /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:40:19.469524 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1f7cc9b4-e742-4fc6-b9d0-9886213e01f7 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:19.470474 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1f7cc9b4-e742-4fc6-b9d0-9886213e01f7 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: a35d467a-2c77-4821-9799-f7873a144436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:19.477554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f7cc9b4-e742-4fc6-b9d0-9886213e01f7 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:19.478178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f7cc9b4-e742-4fc6-b9d0-9886213e01f7 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:19.479776 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f7cc9b4-e742-4fc6-b9d0-9886213e01f7 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:19.480809 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f7cc9b4-e742-4fc6-b9d0-9886213e01f7 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:19.691811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-74cf8bd0-7dae-49de-903d-61975fcf104e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:19.700701 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-74cf8bd0-7dae-49de-903d-61975fcf104e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:19.702662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-74cf8bd0-7dae-49de-903d-61975fcf104e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:19.704945 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-74cf8bd0-7dae-49de-903d-61975fcf104e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 1566 microversion: 2.25 time: 0.370306 Jul 25 12:40:19.720552 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 309/559] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:19 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 1566 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:40:19.725718 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-25dfe885-8a06-42e6-b74c-997513245aa8 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:19.726629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-25dfe885-8a06-42e6-b74c-997513245aa8 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:19.733154 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-25dfe885-8a06-42e6-b74c-997513245aa8 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:19.733999 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-25dfe885-8a06-42e6-b74c-997513245aa8 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:19.735023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-25dfe885-8a06-42e6-b74c-997513245aa8 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:19.735698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-25dfe885-8a06-42e6-b74c-997513245aa8 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:19.835531 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1f7cc9b4-e742-4fc6-b9d0-9886213e01f7 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:19.843987 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1f7cc9b4-e742-4fc6-b9d0-9886213e01f7 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436" status: 200 len: 1474 microversion: 2.1 time: 0.379231 Jul 25 12:40:19.844653 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 251/560] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:19 2022] GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436 => generated 1474 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:19.904837 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-25dfe885-8a06-42e6-b74c-997513245aa8 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe0a455bf5d4a25b517de628c642f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334f5e32ffb4d49a20d4b7e532cd16e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:19.913912 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-25dfe885-8a06-42e6-b74c-997513245aa8 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972" status: 200 len: 1331 microversion: 2.1 time: 0.191924 Jul 25 12:40:19.918105 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 310/561] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:19 2022] GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972 => generated 1331 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:19.946847 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-684473eb-4e8b-4619-8c6c-af6422aee988 req-6d144352-394b-4c41-98a3-3b689d3bacd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "589e9ead-d99c-43de-98e8-da7ed1536b95", "name": "network-vif-deleted", "tag": "c0a35ea1-b5c8-40a8-bb95-4e65c57d81d1"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:19.958861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-684473eb-4e8b-4619-8c6c-af6422aee988 req-6d144352-394b-4c41-98a3-3b689d3bacd5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:19.959394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-684473eb-4e8b-4619-8c6c-af6422aee988 req-6d144352-394b-4c41-98a3-3b689d3bacd5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:19.982101 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-684473eb-4e8b-4619-8c6c-af6422aee988 req-6d144352-394b-4c41-98a3-3b689d3bacd5 service nova] Creating event network-vif-deleted:c0a35ea1-b5c8-40a8-bb95-4e65c57d81d1 for instance 589e9ead-d99c-43de-98e8-da7ed1536b95 on n-h1-848886-15 Jul 25 12:40:19.987866 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-54108e13-4571-4e20-97f8-ede0050d6e57 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:19.988674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-54108e13-4571-4e20-97f8-ede0050d6e57 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: 913f3154-bc36-46f9-8dda-b29d58dd7903] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:19.990148 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-684473eb-4e8b-4619-8c6c-af6422aee988 req-6d144352-394b-4c41-98a3-3b689d3bacd5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047705 Jul 25 12:40:19.994390 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 252/562] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:19.996226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54108e13-4571-4e20-97f8-ede0050d6e57 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:19.996672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54108e13-4571-4e20-97f8-ede0050d6e57 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:19.997451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54108e13-4571-4e20-97f8-ede0050d6e57 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:19.997936 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54108e13-4571-4e20-97f8-ede0050d6e57 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:20.211677 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-54108e13-4571-4e20-97f8-ede0050d6e57 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:20.223625 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-54108e13-4571-4e20-97f8-ede0050d6e57 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903" status: 200 len: 1307 microversion: 2.1 time: 0.236714 Jul 25 12:40:20.223625 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 311/563] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:19 2022] GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903 => generated 1307 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:20.229248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bf13cfc7-743f-4760-9dc6-56d574e42928 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:20.229853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bf13cfc7-743f-4760-9dc6-56d574e42928 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:20.239549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf13cfc7-743f-4760-9dc6-56d574e42928 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:20.240018 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf13cfc7-743f-4760-9dc6-56d574e42928 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:20.240682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf13cfc7-743f-4760-9dc6-56d574e42928 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:20.241122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf13cfc7-743f-4760-9dc6-56d574e42928 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:20.255720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-87fd547e-6984-42a6-86ce-0995c9692c96 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:20.256322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-87fd547e-6984-42a6-86ce-0995c9692c96 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:20.277316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87fd547e-6984-42a6-86ce-0995c9692c96 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:20.277769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87fd547e-6984-42a6-86ce-0995c9692c96 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:20.278566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87fd547e-6984-42a6-86ce-0995c9692c96 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:20.280600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87fd547e-6984-42a6-86ce-0995c9692c96 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:20.434519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bf13cfc7-743f-4760-9dc6-56d574e42928 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:20.443792 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bf13cfc7-743f-4760-9dc6-56d574e42928 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 200 len: 1311 microversion: 2.1 time: 0.218830 Jul 25 12:40:20.457867 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 253/564] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:20 2022] GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 1311 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:20.461775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-87fd547e-6984-42a6-86ce-0995c9692c96 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:20.469813 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-87fd547e-6984-42a6-86ce-0995c9692c96 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1313 microversion: 2.1 time: 0.217875 Jul 25 12:40:20.470475 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 312/565] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:20 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:20.727861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f4c321c4-66be-41c0-af47-884bd95d1b52 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:20.728502 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f4c321c4-66be-41c0-af47-884bd95d1b52 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:20.734459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4c321c4-66be-41c0-af47-884bd95d1b52 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:20.734899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4c321c4-66be-41c0-af47-884bd95d1b52 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:20.735676 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4c321c4-66be-41c0-af47-884bd95d1b52 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:20.736137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4c321c4-66be-41c0-af47-884bd95d1b52 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:20.865159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4a4b3b5a-f706-43d9-99dc-9fbf6e484877 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:20.866431 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4a4b3b5a-f706-43d9-99dc-9fbf6e484877 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: a35d467a-2c77-4821-9799-f7873a144436] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:20.876408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f4c321c4-66be-41c0-af47-884bd95d1b52 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:20.887857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a4b3b5a-f706-43d9-99dc-9fbf6e484877 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:20.888760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f4c321c4-66be-41c0-af47-884bd95d1b52 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:20.889516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a4b3b5a-f706-43d9-99dc-9fbf6e484877 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:20.890445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a4b3b5a-f706-43d9-99dc-9fbf6e484877 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:20.890872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a4b3b5a-f706-43d9-99dc-9fbf6e484877 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:20.893057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f4c321c4-66be-41c0-af47-884bd95d1b52 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:20.899370 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f4c321c4-66be-41c0-af47-884bd95d1b52 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 1566 microversion: 2.25 time: 0.175317 Jul 25 12:40:20.914340 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 254/566] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:20 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:20.939159 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-80c0661b-53ad-4036-a309-cb8b2f744294 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:20.939773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-80c0661b-53ad-4036-a309-cb8b2f744294 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:20.952204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-80c0661b-53ad-4036-a309-cb8b2f744294 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:20.952204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-80c0661b-53ad-4036-a309-cb8b2f744294 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:20.952204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-80c0661b-53ad-4036-a309-cb8b2f744294 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:20.952521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-80c0661b-53ad-4036-a309-cb8b2f744294 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:20.970265 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:21.096887 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4a4b3b5a-f706-43d9-99dc-9fbf6e484877 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:21.106204 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4a4b3b5a-f706-43d9-99dc-9fbf6e484877 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436" status: 200 len: 1474 microversion: 2.1 time: 0.245316 Jul 25 12:40:21.107659 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 313/567] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:20 2022] GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436 => generated 1474 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:21.112764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-1d883ca0-2e06-4664-8e90-85a58e3ba6ce req-722d67d1-57a0-4cc3-87aa-d07eae40ac6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed7807bb-d3da-4dc2-baf9-e547d671f324", "name": "network-vif-plugged", "status": "completed", "tag": "6ef3a05b-5303-4d72-9ec0-6eeee9be1d2a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:21.126786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-1d883ca0-2e06-4664-8e90-85a58e3ba6ce req-722d67d1-57a0-4cc3-87aa-d07eae40ac6b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:21.127408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-1d883ca0-2e06-4664-8e90-85a58e3ba6ce req-722d67d1-57a0-4cc3-87aa-d07eae40ac6b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:21.135616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-80c0661b-53ad-4036-a309-cb8b2f744294 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe0a455bf5d4a25b517de628c642f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334f5e32ffb4d49a20d4b7e532cd16e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:21.141428 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-1d883ca0-2e06-4664-8e90-85a58e3ba6ce req-722d67d1-57a0-4cc3-87aa-d07eae40ac6b service nova] Creating event network-vif-plugged:6ef3a05b-5303-4d72-9ec0-6eeee9be1d2a for instance ed7807bb-d3da-4dc2-baf9-e547d671f324 on n-h2-848886-15 Jul 25 12:40:21.143284 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-80c0661b-53ad-4036-a309-cb8b2f744294 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972" status: 200 len: 1331 microversion: 2.1 time: 0.208088 Jul 25 12:40:21.143981 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 255/568] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:20 2022] GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972 => generated 1331 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:21.146791 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-1d883ca0-2e06-4664-8e90-85a58e3ba6ce req-722d67d1-57a0-4cc3-87aa-d07eae40ac6b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037935 Jul 25 12:40:21.147365 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 314/569] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:21.242471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-21529c1b-a4a4-4da1-9cf1-1efee531d987 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:21.243322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-21529c1b-a4a4-4da1-9cf1-1efee531d987 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: 913f3154-bc36-46f9-8dda-b29d58dd7903] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:21.246215 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:21.247675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=12 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:21.255031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-21529c1b-a4a4-4da1-9cf1-1efee531d987 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:21.255480 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-21529c1b-a4a4-4da1-9cf1-1efee531d987 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:21.256491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-21529c1b-a4a4-4da1-9cf1-1efee531d987 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:21.257048 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-21529c1b-a4a4-4da1-9cf1-1efee531d987 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:21.286998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-4bc43963-627f-4f46-b054-9882ee179570 req-983b21b4-a2cd-4eb6-a5d5-8f9eeb159faa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "742583f4-0949-418b-a666-dc715ab936d5", "tag": "32b54c20-b2ca-4697-b32a-a4dbd0903730"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:21.314601 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4bc43963-627f-4f46-b054-9882ee179570 req-983b21b4-a2cd-4eb6-a5d5-8f9eeb159faa service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:21.315415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4bc43963-627f-4f46-b054-9882ee179570 req-983b21b4-a2cd-4eb6-a5d5-8f9eeb159faa service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:21.354981 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-4bc43963-627f-4f46-b054-9882ee179570 req-983b21b4-a2cd-4eb6-a5d5-8f9eeb159faa service nova] Creating event network-changed:32b54c20-b2ca-4697-b32a-a4dbd0903730 for instance 742583f4-0949-418b-a666-dc715ab936d5 on n-h1-848886-15 Jul 25 12:40:21.365268 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-4bc43963-627f-4f46-b054-9882ee179570 req-983b21b4-a2cd-4eb6-a5d5-8f9eeb159faa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082124 Jul 25 12:40:21.366580 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 315/570] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:40:21.457134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-21529c1b-a4a4-4da1-9cf1-1efee531d987 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:21.465519 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-21529c1b-a4a4-4da1-9cf1-1efee531d987 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903" status: 200 len: 1307 microversion: 2.1 time: 0.227360 Jul 25 12:40:21.465695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8d9f836d-196a-4f01-ae85-90f178d8925d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:21.466405 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8d9f836d-196a-4f01-ae85-90f178d8925d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:21.473986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d9f836d-196a-4f01-ae85-90f178d8925d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:21.473986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d9f836d-196a-4f01-ae85-90f178d8925d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:21.474447 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 256/571] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:21 2022] GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903 => generated 1307 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:21.474563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d9f836d-196a-4f01-ae85-90f178d8925d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:21.477418 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d9f836d-196a-4f01-ae85-90f178d8925d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:21.493098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2b747439-71f3-4de7-91b3-9d83470267ee tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:21.494627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2b747439-71f3-4de7-91b3-9d83470267ee tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:21.503351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2b747439-71f3-4de7-91b3-9d83470267ee tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:21.504264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2b747439-71f3-4de7-91b3-9d83470267ee tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:21.505260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2b747439-71f3-4de7-91b3-9d83470267ee tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:21.505982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2b747439-71f3-4de7-91b3-9d83470267ee tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:21.921788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8d9f836d-196a-4f01-ae85-90f178d8925d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:21.933193 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8d9f836d-196a-4f01-ae85-90f178d8925d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 200 len: 1311 microversion: 2.1 time: 0.471848 Jul 25 12:40:21.933926 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 316/572] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:21 2022] GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 1311 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:22.069234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2b747439-71f3-4de7-91b3-9d83470267ee tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:22.080126 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2b747439-71f3-4de7-91b3-9d83470267ee tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1313 microversion: 2.1 time: 0.591268 Jul 25 12:40:22.094309 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 257/573] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:21 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:22.102602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7a192579-9c94-4c94-80a1-7ccdbd85dd2b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:22.104427 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7a192579-9c94-4c94-80a1-7ccdbd85dd2b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:22.113567 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9bd44e57-cfb2-4a2f-94c6-b318a61b8f3e tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Calling method '.version_select at 0x7efcf9df7af0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:22.114653 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:40:22.114653 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:40:22.116070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9bd44e57-cfb2-4a2f-94c6-b318a61b8f3e tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:22.121424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9bd44e57-cfb2-4a2f-94c6-b318a61b8f3e tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:22.136623 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a192579-9c94-4c94-80a1-7ccdbd85dd2b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:22.138213 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a192579-9c94-4c94-80a1-7ccdbd85dd2b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:22.139394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a192579-9c94-4c94-80a1-7ccdbd85dd2b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:22.139930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a192579-9c94-4c94-80a1-7ccdbd85dd2b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:22.152704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9bd44e57-cfb2-4a2f-94c6-b318a61b8f3e tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:22.160474 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9bd44e57-cfb2-4a2f-94c6-b318a61b8f3e tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:22.183983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9bd44e57-cfb2-4a2f-94c6-b318a61b8f3e tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:22.187091 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9bd44e57-cfb2-4a2f-94c6-b318a61b8f3e tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:22.204513 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9bd44e57-cfb2-4a2f-94c6-b318a61b8f3e tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.266864 Jul 25 12:40:22.214554 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 317/574] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:40:21 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:22.219957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-03eaa926-c1de-4d38-bc26-6dec6b41bf50 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:22.220874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-03eaa926-c1de-4d38-bc26-6dec6b41bf50 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: a35d467a-2c77-4821-9799-f7873a144436] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:22.227826 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-03eaa926-c1de-4d38-bc26-6dec6b41bf50 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:22.228593 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-03eaa926-c1de-4d38-bc26-6dec6b41bf50 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:22.229709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-03eaa926-c1de-4d38-bc26-6dec6b41bf50 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:22.230384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-03eaa926-c1de-4d38-bc26-6dec6b41bf50 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:22.511453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7a192579-9c94-4c94-80a1-7ccdbd85dd2b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:22.520865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7a192579-9c94-4c94-80a1-7ccdbd85dd2b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:22.522813 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7a192579-9c94-4c94-80a1-7ccdbd85dd2b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:22.525372 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7a192579-9c94-4c94-80a1-7ccdbd85dd2b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 1566 microversion: 2.25 time: 0.437872 Jul 25 12:40:22.539736 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 258/575] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:22 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 1566 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:22.544858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-03eaa926-c1de-4d38-bc26-6dec6b41bf50 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:22.549307 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a6514c4a-ddb3-49f6-a7e4-13a896244b15 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:22.550333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a6514c4a-ddb3-49f6-a7e4-13a896244b15 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:22.559776 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-03eaa926-c1de-4d38-bc26-6dec6b41bf50 tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436" status: 200 len: 1474 microversion: 2.1 time: 0.343303 Jul 25 12:40:22.560423 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a6514c4a-ddb3-49f6-a7e4-13a896244b15 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:22.561088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a6514c4a-ddb3-49f6-a7e4-13a896244b15 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:22.562077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a6514c4a-ddb3-49f6-a7e4-13a896244b15 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:22.562694 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a6514c4a-ddb3-49f6-a7e4-13a896244b15 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:22.563205 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 318/576] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:22 2022] GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436 => generated 1474 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:22.571547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-65a1b1c1-dce8-49e2-ae72-c4cae0a4fe04 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Calling method '.version_select at 0x7efcf9e0d160>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:22.573371 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:40:22.573371 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:40:22.574947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65a1b1c1-dce8-49e2-ae72-c4cae0a4fe04 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:22.575756 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65a1b1c1-dce8-49e2-ae72-c4cae0a4fe04 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:22.597035 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65a1b1c1-dce8-49e2-ae72-c4cae0a4fe04 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:22.597669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65a1b1c1-dce8-49e2-ae72-c4cae0a4fe04 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:22.610063 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65a1b1c1-dce8-49e2-ae72-c4cae0a4fe04 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:22.610652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65a1b1c1-dce8-49e2-ae72-c4cae0a4fe04 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:22.616994 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-65a1b1c1-dce8-49e2-ae72-c4cae0a4fe04 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.051965 Jul 25 12:40:22.620049 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 319/577] 10.222.0.49 () {58 vars in 1167 bytes} [Mon Jul 25 12:40:22 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:22.625201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-55150a6e-8878-4044-894f-57166c57f63b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:22.626167 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-55150a6e-8878-4044-894f-57166c57f63b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: 913f3154-bc36-46f9-8dda-b29d58dd7903] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:22.633308 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55150a6e-8878-4044-894f-57166c57f63b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:22.633772 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55150a6e-8878-4044-894f-57166c57f63b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:22.634607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55150a6e-8878-4044-894f-57166c57f63b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:22.635079 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55150a6e-8878-4044-894f-57166c57f63b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:23.245715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a6514c4a-ddb3-49f6-a7e4-13a896244b15 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe0a455bf5d4a25b517de628c642f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334f5e32ffb4d49a20d4b7e532cd16e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:23.255271 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a6514c4a-ddb3-49f6-a7e4-13a896244b15 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972" status: 200 len: 1535 microversion: 2.1 time: 0.714332 Jul 25 12:40:23.256335 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 259/578] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:22 2022] GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972 => generated 1535 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:23.270428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-038bb392-ff64-4dca-a5f2-cc361f64564c tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Calling method '.version_select at 0x7efcfa206040>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:23.270428 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:40:23.270428 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:40:23.270428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-038bb392-ff64-4dca-a5f2-cc361f64564c tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:23.270428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-038bb392-ff64-4dca-a5f2-cc361f64564c tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:23.298455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-038bb392-ff64-4dca-a5f2-cc361f64564c tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:23.299153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-038bb392-ff64-4dca-a5f2-cc361f64564c tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:23.300095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-55150a6e-8878-4044-894f-57166c57f63b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:23.316113 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-55150a6e-8878-4044-894f-57166c57f63b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903" status: 200 len: 1307 microversion: 2.1 time: 0.697201 Jul 25 12:40:23.318450 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-038bb392-ff64-4dca-a5f2-cc361f64564c tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:23.319031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-038bb392-ff64-4dca-a5f2-cc361f64564c tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:23.325956 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 320/579] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:22 2022] GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903 => generated 1307 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:23.346354 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-038bb392-ff64-4dca-a5f2-cc361f64564c tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.083960 Jul 25 12:40:23.346785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-42c2e19d-1cae-416a-b525-6e9f46df1a80 req-3c111e46-9d10-4919-8196-b48c24d4f986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a28091-c9d3-44c2-8289-828c66b56c2b", "name": "network-vif-unplugged", "status": "completed", "tag": "5abc676c-0f69-43cf-b469-5e02f591bcab"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:23.352305 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 260/580] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:40:23 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:23.360658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-96fb64e1-25d6-4a17-8f2e-553c255d046f tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:23.366625 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-96fb64e1-25d6-4a17-8f2e-553c255d046f tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: fefcb083-ed47-4de2-9c77-0bdb30d0aa6f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:23.386973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-42c2e19d-1cae-416a-b525-6e9f46df1a80 req-3c111e46-9d10-4919-8196-b48c24d4f986 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:23.387141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-96fb64e1-25d6-4a17-8f2e-553c255d046f tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:23.387486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-96fb64e1-25d6-4a17-8f2e-553c255d046f tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:23.388083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-42c2e19d-1cae-416a-b525-6e9f46df1a80 req-3c111e46-9d10-4919-8196-b48c24d4f986 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:23.388465 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-96fb64e1-25d6-4a17-8f2e-553c255d046f tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:23.388729 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-96fb64e1-25d6-4a17-8f2e-553c255d046f tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:23.418345 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-42c2e19d-1cae-416a-b525-6e9f46df1a80 req-3c111e46-9d10-4919-8196-b48c24d4f986 service nova] Creating event network-vif-unplugged:5abc676c-0f69-43cf-b469-5e02f591bcab for instance 31a28091-c9d3-44c2-8289-828c66b56c2b on n-h1-848886-15 Jul 25 12:40:23.424880 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-42c2e19d-1cae-416a-b525-6e9f46df1a80 req-3c111e46-9d10-4919-8196-b48c24d4f986 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097191 Jul 25 12:40:23.426264 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 321/581] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:23.435728 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bef41f6b-671c-42b2-8b77-cb746ad9eea6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:23.436598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bef41f6b-671c-42b2-8b77-cb746ad9eea6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:23.447283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bef41f6b-671c-42b2-8b77-cb746ad9eea6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:23.448006 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bef41f6b-671c-42b2-8b77-cb746ad9eea6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:23.449493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bef41f6b-671c-42b2-8b77-cb746ad9eea6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:23.451400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bef41f6b-671c-42b2-8b77-cb746ad9eea6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:23.477770 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-96fb64e1-25d6-4a17-8f2e-553c255d046f tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: fefcb083-ed47-4de2-9c77-0bdb30d0aa6f] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:40:23.611225 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-96fb64e1-25d6-4a17-8f2e-553c255d046f tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f" status: 204 len: 0 microversion: 2.1 time: 0.255233 Jul 25 12:40:23.611943 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 261/582] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:40:23 2022] DELETE /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:40:23.620075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-19b604cd-8a12-4902-a875-b377678732bd tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:23.621820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-19b604cd-8a12-4902-a875-b377678732bd tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:23.632489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-19b604cd-8a12-4902-a875-b377678732bd tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:23.632936 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-19b604cd-8a12-4902-a875-b377678732bd tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:23.633954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-19b604cd-8a12-4902-a875-b377678732bd tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:23.634728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-19b604cd-8a12-4902-a875-b377678732bd tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:23.658170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bef41f6b-671c-42b2-8b77-cb746ad9eea6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:23.673479 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bef41f6b-671c-42b2-8b77-cb746ad9eea6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 200 len: 1311 microversion: 2.1 time: 0.245584 Jul 25 12:40:23.674377 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 322/583] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:23 2022] GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 1311 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:23.683947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-721e024e-daab-4fd3-b78b-fdf3cf9cbe7b tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Action: 'create', calling method: .version_select at 0x7efcf9db7af0>, body: {"pool": "76609c4e-8da9-4b0d-a062-dffca4d9d957"} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:23.977426 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-19b604cd-8a12-4902-a875-b377678732bd tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:23.985789 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-19b604cd-8a12-4902-a875-b377678732bd tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1463 microversion: 2.1 time: 0.372599 Jul 25 12:40:23.986381 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 262/584] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:23 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1463 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:23.992205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-522b1a4a-5484-44ec-b440-1651de99c85b tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Calling method '.version_select at 0x7efcfa2704c0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:23.993304 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:40:23.993304 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:40:23.994842 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-522b1a4a-5484-44ec-b440-1651de99c85b tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:23.995455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-522b1a4a-5484-44ec-b440-1651de99c85b tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:24.013219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-522b1a4a-5484-44ec-b440-1651de99c85b tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:24.014047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-522b1a4a-5484-44ec-b440-1651de99c85b tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:24.025170 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-522b1a4a-5484-44ec-b440-1651de99c85b tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.037388 Jul 25 12:40:24.025767 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 263/585] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:40:23 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:24.031003 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5c2be115-eb6f-48cc-b7e0-aa1126f3ef44 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:24.031716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5c2be115-eb6f-48cc-b7e0-aa1126f3ef44 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:24.039685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c2be115-eb6f-48cc-b7e0-aa1126f3ef44 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:24.040581 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c2be115-eb6f-48cc-b7e0-aa1126f3ef44 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:24.041469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c2be115-eb6f-48cc-b7e0-aa1126f3ef44 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:24.042033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c2be115-eb6f-48cc-b7e0-aa1126f3ef44 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:24.263324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5c2be115-eb6f-48cc-b7e0-aa1126f3ef44 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:24.271868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5c2be115-eb6f-48cc-b7e0-aa1126f3ef44 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:24.273367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5c2be115-eb6f-48cc-b7e0-aa1126f3ef44 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:24.274559 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5c2be115-eb6f-48cc-b7e0-aa1126f3ef44 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 1566 microversion: 2.25 time: 0.247126 Jul 25 12:40:24.275105 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 264/586] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:24 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 1566 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:24.280258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d7761adc-f4d9-4cb8-96f4-08e6dda1a14a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:24.280863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d7761adc-f4d9-4cb8-96f4-08e6dda1a14a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: a35d467a-2c77-4821-9799-f7873a144436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:24.286915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7761adc-f4d9-4cb8-96f4-08e6dda1a14a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:24.287368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7761adc-f4d9-4cb8-96f4-08e6dda1a14a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:24.288113 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7761adc-f4d9-4cb8-96f4-08e6dda1a14a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:24.288708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7761adc-f4d9-4cb8-96f4-08e6dda1a14a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:24.322568 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7761adc-f4d9-4cb8-96f4-08e6dda1a14a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:24.323159 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7761adc-f4d9-4cb8-96f4-08e6dda1a14a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:24.323609 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-d7761adc-f4d9-4cb8-96f4-08e6dda1a14a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lazy-loading 'fault' on Instance uuid a35d467a-2c77-4821-9799-f7873a144436 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:40:24.375030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d7761adc-f4d9-4cb8-96f4-08e6dda1a14a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896d3b06fb2446ca99333ce426e52d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441bc4b2a9f241b8bcb74a18e3741ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:24.382882 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d7761adc-f4d9-4cb8-96f4-08e6dda1a14a tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436" status: 200 len: 1308 microversion: 2.1 time: 0.106616 Jul 25 12:40:24.383462 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 265/587] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:24 2022] GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436 => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:24.387898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d9823d5f-aa55-4832-ae0c-8a2f2e1f838e tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:24.388526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d9823d5f-aa55-4832-ae0c-8a2f2e1f838e tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: fefcb083-ed47-4de2-9c77-0bdb30d0aa6f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:24.394651 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9823d5f-aa55-4832-ae0c-8a2f2e1f838e tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:24.395097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9823d5f-aa55-4832-ae0c-8a2f2e1f838e tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:24.395919 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9823d5f-aa55-4832-ae0c-8a2f2e1f838e tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:24.396278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9823d5f-aa55-4832-ae0c-8a2f2e1f838e tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:24.584457 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d9823d5f-aa55-4832-ae0c-8a2f2e1f838e tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:24.593382 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d9823d5f-aa55-4832-ae0c-8a2f2e1f838e tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f" status: 200 len: 1714 microversion: 2.1 time: 0.208876 Jul 25 12:40:24.593992 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 266/588] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:24 2022] GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f => generated 1714 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:24.598479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3cad8fa5-2e36-4fc0-b286-e8eeeda82b60 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:24.601393 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3cad8fa5-2e36-4fc0-b286-e8eeeda82b60 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:24.607651 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3cad8fa5-2e36-4fc0-b286-e8eeeda82b60 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:24.608102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3cad8fa5-2e36-4fc0-b286-e8eeeda82b60 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:24.608865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3cad8fa5-2e36-4fc0-b286-e8eeeda82b60 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:24.609467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3cad8fa5-2e36-4fc0-b286-e8eeeda82b60 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:24.697664 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3cad8fa5-2e36-4fc0-b286-e8eeeda82b60 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:24.701103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:24.704551 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3cad8fa5-2e36-4fc0-b286-e8eeeda82b60 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Old instance type m1.heat2, new instance type m1.heat {{(pid=125884) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 12:40:24.711793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-3cad8fa5-2e36-4fc0-b286-e8eeeda82b60 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:40:24.712210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-3cad8fa5-2e36-4fc0-b286-e8eeeda82b60 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:40:24.712678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-3cad8fa5-2e36-4fc0-b286-e8eeeda82b60 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:40:24.713086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-3cad8fa5-2e36-4fc0-b286-e8eeeda82b60 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:40:24.713512 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-3cad8fa5-2e36-4fc0-b286-e8eeeda82b60 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:40:24.827287 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3cad8fa5-2e36-4fc0-b286-e8eeeda82b60 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "POST /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324/action" status: 202 len: 0 microversion: 2.1 time: 0.232218 Jul 25 12:40:24.828383 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 267/589] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:40:24 2022] POST /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:40:24.835795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-d062a188-ed1c-4df8-9149-69748c1e4ec4 req-a5ab0e32-65be-4719-bf07-55ea86f8d37d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "742583f4-0949-418b-a666-dc715ab936d5", "name": "network-vif-plugged", "status": "completed", "tag": "32b54c20-b2ca-4697-b32a-a4dbd0903730"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:24.848261 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d062a188-ed1c-4df8-9149-69748c1e4ec4 req-a5ab0e32-65be-4719-bf07-55ea86f8d37d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:24.848891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d062a188-ed1c-4df8-9149-69748c1e4ec4 req-a5ab0e32-65be-4719-bf07-55ea86f8d37d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:24.865094 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-d062a188-ed1c-4df8-9149-69748c1e4ec4 req-a5ab0e32-65be-4719-bf07-55ea86f8d37d service nova] Creating event network-vif-plugged:32b54c20-b2ca-4697-b32a-a4dbd0903730 for instance 742583f4-0949-418b-a666-dc715ab936d5 on n-h1-848886-15 Jul 25 12:40:24.873929 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-d062a188-ed1c-4df8-9149-69748c1e4ec4 req-a5ab0e32-65be-4719-bf07-55ea86f8d37d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044120 Jul 25 12:40:24.875458 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 268/590] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:24.882623 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7875cf9a-825c-437b-9250-4535dd983ace tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Calling method '.version_select at 0x7efcfa22d940>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:24.884162 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:40:24.884162 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:40:24.886126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7875cf9a-825c-437b-9250-4535dd983ace tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:24.887135 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7875cf9a-825c-437b-9250-4535dd983ace tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:24.911130 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7875cf9a-825c-437b-9250-4535dd983ace tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.034332 Jul 25 12:40:24.911958 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 269/591] 10.222.0.49 () {58 vars in 1179 bytes} [Mon Jul 25 12:40:24 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:24.918054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-01e1bf3e-6b4e-474f-9a6e-552cb7a6e300 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:24.919057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-01e1bf3e-6b4e-474f-9a6e-552cb7a6e300 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: 913f3154-bc36-46f9-8dda-b29d58dd7903] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:24.927119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01e1bf3e-6b4e-474f-9a6e-552cb7a6e300 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:24.927522 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01e1bf3e-6b4e-474f-9a6e-552cb7a6e300 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:24.928308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01e1bf3e-6b4e-474f-9a6e-552cb7a6e300 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:24.929114 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01e1bf3e-6b4e-474f-9a6e-552cb7a6e300 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:24.947851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:25.130657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-01e1bf3e-6b4e-474f-9a6e-552cb7a6e300 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:25.143221 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-01e1bf3e-6b4e-474f-9a6e-552cb7a6e300 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903" status: 200 len: 1307 microversion: 2.1 time: 0.229397 Jul 25 12:40:25.155623 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 270/592] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:24 2022] GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903 => generated 1307 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:25.167025 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3cb40d71-fdfc-4a74-9a24-d66775a633df tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:25.167025 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3cb40d71-fdfc-4a74-9a24-d66775a633df tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:25.179242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3cb40d71-fdfc-4a74-9a24-d66775a633df tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.179843 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3cb40d71-fdfc-4a74-9a24-d66775a633df tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.180793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3cb40d71-fdfc-4a74-9a24-d66775a633df tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.181237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3cb40d71-fdfc-4a74-9a24-d66775a633df tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.376615 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-721e024e-daab-4fd3-b78b-fdf3cf9cbe7b tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.700297 Jul 25 12:40:25.377764 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 323/593] 10.222.0.49 () {60 vars in 1170 bytes} [Mon Jul 25 12:40:23 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:25.386816 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-54329994-eb09-4b78-8b0f-23c52779c839 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:25.387452 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-54329994-eb09-4b78-8b0f-23c52779c839 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:25.391783 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3cb40d71-fdfc-4a74-9a24-d66775a633df tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:25.393859 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54329994-eb09-4b78-8b0f-23c52779c839 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.394319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54329994-eb09-4b78-8b0f-23c52779c839 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.395114 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54329994-eb09-4b78-8b0f-23c52779c839 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.395719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54329994-eb09-4b78-8b0f-23c52779c839 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.401978 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3cb40d71-fdfc-4a74-9a24-d66775a633df tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 200 len: 1311 microversion: 2.1 time: 0.244761 Jul 25 12:40:25.402856 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 271/594] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:25 2022] GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 1311 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:25.407316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d3bbefb2-f1f5-4205-be19-e79f16d36957 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Calling method '.version_select at 0x7efcfa1e7d30>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:25.408249 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:40:25.408249 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:40:25.409600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3bbefb2-f1f5-4205-be19-e79f16d36957 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.410085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3bbefb2-f1f5-4205-be19-e79f16d36957 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.425175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3bbefb2-f1f5-4205-be19-e79f16d36957 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.425624 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3bbefb2-f1f5-4205-be19-e79f16d36957 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.437727 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3bbefb2-f1f5-4205-be19-e79f16d36957 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.438227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3bbefb2-f1f5-4205-be19-e79f16d36957 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.444247 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d3bbefb2-f1f5-4205-be19-e79f16d36957 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.040349 Jul 25 12:40:25.445140 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 272/595] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:40:25 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:25.449508 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e0e1c9fc-6bb0-4df7-a588-aa7b784a4c19 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:25.450149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e0e1c9fc-6bb0-4df7-a588-aa7b784a4c19 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:25.456261 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0e1c9fc-6bb0-4df7-a588-aa7b784a4c19 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.456703 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0e1c9fc-6bb0-4df7-a588-aa7b784a4c19 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.457469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0e1c9fc-6bb0-4df7-a588-aa7b784a4c19 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.457915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0e1c9fc-6bb0-4df7-a588-aa7b784a4c19 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.606099 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-54329994-eb09-4b78-8b0f-23c52779c839 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:25.615210 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-54329994-eb09-4b78-8b0f-23c52779c839 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1472 microversion: 2.1 time: 0.236343 Jul 25 12:40:25.615793 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 324/596] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:25 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1472 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:25.621139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e7dc0916-a923-45d5-a6a6-5ac05ef5e49e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Action: 'action', calling method: .version_select at 0x7efcfd19e940>, body: {"addFloatingIp": {"address": "172.25.7.37"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:25.623646 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e7dc0916-a923-45d5-a6a6-5ac05ef5e49e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:25.629856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e7dc0916-a923-45d5-a6a6-5ac05ef5e49e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.630345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e7dc0916-a923-45d5-a6a6-5ac05ef5e49e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.631119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e7dc0916-a923-45d5-a6a6-5ac05ef5e49e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.631551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e7dc0916-a923-45d5-a6a6-5ac05ef5e49e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.632105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e0e1c9fc-6bb0-4df7-a588-aa7b784a4c19 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:25.640437 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e0e1c9fc-6bb0-4df7-a588-aa7b784a4c19 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:25.642085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e0e1c9fc-6bb0-4df7-a588-aa7b784a4c19 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:25.643308 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e0e1c9fc-6bb0-4df7-a588-aa7b784a4c19 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 1566 microversion: 2.25 time: 0.197436 Jul 25 12:40:25.657860 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 273/597] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:25 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 1566 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:25.657860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6bd1a6f1-9d51-40d8-8e2f-b5baba9430ac tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:25.657860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6bd1a6f1-9d51-40d8-8e2f-b5baba9430ac tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] [instance: a35d467a-2c77-4821-9799-f7873a144436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:25.657860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6bd1a6f1-9d51-40d8-8e2f-b5baba9430ac tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.658244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6bd1a6f1-9d51-40d8-8e2f-b5baba9430ac tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.658244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6bd1a6f1-9d51-40d8-8e2f-b5baba9430ac tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.658244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6bd1a6f1-9d51-40d8-8e2f-b5baba9430ac tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.674039 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-6bd1a6f1-9d51-40d8-8e2f-b5baba9430ac tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] HTTP exception thrown: Instance a35d467a-2c77-4821-9799-f7873a144436 could not be found. Jul 25 12:40:25.675868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6bd1a6f1-9d51-40d8-8e2f-b5baba9430ac tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Request method failure captured: Jul 25 12:40:25.675868 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436 HTTP/1.1 Jul 25 12:40:25.675868 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:40:25.675868 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:40:25.675868 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:40:25.675868 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:40:25.675868 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:40:25.675868 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:40:25.675868 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:40:25.675868 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:40:25.675868 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o7yUvCGA5FvL8o_3lcoRKgGqPnMxWYXzwlrO8cJf1hiNOm41A9dsaeqyGJH9XIm5PdossudrOKLjEb-kXa_pOjh_n2T88CwFtvNP1uIjEq0aSA5RNCFn9R3DEavD_gSmWVoVwcsJv7y2ksm62nOvFWus1P-JFz9rLcPu-_AL8-OCtk Jul 25 12:40:25.675868 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:40:25.675868 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:40:25.675868 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:40:25.675868 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:40:25.675868 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:40:25.675868 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:40:25.675868 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 441bc4b2a9f241b8bcb74a18e3741ca0 Jul 25 12:40:25.675868 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-LiveMigrationNegativeTest-180151972 Jul 25 12:40:25.675868 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:40:25.675868 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:40:25.677182 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_441bc4b2a9f241b8bcb74a18e3741ca0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/441bc4b2a9f241b8bcb74a18e3741ca0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/441bc4b2a9f241b8bcb74a18e3741ca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/441bc4b2a9f241b8bcb74a18e3741ca0"}]}] Jul 25 12:40:25.677182 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-LiveMigrationNegativeTest-180151972 Jul 25 12:40:25.677182 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 441bc4b2a9f241b8bcb74a18e3741ca0 Jul 25 12:40:25.677182 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-180151972 Jul 25 12:40:25.677182 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-LiveMigrationNegativeTest-180151972-project Jul 25 12:40:25.677182 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:40:25.677182 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:40:25.677182 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 896d3b06fb2446ca99333ce426e52d4b Jul 25 12:40:25.677182 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-LiveMigrationNegativeTest-180151972-project Jul 25 12:40:25.677182 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:40:25.677182 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance a35d467a-2c77-4821-9799-f7873a144436 could not be found. Jul 25 12:40:25.677182 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'a35d467a-2c77-4821-9799-f7873a144436'} Jul 25 12:40:25.678248 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:40:25.678248 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:25.678248 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:40:25.678248 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:40:25.678248 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:40:25.678248 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:40:25.678248 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:40:25.678248 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:40:25.678248 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:40:25.678248 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:40:25.678248 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a35d467a-2c77-4821-9799-f7873a144436 could not be found. Jul 25 12:40:25.678248 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:25.678248 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:25.678248 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:25.678248 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:25.678248 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:25.678248 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:25.678248 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:40:25.678248 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:40:25.678248 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:40:25.679802 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:40:25.679802 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:40:25.679802 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:40:25.679802 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:40:25.679802 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:40:25.679802 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:40:25.679802 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:40:25.679802 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a35d467a-2c77-4821-9799-f7873a144436 could not be found. Jul 25 12:40:25.679802 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:25.679802 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:25.679802 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:25.679802 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:25.679802 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:25.679802 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:25.679802 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:40:25.679802 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:40:25.679802 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a35d467a-2c77-4821-9799-f7873a144436 could not be found. Jul 25 12:40:25.679802 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:25.680984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6bd1a6f1-9d51-40d8-8e2f-b5baba9430ac tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] Returning 404 to user: Instance a35d467a-2c77-4821-9799-f7873a144436 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:40:25.680984 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6bd1a6f1-9d51-40d8-8e2f-b5baba9430ac tempest-LiveMigrationNegativeTest-180151972 tempest-LiveMigrationNegativeTest-180151972-project] 10.222.0.49 "GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436" status: 404 len: 111 microversion: 2.1 time: 0.031891 Jul 25 12:40:25.680984 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 274/598] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:25 2022] GET /compute/v2.1/servers/a35d467a-2c77-4821-9799-f7873a144436 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:40:25.693653 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e0c02eb4-316d-4c4a-b570-d15e1e6912b6 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Calling method '.version_select at 0x7efcfa1e7820>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:25.696614 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:40:25.696614 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:40:25.697869 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0c02eb4-316d-4c4a-b570-d15e1e6912b6 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.698428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0c02eb4-316d-4c4a-b570-d15e1e6912b6 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.704469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e7dc0916-a923-45d5-a6a6-5ac05ef5e49e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Acquired lock "refresh_cache-79221042-a6d8-42f5-8431-5ecfe1fc1972" {{(pid=125883) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 12:40:25.725206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0c02eb4-316d-4c4a-b570-d15e1e6912b6 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.725669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0c02eb4-316d-4c4a-b570-d15e1e6912b6 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.732365 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e0c02eb4-316d-4c4a-b570-d15e1e6912b6 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.045570 Jul 25 12:40:25.733156 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 275/599] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:40:25 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:25.737737 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-a3cf5a6e-1273-46e1-bf46-577291c0d394 req-8f95c4d8-2830-425d-9b24-52edc7884a2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a35d467a-2c77-4821-9799-f7873a144436", "name": "network-vif-deleted", "tag": "896ea210-b59a-4cf5-8f4d-a412adf1854e"}, {"name": "network-changed", "server_uuid": "31a28091-c9d3-44c2-8289-828c66b56c2b", "tag": "5abc676c-0f69-43cf-b469-5e02f591bcab"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:25.748368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a3cf5a6e-1273-46e1-bf46-577291c0d394 req-8f95c4d8-2830-425d-9b24-52edc7884a2a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.749076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a3cf5a6e-1273-46e1-bf46-577291c0d394 req-8f95c4d8-2830-425d-9b24-52edc7884a2a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.763801 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-a3cf5a6e-1273-46e1-bf46-577291c0d394 req-8f95c4d8-2830-425d-9b24-52edc7884a2a service nova] Creating event network-vif-deleted:896ea210-b59a-4cf5-8f4d-a412adf1854e for instance a35d467a-2c77-4821-9799-f7873a144436 on n-h2-848886-15 Jul 25 12:40:25.764288 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-a3cf5a6e-1273-46e1-bf46-577291c0d394 req-8f95c4d8-2830-425d-9b24-52edc7884a2a service nova] Creating event network-changed:5abc676c-0f69-43cf-b469-5e02f591bcab for instance 31a28091-c9d3-44c2-8289-828c66b56c2b on n-h1-848886-15 Jul 25 12:40:25.773366 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-a3cf5a6e-1273-46e1-bf46-577291c0d394 req-8f95c4d8-2830-425d-9b24-52edc7884a2a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.038858 Jul 25 12:40:25.773968 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 276/600] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:25.779441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d38e8bc8-660b-4e35-99af-47ec48e23922 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:25.780134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d38e8bc8-660b-4e35-99af-47ec48e23922 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: fefcb083-ed47-4de2-9c77-0bdb30d0aa6f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:25.786617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d38e8bc8-660b-4e35-99af-47ec48e23922 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.787137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d38e8bc8-660b-4e35-99af-47ec48e23922 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.787874 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d38e8bc8-660b-4e35-99af-47ec48e23922 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.788262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d38e8bc8-660b-4e35-99af-47ec48e23922 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:26.006233 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=8 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:26.028965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=12 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:26.277622 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d38e8bc8-660b-4e35-99af-47ec48e23922 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:26.296617 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d38e8bc8-660b-4e35-99af-47ec48e23922 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f" status: 200 len: 1714 microversion: 2.1 time: 0.521427 Jul 25 12:40:26.297455 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 277/601] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:25 2022] GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f => generated 1714 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:26.302214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-054fd71a-abe2-4325-ada2-f91f20a44567 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Calling method '.version_select at 0x7efcfa4703a0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:26.303559 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:40:26.303559 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:40:26.304974 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-054fd71a-abe2-4325-ada2-f91f20a44567 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:26.305521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-054fd71a-abe2-4325-ada2-f91f20a44567 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:26.318884 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-054fd71a-abe2-4325-ada2-f91f20a44567 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:26.319585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-054fd71a-abe2-4325-ada2-f91f20a44567 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:26.327608 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-054fd71a-abe2-4325-ada2-f91f20a44567 tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.028864 Jul 25 12:40:26.328722 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 278/602] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:40:26 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:26.333774 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-389de834-627d-4562-ab04-5b02bdeddf88 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:26.334413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-389de834-627d-4562-ab04-5b02bdeddf88 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: 913f3154-bc36-46f9-8dda-b29d58dd7903] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:26.340635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-389de834-627d-4562-ab04-5b02bdeddf88 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:26.341818 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-389de834-627d-4562-ab04-5b02bdeddf88 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:26.347974 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-389de834-627d-4562-ab04-5b02bdeddf88 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:26.348824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-389de834-627d-4562-ab04-5b02bdeddf88 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:27.234218 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-389de834-627d-4562-ab04-5b02bdeddf88 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:27.243449 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-389de834-627d-4562-ab04-5b02bdeddf88 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903" status: 200 len: 1307 microversion: 2.1 time: 0.913669 Jul 25 12:40:27.244021 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 279/603] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:26 2022] GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903 => generated 1307 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:27.249430 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e398030e-8177-433f-8053-1499c66b3a2d tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Calling method '.version_select at 0x7efcfa280310>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:27.250778 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:40:27.250778 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:40:27.252396 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e398030e-8177-433f-8053-1499c66b3a2d tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:27.253299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e398030e-8177-433f-8053-1499c66b3a2d tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:27.269325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e398030e-8177-433f-8053-1499c66b3a2d tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:27.270132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e398030e-8177-433f-8053-1499c66b3a2d tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:27.280569 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e398030e-8177-433f-8053-1499c66b3a2d tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:27.281013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e398030e-8177-433f-8053-1499c66b3a2d tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:27.306730 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e398030e-8177-433f-8053-1499c66b3a2d tempest-HypervisorAdminTestJSON-940804791 tempest-HypervisorAdminTestJSON-940804791-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.060817 Jul 25 12:40:27.307426 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 280/604] 10.222.0.49 () {58 vars in 1173 bytes} [Mon Jul 25 12:40:27 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:27.313166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1ed41f66-3a66-4575-a5cb-15426b9511fb tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:27.314314 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1ed41f66-3a66-4575-a5cb-15426b9511fb tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:27.324499 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ed41f66-3a66-4575-a5cb-15426b9511fb tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:27.324954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ed41f66-3a66-4575-a5cb-15426b9511fb tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:27.325747 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ed41f66-3a66-4575-a5cb-15426b9511fb tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:27.326215 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ed41f66-3a66-4575-a5cb-15426b9511fb tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:27.765577 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1ed41f66-3a66-4575-a5cb-15426b9511fb tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:27.772226 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1ed41f66-3a66-4575-a5cb-15426b9511fb tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 200 len: 1494 microversion: 2.1 time: 0.463155 Jul 25 12:40:27.787701 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 281/605] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:27 2022] GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 1494 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:27.792893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d68ab44b-b5e2-4fcc-b3f4-bf342dc567b4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:27.793860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d68ab44b-b5e2-4fcc-b3f4-bf342dc567b4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:27.800827 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d68ab44b-b5e2-4fcc-b3f4-bf342dc567b4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:27.801472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d68ab44b-b5e2-4fcc-b3f4-bf342dc567b4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:27.802575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d68ab44b-b5e2-4fcc-b3f4-bf342dc567b4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:27.803148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d68ab44b-b5e2-4fcc-b3f4-bf342dc567b4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:28.245385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d68ab44b-b5e2-4fcc-b3f4-bf342dc567b4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:28.253309 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d68ab44b-b5e2-4fcc-b3f4-bf342dc567b4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1472 microversion: 2.1 time: 0.464199 Jul 25 12:40:28.254170 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 282/606] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:27 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1472 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:28.272541 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-95a1ef2e-6fc1-48ad-a43a-70f862ad7197 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:28.273414 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-95a1ef2e-6fc1-48ad-a43a-70f862ad7197 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:28.280760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95a1ef2e-6fc1-48ad-a43a-70f862ad7197 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:28.281519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95a1ef2e-6fc1-48ad-a43a-70f862ad7197 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:28.282551 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95a1ef2e-6fc1-48ad-a43a-70f862ad7197 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:28.283229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95a1ef2e-6fc1-48ad-a43a-70f862ad7197 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:28.959673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-95a1ef2e-6fc1-48ad-a43a-70f862ad7197 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:28.971658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-95a1ef2e-6fc1-48ad-a43a-70f862ad7197 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:28.974409 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-95a1ef2e-6fc1-48ad-a43a-70f862ad7197 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:28.976933 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-95a1ef2e-6fc1-48ad-a43a-70f862ad7197 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 1566 microversion: 2.25 time: 0.709787 Jul 25 12:40:28.977653 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 283/607] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:28 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 1566 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:28.986059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-c57b63ec-911d-47fc-a28b-db0c5adbdbef req-3acc9b87-ad14-4f05-aeb9-e3fb8c52a9ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "913f3154-bc36-46f9-8dda-b29d58dd7903", "name": "network-vif-plugged", "status": "completed", "tag": "20e3356f-efe0-42e1-8e21-b04bba18de4c"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:29.000888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c57b63ec-911d-47fc-a28b-db0c5adbdbef req-3acc9b87-ad14-4f05-aeb9-e3fb8c52a9ad service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:29.002185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c57b63ec-911d-47fc-a28b-db0c5adbdbef req-3acc9b87-ad14-4f05-aeb9-e3fb8c52a9ad service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:29.023406 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-c57b63ec-911d-47fc-a28b-db0c5adbdbef req-3acc9b87-ad14-4f05-aeb9-e3fb8c52a9ad service nova] Creating event network-vif-plugged:20e3356f-efe0-42e1-8e21-b04bba18de4c for instance 913f3154-bc36-46f9-8dda-b29d58dd7903 on n-h2-848886-15 Jul 25 12:40:29.029820 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-c57b63ec-911d-47fc-a28b-db0c5adbdbef req-3acc9b87-ad14-4f05-aeb9-e3fb8c52a9ad service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050636 Jul 25 12:40:29.031367 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 284/608] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:29.043657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-672d2068-3024-4172-ba89-23d20dc7c996 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:29.044655 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-672d2068-3024-4172-ba89-23d20dc7c996 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: fefcb083-ed47-4de2-9c77-0bdb30d0aa6f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:29.052476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-672d2068-3024-4172-ba89-23d20dc7c996 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:29.053617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-672d2068-3024-4172-ba89-23d20dc7c996 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:29.054983 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-672d2068-3024-4172-ba89-23d20dc7c996 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:29.055583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-672d2068-3024-4172-ba89-23d20dc7c996 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:29.186705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-672d2068-3024-4172-ba89-23d20dc7c996 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5e681ba263436099656b879c77162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ded56ca1da44b65a227d978f927d9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:29.205695 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-672d2068-3024-4172-ba89-23d20dc7c996 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f" status: 200 len: 1646 microversion: 2.1 time: 0.167061 Jul 25 12:40:29.206462 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 285/609] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:29 2022] GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f => generated 1646 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:29.221921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-36a6f092-b5c6-49e0-afd7-42986d2bf3ab tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:29.222476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-36a6f092-b5c6-49e0-afd7-42986d2bf3ab tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:29.228777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36a6f092-b5c6-49e0-afd7-42986d2bf3ab tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:29.242504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36a6f092-b5c6-49e0-afd7-42986d2bf3ab tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:29.243449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36a6f092-b5c6-49e0-afd7-42986d2bf3ab tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:29.243904 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36a6f092-b5c6-49e0-afd7-42986d2bf3ab tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:29.932010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-e7dc0916-a923-45d5-a6a6-5ac05ef5e49e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Building network info cache for instance {{(pid=125883) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 12:40:29.943364 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-36a6f092-b5c6-49e0-afd7-42986d2bf3ab tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 200 len: 1647 microversion: 2.1 time: 0.735817 Jul 25 12:40:29.943965 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 286/610] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:29 2022] GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 1647 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:29.964968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-1cd5922e-8043-4448-90b0-a4941680cb20 req-c70064c7-e930-4683-bd07-c02424ddc27e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a28091-c9d3-44c2-8289-828c66b56c2b", "name": "network-vif-unplugged", "status": "completed", "tag": "5abc676c-0f69-43cf-b469-5e02f591bcab"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:29.993868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-1cd5922e-8043-4448-90b0-a4941680cb20 req-c70064c7-e930-4683-bd07-c02424ddc27e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:29.994313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-1cd5922e-8043-4448-90b0-a4941680cb20 req-c70064c7-e930-4683-bd07-c02424ddc27e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:30.012242 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-1cd5922e-8043-4448-90b0-a4941680cb20 req-c70064c7-e930-4683-bd07-c02424ddc27e service nova] Creating event network-vif-unplugged:5abc676c-0f69-43cf-b469-5e02f591bcab for instance 31a28091-c9d3-44c2-8289-828c66b56c2b on n-h2-848886-15 Jul 25 12:40:30.022030 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-1cd5922e-8043-4448-90b0-a4941680cb20 req-c70064c7-e930-4683-bd07-c02424ddc27e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060527 Jul 25 12:40:30.023061 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 287/611] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:30.029349 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2abb5e25-3021-4cf8-981e-bff5c7466745 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:30.030234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2abb5e25-3021-4cf8-981e-bff5c7466745 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: 913f3154-bc36-46f9-8dda-b29d58dd7903] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:30.036941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2abb5e25-3021-4cf8-981e-bff5c7466745 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:30.037477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2abb5e25-3021-4cf8-981e-bff5c7466745 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:30.038763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2abb5e25-3021-4cf8-981e-bff5c7466745 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:30.040008 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2abb5e25-3021-4cf8-981e-bff5c7466745 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:30.378253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2abb5e25-3021-4cf8-981e-bff5c7466745 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:30.387517 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2abb5e25-3021-4cf8-981e-bff5c7466745 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903" status: 200 len: 1307 microversion: 2.1 time: 0.362903 Jul 25 12:40:30.406832 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 288/612] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:30 2022] GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903 => generated 1307 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:30.799548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2d75cc1d-230b-4a02-9117-b77093d90d84 tempest-NetworksTest-2045126285 tempest-NetworksTest-2045126285-project-admin] Calling method '.version_select at 0x7efcfa040940>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:31.013518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-e7dc0916-a923-45d5-a6a6-5ac05ef5e49e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Updating instance_info_cache with network_info: [{"id": "c946b3f1-88fd-42a0-a6b5-cb0bde2dca0b", "address": "fa:16:3e:93:7e:3d", "network": {"id": "3d3f75ac-0896-4f36-8b3a-23fa2957e06c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1075994112-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5334f5e32ffb4d49a20d4b7e532cd16e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc946b3f1-88", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125883) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 12:40:31.021877 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2d75cc1d-230b-4a02-9117-b77093d90d84 tempest-NetworksTest-2045126285 tempest-NetworksTest-2045126285-project-admin] 10.222.0.49 "GET /compute/v2.1/os-networks" status: 200 len: 7440 microversion: 2.1 time: 0.613256 Jul 25 12:40:31.022741 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 289/613] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:40:30 2022] GET /compute/v2.1/os-networks => generated 7440 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:31.031282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9cc1be57-3447-4a86-994b-7de1510120f3 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:31.032237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9cc1be57-3447-4a86-994b-7de1510120f3 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:31.034017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e7dc0916-a923-45d5-a6a6-5ac05ef5e49e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Releasing lock "refresh_cache-79221042-a6d8-42f5-8431-5ecfe1fc1972" {{(pid=125883) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 12:40:31.035303 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e7dc0916-a923-45d5-a6a6-5ac05ef5e49e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "POST /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972/action" status: 202 len: 0 microversion: 2.1 time: 5.418581 Jul 25 12:40:31.036151 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 325/614] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:40:25 2022] POST /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972/action => generated 0 bytes in 5420 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 12:40:31.044887 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-2b5415ec-7154-4729-8fd4-f9d2ffc04275 req-527fb70e-3896-4cf9-8f7e-34a936cf09a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefcb083-ed47-4de2-9c77-0bdb30d0aa6f", "name": "network-vif-deleted", "tag": "3ebd7fbe-3aa1-4cae-a6fe-f0d6422bd74b"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:31.051553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9cc1be57-3447-4a86-994b-7de1510120f3 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:31.052618 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9cc1be57-3447-4a86-994b-7de1510120f3 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:31.054051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9cc1be57-3447-4a86-994b-7de1510120f3 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:31.054998 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9cc1be57-3447-4a86-994b-7de1510120f3 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:31.056369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:31.058916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2b5415ec-7154-4729-8fd4-f9d2ffc04275 req-527fb70e-3896-4cf9-8f7e-34a936cf09a6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:31.059405 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2b5415ec-7154-4729-8fd4-f9d2ffc04275 req-527fb70e-3896-4cf9-8f7e-34a936cf09a6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:31.073198 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-2b5415ec-7154-4729-8fd4-f9d2ffc04275 req-527fb70e-3896-4cf9-8f7e-34a936cf09a6 service nova] Creating event network-vif-deleted:3ebd7fbe-3aa1-4cae-a6fe-f0d6422bd74b for instance fefcb083-ed47-4de2-9c77-0bdb30d0aa6f on n-h2-848886-15 Jul 25 12:40:31.080818 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-2b5415ec-7154-4729-8fd4-f9d2ffc04275 req-527fb70e-3896-4cf9-8f7e-34a936cf09a6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043093 Jul 25 12:40:31.082023 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 326/615] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:31.087739 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e867dd45-a229-4f02-900c-0475737f6252 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:31.088625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e867dd45-a229-4f02-900c-0475737f6252 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:31.097249 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e867dd45-a229-4f02-900c-0475737f6252 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:31.098029 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e867dd45-a229-4f02-900c-0475737f6252 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:31.099338 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e867dd45-a229-4f02-900c-0475737f6252 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:31.099931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e867dd45-a229-4f02-900c-0475737f6252 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:31.349099 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9cc1be57-3447-4a86-994b-7de1510120f3 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:31.359291 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9cc1be57-3447-4a86-994b-7de1510120f3 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1477 microversion: 2.1 time: 0.335259 Jul 25 12:40:31.360524 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 290/616] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:31 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1477 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:31.366479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d8a0354d-c7b9-46b0-8bef-26294bb3284b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:31.367283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d8a0354d-c7b9-46b0-8bef-26294bb3284b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:31.374322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8a0354d-c7b9-46b0-8bef-26294bb3284b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:31.375014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8a0354d-c7b9-46b0-8bef-26294bb3284b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:31.375986 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8a0354d-c7b9-46b0-8bef-26294bb3284b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:31.376426 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8a0354d-c7b9-46b0-8bef-26294bb3284b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:31.395706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:31.398772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:31.406414 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e867dd45-a229-4f02-900c-0475737f6252 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 200 len: 1647 microversion: 2.1 time: 0.322620 Jul 25 12:40:31.407717 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 327/617] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:31 2022] GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 1647 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:31.416910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-216dd40e-474c-4895-ade0-972e180dad3e tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:31.418188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-216dd40e-474c-4895-ade0-972e180dad3e tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: fefcb083-ed47-4de2-9c77-0bdb30d0aa6f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:31.427708 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-216dd40e-474c-4895-ade0-972e180dad3e tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:31.428184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-216dd40e-474c-4895-ade0-972e180dad3e tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:31.429283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-216dd40e-474c-4895-ade0-972e180dad3e tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:31.430012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-216dd40e-474c-4895-ade0-972e180dad3e tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:31.449003 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-216dd40e-474c-4895-ade0-972e180dad3e tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] HTTP exception thrown: Instance fefcb083-ed47-4de2-9c77-0bdb30d0aa6f could not be found. Jul 25 12:40:31.450884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-216dd40e-474c-4895-ade0-972e180dad3e tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Request method failure captured: Jul 25 12:40:31.450884 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f HTTP/1.1 Jul 25 12:40:31.450884 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:40:31.450884 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:40:31.450884 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:40:31.450884 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:40:31.450884 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:40:31.450884 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:40:31.450884 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:40:31.450884 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:40:31.450884 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o6l-_kjeNz_QitF46heNqtCNpxvnIwUOok7JnEwWAK6QqmxvVJj-kVaw259iNWhYbGietFE2cK8hPKs44r3gP0622qFvzzbcC_pFKSjA1uUCa2ezyDaoRCgWVlb1RdMmlnTyOoyK4F2hp9L442SAw94rdhWG7bwtaSy43LIRc2fnig Jul 25 12:40:31.450884 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:40:31.450884 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:40:31.450884 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:40:31.450884 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:40:31.450884 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:40:31.450884 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:40:31.450884 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 4ded56ca1da44b65a227d978f927d9db Jul 25 12:40:31.450884 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-21156428 Jul 25 12:40:31.450884 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:40:31.450884 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:40:31.452700 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4ded56ca1da44b65a227d978f927d9db", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4ded56ca1da44b65a227d978f927d9db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ded56ca1da44b65a227d978f927d9db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ded56ca1da44b65a227d978f927d9db"}]}] Jul 25 12:40:31.452700 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-21156428 Jul 25 12:40:31.452700 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 4ded56ca1da44b65a227d978f927d9db Jul 25 12:40:31.452700 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-21156428 Jul 25 12:40:31.452700 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersWithSpecificFlavorTestJSON-21156428-project Jul 25 12:40:31.452700 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:40:31.452700 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:40:31.452700 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: ef5e681ba263436099656b879c77162b Jul 25 12:40:31.452700 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-21156428-project Jul 25 12:40:31.452700 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:40:31.452700 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance fefcb083-ed47-4de2-9c77-0bdb30d0aa6f could not be found. Jul 25 12:40:31.452700 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'fefcb083-ed47-4de2-9c77-0bdb30d0aa6f'} Jul 25 12:40:31.453623 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:40:31.453623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:31.453623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:40:31.453623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:40:31.453623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:40:31.453623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:40:31.453623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:40:31.453623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:40:31.453623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:40:31.453623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:40:31.453623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fefcb083-ed47-4de2-9c77-0bdb30d0aa6f could not be found. Jul 25 12:40:31.453623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:31.453623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:31.453623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:31.453623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:31.453623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:31.453623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:31.453623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:40:31.453623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:40:31.453623 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:40:31.455101 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:40:31.455101 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:40:31.455101 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:40:31.455101 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:40:31.455101 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:40:31.455101 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:40:31.455101 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:40:31.455101 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fefcb083-ed47-4de2-9c77-0bdb30d0aa6f could not be found. Jul 25 12:40:31.455101 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:31.455101 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:31.455101 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:31.455101 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:31.455101 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:31.455101 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:31.455101 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:40:31.455101 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:40:31.455101 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fefcb083-ed47-4de2-9c77-0bdb30d0aa6f could not be found. Jul 25 12:40:31.455101 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:31.456461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-216dd40e-474c-4895-ade0-972e180dad3e tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Returning 404 to user: Instance fefcb083-ed47-4de2-9c77-0bdb30d0aa6f could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:40:31.457064 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-216dd40e-474c-4895-ade0-972e180dad3e tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f" status: 404 len: 111 microversion: 2.1 time: 0.047336 Jul 25 12:40:31.460930 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 328/618] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:31 2022] GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:40:31.463694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b8f7479f-17d2-414d-9b1a-1513f49a7ac3 tempest-NetworksTest-2045126285 tempest-NetworksTest-2045126285-project-admin] Calling method '.version_select at 0x7efcf9e35790>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:31.624892 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b8f7479f-17d2-414d-9b1a-1513f49a7ac3 tempest-NetworksTest-2045126285 tempest-NetworksTest-2045126285-project-admin] 10.222.0.49 "GET /compute/v2.1/os-networks/76609c4e-8da9-4b0d-a062-dffca4d9d957" status: 200 len: 652 microversion: 2.1 time: 0.165472 Jul 25 12:40:31.629810 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 329/619] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Jul 25 12:40:31 2022] GET /compute/v2.1/os-networks/76609c4e-8da9-4b0d-a062-dffca4d9d957 => generated 652 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:31.630286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d8a0354d-c7b9-46b0-8bef-26294bb3284b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:31.637781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-75fcb0c2-c5d3-46f2-98cf-a180cc26ac66 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Action: 'create', calling method: .version_select at 0x7efcfa0231f0>, body: {"pool": "76609c4e-8da9-4b0d-a062-dffca4d9d957"} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:31.638731 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d8a0354d-c7b9-46b0-8bef-26294bb3284b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:31.640415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d8a0354d-c7b9-46b0-8bef-26294bb3284b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:31.641667 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d8a0354d-c7b9-46b0-8bef-26294bb3284b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 1541 microversion: 2.25 time: 0.279982 Jul 25 12:40:31.642325 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 291/620] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:31 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 1541 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:31.651951 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-325c2402-1511-4477-a52b-37f76bf259d5 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:31.652566 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-325c2402-1511-4477-a52b-37f76bf259d5 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: 913f3154-bc36-46f9-8dda-b29d58dd7903] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:31.659739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-325c2402-1511-4477-a52b-37f76bf259d5 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:31.660198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-325c2402-1511-4477-a52b-37f76bf259d5 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:31.660976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-325c2402-1511-4477-a52b-37f76bf259d5 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:31.661995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-325c2402-1511-4477-a52b-37f76bf259d5 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:31.869487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-325c2402-1511-4477-a52b-37f76bf259d5 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:31.878528 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-325c2402-1511-4477-a52b-37f76bf259d5 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903" status: 200 len: 1487 microversion: 2.1 time: 0.234894 Jul 25 12:40:31.879181 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 292/621] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:31 2022] GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903 => generated 1487 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:31.883821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-570cb853-a3d8-4295-84b6-1cd1ed826ccb tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:31.886610 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:40:31.886610 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:40:31.895138 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-570cb853-a3d8-4295-84b6-1cd1ed826ccb tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:31.897540 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-570cb853-a3d8-4295-84b6-1cd1ed826ccb tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:31.898378 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-570cb853-a3d8-4295-84b6-1cd1ed826ccb tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:31.898995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-570cb853-a3d8-4295-84b6-1cd1ed826ccb tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:31.925989 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-570cb853-a3d8-4295-84b6-1cd1ed826ccb tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.045466 Jul 25 12:40:31.933329 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 293/622] 10.222.0.49 () {58 vars in 1176 bytes} [Mon Jul 25 12:40:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:31.933329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d2bab576-2fe4-49f1-b605-cfe085695050 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:31.933329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d2bab576-2fe4-49f1-b605-cfe085695050 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:31.939872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2bab576-2fe4-49f1-b605-cfe085695050 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:31.940396 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2bab576-2fe4-49f1-b605-cfe085695050 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:31.941185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2bab576-2fe4-49f1-b605-cfe085695050 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:31.941620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2bab576-2fe4-49f1-b605-cfe085695050 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:31.955786 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-d2bab576-2fe4-49f1-b605-cfe085695050 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] HTTP exception thrown: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. Jul 25 12:40:31.957428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d2bab576-2fe4-49f1-b605-cfe085695050 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Request method failure captured: Jul 25 12:40:31.957428 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 HTTP/1.1 Jul 25 12:40:31.957428 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:40:31.957428 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:40:31.957428 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:40:31.957428 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:40:31.957428 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:40:31.957428 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:40:31.957428 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:40:31.957428 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:40:31.957428 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o6l-_kjeNz_QitF46heNqtCNpxvnIwUOok7JnEwWAK6QqmxvVJj-kVaw259iNWhYbGietFE2cK8hPKs44r3gP0622qFvzzbcC_pFKSjA1uUCa2ezyDaoRCgWVlb1RdMmlnTyOoyK4F2hp9L442SAw94rdhWG7bwtaSy43LIRc2fnig Jul 25 12:40:31.957428 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:40:31.957428 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:40:31.957428 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:40:31.957428 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:40:31.957428 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:40:31.957428 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:40:31.957428 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 4ded56ca1da44b65a227d978f927d9db Jul 25 12:40:31.957428 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-21156428 Jul 25 12:40:31.957428 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:40:31.957428 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:40:31.959056 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4ded56ca1da44b65a227d978f927d9db", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4ded56ca1da44b65a227d978f927d9db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ded56ca1da44b65a227d978f927d9db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ded56ca1da44b65a227d978f927d9db"}]}] Jul 25 12:40:31.959056 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-21156428 Jul 25 12:40:31.959056 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 4ded56ca1da44b65a227d978f927d9db Jul 25 12:40:31.959056 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-21156428 Jul 25 12:40:31.959056 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersWithSpecificFlavorTestJSON-21156428-project Jul 25 12:40:31.959056 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:40:31.959056 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:40:31.959056 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: ef5e681ba263436099656b879c77162b Jul 25 12:40:31.959056 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-21156428-project Jul 25 12:40:31.959056 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:40:31.959056 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. Jul 25 12:40:31.959056 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '36fa069d-9aaa-4804-a21f-8526cbe9d728'} Jul 25 12:40:31.960307 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:40:31.960307 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:31.960307 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:40:31.960307 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:40:31.960307 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:40:31.960307 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:40:31.960307 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:40:31.960307 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:40:31.960307 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:40:31.960307 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:40:31.960307 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. Jul 25 12:40:31.960307 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:31.960307 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:31.960307 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:31.960307 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:31.960307 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:31.960307 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:31.960307 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:40:31.960307 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:40:31.960307 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:40:31.961445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:40:31.961445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:40:31.961445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:40:31.961445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:40:31.961445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:40:31.961445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:40:31.961445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:40:31.961445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:40:31.961445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:40:31.961445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. Jul 25 12:40:31.961445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:31.961445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:31.961445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:31.961445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:31.961445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:31.961445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:31.961445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:40:31.961445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:40:31.961445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. Jul 25 12:40:31.961445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:31.962740 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d2bab576-2fe4-49f1-b605-cfe085695050 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Returning 404 to user: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:40:31.962740 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d2bab576-2fe4-49f1-b605-cfe085695050 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "DELETE /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 404 len: 111 microversion: 2.1 time: 0.031050 Jul 25 12:40:31.962740 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 294/623] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:40:31 2022] DELETE /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:40:31.968468 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-44ca53a7-16c3-4b4e-82f0-53595bfa15ae tempest-NetworksTest-2045126285 tempest-NetworksTest-2045126285-project-admin] Calling method '.version_select at 0x7efcfa07d670>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:32.211486 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-44ca53a7-16c3-4b4e-82f0-53595bfa15ae tempest-NetworksTest-2045126285 tempest-NetworksTest-2045126285-project-admin] 10.222.0.49 "GET /compute/v2.1/os-networks" status: 200 len: 7440 microversion: 2.1 time: 0.251057 Jul 25 12:40:32.212334 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 295/624] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:40:31 2022] GET /compute/v2.1/os-networks => generated 7440 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:32.221164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fe26a936-b176-4ddc-909a-40b6e5d22515 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Calling method '.version_select at 0x7efcfa096280>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:32.225199 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fe26a936-b176-4ddc-909a-40b6e5d22515 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:32.225651 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fe26a936-b176-4ddc-909a-40b6e5d22515 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:32.238884 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fe26a936-b176-4ddc-909a-40b6e5d22515 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 2141 microversion: 2.25 time: 0.025695 Jul 25 12:40:32.239460 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 296/625] 10.222.0.49 () {60 vars in 1184 bytes} [Mon Jul 25 12:40:32 2022] GET /compute/v2.1/os-migrations => generated 2141 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:32.244181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5dd9264b-0837-4b0b-a7a0-653255475d3c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:32.244779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5dd9264b-0837-4b0b-a7a0-653255475d3c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: 913f3154-bc36-46f9-8dda-b29d58dd7903] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:32.253550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5dd9264b-0837-4b0b-a7a0-653255475d3c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:32.254041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5dd9264b-0837-4b0b-a7a0-653255475d3c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:32.254876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5dd9264b-0837-4b0b-a7a0-653255475d3c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:32.255311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5dd9264b-0837-4b0b-a7a0-653255475d3c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:32.332252 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5dd9264b-0837-4b0b-a7a0-653255475d3c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "POST /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903/action" status: 202 len: 0 microversion: 2.1 time: 0.091120 Jul 25 12:40:32.333151 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 297/626] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:40:32 2022] POST /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:40:32.344736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3c1360fd-4ebc-44e4-bc3d-57d5b8cdd4ec tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:32.345441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3c1360fd-4ebc-44e4-bc3d-57d5b8cdd4ec tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:32.354099 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3c1360fd-4ebc-44e4-bc3d-57d5b8cdd4ec tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:32.354851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3c1360fd-4ebc-44e4-bc3d-57d5b8cdd4ec tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:32.355785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3c1360fd-4ebc-44e4-bc3d-57d5b8cdd4ec tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:32.356270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3c1360fd-4ebc-44e4-bc3d-57d5b8cdd4ec tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:32.455370 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3c1360fd-4ebc-44e4-bc3d-57d5b8cdd4ec tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5/action" status: 202 len: 0 microversion: 2.1 time: 0.120602 Jul 25 12:40:32.457145 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 298/627] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:40:32 2022] POST /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:40:32.473795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-10804f53-f7f5-4469-bba9-6cd6dbf0aab5 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:32.474998 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-10804f53-f7f5-4469-bba9-6cd6dbf0aab5 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:32.483264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10804f53-f7f5-4469-bba9-6cd6dbf0aab5 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:32.483942 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10804f53-f7f5-4469-bba9-6cd6dbf0aab5 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:32.485701 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10804f53-f7f5-4469-bba9-6cd6dbf0aab5 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:32.486804 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10804f53-f7f5-4469-bba9-6cd6dbf0aab5 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:32.505424 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-10804f53-f7f5-4469-bba9-6cd6dbf0aab5 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] HTTP exception thrown: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. Jul 25 12:40:32.507495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-10804f53-f7f5-4469-bba9-6cd6dbf0aab5 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Request method failure captured: Jul 25 12:40:32.507495 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 HTTP/1.1 Jul 25 12:40:32.507495 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:40:32.507495 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:40:32.507495 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:40:32.507495 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:40:32.507495 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:40:32.507495 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:40:32.507495 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:40:32.507495 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:40:32.507495 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o6l-_kjeNz_QitF46heNqtCNpxvnIwUOok7JnEwWAK6QqmxvVJj-kVaw259iNWhYbGietFE2cK8hPKs44r3gP0622qFvzzbcC_pFKSjA1uUCa2ezyDaoRCgWVlb1RdMmlnTyOoyK4F2hp9L442SAw94rdhWG7bwtaSy43LIRc2fnig Jul 25 12:40:32.507495 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:40:32.507495 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:40:32.507495 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:40:32.507495 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:40:32.507495 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:40:32.507495 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:40:32.507495 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 4ded56ca1da44b65a227d978f927d9db Jul 25 12:40:32.507495 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-21156428 Jul 25 12:40:32.507495 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:40:32.507495 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:40:32.509007 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4ded56ca1da44b65a227d978f927d9db", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4ded56ca1da44b65a227d978f927d9db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ded56ca1da44b65a227d978f927d9db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ded56ca1da44b65a227d978f927d9db"}]}] Jul 25 12:40:32.509007 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-21156428 Jul 25 12:40:32.509007 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 4ded56ca1da44b65a227d978f927d9db Jul 25 12:40:32.509007 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-21156428 Jul 25 12:40:32.509007 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersWithSpecificFlavorTestJSON-21156428-project Jul 25 12:40:32.509007 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:40:32.509007 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:40:32.509007 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: ef5e681ba263436099656b879c77162b Jul 25 12:40:32.509007 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-21156428-project Jul 25 12:40:32.509007 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:40:32.509007 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. Jul 25 12:40:32.509007 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '36fa069d-9aaa-4804-a21f-8526cbe9d728'} Jul 25 12:40:32.509959 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:40:32.509959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:32.509959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:40:32.509959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:40:32.509959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:40:32.509959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:40:32.509959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:40:32.509959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:40:32.509959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:40:32.509959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:40:32.509959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. Jul 25 12:40:32.509959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:32.509959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:32.509959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:32.509959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:32.509959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:32.509959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:32.509959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:40:32.509959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:40:32.509959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:40:32.511379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:40:32.511379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:40:32.511379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:40:32.511379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:40:32.511379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:40:32.511379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:40:32.511379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:40:32.511379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. Jul 25 12:40:32.511379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:32.511379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:32.511379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:32.511379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:32.511379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:32.511379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:32.511379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:40:32.511379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:40:32.511379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. Jul 25 12:40:32.511379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:32.514171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-10804f53-f7f5-4469-bba9-6cd6dbf0aab5 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Returning 404 to user: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:40:32.515271 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-10804f53-f7f5-4469-bba9-6cd6dbf0aab5 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 404 len: 111 microversion: 2.1 time: 0.056783 Jul 25 12:40:32.519508 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 299/628] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:32 2022] GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:40:32.791112 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-65754a5f-b935-4d0b-afae-00a60015c5b0 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Calling method '.version_select at 0x7efcfa22d310>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:32.794683 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:40:32.794683 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:40:32.798085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65754a5f-b935-4d0b-afae-00a60015c5b0 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:32.798738 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65754a5f-b935-4d0b-afae-00a60015c5b0 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:32.818442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65754a5f-b935-4d0b-afae-00a60015c5b0 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:32.818987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65754a5f-b935-4d0b-afae-00a60015c5b0 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:32.866684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65754a5f-b935-4d0b-afae-00a60015c5b0 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:32.867144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65754a5f-b935-4d0b-afae-00a60015c5b0 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:32.878532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65754a5f-b935-4d0b-afae-00a60015c5b0 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:32.878972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65754a5f-b935-4d0b-afae-00a60015c5b0 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:32.905748 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65754a5f-b935-4d0b-afae-00a60015c5b0 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:32.906188 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65754a5f-b935-4d0b-afae-00a60015c5b0 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:32.913211 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-65754a5f-b935-4d0b-afae-00a60015c5b0 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2235 microversion: 2.53 time: 0.392282 Jul 25 12:40:32.913784 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 300/629] 10.222.0.49 () {60 vars in 1243 bytes} [Mon Jul 25 12:40:32 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2235 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:32.930998 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ae2d3342-d6bf-439c-b6fc-23a8e642b7a5 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:32.931830 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ae2d3342-d6bf-439c-b6fc-23a8e642b7a5 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:32.939517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae2d3342-d6bf-439c-b6fc-23a8e642b7a5 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:32.940184 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae2d3342-d6bf-439c-b6fc-23a8e642b7a5 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:32.940784 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae2d3342-d6bf-439c-b6fc-23a8e642b7a5 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:32.941217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae2d3342-d6bf-439c-b6fc-23a8e642b7a5 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.102377 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-75fcb0c2-c5d3-46f2-98cf-a180cc26ac66 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.475433 Jul 25 12:40:33.103084 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 330/630] 10.222.0.49 () {60 vars in 1170 bytes} [Mon Jul 25 12:40:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:33.109058 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2f91a90f-ced1-4b66-b552-3315b9477a7d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:33.109927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2f91a90f-ced1-4b66-b552-3315b9477a7d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: 913f3154-bc36-46f9-8dda-b29d58dd7903] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:33.117585 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f91a90f-ced1-4b66-b552-3315b9477a7d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.118062 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f91a90f-ced1-4b66-b552-3315b9477a7d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.119034 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f91a90f-ced1-4b66-b552-3315b9477a7d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.119451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f91a90f-ced1-4b66-b552-3315b9477a7d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.147106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-ae2d3342-d6bf-439c-b6fc-23a8e642b7a5 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lazy-loading 'services' on Instance uuid 31a28091-c9d3-44c2-8289-828c66b56c2b {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:40:33.162140 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ae2d3342-d6bf-439c-b6fc-23a8e642b7a5 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 2035 microversion: 2.25 time: 0.243214 Jul 25 12:40:33.163183 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 301/631] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:32 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 2035 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:33.167693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-29428d0c-1a7b-4cd0-8465-ddc214c38f00 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:33.168482 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-29428d0c-1a7b-4cd0-8465-ddc214c38f00 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:33.187623 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29428d0c-1a7b-4cd0-8465-ddc214c38f00 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.188085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29428d0c-1a7b-4cd0-8465-ddc214c38f00 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.189014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29428d0c-1a7b-4cd0-8465-ddc214c38f00 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.189443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29428d0c-1a7b-4cd0-8465-ddc214c38f00 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.332050 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2f91a90f-ced1-4b66-b552-3315b9477a7d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:33.342933 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2f91a90f-ced1-4b66-b552-3315b9477a7d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903" status: 200 len: 1472 microversion: 2.1 time: 0.238026 Jul 25 12:40:33.344391 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 331/632] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:33 2022] GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903 => generated 1472 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:33.349493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5d4749c0-9e8b-4924-8b47-6f0c6047468c tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:33.350453 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5d4749c0-9e8b-4924-8b47-6f0c6047468c tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:33.357418 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d4749c0-9e8b-4924-8b47-6f0c6047468c tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.358030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d4749c0-9e8b-4924-8b47-6f0c6047468c tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.359171 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d4749c0-9e8b-4924-8b47-6f0c6047468c tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.359675 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d4749c0-9e8b-4924-8b47-6f0c6047468c tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.375409 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-29428d0c-1a7b-4cd0-8465-ddc214c38f00 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:33.383989 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-29428d0c-1a7b-4cd0-8465-ddc214c38f00 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1477 microversion: 2.1 time: 0.219763 Jul 25 12:40:33.384649 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 302/633] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:33 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1477 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:33.394919 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7203b62f-0801-4d13-8399-fcad5499631c tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '.version_select at 0x7efcfa07d550>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:33.419904 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7203b62f-0801-4d13-8399-fcad5499631c tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1722192819" status: 202 len: 0 microversion: 2.1 time: 0.033531 Jul 25 12:40:33.420969 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 303/634] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Jul 25 12:40:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1722192819 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:40:33.428677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2741f0c6-ccb5-4309-9283-530ac7f927d9 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Calling method '.version_select at 0x7efcfa054b80>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:33.431722 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:40:33.431722 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:40:33.433230 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2741f0c6-ccb5-4309-9283-530ac7f927d9 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.433747 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2741f0c6-ccb5-4309-9283-530ac7f927d9 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.453888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2741f0c6-ccb5-4309-9283-530ac7f927d9 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.454387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2741f0c6-ccb5-4309-9283-530ac7f927d9 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.487855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2741f0c6-ccb5-4309-9283-530ac7f927d9 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.488309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2741f0c6-ccb5-4309-9283-530ac7f927d9 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.498788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2741f0c6-ccb5-4309-9283-530ac7f927d9 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.499229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2741f0c6-ccb5-4309-9283-530ac7f927d9 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.508216 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5d4749c0-9e8b-4924-8b47-6f0c6047468c tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 200 len: 1632 microversion: 2.1 time: 0.162486 Jul 25 12:40:33.509160 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 332/635] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:33 2022] GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 1632 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:33.524306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2741f0c6-ccb5-4309-9283-530ac7f927d9 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.524761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2741f0c6-ccb5-4309-9283-530ac7f927d9 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.527313 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-8e754451-ee96-4efc-bd91-bfcda3bc07cc req-35e8329d-5ded-468b-a99d-6206db3c3e78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79221042-a6d8-42f5-8431-5ecfe1fc1972", "tag": "c946b3f1-88fd-42a0-a6b5-cb0bde2dca0b"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:33.531510 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2741f0c6-ccb5-4309-9283-530ac7f927d9 tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 925 microversion: 2.53 time: 0.109224 Jul 25 12:40:33.532392 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 304/636] 10.222.0.49 () {60 vars in 1222 bytes} [Mon Jul 25 12:40:33 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 925 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:40:33.540624 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-8e754451-ee96-4efc-bd91-bfcda3bc07cc req-35e8329d-5ded-468b-a99d-6206db3c3e78 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.541288 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-8e754451-ee96-4efc-bd91-bfcda3bc07cc req-35e8329d-5ded-468b-a99d-6206db3c3e78 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.543072 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f75cc62e-67ba-48e8-8a1a-8e592f18b187 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Action: 'action', calling method: .version_select at 0x7efcfd19e940>, body: {"addFloatingIp": {"address": "172.25.7.153"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:33.545485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f75cc62e-67ba-48e8-8a1a-8e592f18b187 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:33.551863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f75cc62e-67ba-48e8-8a1a-8e592f18b187 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.552315 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f75cc62e-67ba-48e8-8a1a-8e592f18b187 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.553137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f75cc62e-67ba-48e8-8a1a-8e592f18b187 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.553517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f75cc62e-67ba-48e8-8a1a-8e592f18b187 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.553941 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-8e754451-ee96-4efc-bd91-bfcda3bc07cc req-35e8329d-5ded-468b-a99d-6206db3c3e78 service nova] Creating event network-changed:c946b3f1-88fd-42a0-a6b5-cb0bde2dca0b for instance 79221042-a6d8-42f5-8431-5ecfe1fc1972 on n-h2-848886-15 Jul 25 12:40:33.559458 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-8e754451-ee96-4efc-bd91-bfcda3bc07cc req-35e8329d-5ded-468b-a99d-6206db3c3e78 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039540 Jul 25 12:40:33.560154 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 333/637] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:33.567918 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a620570c-7d5f-4e9f-8519-b37c52f92109 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Action: 'create', calling method: .version_select at 0x7efcf9db7310>, body: {"keypair": {"name": "tempest-keypair-873107585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmDhoFDR5FZWmRsjBe+dEk7MgthDMm3GP/f9Cr7Ftz2idu/Y2R8mKVB7n6SnYm2z03gcNYIF5Zh5gLtt7JuLRBZ+vI94euyFV0uTjq+76lKoWaLf9UGpIuyQCWhm6RmYg=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:33.584442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-a620570c-7d5f-4e9f-8519-b37c52f92109 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Getting quotas for project bdce4da5878543a4a609dc35e389763c. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:40:33.589336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-a620570c-7d5f-4e9f-8519-b37c52f92109 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Getting quotas for user fa79a472f31b4e8eb0a6ad709bc84c01 and project bdce4da5878543a4a609dc35e389763c. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:40:33.620998 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a620570c-7d5f-4e9f-8519-b37c52f92109 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.059307 Jul 25 12:40:33.622780 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 334/638] 10.222.0.49 () {62 vars in 1200 bytes} [Mon Jul 25 12:40:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 12:40:33.630366 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c99be0a3-0e3f-4e3b-addc-b1c73c0fd2e9 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1380827822"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:33.633010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f75cc62e-67ba-48e8-8a1a-8e592f18b187 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Acquired lock "refresh_cache-79221042-a6d8-42f5-8431-5ecfe1fc1972" {{(pid=125884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 12:40:33.633728 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c99be0a3-0e3f-4e3b-addc-b1c73c0fd2e9 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: 913f3154-bc36-46f9-8dda-b29d58dd7903] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:33.643793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c99be0a3-0e3f-4e3b-addc-b1c73c0fd2e9 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.644557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c99be0a3-0e3f-4e3b-addc-b1c73c0fd2e9 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.645542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c99be0a3-0e3f-4e3b-addc-b1c73c0fd2e9 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.646843 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c99be0a3-0e3f-4e3b-addc-b1c73c0fd2e9 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:34.014423 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c99be0a3-0e3f-4e3b-addc-b1c73c0fd2e9 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "POST /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903/action" status: 202 len: 0 microversion: 2.1 time: 0.389220 Jul 25 12:40:34.015204 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 335/639] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:40:33 2022] POST /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 12:40:34.020711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-de7e00d9-d8c2-4e6c-8480-f61a19eee1ba tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-848886-15", "block_migration": true, "disk_over_commit": false}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:34.023495 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-de7e00d9-d8c2-4e6c-8480-f61a19eee1ba tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:34.031138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de7e00d9-d8c2-4e6c-8480-f61a19eee1ba tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:34.031854 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de7e00d9-d8c2-4e6c-8480-f61a19eee1ba tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:34.032792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de7e00d9-d8c2-4e6c-8480-f61a19eee1ba tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:34.033380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de7e00d9-d8c2-4e6c-8480-f61a19eee1ba tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:34.095604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-de7e00d9-d8c2-4e6c-8480-f61a19eee1ba tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lazy-loading 'flavor' on Instance uuid 742583f4-0949-418b-a666-dc715ab936d5 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:40:34.113980 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-de7e00d9-d8c2-4e6c-8480-f61a19eee1ba tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Going to try to live migrate instance to n-h2-848886-15 {{(pid=125883) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 12:40:34.316671 n-d-848886-15 devstack@n-api.service[125884]: DEBUG neutronclient.v2_0.client [None req-f75cc62e-67ba-48e8-8a1a-8e592f18b187 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.7.153 (9d21156f-e053-4579-8869-2dfac21f6109) with port c946b3f1-88fd-42a0-a6b5-cb0bde2dca0b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 76609c4e-8da9-4b0d-a062-dffca4d9d957.", "detail": ""}} {{(pid=125884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:40:34.317312 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f75cc62e-67ba-48e8-8a1a-8e592f18b187 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Releasing lock "refresh_cache-79221042-a6d8-42f5-8431-5ecfe1fc1972" {{(pid=125884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 12:40:34.318147 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-f75cc62e-67ba-48e8-8a1a-8e592f18b187 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] HTTP exception thrown: Cannot associate floating IP 172.25.7.153 (9d21156f-e053-4579-8869-2dfac21f6109) with port c946b3f1-88fd-42a0-a6b5-cb0bde2dca0b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 76609c4e-8da9-4b0d-a062-dffca4d9d957. Jul 25 12:40:34.318147 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-d4eae820-a901-45a2-8206-cae07edb2417'] Jul 25 12:40:34.320764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f75cc62e-67ba-48e8-8a1a-8e592f18b187 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Request method failure captured: Jul 25 12:40:34.320764 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972/action HTTP/1.1 Jul 25 12:40:34.320764 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:40:34.320764 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:40:34.320764 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:40:34.320764 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 46 Jul 25 12:40:34.320764 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:40:34.320764 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:40:34.320764 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:40:34.320764 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:40:34.320764 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o8gDZW5KiL16q9kF4f0IQ7z60rvA9E_ffY_PH855tJdjeVRPgfsx8kMw8HmxaaGmRVyEsVUMk8I0lWvNPFdmPDL6Gesfcg-MZCYl0BnL-FuEyhDBK3O2IR95azal0aquzS7lSz8bkll8AHtBhbsjqcGzx9YvCb_TlRwsVbmBPNKBcg Jul 25 12:40:34.320764 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:40:34.320764 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:40:34.320764 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:40:34.320764 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:40:34.320764 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:40:34.320764 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:40:34.320764 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5334f5e32ffb4d49a20d4b7e532cd16e Jul 25 12:40:34.320764 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 Jul 25 12:40:34.320764 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:40:34.320764 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:40:34.322560 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5334f5e32ffb4d49a20d4b7e532cd16e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5334f5e32ffb4d49a20d4b7e532cd16e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5334f5e32ffb4d49a20d4b7e532cd16e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5334f5e32ffb4d49a20d4b7e532cd16e"}]}] Jul 25 12:40:34.322560 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 Jul 25 12:40:34.322560 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5334f5e32ffb4d49a20d4b7e532cd16e Jul 25 12:40:34.322560 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 Jul 25 12:40:34.322560 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project Jul 25 12:40:34.322560 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:40:34.322560 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:40:34.322560 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: efe0a455bf5d4a25b517de628c642f68 Jul 25 12:40:34.322560 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project Jul 25 12:40:34.322560 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:40:34.322560 n-d-848886-15 devstack@n-api.service[125884]: {"addFloatingIp": {"address": "172.25.7.153"}} Jul 25 12:40:34.322560 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:40:34.323476 n-d-848886-15 devstack@n-api.service[125884]: exception: Cannot associate floating IP 172.25.7.153 (9d21156f-e053-4579-8869-2dfac21f6109) with port c946b3f1-88fd-42a0-a6b5-cb0bde2dca0b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 76609c4e-8da9-4b0d-a062-dffca4d9d957. Jul 25 12:40:34.323476 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-d4eae820-a901-45a2-8206-cae07edb2417'] Jul 25 12:40:34.323476 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '79221042-a6d8-42f5-8431-5ecfe1fc1972', 'body': {'addFloatingIp': {'address': '172.25.7.153'}}} Jul 25 12:40:34.323476 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:40:34.323476 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:34.323476 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 25 12:40:34.323476 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 25 12:40:34.323476 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:40:34.323476 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:40:34.323476 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 25 12:40:34.323476 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 25 12:40:34.323476 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:40:34.323476 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:40:34.323476 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 25 12:40:34.323476 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 25 12:40:34.323476 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:40:34.323476 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:40:34.324781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 25 12:40:34.324781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 25 12:40:34.324781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:40:34.324781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:40:34.324781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:40:34.324781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:40:34.324781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:40:34.324781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:40:34.324781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:40:34.324781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:40:34.324781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:40:34.324781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:40:34.324781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:40:34.324781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:40:34.324781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:40:34.324781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:40:34.325971 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.7.153 (9d21156f-e053-4579-8869-2dfac21f6109) with port c946b3f1-88fd-42a0-a6b5-cb0bde2dca0b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 76609c4e-8da9-4b0d-a062-dffca4d9d957. Jul 25 12:40:34.325971 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4eae820-a901-45a2-8206-cae07edb2417'] Jul 25 12:40:34.325971 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:34.325971 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:34.325971 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:34.325971 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:34.325971 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 25 12:40:34.325971 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 25 12:40:34.325971 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 25 12:40:34.325971 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 25 12:40:34.325971 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 25 12:40:34.325971 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 25 12:40:34.325971 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.7.153 (9d21156f-e053-4579-8869-2dfac21f6109) with port c946b3f1-88fd-42a0-a6b5-cb0bde2dca0b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 76609c4e-8da9-4b0d-a062-dffca4d9d957. Jul 25 12:40:34.325971 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4eae820-a901-45a2-8206-cae07edb2417'] Jul 25 12:40:34.325971 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:34.325971 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:34.327124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:34.327124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:34.327124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:34.327124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:34.327124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:40:34.327124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:40:34.327124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:40:34.327124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:40:34.327124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:40:34.327124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:40:34.327124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:40:34.327124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:40:34.327124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 25 12:40:34.327124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 12:40:34.327124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.7.153 (9d21156f-e053-4579-8869-2dfac21f6109) with port c946b3f1-88fd-42a0-a6b5-cb0bde2dca0b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 76609c4e-8da9-4b0d-a062-dffca4d9d957. Jul 25 12:40:34.327124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4eae820-a901-45a2-8206-cae07edb2417'] Jul 25 12:40:34.327124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:34.327124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:34.328517 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:34.328517 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:34.328517 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:34.328517 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:34.328517 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:40:34.328517 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:40:34.328517 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.7.153 (9d21156f-e053-4579-8869-2dfac21f6109) with port c946b3f1-88fd-42a0-a6b5-cb0bde2dca0b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 76609c4e-8da9-4b0d-a062-dffca4d9d957. Jul 25 12:40:34.328517 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4eae820-a901-45a2-8206-cae07edb2417'] Jul 25 12:40:34.328517 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:34.328517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f75cc62e-67ba-48e8-8a1a-8e592f18b187 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Returning 400 to user: Cannot associate floating IP 172.25.7.153 (9d21156f-e053-4579-8869-2dfac21f6109) with port c946b3f1-88fd-42a0-a6b5-cb0bde2dca0b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 76609c4e-8da9-4b0d-a062-dffca4d9d957. Jul 25 12:40:34.328517 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-d4eae820-a901-45a2-8206-cae07edb2417'] {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:40:34.329490 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f75cc62e-67ba-48e8-8a1a-8e592f18b187 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "POST /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972/action" status: 400 len: 381 microversion: 2.1 time: 0.789259 Jul 25 12:40:34.329490 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 305/640] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:40:33 2022] POST /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972/action => generated 381 bytes in 790 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:40:34.334085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-82e11639-ef3a-46a6-aa48-74d849a1d98a tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Calling method '.version_select at 0x7efcfa023ca0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:34.345009 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:40:34.345009 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:40:34.345819 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82e11639-ef3a-46a6-aa48-74d849a1d98a tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:34.349484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82e11639-ef3a-46a6-aa48-74d849a1d98a tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:34.392415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82e11639-ef3a-46a6-aa48-74d849a1d98a tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:34.393061 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82e11639-ef3a-46a6-aa48-74d849a1d98a tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:34.409879 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-82e11639-ef3a-46a6-aa48-74d849a1d98a tempest-HypervisorAdminV253TestBase-1330838092 tempest-HypervisorAdminV253TestBase-1330838092-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/cf7960e8-f236-4154-86e5-a6121b681c9e" status: 200 len: 794 microversion: 2.53 time: 0.083325 Jul 25 12:40:34.409879 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 306/641] 10.222.0.49 () {60 vars in 1298 bytes} [Mon Jul 25 12:40:34 2022] GET /compute/v2.1/os-hypervisors/cf7960e8-f236-4154-86e5-a6121b681c9e => generated 794 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:40:34.421981 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0385be70-4ce3-4eca-a0ea-ba81c177a697 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcfa023280>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:34.479957 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0385be70-4ce3-4eca-a0ea-ba81c177a697 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da" status: 200 len: 1412 microversion: 2.1 time: 0.069871 Jul 25 12:40:34.488644 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 307/642] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:40:34 2022] GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da => generated 1412 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:34.494113 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-305f3f0d-19f7-4dc5-ba0d-14ce5df00747 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Calling method '.version_select at 0x7efcfa054dc0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:36.173748 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-de7e00d9-d8c2-4e6c-8480-f61a19eee1ba tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5/action" status: 202 len: 0 microversion: 2.1 time: 2.156241 Jul 25 12:40:36.175306 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 336/643] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:40:34 2022] POST /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5/action => generated 0 bytes in 2159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:40:36.180860 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-41da2078-c2e3-4593-a780-e6873692cfdf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:36.181823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-41da2078-c2e3-4593-a780-e6873692cfdf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:36.189644 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-41da2078-c2e3-4593-a780-e6873692cfdf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:36.190423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-41da2078-c2e3-4593-a780-e6873692cfdf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:36.191390 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-41da2078-c2e3-4593-a780-e6873692cfdf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:36.191986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-41da2078-c2e3-4593-a780-e6873692cfdf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:36.279843 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-305f3f0d-19f7-4dc5-ba0d-14ce5df00747 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/9d21156f-e053-4579-8869-2dfac21f6109" status: 202 len: 0 microversion: 2.1 time: 1.789820 Jul 25 12:40:36.282432 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 308/644] 10.222.0.49 () {58 vars in 1263 bytes} [Mon Jul 25 12:40:34 2022] DELETE /compute/v2.1/os-floating-ips/9d21156f-e053-4579-8869-2dfac21f6109 => generated 0 bytes in 1793 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:40:36.289960 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-773ab1b3-1f46-493c-a237-f1aead1a5386 tempest-ServersWithSpecificFlavorTestJSON-890992005 tempest-ServersWithSpecificFlavorTestJSON-890992005-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:36.291165 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:40:36.291165 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:40:36.328649 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-773ab1b3-1f46-493c-a237-f1aead1a5386 tempest-ServersWithSpecificFlavorTestJSON-890992005 tempest-ServersWithSpecificFlavorTestJSON-890992005-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1130049463" status: 202 len: 0 microversion: 2.1 time: 0.044739 Jul 25 12:40:36.329541 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 309/645] 10.222.0.49 () {58 vars in 1161 bytes} [Mon Jul 25 12:40:36 2022] DELETE /compute/v2.1/flavors/1130049463 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:40:36.338274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dfd96b13-d526-4fdc-8452-4c914ed3fa69 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcfa07dca0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:36.380141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-41da2078-c2e3-4593-a780-e6873692cfdf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:36.394599 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-41da2078-c2e3-4593-a780-e6873692cfdf tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1477 microversion: 2.1 time: 0.218001 Jul 25 12:40:36.395995 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 337/646] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:36 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1477 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:36.402022 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dfd96b13-d526-4fdc-8452-4c914ed3fa69 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da" status: 200 len: 1412 microversion: 2.1 time: 0.068131 Jul 25 12:40:36.411709 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 310/647] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:40:36 2022] GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da => generated 1412 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:36.420033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-27e02aca-bb01-4083-a842-249f72ede081 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-578108997", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "6ff0fb68-b414-4b82-96bf-e15dd2a7af95"}], "security_groups": [{"name": "tempest-securitygroup--1795581045"}], "key_name": "tempest-keypair-873107585", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:36.431152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:36.579474 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-27e02aca-bb01-4083-a842-249f72ede081 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] validate_networks() for [('6ff0fb68-b414-4b82-96bf-e15dd2a7af95', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:40:36.695846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8b5e8d93-8257-4591-acc2-d68ef2123a61 tempest-QuotaClassesAdminTestJSON-1663717133 tempest-QuotaClassesAdminTestJSON-1663717133-project-admin] Calling method '.version_select at 0x7efcf9d37430>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:36.697046 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:40:36.697046 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:40:36.711509 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8b5e8d93-8257-4591-acc2-d68ef2123a61 tempest-QuotaClassesAdminTestJSON-1663717133 tempest-QuotaClassesAdminTestJSON-1663717133-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.314225 Jul 25 12:40:36.712186 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 338/648] 10.222.0.49 () {58 vars in 1185 bytes} [Mon Jul 25 12:40:36 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:36.717071 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1c1121e8-883b-43a6-83bb-c4e73e9126bd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:36.717759 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1c1121e8-883b-43a6-83bb-c4e73e9126bd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:36.724941 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1c1121e8-883b-43a6-83bb-c4e73e9126bd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:36.725517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1c1121e8-883b-43a6-83bb-c4e73e9126bd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:36.726351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1c1121e8-883b-43a6-83bb-c4e73e9126bd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:36.726880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1c1121e8-883b-43a6-83bb-c4e73e9126bd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:37.061875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1c1121e8-883b-43a6-83bb-c4e73e9126bd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:37.071535 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1c1121e8-883b-43a6-83bb-c4e73e9126bd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 200 len: 1504 microversion: 2.1 time: 0.357926 Jul 25 12:40:37.073018 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 339/649] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:36 2022] GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 1504 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:37.079970 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a417ee02-9087-45ed-b59f-e836c185acb8 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Action: 'action', calling method: .version_select at 0x7efcfd19ea60>, body: {"removeFloatingIp": {"address": "172.25.7.37"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:37.399912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a417ee02-9087-45ed-b59f-e836c185acb8 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:37.408966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a417ee02-9087-45ed-b59f-e836c185acb8 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:37.409605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a417ee02-9087-45ed-b59f-e836c185acb8 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:37.410843 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a417ee02-9087-45ed-b59f-e836c185acb8 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:37.413048 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a417ee02-9087-45ed-b59f-e836c185acb8 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:37.599225 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-27e02aca-bb01-4083-a842-249f72ede081 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:40:37.601761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-27e02aca-bb01-4083-a842-249f72ede081 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:40:37.602295 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-27e02aca-bb01-4083-a842-249f72ede081 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:40:37.602768 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-27e02aca-bb01-4083-a842-249f72ede081 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:40:37.603150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-27e02aca-bb01-4083-a842-249f72ede081 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:40:37.614407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27e02aca-bb01-4083-a842-249f72ede081 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:37.615068 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27e02aca-bb01-4083-a842-249f72ede081 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:37.616092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27e02aca-bb01-4083-a842-249f72ede081 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:37.616532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27e02aca-bb01-4083-a842-249f72ede081 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:37.636750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-27e02aca-bb01-4083-a842-249f72ede081 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Getting quotas for project bdce4da5878543a4a609dc35e389763c. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:40:37.641449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-27e02aca-bb01-4083-a842-249f72ede081 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Getting quotas for user fa79a472f31b4e8eb0a6ad709bc84c01 and project bdce4da5878543a4a609dc35e389763c. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:40:37.654967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-27e02aca-bb01-4083-a842-249f72ede081 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:40:37.657637 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-27e02aca-bb01-4083-a842-249f72ede081 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:40:37.733522 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-27e02aca-bb01-4083-a842-249f72ede081 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.320482 Jul 25 12:40:37.734570 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 311/650] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Jul 25 12:40:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1322 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 12:40:37.748440 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3945385c-c595-4838-9a82-86ad553e178d tempest-ServersWithSpecificFlavorTestJSON-890992005 tempest-ServersWithSpecificFlavorTestJSON-890992005-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:37.781372 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a417ee02-9087-45ed-b59f-e836c185acb8 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Acquired lock "refresh_cache-79221042-a6d8-42f5-8431-5ecfe1fc1972" {{(pid=125883) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 12:40:37.783836 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3945385c-c595-4838-9a82-86ad553e178d tempest-ServersWithSpecificFlavorTestJSON-890992005 tempest-ServersWithSpecificFlavorTestJSON-890992005-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.048002 Jul 25 12:40:37.797126 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 312/651] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:40:37 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:37.797126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9d6e3d6e-17b4-4ce2-958d-1b90c738f7a1 tempest-QuotaClassesAdminTestJSON-1663717133 tempest-QuotaClassesAdminTestJSON-1663717133-project-admin] Action: 'update', calling method: .version_select at 0x7efcfa1bc1f0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:37.797126 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:40:37.797126 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:40:38.385615 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9d6e3d6e-17b4-4ce2-958d-1b90c738f7a1 tempest-QuotaClassesAdminTestJSON-1663717133 tempest-QuotaClassesAdminTestJSON-1663717133-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.595012 Jul 25 12:40:38.386632 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 313/652] 10.222.0.49 () {60 vars in 1206 bytes} [Mon Jul 25 12:40:37 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:38.404247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8b43b5ed-5aca-413f-8f53-0b00e7f6fe3e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:38.405156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8b43b5ed-5aca-413f-8f53-0b00e7f6fe3e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:38.412186 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b43b5ed-5aca-413f-8f53-0b00e7f6fe3e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:38.413086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b43b5ed-5aca-413f-8f53-0b00e7f6fe3e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:38.414859 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b43b5ed-5aca-413f-8f53-0b00e7f6fe3e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:38.415459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b43b5ed-5aca-413f-8f53-0b00e7f6fe3e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:39.159858 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8b43b5ed-5aca-413f-8f53-0b00e7f6fe3e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:39.174172 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8b43b5ed-5aca-413f-8f53-0b00e7f6fe3e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1477 microversion: 2.1 time: 0.775089 Jul 25 12:40:39.189886 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 314/653] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:38 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1477 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:39.198435 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f4622317-1673-485a-8dfe-8b10552cef14 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcfa22da60>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:39.257708 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f4622317-1673-485a-8dfe-8b10552cef14 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da" status: 200 len: 1412 microversion: 2.1 time: 0.065905 Jul 25 12:40:39.261039 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 315/654] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:40:39 2022] GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da => generated 1412 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:39.268766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4ec8878f-0690-499f-bc29-46e1203ebabf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:39.270023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4ec8878f-0690-499f-bc29-46e1203ebabf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:39.290612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4ec8878f-0690-499f-bc29-46e1203ebabf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:39.291064 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4ec8878f-0690-499f-bc29-46e1203ebabf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:39.291917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4ec8878f-0690-499f-bc29-46e1203ebabf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:39.292539 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4ec8878f-0690-499f-bc29-46e1203ebabf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:39.297250 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:39.486624 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4ec8878f-0690-499f-bc29-46e1203ebabf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:39.500331 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4ec8878f-0690-499f-bc29-46e1203ebabf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:39.506087 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4ec8878f-0690-499f-bc29-46e1203ebabf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:39.508720 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4ec8878f-0690-499f-bc29-46e1203ebabf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1344 microversion: 2.25 time: 0.248846 Jul 25 12:40:39.510374 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 316/655] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:39 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1344 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:39.515033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dbd1095a-b95f-408b-bbc1-181d6dae090a tempest-ServersWithSpecificFlavorTestJSON-890992005 tempest-ServersWithSpecificFlavorTestJSON-890992005-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:39.521404 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:40:39.521404 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:40:39.557887 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dbd1095a-b95f-408b-bbc1-181d6dae090a tempest-ServersWithSpecificFlavorTestJSON-890992005 tempest-ServersWithSpecificFlavorTestJSON-890992005-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1596786347" status: 202 len: 0 microversion: 2.1 time: 0.045272 Jul 25 12:40:39.558806 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 317/656] 10.222.0.49 () {58 vars in 1161 bytes} [Mon Jul 25 12:40:39 2022] DELETE /compute/v2.1/flavors/1596786347 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:40:39.575010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1964b83e-1b4c-4281-8676-0d45e87c823b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:39.576497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1964b83e-1b4c-4281-8676-0d45e87c823b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:39.587806 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1964b83e-1b4c-4281-8676-0d45e87c823b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:39.588586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1964b83e-1b4c-4281-8676-0d45e87c823b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:39.590364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1964b83e-1b4c-4281-8676-0d45e87c823b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:39.591047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1964b83e-1b4c-4281-8676-0d45e87c823b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:39.906365 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1964b83e-1b4c-4281-8676-0d45e87c823b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:39.915952 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1964b83e-1b4c-4281-8676-0d45e87c823b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 200 len: 1504 microversion: 2.1 time: 0.351041 Jul 25 12:40:39.918393 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 318/657] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:39 2022] GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 1504 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:39.935106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-d4916239-9894-4a93-a325-dfe8bc6e5628 req-8cbd9f25-3a5b-4d63-9599-245d5a29f021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "742583f4-0949-418b-a666-dc715ab936d5", "name": "network-vif-unplugged", "status": "completed", "tag": "32b54c20-b2ca-4697-b32a-a4dbd0903730"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:39.953181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d4916239-9894-4a93-a325-dfe8bc6e5628 req-8cbd9f25-3a5b-4d63-9599-245d5a29f021 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:39.956306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d4916239-9894-4a93-a325-dfe8bc6e5628 req-8cbd9f25-3a5b-4d63-9599-245d5a29f021 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:39.981740 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-d4916239-9894-4a93-a325-dfe8bc6e5628 req-8cbd9f25-3a5b-4d63-9599-245d5a29f021 service nova] Creating event network-vif-unplugged:32b54c20-b2ca-4697-b32a-a4dbd0903730 for instance 742583f4-0949-418b-a666-dc715ab936d5 on n-h1-848886-15 Jul 25 12:40:39.994278 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-d4916239-9894-4a93-a325-dfe8bc6e5628 req-8cbd9f25-3a5b-4d63-9599-245d5a29f021 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070565 Jul 25 12:40:39.995464 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 319/658] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:40.011846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-458ca8eb-6ad1-4180-8686-4b648e5dfb08 tempest-QuotaClassesAdminTestJSON-1663717133 tempest-QuotaClassesAdminTestJSON-1663717133-project-admin] Calling method '.version_select at 0x7efcfa054f70>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:40.013306 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:40:40.013306 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:40:40.040054 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-458ca8eb-6ad1-4180-8686-4b648e5dfb08 tempest-QuotaClassesAdminTestJSON-1663717133 tempest-QuotaClassesAdminTestJSON-1663717133-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.041737 Jul 25 12:40:40.053799 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 320/659] 10.222.0.49 () {58 vars in 1185 bytes} [Mon Jul 25 12:40:39 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:40.089971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-a417ee02-9087-45ed-b59f-e836c185acb8 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Building network info cache for instance {{(pid=125883) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 12:40:40.293164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bd7caf21-1990-4360-bdec-3a4ffb616d5b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1972480953", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:40.311147 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=15,nova_api:UPDATE=12,nova_api:DELETE=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:40.389393 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-bd7caf21-1990-4360-bdec-3a4ffb616d5b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] validate_networks() for None {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:40:41.005282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bd7caf21-1990-4360-bdec-3a4ffb616d5b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:40:41.006667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bd7caf21-1990-4360-bdec-3a4ffb616d5b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:40:41.007737 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bd7caf21-1990-4360-bdec-3a4ffb616d5b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:40:41.008332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bd7caf21-1990-4360-bdec-3a4ffb616d5b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:40:41.008894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bd7caf21-1990-4360-bdec-3a4ffb616d5b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:40:41.024066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd7caf21-1990-4360-bdec-3a4ffb616d5b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:41.027931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd7caf21-1990-4360-bdec-3a4ffb616d5b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:41.028999 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd7caf21-1990-4360-bdec-3a4ffb616d5b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:41.032495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd7caf21-1990-4360-bdec-3a4ffb616d5b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:41.085914 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-bd7caf21-1990-4360-bdec-3a4ffb616d5b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:40:41.112071 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-bd7caf21-1990-4360-bdec-3a4ffb616d5b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for user 8c296447c2254c048f94bd9f186b0097 and project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:40:41.188582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bd7caf21-1990-4360-bdec-3a4ffb616d5b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:40:41.203398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bd7caf21-1990-4360-bdec-3a4ffb616d5b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: b2467ff1-7d17-43ae-811d-e37437b3b0ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:40:41.316872 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bd7caf21-1990-4360-bdec-3a4ffb616d5b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.254385 Jul 25 12:40:41.320137 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 321/660] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:40:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:40:41.328712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-a417ee02-9087-45ed-b59f-e836c185acb8 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Updating instance_info_cache with network_info: [{"id": "c946b3f1-88fd-42a0-a6b5-cb0bde2dca0b", "address": "fa:16:3e:93:7e:3d", "network": {"id": "3d3f75ac-0896-4f36-8b3a-23fa2957e06c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1075994112-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5334f5e32ffb4d49a20d4b7e532cd16e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc946b3f1-88", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125883) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 12:40:41.378500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-3c9e4c81-9b55-442e-9e43-2b27c4d81b6a req-defbcd67-84ea-48ec-aeb5-6b2bacc09710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "913f3154-bc36-46f9-8dda-b29d58dd7903", "name": "network-vif-plugged", "status": "completed", "tag": "20e3356f-efe0-42e1-8e21-b04bba18de4c"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:41.385962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a417ee02-9087-45ed-b59f-e836c185acb8 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Releasing lock "refresh_cache-79221042-a6d8-42f5-8431-5ecfe1fc1972" {{(pid=125883) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 12:40:41.387140 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a417ee02-9087-45ed-b59f-e836c185acb8 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "POST /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972/action" status: 202 len: 0 microversion: 2.1 time: 4.312841 Jul 25 12:40:41.389179 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 340/661] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:40:37 2022] POST /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972/action => generated 0 bytes in 4315 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 12:40:41.402291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1b8c3248-7bfa-4981-8c0d-c90804d2bdeb tempest-ServersWithSpecificFlavorTestJSON-890992005 tempest-ServersWithSpecificFlavorTestJSON-890992005-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:41.415336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3c9e4c81-9b55-442e-9e43-2b27c4d81b6a req-defbcd67-84ea-48ec-aeb5-6b2bacc09710 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:41.419849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3c9e4c81-9b55-442e-9e43-2b27c4d81b6a req-defbcd67-84ea-48ec-aeb5-6b2bacc09710 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:41.471700 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-3c9e4c81-9b55-442e-9e43-2b27c4d81b6a req-defbcd67-84ea-48ec-aeb5-6b2bacc09710 service nova] Creating event network-vif-plugged:20e3356f-efe0-42e1-8e21-b04bba18de4c for instance 913f3154-bc36-46f9-8dda-b29d58dd7903 on n-h2-848886-15 Jul 25 12:40:41.479406 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1b8c3248-7bfa-4981-8c0d-c90804d2bdeb tempest-ServersWithSpecificFlavorTestJSON-890992005 tempest-ServersWithSpecificFlavorTestJSON-890992005-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.085866 Jul 25 12:40:41.480308 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 341/662] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:40:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:41.482216 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-3c9e4c81-9b55-442e-9e43-2b27c4d81b6a req-defbcd67-84ea-48ec-aeb5-6b2bacc09710 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159909 Jul 25 12:40:41.486955 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 322/663] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:41.496341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-21f3eca4-30b0-43f8-89a8-4f13b73d1fc2 tempest-QuotaClassesAdminTestJSON-1663717133 tempest-QuotaClassesAdminTestJSON-1663717133-project-admin] Action: 'update', calling method: .version_select at 0x7efcf9cfedc0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:41.508364 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:40:41.508364 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:40:41.510127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f5cda356-17f2-4625-973c-58ac78d6ffb0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:41.510945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f5cda356-17f2-4625-973c-58ac78d6ffb0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:41.522932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5cda356-17f2-4625-973c-58ac78d6ffb0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:41.523257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5cda356-17f2-4625-973c-58ac78d6ffb0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:41.525125 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5cda356-17f2-4625-973c-58ac78d6ffb0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:41.525725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5cda356-17f2-4625-973c-58ac78d6ffb0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:41.797689 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-21f3eca4-30b0-43f8-89a8-4f13b73d1fc2 tempest-QuotaClassesAdminTestJSON-1663717133 tempest-QuotaClassesAdminTestJSON-1663717133-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.314094 Jul 25 12:40:41.798330 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 342/664] 10.222.0.49 () {60 vars in 1206 bytes} [Mon Jul 25 12:40:41 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:41.819117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-40e300e2-fd1b-4a8e-b74f-541ccbafa281 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9cfe430>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:41.915238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f5cda356-17f2-4625-973c-58ac78d6ffb0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:41.930515 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-40e300e2-fd1b-4a8e-b74f-541ccbafa281 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da" status: 200 len: 1412 microversion: 2.1 time: 0.131112 Jul 25 12:40:41.933561 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 343/665] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:40:41 2022] GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da => generated 1412 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:41.936673 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f5cda356-17f2-4625-973c-58ac78d6ffb0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1477 microversion: 2.1 time: 0.447441 Jul 25 12:40:41.944426 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 323/666] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:41 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1477 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:41.951772 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5a6fd640-f1af-46dc-91ec-cc6cae0fedd2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:41.952663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5a6fd640-f1af-46dc-91ec-cc6cae0fedd2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:41.959082 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b78e4284-a62a-4bec-80d0-bed8001e087b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:41.959698 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b78e4284-a62a-4bec-80d0-bed8001e087b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:41.980565 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a6fd640-f1af-46dc-91ec-cc6cae0fedd2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:41.981010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a6fd640-f1af-46dc-91ec-cc6cae0fedd2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:41.981797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a6fd640-f1af-46dc-91ec-cc6cae0fedd2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:41.983636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a6fd640-f1af-46dc-91ec-cc6cae0fedd2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:41.984108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b78e4284-a62a-4bec-80d0-bed8001e087b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:41.984702 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b78e4284-a62a-4bec-80d0-bed8001e087b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:41.987780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b78e4284-a62a-4bec-80d0-bed8001e087b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:41.988407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b78e4284-a62a-4bec-80d0-bed8001e087b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:42.529854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b78e4284-a62a-4bec-80d0-bed8001e087b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:42.541902 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b78e4284-a62a-4bec-80d0-bed8001e087b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 200 len: 1504 microversion: 2.1 time: 0.596315 Jul 25 12:40:42.542863 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 324/667] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:41 2022] GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 1504 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:42.553235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dfd55bb6-1936-40ab-924b-3dc8e736a017 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:42.554439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dfd55bb6-1936-40ab-924b-3dc8e736a017 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: b2467ff1-7d17-43ae-811d-e37437b3b0ba] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:42.567916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5a6fd640-f1af-46dc-91ec-cc6cae0fedd2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:42.569955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dfd55bb6-1936-40ab-924b-3dc8e736a017 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:42.573231 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dfd55bb6-1936-40ab-924b-3dc8e736a017 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:42.574406 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dfd55bb6-1936-40ab-924b-3dc8e736a017 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:42.577203 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dfd55bb6-1936-40ab-924b-3dc8e736a017 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:42.590179 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5a6fd640-f1af-46dc-91ec-cc6cae0fedd2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:42.591688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5a6fd640-f1af-46dc-91ec-cc6cae0fedd2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:42.592853 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5a6fd640-f1af-46dc-91ec-cc6cae0fedd2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1410 microversion: 2.25 time: 0.657408 Jul 25 12:40:42.593423 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 344/668] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:41 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1410 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:42.601440 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-26281dae-6b25-4ec3-8d8e-e19e9d73576c tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Calling method '.version_select at 0x7efcf9df73a0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:42.764257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dfd55bb6-1936-40ab-924b-3dc8e736a017 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:42.772807 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dfd55bb6-1936-40ab-924b-3dc8e736a017 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba" status: 200 len: 1221 microversion: 2.1 time: 0.228655 Jul 25 12:40:42.776906 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 325/669] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:42 2022] GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba => generated 1221 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:42.784656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fcb26bcf-276a-449c-a7f1-0640f4bffda1 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:42.788666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fcb26bcf-276a-449c-a7f1-0640f4bffda1 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: fefcb083-ed47-4de2-9c77-0bdb30d0aa6f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:42.808346 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fcb26bcf-276a-449c-a7f1-0640f4bffda1 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:42.808804 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fcb26bcf-276a-449c-a7f1-0640f4bffda1 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:42.809604 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fcb26bcf-276a-449c-a7f1-0640f4bffda1 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:42.810796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fcb26bcf-276a-449c-a7f1-0640f4bffda1 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:42.832366 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-fcb26bcf-276a-449c-a7f1-0640f4bffda1 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] HTTP exception thrown: Instance fefcb083-ed47-4de2-9c77-0bdb30d0aa6f could not be found. Jul 25 12:40:42.834401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fcb26bcf-276a-449c-a7f1-0640f4bffda1 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Request method failure captured: Jul 25 12:40:42.834401 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f HTTP/1.1 Jul 25 12:40:42.834401 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:40:42.834401 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:40:42.834401 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:40:42.834401 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:40:42.834401 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:40:42.834401 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:40:42.834401 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:40:42.834401 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:40:42.834401 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o6l-_kjeNz_QitF46heNqtCNpxvnIwUOok7JnEwWAK6QqmxvVJj-kVaw259iNWhYbGietFE2cK8hPKs44r3gP0622qFvzzbcC_pFKSjA1uUCa2ezyDaoRCgWVlb1RdMmlnTyOoyK4F2hp9L442SAw94rdhWG7bwtaSy43LIRc2fnig Jul 25 12:40:42.834401 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:40:42.834401 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:40:42.834401 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:40:42.834401 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:40:42.834401 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:40:42.834401 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:40:42.834401 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 4ded56ca1da44b65a227d978f927d9db Jul 25 12:40:42.834401 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-21156428 Jul 25 12:40:42.834401 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:40:42.834401 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:40:42.835742 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4ded56ca1da44b65a227d978f927d9db", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4ded56ca1da44b65a227d978f927d9db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ded56ca1da44b65a227d978f927d9db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ded56ca1da44b65a227d978f927d9db"}]}] Jul 25 12:40:42.835742 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-21156428 Jul 25 12:40:42.835742 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 4ded56ca1da44b65a227d978f927d9db Jul 25 12:40:42.835742 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-21156428 Jul 25 12:40:42.835742 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersWithSpecificFlavorTestJSON-21156428-project Jul 25 12:40:42.835742 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:40:42.835742 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:40:42.835742 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: ef5e681ba263436099656b879c77162b Jul 25 12:40:42.835742 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-21156428-project Jul 25 12:40:42.835742 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:40:42.835742 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance fefcb083-ed47-4de2-9c77-0bdb30d0aa6f could not be found. Jul 25 12:40:42.835742 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'fefcb083-ed47-4de2-9c77-0bdb30d0aa6f'} Jul 25 12:40:42.836511 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:40:42.836511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:42.836511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:40:42.836511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:40:42.836511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:40:42.836511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:40:42.836511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:40:42.836511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:40:42.836511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:40:42.836511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:40:42.836511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fefcb083-ed47-4de2-9c77-0bdb30d0aa6f could not be found. Jul 25 12:40:42.836511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:42.836511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:42.836511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:42.836511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:42.836511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:42.836511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:42.836511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:40:42.836511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:40:42.836511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:40:42.837732 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:40:42.837732 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:40:42.837732 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:40:42.837732 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:40:42.837732 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:40:42.837732 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:40:42.837732 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:40:42.837732 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:40:42.837732 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:40:42.837732 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fefcb083-ed47-4de2-9c77-0bdb30d0aa6f could not be found. Jul 25 12:40:42.837732 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:42.837732 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:42.837732 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:42.837732 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:42.837732 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:42.837732 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:42.837732 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:40:42.837732 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:40:42.837732 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fefcb083-ed47-4de2-9c77-0bdb30d0aa6f could not be found. Jul 25 12:40:42.837732 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:42.838976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fcb26bcf-276a-449c-a7f1-0640f4bffda1 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Returning 404 to user: Instance fefcb083-ed47-4de2-9c77-0bdb30d0aa6f could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:40:42.838976 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fcb26bcf-276a-449c-a7f1-0640f4bffda1 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f" status: 404 len: 111 microversion: 2.1 time: 0.057646 Jul 25 12:40:42.852544 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 326/670] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:40:42 2022] DELETE /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:40:42.873125 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-dec27f2c-52d7-427b-82eb-689797fade19 req-e4d34433-ba8b-45f3-aef0-b009ad2986b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c18f0b76-5dab-4e09-afb8-8a1de682b042", "tag": "b5d54db2-13f2-41e6-b4fa-4d037fc2e51e"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:42.898334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-dec27f2c-52d7-427b-82eb-689797fade19 req-e4d34433-ba8b-45f3-aef0-b009ad2986b4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:42.898806 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-dec27f2c-52d7-427b-82eb-689797fade19 req-e4d34433-ba8b-45f3-aef0-b009ad2986b4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:42.943299 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-dec27f2c-52d7-427b-82eb-689797fade19 req-e4d34433-ba8b-45f3-aef0-b009ad2986b4 service nova] Creating event network-changed:b5d54db2-13f2-41e6-b4fa-4d037fc2e51e for instance c18f0b76-5dab-4e09-afb8-8a1de682b042 on n-h1-848886-15 Jul 25 12:40:42.961727 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-dec27f2c-52d7-427b-82eb-689797fade19 req-e4d34433-ba8b-45f3-aef0-b009ad2986b4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106879 Jul 25 12:40:42.962438 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 327/671] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:42.975243 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-f9300ed6-339c-4b02-8095-78cf38c0a0c4 req-9f7cc182-e64b-4769-81a3-9960b39d126e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "742583f4-0949-418b-a666-dc715ab936d5", "tag": "32b54c20-b2ca-4697-b32a-a4dbd0903730"}, {"name": "network-changed", "server_uuid": "79221042-a6d8-42f5-8431-5ecfe1fc1972", "tag": "c946b3f1-88fd-42a0-a6b5-cb0bde2dca0b"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:43.006048 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f9300ed6-339c-4b02-8095-78cf38c0a0c4 req-9f7cc182-e64b-4769-81a3-9960b39d126e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:43.007489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f9300ed6-339c-4b02-8095-78cf38c0a0c4 req-9f7cc182-e64b-4769-81a3-9960b39d126e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:43.040751 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-f9300ed6-339c-4b02-8095-78cf38c0a0c4 req-9f7cc182-e64b-4769-81a3-9960b39d126e service nova] Creating event network-changed:32b54c20-b2ca-4697-b32a-a4dbd0903730 for instance 742583f4-0949-418b-a666-dc715ab936d5 on n-h1-848886-15 Jul 25 12:40:43.041275 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-f9300ed6-339c-4b02-8095-78cf38c0a0c4 req-9f7cc182-e64b-4769-81a3-9960b39d126e service nova] Creating event network-changed:c946b3f1-88fd-42a0-a6b5-cb0bde2dca0b for instance 79221042-a6d8-42f5-8431-5ecfe1fc1972 on n-h2-848886-15 Jul 25 12:40:43.095070 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-f9300ed6-339c-4b02-8095-78cf38c0a0c4 req-9f7cc182-e64b-4769-81a3-9960b39d126e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.118524 Jul 25 12:40:43.101357 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 328/672] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:43.121790 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-82203c9f-6617-4d5c-bade-705cda700fa3 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:43.131325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-82203c9f-6617-4d5c-bade-705cda700fa3 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: fefcb083-ed47-4de2-9c77-0bdb30d0aa6f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:43.150755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82203c9f-6617-4d5c-bade-705cda700fa3 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:43.155644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82203c9f-6617-4d5c-bade-705cda700fa3 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:43.156859 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82203c9f-6617-4d5c-bade-705cda700fa3 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:43.157477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82203c9f-6617-4d5c-bade-705cda700fa3 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:43.191073 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-82203c9f-6617-4d5c-bade-705cda700fa3 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] HTTP exception thrown: Instance fefcb083-ed47-4de2-9c77-0bdb30d0aa6f could not be found. Jul 25 12:40:43.194861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-82203c9f-6617-4d5c-bade-705cda700fa3 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Request method failure captured: Jul 25 12:40:43.194861 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f HTTP/1.1 Jul 25 12:40:43.194861 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:40:43.194861 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:40:43.194861 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:40:43.194861 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:40:43.194861 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:40:43.194861 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:40:43.194861 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:40:43.194861 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:40:43.194861 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o6l-_kjeNz_QitF46heNqtCNpxvnIwUOok7JnEwWAK6QqmxvVJj-kVaw259iNWhYbGietFE2cK8hPKs44r3gP0622qFvzzbcC_pFKSjA1uUCa2ezyDaoRCgWVlb1RdMmlnTyOoyK4F2hp9L442SAw94rdhWG7bwtaSy43LIRc2fnig Jul 25 12:40:43.194861 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:40:43.194861 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:40:43.194861 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:40:43.194861 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:40:43.194861 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:40:43.194861 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:40:43.194861 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 4ded56ca1da44b65a227d978f927d9db Jul 25 12:40:43.194861 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-21156428 Jul 25 12:40:43.194861 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:40:43.194861 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:40:43.196338 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4ded56ca1da44b65a227d978f927d9db", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4ded56ca1da44b65a227d978f927d9db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ded56ca1da44b65a227d978f927d9db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ded56ca1da44b65a227d978f927d9db"}]}] Jul 25 12:40:43.196338 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-21156428 Jul 25 12:40:43.196338 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 4ded56ca1da44b65a227d978f927d9db Jul 25 12:40:43.196338 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-21156428 Jul 25 12:40:43.196338 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersWithSpecificFlavorTestJSON-21156428-project Jul 25 12:40:43.196338 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:40:43.196338 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:40:43.196338 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: ef5e681ba263436099656b879c77162b Jul 25 12:40:43.196338 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-21156428-project Jul 25 12:40:43.196338 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:40:43.196338 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance fefcb083-ed47-4de2-9c77-0bdb30d0aa6f could not be found. Jul 25 12:40:43.196338 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'fefcb083-ed47-4de2-9c77-0bdb30d0aa6f'} Jul 25 12:40:43.197242 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:40:43.197242 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:43.197242 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:40:43.197242 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:40:43.197242 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:40:43.197242 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:40:43.197242 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:40:43.197242 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:40:43.197242 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:40:43.197242 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:40:43.197242 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fefcb083-ed47-4de2-9c77-0bdb30d0aa6f could not be found. Jul 25 12:40:43.197242 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:43.197242 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:43.197242 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:43.197242 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:43.197242 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:43.197242 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:43.197242 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:40:43.197242 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:40:43.197242 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:40:43.198865 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:40:43.198865 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:40:43.198865 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:40:43.198865 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:40:43.198865 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:40:43.198865 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:40:43.198865 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:40:43.198865 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fefcb083-ed47-4de2-9c77-0bdb30d0aa6f could not be found. Jul 25 12:40:43.198865 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:43.198865 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:43.198865 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:43.198865 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:43.198865 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:43.198865 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:43.198865 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:40:43.198865 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:40:43.198865 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fefcb083-ed47-4de2-9c77-0bdb30d0aa6f could not be found. Jul 25 12:40:43.198865 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:43.206529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-82203c9f-6617-4d5c-bade-705cda700fa3 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Returning 404 to user: Instance fefcb083-ed47-4de2-9c77-0bdb30d0aa6f could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:40:43.209812 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-82203c9f-6617-4d5c-bade-705cda700fa3 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f" status: 404 len: 111 microversion: 2.1 time: 0.105747 Jul 25 12:40:43.211135 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 329/673] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:43 2022] GET /compute/v2.1/servers/fefcb083-ed47-4de2-9c77-0bdb30d0aa6f => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:40:43.223357 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-175504a5-93c6-497f-9dda-56c9a5487d1b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9fb2670>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:43.297427 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-175504a5-93c6-497f-9dda-56c9a5487d1b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da" status: 200 len: 1412 microversion: 2.1 time: 0.080206 Jul 25 12:40:43.304648 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 330/674] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:40:43 2022] GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da => generated 1412 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:43.309710 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f79979e0-fff9-4d8b-bcde-0390cb2c9278 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:43.313532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f79979e0-fff9-4d8b-bcde-0390cb2c9278 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:43.323394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f79979e0-fff9-4d8b-bcde-0390cb2c9278 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:43.324120 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f79979e0-fff9-4d8b-bcde-0390cb2c9278 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:43.324892 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f79979e0-fff9-4d8b-bcde-0390cb2c9278 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:43.325686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f79979e0-fff9-4d8b-bcde-0390cb2c9278 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:43.955075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f79979e0-fff9-4d8b-bcde-0390cb2c9278 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:43.968867 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f79979e0-fff9-4d8b-bcde-0390cb2c9278 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1477 microversion: 2.1 time: 0.669316 Jul 25 12:40:43.969453 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 331/675] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:43 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1477 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:43.978788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-460be894-5aee-49ef-a36e-c0a16e1820d8 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:43.981360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-460be894-5aee-49ef-a36e-c0a16e1820d8 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:43.995088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-460be894-5aee-49ef-a36e-c0a16e1820d8 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:43.995550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-460be894-5aee-49ef-a36e-c0a16e1820d8 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:43.996366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-460be894-5aee-49ef-a36e-c0a16e1820d8 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:43.996791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-460be894-5aee-49ef-a36e-c0a16e1820d8 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:44.016401 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-460be894-5aee-49ef-a36e-c0a16e1820d8 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] HTTP exception thrown: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. Jul 25 12:40:44.018593 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-460be894-5aee-49ef-a36e-c0a16e1820d8 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Request method failure captured: Jul 25 12:40:44.018593 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 HTTP/1.1 Jul 25 12:40:44.018593 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:40:44.018593 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:40:44.018593 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:40:44.018593 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:40:44.018593 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:40:44.018593 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:40:44.018593 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:40:44.018593 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:40:44.018593 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o6l-_kjeNz_QitF46heNqtCNpxvnIwUOok7JnEwWAK6QqmxvVJj-kVaw259iNWhYbGietFE2cK8hPKs44r3gP0622qFvzzbcC_pFKSjA1uUCa2ezyDaoRCgWVlb1RdMmlnTyOoyK4F2hp9L442SAw94rdhWG7bwtaSy43LIRc2fnig Jul 25 12:40:44.018593 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:40:44.018593 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:40:44.018593 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:40:44.018593 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:40:44.018593 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:40:44.018593 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:40:44.018593 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 4ded56ca1da44b65a227d978f927d9db Jul 25 12:40:44.018593 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-21156428 Jul 25 12:40:44.018593 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:40:44.018593 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:40:44.020223 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4ded56ca1da44b65a227d978f927d9db", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4ded56ca1da44b65a227d978f927d9db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ded56ca1da44b65a227d978f927d9db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ded56ca1da44b65a227d978f927d9db"}]}] Jul 25 12:40:44.020223 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-21156428 Jul 25 12:40:44.020223 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 4ded56ca1da44b65a227d978f927d9db Jul 25 12:40:44.020223 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-21156428 Jul 25 12:40:44.020223 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersWithSpecificFlavorTestJSON-21156428-project Jul 25 12:40:44.020223 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:40:44.020223 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:40:44.020223 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: ef5e681ba263436099656b879c77162b Jul 25 12:40:44.020223 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-21156428-project Jul 25 12:40:44.020223 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:40:44.020223 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. Jul 25 12:40:44.020223 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '36fa069d-9aaa-4804-a21f-8526cbe9d728'} Jul 25 12:40:44.021084 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:40:44.021084 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:44.021084 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:40:44.021084 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:40:44.021084 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:40:44.021084 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:40:44.021084 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:40:44.021084 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:40:44.021084 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:40:44.021084 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:40:44.021084 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. Jul 25 12:40:44.021084 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:44.021084 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:44.021084 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:44.021084 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:44.021084 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:44.021084 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:44.021084 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:40:44.021084 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:40:44.021084 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:40:44.022497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:40:44.022497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:40:44.022497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:40:44.022497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:40:44.022497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:40:44.022497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:40:44.022497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:40:44.022497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:40:44.022497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:40:44.022497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. Jul 25 12:40:44.022497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:44.022497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:44.022497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:44.022497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:44.022497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:44.022497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:44.022497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:40:44.022497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:40:44.022497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. Jul 25 12:40:44.022497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:44.023821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-460be894-5aee-49ef-a36e-c0a16e1820d8 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Returning 404 to user: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:40:44.023821 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-460be894-5aee-49ef-a36e-c0a16e1820d8 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "DELETE /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 404 len: 111 microversion: 2.1 time: 0.049448 Jul 25 12:40:44.025123 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 332/676] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:40:43 2022] DELETE /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:40:44.034113 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fb91b143-836c-41d2-a1a8-fe10d2e4b184 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:44.035688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fb91b143-836c-41d2-a1a8-fe10d2e4b184 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:44.046062 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb91b143-836c-41d2-a1a8-fe10d2e4b184 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:44.046777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb91b143-836c-41d2-a1a8-fe10d2e4b184 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:44.051864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb91b143-836c-41d2-a1a8-fe10d2e4b184 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:44.052624 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb91b143-836c-41d2-a1a8-fe10d2e4b184 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:44.564788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fb91b143-836c-41d2-a1a8-fe10d2e4b184 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:44.578943 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fb91b143-836c-41d2-a1a8-fe10d2e4b184 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 200 len: 1504 microversion: 2.1 time: 0.551246 Jul 25 12:40:44.579896 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 333/677] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:44 2022] GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 1504 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:44.588362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5a85996b-2cdd-4fe3-a26b-039ce2a4e9bf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:44.589198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5a85996b-2cdd-4fe3-a26b-039ce2a4e9bf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:44.601459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a85996b-2cdd-4fe3-a26b-039ce2a4e9bf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:44.602289 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a85996b-2cdd-4fe3-a26b-039ce2a4e9bf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:44.604094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a85996b-2cdd-4fe3-a26b-039ce2a4e9bf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:44.604682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a85996b-2cdd-4fe3-a26b-039ce2a4e9bf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:45.655275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5a85996b-2cdd-4fe3-a26b-039ce2a4e9bf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:45.671682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5a85996b-2cdd-4fe3-a26b-039ce2a4e9bf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:45.679224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5a85996b-2cdd-4fe3-a26b-039ce2a4e9bf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:45.681029 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5a85996b-2cdd-4fe3-a26b-039ce2a4e9bf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1410 microversion: 2.25 time: 1.099893 Jul 25 12:40:45.681848 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 334/678] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:44 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1410 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:45.690640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-367c6b8e-850d-458f-b0b4-362a85a8bf25 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:45.702930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-367c6b8e-850d-458f-b0b4-362a85a8bf25 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: b2467ff1-7d17-43ae-811d-e37437b3b0ba] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:45.716574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-367c6b8e-850d-458f-b0b4-362a85a8bf25 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:45.718536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-367c6b8e-850d-458f-b0b4-362a85a8bf25 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:45.719366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-367c6b8e-850d-458f-b0b4-362a85a8bf25 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:45.719813 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-367c6b8e-850d-458f-b0b4-362a85a8bf25 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:45.960710 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-367c6b8e-850d-458f-b0b4-362a85a8bf25 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:45.969656 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-367c6b8e-850d-458f-b0b4-362a85a8bf25 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba" status: 200 len: 1275 microversion: 2.1 time: 0.286432 Jul 25 12:40:45.974216 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 335/679] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:45 2022] GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba => generated 1275 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:45.989905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-31eb2993-e112-4ae5-b2a7-8b5ea1285860 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:45.990474 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-31eb2993-e112-4ae5-b2a7-8b5ea1285860 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] [instance: 36fa069d-9aaa-4804-a21f-8526cbe9d728] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:45.997217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-31eb2993-e112-4ae5-b2a7-8b5ea1285860 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:45.998122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-31eb2993-e112-4ae5-b2a7-8b5ea1285860 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:45.999043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-31eb2993-e112-4ae5-b2a7-8b5ea1285860 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:45.999855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-31eb2993-e112-4ae5-b2a7-8b5ea1285860 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:46.039852 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-31eb2993-e112-4ae5-b2a7-8b5ea1285860 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] HTTP exception thrown: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. Jul 25 12:40:46.047936 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-31eb2993-e112-4ae5-b2a7-8b5ea1285860 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Request method failure captured: Jul 25 12:40:46.047936 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 HTTP/1.1 Jul 25 12:40:46.047936 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:40:46.047936 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:40:46.047936 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:40:46.047936 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:40:46.047936 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:40:46.047936 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:40:46.047936 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:40:46.047936 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:40:46.047936 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o6l-_kjeNz_QitF46heNqtCNpxvnIwUOok7JnEwWAK6QqmxvVJj-kVaw259iNWhYbGietFE2cK8hPKs44r3gP0622qFvzzbcC_pFKSjA1uUCa2ezyDaoRCgWVlb1RdMmlnTyOoyK4F2hp9L442SAw94rdhWG7bwtaSy43LIRc2fnig Jul 25 12:40:46.047936 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:40:46.047936 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:40:46.047936 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:40:46.047936 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:40:46.047936 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:40:46.047936 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:40:46.047936 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 4ded56ca1da44b65a227d978f927d9db Jul 25 12:40:46.047936 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-21156428 Jul 25 12:40:46.047936 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:40:46.047936 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:40:46.049374 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4ded56ca1da44b65a227d978f927d9db", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4ded56ca1da44b65a227d978f927d9db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ded56ca1da44b65a227d978f927d9db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ded56ca1da44b65a227d978f927d9db"}]}] Jul 25 12:40:46.049374 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-21156428 Jul 25 12:40:46.049374 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 4ded56ca1da44b65a227d978f927d9db Jul 25 12:40:46.049374 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-21156428 Jul 25 12:40:46.049374 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersWithSpecificFlavorTestJSON-21156428-project Jul 25 12:40:46.049374 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:40:46.049374 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:40:46.049374 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: ef5e681ba263436099656b879c77162b Jul 25 12:40:46.049374 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-21156428-project Jul 25 12:40:46.049374 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:40:46.049374 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. Jul 25 12:40:46.049374 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '36fa069d-9aaa-4804-a21f-8526cbe9d728'} Jul 25 12:40:46.050312 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:40:46.050312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:46.050312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:40:46.050312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:40:46.050312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:40:46.050312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:40:46.050312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:40:46.050312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:40:46.050312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:40:46.050312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:40:46.050312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. Jul 25 12:40:46.050312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:46.050312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:46.050312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:46.050312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:46.050312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:46.050312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:46.050312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:40:46.050312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:40:46.050312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:40:46.051485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:40:46.051485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:40:46.051485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:40:46.051485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:40:46.051485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:40:46.051485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:40:46.051485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:40:46.051485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. Jul 25 12:40:46.051485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:46.051485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:46.051485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:46.051485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:46.051485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:46.051485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:46.051485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:40:46.051485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:40:46.051485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. Jul 25 12:40:46.051485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:46.053898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-31eb2993-e112-4ae5-b2a7-8b5ea1285860 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] Returning 404 to user: Instance 36fa069d-9aaa-4804-a21f-8526cbe9d728 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:40:46.054941 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-31eb2993-e112-4ae5-b2a7-8b5ea1285860 tempest-ServersWithSpecificFlavorTestJSON-21156428 tempest-ServersWithSpecificFlavorTestJSON-21156428-project] 10.222.0.49 "GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728" status: 404 len: 111 microversion: 2.1 time: 0.079748 Jul 25 12:40:46.056394 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 336/680] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:45 2022] GET /compute/v2.1/servers/36fa069d-9aaa-4804-a21f-8526cbe9d728 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:40:46.070367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9ad948a3-b6fb-40cc-add7-360dba71583b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9fe4700>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:46.165572 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9ad948a3-b6fb-40cc-add7-360dba71583b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da" status: 200 len: 1412 microversion: 2.1 time: 0.106914 Jul 25 12:40:46.167374 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 337/681] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:40:46 2022] GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da => generated 1412 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:46.180826 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-26281dae-6b25-4ec3-8d8e-e19e9d73576c tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/a132e576-da10-43d6-862a-9dbe2eb173be" status: 202 len: 0 microversion: 2.1 time: 3.585994 Jul 25 12:40:46.181417 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 345/682] 10.222.0.49 () {58 vars in 1263 bytes} [Mon Jul 25 12:40:42 2022] DELETE /compute/v2.1/os-floating-ips/a132e576-da10-43d6-862a-9dbe2eb173be => generated 0 bytes in 3587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:40:46.186534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2a1b880a-c0b0-48f7-9daf-a57d9c2b9805 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:46.187568 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2a1b880a-c0b0-48f7-9daf-a57d9c2b9805 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:46.203280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ae281ea6-83ab-4ea6-90c9-0f32d796c7a9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:46.207156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ae281ea6-83ab-4ea6-90c9-0f32d796c7a9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:46.218023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2a1b880a-c0b0-48f7-9daf-a57d9c2b9805 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:46.227840 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2a1b880a-c0b0-48f7-9daf-a57d9c2b9805 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:46.228882 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2a1b880a-c0b0-48f7-9daf-a57d9c2b9805 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:46.230833 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2a1b880a-c0b0-48f7-9daf-a57d9c2b9805 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:46.232525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae281ea6-83ab-4ea6-90c9-0f32d796c7a9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:46.234902 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae281ea6-83ab-4ea6-90c9-0f32d796c7a9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:46.243115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae281ea6-83ab-4ea6-90c9-0f32d796c7a9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:46.243694 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae281ea6-83ab-4ea6-90c9-0f32d796c7a9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:46.768059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ae281ea6-83ab-4ea6-90c9-0f32d796c7a9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:46.777416 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ae281ea6-83ab-4ea6-90c9-0f32d796c7a9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1477 microversion: 2.1 time: 0.599193 Jul 25 12:40:46.785433 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 338/683] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:46 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1477 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:46.843502 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-7b8a3fc6-6184-4e2d-9e2d-ba192876df9c req-b8d7ccd2-2fb2-4241-86eb-319342c5ec06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "742583f4-0949-418b-a666-dc715ab936d5", "name": "network-vif-unplugged", "status": "completed", "tag": "32b54c20-b2ca-4697-b32a-a4dbd0903730"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:46.881303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-7b8a3fc6-6184-4e2d-9e2d-ba192876df9c req-b8d7ccd2-2fb2-4241-86eb-319342c5ec06 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:46.882229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-7b8a3fc6-6184-4e2d-9e2d-ba192876df9c req-b8d7ccd2-2fb2-4241-86eb-319342c5ec06 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:46.897460 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-7b8a3fc6-6184-4e2d-9e2d-ba192876df9c req-b8d7ccd2-2fb2-4241-86eb-319342c5ec06 service nova] Creating event network-vif-unplugged:32b54c20-b2ca-4697-b32a-a4dbd0903730 for instance 742583f4-0949-418b-a666-dc715ab936d5 on n-h1-848886-15 Jul 25 12:40:46.906121 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-7b8a3fc6-6184-4e2d-9e2d-ba192876df9c req-b8d7ccd2-2fb2-4241-86eb-319342c5ec06 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114679 Jul 25 12:40:46.912228 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 339/684] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:46.919404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9b623e7b-5d2e-48a2-ac73-7a08ca1f14ad tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:46.924091 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9b623e7b-5d2e-48a2-ac73-7a08ca1f14ad tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Request method failure captured: Jul 25 12:40:46.924091 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972/action HTTP/1.1 Jul 25 12:40:46.924091 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:40:46.924091 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:40:46.924091 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:40:46.924091 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 34 Jul 25 12:40:46.924091 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:40:46.924091 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:40:46.924091 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:40:46.924091 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:40:46.924091 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o8gDZW5KiL16q9kF4f0IQ7z60rvA9E_ffY_PH855tJdjeVRPgfsx8kMw8HmxaaGmRVyEsVUMk8I0lWvNPFdmPDL6Gesfcg-MZCYl0BnL-FuEyhDBK3O2IR95azal0aquzS7lSz8bkll8AHtBhbsjqcGzx9YvCb_TlRwsVbmBPNKBcg Jul 25 12:40:46.924091 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:40:46.924091 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:40:46.924091 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:40:46.924091 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:40:46.924091 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:40:46.924091 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:40:46.924091 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5334f5e32ffb4d49a20d4b7e532cd16e Jul 25 12:40:46.924091 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 Jul 25 12:40:46.924091 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:40:46.924091 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:40:46.925470 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5334f5e32ffb4d49a20d4b7e532cd16e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5334f5e32ffb4d49a20d4b7e532cd16e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5334f5e32ffb4d49a20d4b7e532cd16e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5334f5e32ffb4d49a20d4b7e532cd16e"}]}] Jul 25 12:40:46.925470 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 Jul 25 12:40:46.925470 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5334f5e32ffb4d49a20d4b7e532cd16e Jul 25 12:40:46.925470 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 Jul 25 12:40:46.925470 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project Jul 25 12:40:46.925470 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:40:46.925470 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:40:46.925470 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: efe0a455bf5d4a25b517de628c642f68 Jul 25 12:40:46.925470 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project Jul 25 12:40:46.925470 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:40:46.925470 n-d-848886-15 devstack@n-api.service[125884]: {"addFloatingIp": {"address": ""}} Jul 25 12:40:46.925470 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:40:46.925470 n-d-848886-15 devstack@n-api.service[125884]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 25 12:40:46.926416 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '79221042-a6d8-42f5-8431-5ecfe1fc1972', 'body': {'addFloatingIp': {'address': ''}}} Jul 25 12:40:46.926416 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:40:46.926416 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:46.926416 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:40:46.926416 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:40:46.926416 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:40:46.926416 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:40:46.926416 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 25 12:40:46.926416 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:46.926416 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 25 12:40:46.926416 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 25 12:40:46.926416 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:46.926416 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 25 12:40:46.926416 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi '' Jul 25 12:40:46.926416 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:46.926416 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:46.926416 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:46.926416 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:46.926416 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:46.926416 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:46.926416 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:40:46.926416 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:40:46.927674 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:40:46.927674 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:40:46.927674 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:40:46.927674 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:40:46.927674 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:40:46.927674 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:40:46.927674 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:40:46.927674 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:40:46.927674 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:40:46.927674 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:40:46.927674 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 25 12:40:46.927674 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:46.927674 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:46.927674 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:46.927674 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:46.927674 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:46.927674 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:46.927674 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:40:46.927674 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:40:46.928827 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 25 12:40:46.928827 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:46.931301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9b623e7b-5d2e-48a2-ac73-7a08ca1f14ad tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:40:46.934221 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9b623e7b-5d2e-48a2-ac73-7a08ca1f14ad tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "POST /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972/action" status: 400 len: 142 microversion: 2.1 time: 0.020472 Jul 25 12:40:46.935499 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 340/685] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:40:46 2022] POST /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972/action => generated 142 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:40:46.943424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-597335db-f495-4703-8fcf-54012b292fe7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:46.945627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-597335db-f495-4703-8fcf-54012b292fe7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:46.955216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-597335db-f495-4703-8fcf-54012b292fe7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:46.956089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-597335db-f495-4703-8fcf-54012b292fe7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:46.957124 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-597335db-f495-4703-8fcf-54012b292fe7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:46.957788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-597335db-f495-4703-8fcf-54012b292fe7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:47.328675 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2a1b880a-c0b0-48f7-9daf-a57d9c2b9805 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:47.346869 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2a1b880a-c0b0-48f7-9daf-a57d9c2b9805 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 200 len: 1504 microversion: 2.1 time: 1.163898 Jul 25 12:40:47.348943 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 346/686] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:46 2022] GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 1504 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:47.376045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f278ab69-3eb8-4366-a113-93bc9f879b0e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:47.388074 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f278ab69-3eb8-4366-a113-93bc9f879b0e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:47.430355 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f278ab69-3eb8-4366-a113-93bc9f879b0e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:47.432259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f278ab69-3eb8-4366-a113-93bc9f879b0e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:47.436454 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f278ab69-3eb8-4366-a113-93bc9f879b0e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:47.437175 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f278ab69-3eb8-4366-a113-93bc9f879b0e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:47.493487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f278ab69-3eb8-4366-a113-93bc9f879b0e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Acquired lock "refresh_cache-79221042-a6d8-42f5-8431-5ecfe1fc1972" {{(pid=125883) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 12:40:47.522255 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-597335db-f495-4703-8fcf-54012b292fe7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:47.531469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-597335db-f495-4703-8fcf-54012b292fe7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:47.541654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-597335db-f495-4703-8fcf-54012b292fe7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:47.543273 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-597335db-f495-4703-8fcf-54012b292fe7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1410 microversion: 2.25 time: 0.606531 Jul 25 12:40:47.544355 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 341/687] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:46 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1410 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:47.554479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fc7000f7-a5f4-4125-a6d5-8569c617b259 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:47.555550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fc7000f7-a5f4-4125-a6d5-8569c617b259 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: b2467ff1-7d17-43ae-811d-e37437b3b0ba] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:47.569781 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc7000f7-a5f4-4125-a6d5-8569c617b259 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:47.574605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc7000f7-a5f4-4125-a6d5-8569c617b259 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:47.575755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc7000f7-a5f4-4125-a6d5-8569c617b259 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:47.576355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc7000f7-a5f4-4125-a6d5-8569c617b259 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:47.994461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f278ab69-3eb8-4366-a113-93bc9f879b0e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Releasing lock "refresh_cache-79221042-a6d8-42f5-8431-5ecfe1fc1972" {{(pid=125883) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 12:40:47.995337 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-f278ab69-3eb8-4366-a113-93bc9f879b0e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] HTTP exception thrown: floating IP not found Jul 25 12:40:47.998861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f278ab69-3eb8-4366-a113-93bc9f879b0e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Request method failure captured: Jul 25 12:40:47.998861 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972/action HTTP/1.1 Jul 25 12:40:47.998861 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:40:47.998861 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:40:47.998861 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:40:47.998861 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 41 Jul 25 12:40:47.998861 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:40:47.998861 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:40:47.998861 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:40:47.998861 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:40:47.998861 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o8gDZW5KiL16q9kF4f0IQ7z60rvA9E_ffY_PH855tJdjeVRPgfsx8kMw8HmxaaGmRVyEsVUMk8I0lWvNPFdmPDL6Gesfcg-MZCYl0BnL-FuEyhDBK3O2IR95azal0aquzS7lSz8bkll8AHtBhbsjqcGzx9YvCb_TlRwsVbmBPNKBcg Jul 25 12:40:47.998861 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:40:47.998861 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:40:47.998861 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:40:47.998861 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:40:47.998861 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:40:47.998861 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:40:47.998861 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 5334f5e32ffb4d49a20d4b7e532cd16e Jul 25 12:40:47.998861 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 Jul 25 12:40:47.998861 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:40:47.998861 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:40:48.000214 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5334f5e32ffb4d49a20d4b7e532cd16e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5334f5e32ffb4d49a20d4b7e532cd16e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5334f5e32ffb4d49a20d4b7e532cd16e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5334f5e32ffb4d49a20d4b7e532cd16e"}]}] Jul 25 12:40:48.000214 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 Jul 25 12:40:48.000214 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 5334f5e32ffb4d49a20d4b7e532cd16e Jul 25 12:40:48.000214 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 Jul 25 12:40:48.000214 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project Jul 25 12:40:48.000214 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:40:48.000214 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:40:48.000214 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: efe0a455bf5d4a25b517de628c642f68 Jul 25 12:40:48.000214 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project Jul 25 12:40:48.000214 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:40:48.000214 n-d-848886-15 devstack@n-api.service[125883]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 25 12:40:48.000214 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:40:48.000214 n-d-848886-15 devstack@n-api.service[125883]: exception: floating IP not found Jul 25 12:40:48.001123 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '79221042-a6d8-42f5-8431-5ecfe1fc1972', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 25 12:40:48.001123 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:40:48.001123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:48.001123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 25 12:40:48.001123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 25 12:40:48.001123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 25 12:40:48.001123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 25 12:40:48.001123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 25 12:40:48.001123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 25 12:40:48.001123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 25 12:40:48.001123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 25 12:40:48.001123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 25 12:40:48.001123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:48.001123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:48.001123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:48.001123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:48.001123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:48.001123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:48.001123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:40:48.002286 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:40:48.002286 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:40:48.002286 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:40:48.002286 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:40:48.002286 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:40:48.002286 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:40:48.002286 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:40:48.002286 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 25 12:40:48.002286 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 12:40:48.002286 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 25 12:40:48.002286 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:48.002286 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:48.002286 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:48.002286 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:48.002286 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:48.002286 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:48.002286 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:40:48.002286 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:40:48.002286 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 25 12:40:48.002286 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:40:48.008391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f278ab69-3eb8-4366-a113-93bc9f879b0e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Returning 404 to user: floating IP not found {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:40:48.011350 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f278ab69-3eb8-4366-a113-93bc9f879b0e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "POST /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972/action" status: 404 len: 67 microversion: 2.1 time: 0.657931 Jul 25 12:40:48.013984 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 347/688] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:40:47 2022] POST /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972/action => generated 67 bytes in 664 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:40:48.025155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7c2e8cda-11c5-4eae-8b8c-3028758bdcde tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9cfe280>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:48.169380 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7c2e8cda-11c5-4eae-8b8c-3028758bdcde tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da" status: 200 len: 1412 microversion: 2.1 time: 0.153514 Jul 25 12:40:48.170033 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 348/689] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:40:48 2022] GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da => generated 1412 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:48.194736 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d9ba89a4-29ae-482b-9490-a701dc927ff2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:48.204269 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d9ba89a4-29ae-482b-9490-a701dc927ff2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:48.223629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9ba89a4-29ae-482b-9490-a701dc927ff2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:48.226382 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9ba89a4-29ae-482b-9490-a701dc927ff2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:48.227487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9ba89a4-29ae-482b-9490-a701dc927ff2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:48.231123 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9ba89a4-29ae-482b-9490-a701dc927ff2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:48.324583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fc7000f7-a5f4-4125-a6d5-8569c617b259 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:48.338754 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fc7000f7-a5f4-4125-a6d5-8569c617b259 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba" status: 200 len: 1317 microversion: 2.1 time: 0.792845 Jul 25 12:40:48.353420 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 342/690] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:47 2022] GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba => generated 1317 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:48.362951 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a6142fdc-9917-469c-ad35-d4b621d1f52e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Action: 'action', calling method: .version_select at 0x7efcfd19ea60>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:48.483822 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-a6142fdc-9917-469c-ad35-d4b621d1f52e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 25 12:40:48.486377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a6142fdc-9917-469c-ad35-d4b621d1f52e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Request method failure captured: Jul 25 12:40:48.486377 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972/action HTTP/1.1 Jul 25 12:40:48.486377 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:40:48.486377 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:40:48.486377 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:40:48.486377 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 44 Jul 25 12:40:48.486377 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:40:48.486377 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:40:48.486377 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:40:48.486377 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:40:48.486377 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o8gDZW5KiL16q9kF4f0IQ7z60rvA9E_ffY_PH855tJdjeVRPgfsx8kMw8HmxaaGmRVyEsVUMk8I0lWvNPFdmPDL6Gesfcg-MZCYl0BnL-FuEyhDBK3O2IR95azal0aquzS7lSz8bkll8AHtBhbsjqcGzx9YvCb_TlRwsVbmBPNKBcg Jul 25 12:40:48.486377 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:40:48.486377 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:40:48.486377 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:40:48.486377 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:40:48.486377 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:40:48.486377 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:40:48.486377 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5334f5e32ffb4d49a20d4b7e532cd16e Jul 25 12:40:48.486377 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 Jul 25 12:40:48.486377 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:40:48.486377 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:40:48.487661 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5334f5e32ffb4d49a20d4b7e532cd16e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5334f5e32ffb4d49a20d4b7e532cd16e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5334f5e32ffb4d49a20d4b7e532cd16e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5334f5e32ffb4d49a20d4b7e532cd16e"}]}] Jul 25 12:40:48.487661 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 Jul 25 12:40:48.487661 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5334f5e32ffb4d49a20d4b7e532cd16e Jul 25 12:40:48.487661 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 Jul 25 12:40:48.487661 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project Jul 25 12:40:48.487661 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:40:48.487661 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:40:48.487661 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: efe0a455bf5d4a25b517de628c642f68 Jul 25 12:40:48.487661 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project Jul 25 12:40:48.487661 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:40:48.487661 n-d-848886-15 devstack@n-api.service[125884]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 25 12:40:48.487661 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:40:48.487661 n-d-848886-15 devstack@n-api.service[125884]: exception: Floating IP not found for address 0.0.0.0. Jul 25 12:40:48.488452 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '79221042-a6d8-42f5-8431-5ecfe1fc1972', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 25 12:40:48.488452 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:40:48.488452 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:48.488452 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 25 12:40:48.488452 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 25 12:40:48.488452 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 25 12:40:48.488452 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 25 12:40:48.488452 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 25 12:40:48.488452 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 25 12:40:48.488452 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 25 12:40:48.488452 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:48.488452 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:48.488452 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:48.488452 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:48.488452 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:48.488452 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:48.488452 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:40:48.488452 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:40:48.488452 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:40:48.489560 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:40:48.489560 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:40:48.489560 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:40:48.489560 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:40:48.489560 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:40:48.489560 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 25 12:40:48.489560 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 25 12:40:48.489560 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 25 12:40:48.489560 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 25 12:40:48.489560 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 25 12:40:48.489560 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:48.489560 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:48.489560 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:48.489560 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:48.489560 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:48.489560 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:48.489560 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:40:48.489560 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:40:48.489560 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 25 12:40:48.489560 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:48.490763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a6142fdc-9917-469c-ad35-d4b621d1f52e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:40:48.490763 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a6142fdc-9917-469c-ad35-d4b621d1f52e tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "POST /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972/action" status: 404 len: 88 microversion: 2.1 time: 0.145987 Jul 25 12:40:48.494070 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 343/691] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:40:48 2022] POST /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972/action => generated 88 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:40:48.505029 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-145c8aed-a3fb-4509-8fb5-51e0066dfce8 req-07253369-4765-40ec-bb4c-1c7450b91ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c18f0b76-5dab-4e09-afb8-8a1de682b042", "name": "network-vif-plugged", "status": "completed", "tag": "b5d54db2-13f2-41e6-b4fa-4d037fc2e51e"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:48.541709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-145c8aed-a3fb-4509-8fb5-51e0066dfce8 req-07253369-4765-40ec-bb4c-1c7450b91ed9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:48.546635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-145c8aed-a3fb-4509-8fb5-51e0066dfce8 req-07253369-4765-40ec-bb4c-1c7450b91ed9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:48.578640 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-145c8aed-a3fb-4509-8fb5-51e0066dfce8 req-07253369-4765-40ec-bb4c-1c7450b91ed9 service nova] Creating event network-vif-plugged:b5d54db2-13f2-41e6-b4fa-4d037fc2e51e for instance c18f0b76-5dab-4e09-afb8-8a1de682b042 on n-h1-848886-15 Jul 25 12:40:48.591515 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-145c8aed-a3fb-4509-8fb5-51e0066dfce8 req-07253369-4765-40ec-bb4c-1c7450b91ed9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095868 Jul 25 12:40:48.592563 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 344/692] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:48.618547 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c30dcbb6-6d6f-4a68-8801-58ffcfebb595 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:48.619537 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c30dcbb6-6d6f-4a68-8801-58ffcfebb595 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:48.629763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c30dcbb6-6d6f-4a68-8801-58ffcfebb595 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:48.635301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c30dcbb6-6d6f-4a68-8801-58ffcfebb595 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:48.638229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c30dcbb6-6d6f-4a68-8801-58ffcfebb595 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:48.641801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c30dcbb6-6d6f-4a68-8801-58ffcfebb595 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:48.918483 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d9ba89a4-29ae-482b-9490-a701dc927ff2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:48.933868 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d9ba89a4-29ae-482b-9490-a701dc927ff2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1477 microversion: 2.1 time: 0.750841 Jul 25 12:40:48.966031 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 349/693] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:48 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1477 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:48.972618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8656a2fd-7ba0-445e-aecb-4cdd50edba78 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:48.973494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8656a2fd-7ba0-445e-aecb-4cdd50edba78 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:48.982712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8656a2fd-7ba0-445e-aecb-4cdd50edba78 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:48.983594 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8656a2fd-7ba0-445e-aecb-4cdd50edba78 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:48.985137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8656a2fd-7ba0-445e-aecb-4cdd50edba78 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:48.985867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8656a2fd-7ba0-445e-aecb-4cdd50edba78 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:49.021075 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8656a2fd-7ba0-445e-aecb-4cdd50edba78 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:40:49.071142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:49.255680 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8656a2fd-7ba0-445e-aecb-4cdd50edba78 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "DELETE /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972" status: 204 len: 0 microversion: 2.1 time: 0.286848 Jul 25 12:40:49.267369 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 350/694] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:40:48 2022] DELETE /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:40:49.278489 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9d2ac31e-97d9-4c0b-8611-3f389d98e781 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:49.280182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9d2ac31e-97d9-4c0b-8611-3f389d98e781 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:49.299505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9d2ac31e-97d9-4c0b-8611-3f389d98e781 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:49.300330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9d2ac31e-97d9-4c0b-8611-3f389d98e781 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:49.301289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9d2ac31e-97d9-4c0b-8611-3f389d98e781 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:49.302113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9d2ac31e-97d9-4c0b-8611-3f389d98e781 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:49.399410 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c30dcbb6-6d6f-4a68-8801-58ffcfebb595 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:49.412296 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c30dcbb6-6d6f-4a68-8801-58ffcfebb595 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 200 len: 1504 microversion: 2.1 time: 0.818057 Jul 25 12:40:49.425489 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 345/695] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:48 2022] GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 1504 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:49.525170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9d2ac31e-97d9-4c0b-8611-3f389d98e781 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:49.534953 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9d2ac31e-97d9-4c0b-8611-3f389d98e781 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:49.536767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9d2ac31e-97d9-4c0b-8611-3f389d98e781 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:49.538209 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9d2ac31e-97d9-4c0b-8611-3f389d98e781 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1410 microversion: 2.25 time: 0.269058 Jul 25 12:40:49.539222 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 351/696] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:49 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1410 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:49.544384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-f5872767-cca5-4015-b468-22720297dd7c req-8fbbd4f6-7997-4eb9-aadf-65c14beeaf29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2467ff1-7d17-43ae-811d-e37437b3b0ba", "tag": "b3568573-7fe4-4107-a7fc-99ac9b7eb8df"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:49.555059 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-f5872767-cca5-4015-b468-22720297dd7c req-8fbbd4f6-7997-4eb9-aadf-65c14beeaf29 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:49.555652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-f5872767-cca5-4015-b468-22720297dd7c req-8fbbd4f6-7997-4eb9-aadf-65c14beeaf29 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:49.571704 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-f5872767-cca5-4015-b468-22720297dd7c req-8fbbd4f6-7997-4eb9-aadf-65c14beeaf29 service nova] Creating event network-changed:b3568573-7fe4-4107-a7fc-99ac9b7eb8df for instance b2467ff1-7d17-43ae-811d-e37437b3b0ba on n-h1-848886-15 Jul 25 12:40:49.576579 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-f5872767-cca5-4015-b468-22720297dd7c req-8fbbd4f6-7997-4eb9-aadf-65c14beeaf29 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035938 Jul 25 12:40:49.577821 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 352/697] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:49.583361 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-19a77c00-a66a-4f7a-a310-95524c4d4955 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9e7e040>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:49.607447 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9ea18e3b-fab7-4acb-8831-e4bc34322217 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1718187588", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:49.669284 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-19a77c00-a66a-4f7a-a310-95524c4d4955 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da" status: 200 len: 1412 microversion: 2.1 time: 0.089782 Jul 25 12:40:49.677018 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 353/698] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:40:49 2022] GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da => generated 1412 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:49.679297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a22a475a-9e56-4466-8555-5c881ed7bad0 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:49.681109 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a22a475a-9e56-4466-8555-5c881ed7bad0 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:49.692050 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a22a475a-9e56-4466-8555-5c881ed7bad0 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:49.693261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a22a475a-9e56-4466-8555-5c881ed7bad0 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:49.694215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a22a475a-9e56-4466-8555-5c881ed7bad0 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:49.695246 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a22a475a-9e56-4466-8555-5c881ed7bad0 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:49.728368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-9ea18e3b-fab7-4acb-8831-e4bc34322217 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] validate_networks() for None {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:40:50.063323 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-9ea18e3b-fab7-4acb-8831-e4bc34322217 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:40:50.063741 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-9ea18e3b-fab7-4acb-8831-e4bc34322217 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:40:50.064212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-9ea18e3b-fab7-4acb-8831-e4bc34322217 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:40:50.064719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-9ea18e3b-fab7-4acb-8831-e4bc34322217 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:40:50.065418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-9ea18e3b-fab7-4acb-8831-e4bc34322217 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:40:50.083406 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ea18e3b-fab7-4acb-8831-e4bc34322217 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:50.084092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ea18e3b-fab7-4acb-8831-e4bc34322217 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:50.084644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ea18e3b-fab7-4acb-8831-e4bc34322217 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:50.085077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ea18e3b-fab7-4acb-8831-e4bc34322217 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:50.103915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:50.143871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a22a475a-9e56-4466-8555-5c881ed7bad0 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe0a455bf5d4a25b517de628c642f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334f5e32ffb4d49a20d4b7e532cd16e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:50.152802 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a22a475a-9e56-4466-8555-5c881ed7bad0 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972" status: 200 len: 1541 microversion: 2.1 time: 0.481716 Jul 25 12:40:50.153570 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 354/699] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:49 2022] GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972 => generated 1541 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:50.162804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c34fdc98-3ec5-403d-a028-0b6d3adc64e8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:50.163530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c34fdc98-3ec5-403d-a028-0b6d3adc64e8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: b2467ff1-7d17-43ae-811d-e37437b3b0ba] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:50.166165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-9ea18e3b-fab7-4acb-8831-e4bc34322217 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Getting quotas for project d7f22c7407e64750861d2cf92e2d1aa7. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:40:50.171596 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c34fdc98-3ec5-403d-a028-0b6d3adc64e8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:50.172150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c34fdc98-3ec5-403d-a028-0b6d3adc64e8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:50.173232 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c34fdc98-3ec5-403d-a028-0b6d3adc64e8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:50.173667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c34fdc98-3ec5-403d-a028-0b6d3adc64e8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:50.187419 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-9ea18e3b-fab7-4acb-8831-e4bc34322217 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Getting quotas for user bcea41fff09b46e6823d10f5b1840e6e and project d7f22c7407e64750861d2cf92e2d1aa7. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:40:50.240250 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9ea18e3b-fab7-4acb-8831-e4bc34322217 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:40:50.249561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9ea18e3b-fab7-4acb-8831-e4bc34322217 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] [instance: 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:40:50.368419 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9ea18e3b-fab7-4acb-8831-e4bc34322217 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.954146 Jul 25 12:40:50.373542 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 346/700] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:40:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:40:50.387537 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d0db99f5-fe58-4beb-95b8-40074ba55e07 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:50.388643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d0db99f5-fe58-4beb-95b8-40074ba55e07 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:50.392042 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c34fdc98-3ec5-403d-a028-0b6d3adc64e8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:50.399736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d0db99f5-fe58-4beb-95b8-40074ba55e07 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:50.400320 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d0db99f5-fe58-4beb-95b8-40074ba55e07 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:50.402287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d0db99f5-fe58-4beb-95b8-40074ba55e07 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:50.402819 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d0db99f5-fe58-4beb-95b8-40074ba55e07 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:50.407373 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c34fdc98-3ec5-403d-a028-0b6d3adc64e8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba" status: 200 len: 1317 microversion: 2.1 time: 0.248446 Jul 25 12:40:50.420935 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 355/701] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:50 2022] GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:50.436403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9e4f0699-e6ae-4764-9a3b-adf8ea648636 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:50.437266 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9e4f0699-e6ae-4764-9a3b-adf8ea648636 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] [instance: 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:50.536058 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9e4f0699-e6ae-4764-9a3b-adf8ea648636 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea41fff09b46e6823d10f5b1840e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f22c7407e64750861d2cf92e2d1aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:50.550887 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9e4f0699-e6ae-4764-9a3b-adf8ea648636 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] 10.222.0.49 "GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65" status: 200 len: 1223 microversion: 2.1 time: 0.126406 Jul 25 12:40:50.551506 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 356/702] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:50 2022] GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65 => generated 1223 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:50.558502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a9e65398-fc39-4a45-9e4b-bef5ed12c73e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:50.559487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a9e65398-fc39-4a45-9e4b-bef5ed12c73e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:50.575209 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9e65398-fc39-4a45-9e4b-bef5ed12c73e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:50.580929 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9e65398-fc39-4a45-9e4b-bef5ed12c73e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:50.583798 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9e65398-fc39-4a45-9e4b-bef5ed12c73e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:50.584450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9e65398-fc39-4a45-9e4b-bef5ed12c73e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:50.848686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d0db99f5-fe58-4beb-95b8-40074ba55e07 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:50.858122 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d0db99f5-fe58-4beb-95b8-40074ba55e07 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1477 microversion: 2.1 time: 0.483090 Jul 25 12:40:50.892965 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 347/703] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:50 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1477 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:50.901113 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a7460574-a475-49b2-802d-2dfb83ee57f2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:50.902430 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a7460574-a475-49b2-802d-2dfb83ee57f2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:50.913488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7460574-a475-49b2-802d-2dfb83ee57f2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:50.914334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7460574-a475-49b2-802d-2dfb83ee57f2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:50.916515 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7460574-a475-49b2-802d-2dfb83ee57f2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:50.917273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7460574-a475-49b2-802d-2dfb83ee57f2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:51.389135 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a9e65398-fc39-4a45-9e4b-bef5ed12c73e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:51.404024 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a9e65398-fc39-4a45-9e4b-bef5ed12c73e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 200 len: 1504 microversion: 2.1 time: 0.850984 Jul 25 12:40:51.404937 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 357/704] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:50 2022] GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 1504 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:51.421722 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dab3826b-1887-437c-8122-be9c10b0aac3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9e7e5e0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:51.483714 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dab3826b-1887-437c-8122-be9c10b0aac3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da" status: 200 len: 1412 microversion: 2.1 time: 0.077516 Jul 25 12:40:51.484848 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 358/705] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:40:51 2022] GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da => generated 1412 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:51.491409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6fa2b717-ecf3-476a-94eb-553b342aeb30 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:51.492300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6fa2b717-ecf3-476a-94eb-553b342aeb30 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:51.499188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6fa2b717-ecf3-476a-94eb-553b342aeb30 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:51.499983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6fa2b717-ecf3-476a-94eb-553b342aeb30 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:51.500988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6fa2b717-ecf3-476a-94eb-553b342aeb30 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:51.501633 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6fa2b717-ecf3-476a-94eb-553b342aeb30 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:52.037438 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a7460574-a475-49b2-802d-2dfb83ee57f2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:52.050805 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a7460574-a475-49b2-802d-2dfb83ee57f2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:52.052701 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a7460574-a475-49b2-802d-2dfb83ee57f2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:52.058714 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a7460574-a475-49b2-802d-2dfb83ee57f2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1604 microversion: 2.25 time: 1.163956 Jul 25 12:40:52.059857 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 348/706] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:50 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1604 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:52.074811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a306f24b-2e31-4f56-a99f-8f28938512b1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:52.075741 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a306f24b-2e31-4f56-a99f-8f28938512b1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: b2467ff1-7d17-43ae-811d-e37437b3b0ba] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:52.094241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a306f24b-2e31-4f56-a99f-8f28938512b1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:52.095097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a306f24b-2e31-4f56-a99f-8f28938512b1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:52.096160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a306f24b-2e31-4f56-a99f-8f28938512b1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:52.096891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a306f24b-2e31-4f56-a99f-8f28938512b1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:52.455006 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6fa2b717-ecf3-476a-94eb-553b342aeb30 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe0a455bf5d4a25b517de628c642f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334f5e32ffb4d49a20d4b7e532cd16e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:52.466934 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6fa2b717-ecf3-476a-94eb-553b342aeb30 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972" status: 200 len: 1541 microversion: 2.1 time: 0.980785 Jul 25 12:40:52.469340 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 359/707] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:51 2022] GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972 => generated 1541 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:52.479388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0536865f-a026-4b93-9a8d-bc7122f41489 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:52.482738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0536865f-a026-4b93-9a8d-bc7122f41489 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] [instance: 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:52.496720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0536865f-a026-4b93-9a8d-bc7122f41489 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:52.498321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0536865f-a026-4b93-9a8d-bc7122f41489 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:52.500641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0536865f-a026-4b93-9a8d-bc7122f41489 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:52.501086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0536865f-a026-4b93-9a8d-bc7122f41489 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:52.676397 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0536865f-a026-4b93-9a8d-bc7122f41489 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea41fff09b46e6823d10f5b1840e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f22c7407e64750861d2cf92e2d1aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:52.702330 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0536865f-a026-4b93-9a8d-bc7122f41489 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] 10.222.0.49 "GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65" status: 200 len: 1281 microversion: 2.1 time: 0.231482 Jul 25 12:40:52.720088 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 360/708] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:52 2022] GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65 => generated 1281 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:52.726410 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b5934f61-f271-493b-b840-798ab2865826 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:52.727248 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b5934f61-f271-493b-b840-798ab2865826 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:52.736275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=1,nova_api:UPDATE=13 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:52.744054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b5934f61-f271-493b-b840-798ab2865826 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:52.744948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b5934f61-f271-493b-b840-798ab2865826 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:52.746156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b5934f61-f271-493b-b840-798ab2865826 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:52.747173 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b5934f61-f271-493b-b840-798ab2865826 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:52.916174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a306f24b-2e31-4f56-a99f-8f28938512b1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:52.926365 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a306f24b-2e31-4f56-a99f-8f28938512b1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba" status: 200 len: 1317 microversion: 2.1 time: 0.865173 Jul 25 12:40:52.931093 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 349/709] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:52 2022] GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba => generated 1317 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:52.944588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-327ba0aa-8df7-43f3-98de-aae3e9493d16 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:52.945111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-327ba0aa-8df7-43f3-98de-aae3e9493d16 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:52.961845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-327ba0aa-8df7-43f3-98de-aae3e9493d16 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:52.963394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-327ba0aa-8df7-43f3-98de-aae3e9493d16 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:52.964364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-327ba0aa-8df7-43f3-98de-aae3e9493d16 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:52.964811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-327ba0aa-8df7-43f3-98de-aae3e9493d16 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:53.234620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b5934f61-f271-493b-b840-798ab2865826 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:53.243320 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b5934f61-f271-493b-b840-798ab2865826 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1477 microversion: 2.1 time: 0.521641 Jul 25 12:40:53.246869 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 361/710] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:52 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1477 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:53.266797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bf8663d5-08c2-4314-9bea-299efeef6d21 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:53.267625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bf8663d5-08c2-4314-9bea-299efeef6d21 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:53.287658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf8663d5-08c2-4314-9bea-299efeef6d21 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:53.288261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf8663d5-08c2-4314-9bea-299efeef6d21 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:53.289337 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf8663d5-08c2-4314-9bea-299efeef6d21 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:53.290935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf8663d5-08c2-4314-9bea-299efeef6d21 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:53.377626 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-327ba0aa-8df7-43f3-98de-aae3e9493d16 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.441516 Jul 25 12:40:53.389086 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 350/711] 10.222.0.49 () {60 vars in 1316 bytes} [Mon Jul 25 12:40:52 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/os-interface => generated 284 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:40:53.397608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-faae57aa-9869-411c-9dc7-1b3d84fb03d7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcfa0a6af0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:53.483123 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-faae57aa-9869-411c-9dc7-1b3d84fb03d7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da" status: 200 len: 1412 microversion: 2.1 time: 0.092280 Jul 25 12:40:53.494492 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 351/712] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:40:53 2022] GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:53.506488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-e3cba144-ea16-45e9-b38d-e28711b98740 req-75fcced9-17d6-44b2-b8eb-f109882b6d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79221042-a6d8-42f5-8431-5ecfe1fc1972", "name": "network-vif-deleted", "tag": "c946b3f1-88fd-42a0-a6b5-cb0bde2dca0b"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:53.555034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e3cba144-ea16-45e9-b38d-e28711b98740 req-75fcced9-17d6-44b2-b8eb-f109882b6d33 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:53.555830 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e3cba144-ea16-45e9-b38d-e28711b98740 req-75fcced9-17d6-44b2-b8eb-f109882b6d33 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:53.584118 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-e3cba144-ea16-45e9-b38d-e28711b98740 req-75fcced9-17d6-44b2-b8eb-f109882b6d33 service nova] Creating event network-vif-deleted:c946b3f1-88fd-42a0-a6b5-cb0bde2dca0b for instance 79221042-a6d8-42f5-8431-5ecfe1fc1972 on n-h2-848886-15 Jul 25 12:40:53.595136 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-e3cba144-ea16-45e9-b38d-e28711b98740 req-75fcced9-17d6-44b2-b8eb-f109882b6d33 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098892 Jul 25 12:40:53.602437 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 352/713] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:53.613076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-294e30f3-88ca-4107-85d5-13bfa3395fee tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:53.619577 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-294e30f3-88ca-4107-85d5-13bfa3395fee tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:53.653901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-294e30f3-88ca-4107-85d5-13bfa3395fee tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:53.655745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-294e30f3-88ca-4107-85d5-13bfa3395fee tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:53.659083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-294e30f3-88ca-4107-85d5-13bfa3395fee tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:53.659808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-294e30f3-88ca-4107-85d5-13bfa3395fee tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:53.739216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-294e30f3-88ca-4107-85d5-13bfa3395fee tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:53.739815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-294e30f3-88ca-4107-85d5-13bfa3395fee tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:53.740282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-294e30f3-88ca-4107-85d5-13bfa3395fee tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lazy-loading 'fault' on Instance uuid 79221042-a6d8-42f5-8431-5ecfe1fc1972 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:40:53.846499 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-294e30f3-88ca-4107-85d5-13bfa3395fee tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe0a455bf5d4a25b517de628c642f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334f5e32ffb4d49a20d4b7e532cd16e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:53.855697 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-294e30f3-88ca-4107-85d5-13bfa3395fee tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972" status: 200 len: 1321 microversion: 2.1 time: 0.251005 Jul 25 12:40:53.869884 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 353/714] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:53 2022] GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:53.875161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5a84810d-0673-4c81-8ae7-1059c62c6091 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:53.876051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5a84810d-0673-4c81-8ae7-1059c62c6091 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] [instance: 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:53.886613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a84810d-0673-4c81-8ae7-1059c62c6091 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:53.887251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a84810d-0673-4c81-8ae7-1059c62c6091 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:53.888225 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a84810d-0673-4c81-8ae7-1059c62c6091 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:53.888822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a84810d-0673-4c81-8ae7-1059c62c6091 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:54.178280 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bf8663d5-08c2-4314-9bea-299efeef6d21 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:54.191756 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bf8663d5-08c2-4314-9bea-299efeef6d21 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 200 len: 1479 microversion: 2.1 time: 0.942956 Jul 25 12:40:54.197312 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 362/715] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:53 2022] GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 1479 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:54.219336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d873846d-7a4b-448e-89cf-85e3a1839152 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:54.220394 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d873846d-7a4b-448e-89cf-85e3a1839152 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: b2467ff1-7d17-43ae-811d-e37437b3b0ba] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:54.234480 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d873846d-7a4b-448e-89cf-85e3a1839152 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:54.244876 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d873846d-7a4b-448e-89cf-85e3a1839152 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:54.246082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d873846d-7a4b-448e-89cf-85e3a1839152 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:54.254581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d873846d-7a4b-448e-89cf-85e3a1839152 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:54.670187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5a84810d-0673-4c81-8ae7-1059c62c6091 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea41fff09b46e6823d10f5b1840e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f22c7407e64750861d2cf92e2d1aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:54.683908 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5a84810d-0673-4c81-8ae7-1059c62c6091 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] 10.222.0.49 "GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65" status: 200 len: 1323 microversion: 2.1 time: 0.812495 Jul 25 12:40:54.687581 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 354/716] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:53 2022] GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65 => generated 1323 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:54.705527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-16b1e4a0-4ce2-4477-b477-fcdef01d4542 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Calling method '.version_select at 0x7efcfa0543a0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:54.722446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16b1e4a0-4ce2-4477-b477-fcdef01d4542 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:54.722906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16b1e4a0-4ce2-4477-b477-fcdef01d4542 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:54.740250 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-16b1e4a0-4ce2-4477-b477-fcdef01d4542 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 2362 microversion: 2.1 time: 0.038482 Jul 25 12:40:54.747181 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 355/717] 10.222.0.49 () {58 vars in 1143 bytes} [Mon Jul 25 12:40:54 2022] GET /compute/v2.1/os-migrations => generated 2362 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:54.767552 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c80c6e92-136a-432e-8414-8821d56bf718 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:54.769967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c80c6e92-136a-432e-8414-8821d56bf718 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:54.784715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c80c6e92-136a-432e-8414-8821d56bf718 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:54.788084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c80c6e92-136a-432e-8414-8821d56bf718 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:54.789400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c80c6e92-136a-432e-8414-8821d56bf718 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:54.792963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c80c6e92-136a-432e-8414-8821d56bf718 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:54.879950 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d873846d-7a4b-448e-89cf-85e3a1839152 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:54.891029 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d873846d-7a4b-448e-89cf-85e3a1839152 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba" status: 200 len: 1317 microversion: 2.1 time: 0.692114 Jul 25 12:40:54.892526 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 363/718] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:54 2022] GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba => generated 1317 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:54.899442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8295f7f9-2dd1-410b-a6f1-a0f6208b8537 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9e0daf0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:55.005346 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8295f7f9-2dd1-410b-a6f1-a0f6208b8537 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da" status: 200 len: 1412 microversion: 2.1 time: 0.110967 Jul 25 12:40:55.007513 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 364/719] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:40:54 2022] GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:55.031441 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0a5ecc7a-f481-4dfc-970f-96b874a64a60 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:55.035334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0a5ecc7a-f481-4dfc-970f-96b874a64a60 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:55.078707 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a5ecc7a-f481-4dfc-970f-96b874a64a60 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:55.086909 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a5ecc7a-f481-4dfc-970f-96b874a64a60 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:55.087241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a5ecc7a-f481-4dfc-970f-96b874a64a60 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:55.087627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a5ecc7a-f481-4dfc-970f-96b874a64a60 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:55.271260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c80c6e92-136a-432e-8414-8821d56bf718 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:55.292523 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c80c6e92-136a-432e-8414-8821d56bf718 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1477 microversion: 2.1 time: 0.530221 Jul 25 12:40:55.293811 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 356/720] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:54 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1477 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:55.304556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3ea0916f-803d-4712-8b2c-4561f714ccc3 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:55.306903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3ea0916f-803d-4712-8b2c-4561f714ccc3 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] [instance: 79221042-a6d8-42f5-8431-5ecfe1fc1972] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:55.338249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ea0916f-803d-4712-8b2c-4561f714ccc3 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:55.338977 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ea0916f-803d-4712-8b2c-4561f714ccc3 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:55.340200 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ea0916f-803d-4712-8b2c-4561f714ccc3 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:55.340793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ea0916f-803d-4712-8b2c-4561f714ccc3 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:55.370100 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-3ea0916f-803d-4712-8b2c-4561f714ccc3 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] HTTP exception thrown: Instance 79221042-a6d8-42f5-8431-5ecfe1fc1972 could not be found. Jul 25 12:40:55.372346 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3ea0916f-803d-4712-8b2c-4561f714ccc3 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Request method failure captured: Jul 25 12:40:55.372346 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972 HTTP/1.1 Jul 25 12:40:55.372346 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:40:55.372346 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:40:55.372346 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:40:55.372346 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:40:55.372346 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:40:55.372346 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:40:55.372346 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:40:55.372346 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:40:55.372346 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o8gDZW5KiL16q9kF4f0IQ7z60rvA9E_ffY_PH855tJdjeVRPgfsx8kMw8HmxaaGmRVyEsVUMk8I0lWvNPFdmPDL6Gesfcg-MZCYl0BnL-FuEyhDBK3O2IR95azal0aquzS7lSz8bkll8AHtBhbsjqcGzx9YvCb_TlRwsVbmBPNKBcg Jul 25 12:40:55.372346 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:40:55.372346 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:40:55.372346 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:40:55.372346 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:40:55.372346 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:40:55.372346 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:40:55.372346 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5334f5e32ffb4d49a20d4b7e532cd16e Jul 25 12:40:55.372346 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 Jul 25 12:40:55.372346 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:40:55.372346 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:40:55.373928 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5334f5e32ffb4d49a20d4b7e532cd16e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5334f5e32ffb4d49a20d4b7e532cd16e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5334f5e32ffb4d49a20d4b7e532cd16e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5334f5e32ffb4d49a20d4b7e532cd16e"}]}] Jul 25 12:40:55.373928 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 Jul 25 12:40:55.373928 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5334f5e32ffb4d49a20d4b7e532cd16e Jul 25 12:40:55.373928 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 Jul 25 12:40:55.373928 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project Jul 25 12:40:55.373928 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:40:55.373928 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:40:55.373928 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: efe0a455bf5d4a25b517de628c642f68 Jul 25 12:40:55.373928 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project Jul 25 12:40:55.373928 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:40:55.373928 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 79221042-a6d8-42f5-8431-5ecfe1fc1972 could not be found. Jul 25 12:40:55.373928 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '79221042-a6d8-42f5-8431-5ecfe1fc1972'} Jul 25 12:40:55.374781 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:40:55.374781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:55.374781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:40:55.374781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:40:55.374781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:40:55.374781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:40:55.374781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:40:55.374781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:40:55.374781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:40:55.374781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:40:55.374781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79221042-a6d8-42f5-8431-5ecfe1fc1972 could not be found. Jul 25 12:40:55.374781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:55.374781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:55.374781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:55.374781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:55.374781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:55.374781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:55.374781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:40:55.374781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:40:55.374781 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:40:55.376246 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:40:55.376246 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:40:55.376246 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:40:55.376246 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:40:55.376246 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:40:55.376246 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:40:55.376246 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:40:55.376246 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79221042-a6d8-42f5-8431-5ecfe1fc1972 could not be found. Jul 25 12:40:55.376246 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:55.376246 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:40:55.376246 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:55.376246 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:40:55.376246 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:40:55.376246 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:40:55.376246 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:40:55.376246 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:40:55.376246 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79221042-a6d8-42f5-8431-5ecfe1fc1972 could not be found. Jul 25 12:40:55.376246 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:40:55.378363 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3ea0916f-803d-4712-8b2c-4561f714ccc3 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] Returning 404 to user: Instance 79221042-a6d8-42f5-8431-5ecfe1fc1972 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:40:55.379989 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3ea0916f-803d-4712-8b2c-4561f714ccc3 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893 tempest-FloatingIPsAssociationNegativeTestJSON-2129062893-project] 10.222.0.49 "GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972" status: 404 len: 111 microversion: 2.1 time: 0.084233 Jul 25 12:40:55.384484 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 357/721] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:55 2022] GET /compute/v2.1/servers/79221042-a6d8-42f5-8431-5ecfe1fc1972 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:40:55.471917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-3b00872c-27e2-41fc-bc7b-9b96ffeb05de req-ca486451-1302-41a4-bd5d-4a55fc7a0e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65", "tag": "68928615-4f65-4c21-ab89-f8bfac074672"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:55.498155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3b00872c-27e2-41fc-bc7b-9b96ffeb05de req-ca486451-1302-41a4-bd5d-4a55fc7a0e5b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:55.498944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3b00872c-27e2-41fc-bc7b-9b96ffeb05de req-ca486451-1302-41a4-bd5d-4a55fc7a0e5b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:55.517812 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-3b00872c-27e2-41fc-bc7b-9b96ffeb05de req-ca486451-1302-41a4-bd5d-4a55fc7a0e5b service nova] Creating event network-changed:68928615-4f65-4c21-ab89-f8bfac074672 for instance 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65 on n-h2-848886-15 Jul 25 12:40:55.523434 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-3b00872c-27e2-41fc-bc7b-9b96ffeb05de req-ca486451-1302-41a4-bd5d-4a55fc7a0e5b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062475 Jul 25 12:40:55.524704 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 358/722] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:40:55.707976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6960374c-8ffc-4d6e-90d9-3a1fa0a0aa8d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:55.708990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6960374c-8ffc-4d6e-90d9-3a1fa0a0aa8d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] [instance: 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:55.731822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6960374c-8ffc-4d6e-90d9-3a1fa0a0aa8d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:55.732928 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6960374c-8ffc-4d6e-90d9-3a1fa0a0aa8d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:55.734866 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6960374c-8ffc-4d6e-90d9-3a1fa0a0aa8d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:55.739017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6960374c-8ffc-4d6e-90d9-3a1fa0a0aa8d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:56.354016 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0a5ecc7a-f481-4dfc-970f-96b874a64a60 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 200 len: 1632 microversion: 2.1 time: 1.344090 Jul 25 12:40:56.355067 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 365/723] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:55 2022] GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 1632 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:56.395779 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ad946249-2d56-4f32-8cf0-5fb853efb975 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:56.396671 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ad946249-2d56-4f32-8cf0-5fb853efb975 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: b2467ff1-7d17-43ae-811d-e37437b3b0ba] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:56.415575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad946249-2d56-4f32-8cf0-5fb853efb975 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:56.416511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad946249-2d56-4f32-8cf0-5fb853efb975 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:56.417593 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad946249-2d56-4f32-8cf0-5fb853efb975 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:56.418296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad946249-2d56-4f32-8cf0-5fb853efb975 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:56.490885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6960374c-8ffc-4d6e-90d9-3a1fa0a0aa8d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea41fff09b46e6823d10f5b1840e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f22c7407e64750861d2cf92e2d1aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:56.504229 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6960374c-8ffc-4d6e-90d9-3a1fa0a0aa8d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] 10.222.0.49 "GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65" status: 200 len: 1323 microversion: 2.1 time: 0.797198 Jul 25 12:40:56.514612 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 359/724] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:55 2022] GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65 => generated 1323 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:56.530827 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a999d624-54e7-4c67-b9a0-dcd7007393bd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9f82700>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:56.580209 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a999d624-54e7-4c67-b9a0-dcd7007393bd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da" status: 200 len: 1412 microversion: 2.1 time: 0.064292 Jul 25 12:40:56.588836 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 360/725] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:40:56 2022] GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:56.594157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-db37fe72-208d-4014-b8a6-afb4a16a65d3 req-451e183f-58fd-4ad4-af78-9e7a196adc46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2467ff1-7d17-43ae-811d-e37437b3b0ba", "name": "network-vif-plugged", "status": "completed", "tag": "b3568573-7fe4-4107-a7fc-99ac9b7eb8df"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:56.605039 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-db37fe72-208d-4014-b8a6-afb4a16a65d3 req-451e183f-58fd-4ad4-af78-9e7a196adc46 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:56.605481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-db37fe72-208d-4014-b8a6-afb4a16a65d3 req-451e183f-58fd-4ad4-af78-9e7a196adc46 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:56.618119 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-db37fe72-208d-4014-b8a6-afb4a16a65d3 req-451e183f-58fd-4ad4-af78-9e7a196adc46 service nova] Creating event network-vif-plugged:b3568573-7fe4-4107-a7fc-99ac9b7eb8df for instance b2467ff1-7d17-43ae-811d-e37437b3b0ba on n-h1-848886-15 Jul 25 12:40:56.624124 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-db37fe72-208d-4014-b8a6-afb4a16a65d3 req-451e183f-58fd-4ad4-af78-9e7a196adc46 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033805 Jul 25 12:40:56.625265 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 361/726] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:56.631773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-51e4806a-359f-4530-b7ad-1e64244a12df tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:56.634237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-51e4806a-359f-4530-b7ad-1e64244a12df tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:56.642444 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-51e4806a-359f-4530-b7ad-1e64244a12df tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:56.643405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-51e4806a-359f-4530-b7ad-1e64244a12df tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:56.644563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-51e4806a-359f-4530-b7ad-1e64244a12df tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:56.645171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-51e4806a-359f-4530-b7ad-1e64244a12df tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:57.469488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ad946249-2d56-4f32-8cf0-5fb853efb975 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:57.481731 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ad946249-2d56-4f32-8cf0-5fb853efb975 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba" status: 200 len: 1317 microversion: 2.1 time: 1.124474 Jul 25 12:40:57.496785 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 366/727] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:56 2022] GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba => generated 1317 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:57.508588 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ebc50090-fd3a-438a-b2e5-bc2bf668adf3 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Action: 'create', calling method: .version_select at 0x7efcf9cfe820>, body: {"keypair": {"name": "tempest-keypair-508096258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMqTuIOKtzYGYP8+tUn4Oua11HbJl5bR4yweH6MxE2OHw/dSSWrJeKJz+jN32ojEZxvE9rt9cVYvF0OTZDrz8m/Eb/QzfIWnGJq1VEwcwfuCGzhTHvlFA4Zgo2grpmn0Q=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:57.527172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-51e4806a-359f-4530-b7ad-1e64244a12df tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:57.547777 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-51e4806a-359f-4530-b7ad-1e64244a12df tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1477 microversion: 2.1 time: 0.920882 Jul 25 12:40:57.549702 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 362/728] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:56 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1477 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:57.554723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-de02ae50-9ec6-4802-882b-f12b0566c94c req-9ca9f1fe-09c9-468a-bbe4-96a198395922 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c18f0b76-5dab-4e09-afb8-8a1de682b042", "tag": "b5d54db2-13f2-41e6-b4fa-4d037fc2e51e"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:57.562664 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:57.562849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=11 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:57.568010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-de02ae50-9ec6-4802-882b-f12b0566c94c req-9ca9f1fe-09c9-468a-bbe4-96a198395922 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:57.569339 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-de02ae50-9ec6-4802-882b-f12b0566c94c req-9ca9f1fe-09c9-468a-bbe4-96a198395922 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:57.578423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-ebc50090-fd3a-438a-b2e5-bc2bf668adf3 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Getting quotas for project 4946a18b68e146278158ac991143a243. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:40:57.584217 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-de02ae50-9ec6-4802-882b-f12b0566c94c req-9ca9f1fe-09c9-468a-bbe4-96a198395922 service nova] Creating event network-changed:b5d54db2-13f2-41e6-b4fa-4d037fc2e51e for instance c18f0b76-5dab-4e09-afb8-8a1de682b042 on n-h1-848886-15 Jul 25 12:40:57.595207 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-de02ae50-9ec6-4802-882b-f12b0566c94c req-9ca9f1fe-09c9-468a-bbe4-96a198395922 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042491 Jul 25 12:40:57.597192 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 363/729] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:57.615362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9239e2bd-a9b7-44d4-8c35-0d6a6eee13f2 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:57.616464 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9239e2bd-a9b7-44d4-8c35-0d6a6eee13f2 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] [instance: 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:57.623535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9239e2bd-a9b7-44d4-8c35-0d6a6eee13f2 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:57.624336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9239e2bd-a9b7-44d4-8c35-0d6a6eee13f2 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:57.625032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-ebc50090-fd3a-438a-b2e5-bc2bf668adf3 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Getting quotas for user a02530d4c6384518b3f45515208e83d8 and project 4946a18b68e146278158ac991143a243. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:40:57.625609 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9239e2bd-a9b7-44d4-8c35-0d6a6eee13f2 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:57.626290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9239e2bd-a9b7-44d4-8c35-0d6a6eee13f2 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:57.717374 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ebc50090-fd3a-438a-b2e5-bc2bf668adf3 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.218860 Jul 25 12:40:57.718233 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 367/730] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:40:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:57.730482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-612a2bf2-20f9-40ca-856c-964284b3ab0f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9fe35e0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:57.801738 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-612a2bf2-20f9-40ca-856c-964284b3ab0f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da" status: 200 len: 1421 microversion: 2.1 time: 0.082133 Jul 25 12:40:57.803026 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 368/731] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:40:57 2022] GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da => generated 1421 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:57.820029 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ad68a5f4-66dc-42d4-b7ef-fa9dd4319ac6 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9e7e8b0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:57.891226 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ad68a5f4-66dc-42d4-b7ef-fa9dd4319ac6 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da" status: 200 len: 1421 microversion: 2.1 time: 0.077353 Jul 25 12:40:57.900275 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 369/732] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:40:57 2022] GET /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da => generated 1421 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:57.909685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5e708b9f-165b-4a2a-977f-d7604984cc0c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9fe3670>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:58.364785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9239e2bd-a9b7-44d4-8c35-0d6a6eee13f2 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea41fff09b46e6823d10f5b1840e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f22c7407e64750861d2cf92e2d1aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:58.379168 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9239e2bd-a9b7-44d4-8c35-0d6a6eee13f2 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] 10.222.0.49 "GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65" status: 200 len: 1323 microversion: 2.1 time: 0.780185 Jul 25 12:40:58.381376 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 364/733] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:57 2022] GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65 => generated 1323 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:58.505161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-97eda67d-7d96-4971-a24b-65faa68db792 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:58.506234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-97eda67d-7d96-4971-a24b-65faa68db792 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: b2467ff1-7d17-43ae-811d-e37437b3b0ba] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:58.533043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-97eda67d-7d96-4971-a24b-65faa68db792 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:58.546358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-97eda67d-7d96-4971-a24b-65faa68db792 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:58.547573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-97eda67d-7d96-4971-a24b-65faa68db792 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:58.549344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-97eda67d-7d96-4971-a24b-65faa68db792 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:59.018075 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5e708b9f-165b-4a2a-977f-d7604984cc0c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "DELETE /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da" status: 204 len: 0 microversion: 2.1 time: 1.115961 Jul 25 12:40:59.020239 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 370/734] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:57 2022] DELETE /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da => generated 0 bytes in 1119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:40:59.028218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-161be02d-5f89-417c-a055-aea2451f1e36 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:59.029154 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-161be02d-5f89-417c-a055-aea2451f1e36 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:59.038154 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-161be02d-5f89-417c-a055-aea2451f1e36 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:59.038874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-161be02d-5f89-417c-a055-aea2451f1e36 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:59.039825 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-161be02d-5f89-417c-a055-aea2451f1e36 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:59.040409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-161be02d-5f89-417c-a055-aea2451f1e36 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:59.778719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-97eda67d-7d96-4971-a24b-65faa68db792 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:59.786897 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-97eda67d-7d96-4971-a24b-65faa68db792 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba" status: 200 len: 1467 microversion: 2.1 time: 1.287606 Jul 25 12:40:59.788172 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 365/735] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:58 2022] GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba => generated 1467 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:59.793327 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-65829dba-d2e3-4a66-a79d-e5f80252039a req-550b8f14-c0e8-4dad-b4e2-a43ce62c4bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed7807bb-d3da-4dc2-baf9-e547d671f324", "name": "network-vif-unplugged", "status": "completed", "tag": "6ef3a05b-5303-4d72-9ec0-6eeee9be1d2a"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:59.804047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-65829dba-d2e3-4a66-a79d-e5f80252039a req-550b8f14-c0e8-4dad-b4e2-a43ce62c4bd9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:59.804695 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-65829dba-d2e3-4a66-a79d-e5f80252039a req-550b8f14-c0e8-4dad-b4e2-a43ce62c4bd9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:59.819846 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-65829dba-d2e3-4a66-a79d-e5f80252039a req-550b8f14-c0e8-4dad-b4e2-a43ce62c4bd9 service nova] Creating event network-vif-unplugged:6ef3a05b-5303-4d72-9ec0-6eeee9be1d2a for instance ed7807bb-d3da-4dc2-baf9-e547d671f324 on n-h1-848886-15 Jul 25 12:40:59.826201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [req-65829dba-d2e3-4a66-a79d-e5f80252039a req-550b8f14-c0e8-4dad-b4e2-a43ce62c4bd9 service nova] Instance ed7807bb-d3da-4dc2-baf9-e547d671f324 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 12:40:59.840369 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-65829dba-d2e3-4a66-a79d-e5f80252039a req-550b8f14-c0e8-4dad-b4e2-a43ce62c4bd9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050801 Jul 25 12:40:59.841662 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 366/736] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:59.849123 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d9ad78bd-9d7d-448c-930a-c80324eaff36 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:59.849951 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d9ad78bd-9d7d-448c-930a-c80324eaff36 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: 913f3154-bc36-46f9-8dda-b29d58dd7903] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:59.859419 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9ad78bd-9d7d-448c-930a-c80324eaff36 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:59.860623 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9ad78bd-9d7d-448c-930a-c80324eaff36 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:59.861557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9ad78bd-9d7d-448c-930a-c80324eaff36 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:59.862245 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9ad78bd-9d7d-448c-930a-c80324eaff36 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:59.899960 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d9ad78bd-9d7d-448c-930a-c80324eaff36 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: 913f3154-bc36-46f9-8dda-b29d58dd7903] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:41:00.008624 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d9ad78bd-9d7d-448c-930a-c80324eaff36 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "DELETE /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903" status: 204 len: 0 microversion: 2.1 time: 0.164123 Jul 25 12:41:00.010200 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 367/737] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:40:59 2022] DELETE /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:41:00.017180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d09efcee-dca9-4865-9f89-e672cdcc927c tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:00.018893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d09efcee-dca9-4865-9f89-e672cdcc927c tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] [instance: 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:00.027912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d09efcee-dca9-4865-9f89-e672cdcc927c tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:00.028722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d09efcee-dca9-4865-9f89-e672cdcc927c tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:00.030472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d09efcee-dca9-4865-9f89-e672cdcc927c tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:00.031556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d09efcee-dca9-4865-9f89-e672cdcc927c tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:00.036016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:00.100519 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-161be02d-5f89-417c-a055-aea2451f1e36 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:00.103830 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=8 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:00.116776 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-161be02d-5f89-417c-a055-aea2451f1e36 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1476 microversion: 2.1 time: 1.093186 Jul 25 12:41:00.118564 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 371/738] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:59 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1476 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:00.221352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=58,nova_cell0:UPDATE=12 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:00.272380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b31fbb82-97d7-42a0-8d97-9e321f15a8dd tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:00.272996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b31fbb82-97d7-42a0-8d97-9e321f15a8dd tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] [instance: b2467ff1-7d17-43ae-811d-e37437b3b0ba] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:00.279834 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b31fbb82-97d7-42a0-8d97-9e321f15a8dd tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:00.280548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b31fbb82-97d7-42a0-8d97-9e321f15a8dd tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:00.281520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b31fbb82-97d7-42a0-8d97-9e321f15a8dd tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:00.282159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b31fbb82-97d7-42a0-8d97-9e321f15a8dd tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:00.551926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d09efcee-dca9-4865-9f89-e672cdcc927c tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea41fff09b46e6823d10f5b1840e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f22c7407e64750861d2cf92e2d1aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:00.562394 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d09efcee-dca9-4865-9f89-e672cdcc927c tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] 10.222.0.49 "GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65" status: 200 len: 1323 microversion: 2.1 time: 0.550550 Jul 25 12:41:00.575180 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 368/739] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:00 2022] GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65 => generated 1323 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:00.582846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0638be9f-4133-4ac8-94d0-4edcb08aaac7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1441168357", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "e35876fc-c9c4-48b7-9074-6fd9241d1669"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:00.662154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-0638be9f-4133-4ac8-94d0-4edcb08aaac7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] validate_networks() for [('e35876fc-c9c4-48b7-9074-6fd9241d1669', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:41:01.154033 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b31fbb82-97d7-42a0-8d97-9e321f15a8dd tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba" status: 200 len: 1620 microversion: 2.1 time: 1.032049 Jul 25 12:41:01.156172 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 372/740] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:00 2022] GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba => generated 1620 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:01.176426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-bcd332e2-d8f0-477a-b882-9bb14467465b req-0b6d3108-bcd8-4c57-bdcb-628cf5e299fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65", "name": "network-vif-plugged", "status": "completed", "tag": "68928615-4f65-4c21-ab89-f8bfac074672"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:01.193817 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-bcd332e2-d8f0-477a-b882-9bb14467465b req-0b6d3108-bcd8-4c57-bdcb-628cf5e299fb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:01.195000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-bcd332e2-d8f0-477a-b882-9bb14467465b req-0b6d3108-bcd8-4c57-bdcb-628cf5e299fb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:01.211230 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-bcd332e2-d8f0-477a-b882-9bb14467465b req-0b6d3108-bcd8-4c57-bdcb-628cf5e299fb service nova] Creating event network-vif-plugged:68928615-4f65-4c21-ab89-f8bfac074672 for instance 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65 on n-h2-848886-15 Jul 25 12:41:01.216749 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-bcd332e2-d8f0-477a-b882-9bb14467465b req-0b6d3108-bcd8-4c57-bdcb-628cf5e299fb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059152 Jul 25 12:41:01.218009 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 373/741] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:01.223916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-877dd089-5698-4d48-b800-b75054f2a619 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:01.224820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-877dd089-5698-4d48-b800-b75054f2a619 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:01.232623 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-877dd089-5698-4d48-b800-b75054f2a619 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:01.233160 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-877dd089-5698-4d48-b800-b75054f2a619 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:01.234032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-877dd089-5698-4d48-b800-b75054f2a619 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:01.234678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-877dd089-5698-4d48-b800-b75054f2a619 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:02.157155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-877dd089-5698-4d48-b800-b75054f2a619 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:02.178856 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-877dd089-5698-4d48-b800-b75054f2a619 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1474 microversion: 2.1 time: 0.955294 Jul 25 12:41:02.179958 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 374/742] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:01 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1474 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:02.186075 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6fa3d467-0100-4650-b443-b5a6067def36 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Action: 'create', calling method: .version_select at 0x7efcfa3aeca0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1784621786", "policies": ["affinity"]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:02.227513 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-6fa3d467-0100-4650-b443-b5a6067def36 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_groups'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:41:02.235475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-6fa3d467-0100-4650-b443-b5a6067def36 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for user 8c296447c2254c048f94bd9f186b0097 and project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_groups'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:41:02.298822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-6fa3d467-0100-4650-b443-b5a6067def36 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_groups'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:41:02.305188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-6fa3d467-0100-4650-b443-b5a6067def36 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for user 8c296447c2254c048f94bd9f186b0097 and project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_groups'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:41:02.323194 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6fa3d467-0100-4650-b443-b5a6067def36 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.141234 Jul 25 12:41:02.323820 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 375/743] 10.222.0.49 () {60 vars in 1174 bytes} [Mon Jul 25 12:41:02 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:02.329330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-66b773f7-6ff0-44f9-88ad-2a87f90ad2a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-692741322", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "2f06aa7d-4566-4383-a6d0-5dee93546175"}], "security_groups": [{"name": "tempest-securitygroup--1895933547"}], "key_name": "tempest-keypair-508096258", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:02.499371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-0638be9f-4133-4ac8-94d0-4edcb08aaac7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:41:02.499910 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-0638be9f-4133-4ac8-94d0-4edcb08aaac7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:41:02.501515 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-0638be9f-4133-4ac8-94d0-4edcb08aaac7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:41:02.502071 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-0638be9f-4133-4ac8-94d0-4edcb08aaac7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:41:02.502753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-0638be9f-4133-4ac8-94d0-4edcb08aaac7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:41:02.512913 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0638be9f-4133-4ac8-94d0-4edcb08aaac7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:02.513722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0638be9f-4133-4ac8-94d0-4edcb08aaac7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:02.514783 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0638be9f-4133-4ac8-94d0-4edcb08aaac7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:02.515293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0638be9f-4133-4ac8-94d0-4edcb08aaac7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:02.536149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-0638be9f-4133-4ac8-94d0-4edcb08aaac7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Getting quotas for project 85c0dc3e0d894a5a95b1628cbd20df9f. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:41:02.542167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-0638be9f-4133-4ac8-94d0-4edcb08aaac7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Getting quotas for user 53f799c73ceb4c189329bc86056bc048 and project 85c0dc3e0d894a5a95b1628cbd20df9f. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:41:02.555282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0638be9f-4133-4ac8-94d0-4edcb08aaac7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:41:02.557755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0638be9f-4133-4ac8-94d0-4edcb08aaac7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:41:02.607619 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0638be9f-4133-4ac8-94d0-4edcb08aaac7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.031132 Jul 25 12:41:02.608525 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 369/744] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:41:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:41:02.613438 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d024355d-b656-4530-a104-ba54408afdcb tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:02.614257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d024355d-b656-4530-a104-ba54408afdcb tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] [instance: 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:02.621307 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d024355d-b656-4530-a104-ba54408afdcb tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:02.622003 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d024355d-b656-4530-a104-ba54408afdcb tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:02.622982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d024355d-b656-4530-a104-ba54408afdcb tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:02.623607 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d024355d-b656-4530-a104-ba54408afdcb tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:02.649149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-66b773f7-6ff0-44f9-88ad-2a87f90ad2a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] validate_networks() for [('2f06aa7d-4566-4383-a6d0-5dee93546175', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:41:03.039931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d024355d-b656-4530-a104-ba54408afdcb tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea41fff09b46e6823d10f5b1840e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f22c7407e64750861d2cf92e2d1aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:03.055424 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d024355d-b656-4530-a104-ba54408afdcb tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] 10.222.0.49 "GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65" status: 200 len: 1323 microversion: 2.1 time: 0.445520 Jul 25 12:41:03.060191 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 370/745] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:02 2022] GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65 => generated 1323 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:03.065506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-dc3927c5-e6f5-41ee-add9-5c1208c03a8f req-bf43d82f-2f02-402a-a7e1-80c43102e802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed7807bb-d3da-4dc2-baf9-e547d671f324", "tag": "6ef3a05b-5303-4d72-9ec0-6eeee9be1d2a"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:03.107786 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-dc3927c5-e6f5-41ee-add9-5c1208c03a8f req-bf43d82f-2f02-402a-a7e1-80c43102e802 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:03.108303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-dc3927c5-e6f5-41ee-add9-5c1208c03a8f req-bf43d82f-2f02-402a-a7e1-80c43102e802 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:03.135023 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-dc3927c5-e6f5-41ee-add9-5c1208c03a8f req-bf43d82f-2f02-402a-a7e1-80c43102e802 service nova] Creating event network-changed:6ef3a05b-5303-4d72-9ec0-6eeee9be1d2a for instance ed7807bb-d3da-4dc2-baf9-e547d671f324 on n-h1-848886-15 Jul 25 12:41:03.147827 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [req-dc3927c5-e6f5-41ee-add9-5c1208c03a8f req-bf43d82f-2f02-402a-a7e1-80c43102e802 service nova] Instance ed7807bb-d3da-4dc2-baf9-e547d671f324 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 12:41:03.161560 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-dc3927c5-e6f5-41ee-add9-5c1208c03a8f req-bf43d82f-2f02-402a-a7e1-80c43102e802 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099630 Jul 25 12:41:03.163221 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 371/746] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:03.169127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-539913798", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "5f168769-42c4-41f2-afbc-424c2b01f168"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:03.244394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] validate_networks() for None {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:41:04.432657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:41:04.433265 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:41:04.433674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:41:04.434895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:41:04.435549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:41:04.464105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:04.464991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:04.466079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:04.466500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:04.485870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:41:04.491829 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for user 8c296447c2254c048f94bd9f186b0097 and project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:41:04.509169 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Going to run 2 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:41:04.512879 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: ce1a79d3-137b-485c-9757-bfa73c2dfbfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:41:04.553757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=125884) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 25 12:41:04.566656 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-66b773f7-6ff0-44f9-88ad-2a87f90ad2a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:41:04.568581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-66b773f7-6ff0-44f9-88ad-2a87f90ad2a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:41:04.569226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-66b773f7-6ff0-44f9-88ad-2a87f90ad2a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:41:04.569780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-66b773f7-6ff0-44f9-88ad-2a87f90ad2a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:41:04.570849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-66b773f7-6ff0-44f9-88ad-2a87f90ad2a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:41:04.575616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_group_members'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:41:04.604179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for user 8c296447c2254c048f94bd9f186b0097 and project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_group_members'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:41:04.606261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66b773f7-6ff0-44f9-88ad-2a87f90ad2a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:04.606893 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66b773f7-6ff0-44f9-88ad-2a87f90ad2a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:04.607920 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66b773f7-6ff0-44f9-88ad-2a87f90ad2a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:04.608783 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66b773f7-6ff0-44f9-88ad-2a87f90ad2a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:04.638947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-66b773f7-6ff0-44f9-88ad-2a87f90ad2a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Getting quotas for project 4946a18b68e146278158ac991143a243. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:41:04.646424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-66b773f7-6ff0-44f9-88ad-2a87f90ad2a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Getting quotas for user a02530d4c6384518b3f45515208e83d8 and project 4946a18b68e146278158ac991143a243. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:41:04.677419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-66b773f7-6ff0-44f9-88ad-2a87f90ad2a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:41:04.684194 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-66b773f7-6ff0-44f9-88ad-2a87f90ad2a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:41:04.712993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_group_members'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:41:04.726120 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for user 8c296447c2254c048f94bd9f186b0097 and project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_group_members'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:41:04.770215 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 662e780d-2f9d-4eeb-9323-978b7679d299] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=ce1a79d3-137b-485c-9757-bfa73c2dfbfb,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:41:04.802388 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-66b773f7-6ff0-44f9-88ad-2a87f90ad2a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.477391 Jul 25 12:41:04.816998 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 376/747] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:41:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 2492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:41:04.822614 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ebed8762-2edc-4d86-8a24-df50f71ab0bf tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:04.830646 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ebed8762-2edc-4d86-8a24-df50f71ab0bf tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:04.848636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ebed8762-2edc-4d86-8a24-df50f71ab0bf tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:04.849566 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_group_members'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:41:04.851262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ebed8762-2edc-4d86-8a24-df50f71ab0bf tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:04.853850 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ebed8762-2edc-4d86-8a24-df50f71ab0bf tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:04.854459 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ebed8762-2edc-4d86-8a24-df50f71ab0bf tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:04.894968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for user 8c296447c2254c048f94bd9f186b0097 and project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_group_members'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:41:04.916812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:04.953413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=11 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:04.981302 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_group_members'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:41:05.000898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for user 8c296447c2254c048f94bd9f186b0097 and project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_group_members'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:41:05.073568 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-81e1756a-3bdb-469b-b8b4-799eadc73f74 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.908295 Jul 25 12:41:05.074564 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 372/748] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:41:03 2022] POST /compute/v2.1/servers => generated 32 bytes in 1910 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 25 12:41:05.082395 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-de5f74ff-edaf-4244-be8e-0e6198b52f10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:05.083791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-de5f74ff-edaf-4244-be8e-0e6198b52f10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:05.105285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de5f74ff-edaf-4244-be8e-0e6198b52f10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:05.105753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de5f74ff-edaf-4244-be8e-0e6198b52f10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:05.106588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de5f74ff-edaf-4244-be8e-0e6198b52f10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:05.107084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de5f74ff-edaf-4244-be8e-0e6198b52f10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:06.020343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ebed8762-2edc-4d86-8a24-df50f71ab0bf tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:06.034717 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ebed8762-2edc-4d86-8a24-df50f71ab0bf tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 200 len: 1308 microversion: 2.1 time: 1.216186 Jul 25 12:41:06.035581 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 377/749] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:04 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 1308 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:06.040476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-772a166c-9233-4a6d-86f3-902a1fc170bd req-481982a6-abd8-4da3-b060-7182f1dcd4bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "913f3154-bc36-46f9-8dda-b29d58dd7903", "name": "network-vif-unplugged", "status": "completed", "tag": "20e3356f-efe0-42e1-8e21-b04bba18de4c"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:06.050680 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-de5f74ff-edaf-4244-be8e-0e6198b52f10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:06.062524 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-de5f74ff-edaf-4244-be8e-0e6198b52f10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1471 microversion: 2.1 time: 0.986736 Jul 25 12:41:06.068365 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 373/750] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:05 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1471 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:06.073349 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a948ecdd-d5f6-4f04-ba28-9d87ca18368d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:06.077505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-772a166c-9233-4a6d-86f3-902a1fc170bd req-481982a6-abd8-4da3-b060-7182f1dcd4bf service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:06.079171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a948ecdd-d5f6-4f04-ba28-9d87ca18368d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] [instance: 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:06.094329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-772a166c-9233-4a6d-86f3-902a1fc170bd req-481982a6-abd8-4da3-b060-7182f1dcd4bf service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:06.096135 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a948ecdd-d5f6-4f04-ba28-9d87ca18368d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:06.099040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a948ecdd-d5f6-4f04-ba28-9d87ca18368d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:06.100041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a948ecdd-d5f6-4f04-ba28-9d87ca18368d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:06.100586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a948ecdd-d5f6-4f04-ba28-9d87ca18368d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:06.128682 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-772a166c-9233-4a6d-86f3-902a1fc170bd req-481982a6-abd8-4da3-b060-7182f1dcd4bf service nova] Creating event network-vif-unplugged:20e3356f-efe0-42e1-8e21-b04bba18de4c for instance 913f3154-bc36-46f9-8dda-b29d58dd7903 on n-h2-848886-15 Jul 25 12:41:06.133966 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-772a166c-9233-4a6d-86f3-902a1fc170bd req-481982a6-abd8-4da3-b060-7182f1dcd4bf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096989 Jul 25 12:41:06.138781 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 378/751] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:06.146415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-90de7b2d-c842-4667-acba-6f0f5ba0456b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:06.147388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-90de7b2d-c842-4667-acba-6f0f5ba0456b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:06.154865 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-90de7b2d-c842-4667-acba-6f0f5ba0456b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:06.155570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-90de7b2d-c842-4667-acba-6f0f5ba0456b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:06.156547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-90de7b2d-c842-4667-acba-6f0f5ba0456b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:06.157170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-90de7b2d-c842-4667-acba-6f0f5ba0456b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:06.312549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-90de7b2d-c842-4667-acba-6f0f5ba0456b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:06.322843 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-90de7b2d-c842-4667-acba-6f0f5ba0456b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1285 microversion: 2.1 time: 0.181770 Jul 25 12:41:06.343630 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 379/752] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:06 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:06.349403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fb8b8a64-2b42-4abb-a4e9-94c9786648e5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:06.355269 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fb8b8a64-2b42-4abb-a4e9-94c9786648e5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:06.356475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fb8b8a64-2b42-4abb-a4e9-94c9786648e5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Searching by: {'deleted': False, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 12:41:06.364609 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb8b8a64-2b42-4abb-a4e9-94c9786648e5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:06.365459 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb8b8a64-2b42-4abb-a4e9-94c9786648e5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:06.366466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb8b8a64-2b42-4abb-a4e9-94c9786648e5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:06.368089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb8b8a64-2b42-4abb-a4e9-94c9786648e5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:06.491088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a948ecdd-d5f6-4f04-ba28-9d87ca18368d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea41fff09b46e6823d10f5b1840e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f22c7407e64750861d2cf92e2d1aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:06.503145 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a948ecdd-d5f6-4f04-ba28-9d87ca18368d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] 10.222.0.49 "GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65" status: 200 len: 1473 microversion: 2.1 time: 0.432762 Jul 25 12:41:06.503817 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 374/753] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:06 2022] GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65 => generated 1473 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:06.515478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-eee7577a-852b-4992-a3ee-c6fd9f991739 req-3e471736-0090-467d-8362-6851a8a49503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "913f3154-bc36-46f9-8dda-b29d58dd7903", "name": "network-vif-deleted", "tag": "20e3356f-efe0-42e1-8e21-b04bba18de4c"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:06.521001 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-fb8b8a64-2b42-4abb-a4e9-94c9786648e5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 12:41:06.540255 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-eee7577a-852b-4992-a3ee-c6fd9f991739 req-3e471736-0090-467d-8362-6851a8a49503 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:06.542039 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-eee7577a-852b-4992-a3ee-c6fd9f991739 req-3e471736-0090-467d-8362-6851a8a49503 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:06.568922 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-eee7577a-852b-4992-a3ee-c6fd9f991739 req-3e471736-0090-467d-8362-6851a8a49503 service nova] Creating event network-vif-deleted:20e3356f-efe0-42e1-8e21-b04bba18de4c for instance 913f3154-bc36-46f9-8dda-b29d58dd7903 on n-h2-848886-15 Jul 25 12:41:06.576255 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-eee7577a-852b-4992-a3ee-c6fd9f991739 req-3e471736-0090-467d-8362-6851a8a49503 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069366 Jul 25 12:41:06.577510 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 375/754] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:06.583968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a5641e1f-ff1d-49eb-a503-c900a60f97a4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:06.585033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a5641e1f-ff1d-49eb-a503-c900a60f97a4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:06.593041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5641e1f-ff1d-49eb-a503-c900a60f97a4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:06.593773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5641e1f-ff1d-49eb-a503-c900a60f97a4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:06.594853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5641e1f-ff1d-49eb-a503-c900a60f97a4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:06.595527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5641e1f-ff1d-49eb-a503-c900a60f97a4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:06.721033 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a5641e1f-ff1d-49eb-a503-c900a60f97a4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "POST /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324/action" status: 204 len: 0 microversion: 2.1 time: 0.140484 Jul 25 12:41:06.723195 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 376/755] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:41:06 2022] POST /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324/action => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:41:06.735584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-84ef9222-536b-4477-808d-b8a07a5bbb83 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:06.741207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-84ef9222-536b-4477-808d-b8a07a5bbb83 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] [instance: 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:06.760978 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84ef9222-536b-4477-808d-b8a07a5bbb83 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:06.762874 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84ef9222-536b-4477-808d-b8a07a5bbb83 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:06.765147 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84ef9222-536b-4477-808d-b8a07a5bbb83 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:06.766693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84ef9222-536b-4477-808d-b8a07a5bbb83 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:06.810475 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fb8b8a64-2b42-4abb-a4e9-94c9786648e5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.465009 Jul 25 12:41:06.813748 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 380/756] 10.222.0.49 () {58 vars in 1125 bytes} [Mon Jul 25 12:41:06 2022] GET /compute/v2.1/servers => generated 1002 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:06.831712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9ec91a3d-4d6a-4a52-aab0-d87a7ef8d152 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:06.832488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9ec91a3d-4d6a-4a52-aab0-d87a7ef8d152 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:06.847465 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-84ef9222-536b-4477-808d-b8a07a5bbb83 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'bcea41fff09b46e6823d10f5b1840e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f22c7407e64750861d2cf92e2d1aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:06.858945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-84ef9222-536b-4477-808d-b8a07a5bbb83 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Request method failure captured: Jul 25 12:41:06.858945 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65/diagnostics HTTP/1.1 Jul 25 12:41:06.858945 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:41:06.858945 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:41:06.858945 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:41:06.858945 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:41:06.858945 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:41:06.858945 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:41:06.858945 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:41:06.858945 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:41:06.858945 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o9OiLjICezVjUwkSTh2jMnVJtZWMBbxGUpj5gStCCwBH9WvxrwKNCfTk7zrUHXeHGolzMAX3ocA33gwkmwKyZWbJbKc2Ifdc1EZAHUFJl3wubVyteaP2ZG5p1oxm__biZ3KNsB5oOk_nLJtzVsCvUcNWdd1weFZ0KQUInN6DzeqeG0 Jul 25 12:41:06.858945 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:41:06.858945 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:41:06.858945 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:41:06.858945 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:41:06.858945 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:41:06.858945 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:41:06.858945 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d7f22c7407e64750861d2cf92e2d1aa7 Jul 25 12:41:06.858945 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-535585157 Jul 25 12:41:06.858945 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:41:06.858945 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:41:06.860511 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d7f22c7407e64750861d2cf92e2d1aa7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d7f22c7407e64750861d2cf92e2d1aa7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d7f22c7407e64750861d2cf92e2d1aa7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d7f22c7407e64750861d2cf92e2d1aa7"}]}] Jul 25 12:41:06.860511 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-535585157 Jul 25 12:41:06.860511 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d7f22c7407e64750861d2cf92e2d1aa7 Jul 25 12:41:06.860511 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-535585157 Jul 25 12:41:06.860511 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerDiagnosticsNegativeTest-535585157-project Jul 25 12:41:06.860511 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:41:06.860511 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:41:06.860511 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: bcea41fff09b46e6823d10f5b1840e6e Jul 25 12:41:06.860511 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-535585157-project Jul 25 12:41:06.860511 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:41:06.860511 n-d-848886-15 devstack@n-api.service[125884]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 25 12:41:06.861350 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'server_id': '0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65'} Jul 25 12:41:06.861350 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:41:06.861350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:06.861350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:06.861350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:06.861350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:41:06.861350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:41:06.861350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:41:06.861350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:41:06.861350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 25 12:41:06.861350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 25 12:41:06.861350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:41:06.861350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:41:06.861350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:41:06.861350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:41:06.861350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:41:06.861350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:41:06.861350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:41:06.861350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:41:06.861350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:41:06.863053 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:41:06.863053 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:41:06.863053 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:41:06.863053 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:41:06.863053 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:41:06.863053 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 25 12:41:06.863053 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:06.863053 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:06.863053 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:06.863053 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:06.863053 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:06.863053 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:06.863053 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:41:06.863053 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:41:06.863053 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 25 12:41:06.863053 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:06.866864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-84ef9222-536b-4477-808d-b8a07a5bbb83 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:41:06.867892 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-84ef9222-536b-4477-808d-b8a07a5bbb83 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] 10.222.0.49 "GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.142594 Jul 25 12:41:06.869072 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 377/757] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:41:06 2022] GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65/diagnostics => generated 117 bytes in 145 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:41:06.870354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ec91a3d-4d6a-4a52-aab0-d87a7ef8d152 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:06.875643 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ec91a3d-4d6a-4a52-aab0-d87a7ef8d152 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:06.876561 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ec91a3d-4d6a-4a52-aab0-d87a7ef8d152 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:06.881024 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-87cdcbbc-69b6-4714-a5e8-6bfe4dfb3e9c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:06.881271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ec91a3d-4d6a-4a52-aab0-d87a7ef8d152 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:06.887460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-87cdcbbc-69b6-4714-a5e8-6bfe4dfb3e9c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 662e780d-2f9d-4eeb-9323-978b7679d299] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:06.913424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87cdcbbc-69b6-4714-a5e8-6bfe4dfb3e9c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:06.915199 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87cdcbbc-69b6-4714-a5e8-6bfe4dfb3e9c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:06.920165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87cdcbbc-69b6-4714-a5e8-6bfe4dfb3e9c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:06.920697 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87cdcbbc-69b6-4714-a5e8-6bfe4dfb3e9c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:07.279867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-87cdcbbc-69b6-4714-a5e8-6bfe4dfb3e9c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:07.295134 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-87cdcbbc-69b6-4714-a5e8-6bfe4dfb3e9c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299" status: 200 len: 1270 microversion: 2.1 time: 0.423673 Jul 25 12:41:07.311350 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 378/758] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:06 2022] GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299 => generated 1270 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:07.318155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-85e9c613-144e-494d-a6d5-3ec12118dd1c tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:07.319378 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-85e9c613-144e-494d-a6d5-3ec12118dd1c tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] [instance: 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:07.329953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85e9c613-144e-494d-a6d5-3ec12118dd1c tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:07.332408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85e9c613-144e-494d-a6d5-3ec12118dd1c tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:07.334766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85e9c613-144e-494d-a6d5-3ec12118dd1c tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:07.335484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85e9c613-144e-494d-a6d5-3ec12118dd1c tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:07.377900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-85e9c613-144e-494d-a6d5-3ec12118dd1c tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] [instance: 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:41:07.571795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9ec91a3d-4d6a-4a52-aab0-d87a7ef8d152 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:07.572941 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-85e9c613-144e-494d-a6d5-3ec12118dd1c tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65" status: 204 len: 0 microversion: 2.1 time: 0.257552 Jul 25 12:41:07.575814 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 379/759] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:41:07 2022] DELETE /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:41:07.586536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-167f58a5-6097-44fc-806e-844d3b6e472f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:07.587418 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9ec91a3d-4d6a-4a52-aab0-d87a7ef8d152 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1471 microversion: 2.1 time: 0.772507 Jul 25 12:41:07.587535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-167f58a5-6097-44fc-806e-844d3b6e472f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:07.589158 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 381/760] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:06 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1471 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:07.594476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-82ea1c3c-331a-46e5-96d1-9cfa94417fcd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:07.595697 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-167f58a5-6097-44fc-806e-844d3b6e472f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:07.596206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-167f58a5-6097-44fc-806e-844d3b6e472f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:07.596991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-167f58a5-6097-44fc-806e-844d3b6e472f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:07.597576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-167f58a5-6097-44fc-806e-844d3b6e472f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:07.610795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-82ea1c3c-331a-46e5-96d1-9cfa94417fcd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:07.617970 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82ea1c3c-331a-46e5-96d1-9cfa94417fcd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:07.618659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82ea1c3c-331a-46e5-96d1-9cfa94417fcd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:07.619616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82ea1c3c-331a-46e5-96d1-9cfa94417fcd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:07.620236 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82ea1c3c-331a-46e5-96d1-9cfa94417fcd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:07.733457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-82ea1c3c-331a-46e5-96d1-9cfa94417fcd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:07.742895 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-82ea1c3c-331a-46e5-96d1-9cfa94417fcd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1291 microversion: 2.1 time: 0.152149 Jul 25 12:41:07.744209 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 382/761] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:07 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1291 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:07.751327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-10824b8a-3da9-4701-a33e-a2cedfecc614 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:07.753193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-10824b8a-3da9-4701-a33e-a2cedfecc614 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] [instance: 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:07.761758 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10824b8a-3da9-4701-a33e-a2cedfecc614 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:07.762282 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10824b8a-3da9-4701-a33e-a2cedfecc614 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:07.763108 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10824b8a-3da9-4701-a33e-a2cedfecc614 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:07.763542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10824b8a-3da9-4701-a33e-a2cedfecc614 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:08.007143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-167f58a5-6097-44fc-806e-844d3b6e472f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:08.017431 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-167f58a5-6097-44fc-806e-844d3b6e472f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 200 len: 1308 microversion: 2.1 time: 0.437717 Jul 25 12:41:08.018193 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 380/762] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:07 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 1308 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:08.158082 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-ccd87b7e-4eb9-4d18-95bf-289f24642115 req-cf26f95f-989a-4892-8380-261422396d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed7807bb-d3da-4dc2-baf9-e547d671f324", "name": "network-vif-plugged", "status": "completed", "tag": "6ef3a05b-5303-4d72-9ec0-6eeee9be1d2a"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:08.167841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-ccd87b7e-4eb9-4d18-95bf-289f24642115 req-cf26f95f-989a-4892-8380-261422396d8c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:08.168276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-ccd87b7e-4eb9-4d18-95bf-289f24642115 req-cf26f95f-989a-4892-8380-261422396d8c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:08.180469 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-ccd87b7e-4eb9-4d18-95bf-289f24642115 req-cf26f95f-989a-4892-8380-261422396d8c service nova] Creating event network-vif-plugged:6ef3a05b-5303-4d72-9ec0-6eeee9be1d2a for instance ed7807bb-d3da-4dc2-baf9-e547d671f324 on n-h1-848886-15 Jul 25 12:41:08.189735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [req-ccd87b7e-4eb9-4d18-95bf-289f24642115 req-cf26f95f-989a-4892-8380-261422396d8c service nova] Instance ed7807bb-d3da-4dc2-baf9-e547d671f324 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 12:41:08.204120 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-ccd87b7e-4eb9-4d18-95bf-289f24642115 req-cf26f95f-989a-4892-8380-261422396d8c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049111 Jul 25 12:41:08.204652 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 381/763] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:08.297122 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-10824b8a-3da9-4701-a33e-a2cedfecc614 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea41fff09b46e6823d10f5b1840e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f22c7407e64750861d2cf92e2d1aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:08.306355 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-10824b8a-3da9-4701-a33e-a2cedfecc614 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] 10.222.0.49 "GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65" status: 200 len: 1479 microversion: 2.1 time: 0.560608 Jul 25 12:41:08.308812 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 383/764] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:07 2022] GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65 => generated 1479 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:08.316710 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4e7c1694-4188-4c95-8e46-ed6d4a1973b6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:08.317565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4e7c1694-4188-4c95-8e46-ed6d4a1973b6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 662e780d-2f9d-4eeb-9323-978b7679d299] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:08.329775 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e7c1694-4188-4c95-8e46-ed6d4a1973b6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:08.330103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e7c1694-4188-4c95-8e46-ed6d4a1973b6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:08.331115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e7c1694-4188-4c95-8e46-ed6d4a1973b6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:08.331551 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e7c1694-4188-4c95-8e46-ed6d4a1973b6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:08.509377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4e7c1694-4188-4c95-8e46-ed6d4a1973b6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:08.523419 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4e7c1694-4188-4c95-8e46-ed6d4a1973b6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299" status: 200 len: 1276 microversion: 2.1 time: 0.210340 Jul 25 12:41:08.524521 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 382/765] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:08 2022] GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299 => generated 1276 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:08.604122 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-4d7a3eb0-b8ca-4ad3-b3a1-35441eff9564 req-aab04539-41cd-43e5-8517-08551c987c0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2b91c2f-a489-4adc-9090-7bd3f4d40e16", "tag": "1db48820-05f4-4c09-bd03-4b5f5ea84c25"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:08.611385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e27b2ca4-7750-48d1-ad02-20fec44ea437 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:08.612244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e27b2ca4-7750-48d1-ad02-20fec44ea437 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:08.621595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e27b2ca4-7750-48d1-ad02-20fec44ea437 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:08.622284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e27b2ca4-7750-48d1-ad02-20fec44ea437 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:08.623311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e27b2ca4-7750-48d1-ad02-20fec44ea437 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:08.623910 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e27b2ca4-7750-48d1-ad02-20fec44ea437 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:08.632377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4d7a3eb0-b8ca-4ad3-b3a1-35441eff9564 req-aab04539-41cd-43e5-8517-08551c987c0a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:08.634720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4d7a3eb0-b8ca-4ad3-b3a1-35441eff9564 req-aab04539-41cd-43e5-8517-08551c987c0a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:08.664965 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-4d7a3eb0-b8ca-4ad3-b3a1-35441eff9564 req-aab04539-41cd-43e5-8517-08551c987c0a service nova] Creating event network-changed:1db48820-05f4-4c09-bd03-4b5f5ea84c25 for instance c2b91c2f-a489-4adc-9090-7bd3f4d40e16 on n-h1-848886-15 Jul 25 12:41:08.672072 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-4d7a3eb0-b8ca-4ad3-b3a1-35441eff9564 req-aab04539-41cd-43e5-8517-08551c987c0a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074541 Jul 25 12:41:08.674654 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 384/766] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:08.768922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bbd1818b-aaf5-45f2-baed-3609ef5ae62d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:08.770240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bbd1818b-aaf5-45f2-baed-3609ef5ae62d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:08.778218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbd1818b-aaf5-45f2-baed-3609ef5ae62d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:08.779148 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbd1818b-aaf5-45f2-baed-3609ef5ae62d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:08.780953 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbd1818b-aaf5-45f2-baed-3609ef5ae62d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:08.781876 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbd1818b-aaf5-45f2-baed-3609ef5ae62d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:09.109004 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bbd1818b-aaf5-45f2-baed-3609ef5ae62d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:09.127878 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bbd1818b-aaf5-45f2-baed-3609ef5ae62d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1291 microversion: 2.1 time: 0.364725 Jul 25 12:41:09.128804 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 385/767] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:08 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1291 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:41:09.135010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5735234f-bc3f-4a19-a86a-99a001d754fa tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:09.136245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5735234f-bc3f-4a19-a86a-99a001d754fa tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:09.145053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5735234f-bc3f-4a19-a86a-99a001d754fa tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:09.146035 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5735234f-bc3f-4a19-a86a-99a001d754fa tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:09.147037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5735234f-bc3f-4a19-a86a-99a001d754fa tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:09.147508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5735234f-bc3f-4a19-a86a-99a001d754fa tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:09.535270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e27b2ca4-7750-48d1-ad02-20fec44ea437 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:09.546624 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e27b2ca4-7750-48d1-ad02-20fec44ea437 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1471 microversion: 2.1 time: 0.939915 Jul 25 12:41:09.548569 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 383/768] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:08 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1471 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:09.555225 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2dc18d8f-d3c5-4055-a9d9-4b536af42e7d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:09.557058 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2dc18d8f-d3c5-4055-a9d9-4b536af42e7d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] [instance: 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:09.571363 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2dc18d8f-d3c5-4055-a9d9-4b536af42e7d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:09.574611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2dc18d8f-d3c5-4055-a9d9-4b536af42e7d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:09.576356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2dc18d8f-d3c5-4055-a9d9-4b536af42e7d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:09.577399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2dc18d8f-d3c5-4055-a9d9-4b536af42e7d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:09.707362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5735234f-bc3f-4a19-a86a-99a001d754fa tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:09.715216 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5735234f-bc3f-4a19-a86a-99a001d754fa tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 200 len: 1308 microversion: 2.1 time: 0.585311 Jul 25 12:41:09.716099 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 386/769] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:09 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 1308 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:09.720611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7defcccf-70b0-45d9-930b-df37667088c2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:09.721258 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7defcccf-70b0-45d9-930b-df37667088c2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 662e780d-2f9d-4eeb-9323-978b7679d299] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:09.733000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7defcccf-70b0-45d9-930b-df37667088c2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:09.733452 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7defcccf-70b0-45d9-930b-df37667088c2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:09.734261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7defcccf-70b0-45d9-930b-df37667088c2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:09.734689 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7defcccf-70b0-45d9-930b-df37667088c2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:09.824059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2dc18d8f-d3c5-4055-a9d9-4b536af42e7d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea41fff09b46e6823d10f5b1840e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f22c7407e64750861d2cf92e2d1aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:09.829029 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:09.841004 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2dc18d8f-d3c5-4055-a9d9-4b536af42e7d tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] 10.222.0.49 "GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65" status: 200 len: 1437 microversion: 2.1 time: 0.289032 Jul 25 12:41:09.841208 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 384/770] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:09 2022] GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65 => generated 1437 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:09.936693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7defcccf-70b0-45d9-930b-df37667088c2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:09.949704 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7defcccf-70b0-45d9-930b-df37667088c2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299" status: 200 len: 1276 microversion: 2.1 time: 0.232296 Jul 25 12:41:09.951058 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 387/771] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:09 2022] GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299 => generated 1276 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:10.157526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d7f48758-20eb-4dbe-a340-4aac072e1e4a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:10.159423 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d7f48758-20eb-4dbe-a340-4aac072e1e4a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:10.171895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7f48758-20eb-4dbe-a340-4aac072e1e4a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:10.172763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7f48758-20eb-4dbe-a340-4aac072e1e4a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:10.173653 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7f48758-20eb-4dbe-a340-4aac072e1e4a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:10.174940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7f48758-20eb-4dbe-a340-4aac072e1e4a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:10.381072 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d7f48758-20eb-4dbe-a340-4aac072e1e4a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:10.389315 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d7f48758-20eb-4dbe-a340-4aac072e1e4a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1291 microversion: 2.1 time: 0.241714 Jul 25 12:41:10.389931 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 385/772] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:10 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1291 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:10.568663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0f308fd8-600c-4710-ae78-9ebd3a8cec84 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:10.569552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0f308fd8-600c-4710-ae78-9ebd3a8cec84 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:10.586431 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f308fd8-600c-4710-ae78-9ebd3a8cec84 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:10.587052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f308fd8-600c-4710-ae78-9ebd3a8cec84 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:10.588027 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f308fd8-600c-4710-ae78-9ebd3a8cec84 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:10.588524 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f308fd8-600c-4710-ae78-9ebd3a8cec84 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:10.699042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-4657fac0-e5f7-40df-aadf-2479365c42ee req-e00eb9b4-70bd-4a14-9bc5-41e7e3324e8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65", "name": "network-vif-deleted", "tag": "68928615-4f65-4c21-ab89-f8bfac074672"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:10.709717 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4657fac0-e5f7-40df-aadf-2479365c42ee req-e00eb9b4-70bd-4a14-9bc5-41e7e3324e8c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:10.710452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4657fac0-e5f7-40df-aadf-2479365c42ee req-e00eb9b4-70bd-4a14-9bc5-41e7e3324e8c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:10.723564 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-4657fac0-e5f7-40df-aadf-2479365c42ee req-e00eb9b4-70bd-4a14-9bc5-41e7e3324e8c service nova] Creating event network-vif-deleted:68928615-4f65-4c21-ab89-f8bfac074672 for instance 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65 on n-h2-848886-15 Jul 25 12:41:10.729106 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-4657fac0-e5f7-40df-aadf-2479365c42ee req-e00eb9b4-70bd-4a14-9bc5-41e7e3324e8c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038642 Jul 25 12:41:10.730963 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 386/773] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:10.738067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8deb3470-a640-4ea6-a2f6-6b1c0171cc0f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:10.739058 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8deb3470-a640-4ea6-a2f6-6b1c0171cc0f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:10.747005 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8deb3470-a640-4ea6-a2f6-6b1c0171cc0f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:10.747832 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8deb3470-a640-4ea6-a2f6-6b1c0171cc0f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:10.748819 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8deb3470-a640-4ea6-a2f6-6b1c0171cc0f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:10.749481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8deb3470-a640-4ea6-a2f6-6b1c0171cc0f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:11.219852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0f308fd8-600c-4710-ae78-9ebd3a8cec84 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:11.233018 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0f308fd8-600c-4710-ae78-9ebd3a8cec84 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1471 microversion: 2.1 time: 0.667125 Jul 25 12:41:11.247368 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 388/774] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:10 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1471 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:11.254472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fe9dcf7b-0083-47ee-bf22-3790b7724b80 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:11.255147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fe9dcf7b-0083-47ee-bf22-3790b7724b80 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] [instance: 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:11.258935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:11.262729 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fe9dcf7b-0083-47ee-bf22-3790b7724b80 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:11.263181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fe9dcf7b-0083-47ee-bf22-3790b7724b80 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:11.264095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fe9dcf7b-0083-47ee-bf22-3790b7724b80 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:11.264977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fe9dcf7b-0083-47ee-bf22-3790b7724b80 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:11.283838 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-fe9dcf7b-0083-47ee-bf22-3790b7724b80 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] HTTP exception thrown: Instance 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65 could not be found. Jul 25 12:41:11.286010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fe9dcf7b-0083-47ee-bf22-3790b7724b80 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Request method failure captured: Jul 25 12:41:11.286010 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65 HTTP/1.1 Jul 25 12:41:11.286010 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:41:11.286010 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:41:11.286010 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:41:11.286010 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:41:11.286010 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:41:11.286010 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:41:11.286010 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:41:11.286010 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:41:11.286010 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o9OiLjICezVjUwkSTh2jMnVJtZWMBbxGUpj5gStCCwBH9WvxrwKNCfTk7zrUHXeHGolzMAX3ocA33gwkmwKyZWbJbKc2Ifdc1EZAHUFJl3wubVyteaP2ZG5p1oxm__biZ3KNsB5oOk_nLJtzVsCvUcNWdd1weFZ0KQUInN6DzeqeG0 Jul 25 12:41:11.286010 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:41:11.286010 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:41:11.286010 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:41:11.286010 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:41:11.286010 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:41:11.286010 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:41:11.286010 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d7f22c7407e64750861d2cf92e2d1aa7 Jul 25 12:41:11.286010 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-535585157 Jul 25 12:41:11.286010 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:41:11.286010 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:41:11.287568 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d7f22c7407e64750861d2cf92e2d1aa7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d7f22c7407e64750861d2cf92e2d1aa7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d7f22c7407e64750861d2cf92e2d1aa7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d7f22c7407e64750861d2cf92e2d1aa7"}]}] Jul 25 12:41:11.287568 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-535585157 Jul 25 12:41:11.287568 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d7f22c7407e64750861d2cf92e2d1aa7 Jul 25 12:41:11.287568 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-535585157 Jul 25 12:41:11.287568 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerDiagnosticsNegativeTest-535585157-project Jul 25 12:41:11.287568 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:41:11.287568 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:41:11.287568 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: bcea41fff09b46e6823d10f5b1840e6e Jul 25 12:41:11.287568 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-535585157-project Jul 25 12:41:11.287568 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:41:11.287568 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65 could not be found. Jul 25 12:41:11.287568 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65'} Jul 25 12:41:11.288412 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:41:11.288412 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:11.288412 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:41:11.288412 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:41:11.288412 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:41:11.288412 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:41:11.288412 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:41:11.288412 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:41:11.288412 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:41:11.288412 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:41:11.288412 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65 could not be found. Jul 25 12:41:11.288412 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:11.288412 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:11.288412 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:11.288412 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:11.288412 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:11.288412 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:11.288412 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:41:11.288412 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:41:11.288412 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:41:11.290728 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:41:11.290728 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:41:11.290728 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:41:11.290728 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:41:11.290728 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:41:11.290728 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:41:11.290728 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:41:11.290728 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65 could not be found. Jul 25 12:41:11.290728 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:11.290728 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:11.290728 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:11.290728 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:11.290728 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:11.290728 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:11.290728 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:41:11.290728 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:41:11.290728 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65 could not be found. Jul 25 12:41:11.290728 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:11.293308 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fe9dcf7b-0083-47ee-bf22-3790b7724b80 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] Returning 404 to user: Instance 0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:41:11.294460 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fe9dcf7b-0083-47ee-bf22-3790b7724b80 tempest-ServerDiagnosticsNegativeTest-535585157 tempest-ServerDiagnosticsNegativeTest-535585157-project] 10.222.0.49 "GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65" status: 404 len: 111 microversion: 2.1 time: 0.045883 Jul 25 12:41:11.306697 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 389/775] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:11 2022] GET /compute/v2.1/servers/0d6d3c06-a1d5-40ee-8e44-caccaaeb2f65 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:41:11.325073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c1f04f91-bc4f-449d-97bf-fef7cbc9ff55 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:11.327015 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c1f04f91-bc4f-449d-97bf-fef7cbc9ff55 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 662e780d-2f9d-4eeb-9323-978b7679d299] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:11.327687 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8deb3470-a640-4ea6-a2f6-6b1c0171cc0f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:11.338975 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c1f04f91-bc4f-449d-97bf-fef7cbc9ff55 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:11.341007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c1f04f91-bc4f-449d-97bf-fef7cbc9ff55 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:11.343040 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c1f04f91-bc4f-449d-97bf-fef7cbc9ff55 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:11.344778 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c1f04f91-bc4f-449d-97bf-fef7cbc9ff55 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:11.354183 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8deb3470-a640-4ea6-a2f6-6b1c0171cc0f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 200 len: 1308 microversion: 2.1 time: 0.613564 Jul 25 12:41:11.357977 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 387/776] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:10 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 1308 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:11.414210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-32e2e92b-b0b3-41fb-ad8d-e00d378a0626 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:11.415042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-32e2e92b-b0b3-41fb-ad8d-e00d378a0626 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:11.424000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32e2e92b-b0b3-41fb-ad8d-e00d378a0626 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:11.430564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32e2e92b-b0b3-41fb-ad8d-e00d378a0626 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:11.431641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32e2e92b-b0b3-41fb-ad8d-e00d378a0626 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:11.432276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32e2e92b-b0b3-41fb-ad8d-e00d378a0626 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:12.443812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c1f04f91-bc4f-449d-97bf-fef7cbc9ff55 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:12.456445 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c1f04f91-bc4f-449d-97bf-fef7cbc9ff55 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299" status: 200 len: 1318 microversion: 2.1 time: 1.139626 Jul 25 12:41:12.457822 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 390/777] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:11 2022] GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299 => generated 1318 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:12.464333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1013690b-514c-40ff-84c2-ecd3d0e15bfa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:12.466254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1013690b-514c-40ff-84c2-ecd3d0e15bfa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:12.487510 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1013690b-514c-40ff-84c2-ecd3d0e15bfa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:12.488669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1013690b-514c-40ff-84c2-ecd3d0e15bfa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:12.491263 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1013690b-514c-40ff-84c2-ecd3d0e15bfa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:12.492305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1013690b-514c-40ff-84c2-ecd3d0e15bfa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:12.526734 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-32e2e92b-b0b3-41fb-ad8d-e00d378a0626 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:12.541388 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-32e2e92b-b0b3-41fb-ad8d-e00d378a0626 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1359 microversion: 2.1 time: 1.129642 Jul 25 12:41:12.543937 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 388/778] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:11 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1359 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:41:12.559552 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7fb6c9f3-f0e1-4dbd-ad71-9e329ad93667 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:12.560337 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7fb6c9f3-f0e1-4dbd-ad71-9e329ad93667 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:12.575994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7fb6c9f3-f0e1-4dbd-ad71-9e329ad93667 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:12.576756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7fb6c9f3-f0e1-4dbd-ad71-9e329ad93667 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:12.578222 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7fb6c9f3-f0e1-4dbd-ad71-9e329ad93667 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:12.579899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7fb6c9f3-f0e1-4dbd-ad71-9e329ad93667 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:13.032593 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1013690b-514c-40ff-84c2-ecd3d0e15bfa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:13.047529 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1013690b-514c-40ff-84c2-ecd3d0e15bfa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1463 microversion: 2.1 time: 0.587885 Jul 25 12:41:13.049332 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 391/779] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:12 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1463 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:13.076959 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-236e396b-ecc0-466c-85d1-9d5e0507c36f req-4ecc15af-ec8f-40a2-8857-b7792b4e4944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b91c2f-a489-4adc-9090-7bd3f4d40e16", "name": "network-vif-plugged", "status": "completed", "tag": "1db48820-05f4-4c09-bd03-4b5f5ea84c25"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:13.111407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7fb6c9f3-f0e1-4dbd-ad71-9e329ad93667 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:13.122278 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7fb6c9f3-f0e1-4dbd-ad71-9e329ad93667 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 200 len: 1308 microversion: 2.1 time: 0.576566 Jul 25 12:41:13.124542 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 389/780] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:12 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 1308 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:13.133667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-eb3089aa-06c9-4fe4-bc5c-2aa54bddc0ca tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:13.137792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eb3089aa-06c9-4fe4-bc5c-2aa54bddc0ca tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:13.154564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-236e396b-ecc0-466c-85d1-9d5e0507c36f req-4ecc15af-ec8f-40a2-8857-b7792b4e4944 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:13.157126 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-236e396b-ecc0-466c-85d1-9d5e0507c36f req-4ecc15af-ec8f-40a2-8857-b7792b4e4944 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:13.158352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb3089aa-06c9-4fe4-bc5c-2aa54bddc0ca tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:13.158989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb3089aa-06c9-4fe4-bc5c-2aa54bddc0ca tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:13.159985 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb3089aa-06c9-4fe4-bc5c-2aa54bddc0ca tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:13.163352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb3089aa-06c9-4fe4-bc5c-2aa54bddc0ca tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:13.212034 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-236e396b-ecc0-466c-85d1-9d5e0507c36f req-4ecc15af-ec8f-40a2-8857-b7792b4e4944 service nova] Creating event network-vif-plugged:1db48820-05f4-4c09-bd03-4b5f5ea84c25 for instance c2b91c2f-a489-4adc-9090-7bd3f4d40e16 on n-h1-848886-15 Jul 25 12:41:13.222824 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-236e396b-ecc0-466c-85d1-9d5e0507c36f req-4ecc15af-ec8f-40a2-8857-b7792b4e4944 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168465 Jul 25 12:41:13.224339 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 392/781] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:13.488990 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2cd1bd56-9d9d-4d22-9bec-3a7225b4db89 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:13.490952 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2cd1bd56-9d9d-4d22-9bec-3a7225b4db89 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 662e780d-2f9d-4eeb-9323-978b7679d299] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:13.506337 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2cd1bd56-9d9d-4d22-9bec-3a7225b4db89 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:13.507377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2cd1bd56-9d9d-4d22-9bec-3a7225b4db89 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:13.513029 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2cd1bd56-9d9d-4d22-9bec-3a7225b4db89 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:13.514447 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2cd1bd56-9d9d-4d22-9bec-3a7225b4db89 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:13.696494 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-eb3089aa-06c9-4fe4-bc5c-2aa54bddc0ca tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:13.705700 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-eb3089aa-06c9-4fe4-bc5c-2aa54bddc0ca tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1463 microversion: 2.1 time: 0.578201 Jul 25 12:41:13.708971 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 390/782] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:13 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1463 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:13.722685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e445100f-f870-46d8-8cea-725aaba3f992 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:13.723367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e445100f-f870-46d8-8cea-725aaba3f992 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:13.747003 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e445100f-f870-46d8-8cea-725aaba3f992 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:13.747604 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e445100f-f870-46d8-8cea-725aaba3f992 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:13.748450 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e445100f-f870-46d8-8cea-725aaba3f992 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:13.760145 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e445100f-f870-46d8-8cea-725aaba3f992 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:14.252773 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2cd1bd56-9d9d-4d22-9bec-3a7225b4db89 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:14.273032 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2cd1bd56-9d9d-4d22-9bec-3a7225b4db89 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299" status: 200 len: 1318 microversion: 2.1 time: 0.796077 Jul 25 12:41:14.274317 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 393/783] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:13 2022] GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299 => generated 1318 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:41:14.284639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-2d4bfa12-0faf-4a31-9233-fa4627b1585b req-ab3551fd-d386-4491-8dd9-0c2f140d544c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce1a79d3-137b-485c-9757-bfa73c2dfbfb", "tag": "4340e7ff-5786-4e4c-9869-3fe8f941e21a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:14.327467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2d4bfa12-0faf-4a31-9233-fa4627b1585b req-ab3551fd-d386-4491-8dd9-0c2f140d544c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:14.327921 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2d4bfa12-0faf-4a31-9233-fa4627b1585b req-ab3551fd-d386-4491-8dd9-0c2f140d544c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:14.377411 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-2d4bfa12-0faf-4a31-9233-fa4627b1585b req-ab3551fd-d386-4491-8dd9-0c2f140d544c service nova] Creating event network-changed:4340e7ff-5786-4e4c-9869-3fe8f941e21a for instance ce1a79d3-137b-485c-9757-bfa73c2dfbfb on n-h1-848886-15 Jul 25 12:41:14.386737 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-2d4bfa12-0faf-4a31-9233-fa4627b1585b req-ab3551fd-d386-4491-8dd9-0c2f140d544c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110853 Jul 25 12:41:14.387711 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 394/784] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:14.398975 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-42914763-c25a-4d35-a5c6-a874991d511e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Action: 'create', calling method: .version_select at 0x7efcf9e0db80>, body: {"keypair": {"name": "tempest-keypair-1889547677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErfwPVaTi/Jl0KfUOguXf3o0QMUXllK5EeBUBzqYU9np4Sjssy2316BKm7kD2idp+c4cUNRV4kQuN1OIrFAj+I24H03Op2rEHYTaAtcYaUBBfrOoTkZb5zV1xlwWtXvzg=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:14.424082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-42914763-c25a-4d35-a5c6-a874991d511e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Getting quotas for project 5220cb7ebe7b4a89a8d1edabad2391a7. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:41:14.430159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-42914763-c25a-4d35-a5c6-a874991d511e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Getting quotas for user 045d03491c1046609caffee111db48fc and project 5220cb7ebe7b4a89a8d1edabad2391a7. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:41:14.476626 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:14.492583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e445100f-f870-46d8-8cea-725aaba3f992 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:14.505355 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-42914763-c25a-4d35-a5c6-a874991d511e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.115393 Jul 25 12:41:14.508796 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 395/785] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:41:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:14.509389 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e445100f-f870-46d8-8cea-725aaba3f992 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1359 microversion: 2.1 time: 0.795314 Jul 25 12:41:14.512840 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 391/786] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:13 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1359 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:14.525378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d793e640-a314-4365-9b64-cbef55ad8271 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:14.526863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d793e640-a314-4365-9b64-cbef55ad8271 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:14.527356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-fc91b0c2-3392-4767-9a70-12797fcd1ce2 req-409f8551-fe90-439a-81a3-4d7ce9bf365d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2711752-4c19-477f-a5f0-e5097f2dc41a", "tag": "9e34f7bb-4583-4a3f-875a-1441c142d908"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:14.553375 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d793e640-a314-4365-9b64-cbef55ad8271 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:14.554416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d793e640-a314-4365-9b64-cbef55ad8271 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:14.557697 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fc91b0c2-3392-4767-9a70-12797fcd1ce2 req-409f8551-fe90-439a-81a3-4d7ce9bf365d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:14.559343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d793e640-a314-4365-9b64-cbef55ad8271 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:14.560020 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d793e640-a314-4365-9b64-cbef55ad8271 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:14.562536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fc91b0c2-3392-4767-9a70-12797fcd1ce2 req-409f8551-fe90-439a-81a3-4d7ce9bf365d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:14.598111 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-fc91b0c2-3392-4767-9a70-12797fcd1ce2 req-409f8551-fe90-439a-81a3-4d7ce9bf365d service nova] Creating event network-changed:9e34f7bb-4583-4a3f-875a-1441c142d908 for instance d2711752-4c19-477f-a5f0-e5097f2dc41a on n-h1-848886-15 Jul 25 12:41:14.611310 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-fc91b0c2-3392-4767-9a70-12797fcd1ce2 req-409f8551-fe90-439a-81a3-4d7ce9bf365d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093733 Jul 25 12:41:14.616243 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 392/787] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:15.049296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d793e640-a314-4365-9b64-cbef55ad8271 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:15.071192 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d793e640-a314-4365-9b64-cbef55ad8271 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 200 len: 1308 microversion: 2.1 time: 0.557833 Jul 25 12:41:15.072594 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 396/788] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:14 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 1308 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:15.314397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a0356719-ab59-4e51-a32c-f8877ba5ecb7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:15.316957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a0356719-ab59-4e51-a32c-f8877ba5ecb7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 662e780d-2f9d-4eeb-9323-978b7679d299] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:15.341174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=28 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:15.352083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0356719-ab59-4e51-a32c-f8877ba5ecb7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:15.355092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0356719-ab59-4e51-a32c-f8877ba5ecb7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:15.357418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0356719-ab59-4e51-a32c-f8877ba5ecb7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:15.360472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0356719-ab59-4e51-a32c-f8877ba5ecb7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:15.534784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1617b5e1-d5fd-4e60-a67b-d629c65571ed tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:15.536285 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1617b5e1-d5fd-4e60-a67b-d629c65571ed tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:15.556872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1617b5e1-d5fd-4e60-a67b-d629c65571ed tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:15.557621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1617b5e1-d5fd-4e60-a67b-d629c65571ed tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:15.560750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1617b5e1-d5fd-4e60-a67b-d629c65571ed tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:15.562220 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1617b5e1-d5fd-4e60-a67b-d629c65571ed tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:16.156355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a0356719-ab59-4e51-a32c-f8877ba5ecb7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:16.170113 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a0356719-ab59-4e51-a32c-f8877ba5ecb7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299" status: 200 len: 1318 microversion: 2.1 time: 0.868920 Jul 25 12:41:16.171979 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 393/789] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:15 2022] GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299 => generated 1318 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:16.181369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d2f8c08a-bc65-4f93-ae8a-ece8f5951c6f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:16.185624 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d2f8c08a-bc65-4f93-ae8a-ece8f5951c6f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:16.202957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1617b5e1-d5fd-4e60-a67b-d629c65571ed tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:16.203169 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2f8c08a-bc65-4f93-ae8a-ece8f5951c6f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:16.203560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2f8c08a-bc65-4f93-ae8a-ece8f5951c6f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:16.205152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2f8c08a-bc65-4f93-ae8a-ece8f5951c6f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:16.205783 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2f8c08a-bc65-4f93-ae8a-ece8f5951c6f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:16.210017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:16.213670 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1617b5e1-d5fd-4e60-a67b-d629c65571ed tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1359 microversion: 2.1 time: 0.684664 Jul 25 12:41:16.216722 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 397/790] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:15 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1359 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:41:16.453099 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d2f8c08a-bc65-4f93-ae8a-ece8f5951c6f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:16.461735 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d2f8c08a-bc65-4f93-ae8a-ece8f5951c6f tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 200 len: 1488 microversion: 2.1 time: 0.288322 Jul 25 12:41:16.465481 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 394/791] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:16 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 1488 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:16.485212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-adf62399-80fd-47e7-80bb-d60bede44f9e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:16.490437 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:16.495873 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-adf62399-80fd-47e7-80bb-d60bede44f9e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:16.496574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-adf62399-80fd-47e7-80bb-d60bede44f9e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:16.610252 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-adf62399-80fd-47e7-80bb-d60bede44f9e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Going to try to stop instance {{(pid=125883) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 12:41:16.671939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-10cb7b6c-856b-41e8-8e1d-e0df477a517b req-95bc68b7-e352-46d3-9bd3-b8654acf8339 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "662e780d-2f9d-4eeb-9323-978b7679d299", "tag": "8b7db3fa-056f-4964-8cb9-66f5bb712514"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:16.678991 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-adf62399-80fd-47e7-80bb-d60bede44f9e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "POST /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16/action" status: 202 len: 0 microversion: 2.1 time: 0.197551 Jul 25 12:41:16.685763 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 398/792] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:41:16 2022] POST /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:41:16.696208 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-28b673fd-bbd7-42ea-8884-329d6bad7e42 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:16.699281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-28b673fd-bbd7-42ea-8884-329d6bad7e42 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:16.711659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-28b673fd-bbd7-42ea-8884-329d6bad7e42 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:16.711862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-10cb7b6c-856b-41e8-8e1d-e0df477a517b req-95bc68b7-e352-46d3-9bd3-b8654acf8339 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:16.712280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-10cb7b6c-856b-41e8-8e1d-e0df477a517b req-95bc68b7-e352-46d3-9bd3-b8654acf8339 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:16.713514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-28b673fd-bbd7-42ea-8884-329d6bad7e42 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:16.714715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-28b673fd-bbd7-42ea-8884-329d6bad7e42 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:16.715830 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-28b673fd-bbd7-42ea-8884-329d6bad7e42 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:16.736285 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-10cb7b6c-856b-41e8-8e1d-e0df477a517b req-95bc68b7-e352-46d3-9bd3-b8654acf8339 service nova] Creating event network-changed:8b7db3fa-056f-4964-8cb9-66f5bb712514 for instance 662e780d-2f9d-4eeb-9323-978b7679d299 on n-h1-848886-15 Jul 25 12:41:16.745651 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-10cb7b6c-856b-41e8-8e1d-e0df477a517b req-95bc68b7-e352-46d3-9bd3-b8654acf8339 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078417 Jul 25 12:41:16.746790 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 395/793] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:16.966553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-28b673fd-bbd7-42ea-8884-329d6bad7e42 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:16.975025 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-28b673fd-bbd7-42ea-8884-329d6bad7e42 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 200 len: 1498 microversion: 2.1 time: 0.286467 Jul 25 12:41:16.975989 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 399/794] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:16 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 1498 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:17.192017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b0a97bd8-a854-459c-b1d6-860fb6a05bdb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:17.193123 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b0a97bd8-a854-459c-b1d6-860fb6a05bdb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 662e780d-2f9d-4eeb-9323-978b7679d299] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:17.199878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0a97bd8-a854-459c-b1d6-860fb6a05bdb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:17.200635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0a97bd8-a854-459c-b1d6-860fb6a05bdb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:17.201417 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0a97bd8-a854-459c-b1d6-860fb6a05bdb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:17.201886 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0a97bd8-a854-459c-b1d6-860fb6a05bdb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:17.238058 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-812b93be-0e0e-40ef-9366-5e01ca1fd2aa tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:17.238309 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-812b93be-0e0e-40ef-9366-5e01ca1fd2aa tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:17.247518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-812b93be-0e0e-40ef-9366-5e01ca1fd2aa tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:17.249983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-812b93be-0e0e-40ef-9366-5e01ca1fd2aa tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:17.251131 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-812b93be-0e0e-40ef-9366-5e01ca1fd2aa tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:17.251967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-812b93be-0e0e-40ef-9366-5e01ca1fd2aa tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:17.424705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b0a97bd8-a854-459c-b1d6-860fb6a05bdb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:17.434435 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b0a97bd8-a854-459c-b1d6-860fb6a05bdb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299" status: 200 len: 1318 microversion: 2.1 time: 0.246621 Jul 25 12:41:17.446432 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 396/795] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:17 2022] GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:17.576298 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-812b93be-0e0e-40ef-9366-5e01ca1fd2aa tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:17.589798 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-812b93be-0e0e-40ef-9366-5e01ca1fd2aa tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1359 microversion: 2.1 time: 0.353678 Jul 25 12:41:17.590701 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 400/796] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:17 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1359 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:41:18.001330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-68544bef-3652-4970-9e1f-5f08d55f8107 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:18.003055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-68544bef-3652-4970-9e1f-5f08d55f8107 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:18.015424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68544bef-3652-4970-9e1f-5f08d55f8107 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:18.017081 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68544bef-3652-4970-9e1f-5f08d55f8107 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:18.021436 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68544bef-3652-4970-9e1f-5f08d55f8107 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:18.022154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68544bef-3652-4970-9e1f-5f08d55f8107 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:18.457573 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-565ff954-06ba-4e7d-8219-1421695743ff tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:18.458344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-565ff954-06ba-4e7d-8219-1421695743ff tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 662e780d-2f9d-4eeb-9323-978b7679d299] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:18.469425 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-565ff954-06ba-4e7d-8219-1421695743ff tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:18.472339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-565ff954-06ba-4e7d-8219-1421695743ff tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:18.474782 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-565ff954-06ba-4e7d-8219-1421695743ff tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:18.476642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-565ff954-06ba-4e7d-8219-1421695743ff tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:18.827494 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-68544bef-3652-4970-9e1f-5f08d55f8107 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:18.855817 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-68544bef-3652-4970-9e1f-5f08d55f8107 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 200 len: 1498 microversion: 2.1 time: 0.860948 Jul 25 12:41:18.857060 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 397/797] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:17 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 1498 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:41:18.871971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-69bdf4c6-1da9-4b5f-aa6a-9d24a5692d58 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:18.873499 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-69bdf4c6-1da9-4b5f-aa6a-9d24a5692d58 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:18.890187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-69bdf4c6-1da9-4b5f-aa6a-9d24a5692d58 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:18.890634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-69bdf4c6-1da9-4b5f-aa6a-9d24a5692d58 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:18.891414 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-69bdf4c6-1da9-4b5f-aa6a-9d24a5692d58 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:18.891843 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-69bdf4c6-1da9-4b5f-aa6a-9d24a5692d58 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:19.403476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-565ff954-06ba-4e7d-8219-1421695743ff tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:19.413701 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-565ff954-06ba-4e7d-8219-1421695743ff tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299" status: 200 len: 1318 microversion: 2.1 time: 0.960572 Jul 25 12:41:19.418290 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 401/798] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:18 2022] GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299 => generated 1318 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:19.426038 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-806eac81-1238-40a9-b4c8-ff4924b6b5fd tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Calling method '.version_select at 0x7efcf9fe39d0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:19.451909 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-806eac81-1238-40a9-b4c8-ff4924b6b5fd tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:19.453167 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-806eac81-1238-40a9-b4c8-ff4924b6b5fd tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:19.497215 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-806eac81-1238-40a9-b4c8-ff4924b6b5fd tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 2362 microversion: 2.1 time: 0.077532 Jul 25 12:41:19.510436 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 402/799] 10.222.0.49 () {58 vars in 1143 bytes} [Mon Jul 25 12:41:19 2022] GET /compute/v2.1/os-migrations => generated 2362 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:19.684251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-69bdf4c6-1da9-4b5f-aa6a-9d24a5692d58 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:19.696778 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-69bdf4c6-1da9-4b5f-aa6a-9d24a5692d58 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1359 microversion: 2.1 time: 0.837186 Jul 25 12:41:19.698943 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 398/800] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:18 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1359 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:19.711986 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-539793df-1c62-49fd-b3ca-61a81d46e01a tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:19.737580 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-539793df-1c62-49fd-b3ca-61a81d46e01a tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034590 Jul 25 12:41:19.738645 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 399/801] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:41:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:19.752154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a384e487-b79d-4b56-9c76-0fb329c6d7af tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-2145327132", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:19.763252 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:19.763252 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:41:19.799752 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a384e487-b79d-4b56-9c76-0fb329c6d7af tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.050092 Jul 25 12:41:19.801237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3147df5a-987a-43ba-b7cd-6f1d94483c13 tempest-FlavorsAccessTestJSON-665708222 tempest-FlavorsAccessTestJSON-665708222-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-389681333", "id": 1260373486, "os-flavor-access:is_public": "False"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:19.801814 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 400/802] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 25 12:41:19 2022] POST /compute/v2.1/flavors => generated 499 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:19.808552 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:19.808552 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:41:19.817669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-44fd87f9-b2d5-4637-8106-52566f31d2c3 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:19.842035 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-44fd87f9-b2d5-4637-8106-52566f31d2c3 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.031684 Jul 25 12:41:19.842917 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 401/803] 10.222.0.49 () {58 vars in 1182 bytes} [Mon Jul 25 12:41:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 12:41:19.843938 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3147df5a-987a-43ba-b7cd-6f1d94483c13 tempest-FlavorsAccessTestJSON-665708222 tempest-FlavorsAccessTestJSON-665708222-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.334745 Jul 25 12:41:19.860038 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 403/804] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:41:19 2022] POST /compute/v2.1/flavors => generated 430 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:19.862413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5ceb4cb2-5299-403d-91ef-381fce305626 tempest-FlavorsAccessTestJSON-665708222 tempest-FlavorsAccessTestJSON-665708222-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "37160c259faf4e498ef58daa144ae82f"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:19.874163 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:19.874163 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:41:19.879284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b35e481b-7d17-4b28-b237-21ab1b6e32cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:19.879890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b35e481b-7d17-4b28-b237-21ab1b6e32cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:19.889941 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b35e481b-7d17-4b28-b237-21ab1b6e32cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:19.900052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b35e481b-7d17-4b28-b237-21ab1b6e32cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:19.903201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b35e481b-7d17-4b28-b237-21ab1b6e32cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:19.903709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b35e481b-7d17-4b28-b237-21ab1b6e32cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:20.019820 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5ceb4cb2-5299-403d-91ef-381fce305626 tempest-FlavorsAccessTestJSON-665708222 tempest-FlavorsAccessTestJSON-665708222-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1260373486/action" status: 200 len: 97 microversion: 2.1 time: 0.164568 Jul 25 12:41:20.021194 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 402/805] 10.222.0.49 () {60 vars in 1200 bytes} [Mon Jul 25 12:41:19 2022] POST /compute/v2.1/flavors/1260373486/action => generated 97 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:41:20.187088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fb4d0df2-1192-4e86-a5c2-ad498288f28e tempest-FlavorsAccessTestJSON-23525775 tempest-FlavorsAccessTestJSON-23525775-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:20.224746 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fb4d0df2-1192-4e86-a5c2-ad498288f28e tempest-FlavorsAccessTestJSON-23525775 tempest-FlavorsAccessTestJSON-23525775-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5900 microversion: 2.1 time: 0.196788 Jul 25 12:41:20.226201 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 403/806] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:41:20 2022] GET /compute/v2.1/flavors/detail => generated 5900 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:20.231726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-eeb7cc79-d10e-4d2e-81cc-b5e3db425817 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-601927374", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "3d28811f-a317-4701-8a64-72af0acde626"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:20.264811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b35e481b-7d17-4b28-b237-21ab1b6e32cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:20.286187 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b35e481b-7d17-4b28-b237-21ab1b6e32cd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 200 len: 1498 microversion: 2.1 time: 0.405336 Jul 25 12:41:20.289342 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 404/807] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:19 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 1498 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:20.336084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-eeb7cc79-d10e-4d2e-81cc-b5e3db425817 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] validate_networks() for None {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:41:20.375247 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2162059c-c28b-4b30-abc3-010cf5b730ff tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Action: 'create', calling method: .version_select at 0x7efcfa2b9d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1347793061", "description": "tempest-description-588533612"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:21.055495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-eeb7cc79-d10e-4d2e-81cc-b5e3db425817 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:41:21.058034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-eeb7cc79-d10e-4d2e-81cc-b5e3db425817 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:41:21.058667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-eeb7cc79-d10e-4d2e-81cc-b5e3db425817 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:41:21.059530 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-eeb7cc79-d10e-4d2e-81cc-b5e3db425817 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:41:21.061557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-eeb7cc79-d10e-4d2e-81cc-b5e3db425817 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:41:21.074410 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eeb7cc79-d10e-4d2e-81cc-b5e3db425817 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:21.075109 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eeb7cc79-d10e-4d2e-81cc-b5e3db425817 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:21.075900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eeb7cc79-d10e-4d2e-81cc-b5e3db425817 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:21.076339 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eeb7cc79-d10e-4d2e-81cc-b5e3db425817 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:21.094872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-eeb7cc79-d10e-4d2e-81cc-b5e3db425817 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Getting quotas for project 5220cb7ebe7b4a89a8d1edabad2391a7. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:41:21.100093 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-eeb7cc79-d10e-4d2e-81cc-b5e3db425817 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Getting quotas for user 045d03491c1046609caffee111db48fc and project 5220cb7ebe7b4a89a8d1edabad2391a7. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:41:21.113931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eeb7cc79-d10e-4d2e-81cc-b5e3db425817 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:41:21.122262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eeb7cc79-d10e-4d2e-81cc-b5e3db425817 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:41:21.168041 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2162059c-c28b-4b30-abc3-010cf5b730ff tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.876045 Jul 25 12:41:21.169323 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 405/808] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:41:20 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:21.180940 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-948444a2-5c2b-499a-a303-55bb54db1775 tempest-FlavorsAccessTestJSON-665708222 tempest-FlavorsAccessTestJSON-665708222-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "37160c259faf4e498ef58daa144ae82f"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:21.185061 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:21.185061 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:41:21.236427 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-eeb7cc79-d10e-4d2e-81cc-b5e3db425817 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.006532 Jul 25 12:41:21.245929 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 404/809] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:41:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:41:21.259767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f516edbe-b605-4ce4-b5ce-89d88e170945 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:21.260655 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f516edbe-b605-4ce4-b5ce-89d88e170945 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 662e780d-2f9d-4eeb-9323-978b7679d299] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:21.267852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:21.276677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f516edbe-b605-4ce4-b5ce-89d88e170945 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:21.276860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f516edbe-b605-4ce4-b5ce-89d88e170945 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:21.277925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f516edbe-b605-4ce4-b5ce-89d88e170945 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:21.278776 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f516edbe-b605-4ce4-b5ce-89d88e170945 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:21.286952 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-948444a2-5c2b-499a-a303-55bb54db1775 tempest-FlavorsAccessTestJSON-665708222 tempest-FlavorsAccessTestJSON-665708222-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1260373486/action" status: 200 len: 21 microversion: 2.1 time: 0.116170 Jul 25 12:41:21.288092 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 406/810] 10.222.0.49 () {60 vars in 1200 bytes} [Mon Jul 25 12:41:21 2022] POST /compute/v2.1/flavors/1260373486/action => generated 21 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:41:21.299639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-414473ec-873a-4dfe-8751-bbf503995510 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:21.302275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-414473ec-873a-4dfe-8751-bbf503995510 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:21.320941 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-414473ec-873a-4dfe-8751-bbf503995510 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:21.326171 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-414473ec-873a-4dfe-8751-bbf503995510 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:21.327469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-414473ec-873a-4dfe-8751-bbf503995510 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:21.328026 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-414473ec-873a-4dfe-8751-bbf503995510 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:21.710581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-414473ec-873a-4dfe-8751-bbf503995510 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:21.720204 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-414473ec-873a-4dfe-8751-bbf503995510 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1359 microversion: 2.1 time: 0.430546 Jul 25 12:41:21.734409 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 407/811] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:21 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1359 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:21.740121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-0b09a249-ab6a-4568-abe9-2d29f88a82bb req-011df3de-23fb-496e-b033-a7567ef72e5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce1a79d3-137b-485c-9757-bfa73c2dfbfb", "name": "network-vif-plugged", "status": "completed", "tag": "4340e7ff-5786-4e4c-9869-3fe8f941e21a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:21.744779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f516edbe-b605-4ce4-b5ce-89d88e170945 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:21.752357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0b09a249-ab6a-4568-abe9-2d29f88a82bb req-011df3de-23fb-496e-b033-a7567ef72e5a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:21.753140 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0b09a249-ab6a-4568-abe9-2d29f88a82bb req-011df3de-23fb-496e-b033-a7567ef72e5a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:21.758283 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f516edbe-b605-4ce4-b5ce-89d88e170945 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299" status: 200 len: 1318 microversion: 2.1 time: 0.506009 Jul 25 12:41:21.759909 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 405/812] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:21 2022] GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299 => generated 1318 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:21.768429 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-0b09a249-ab6a-4568-abe9-2d29f88a82bb req-011df3de-23fb-496e-b033-a7567ef72e5a service nova] Creating event network-vif-plugged:4340e7ff-5786-4e4c-9869-3fe8f941e21a for instance ce1a79d3-137b-485c-9757-bfa73c2dfbfb on n-h1-848886-15 Jul 25 12:41:21.774776 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-0b09a249-ab6a-4568-abe9-2d29f88a82bb req-011df3de-23fb-496e-b033-a7567ef72e5a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038355 Jul 25 12:41:21.775733 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 408/813] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:21.781616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a61b4364-b303-41fb-9536-88d9178974cb tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Action: 'create', calling method: .version_select at 0x7efcfa040940>, body: {"security_group_rule": {"parent_group_id": "06b423ca-aadf-45ec-8726-fed37590388a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:21.782448 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1b208602-3846-47ef-be0c-0a9a3be966f7 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:21.784665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1b208602-3846-47ef-be0c-0a9a3be966f7 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:21.869973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1b208602-3846-47ef-be0c-0a9a3be966f7 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:21.899178 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1b208602-3846-47ef-be0c-0a9a3be966f7 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1278 microversion: 2.1 time: 0.121537 Jul 25 12:41:21.900502 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 409/814] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:21 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1278 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:21.911089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-333b3057-f099-42b0-b8fa-5e58ca355028 tempest-FlavorsAccessTestJSON-23525775 tempest-FlavorsAccessTestJSON-23525775-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:21.947844 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-333b3057-f099-42b0-b8fa-5e58ca355028 tempest-FlavorsAccessTestJSON-23525775 tempest-FlavorsAccessTestJSON-23525775-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.043338 Jul 25 12:41:21.948618 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 410/815] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:41:21 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:21.960476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7b290af0-a7c5-4eb6-aa6f-a342f2281e57 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:21.962240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7b290af0-a7c5-4eb6-aa6f-a342f2281e57 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:21.972559 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b290af0-a7c5-4eb6-aa6f-a342f2281e57 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:21.973414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b290af0-a7c5-4eb6-aa6f-a342f2281e57 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:21.976023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b290af0-a7c5-4eb6-aa6f-a342f2281e57 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:21.976797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b290af0-a7c5-4eb6-aa6f-a342f2281e57 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:22.397738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7b290af0-a7c5-4eb6-aa6f-a342f2281e57 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:22.411249 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7b290af0-a7c5-4eb6-aa6f-a342f2281e57 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 200 len: 1498 microversion: 2.1 time: 0.461211 Jul 25 12:41:22.425191 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 411/816] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:21 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 1498 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:22.425191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2ebd303f-d724-47db-a9b2-ed735e06ef49 tempest-FlavorsAccessTestJSON-665708222 tempest-FlavorsAccessTestJSON-665708222-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:22.425191 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:22.425191 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:41:22.440314 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2ebd303f-d724-47db-a9b2-ed735e06ef49 tempest-FlavorsAccessTestJSON-665708222 tempest-FlavorsAccessTestJSON-665708222-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1260373486" status: 202 len: 0 microversion: 2.1 time: 0.026810 Jul 25 12:41:22.441555 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 412/817] 10.222.0.49 () {58 vars in 1161 bytes} [Mon Jul 25 12:41:22 2022] DELETE /compute/v2.1/flavors/1260373486 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:41:22.465485 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-eed6f757-9c34-47af-be92-ff5687255c34 tempest-FlavorsAccessTestJSON-665708222 tempest-FlavorsAccessTestJSON-665708222-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:22.496407 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-eed6f757-9c34-47af-be92-ff5687255c34 tempest-FlavorsAccessTestJSON-665708222 tempest-FlavorsAccessTestJSON-665708222-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.050279 Jul 25 12:41:22.498293 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 413/818] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:41:22 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:22.518704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-20cab292-9a3b-4a96-bc2f-afd2758b9de5 tempest-FlavorsAccessTestJSON-665708222 tempest-FlavorsAccessTestJSON-665708222-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-804644676", "id": 1050848703, "os-flavor-access:is_public": "False"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:22.522515 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:22.522515 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:41:22.554063 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-20cab292-9a3b-4a96-bc2f-afd2758b9de5 tempest-FlavorsAccessTestJSON-665708222 tempest-FlavorsAccessTestJSON-665708222-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.039002 Jul 25 12:41:22.555098 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 414/819] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:41:22 2022] POST /compute/v2.1/flavors => generated 430 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:41:22.567889 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d9d25953-53f6-4cc0-84a5-82a4653f061c tempest-FlavorsAccessTestJSON-665708222 tempest-FlavorsAccessTestJSON-665708222-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:22.568694 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:22.568694 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:41:22.585699 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d9d25953-53f6-4cc0-84a5-82a4653f061c tempest-FlavorsAccessTestJSON-665708222 tempest-FlavorsAccessTestJSON-665708222-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/1050848703/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.022732 Jul 25 12:41:22.586596 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 415/820] 10.222.0.49 () {58 vars in 1209 bytes} [Mon Jul 25 12:41:22 2022] GET /compute/v2.1/flavors/1050848703/os-flavor-access => generated 21 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:41:22.601347 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-76d53d62-7208-48cf-8e0c-3e4e1352a52c tempest-FlavorsAccessTestJSON-665708222 tempest-FlavorsAccessTestJSON-665708222-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:22.603813 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a61b4364-b303-41fb-9536-88d9178974cb tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.840224 Jul 25 12:41:22.615304 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 406/821] 10.222.0.49 () {60 vars in 1195 bytes} [Mon Jul 25 12:41:21 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:22.621716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fb5e86b5-9c3f-43f9-8c70-4511b419ca6e tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Action: 'create', calling method: .version_select at 0x7efcfa270c10>, body: {"security_group_rule": {"parent_group_id": "06b423ca-aadf-45ec-8726-fed37590388a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:22.630933 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-76d53d62-7208-48cf-8e0c-3e4e1352a52c tempest-FlavorsAccessTestJSON-665708222 tempest-FlavorsAccessTestJSON-665708222-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1050848703" status: 202 len: 0 microversion: 2.1 time: 0.037790 Jul 25 12:41:22.632119 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 416/822] 10.222.0.49 () {58 vars in 1161 bytes} [Mon Jul 25 12:41:22 2022] DELETE /compute/v2.1/flavors/1050848703 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:41:22.640213 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5a282d78-0c5a-4a85-ad45-b28275f4b843 tempest-FlavorsAccessTestJSON-665708222 tempest-FlavorsAccessTestJSON-665708222-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:22.678903 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5a282d78-0c5a-4a85-ad45-b28275f4b843 tempest-FlavorsAccessTestJSON-665708222 tempest-FlavorsAccessTestJSON-665708222-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.042605 Jul 25 12:41:22.680203 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 417/823] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:41:22 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:22.742516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0be47c1a-d584-4b8c-aeec-20e88cc3feb6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:22.743465 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0be47c1a-d584-4b8c-aeec-20e88cc3feb6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:22.768221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0be47c1a-d584-4b8c-aeec-20e88cc3feb6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:22.768744 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0be47c1a-d584-4b8c-aeec-20e88cc3feb6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:22.776822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0be47c1a-d584-4b8c-aeec-20e88cc3feb6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:22.777439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0be47c1a-d584-4b8c-aeec-20e88cc3feb6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:22.865323 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-fb5e86b5-9c3f-43f9-8c70-4511b419ca6e tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] HTTP exception thrown: This rule already exists in group 06b423ca-aadf-45ec-8726-fed37590388a Jul 25 12:41:22.867820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fb5e86b5-9c3f-43f9-8c70-4511b419ca6e tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Request method failure captured: Jul 25 12:41:22.867820 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 12:41:22.867820 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:41:22.867820 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:41:22.867820 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:41:22.867820 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 138 Jul 25 12:41:22.867820 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:41:22.867820 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:41:22.867820 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:41:22.867820 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:41:22.867820 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o9wmOYd-ttJArY_dTNEtQIW2u-zyOdRxZ-LJ4bmuOg5HIr_petSkt_Vtp9X81k1T_g6VJapRnVh4j0lmlse4spM6Cu5OZqdaAsVrqFJ11hrBMJZC0MpsWT62dxXOFjJIGcMiSgLGXUb2AElGLn-BXiZCb3CXYv4Uc7GscHGs9_rV24 Jul 25 12:41:22.867820 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:41:22.867820 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:41:22.867820 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:41:22.867820 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:41:22.867820 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:41:22.867820 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:41:22.867820 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 29e189acdfe94ef0850bd23f2e68afea Jul 25 12:41:22.867820 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:22.867820 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:41:22.867820 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:41:22.869211 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_29e189acdfe94ef0850bd23f2e68afea", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/29e189acdfe94ef0850bd23f2e68afea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/29e189acdfe94ef0850bd23f2e68afea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/29e189acdfe94ef0850bd23f2e68afea"}]}] Jul 25 12:41:22.869211 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:22.869211 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 29e189acdfe94ef0850bd23f2e68afea Jul 25 12:41:22.869211 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:22.869211 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304168973-project Jul 25 12:41:22.869211 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:41:22.869211 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:41:22.869211 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 71b9a7d19cb0436abcc37c404f571bdb Jul 25 12:41:22.869211 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973-project Jul 25 12:41:22.869211 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:41:22.869211 n-d-848886-15 devstack@n-api.service[125884]: {"security_group_rule": {"parent_group_id": "06b423ca-aadf-45ec-8726-fed37590388a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 25 12:41:22.869211 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:41:22.871428 n-d-848886-15 devstack@n-api.service[125884]: exception: This rule already exists in group 06b423ca-aadf-45ec-8726-fed37590388a Jul 25 12:41:22.871428 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'body': {'security_group_rule': {'parent_group_id': '06b423ca-aadf-45ec-8726-fed37590388a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 25 12:41:22.871428 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:41:22.871428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:22.871428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 25 12:41:22.871428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 25 12:41:22.871428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 25 12:41:22.871428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 25 12:41:22.871428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 06b423ca-aadf-45ec-8726-fed37590388a Jul 25 12:41:22.871428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:22.871428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:22.871428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:22.871428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:22.871428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:22.871428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:22.871428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:41:22.871428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:41:22.871428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:41:22.871428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:41:22.871428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:41:22.872871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:41:22.872871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 25 12:41:22.872871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 12:41:22.872871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 06b423ca-aadf-45ec-8726-fed37590388a Jul 25 12:41:22.872871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:22.872871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:22.872871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:22.872871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:22.872871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:22.872871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:22.872871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:41:22.872871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:41:22.872871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 06b423ca-aadf-45ec-8726-fed37590388a Jul 25 12:41:22.872871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:22.872871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fb5e86b5-9c3f-43f9-8c70-4511b419ca6e tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Returning 400 to user: This rule already exists in group 06b423ca-aadf-45ec-8726-fed37590388a {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:41:22.875453 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fb5e86b5-9c3f-43f9-8c70-4511b419ca6e tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.254469 Jul 25 12:41:22.880164 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 407/824] 10.222.0.49 () {60 vars in 1195 bytes} [Mon Jul 25 12:41:22 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 264 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:41:22.886734 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-53d3101b-c93f-43c5-a24c-d04e24572522 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:22.887450 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-53d3101b-c93f-43c5-a24c-d04e24572522 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 662e780d-2f9d-4eeb-9323-978b7679d299] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:22.895107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53d3101b-c93f-43c5-a24c-d04e24572522 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:22.895880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53d3101b-c93f-43c5-a24c-d04e24572522 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:22.896882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53d3101b-c93f-43c5-a24c-d04e24572522 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:22.897531 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53d3101b-c93f-43c5-a24c-d04e24572522 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:23.771530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0be47c1a-d584-4b8c-aeec-20e88cc3feb6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:23.791245 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0be47c1a-d584-4b8c-aeec-20e88cc3feb6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1359 microversion: 2.1 time: 1.053719 Jul 25 12:41:23.795316 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 418/825] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:22 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1359 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:41:23.804624 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-73337a6e-365d-453a-874b-31a6dd50b8c5 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Calling method '.version_select at 0x7efcf9e0da60>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:23.807323 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-53d3101b-c93f-43c5-a24c-d04e24572522 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:23.816882 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-53d3101b-c93f-43c5-a24c-d04e24572522 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299" status: 200 len: 1318 microversion: 2.1 time: 0.935245 Jul 25 12:41:23.829549 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 408/826] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:22 2022] GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299 => generated 1318 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:23.829549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2009702a-e425-4736-8fa5-b4bf6c1402fb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:23.829549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2009702a-e425-4736-8fa5-b4bf6c1402fb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:23.834908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2009702a-e425-4736-8fa5-b4bf6c1402fb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:23.834908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2009702a-e425-4736-8fa5-b4bf6c1402fb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:23.836838 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2009702a-e425-4736-8fa5-b4bf6c1402fb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:23.837351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2009702a-e425-4736-8fa5-b4bf6c1402fb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:23.940952 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2009702a-e425-4736-8fa5-b4bf6c1402fb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:23.952294 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2009702a-e425-4736-8fa5-b4bf6c1402fb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1336 microversion: 2.1 time: 0.132886 Jul 25 12:41:23.961610 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 409/827] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:23 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1336 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:23.969270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e81570d2-a159-47c9-8c24-55802006a1af tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:23.970586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e81570d2-a159-47c9-8c24-55802006a1af tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:23.981994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e81570d2-a159-47c9-8c24-55802006a1af tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:23.984281 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e81570d2-a159-47c9-8c24-55802006a1af tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:23.985534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e81570d2-a159-47c9-8c24-55802006a1af tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:23.986375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e81570d2-a159-47c9-8c24-55802006a1af tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:24.487763 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-73337a6e-365d-453a-874b-31a6dd50b8c5 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-group-rules/62f76792-66b1-4073-ab8a-432220b3e034" status: 202 len: 0 microversion: 2.1 time: 0.690860 Jul 25 12:41:24.488015 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 419/828] 10.222.0.49 () {58 vars in 1287 bytes} [Mon Jul 25 12:41:23 2022] DELETE /compute/v2.1/os-security-group-rules/62f76792-66b1-4073-ab8a-432220b3e034 => generated 0 bytes in 692 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:41:24.494705 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-06d6e061-feee-4a6f-9f47-97838619364b req-04428c19-8c97-4bdd-8320-495a5dc382d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2711752-4c19-477f-a5f0-e5097f2dc41a", "name": "network-vif-plugged", "status": "completed", "tag": "9e34f7bb-4583-4a3f-875a-1441c142d908"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:24.526398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-06d6e061-feee-4a6f-9f47-97838619364b req-04428c19-8c97-4bdd-8320-495a5dc382d2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:24.526652 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e81570d2-a159-47c9-8c24-55802006a1af tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:24.526840 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-06d6e061-feee-4a6f-9f47-97838619364b req-04428c19-8c97-4bdd-8320-495a5dc382d2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:24.535575 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e81570d2-a159-47c9-8c24-55802006a1af tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 200 len: 1498 microversion: 2.1 time: 0.572713 Jul 25 12:41:24.541608 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 410/829] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:23 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 1498 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:24.546755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3e92559f-f7f6-4e95-ab57-25237edfb40b tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Action: 'create', calling method: .version_select at 0x7efcfa2405e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2006056857", "description": "tempest-description-1569476107"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:24.592984 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-06d6e061-feee-4a6f-9f47-97838619364b req-04428c19-8c97-4bdd-8320-495a5dc382d2 service nova] Creating event network-vif-plugged:9e34f7bb-4583-4a3f-875a-1441c142d908 for instance d2711752-4c19-477f-a5f0-e5097f2dc41a on n-h1-848886-15 Jul 25 12:41:24.607753 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-06d6e061-feee-4a6f-9f47-97838619364b req-04428c19-8c97-4bdd-8320-495a5dc382d2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118246 Jul 25 12:41:24.610485 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 420/830] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:24.817141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b65dd440-226d-4f25-9e06-5f40f2068e30 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:24.818827 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b65dd440-226d-4f25-9e06-5f40f2068e30 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:24.834083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b65dd440-226d-4f25-9e06-5f40f2068e30 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:24.834563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b65dd440-226d-4f25-9e06-5f40f2068e30 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:24.843880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b65dd440-226d-4f25-9e06-5f40f2068e30 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:24.844354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b65dd440-226d-4f25-9e06-5f40f2068e30 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:25.615672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b65dd440-226d-4f25-9e06-5f40f2068e30 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:25.627868 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b65dd440-226d-4f25-9e06-5f40f2068e30 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1359 microversion: 2.1 time: 0.815261 Jul 25 12:41:25.643994 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 421/831] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:24 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1359 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:25.644939 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3e92559f-f7f6-4e95-ab57-25237edfb40b tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.090169 Jul 25 12:41:25.644939 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 411/832] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:41:24 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:25.651716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-528f3a0e-43a0-4a21-b6bd-4738bb08b323 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:25.654981 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-528f3a0e-43a0-4a21-b6bd-4738bb08b323 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 662e780d-2f9d-4eeb-9323-978b7679d299] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:25.657241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e00a7db0-2886-47c6-a449-a0ae40c12f46 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:25.657891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e00a7db0-2886-47c6-a449-a0ae40c12f46 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:25.666211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-528f3a0e-43a0-4a21-b6bd-4738bb08b323 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:25.666972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-528f3a0e-43a0-4a21-b6bd-4738bb08b323 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:25.667967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-528f3a0e-43a0-4a21-b6bd-4738bb08b323 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:25.668611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-528f3a0e-43a0-4a21-b6bd-4738bb08b323 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:25.685640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e00a7db0-2886-47c6-a449-a0ae40c12f46 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:25.686131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e00a7db0-2886-47c6-a449-a0ae40c12f46 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:25.686927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e00a7db0-2886-47c6-a449-a0ae40c12f46 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:25.687358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e00a7db0-2886-47c6-a449-a0ae40c12f46 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:25.742799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:26.102620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-528f3a0e-43a0-4a21-b6bd-4738bb08b323 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:26.113510 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-528f3a0e-43a0-4a21-b6bd-4738bb08b323 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299" status: 200 len: 1318 microversion: 2.1 time: 0.480454 Jul 25 12:41:26.121629 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 422/833] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:25 2022] GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299 => generated 1318 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:26.141205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c044647c-4854-4c07-8359-f456a2309300 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:26.145092 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c044647c-4854-4c07-8359-f456a2309300 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:26.175523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c044647c-4854-4c07-8359-f456a2309300 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:26.176904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c044647c-4854-4c07-8359-f456a2309300 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:26.182104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c044647c-4854-4c07-8359-f456a2309300 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:26.186199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c044647c-4854-4c07-8359-f456a2309300 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:26.201618 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e00a7db0-2886-47c6-a449-a0ae40c12f46 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:26.215356 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e00a7db0-2886-47c6-a449-a0ae40c12f46 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1378 microversion: 2.1 time: 0.580357 Jul 25 12:41:26.217486 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 412/834] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:25 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1378 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:26.227419 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2bbf352c-293f-4ca3-b738-352e36c49864 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Action: 'create', calling method: .version_select at 0x7efcfa2400d0>, body: {"security_group_rule": {"parent_group_id": "a5943e5c-fc18-42cf-a1c0-16002de87c8c", "ip_protocol": "tcp", "from_port": 102984844, "to_port": 22}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:26.305970 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-2bbf352c-293f-4ca3-b738-352e36c49864 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] HTTP exception thrown: Invalid port range 102984844:22. Former value cannot be greater than the later Jul 25 12:41:26.308144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2bbf352c-293f-4ca3-b738-352e36c49864 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Request method failure captured: Jul 25 12:41:26.308144 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 12:41:26.308144 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:41:26.308144 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:41:26.308144 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:41:26.308144 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 145 Jul 25 12:41:26.308144 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:41:26.308144 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:41:26.308144 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:41:26.308144 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:41:26.308144 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o9wmOYd-ttJArY_dTNEtQIW2u-zyOdRxZ-LJ4bmuOg5HIr_petSkt_Vtp9X81k1T_g6VJapRnVh4j0lmlse4spM6Cu5OZqdaAsVrqFJ11hrBMJZC0MpsWT62dxXOFjJIGcMiSgLGXUb2AElGLn-BXiZCb3CXYv4Uc7GscHGs9_rV24 Jul 25 12:41:26.308144 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:41:26.308144 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:41:26.308144 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:41:26.308144 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:41:26.308144 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:41:26.308144 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:41:26.308144 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 29e189acdfe94ef0850bd23f2e68afea Jul 25 12:41:26.308144 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:26.308144 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:41:26.308144 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:41:26.309714 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_29e189acdfe94ef0850bd23f2e68afea", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/29e189acdfe94ef0850bd23f2e68afea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/29e189acdfe94ef0850bd23f2e68afea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/29e189acdfe94ef0850bd23f2e68afea"}]}] Jul 25 12:41:26.309714 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:26.309714 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 29e189acdfe94ef0850bd23f2e68afea Jul 25 12:41:26.309714 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:26.309714 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304168973-project Jul 25 12:41:26.309714 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:41:26.309714 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:41:26.309714 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 71b9a7d19cb0436abcc37c404f571bdb Jul 25 12:41:26.309714 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973-project Jul 25 12:41:26.309714 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:41:26.309714 n-d-848886-15 devstack@n-api.service[125884]: {"security_group_rule": {"parent_group_id": "a5943e5c-fc18-42cf-a1c0-16002de87c8c", "ip_protocol": "tcp", "from_port": 102984844, "to_port": 22}} Jul 25 12:41:26.309714 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:41:26.310939 n-d-848886-15 devstack@n-api.service[125884]: exception: Invalid port range 102984844:22. Former value cannot be greater than the later Jul 25 12:41:26.310939 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a5943e5c-fc18-42cf-a1c0-16002de87c8c', 'ip_protocol': 'tcp', 'from_port': 102984844, 'to_port': 22}}} Jul 25 12:41:26.310939 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:41:26.310939 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:26.310939 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 25 12:41:26.310939 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 25 12:41:26.310939 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 25 12:41:26.310939 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 25 12:41:26.310939 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 25 12:41:26.310939 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 25 12:41:26.310939 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 25 12:41:26.310939 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 25 12:41:26.310939 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 102984844:22. Former value cannot be greater than the later Jul 25 12:41:26.310939 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:26.310939 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:26.310939 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:26.310939 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:26.310939 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:26.310939 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:26.313100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:41:26.313100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:41:26.313100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:41:26.313100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:41:26.313100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:41:26.313100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:41:26.313100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 25 12:41:26.313100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 12:41:26.313100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 102984844:22. Former value cannot be greater than the later Jul 25 12:41:26.313100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:26.313100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:26.313100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:26.313100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:26.313100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:26.313100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:26.313100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:41:26.313100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:41:26.313100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 102984844:22. Former value cannot be greater than the later Jul 25 12:41:26.313100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:26.316462 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2bbf352c-293f-4ca3-b738-352e36c49864 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Returning 400 to user: Invalid port range 102984844:22. Former value cannot be greater than the later {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:41:26.319825 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2bbf352c-293f-4ca3-b738-352e36c49864 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.100604 Jul 25 12:41:26.321702 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 413/835] 10.222.0.49 () {60 vars in 1195 bytes} [Mon Jul 25 12:41:26 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:41:26.332443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dc0fc26d-ade8-4376-8832-3d2100941dd9 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Action: 'create', calling method: .version_select at 0x7efcfa023040>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1244146126", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:26.335951 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-dc0fc26d-ade8-4376-8832-3d2100941dd9 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] HTTP exception thrown: Security group id should be uuid Jul 25 12:41:26.339362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dc0fc26d-ade8-4376-8832-3d2100941dd9 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Request method failure captured: Jul 25 12:41:26.339362 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 12:41:26.339362 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:41:26.339362 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:41:26.339362 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:41:26.339362 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 131 Jul 25 12:41:26.339362 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:41:26.339362 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:41:26.339362 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:41:26.339362 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:41:26.339362 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o9wmOYd-ttJArY_dTNEtQIW2u-zyOdRxZ-LJ4bmuOg5HIr_petSkt_Vtp9X81k1T_g6VJapRnVh4j0lmlse4spM6Cu5OZqdaAsVrqFJ11hrBMJZC0MpsWT62dxXOFjJIGcMiSgLGXUb2AElGLn-BXiZCb3CXYv4Uc7GscHGs9_rV24 Jul 25 12:41:26.339362 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:41:26.339362 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:41:26.339362 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:41:26.339362 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:41:26.339362 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:41:26.339362 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:41:26.339362 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 29e189acdfe94ef0850bd23f2e68afea Jul 25 12:41:26.339362 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:26.339362 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:41:26.339362 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:41:26.340878 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_29e189acdfe94ef0850bd23f2e68afea", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/29e189acdfe94ef0850bd23f2e68afea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/29e189acdfe94ef0850bd23f2e68afea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/29e189acdfe94ef0850bd23f2e68afea"}]}] Jul 25 12:41:26.340878 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:26.340878 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 29e189acdfe94ef0850bd23f2e68afea Jul 25 12:41:26.340878 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:26.340878 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304168973-project Jul 25 12:41:26.340878 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:41:26.340878 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:41:26.340878 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 71b9a7d19cb0436abcc37c404f571bdb Jul 25 12:41:26.340878 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973-project Jul 25 12:41:26.340878 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:41:26.340878 n-d-848886-15 devstack@n-api.service[125884]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1244146126", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 25 12:41:26.340878 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:41:26.340878 n-d-848886-15 devstack@n-api.service[125884]: exception: Security group id should be uuid Jul 25 12:41:26.341902 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1244146126', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 25 12:41:26.341902 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:41:26.341902 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:26.341902 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 25 12:41:26.341902 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 25 12:41:26.341902 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 25 12:41:26.341902 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 25 12:41:26.341902 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 25 12:41:26.341902 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:26.341902 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:26.341902 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:26.341902 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:26.341902 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:26.341902 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:26.341902 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:41:26.341902 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:41:26.341902 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:41:26.341902 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:41:26.341902 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:41:26.341902 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:41:26.343465 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 25 12:41:26.343465 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 12:41:26.343465 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 25 12:41:26.343465 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:26.343465 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:26.343465 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:26.343465 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:26.343465 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:26.343465 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:26.343465 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:41:26.343465 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:41:26.343465 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 25 12:41:26.343465 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:26.348484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dc0fc26d-ade8-4376-8832-3d2100941dd9 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Returning 400 to user: Security group id should be uuid {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:41:26.352192 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dc0fc26d-ade8-4376-8832-3d2100941dd9 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.024286 Jul 25 12:41:26.356335 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 414/836] 10.222.0.49 () {60 vars in 1195 bytes} [Mon Jul 25 12:41:26 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:41:26.370228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7854ed62-0fd3-4f50-b416-52caef4c7b6a tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Action: 'create', calling method: .version_select at 0x7efcfa054f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1399396463", "description": "tempest-description-2069135247"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:26.893927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c044647c-4854-4c07-8359-f456a2309300 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:26.914441 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c044647c-4854-4c07-8359-f456a2309300 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 200 len: 1498 microversion: 2.1 time: 0.791564 Jul 25 12:41:26.919233 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 423/837] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:26 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 1498 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:26.937502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9b22dd70-05f0-4a57-8ea0-a0b43ecc890a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:26.939365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9b22dd70-05f0-4a57-8ea0-a0b43ecc890a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:26.958451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b22dd70-05f0-4a57-8ea0-a0b43ecc890a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:26.964469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b22dd70-05f0-4a57-8ea0-a0b43ecc890a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:26.966659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b22dd70-05f0-4a57-8ea0-a0b43ecc890a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:26.971001 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b22dd70-05f0-4a57-8ea0-a0b43ecc890a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:27.214087 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7854ed62-0fd3-4f50-b416-52caef4c7b6a tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.852341 Jul 25 12:41:27.214763 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 415/838] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:41:26 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:27.221937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c8712625-01a7-477d-a915-88750510c7ba tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:27.221937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c8712625-01a7-477d-a915-88750510c7ba tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 662e780d-2f9d-4eeb-9323-978b7679d299] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:27.230953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c8712625-01a7-477d-a915-88750510c7ba tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:27.231179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c8712625-01a7-477d-a915-88750510c7ba tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:27.231968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c8712625-01a7-477d-a915-88750510c7ba tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:27.232405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c8712625-01a7-477d-a915-88750510c7ba tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:27.470523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9b22dd70-05f0-4a57-8ea0-a0b43ecc890a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:27.495262 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9b22dd70-05f0-4a57-8ea0-a0b43ecc890a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1359 microversion: 2.1 time: 0.571226 Jul 25 12:41:27.495867 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 424/839] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:26 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1359 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:27.500542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8dd6606c-2ee6-4d7f-8340-2caed0198698 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Action: 'create', calling method: .version_select at 0x7efcf9ec8d30>, body: {"security_group_rule": {"parent_group_id": "69897cb4-2e45-4cdc-bc9a-685428d1345a", "ip_protocol": "tempest-999-1904628616", "from_port": 22, "to_port": 22}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:27.646375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c8712625-01a7-477d-a915-88750510c7ba tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:27.670569 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c8712625-01a7-477d-a915-88750510c7ba tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299" status: 200 len: 1318 microversion: 2.1 time: 0.452070 Jul 25 12:41:27.675798 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 416/840] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:27 2022] GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299 => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:27.683078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-20939208-ad89-4d50-b355-1bb76a49cdc1 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:27.684840 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-20939208-ad89-4d50-b355-1bb76a49cdc1 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:27.701342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20939208-ad89-4d50-b355-1bb76a49cdc1 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:27.702327 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20939208-ad89-4d50-b355-1bb76a49cdc1 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:27.703287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20939208-ad89-4d50-b355-1bb76a49cdc1 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:27.703913 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20939208-ad89-4d50-b355-1bb76a49cdc1 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:27.718358 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-8dd6606c-2ee6-4d7f-8340-2caed0198698 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] HTTP exception thrown: Invalid IP protocol tempest-999-1904628616. Jul 25 12:41:27.720943 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8dd6606c-2ee6-4d7f-8340-2caed0198698 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Request method failure captured: Jul 25 12:41:27.720943 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 12:41:27.720943 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:41:27.720943 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:41:27.720943 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:41:27.720943 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 157 Jul 25 12:41:27.720943 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:41:27.720943 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:41:27.720943 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:41:27.720943 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:41:27.720943 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o9wmOYd-ttJArY_dTNEtQIW2u-zyOdRxZ-LJ4bmuOg5HIr_petSkt_Vtp9X81k1T_g6VJapRnVh4j0lmlse4spM6Cu5OZqdaAsVrqFJ11hrBMJZC0MpsWT62dxXOFjJIGcMiSgLGXUb2AElGLn-BXiZCb3CXYv4Uc7GscHGs9_rV24 Jul 25 12:41:27.720943 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:41:27.720943 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:41:27.720943 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:41:27.720943 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:41:27.720943 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:41:27.720943 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:41:27.720943 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 29e189acdfe94ef0850bd23f2e68afea Jul 25 12:41:27.720943 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:27.720943 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:41:27.720943 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:41:27.722446 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_29e189acdfe94ef0850bd23f2e68afea", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/29e189acdfe94ef0850bd23f2e68afea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/29e189acdfe94ef0850bd23f2e68afea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/29e189acdfe94ef0850bd23f2e68afea"}]}] Jul 25 12:41:27.722446 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:27.722446 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 29e189acdfe94ef0850bd23f2e68afea Jul 25 12:41:27.722446 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:27.722446 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304168973-project Jul 25 12:41:27.722446 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:41:27.722446 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:41:27.722446 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 71b9a7d19cb0436abcc37c404f571bdb Jul 25 12:41:27.722446 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973-project Jul 25 12:41:27.722446 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:41:27.722446 n-d-848886-15 devstack@n-api.service[125883]: {"security_group_rule": {"parent_group_id": "69897cb4-2e45-4cdc-bc9a-685428d1345a", "ip_protocol": "tempest-999-1904628616", "from_port": 22, "to_port": 22}} Jul 25 12:41:27.722446 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:41:27.722446 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid IP protocol tempest-999-1904628616. Jul 25 12:41:27.727772 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'security_group_rule': {'parent_group_id': '69897cb4-2e45-4cdc-bc9a-685428d1345a', 'ip_protocol': 'tempest-999-1904628616', 'from_port': 22, 'to_port': 22}}} Jul 25 12:41:27.727772 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:41:27.727772 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:27.727772 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 25 12:41:27.727772 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 25 12:41:27.727772 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 25 12:41:27.727772 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 25 12:41:27.727772 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 25 12:41:27.727772 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 25 12:41:27.727772 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 25 12:41:27.727772 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 25 12:41:27.727772 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1904628616. Jul 25 12:41:27.727772 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:27.727772 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:27.727772 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:27.727772 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:27.727772 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:27.727772 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:27.727772 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:41:27.729136 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:41:27.729136 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:41:27.729136 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:41:27.729136 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:41:27.729136 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:41:27.729136 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 25 12:41:27.729136 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 12:41:27.729136 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1904628616. Jul 25 12:41:27.729136 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:27.729136 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:27.729136 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:27.729136 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:27.729136 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:27.729136 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:27.729136 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:41:27.729136 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:41:27.729136 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1904628616. Jul 25 12:41:27.729136 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:27.730655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8dd6606c-2ee6-4d7f-8340-2caed0198698 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Returning 400 to user: Invalid IP protocol tempest-999-1904628616. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:41:27.730655 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8dd6606c-2ee6-4d7f-8340-2caed0198698 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.225608 Jul 25 12:41:27.732419 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 425/841] 10.222.0.49 () {60 vars in 1195 bytes} [Mon Jul 25 12:41:27 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 236 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:41:27.742812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-257d2cb9-03e7-404b-87d7-84c4b3d2ed9a req-f9a49036-c31f-41a5-ac38-d53e19ca8d22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a", "tag": "4dc52859-0016-4f90-b755-bb756ddacc11"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:27.770442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-257d2cb9-03e7-404b-87d7-84c4b3d2ed9a req-f9a49036-c31f-41a5-ac38-d53e19ca8d22 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:27.777103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-257d2cb9-03e7-404b-87d7-84c4b3d2ed9a req-f9a49036-c31f-41a5-ac38-d53e19ca8d22 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:27.807517 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-257d2cb9-03e7-404b-87d7-84c4b3d2ed9a req-f9a49036-c31f-41a5-ac38-d53e19ca8d22 service nova] Creating event network-changed:4dc52859-0016-4f90-b755-bb756ddacc11 for instance e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a on n-h2-848886-15 Jul 25 12:41:27.814053 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-257d2cb9-03e7-404b-87d7-84c4b3d2ed9a req-f9a49036-c31f-41a5-ac38-d53e19ca8d22 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079981 Jul 25 12:41:27.818898 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 426/842] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:27.825322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-76574d1f-c26f-4857-8833-a675ef70d2ab tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Action: 'create', calling method: .version_select at 0x7efcf9ec8b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-11968185", "description": "tempest-description-412886843"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:28.272712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-20939208-ad89-4d50-b355-1bb76a49cdc1 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:28.282201 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-20939208-ad89-4d50-b355-1bb76a49cdc1 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1378 microversion: 2.1 time: 0.605249 Jul 25 12:41:28.294359 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 417/843] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:27 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1378 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:28.299700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c2ae9b02-0034-4bc4-90e5-10394f7440a2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:28.300542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c2ae9b02-0034-4bc4-90e5-10394f7440a2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:28.312408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c2ae9b02-0034-4bc4-90e5-10394f7440a2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:28.314527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c2ae9b02-0034-4bc4-90e5-10394f7440a2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:28.315788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c2ae9b02-0034-4bc4-90e5-10394f7440a2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:28.317277 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c2ae9b02-0034-4bc4-90e5-10394f7440a2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:28.508155 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-76574d1f-c26f-4857-8833-a675ef70d2ab tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.687526 Jul 25 12:41:28.508808 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 427/844] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:41:27 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:28.604414 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c2ae9b02-0034-4bc4-90e5-10394f7440a2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:28.612817 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c2ae9b02-0034-4bc4-90e5-10394f7440a2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 200 len: 1498 microversion: 2.1 time: 0.317091 Jul 25 12:41:28.613706 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 418/845] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:28 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 1498 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:28.622062 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-45d455df-7807-42db-97ec-0477278088ba tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:28.622909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-45d455df-7807-42db-97ec-0477278088ba tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:28.630340 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45d455df-7807-42db-97ec-0477278088ba tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:28.630979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45d455df-7807-42db-97ec-0477278088ba tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:28.631833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45d455df-7807-42db-97ec-0477278088ba tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:28.632500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45d455df-7807-42db-97ec-0477278088ba tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:28.780658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-45d455df-7807-42db-97ec-0477278088ba tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:28.788963 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-45d455df-7807-42db-97ec-0477278088ba tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1541 microversion: 2.1 time: 0.173715 Jul 25 12:41:28.789541 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 419/846] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:28 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1541 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:28.794156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2950e4c3-7d33-4bd5-bfb5-caffac31d41e tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Action: 'create', calling method: .version_select at 0x7efcfa0e7dc0>, body: {"security_group_rule": {"parent_group_id": "68465b10-b44e-4002-87be-5ce4b9a96117", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:28.818913 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9c17982c-4510-4929-b932-cc4a79f8c98e tempest-FloatingIPsNegativeTestJSON-2075546837 tempest-FloatingIPsNegativeTestJSON-2075546837-project] Calling method '.version_select at 0x7efcfa0231f0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:28.871498 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9c17982c-4510-4929-b932-cc4a79f8c98e tempest-FloatingIPsNegativeTestJSON-2075546837 tempest-FloatingIPsNegativeTestJSON-2075546837-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.361039 Jul 25 12:41:28.872423 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 428/847] 10.222.0.49 () {58 vars in 1149 bytes} [Mon Jul 25 12:41:28 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:41:28.876780 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-2950e4c3-7d33-4bd5-bfb5-caffac31d41e tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 25 12:41:28.877608 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fd5ee818-fc22-4447-af45-30892febfef0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:28.878549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fd5ee818-fc22-4447-af45-30892febfef0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 662e780d-2f9d-4eeb-9323-978b7679d299] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:28.878677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2950e4c3-7d33-4bd5-bfb5-caffac31d41e tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Request method failure captured: Jul 25 12:41:28.878677 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 12:41:28.878677 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:41:28.878677 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:41:28.878677 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:41:28.878677 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 138 Jul 25 12:41:28.878677 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:41:28.878677 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:41:28.878677 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:41:28.878677 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:41:28.878677 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o9wmOYd-ttJArY_dTNEtQIW2u-zyOdRxZ-LJ4bmuOg5HIr_petSkt_Vtp9X81k1T_g6VJapRnVh4j0lmlse4spM6Cu5OZqdaAsVrqFJ11hrBMJZC0MpsWT62dxXOFjJIGcMiSgLGXUb2AElGLn-BXiZCb3CXYv4Uc7GscHGs9_rV24 Jul 25 12:41:28.878677 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:41:28.878677 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:41:28.878677 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:41:28.878677 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:41:28.878677 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:41:28.878677 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:41:28.878677 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 29e189acdfe94ef0850bd23f2e68afea Jul 25 12:41:28.878677 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:28.878677 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:41:28.878677 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:41:28.879918 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_29e189acdfe94ef0850bd23f2e68afea", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/29e189acdfe94ef0850bd23f2e68afea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/29e189acdfe94ef0850bd23f2e68afea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/29e189acdfe94ef0850bd23f2e68afea"}]}] Jul 25 12:41:28.879918 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:28.879918 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 29e189acdfe94ef0850bd23f2e68afea Jul 25 12:41:28.879918 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:28.879918 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304168973-project Jul 25 12:41:28.879918 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:41:28.879918 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:41:28.879918 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 71b9a7d19cb0436abcc37c404f571bdb Jul 25 12:41:28.879918 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973-project Jul 25 12:41:28.879918 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:41:28.879918 n-d-848886-15 devstack@n-api.service[125884]: {"security_group_rule": {"parent_group_id": "68465b10-b44e-4002-87be-5ce4b9a96117", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 25 12:41:28.879918 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:41:28.880681 n-d-848886-15 devstack@n-api.service[125884]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 25 12:41:28.880681 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'body': {'security_group_rule': {'parent_group_id': '68465b10-b44e-4002-87be-5ce4b9a96117', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 25 12:41:28.880681 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:41:28.880681 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:28.880681 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 25 12:41:28.880681 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 25 12:41:28.880681 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 25 12:41:28.880681 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 25 12:41:28.880681 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 25 12:41:28.880681 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 25 12:41:28.880681 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 25 12:41:28.880681 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 25 12:41:28.880681 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 25 12:41:28.880681 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:28.880681 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:28.880681 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:28.880681 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:28.880681 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:28.880681 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:28.882234 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:41:28.882234 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:41:28.882234 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:41:28.882234 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:41:28.882234 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:41:28.882234 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:41:28.882234 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 25 12:41:28.882234 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 12:41:28.882234 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 25 12:41:28.882234 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:28.882234 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:28.882234 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:28.882234 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:28.882234 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:28.882234 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:28.882234 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:41:28.882234 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:41:28.882234 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 25 12:41:28.882234 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:28.883509 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2950e4c3-7d33-4bd5-bfb5-caffac31d41e tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:41:28.883509 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2950e4c3-7d33-4bd5-bfb5-caffac31d41e tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.089272 Jul 25 12:41:28.883509 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 420/848] 10.222.0.49 () {60 vars in 1195 bytes} [Mon Jul 25 12:41:28 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:41:28.888021 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:DELETE=7 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:28.892532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd5ee818-fc22-4447-af45-30892febfef0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:28.893227 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd5ee818-fc22-4447-af45-30892febfef0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:28.894125 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd5ee818-fc22-4447-af45-30892febfef0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:28.894486 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd5ee818-fc22-4447-af45-30892febfef0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:29.009913 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d120d61d-ba63-4150-bcbc-2841928dc7dc tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-537475259", "id": 427632475, "os-flavor-access:is_public": "False"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:29.013241 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:29.013241 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:41:29.031451 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d120d61d-ba63-4150-bcbc-2841928dc7dc tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.149620 Jul 25 12:41:29.032316 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 421/849] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:41:28 2022] POST /compute/v2.1/flavors => generated 435 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:29.037413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8b8f4c9e-446c-41ad-8af2-d102cd716e33 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:29.038104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8b8f4c9e-446c-41ad-8af2-d102cd716e33 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:29.043801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fd5ee818-fc22-4447-af45-30892febfef0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:29.045191 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b8f4c9e-446c-41ad-8af2-d102cd716e33 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:29.045675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b8f4c9e-446c-41ad-8af2-d102cd716e33 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:29.046564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b8f4c9e-446c-41ad-8af2-d102cd716e33 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:29.047588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b8f4c9e-446c-41ad-8af2-d102cd716e33 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:29.054610 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fd5ee818-fc22-4447-af45-30892febfef0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299" status: 200 len: 1318 microversion: 2.1 time: 0.180955 Jul 25 12:41:29.055201 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 429/850] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:28 2022] GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:29.065532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7b5a9f15-b460-414b-bc30-a02189215b63 tempest-FloatingIPsNegativeTestJSON-2075546837 tempest-FloatingIPsNegativeTestJSON-2075546837-project] Action: 'create', calling method: .version_select at 0x7efcfa0231f0>, body: {"pool": "non_exist_pool"} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:29.100122 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-7b5a9f15-b460-414b-bc30-a02189215b63 tempest-FloatingIPsNegativeTestJSON-2075546837 tempest-FloatingIPsNegativeTestJSON-2075546837-project] HTTP exception thrown: Floating IP pool not found. Jul 25 12:41:29.102138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7b5a9f15-b460-414b-bc30-a02189215b63 tempest-FloatingIPsNegativeTestJSON-2075546837 tempest-FloatingIPsNegativeTestJSON-2075546837-project] Request method failure captured: Jul 25 12:41:29.102138 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 25 12:41:29.102138 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:41:29.102138 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:41:29.102138 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:41:29.102138 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 26 Jul 25 12:41:29.102138 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:41:29.102138 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:41:29.102138 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:41:29.102138 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:41:29.102138 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o942crh3IDNkYOC9dEMtDWLgY4qNvG00GIUR3u5V03xOhyBex_42lFq_7D9yyG8ta8WWKdRcscpm_G-5JEua-_a4fg-Uw8wO2A3A9Yabrh4U0zx02M4ZzU9Wxcdpf5NJrTCq6IrxXYFqgVheEIhvKN3CidG524Or865QE6ZE1jOYCQ Jul 25 12:41:29.102138 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:41:29.102138 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:41:29.102138 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:41:29.102138 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:41:29.102138 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:41:29.102138 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:41:29.102138 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: cd77b404c99d4058ae041010f585826e Jul 25 12:41:29.102138 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2075546837 Jul 25 12:41:29.102138 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:41:29.102138 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:41:29.103675 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cd77b404c99d4058ae041010f585826e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cd77b404c99d4058ae041010f585826e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd77b404c99d4058ae041010f585826e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd77b404c99d4058ae041010f585826e"}]}] Jul 25 12:41:29.103675 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2075546837 Jul 25 12:41:29.103675 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: cd77b404c99d4058ae041010f585826e Jul 25 12:41:29.103675 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2075546837 Jul 25 12:41:29.103675 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-FloatingIPsNegativeTestJSON-2075546837-project Jul 25 12:41:29.103675 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:41:29.103675 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:41:29.103675 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: edf524e6cea443a59b66526edf30aea3 Jul 25 12:41:29.103675 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2075546837-project Jul 25 12:41:29.103675 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:41:29.103675 n-d-848886-15 devstack@n-api.service[125883]: {"pool": "non_exist_pool"} Jul 25 12:41:29.103675 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:41:29.103675 n-d-848886-15 devstack@n-api.service[125883]: exception: Floating IP pool not found. Jul 25 12:41:29.103675 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 25 12:41:29.103675 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:41:29.104769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:29.104769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 25 12:41:29.104769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 25 12:41:29.104769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 25 12:41:29.104769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 25 12:41:29.104769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 25 12:41:29.104769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 25 12:41:29.104769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 25 12:41:29.104769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.104769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:29.104769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.104769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:29.104769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:29.104769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:29.104769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:41:29.104769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:41:29.104769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:41:29.104769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:41:29.104769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:41:29.104769 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:41:29.106279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 25 12:41:29.106279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:41:29.106279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 25 12:41:29.106279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.106279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:29.106279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.106279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:29.106279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:29.106279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:29.106279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:41:29.106279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:41:29.106279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 25 12:41:29.106279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.106279 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7b5a9f15-b460-414b-bc30-a02189215b63 tempest-FloatingIPsNegativeTestJSON-2075546837 tempest-FloatingIPsNegativeTestJSON-2075546837-project] Returning 404 to user: Floating IP pool not found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:41:29.108096 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7b5a9f15-b460-414b-bc30-a02189215b63 tempest-FloatingIPsNegativeTestJSON-2075546837 tempest-FloatingIPsNegativeTestJSON-2075546837-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.051824 Jul 25 12:41:29.108781 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 430/851] 10.222.0.49 () {60 vars in 1170 bytes} [Mon Jul 25 12:41:29 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:41:29.118755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-76645315-84e9-49d7-adf4-8d47953a7635 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Action: 'create', calling method: .version_select at 0x7efcf9e97ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-980988676", "description": "tempest-description-276371080"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:29.170503 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8b8f4c9e-446c-41ad-8af2-d102cd716e33 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136946 Jul 25 12:41:29.171210 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 422/852] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 12:41:29 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:29.176543 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-2a7cb433-7e05-4d47-a1d1-28346db86e67 req-2648758b-e23a-4a0d-97b2-66f5be7f91cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662e780d-2f9d-4eeb-9323-978b7679d299", "name": "network-vif-plugged", "status": "completed", "tag": "8b7db3fa-056f-4964-8cb9-66f5bb712514"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:29.186595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-2a7cb433-7e05-4d47-a1d1-28346db86e67 req-2648758b-e23a-4a0d-97b2-66f5be7f91cc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:29.187106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-2a7cb433-7e05-4d47-a1d1-28346db86e67 req-2648758b-e23a-4a0d-97b2-66f5be7f91cc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:29.201013 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-2a7cb433-7e05-4d47-a1d1-28346db86e67 req-2648758b-e23a-4a0d-97b2-66f5be7f91cc service nova] Creating event network-vif-plugged:8b7db3fa-056f-4964-8cb9-66f5bb712514 for instance 662e780d-2f9d-4eeb-9323-978b7679d299 on n-h1-848886-15 Jul 25 12:41:29.206469 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-2a7cb433-7e05-4d47-a1d1-28346db86e67 req-2648758b-e23a-4a0d-97b2-66f5be7f91cc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033678 Jul 25 12:41:29.207272 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 423/853] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:29.216162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-40e5a000-3e9b-44b1-b6e1-b8f73d9f8f63 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b405a9e543da4e22aea2799ecfc69143"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:29.218761 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:29.218761 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:41:29.336334 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-40e5a000-3e9b-44b1-b6e1-b8f73d9f8f63 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/427632475/action" status: 200 len: 96 microversion: 2.1 time: 0.124386 Jul 25 12:41:29.338884 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 424/854] 10.222.0.49 () {60 vars in 1197 bytes} [Mon Jul 25 12:41:29 2022] POST /compute/v2.1/flavors/427632475/action => generated 96 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:41:29.344251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bab4f357-27a5-4c27-9e19-fc2d64fb9082 tempest-FloatingIPsNegativeTestJSON-2075546837 tempest-FloatingIPsNegativeTestJSON-2075546837-project] Calling method '.version_select at 0x7efcfa240280>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:29.359827 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-76645315-84e9-49d7-adf4-8d47953a7635 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.245531 Jul 25 12:41:29.360692 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 431/855] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:41:29 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:29.370255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1a334150-3e1e-4518-b759-a2b7dfe40968 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:29.372711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1a334150-3e1e-4518-b759-a2b7dfe40968 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:29.382927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a334150-3e1e-4518-b759-a2b7dfe40968 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:29.383461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a334150-3e1e-4518-b759-a2b7dfe40968 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:29.384301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a334150-3e1e-4518-b759-a2b7dfe40968 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:29.384849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a334150-3e1e-4518-b759-a2b7dfe40968 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:29.405687 n-d-848886-15 devstack@n-api.service[125884]: DEBUG neutronclient.v2_0.client [None req-bab4f357-27a5-4c27-9e19-fc2d64fb9082 tempest-FloatingIPsNegativeTestJSON-2075546837 tempest-FloatingIPsNegativeTestJSON-2075546837-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 6e5ca084-79b1-4584-afce-7834f59e657b could not be found", "detail": ""}} {{(pid=125884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:41:29.406406 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-bab4f357-27a5-4c27-9e19-fc2d64fb9082 tempest-FloatingIPsNegativeTestJSON-2075546837 tempest-FloatingIPsNegativeTestJSON-2075546837-project] HTTP exception thrown: Floating IP not found for ID 6e5ca084-79b1-4584-afce-7834f59e657b Jul 25 12:41:29.408377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bab4f357-27a5-4c27-9e19-fc2d64fb9082 tempest-FloatingIPsNegativeTestJSON-2075546837 tempest-FloatingIPsNegativeTestJSON-2075546837-project] Request method failure captured: Jul 25 12:41:29.408377 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/os-floating-ips/6e5ca084-79b1-4584-afce-7834f59e657b HTTP/1.1 Jul 25 12:41:29.408377 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:41:29.408377 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:41:29.408377 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:41:29.408377 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:41:29.408377 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:41:29.408377 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:41:29.408377 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:41:29.408377 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:41:29.408377 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o942crh3IDNkYOC9dEMtDWLgY4qNvG00GIUR3u5V03xOhyBex_42lFq_7D9yyG8ta8WWKdRcscpm_G-5JEua-_a4fg-Uw8wO2A3A9Yabrh4U0zx02M4ZzU9Wxcdpf5NJrTCq6IrxXYFqgVheEIhvKN3CidG524Or865QE6ZE1jOYCQ Jul 25 12:41:29.408377 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:41:29.408377 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:41:29.408377 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:41:29.408377 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:41:29.408377 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:41:29.408377 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:41:29.408377 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: cd77b404c99d4058ae041010f585826e Jul 25 12:41:29.408377 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2075546837 Jul 25 12:41:29.408377 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:41:29.408377 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:41:29.410070 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cd77b404c99d4058ae041010f585826e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cd77b404c99d4058ae041010f585826e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd77b404c99d4058ae041010f585826e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd77b404c99d4058ae041010f585826e"}]}] Jul 25 12:41:29.410070 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2075546837 Jul 25 12:41:29.410070 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: cd77b404c99d4058ae041010f585826e Jul 25 12:41:29.410070 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2075546837 Jul 25 12:41:29.410070 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-FloatingIPsNegativeTestJSON-2075546837-project Jul 25 12:41:29.410070 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:41:29.410070 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:41:29.410070 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: edf524e6cea443a59b66526edf30aea3 Jul 25 12:41:29.410070 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2075546837-project Jul 25 12:41:29.410070 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:41:29.410070 n-d-848886-15 devstack@n-api.service[125884]: exception: Floating IP not found for ID 6e5ca084-79b1-4584-afce-7834f59e657b Jul 25 12:41:29.410070 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '6e5ca084-79b1-4584-afce-7834f59e657b'} Jul 25 12:41:29.410070 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:41:29.411017 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:29.411017 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 25 12:41:29.411017 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 25 12:41:29.411017 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:41:29.411017 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:41:29.411017 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 25 12:41:29.411017 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 25 12:41:29.411017 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:41:29.411017 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:41:29.411017 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 12:41:29.411017 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 12:41:29.411017 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:41:29.411017 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:41:29.411017 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:41:29.411017 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:41:29.411017 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:41:29.411017 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:41:29.411017 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:41:29.411017 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:41:29.412389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:41:29.412389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:41:29.412389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:41:29.412389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:41:29.412389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:41:29.412389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:41:29.412389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 6e5ca084-79b1-4584-afce-7834f59e657b could not be found Jul 25 12:41:29.412389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc2ea35e-4070-4d81-b45f-0c90500c13cc'] Jul 25 12:41:29.412389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.412389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:29.412389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.412389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:29.412389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 25 12:41:29.412389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 25 12:41:29.412389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 25 12:41:29.412389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 25 12:41:29.412389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 6e5ca084-79b1-4584-afce-7834f59e657b. Jul 25 12:41:29.412389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.412389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:29.412389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.413996 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:29.413996 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:29.413996 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:29.413996 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:41:29.413996 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:41:29.413996 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:41:29.413996 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:41:29.413996 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:41:29.413996 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:41:29.413996 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 25 12:41:29.413996 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 12:41:29.413996 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 6e5ca084-79b1-4584-afce-7834f59e657b Jul 25 12:41:29.413996 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.413996 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:29.413996 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.413996 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:29.413996 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:29.413996 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:29.413996 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:41:29.413996 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:41:29.415539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 6e5ca084-79b1-4584-afce-7834f59e657b Jul 25 12:41:29.415539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.415539 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bab4f357-27a5-4c27-9e19-fc2d64fb9082 tempest-FloatingIPsNegativeTestJSON-2075546837 tempest-FloatingIPsNegativeTestJSON-2075546837-project] Returning 404 to user: Floating IP not found for ID 6e5ca084-79b1-4584-afce-7834f59e657b {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:41:29.415539 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bab4f357-27a5-4c27-9e19-fc2d64fb9082 tempest-FloatingIPsNegativeTestJSON-2075546837 tempest-FloatingIPsNegativeTestJSON-2075546837-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/6e5ca084-79b1-4584-afce-7834f59e657b" status: 404 len: 111 microversion: 2.1 time: 0.069647 Jul 25 12:41:29.415539 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 425/856] 10.222.0.49 () {58 vars in 1263 bytes} [Mon Jul 25 12:41:29 2022] DELETE /compute/v2.1/os-floating-ips/6e5ca084-79b1-4584-afce-7834f59e657b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:41:29.424925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-14d65f3a-b129-44b0-b5c5-58c101efc570 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b405a9e543da4e22aea2799ecfc69143"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:29.511851 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-14d65f3a-b129-44b0-b5c5-58c101efc570 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] HTTP exception thrown: Flavor access already exists for flavor 36 and project b405a9e543da4e22aea2799ecfc69143 combination. Jul 25 12:41:29.524789 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-14d65f3a-b129-44b0-b5c5-58c101efc570 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Request method failure captured: Jul 25 12:41:29.524789 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/flavors/427632475/action HTTP/1.1 Jul 25 12:41:29.524789 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:41:29.524789 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:41:29.524789 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:41:29.524789 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 67 Jul 25 12:41:29.524789 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:41:29.524789 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:41:29.524789 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:41:29.524789 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:41:29.524789 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o93eMMPAuDd3INLIJfK6ptZ3f42WEC409SSGMUxphSt-5l6HvT-XvN2SNjFTHJDfjTGiFmez_6Uxw8IApUtjNIF-extTdlrvWbW1-pWPqjGWt_KN-2wQsOJyKD1bt5uek-QE7HmmDKoz47bsmvuNppFjj462BUf4qU1gicaBZjpzyQ Jul 25 12:41:29.524789 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:41:29.524789 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:41:29.524789 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:41:29.524789 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:41:29.524789 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:41:29.524789 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:41:29.524789 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 3b6a51b68f68412785f9b7ac7ab9d34e Jul 25 12:41:29.524789 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2003359817 Jul 25 12:41:29.524789 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,admin,member Jul 25 12:41:29.524789 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,admin,member Jul 25 12:41:29.526733 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3b6a51b68f68412785f9b7ac7ab9d34e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3b6a51b68f68412785f9b7ac7ab9d34e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b6a51b68f68412785f9b7ac7ab9d34e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b6a51b68f68412785f9b7ac7ab9d34e"}]}] Jul 25 12:41:29.526733 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2003359817 Jul 25 12:41:29.526733 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 3b6a51b68f68412785f9b7ac7ab9d34e Jul 25 12:41:29.526733 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2003359817 Jul 25 12:41:29.526733 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin Jul 25 12:41:29.526733 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:41:29.526733 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:41:29.526733 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 51dacf95a4484c2abcbdb55280c0d3a5 Jul 25 12:41:29.526733 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin Jul 25 12:41:29.526733 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:41:29.526733 n-d-848886-15 devstack@n-api.service[125884]: {"addTenantAccess": {"tenant": "b405a9e543da4e22aea2799ecfc69143"}} Jul 25 12:41:29.526733 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:41:29.527548 n-d-848886-15 devstack@n-api.service[125884]: exception: Flavor access already exists for flavor 36 and project b405a9e543da4e22aea2799ecfc69143 combination. Jul 25 12:41:29.527548 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '427632475', 'body': {'addTenantAccess': {'tenant': 'b405a9e543da4e22aea2799ecfc69143'}}} Jul 25 12:41:29.527548 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:41:29.527548 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:29.527548 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 12:41:29.527548 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 12:41:29.527548 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 12:41:29.527548 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 12:41:29.527548 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 12:41:29.527548 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 12:41:29.527548 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 12:41:29.527548 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 12:41:29.527548 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 12:41:29.527548 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 12:41:29.527548 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 12:41:29.527548 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result.read() Jul 25 12:41:29.527548 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 12:41:29.527548 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 12:41:29.529367 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 12:41:29.529367 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 12:41:29.529367 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 12:41:29.529367 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 12:41:29.529367 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 12:41:29.529367 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 12:41:29.529367 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '36-b405a9e543da4e22aea2799ecfc69143' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 25 12:41:29.529367 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.529367 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 25 12:41:29.529367 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.529367 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:29.529367 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 25 12:41:29.529367 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 25 12:41:29.529367 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 25 12:41:29.529367 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi session.flush() Jul 25 12:41:29.529367 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 12:41:29.529367 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 25 12:41:29.529367 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 12:41:29.529367 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 25 12:41:29.530539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 12:41:29.530539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 25 12:41:29.530539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 12:41:29.530539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception Jul 25 12:41:29.530539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 12:41:29.530539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 25 12:41:29.530539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 12:41:29.530539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 25 12:41:29.530539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 12:41:29.530539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 25 12:41:29.530539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 12:41:29.530539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 25 12:41:29.530539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 12:41:29.530539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 25 12:41:29.530539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 12:41:29.530539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 12:41:29.530539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 12:41:29.530539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 25 12:41:29.532493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 12:41:29.532493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 25 12:41:29.532493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 12:41:29.532493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 25 12:41:29.532493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 12:41:29.532493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 12:41:29.532493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 12:41:29.532493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception Jul 25 12:41:29.532493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 12:41:29.532493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 12:41:29.532493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 12:41:29.532493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 12:41:29.532493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 12:41:29.532493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 12:41:29.532493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 12:41:29.532493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 12:41:29.532493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 12:41:29.532493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 12:41:29.535162 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 12:41:29.535162 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result.read() Jul 25 12:41:29.535162 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 12:41:29.535162 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 12:41:29.535162 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 12:41:29.535162 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 12:41:29.535162 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 12:41:29.535162 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 12:41:29.535162 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 12:41:29.535162 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 12:41:29.535162 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '36-b405a9e543da4e22aea2799ecfc69143' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 25 12:41:29.535162 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 25 12:41:29.535162 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 25, 12, 41, 29, 502794), 'updated_at': None, 'flavor_id': 36, 'project_id': 'b405a9e543da4e22aea2799ecfc69143'}] Jul 25 12:41:29.535162 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 12:41:29.535162 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.535162 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:29.535162 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.538456 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:29.538456 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 25 12:41:29.538456 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 25 12:41:29.538456 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 12:41:29.538456 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 12:41:29.538456 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 25 12:41:29.538456 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 25 12:41:29.538456 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 25 12:41:29.538456 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 25 12:41:29.538456 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 25 12:41:29.538456 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 25 12:41:29.538456 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:41:29.538456 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:41:29.538456 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 25 12:41:29.538456 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 25 12:41:29.538456 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 36 and project b405a9e543da4e22aea2799ecfc69143 combination. Jul 25 12:41:29.538456 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.538456 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:29.538456 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.540990 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:29.540990 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:29.540990 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:29.540990 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:41:29.540990 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:41:29.540990 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:41:29.540990 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:41:29.540990 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:41:29.540990 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:41:29.540990 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 25 12:41:29.540990 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 25 12:41:29.540990 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 36 and project b405a9e543da4e22aea2799ecfc69143 combination. Jul 25 12:41:29.540990 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.540990 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:29.540990 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.540990 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:29.540990 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:29.540990 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:29.540990 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:41:29.540990 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:41:29.544652 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 36 and project b405a9e543da4e22aea2799ecfc69143 combination. Jul 25 12:41:29.544652 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.544652 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-14d65f3a-b129-44b0-b5c5-58c101efc570 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Returning 409 to user: Flavor access already exists for flavor 36 and project b405a9e543da4e22aea2799ecfc69143 combination. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:41:29.544652 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-14d65f3a-b129-44b0-b5c5-58c101efc570 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/427632475/action" status: 409 len: 152 microversion: 2.1 time: 0.110083 Jul 25 12:41:29.544652 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 426/857] 10.222.0.49 () {60 vars in 1197 bytes} [Mon Jul 25 12:41:29 2022] POST /compute/v2.1/flavors/427632475/action => generated 152 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:41:29.544652 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-872b416a-a706-4ac3-af25-815492d2eda0 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Action: 'create', calling method: .version_select at 0x7efcf9dae700>, body: {"security_group_rule": {"parent_group_id": "e01f2253-cefb-491c-859b-5f3b95aab37d", "ip_protocol": "tcp", "from_port": 22, "to_port": 1131929880}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:29.725353 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1a334150-3e1e-4518-b759-a2b7dfe40968 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:29.730549 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-872b416a-a706-4ac3-af25-815492d2eda0 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] HTTP exception thrown: Invalid port range 22:1131929880. Valid TCP ports should be between 1-65535 Jul 25 12:41:29.732252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-872b416a-a706-4ac3-af25-815492d2eda0 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Request method failure captured: Jul 25 12:41:29.732252 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 12:41:29.732252 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:41:29.732252 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:41:29.732252 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:41:29.732252 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 146 Jul 25 12:41:29.732252 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:41:29.732252 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:41:29.732252 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:41:29.732252 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:41:29.732252 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o9wmOYd-ttJArY_dTNEtQIW2u-zyOdRxZ-LJ4bmuOg5HIr_petSkt_Vtp9X81k1T_g6VJapRnVh4j0lmlse4spM6Cu5OZqdaAsVrqFJ11hrBMJZC0MpsWT62dxXOFjJIGcMiSgLGXUb2AElGLn-BXiZCb3CXYv4Uc7GscHGs9_rV24 Jul 25 12:41:29.732252 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:41:29.732252 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:41:29.732252 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:41:29.732252 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:41:29.732252 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:41:29.732252 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:41:29.732252 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 29e189acdfe94ef0850bd23f2e68afea Jul 25 12:41:29.732252 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:29.732252 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:41:29.732252 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:41:29.733463 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_29e189acdfe94ef0850bd23f2e68afea", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/29e189acdfe94ef0850bd23f2e68afea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/29e189acdfe94ef0850bd23f2e68afea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/29e189acdfe94ef0850bd23f2e68afea"}]}] Jul 25 12:41:29.733463 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:29.733463 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 29e189acdfe94ef0850bd23f2e68afea Jul 25 12:41:29.733463 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:29.733463 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304168973-project Jul 25 12:41:29.733463 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:41:29.733463 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:41:29.733463 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 71b9a7d19cb0436abcc37c404f571bdb Jul 25 12:41:29.733463 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973-project Jul 25 12:41:29.733463 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:41:29.733463 n-d-848886-15 devstack@n-api.service[125884]: {"security_group_rule": {"parent_group_id": "e01f2253-cefb-491c-859b-5f3b95aab37d", "ip_protocol": "tcp", "from_port": 22, "to_port": 1131929880}} Jul 25 12:41:29.733463 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:41:29.734753 n-d-848886-15 devstack@n-api.service[125884]: exception: Invalid port range 22:1131929880. Valid TCP ports should be between 1-65535 Jul 25 12:41:29.734753 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e01f2253-cefb-491c-859b-5f3b95aab37d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1131929880}}} Jul 25 12:41:29.734753 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:41:29.734753 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:29.734753 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 25 12:41:29.734753 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 25 12:41:29.734753 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 25 12:41:29.734753 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 25 12:41:29.734753 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 25 12:41:29.734753 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 25 12:41:29.734753 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 25 12:41:29.734753 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 25 12:41:29.734753 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1131929880. Valid TCP ports should be between 1-65535 Jul 25 12:41:29.734753 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.734753 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:29.734753 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.734753 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:29.734753 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:29.734753 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:29.735836 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:41:29.735836 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:41:29.735836 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:41:29.735836 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:41:29.735836 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:41:29.735836 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:41:29.735836 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 25 12:41:29.735836 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 12:41:29.735836 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1131929880. Valid TCP ports should be between 1-65535 Jul 25 12:41:29.735836 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.735836 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:29.735836 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.735836 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:29.735836 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:29.735836 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:29.735836 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:41:29.735836 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:41:29.735836 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1131929880. Valid TCP ports should be between 1-65535 Jul 25 12:41:29.735836 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.739933 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-872b416a-a706-4ac3-af25-815492d2eda0 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Returning 400 to user: Invalid port range 22:1131929880. Valid TCP ports should be between 1-65535 {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:41:29.739933 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-872b416a-a706-4ac3-af25-815492d2eda0 tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.201297 Jul 25 12:41:29.739933 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 427/858] 10.222.0.49 () {60 vars in 1195 bytes} [Mon Jul 25 12:41:29 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 207 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:41:29.741249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-186a6a38-5a1b-4357-ba7c-4353090d8cf4 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b405a9e543da4e22aea2799ecfc69143"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:29.745746 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1a334150-3e1e-4518-b759-a2b7dfe40968 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1378 microversion: 2.1 time: 0.382936 Jul 25 12:41:29.746679 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 432/859] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:29 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1378 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:29.749661 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:29.749661 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:41:29.752336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a2200292-022a-4c1d-9639-38384c5ddb66 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:29.753235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a2200292-022a-4c1d-9639-38384c5ddb66 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:29.760209 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2200292-022a-4c1d-9639-38384c5ddb66 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:29.761162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2200292-022a-4c1d-9639-38384c5ddb66 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:29.763271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2200292-022a-4c1d-9639-38384c5ddb66 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:29.763936 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2200292-022a-4c1d-9639-38384c5ddb66 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:29.771861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:29.874025 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-186a6a38-5a1b-4357-ba7c-4353090d8cf4 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/427632475/action" status: 200 len: 21 microversion: 2.1 time: 0.137044 Jul 25 12:41:29.874864 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 428/860] 10.222.0.49 () {60 vars in 1197 bytes} [Mon Jul 25 12:41:29 2022] POST /compute/v2.1/flavors/427632475/action => generated 21 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:41:29.882155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1e495ec1-42b2-4780-849c-7097089319bb tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Action: 'create', calling method: .version_select at 0x7efcf9dae820>, body: {"security_group_rule": {"parent_group_id": "5c283288-011b-4273-800d-cd669663f11a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:29.932542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG neutronclient.v2_0.client [None req-1e495ec1-42b2-4780-849c-7097089319bb tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5c283288-011b-4273-800d-cd669663f11a does not exist", "detail": ""}} {{(pid=125884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:41:29.933629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.security_group_api [None req-1e495ec1-42b2-4780-849c-7097089319bb tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Neutron security group 5c283288-011b-4273-800d-cd669663f11a not found {{(pid=125884) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 12:41:29.934477 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-1e495ec1-42b2-4780-849c-7097089319bb tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] HTTP exception thrown: Security group 5c283288-011b-4273-800d-cd669663f11a does not exist Jul 25 12:41:29.934477 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-335fdaee-6db3-489d-b1e9-7142eec01828'] Jul 25 12:41:29.937751 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1e495ec1-42b2-4780-849c-7097089319bb tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Request method failure captured: Jul 25 12:41:29.937751 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 12:41:29.937751 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:41:29.937751 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:41:29.937751 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:41:29.937751 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 138 Jul 25 12:41:29.937751 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:41:29.937751 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:41:29.937751 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:41:29.937751 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:41:29.937751 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o9wmOYd-ttJArY_dTNEtQIW2u-zyOdRxZ-LJ4bmuOg5HIr_petSkt_Vtp9X81k1T_g6VJapRnVh4j0lmlse4spM6Cu5OZqdaAsVrqFJ11hrBMJZC0MpsWT62dxXOFjJIGcMiSgLGXUb2AElGLn-BXiZCb3CXYv4Uc7GscHGs9_rV24 Jul 25 12:41:29.937751 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:41:29.937751 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:41:29.937751 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:41:29.937751 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:41:29.937751 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:41:29.937751 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:41:29.937751 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 29e189acdfe94ef0850bd23f2e68afea Jul 25 12:41:29.937751 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:29.937751 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:41:29.937751 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:41:29.939419 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_29e189acdfe94ef0850bd23f2e68afea", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/29e189acdfe94ef0850bd23f2e68afea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/29e189acdfe94ef0850bd23f2e68afea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/29e189acdfe94ef0850bd23f2e68afea"}]}] Jul 25 12:41:29.939419 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:29.939419 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 29e189acdfe94ef0850bd23f2e68afea Jul 25 12:41:29.939419 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:29.939419 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304168973-project Jul 25 12:41:29.939419 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:41:29.939419 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:41:29.939419 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 71b9a7d19cb0436abcc37c404f571bdb Jul 25 12:41:29.939419 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973-project Jul 25 12:41:29.939419 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:41:29.939419 n-d-848886-15 devstack@n-api.service[125884]: {"security_group_rule": {"parent_group_id": "5c283288-011b-4273-800d-cd669663f11a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 25 12:41:29.939419 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:41:29.940356 n-d-848886-15 devstack@n-api.service[125884]: exception: Security group 5c283288-011b-4273-800d-cd669663f11a does not exist Jul 25 12:41:29.940356 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-335fdaee-6db3-489d-b1e9-7142eec01828'] Jul 25 12:41:29.940356 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5c283288-011b-4273-800d-cd669663f11a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 25 12:41:29.940356 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:41:29.940356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:29.940356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 12:41:29.940356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 12:41:29.940356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:41:29.940356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:41:29.940356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 12:41:29.940356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 12:41:29.940356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:41:29.940356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:41:29.940356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 12:41:29.940356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 12:41:29.940356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:41:29.940356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:41:29.940356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:41:29.940356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:41:29.941736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:41:29.941736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:41:29.941736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:41:29.941736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:41:29.941736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:41:29.941736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:41:29.941736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:41:29.941736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:41:29.941736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:41:29.941736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:41:29.941736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5c283288-011b-4273-800d-cd669663f11a does not exist Jul 25 12:41:29.941736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-335fdaee-6db3-489d-b1e9-7142eec01828'] Jul 25 12:41:29.941736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.941736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:29.941736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.941736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:29.941736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 25 12:41:29.941736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 25 12:41:29.941736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 12:41:29.943124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 12:41:29.943124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5c283288-011b-4273-800d-cd669663f11a does not exist Jul 25 12:41:29.943124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-335fdaee-6db3-489d-b1e9-7142eec01828'] Jul 25 12:41:29.943124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.943124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:29.943124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.943124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:29.943124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:29.943124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:29.943124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:41:29.943124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:41:29.943124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:41:29.943124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:41:29.943124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:41:29.943124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:41:29.943124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 25 12:41:29.943124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 12:41:29.943124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5c283288-011b-4273-800d-cd669663f11a does not exist Jul 25 12:41:29.943124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-335fdaee-6db3-489d-b1e9-7142eec01828'] Jul 25 12:41:29.943124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.946016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:29.946016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.946016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:29.946016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:29.946016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:29.946016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:41:29.946016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:41:29.946016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5c283288-011b-4273-800d-cd669663f11a does not exist Jul 25 12:41:29.946016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-335fdaee-6db3-489d-b1e9-7142eec01828'] Jul 25 12:41:29.946016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:29.948649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1e495ec1-42b2-4780-849c-7097089319bb tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Returning 404 to user: Security group 5c283288-011b-4273-800d-cd669663f11a does not exist Jul 25 12:41:29.948649 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-335fdaee-6db3-489d-b1e9-7142eec01828'] {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:41:29.949959 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1e495ec1-42b2-4780-849c-7097089319bb tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.074051 Jul 25 12:41:29.950700 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 429/861] 10.222.0.49 () {60 vars in 1195 bytes} [Mon Jul 25 12:41:29 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:41:29.963489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-60db60f2-839e-4f65-bf2b-b845ca4fa652 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:29.964264 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:29.964264 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:41:29.992726 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-60db60f2-839e-4f65-bf2b-b845ca4fa652 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/427632475" status: 202 len: 0 microversion: 2.1 time: 0.040663 Jul 25 12:41:29.994222 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 430/862] 10.222.0.49 () {58 vars in 1158 bytes} [Mon Jul 25 12:41:29 2022] DELETE /compute/v2.1/flavors/427632475 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:41:29.999736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3f42d1df-f1dc-49f7-8b0d-311b2484502a tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Calling method '.version_select at 0x7efcfa240af0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:30.064855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG neutronclient.v2_0.client [None req-3f42d1df-f1dc-49f7-8b0d-311b2484502a tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 95589798-a7ca-40ae-a322-502cbb75f8ed does not exist", "detail": ""}} {{(pid=125884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:41:30.066127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.security_group_api [None req-3f42d1df-f1dc-49f7-8b0d-311b2484502a tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Neutron security group rule 95589798-a7ca-40ae-a322-502cbb75f8ed not found {{(pid=125884) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 25 12:41:30.067023 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-3f42d1df-f1dc-49f7-8b0d-311b2484502a tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] HTTP exception thrown: Security group rule 95589798-a7ca-40ae-a322-502cbb75f8ed does not exist Jul 25 12:41:30.067023 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-baa58100-308f-4123-9d32-206179ab52a8'] Jul 25 12:41:30.070267 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3f42d1df-f1dc-49f7-8b0d-311b2484502a tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Request method failure captured: Jul 25 12:41:30.070267 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/os-security-group-rules/95589798-a7ca-40ae-a322-502cbb75f8ed HTTP/1.1 Jul 25 12:41:30.070267 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:41:30.070267 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:41:30.070267 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:41:30.070267 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:41:30.070267 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:41:30.070267 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:41:30.070267 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:41:30.070267 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:41:30.070267 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o9wmOYd-ttJArY_dTNEtQIW2u-zyOdRxZ-LJ4bmuOg5HIr_petSkt_Vtp9X81k1T_g6VJapRnVh4j0lmlse4spM6Cu5OZqdaAsVrqFJ11hrBMJZC0MpsWT62dxXOFjJIGcMiSgLGXUb2AElGLn-BXiZCb3CXYv4Uc7GscHGs9_rV24 Jul 25 12:41:30.070267 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:41:30.070267 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:41:30.070267 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:41:30.070267 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:41:30.070267 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:41:30.070267 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:41:30.070267 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 29e189acdfe94ef0850bd23f2e68afea Jul 25 12:41:30.070267 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:30.070267 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:41:30.070267 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:41:30.071836 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_29e189acdfe94ef0850bd23f2e68afea", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/29e189acdfe94ef0850bd23f2e68afea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/29e189acdfe94ef0850bd23f2e68afea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/29e189acdfe94ef0850bd23f2e68afea"}]}] Jul 25 12:41:30.071836 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:30.071836 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 29e189acdfe94ef0850bd23f2e68afea Jul 25 12:41:30.071836 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973 Jul 25 12:41:30.071836 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304168973-project Jul 25 12:41:30.071836 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:41:30.071836 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:41:30.071836 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 71b9a7d19cb0436abcc37c404f571bdb Jul 25 12:41:30.071836 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304168973-project Jul 25 12:41:30.071836 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:41:30.071836 n-d-848886-15 devstack@n-api.service[125884]: exception: Security group rule 95589798-a7ca-40ae-a322-502cbb75f8ed does not exist Jul 25 12:41:30.071836 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-baa58100-308f-4123-9d32-206179ab52a8'] Jul 25 12:41:30.072785 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '95589798-a7ca-40ae-a322-502cbb75f8ed'} Jul 25 12:41:30.072785 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:41:30.072785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:30.072785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 25 12:41:30.072785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 25 12:41:30.072785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:41:30.072785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:41:30.072785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 25 12:41:30.072785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 25 12:41:30.072785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:41:30.072785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:41:30.072785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 12:41:30.072785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 12:41:30.072785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:41:30.072785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:41:30.072785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:41:30.072785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:41:30.072785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:41:30.072785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:41:30.075286 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:41:30.075286 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:41:30.075286 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:41:30.075286 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:41:30.075286 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:41:30.075286 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:41:30.075286 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:41:30.075286 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:41:30.075286 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 95589798-a7ca-40ae-a322-502cbb75f8ed does not exist Jul 25 12:41:30.075286 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-baa58100-308f-4123-9d32-206179ab52a8'] Jul 25 12:41:30.075286 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:30.075286 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:30.075286 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:30.075286 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:30.075286 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 25 12:41:30.075286 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 25 12:41:30.075286 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 25 12:41:30.075286 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 12:41:30.076599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 95589798-a7ca-40ae-a322-502cbb75f8ed does not exist Jul 25 12:41:30.076599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-baa58100-308f-4123-9d32-206179ab52a8'] Jul 25 12:41:30.076599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:30.076599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:30.076599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:30.076599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:30.076599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:30.076599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:30.076599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:41:30.076599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:41:30.076599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:41:30.076599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:41:30.076599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:41:30.076599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:41:30.076599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 25 12:41:30.076599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 12:41:30.076599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 95589798-a7ca-40ae-a322-502cbb75f8ed does not exist Jul 25 12:41:30.076599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-baa58100-308f-4123-9d32-206179ab52a8'] Jul 25 12:41:30.076599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:30.076599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:30.079085 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:30.079085 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:30.079085 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:30.079085 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:30.079085 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:41:30.079085 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:41:30.079085 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 95589798-a7ca-40ae-a322-502cbb75f8ed does not exist Jul 25 12:41:30.079085 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-baa58100-308f-4123-9d32-206179ab52a8'] Jul 25 12:41:30.079085 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:30.082378 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3f42d1df-f1dc-49f7-8b0d-311b2484502a tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Returning 404 to user: Security group rule 95589798-a7ca-40ae-a322-502cbb75f8ed does not exist Jul 25 12:41:30.082378 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-baa58100-308f-4123-9d32-206179ab52a8'] {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:41:30.082832 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3f42d1df-f1dc-49f7-8b0d-311b2484502a tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-group-rules/95589798-a7ca-40ae-a322-502cbb75f8ed" status: 404 len: 199 microversion: 2.1 time: 0.087441 Jul 25 12:41:30.083491 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 431/863] 10.222.0.49 () {58 vars in 1287 bytes} [Mon Jul 25 12:41:29 2022] DELETE /compute/v2.1/os-security-group-rules/95589798-a7ca-40ae-a322-502cbb75f8ed => generated 199 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:41:30.092524 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-44d3663a-42d4-46b6-85f7-05013ca9cdb6 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:30.119285 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-44d3663a-42d4-46b6-85f7-05013ca9cdb6 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.031894 Jul 25 12:41:30.120977 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 432/864] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:41:30 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:30.129437 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-47bd026b-ef25-4cab-af31-1f5f07436f96 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:30.131249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-47bd026b-ef25-4cab-af31-1f5f07436f96 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 662e780d-2f9d-4eeb-9323-978b7679d299] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:30.149916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-47bd026b-ef25-4cab-af31-1f5f07436f96 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:30.150150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a2200292-022a-4c1d-9639-38384c5ddb66 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:30.151142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-47bd026b-ef25-4cab-af31-1f5f07436f96 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:30.152554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-47bd026b-ef25-4cab-af31-1f5f07436f96 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:30.153182 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-47bd026b-ef25-4cab-af31-1f5f07436f96 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:30.167655 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a2200292-022a-4c1d-9639-38384c5ddb66 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 200 len: 1498 microversion: 2.1 time: 0.419624 Jul 25 12:41:30.172116 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 433/865] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:29 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 1498 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:30.177419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d2893404-20ae-40e8-915c-40ad7a4a4acd tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Calling method '.version_select at 0x7efcf9d5e5e0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:30.879757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-47bd026b-ef25-4cab-af31-1f5f07436f96 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:30.898520 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-47bd026b-ef25-4cab-af31-1f5f07436f96 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299" status: 200 len: 1318 microversion: 2.1 time: 0.774357 Jul 25 12:41:30.915243 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 433/866] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:30 2022] GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299 => generated 1318 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:30.921200 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d07978c8-7b20-4f4f-8fa9-133ae768f8e5 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-768156523", "id": 278227216, "os-flavor-access:is_public": "True"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:30.926569 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:30.926569 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:41:30.959075 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d07978c8-7b20-4f4f-8fa9-133ae768f8e5 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.054777 Jul 25 12:41:30.959720 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 434/867] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:41:30 2022] POST /compute/v2.1/flavors => generated 434 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:30.971216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b10fcacb-e191-4c56-838b-e47bbca1ab92 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:30.971612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b10fcacb-e191-4c56-838b-e47bbca1ab92 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:30.990239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b10fcacb-e191-4c56-838b-e47bbca1ab92 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:30.990833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b10fcacb-e191-4c56-838b-e47bbca1ab92 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:30.991867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b10fcacb-e191-4c56-838b-e47bbca1ab92 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:30.992319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b10fcacb-e191-4c56-838b-e47bbca1ab92 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:31.069685 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d2893404-20ae-40e8-915c-40ad7a4a4acd tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/e01f2253-cefb-491c-859b-5f3b95aab37d" status: 202 len: 0 microversion: 2.1 time: 0.895072 Jul 25 12:41:31.070482 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 434/868] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:41:30 2022] DELETE /compute/v2.1/os-security-groups/e01f2253-cefb-491c-859b-5f3b95aab37d => generated 0 bytes in 898 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:41:31.076580 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dac8c796-36d2-4f38-90f1-d53c06535725 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:31.077784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dac8c796-36d2-4f38-90f1-d53c06535725 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:31.086102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:31.091080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dac8c796-36d2-4f38-90f1-d53c06535725 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:31.091954 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dac8c796-36d2-4f38-90f1-d53c06535725 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:31.093294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dac8c796-36d2-4f38-90f1-d53c06535725 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:31.094086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dac8c796-36d2-4f38-90f1-d53c06535725 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:31.108183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:31.271218 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b10fcacb-e191-4c56-838b-e47bbca1ab92 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:31.286542 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b10fcacb-e191-4c56-838b-e47bbca1ab92 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1378 microversion: 2.1 time: 0.320276 Jul 25 12:41:31.287507 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 435/869] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:30 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1378 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:31.292439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-68b53b2d-2bef-46f0-af02-97bd00c79f75 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:31.293471 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:31.293471 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:41:31.310341 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-68b53b2d-2bef-46f0-af02-97bd00c79f75 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 25 12:41:31.312092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-68b53b2d-2bef-46f0-af02-97bd00c79f75 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Request method failure captured: Jul 25 12:41:31.312092 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/flavors/278227216/os-flavor-access HTTP/1.1 Jul 25 12:41:31.312092 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:41:31.312092 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:41:31.312092 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:41:31.312092 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:41:31.312092 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:41:31.312092 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:41:31.312092 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:41:31.312092 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:41:31.312092 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o93eMMPAuDd3INLIJfK6ptZ3f42WEC409SSGMUxphSt-5l6HvT-XvN2SNjFTHJDfjTGiFmez_6Uxw8IApUtjNIF-extTdlrvWbW1-pWPqjGWt_KN-2wQsOJyKD1bt5uek-QE7HmmDKoz47bsmvuNppFjj462BUf4qU1gicaBZjpzyQ Jul 25 12:41:31.312092 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:41:31.312092 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:41:31.312092 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:41:31.312092 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:41:31.312092 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:41:31.312092 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:41:31.312092 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 3b6a51b68f68412785f9b7ac7ab9d34e Jul 25 12:41:31.312092 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2003359817 Jul 25 12:41:31.312092 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,admin,member Jul 25 12:41:31.312092 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,admin,member Jul 25 12:41:31.313601 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3b6a51b68f68412785f9b7ac7ab9d34e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3b6a51b68f68412785f9b7ac7ab9d34e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b6a51b68f68412785f9b7ac7ab9d34e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b6a51b68f68412785f9b7ac7ab9d34e"}]}] Jul 25 12:41:31.313601 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2003359817 Jul 25 12:41:31.313601 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 3b6a51b68f68412785f9b7ac7ab9d34e Jul 25 12:41:31.313601 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2003359817 Jul 25 12:41:31.313601 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin Jul 25 12:41:31.313601 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:41:31.313601 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:41:31.313601 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 51dacf95a4484c2abcbdb55280c0d3a5 Jul 25 12:41:31.313601 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin Jul 25 12:41:31.313601 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:41:31.313601 n-d-848886-15 devstack@n-api.service[125884]: exception: Access list not available for public flavors. Jul 25 12:41:31.313601 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'flavor_id': '278227216'} Jul 25 12:41:31.314612 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:41:31.314612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:31.314612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:31.314612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:31.314612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:41:31.314612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:41:31.314612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:41:31.314612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:41:31.314612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 25 12:41:31.314612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 12:41:31.314612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 25 12:41:31.314612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:31.314612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:31.314612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:31.314612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:31.314612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:31.314612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:31.314612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:41:31.314612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:41:31.314612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 25 12:41:31.314612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:31.316953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-68b53b2d-2bef-46f0-af02-97bd00c79f75 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:41:31.318538 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-68b53b2d-2bef-46f0-af02-97bd00c79f75 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/278227216/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.029506 Jul 25 12:41:31.319942 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 436/870] 10.222.0.49 () {58 vars in 1206 bytes} [Mon Jul 25 12:41:31 2022] GET /compute/v2.1/flavors/278227216/os-flavor-access => generated 91 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:41:31.326134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-da87e17c-54b7-4e71-860d-9b9ca3b1af3b tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Calling method '.version_select at 0x7efcf9d35dc0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:31.385534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-dac8c796-36d2-4f38-90f1-d53c06535725 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lazy-loading 'services' on Instance uuid c18f0b76-5dab-4e09-afb8-8a1de682b042 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:41:31.427261 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dac8c796-36d2-4f38-90f1-d53c06535725 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 2342 microversion: 2.25 time: 0.354774 Jul 25 12:41:31.428095 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 435/871] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:41:31 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 2342 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:41:31.436023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8ca68734-4f72-41c4-acc3-058dbe47524b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:31.440039 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8ca68734-4f72-41c4-acc3-058dbe47524b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:31.456321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ca68734-4f72-41c4-acc3-058dbe47524b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:31.457245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ca68734-4f72-41c4-acc3-058dbe47524b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:31.458322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ca68734-4f72-41c4-acc3-058dbe47524b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:31.459337 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ca68734-4f72-41c4-acc3-058dbe47524b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:31.691186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8ca68734-4f72-41c4-acc3-058dbe47524b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:31.703641 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8ca68734-4f72-41c4-acc3-058dbe47524b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 200 len: 1498 microversion: 2.1 time: 0.271284 Jul 25 12:41:31.720273 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 436/872] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:31 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 1498 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:31.725219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e0e88ddf-5455-4feb-bd41-37d29a278852 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:31.727712 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:31.727712 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:41:31.767333 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e0e88ddf-5455-4feb-bd41-37d29a278852 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/278227216" status: 202 len: 0 microversion: 2.1 time: 0.058379 Jul 25 12:41:31.768497 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 437/873] 10.222.0.49 () {58 vars in 1158 bytes} [Mon Jul 25 12:41:31 2022] DELETE /compute/v2.1/flavors/278227216 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:41:31.775031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-1c2fc566-04a7-4e0c-b5e4-6194381dc4d4 req-9110e0d3-63ab-4b10-a6c6-203927b88f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2711752-4c19-477f-a5f0-e5097f2dc41a", "tag": "9e34f7bb-4583-4a3f-875a-1441c142d908"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:31.806020 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-1c2fc566-04a7-4e0c-b5e4-6194381dc4d4 req-9110e0d3-63ab-4b10-a6c6-203927b88f2d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:31.809211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-1c2fc566-04a7-4e0c-b5e4-6194381dc4d4 req-9110e0d3-63ab-4b10-a6c6-203927b88f2d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:31.840757 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-1c2fc566-04a7-4e0c-b5e4-6194381dc4d4 req-9110e0d3-63ab-4b10-a6c6-203927b88f2d service nova] Creating event network-changed:9e34f7bb-4583-4a3f-875a-1441c142d908 for instance d2711752-4c19-477f-a5f0-e5097f2dc41a on n-h1-848886-15 Jul 25 12:41:31.897307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=23 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:31.906593 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-1c2fc566-04a7-4e0c-b5e4-6194381dc4d4 req-9110e0d3-63ab-4b10-a6c6-203927b88f2d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135747 Jul 25 12:41:31.908082 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 438/874] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:31.913718 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6790e95b-9a78-4116-8d86-dd9a54ecf0ed tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:31.917012 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:31.917012 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:41:31.919206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6790e95b-9a78-4116-8d86-dd9a54ecf0ed tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:31.919952 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6790e95b-9a78-4116-8d86-dd9a54ecf0ed tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:31.922289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6790e95b-9a78-4116-8d86-dd9a54ecf0ed tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:31.923641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6790e95b-9a78-4116-8d86-dd9a54ecf0ed tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:31.936113 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-da87e17c-54b7-4e71-860d-9b9ca3b1af3b tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/68465b10-b44e-4002-87be-5ce4b9a96117" status: 202 len: 0 microversion: 2.1 time: 0.614915 Jul 25 12:41:31.937511 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 437/875] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:41:31 2022] DELETE /compute/v2.1/os-security-groups/68465b10-b44e-4002-87be-5ce4b9a96117 => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:41:31.944063 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0c8a61bf-fa7e-446b-905c-de76a4a34229 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:32.003595 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6790e95b-9a78-4116-8d86-dd9a54ecf0ed tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.093867 Jul 25 12:41:32.005471 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0c8a61bf-fa7e-446b-905c-de76a4a34229 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.063616 Jul 25 12:41:32.007294 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 439/876] 10.222.0.49 () {60 vars in 1217 bytes} [Mon Jul 25 12:41:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:41:32.007808 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 438/877] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:41:31 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:32.014896 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3c795173-5690-4b6d-85a9-5e57134971c6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:32.018050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4fe6862b-d418-442d-b14a-a954993b8a3a tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Calling method '.version_select at 0x7efcf9d35940>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:32.021022 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3c795173-5690-4b6d-85a9-5e57134971c6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 662e780d-2f9d-4eeb-9323-978b7679d299] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:32.033788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c795173-5690-4b6d-85a9-5e57134971c6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:32.034323 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c795173-5690-4b6d-85a9-5e57134971c6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:32.035386 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c795173-5690-4b6d-85a9-5e57134971c6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:32.036134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c795173-5690-4b6d-85a9-5e57134971c6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:32.361327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3c795173-5690-4b6d-85a9-5e57134971c6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:32.370813 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3c795173-5690-4b6d-85a9-5e57134971c6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299" status: 200 len: 1466 microversion: 2.1 time: 0.359575 Jul 25 12:41:32.377928 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 440/878] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:32 2022] GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299 => generated 1466 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:32.391924 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-512549af-3207-4610-9541-8135433c4fed tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2011293274", "id": 960193375, "os-flavor-access:is_public": "False"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:32.397716 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:32.397716 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:41:32.434229 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-512549af-3207-4610-9541-8135433c4fed tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.054633 Jul 25 12:41:32.436579 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 441/879] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:41:32 2022] POST /compute/v2.1/flavors => generated 436 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:32.449623 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f414147d-85ad-465f-957a-2c1652f61ea4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:32.454715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f414147d-85ad-465f-957a-2c1652f61ea4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:32.466061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f414147d-85ad-465f-957a-2c1652f61ea4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:32.466976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f414147d-85ad-465f-957a-2c1652f61ea4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:32.470885 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f414147d-85ad-465f-957a-2c1652f61ea4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:32.471550 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f414147d-85ad-465f-957a-2c1652f61ea4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:32.865928 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f414147d-85ad-465f-957a-2c1652f61ea4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:32.874587 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f414147d-85ad-465f-957a-2c1652f61ea4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1378 microversion: 2.1 time: 0.436727 Jul 25 12:41:32.894005 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 442/880] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:32 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1378 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:32.900270 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8687aa2b-3646-4b07-ac46-f685b6e43488 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:32.903403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8687aa2b-3646-4b07-ac46-f685b6e43488 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: ce1a79d3-137b-485c-9757-bfa73c2dfbfb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:32.917070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8687aa2b-3646-4b07-ac46-f685b6e43488 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:32.925753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8687aa2b-3646-4b07-ac46-f685b6e43488 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:32.926901 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8687aa2b-3646-4b07-ac46-f685b6e43488 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:32.927507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8687aa2b-3646-4b07-ac46-f685b6e43488 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:33.296393 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4fe6862b-d418-442d-b14a-a954993b8a3a tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/69897cb4-2e45-4cdc-bc9a-685428d1345a" status: 202 len: 0 microversion: 2.1 time: 1.287382 Jul 25 12:41:33.297458 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 439/881] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:41:32 2022] DELETE /compute/v2.1/os-security-groups/69897cb4-2e45-4cdc-bc9a-685428d1345a => generated 0 bytes in 1289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:41:33.325129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8687aa2b-3646-4b07-ac46-f685b6e43488 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:33.333317 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8687aa2b-3646-4b07-ac46-f685b6e43488 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/ce1a79d3-137b-485c-9757-bfa73c2dfbfb" status: 200 len: 1468 microversion: 2.1 time: 0.437930 Jul 25 12:41:33.337993 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 443/882] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:32 2022] GET /compute/v2.1/servers/ce1a79d3-137b-485c-9757-bfa73c2dfbfb => generated 1468 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:33.342975 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a28f3b3b-be4e-4bb5-b3b0-2093bb6b9c42 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:33.350946 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a28f3b3b-be4e-4bb5-b3b0-2093bb6b9c42 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:33.382412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a28f3b3b-be4e-4bb5-b3b0-2093bb6b9c42 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:33.383095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a28f3b3b-be4e-4bb5-b3b0-2093bb6b9c42 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:33.383745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a28f3b3b-be4e-4bb5-b3b0-2093bb6b9c42 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:33.384192 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a28f3b3b-be4e-4bb5-b3b0-2093bb6b9c42 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:33.569357 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c3364b92-5cf0-4070-b11a-5de5c5eb9e80 tempest-FlavorsAccessNegativeTestJSON-59221541 tempest-FlavorsAccessNegativeTestJSON-59221541-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b405a9e543da4e22aea2799ecfc69143"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:33.573028 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:33.573028 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:41:33.574019 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c3364b92-5cf0-4070-b11a-5de5c5eb9e80 tempest-FlavorsAccessNegativeTestJSON-59221541 tempest-FlavorsAccessNegativeTestJSON-59221541-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '64d1c1d4ada840bca60794c106d04cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b405a9e543da4e22aea2799ecfc69143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:33.575640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c3364b92-5cf0-4070-b11a-5de5c5eb9e80 tempest-FlavorsAccessNegativeTestJSON-59221541 tempest-FlavorsAccessNegativeTestJSON-59221541-project] Request method failure captured: Jul 25 12:41:33.575640 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/flavors/960193375/action HTTP/1.1 Jul 25 12:41:33.575640 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:41:33.575640 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:41:33.575640 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:41:33.575640 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 67 Jul 25 12:41:33.575640 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:41:33.575640 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:41:33.575640 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:41:33.575640 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:41:33.575640 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o92hkeUwpKxjSRpCp7c2A7WQ-MUaGFdSTvgZHktQ5mbmkvh9uGkl2wZjrrSP30BZcvo2gU0_YOwfXY3LU9xs02doCvd_qjccyGx4sIpyrXIwgXk3IZXO3XdA3K4pRzWbib0yVK4f9NeiOIFrCNvWFkzhIFhZJtlDui843b-Hkf5YIk Jul 25 12:41:33.575640 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:41:33.575640 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:41:33.575640 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:41:33.575640 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:41:33.575640 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:41:33.575640 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:41:33.575640 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: b405a9e543da4e22aea2799ecfc69143 Jul 25 12:41:33.575640 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-59221541 Jul 25 12:41:33.575640 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:41:33.575640 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:41:33.577196 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b405a9e543da4e22aea2799ecfc69143", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b405a9e543da4e22aea2799ecfc69143"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b405a9e543da4e22aea2799ecfc69143"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b405a9e543da4e22aea2799ecfc69143"}]}] Jul 25 12:41:33.577196 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-59221541 Jul 25 12:41:33.577196 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: b405a9e543da4e22aea2799ecfc69143 Jul 25 12:41:33.577196 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-59221541 Jul 25 12:41:33.577196 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-FlavorsAccessNegativeTestJSON-59221541-project Jul 25 12:41:33.577196 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:41:33.577196 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:41:33.577196 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 64d1c1d4ada840bca60794c106d04cdb Jul 25 12:41:33.577196 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-59221541-project Jul 25 12:41:33.577196 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:41:33.577196 n-d-848886-15 devstack@n-api.service[125884]: {"addTenantAccess": {"tenant": "b405a9e543da4e22aea2799ecfc69143"}} Jul 25 12:41:33.577196 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:41:33.578164 n-d-848886-15 devstack@n-api.service[125884]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 25 12:41:33.578164 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '960193375', 'body': {'addTenantAccess': {'tenant': 'b405a9e543da4e22aea2799ecfc69143'}}} Jul 25 12:41:33.578164 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:41:33.578164 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:33.578164 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:33.578164 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:33.578164 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:41:33.578164 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:41:33.578164 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:41:33.578164 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:41:33.578164 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:41:33.578164 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:41:33.578164 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 25 12:41:33.578164 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 25 12:41:33.578164 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:41:33.578164 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:41:33.578164 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:41:33.578164 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:41:33.578164 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:41:33.580285 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:41:33.580285 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:41:33.580285 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:41:33.580285 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:41:33.580285 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:41:33.580285 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:41:33.580285 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:41:33.580285 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:41:33.580285 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:41:33.580285 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 25 12:41:33.580285 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:33.580285 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:33.580285 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:33.580285 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:33.580285 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:33.580285 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:33.580285 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:41:33.580285 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:41:33.580285 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 25 12:41:33.580285 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:41:33.581961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c3364b92-5cf0-4070-b11a-5de5c5eb9e80 tempest-FlavorsAccessNegativeTestJSON-59221541 tempest-FlavorsAccessNegativeTestJSON-59221541-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:41:33.581961 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c3364b92-5cf0-4070-b11a-5de5c5eb9e80 tempest-FlavorsAccessNegativeTestJSON-59221541 tempest-FlavorsAccessNegativeTestJSON-59221541-project] 10.222.0.49 "POST /compute/v2.1/flavors/960193375/action" status: 403 len: 130 microversion: 2.1 time: 0.278470 Jul 25 12:41:33.593636 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 440/883] 10.222.0.49 () {60 vars in 1197 bytes} [Mon Jul 25 12:41:33 2022] POST /compute/v2.1/flavors/960193375/action => generated 130 bytes in 295 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:41:33.610728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-40c2f65d-1d5b-4871-a9e2-b40ba206a58f tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Calling method '.version_select at 0x7efcf9d3cd30>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:33.919526 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a28f3b3b-be4e-4bb5-b3b0-2093bb6b9c42 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:33.928639 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a28f3b3b-be4e-4bb5-b3b0-2093bb6b9c42 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 200 len: 1498 microversion: 2.1 time: 0.589315 Jul 25 12:41:33.929417 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 444/884] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:33 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 1498 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:33.941591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-775af653-bf6d-44d6-876c-51b0fd75cd1a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:33.953299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-775af653-bf6d-44d6-876c-51b0fd75cd1a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:33.954935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-775af653-bf6d-44d6-876c-51b0fd75cd1a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Searching by: {'reservation_id': 'r-wro70dow', 'deleted': False, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 12:41:33.968291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-775af653-bf6d-44d6-876c-51b0fd75cd1a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:33.968968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-775af653-bf6d-44d6-876c-51b0fd75cd1a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:33.970369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-775af653-bf6d-44d6-876c-51b0fd75cd1a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:33.971084 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-775af653-bf6d-44d6-876c-51b0fd75cd1a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:34.095815 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-40c2f65d-1d5b-4871-a9e2-b40ba206a58f tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/a5943e5c-fc18-42cf-a1c0-16002de87c8c" status: 202 len: 0 microversion: 2.1 time: 0.499962 Jul 25 12:41:34.099449 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 441/885] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:41:33 2022] DELETE /compute/v2.1/os-security-groups/a5943e5c-fc18-42cf-a1c0-16002de87c8c => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:41:34.101722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f23e5a8f-14e9-4c9c-997b-8f4be8c2dbcc tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:34.102674 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:34.102674 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:41:34.140949 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f23e5a8f-14e9-4c9c-997b-8f4be8c2dbcc tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/960193375" status: 202 len: 0 microversion: 2.1 time: 0.042916 Jul 25 12:41:34.141983 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 442/886] 10.222.0.49 () {58 vars in 1158 bytes} [Mon Jul 25 12:41:34 2022] DELETE /compute/v2.1/flavors/960193375 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:41:34.148882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-be48a49b-4050-4d1c-92a9-4aaf981dd9c7 req-445a95d3-aa27-4128-901a-4d1d2973b0bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a", "name": "network-vif-plugged", "status": "completed", "tag": "4dc52859-0016-4f90-b755-bb756ddacc11"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:34.162640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-be48a49b-4050-4d1c-92a9-4aaf981dd9c7 req-445a95d3-aa27-4128-901a-4d1d2973b0bb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:34.163401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-be48a49b-4050-4d1c-92a9-4aaf981dd9c7 req-445a95d3-aa27-4128-901a-4d1d2973b0bb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:34.179214 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-be48a49b-4050-4d1c-92a9-4aaf981dd9c7 req-445a95d3-aa27-4128-901a-4d1d2973b0bb service nova] Creating event network-vif-plugged:4dc52859-0016-4f90-b755-bb756ddacc11 for instance e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a on n-h2-848886-15 Jul 25 12:41:34.187403 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-be48a49b-4050-4d1c-92a9-4aaf981dd9c7 req-445a95d3-aa27-4128-901a-4d1d2973b0bb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043616 Jul 25 12:41:34.189597 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 443/887] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:34.197646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a160b965-9b2f-49ca-a93c-0670ebdcd696 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:34.198758 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a160b965-9b2f-49ca-a93c-0670ebdcd696 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:34.206878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a160b965-9b2f-49ca-a93c-0670ebdcd696 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:34.207633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a160b965-9b2f-49ca-a93c-0670ebdcd696 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:34.208833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a160b965-9b2f-49ca-a93c-0670ebdcd696 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:34.209634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a160b965-9b2f-49ca-a93c-0670ebdcd696 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:34.259257 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-775af653-bf6d-44d6-876c-51b0fd75cd1a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 12:41:34.353369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-775af653-bf6d-44d6-876c-51b0fd75cd1a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:34.361821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-775af653-bf6d-44d6-876c-51b0fd75cd1a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:34.362522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-775af653-bf6d-44d6-876c-51b0fd75cd1a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:34.636852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a160b965-9b2f-49ca-a93c-0670ebdcd696 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:34.646070 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a160b965-9b2f-49ca-a93c-0670ebdcd696 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1378 microversion: 2.1 time: 0.454837 Jul 25 12:41:34.646656 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 444/888] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:34 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1378 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:34.651557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f80a85d3-5114-45c7-a764-bc4b757f207b tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] Calling method '.version_select at 0x7efcf9d3c8b0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:34.675432 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-775af653-bf6d-44d6-876c-51b0fd75cd1a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?reservation_id=r-wro70dow" status: 200 len: 2927 microversion: 2.1 time: 0.740560 Jul 25 12:41:34.700342 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 445/889] 10.222.0.49 () {58 vars in 1197 bytes} [Mon Jul 25 12:41:33 2022] GET /compute/v2.1/servers/detail?reservation_id=r-wro70dow => generated 2927 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:34.705570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bb775ca9-c562-42de-a658-c245986aff97 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:34.730562 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bb775ca9-c562-42de-a658-c245986aff97 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.025786 Jul 25 12:41:34.742399 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 446/890] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:41:34 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:34.747596 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-769047ef-e7ce-4472-b727-2b8c99184f89 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:34.773590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.compute.server_groups [None req-769047ef-e7ce-4472-b727-2b8c99184f89 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Querying cell 44375b4d-91c4-48bf-9056-56d6e14223f5(cell1) for 2 instances {{(pid=125883) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 25 12:41:34.774436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-769047ef-e7ce-4472-b727-2b8c99184f89 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:34.774874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-769047ef-e7ce-4472-b727-2b8c99184f89 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:34.805821 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-769047ef-e7ce-4472-b727-2b8c99184f89 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups/5f168769-42c4-41f2-afbc-424c2b01f168" status: 200 len: 266 microversion: 2.1 time: 0.062200 Jul 25 12:41:34.806683 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 447/891] 10.222.0.49 () {58 vars in 1263 bytes} [Mon Jul 25 12:41:34 2022] GET /compute/v2.1/os-server-groups/5f168769-42c4-41f2-afbc-424c2b01f168 => generated 266 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:34.819888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a7723cf5-9a06-4d0a-9ba9-ce8f286f4c30 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-12301122", "id": 730913207, "os-flavor-access:is_public": "False"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:34.822995 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:34.822995 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:41:34.873628 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a7723cf5-9a06-4d0a-9ba9-ce8f286f4c30 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.060358 Jul 25 12:41:34.874274 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 448/892] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:41:34 2022] POST /compute/v2.1/flavors => generated 434 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:34.888011 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2ac3fe85-0b6f-4b4c-89d3-2d2f2163681b tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:34.893307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2ac3fe85-0b6f-4b4c-89d3-2d2f2163681b tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] [instance: 662e780d-2f9d-4eeb-9323-978b7679d299] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:34.903311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2ac3fe85-0b6f-4b4c-89d3-2d2f2163681b tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:34.909160 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2ac3fe85-0b6f-4b4c-89d3-2d2f2163681b tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:34.909160 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2ac3fe85-0b6f-4b4c-89d3-2d2f2163681b tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:34.909559 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2ac3fe85-0b6f-4b4c-89d3-2d2f2163681b tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:34.955680 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f80a85d3-5114-45c7-a764-bc4b757f207b tempest-SecurityGroupRulesNegativeTestJSON-304168973 tempest-SecurityGroupRulesNegativeTestJSON-304168973-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/06b423ca-aadf-45ec-8726-fed37590388a" status: 202 len: 0 microversion: 2.1 time: 0.307795 Jul 25 12:41:34.962319 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 445/893] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:41:34 2022] DELETE /compute/v2.1/os-security-groups/06b423ca-aadf-45ec-8726-fed37590388a => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:41:34.979355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-66e3587e-09ad-4615-903e-a9edd4613945 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b405a9e543da4e22aea2799ecfc69143"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:34.983035 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:34.983035 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:41:35.128324 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-66e3587e-09ad-4615-903e-a9edd4613945 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/730913207/action" status: 200 len: 96 microversion: 2.1 time: 0.164781 Jul 25 12:41:35.130326 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 446/894] 10.222.0.49 () {60 vars in 1197 bytes} [Mon Jul 25 12:41:34 2022] POST /compute/v2.1/flavors/730913207/action => generated 96 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:41:35.136050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-93aea432-75d7-4e68-ba4e-d907c3325d29 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:35.136907 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-93aea432-75d7-4e68-ba4e-d907c3325d29 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:35.148340 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93aea432-75d7-4e68-ba4e-d907c3325d29 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:35.149780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93aea432-75d7-4e68-ba4e-d907c3325d29 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:35.151492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93aea432-75d7-4e68-ba4e-d907c3325d29 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:35.152122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93aea432-75d7-4e68-ba4e-d907c3325d29 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:35.205213 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2ac3fe85-0b6f-4b4c-89d3-2d2f2163681b tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299" status: 200 len: 1619 microversion: 2.1 time: 0.328229 Jul 25 12:41:35.205924 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 449/895] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:34 2022] GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299 => generated 1619 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:35.210547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-29bb9744-fb68-4615-89db-487e66ebeef7 tempest-FlavorsAccessNegativeTestJSON-59221541 tempest-FlavorsAccessNegativeTestJSON-59221541-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b405a9e543da4e22aea2799ecfc69143"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:35.213191 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:35.213191 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:41:35.214378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-29bb9744-fb68-4615-89db-487e66ebeef7 tempest-FlavorsAccessNegativeTestJSON-59221541 tempest-FlavorsAccessNegativeTestJSON-59221541-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '64d1c1d4ada840bca60794c106d04cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b405a9e543da4e22aea2799ecfc69143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:35.216461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-29bb9744-fb68-4615-89db-487e66ebeef7 tempest-FlavorsAccessNegativeTestJSON-59221541 tempest-FlavorsAccessNegativeTestJSON-59221541-project] Request method failure captured: Jul 25 12:41:35.216461 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/flavors/730913207/action HTTP/1.1 Jul 25 12:41:35.216461 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:41:35.216461 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:41:35.216461 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:41:35.216461 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 70 Jul 25 12:41:35.216461 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:41:35.216461 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:41:35.216461 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:41:35.216461 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:41:35.216461 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o92hkeUwpKxjSRpCp7c2A7WQ-MUaGFdSTvgZHktQ5mbmkvh9uGkl2wZjrrSP30BZcvo2gU0_YOwfXY3LU9xs02doCvd_qjccyGx4sIpyrXIwgXk3IZXO3XdA3K4pRzWbib0yVK4f9NeiOIFrCNvWFkzhIFhZJtlDui843b-Hkf5YIk Jul 25 12:41:35.216461 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:41:35.216461 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:41:35.216461 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:41:35.216461 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:41:35.216461 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:41:35.216461 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:41:35.216461 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: b405a9e543da4e22aea2799ecfc69143 Jul 25 12:41:35.216461 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-59221541 Jul 25 12:41:35.216461 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:41:35.216461 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:41:35.217767 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b405a9e543da4e22aea2799ecfc69143", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b405a9e543da4e22aea2799ecfc69143"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b405a9e543da4e22aea2799ecfc69143"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b405a9e543da4e22aea2799ecfc69143"}]}] Jul 25 12:41:35.217767 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-59221541 Jul 25 12:41:35.217767 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: b405a9e543da4e22aea2799ecfc69143 Jul 25 12:41:35.217767 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-59221541 Jul 25 12:41:35.217767 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-FlavorsAccessNegativeTestJSON-59221541-project Jul 25 12:41:35.217767 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:41:35.217767 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:41:35.217767 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 64d1c1d4ada840bca60794c106d04cdb Jul 25 12:41:35.217767 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-59221541-project Jul 25 12:41:35.217767 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:41:35.217767 n-d-848886-15 devstack@n-api.service[125883]: {"removeTenantAccess": {"tenant": "b405a9e543da4e22aea2799ecfc69143"}} Jul 25 12:41:35.217767 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:41:35.218539 n-d-848886-15 devstack@n-api.service[125883]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 25 12:41:35.218539 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '730913207', 'body': {'removeTenantAccess': {'tenant': 'b405a9e543da4e22aea2799ecfc69143'}}} Jul 25 12:41:35.218539 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:41:35.218539 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:35.218539 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:35.218539 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:35.218539 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:41:35.218539 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:41:35.218539 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:41:35.218539 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:41:35.218539 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:41:35.218539 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:41:35.218539 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 25 12:41:35.218539 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi context.can( Jul 25 12:41:35.218539 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:41:35.218539 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:41:35.218539 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:41:35.218539 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:41:35.218539 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:41:35.218539 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:41:35.219699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:41:35.219699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:41:35.219699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:41:35.219699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:41:35.219699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:41:35.219699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:41:35.219699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:41:35.219699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:41:35.219699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 25 12:41:35.219699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:35.219699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:35.219699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:35.219699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:35.219699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:35.219699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:35.219699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:41:35.219699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:41:35.219699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 25 12:41:35.219699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:35.224831 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-29bb9744-fb68-4615-89db-487e66ebeef7 tempest-FlavorsAccessNegativeTestJSON-59221541 tempest-FlavorsAccessNegativeTestJSON-59221541-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:41:35.227168 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-29bb9744-fb68-4615-89db-487e66ebeef7 tempest-FlavorsAccessNegativeTestJSON-59221541 tempest-FlavorsAccessNegativeTestJSON-59221541-project] 10.222.0.49 "POST /compute/v2.1/flavors/730913207/action" status: 403 len: 133 microversion: 2.1 time: 0.018976 Jul 25 12:41:35.227906 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 450/896] 10.222.0.49 () {60 vars in 1197 bytes} [Mon Jul 25 12:41:35 2022] POST /compute/v2.1/flavors/730913207/action => generated 133 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:41:35.236430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8949897b-e170-46a8-8e67-0a17845dac7d tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:35.237416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8949897b-e170-46a8-8e67-0a17845dac7d tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] [instance: ce1a79d3-137b-485c-9757-bfa73c2dfbfb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:35.257613 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8949897b-e170-46a8-8e67-0a17845dac7d tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:35.258454 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8949897b-e170-46a8-8e67-0a17845dac7d tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:35.259589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8949897b-e170-46a8-8e67-0a17845dac7d tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:35.260308 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8949897b-e170-46a8-8e67-0a17845dac7d tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:35.513977 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-93aea432-75d7-4e68-ba4e-d907c3325d29 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:35.527075 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-93aea432-75d7-4e68-ba4e-d907c3325d29 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 200 len: 1498 microversion: 2.1 time: 0.394820 Jul 25 12:41:35.529309 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 447/897] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:35 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 1498 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:35.541731 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8cfb9530-2082-4b9d-a14c-2302deca4641 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b405a9e543da4e22aea2799ecfc69143"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:35.545699 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:35.545699 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:41:35.561677 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8949897b-e170-46a8-8e67-0a17845dac7d tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce1a79d3-137b-485c-9757-bfa73c2dfbfb" status: 200 len: 1621 microversion: 2.1 time: 0.298259 Jul 25 12:41:35.562517 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 451/898] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:35 2022] GET /compute/v2.1/servers/ce1a79d3-137b-485c-9757-bfa73c2dfbfb => generated 1621 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:35.587419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cfb57e66-17d3-4805-a9cc-2b9a64ebe05e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Action: 'create', calling method: .version_select at 0x7efcf9ec8d30>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-17667234", "policies": ["anti-affinity"]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:35.615399 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-cfb57e66-17d3-4805-a9cc-2b9a64ebe05e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_groups'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:41:35.622453 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-cfb57e66-17d3-4805-a9cc-2b9a64ebe05e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for user 8c296447c2254c048f94bd9f186b0097 and project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_groups'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:41:35.676686 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8cfb9530-2082-4b9d-a14c-2302deca4641 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/730913207/action" status: 200 len: 21 microversion: 2.1 time: 0.145897 Jul 25 12:41:35.682354 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 448/899] 10.222.0.49 () {60 vars in 1197 bytes} [Mon Jul 25 12:41:35 2022] POST /compute/v2.1/flavors/730913207/action => generated 21 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:41:35.705381 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-cfb57e66-17d3-4805-a9cc-2b9a64ebe05e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_groups'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:41:35.708546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9d358892-6291-451b-a1a1-fbc89d7ec7bc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:35.709174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9d358892-6291-451b-a1a1-fbc89d7ec7bc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:35.714471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-cfb57e66-17d3-4805-a9cc-2b9a64ebe05e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for user 8c296447c2254c048f94bd9f186b0097 and project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_groups'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:41:35.733100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d358892-6291-451b-a1a1-fbc89d7ec7bc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:35.733506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d358892-6291-451b-a1a1-fbc89d7ec7bc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:35.734695 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d358892-6291-451b-a1a1-fbc89d7ec7bc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:35.735156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d358892-6291-451b-a1a1-fbc89d7ec7bc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:35.736367 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cfb57e66-17d3-4805-a9cc-2b9a64ebe05e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 191 microversion: 2.1 time: 0.153532 Jul 25 12:41:35.737766 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 452/900] 10.222.0.49 () {60 vars in 1174 bytes} [Mon Jul 25 12:41:35 2022] POST /compute/v2.1/os-server-groups => generated 191 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:41:35.742713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f210ceb1-03dd-40dd-89d5-8f521693e7d1 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:35.743665 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:35.743665 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:41:35.780828 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f210ceb1-03dd-40dd-89d5-8f521693e7d1 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/730913207" status: 202 len: 0 microversion: 2.1 time: 0.041632 Jul 25 12:41:35.781922 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 453/901] 10.222.0.49 () {58 vars in 1158 bytes} [Mon Jul 25 12:41:35 2022] DELETE /compute/v2.1/flavors/730913207 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:41:35.798529 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ab26fd92-f6f0-476c-86c3-60cf6e256a84 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:35.830633 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ab26fd92-f6f0-476c-86c3-60cf6e256a84 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.042481 Jul 25 12:41:35.832976 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 454/902] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:41:35 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:35.852426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-18a65aee-a793-41fc-8022-332705265101 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1740508309", "id": 1428408454, "os-flavor-access:is_public": "False"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:35.856927 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:35.856927 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:41:35.880072 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-18a65aee-a793-41fc-8022-332705265101 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.031593 Jul 25 12:41:35.889886 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 455/903] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:41:35 2022] POST /compute/v2.1/flavors => generated 439 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:35.898729 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-601c6737-c776-4258-bd5e-6253fb53102b tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e367b73e16eb4d9bbaa2e14c3a6fcc6e"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:35.902849 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:35.902849 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:41:35.976001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9d358892-6291-451b-a1a1-fbc89d7ec7bc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:35.984121 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-601c6737-c776-4258-bd5e-6253fb53102b tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] HTTP exception thrown: Flavor access not found for 40 / e367b73e16eb4d9bbaa2e14c3a6fcc6e combination. Jul 25 12:41:35.984303 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9d358892-6291-451b-a1a1-fbc89d7ec7bc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1378 microversion: 2.1 time: 0.299432 Jul 25 12:41:35.984877 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 449/904] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:35 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1378 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:35.986984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-601c6737-c776-4258-bd5e-6253fb53102b tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Request method failure captured: Jul 25 12:41:35.986984 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/flavors/1428408454/action HTTP/1.1 Jul 25 12:41:35.986984 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:41:35.986984 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:41:35.986984 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:41:35.986984 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 70 Jul 25 12:41:35.986984 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:41:35.986984 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:41:35.986984 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:41:35.986984 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:41:35.986984 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o93eMMPAuDd3INLIJfK6ptZ3f42WEC409SSGMUxphSt-5l6HvT-XvN2SNjFTHJDfjTGiFmez_6Uxw8IApUtjNIF-extTdlrvWbW1-pWPqjGWt_KN-2wQsOJyKD1bt5uek-QE7HmmDKoz47bsmvuNppFjj462BUf4qU1gicaBZjpzyQ Jul 25 12:41:35.986984 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:41:35.986984 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:41:35.986984 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:41:35.986984 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:41:35.986984 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:41:35.986984 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:41:35.986984 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 3b6a51b68f68412785f9b7ac7ab9d34e Jul 25 12:41:35.986984 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2003359817 Jul 25 12:41:35.986984 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:41:35.986984 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:41:35.988328 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3b6a51b68f68412785f9b7ac7ab9d34e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3b6a51b68f68412785f9b7ac7ab9d34e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b6a51b68f68412785f9b7ac7ab9d34e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b6a51b68f68412785f9b7ac7ab9d34e"}]}] Jul 25 12:41:35.988328 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2003359817 Jul 25 12:41:35.988328 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 3b6a51b68f68412785f9b7ac7ab9d34e Jul 25 12:41:35.988328 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2003359817 Jul 25 12:41:35.988328 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin Jul 25 12:41:35.988328 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:41:35.988328 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:41:35.988328 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 51dacf95a4484c2abcbdb55280c0d3a5 Jul 25 12:41:35.988328 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin Jul 25 12:41:35.988328 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:41:35.988328 n-d-848886-15 devstack@n-api.service[125883]: {"removeTenantAccess": {"tenant": "e367b73e16eb4d9bbaa2e14c3a6fcc6e"}} Jul 25 12:41:35.988328 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:41:35.989041 n-d-848886-15 devstack@n-api.service[125883]: exception: Flavor access not found for 40 / e367b73e16eb4d9bbaa2e14c3a6fcc6e combination. Jul 25 12:41:35.989041 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '1428408454', 'body': {'removeTenantAccess': {'tenant': 'e367b73e16eb4d9bbaa2e14c3a6fcc6e'}}} Jul 25 12:41:35.989041 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:41:35.989041 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:35.989041 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 25 12:41:35.989041 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 25 12:41:35.989041 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 12:41:35.989041 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 12:41:35.989041 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 25 12:41:35.989041 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 25 12:41:35.989041 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 25 12:41:35.989041 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 25 12:41:35.989041 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 25 12:41:35.989041 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 25 12:41:35.989041 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:41:35.989041 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:41:35.989041 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 25 12:41:35.989041 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 25 12:41:35.991185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 40 / e367b73e16eb4d9bbaa2e14c3a6fcc6e combination. Jul 25 12:41:35.991185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:35.991185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:35.991185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:35.991185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:35.991185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:35.991185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:35.991185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:41:35.991185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:41:35.991185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:41:35.991185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:41:35.991185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:41:35.991185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:41:35.991185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 25 12:41:35.991185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:41:35.991185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 40 / e367b73e16eb4d9bbaa2e14c3a6fcc6e combination. Jul 25 12:41:35.991185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:35.991185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:35.991185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:35.991185 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:35.992377 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:35.992377 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:35.992377 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:41:35.992377 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:41:35.992377 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 40 / e367b73e16eb4d9bbaa2e14c3a6fcc6e combination. Jul 25 12:41:35.992377 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:35.992377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-601c6737-c776-4258-bd5e-6253fb53102b tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Returning 404 to user: Flavor access not found for 40 / e367b73e16eb4d9bbaa2e14c3a6fcc6e combination. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:41:35.992377 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-601c6737-c776-4258-bd5e-6253fb53102b tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1428408454/action" status: 404 len: 124 microversion: 2.1 time: 0.096532 Jul 25 12:41:35.992377 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 456/905] 10.222.0.49 () {60 vars in 1200 bytes} [Mon Jul 25 12:41:35 2022] POST /compute/v2.1/flavors/1428408454/action => generated 124 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:41:36.001329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1083866984", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "4ed2b1d5-e7d3-4cb9-a903-29a884e9882c"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:36.004699 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aca9afbe-1df0-428f-9422-de12d83c9c43 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:36.019558 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=9,nova_api:INSERT=5 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:36.028636 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aca9afbe-1df0-428f-9422-de12d83c9c43 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1428408454" status: 202 len: 0 microversion: 2.1 time: 0.033903 Jul 25 12:41:36.032446 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 457/906] 10.222.0.49 () {58 vars in 1161 bytes} [Mon Jul 25 12:41:35 2022] DELETE /compute/v2.1/flavors/1428408454 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:41:36.038654 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e2cef4f4-170c-4d64-b9d0-f7a343d63dd2 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:36.064936 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] validate_networks() for None {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:41:36.068048 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e2cef4f4-170c-4d64-b9d0-f7a343d63dd2 tempest-FlavorsAccessNegativeTestJSON-2003359817 tempest-FlavorsAccessNegativeTestJSON-2003359817-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.034334 Jul 25 12:41:36.068993 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 458/907] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:41:36 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:36.404617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:41:36.405023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:41:36.405575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:41:36.406338 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:41:36.407046 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:41:36.424723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:36.425180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:36.426114 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:36.426966 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:36.433403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-53eb8b39-b463-451e-af3f-acd8c74f5a6e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35050ae4-0fb9-4de9-9623-e06491e15233", "device": "/dev/xvdb"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:36.436286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-53eb8b39-b463-451e-af3f-acd8c74f5a6e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:36.451265 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:41:36.452237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53eb8b39-b463-451e-af3f-acd8c74f5a6e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:36.452693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53eb8b39-b463-451e-af3f-acd8c74f5a6e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:36.453478 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53eb8b39-b463-451e-af3f-acd8c74f5a6e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:36.454784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53eb8b39-b463-451e-af3f-acd8c74f5a6e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:36.465822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for user 8c296447c2254c048f94bd9f186b0097 and project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:41:36.470203 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=5,nova_api:DELETE=8 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:36.492895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Going to run 2 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:41:36.495696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: dd308860-1e7f-4257-b285-3d2d3054d4ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:41:36.567761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_group_members'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:41:36.576319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for user 8c296447c2254c048f94bd9f186b0097 and project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_group_members'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:41:36.638711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_group_members'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:41:36.646397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for user 8c296447c2254c048f94bd9f186b0097 and project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_group_members'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:41:36.664782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 10a61568-b301-4b9e-82f9-160490f071d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=dd308860-1e7f-4257-b285-3d2d3054d4ef,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:41:36.760516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_group_members'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:41:36.768671 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for user 8c296447c2254c048f94bd9f186b0097 and project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_group_members'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:41:36.821118 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_group_members'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:41:36.827868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for user 8c296447c2254c048f94bd9f186b0097 and project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'server_group_members'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:41:36.880695 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9b1b9c63-c9e4-4583-bf02-a0b65320be22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.894518 Jul 25 12:41:36.881666 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 450/908] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:41:35 2022] POST /compute/v2.1/servers => generated 32 bytes in 896 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 25 12:41:36.893157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6e3e6898-c19f-409d-b701-c79a760f22bd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:36.894286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6e3e6898-c19f-409d-b701-c79a760f22bd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:36.904717 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e3e6898-c19f-409d-b701-c79a760f22bd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:36.908708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e3e6898-c19f-409d-b701-c79a760f22bd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:36.910235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e3e6898-c19f-409d-b701-c79a760f22bd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:36.910832 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e3e6898-c19f-409d-b701-c79a760f22bd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:36.948331 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-53eb8b39-b463-451e-af3f-acd8c74f5a6e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "POST /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.518634 Jul 25 12:41:36.950194 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 459/909] 10.222.0.49 () {62 vars in 1364 bytes} [Mon Jul 25 12:41:36 2022] POST /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/os-volume_attachments => generated 194 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:41:36.959462 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-56ae9706-b077-47d5-b1d0-fbbbe55496a5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:36.967919 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-56ae9706-b077-47d5-b1d0-fbbbe55496a5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:36.968921 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-56ae9706-b077-47d5-b1d0-fbbbe55496a5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Searching by: {'deleted': False, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 12:41:36.991427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56ae9706-b077-47d5-b1d0-fbbbe55496a5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:36.992301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56ae9706-b077-47d5-b1d0-fbbbe55496a5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:36.993368 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56ae9706-b077-47d5-b1d0-fbbbe55496a5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:36.994245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56ae9706-b077-47d5-b1d0-fbbbe55496a5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:37.037535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-56ae9706-b077-47d5-b1d0-fbbbe55496a5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 12:41:37.071753 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-56ae9706-b077-47d5-b1d0-fbbbe55496a5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.119961 Jul 25 12:41:37.073249 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 460/910] 10.222.0.49 () {58 vars in 1125 bytes} [Mon Jul 25 12:41:36 2022] GET /compute/v2.1/servers => generated 1664 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:37.078818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6c81f8d1-6572-47a6-9c6c-28fcf85bfffa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:37.080125 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6c81f8d1-6572-47a6-9c6c-28fcf85bfffa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:37.089131 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c81f8d1-6572-47a6-9c6c-28fcf85bfffa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:37.089820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c81f8d1-6572-47a6-9c6c-28fcf85bfffa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:37.090945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c81f8d1-6572-47a6-9c6c-28fcf85bfffa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:37.091602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c81f8d1-6572-47a6-9c6c-28fcf85bfffa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:37.228012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6e3e6898-c19f-409d-b701-c79a760f22bd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:37.244764 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6e3e6898-c19f-409d-b701-c79a760f22bd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 200 len: 1498 microversion: 2.1 time: 0.356998 Jul 25 12:41:37.245574 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 451/911] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:36 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 1498 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:37.258862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d72deeea-2df8-4eb4-a631-26c08711c60d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:37.259817 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d72deeea-2df8-4eb4-a631-26c08711c60d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 10a61568-b301-4b9e-82f9-160490f071d7] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:37.336791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d72deeea-2df8-4eb4-a631-26c08711c60d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:37.344003 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d72deeea-2df8-4eb4-a631-26c08711c60d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7" status: 200 len: 1219 microversion: 2.1 time: 0.096133 Jul 25 12:41:37.347559 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 452/912] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:37 2022] GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:37.351289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6c81f8d1-6572-47a6-9c6c-28fcf85bfffa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:37.354465 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:37.363490 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6c81f8d1-6572-47a6-9c6c-28fcf85bfffa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1526 microversion: 2.1 time: 0.288901 Jul 25 12:41:37.364554 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 461/913] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:37 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1526 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:37.385808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6cd8126c-0eaa-4e33-ad17-fa77d29ba168 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:37.386722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6cd8126c-0eaa-4e33-ad17-fa77d29ba168 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:37.407342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cd8126c-0eaa-4e33-ad17-fa77d29ba168 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:37.408462 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cd8126c-0eaa-4e33-ad17-fa77d29ba168 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:37.410012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cd8126c-0eaa-4e33-ad17-fa77d29ba168 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:37.410991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cd8126c-0eaa-4e33-ad17-fa77d29ba168 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:37.678345 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6cd8126c-0eaa-4e33-ad17-fa77d29ba168 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:37.686638 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6cd8126c-0eaa-4e33-ad17-fa77d29ba168 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1526 microversion: 2.1 time: 0.305289 Jul 25 12:41:37.690602 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 453/914] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:37 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1526 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:37.713289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-085cde81-25a0-47b1-9e62-bcc2a28ba074 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:37.715000 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:37.715000 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:41:37.777156 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-085cde81-25a0-47b1-9e62-bcc2a28ba074 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/3d28811f-a317-4701-8a64-72af0acde626" status: 202 len: 0 microversion: 2.1 time: 0.062507 Jul 25 12:41:37.777156 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 462/915] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:41:37 2022] DELETE /compute/v2.1/flavors/3d28811f-a317-4701-8a64-72af0acde626 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:41:37.787592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d2a10d74-078b-4fe5-8c29-dfef56784403 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:37.828951 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d2a10d74-078b-4fe5-8c29-dfef56784403 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049672 Jul 25 12:41:37.832026 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 454/916] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:41:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:37.850432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4b932b60-a123-4148-ad7c-170c62be42e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:37.854583 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4b932b60-a123-4148-ad7c-170c62be42e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:37.867117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b932b60-a123-4148-ad7c-170c62be42e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:37.868424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b932b60-a123-4148-ad7c-170c62be42e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:37.871879 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b932b60-a123-4148-ad7c-170c62be42e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:37.876951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b932b60-a123-4148-ad7c-170c62be42e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:38.087527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4b932b60-a123-4148-ad7c-170c62be42e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:38.099280 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4b932b60-a123-4148-ad7c-170c62be42e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Old instance type tempest-test_resize_flavor_-2145327132, new instance type m1.heat {{(pid=125883) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 12:41:38.124371 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4b932b60-a123-4148-ad7c-170c62be42e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:41:38.124987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4b932b60-a123-4148-ad7c-170c62be42e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:41:38.125722 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4b932b60-a123-4148-ad7c-170c62be42e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:41:38.135219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4b932b60-a123-4148-ad7c-170c62be42e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:41:38.136026 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4b932b60-a123-4148-ad7c-170c62be42e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:41:38.267398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-768e0e31-2d37-4931-8852-e2535fcd952a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:38.268195 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-768e0e31-2d37-4931-8852-e2535fcd952a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:38.278229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-768e0e31-2d37-4931-8852-e2535fcd952a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:38.279693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-768e0e31-2d37-4931-8852-e2535fcd952a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:38.280699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-768e0e31-2d37-4931-8852-e2535fcd952a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:38.281294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-768e0e31-2d37-4931-8852-e2535fcd952a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:38.335273 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4b932b60-a123-4148-ad7c-170c62be42e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "POST /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a/action" status: 202 len: 0 microversion: 2.1 time: 0.488536 Jul 25 12:41:38.336526 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 463/917] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:41:37 2022] POST /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:41:38.344385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-094019a7-eb1c-4d3e-aba5-490bc839278e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:38.351894 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-094019a7-eb1c-4d3e-aba5-490bc839278e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:38.367638 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-094019a7-eb1c-4d3e-aba5-490bc839278e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:38.368100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-094019a7-eb1c-4d3e-aba5-490bc839278e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:38.372311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-094019a7-eb1c-4d3e-aba5-490bc839278e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:38.384698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-094019a7-eb1c-4d3e-aba5-490bc839278e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:38.640991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-768e0e31-2d37-4931-8852-e2535fcd952a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:38.652942 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-768e0e31-2d37-4931-8852-e2535fcd952a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 200 len: 1498 microversion: 2.1 time: 0.387054 Jul 25 12:41:38.653909 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 455/918] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:38 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 1498 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:38.664034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f680d386-0ba8-449a-afa2-85f7ad350603 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:38.667158 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f680d386-0ba8-449a-afa2-85f7ad350603 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 10a61568-b301-4b9e-82f9-160490f071d7] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:38.679851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f680d386-0ba8-449a-afa2-85f7ad350603 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:38.683381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f680d386-0ba8-449a-afa2-85f7ad350603 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:38.684901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f680d386-0ba8-449a-afa2-85f7ad350603 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:38.688397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f680d386-0ba8-449a-afa2-85f7ad350603 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:38.723962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-094019a7-eb1c-4d3e-aba5-490bc839278e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:38.759671 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-094019a7-eb1c-4d3e-aba5-490bc839278e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1535 microversion: 2.1 time: 0.418788 Jul 25 12:41:38.766760 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 464/919] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:38 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1535 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:38.805781 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f680d386-0ba8-449a-afa2-85f7ad350603 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:38.815667 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f680d386-0ba8-449a-afa2-85f7ad350603 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7" status: 200 len: 1215 microversion: 2.1 time: 0.160331 Jul 25 12:41:38.816704 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 456/920] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:38 2022] GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7 => generated 1215 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:39.679783 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-37ae1352-1251-4ca3-9e46-af45f5edda66 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:39.680492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-37ae1352-1251-4ca3-9e46-af45f5edda66 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:39.700210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37ae1352-1251-4ca3-9e46-af45f5edda66 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:39.700668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37ae1352-1251-4ca3-9e46-af45f5edda66 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:39.701463 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37ae1352-1251-4ca3-9e46-af45f5edda66 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:39.701928 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37ae1352-1251-4ca3-9e46-af45f5edda66 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:39.780971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-85d2489e-2409-4f49-92d7-084bc4d72572 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:39.782217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-85d2489e-2409-4f49-92d7-084bc4d72572 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:39.793908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85d2489e-2409-4f49-92d7-084bc4d72572 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:39.799648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85d2489e-2409-4f49-92d7-084bc4d72572 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:39.804505 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85d2489e-2409-4f49-92d7-084bc4d72572 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:39.808577 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85d2489e-2409-4f49-92d7-084bc4d72572 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:40.645549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-37ae1352-1251-4ca3-9e46-af45f5edda66 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:40.658405 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-37ae1352-1251-4ca3-9e46-af45f5edda66 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 200 len: 1498 microversion: 2.1 time: 0.983206 Jul 25 12:41:40.674752 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 465/921] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:39 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 1498 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:40.686984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-18221b01-0d68-495e-b28c-9a6456cd33e9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:40.689626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-18221b01-0d68-495e-b28c-9a6456cd33e9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 10a61568-b301-4b9e-82f9-160490f071d7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:40.708497 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18221b01-0d68-495e-b28c-9a6456cd33e9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:40.709038 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18221b01-0d68-495e-b28c-9a6456cd33e9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:40.711517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18221b01-0d68-495e-b28c-9a6456cd33e9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:40.712321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18221b01-0d68-495e-b28c-9a6456cd33e9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:40.819940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-85d2489e-2409-4f49-92d7-084bc4d72572 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:40.837113 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-85d2489e-2409-4f49-92d7-084bc4d72572 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1535 microversion: 2.1 time: 1.060077 Jul 25 12:41:40.868966 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 457/922] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:39 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1535 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:41:40.935143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-18221b01-0d68-495e-b28c-9a6456cd33e9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:40.946259 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-18221b01-0d68-495e-b28c-9a6456cd33e9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7" status: 200 len: 1277 microversion: 2.1 time: 0.270089 Jul 25 12:41:40.952053 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 466/923] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:40 2022] GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7 => generated 1277 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:41.680561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1bf8de81-6a95-4c59-a4a1-475b34c09dc2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:41.681235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1bf8de81-6a95-4c59-a4a1-475b34c09dc2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:41.691388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1bf8de81-6a95-4c59-a4a1-475b34c09dc2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:41.699354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1bf8de81-6a95-4c59-a4a1-475b34c09dc2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:41.701053 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1bf8de81-6a95-4c59-a4a1-475b34c09dc2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:41.701910 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1bf8de81-6a95-4c59-a4a1-475b34c09dc2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:41.708631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:41.867213 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a0c81841-0918-4eaa-9a62-3131db3191d2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:41.869554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a0c81841-0918-4eaa-9a62-3131db3191d2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:41.889403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a0c81841-0918-4eaa-9a62-3131db3191d2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:41.890213 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a0c81841-0918-4eaa-9a62-3131db3191d2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:41.891465 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a0c81841-0918-4eaa-9a62-3131db3191d2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:41.892119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a0c81841-0918-4eaa-9a62-3131db3191d2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:42.542119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1bf8de81-6a95-4c59-a4a1-475b34c09dc2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:42.550863 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1bf8de81-6a95-4c59-a4a1-475b34c09dc2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 200 len: 1498 microversion: 2.1 time: 0.874527 Jul 25 12:41:42.554921 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 458/924] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:41 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 1498 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:42.561945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8dc2e7ef-d261-43d1-8eca-9509092be3c8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:42.562785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8dc2e7ef-d261-43d1-8eca-9509092be3c8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 10a61568-b301-4b9e-82f9-160490f071d7] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:42.584735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8dc2e7ef-d261-43d1-8eca-9509092be3c8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:42.585345 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8dc2e7ef-d261-43d1-8eca-9509092be3c8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:42.586309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8dc2e7ef-d261-43d1-8eca-9509092be3c8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:42.586846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8dc2e7ef-d261-43d1-8eca-9509092be3c8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:42.986545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a0c81841-0918-4eaa-9a62-3131db3191d2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:43.019556 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a0c81841-0918-4eaa-9a62-3131db3191d2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1535 microversion: 2.1 time: 1.160347 Jul 25 12:41:43.021783 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 467/925] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:41 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1535 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:43.348820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8dc2e7ef-d261-43d1-8eca-9509092be3c8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:43.359865 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8dc2e7ef-d261-43d1-8eca-9509092be3c8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7" status: 200 len: 1319 microversion: 2.1 time: 0.800811 Jul 25 12:41:43.361001 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 459/926] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:42 2022] GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7 => generated 1319 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:43.582812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4b50e93b-0328-4e6e-a0c7-13bb39ccdf40 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:43.585060 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4b50e93b-0328-4e6e-a0c7-13bb39ccdf40 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:43.596516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b50e93b-0328-4e6e-a0c7-13bb39ccdf40 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:43.598226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b50e93b-0328-4e6e-a0c7-13bb39ccdf40 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:43.599923 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b50e93b-0328-4e6e-a0c7-13bb39ccdf40 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:43.601886 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b50e93b-0328-4e6e-a0c7-13bb39ccdf40 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:44.043778 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d7381ff1-be4d-476f-b80b-814a3594662d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:44.044412 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d7381ff1-be4d-476f-b80b-814a3594662d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:44.060860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7381ff1-be4d-476f-b80b-814a3594662d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:44.062036 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7381ff1-be4d-476f-b80b-814a3594662d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:44.063335 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7381ff1-be4d-476f-b80b-814a3594662d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:44.064135 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7381ff1-be4d-476f-b80b-814a3594662d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:44.158419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4b50e93b-0328-4e6e-a0c7-13bb39ccdf40 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:44.169202 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4b50e93b-0328-4e6e-a0c7-13bb39ccdf40 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 200 len: 1475 microversion: 2.1 time: 0.592561 Jul 25 12:41:44.173953 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 468/927] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:43 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 1475 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:44.210370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-302055d5-1488-40f6-b5dc-fa4d7b7b01b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1531820198"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:44.215173 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-302055d5-1488-40f6-b5dc-fa4d7b7b01b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:44.233964 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-302055d5-1488-40f6-b5dc-fa4d7b7b01b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:44.234740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-302055d5-1488-40f6-b5dc-fa4d7b7b01b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:44.239624 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-302055d5-1488-40f6-b5dc-fa4d7b7b01b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:44.240442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-302055d5-1488-40f6-b5dc-fa4d7b7b01b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:44.708600 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-302055d5-1488-40f6-b5dc-fa4d7b7b01b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "POST /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16/action" status: 202 len: 0 microversion: 2.1 time: 0.502738 Jul 25 12:41:44.712225 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 469/928] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:41:44 2022] POST /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 25 12:41:44.728658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c0341c32-afa7-43a1-ae25-fb10f415b8d6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:44.729647 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c0341c32-afa7-43a1-ae25-fb10f415b8d6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 10a61568-b301-4b9e-82f9-160490f071d7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:44.736936 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0341c32-afa7-43a1-ae25-fb10f415b8d6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:44.738385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0341c32-afa7-43a1-ae25-fb10f415b8d6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:44.739773 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0341c32-afa7-43a1-ae25-fb10f415b8d6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:44.740428 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0341c32-afa7-43a1-ae25-fb10f415b8d6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:45.082715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d7381ff1-be4d-476f-b80b-814a3594662d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:45.095010 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d7381ff1-be4d-476f-b80b-814a3594662d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1540 microversion: 2.1 time: 1.055559 Jul 25 12:41:45.096304 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 460/929] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:44 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1540 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:45.102211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a9936285-e2e7-4e45-be24-913d0572e466 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9d435e0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:45.197242 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a9936285-e2e7-4e45-be24-913d0572e466 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c" status: 200 len: 1412 microversion: 2.1 time: 0.099474 Jul 25 12:41:45.197856 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 461/930] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:41:45 2022] GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c => generated 1412 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:45.324344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c0341c32-afa7-43a1-ae25-fb10f415b8d6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:45.336924 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c0341c32-afa7-43a1-ae25-fb10f415b8d6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7" status: 200 len: 1319 microversion: 2.1 time: 0.622669 Jul 25 12:41:45.339547 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 470/931] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:44 2022] GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7 => generated 1319 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:45.719987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-2eafdeed-64bc-4d51-b9e4-3a1efa654922 req-51fecab1-d94f-4587-9a88-2cd8d64849aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10a61568-b301-4b9e-82f9-160490f071d7", "tag": "c2f0713b-8145-47ab-9dec-7cf60284524b"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:45.786248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-2eafdeed-64bc-4d51-b9e4-3a1efa654922 req-51fecab1-d94f-4587-9a88-2cd8d64849aa service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:45.789107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-2eafdeed-64bc-4d51-b9e4-3a1efa654922 req-51fecab1-d94f-4587-9a88-2cd8d64849aa service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:45.852994 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=10 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:45.858327 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-2eafdeed-64bc-4d51-b9e4-3a1efa654922 req-51fecab1-d94f-4587-9a88-2cd8d64849aa service nova] Creating event network-changed:c2f0713b-8145-47ab-9dec-7cf60284524b for instance 10a61568-b301-4b9e-82f9-160490f071d7 on n-h1-848886-15 Jul 25 12:41:45.881931 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-2eafdeed-64bc-4d51-b9e4-3a1efa654922 req-51fecab1-d94f-4587-9a88-2cd8d64849aa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165285 Jul 25 12:41:45.883348 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 462/932] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:46.118164 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-650e86bd-0c22-4bba-90db-1b1c84637b6f tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Calling method '.version_select at 0x7efcf9939310>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:46.120935 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:46.120935 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:41:46.122619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-650e86bd-0c22-4bba-90db-1b1c84637b6f tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:46.123079 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-650e86bd-0c22-4bba-90db-1b1c84637b6f tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:46.123893 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-650e86bd-0c22-4bba-90db-1b1c84637b6f tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:46.129652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-650e86bd-0c22-4bba-90db-1b1c84637b6f tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:46.158963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-163addf1-4b2b-43b3-be3c-d76289864aa6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:46.160420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-163addf1-4b2b-43b3-be3c-d76289864aa6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:46.170972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-163addf1-4b2b-43b3-be3c-d76289864aa6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:46.171811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-163addf1-4b2b-43b3-be3c-d76289864aa6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:46.172832 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-163addf1-4b2b-43b3-be3c-d76289864aa6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:46.174040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-163addf1-4b2b-43b3-be3c-d76289864aa6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:46.196370 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-650e86bd-0c22-4bba-90db-1b1c84637b6f tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.348600 Jul 25 12:41:46.203682 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 471/933] 10.222.0.49 () {58 vars in 1128 bytes} [Mon Jul 25 12:41:45 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:41:46.210120 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-80b895ff-7c71-46ce-b753-64888266a48c tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Calling method '.version_select at 0x7efcf9a8fdc0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:46.212660 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:46.212660 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:41:46.223103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80b895ff-7c71-46ce-b753-64888266a48c tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:46.223782 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80b895ff-7c71-46ce-b753-64888266a48c tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:46.224766 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80b895ff-7c71-46ce-b753-64888266a48c tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:46.225513 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80b895ff-7c71-46ce-b753-64888266a48c tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:46.323899 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-80b895ff-7c71-46ce-b753-64888266a48c tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.113329 Jul 25 12:41:46.331563 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 472/934] 10.222.0.49 () {58 vars in 1139 bytes} [Mon Jul 25 12:41:46 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:46.343597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-19994fec-80dd-461f-a123-50dc89d9f4b6 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9a88310>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:46.397081 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-19994fec-80dd-461f-a123-50dc89d9f4b6 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c" status: 200 len: 1412 microversion: 2.1 time: 0.064328 Jul 25 12:41:46.397684 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 473/935] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:41:46 2022] GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c => generated 1412 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:46.410238 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9489179a-fecd-4a28-b02f-a3fbec18ce83 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Calling method '.version_select at 0x7efcf9944d30>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:46.413165 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:46.413165 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:41:46.414788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9489179a-fecd-4a28-b02f-a3fbec18ce83 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:46.415459 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9489179a-fecd-4a28-b02f-a3fbec18ce83 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:46.416452 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9489179a-fecd-4a28-b02f-a3fbec18ce83 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:46.417049 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9489179a-fecd-4a28-b02f-a3fbec18ce83 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:46.436042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:46.468941 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9489179a-fecd-4a28-b02f-a3fbec18ce83 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.061450 Jul 25 12:41:46.476430 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 474/936] 10.222.0.49 () {58 vars in 1145 bytes} [Mon Jul 25 12:41:46 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:41:46.481469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-39a6a392-a218-4b8c-b2bc-93c67f787e1d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:46.488868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-39a6a392-a218-4b8c-b2bc-93c67f787e1d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 10a61568-b301-4b9e-82f9-160490f071d7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:46.499112 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39a6a392-a218-4b8c-b2bc-93c67f787e1d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:46.499826 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39a6a392-a218-4b8c-b2bc-93c67f787e1d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:46.500778 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39a6a392-a218-4b8c-b2bc-93c67f787e1d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:46.501371 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39a6a392-a218-4b8c-b2bc-93c67f787e1d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:46.691594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-163addf1-4b2b-43b3-be3c-d76289864aa6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:46.705762 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-163addf1-4b2b-43b3-be3c-d76289864aa6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1540 microversion: 2.1 time: 0.589942 Jul 25 12:41:46.706396 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 463/937] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:46 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1540 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:46.713731 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d80bd901-2d11-4f74-9d19-fd1277b51790 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Calling method '.version_select at 0x7efcf9d55670>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:46.717921 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:46.717921 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:41:46.729332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d80bd901-2d11-4f74-9d19-fd1277b51790 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:46.730568 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d80bd901-2d11-4f74-9d19-fd1277b51790 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:46.732202 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d80bd901-2d11-4f74-9d19-fd1277b51790 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:46.732842 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d80bd901-2d11-4f74-9d19-fd1277b51790 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:46.773390 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d80bd901-2d11-4f74-9d19-fd1277b51790 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.065731 Jul 25 12:41:46.774557 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 464/938] 10.222.0.49 () {58 vars in 1128 bytes} [Mon Jul 25 12:41:46 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:46.809441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-423e0490-51d8-49ca-be21-23c94d2dfeb3 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Calling method '.version_select at 0x7efcf9d558b0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:46.818549 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:46.818549 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:41:46.820606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-423e0490-51d8-49ca-be21-23c94d2dfeb3 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:46.822364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-423e0490-51d8-49ca-be21-23c94d2dfeb3 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:46.826641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-423e0490-51d8-49ca-be21-23c94d2dfeb3 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:46.827373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-423e0490-51d8-49ca-be21-23c94d2dfeb3 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:46.859698 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-423e0490-51d8-49ca-be21-23c94d2dfeb3 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.068504 Jul 25 12:41:46.860939 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 465/939] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Jul 25 12:41:46 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:46.890058 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-36c08abe-07d9-4e8c-8b12-ea5a9448452e tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Calling method '.version_select at 0x7efcf9dae1f0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:46.895496 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:46.895496 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:41:46.899471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36c08abe-07d9-4e8c-8b12-ea5a9448452e tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:46.901725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36c08abe-07d9-4e8c-8b12-ea5a9448452e tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:46.902825 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36c08abe-07d9-4e8c-8b12-ea5a9448452e tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:46.903505 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36c08abe-07d9-4e8c-8b12-ea5a9448452e tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:46.954012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-39a6a392-a218-4b8c-b2bc-93c67f787e1d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:46.960108 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-36c08abe-07d9-4e8c-8b12-ea5a9448452e tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.078653 Jul 25 12:41:46.964565 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 466/940] 10.222.0.49 () {58 vars in 1128 bytes} [Mon Jul 25 12:41:46 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:46.970555 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-39a6a392-a218-4b8c-b2bc-93c67f787e1d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7" status: 200 len: 1319 microversion: 2.1 time: 0.492784 Jul 25 12:41:46.977008 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5cc8e3db-e498-45e9-8823-80ae33e1059e tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Calling method '.version_select at 0x7efcfa054b80>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:46.979151 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 475/941] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:46 2022] GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7 => generated 1319 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:46.979316 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:46.979316 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:41:46.994086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5cc8e3db-e498-45e9-8823-80ae33e1059e tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:47.003941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5cc8e3db-e498-45e9-8823-80ae33e1059e tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:47.016061 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:47.021170 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5cc8e3db-e498-45e9-8823-80ae33e1059e tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:47.022023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5cc8e3db-e498-45e9-8823-80ae33e1059e tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:47.053266 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5cc8e3db-e498-45e9-8823-80ae33e1059e tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/n-h2-848886-15" status: 200 len: 867 microversion: 2.1 time: 0.081273 Jul 25 12:41:47.054279 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 467/942] 10.222.0.49 () {58 vars in 1173 bytes} [Mon Jul 25 12:41:46 2022] GET /compute/v2.1/os-hosts/n-h2-848886-15 => generated 867 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:47.065266 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8870e192-5446-4d5d-a04a-cf3be7a07573 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Calling method '.version_select at 0x7efcf9a99160>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:47.066140 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:47.066140 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:41:47.073306 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8870e192-5446-4d5d-a04a-cf3be7a07573 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:47.073998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8870e192-5446-4d5d-a04a-cf3be7a07573 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:47.088493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8870e192-5446-4d5d-a04a-cf3be7a07573 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:47.089121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8870e192-5446-4d5d-a04a-cf3be7a07573 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:47.155115 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8870e192-5446-4d5d-a04a-cf3be7a07573 tempest-HostsAdminTestJSON-1168578499 tempest-HostsAdminTestJSON-1168578499-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/n-h1-848886-15" status: 200 len: 1004 microversion: 2.1 time: 0.093410 Jul 25 12:41:47.161336 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 476/943] 10.222.0.49 () {58 vars in 1173 bytes} [Mon Jul 25 12:41:47 2022] GET /compute/v2.1/os-hosts/n-h1-848886-15 => generated 1004 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:47.412929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b5f62716-824f-4956-b224-e2e4fec1251d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9d43a60>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:47.427255 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=24 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:47.506710 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b5f62716-824f-4956-b224-e2e4fec1251d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c" status: 200 len: 1412 microversion: 2.1 time: 0.098023 Jul 25 12:41:47.526283 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 468/944] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:41:47 2022] GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:47.731149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1a851de9-b3fd-4b8a-95a9-8e376734839e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:47.731808 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1a851de9-b3fd-4b8a-95a9-8e376734839e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:47.759833 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a851de9-b3fd-4b8a-95a9-8e376734839e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:47.760577 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a851de9-b3fd-4b8a-95a9-8e376734839e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:47.761565 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a851de9-b3fd-4b8a-95a9-8e376734839e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:47.762186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a851de9-b3fd-4b8a-95a9-8e376734839e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:47.978714 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-75f98ebd-3cf6-4a6c-84d1-21dc4ab77933 req-24f598cc-542f-4d47-9093-ede4fc90e3bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd308860-1e7f-4257-b285-3d2d3054d4ef", "tag": "95b22aa1-9462-42f8-be1e-7da968ced052"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:47.985525 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1a851de9-b3fd-4b8a-95a9-8e376734839e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:47.995422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-75f98ebd-3cf6-4a6c-84d1-21dc4ab77933 req-24f598cc-542f-4d47-9093-ede4fc90e3bf service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:47.996134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-75f98ebd-3cf6-4a6c-84d1-21dc4ab77933 req-24f598cc-542f-4d47-9093-ede4fc90e3bf service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:47.997335 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1a851de9-b3fd-4b8a-95a9-8e376734839e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1540 microversion: 2.1 time: 0.271096 Jul 25 12:41:47.998160 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 477/945] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:47 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1540 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:48.006485 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7ab4fdaf-ac55-42d9-8e84-f30890d7a2ec tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:48.007111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7ab4fdaf-ac55-42d9-8e84-f30890d7a2ec tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 10a61568-b301-4b9e-82f9-160490f071d7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:48.008937 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-75f98ebd-3cf6-4a6c-84d1-21dc4ab77933 req-24f598cc-542f-4d47-9093-ede4fc90e3bf service nova] Creating event network-changed:95b22aa1-9462-42f8-be1e-7da968ced052 for instance dd308860-1e7f-4257-b285-3d2d3054d4ef on n-h2-848886-15 Jul 25 12:41:48.019127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ab4fdaf-ac55-42d9-8e84-f30890d7a2ec tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:48.019373 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-75f98ebd-3cf6-4a6c-84d1-21dc4ab77933 req-24f598cc-542f-4d47-9093-ede4fc90e3bf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043973 Jul 25 12:41:48.019920 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 469/946] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:41:48.020409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ab4fdaf-ac55-42d9-8e84-f30890d7a2ec tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:48.021381 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ab4fdaf-ac55-42d9-8e84-f30890d7a2ec tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:48.022011 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ab4fdaf-ac55-42d9-8e84-f30890d7a2ec tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:48.279525 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7ab4fdaf-ac55-42d9-8e84-f30890d7a2ec tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:48.293206 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7ab4fdaf-ac55-42d9-8e84-f30890d7a2ec tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7" status: 200 len: 1319 microversion: 2.1 time: 0.294160 Jul 25 12:41:48.294722 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 478/947] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:47 2022] GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7 => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:48.544157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e839bbdf-c1e1-4189-9cb1-a4458072c7e4 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9d344c0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:48.647379 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e839bbdf-c1e1-4189-9cb1-a4458072c7e4 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c" status: 200 len: 1412 microversion: 2.1 time: 0.118487 Jul 25 12:41:48.647980 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 470/948] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:41:48 2022] GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c => generated 1412 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:49.021779 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ef25e7d6-02c7-4b29-bbf1-692b930793a5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:49.022426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ef25e7d6-02c7-4b29-bbf1-692b930793a5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:49.037119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef25e7d6-02c7-4b29-bbf1-692b930793a5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:49.038561 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef25e7d6-02c7-4b29-bbf1-692b930793a5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:49.041698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef25e7d6-02c7-4b29-bbf1-692b930793a5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:49.042665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef25e7d6-02c7-4b29-bbf1-692b930793a5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:49.319632 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-65bd41cc-fb04-48b3-b8df-0aa77b248ef2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:49.322273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-65bd41cc-fb04-48b3-b8df-0aa77b248ef2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 10a61568-b301-4b9e-82f9-160490f071d7] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:49.354528 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65bd41cc-fb04-48b3-b8df-0aa77b248ef2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:49.358604 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65bd41cc-fb04-48b3-b8df-0aa77b248ef2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:49.361533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65bd41cc-fb04-48b3-b8df-0aa77b248ef2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:49.371167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65bd41cc-fb04-48b3-b8df-0aa77b248ef2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:50.186551 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-65bd41cc-fb04-48b3-b8df-0aa77b248ef2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:50.190417 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ef25e7d6-02c7-4b29-bbf1-692b930793a5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:50.197281 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-65bd41cc-fb04-48b3-b8df-0aa77b248ef2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7" status: 200 len: 1319 microversion: 2.1 time: 0.885211 Jul 25 12:41:50.197687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:50.204357 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ef25e7d6-02c7-4b29-bbf1-692b930793a5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1540 microversion: 2.1 time: 1.184804 Jul 25 12:41:50.207252 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 479/949] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:49 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1540 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:50.213000 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 471/950] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:49 2022] GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7 => generated 1319 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:50.222687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-8bf13e14-4486-4702-8e40-b00fb550a429 req-5cf6a5c1-de12-4d55-a5dd-0369aba1ba7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b91c2f-a489-4adc-9090-7bd3f4d40e16", "name": "network-vif-plugged", "status": "completed", "tag": "1db48820-05f4-4c09-bd03-4b5f5ea84c25"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:50.225699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fdbba222-b7ff-4af0-997f-008a2458c04a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcfa0a64c0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:50.254436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-8bf13e14-4486-4702-8e40-b00fb550a429 req-5cf6a5c1-de12-4d55-a5dd-0369aba1ba7f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:50.255655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-8bf13e14-4486-4702-8e40-b00fb550a429 req-5cf6a5c1-de12-4d55-a5dd-0369aba1ba7f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:50.303799 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-8bf13e14-4486-4702-8e40-b00fb550a429 req-5cf6a5c1-de12-4d55-a5dd-0369aba1ba7f service nova] Creating event network-vif-plugged:1db48820-05f4-4c09-bd03-4b5f5ea84c25 for instance c2b91c2f-a489-4adc-9090-7bd3f4d40e16 on n-h1-848886-15 Jul 25 12:41:50.314331 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-8bf13e14-4486-4702-8e40-b00fb550a429 req-5cf6a5c1-de12-4d55-a5dd-0369aba1ba7f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104244 Jul 25 12:41:50.318203 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 480/951] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:50.352776 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fdbba222-b7ff-4af0-997f-008a2458c04a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c" status: 200 len: 1412 microversion: 2.1 time: 0.138409 Jul 25 12:41:50.353861 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 472/952] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:41:50 2022] GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c => generated 1412 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:51.239014 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7316fb1b-5167-483c-bd62-0d9e4cbde479 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:51.240615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7316fb1b-5167-483c-bd62-0d9e4cbde479 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 10a61568-b301-4b9e-82f9-160490f071d7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:51.240893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5a5b99d3-3509-4a91-94ce-2851faca4b26 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:51.241658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5a5b99d3-3509-4a91-94ce-2851faca4b26 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:51.255177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7316fb1b-5167-483c-bd62-0d9e4cbde479 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:51.256076 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7316fb1b-5167-483c-bd62-0d9e4cbde479 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:51.257806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7316fb1b-5167-483c-bd62-0d9e4cbde479 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:51.258980 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7316fb1b-5167-483c-bd62-0d9e4cbde479 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:51.264796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a5b99d3-3509-4a91-94ce-2851faca4b26 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:51.265672 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a5b99d3-3509-4a91-94ce-2851faca4b26 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:51.269522 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a5b99d3-3509-4a91-94ce-2851faca4b26 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:51.272158 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a5b99d3-3509-4a91-94ce-2851faca4b26 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:52.356634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5a5b99d3-3509-4a91-94ce-2851faca4b26 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:52.370993 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5a5b99d3-3509-4a91-94ce-2851faca4b26 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1540 microversion: 2.1 time: 1.140568 Jul 25 12:41:52.396251 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 473/953] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:51 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1540 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:52.414611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-19b25585-225a-47e8-b9e2-360646ce06fc tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9d34040>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:52.535023 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-19b25585-225a-47e8-b9e2-360646ce06fc tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c" status: 200 len: 1412 microversion: 2.1 time: 0.135006 Jul 25 12:41:52.535866 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 474/954] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:41:52 2022] GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c => generated 1412 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:52.580373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7316fb1b-5167-483c-bd62-0d9e4cbde479 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:52.588226 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7316fb1b-5167-483c-bd62-0d9e4cbde479 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7" status: 200 len: 1319 microversion: 2.1 time: 1.371783 Jul 25 12:41:52.588826 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 481/955] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:51 2022] GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7 => generated 1319 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:53.399910 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-15e72d00-d9dc-463a-bfc4-61f75374aee6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:53.401501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-15e72d00-d9dc-463a-bfc4-61f75374aee6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:53.422429 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-15e72d00-d9dc-463a-bfc4-61f75374aee6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:53.422873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-15e72d00-d9dc-463a-bfc4-61f75374aee6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:53.424804 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-15e72d00-d9dc-463a-bfc4-61f75374aee6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:53.426755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-15e72d00-d9dc-463a-bfc4-61f75374aee6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:53.794810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-abf1afa1-91e8-4bdb-9ba5-4a2bb5b84699 tempest-InstanceUsageAuditLogTestJSON-1531927282 tempest-InstanceUsageAuditLogTestJSON-1531927282-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:53.795963 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:53.795963 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:41:53.840630 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-abf1afa1-91e8-4bdb-9ba5-4a2bb5b84699 tempest-InstanceUsageAuditLogTestJSON-1531927282 tempest-InstanceUsageAuditLogTestJSON-1531927282-project-admin] 10.222.0.49 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-25 12:41:53" status: 200 len: 318 microversion: 2.1 time: 0.387951 Jul 25 12:41:53.843891 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 482/956] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Jul 25 12:41:53 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-25%2012%3A41%3A53 => generated 318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:53.853729 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cc380af3-22e3-4cb5-a54f-ca62e77ba2f3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcfa2c9940>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:53.980144 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cc380af3-22e3-4cb5-a54f-ca62e77ba2f3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c" status: 200 len: 1412 microversion: 2.1 time: 0.131111 Jul 25 12:41:53.983474 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 483/957] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:41:53 2022] GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c => generated 1412 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:53.991100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-31c494d5-696d-4096-ad60-2b11d114585d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:53.994333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-31c494d5-696d-4096-ad60-2b11d114585d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 10a61568-b301-4b9e-82f9-160490f071d7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:54.010655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31c494d5-696d-4096-ad60-2b11d114585d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:54.014236 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31c494d5-696d-4096-ad60-2b11d114585d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:54.015239 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31c494d5-696d-4096-ad60-2b11d114585d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:54.015749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31c494d5-696d-4096-ad60-2b11d114585d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:54.394289 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-15e72d00-d9dc-463a-bfc4-61f75374aee6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:54.411461 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-15e72d00-d9dc-463a-bfc4-61f75374aee6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1540 microversion: 2.1 time: 1.017389 Jul 25 12:41:54.430733 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 475/958] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:53 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1540 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:54.451826 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-85fa187c-1e95-488e-abc5-46e45fa22e70 tempest-InstanceUsageAuditLogTestJSON-1531927282 tempest-InstanceUsageAuditLogTestJSON-1531927282-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:54.452791 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:41:54.452791 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:41:54.513712 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-85fa187c-1e95-488e-abc5-46e45fa22e70 tempest-InstanceUsageAuditLogTestJSON-1531927282 tempest-InstanceUsageAuditLogTestJSON-1531927282-project-admin] 10.222.0.49 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.080181 Jul 25 12:41:54.523864 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 476/959] 10.222.0.49 () {58 vars in 1185 bytes} [Mon Jul 25 12:41:54 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:54.575639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-31c494d5-696d-4096-ad60-2b11d114585d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:54.584743 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-31c494d5-696d-4096-ad60-2b11d114585d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7" status: 200 len: 1319 microversion: 2.1 time: 0.599865 Jul 25 12:41:54.590745 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 484/960] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:53 2022] GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7 => generated 1319 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:54.997393 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ccc34c7a-4eeb-4e4c-b4a5-2dae9b278e15 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9d558b0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:55.134554 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ccc34c7a-4eeb-4e4c-b4a5-2dae9b278e15 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c" status: 200 len: 1412 microversion: 2.1 time: 0.132522 Jul 25 12:41:55.135847 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 477/961] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:41:54 2022] GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c => generated 1412 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:55.388224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-afc36f7b-8175-49cb-b6df-4d7c5ab79004 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:55.389309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-afc36f7b-8175-49cb-b6df-4d7c5ab79004 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:55.410042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-afc36f7b-8175-49cb-b6df-4d7c5ab79004 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:55.411310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-afc36f7b-8175-49cb-b6df-4d7c5ab79004 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:55.417555 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-afc36f7b-8175-49cb-b6df-4d7c5ab79004 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:55.420422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-afc36f7b-8175-49cb-b6df-4d7c5ab79004 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:55.627402 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-646722fb-e87b-4953-883f-60440eae377d tempest-FloatingIPDetailsNegativeTestJSON-1789940931 tempest-FloatingIPDetailsNegativeTestJSON-1789940931-project] Calling method '.version_select at 0x7efcf9916790>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:55.749677 n-d-848886-15 devstack@n-api.service[125883]: DEBUG neutronclient.v2_0.client [None req-646722fb-e87b-4953-883f-60440eae377d tempest-FloatingIPDetailsNegativeTestJSON-1789940931 tempest-FloatingIPDetailsNegativeTestJSON-1789940931-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 04175325-6d90-4c34-a709-7fdd5862b4df could not be found", "detail": ""}} {{(pid=125883) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:41:55.750542 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-646722fb-e87b-4953-883f-60440eae377d tempest-FloatingIPDetailsNegativeTestJSON-1789940931 tempest-FloatingIPDetailsNegativeTestJSON-1789940931-project] HTTP exception thrown: Floating IP not found for ID 04175325-6d90-4c34-a709-7fdd5862b4df Jul 25 12:41:55.754351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-646722fb-e87b-4953-883f-60440eae377d tempest-FloatingIPDetailsNegativeTestJSON-1789940931 tempest-FloatingIPDetailsNegativeTestJSON-1789940931-project] Request method failure captured: Jul 25 12:41:55.754351 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-floating-ips/04175325-6d90-4c34-a709-7fdd5862b4df HTTP/1.1 Jul 25 12:41:55.754351 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:41:55.754351 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:41:55.754351 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:41:55.754351 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:41:55.754351 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:41:55.754351 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:41:55.754351 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:41:55.754351 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:41:55.754351 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o-T5DdO5EF1V89vJ82d3UB6UfI8DoYbRMceK4mVQvGD78EcfAveieAG2hggbv3uDBJ6S4jvCV95SVb8PVtxn7SLWYRztN_-jHQecE3EJ0POXym5whFIQNR1M28aNNMhuG_wPTA6jWfXuvZJoiAP3ZxvmDic1kUaCjhaqk-2opRTlTQ Jul 25 12:41:55.754351 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:41:55.754351 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:41:55.754351 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:41:55.754351 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:41:55.754351 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:41:55.754351 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:41:55.754351 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 20d67b3cd241467ca97b6fea642161a2 Jul 25 12:41:55.754351 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1789940931 Jul 25 12:41:55.754351 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:41:55.754351 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:41:55.755885 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_20d67b3cd241467ca97b6fea642161a2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/20d67b3cd241467ca97b6fea642161a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/20d67b3cd241467ca97b6fea642161a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/20d67b3cd241467ca97b6fea642161a2"}]}] Jul 25 12:41:55.755885 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1789940931 Jul 25 12:41:55.755885 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 20d67b3cd241467ca97b6fea642161a2 Jul 25 12:41:55.755885 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1789940931 Jul 25 12:41:55.755885 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1789940931-project Jul 25 12:41:55.755885 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:41:55.755885 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:41:55.755885 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 4a22bd79b6584a3494e2a02ea68283ac Jul 25 12:41:55.755885 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1789940931-project Jul 25 12:41:55.755885 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:41:55.755885 n-d-848886-15 devstack@n-api.service[125883]: exception: Floating IP not found for ID 04175325-6d90-4c34-a709-7fdd5862b4df Jul 25 12:41:55.755885 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '04175325-6d90-4c34-a709-7fdd5862b4df'} Jul 25 12:41:55.756735 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:41:55.756735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:55.756735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 25 12:41:55.756735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 25 12:41:55.756735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:41:55.756735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:41:55.756735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 25 12:41:55.756735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 25 12:41:55.756735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:41:55.756735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:41:55.756735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 12:41:55.756735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 12:41:55.756735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:41:55.756735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:41:55.756735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:41:55.756735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:41:55.756735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:41:55.756735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:41:55.756735 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:41:55.757998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:41:55.757998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:41:55.757998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:41:55.757998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:41:55.757998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:41:55.757998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:41:55.757998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:41:55.757998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 04175325-6d90-4c34-a709-7fdd5862b4df could not be found Jul 25 12:41:55.757998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-296f2fe0-b8e8-402f-821f-4eb2602be77c'] Jul 25 12:41:55.757998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:55.757998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:55.757998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:55.757998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:55.757998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 25 12:41:55.757998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 25 12:41:55.757998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 25 12:41:55.757998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 25 12:41:55.757998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 04175325-6d90-4c34-a709-7fdd5862b4df. Jul 25 12:41:55.757998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:55.760652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:55.760652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:55.760652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:55.760652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:55.760652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:55.760652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:41:55.760652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:41:55.760652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:41:55.760652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:41:55.760652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:41:55.760652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:41:55.760652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 25 12:41:55.760652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 12:41:55.760652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 04175325-6d90-4c34-a709-7fdd5862b4df Jul 25 12:41:55.760652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:55.760652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:55.760652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:55.760652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:55.760652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:55.760652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:55.760652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:41:55.764005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:41:55.764005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 04175325-6d90-4c34-a709-7fdd5862b4df Jul 25 12:41:55.764005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:41:55.764005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-646722fb-e87b-4953-883f-60440eae377d tempest-FloatingIPDetailsNegativeTestJSON-1789940931 tempest-FloatingIPDetailsNegativeTestJSON-1789940931-project] Returning 404 to user: Floating IP not found for ID 04175325-6d90-4c34-a709-7fdd5862b4df {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:41:55.764005 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-646722fb-e87b-4953-883f-60440eae377d tempest-FloatingIPDetailsNegativeTestJSON-1789940931 tempest-FloatingIPDetailsNegativeTestJSON-1789940931-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips/04175325-6d90-4c34-a709-7fdd5862b4df" status: 404 len: 111 microversion: 2.1 time: 0.415581 Jul 25 12:41:55.764005 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 485/962] 10.222.0.49 () {58 vars in 1260 bytes} [Mon Jul 25 12:41:55 2022] GET /compute/v2.1/os-floating-ips/04175325-6d90-4c34-a709-7fdd5862b4df => generated 111 bytes in 417 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:41:55.788810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5ba10f86-8ca8-4c42-bcc5-5f93a60bc094 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:55.792265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5ba10f86-8ca8-4c42-bcc5-5f93a60bc094 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:55.808693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ba10f86-8ca8-4c42-bcc5-5f93a60bc094 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:55.810586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ba10f86-8ca8-4c42-bcc5-5f93a60bc094 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:55.811604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ba10f86-8ca8-4c42-bcc5-5f93a60bc094 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:55.812940 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ba10f86-8ca8-4c42-bcc5-5f93a60bc094 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:56.438039 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=12 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:56.630145 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-afc36f7b-8175-49cb-b6df-4d7c5ab79004 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lazy-loading 'services' on Instance uuid c18f0b76-5dab-4e09-afb8-8a1de682b042 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:41:56.676511 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-afc36f7b-8175-49cb-b6df-4d7c5ab79004 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 2420 microversion: 2.25 time: 1.285118 Jul 25 12:41:56.678062 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 478/963] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:41:55 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 2420 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:41:56.690148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c55110c9-2e5d-4dd8-8531-e82cdee38bf7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:56.692083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c55110c9-2e5d-4dd8-8531-e82cdee38bf7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 10a61568-b301-4b9e-82f9-160490f071d7] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:56.708919 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c55110c9-2e5d-4dd8-8531-e82cdee38bf7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:56.709794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c55110c9-2e5d-4dd8-8531-e82cdee38bf7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:56.712022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c55110c9-2e5d-4dd8-8531-e82cdee38bf7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:56.713803 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c55110c9-2e5d-4dd8-8531-e82cdee38bf7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:56.913757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:57.455269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c55110c9-2e5d-4dd8-8531-e82cdee38bf7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:57.468634 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c55110c9-2e5d-4dd8-8531-e82cdee38bf7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7" status: 200 len: 1319 microversion: 2.1 time: 0.789428 Jul 25 12:41:57.471524 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 479/964] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:56 2022] GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7 => generated 1319 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:57.489310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-54a6730b-4d6a-4cc6-a092-677879d05e4b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9d64550>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:57.497311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5ba10f86-8ca8-4c42-bcc5-5f93a60bc094 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:57.532200 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5ba10f86-8ca8-4c42-bcc5-5f93a60bc094 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1540 microversion: 2.1 time: 1.772103 Jul 25 12:41:57.533820 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 486/965] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:55 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1540 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:57.571113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-62b5039a-5f7c-45b3-be80-ac16a8b135c4 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-848886-15", "block_migration": "auto"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:57.589854 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-62b5039a-5f7c-45b3-be80-ac16a8b135c4 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:57.631964 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-54a6730b-4d6a-4cc6-a092-677879d05e4b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c" status: 200 len: 1412 microversion: 2.1 time: 0.155636 Jul 25 12:41:57.633020 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 480/966] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:41:57 2022] GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c => generated 1412 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:57.640757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62b5039a-5f7c-45b3-be80-ac16a8b135c4 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:57.641327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62b5039a-5f7c-45b3-be80-ac16a8b135c4 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:57.642448 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62b5039a-5f7c-45b3-be80-ac16a8b135c4 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:57.642896 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62b5039a-5f7c-45b3-be80-ac16a8b135c4 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:57.663146 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-5092e3fd-3c24-4659-9418-0cb842f0a1cd req-aca0317b-a7d8-4245-87b7-4bf77caea94d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd308860-1e7f-4257-b285-3d2d3054d4ef", "name": "network-vif-plugged", "status": "completed", "tag": "95b22aa1-9462-42f8-be1e-7da968ced052"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:57.717705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5092e3fd-3c24-4659-9418-0cb842f0a1cd req-aca0317b-a7d8-4245-87b7-4bf77caea94d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:57.725303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5092e3fd-3c24-4659-9418-0cb842f0a1cd req-aca0317b-a7d8-4245-87b7-4bf77caea94d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:57.755014 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-62b5039a-5f7c-45b3-be80-ac16a8b135c4 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lazy-loading 'flavor' on Instance uuid c18f0b76-5dab-4e09-afb8-8a1de682b042 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:41:57.780755 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-5092e3fd-3c24-4659-9418-0cb842f0a1cd req-aca0317b-a7d8-4245-87b7-4bf77caea94d service nova] Creating event network-vif-plugged:95b22aa1-9462-42f8-be1e-7da968ced052 for instance dd308860-1e7f-4257-b285-3d2d3054d4ef on n-h2-848886-15 Jul 25 12:41:57.803022 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-5092e3fd-3c24-4659-9418-0cb842f0a1cd req-aca0317b-a7d8-4245-87b7-4bf77caea94d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163422 Jul 25 12:41:57.808556 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 481/967] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:57.810821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-62b5039a-5f7c-45b3-be80-ac16a8b135c4 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Going to try to live migrate instance to n-h2-848886-15 {{(pid=125883) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 12:41:58.522588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-62e73e8f-e539-40c0-b755-a44289275a73 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-956958482", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "65a9c256-dcda-46f3-a853-a427bb296a46"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:58.692035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-62e73e8f-e539-40c0-b755-a44289275a73 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] validate_networks() for [('65a9c256-dcda-46f3-a853-a427bb296a46', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:42:00.680723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-62e73e8f-e539-40c0-b755-a44289275a73 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:42:00.682005 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-62e73e8f-e539-40c0-b755-a44289275a73 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:42:00.699095 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-62e73e8f-e539-40c0-b755-a44289275a73 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:42:00.703001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-62e73e8f-e539-40c0-b755-a44289275a73 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:42:00.705417 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-62e73e8f-e539-40c0-b755-a44289275a73 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:42:00.742076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-62e73e8f-e539-40c0-b755-a44289275a73 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:00.745067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-62e73e8f-e539-40c0-b755-a44289275a73 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:00.751317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-62e73e8f-e539-40c0-b755-a44289275a73 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:00.754484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-62e73e8f-e539-40c0-b755-a44289275a73 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:00.828439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-62e73e8f-e539-40c0-b755-a44289275a73 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Getting quotas for project 4c04b18299cf48eeb27a4212724321c1. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:42:00.857411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-62e73e8f-e539-40c0-b755-a44289275a73 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Getting quotas for user 068cf3ae93ad4003b7a4bc580fae55c1 and project 4c04b18299cf48eeb27a4212724321c1. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:42:00.922093 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-62e73e8f-e539-40c0-b755-a44289275a73 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:42:00.924874 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-62e73e8f-e539-40c0-b755-a44289275a73 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] [instance: d184a9e5-6927-4167-a72a-8537f979a0c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:42:01.042307 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-62e73e8f-e539-40c0-b755-a44289275a73 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.922574 Jul 25 12:42:01.055258 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 482/968] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:41:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:42:01.066060 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a5006fe2-f7d5-42fe-a396-36233419b42e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:01.066712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a5006fe2-f7d5-42fe-a396-36233419b42e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 10a61568-b301-4b9e-82f9-160490f071d7] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:01.103335 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5006fe2-f7d5-42fe-a396-36233419b42e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:01.107098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5006fe2-f7d5-42fe-a396-36233419b42e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:01.108012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5006fe2-f7d5-42fe-a396-36233419b42e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:01.108360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5006fe2-f7d5-42fe-a396-36233419b42e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:01.189423 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-62b5039a-5f7c-45b3-be80-ac16a8b135c4 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/action" status: 202 len: 0 microversion: 2.25 time: 3.636211 Jul 25 12:42:01.190957 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 487/969] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Jul 25 12:41:57 2022] POST /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/action => generated 0 bytes in 3639 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:42:01.200858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7ec7a903-6b40-4714-bd5b-b2a0e8061bde tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:01.203784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7ec7a903-6b40-4714-bd5b-b2a0e8061bde tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:01.220262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ec7a903-6b40-4714-bd5b-b2a0e8061bde tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:01.221454 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ec7a903-6b40-4714-bd5b-b2a0e8061bde tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:01.222620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ec7a903-6b40-4714-bd5b-b2a0e8061bde tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:01.223377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ec7a903-6b40-4714-bd5b-b2a0e8061bde tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:01.748551 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a5006fe2-f7d5-42fe-a396-36233419b42e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:01.764459 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a5006fe2-f7d5-42fe-a396-36233419b42e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7" status: 200 len: 1319 microversion: 2.1 time: 0.706954 Jul 25 12:42:01.767088 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 483/970] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:01 2022] GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7 => generated 1319 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:01.789241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-52bf8116-f522-49f5-83c6-389615698f27 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9d64c10>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:01.901684 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-52bf8116-f522-49f5-83c6-389615698f27 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c" status: 200 len: 1412 microversion: 2.1 time: 0.131588 Jul 25 12:42:01.906032 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 484/971] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:01 2022] GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c => generated 1412 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:01.931116 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-64c6b7e9-4598-4e20-a9fe-4123c7a33311 req-1f30796d-1564-4505-83e4-a9c898bfbcb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10a61568-b301-4b9e-82f9-160490f071d7", "name": "network-vif-plugged", "status": "completed", "tag": "c2f0713b-8145-47ab-9dec-7cf60284524b"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:01.953602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-64c6b7e9-4598-4e20-a9fe-4123c7a33311 req-1f30796d-1564-4505-83e4-a9c898bfbcb1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:01.954420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-64c6b7e9-4598-4e20-a9fe-4123c7a33311 req-1f30796d-1564-4505-83e4-a9c898bfbcb1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:01.967010 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-64c6b7e9-4598-4e20-a9fe-4123c7a33311 req-1f30796d-1564-4505-83e4-a9c898bfbcb1 service nova] Creating event network-vif-plugged:c2f0713b-8145-47ab-9dec-7cf60284524b for instance 10a61568-b301-4b9e-82f9-160490f071d7 on n-h1-848886-15 Jul 25 12:42:01.981470 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-64c6b7e9-4598-4e20-a9fe-4123c7a33311 req-1f30796d-1564-4505-83e4-a9c898bfbcb1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064493 Jul 25 12:42:01.985354 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 485/972] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:02.012020 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ae92c3bb-272b-47ce-8682-557887b348e0 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:02.013323 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ae92c3bb-272b-47ce-8682-557887b348e0 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] [instance: d184a9e5-6927-4167-a72a-8537f979a0c1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:02.185276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ae92c3bb-272b-47ce-8682-557887b348e0 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068cf3ae93ad4003b7a4bc580fae55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c04b18299cf48eeb27a4212724321c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:02.199234 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ae92c3bb-272b-47ce-8682-557887b348e0 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] 10.222.0.49 "GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1" status: 200 len: 1224 microversion: 2.1 time: 0.212182 Jul 25 12:42:02.199840 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 486/973] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:01 2022] GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1 => generated 1224 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:02.217116 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5fbaa3c4-d1a3-435b-9428-f09c5b4a4cf7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:02.217749 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5fbaa3c4-d1a3-435b-9428-f09c5b4a4cf7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:02.235475 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5fbaa3c4-d1a3-435b-9428-f09c5b4a4cf7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:02.236655 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5fbaa3c4-d1a3-435b-9428-f09c5b4a4cf7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:02.237716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5fbaa3c4-d1a3-435b-9428-f09c5b4a4cf7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:02.238408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5fbaa3c4-d1a3-435b-9428-f09c5b4a4cf7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:02.507448 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7ec7a903-6b40-4714-bd5b-b2a0e8061bde tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:02.531046 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7ec7a903-6b40-4714-bd5b-b2a0e8061bde tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1540 microversion: 2.1 time: 1.331414 Jul 25 12:42:02.538476 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 488/974] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:01 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1540 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:02.644760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5fbaa3c4-d1a3-435b-9428-f09c5b4a4cf7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:02.654282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5fbaa3c4-d1a3-435b-9428-f09c5b4a4cf7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:02.655761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5fbaa3c4-d1a3-435b-9428-f09c5b4a4cf7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:02.664860 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5fbaa3c4-d1a3-435b-9428-f09c5b4a4cf7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1810 microversion: 2.25 time: 0.463798 Jul 25 12:42:02.665461 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 487/975] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:02 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1810 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:02.788089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a8ad6c66-4ddd-4608-b9d3-5148702057f1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:02.789400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a8ad6c66-4ddd-4608-b9d3-5148702057f1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 10a61568-b301-4b9e-82f9-160490f071d7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:02.799909 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a8ad6c66-4ddd-4608-b9d3-5148702057f1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:02.804469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a8ad6c66-4ddd-4608-b9d3-5148702057f1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:02.807221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a8ad6c66-4ddd-4608-b9d3-5148702057f1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:02.809162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a8ad6c66-4ddd-4608-b9d3-5148702057f1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:02.923097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4ef0f644-c877-4b20-a90d-e64d85b5ca41 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9d67940>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:03.016380 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4ef0f644-c877-4b20-a90d-e64d85b5ca41 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c" status: 200 len: 1412 microversion: 2.1 time: 0.095188 Jul 25 12:42:03.026499 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 488/976] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:02 2022] GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c => generated 1412 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:03.220598 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2c430b5c-3819-4562-9be3-6db223ebd435 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:03.221220 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2c430b5c-3819-4562-9be3-6db223ebd435 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] [instance: d184a9e5-6927-4167-a72a-8537f979a0c1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:03.239628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c430b5c-3819-4562-9be3-6db223ebd435 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:03.240079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c430b5c-3819-4562-9be3-6db223ebd435 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:03.240875 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c430b5c-3819-4562-9be3-6db223ebd435 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:03.241316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c430b5c-3819-4562-9be3-6db223ebd435 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:03.498511 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2c430b5c-3819-4562-9be3-6db223ebd435 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068cf3ae93ad4003b7a4bc580fae55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c04b18299cf48eeb27a4212724321c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:03.507588 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2c430b5c-3819-4562-9be3-6db223ebd435 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] 10.222.0.49 "GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1" status: 200 len: 1294 microversion: 2.1 time: 0.290982 Jul 25 12:42:03.513699 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 489/977] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:03 2022] GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1 => generated 1294 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:03.629500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a8ad6c66-4ddd-4608-b9d3-5148702057f1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:03.644353 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a8ad6c66-4ddd-4608-b9d3-5148702057f1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7" status: 200 len: 1319 microversion: 2.1 time: 0.858496 Jul 25 12:42:03.661183 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 489/978] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:02 2022] GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7 => generated 1319 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:03.671592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-50d86bcf-bdf3-46a7-ba50-9d5bf1dfb7bc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:03.672616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-50d86bcf-bdf3-46a7-ba50-9d5bf1dfb7bc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:03.689935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50d86bcf-bdf3-46a7-ba50-9d5bf1dfb7bc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:03.691817 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50d86bcf-bdf3-46a7-ba50-9d5bf1dfb7bc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:03.693149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50d86bcf-bdf3-46a7-ba50-9d5bf1dfb7bc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:03.695473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50d86bcf-bdf3-46a7-ba50-9d5bf1dfb7bc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:03.826857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:03.851855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d6e6b62b-2c84-464a-b865-ec15178cabc4 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Calling method '.version_select at 0x7efcf9d64b80>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:04.000801 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d6e6b62b-2c84-464a-b865-ec15178cabc4 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/d430a160ce7540adb7466409c8265b85" status: 200 len: 371 microversion: 2.1 time: 0.461736 Jul 25 12:42:04.001520 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 490/979] 10.222.0.49 () {58 vars in 1242 bytes} [Mon Jul 25 12:42:03 2022] GET /compute/v2.1/os-quota-sets/d430a160ce7540adb7466409c8265b85 => generated 371 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:42:04.016098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-50d86bcf-bdf3-46a7-ba50-9d5bf1dfb7bc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:04.030546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1638c09b-c78d-43ce-b782-30f30c1754f5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:04.033972 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-50d86bcf-bdf3-46a7-ba50-9d5bf1dfb7bc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1540 microversion: 2.1 time: 0.371125 Jul 25 12:42:04.035027 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 490/980] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:03 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1540 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:04.037087 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1638c09b-c78d-43ce-b782-30f30c1754f5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:04.043556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1638c09b-c78d-43ce-b782-30f30c1754f5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:04.044014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1638c09b-c78d-43ce-b782-30f30c1754f5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:04.044797 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1638c09b-c78d-43ce-b782-30f30c1754f5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:04.045234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1638c09b-c78d-43ce-b782-30f30c1754f5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:04.050207 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-41c7f606-d005-4a1e-812c-78d6020c3117 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Action: 'update', calling method: .version_select at 0x7efcf9930040>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:04.256368 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-41c7f606-d005-4a1e-812c-78d6020c3117 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:04.256926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-41c7f606-d005-4a1e-812c-78d6020c3117 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:04.257987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-41c7f606-d005-4a1e-812c-78d6020c3117 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:04.258434 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-41c7f606-d005-4a1e-812c-78d6020c3117 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:04.444354 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-41c7f606-d005-4a1e-812c-78d6020c3117 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/d430a160ce7540adb7466409c8265b85" status: 200 len: 328 microversion: 2.1 time: 0.407281 Jul 25 12:42:04.447492 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 491/981] 10.222.0.49 () {60 vars in 1262 bytes} [Mon Jul 25 12:42:04 2022] PUT /compute/v2.1/os-quota-sets/d430a160ce7540adb7466409c8265b85 => generated 328 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:04.464163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ab9b7dc9-5419-443d-9be4-0dd0a1452398 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf995b8b0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:04.529693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1638c09b-c78d-43ce-b782-30f30c1754f5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:04.537157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:04.552946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1638c09b-c78d-43ce-b782-30f30c1754f5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:04.559179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1638c09b-c78d-43ce-b782-30f30c1754f5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:04.561859 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1638c09b-c78d-43ce-b782-30f30c1754f5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1810 microversion: 2.25 time: 0.535444 Jul 25 12:42:04.575600 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ab9b7dc9-5419-443d-9be4-0dd0a1452398 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c" status: 200 len: 1412 microversion: 2.1 time: 0.126054 Jul 25 12:42:04.576657 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 492/982] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:04 2022] GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c => generated 1412 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:04.581354 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 491/983] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:04 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1810 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:04.586284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f9460d65-a6c1-4567-9b45-6f2467eb7e32 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:04.592003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f9460d65-a6c1-4567-9b45-6f2467eb7e32 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] [instance: d184a9e5-6927-4167-a72a-8537f979a0c1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:04.606451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9460d65-a6c1-4567-9b45-6f2467eb7e32 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:04.609691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9460d65-a6c1-4567-9b45-6f2467eb7e32 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:04.610940 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9460d65-a6c1-4567-9b45-6f2467eb7e32 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:04.611550 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9460d65-a6c1-4567-9b45-6f2467eb7e32 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:04.670202 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e1443afe-8da2-4f24-aa40-5e7b8d277b7b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:04.671483 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e1443afe-8da2-4f24-aa40-5e7b8d277b7b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 10a61568-b301-4b9e-82f9-160490f071d7] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:04.689649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1443afe-8da2-4f24-aa40-5e7b8d277b7b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:04.690359 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1443afe-8da2-4f24-aa40-5e7b8d277b7b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:04.692453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1443afe-8da2-4f24-aa40-5e7b8d277b7b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:04.694775 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1443afe-8da2-4f24-aa40-5e7b8d277b7b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:04.772553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f9460d65-a6c1-4567-9b45-6f2467eb7e32 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068cf3ae93ad4003b7a4bc580fae55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c04b18299cf48eeb27a4212724321c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:04.780969 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f9460d65-a6c1-4567-9b45-6f2467eb7e32 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] 10.222.0.49 "GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1" status: 200 len: 1282 microversion: 2.1 time: 0.198664 Jul 25 12:42:04.799275 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 493/984] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:04 2022] GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1 => generated 1282 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:04.916245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2af1e9c7-3dc2-4bee-b4f8-03080dba7392 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1705603648", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:05.029100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-2af1e9c7-3dc2-4bee-b4f8-03080dba7392 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] validate_networks() for None {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:42:05.355359 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e1443afe-8da2-4f24-aa40-5e7b8d277b7b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:05.365955 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e1443afe-8da2-4f24-aa40-5e7b8d277b7b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7" status: 200 len: 1468 microversion: 2.1 time: 0.700526 Jul 25 12:42:05.375481 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 492/985] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:04 2022] GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7 => generated 1468 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:42:05.390489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5ded0b93-3de1-4497-81bf-ad73cf83de61 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:05.391380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5ded0b93-3de1-4497-81bf-ad73cf83de61 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:05.415124 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5ded0b93-3de1-4497-81bf-ad73cf83de61 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:05.415840 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5ded0b93-3de1-4497-81bf-ad73cf83de61 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:05.416800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5ded0b93-3de1-4497-81bf-ad73cf83de61 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:05.417469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5ded0b93-3de1-4497-81bf-ad73cf83de61 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:05.832752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2af1e9c7-3dc2-4bee-b4f8-03080dba7392 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:42:05.833925 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2af1e9c7-3dc2-4bee-b4f8-03080dba7392 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:42:05.834565 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2af1e9c7-3dc2-4bee-b4f8-03080dba7392 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:42:05.835150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2af1e9c7-3dc2-4bee-b4f8-03080dba7392 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:42:05.835741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2af1e9c7-3dc2-4bee-b4f8-03080dba7392 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:42:05.866001 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2af1e9c7-3dc2-4bee-b4f8-03080dba7392 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:05.866731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2af1e9c7-3dc2-4bee-b4f8-03080dba7392 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:05.867825 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2af1e9c7-3dc2-4bee-b4f8-03080dba7392 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:05.868457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2af1e9c7-3dc2-4bee-b4f8-03080dba7392 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:05.899748 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=4,nova_api:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:05.915916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5ded0b93-3de1-4497-81bf-ad73cf83de61 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:05.924553 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5ded0b93-3de1-4497-81bf-ad73cf83de61 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1539 microversion: 2.1 time: 0.546839 Jul 25 12:42:05.925748 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 493/986] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:05 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1539 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:05.942776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-2af1e9c7-3dc2-4bee-b4f8-03080dba7392 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Getting quotas for project d430a160ce7540adb7466409c8265b85. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:42:05.946571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c91a17d8-ad30-49dc-b115-12e16e93c621 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:05.947191 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c91a17d8-ad30-49dc-b115-12e16e93c621 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: dd308860-1e7f-4257-b285-3d2d3054d4ef] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:05.955880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-2af1e9c7-3dc2-4bee-b4f8-03080dba7392 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Getting quotas for user 2be52b1fc5894ea38544048fd867db30 and project d430a160ce7540adb7466409c8265b85. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:42:05.963262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c91a17d8-ad30-49dc-b115-12e16e93c621 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:05.963262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c91a17d8-ad30-49dc-b115-12e16e93c621 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:05.963863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c91a17d8-ad30-49dc-b115-12e16e93c621 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:05.964622 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c91a17d8-ad30-49dc-b115-12e16e93c621 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:05.997524 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.utils [None req-2af1e9c7-3dc2-4bee-b4f8-03080dba7392 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] cores quota exceeded for d430a160ce7540adb7466409c8265b85, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=125883) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 25 12:42:06.006522 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-2af1e9c7-3dc2-4bee-b4f8-03080dba7392 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 25 12:42:06.009591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2af1e9c7-3dc2-4bee-b4f8-03080dba7392 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Request method failure captured: Jul 25 12:42:06.009591 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 12:42:06.009591 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:42:06.009591 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:42:06.009591 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:42:06.009591 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 145 Jul 25 12:42:06.009591 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:42:06.009591 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:42:06.009591 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:42:06.009591 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:42:06.009591 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o-a6gqUjTaQhlDAR4iTtNSnUvKK1P_ptR5rHVxzv3ScdFYbJOamIAHe9aXg7Eq9ddtIc82smm7Y96CnKZH7U0jvx7QZTYwq_VQM1DX0ltlVj8ZH8Yd4rky9gSqD8Y3oO49FoY3nmqZP3M4ZatCOkiNbLMDJFNv8RFLyUV6hV9lOKek Jul 25 12:42:06.009591 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:42:06.009591 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:42:06.009591 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:42:06.009591 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:42:06.009591 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:42:06.009591 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:42:06.009591 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d430a160ce7540adb7466409c8265b85 Jul 25 12:42:06.009591 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-QuotasAdminNegativeTest-1713167850 Jul 25 12:42:06.009591 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:42:06.009591 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:42:06.011255 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d430a160ce7540adb7466409c8265b85", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d430a160ce7540adb7466409c8265b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d430a160ce7540adb7466409c8265b85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d430a160ce7540adb7466409c8265b85"}]}] Jul 25 12:42:06.011255 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-QuotasAdminNegativeTest-1713167850 Jul 25 12:42:06.011255 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d430a160ce7540adb7466409c8265b85 Jul 25 12:42:06.011255 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1713167850 Jul 25 12:42:06.011255 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-QuotasAdminNegativeTest-1713167850-project Jul 25 12:42:06.011255 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:42:06.011255 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:42:06.011255 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 2be52b1fc5894ea38544048fd867db30 Jul 25 12:42:06.011255 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-QuotasAdminNegativeTest-1713167850-project Jul 25 12:42:06.011255 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:42:06.011255 n-d-848886-15 devstack@n-api.service[125883]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1705603648", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} Jul 25 12:42:06.011255 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:42:06.012171 n-d-848886-15 devstack@n-api.service[125883]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 25 12:42:06.012171 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1705603648', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452'}}} Jul 25 12:42:06.012171 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:42:06.012171 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:06.012171 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 25 12:42:06.012171 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 25 12:42:06.012171 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:42:06.012171 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:42:06.012171 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 25 12:42:06.012171 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc Jul 25 12:42:06.012171 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 25 12:42:06.012171 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 25 12:42:06.012171 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:42:06.012171 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:42:06.012171 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 25 12:42:06.012171 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 25 12:42:06.012171 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 25 12:42:06.012171 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 25 12:42:06.013463 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 25 12:42:06.013463 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 25 12:42:06.013463 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 25 12:42:06.013463 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:06.013463 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:42:06.013463 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:06.013463 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:06.013463 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 12:42:06.013463 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 12:42:06.013463 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 12:42:06.013463 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 12:42:06.013463 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 25 12:42:06.013463 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 25 12:42:06.013463 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 25 12:42:06.013463 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 25 12:42:06.013463 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 25 12:42:06.013463 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 25 12:42:06.013463 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 25 12:42:06.013463 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:06.013463 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:42:06.013463 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:06.015021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:06.015021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:42:06.015021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:42:06.015021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:42:06.015021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:42:06.015021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:42:06.015021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:42:06.015021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:42:06.015021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:42:06.015021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:42:06.015021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:42:06.015021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:42:06.015021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:42:06.015021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 12:42:06.015021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 25 12:42:06.015021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 12:42:06.015021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 25 12:42:06.015021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:06.015021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:42:06.015021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:06.015021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:06.017327 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:42:06.017327 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:42:06.017327 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:42:06.017327 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:42:06.017327 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 25 12:42:06.017327 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:06.023427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2af1e9c7-3dc2-4bee-b4f8-03080dba7392 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:42:06.024519 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2af1e9c7-3dc2-4bee-b4f8-03080dba7392 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.223641 Jul 25 12:42:06.030557 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 494/987] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:42:04 2022] POST /compute/v2.1/servers => generated 111 bytes in 1231 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:42:06.044888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-95c6df9e-8a97-4e1a-99cd-6c339b63f5ea tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcfa2c9940>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:06.152919 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-95c6df9e-8a97-4e1a-99cd-6c339b63f5ea tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c" status: 200 len: 1412 microversion: 2.1 time: 0.120780 Jul 25 12:42:06.165284 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 495/988] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:06 2022] GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c => generated 1412 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:06.182127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b96daf49-d9e2-426a-b0e8-7661e4b79703 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:06.182792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b96daf49-d9e2-426a-b0e8-7661e4b79703 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:06.195537 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b96daf49-d9e2-426a-b0e8-7661e4b79703 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:06.196815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b96daf49-d9e2-426a-b0e8-7661e4b79703 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:06.198672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b96daf49-d9e2-426a-b0e8-7661e4b79703 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:06.206211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b96daf49-d9e2-426a-b0e8-7661e4b79703 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:06.801455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c91a17d8-ad30-49dc-b115-12e16e93c621 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:06.816794 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c91a17d8-ad30-49dc-b115-12e16e93c621 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/dd308860-1e7f-4257-b285-3d2d3054d4ef" status: 200 len: 1468 microversion: 2.1 time: 0.887197 Jul 25 12:42:06.818520 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 494/989] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:05 2022] GET /compute/v2.1/servers/dd308860-1e7f-4257-b285-3d2d3054d4ef => generated 1468 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:06.838792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f99d94bc-2f00-456a-804a-c59834ca4d99 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:06.841305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f99d94bc-2f00-456a-804a-c59834ca4d99 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] [instance: d184a9e5-6927-4167-a72a-8537f979a0c1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:06.859102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f99d94bc-2f00-456a-804a-c59834ca4d99 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:06.859637 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f99d94bc-2f00-456a-804a-c59834ca4d99 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:06.861947 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f99d94bc-2f00-456a-804a-c59834ca4d99 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:06.863420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f99d94bc-2f00-456a-804a-c59834ca4d99 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:07.402214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f99d94bc-2f00-456a-804a-c59834ca4d99 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068cf3ae93ad4003b7a4bc580fae55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c04b18299cf48eeb27a4212724321c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:07.415820 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f99d94bc-2f00-456a-804a-c59834ca4d99 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] 10.222.0.49 "GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1" status: 200 len: 1324 microversion: 2.1 time: 0.596118 Jul 25 12:42:07.419926 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 495/990] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:06 2022] GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1 => generated 1324 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:07.440878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ea31cac9-0a3b-4389-ab70-6ff528894f12 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Action: 'update', calling method: .version_select at 0x7efcf9d64d30>, body: {"quota_set": {"cores": 20}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:07.470099 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b96daf49-d9e2-426a-b0e8-7661e4b79703 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:07.487480 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b96daf49-d9e2-426a-b0e8-7661e4b79703 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:07.489001 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b96daf49-d9e2-426a-b0e8-7661e4b79703 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:07.490250 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b96daf49-d9e2-426a-b0e8-7661e4b79703 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1810 microversion: 2.25 time: 1.323991 Jul 25 12:42:07.505172 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 496/991] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:06 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1810 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:07.519724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-21f01c51-8da7-43d7-af50-f57d98b9bada tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:07.527287 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-21f01c51-8da7-43d7-af50-f57d98b9bada tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:07.545791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-21f01c51-8da7-43d7-af50-f57d98b9bada tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Searching by: {'reservation_id': 'r-0y7iq1tj', 'deleted': False, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 12:42:07.566814 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-21f01c51-8da7-43d7-af50-f57d98b9bada tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:07.571444 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-21f01c51-8da7-43d7-af50-f57d98b9bada tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:07.576534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-21f01c51-8da7-43d7-af50-f57d98b9bada tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:07.587626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-21f01c51-8da7-43d7-af50-f57d98b9bada tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:07.610244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea31cac9-0a3b-4389-ab70-6ff528894f12 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:07.623182 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea31cac9-0a3b-4389-ab70-6ff528894f12 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:07.625032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea31cac9-0a3b-4389-ab70-6ff528894f12 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:07.627787 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea31cac9-0a3b-4389-ab70-6ff528894f12 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:07.812008 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ea31cac9-0a3b-4389-ab70-6ff528894f12 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/d430a160ce7540adb7466409c8265b85" status: 200 len: 329 microversion: 2.1 time: 0.388086 Jul 25 12:42:07.814364 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 496/992] 10.222.0.49 () {60 vars in 1262 bytes} [Mon Jul 25 12:42:07 2022] PUT /compute/v2.1/os-quota-sets/d430a160ce7540adb7466409c8265b85 => generated 329 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:07.836704 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a39541fe-29f9-4cec-88ac-307e6b415241 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:07.838241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a39541fe-29f9-4cec-88ac-307e6b415241 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:07.858061 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a39541fe-29f9-4cec-88ac-307e6b415241 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:07.858497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a39541fe-29f9-4cec-88ac-307e6b415241 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:07.859328 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a39541fe-29f9-4cec-88ac-307e6b415241 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:07.862335 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a39541fe-29f9-4cec-88ac-307e6b415241 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:07.878321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-21f01c51-8da7-43d7-af50-f57d98b9bada tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 12:42:08.173298 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-21f01c51-8da7-43d7-af50-f57d98b9bada tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:08.195291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-21f01c51-8da7-43d7-af50-f57d98b9bada tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:08.195745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-21f01c51-8da7-43d7-af50-f57d98b9bada tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:08.373214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a39541fe-29f9-4cec-88ac-307e6b415241 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:08.382840 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a39541fe-29f9-4cec-88ac-307e6b415241 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1539 microversion: 2.1 time: 0.558267 Jul 25 12:42:08.385338 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 497/993] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:07 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1539 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:08.396406 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a695ab27-b088-4829-9372-d03121470f2d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcfa0e7e50>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:08.505723 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a695ab27-b088-4829-9372-d03121470f2d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c" status: 200 len: 1412 microversion: 2.1 time: 0.118741 Jul 25 12:42:08.506357 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 498/994] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:08 2022] GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c => generated 1412 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:08.510932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-84daf2d0-a9e4-43ed-8739-6ff778d44c2a tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Calling method '.version_select at 0x7efcfa5863a0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:08.632456 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-21f01c51-8da7-43d7-af50-f57d98b9bada tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?reservation_id=r-0y7iq1tj" status: 200 len: 2929 microversion: 2.1 time: 1.125240 Jul 25 12:42:08.634435 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 497/995] 10.222.0.49 () {58 vars in 1197 bytes} [Mon Jul 25 12:42:07 2022] GET /compute/v2.1/servers/detail?reservation_id=r-0y7iq1tj => generated 2929 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:08.651228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-20102064-d599-4b72-b83b-1e4e3dcfb6ac tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:08.652141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-20102064-d599-4b72-b83b-1e4e3dcfb6ac tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] [instance: d184a9e5-6927-4167-a72a-8537f979a0c1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:08.663338 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20102064-d599-4b72-b83b-1e4e3dcfb6ac tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:08.667439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20102064-d599-4b72-b83b-1e4e3dcfb6ac tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:08.673728 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20102064-d599-4b72-b83b-1e4e3dcfb6ac tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:08.675966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20102064-d599-4b72-b83b-1e4e3dcfb6ac tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:08.689990 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-84daf2d0-a9e4-43ed-8739-6ff778d44c2a tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/d430a160ce7540adb7466409c8265b85" status: 200 len: 371 microversion: 2.1 time: 0.181967 Jul 25 12:42:08.702878 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 499/996] 10.222.0.49 () {58 vars in 1242 bytes} [Mon Jul 25 12:42:08 2022] GET /compute/v2.1/os-quota-sets/d430a160ce7540adb7466409c8265b85 => generated 371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:08.718141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-05c5cbf6-c5a2-4193-8288-39eaa35bc4a2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:08.718141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-05c5cbf6-c5a2-4193-8288-39eaa35bc4a2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:08.749637 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05c5cbf6-c5a2-4193-8288-39eaa35bc4a2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:08.750380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05c5cbf6-c5a2-4193-8288-39eaa35bc4a2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:08.751399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05c5cbf6-c5a2-4193-8288-39eaa35bc4a2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:08.753138 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05c5cbf6-c5a2-4193-8288-39eaa35bc4a2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:09.181254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-20102064-d599-4b72-b83b-1e4e3dcfb6ac tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068cf3ae93ad4003b7a4bc580fae55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c04b18299cf48eeb27a4212724321c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:09.191503 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-20102064-d599-4b72-b83b-1e4e3dcfb6ac tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] 10.222.0.49 "GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1" status: 200 len: 1324 microversion: 2.1 time: 0.555213 Jul 25 12:42:09.196232 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 498/997] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:08 2022] GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1 => generated 1324 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:09.201203 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fc8ed8c0-5fee-401a-a94c-2455d5aca833 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:09.230638 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.compute.server_groups [None req-fc8ed8c0-5fee-401a-a94c-2455d5aca833 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Querying cell 44375b4d-91c4-48bf-9056-56d6e14223f5(cell1) for 2 instances {{(pid=125883) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 25 12:42:09.231502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fc8ed8c0-5fee-401a-a94c-2455d5aca833 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:09.231985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fc8ed8c0-5fee-401a-a94c-2455d5aca833 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:09.270487 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fc8ed8c0-5fee-401a-a94c-2455d5aca833 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups/4ed2b1d5-e7d3-4cb9-a903-29a884e9882c" status: 200 len: 269 microversion: 2.1 time: 0.073050 Jul 25 12:42:09.277019 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 499/998] 10.222.0.49 () {58 vars in 1263 bytes} [Mon Jul 25 12:42:09 2022] GET /compute/v2.1/os-server-groups/4ed2b1d5-e7d3-4cb9-a903-29a884e9882c => generated 269 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:09.282771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ea0e2012-7cb2-4a85-956f-9a30d67f29d1 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Action: 'update', calling method: .version_select at 0x7efcf991e670>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:09.407563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea0e2012-7cb2-4a85-956f-9a30d67f29d1 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:09.410762 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea0e2012-7cb2-4a85-956f-9a30d67f29d1 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:09.411735 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea0e2012-7cb2-4a85-956f-9a30d67f29d1 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:09.412270 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea0e2012-7cb2-4a85-956f-9a30d67f29d1 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:09.520000 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ea0e2012-7cb2-4a85-956f-9a30d67f29d1 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/d430a160ce7540adb7466409c8265b85" status: 200 len: 328 microversion: 2.1 time: 0.241585 Jul 25 12:42:09.521940 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 500/999] 10.222.0.49 () {60 vars in 1262 bytes} [Mon Jul 25 12:42:09 2022] PUT /compute/v2.1/os-quota-sets/d430a160ce7540adb7466409c8265b85 => generated 328 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:09.545982 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-f834a328-9749-462e-84be-dcdb210cba3d req-4a18875e-e3fa-49bb-b665-cb819dc427f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d184a9e5-6927-4167-a72a-8537f979a0c1", "tag": "cdbd1503-b93c-46e8-979d-0738c3bf516a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:09.596759 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-05c5cbf6-c5a2-4193-8288-39eaa35bc4a2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:09.612370 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-05c5cbf6-c5a2-4193-8288-39eaa35bc4a2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:09.614036 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-05c5cbf6-c5a2-4193-8288-39eaa35bc4a2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:09.615268 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-05c5cbf6-c5a2-4193-8288-39eaa35bc4a2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1810 microversion: 2.25 time: 0.911371 Jul 25 12:42:09.615849 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 500/1000] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:08 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1810 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:09.624466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-f834a328-9749-462e-84be-dcdb210cba3d req-4a18875e-e3fa-49bb-b665-cb819dc427f1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:09.625231 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-f834a328-9749-462e-84be-dcdb210cba3d req-4a18875e-e3fa-49bb-b665-cb819dc427f1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:09.670765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bb86de71-4c0f-456b-80b8-10ffd6a806af tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:09.672401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bb86de71-4c0f-456b-80b8-10ffd6a806af tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] [instance: 10a61568-b301-4b9e-82f9-160490f071d7] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:09.692426 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-f834a328-9749-462e-84be-dcdb210cba3d req-4a18875e-e3fa-49bb-b665-cb819dc427f1 service nova] Creating event network-changed:cdbd1503-b93c-46e8-979d-0738c3bf516a for instance d184a9e5-6927-4167-a72a-8537f979a0c1 on n-h2-848886-15 Jul 25 12:42:09.699125 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bb86de71-4c0f-456b-80b8-10ffd6a806af tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:09.708957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bb86de71-4c0f-456b-80b8-10ffd6a806af tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:09.710719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bb86de71-4c0f-456b-80b8-10ffd6a806af tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:09.712543 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bb86de71-4c0f-456b-80b8-10ffd6a806af tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:09.714438 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-f834a328-9749-462e-84be-dcdb210cba3d req-4a18875e-e3fa-49bb-b665-cb819dc427f1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191002 Jul 25 12:42:09.724136 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 501/1001] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:09.730473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3de25769-ca32-4f5d-b205-f884882ebbe6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:09.746364 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3de25769-ca32-4f5d-b205-f884882ebbe6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:09.764434 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3de25769-ca32-4f5d-b205-f884882ebbe6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:09.764898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3de25769-ca32-4f5d-b205-f884882ebbe6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:09.765716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3de25769-ca32-4f5d-b205-f884882ebbe6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:09.771176 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3de25769-ca32-4f5d-b205-f884882ebbe6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:09.814295 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:10.265419 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bb86de71-4c0f-456b-80b8-10ffd6a806af tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7" status: 200 len: 1621 microversion: 2.1 time: 0.636928 Jul 25 12:42:10.270828 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 501/1002] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:09 2022] GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7 => generated 1621 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:10.289946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-909cb2af-22f5-4d99-abaa-763ebd20ba58 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9d690d0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:10.294281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3de25769-ca32-4f5d-b205-f884882ebbe6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:10.303535 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3de25769-ca32-4f5d-b205-f884882ebbe6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1471 microversion: 2.1 time: 0.577235 Jul 25 12:42:10.307802 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 502/1003] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:09 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1471 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:10.324630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6bb83de1-6ab0-4fe7-9987-8fff8427e797 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1202885453", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:10.380028 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-909cb2af-22f5-4d99-abaa-763ebd20ba58 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c" status: 200 len: 1412 microversion: 2.1 time: 0.102170 Jul 25 12:42:10.380963 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 502/1004] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:10 2022] GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:10.389403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-957fc897-4210-44e2-8c46-8a9c1b930c89 req-d3bc3f0d-d2c4-407a-b3c3-335a9e1dcaed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a", "name": "network-vif-unplugged", "status": "completed", "tag": "4dc52859-0016-4f90-b755-bb756ddacc11"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:10.408138 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-957fc897-4210-44e2-8c46-8a9c1b930c89 req-d3bc3f0d-d2c4-407a-b3c3-335a9e1dcaed service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:10.408583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-957fc897-4210-44e2-8c46-8a9c1b930c89 req-d3bc3f0d-d2c4-407a-b3c3-335a9e1dcaed service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:10.425503 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-6bb83de1-6ab0-4fe7-9987-8fff8427e797 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] validate_networks() for None {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:42:10.443945 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-957fc897-4210-44e2-8c46-8a9c1b930c89 req-d3bc3f0d-d2c4-407a-b3c3-335a9e1dcaed service nova] Creating event network-vif-unplugged:4dc52859-0016-4f90-b755-bb756ddacc11 for instance e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a on n-h2-848886-15 Jul 25 12:42:10.452242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [req-957fc897-4210-44e2-8c46-8a9c1b930c89 req-d3bc3f0d-d2c4-407a-b3c3-335a9e1dcaed service nova] Instance e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-15'} {{(pid=125884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 12:42:10.459146 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-957fc897-4210-44e2-8c46-8a9c1b930c89 req-d3bc3f0d-d2c4-407a-b3c3-335a9e1dcaed service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076925 Jul 25 12:42:10.460166 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 503/1005] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:10.466405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-262b671d-6718-4d7d-9bd7-f9f5248cc56a tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:10.467535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-262b671d-6718-4d7d-9bd7-f9f5248cc56a tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] [instance: d184a9e5-6927-4167-a72a-8537f979a0c1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:10.474290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-262b671d-6718-4d7d-9bd7-f9f5248cc56a tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:10.474959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-262b671d-6718-4d7d-9bd7-f9f5248cc56a tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:10.475903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-262b671d-6718-4d7d-9bd7-f9f5248cc56a tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:10.476501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-262b671d-6718-4d7d-9bd7-f9f5248cc56a tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:10.840364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-262b671d-6718-4d7d-9bd7-f9f5248cc56a tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068cf3ae93ad4003b7a4bc580fae55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c04b18299cf48eeb27a4212724321c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:10.856304 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-262b671d-6718-4d7d-9bd7-f9f5248cc56a tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] 10.222.0.49 "GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1" status: 200 len: 1324 microversion: 2.1 time: 0.394653 Jul 25 12:42:10.856913 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 504/1006] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:10 2022] GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1 => generated 1324 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:10.865646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-885d6dc5-7725-477b-a2b5-6a5a9a067b90 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:10.866300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-885d6dc5-7725-477b-a2b5-6a5a9a067b90 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] [instance: dd308860-1e7f-4257-b285-3d2d3054d4ef] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:10.885096 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-885d6dc5-7725-477b-a2b5-6a5a9a067b90 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:10.885562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-885d6dc5-7725-477b-a2b5-6a5a9a067b90 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:10.886454 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-885d6dc5-7725-477b-a2b5-6a5a9a067b90 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:10.887066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-885d6dc5-7725-477b-a2b5-6a5a9a067b90 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:11.011779 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-6bb83de1-6ab0-4fe7-9987-8fff8427e797 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:42:11.012673 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-6bb83de1-6ab0-4fe7-9987-8fff8427e797 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:42:11.012673 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-6bb83de1-6ab0-4fe7-9987-8fff8427e797 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:42:11.013073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-6bb83de1-6ab0-4fe7-9987-8fff8427e797 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:42:11.013492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-6bb83de1-6ab0-4fe7-9987-8fff8427e797 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:42:11.040434 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6bb83de1-6ab0-4fe7-9987-8fff8427e797 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:11.040871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6bb83de1-6ab0-4fe7-9987-8fff8427e797 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:11.041679 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6bb83de1-6ab0-4fe7-9987-8fff8427e797 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:11.042142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6bb83de1-6ab0-4fe7-9987-8fff8427e797 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:11.117158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-6bb83de1-6ab0-4fe7-9987-8fff8427e797 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Getting quotas for project d430a160ce7540adb7466409c8265b85. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:42:11.156354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-6bb83de1-6ab0-4fe7-9987-8fff8427e797 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Getting quotas for user 2be52b1fc5894ea38544048fd867db30 and project d430a160ce7540adb7466409c8265b85. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:42:11.202529 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.utils [None req-6bb83de1-6ab0-4fe7-9987-8fff8427e797 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] instances quota exceeded for d430a160ce7540adb7466409c8265b85, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=125883) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 25 12:42:11.203104 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-6bb83de1-6ab0-4fe7-9987-8fff8427e797 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 25 12:42:11.205237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6bb83de1-6ab0-4fe7-9987-8fff8427e797 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Request method failure captured: Jul 25 12:42:11.205237 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 12:42:11.205237 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:42:11.205237 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:42:11.205237 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:42:11.205237 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 145 Jul 25 12:42:11.205237 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:42:11.205237 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:42:11.205237 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:42:11.205237 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:42:11.205237 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o-a6gqUjTaQhlDAR4iTtNSnUvKK1P_ptR5rHVxzv3ScdFYbJOamIAHe9aXg7Eq9ddtIc82smm7Y96CnKZH7U0jvx7QZTYwq_VQM1DX0ltlVj8ZH8Yd4rky9gSqD8Y3oO49FoY3nmqZP3M4ZatCOkiNbLMDJFNv8RFLyUV6hV9lOKek Jul 25 12:42:11.205237 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:42:11.205237 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:42:11.205237 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:42:11.205237 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:42:11.205237 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:42:11.205237 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:42:11.205237 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d430a160ce7540adb7466409c8265b85 Jul 25 12:42:11.205237 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-QuotasAdminNegativeTest-1713167850 Jul 25 12:42:11.205237 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:42:11.205237 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:42:11.206912 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d430a160ce7540adb7466409c8265b85", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d430a160ce7540adb7466409c8265b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d430a160ce7540adb7466409c8265b85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d430a160ce7540adb7466409c8265b85"}]}] Jul 25 12:42:11.206912 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-QuotasAdminNegativeTest-1713167850 Jul 25 12:42:11.206912 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d430a160ce7540adb7466409c8265b85 Jul 25 12:42:11.206912 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1713167850 Jul 25 12:42:11.206912 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-QuotasAdminNegativeTest-1713167850-project Jul 25 12:42:11.206912 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:42:11.206912 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:42:11.206912 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 2be52b1fc5894ea38544048fd867db30 Jul 25 12:42:11.206912 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-QuotasAdminNegativeTest-1713167850-project Jul 25 12:42:11.206912 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:42:11.206912 n-d-848886-15 devstack@n-api.service[125883]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1202885453", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} Jul 25 12:42:11.206912 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:42:11.207793 n-d-848886-15 devstack@n-api.service[125883]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 25 12:42:11.207793 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1202885453', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452'}}} Jul 25 12:42:11.207793 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:42:11.207793 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:11.207793 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 25 12:42:11.207793 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 25 12:42:11.207793 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:42:11.207793 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:42:11.207793 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 25 12:42:11.207793 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc Jul 25 12:42:11.207793 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 25 12:42:11.207793 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 25 12:42:11.207793 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:42:11.207793 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:42:11.207793 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 25 12:42:11.207793 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 25 12:42:11.207793 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 25 12:42:11.207793 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 25 12:42:11.209064 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 25 12:42:11.209064 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 25 12:42:11.209064 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 25 12:42:11.209064 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:11.209064 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:42:11.209064 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:11.209064 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:11.209064 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 12:42:11.209064 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 12:42:11.209064 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 12:42:11.209064 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 12:42:11.209064 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 25 12:42:11.209064 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 25 12:42:11.209064 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 25 12:42:11.209064 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 25 12:42:11.209064 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 25 12:42:11.209064 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 25 12:42:11.209064 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 25 12:42:11.209064 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:11.209064 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:42:11.209064 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:11.210674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:11.210674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:42:11.210674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:42:11.210674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:42:11.210674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:42:11.210674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:42:11.210674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:42:11.210674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:42:11.210674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:42:11.210674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:42:11.210674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:42:11.210674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:42:11.210674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:42:11.210674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 12:42:11.210674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 25 12:42:11.210674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 12:42:11.210674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 25 12:42:11.210674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:11.210674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:42:11.210674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:11.210674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:11.212181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:42:11.212181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:42:11.212181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:42:11.212181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:42:11.212181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 25 12:42:11.212181 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:11.212181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6bb83de1-6ab0-4fe7-9987-8fff8427e797 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:42:11.212181 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6bb83de1-6ab0-4fe7-9987-8fff8427e797 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.897623 Jul 25 12:42:11.212181 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 503/1007] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:42:10 2022] POST /compute/v2.1/servers => generated 119 bytes in 903 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:42:11.218828 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-419fe556-6915-47f2-9553-0640e6571f5b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:11.221971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-419fe556-6915-47f2-9553-0640e6571f5b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:11.235157 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-419fe556-6915-47f2-9553-0640e6571f5b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:11.235553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-419fe556-6915-47f2-9553-0640e6571f5b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:11.236411 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-419fe556-6915-47f2-9553-0640e6571f5b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:11.236852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-419fe556-6915-47f2-9553-0640e6571f5b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:11.241541 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-885d6dc5-7725-477b-a2b5-6a5a9a067b90 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/dd308860-1e7f-4257-b285-3d2d3054d4ef" status: 200 len: 1621 microversion: 2.1 time: 0.380371 Jul 25 12:42:11.242298 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 505/1008] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:10 2022] GET /compute/v2.1/servers/dd308860-1e7f-4257-b285-3d2d3054d4ef => generated 1621 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:11.255783 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f5b29881-dc9d-4c61-b626-975798b1095b tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Action: 'update', calling method: .version_select at 0x7efcf9d59280>, body: {"quota_set": {"instances": 10}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:11.543346 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5b29881-dc9d-4c61-b626-975798b1095b tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:11.543957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5b29881-dc9d-4c61-b626-975798b1095b tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:11.547173 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5b29881-dc9d-4c61-b626-975798b1095b tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:11.547361 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-419fe556-6915-47f2-9553-0640e6571f5b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:11.547832 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5b29881-dc9d-4c61-b626-975798b1095b tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:11.556537 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-419fe556-6915-47f2-9553-0640e6571f5b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:11.558318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-419fe556-6915-47f2-9553-0640e6571f5b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:11.559806 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-419fe556-6915-47f2-9553-0640e6571f5b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1810 microversion: 2.25 time: 0.344759 Jul 25 12:42:11.560541 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 504/1009] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:11 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1810 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:11.583395 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1906646d-4985-41f4-b3be-7a0ec09805ce tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:11.584586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1906646d-4985-41f4-b3be-7a0ec09805ce tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:11.591625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1906646d-4985-41f4-b3be-7a0ec09805ce tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:11.592274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1906646d-4985-41f4-b3be-7a0ec09805ce tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:11.593190 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1906646d-4985-41f4-b3be-7a0ec09805ce tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:11.593762 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1906646d-4985-41f4-b3be-7a0ec09805ce tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:11.670083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:11.713785 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f5b29881-dc9d-4c61-b626-975798b1095b tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/d430a160ce7540adb7466409c8265b85" status: 200 len: 329 microversion: 2.1 time: 0.467503 Jul 25 12:42:11.714971 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 506/1010] 10.222.0.49 () {60 vars in 1262 bytes} [Mon Jul 25 12:42:11 2022] PUT /compute/v2.1/os-quota-sets/d430a160ce7540adb7466409c8265b85 => generated 329 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:11.721723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ee94b253-a509-49a4-9f94-7ce7ea959690 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9d69c10>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:11.830845 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ee94b253-a509-49a4-9f94-7ce7ea959690 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c" status: 200 len: 1412 microversion: 2.1 time: 0.113968 Jul 25 12:42:11.832423 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 507/1011] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:11 2022] GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c => generated 1412 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:11.837254 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ed157340-313c-4faf-ad93-91ee752d2622 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-401662699", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "b2467ff1-7d17-43ae-811d-e37437b3b0ba"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:11.914811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1906646d-4985-41f4-b3be-7a0ec09805ce tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:11.926060 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1906646d-4985-41f4-b3be-7a0ec09805ce tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1468 microversion: 2.1 time: 0.349902 Jul 25 12:42:11.926782 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 505/1012] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:11 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1468 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:11.956311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-229b79a8-5994-4606-8f1e-99aad1511485 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Calling method '.version_select at 0x7efcf995b310>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:11.957841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-ed157340-313c-4faf-ad93-91ee752d2622 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] validate_networks() for None {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:42:12.453766 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-229b79a8-5994-4606-8f1e-99aad1511485 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/d430a160ce7540adb7466409c8265b85" status: 200 len: 371 microversion: 2.1 time: 0.506344 Jul 25 12:42:12.454373 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 506/1013] 10.222.0.49 () {58 vars in 1242 bytes} [Mon Jul 25 12:42:11 2022] GET /compute/v2.1/os-quota-sets/d430a160ce7540adb7466409c8265b85 => generated 371 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:12.475201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9a9800ac-85c5-4549-acb1-80c6fa15bd25 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:12.476625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9a9800ac-85c5-4549-acb1-80c6fa15bd25 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] [instance: d184a9e5-6927-4167-a72a-8537f979a0c1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:12.510603 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a9800ac-85c5-4549-acb1-80c6fa15bd25 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:12.511331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a9800ac-85c5-4549-acb1-80c6fa15bd25 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:12.512163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a9800ac-85c5-4549-acb1-80c6fa15bd25 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:12.512599 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a9800ac-85c5-4549-acb1-80c6fa15bd25 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:12.534160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ed157340-313c-4faf-ad93-91ee752d2622 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:42:12.534576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ed157340-313c-4faf-ad93-91ee752d2622 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:42:12.535048 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ed157340-313c-4faf-ad93-91ee752d2622 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:42:12.535627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ed157340-313c-4faf-ad93-91ee752d2622 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:42:12.536045 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ed157340-313c-4faf-ad93-91ee752d2622 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:42:12.566591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed157340-313c-4faf-ad93-91ee752d2622 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:12.567037 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed157340-313c-4faf-ad93-91ee752d2622 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:12.567959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed157340-313c-4faf-ad93-91ee752d2622 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:12.568398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed157340-313c-4faf-ad93-91ee752d2622 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:12.652742 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-ed157340-313c-4faf-ad93-91ee752d2622 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:42:12.679775 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-ed157340-313c-4faf-ad93-91ee752d2622 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for user 8c296447c2254c048f94bd9f186b0097 and project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:42:12.720610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ed157340-313c-4faf-ad93-91ee752d2622 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:42:12.728865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ed157340-313c-4faf-ad93-91ee752d2622 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: f7651c95-4705-42c3-8fc5-58644c0d8dc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:42:12.890976 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ed157340-313c-4faf-ad93-91ee752d2622 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.057350 Jul 25 12:42:12.903306 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 508/1014] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:42:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:42:12.915429 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fd20d364-9e1e-44a3-8561-b019c3825678 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:12.916021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fd20d364-9e1e-44a3-8561-b019c3825678 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:12.925668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9a9800ac-85c5-4549-acb1-80c6fa15bd25 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068cf3ae93ad4003b7a4bc580fae55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c04b18299cf48eeb27a4212724321c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:12.950774 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9a9800ac-85c5-4549-acb1-80c6fa15bd25 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] 10.222.0.49 "GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1" status: 200 len: 1324 microversion: 2.1 time: 0.479655 Jul 25 12:42:12.950975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd20d364-9e1e-44a3-8561-b019c3825678 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:12.951237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd20d364-9e1e-44a3-8561-b019c3825678 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:12.951368 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 507/1015] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:12 2022] GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1 => generated 1324 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:12.952014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd20d364-9e1e-44a3-8561-b019c3825678 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:12.952596 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd20d364-9e1e-44a3-8561-b019c3825678 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:12.967162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e0a60992-2cbf-485b-a952-a2af2900e3e2 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Action: 'update', calling method: .version_select at 0x7efcf9963550>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:13.036899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd20d364-9e1e-44a3-8561-b019c3825678 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:13.038070 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd20d364-9e1e-44a3-8561-b019c3825678 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:13.039059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd20d364-9e1e-44a3-8561-b019c3825678 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:13.039675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd20d364-9e1e-44a3-8561-b019c3825678 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:13.107691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-fd20d364-9e1e-44a3-8561-b019c3825678 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Getting quotas for project 5220cb7ebe7b4a89a8d1edabad2391a7. Resources: {'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:42:13.118255 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-fd20d364-9e1e-44a3-8561-b019c3825678 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Getting quotas for user 045d03491c1046609caffee111db48fc and project 5220cb7ebe7b4a89a8d1edabad2391a7. Resources: {'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:42:13.479487 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fd20d364-9e1e-44a3-8561-b019c3825678 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "POST /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a/action" status: 202 len: 0 microversion: 2.1 time: 0.573805 Jul 25 12:42:13.481310 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 509/1016] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:42:12 2022] POST /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:42:13.499253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-abd1661d-0072-4f89-880e-d9b2c55735f0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:13.501785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-abd1661d-0072-4f89-880e-d9b2c55735f0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:13.536798 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e0a60992-2cbf-485b-a952-a2af2900e3e2 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:13.537220 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-abd1661d-0072-4f89-880e-d9b2c55735f0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:13.537529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-abd1661d-0072-4f89-880e-d9b2c55735f0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:13.538984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e0a60992-2cbf-485b-a952-a2af2900e3e2 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:13.539923 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e0a60992-2cbf-485b-a952-a2af2900e3e2 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:13.540654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-abd1661d-0072-4f89-880e-d9b2c55735f0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:13.541100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-abd1661d-0072-4f89-880e-d9b2c55735f0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:13.541582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e0a60992-2cbf-485b-a952-a2af2900e3e2 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:13.643004 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e0a60992-2cbf-485b-a952-a2af2900e3e2 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/d430a160ce7540adb7466409c8265b85" status: 200 len: 325 microversion: 2.1 time: 0.671035 Jul 25 12:42:13.655070 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 508/1017] 10.222.0.49 () {60 vars in 1262 bytes} [Mon Jul 25 12:42:12 2022] PUT /compute/v2.1/os-quota-sets/d430a160ce7540adb7466409c8265b85 => generated 325 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:13.665556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-54c7c7c7-61e5-47bf-9f32-a475b9642624 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf97dc700>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:13.772649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-abd1661d-0072-4f89-880e-d9b2c55735f0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:13.783795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-abd1661d-0072-4f89-880e-d9b2c55735f0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:13.785550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-abd1661d-0072-4f89-880e-d9b2c55735f0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:13.787079 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-abd1661d-0072-4f89-880e-d9b2c55735f0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1810 microversion: 2.25 time: 0.302468 Jul 25 12:42:13.788391 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 510/1018] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:13 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1810 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:13.793050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-83e87d6e-39a9-4f12-bc9b-0d6275c305e5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:13.793675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-83e87d6e-39a9-4f12-bc9b-0d6275c305e5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: f7651c95-4705-42c3-8fc5-58644c0d8dc5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:13.881491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-83e87d6e-39a9-4f12-bc9b-0d6275c305e5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:13.897490 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-83e87d6e-39a9-4f12-bc9b-0d6275c305e5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5" status: 200 len: 1216 microversion: 2.1 time: 0.107714 Jul 25 12:42:13.909856 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 511/1019] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:13 2022] GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5 => generated 1216 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:13.909856 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-38922df7-3a31-4d5e-a9ef-1b0a84554261 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:13.909856 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-38922df7-3a31-4d5e-a9ef-1b0a84554261 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:13.927704 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38922df7-3a31-4d5e-a9ef-1b0a84554261 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:13.928372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38922df7-3a31-4d5e-a9ef-1b0a84554261 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:13.933801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38922df7-3a31-4d5e-a9ef-1b0a84554261 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:13.934407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38922df7-3a31-4d5e-a9ef-1b0a84554261 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:14.039076 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-54c7c7c7-61e5-47bf-9f32-a475b9642624 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c" status: 200 len: 1412 microversion: 2.1 time: 0.378891 Jul 25 12:42:14.039708 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 509/1020] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:13 2022] GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c => generated 1412 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:14.052667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1294ad1a-0bba-4cd2-b23a-d0d6a65a5408 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2023822153", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:14.201805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-1294ad1a-0bba-4cd2-b23a-d0d6a65a5408 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] validate_networks() for None {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:42:14.591066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-1294ad1a-0bba-4cd2-b23a-d0d6a65a5408 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:42:14.591066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-1294ad1a-0bba-4cd2-b23a-d0d6a65a5408 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:42:14.591066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-1294ad1a-0bba-4cd2-b23a-d0d6a65a5408 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:42:14.591066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-1294ad1a-0bba-4cd2-b23a-d0d6a65a5408 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:42:14.591066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-1294ad1a-0bba-4cd2-b23a-d0d6a65a5408 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:42:14.597277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1294ad1a-0bba-4cd2-b23a-d0d6a65a5408 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:14.598086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1294ad1a-0bba-4cd2-b23a-d0d6a65a5408 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:14.599375 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1294ad1a-0bba-4cd2-b23a-d0d6a65a5408 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:14.599827 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1294ad1a-0bba-4cd2-b23a-d0d6a65a5408 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:14.613886 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-38922df7-3a31-4d5e-a9ef-1b0a84554261 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:14.619046 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:14.627192 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-38922df7-3a31-4d5e-a9ef-1b0a84554261 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1467 microversion: 2.1 time: 0.727932 Jul 25 12:42:14.628324 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 512/1021] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:13 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1467 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:14.633663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-95ec54f3-da27-4ba4-af8c-05756eefc8c5 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:14.634598 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-95ec54f3-da27-4ba4-af8c-05756eefc8c5 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] [instance: d184a9e5-6927-4167-a72a-8537f979a0c1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:14.646058 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-1294ad1a-0bba-4cd2-b23a-d0d6a65a5408 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Getting quotas for project d430a160ce7540adb7466409c8265b85. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:42:14.651851 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-1294ad1a-0bba-4cd2-b23a-d0d6a65a5408 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Getting quotas for user 2be52b1fc5894ea38544048fd867db30 and project d430a160ce7540adb7466409c8265b85. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:42:14.660077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95ec54f3-da27-4ba4-af8c-05756eefc8c5 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:14.660933 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95ec54f3-da27-4ba4-af8c-05756eefc8c5 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:14.662077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95ec54f3-da27-4ba4-af8c-05756eefc8c5 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:14.662908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95ec54f3-da27-4ba4-af8c-05756eefc8c5 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:14.682592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.utils [None req-1294ad1a-0bba-4cd2-b23a-d0d6a65a5408 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] ram quota exceeded for d430a160ce7540adb7466409c8265b85, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=125883) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 25 12:42:14.683679 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-1294ad1a-0bba-4cd2-b23a-d0d6a65a5408 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 25 12:42:14.691690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1294ad1a-0bba-4cd2-b23a-d0d6a65a5408 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Request method failure captured: Jul 25 12:42:14.691690 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 12:42:14.691690 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:42:14.691690 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:42:14.691690 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:42:14.691690 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 145 Jul 25 12:42:14.691690 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:42:14.691690 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:42:14.691690 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:42:14.691690 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:42:14.691690 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o-a6gqUjTaQhlDAR4iTtNSnUvKK1P_ptR5rHVxzv3ScdFYbJOamIAHe9aXg7Eq9ddtIc82smm7Y96CnKZH7U0jvx7QZTYwq_VQM1DX0ltlVj8ZH8Yd4rky9gSqD8Y3oO49FoY3nmqZP3M4ZatCOkiNbLMDJFNv8RFLyUV6hV9lOKek Jul 25 12:42:14.691690 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:42:14.691690 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:42:14.691690 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:42:14.691690 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:42:14.691690 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:42:14.691690 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:42:14.691690 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d430a160ce7540adb7466409c8265b85 Jul 25 12:42:14.691690 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-QuotasAdminNegativeTest-1713167850 Jul 25 12:42:14.691690 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:42:14.691690 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:42:14.693098 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d430a160ce7540adb7466409c8265b85", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d430a160ce7540adb7466409c8265b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d430a160ce7540adb7466409c8265b85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d430a160ce7540adb7466409c8265b85"}]}] Jul 25 12:42:14.693098 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-QuotasAdminNegativeTest-1713167850 Jul 25 12:42:14.693098 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d430a160ce7540adb7466409c8265b85 Jul 25 12:42:14.693098 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1713167850 Jul 25 12:42:14.693098 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-QuotasAdminNegativeTest-1713167850-project Jul 25 12:42:14.693098 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:42:14.693098 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:42:14.693098 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 2be52b1fc5894ea38544048fd867db30 Jul 25 12:42:14.693098 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-QuotasAdminNegativeTest-1713167850-project Jul 25 12:42:14.693098 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:42:14.693098 n-d-848886-15 devstack@n-api.service[125883]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2023822153", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} Jul 25 12:42:14.693098 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:42:14.693875 n-d-848886-15 devstack@n-api.service[125883]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 25 12:42:14.693875 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2023822153', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452'}}} Jul 25 12:42:14.693875 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:42:14.693875 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:14.693875 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 25 12:42:14.693875 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 25 12:42:14.693875 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:42:14.693875 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:42:14.693875 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 25 12:42:14.693875 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc Jul 25 12:42:14.693875 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 25 12:42:14.693875 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 25 12:42:14.693875 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:42:14.693875 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:42:14.693875 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 25 12:42:14.693875 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 25 12:42:14.693875 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 25 12:42:14.693875 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 25 12:42:14.694981 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 25 12:42:14.694981 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 25 12:42:14.694981 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 25 12:42:14.694981 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:14.694981 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:42:14.694981 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:14.694981 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:14.694981 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 12:42:14.694981 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 12:42:14.694981 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 12:42:14.694981 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 12:42:14.694981 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 25 12:42:14.694981 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 25 12:42:14.694981 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 25 12:42:14.694981 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 25 12:42:14.694981 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 25 12:42:14.694981 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 25 12:42:14.694981 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 25 12:42:14.694981 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:14.694981 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:42:14.694981 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:14.696243 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:14.696243 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:42:14.696243 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:42:14.696243 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:42:14.696243 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:42:14.696243 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:42:14.696243 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:42:14.696243 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:42:14.696243 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:42:14.696243 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:42:14.696243 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:42:14.696243 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:42:14.696243 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:42:14.696243 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 12:42:14.696243 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 25 12:42:14.696243 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 12:42:14.696243 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 25 12:42:14.696243 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:14.696243 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:42:14.696243 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:14.696243 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:14.697475 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:42:14.697475 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:42:14.697475 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:42:14.697475 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:42:14.697475 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 25 12:42:14.697475 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:14.697475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1294ad1a-0bba-4cd2-b23a-d0d6a65a5408 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:42:14.697475 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1294ad1a-0bba-4cd2-b23a-d0d6a65a5408 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.654648 Jul 25 12:42:14.699510 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 510/1022] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:42:14 2022] POST /compute/v2.1/servers => generated 110 bytes in 658 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:42:14.710862 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f063fa8c-e689-4428-b29a-1a9a8f28ec58 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Action: 'update', calling method: .version_select at 0x7efcf995b670>, body: {"quota_set": {"ram": 51200}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:14.974132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f063fa8c-e689-4428-b29a-1a9a8f28ec58 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:14.975194 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f063fa8c-e689-4428-b29a-1a9a8f28ec58 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:14.976238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-95ec54f3-da27-4ba4-af8c-05756eefc8c5 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068cf3ae93ad4003b7a4bc580fae55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c04b18299cf48eeb27a4212724321c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:14.978277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f063fa8c-e689-4428-b29a-1a9a8f28ec58 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:14.979850 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f063fa8c-e689-4428-b29a-1a9a8f28ec58 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:14.985109 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-95ec54f3-da27-4ba4-af8c-05756eefc8c5 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] 10.222.0.49 "GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1" status: 200 len: 1324 microversion: 2.1 time: 0.355352 Jul 25 12:42:14.986358 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 513/1023] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:14 2022] GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1 => generated 1324 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:15.002649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3669608e-ff74-4596-8386-da9d2ac26092 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:15.003270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3669608e-ff74-4596-8386-da9d2ac26092 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:15.009782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3669608e-ff74-4596-8386-da9d2ac26092 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:15.010275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3669608e-ff74-4596-8386-da9d2ac26092 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:15.011059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3669608e-ff74-4596-8386-da9d2ac26092 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:15.011489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3669608e-ff74-4596-8386-da9d2ac26092 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:15.059093 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:15.060725 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f063fa8c-e689-4428-b29a-1a9a8f28ec58 tempest-QuotasAdminNegativeTest-1043787246 tempest-QuotasAdminNegativeTest-1043787246-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/d430a160ce7540adb7466409c8265b85" status: 200 len: 329 microversion: 2.1 time: 0.358183 Jul 25 12:42:15.061449 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 511/1024] 10.222.0.49 () {60 vars in 1262 bytes} [Mon Jul 25 12:42:14 2022] PUT /compute/v2.1/os-quota-sets/d430a160ce7540adb7466409c8265b85 => generated 329 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:42:15.069316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-276118fe-dfc1-4189-b45b-88d21eafc20d req-6e7889f9-29da-4239-ae02-5f2b74f75538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a", "name": "network-vif-plugged", "status": "completed", "tag": "4dc52859-0016-4f90-b755-bb756ddacc11"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:15.079369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-276118fe-dfc1-4189-b45b-88d21eafc20d req-6e7889f9-29da-4239-ae02-5f2b74f75538 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:15.080004 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-276118fe-dfc1-4189-b45b-88d21eafc20d req-6e7889f9-29da-4239-ae02-5f2b74f75538 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:15.106274 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-276118fe-dfc1-4189-b45b-88d21eafc20d req-6e7889f9-29da-4239-ae02-5f2b74f75538 service nova] Creating event network-vif-plugged:4dc52859-0016-4f90-b755-bb756ddacc11 for instance e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a on n-h2-848886-15 Jul 25 12:42:15.114080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [req-276118fe-dfc1-4189-b45b-88d21eafc20d req-6e7889f9-29da-4239-ae02-5f2b74f75538 service nova] Instance e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-15'} {{(pid=125883) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 12:42:15.121870 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-276118fe-dfc1-4189-b45b-88d21eafc20d req-6e7889f9-29da-4239-ae02-5f2b74f75538 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059103 Jul 25 12:42:15.128754 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 512/1025] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:15.135639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5428515a-a492-4221-baff-9a368394ec64 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:15.151009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5428515a-a492-4221-baff-9a368394ec64 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: f7651c95-4705-42c3-8fc5-58644c0d8dc5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:15.160180 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5428515a-a492-4221-baff-9a368394ec64 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:15.160720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5428515a-a492-4221-baff-9a368394ec64 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:15.161574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5428515a-a492-4221-baff-9a368394ec64 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:15.162147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5428515a-a492-4221-baff-9a368394ec64 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:15.233418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3669608e-ff74-4596-8386-da9d2ac26092 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:15.269503 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5428515a-a492-4221-baff-9a368394ec64 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:15.277396 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3669608e-ff74-4596-8386-da9d2ac26092 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:15.283365 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5428515a-a492-4221-baff-9a368394ec64 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5" status: 200 len: 1286 microversion: 2.1 time: 0.152839 Jul 25 12:42:15.283606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3669608e-ff74-4596-8386-da9d2ac26092 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:15.284894 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 513/1026] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:15 2022] GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5 => generated 1286 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:15.285361 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3669608e-ff74-4596-8386-da9d2ac26092 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1810 microversion: 2.25 time: 0.297590 Jul 25 12:42:15.286291 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 514/1027] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:14 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1810 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:15.294385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-af3fd26f-5bac-42a4-b057-1c6dc8a447a3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf97c1310>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:15.304431 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0eaa13c0-19fb-47f7-a9b3-23207eec2f73 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Action: 'update', calling method: .version_select at 0x7efcf9d0eee0>, body: {"quota_set": {"ram": 0}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:15.313020 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0eaa13c0-19fb-47f7-a9b3-23207eec2f73 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '2be52b1fc5894ea38544048fd867db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd430a160ce7540adb7466409c8265b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:15.316095 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0eaa13c0-19fb-47f7-a9b3-23207eec2f73 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Request method failure captured: Jul 25 12:42:15.316095 n-d-848886-15 devstack@n-api.service[125884]: request: PUT /compute/v2.1/os-quota-sets/d430a160ce7540adb7466409c8265b85 HTTP/1.1 Jul 25 12:42:15.316095 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:42:15.316095 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:42:15.316095 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:42:15.316095 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 25 Jul 25 12:42:15.316095 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:42:15.316095 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:42:15.316095 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:42:15.316095 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:42:15.316095 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o-a6gqUjTaQhlDAR4iTtNSnUvKK1P_ptR5rHVxzv3ScdFYbJOamIAHe9aXg7Eq9ddtIc82smm7Y96CnKZH7U0jvx7QZTYwq_VQM1DX0ltlVj8ZH8Yd4rky9gSqD8Y3oO49FoY3nmqZP3M4ZatCOkiNbLMDJFNv8RFLyUV6hV9lOKek Jul 25 12:42:15.316095 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:42:15.316095 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:42:15.316095 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:42:15.316095 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:42:15.316095 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:42:15.316095 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:42:15.316095 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d430a160ce7540adb7466409c8265b85 Jul 25 12:42:15.316095 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-QuotasAdminNegativeTest-1713167850 Jul 25 12:42:15.316095 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:42:15.316095 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:42:15.317721 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d430a160ce7540adb7466409c8265b85", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d430a160ce7540adb7466409c8265b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d430a160ce7540adb7466409c8265b85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d430a160ce7540adb7466409c8265b85"}]}] Jul 25 12:42:15.317721 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-QuotasAdminNegativeTest-1713167850 Jul 25 12:42:15.317721 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d430a160ce7540adb7466409c8265b85 Jul 25 12:42:15.317721 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1713167850 Jul 25 12:42:15.317721 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-QuotasAdminNegativeTest-1713167850-project Jul 25 12:42:15.317721 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:42:15.317721 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:42:15.317721 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 2be52b1fc5894ea38544048fd867db30 Jul 25 12:42:15.317721 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-QuotasAdminNegativeTest-1713167850-project Jul 25 12:42:15.317721 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:42:15.317721 n-d-848886-15 devstack@n-api.service[125884]: {"quota_set": {"ram": 0}} Jul 25 12:42:15.317721 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:42:15.317721 n-d-848886-15 devstack@n-api.service[125884]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 25 12:42:15.317721 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'd430a160ce7540adb7466409c8265b85', 'body': {'quota_set': {'ram': 0}}} Jul 25 12:42:15.318658 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:42:15.318658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:15.318658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:42:15.318658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:42:15.318658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:42:15.318658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:42:15.318658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:42:15.318658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:42:15.318658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:42:15.318658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:42:15.318658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:42:15.318658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:42:15.318658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 25 12:42:15.318658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 25 12:42:15.318658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 12:42:15.318658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:42:15.318658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 12:42:15.318658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:42:15.318658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 25 12:42:15.320146 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 25 12:42:15.320146 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:42:15.320146 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:42:15.320146 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:42:15.320146 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:42:15.320146 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:42:15.320146 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:42:15.320146 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:42:15.320146 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:42:15.320146 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:42:15.320146 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:42:15.320146 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:42:15.320146 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:42:15.320146 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:42:15.320146 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:42:15.320146 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 25 12:42:15.320146 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:42:15.320146 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:42:15.320146 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:42:15.320146 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:15.321671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:42:15.321671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:42:15.321671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:42:15.321671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:42:15.321671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 25 12:42:15.321671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:42:15.322443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0eaa13c0-19fb-47f7-a9b3-23207eec2f73 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:42:15.324067 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0eaa13c0-19fb-47f7-a9b3-23207eec2f73 tempest-QuotasAdminNegativeTest-1713167850 tempest-QuotasAdminNegativeTest-1713167850-project] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/d430a160ce7540adb7466409c8265b85" status: 403 len: 116 microversion: 2.1 time: 0.036531 Jul 25 12:42:15.325110 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 515/1028] 10.222.0.49 () {60 vars in 1262 bytes} [Mon Jul 25 12:42:15 2022] PUT /compute/v2.1/os-quota-sets/d430a160ce7540adb7466409c8265b85 => generated 116 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:42:15.365670 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-af3fd26f-5bac-42a4-b057-1c6dc8a447a3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c" status: 200 len: 1421 microversion: 2.1 time: 0.079192 Jul 25 12:42:15.366734 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 514/1029] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:15 2022] GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c => generated 1421 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:15.382360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1abac168-a974-4c66-ba0f-1ea68c876eff tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9cb3430>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:15.451983 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1abac168-a974-4c66-ba0f-1ea68c876eff tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c" status: 200 len: 1421 microversion: 2.1 time: 0.075701 Jul 25 12:42:15.460691 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 516/1030] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:15 2022] GET /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c => generated 1421 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:15.469781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-57b3cf54-2b87-4763-a819-b5e93a22f223 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf97f1dc0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:15.606034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-31a5b8db-84c9-4777-8d55-160a94c39802 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9ef4f70>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:15.661549 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-31a5b8db-84c9-4777-8d55-160a94c39802 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/9fc01346-3991-4ca8-a50a-080c71b19e48" status: 200 len: 661 microversion: 2.1 time: 0.060329 Jul 25 12:42:15.662402 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 517/1031] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:15 2022] GET /compute/v2.1/images/9fc01346-3991-4ca8-a50a-080c71b19e48 => generated 661 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:15.677105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-08ab17c3-1456-4e85-9102-3f4af360adc8 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:15.678445 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-08ab17c3-1456-4e85-9102-3f4af360adc8 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:15.686587 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-08ab17c3-1456-4e85-9102-3f4af360adc8 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:15.687417 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-08ab17c3-1456-4e85-9102-3f4af360adc8 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:15.688947 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-08ab17c3-1456-4e85-9102-3f4af360adc8 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:15.689669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-08ab17c3-1456-4e85-9102-3f4af360adc8 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:15.862814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-08ab17c3-1456-4e85-9102-3f4af360adc8 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:15.872119 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-08ab17c3-1456-4e85-9102-3f4af360adc8 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1467 microversion: 2.1 time: 0.200212 Jul 25 12:42:15.872912 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 518/1032] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:15 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1467 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:15.883392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ce2792e8-7219-4ba4-8008-572f6aa3545a tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9d0ea60>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:15.957216 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ce2792e8-7219-4ba4-8008-572f6aa3545a tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/9fc01346-3991-4ca8-a50a-080c71b19e48" status: 200 len: 661 microversion: 2.1 time: 0.082385 Jul 25 12:42:15.958091 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 519/1033] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:15 2022] GET /compute/v2.1/images/9fc01346-3991-4ca8-a50a-080c71b19e48 => generated 661 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:16.008251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dd142cf4-b3f1-4bde-b929-ca4dee21b10e tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:16.009291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dd142cf4-b3f1-4bde-b929-ca4dee21b10e tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] [instance: d184a9e5-6927-4167-a72a-8537f979a0c1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:16.018163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd142cf4-b3f1-4bde-b929-ca4dee21b10e tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:16.019363 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd142cf4-b3f1-4bde-b929-ca4dee21b10e tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:16.020418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd142cf4-b3f1-4bde-b929-ca4dee21b10e tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:16.021228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd142cf4-b3f1-4bde-b929-ca4dee21b10e tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:16.196897 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-57b3cf54-2b87-4763-a819-b5e93a22f223 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "DELETE /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c" status: 204 len: 0 microversion: 2.1 time: 0.734770 Jul 25 12:42:16.197559 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 515/1034] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:15 2022] DELETE /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c => generated 0 bytes in 736 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:42:16.206747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6068526f-30a5-4af7-a9c7-cad1dbdabded tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:16.207256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6068526f-30a5-4af7-a9c7-cad1dbdabded tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:16.215657 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6068526f-30a5-4af7-a9c7-cad1dbdabded tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:16.216204 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6068526f-30a5-4af7-a9c7-cad1dbdabded tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:16.217025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6068526f-30a5-4af7-a9c7-cad1dbdabded tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:16.217526 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6068526f-30a5-4af7-a9c7-cad1dbdabded tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:16.247000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6068526f-30a5-4af7-a9c7-cad1dbdabded tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:42:16.359531 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6068526f-30a5-4af7-a9c7-cad1dbdabded tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 204 len: 0 microversion: 2.1 time: 0.157154 Jul 25 12:42:16.361359 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 516/1035] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:42:16 2022] DELETE /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:42:16.366733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9c439403-fd53-486e-b5e8-b98bd703ffdf tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:16.368088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9c439403-fd53-486e-b5e8-b98bd703ffdf tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: f7651c95-4705-42c3-8fc5-58644c0d8dc5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:16.385253 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c439403-fd53-486e-b5e8-b98bd703ffdf tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:16.386120 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c439403-fd53-486e-b5e8-b98bd703ffdf tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:16.387730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c439403-fd53-486e-b5e8-b98bd703ffdf tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:16.388227 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c439403-fd53-486e-b5e8-b98bd703ffdf tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:16.462910 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dd142cf4-b3f1-4bde-b929-ca4dee21b10e tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068cf3ae93ad4003b7a4bc580fae55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c04b18299cf48eeb27a4212724321c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:16.471709 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dd142cf4-b3f1-4bde-b929-ca4dee21b10e tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] 10.222.0.49 "GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1" status: 200 len: 1324 microversion: 2.1 time: 0.469151 Jul 25 12:42:16.472393 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 520/1036] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:16 2022] GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1 => generated 1324 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:42:16.477564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ce9c31d0-5906-48cf-8737-fbab5c51a999 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:16.478216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ce9c31d0-5906-48cf-8737-fbab5c51a999 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:16.484161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ce9c31d0-5906-48cf-8737-fbab5c51a999 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:16.484800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ce9c31d0-5906-48cf-8737-fbab5c51a999 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:16.485876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ce9c31d0-5906-48cf-8737-fbab5c51a999 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:16.486665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ce9c31d0-5906-48cf-8737-fbab5c51a999 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:16.516545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9c439403-fd53-486e-b5e8-b98bd703ffdf tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:16.529461 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9c439403-fd53-486e-b5e8-b98bd703ffdf tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5" status: 200 len: 1274 microversion: 2.1 time: 0.166905 Jul 25 12:42:16.530545 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 517/1037] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:16 2022] GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5 => generated 1274 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:16.539219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-07aa7401-6463-40bd-b170-f7365ac3c45d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1760575837", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "e35876fc-c9c4-48b7-9074-6fd9241d1669"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:16.599340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-07aa7401-6463-40bd-b170-f7365ac3c45d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] validate_networks() for [('e35876fc-c9c4-48b7-9074-6fd9241d1669', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:42:17.095439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ce9c31d0-5906-48cf-8737-fbab5c51a999 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:17.108282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ce9c31d0-5906-48cf-8737-fbab5c51a999 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:17.110391 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ce9c31d0-5906-48cf-8737-fbab5c51a999 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:17.113748 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ce9c31d0-5906-48cf-8737-fbab5c51a999 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1810 microversion: 2.25 time: 0.640122 Jul 25 12:42:17.114347 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 521/1038] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:16 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1810 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:17.147365 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-49598332-6856-4c9b-b066-b2db276d4173 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:17.155585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-49598332-6856-4c9b-b066-b2db276d4173 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:17.162939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49598332-6856-4c9b-b066-b2db276d4173 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:17.164311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49598332-6856-4c9b-b066-b2db276d4173 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:17.178107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49598332-6856-4c9b-b066-b2db276d4173 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:17.178582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49598332-6856-4c9b-b066-b2db276d4173 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:17.519175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-49598332-6856-4c9b-b066-b2db276d4173 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:17.532706 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-49598332-6856-4c9b-b066-b2db276d4173 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1533 microversion: 2.1 time: 0.413762 Jul 25 12:42:17.533586 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 522/1039] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:17 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1533 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:17.554251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-3236c002-871b-4543-811d-8160eeeab412 req-33272373-f6fd-4933-a997-70a1ff20167b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d184a9e5-6927-4167-a72a-8537f979a0c1", "name": "network-vif-plugged", "status": "completed", "tag": "cdbd1503-b93c-46e8-979d-0738c3bf516a"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:17.577223 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3236c002-871b-4543-811d-8160eeeab412 req-33272373-f6fd-4933-a997-70a1ff20167b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:17.577916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3236c002-871b-4543-811d-8160eeeab412 req-33272373-f6fd-4933-a997-70a1ff20167b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:17.591577 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-3236c002-871b-4543-811d-8160eeeab412 req-33272373-f6fd-4933-a997-70a1ff20167b service nova] Creating event network-vif-plugged:cdbd1503-b93c-46e8-979d-0738c3bf516a for instance d184a9e5-6927-4167-a72a-8537f979a0c1 on n-h2-848886-15 Jul 25 12:42:17.598510 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-3236c002-871b-4543-811d-8160eeeab412 req-33272373-f6fd-4933-a997-70a1ff20167b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050872 Jul 25 12:42:17.602019 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 523/1040] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:17.613798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-232f7cb5-37cd-49ea-ab18-98e698afaa64 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:17.619933 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-232f7cb5-37cd-49ea-ab18-98e698afaa64 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:17.636376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-232f7cb5-37cd-49ea-ab18-98e698afaa64 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:17.639045 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-232f7cb5-37cd-49ea-ab18-98e698afaa64 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:17.640185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-232f7cb5-37cd-49ea-ab18-98e698afaa64 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:17.641000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-232f7cb5-37cd-49ea-ab18-98e698afaa64 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:17.953226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-07aa7401-6463-40bd-b170-f7365ac3c45d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:42:17.953824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-07aa7401-6463-40bd-b170-f7365ac3c45d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:42:17.954123 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-07aa7401-6463-40bd-b170-f7365ac3c45d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:42:17.954590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-07aa7401-6463-40bd-b170-f7365ac3c45d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:42:17.955188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-07aa7401-6463-40bd-b170-f7365ac3c45d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:42:17.965113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07aa7401-6463-40bd-b170-f7365ac3c45d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:17.965883 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07aa7401-6463-40bd-b170-f7365ac3c45d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:17.967506 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07aa7401-6463-40bd-b170-f7365ac3c45d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:17.968098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07aa7401-6463-40bd-b170-f7365ac3c45d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:17.988856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-07aa7401-6463-40bd-b170-f7365ac3c45d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Getting quotas for project 85c0dc3e0d894a5a95b1628cbd20df9f. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:42:17.999036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-07aa7401-6463-40bd-b170-f7365ac3c45d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Getting quotas for user 53f799c73ceb4c189329bc86056bc048 and project 85c0dc3e0d894a5a95b1628cbd20df9f. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:42:18.015639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-07aa7401-6463-40bd-b170-f7365ac3c45d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:42:18.019286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-07aa7401-6463-40bd-b170-f7365ac3c45d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c9c04c11-ce42-44b4-a6fd-7f7658a05292] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:42:18.089470 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-07aa7401-6463-40bd-b170-f7365ac3c45d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.554338 Jul 25 12:42:18.098046 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 518/1041] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:42:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:42:18.103647 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cb8a755d-68f4-47c1-8753-3bed1c430179 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:18.104486 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cb8a755d-68f4-47c1-8753-3bed1c430179 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] [instance: d184a9e5-6927-4167-a72a-8537f979a0c1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:18.112398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb8a755d-68f4-47c1-8753-3bed1c430179 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:18.113194 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb8a755d-68f4-47c1-8753-3bed1c430179 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:18.114178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb8a755d-68f4-47c1-8753-3bed1c430179 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:18.115324 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb8a755d-68f4-47c1-8753-3bed1c430179 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:18.172745 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-232f7cb5-37cd-49ea-ab18-98e698afaa64 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1813 microversion: 2.1 time: 0.565592 Jul 25 12:42:18.175517 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 524/1042] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:17 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1813 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:18.198413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b28d45b7-adef-4e1c-a56b-c3e5a9f68472 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:18.200063 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b28d45b7-adef-4e1c-a56b-c3e5a9f68472 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: f7651c95-4705-42c3-8fc5-58644c0d8dc5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:18.215460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b28d45b7-adef-4e1c-a56b-c3e5a9f68472 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:18.215923 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b28d45b7-adef-4e1c-a56b-c3e5a9f68472 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:18.216731 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b28d45b7-adef-4e1c-a56b-c3e5a9f68472 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:18.217174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b28d45b7-adef-4e1c-a56b-c3e5a9f68472 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:18.687715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b28d45b7-adef-4e1c-a56b-c3e5a9f68472 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:18.702721 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b28d45b7-adef-4e1c-a56b-c3e5a9f68472 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5" status: 200 len: 1316 microversion: 2.1 time: 0.523225 Jul 25 12:42:18.703189 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 525/1043] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:18 2022] GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5 => generated 1316 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:18.718558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9a4f8e28-8983-4277-b7de-defaa1b0e3e4 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9d35700>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:18.745612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cb8a755d-68f4-47c1-8753-3bed1c430179 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068cf3ae93ad4003b7a4bc580fae55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c04b18299cf48eeb27a4212724321c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:18.760669 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cb8a755d-68f4-47c1-8753-3bed1c430179 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] 10.222.0.49 "GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1" status: 200 len: 1324 microversion: 2.1 time: 0.658219 Jul 25 12:42:18.774652 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 519/1044] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:18 2022] GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1 => generated 1324 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:18.774652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e31420d4-6a8c-4876-9fb7-e8c67467a2cb tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:18.774652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e31420d4-6a8c-4876-9fb7-e8c67467a2cb tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c9c04c11-ce42-44b4-a6fd-7f7658a05292] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:18.775800 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9a4f8e28-8983-4277-b7de-defaa1b0e3e4 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/db4eca84-fc4e-45ed-80b0-8b171b7cda89" status: 200 len: 661 microversion: 2.1 time: 0.068946 Jul 25 12:42:18.775800 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 526/1045] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:18 2022] GET /compute/v2.1/images/db4eca84-fc4e-45ed-80b0-8b171b7cda89 => generated 661 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:18.781435 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-11cf5034-4de1-4f36-9ae3-3a6b00f33c0e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:18.782310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-11cf5034-4de1-4f36-9ae3-3a6b00f33c0e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:18.790465 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11cf5034-4de1-4f36-9ae3-3a6b00f33c0e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:18.791258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11cf5034-4de1-4f36-9ae3-3a6b00f33c0e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:18.792192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11cf5034-4de1-4f36-9ae3-3a6b00f33c0e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:18.792772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11cf5034-4de1-4f36-9ae3-3a6b00f33c0e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:18.963039 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e31420d4-6a8c-4876-9fb7-e8c67467a2cb tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:18.980819 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e31420d4-6a8c-4876-9fb7-e8c67467a2cb tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292" status: 200 len: 1208 microversion: 2.1 time: 0.218427 Jul 25 12:42:18.981411 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 520/1046] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:18 2022] GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292 => generated 1208 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:18.990695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f6bbc2e7-6739-429b-8fd9-f093ba280019 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:18.993375 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:42:18.993375 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:42:18.994634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f6bbc2e7-6739-429b-8fd9-f093ba280019 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:18.995080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f6bbc2e7-6739-429b-8fd9-f093ba280019 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:18.995883 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f6bbc2e7-6739-429b-8fd9-f093ba280019 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:18.996317 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f6bbc2e7-6739-429b-8fd9-f093ba280019 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:19.026990 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f6bbc2e7-6739-429b-8fd9-f093ba280019 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.042685 Jul 25 12:42:19.027614 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 521/1047] 10.222.0.49 () {58 vars in 1176 bytes} [Mon Jul 25 12:42:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:19.039031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-45dbf030-ce3c-41b4-871d-59c9f2136aa6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:19.039657 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-45dbf030-ce3c-41b4-871d-59c9f2136aa6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:19.046792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-45dbf030-ce3c-41b4-871d-59c9f2136aa6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:19.047250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-45dbf030-ce3c-41b4-871d-59c9f2136aa6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:19.048133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-45dbf030-ce3c-41b4-871d-59c9f2136aa6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:19.049129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-45dbf030-ce3c-41b4-871d-59c9f2136aa6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:19.210687 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-11cf5034-4de1-4f36-9ae3-3a6b00f33c0e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:19.233788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-11cf5034-4de1-4f36-9ae3-3a6b00f33c0e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:19.236961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-11cf5034-4de1-4f36-9ae3-3a6b00f33c0e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:19.238943 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-11cf5034-4de1-4f36-9ae3-3a6b00f33c0e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1810 microversion: 2.25 time: 0.461565 Jul 25 12:42:19.239761 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 527/1048] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:18 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1810 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:19.263679 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3f754ed8-7cf1-4a32-9cff-7beafbc18152 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9d64d30>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:19.318486 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3f754ed8-7cf1-4a32-9cff-7beafbc18152 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/db4eca84-fc4e-45ed-80b0-8b171b7cda89" status: 200 len: 661 microversion: 2.1 time: 0.060144 Jul 25 12:42:19.321965 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 528/1049] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:19 2022] GET /compute/v2.1/images/db4eca84-fc4e-45ed-80b0-8b171b7cda89 => generated 661 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:19.376732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-45dbf030-ce3c-41b4-871d-59c9f2136aa6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:19.384987 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-45dbf030-ce3c-41b4-871d-59c9f2136aa6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1533 microversion: 2.1 time: 0.349718 Jul 25 12:42:19.385930 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 522/1050] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:19 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1533 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:19.625205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-76789fb5-c5a7-4521-aae3-eb6011e576da req-a36a16f2-f357-436b-ac63-3c9b155c9339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b91c2f-a489-4adc-9090-7bd3f4d40e16", "name": "network-vif-deleted", "tag": "1db48820-05f4-4c09-bd03-4b5f5ea84c25"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:19.660914 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-76789fb5-c5a7-4521-aae3-eb6011e576da req-a36a16f2-f357-436b-ac63-3c9b155c9339 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:19.662702 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-76789fb5-c5a7-4521-aae3-eb6011e576da req-a36a16f2-f357-436b-ac63-3c9b155c9339 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:19.687793 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-76789fb5-c5a7-4521-aae3-eb6011e576da req-a36a16f2-f357-436b-ac63-3c9b155c9339 service nova] Creating event network-vif-deleted:1db48820-05f4-4c09-bd03-4b5f5ea84c25 for instance c2b91c2f-a489-4adc-9090-7bd3f4d40e16 on n-h1-848886-15 Jul 25 12:42:19.695534 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-76789fb5-c5a7-4521-aae3-eb6011e576da req-a36a16f2-f357-436b-ac63-3c9b155c9339 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081787 Jul 25 12:42:19.697043 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 529/1051] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:19.728173 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-44353459-9915-4089-9547-9dc4fb620922 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:19.729766 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-44353459-9915-4089-9547-9dc4fb620922 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: f7651c95-4705-42c3-8fc5-58644c0d8dc5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:19.755324 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-44353459-9915-4089-9547-9dc4fb620922 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:19.756340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-44353459-9915-4089-9547-9dc4fb620922 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:19.758559 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-44353459-9915-4089-9547-9dc4fb620922 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:19.759687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-44353459-9915-4089-9547-9dc4fb620922 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:19.810458 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c8a35edc-f779-45ae-8e6b-7135a7c47f3b tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:19.811311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c8a35edc-f779-45ae-8e6b-7135a7c47f3b tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] [instance: d184a9e5-6927-4167-a72a-8537f979a0c1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:19.824393 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c8a35edc-f779-45ae-8e6b-7135a7c47f3b tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:19.824862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c8a35edc-f779-45ae-8e6b-7135a7c47f3b tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:19.825665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c8a35edc-f779-45ae-8e6b-7135a7c47f3b tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:19.826132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c8a35edc-f779-45ae-8e6b-7135a7c47f3b tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:20.385597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c8a35edc-f779-45ae-8e6b-7135a7c47f3b tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068cf3ae93ad4003b7a4bc580fae55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c04b18299cf48eeb27a4212724321c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:20.403363 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c8a35edc-f779-45ae-8e6b-7135a7c47f3b tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] 10.222.0.49 "GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1" status: 200 len: 1324 microversion: 2.1 time: 0.612821 Jul 25 12:42:20.404067 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 530/1052] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:19 2022] GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1 => generated 1324 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:20.433995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3546c10c-83e1-4cae-8d12-ae0b3a097e22 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:20.434634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3546c10c-83e1-4cae-8d12-ae0b3a097e22 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c9c04c11-ce42-44b4-a6fd-7f7658a05292] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:20.450939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-44353459-9915-4089-9547-9dc4fb620922 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:20.464927 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-44353459-9915-4089-9547-9dc4fb620922 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5" status: 200 len: 1316 microversion: 2.1 time: 0.741310 Jul 25 12:42:20.468572 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3546c10c-83e1-4cae-8d12-ae0b3a097e22 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:20.468965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3546c10c-83e1-4cae-8d12-ae0b3a097e22 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:20.469757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3546c10c-83e1-4cae-8d12-ae0b3a097e22 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:20.470330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3546c10c-83e1-4cae-8d12-ae0b3a097e22 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:20.481648 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 523/1053] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:19 2022] GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5 => generated 1316 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:20.495603 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c08f8439-00ee-4d95-9696-56d8cd7befd7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:20.496217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c08f8439-00ee-4d95-9696-56d8cd7befd7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:20.512708 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c08f8439-00ee-4d95-9696-56d8cd7befd7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:20.513895 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c08f8439-00ee-4d95-9696-56d8cd7befd7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:20.515328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c08f8439-00ee-4d95-9696-56d8cd7befd7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:20.517051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c08f8439-00ee-4d95-9696-56d8cd7befd7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:20.837644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3546c10c-83e1-4cae-8d12-ae0b3a097e22 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:20.853423 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3546c10c-83e1-4cae-8d12-ae0b3a097e22 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292" status: 200 len: 1266 microversion: 2.1 time: 0.429024 Jul 25 12:42:20.855971 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 531/1054] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:20 2022] GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292 => generated 1266 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:20.871586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-70277aea-a6bf-46d6-b854-0adfb5a3347e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:20.872501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-70277aea-a6bf-46d6-b854-0adfb5a3347e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:20.905879 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70277aea-a6bf-46d6-b854-0adfb5a3347e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:20.906914 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70277aea-a6bf-46d6-b854-0adfb5a3347e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:20.908305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70277aea-a6bf-46d6-b854-0adfb5a3347e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:20.910063 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70277aea-a6bf-46d6-b854-0adfb5a3347e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:21.535133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c08f8439-00ee-4d95-9696-56d8cd7befd7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:21.544119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c08f8439-00ee-4d95-9696-56d8cd7befd7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:21.545707 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c08f8439-00ee-4d95-9696-56d8cd7befd7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:21.546914 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c08f8439-00ee-4d95-9696-56d8cd7befd7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1810 microversion: 2.25 time: 1.063229 Jul 25 12:42:21.547487 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 524/1055] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:20 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1810 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:21.612741 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-70277aea-a6bf-46d6-b854-0adfb5a3347e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:21.620739 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-70277aea-a6bf-46d6-b854-0adfb5a3347e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1526 microversion: 2.1 time: 0.761794 Jul 25 12:42:21.621593 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 532/1056] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:20 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1526 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:21.626561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e55dff2f-057c-4777-a5ce-da0955596406 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9cdca60>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:21.693339 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e55dff2f-057c-4777-a5ce-da0955596406 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/35a92216-909b-469f-94ec-278efa934030" status: 200 len: 661 microversion: 2.1 time: 0.070257 Jul 25 12:42:21.694740 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 533/1057] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:21 2022] GET /compute/v2.1/images/35a92216-909b-469f-94ec-278efa934030 => generated 661 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:21.711459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e4c3a9d3-642a-4dab-b608-7d92a523ea1c tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:21.712122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e4c3a9d3-642a-4dab-b608-7d92a523ea1c tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] [instance: d184a9e5-6927-4167-a72a-8537f979a0c1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:21.715388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f49812c2-eff7-4373-8bc5-d4983ace6c7f tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-758507808", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": "none"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:21.719053 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4c3a9d3-642a-4dab-b608-7d92a523ea1c tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:21.719514 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4c3a9d3-642a-4dab-b608-7d92a523ea1c tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:21.720476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4c3a9d3-642a-4dab-b608-7d92a523ea1c tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:21.720774 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4c3a9d3-642a-4dab-b608-7d92a523ea1c tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:21.810329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-f49812c2-eff7-4373-8bc5-d4983ace6c7f tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:42:21.810894 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-f49812c2-eff7-4373-8bc5-d4983ace6c7f tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:42:21.811553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-f49812c2-eff7-4373-8bc5-d4983ace6c7f tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:42:21.812055 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-f49812c2-eff7-4373-8bc5-d4983ace6c7f tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:42:21.812564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-f49812c2-eff7-4373-8bc5-d4983ace6c7f tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:42:21.825359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f49812c2-eff7-4373-8bc5-d4983ace6c7f tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:21.826057 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f49812c2-eff7-4373-8bc5-d4983ace6c7f tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:21.827222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f49812c2-eff7-4373-8bc5-d4983ace6c7f tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:21.827821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f49812c2-eff7-4373-8bc5-d4983ace6c7f tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:21.847775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-f49812c2-eff7-4373-8bc5-d4983ace6c7f tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Getting quotas for project 109279139d284b8b82da98c474a00dce. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:42:21.853111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-f49812c2-eff7-4373-8bc5-d4983ace6c7f tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Getting quotas for user eb5916ce611c47cda8d150daefa0f770 and project 109279139d284b8b82da98c474a00dce. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:42:21.865529 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f49812c2-eff7-4373-8bc5-d4983ace6c7f tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:42:21.867715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f49812c2-eff7-4373-8bc5-d4983ace6c7f tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:42:21.918399 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f49812c2-eff7-4373-8bc5-d4983ace6c7f tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.369684 Jul 25 12:42:21.919738 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 525/1058] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Jul 25 12:42:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 372 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 12:42:21.931415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-505a1667-4cf5-46ae-a532-2dc1f7d76d58 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:21.931828 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e4c3a9d3-642a-4dab-b608-7d92a523ea1c tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068cf3ae93ad4003b7a4bc580fae55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c04b18299cf48eeb27a4212724321c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:21.932114 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-505a1667-4cf5-46ae-a532-2dc1f7d76d58 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: f7651c95-4705-42c3-8fc5-58644c0d8dc5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:21.940784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-505a1667-4cf5-46ae-a532-2dc1f7d76d58 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:21.942180 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-505a1667-4cf5-46ae-a532-2dc1f7d76d58 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:21.942504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-505a1667-4cf5-46ae-a532-2dc1f7d76d58 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:21.943052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-505a1667-4cf5-46ae-a532-2dc1f7d76d58 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:21.957869 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e4c3a9d3-642a-4dab-b608-7d92a523ea1c tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] 10.222.0.49 "GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1" status: 200 len: 1521 microversion: 2.1 time: 0.252576 Jul 25 12:42:21.970485 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 534/1059] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:21 2022] GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:21.980982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8a81001c-7b88-4d5a-98e4-821a21c9f35c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:21.990863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8a81001c-7b88-4d5a-98e4-821a21c9f35c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:21.997307 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a81001c-7b88-4d5a-98e4-821a21c9f35c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:21.997752 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a81001c-7b88-4d5a-98e4-821a21c9f35c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:21.998569 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a81001c-7b88-4d5a-98e4-821a21c9f35c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:21.998999 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a81001c-7b88-4d5a-98e4-821a21c9f35c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:22.287512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-505a1667-4cf5-46ae-a532-2dc1f7d76d58 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:22.299183 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-505a1667-4cf5-46ae-a532-2dc1f7d76d58 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5" status: 200 len: 1316 microversion: 2.1 time: 0.376065 Jul 25 12:42:22.300153 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 526/1060] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:21 2022] GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5 => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:22.317627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0a65cf06-e532-491f-a7ca-557a9701d318 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf991e670>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:22.333889 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8a81001c-7b88-4d5a-98e4-821a21c9f35c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:22.343745 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8a81001c-7b88-4d5a-98e4-821a21c9f35c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1526 microversion: 2.1 time: 0.371646 Jul 25 12:42:22.349502 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 535/1061] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:21 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1526 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:22.357562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5c85c99f-bfe0-43c3-8d2e-e6833786350c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12d85cbc-6af6-43fe-ae92-3275db3daa0c", "device": "/dev/xvdb"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:22.362416 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5c85c99f-bfe0-43c3-8d2e-e6833786350c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:22.387710 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0a65cf06-e532-491f-a7ca-557a9701d318 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/35a92216-909b-469f-94ec-278efa934030" status: 200 len: 661 microversion: 2.1 time: 0.086585 Jul 25 12:42:22.399088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c85c99f-bfe0-43c3-8d2e-e6833786350c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:22.399837 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c85c99f-bfe0-43c3-8d2e-e6833786350c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:22.401861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c85c99f-bfe0-43c3-8d2e-e6833786350c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:22.402482 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c85c99f-bfe0-43c3-8d2e-e6833786350c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:22.405801 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 527/1062] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:22 2022] GET /compute/v2.1/images/35a92216-909b-469f-94ec-278efa934030 => generated 661 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:22.412732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-d71b106f-d6ae-4991-b8ff-ffd4d1b40020 req-bc744804-2c5e-4227-a6a0-261483bc572d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7651c95-4705-42c3-8fc5-58644c0d8dc5", "tag": "046ef6e8-f893-4e00-95e9-57298459c892"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:22.424905 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d71b106f-d6ae-4991-b8ff-ffd4d1b40020 req-bc744804-2c5e-4227-a6a0-261483bc572d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:22.425433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d71b106f-d6ae-4991-b8ff-ffd4d1b40020 req-bc744804-2c5e-4227-a6a0-261483bc572d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:22.442627 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-d71b106f-d6ae-4991-b8ff-ffd4d1b40020 req-bc744804-2c5e-4227-a6a0-261483bc572d service nova] Creating event network-changed:046ef6e8-f893-4e00-95e9-57298459c892 for instance f7651c95-4705-42c3-8fc5-58644c0d8dc5 on n-h2-848886-15 Jul 25 12:42:22.452173 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-d71b106f-d6ae-4991-b8ff-ffd4d1b40020 req-bc744804-2c5e-4227-a6a0-261483bc572d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044723 Jul 25 12:42:22.456705 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 528/1063] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:22.471424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f0475c66-2ab2-4936-b71d-4d673a7de439 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:22.472298 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f0475c66-2ab2-4936-b71d-4d673a7de439 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c9c04c11-ce42-44b4-a6fd-7f7658a05292] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:22.479422 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0475c66-2ab2-4936-b71d-4d673a7de439 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:22.480137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0475c66-2ab2-4936-b71d-4d673a7de439 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:22.481323 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0475c66-2ab2-4936-b71d-4d673a7de439 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:22.482040 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0475c66-2ab2-4936-b71d-4d673a7de439 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:22.487007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:22.818398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:22.841979 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5c85c99f-bfe0-43c3-8d2e-e6833786350c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "POST /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.490724 Jul 25 12:42:22.842725 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 536/1064] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Jul 25 12:42:22 2022] POST /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a/os-volume_attachments => generated 194 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:22.850476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f0475c66-2ab2-4936-b71d-4d673a7de439 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:22.859356 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f0475c66-2ab2-4936-b71d-4d673a7de439 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292" status: 200 len: 1308 microversion: 2.1 time: 0.401090 Jul 25 12:42:22.860043 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 529/1065] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:22 2022] GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292 => generated 1308 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:22.865301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-30f225e8-87d3-49b5-8046-37a78ad240cd tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:22.865955 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-30f225e8-87d3-49b5-8046-37a78ad240cd tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] [instance: d184a9e5-6927-4167-a72a-8537f979a0c1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:22.867518 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b663946a-542c-450e-a8d0-6f54aaadd531 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:22.872764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30f225e8-87d3-49b5-8046-37a78ad240cd tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:22.873605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30f225e8-87d3-49b5-8046-37a78ad240cd tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:22.874505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30f225e8-87d3-49b5-8046-37a78ad240cd tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:22.875042 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30f225e8-87d3-49b5-8046-37a78ad240cd tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:22.877469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b663946a-542c-450e-a8d0-6f54aaadd531 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:22.891031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b663946a-542c-450e-a8d0-6f54aaadd531 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:22.891490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b663946a-542c-450e-a8d0-6f54aaadd531 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:22.892340 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b663946a-542c-450e-a8d0-6f54aaadd531 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:22.892808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b663946a-542c-450e-a8d0-6f54aaadd531 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:22.912728 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-30f225e8-87d3-49b5-8046-37a78ad240cd tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] HTTP exception thrown: Action 999 not found Jul 25 12:42:22.914883 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-30f225e8-87d3-49b5-8046-37a78ad240cd tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Request method failure captured: Jul 25 12:42:22.914883 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1/os-instance-actions/999 HTTP/1.1 Jul 25 12:42:22.914883 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:42:22.914883 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:42:22.914883 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:42:22.914883 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:42:22.914883 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:42:22.914883 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:42:22.914883 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:42:22.914883 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:42:22.914883 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o-V0DrnJbYn3R2hJkvZNJU6NLMNRlvuXnxe8NPUr_cVhN3yIHhInGS6ZX3g8dTHT8N9yRO5UKeY3Z2pyJkCWWt6GGln9gHz9Tqc6_rjkGnwkabcgHJFZ094kj7hERHM5wd8UVgX3GSCB1h4H2_1ESFfvrAmrIfPnaI31jCKlHOXA1s Jul 25 12:42:22.914883 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:42:22.914883 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:42:22.914883 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:42:22.914883 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:42:22.914883 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:42:22.914883 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:42:22.914883 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 4c04b18299cf48eeb27a4212724321c1 Jul 25 12:42:22.914883 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1593642340 Jul 25 12:42:22.914883 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:42:22.914883 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:42:22.916231 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4c04b18299cf48eeb27a4212724321c1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4c04b18299cf48eeb27a4212724321c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c04b18299cf48eeb27a4212724321c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c04b18299cf48eeb27a4212724321c1"}]}] Jul 25 12:42:22.916231 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1593642340 Jul 25 12:42:22.916231 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 4c04b18299cf48eeb27a4212724321c1 Jul 25 12:42:22.916231 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1593642340 Jul 25 12:42:22.916231 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-InstanceActionsNegativeTestJSON-1593642340-project Jul 25 12:42:22.916231 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:42:22.916231 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:42:22.916231 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 068cf3ae93ad4003b7a4bc580fae55c1 Jul 25 12:42:22.916231 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1593642340-project Jul 25 12:42:22.916231 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:42:22.916231 n-d-848886-15 devstack@n-api.service[125883]: exception: Action 999 not found Jul 25 12:42:22.916231 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'server_id': 'd184a9e5-6927-4167-a72a-8537f979a0c1', 'id': '999'} Jul 25 12:42:22.916995 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:42:22.916995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:22.916995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:42:22.916995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:42:22.916995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:42:22.916995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:42:22.916995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:42:22.916995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:42:22.916995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 25 12:42:22.916995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 12:42:22.916995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 25 12:42:22.916995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:22.916995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:42:22.916995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:22.916995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:22.916995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:42:22.916995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:42:22.916995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:42:22.916995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:42:22.916995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 25 12:42:22.916995 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:22.919997 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-30f225e8-87d3-49b5-8046-37a78ad240cd tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Returning 404 to user: Action 999 not found {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:42:22.921352 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-30f225e8-87d3-49b5-8046-37a78ad240cd tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] 10.222.0.49 "GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.059627 Jul 25 12:42:22.923082 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 530/1066] 10.222.0.49 () {58 vars in 1308 bytes} [Mon Jul 25 12:42:22 2022] GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1/os-instance-actions/999 => generated 66 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:42:22.931809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-53339a6f-bce2-461d-9a0c-83dac376bb8d tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:22.932934 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:42:22.932934 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:42:22.941321 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-53339a6f-bce2-461d-9a0c-83dac376bb8d tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] HTTP exception thrown: Flavor 3d28811f-a317-4701-8a64-72af0acde626 could not be found. Jul 25 12:42:22.944132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-53339a6f-bce2-461d-9a0c-83dac376bb8d tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Request method failure captured: Jul 25 12:42:22.944132 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/flavors/3d28811f-a317-4701-8a64-72af0acde626 HTTP/1.1 Jul 25 12:42:22.944132 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:42:22.944132 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:42:22.944132 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:42:22.944132 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:42:22.944132 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:42:22.944132 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:42:22.944132 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:42:22.944132 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:42:22.944132 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7WZzfFFCTien9D8AGJlN5ZLX73WCepbz-9l4G_hpvAuHKXi7ixh3LjknbvsfLKnNQAvH6FrYL0UT1irN2gvTU-d-rhFPkVExN5s0wPokGp7reAgUr8L9UirqLQ_2BrVCncBjCf5EItq92_-q95FvLAXMOV75v0yVCMWssMJv1C4hA Jul 25 12:42:22.944132 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:42:22.944132 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:42:22.944132 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:42:22.944132 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:42:22.944132 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:42:22.944132 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:42:22.944132 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: bda37bacac5a405f86d02897dd9b0388 Jul 25 12:42:22.944132 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-MigrationsAdminTest-1913682051 Jul 25 12:42:22.944132 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:42:22.944132 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:42:22.945476 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bda37bacac5a405f86d02897dd9b0388", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bda37bacac5a405f86d02897dd9b0388"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bda37bacac5a405f86d02897dd9b0388"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bda37bacac5a405f86d02897dd9b0388"}]}] Jul 25 12:42:22.945476 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-MigrationsAdminTest-1913682051 Jul 25 12:42:22.945476 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: bda37bacac5a405f86d02897dd9b0388 Jul 25 12:42:22.945476 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-MigrationsAdminTest-1913682051 Jul 25 12:42:22.945476 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-MigrationsAdminTest-1913682051-project-admin Jul 25 12:42:22.945476 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:42:22.945476 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:42:22.945476 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: f1d6eca33052491a9601c2bd454dd5e7 Jul 25 12:42:22.945476 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-MigrationsAdminTest-1913682051-project-admin Jul 25 12:42:22.945476 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:42:22.945476 n-d-848886-15 devstack@n-api.service[125883]: exception: Flavor 3d28811f-a317-4701-8a64-72af0acde626 could not be found. Jul 25 12:42:22.945476 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '3d28811f-a317-4701-8a64-72af0acde626'} Jul 25 12:42:22.946653 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:42:22.946653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:22.946653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 25 12:42:22.946653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 25 12:42:22.946653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 12:42:22.946653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 12:42:22.946653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 25 12:42:22.946653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 25 12:42:22.946653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 25 12:42:22.946653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 25 12:42:22.946653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:42:22.946653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:42:22.946653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 25 12:42:22.946653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 25 12:42:22.946653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 3d28811f-a317-4701-8a64-72af0acde626 could not be found. Jul 25 12:42:22.946653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:22.946653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:42:22.946653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:22.946653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:22.946653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:42:22.947884 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:42:22.947884 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:42:22.947884 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:42:22.947884 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:42:22.947884 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:42:22.947884 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 25 12:42:22.947884 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:42:22.947884 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 3d28811f-a317-4701-8a64-72af0acde626 could not be found. Jul 25 12:42:22.947884 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:22.947884 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:42:22.947884 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:22.947884 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:22.947884 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:42:22.947884 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:42:22.947884 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:42:22.947884 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:42:22.947884 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 3d28811f-a317-4701-8a64-72af0acde626 could not be found. Jul 25 12:42:22.947884 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:22.950850 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-53339a6f-bce2-461d-9a0c-83dac376bb8d tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Returning 404 to user: Flavor 3d28811f-a317-4701-8a64-72af0acde626 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:42:22.951846 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-53339a6f-bce2-461d-9a0c-83dac376bb8d tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/3d28811f-a317-4701-8a64-72af0acde626" status: 404 len: 109 microversion: 2.1 time: 0.027596 Jul 25 12:42:22.966370 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 531/1067] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:42:22 2022] DELETE /compute/v2.1/flavors/3d28811f-a317-4701-8a64-72af0acde626 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:42:22.975072 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-6879ab83-5801-4ac4-b8b1-e24502f6eda9 req-f7ccbde5-1ef8-4eb1-b9d5-6a3aaadcc086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a", "name": "network-vif-plugged", "status": "completed", "tag": "4dc52859-0016-4f90-b755-bb756ddacc11"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:22.980801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-6879ab83-5801-4ac4-b8b1-e24502f6eda9 req-f7ccbde5-1ef8-4eb1-b9d5-6a3aaadcc086 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:22.981248 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-6879ab83-5801-4ac4-b8b1-e24502f6eda9 req-f7ccbde5-1ef8-4eb1-b9d5-6a3aaadcc086 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:22.993670 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-6879ab83-5801-4ac4-b8b1-e24502f6eda9 req-f7ccbde5-1ef8-4eb1-b9d5-6a3aaadcc086 service nova] Creating event network-vif-plugged:4dc52859-0016-4f90-b755-bb756ddacc11 for instance e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a on n-h2-848886-15 Jul 25 12:42:22.999557 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-6879ab83-5801-4ac4-b8b1-e24502f6eda9 req-f7ccbde5-1ef8-4eb1-b9d5-6a3aaadcc086 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041605 Jul 25 12:42:23.000389 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 532/1068] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:23.008365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0c6a6942-5a8a-4b6a-bffc-2588fca35b17 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:23.009433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0c6a6942-5a8a-4b6a-bffc-2588fca35b17 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:23.019025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c6a6942-5a8a-4b6a-bffc-2588fca35b17 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:23.019701 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c6a6942-5a8a-4b6a-bffc-2588fca35b17 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:23.020862 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c6a6942-5a8a-4b6a-bffc-2588fca35b17 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:23.021575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c6a6942-5a8a-4b6a-bffc-2588fca35b17 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:23.075219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=11 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:23.263031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b663946a-542c-450e-a8d0-6f54aaadd531 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:23.272750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b663946a-542c-450e-a8d0-6f54aaadd531 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:23.275475 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b663946a-542c-450e-a8d0-6f54aaadd531 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:23.282301 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b663946a-542c-450e-a8d0-6f54aaadd531 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "PUT /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1410 microversion: 2.75 time: 0.437583 Jul 25 12:42:23.283340 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 537/1069] 10.222.0.49 () {62 vars in 1297 bytes} [Mon Jul 25 12:42:22 2022] PUT /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1410 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:23.288505 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5b0dfff9-2f47-452e-8e1e-f0701fb44980 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2003919298", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:23.360708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-5b0dfff9-2f47-452e-8e1e-f0701fb44980 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] validate_networks() for None {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:42:23.472974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0c6a6942-5a8a-4b6a-bffc-2588fca35b17 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:23.482437 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0c6a6942-5a8a-4b6a-bffc-2588fca35b17 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:23.484108 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0c6a6942-5a8a-4b6a-bffc-2588fca35b17 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:23.485402 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0c6a6942-5a8a-4b6a-bffc-2588fca35b17 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1810 microversion: 2.25 time: 0.483650 Jul 25 12:42:23.486094 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 533/1070] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:23 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1810 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:23.491754 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ea115c54-9eec-4db0-827e-666df5f7ade3 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Calling method '.version_select at 0x7efcf9739e50>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:23.492613 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ea115c54-9eec-4db0-827e-666df5f7ade3 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] [instance: 6eeea114-b4b5-4d42-9b9e-4e0f218636f6] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:23.502589 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-ea115c54-9eec-4db0-827e-666df5f7ade3 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] HTTP exception thrown: Instance 6eeea114-b4b5-4d42-9b9e-4e0f218636f6 could not be found. Jul 25 12:42:23.504464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ea115c54-9eec-4db0-827e-666df5f7ade3 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Request method failure captured: Jul 25 12:42:23.504464 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/6eeea114-b4b5-4d42-9b9e-4e0f218636f6/os-instance-actions HTTP/1.1 Jul 25 12:42:23.504464 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:42:23.504464 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:42:23.504464 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:42:23.504464 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:42:23.504464 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:42:23.504464 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:42:23.504464 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:42:23.504464 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:42:23.504464 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o-V0DrnJbYn3R2hJkvZNJU6NLMNRlvuXnxe8NPUr_cVhN3yIHhInGS6ZX3g8dTHT8N9yRO5UKeY3Z2pyJkCWWt6GGln9gHz9Tqc6_rjkGnwkabcgHJFZ094kj7hERHM5wd8UVgX3GSCB1h4H2_1ESFfvrAmrIfPnaI31jCKlHOXA1s Jul 25 12:42:23.504464 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:42:23.504464 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:42:23.504464 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:42:23.504464 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:42:23.504464 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:42:23.504464 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:42:23.504464 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 4c04b18299cf48eeb27a4212724321c1 Jul 25 12:42:23.504464 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1593642340 Jul 25 12:42:23.504464 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:42:23.504464 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:42:23.506085 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4c04b18299cf48eeb27a4212724321c1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4c04b18299cf48eeb27a4212724321c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c04b18299cf48eeb27a4212724321c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c04b18299cf48eeb27a4212724321c1"}]}] Jul 25 12:42:23.506085 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1593642340 Jul 25 12:42:23.506085 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 4c04b18299cf48eeb27a4212724321c1 Jul 25 12:42:23.506085 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1593642340 Jul 25 12:42:23.506085 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-InstanceActionsNegativeTestJSON-1593642340-project Jul 25 12:42:23.506085 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:42:23.506085 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:42:23.506085 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 068cf3ae93ad4003b7a4bc580fae55c1 Jul 25 12:42:23.506085 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1593642340-project Jul 25 12:42:23.506085 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:42:23.506085 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 6eeea114-b4b5-4d42-9b9e-4e0f218636f6 could not be found. Jul 25 12:42:23.506085 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'server_id': '6eeea114-b4b5-4d42-9b9e-4e0f218636f6'} Jul 25 12:42:23.506952 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:42:23.506952 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:23.506952 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:42:23.506952 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:42:23.506952 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:42:23.506952 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:42:23.506952 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 12:42:23.506952 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 12:42:23.506952 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eeea114-b4b5-4d42-9b9e-4e0f218636f6 could not be found. Jul 25 12:42:23.506952 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:23.506952 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:42:23.506952 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:23.506952 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:23.506952 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:42:23.506952 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:42:23.506952 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:42:23.506952 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:42:23.506952 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:42:23.506952 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:42:23.506952 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:42:23.508279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:42:23.508279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 25 12:42:23.508279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 25 12:42:23.508279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:42:23.508279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:42:23.508279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 25 12:42:23.508279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 25 12:42:23.508279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:42:23.508279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:42:23.508279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eeea114-b4b5-4d42-9b9e-4e0f218636f6 could not be found. Jul 25 12:42:23.508279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:23.508279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:42:23.508279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:23.508279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:23.508279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:42:23.508279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:42:23.508279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:42:23.508279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:42:23.508279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eeea114-b4b5-4d42-9b9e-4e0f218636f6 could not be found. Jul 25 12:42:23.508279 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:42:23.510859 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ea115c54-9eec-4db0-827e-666df5f7ade3 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Returning 404 to user: Instance 6eeea114-b4b5-4d42-9b9e-4e0f218636f6 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:42:23.512316 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ea115c54-9eec-4db0-827e-666df5f7ade3 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] 10.222.0.49 "GET /compute/v2.1/servers/6eeea114-b4b5-4d42-9b9e-4e0f218636f6/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.024583 Jul 25 12:42:23.512543 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 534/1071] 10.222.0.49 () {58 vars in 1296 bytes} [Mon Jul 25 12:42:23 2022] GET /compute/v2.1/servers/6eeea114-b4b5-4d42-9b9e-4e0f218636f6/os-instance-actions => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:42:23.519913 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a66d5649-2251-4487-bac1-8d78873e3579 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1789476217", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:23.605172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-a66d5649-2251-4487-bac1-8d78873e3579 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] validate_networks() for None {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:42:23.772736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-5b0dfff9-2f47-452e-8e1e-f0701fb44980 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:42:23.774474 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-5b0dfff9-2f47-452e-8e1e-f0701fb44980 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:42:23.775553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-5b0dfff9-2f47-452e-8e1e-f0701fb44980 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:42:23.776166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-5b0dfff9-2f47-452e-8e1e-f0701fb44980 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:42:23.778339 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-5b0dfff9-2f47-452e-8e1e-f0701fb44980 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:42:23.788847 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=41 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:23.792467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b0dfff9-2f47-452e-8e1e-f0701fb44980 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:23.792989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b0dfff9-2f47-452e-8e1e-f0701fb44980 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:23.793885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b0dfff9-2f47-452e-8e1e-f0701fb44980 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:23.794706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b0dfff9-2f47-452e-8e1e-f0701fb44980 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:23.813445 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-5b0dfff9-2f47-452e-8e1e-f0701fb44980 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Getting quotas for project 29e28b1b4184471694b4dc157e452e93. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:42:23.819223 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-5b0dfff9-2f47-452e-8e1e-f0701fb44980 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Getting quotas for user bbb37368bd444de3848966e7ff6def09 and project 29e28b1b4184471694b4dc157e452e93. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:42:23.835310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5b0dfff9-2f47-452e-8e1e-f0701fb44980 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:42:23.837875 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5b0dfff9-2f47-452e-8e1e-f0701fb44980 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: 159b5add-9666-4a2a-82e7-7571a120cabb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:42:23.892013 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5b0dfff9-2f47-452e-8e1e-f0701fb44980 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607166 Jul 25 12:42:23.892894 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 538/1072] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:42:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:42:23.904740 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-84bd08b9-e60f-4ef5-9515-49a61c31a9b5 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:23.905504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-84bd08b9-e60f-4ef5-9515-49a61c31a9b5 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:23.908437 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:23.915396 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-a66d5649-2251-4487-bac1-8d78873e3579 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:42:23.915972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84bd08b9-e60f-4ef5-9515-49a61c31a9b5 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:23.916078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-a66d5649-2251-4487-bac1-8d78873e3579 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:42:23.916166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84bd08b9-e60f-4ef5-9515-49a61c31a9b5 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:23.916659 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84bd08b9-e60f-4ef5-9515-49a61c31a9b5 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:23.916855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-a66d5649-2251-4487-bac1-8d78873e3579 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:42:23.917092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84bd08b9-e60f-4ef5-9515-49a61c31a9b5 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:23.917447 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-a66d5649-2251-4487-bac1-8d78873e3579 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:42:23.918211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-a66d5649-2251-4487-bac1-8d78873e3579 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:42:23.932102 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a66d5649-2251-4487-bac1-8d78873e3579 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:23.932827 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a66d5649-2251-4487-bac1-8d78873e3579 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:23.937242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a66d5649-2251-4487-bac1-8d78873e3579 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:23.939702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a66d5649-2251-4487-bac1-8d78873e3579 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:23.969898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-a66d5649-2251-4487-bac1-8d78873e3579 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Getting quotas for project 5220cb7ebe7b4a89a8d1edabad2391a7. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:42:23.979227 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-a66d5649-2251-4487-bac1-8d78873e3579 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Getting quotas for user 045d03491c1046609caffee111db48fc and project 5220cb7ebe7b4a89a8d1edabad2391a7. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:42:23.998455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a66d5649-2251-4487-bac1-8d78873e3579 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:42:24.000505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a66d5649-2251-4487-bac1-8d78873e3579 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:42:24.021594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-84bd08b9-e60f-4ef5-9515-49a61c31a9b5 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:24.031368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-84bd08b9-e60f-4ef5-9515-49a61c31a9b5 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:24.036062 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-84bd08b9-e60f-4ef5-9515-49a61c31a9b5 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:24.048329 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-84bd08b9-e60f-4ef5-9515-49a61c31a9b5 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1416 microversion: 2.75 time: 0.148505 Jul 25 12:42:24.048910 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 539/1073] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:23 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:24.074135 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3f8af4eb-97e7-4573-94fe-43f9007f5500 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:24.074726 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a66d5649-2251-4487-bac1-8d78873e3579 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560816 Jul 25 12:42:24.074847 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3f8af4eb-97e7-4573-94fe-43f9007f5500 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: f7651c95-4705-42c3-8fc5-58644c0d8dc5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:24.075377 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 535/1074] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:42:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:42:24.081177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-24b5d75e-0476-401b-be83-46d36cbc9db6 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:24.081861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-24b5d75e-0476-401b-be83-46d36cbc9db6 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] [instance: d184a9e5-6927-4167-a72a-8537f979a0c1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:24.090316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f8af4eb-97e7-4573-94fe-43f9007f5500 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:24.090548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-24b5d75e-0476-401b-be83-46d36cbc9db6 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:24.090779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f8af4eb-97e7-4573-94fe-43f9007f5500 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:24.091349 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-24b5d75e-0476-401b-be83-46d36cbc9db6 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:24.093573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f8af4eb-97e7-4573-94fe-43f9007f5500 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:24.094061 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f8af4eb-97e7-4573-94fe-43f9007f5500 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:24.098872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-24b5d75e-0476-401b-be83-46d36cbc9db6 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:24.100200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-24b5d75e-0476-401b-be83-46d36cbc9db6 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:24.158540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-24b5d75e-0476-401b-be83-46d36cbc9db6 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] [instance: d184a9e5-6927-4167-a72a-8537f979a0c1] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:42:24.249173 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:24.283617 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-24b5d75e-0476-401b-be83-46d36cbc9db6 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1" status: 204 len: 0 microversion: 2.1 time: 0.205125 Jul 25 12:42:24.290212 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 536/1075] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:42:24 2022] DELETE /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:42:24.290799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3f8af4eb-97e7-4573-94fe-43f9007f5500 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:24.300076 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3f8af4eb-97e7-4573-94fe-43f9007f5500 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5" status: 200 len: 1316 microversion: 2.1 time: 0.250061 Jul 25 12:42:24.301396 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 540/1076] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:24 2022] GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5 => generated 1316 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:24.303983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e78e5d8e-2b80-48c3-867f-b624180c2b31 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:24.304754 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e78e5d8e-2b80-48c3-867f-b624180c2b31 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c9c04c11-ce42-44b4-a6fd-7f7658a05292] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:24.306621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-44fc618d-ae1e-4455-911d-c7fb984e80ec tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-959669771", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:24.319830 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e78e5d8e-2b80-48c3-867f-b624180c2b31 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:24.320333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e78e5d8e-2b80-48c3-867f-b624180c2b31 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:24.321481 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e78e5d8e-2b80-48c3-867f-b624180c2b31 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:24.322642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e78e5d8e-2b80-48c3-867f-b624180c2b31 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:24.374832 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-44fc618d-ae1e-4455-911d-c7fb984e80ec tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] validate_networks() for None {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:42:24.735484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e78e5d8e-2b80-48c3-867f-b624180c2b31 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:24.748303 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e78e5d8e-2b80-48c3-867f-b624180c2b31 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292" status: 200 len: 1308 microversion: 2.1 time: 0.456725 Jul 25 12:42:24.749100 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 537/1077] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:24 2022] GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292 => generated 1308 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:24.768985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2cc14f23-79fe-42ed-ab48-319026b91b8f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:24.770688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2cc14f23-79fe-42ed-ab48-319026b91b8f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:24.884723 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2cc14f23-79fe-42ed-ab48-319026b91b8f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:24.892338 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2cc14f23-79fe-42ed-ab48-319026b91b8f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1213 microversion: 2.1 time: 0.142287 Jul 25 12:42:24.902582 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 538/1078] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:24 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1213 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:24.912922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-66b82887-4b77-495e-98de-b189d00d5bca tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:24.913546 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-66b82887-4b77-495e-98de-b189d00d5bca tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] [instance: d184a9e5-6927-4167-a72a-8537f979a0c1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:24.920489 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66b82887-4b77-495e-98de-b189d00d5bca tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:24.921625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66b82887-4b77-495e-98de-b189d00d5bca tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:24.922627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66b82887-4b77-495e-98de-b189d00d5bca tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:24.923350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66b82887-4b77-495e-98de-b189d00d5bca tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:25.027690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-44fc618d-ae1e-4455-911d-c7fb984e80ec tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:42:25.028797 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-44fc618d-ae1e-4455-911d-c7fb984e80ec tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:42:25.029610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-44fc618d-ae1e-4455-911d-c7fb984e80ec tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:42:25.030667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-44fc618d-ae1e-4455-911d-c7fb984e80ec tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:42:25.031378 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-44fc618d-ae1e-4455-911d-c7fb984e80ec tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:42:25.042052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44fc618d-ae1e-4455-911d-c7fb984e80ec tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:25.043023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44fc618d-ae1e-4455-911d-c7fb984e80ec tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:25.045205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44fc618d-ae1e-4455-911d-c7fb984e80ec tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:25.058072 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44fc618d-ae1e-4455-911d-c7fb984e80ec tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:25.085254 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-44fc618d-ae1e-4455-911d-c7fb984e80ec tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Getting quotas for project 29e28b1b4184471694b4dc157e452e93. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:42:25.099382 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-44fc618d-ae1e-4455-911d-c7fb984e80ec tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Getting quotas for user bbb37368bd444de3848966e7ff6def09 and project 29e28b1b4184471694b4dc157e452e93. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:42:25.126815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-44fc618d-ae1e-4455-911d-c7fb984e80ec tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:42:25.129503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-44fc618d-ae1e-4455-911d-c7fb984e80ec tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:42:25.173474 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-66b82887-4b77-495e-98de-b189d00d5bca tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068cf3ae93ad4003b7a4bc580fae55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c04b18299cf48eeb27a4212724321c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:25.181280 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-44fc618d-ae1e-4455-911d-c7fb984e80ec tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.878407 Jul 25 12:42:25.182581 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 541/1079] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:42:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:42:25.188008 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fb6992d8-9d4e-4b76-b62b-414e26b88530 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:25.188945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fb6992d8-9d4e-4b76-b62b-414e26b88530 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:25.195787 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb6992d8-9d4e-4b76-b62b-414e26b88530 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:25.196526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb6992d8-9d4e-4b76-b62b-414e26b88530 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:25.197094 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-66b82887-4b77-495e-98de-b189d00d5bca tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] 10.222.0.49 "GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1" status: 200 len: 1527 microversion: 2.1 time: 0.289498 Jul 25 12:42:25.197752 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb6992d8-9d4e-4b76-b62b-414e26b88530 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:25.198399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb6992d8-9d4e-4b76-b62b-414e26b88530 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:25.204494 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 539/1080] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:24 2022] GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1 => generated 1527 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:25.225430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-9e40010b-8035-4957-806d-2f80b58dfefe req-12652769-4edf-45cb-a0fa-0148665726ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9c04c11-ce42-44b4-a6fd-7f7658a05292", "tag": "3844a30a-3f07-4f1e-9005-38e3c53d311a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:25.247362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-9e40010b-8035-4957-806d-2f80b58dfefe req-12652769-4edf-45cb-a0fa-0148665726ed service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:25.250760 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-9e40010b-8035-4957-806d-2f80b58dfefe req-12652769-4edf-45cb-a0fa-0148665726ed service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:25.276757 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-9e40010b-8035-4957-806d-2f80b58dfefe req-12652769-4edf-45cb-a0fa-0148665726ed service nova] Creating event network-changed:3844a30a-3f07-4f1e-9005-38e3c53d311a for instance c9c04c11-ce42-44b4-a6fd-7f7658a05292 on n-h1-848886-15 Jul 25 12:42:25.283286 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-9e40010b-8035-4957-806d-2f80b58dfefe req-12652769-4edf-45cb-a0fa-0148665726ed service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076984 Jul 25 12:42:25.283986 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 540/1081] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:25.290271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5c2620ab-1e4c-4029-9414-62b45d901a07 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:25.291337 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5c2620ab-1e4c-4029-9414-62b45d901a07 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:25.298486 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c2620ab-1e4c-4029-9414-62b45d901a07 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:25.299222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c2620ab-1e4c-4029-9414-62b45d901a07 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:25.300168 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c2620ab-1e4c-4029-9414-62b45d901a07 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:25.300753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c2620ab-1e4c-4029-9414-62b45d901a07 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:25.459077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5c2620ab-1e4c-4029-9414-62b45d901a07 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:25.460662 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fb6992d8-9d4e-4b76-b62b-414e26b88530 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:25.468775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5c2620ab-1e4c-4029-9414-62b45d901a07 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:25.470482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5c2620ab-1e4c-4029-9414-62b45d901a07 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:25.474744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fb6992d8-9d4e-4b76-b62b-414e26b88530 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:25.476329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fb6992d8-9d4e-4b76-b62b-414e26b88530 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:25.477649 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5c2620ab-1e4c-4029-9414-62b45d901a07 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1416 microversion: 2.75 time: 0.192003 Jul 25 12:42:25.478884 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 541/1082] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:25 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1416 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:25.483788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-16279368-2e9c-44ab-9ea4-4f3d2f088e88 req-f24d7fd2-8044-44af-9207-2f0ba8473410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c18f0b76-5dab-4e09-afb8-8a1de682b042", "name": "network-vif-unplugged", "status": "completed", "tag": "b5d54db2-13f2-41e6-b4fa-4d037fc2e51e"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:25.495245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-16279368-2e9c-44ab-9ea4-4f3d2f088e88 req-f24d7fd2-8044-44af-9207-2f0ba8473410 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:25.495851 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-16279368-2e9c-44ab-9ea4-4f3d2f088e88 req-f24d7fd2-8044-44af-9207-2f0ba8473410 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:25.496648 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fb6992d8-9d4e-4b76-b62b-414e26b88530 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1810 microversion: 2.25 time: 0.293668 Jul 25 12:42:25.497305 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 542/1083] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:25 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1810 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:25.503802 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3196232c-f94b-43ac-b1de-d5af786b687c tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:25.504405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3196232c-f94b-43ac-b1de-d5af786b687c tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:25.527386 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-16279368-2e9c-44ab-9ea4-4f3d2f088e88 req-f24d7fd2-8044-44af-9207-2f0ba8473410 service nova] Creating event network-vif-unplugged:b5d54db2-13f2-41e6-b4fa-4d037fc2e51e for instance c18f0b76-5dab-4e09-afb8-8a1de682b042 on n-h1-848886-15 Jul 25 12:42:25.535477 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-16279368-2e9c-44ab-9ea4-4f3d2f088e88 req-f24d7fd2-8044-44af-9207-2f0ba8473410 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054531 Jul 25 12:42:25.536665 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 542/1084] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:25.542863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-86a7e691-0a8b-43b2-b62a-41d5ecc0809e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:25.543708 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-86a7e691-0a8b-43b2-b62a-41d5ecc0809e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: f7651c95-4705-42c3-8fc5-58644c0d8dc5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:25.567365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86a7e691-0a8b-43b2-b62a-41d5ecc0809e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:25.567846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86a7e691-0a8b-43b2-b62a-41d5ecc0809e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:25.568929 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86a7e691-0a8b-43b2-b62a-41d5ecc0809e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:25.570591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86a7e691-0a8b-43b2-b62a-41d5ecc0809e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:25.630274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3196232c-f94b-43ac-b1de-d5af786b687c tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:25.640033 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3196232c-f94b-43ac-b1de-d5af786b687c tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1217 microversion: 2.1 time: 0.141630 Jul 25 12:42:25.641155 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 543/1085] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:25 2022] GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1217 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:25.785929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b5fe7483-a085-4737-af38-7a0a0e568e29 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:25.786781 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b5fe7483-a085-4737-af38-7a0a0e568e29 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c9c04c11-ce42-44b4-a6fd-7f7658a05292] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:25.806149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5fe7483-a085-4737-af38-7a0a0e568e29 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:25.806585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5fe7483-a085-4737-af38-7a0a0e568e29 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:25.807386 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5fe7483-a085-4737-af38-7a0a0e568e29 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:25.807810 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5fe7483-a085-4737-af38-7a0a0e568e29 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:25.838274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-86a7e691-0a8b-43b2-b62a-41d5ecc0809e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:25.846450 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-86a7e691-0a8b-43b2-b62a-41d5ecc0809e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5" status: 200 len: 1316 microversion: 2.1 time: 0.308480 Jul 25 12:42:25.847048 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 543/1086] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:25 2022] GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5 => generated 1316 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:25.923400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a590edbe-c563-4cde-9880-106f14bf2001 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:25.924079 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a590edbe-c563-4cde-9880-106f14bf2001 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:25.939202 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a590edbe-c563-4cde-9880-106f14bf2001 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:25.939749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a590edbe-c563-4cde-9880-106f14bf2001 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:25.940566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a590edbe-c563-4cde-9880-106f14bf2001 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:25.941000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a590edbe-c563-4cde-9880-106f14bf2001 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:26.077548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a590edbe-c563-4cde-9880-106f14bf2001 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:26.090264 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a590edbe-c563-4cde-9880-106f14bf2001 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1217 microversion: 2.1 time: 0.166769 Jul 25 12:42:26.091160 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 544/1087] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:25 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:42:26.223491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cbab4152-3882-4ff4-a30c-7c2616ae8a81 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:26.224114 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cbab4152-3882-4ff4-a30c-7c2616ae8a81 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] [instance: d184a9e5-6927-4167-a72a-8537f979a0c1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:26.233431 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cbab4152-3882-4ff4-a30c-7c2616ae8a81 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:26.233892 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cbab4152-3882-4ff4-a30c-7c2616ae8a81 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:26.234701 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cbab4152-3882-4ff4-a30c-7c2616ae8a81 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:26.235127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cbab4152-3882-4ff4-a30c-7c2616ae8a81 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:26.300829 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b5fe7483-a085-4737-af38-7a0a0e568e29 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:26.318409 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b5fe7483-a085-4737-af38-7a0a0e568e29 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292" status: 200 len: 1308 microversion: 2.1 time: 0.537416 Jul 25 12:42:26.325203 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 544/1088] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:25 2022] GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292 => generated 1308 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:26.506228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6f3f08db-c58d-4d3f-8667-8200d3cb8a62 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:26.506920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6f3f08db-c58d-4d3f-8667-8200d3cb8a62 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:26.524246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6f3f08db-c58d-4d3f-8667-8200d3cb8a62 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:26.524793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6f3f08db-c58d-4d3f-8667-8200d3cb8a62 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:26.528210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6f3f08db-c58d-4d3f-8667-8200d3cb8a62 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:26.529481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6f3f08db-c58d-4d3f-8667-8200d3cb8a62 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:26.697346 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6f3f08db-c58d-4d3f-8667-8200d3cb8a62 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:26.702948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cbab4152-3882-4ff4-a30c-7c2616ae8a81 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068cf3ae93ad4003b7a4bc580fae55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c04b18299cf48eeb27a4212724321c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:26.708708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6f3f08db-c58d-4d3f-8667-8200d3cb8a62 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:26.712865 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cbab4152-3882-4ff4-a30c-7c2616ae8a81 tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] 10.222.0.49 "GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1" status: 200 len: 1527 microversion: 2.1 time: 0.493067 Jul 25 12:42:26.714181 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 545/1089] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:26 2022] GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1 => generated 1527 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:26.722770 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6f3f08db-c58d-4d3f-8667-8200d3cb8a62 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:26.728903 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6f3f08db-c58d-4d3f-8667-8200d3cb8a62 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1437 microversion: 2.75 time: 0.228430 Jul 25 12:42:26.730092 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 545/1090] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:26 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1437 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:42:26.730476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2fd772b7-76b1-4d7b-b8a2-646d19333835 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:26.731193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2fd772b7-76b1-4d7b-b8a2-646d19333835 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:26.738275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-01f56a33-2552-4a7a-98de-76eb7ecbcf0b tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:26.742184 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-01f56a33-2552-4a7a-98de-76eb7ecbcf0b tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:26.742840 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fd772b7-76b1-4d7b-b8a2-646d19333835 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:26.743292 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fd772b7-76b1-4d7b-b8a2-646d19333835 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:26.744073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fd772b7-76b1-4d7b-b8a2-646d19333835 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:26.744528 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fd772b7-76b1-4d7b-b8a2-646d19333835 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:26.757415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01f56a33-2552-4a7a-98de-76eb7ecbcf0b tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:26.758217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01f56a33-2552-4a7a-98de-76eb7ecbcf0b tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:26.759374 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01f56a33-2552-4a7a-98de-76eb7ecbcf0b tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:26.759719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01f56a33-2552-4a7a-98de-76eb7ecbcf0b tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:26.923579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-01f56a33-2552-4a7a-98de-76eb7ecbcf0b tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:26.934701 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-01f56a33-2552-4a7a-98de-76eb7ecbcf0b tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1269 microversion: 2.1 time: 0.203176 Jul 25 12:42:26.935590 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 546/1091] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:26 2022] GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1269 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:26.949922 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d22f45aa-df90-4512-80a8-ff3eeafca021 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "97beeed7-7564-4203-abda-feef7e93cd98"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:26.953561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d22f45aa-df90-4512-80a8-ff3eeafca021 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:26.968391 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d22f45aa-df90-4512-80a8-ff3eeafca021 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:26.969242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d22f45aa-df90-4512-80a8-ff3eeafca021 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:26.972595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d22f45aa-df90-4512-80a8-ff3eeafca021 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:26.973200 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d22f45aa-df90-4512-80a8-ff3eeafca021 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:27.032637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2fd772b7-76b1-4d7b-b8a2-646d19333835 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:27.057127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2fd772b7-76b1-4d7b-b8a2-646d19333835 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:27.063899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2fd772b7-76b1-4d7b-b8a2-646d19333835 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:27.065170 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2fd772b7-76b1-4d7b-b8a2-646d19333835 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1810 microversion: 2.25 time: 0.349899 Jul 25 12:42:27.074262 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 546/1092] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:26 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1810 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:27.079553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4ab8b6e7-6785-4c59-8b18-f258462e33ee tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:27.081226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4ab8b6e7-6785-4c59-8b18-f258462e33ee tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: f7651c95-4705-42c3-8fc5-58644c0d8dc5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:27.096882 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ab8b6e7-6785-4c59-8b18-f258462e33ee tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:27.098205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ab8b6e7-6785-4c59-8b18-f258462e33ee tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:27.101806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ab8b6e7-6785-4c59-8b18-f258462e33ee tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:27.106816 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ab8b6e7-6785-4c59-8b18-f258462e33ee tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:27.129273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d22f45aa-df90-4512-80a8-ff3eeafca021 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:42:27.129735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d22f45aa-df90-4512-80a8-ff3eeafca021 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:42:27.130287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d22f45aa-df90-4512-80a8-ff3eeafca021 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:42:27.130699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d22f45aa-df90-4512-80a8-ff3eeafca021 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:42:27.131116 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d22f45aa-df90-4512-80a8-ff3eeafca021 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:42:27.270004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d22f45aa-df90-4512-80a8-ff3eeafca021 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:27.288437 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d22f45aa-df90-4512-80a8-ff3eeafca021 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:27.289120 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d22f45aa-df90-4512-80a8-ff3eeafca021 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:27.290206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d22f45aa-df90-4512-80a8-ff3eeafca021 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:27.290887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d22f45aa-df90-4512-80a8-ff3eeafca021 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:27.449026 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d22f45aa-df90-4512-80a8-ff3eeafca021 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:27.464607 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d22f45aa-df90-4512-80a8-ff3eeafca021 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:27.466399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d22f45aa-df90-4512-80a8-ff3eeafca021 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:27.482151 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d22f45aa-df90-4512-80a8-ff3eeafca021 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "POST /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec/action" status: 202 len: 1494 microversion: 2.75 time: 0.544140 Jul 25 12:42:27.482782 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 547/1093] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Jul 25 12:42:26 2022] POST /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec/action => generated 1494 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 12:42:27.500960 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-78d8f92d-5023-4c12-973a-a7a0457e836e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:27.504285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-78d8f92d-5023-4c12-973a-a7a0457e836e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:27.504903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4ab8b6e7-6785-4c59-8b18-f258462e33ee tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:27.513902 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-78d8f92d-5023-4c12-973a-a7a0457e836e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:27.518435 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4ab8b6e7-6785-4c59-8b18-f258462e33ee tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5" status: 200 len: 1316 microversion: 2.1 time: 0.441651 Jul 25 12:42:27.519105 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 547/1094] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:27 2022] GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5 => generated 1316 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:27.531763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-78d8f92d-5023-4c12-973a-a7a0457e836e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:27.535272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c26a0970-62f7-470a-b34f-154ec23fae0a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:27.536086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c26a0970-62f7-470a-b34f-154ec23fae0a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c9c04c11-ce42-44b4-a6fd-7f7658a05292] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:27.540627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-78d8f92d-5023-4c12-973a-a7a0457e836e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:27.541490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-78d8f92d-5023-4c12-973a-a7a0457e836e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:27.550194 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c26a0970-62f7-470a-b34f-154ec23fae0a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:27.550658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c26a0970-62f7-470a-b34f-154ec23fae0a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:27.551469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c26a0970-62f7-470a-b34f-154ec23fae0a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:27.551907 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c26a0970-62f7-470a-b34f-154ec23fae0a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:27.709300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-78d8f92d-5023-4c12-973a-a7a0457e836e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:27.721295 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-78d8f92d-5023-4c12-973a-a7a0457e836e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1273 microversion: 2.1 time: 0.234478 Jul 25 12:42:27.721940 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 548/1095] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:27 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1273 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:27.735874 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0deba701-b25b-4f9e-ac53-b9ec523904b8 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:27.737106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0deba701-b25b-4f9e-ac53-b9ec523904b8 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:27.752582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0deba701-b25b-4f9e-ac53-b9ec523904b8 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:27.753300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0deba701-b25b-4f9e-ac53-b9ec523904b8 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:27.754536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0deba701-b25b-4f9e-ac53-b9ec523904b8 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:27.757348 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0deba701-b25b-4f9e-ac53-b9ec523904b8 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:28.420772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0deba701-b25b-4f9e-ac53-b9ec523904b8 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:28.431480 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0deba701-b25b-4f9e-ac53-b9ec523904b8 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:28.437620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0deba701-b25b-4f9e-ac53-b9ec523904b8 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:28.449905 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0deba701-b25b-4f9e-ac53-b9ec523904b8 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1446 microversion: 2.75 time: 0.726845 Jul 25 12:42:28.457290 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 549/1096] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:27 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1446 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:28.462393 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-658d2b57-4cb1-4e91-bf7e-c0419f04a6cc req-21b155b4-41cd-42bb-b43c-093e110ccbd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c18f0b76-5dab-4e09-afb8-8a1de682b042", "tag": "b5d54db2-13f2-41e6-b4fa-4d037fc2e51e"}, {"server_uuid": "d184a9e5-6927-4167-a72a-8537f979a0c1", "name": "network-vif-deleted", "tag": "cdbd1503-b93c-46e8-979d-0738c3bf516a"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:28.489671 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-658d2b57-4cb1-4e91-bf7e-c0419f04a6cc req-21b155b4-41cd-42bb-b43c-093e110ccbd9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:28.490214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-658d2b57-4cb1-4e91-bf7e-c0419f04a6cc req-21b155b4-41cd-42bb-b43c-093e110ccbd9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:28.517927 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-658d2b57-4cb1-4e91-bf7e-c0419f04a6cc req-21b155b4-41cd-42bb-b43c-093e110ccbd9 service nova] Creating event network-changed:b5d54db2-13f2-41e6-b4fa-4d037fc2e51e for instance c18f0b76-5dab-4e09-afb8-8a1de682b042 on n-h1-848886-15 Jul 25 12:42:28.518528 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-658d2b57-4cb1-4e91-bf7e-c0419f04a6cc req-21b155b4-41cd-42bb-b43c-093e110ccbd9 service nova] Creating event network-vif-deleted:cdbd1503-b93c-46e8-979d-0738c3bf516a for instance d184a9e5-6927-4167-a72a-8537f979a0c1 on n-h2-848886-15 Jul 25 12:42:28.551110 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-658d2b57-4cb1-4e91-bf7e-c0419f04a6cc req-21b155b4-41cd-42bb-b43c-093e110ccbd9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.092093 Jul 25 12:42:28.551868 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 550/1097] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:28.558532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3c5c0989-509e-4384-984a-b2946cc973fd tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:28.559576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3c5c0989-509e-4384-984a-b2946cc973fd tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] [instance: d184a9e5-6927-4167-a72a-8537f979a0c1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:28.566647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3c5c0989-509e-4384-984a-b2946cc973fd tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:28.567441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3c5c0989-509e-4384-984a-b2946cc973fd tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:28.568508 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3c5c0989-509e-4384-984a-b2946cc973fd tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:28.569182 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3c5c0989-509e-4384-984a-b2946cc973fd tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:28.585613 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-3c5c0989-509e-4384-984a-b2946cc973fd tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] HTTP exception thrown: Instance d184a9e5-6927-4167-a72a-8537f979a0c1 could not be found. Jul 25 12:42:28.587916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3c5c0989-509e-4384-984a-b2946cc973fd tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Request method failure captured: Jul 25 12:42:28.587916 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1 HTTP/1.1 Jul 25 12:42:28.587916 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:42:28.587916 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:42:28.587916 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:42:28.587916 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:42:28.587916 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:42:28.587916 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:42:28.587916 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:42:28.587916 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:42:28.587916 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o-V0DrnJbYn3R2hJkvZNJU6NLMNRlvuXnxe8NPUr_cVhN3yIHhInGS6ZX3g8dTHT8N9yRO5UKeY3Z2pyJkCWWt6GGln9gHz9Tqc6_rjkGnwkabcgHJFZ094kj7hERHM5wd8UVgX3GSCB1h4H2_1ESFfvrAmrIfPnaI31jCKlHOXA1s Jul 25 12:42:28.587916 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:42:28.587916 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:42:28.587916 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:42:28.587916 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:42:28.587916 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:42:28.587916 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:42:28.587916 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 4c04b18299cf48eeb27a4212724321c1 Jul 25 12:42:28.587916 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1593642340 Jul 25 12:42:28.587916 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:42:28.587916 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:42:28.589313 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4c04b18299cf48eeb27a4212724321c1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4c04b18299cf48eeb27a4212724321c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c04b18299cf48eeb27a4212724321c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c04b18299cf48eeb27a4212724321c1"}]}] Jul 25 12:42:28.589313 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1593642340 Jul 25 12:42:28.589313 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 4c04b18299cf48eeb27a4212724321c1 Jul 25 12:42:28.589313 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1593642340 Jul 25 12:42:28.589313 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-InstanceActionsNegativeTestJSON-1593642340-project Jul 25 12:42:28.589313 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:42:28.589313 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:42:28.589313 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 068cf3ae93ad4003b7a4bc580fae55c1 Jul 25 12:42:28.589313 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1593642340-project Jul 25 12:42:28.589313 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:42:28.589313 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance d184a9e5-6927-4167-a72a-8537f979a0c1 could not be found. Jul 25 12:42:28.589313 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'd184a9e5-6927-4167-a72a-8537f979a0c1'} Jul 25 12:42:28.592916 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:42:28.592916 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:28.592916 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:42:28.592916 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:42:28.592916 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:42:28.592916 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:42:28.592916 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:42:28.592916 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:42:28.592916 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:42:28.592916 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:42:28.592916 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d184a9e5-6927-4167-a72a-8537f979a0c1 could not be found. Jul 25 12:42:28.592916 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:42:28.592916 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:42:28.592916 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:42:28.592916 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:28.592916 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:42:28.592916 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:42:28.592916 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:42:28.592916 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:42:28.592916 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:42:28.594584 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:42:28.594584 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:42:28.594584 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:42:28.594584 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:42:28.594584 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:42:28.594584 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:42:28.594584 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:42:28.594584 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d184a9e5-6927-4167-a72a-8537f979a0c1 could not be found. Jul 25 12:42:28.594584 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:42:28.594584 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:42:28.594584 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:42:28.594584 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:42:28.594584 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:42:28.594584 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:42:28.594584 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:42:28.594584 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:42:28.594584 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d184a9e5-6927-4167-a72a-8537f979a0c1 could not be found. Jul 25 12:42:28.594584 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:42:28.596092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3c5c0989-509e-4384-984a-b2946cc973fd tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] Returning 404 to user: Instance d184a9e5-6927-4167-a72a-8537f979a0c1 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:42:28.596092 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3c5c0989-509e-4384-984a-b2946cc973fd tempest-InstanceActionsNegativeTestJSON-1593642340 tempest-InstanceActionsNegativeTestJSON-1593642340-project] 10.222.0.49 "GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1" status: 404 len: 111 microversion: 2.1 time: 0.038805 Jul 25 12:42:28.596092 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 551/1098] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:28 2022] GET /compute/v2.1/servers/d184a9e5-6927-4167-a72a-8537f979a0c1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:42:28.602077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1a978c53-b1c4-4638-98c9-cdfe90ec7432 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:28.603116 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1a978c53-b1c4-4638-98c9-cdfe90ec7432 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:28.610707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a978c53-b1c4-4638-98c9-cdfe90ec7432 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:28.611518 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a978c53-b1c4-4638-98c9-cdfe90ec7432 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:28.612579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a978c53-b1c4-4638-98c9-cdfe90ec7432 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:28.613302 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a978c53-b1c4-4638-98c9-cdfe90ec7432 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:28.668250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c26a0970-62f7-470a-b34f-154ec23fae0a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:28.677646 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c26a0970-62f7-470a-b34f-154ec23fae0a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292" status: 200 len: 1308 microversion: 2.1 time: 1.146498 Jul 25 12:42:28.679083 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 548/1099] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:27 2022] GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292 => generated 1308 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:28.684732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-545a749a-200d-4837-b526-f99f99174944 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:28.685702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-545a749a-200d-4837-b526-f99f99174944 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:28.693085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-545a749a-200d-4837-b526-f99f99174944 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:28.693916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-545a749a-200d-4837-b526-f99f99174944 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:28.695070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-545a749a-200d-4837-b526-f99f99174944 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:28.695777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-545a749a-200d-4837-b526-f99f99174944 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:28.874414 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1a978c53-b1c4-4638-98c9-cdfe90ec7432 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:28.895122 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1a978c53-b1c4-4638-98c9-cdfe90ec7432 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1275 microversion: 2.1 time: 0.297288 Jul 25 12:42:28.909384 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 552/1100] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:28 2022] GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1275 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:28.909384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a68fbaaa-f1d9-4b3a-a3c6-b8a555593810 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:28.909384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a68fbaaa-f1d9-4b3a-a3c6-b8a555593810 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: f7651c95-4705-42c3-8fc5-58644c0d8dc5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:28.919761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a68fbaaa-f1d9-4b3a-a3c6-b8a555593810 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:28.920574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a68fbaaa-f1d9-4b3a-a3c6-b8a555593810 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:28.921988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a68fbaaa-f1d9-4b3a-a3c6-b8a555593810 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:28.922641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a68fbaaa-f1d9-4b3a-a3c6-b8a555593810 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:29.297598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-545a749a-200d-4837-b526-f99f99174944 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:29.300023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:29.307871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-545a749a-200d-4837-b526-f99f99174944 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:29.309572 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-545a749a-200d-4837-b526-f99f99174944 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:29.311041 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-545a749a-200d-4837-b526-f99f99174944 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1810 microversion: 2.25 time: 0.630483 Jul 25 12:42:29.311844 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 549/1101] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:28 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1810 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:29.317358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-de439e9e-6ef2-4b2b-99f0-53894e00d80a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:29.318439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-de439e9e-6ef2-4b2b-99f0-53894e00d80a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:29.332037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de439e9e-6ef2-4b2b-99f0-53894e00d80a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:29.332851 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de439e9e-6ef2-4b2b-99f0-53894e00d80a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:29.333890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de439e9e-6ef2-4b2b-99f0-53894e00d80a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:29.334545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de439e9e-6ef2-4b2b-99f0-53894e00d80a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:29.395764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a68fbaaa-f1d9-4b3a-a3c6-b8a555593810 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:29.408051 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a68fbaaa-f1d9-4b3a-a3c6-b8a555593810 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5" status: 200 len: 1316 microversion: 2.1 time: 0.509776 Jul 25 12:42:29.410039 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 553/1102] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:28 2022] GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5 => generated 1316 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:29.444551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-de439e9e-6ef2-4b2b-99f0-53894e00d80a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:29.457205 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-de439e9e-6ef2-4b2b-99f0-53894e00d80a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1271 microversion: 2.1 time: 0.141536 Jul 25 12:42:29.458447 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 550/1103] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:29 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1271 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:29.487541 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2c7749b7-76ab-4008-9781-1fb8618ab26b tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:29.488092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2c7749b7-76ab-4008-9781-1fb8618ab26b tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:29.499850 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c7749b7-76ab-4008-9781-1fb8618ab26b tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:29.500308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c7749b7-76ab-4008-9781-1fb8618ab26b tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:29.501213 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c7749b7-76ab-4008-9781-1fb8618ab26b tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:29.506129 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c7749b7-76ab-4008-9781-1fb8618ab26b tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:29.564080 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:29.702005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7869f1e7-2543-491e-beea-96443a00b9fa tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:29.702626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7869f1e7-2543-491e-beea-96443a00b9fa tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c9c04c11-ce42-44b4-a6fd-7f7658a05292] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:29.708214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2c7749b7-76ab-4008-9781-1fb8618ab26b tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:29.714453 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7869f1e7-2543-491e-beea-96443a00b9fa tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:29.715199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7869f1e7-2543-491e-beea-96443a00b9fa tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:29.718290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7869f1e7-2543-491e-beea-96443a00b9fa tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:29.719077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7869f1e7-2543-491e-beea-96443a00b9fa tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:29.722352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2c7749b7-76ab-4008-9781-1fb8618ab26b tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:29.739777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2c7749b7-76ab-4008-9781-1fb8618ab26b tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:29.745585 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2c7749b7-76ab-4008-9781-1fb8618ab26b tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1446 microversion: 2.75 time: 0.263036 Jul 25 12:42:29.757862 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 554/1104] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:29 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1446 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:29.916598 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9377ba31-b600-4d51-acb4-3b1fced49b3a tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:29.917228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9377ba31-b600-4d51-acb4-3b1fced49b3a tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:29.932449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9377ba31-b600-4d51-acb4-3b1fced49b3a tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:29.932807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9377ba31-b600-4d51-acb4-3b1fced49b3a tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:29.933925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9377ba31-b600-4d51-acb4-3b1fced49b3a tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:29.934527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9377ba31-b600-4d51-acb4-3b1fced49b3a tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:30.088832 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9377ba31-b600-4d51-acb4-3b1fced49b3a tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:30.099374 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9377ba31-b600-4d51-acb4-3b1fced49b3a tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1275 microversion: 2.1 time: 0.186548 Jul 25 12:42:30.121327 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 555/1105] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:29 2022] GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1275 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:42:30.283230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7869f1e7-2543-491e-beea-96443a00b9fa tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:30.296463 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7869f1e7-2543-491e-beea-96443a00b9fa tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292" status: 200 len: 1308 microversion: 2.1 time: 0.599514 Jul 25 12:42:30.297501 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 551/1106] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:29 2022] GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292 => generated 1308 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:42:30.336970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-75ef62af-dcae-4565-b200-62ff29dc4125 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:30.337890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-75ef62af-dcae-4565-b200-62ff29dc4125 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:30.345160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75ef62af-dcae-4565-b200-62ff29dc4125 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:30.352957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75ef62af-dcae-4565-b200-62ff29dc4125 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:30.354172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75ef62af-dcae-4565-b200-62ff29dc4125 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:30.354783 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75ef62af-dcae-4565-b200-62ff29dc4125 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:30.430420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-601d240f-f600-47de-a695-141b64ddd1f1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:30.431391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-601d240f-f600-47de-a695-141b64ddd1f1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: f7651c95-4705-42c3-8fc5-58644c0d8dc5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:30.438376 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-601d240f-f600-47de-a695-141b64ddd1f1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:30.439178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-601d240f-f600-47de-a695-141b64ddd1f1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:30.440660 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-601d240f-f600-47de-a695-141b64ddd1f1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:30.441260 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-601d240f-f600-47de-a695-141b64ddd1f1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:30.795924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-75ef62af-dcae-4565-b200-62ff29dc4125 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:30.812190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-75ef62af-dcae-4565-b200-62ff29dc4125 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:30.814319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-75ef62af-dcae-4565-b200-62ff29dc4125 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:30.815830 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-75ef62af-dcae-4565-b200-62ff29dc4125 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1810 microversion: 2.25 time: 0.484674 Jul 25 12:42:30.817148 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 556/1107] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:30 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1810 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:30.826488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-601d240f-f600-47de-a695-141b64ddd1f1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:30.838266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b18dcaf1-8b49-4c01-80cd-e961bc9af2b3 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:30.840360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b18dcaf1-8b49-4c01-80cd-e961bc9af2b3 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:30.842651 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-601d240f-f600-47de-a695-141b64ddd1f1 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5" status: 200 len: 1316 microversion: 2.1 time: 0.414750 Jul 25 12:42:30.843839 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 552/1108] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:30 2022] GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5 => generated 1316 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:42:30.850912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-a534e01e-b0c3-4f91-ae91-263971c45ac8 req-940d94b4-1d11-4d4c-b62f-5723f9a0d93e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7651c95-4705-42c3-8fc5-58644c0d8dc5", "name": "network-vif-plugged", "status": "completed", "tag": "046ef6e8-f893-4e00-95e9-57298459c892"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:30.854276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b18dcaf1-8b49-4c01-80cd-e961bc9af2b3 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:30.854937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b18dcaf1-8b49-4c01-80cd-e961bc9af2b3 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:30.855957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b18dcaf1-8b49-4c01-80cd-e961bc9af2b3 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:30.856619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b18dcaf1-8b49-4c01-80cd-e961bc9af2b3 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:30.875072 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a534e01e-b0c3-4f91-ae91-263971c45ac8 req-940d94b4-1d11-4d4c-b62f-5723f9a0d93e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:30.877213 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a534e01e-b0c3-4f91-ae91-263971c45ac8 req-940d94b4-1d11-4d4c-b62f-5723f9a0d93e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:30.896488 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-a534e01e-b0c3-4f91-ae91-263971c45ac8 req-940d94b4-1d11-4d4c-b62f-5723f9a0d93e service nova] Creating event network-vif-plugged:046ef6e8-f893-4e00-95e9-57298459c892 for instance f7651c95-4705-42c3-8fc5-58644c0d8dc5 on n-h2-848886-15 Jul 25 12:42:30.903181 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-a534e01e-b0c3-4f91-ae91-263971c45ac8 req-940d94b4-1d11-4d4c-b62f-5723f9a0d93e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057541 Jul 25 12:42:30.910342 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 553/1109] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:30.937518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-993f21e0-d173-4bd0-96aa-17342d9a5b32 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:30.939076 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-993f21e0-d173-4bd0-96aa-17342d9a5b32 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:30.953160 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-993f21e0-d173-4bd0-96aa-17342d9a5b32 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:30.953726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-993f21e0-d173-4bd0-96aa-17342d9a5b32 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:30.957312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-993f21e0-d173-4bd0-96aa-17342d9a5b32 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:30.959127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-993f21e0-d173-4bd0-96aa-17342d9a5b32 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:31.489419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-993f21e0-d173-4bd0-96aa-17342d9a5b32 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:31.498389 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-993f21e0-d173-4bd0-96aa-17342d9a5b32 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:31.499889 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-993f21e0-d173-4bd0-96aa-17342d9a5b32 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:31.505349 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-993f21e0-d173-4bd0-96aa-17342d9a5b32 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1446 microversion: 2.75 time: 0.593389 Jul 25 12:42:31.505947 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 554/1110] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:30 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1446 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:31.510612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bc5ed0a2-f09c-472f-9cad-6097f41ce555 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:31.511566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bc5ed0a2-f09c-472f-9cad-6097f41ce555 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:31.517170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc5ed0a2-f09c-472f-9cad-6097f41ce555 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:31.517622 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc5ed0a2-f09c-472f-9cad-6097f41ce555 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:31.518991 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc5ed0a2-f09c-472f-9cad-6097f41ce555 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:31.518991 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc5ed0a2-f09c-472f-9cad-6097f41ce555 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:31.613815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b18dcaf1-8b49-4c01-80cd-e961bc9af2b3 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:31.621756 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b18dcaf1-8b49-4c01-80cd-e961bc9af2b3 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1313 microversion: 2.1 time: 0.803136 Jul 25 12:42:31.622377 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 557/1111] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:30 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1313 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:31.626866 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3422f8a6-3b9c-4b29-a656-8283b9e7a8ef tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:31.627497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3422f8a6-3b9c-4b29-a656-8283b9e7a8ef tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c9c04c11-ce42-44b4-a6fd-7f7658a05292] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:31.634157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3422f8a6-3b9c-4b29-a656-8283b9e7a8ef tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:31.634610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3422f8a6-3b9c-4b29-a656-8283b9e7a8ef tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:31.635454 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3422f8a6-3b9c-4b29-a656-8283b9e7a8ef tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:31.635904 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3422f8a6-3b9c-4b29-a656-8283b9e7a8ef tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:31.930266 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bc5ed0a2-f09c-472f-9cad-6097f41ce555 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:31.938342 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bc5ed0a2-f09c-472f-9cad-6097f41ce555 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1317 microversion: 2.1 time: 0.431298 Jul 25 12:42:31.939057 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 555/1112] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:31 2022] GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:31.943694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-29c7d8b1-9ac1-4a9a-8adc-b79752b8d35e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:31.944472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-29c7d8b1-9ac1-4a9a-8adc-b79752b8d35e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:31.950692 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29c7d8b1-9ac1-4a9a-8adc-b79752b8d35e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:31.951328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29c7d8b1-9ac1-4a9a-8adc-b79752b8d35e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:31.952268 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29c7d8b1-9ac1-4a9a-8adc-b79752b8d35e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:31.952851 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29c7d8b1-9ac1-4a9a-8adc-b79752b8d35e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:31.982347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3422f8a6-3b9c-4b29-a656-8283b9e7a8ef tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:31.999631 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3422f8a6-3b9c-4b29-a656-8283b9e7a8ef tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292" status: 200 len: 1308 microversion: 2.1 time: 0.376182 Jul 25 12:42:32.001314 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 558/1113] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:31 2022] GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292 => generated 1308 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:32.008615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8118f0b3-2c9a-4640-b630-47469eb4ff33 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:32.009240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8118f0b3-2c9a-4640-b630-47469eb4ff33 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: f7651c95-4705-42c3-8fc5-58644c0d8dc5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:32.019983 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8118f0b3-2c9a-4640-b630-47469eb4ff33 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:32.021372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8118f0b3-2c9a-4640-b630-47469eb4ff33 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:32.021841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8118f0b3-2c9a-4640-b630-47469eb4ff33 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:32.023397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8118f0b3-2c9a-4640-b630-47469eb4ff33 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:32.470075 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-29c7d8b1-9ac1-4a9a-8adc-b79752b8d35e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:32.502323 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-29c7d8b1-9ac1-4a9a-8adc-b79752b8d35e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:32.506407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-29c7d8b1-9ac1-4a9a-8adc-b79752b8d35e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:32.508118 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-29c7d8b1-9ac1-4a9a-8adc-b79752b8d35e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1810 microversion: 2.25 time: 0.567832 Jul 25 12:42:32.510126 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 556/1114] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:31 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1810 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:32.545513 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-309ae70d-1689-438c-9088-883532826131 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:32.546110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-309ae70d-1689-438c-9088-883532826131 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:32.562999 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-309ae70d-1689-438c-9088-883532826131 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:32.563941 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-309ae70d-1689-438c-9088-883532826131 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:32.564900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8118f0b3-2c9a-4640-b630-47469eb4ff33 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:32.566547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-309ae70d-1689-438c-9088-883532826131 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:32.567201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-309ae70d-1689-438c-9088-883532826131 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:32.580767 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8118f0b3-2c9a-4640-b630-47469eb4ff33 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5" status: 200 len: 1316 microversion: 2.1 time: 0.575782 Jul 25 12:42:32.583375 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 559/1115] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:32 2022] GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5 => generated 1316 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:32.605510 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-f4ee3d41-faac-4172-8588-31e3aa377477 req-0659ab59-4622-4bc5-8dac-b3d5b6bfed7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eb5975b-24da-4318-90ce-bd3b7d0d01f2", "tag": "0012b1f8-03b2-4861-88f2-461bdd29f4d1"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:32.630209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f4ee3d41-faac-4172-8588-31e3aa377477 req-0659ab59-4622-4bc5-8dac-b3d5b6bfed7a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:32.630652 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f4ee3d41-faac-4172-8588-31e3aa377477 req-0659ab59-4622-4bc5-8dac-b3d5b6bfed7a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:32.665947 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-f4ee3d41-faac-4172-8588-31e3aa377477 req-0659ab59-4622-4bc5-8dac-b3d5b6bfed7a service nova] Creating event network-changed:0012b1f8-03b2-4861-88f2-461bdd29f4d1 for instance 7eb5975b-24da-4318-90ce-bd3b7d0d01f2 on n-h2-848886-15 Jul 25 12:42:32.681232 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-f4ee3d41-faac-4172-8588-31e3aa377477 req-0659ab59-4622-4bc5-8dac-b3d5b6bfed7a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090153 Jul 25 12:42:32.681953 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 560/1116] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:32.694400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-09bc5e2b-fe7a-4e66-bede-325f9b9b20ac tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:32.695411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-09bc5e2b-fe7a-4e66-bede-325f9b9b20ac tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:32.708519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09bc5e2b-fe7a-4e66-bede-325f9b9b20ac tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:32.710738 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09bc5e2b-fe7a-4e66-bede-325f9b9b20ac tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:32.713218 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09bc5e2b-fe7a-4e66-bede-325f9b9b20ac tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:32.713873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09bc5e2b-fe7a-4e66-bede-325f9b9b20ac tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:32.750120 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-309ae70d-1689-438c-9088-883532826131 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:32.803791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-309ae70d-1689-438c-9088-883532826131 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:32.807663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-309ae70d-1689-438c-9088-883532826131 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:32.825850 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-309ae70d-1689-438c-9088-883532826131 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1446 microversion: 2.75 time: 0.289738 Jul 25 12:42:32.826588 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 557/1117] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:32 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1446 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:32.926347 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-76f1da54-3a30-40e3-998b-9259308a04f2 req-793b93c7-66cc-4c27-80bc-16825bbcac51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9c04c11-ce42-44b4-a6fd-7f7658a05292", "name": "network-vif-plugged", "status": "completed", "tag": "3844a30a-3f07-4f1e-9005-38e3c53d311a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:32.942062 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-76f1da54-3a30-40e3-998b-9259308a04f2 req-793b93c7-66cc-4c27-80bc-16825bbcac51 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:32.943324 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-76f1da54-3a30-40e3-998b-9259308a04f2 req-793b93c7-66cc-4c27-80bc-16825bbcac51 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:32.958381 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-76f1da54-3a30-40e3-998b-9259308a04f2 req-793b93c7-66cc-4c27-80bc-16825bbcac51 service nova] Creating event network-vif-plugged:3844a30a-3f07-4f1e-9005-38e3c53d311a for instance c9c04c11-ce42-44b4-a6fd-7f7658a05292 on n-h1-848886-15 Jul 25 12:42:32.967548 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-76f1da54-3a30-40e3-998b-9259308a04f2 req-793b93c7-66cc-4c27-80bc-16825bbcac51 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046059 Jul 25 12:42:33.000654 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 558/1118] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:33.035221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-baa2ff2e-f169-4f66-a25d-c0b9786343ef tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:33.036547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-baa2ff2e-f169-4f66-a25d-c0b9786343ef tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:33.059208 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-baa2ff2e-f169-4f66-a25d-c0b9786343ef tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:33.060931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-baa2ff2e-f169-4f66-a25d-c0b9786343ef tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:33.062912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-baa2ff2e-f169-4f66-a25d-c0b9786343ef tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:33.064500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-baa2ff2e-f169-4f66-a25d-c0b9786343ef tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:33.209733 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-09bc5e2b-fe7a-4e66-bede-325f9b9b20ac tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:33.222589 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-09bc5e2b-fe7a-4e66-bede-325f9b9b20ac tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1313 microversion: 2.1 time: 0.539072 Jul 25 12:42:33.226590 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 561/1119] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:32 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1313 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:33.246394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-056e372b-411e-49ec-a6a4-cf57ecb6413d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:33.247180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-056e372b-411e-49ec-a6a4-cf57ecb6413d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c9c04c11-ce42-44b4-a6fd-7f7658a05292] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:33.258089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-056e372b-411e-49ec-a6a4-cf57ecb6413d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:33.258938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-056e372b-411e-49ec-a6a4-cf57ecb6413d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:33.260763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-056e372b-411e-49ec-a6a4-cf57ecb6413d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:33.261368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-056e372b-411e-49ec-a6a4-cf57ecb6413d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:33.571316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-baa2ff2e-f169-4f66-a25d-c0b9786343ef tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:33.587088 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-baa2ff2e-f169-4f66-a25d-c0b9786343ef tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1317 microversion: 2.1 time: 0.584136 Jul 25 12:42:33.588577 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 559/1120] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:33 2022] GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1317 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:33.595092 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-09a1496d-b771-4c32-94ba-3b6b005a84cf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:33.597121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-09a1496d-b771-4c32-94ba-3b6b005a84cf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:33.608367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09a1496d-b771-4c32-94ba-3b6b005a84cf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:33.609115 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09a1496d-b771-4c32-94ba-3b6b005a84cf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:33.610273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09a1496d-b771-4c32-94ba-3b6b005a84cf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:33.611424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09a1496d-b771-4c32-94ba-3b6b005a84cf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:33.674407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-056e372b-411e-49ec-a6a4-cf57ecb6413d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:33.686725 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-056e372b-411e-49ec-a6a4-cf57ecb6413d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292" status: 200 len: 1308 microversion: 2.1 time: 0.453906 Jul 25 12:42:33.687674 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 562/1121] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:33 2022] GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292 => generated 1308 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:33.693784 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fe1b4cb8-e766-4037-8f5e-b31ae38428a3 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:33.695113 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fe1b4cb8-e766-4037-8f5e-b31ae38428a3 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: f7651c95-4705-42c3-8fc5-58644c0d8dc5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:33.705461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fe1b4cb8-e766-4037-8f5e-b31ae38428a3 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:33.706137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fe1b4cb8-e766-4037-8f5e-b31ae38428a3 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:33.707131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fe1b4cb8-e766-4037-8f5e-b31ae38428a3 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:33.707888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fe1b4cb8-e766-4037-8f5e-b31ae38428a3 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:33.955516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=24 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:34.046009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fe1b4cb8-e766-4037-8f5e-b31ae38428a3 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:34.059372 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fe1b4cb8-e766-4037-8f5e-b31ae38428a3 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5" status: 200 len: 1465 microversion: 2.1 time: 0.370128 Jul 25 12:42:34.074832 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 563/1122] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:33 2022] GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5 => generated 1465 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:34.083409 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-de7244d6-7013-4881-9467-e527d3322ebb tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:34.092063 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-09a1496d-b771-4c32-94ba-3b6b005a84cf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:34.096646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-de7244d6-7013-4881-9467-e527d3322ebb tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:34.104119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-09a1496d-b771-4c32-94ba-3b6b005a84cf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:34.108130 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-09a1496d-b771-4c32-94ba-3b6b005a84cf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:34.114211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de7244d6-7013-4881-9467-e527d3322ebb tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:34.115871 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-09a1496d-b771-4c32-94ba-3b6b005a84cf tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1810 microversion: 2.25 time: 0.525908 Jul 25 12:42:34.118906 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 560/1123] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:33 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1810 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:34.123315 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de7244d6-7013-4881-9467-e527d3322ebb tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:34.126872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de7244d6-7013-4881-9467-e527d3322ebb tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:34.127467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de7244d6-7013-4881-9467-e527d3322ebb tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:34.131555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5ac731ff-a3a3-4018-be56-d9acfeb85727 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:34.136910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5ac731ff-a3a3-4018-be56-d9acfeb85727 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] [instance: f7651c95-4705-42c3-8fc5-58644c0d8dc5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:34.157694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ac731ff-a3a3-4018-be56-d9acfeb85727 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:34.161158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ac731ff-a3a3-4018-be56-d9acfeb85727 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:34.162206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ac731ff-a3a3-4018-be56-d9acfeb85727 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:34.167768 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ac731ff-a3a3-4018-be56-d9acfeb85727 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:34.312264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-de7244d6-7013-4881-9467-e527d3322ebb tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:34.332055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-de7244d6-7013-4881-9467-e527d3322ebb tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:34.333545 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-de7244d6-7013-4881-9467-e527d3322ebb tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:34.339046 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-de7244d6-7013-4881-9467-e527d3322ebb tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1446 microversion: 2.75 time: 0.262823 Jul 25 12:42:34.350281 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 564/1124] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:34 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1446 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:34.355527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a3032053-c6e4-4bdc-8cb5-7b7767a4d253 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:34.356317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a3032053-c6e4-4bdc-8cb5-7b7767a4d253 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:34.367422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3032053-c6e4-4bdc-8cb5-7b7767a4d253 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:34.368117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3032053-c6e4-4bdc-8cb5-7b7767a4d253 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:34.369074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3032053-c6e4-4bdc-8cb5-7b7767a4d253 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:34.369927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3032053-c6e4-4bdc-8cb5-7b7767a4d253 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:34.601403 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5ac731ff-a3a3-4018-be56-d9acfeb85727 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5" status: 200 len: 1618 microversion: 2.1 time: 0.481084 Jul 25 12:42:34.604360 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 561/1125] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:34 2022] GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5 => generated 1618 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:34.612427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-323905e7-4f2a-43c9-9670-1aad4b684583 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:34.613052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-323905e7-4f2a-43c9-9670-1aad4b684583 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:34.628796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-323905e7-4f2a-43c9-9670-1aad4b684583 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:34.629459 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-323905e7-4f2a-43c9-9670-1aad4b684583 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:34.644969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-323905e7-4f2a-43c9-9670-1aad4b684583 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:34.645440 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-323905e7-4f2a-43c9-9670-1aad4b684583 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:34.779776 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a3032053-c6e4-4bdc-8cb5-7b7767a4d253 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:34.790306 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a3032053-c6e4-4bdc-8cb5-7b7767a4d253 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1313 microversion: 2.1 time: 0.438534 Jul 25 12:42:34.791942 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 565/1126] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:34 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:34.798525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-d7fc9d02-7b62-415d-9678-8576d6b04137 req-123d537a-4125-4340-bf66-2fa226458b0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2cc4389-ef66-4ad7-a6e5-ab70905b9620", "tag": "94f1f07a-a4dc-4d37-9c1f-822a76bcc0b8"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:34.812324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d7fc9d02-7b62-415d-9678-8576d6b04137 req-123d537a-4125-4340-bf66-2fa226458b0c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:34.813411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d7fc9d02-7b62-415d-9678-8576d6b04137 req-123d537a-4125-4340-bf66-2fa226458b0c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:34.829467 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-d7fc9d02-7b62-415d-9678-8576d6b04137 req-123d537a-4125-4340-bf66-2fa226458b0c service nova] Creating event network-changed:94f1f07a-a4dc-4d37-9c1f-822a76bcc0b8 for instance f2cc4389-ef66-4ad7-a6e5-ab70905b9620 on n-h2-848886-15 Jul 25 12:42:34.836498 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-d7fc9d02-7b62-415d-9678-8576d6b04137 req-123d537a-4125-4340-bf66-2fa226458b0c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043031 Jul 25 12:42:34.845866 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 566/1127] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:34.852433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-01c979ca-8020-43ee-9945-5cce5349dd9b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:34.853541 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-01c979ca-8020-43ee-9945-5cce5349dd9b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c9c04c11-ce42-44b4-a6fd-7f7658a05292] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:34.860782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01c979ca-8020-43ee-9945-5cce5349dd9b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:34.861406 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01c979ca-8020-43ee-9945-5cce5349dd9b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:34.862589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01c979ca-8020-43ee-9945-5cce5349dd9b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:34.863112 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01c979ca-8020-43ee-9945-5cce5349dd9b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:34.889428 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=76 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:34.972476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-323905e7-4f2a-43c9-9670-1aad4b684583 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:34.982266 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-323905e7-4f2a-43c9-9670-1aad4b684583 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1317 microversion: 2.1 time: 0.375426 Jul 25 12:42:34.986097 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 562/1128] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:34 2022] GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:34.999317 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-40479bcf-1127-4e31-8250-b396464710de req-22d04cd2-4b1c-4c47-80f1-6ac833dc0309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "159b5add-9666-4a2a-82e7-7571a120cabb", "tag": "27e87312-289e-4818-b884-b357c21f7a9f"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:35.020110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-40479bcf-1127-4e31-8250-b396464710de req-22d04cd2-4b1c-4c47-80f1-6ac833dc0309 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:35.023933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-40479bcf-1127-4e31-8250-b396464710de req-22d04cd2-4b1c-4c47-80f1-6ac833dc0309 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:35.043686 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-40479bcf-1127-4e31-8250-b396464710de req-22d04cd2-4b1c-4c47-80f1-6ac833dc0309 service nova] Creating event network-changed:27e87312-289e-4818-b884-b357c21f7a9f for instance 159b5add-9666-4a2a-82e7-7571a120cabb on n-h2-848886-15 Jul 25 12:42:35.051742 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-40479bcf-1127-4e31-8250-b396464710de req-22d04cd2-4b1c-4c47-80f1-6ac833dc0309 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063005 Jul 25 12:42:35.052710 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 563/1129] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:35.066597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:35.092742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3b92366f-d9fd-4822-a82e-ca5b73765b85 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-322132081", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["b2467ff1-7d17-43ae-811d-e37437b3b0ba"]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:35.107158 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-01c979ca-8020-43ee-9945-5cce5349dd9b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:35.115720 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-01c979ca-8020-43ee-9945-5cce5349dd9b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292" status: 200 len: 1308 microversion: 2.1 time: 0.268316 Jul 25 12:42:35.135125 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 567/1130] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:34 2022] GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292 => generated 1308 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:35.151678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9010cd48-d0b9-41ed-af1f-1576c9f0348e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:35.155284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9010cd48-d0b9-41ed-af1f-1576c9f0348e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:35.169682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9010cd48-d0b9-41ed-af1f-1576c9f0348e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:35.170871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9010cd48-d0b9-41ed-af1f-1576c9f0348e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:35.173715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9010cd48-d0b9-41ed-af1f-1576c9f0348e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:35.174584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9010cd48-d0b9-41ed-af1f-1576c9f0348e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:35.211983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-3b92366f-d9fd-4822-a82e-ca5b73765b85 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] validate_networks() for None {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:42:35.434434 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9010cd48-d0b9-41ed-af1f-1576c9f0348e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:35.451417 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9010cd48-d0b9-41ed-af1f-1576c9f0348e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:35.453484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9010cd48-d0b9-41ed-af1f-1576c9f0348e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:35.454989 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9010cd48-d0b9-41ed-af1f-1576c9f0348e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1810 microversion: 2.25 time: 0.318303 Jul 25 12:42:35.455794 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 568/1131] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:35 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1810 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:35.464211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-09a884d6-decb-466d-865b-1eedcb930c46 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:35.465984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-09a884d6-decb-466d-865b-1eedcb930c46 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:35.474262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09a884d6-decb-466d-865b-1eedcb930c46 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:35.475056 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09a884d6-decb-466d-865b-1eedcb930c46 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:35.476445 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09a884d6-decb-466d-865b-1eedcb930c46 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:35.477128 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09a884d6-decb-466d-865b-1eedcb930c46 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:35.641076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-09a884d6-decb-466d-865b-1eedcb930c46 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:35.643303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=13 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:35.653615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-09a884d6-decb-466d-865b-1eedcb930c46 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:35.655325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-09a884d6-decb-466d-865b-1eedcb930c46 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:35.662704 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-09a884d6-decb-466d-865b-1eedcb930c46 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1446 microversion: 2.75 time: 0.205593 Jul 25 12:42:35.663118 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-3b92366f-d9fd-4822-a82e-ca5b73765b85 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:42:35.663546 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-3b92366f-d9fd-4822-a82e-ca5b73765b85 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:42:35.664024 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-3b92366f-d9fd-4822-a82e-ca5b73765b85 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:42:35.664400 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 569/1132] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:35 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1446 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:35.664524 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-3b92366f-d9fd-4822-a82e-ca5b73765b85 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:42:35.664830 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-3b92366f-d9fd-4822-a82e-ca5b73765b85 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:42:35.677264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b92366f-d9fd-4822-a82e-ca5b73765b85 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:35.677921 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b92366f-d9fd-4822-a82e-ca5b73765b85 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:35.680591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b92366f-d9fd-4822-a82e-ca5b73765b85 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:35.681192 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b92366f-d9fd-4822-a82e-ca5b73765b85 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:35.709097 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-3b92366f-d9fd-4822-a82e-ca5b73765b85 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:42:35.714311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-3b92366f-d9fd-4822-a82e-ca5b73765b85 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for user 8c296447c2254c048f94bd9f186b0097 and project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:42:35.727427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3b92366f-d9fd-4822-a82e-ca5b73765b85 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:42:35.729974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3b92366f-d9fd-4822-a82e-ca5b73765b85 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 1c42ab74-7b7f-493e-a5b0-e0384beafd96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:42:35.804426 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3b92366f-d9fd-4822-a82e-ca5b73765b85 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749676 Jul 25 12:42:35.805100 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 564/1133] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:42:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:42:35.818060 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-46bb5658-9346-4a4c-8810-5b7b130905ed tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:35.818927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-46bb5658-9346-4a4c-8810-5b7b130905ed tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:35.829433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9e1330a7-d81f-45cb-925a-a99d04ab86c8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:35.830395 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9e1330a7-d81f-45cb-925a-a99d04ab86c8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 1c42ab74-7b7f-493e-a5b0-e0384beafd96] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:35.830688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-46bb5658-9346-4a4c-8810-5b7b130905ed tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:35.831158 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-46bb5658-9346-4a4c-8810-5b7b130905ed tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:35.834172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-46bb5658-9346-4a4c-8810-5b7b130905ed tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:35.850126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-46bb5658-9346-4a4c-8810-5b7b130905ed tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:36.038632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9e1330a7-d81f-45cb-925a-a99d04ab86c8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:36.047024 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9e1330a7-d81f-45cb-925a-a99d04ab86c8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96" status: 200 len: 1216 microversion: 2.1 time: 0.234591 Jul 25 12:42:36.047954 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 565/1134] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:35 2022] GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96 => generated 1216 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:36.059752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5218c348-56bc-4690-9485-847b3deed02b tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:36.061566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5218c348-56bc-4690-9485-847b3deed02b tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:36.084551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5218c348-56bc-4690-9485-847b3deed02b tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:36.085071 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5218c348-56bc-4690-9485-847b3deed02b tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:36.089180 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5218c348-56bc-4690-9485-847b3deed02b tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:36.089807 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5218c348-56bc-4690-9485-847b3deed02b tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:36.824927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-46bb5658-9346-4a4c-8810-5b7b130905ed tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:36.836551 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-46bb5658-9346-4a4c-8810-5b7b130905ed tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1313 microversion: 2.1 time: 1.023483 Jul 25 12:42:36.837224 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 570/1135] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:35 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1313 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:36.843940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8d8eaa7c-80f7-42c5-9c85-d63ba22d214a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:36.845251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8d8eaa7c-80f7-42c5-9c85-d63ba22d214a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c9c04c11-ce42-44b4-a6fd-7f7658a05292] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:36.854144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d8eaa7c-80f7-42c5-9c85-d63ba22d214a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:36.854589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d8eaa7c-80f7-42c5-9c85-d63ba22d214a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:36.855371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d8eaa7c-80f7-42c5-9c85-d63ba22d214a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:36.855798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d8eaa7c-80f7-42c5-9c85-d63ba22d214a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:36.896101 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5218c348-56bc-4690-9485-847b3deed02b tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:36.905079 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5218c348-56bc-4690-9485-847b3deed02b tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1317 microversion: 2.1 time: 0.854850 Jul 25 12:42:36.906187 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 566/1136] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:36 2022] GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1317 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:36.910951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0e80ad21-24db-49ed-a4a8-d78377c259cb tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:36.911562 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0e80ad21-24db-49ed-a4a8-d78377c259cb tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:36.919189 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e80ad21-24db-49ed-a4a8-d78377c259cb tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:36.919560 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e80ad21-24db-49ed-a4a8-d78377c259cb tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:36.920720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e80ad21-24db-49ed-a4a8-d78377c259cb tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:36.920849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e80ad21-24db-49ed-a4a8-d78377c259cb tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:37.496693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8d8eaa7c-80f7-42c5-9c85-d63ba22d214a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:37.507091 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0e80ad21-24db-49ed-a4a8-d78377c259cb tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:37.512360 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8d8eaa7c-80f7-42c5-9c85-d63ba22d214a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292" status: 200 len: 1489 microversion: 2.1 time: 0.673461 Jul 25 12:42:37.512930 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 571/1137] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:36 2022] GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292 => generated 1489 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:37.519835 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0e80ad21-24db-49ed-a4a8-d78377c259cb tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:37.523569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0e80ad21-24db-49ed-a4a8-d78377c259cb tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:37.525892 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0e80ad21-24db-49ed-a4a8-d78377c259cb tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1810 microversion: 2.25 time: 0.618665 Jul 25 12:42:37.528804 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 567/1138] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:36 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1810 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:37.529010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-577ae1dd-d32c-4535-a906-a33bd4d0bb65 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:37.544543 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-577ae1dd-d32c-4535-a906-a33bd4d0bb65 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:37.552849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ad145c30-3d8c-46a9-b1cc-a62dd93d1b66 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:37.553766 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ad145c30-3d8c-46a9-b1cc-a62dd93d1b66 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:37.557303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:37.559028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-577ae1dd-d32c-4535-a906-a33bd4d0bb65 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:37.559604 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-577ae1dd-d32c-4535-a906-a33bd4d0bb65 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:37.560725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-577ae1dd-d32c-4535-a906-a33bd4d0bb65 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:37.561682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-577ae1dd-d32c-4535-a906-a33bd4d0bb65 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:37.565981 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad145c30-3d8c-46a9-b1cc-a62dd93d1b66 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:37.566950 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad145c30-3d8c-46a9-b1cc-a62dd93d1b66 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:37.568519 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad145c30-3d8c-46a9-b1cc-a62dd93d1b66 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:37.569151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad145c30-3d8c-46a9-b1cc-a62dd93d1b66 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:37.584502 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:37.791971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ad145c30-3d8c-46a9-b1cc-a62dd93d1b66 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:37.804794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ad145c30-3d8c-46a9-b1cc-a62dd93d1b66 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:37.807454 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ad145c30-3d8c-46a9-b1cc-a62dd93d1b66 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:37.814128 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ad145c30-3d8c-46a9-b1cc-a62dd93d1b66 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1446 microversion: 2.75 time: 0.283428 Jul 25 12:42:37.817310 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 568/1139] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:37 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1446 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:37.819924 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f8579534-78c2-4d7a-bba1-42f73dd70638 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:37.820703 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f8579534-78c2-4d7a-bba1-42f73dd70638 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 1c42ab74-7b7f-493e-a5b0-e0384beafd96] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:37.828487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8579534-78c2-4d7a-bba1-42f73dd70638 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:37.829808 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8579534-78c2-4d7a-bba1-42f73dd70638 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:37.830799 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8579534-78c2-4d7a-bba1-42f73dd70638 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:37.831580 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8579534-78c2-4d7a-bba1-42f73dd70638 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:37.969886 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f8579534-78c2-4d7a-bba1-42f73dd70638 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:37.979493 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f8579534-78c2-4d7a-bba1-42f73dd70638 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96" status: 200 len: 1274 microversion: 2.1 time: 0.163046 Jul 25 12:42:37.980760 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 569/1140] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:37 2022] GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96 => generated 1274 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:37.984922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-41d11ff1-2ce8-4f32-8a9b-f0f462c50f72 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:37.985713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-41d11ff1-2ce8-4f32-8a9b-f0f462c50f72 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c9c04c11-ce42-44b4-a6fd-7f7658a05292] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:37.992513 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-41d11ff1-2ce8-4f32-8a9b-f0f462c50f72 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:37.993033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-41d11ff1-2ce8-4f32-8a9b-f0f462c50f72 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:37.993883 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-41d11ff1-2ce8-4f32-8a9b-f0f462c50f72 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:37.994381 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-41d11ff1-2ce8-4f32-8a9b-f0f462c50f72 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:37.998395 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:38.019985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-41d11ff1-2ce8-4f32-8a9b-f0f462c50f72 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lazy-loading 'flavor' on Instance uuid c9c04c11-ce42-44b4-a6fd-7f7658a05292 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:42:38.133234 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-577ae1dd-d32c-4535-a906-a33bd4d0bb65 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1859 microversion: 2.1 time: 0.609952 Jul 25 12:42:38.134885 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 572/1141] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:37 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1859 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:38.140009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-564ceb5c-ea0b-4751-8298-d4373fce5143 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:38.140600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-564ceb5c-ea0b-4751-8298-d4373fce5143 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:38.147285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-564ceb5c-ea0b-4751-8298-d4373fce5143 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:38.147445 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-41d11ff1-2ce8-4f32-8a9b-f0f462c50f72 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "POST /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292/action" status: 202 len: 0 microversion: 2.1 time: 0.165608 Jul 25 12:42:38.148032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-564ceb5c-ea0b-4751-8298-d4373fce5143 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:38.148526 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 570/1142] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:42:37 2022] POST /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:42:38.149340 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-564ceb5c-ea0b-4751-8298-d4373fce5143 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:38.150328 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-564ceb5c-ea0b-4751-8298-d4373fce5143 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:38.156037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-09645e92-ef0f-4261-ac62-db71084eb712 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:38.156743 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-09645e92-ef0f-4261-ac62-db71084eb712 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:38.166811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09645e92-ef0f-4261-ac62-db71084eb712 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:38.167872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09645e92-ef0f-4261-ac62-db71084eb712 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:38.168746 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09645e92-ef0f-4261-ac62-db71084eb712 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:38.169551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09645e92-ef0f-4261-ac62-db71084eb712 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:38.649291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-09645e92-ef0f-4261-ac62-db71084eb712 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:38.652834 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-564ceb5c-ea0b-4751-8298-d4373fce5143 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:38.662141 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-09645e92-ef0f-4261-ac62-db71084eb712 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1317 microversion: 2.1 time: 0.510818 Jul 25 12:42:38.663411 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 571/1143] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:38 2022] GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1317 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:38.674130 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-564ceb5c-ea0b-4751-8298-d4373fce5143 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1313 microversion: 2.1 time: 0.527299 Jul 25 12:42:38.674254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-ca8a8f3a-b28a-4a34-8291-5b90dc0a00bf req-bdf44e68-6ffc-4858-9960-993878ef0420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c18f0b76-5dab-4e09-afb8-8a1de682b042", "name": "network-vif-unplugged", "status": "completed", "tag": "b5d54db2-13f2-41e6-b4fa-4d037fc2e51e"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:38.674354 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 573/1144] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:38 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1313 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:38.675855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:38.677176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8a0a0f95-f713-4db1-abe8-8e62fbe27859 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:38.677802 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8a0a0f95-f713-4db1-abe8-8e62fbe27859 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c9c04c11-ce42-44b4-a6fd-7f7658a05292] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:38.684435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ca8a8f3a-b28a-4a34-8291-5b90dc0a00bf req-bdf44e68-6ffc-4858-9960-993878ef0420 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:38.685546 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ca8a8f3a-b28a-4a34-8291-5b90dc0a00bf req-bdf44e68-6ffc-4858-9960-993878ef0420 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:38.706296 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a0a0f95-f713-4db1-abe8-8e62fbe27859 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:38.706591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a0a0f95-f713-4db1-abe8-8e62fbe27859 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:38.707599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a0a0f95-f713-4db1-abe8-8e62fbe27859 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:38.708198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a0a0f95-f713-4db1-abe8-8e62fbe27859 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:39.028981 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-ca8a8f3a-b28a-4a34-8291-5b90dc0a00bf req-bdf44e68-6ffc-4858-9960-993878ef0420 service nova] Creating event network-vif-unplugged:b5d54db2-13f2-41e6-b4fa-4d037fc2e51e for instance c18f0b76-5dab-4e09-afb8-8a1de682b042 on n-h1-848886-15 Jul 25 12:42:39.034822 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-ca8a8f3a-b28a-4a34-8291-5b90dc0a00bf req-bdf44e68-6ffc-4858-9960-993878ef0420 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.370203 Jul 25 12:42:39.035976 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 572/1145] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:39.042238 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fe099daf-1158-43ee-85b2-03dba25680f0 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-848886-15", "block_migration": true, "disk_over_commit": false}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:39.044678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fe099daf-1158-43ee-85b2-03dba25680f0 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:39.051639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fe099daf-1158-43ee-85b2-03dba25680f0 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:39.052134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fe099daf-1158-43ee-85b2-03dba25680f0 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:39.053065 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fe099daf-1158-43ee-85b2-03dba25680f0 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:39.053505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fe099daf-1158-43ee-85b2-03dba25680f0 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:39.079852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-fe099daf-1158-43ee-85b2-03dba25680f0 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lazy-loading 'flavor' on Instance uuid d2711752-4c19-477f-a5f0-e5097f2dc41a {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:42:39.093237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fe099daf-1158-43ee-85b2-03dba25680f0 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Going to try to live migrate instance to n-h2-848886-15 {{(pid=125883) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 12:42:39.569603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8a0a0f95-f713-4db1-abe8-8e62fbe27859 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:39.579612 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8a0a0f95-f713-4db1-abe8-8e62fbe27859 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292" status: 200 len: 1497 microversion: 2.1 time: 0.908272 Jul 25 12:42:39.580927 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 574/1146] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:38 2022] GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292 => generated 1497 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:39.588467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e4454c3b-7ce6-4169-bcf2-3829e557aab8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:39.589221 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e4454c3b-7ce6-4169-bcf2-3829e557aab8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:39.597370 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4454c3b-7ce6-4169-bcf2-3829e557aab8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:39.598076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4454c3b-7ce6-4169-bcf2-3829e557aab8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:39.599617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4454c3b-7ce6-4169-bcf2-3829e557aab8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:39.600278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4454c3b-7ce6-4169-bcf2-3829e557aab8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:39.877845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e4454c3b-7ce6-4169-bcf2-3829e557aab8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:39.889965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e4454c3b-7ce6-4169-bcf2-3829e557aab8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:39.891740 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e4454c3b-7ce6-4169-bcf2-3829e557aab8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:39.893321 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e4454c3b-7ce6-4169-bcf2-3829e557aab8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1810 microversion: 2.25 time: 0.310988 Jul 25 12:42:39.894926 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 575/1147] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:39 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1810 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:39.909122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e4cd00d6-c3a2-4737-905d-c8fff31e673a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:39.912165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e4cd00d6-c3a2-4737-905d-c8fff31e673a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:39.953264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4cd00d6-c3a2-4737-905d-c8fff31e673a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:39.957294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4cd00d6-c3a2-4737-905d-c8fff31e673a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:39.960563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4cd00d6-c3a2-4737-905d-c8fff31e673a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:39.961235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4cd00d6-c3a2-4737-905d-c8fff31e673a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:40.117216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e4cd00d6-c3a2-4737-905d-c8fff31e673a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:40.135174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e4cd00d6-c3a2-4737-905d-c8fff31e673a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:40.138626 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e4cd00d6-c3a2-4737-905d-c8fff31e673a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:40.144397 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e4cd00d6-c3a2-4737-905d-c8fff31e673a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1446 microversion: 2.75 time: 0.247780 Jul 25 12:42:40.145083 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 576/1148] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:39 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1446 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:40.151012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f4b1a955-3f2b-4262-af6b-cd821c98974c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:40.151861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f4b1a955-3f2b-4262-af6b-cd821c98974c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 1c42ab74-7b7f-493e-a5b0-e0384beafd96] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:40.159152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4b1a955-3f2b-4262-af6b-cd821c98974c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:40.159833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4b1a955-3f2b-4262-af6b-cd821c98974c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:40.160778 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4b1a955-3f2b-4262-af6b-cd821c98974c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:40.161367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4b1a955-3f2b-4262-af6b-cd821c98974c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:40.373881 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f4b1a955-3f2b-4262-af6b-cd821c98974c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:40.387843 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f4b1a955-3f2b-4262-af6b-cd821c98974c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96" status: 200 len: 1316 microversion: 2.1 time: 0.238545 Jul 25 12:42:40.388690 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 577/1149] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:40 2022] GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96 => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:40.415971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-367e7d40-eefb-482d-ada7-506314cd2e41 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:40.418169 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-367e7d40-eefb-482d-ada7-506314cd2e41 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:40.427941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-367e7d40-eefb-482d-ada7-506314cd2e41 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:40.428450 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-367e7d40-eefb-482d-ada7-506314cd2e41 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:40.430182 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-367e7d40-eefb-482d-ada7-506314cd2e41 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:40.430630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-367e7d40-eefb-482d-ada7-506314cd2e41 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:40.866730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-367e7d40-eefb-482d-ada7-506314cd2e41 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:40.880352 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-367e7d40-eefb-482d-ada7-506314cd2e41 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1313 microversion: 2.1 time: 0.489500 Jul 25 12:42:40.882041 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 578/1150] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:40 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:40.890080 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-acf6c2ea-f527-40a7-a4d0-9e90a42fa87d tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:40.891250 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-acf6c2ea-f527-40a7-a4d0-9e90a42fa87d tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:40.901413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acf6c2ea-f527-40a7-a4d0-9e90a42fa87d tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:40.901809 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acf6c2ea-f527-40a7-a4d0-9e90a42fa87d tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:40.902734 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acf6c2ea-f527-40a7-a4d0-9e90a42fa87d tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:40.903329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acf6c2ea-f527-40a7-a4d0-9e90a42fa87d tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:41.355773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-acf6c2ea-f527-40a7-a4d0-9e90a42fa87d tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:41.370617 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-acf6c2ea-f527-40a7-a4d0-9e90a42fa87d tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1317 microversion: 2.1 time: 0.485865 Jul 25 12:42:41.384262 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 579/1151] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:40 2022] GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1317 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:41.384262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-388bf7a7-a11f-4bf7-9fbe-d12df83dc77e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:41.384262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-388bf7a7-a11f-4bf7-9fbe-d12df83dc77e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c9c04c11-ce42-44b4-a6fd-7f7658a05292] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:41.395164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-388bf7a7-a11f-4bf7-9fbe-d12df83dc77e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:41.396122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-388bf7a7-a11f-4bf7-9fbe-d12df83dc77e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:41.397624 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-388bf7a7-a11f-4bf7-9fbe-d12df83dc77e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:41.398549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-388bf7a7-a11f-4bf7-9fbe-d12df83dc77e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:41.740840 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fe099daf-1158-43ee-85b2-03dba25680f0 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a/action" status: 202 len: 0 microversion: 2.1 time: 2.703314 Jul 25 12:42:41.742186 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 573/1152] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:42:39 2022] POST /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a/action => generated 0 bytes in 2705 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:42:41.749360 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-073eb9ab-704a-471b-a329-3bc345ec3aa0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:41.750441 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-073eb9ab-704a-471b-a329-3bc345ec3aa0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:41.786236 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-073eb9ab-704a-471b-a329-3bc345ec3aa0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:41.787097 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-073eb9ab-704a-471b-a329-3bc345ec3aa0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:41.788542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-073eb9ab-704a-471b-a329-3bc345ec3aa0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:41.789226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-073eb9ab-704a-471b-a329-3bc345ec3aa0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:41.833208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-388bf7a7-a11f-4bf7-9fbe-d12df83dc77e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:41.842311 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-388bf7a7-a11f-4bf7-9fbe-d12df83dc77e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292" status: 200 len: 1480 microversion: 2.1 time: 0.468761 Jul 25 12:42:41.861416 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 580/1153] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:41 2022] GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292 => generated 1480 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:41.866579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-25d94ba6-9c75-4607-9329-f3f8529db443 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:41.867193 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-25d94ba6-9c75-4607-9329-f3f8529db443 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:41.874090 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25d94ba6-9c75-4607-9329-f3f8529db443 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:41.874673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25d94ba6-9c75-4607-9329-f3f8529db443 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:41.875758 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25d94ba6-9c75-4607-9329-f3f8529db443 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:41.876420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25d94ba6-9c75-4607-9329-f3f8529db443 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:41.995630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-25d94ba6-9c75-4607-9329-f3f8529db443 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:42.015810 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-25d94ba6-9c75-4607-9329-f3f8529db443 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:42.021290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-25d94ba6-9c75-4607-9329-f3f8529db443 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:42.031322 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-25d94ba6-9c75-4607-9329-f3f8529db443 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1446 microversion: 2.75 time: 0.168655 Jul 25 12:42:42.032785 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 581/1154] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:41 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1446 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:42.038927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5cdf5715-028a-4e2a-89a2-c5729c45691c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:42.040378 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5cdf5715-028a-4e2a-89a2-c5729c45691c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 1c42ab74-7b7f-493e-a5b0-e0384beafd96] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:42.049396 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5cdf5715-028a-4e2a-89a2-c5729c45691c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:42.051264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5cdf5715-028a-4e2a-89a2-c5729c45691c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:42.052809 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5cdf5715-028a-4e2a-89a2-c5729c45691c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:42.053605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5cdf5715-028a-4e2a-89a2-c5729c45691c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:42.119155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-073eb9ab-704a-471b-a329-3bc345ec3aa0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:42.134743 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-073eb9ab-704a-471b-a329-3bc345ec3aa0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:42.136387 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-073eb9ab-704a-471b-a329-3bc345ec3aa0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:42.138551 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-073eb9ab-704a-471b-a329-3bc345ec3aa0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1810 microversion: 2.25 time: 0.395122 Jul 25 12:42:42.151815 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 574/1155] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:41 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1810 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:42.159177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bd6febe4-8d60-49cb-a3ef-60cc470d6a2e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:42.161503 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bd6febe4-8d60-49cb-a3ef-60cc470d6a2e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:42.176041 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd6febe4-8d60-49cb-a3ef-60cc470d6a2e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:42.178112 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd6febe4-8d60-49cb-a3ef-60cc470d6a2e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:42.182105 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd6febe4-8d60-49cb-a3ef-60cc470d6a2e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:42.182861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd6febe4-8d60-49cb-a3ef-60cc470d6a2e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:42.633212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5cdf5715-028a-4e2a-89a2-c5729c45691c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:42.642487 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5cdf5715-028a-4e2a-89a2-c5729c45691c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96" status: 200 len: 1316 microversion: 2.1 time: 0.608091 Jul 25 12:42:42.643096 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 582/1156] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:42 2022] GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96 => generated 1316 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:42.654536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0dad9c84-93e4-4b5b-a90b-a1d3b83c34b2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-28660253"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:42.663089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0dad9c84-93e4-4b5b-a90b-a1d3b83c34b2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c9c04c11-ce42-44b4-a6fd-7f7658a05292] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:42.680037 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0dad9c84-93e4-4b5b-a90b-a1d3b83c34b2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:42.680403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0dad9c84-93e4-4b5b-a90b-a1d3b83c34b2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:42.681206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0dad9c84-93e4-4b5b-a90b-a1d3b83c34b2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:42.681645 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0dad9c84-93e4-4b5b-a90b-a1d3b83c34b2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:42.859433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bd6febe4-8d60-49cb-a3ef-60cc470d6a2e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:42.880279 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bd6febe4-8d60-49cb-a3ef-60cc470d6a2e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1716 microversion: 2.1 time: 0.727055 Jul 25 12:42:42.885156 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 575/1157] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:42 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1716 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:42.898242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b718e193-c712-4948-9948-8c1a133c9ca7 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:42.899421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b718e193-c712-4948-9948-8c1a133c9ca7 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:42.916740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b718e193-c712-4948-9948-8c1a133c9ca7 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:42.917436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b718e193-c712-4948-9948-8c1a133c9ca7 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:42.920353 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b718e193-c712-4948-9948-8c1a133c9ca7 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:42.921541 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b718e193-c712-4948-9948-8c1a133c9ca7 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:43.002247 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0dad9c84-93e4-4b5b-a90b-a1d3b83c34b2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "POST /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292/action" status: 202 len: 0 microversion: 2.1 time: 0.357689 Jul 25 12:42:43.010180 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 583/1158] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:42:42 2022] POST /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 12:42:43.026698 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-fa93e7ab-01db-46e7-bc84-cc1a598d9866 req-21b943f0-64bc-4014-baf4-3b5e7b6acd8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2cc4389-ef66-4ad7-a6e5-ab70905b9620", "name": "network-vif-plugged", "status": "completed", "tag": "94f1f07a-a4dc-4d37-9c1f-822a76bcc0b8"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:43.048479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fa93e7ab-01db-46e7-bc84-cc1a598d9866 req-21b943f0-64bc-4014-baf4-3b5e7b6acd8f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:43.049315 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fa93e7ab-01db-46e7-bc84-cc1a598d9866 req-21b943f0-64bc-4014-baf4-3b5e7b6acd8f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:43.063908 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-fa93e7ab-01db-46e7-bc84-cc1a598d9866 req-21b943f0-64bc-4014-baf4-3b5e7b6acd8f service nova] Creating event network-vif-plugged:94f1f07a-a4dc-4d37-9c1f-822a76bcc0b8 for instance f2cc4389-ef66-4ad7-a6e5-ab70905b9620 on n-h2-848886-15 Jul 25 12:42:43.069563 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-fa93e7ab-01db-46e7-bc84-cc1a598d9866 req-21b943f0-64bc-4014-baf4-3b5e7b6acd8f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057392 Jul 25 12:42:43.070672 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 584/1159] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:43.076948 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-af302e36-c3b5-4a5e-b384-40f153e355d8 req-284eca74-9e53-499c-adc9-e4d4b6b7ad6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c42ab74-7b7f-493e-a5b0-e0384beafd96", "tag": "c39cff1c-5245-48af-82fe-4998aae199ab"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:43.089705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-af302e36-c3b5-4a5e-b384-40f153e355d8 req-284eca74-9e53-499c-adc9-e4d4b6b7ad6d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:43.090484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-af302e36-c3b5-4a5e-b384-40f153e355d8 req-284eca74-9e53-499c-adc9-e4d4b6b7ad6d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:43.106724 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-af302e36-c3b5-4a5e-b384-40f153e355d8 req-284eca74-9e53-499c-adc9-e4d4b6b7ad6d service nova] Creating event network-changed:c39cff1c-5245-48af-82fe-4998aae199ab for instance 1c42ab74-7b7f-493e-a5b0-e0384beafd96 on n-h2-848886-15 Jul 25 12:42:43.127152 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-af302e36-c3b5-4a5e-b384-40f153e355d8 req-284eca74-9e53-499c-adc9-e4d4b6b7ad6d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054008 Jul 25 12:42:43.128074 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 585/1160] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:43.137158 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8fd7f807-27b0-4d3e-8967-de2c67c103d9 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:43.138357 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8fd7f807-27b0-4d3e-8967-de2c67c103d9 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:43.149420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8fd7f807-27b0-4d3e-8967-de2c67c103d9 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:43.150656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8fd7f807-27b0-4d3e-8967-de2c67c103d9 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:43.151667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8fd7f807-27b0-4d3e-8967-de2c67c103d9 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:43.154107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8fd7f807-27b0-4d3e-8967-de2c67c103d9 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:43.372190 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b718e193-c712-4948-9948-8c1a133c9ca7 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:43.381518 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b718e193-c712-4948-9948-8c1a133c9ca7 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1313 microversion: 2.1 time: 0.494848 Jul 25 12:42:43.382434 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 576/1161] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:42 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1313 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:43.387780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1fd5271f-dace-4ac8-8c9b-de1b16e91b61 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9a28040>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:43.444582 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1fd5271f-dace-4ac8-8c9b-de1b16e91b61 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c" status: 200 len: 1436 microversion: 2.1 time: 0.059182 Jul 25 12:42:43.445387 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 577/1162] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:43 2022] GET /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c => generated 1436 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:43.464840 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b730bf45-ce73-4eed-9d8d-356c89cbf603 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:43.466690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b730bf45-ce73-4eed-9d8d-356c89cbf603 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:43.478037 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8fd7f807-27b0-4d3e-8967-de2c67c103d9 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:43.490494 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8fd7f807-27b0-4d3e-8967-de2c67c103d9 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1317 microversion: 2.1 time: 0.360978 Jul 25 12:42:43.491437 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 586/1163] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:43 2022] GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:43.493241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b730bf45-ce73-4eed-9d8d-356c89cbf603 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:43.493745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b730bf45-ce73-4eed-9d8d-356c89cbf603 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:43.497864 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b730bf45-ce73-4eed-9d8d-356c89cbf603 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:43.498473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b730bf45-ce73-4eed-9d8d-356c89cbf603 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:43.502798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-af7980ed-2c6f-4366-8df7-7717e801f524 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:43.503570 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-af7980ed-2c6f-4366-8df7-7717e801f524 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:43.515970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-af7980ed-2c6f-4366-8df7-7717e801f524 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:43.518366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-af7980ed-2c6f-4366-8df7-7717e801f524 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:43.519424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-af7980ed-2c6f-4366-8df7-7717e801f524 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:43.526650 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-af7980ed-2c6f-4366-8df7-7717e801f524 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:43.708066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b730bf45-ce73-4eed-9d8d-356c89cbf603 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:43.716631 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b730bf45-ce73-4eed-9d8d-356c89cbf603 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:43.718200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b730bf45-ce73-4eed-9d8d-356c89cbf603 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:43.742471 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b730bf45-ce73-4eed-9d8d-356c89cbf603 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1446 microversion: 2.75 time: 0.286046 Jul 25 12:42:43.746360 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 578/1164] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:43 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1446 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:43.756280 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e94eb3b6-996c-479d-9c54-145a7b3d1122 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:43.759636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e94eb3b6-996c-479d-9c54-145a7b3d1122 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 1c42ab74-7b7f-493e-a5b0-e0384beafd96] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:43.775761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e94eb3b6-996c-479d-9c54-145a7b3d1122 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:43.776500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e94eb3b6-996c-479d-9c54-145a7b3d1122 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:43.781030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e94eb3b6-996c-479d-9c54-145a7b3d1122 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:43.781696 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e94eb3b6-996c-479d-9c54-145a7b3d1122 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:43.827238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-af7980ed-2c6f-4366-8df7-7717e801f524 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:43.837273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-af7980ed-2c6f-4366-8df7-7717e801f524 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:43.849039 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-af7980ed-2c6f-4366-8df7-7717e801f524 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:43.850650 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-af7980ed-2c6f-4366-8df7-7717e801f524 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1800 microversion: 2.25 time: 0.358577 Jul 25 12:42:43.851421 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 587/1165] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:43 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1800 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:43.875352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-da2aa968-73f6-4bf9-a16e-17621bf7e7fb tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Calling method '.version_select at 0x7efcf9bac9d0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:43.879547 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da2aa968-73f6-4bf9-a16e-17621bf7e7fb tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:43.879985 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da2aa968-73f6-4bf9-a16e-17621bf7e7fb tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:43.893583 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-da2aa968-73f6-4bf9-a16e-17621bf7e7fb tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 4324 microversion: 2.25 time: 0.021775 Jul 25 12:42:43.906597 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 588/1166] 10.222.0.49 () {60 vars in 1184 bytes} [Mon Jul 25 12:42:43 2022] GET /compute/v2.1/os-migrations => generated 4324 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:42:43.912745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-33dc4afb-4de7-4f86-afcc-dd783d25ec0e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:43.913857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-33dc4afb-4de7-4f86-afcc-dd783d25ec0e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:43.920662 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-33dc4afb-4de7-4f86-afcc-dd783d25ec0e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:43.921364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-33dc4afb-4de7-4f86-afcc-dd783d25ec0e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:43.922311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-33dc4afb-4de7-4f86-afcc-dd783d25ec0e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:43.922931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-33dc4afb-4de7-4f86-afcc-dd783d25ec0e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:44.015465 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e94eb3b6-996c-479d-9c54-145a7b3d1122 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:44.025915 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e94eb3b6-996c-479d-9c54-145a7b3d1122 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96" status: 200 len: 1316 microversion: 2.1 time: 0.277547 Jul 25 12:42:44.026803 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 579/1167] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:43 2022] GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96 => generated 1316 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:44.046275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6e41367e-7827-4a96-bf33-39167160bfd7 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:44.047164 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6e41367e-7827-4a96-bf33-39167160bfd7 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:44.053973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6e41367e-7827-4a96-bf33-39167160bfd7 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:44.054668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6e41367e-7827-4a96-bf33-39167160bfd7 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:44.055626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6e41367e-7827-4a96-bf33-39167160bfd7 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:44.056245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6e41367e-7827-4a96-bf33-39167160bfd7 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:44.114324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-33dc4afb-4de7-4f86-afcc-dd783d25ec0e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:44.120894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:44.124363 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-33dc4afb-4de7-4f86-afcc-dd783d25ec0e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1716 microversion: 2.1 time: 0.216474 Jul 25 12:42:44.125124 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 589/1168] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:43 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1716 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:44.229886 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-6e41367e-7827-4a96-bf33-39167160bfd7 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lazy-loading 'services' on Instance uuid c18f0b76-5dab-4e09-afb8-8a1de682b042 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:42:44.246171 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6e41367e-7827-4a96-bf33-39167160bfd7 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 2420 microversion: 2.25 time: 0.203600 Jul 25 12:42:44.247344 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 580/1169] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:44 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 2420 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:44.279201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-28ff0811-f57b-4374-bd34-76c9e72650fd tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:44.280122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-28ff0811-f57b-4374-bd34-76c9e72650fd tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:44.286834 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-28ff0811-f57b-4374-bd34-76c9e72650fd tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:44.287432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-28ff0811-f57b-4374-bd34-76c9e72650fd tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:44.288279 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-28ff0811-f57b-4374-bd34-76c9e72650fd tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:44.288720 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-28ff0811-f57b-4374-bd34-76c9e72650fd tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:44.406246 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2487e169-e4e3-4718-b8ed-a6d3880f4692 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:44.407219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2487e169-e4e3-4718-b8ed-a6d3880f4692 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:44.416567 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2487e169-e4e3-4718-b8ed-a6d3880f4692 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:44.416950 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2487e169-e4e3-4718-b8ed-a6d3880f4692 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:44.417941 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2487e169-e4e3-4718-b8ed-a6d3880f4692 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:44.418356 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2487e169-e4e3-4718-b8ed-a6d3880f4692 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:44.548955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-28ff0811-f57b-4374-bd34-76c9e72650fd tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lazy-loading 'services' on Instance uuid c18f0b76-5dab-4e09-afb8-8a1de682b042 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:42:44.576991 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-28ff0811-f57b-4374-bd34-76c9e72650fd tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 2420 microversion: 2.25 time: 0.302571 Jul 25 12:42:44.586710 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 590/1170] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:44 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 2420 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:44.591871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-50001019-0b09-4f42-a493-2ae7b293356a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9c04ca0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:44.631359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2487e169-e4e3-4718-b8ed-a6d3880f4692 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:44.642776 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2487e169-e4e3-4718-b8ed-a6d3880f4692 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1313 microversion: 2.1 time: 0.241338 Jul 25 12:42:44.644221 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 581/1171] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:44 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:44.659277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d11f8230-f8fd-4f5c-8105-11f3b098f4f3 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:44.660965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d11f8230-f8fd-4f5c-8105-11f3b098f4f3 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:44.667878 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-50001019-0b09-4f42-a493-2ae7b293356a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c" status: 200 len: 1436 microversion: 2.1 time: 0.079902 Jul 25 12:42:44.669261 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 591/1172] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:44 2022] GET /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c => generated 1436 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:44.676530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d11f8230-f8fd-4f5c-8105-11f3b098f4f3 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:44.676994 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d11f8230-f8fd-4f5c-8105-11f3b098f4f3 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:44.677795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d11f8230-f8fd-4f5c-8105-11f3b098f4f3 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:44.678277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d11f8230-f8fd-4f5c-8105-11f3b098f4f3 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:44.703431 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d0dc12f6-08aa-4c89-a327-d3e566010346 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:44.703927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d0dc12f6-08aa-4c89-a327-d3e566010346 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:44.710879 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d0dc12f6-08aa-4c89-a327-d3e566010346 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:44.711326 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d0dc12f6-08aa-4c89-a327-d3e566010346 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:44.712704 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d0dc12f6-08aa-4c89-a327-d3e566010346 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:44.713141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d0dc12f6-08aa-4c89-a327-d3e566010346 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:44.826057 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d11f8230-f8fd-4f5c-8105-11f3b098f4f3 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:44.835043 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d11f8230-f8fd-4f5c-8105-11f3b098f4f3 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1317 microversion: 2.1 time: 0.188206 Jul 25 12:42:44.850789 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 582/1173] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:44 2022] GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:44.855804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-def4e5ad-7200-4017-8560-c133b6dcf911 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:44.856659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-def4e5ad-7200-4017-8560-c133b6dcf911 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:44.866649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-def4e5ad-7200-4017-8560-c133b6dcf911 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:44.867287 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-def4e5ad-7200-4017-8560-c133b6dcf911 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:44.868259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-def4e5ad-7200-4017-8560-c133b6dcf911 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:44.869220 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-def4e5ad-7200-4017-8560-c133b6dcf911 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:44.876329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-d0dc12f6-08aa-4c89-a327-d3e566010346 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lazy-loading 'services' on Instance uuid c18f0b76-5dab-4e09-afb8-8a1de682b042 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:42:44.997305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-def4e5ad-7200-4017-8560-c133b6dcf911 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:45.014016 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-def4e5ad-7200-4017-8560-c133b6dcf911 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:45.018805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-def4e5ad-7200-4017-8560-c133b6dcf911 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:45.035021 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-def4e5ad-7200-4017-8560-c133b6dcf911 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1446 microversion: 2.75 time: 0.182823 Jul 25 12:42:45.036320 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 583/1174] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:44 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1446 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:45.052755 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d0dc12f6-08aa-4c89-a327-d3e566010346 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/os-volume_attachments/35050ae4-0fb9-4de9-9623-e06491e15233" status: 202 len: 0 microversion: 2.25 time: 0.353290 Jul 25 12:42:45.053547 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 592/1175] 10.222.0.49 () {60 vars in 1457 bytes} [Mon Jul 25 12:42:44 2022] DELETE /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/os-volume_attachments/35050ae4-0fb9-4de9-9623-e06491e15233 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:42:45.058130 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0610d73e-23a1-40fc-968f-2f5d22244614 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:45.060742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0610d73e-23a1-40fc-968f-2f5d22244614 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 1c42ab74-7b7f-493e-a5b0-e0384beafd96] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:45.062786 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f7e5229c-4ce1-4e39-9c02-474831a18d86 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:45.065396 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f7e5229c-4ce1-4e39-9c02-474831a18d86 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:45.081310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7e5229c-4ce1-4e39-9c02-474831a18d86 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:45.081444 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7e5229c-4ce1-4e39-9c02-474831a18d86 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:45.082266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7e5229c-4ce1-4e39-9c02-474831a18d86 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:45.082715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7e5229c-4ce1-4e39-9c02-474831a18d86 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:45.083154 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0610d73e-23a1-40fc-968f-2f5d22244614 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:45.084204 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0610d73e-23a1-40fc-968f-2f5d22244614 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:45.085237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0610d73e-23a1-40fc-968f-2f5d22244614 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:45.086069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0610d73e-23a1-40fc-968f-2f5d22244614 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:45.103517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:45.169337 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f7e5229c-4ce1-4e39-9c02-474831a18d86 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.111254 Jul 25 12:42:45.176872 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 593/1176] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Jul 25 12:42:45 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:42:45.182969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-f87a3eae-5ced-4b14-b14b-a5e251ebd362 req-1f18563e-17ed-47b3-929a-25fcd774394a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb5975b-24da-4318-90ce-bd3b7d0d01f2", "name": "network-vif-plugged", "status": "completed", "tag": "0012b1f8-03b2-4861-88f2-461bdd29f4d1"}, {"server_uuid": "159b5add-9666-4a2a-82e7-7571a120cabb", "name": "network-vif-plugged", "status": "completed", "tag": "27e87312-289e-4818-b884-b357c21f7a9f"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:45.198190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f87a3eae-5ced-4b14-b14b-a5e251ebd362 req-1f18563e-17ed-47b3-929a-25fcd774394a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:45.198842 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f87a3eae-5ced-4b14-b14b-a5e251ebd362 req-1f18563e-17ed-47b3-929a-25fcd774394a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:45.213262 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-f87a3eae-5ced-4b14-b14b-a5e251ebd362 req-1f18563e-17ed-47b3-929a-25fcd774394a service nova] Creating event network-vif-plugged:0012b1f8-03b2-4861-88f2-461bdd29f4d1 for instance 7eb5975b-24da-4318-90ce-bd3b7d0d01f2 on n-h2-848886-15 Jul 25 12:42:45.214061 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-f87a3eae-5ced-4b14-b14b-a5e251ebd362 req-1f18563e-17ed-47b3-929a-25fcd774394a service nova] Creating event network-vif-plugged:27e87312-289e-4818-b884-b357c21f7a9f for instance 159b5add-9666-4a2a-82e7-7571a120cabb on n-h2-848886-15 Jul 25 12:42:45.231816 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-f87a3eae-5ced-4b14-b14b-a5e251ebd362 req-1f18563e-17ed-47b3-929a-25fcd774394a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052162 Jul 25 12:42:45.232134 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 594/1177] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:45.239269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fc5ebfe6-b5f5-4188-9b77-f9900d4135a7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:45.239968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fc5ebfe6-b5f5-4188-9b77-f9900d4135a7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:45.246447 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc5ebfe6-b5f5-4188-9b77-f9900d4135a7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:45.246892 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc5ebfe6-b5f5-4188-9b77-f9900d4135a7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:45.248073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc5ebfe6-b5f5-4188-9b77-f9900d4135a7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:45.248677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc5ebfe6-b5f5-4188-9b77-f9900d4135a7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:45.381775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0610d73e-23a1-40fc-968f-2f5d22244614 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:45.390695 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0610d73e-23a1-40fc-968f-2f5d22244614 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96" status: 200 len: 1316 microversion: 2.1 time: 0.339199 Jul 25 12:42:45.405027 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 584/1178] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:45 2022] GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96 => generated 1316 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:42:45.447170 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fc5ebfe6-b5f5-4188-9b77-f9900d4135a7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:45.456043 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fc5ebfe6-b5f5-4188-9b77-f9900d4135a7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1716 microversion: 2.1 time: 0.221476 Jul 25 12:42:45.456620 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 595/1179] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:45 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1716 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:45.526206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-62d9bcb0-96e4-41b6-81f2-de06e27359f4 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1245758093", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:45.578295 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-62d9bcb0-96e4-41b6-81f2-de06e27359f4 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] validate_networks() for [('c8484052-ee86-4e45-a84b-61b3e2a22acb', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:42:45.664649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a3000233-26a2-4ec1-a426-1de3ec8e675a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:45.665266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a3000233-26a2-4ec1-a426-1de3ec8e675a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:45.671746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3000233-26a2-4ec1-a426-1de3ec8e675a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:45.672188 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3000233-26a2-4ec1-a426-1de3ec8e675a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:45.673073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3000233-26a2-4ec1-a426-1de3ec8e675a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:45.673513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3000233-26a2-4ec1-a426-1de3ec8e675a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:45.692318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:46.005104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a3000233-26a2-4ec1-a426-1de3ec8e675a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:46.022732 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a3000233-26a2-4ec1-a426-1de3ec8e675a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1313 microversion: 2.1 time: 0.362002 Jul 25 12:42:46.023929 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 596/1180] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:45 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:46.029018 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a6b8a0d2-156f-41d8-adf0-4456b3b30956 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9b5eee0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:46.045713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=8 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:46.080322 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a6b8a0d2-156f-41d8-adf0-4456b3b30956 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c" status: 200 len: 1436 microversion: 2.1 time: 0.055177 Jul 25 12:42:46.081704 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 597/1181] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:46 2022] GET /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c => generated 1436 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:46.085900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a7a60ca0-65c5-463c-9b37-f12028ee00b5 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:46.086519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a7a60ca0-65c5-463c-9b37-f12028ee00b5 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:46.094161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7a60ca0-65c5-463c-9b37-f12028ee00b5 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:46.094714 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7a60ca0-65c5-463c-9b37-f12028ee00b5 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:46.095721 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7a60ca0-65c5-463c-9b37-f12028ee00b5 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:46.096151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7a60ca0-65c5-463c-9b37-f12028ee00b5 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:46.777805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-62d9bcb0-96e4-41b6-81f2-de06e27359f4 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:42:46.778450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-62d9bcb0-96e4-41b6-81f2-de06e27359f4 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:42:46.779184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-62d9bcb0-96e4-41b6-81f2-de06e27359f4 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:42:46.779852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-62d9bcb0-96e4-41b6-81f2-de06e27359f4 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:42:46.780346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-62d9bcb0-96e4-41b6-81f2-de06e27359f4 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:42:46.793899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62d9bcb0-96e4-41b6-81f2-de06e27359f4 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:46.794573 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62d9bcb0-96e4-41b6-81f2-de06e27359f4 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:46.795476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62d9bcb0-96e4-41b6-81f2-de06e27359f4 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:46.796800 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62d9bcb0-96e4-41b6-81f2-de06e27359f4 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:46.875631 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-62d9bcb0-96e4-41b6-81f2-de06e27359f4 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Getting quotas for project 7c39943d13c4455a8b7a18cce243d079. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:42:46.898578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-62d9bcb0-96e4-41b6-81f2-de06e27359f4 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Getting quotas for user 66746994c09d40edb7f51ca444b7a5a7 and project 7c39943d13c4455a8b7a18cce243d079. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:42:46.939573 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-62d9bcb0-96e4-41b6-81f2-de06e27359f4 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:42:46.946157 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-62d9bcb0-96e4-41b6-81f2-de06e27359f4 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:42:47.036196 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-62d9bcb0-96e4-41b6-81f2-de06e27359f4 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.629433 Jul 25 12:42:47.038802 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 585/1182] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:42:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 1633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:42:47.045029 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-adc03911-c607-42fd-b2cc-0d7778a58bef tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:47.046291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-adc03911-c607-42fd-b2cc-0d7778a58bef tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:47.055027 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-adc03911-c607-42fd-b2cc-0d7778a58bef tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:47.056372 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-adc03911-c607-42fd-b2cc-0d7778a58bef tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:47.057387 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-adc03911-c607-42fd-b2cc-0d7778a58bef tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:47.058442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-adc03911-c607-42fd-b2cc-0d7778a58bef tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:47.260854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a7a60ca0-65c5-463c-9b37-f12028ee00b5 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:47.267663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-adc03911-c607-42fd-b2cc-0d7778a58bef tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:47.279498 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a7a60ca0-65c5-463c-9b37-f12028ee00b5 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1317 microversion: 2.1 time: 1.197459 Jul 25 12:42:47.282129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-adc03911-c607-42fd-b2cc-0d7778a58bef tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:47.283831 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-adc03911-c607-42fd-b2cc-0d7778a58bef tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:47.292703 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 598/1183] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:46 2022] GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1317 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:47.292915 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-adc03911-c607-42fd-b2cc-0d7778a58bef tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1446 microversion: 2.75 time: 0.252817 Jul 25 12:42:47.293664 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 586/1184] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:47 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1446 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:47.300398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-80067929-18f6-450b-a157-ec9f559e7cd0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:47.301242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-80067929-18f6-450b-a157-ec9f559e7cd0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 1c42ab74-7b7f-493e-a5b0-e0384beafd96] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:47.310006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ac273ade-87e9-4150-9933-7040b41273a7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:47.312304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ac273ade-87e9-4150-9933-7040b41273a7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:47.312824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80067929-18f6-450b-a157-ec9f559e7cd0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:47.313331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80067929-18f6-450b-a157-ec9f559e7cd0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:47.314159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80067929-18f6-450b-a157-ec9f559e7cd0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:47.314767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80067929-18f6-450b-a157-ec9f559e7cd0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:47.329106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac273ade-87e9-4150-9933-7040b41273a7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:47.329931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac273ade-87e9-4150-9933-7040b41273a7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:47.330924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac273ade-87e9-4150-9933-7040b41273a7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:47.331619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac273ade-87e9-4150-9933-7040b41273a7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:47.399986 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ac273ade-87e9-4150-9933-7040b41273a7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.105453 Jul 25 12:42:47.409459 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 599/1185] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Jul 25 12:42:47 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:42:47.420171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a941c478-f565-4712-bbc8-8374d241ba8a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:47.421165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a941c478-f565-4712-bbc8-8374d241ba8a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:47.438323 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a941c478-f565-4712-bbc8-8374d241ba8a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:47.439198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a941c478-f565-4712-bbc8-8374d241ba8a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:47.440543 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a941c478-f565-4712-bbc8-8374d241ba8a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:47.443993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a941c478-f565-4712-bbc8-8374d241ba8a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:47.799494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-80067929-18f6-450b-a157-ec9f559e7cd0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:47.809415 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-80067929-18f6-450b-a157-ec9f559e7cd0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96" status: 200 len: 1316 microversion: 2.1 time: 0.514511 Jul 25 12:42:47.811915 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 587/1186] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:47 2022] GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96 => generated 1316 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:47.831797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-61120b36-94ec-469e-bd9e-ac3f4d26e0f9 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:47.832435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-61120b36-94ec-469e-bd9e-ac3f4d26e0f9 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:47.851439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-61120b36-94ec-469e-bd9e-ac3f4d26e0f9 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:47.852300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-61120b36-94ec-469e-bd9e-ac3f4d26e0f9 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:47.853895 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-61120b36-94ec-469e-bd9e-ac3f4d26e0f9 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:47.855140 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-61120b36-94ec-469e-bd9e-ac3f4d26e0f9 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:48.045134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-61120b36-94ec-469e-bd9e-ac3f4d26e0f9 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:48.059068 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-61120b36-94ec-469e-bd9e-ac3f4d26e0f9 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1218 microversion: 2.1 time: 0.244769 Jul 25 12:42:48.061483 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 588/1187] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:47 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1218 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:48.068582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-16d3be3a-9aa1-431e-8959-7463553fd2f8 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:48.069459 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-16d3be3a-9aa1-431e-8959-7463553fd2f8 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:48.081017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16d3be3a-9aa1-431e-8959-7463553fd2f8 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:48.082163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16d3be3a-9aa1-431e-8959-7463553fd2f8 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:48.083414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16d3be3a-9aa1-431e-8959-7463553fd2f8 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:48.084859 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16d3be3a-9aa1-431e-8959-7463553fd2f8 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:48.181611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a941c478-f565-4712-bbc8-8374d241ba8a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:48.190252 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a941c478-f565-4712-bbc8-8374d241ba8a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1716 microversion: 2.1 time: 0.778033 Jul 25 12:42:48.194352 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 600/1188] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:47 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1716 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:48.202753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-264e89da-16b8-4f46-8717-56595031b9f1 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9b40700>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:48.283162 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-264e89da-16b8-4f46-8717-56595031b9f1 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c" status: 200 len: 1436 microversion: 2.1 time: 0.086898 Jul 25 12:42:48.284838 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 601/1189] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:48 2022] GET /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c => generated 1436 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:48.303664 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cf522473-bc2d-4964-8ff4-d726239f4521 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:48.306778 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cf522473-bc2d-4964-8ff4-d726239f4521 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:48.327664 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf522473-bc2d-4964-8ff4-d726239f4521 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:48.330353 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf522473-bc2d-4964-8ff4-d726239f4521 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:48.331388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf522473-bc2d-4964-8ff4-d726239f4521 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:48.334503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf522473-bc2d-4964-8ff4-d726239f4521 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:48.842486 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-16d3be3a-9aa1-431e-8959-7463553fd2f8 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:48.851167 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-16d3be3a-9aa1-431e-8959-7463553fd2f8 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1313 microversion: 2.1 time: 0.788435 Jul 25 12:42:48.861139 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 589/1190] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:48 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1313 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:48.878265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c3a02389-e832-4d3d-b478-49a31a8a699a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:48.879333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c3a02389-e832-4d3d-b478-49a31a8a699a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:48.893491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3a02389-e832-4d3d-b478-49a31a8a699a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:48.894419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3a02389-e832-4d3d-b478-49a31a8a699a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:48.897059 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3a02389-e832-4d3d-b478-49a31a8a699a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:48.897776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3a02389-e832-4d3d-b478-49a31a8a699a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:49.371114 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cf522473-bc2d-4964-8ff4-d726239f4521 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:49.386633 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cf522473-bc2d-4964-8ff4-d726239f4521 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1467 microversion: 2.1 time: 1.088537 Jul 25 12:42:49.405729 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 602/1191] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:48 2022] GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1467 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:49.414293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b0ce43a4-aa4c-4970-b158-43b8903ecce0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:49.417676 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b0ce43a4-aa4c-4970-b158-43b8903ecce0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:49.432358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0ce43a4-aa4c-4970-b158-43b8903ecce0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:49.433146 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0ce43a4-aa4c-4970-b158-43b8903ecce0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:49.434349 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0ce43a4-aa4c-4970-b158-43b8903ecce0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:49.435072 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0ce43a4-aa4c-4970-b158-43b8903ecce0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:49.511412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c3a02389-e832-4d3d-b478-49a31a8a699a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:49.522714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c3a02389-e832-4d3d-b478-49a31a8a699a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:49.527590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c3a02389-e832-4d3d-b478-49a31a8a699a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:49.529282 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b0ce43a4-aa4c-4970-b158-43b8903ecce0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.123630 Jul 25 12:42:49.530771 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 603/1192] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Jul 25 12:42:49 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:42:49.543563 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c3a02389-e832-4d3d-b478-49a31a8a699a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1446 microversion: 2.75 time: 0.679835 Jul 25 12:42:49.544900 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 590/1193] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:48 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1446 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:49.550017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-177485f7-3bce-4090-b451-beff489ac820 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:49.551873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-177485f7-3bce-4090-b451-beff489ac820 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 1c42ab74-7b7f-493e-a5b0-e0384beafd96] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:49.555682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-01c8a919-1945-45d7-9db9-a0b98ffb2b2a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:49.566086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-01c8a919-1945-45d7-9db9-a0b98ffb2b2a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:49.567481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-177485f7-3bce-4090-b451-beff489ac820 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:49.569571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-177485f7-3bce-4090-b451-beff489ac820 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:49.574838 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-177485f7-3bce-4090-b451-beff489ac820 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:49.575299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-177485f7-3bce-4090-b451-beff489ac820 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:49.589339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01c8a919-1945-45d7-9db9-a0b98ffb2b2a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:49.598754 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01c8a919-1945-45d7-9db9-a0b98ffb2b2a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:49.599836 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01c8a919-1945-45d7-9db9-a0b98ffb2b2a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:49.608363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01c8a919-1945-45d7-9db9-a0b98ffb2b2a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:50.142632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-01c8a919-1945-45d7-9db9-a0b98ffb2b2a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:50.154604 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-01c8a919-1945-45d7-9db9-a0b98ffb2b2a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1272 microversion: 2.1 time: 0.604950 Jul 25 12:42:50.157456 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 591/1194] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:49 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1272 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:50.181293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c0a51051-c4e9-4fed-aff1-a2dfa4bd843c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:50.182181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c0a51051-c4e9-4fed-aff1-a2dfa4bd843c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:50.202294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0a51051-c4e9-4fed-aff1-a2dfa4bd843c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:50.204974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0a51051-c4e9-4fed-aff1-a2dfa4bd843c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:50.209166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0a51051-c4e9-4fed-aff1-a2dfa4bd843c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:50.211182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0a51051-c4e9-4fed-aff1-a2dfa4bd843c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:50.652847 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-177485f7-3bce-4090-b451-beff489ac820 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:50.662967 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-177485f7-3bce-4090-b451-beff489ac820 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96" status: 200 len: 1316 microversion: 2.1 time: 1.130053 Jul 25 12:42:50.668562 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c0a51051-c4e9-4fed-aff1-a2dfa4bd843c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:50.678050 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c0a51051-c4e9-4fed-aff1-a2dfa4bd843c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1716 microversion: 2.1 time: 0.510379 Jul 25 12:42:50.678681 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 592/1195] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:50 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1716 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:50.695221 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 604/1196] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:49 2022] GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96 => generated 1316 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:50.709370 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a01f2c68-1b2a-4ff9-b12f-7e0e0ebf7a6d tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:50.710081 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a01f2c68-1b2a-4ff9-b12f-7e0e0ebf7a6d tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: 159b5add-9666-4a2a-82e7-7571a120cabb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:50.716976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ca89abf5-ba7b-4284-ac31-fa26f3e09858 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf98b53a0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:50.727859 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a01f2c68-1b2a-4ff9-b12f-7e0e0ebf7a6d tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:50.728397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a01f2c68-1b2a-4ff9-b12f-7e0e0ebf7a6d tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:50.729452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a01f2c68-1b2a-4ff9-b12f-7e0e0ebf7a6d tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:50.738044 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a01f2c68-1b2a-4ff9-b12f-7e0e0ebf7a6d tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:50.811087 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ca89abf5-ba7b-4284-ac31-fa26f3e09858 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c" status: 200 len: 1436 microversion: 2.1 time: 0.108884 Jul 25 12:42:50.811843 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 593/1197] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:50 2022] GET /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c => generated 1436 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:50.827553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-227231c3-d470-4a64-9263-fe7cdb6d4387 req-afd05b43-08d7-41d0-949c-1af855faa50f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9c04c11-ce42-44b4-a6fd-7f7658a05292", "name": "network-vif-plugged", "status": "completed", "tag": "3844a30a-3f07-4f1e-9005-38e3c53d311a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:50.867953 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-227231c3-d470-4a64-9263-fe7cdb6d4387 req-afd05b43-08d7-41d0-949c-1af855faa50f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:50.868597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-227231c3-d470-4a64-9263-fe7cdb6d4387 req-afd05b43-08d7-41d0-949c-1af855faa50f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:50.902962 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-227231c3-d470-4a64-9263-fe7cdb6d4387 req-afd05b43-08d7-41d0-949c-1af855faa50f service nova] Creating event network-vif-plugged:3844a30a-3f07-4f1e-9005-38e3c53d311a for instance c9c04c11-ce42-44b4-a6fd-7f7658a05292 on n-h1-848886-15 Jul 25 12:42:50.915351 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-227231c3-d470-4a64-9263-fe7cdb6d4387 req-afd05b43-08d7-41d0-949c-1af855faa50f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101557 Jul 25 12:42:50.922452 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 594/1198] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:50.936733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cb0ad092-8053-4f98-8c3e-2404238c328b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:50.941005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cb0ad092-8053-4f98-8c3e-2404238c328b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:50.962251 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb0ad092-8053-4f98-8c3e-2404238c328b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:50.963247 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb0ad092-8053-4f98-8c3e-2404238c328b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:50.966559 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb0ad092-8053-4f98-8c3e-2404238c328b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:50.967158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb0ad092-8053-4f98-8c3e-2404238c328b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:51.325190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a01f2c68-1b2a-4ff9-b12f-7e0e0ebf7a6d tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:51.332948 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a01f2c68-1b2a-4ff9-b12f-7e0e0ebf7a6d tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/159b5add-9666-4a2a-82e7-7571a120cabb" status: 200 len: 1467 microversion: 2.1 time: 0.636354 Jul 25 12:42:51.342261 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 605/1199] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:50 2022] GET /compute/v2.1/servers/159b5add-9666-4a2a-82e7-7571a120cabb => generated 1467 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:51.352429 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-161b960e-9b95-4a7d-9eee-6ae8ad9960c7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:51.362508 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-161b960e-9b95-4a7d-9eee-6ae8ad9960c7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:51.385532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-161b960e-9b95-4a7d-9eee-6ae8ad9960c7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:51.398276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-161b960e-9b95-4a7d-9eee-6ae8ad9960c7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:51.399280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-161b960e-9b95-4a7d-9eee-6ae8ad9960c7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:51.401801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-161b960e-9b95-4a7d-9eee-6ae8ad9960c7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:51.512853 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-161b960e-9b95-4a7d-9eee-6ae8ad9960c7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.169163 Jul 25 12:42:51.522186 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 606/1200] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Jul 25 12:42:51 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:42:51.531820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-472bcd0c-c5ad-4625-8d82-e981392eb2d4 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:51.532513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-472bcd0c-c5ad-4625-8d82-e981392eb2d4 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:51.548270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-472bcd0c-c5ad-4625-8d82-e981392eb2d4 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:51.548725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-472bcd0c-c5ad-4625-8d82-e981392eb2d4 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:51.549516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-472bcd0c-c5ad-4625-8d82-e981392eb2d4 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:51.549978 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-472bcd0c-c5ad-4625-8d82-e981392eb2d4 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:51.609621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cb0ad092-8053-4f98-8c3e-2404238c328b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:51.618755 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cb0ad092-8053-4f98-8c3e-2404238c328b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1463 microversion: 2.1 time: 0.693355 Jul 25 12:42:51.639761 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 595/1201] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:50 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1463 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:51.666757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-49517bd3-3a55-4c47-9eff-0c506baddd90 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:51.667918 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-49517bd3-3a55-4c47-9eff-0c506baddd90 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:51.697515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-49517bd3-3a55-4c47-9eff-0c506baddd90 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:51.706226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-49517bd3-3a55-4c47-9eff-0c506baddd90 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:51.707324 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-49517bd3-3a55-4c47-9eff-0c506baddd90 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:51.709772 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-49517bd3-3a55-4c47-9eff-0c506baddd90 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:51.775404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-472bcd0c-c5ad-4625-8d82-e981392eb2d4 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:51.790148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-472bcd0c-c5ad-4625-8d82-e981392eb2d4 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:51.792176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-472bcd0c-c5ad-4625-8d82-e981392eb2d4 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:51.819263 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-472bcd0c-c5ad-4625-8d82-e981392eb2d4 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1446 microversion: 2.75 time: 0.294362 Jul 25 12:42:51.835732 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 607/1202] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:51 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1446 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:51.859509 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-86d50158-accf-42e4-bbf2-b06002e7a86f tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-47390149"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:51.862983 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-86d50158-accf-42e4-bbf2-b06002e7a86f tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: 159b5add-9666-4a2a-82e7-7571a120cabb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:51.879923 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-86d50158-accf-42e4-bbf2-b06002e7a86f tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:51.880724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-86d50158-accf-42e4-bbf2-b06002e7a86f tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:51.883920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-86d50158-accf-42e4-bbf2-b06002e7a86f tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:51.884636 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-86d50158-accf-42e4-bbf2-b06002e7a86f tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:52.174476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-49517bd3-3a55-4c47-9eff-0c506baddd90 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:52.185734 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-49517bd3-3a55-4c47-9eff-0c506baddd90 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1314 microversion: 2.1 time: 0.540184 Jul 25 12:42:52.186318 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 596/1203] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:51 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:52.226908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-78aaeaba-6b4b-40b4-9819-fb56481ba69e tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:52.229365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-78aaeaba-6b4b-40b4-9819-fb56481ba69e tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:52.265317 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78aaeaba-6b4b-40b4-9819-fb56481ba69e tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:52.266890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78aaeaba-6b4b-40b4-9819-fb56481ba69e tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:52.270078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78aaeaba-6b4b-40b4-9819-fb56481ba69e tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:52.273684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78aaeaba-6b4b-40b4-9819-fb56481ba69e tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:52.300131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:52.460155 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-86d50158-accf-42e4-bbf2-b06002e7a86f tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "POST /compute/v2.1/servers/159b5add-9666-4a2a-82e7-7571a120cabb/action" status: 202 len: 0 microversion: 2.1 time: 0.613536 Jul 25 12:42:52.470252 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 608/1204] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:42:51 2022] POST /compute/v2.1/servers/159b5add-9666-4a2a-82e7-7571a120cabb/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 12:42:52.490836 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fbdfd6e8-540f-42d7-894a-7fa54039a0e5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:52.493771 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fbdfd6e8-540f-42d7-894a-7fa54039a0e5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 1c42ab74-7b7f-493e-a5b0-e0384beafd96] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:52.535353 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fbdfd6e8-540f-42d7-894a-7fa54039a0e5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:52.535786 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fbdfd6e8-540f-42d7-894a-7fa54039a0e5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:52.544251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fbdfd6e8-540f-42d7-894a-7fa54039a0e5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:52.544731 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fbdfd6e8-540f-42d7-894a-7fa54039a0e5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:52.830461 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-78aaeaba-6b4b-40b4-9819-fb56481ba69e tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1616 microversion: 2.1 time: 0.632770 Jul 25 12:42:52.832762 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 597/1205] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:52 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1616 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:52.845821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cd7154ff-b2c5-4c04-a695-f83d6aec8a6b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:52.846910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cd7154ff-b2c5-4c04-a695-f83d6aec8a6b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:52.857562 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd7154ff-b2c5-4c04-a695-f83d6aec8a6b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:52.858279 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd7154ff-b2c5-4c04-a695-f83d6aec8a6b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:52.859279 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd7154ff-b2c5-4c04-a695-f83d6aec8a6b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:52.859994 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd7154ff-b2c5-4c04-a695-f83d6aec8a6b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:52.981645 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fbdfd6e8-540f-42d7-894a-7fa54039a0e5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:52.992237 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fbdfd6e8-540f-42d7-894a-7fa54039a0e5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96" status: 200 len: 1316 microversion: 2.1 time: 0.520231 Jul 25 12:42:52.996487 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 609/1206] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:52 2022] GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96 => generated 1316 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:53.008057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4aae5d2e-8be8-43ed-a3b7-11c52c49b13c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9bcaa60>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:53.092794 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4aae5d2e-8be8-43ed-a3b7-11c52c49b13c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c" status: 200 len: 1436 microversion: 2.1 time: 0.094922 Jul 25 12:42:53.093795 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 610/1207] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:52 2022] GET /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c => generated 1436 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:53.099812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-eab63a79-9a5a-45fc-9e55-608de4d70afc req-0a13ab48-9d6d-4f83-b375-c60a81b8de7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d4a19ea-699a-40fe-a620-9bf5305da67c", "tag": "b1a768b8-dfe9-40eb-a595-524fadb9cb2c"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:53.111155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-eab63a79-9a5a-45fc-9e55-608de4d70afc req-0a13ab48-9d6d-4f83-b375-c60a81b8de7f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:53.112058 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-eab63a79-9a5a-45fc-9e55-608de4d70afc req-0a13ab48-9d6d-4f83-b375-c60a81b8de7f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:53.126114 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-eab63a79-9a5a-45fc-9e55-608de4d70afc req-0a13ab48-9d6d-4f83-b375-c60a81b8de7f service nova] Creating event network-changed:b1a768b8-dfe9-40eb-a595-524fadb9cb2c for instance 2d4a19ea-699a-40fe-a620-9bf5305da67c on n-h1-848886-15 Jul 25 12:42:53.134890 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-eab63a79-9a5a-45fc-9e55-608de4d70afc req-0a13ab48-9d6d-4f83-b375-c60a81b8de7f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039538 Jul 25 12:42:53.137627 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 611/1208] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:53.145479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8a25522b-907e-4fac-89c8-e3abcbc44a63 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9f82af0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:53.176468 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cd7154ff-b2c5-4c04-a695-f83d6aec8a6b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:53.185899 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cd7154ff-b2c5-4c04-a695-f83d6aec8a6b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1716 microversion: 2.1 time: 0.350872 Jul 25 12:42:53.186508 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 598/1209] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:52 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1716 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:53.212524 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-62926076-1dd6-411c-b8c5-727f8351b91b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:53.223467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-62926076-1dd6-411c-b8c5-727f8351b91b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:53.225247 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8a25522b-907e-4fac-89c8-e3abcbc44a63 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/77580041-bccb-4492-803a-43484ed1a352" status: 200 len: 1447 microversion: 2.1 time: 0.085920 Jul 25 12:42:53.225910 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 612/1210] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:53 2022] GET /compute/v2.1/images/77580041-bccb-4492-803a-43484ed1a352 => generated 1447 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:53.237664 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5932d48f-9a5d-434e-8b6b-9a5279636277 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:53.238784 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5932d48f-9a5d-434e-8b6b-9a5279636277 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:53.244666 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62926076-1dd6-411c-b8c5-727f8351b91b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:53.245162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62926076-1dd6-411c-b8c5-727f8351b91b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:53.246034 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62926076-1dd6-411c-b8c5-727f8351b91b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:53.246452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5932d48f-9a5d-434e-8b6b-9a5279636277 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:53.246599 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62926076-1dd6-411c-b8c5-727f8351b91b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:53.247234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5932d48f-9a5d-434e-8b6b-9a5279636277 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:53.248162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5932d48f-9a5d-434e-8b6b-9a5279636277 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:53.248745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5932d48f-9a5d-434e-8b6b-9a5279636277 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:53.330996 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-62926076-1dd6-411c-b8c5-727f8351b91b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.131166 Jul 25 12:42:53.332272 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 599/1211] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Jul 25 12:42:53 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:42:53.337185 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-419a5634-66ed-4408-8803-3654c826b755 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:53.337753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-419a5634-66ed-4408-8803-3654c826b755 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:53.350756 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-419a5634-66ed-4408-8803-3654c826b755 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:53.355387 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-419a5634-66ed-4408-8803-3654c826b755 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:53.356438 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-419a5634-66ed-4408-8803-3654c826b755 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:53.357058 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-419a5634-66ed-4408-8803-3654c826b755 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:53.369078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5932d48f-9a5d-434e-8b6b-9a5279636277 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:53.383098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5932d48f-9a5d-434e-8b6b-9a5279636277 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:53.386390 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5932d48f-9a5d-434e-8b6b-9a5279636277 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:53.394982 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5932d48f-9a5d-434e-8b6b-9a5279636277 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1446 microversion: 2.75 time: 0.160097 Jul 25 12:42:53.397012 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 613/1212] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:53 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1446 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:53.403643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-4c1c50f4-a6bf-4282-8127-2440e6636484 req-d7a13f02-5e0d-4001-99fb-e748271df366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c42ab74-7b7f-493e-a5b0-e0384beafd96", "name": "network-vif-plugged", "status": "completed", "tag": "c39cff1c-5245-48af-82fe-4998aae199ab"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:53.417005 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4c1c50f4-a6bf-4282-8127-2440e6636484 req-d7a13f02-5e0d-4001-99fb-e748271df366 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:53.417700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4c1c50f4-a6bf-4282-8127-2440e6636484 req-d7a13f02-5e0d-4001-99fb-e748271df366 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:53.431205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-419a5634-66ed-4408-8803-3654c826b755 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f1d6eca33052491a9601c2bd454dd5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda37bacac5a405f86d02897dd9b0388', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:53.432678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-419a5634-66ed-4408-8803-3654c826b755 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] flavor_id is None. Assuming migration. {{(pid=125883) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 25 12:42:53.433339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-419a5634-66ed-4408-8803-3654c826b755 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125883) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 12:42:53.441325 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-4c1c50f4-a6bf-4282-8127-2440e6636484 req-d7a13f02-5e0d-4001-99fb-e748271df366 service nova] Creating event network-vif-plugged:c39cff1c-5245-48af-82fe-4998aae199ab for instance 1c42ab74-7b7f-493e-a5b0-e0384beafd96 on n-h2-848886-15 Jul 25 12:42:53.457919 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-4c1c50f4-a6bf-4282-8127-2440e6636484 req-d7a13f02-5e0d-4001-99fb-e748271df366 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059380 Jul 25 12:42:53.460125 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 614/1213] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:53.466828 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-854aaed1-ecfb-4e90-926c-7debcb6d1783 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:53.467796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-854aaed1-ecfb-4e90-926c-7debcb6d1783 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:53.475029 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-854aaed1-ecfb-4e90-926c-7debcb6d1783 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:53.476269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-854aaed1-ecfb-4e90-926c-7debcb6d1783 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:53.477178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-854aaed1-ecfb-4e90-926c-7debcb6d1783 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:53.477860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-854aaed1-ecfb-4e90-926c-7debcb6d1783 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:53.637602 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-419a5634-66ed-4408-8803-3654c826b755 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2/action" status: 202 len: 0 microversion: 2.1 time: 0.303901 Jul 25 12:42:53.645974 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 600/1214] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:42:53 2022] POST /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:42:53.662224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6ea1641e-224a-471d-9e0d-5547fd5d7553 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:53.663319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6ea1641e-224a-471d-9e0d-5547fd5d7553 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:53.677746 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6ea1641e-224a-471d-9e0d-5547fd5d7553 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:53.678671 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6ea1641e-224a-471d-9e0d-5547fd5d7553 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:53.679721 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6ea1641e-224a-471d-9e0d-5547fd5d7553 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:53.680504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6ea1641e-224a-471d-9e0d-5547fd5d7553 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:53.944363 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-854aaed1-ecfb-4e90-926c-7debcb6d1783 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:53.954127 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-854aaed1-ecfb-4e90-926c-7debcb6d1783 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1314 microversion: 2.1 time: 0.492029 Jul 25 12:42:53.954727 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 615/1215] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:53 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:54.001655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6ea1641e-224a-471d-9e0d-5547fd5d7553 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:54.004186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:54.017425 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6ea1641e-224a-471d-9e0d-5547fd5d7553 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1472 microversion: 2.1 time: 0.369224 Jul 25 12:42:54.018202 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 601/1216] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:53 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1472 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:54.022622 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-90e1e0e7-b12b-4fc6-9e34-f3fa76ff8069 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:54.023504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-90e1e0e7-b12b-4fc6-9e34-f3fa76ff8069 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 1c42ab74-7b7f-493e-a5b0-e0384beafd96] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:54.034180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90e1e0e7-b12b-4fc6-9e34-f3fa76ff8069 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:54.036139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90e1e0e7-b12b-4fc6-9e34-f3fa76ff8069 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:54.037898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90e1e0e7-b12b-4fc6-9e34-f3fa76ff8069 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:54.038553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90e1e0e7-b12b-4fc6-9e34-f3fa76ff8069 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:54.107988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9d97caea-dbe6-428e-a126-15a9d3174ffe tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf98b53a0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:54.184703 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9d97caea-dbe6-428e-a126-15a9d3174ffe tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c" status: 200 len: 1436 microversion: 2.1 time: 0.080881 Jul 25 12:42:54.190232 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 602/1217] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:54 2022] GET /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c => generated 1436 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:54.210082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-59750949-d37c-48d4-8166-fc0dd52ab01c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:54.211066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-59750949-d37c-48d4-8166-fc0dd52ab01c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:54.221739 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59750949-d37c-48d4-8166-fc0dd52ab01c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:54.222227 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59750949-d37c-48d4-8166-fc0dd52ab01c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:54.226276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59750949-d37c-48d4-8166-fc0dd52ab01c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:54.226969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59750949-d37c-48d4-8166-fc0dd52ab01c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:54.298585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-90e1e0e7-b12b-4fc6-9e34-f3fa76ff8069 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:54.308465 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-90e1e0e7-b12b-4fc6-9e34-f3fa76ff8069 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96" status: 200 len: 1316 microversion: 2.1 time: 0.290454 Jul 25 12:42:54.309060 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 616/1218] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:54 2022] GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96 => generated 1316 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:54.332338 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ed507b9a-a533-4c6a-b52a-02b033f1635b tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9b404c0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:54.428122 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ed507b9a-a533-4c6a-b52a-02b033f1635b tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/77580041-bccb-4492-803a-43484ed1a352" status: 200 len: 1447 microversion: 2.1 time: 0.116440 Jul 25 12:42:54.429602 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 617/1219] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:54 2022] GET /compute/v2.1/images/77580041-bccb-4492-803a-43484ed1a352 => generated 1447 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:54.435031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9866ebd2-720f-4320-854d-7314456b1819 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:54.437465 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9866ebd2-720f-4320-854d-7314456b1819 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:54.446150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9866ebd2-720f-4320-854d-7314456b1819 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:54.447292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9866ebd2-720f-4320-854d-7314456b1819 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:54.448301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9866ebd2-720f-4320-854d-7314456b1819 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:54.449065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9866ebd2-720f-4320-854d-7314456b1819 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:54.506829 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9866ebd2-720f-4320-854d-7314456b1819 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.075747 Jul 25 12:42:54.512265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-59750949-d37c-48d4-8166-fc0dd52ab01c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:54.514840 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 618/1220] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Jul 25 12:42:54 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:42:54.522301 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-59750949-d37c-48d4-8166-fc0dd52ab01c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1716 microversion: 2.1 time: 0.316652 Jul 25 12:42:54.523337 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 603/1221] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:54 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1716 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:42:54.534341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b5e5f447-a4d6-4cab-a7bc-0d8c5ad62c40 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:54.534836 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b5e5f447-a4d6-4cab-a7bc-0d8c5ad62c40 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:54.541680 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5e5f447-a4d6-4cab-a7bc-0d8c5ad62c40 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:54.542163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5e5f447-a4d6-4cab-a7bc-0d8c5ad62c40 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:54.542945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5e5f447-a4d6-4cab-a7bc-0d8c5ad62c40 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:54.543385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5e5f447-a4d6-4cab-a7bc-0d8c5ad62c40 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:54.644630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b5e5f447-a4d6-4cab-a7bc-0d8c5ad62c40 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:54.665542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b5e5f447-a4d6-4cab-a7bc-0d8c5ad62c40 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:54.673787 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b5e5f447-a4d6-4cab-a7bc-0d8c5ad62c40 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:54.680876 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b5e5f447-a4d6-4cab-a7bc-0d8c5ad62c40 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1446 microversion: 2.75 time: 0.150715 Jul 25 12:42:54.682157 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 619/1222] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:54 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1446 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:54.974855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-08fe36b0-fa7e-4584-9815-21284204183d tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:54.975464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-08fe36b0-fa7e-4584-9815-21284204183d tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:54.991592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-08fe36b0-fa7e-4584-9815-21284204183d tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:54.992369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-08fe36b0-fa7e-4584-9815-21284204183d tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:54.993526 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-08fe36b0-fa7e-4584-9815-21284204183d tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:54.994015 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-08fe36b0-fa7e-4584-9815-21284204183d tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:55.042004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2a4cb8c2-53cb-4c7b-bdf8-f433f7b92291 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:55.042623 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2a4cb8c2-53cb-4c7b-bdf8-f433f7b92291 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:55.050961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a4cb8c2-53cb-4c7b-bdf8-f433f7b92291 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:55.051712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a4cb8c2-53cb-4c7b-bdf8-f433f7b92291 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:55.052660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a4cb8c2-53cb-4c7b-bdf8-f433f7b92291 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:55.056089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a4cb8c2-53cb-4c7b-bdf8-f433f7b92291 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:55.396541 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2a4cb8c2-53cb-4c7b-bdf8-f433f7b92291 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:55.407795 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2a4cb8c2-53cb-4c7b-bdf8-f433f7b92291 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1472 microversion: 2.1 time: 0.368579 Jul 25 12:42:55.409179 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 620/1223] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:55 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1472 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:55.419476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-08fe36b0-fa7e-4584-9815-21284204183d tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:55.429399 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-08fe36b0-fa7e-4584-9815-21284204183d tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1314 microversion: 2.1 time: 0.458293 Jul 25 12:42:55.432133 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-61a14caa-ee17-4c1c-9fbe-63b663bdf177 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcfee46a60>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:55.446621 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 604/1224] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:54 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:55.464012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a9f133cb-fa47-40e6-adda-518a19154887 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:55.464922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a9f133cb-fa47-40e6-adda-518a19154887 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 1c42ab74-7b7f-493e-a5b0-e0384beafd96] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:55.471962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9f133cb-fa47-40e6-adda-518a19154887 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:55.472911 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9f133cb-fa47-40e6-adda-518a19154887 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:55.473989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9f133cb-fa47-40e6-adda-518a19154887 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:55.474658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9f133cb-fa47-40e6-adda-518a19154887 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:55.550708 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-61a14caa-ee17-4c1c-9fbe-63b663bdf177 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c" status: 200 len: 1436 microversion: 2.1 time: 0.140051 Jul 25 12:42:55.552142 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 621/1225] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:55 2022] GET /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c => generated 1436 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:55.563365 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6337f575-e2eb-4eae-9106-e01f127db990 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9b4c0d0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:55.633704 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6337f575-e2eb-4eae-9106-e01f127db990 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/77580041-bccb-4492-803a-43484ed1a352" status: 200 len: 1447 microversion: 2.1 time: 0.076387 Jul 25 12:42:55.634800 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 622/1226] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:55 2022] GET /compute/v2.1/images/77580041-bccb-4492-803a-43484ed1a352 => generated 1447 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:55.653562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aacb9818-67be-40d0-81c4-85321eb4c901 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:55.658490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-aacb9818-67be-40d0-81c4-85321eb4c901 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:55.678088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aacb9818-67be-40d0-81c4-85321eb4c901 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:55.678877 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aacb9818-67be-40d0-81c4-85321eb4c901 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:55.679848 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aacb9818-67be-40d0-81c4-85321eb4c901 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:55.680467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aacb9818-67be-40d0-81c4-85321eb4c901 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:55.732071 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a9f133cb-fa47-40e6-adda-518a19154887 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:55.743773 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a9f133cb-fa47-40e6-adda-518a19154887 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96" status: 200 len: 1316 microversion: 2.1 time: 0.294937 Jul 25 12:42:55.744927 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 605/1227] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:55 2022] GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96 => generated 1316 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:55.763340 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-aacb9818-67be-40d0-81c4-85321eb4c901 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.127285 Jul 25 12:42:55.763738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-82afb580-8661-4296-813f-14d0c79795b2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:55.766637 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 623/1228] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Jul 25 12:42:55 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:42:55.768302 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-82afb580-8661-4296-813f-14d0c79795b2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:55.775560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-728b2e08-5f85-41d8-8672-359eea258e5b tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:55.776401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-728b2e08-5f85-41d8-8672-359eea258e5b tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:55.776809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82afb580-8661-4296-813f-14d0c79795b2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:55.777781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82afb580-8661-4296-813f-14d0c79795b2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:55.778815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82afb580-8661-4296-813f-14d0c79795b2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:55.784258 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82afb580-8661-4296-813f-14d0c79795b2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:55.784876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-728b2e08-5f85-41d8-8672-359eea258e5b tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:55.785391 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-728b2e08-5f85-41d8-8672-359eea258e5b tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:55.798349 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-728b2e08-5f85-41d8-8672-359eea258e5b tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:55.799043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-728b2e08-5f85-41d8-8672-359eea258e5b tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:55.967481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-728b2e08-5f85-41d8-8672-359eea258e5b tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:55.982069 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-728b2e08-5f85-41d8-8672-359eea258e5b tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:55.987456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-728b2e08-5f85-41d8-8672-359eea258e5b tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:55.999716 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-728b2e08-5f85-41d8-8672-359eea258e5b tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1446 microversion: 2.75 time: 0.234228 Jul 25 12:42:56.018330 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 624/1229] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:42:55 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1446 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:42:56.117194 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-82afb580-8661-4296-813f-14d0c79795b2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:56.127494 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-82afb580-8661-4296-813f-14d0c79795b2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1716 microversion: 2.1 time: 0.378352 Jul 25 12:42:56.136436 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 606/1230] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:55 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1716 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:56.447342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-37d38a04-7649-49a3-bb65-fd48d335ad4e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:56.448987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-37d38a04-7649-49a3-bb65-fd48d335ad4e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:56.453606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:56.463504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-960a5b7c-9b44-4b39-b024-bbb9dd4f0c53 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:56.464841 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-960a5b7c-9b44-4b39-b024-bbb9dd4f0c53 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:56.475838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-960a5b7c-9b44-4b39-b024-bbb9dd4f0c53 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:56.479756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-37d38a04-7649-49a3-bb65-fd48d335ad4e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:56.480515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-960a5b7c-9b44-4b39-b024-bbb9dd4f0c53 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:56.481562 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-960a5b7c-9b44-4b39-b024-bbb9dd4f0c53 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:56.482676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-960a5b7c-9b44-4b39-b024-bbb9dd4f0c53 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:56.483308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-37d38a04-7649-49a3-bb65-fd48d335ad4e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:56.484315 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-37d38a04-7649-49a3-bb65-fd48d335ad4e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:56.487628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-37d38a04-7649-49a3-bb65-fd48d335ad4e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:56.816700 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:56.929672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:57.010938 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-960a5b7c-9b44-4b39-b024-bbb9dd4f0c53 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:57.024323 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-960a5b7c-9b44-4b39-b024-bbb9dd4f0c53 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1314 microversion: 2.1 time: 0.566186 Jul 25 12:42:57.027058 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 607/1231] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:56 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:57.045111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c8acb482-2639-4858-9f20-4390df8db6ed tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf96d29d0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:57.078177 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-37d38a04-7649-49a3-bb65-fd48d335ad4e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:57.094520 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-37d38a04-7649-49a3-bb65-fd48d335ad4e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1472 microversion: 2.1 time: 0.651623 Jul 25 12:42:57.095444 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 625/1232] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:56 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1472 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:57.100265 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2d60498e-319d-4459-a016-fa813c25eeba tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcfee46dc0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:02.886489 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c8acb482-2639-4858-9f20-4390df8db6ed tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c" status: 200 len: 1445 microversion: 2.1 time: 5.857484 Jul 25 12:43:02.891832 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 608/1233] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:57 2022] GET /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c => generated 1445 bytes in 5864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:02.906401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2c10bf9d-e297-49d9-800a-ccfdac3abec6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:02.909764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2c10bf9d-e297-49d9-800a-ccfdac3abec6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 1c42ab74-7b7f-493e-a5b0-e0384beafd96] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:02.914442 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2d60498e-319d-4459-a016-fa813c25eeba tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/77580041-bccb-4492-803a-43484ed1a352" status: 200 len: 1447 microversion: 2.1 time: 5.817678 Jul 25 12:43:02.921532 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 626/1234] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:42:57 2022] GET /compute/v2.1/images/77580041-bccb-4492-803a-43484ed1a352 => generated 1447 bytes in 5819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:02.925635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-40ca58cc-0eb7-4dd8-82c2-df1aab5293ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:02.926522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c10bf9d-e297-49d9-800a-ccfdac3abec6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:02.927054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c10bf9d-e297-49d9-800a-ccfdac3abec6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:02.928033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c10bf9d-e297-49d9-800a-ccfdac3abec6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:02.928566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c10bf9d-e297-49d9-800a-ccfdac3abec6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:02.932368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-40ca58cc-0eb7-4dd8-82c2-df1aab5293ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:02.941351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40ca58cc-0eb7-4dd8-82c2-df1aab5293ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:02.942114 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40ca58cc-0eb7-4dd8-82c2-df1aab5293ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:02.943282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40ca58cc-0eb7-4dd8-82c2-df1aab5293ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:02.943897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40ca58cc-0eb7-4dd8-82c2-df1aab5293ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:02.997377 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-40ca58cc-0eb7-4dd8-82c2-df1aab5293ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.080479 Jul 25 12:43:02.998166 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 627/1235] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Jul 25 12:43:02 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:03.031812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aa2cc979-9191-4418-a1b7-f4f578ec3c69 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:03.032707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-aa2cc979-9191-4418-a1b7-f4f578ec3c69 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:03.047219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa2cc979-9191-4418-a1b7-f4f578ec3c69 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:03.047760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa2cc979-9191-4418-a1b7-f4f578ec3c69 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:03.048563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa2cc979-9191-4418-a1b7-f4f578ec3c69 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:03.048986 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa2cc979-9191-4418-a1b7-f4f578ec3c69 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:03.193719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-aa2cc979-9191-4418-a1b7-f4f578ec3c69 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:03.206808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-aa2cc979-9191-4418-a1b7-f4f578ec3c69 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:03.208620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-aa2cc979-9191-4418-a1b7-f4f578ec3c69 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:03.217759 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-aa2cc979-9191-4418-a1b7-f4f578ec3c69 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1437 microversion: 2.75 time: 0.201856 Jul 25 12:43:03.219608 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 628/1236] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:02 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1437 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:03.225560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cbd69598-5d53-4bfa-97af-96d423c1da7b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:03.227137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cbd69598-5d53-4bfa-97af-96d423c1da7b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:03.232757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2c10bf9d-e297-49d9-800a-ccfdac3abec6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:03.233969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cbd69598-5d53-4bfa-97af-96d423c1da7b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:03.234608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cbd69598-5d53-4bfa-97af-96d423c1da7b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:03.235621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cbd69598-5d53-4bfa-97af-96d423c1da7b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:03.236214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cbd69598-5d53-4bfa-97af-96d423c1da7b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:03.243479 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2c10bf9d-e297-49d9-800a-ccfdac3abec6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96" status: 200 len: 1466 microversion: 2.1 time: 0.350071 Jul 25 12:43:03.246214 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 609/1237] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:02 2022] GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96 => generated 1466 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:03.253750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-36a7db8e-d121-4722-8fbc-520913f998aa req-cc0e585f-6aee-4ee8-9c0b-9b3c266c6aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159b5add-9666-4a2a-82e7-7571a120cabb", "name": "network-vif-plugged", "status": "completed", "tag": "27e87312-289e-4818-b884-b357c21f7a9f"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:03.279289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-36a7db8e-d121-4722-8fbc-520913f998aa req-cc0e585f-6aee-4ee8-9c0b-9b3c266c6aca service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:03.279767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-36a7db8e-d121-4722-8fbc-520913f998aa req-cc0e585f-6aee-4ee8-9c0b-9b3c266c6aca service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:03.315628 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-36a7db8e-d121-4722-8fbc-520913f998aa req-cc0e585f-6aee-4ee8-9c0b-9b3c266c6aca service nova] Creating event network-vif-plugged:27e87312-289e-4818-b884-b357c21f7a9f for instance 159b5add-9666-4a2a-82e7-7571a120cabb on n-h2-848886-15 Jul 25 12:43:03.323676 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-36a7db8e-d121-4722-8fbc-520913f998aa req-cc0e585f-6aee-4ee8-9c0b-9b3c266c6aca service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075140 Jul 25 12:43:03.324820 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 610/1238] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:03.331735 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b1e19f31-5324-4077-98e8-8d777eda298f tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:03.333553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b1e19f31-5324-4077-98e8-8d777eda298f tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:03.341530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b1e19f31-5324-4077-98e8-8d777eda298f tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:03.342058 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b1e19f31-5324-4077-98e8-8d777eda298f tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:03.342846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b1e19f31-5324-4077-98e8-8d777eda298f tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:03.343282 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b1e19f31-5324-4077-98e8-8d777eda298f tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:03.550489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cbd69598-5d53-4bfa-97af-96d423c1da7b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:03.570665 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cbd69598-5d53-4bfa-97af-96d423c1da7b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1716 microversion: 2.1 time: 0.341744 Jul 25 12:43:03.571890 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 629/1239] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:03 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1716 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:03.577020 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ac480f8b-75e1-469f-8641-e3204524bfa2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:03.580048 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ac480f8b-75e1-469f-8641-e3204524bfa2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:03.593699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac480f8b-75e1-469f-8641-e3204524bfa2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:03.596908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac480f8b-75e1-469f-8641-e3204524bfa2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:03.598021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac480f8b-75e1-469f-8641-e3204524bfa2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:03.598620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac480f8b-75e1-469f-8641-e3204524bfa2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:04.142118 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b1e19f31-5324-4077-98e8-8d777eda298f tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:04.154379 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b1e19f31-5324-4077-98e8-8d777eda298f tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1314 microversion: 2.1 time: 0.827887 Jul 25 12:43:04.166738 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 611/1240] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:03 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1314 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:04.175378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ba2b61a0-36cd-4dd7-aba8-bc04f60fbbeb tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf991e280>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:04.239722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ac480f8b-75e1-469f-8641-e3204524bfa2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:04.248166 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ac480f8b-75e1-469f-8641-e3204524bfa2 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1477 microversion: 2.1 time: 0.674795 Jul 25 12:43:04.262213 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 630/1241] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:03 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1477 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:04.286503 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ba2b61a0-36cd-4dd7-aba8-bc04f60fbbeb tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c" status: 200 len: 1445 microversion: 2.1 time: 0.118116 Jul 25 12:43:04.287036 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 612/1242] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:04 2022] GET /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c => generated 1445 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:04.310541 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f06dee85-eab6-426e-abcd-17b37585b0a9 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:04.313332 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f06dee85-eab6-426e-abcd-17b37585b0a9 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] [instance: 1c42ab74-7b7f-493e-a5b0-e0384beafd96] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:04.333653 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f06dee85-eab6-426e-abcd-17b37585b0a9 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:04.335828 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f06dee85-eab6-426e-abcd-17b37585b0a9 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:04.337173 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f06dee85-eab6-426e-abcd-17b37585b0a9 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:04.337974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f06dee85-eab6-426e-abcd-17b37585b0a9 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:04.431699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-65fcc920-3618-4cdb-8132-445481a356ce tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "97beeed7-7564-4203-abda-feef7e93cd98"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:04.435276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-65fcc920-3618-4cdb-8132-445481a356ce tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:04.442968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65fcc920-3618-4cdb-8132-445481a356ce tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:04.443851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65fcc920-3618-4cdb-8132-445481a356ce tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:04.445026 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65fcc920-3618-4cdb-8132-445481a356ce tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:04.445748 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65fcc920-3618-4cdb-8132-445481a356ce tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:04.531209 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f06dee85-eab6-426e-abcd-17b37585b0a9 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96" status: 200 len: 1619 microversion: 2.1 time: 0.228736 Jul 25 12:43:04.532160 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 613/1243] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:04 2022] GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96 => generated 1619 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:04.538038 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2ad9fa37-8df6-4f8b-81b2-d7a961d92f08 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9944550>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:08.759011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:08.763870 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2ad9fa37-8df6-4f8b-81b2-d7a961d92f08 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/77580041-bccb-4492-803a-43484ed1a352" status: 200 len: 1456 microversion: 2.1 time: 4.230124 Jul 25 12:43:08.764465 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 614/1244] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:04 2022] GET /compute/v2.1/images/77580041-bccb-4492-803a-43484ed1a352 => generated 1456 bytes in 4232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:08.773553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-77c0098e-29fe-4d0c-bb7f-a90caf5ae929 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf98c7c10>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:08.785940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-65fcc920-3618-4cdb-8132-445481a356ce tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:43:08.786376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-65fcc920-3618-4cdb-8132-445481a356ce tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:43:08.786848 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-65fcc920-3618-4cdb-8132-445481a356ce tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:43:08.787254 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-65fcc920-3618-4cdb-8132-445481a356ce tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:43:08.787862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-65fcc920-3618-4cdb-8132-445481a356ce tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:43:08.866118 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-65fcc920-3618-4cdb-8132-445481a356ce tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:08.872723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65fcc920-3618-4cdb-8132-445481a356ce tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:08.873180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65fcc920-3618-4cdb-8132-445481a356ce tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:08.874161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65fcc920-3618-4cdb-8132-445481a356ce tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:08.875190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65fcc920-3618-4cdb-8132-445481a356ce tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:09.000495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-65fcc920-3618-4cdb-8132-445481a356ce tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lazy-loading 'services' on Instance uuid 2ad2b2a1-b3f1-47cc-a769-04744715a6ec {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:09.020748 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-65fcc920-3618-4cdb-8132-445481a356ce tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec/action" status: 202 len: 1942 microversion: 2.75 time: 4.756739 Jul 25 12:43:09.021892 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 631/1245] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Jul 25 12:43:04 2022] POST /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec/action => generated 1942 bytes in 4759 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 12:43:09.027824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-729bb2f8-3d5b-4b9b-9287-9135fa9a83ee tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:09.028429 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-729bb2f8-3d5b-4b9b-9287-9135fa9a83ee tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:09.038036 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-729bb2f8-3d5b-4b9b-9287-9135fa9a83ee tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:09.038489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-729bb2f8-3d5b-4b9b-9287-9135fa9a83ee tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:09.039257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-729bb2f8-3d5b-4b9b-9287-9135fa9a83ee tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:09.039687 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-729bb2f8-3d5b-4b9b-9287-9135fa9a83ee tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:09.212118 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-729bb2f8-3d5b-4b9b-9287-9135fa9a83ee tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:09.223253 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-729bb2f8-3d5b-4b9b-9287-9135fa9a83ee tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1716 microversion: 2.1 time: 0.200049 Jul 25 12:43:09.223848 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 632/1246] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:09 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1716 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:09.230120 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8d615a9a-8654-4ca4-b761-4ce64638a91e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-109769787", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "b2467ff1-7d17-43ae-811d-e37437b3b0ba"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:09.316875 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-77c0098e-29fe-4d0c-bb7f-a90caf5ae929 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "DELETE /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c" status: 204 len: 0 microversion: 2.1 time: 0.551311 Jul 25 12:43:09.317478 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 615/1247] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:08 2022] DELETE /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:43:09.322580 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cf3e090e-d82d-4d52-ae1c-a6c32161a5ba tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:09.323405 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cf3e090e-d82d-4d52-ae1c-a6c32161a5ba tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:09.331215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:09.334460 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf3e090e-d82d-4d52-ae1c-a6c32161a5ba tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:09.335288 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf3e090e-d82d-4d52-ae1c-a6c32161a5ba tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:09.336868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf3e090e-d82d-4d52-ae1c-a6c32161a5ba tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:09.337453 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf3e090e-d82d-4d52-ae1c-a6c32161a5ba tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:09.375311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-8d615a9a-8654-4ca4-b761-4ce64638a91e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] validate_networks() for None {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:43:09.584437 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cf3e090e-d82d-4d52-ae1c-a6c32161a5ba tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:09.607470 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cf3e090e-d82d-4d52-ae1c-a6c32161a5ba tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1314 microversion: 2.1 time: 0.288848 Jul 25 12:43:09.608274 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 616/1248] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:09 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:09.615555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ca2730ed-3fbf-49ac-984b-15cf64d75ded tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:09.616380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ca2730ed-3fbf-49ac-984b-15cf64d75ded tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:09.626940 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca2730ed-3fbf-49ac-984b-15cf64d75ded tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:09.627662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca2730ed-3fbf-49ac-984b-15cf64d75ded tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:09.628747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca2730ed-3fbf-49ac-984b-15cf64d75ded tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:09.629378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca2730ed-3fbf-49ac-984b-15cf64d75ded tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:09.729057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-8d615a9a-8654-4ca4-b761-4ce64638a91e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:43:09.729493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-8d615a9a-8654-4ca4-b761-4ce64638a91e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:43:09.730002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-8d615a9a-8654-4ca4-b761-4ce64638a91e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:43:09.730952 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-8d615a9a-8654-4ca4-b761-4ce64638a91e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:43:09.731547 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-8d615a9a-8654-4ca4-b761-4ce64638a91e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:43:09.748155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d615a9a-8654-4ca4-b761-4ce64638a91e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:09.748629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d615a9a-8654-4ca4-b761-4ce64638a91e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:09.749475 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d615a9a-8654-4ca4-b761-4ce64638a91e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:09.750127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d615a9a-8654-4ca4-b761-4ce64638a91e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:09.768560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-8d615a9a-8654-4ca4-b761-4ce64638a91e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:43:09.775180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-8d615a9a-8654-4ca4-b761-4ce64638a91e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Getting quotas for user 8c296447c2254c048f94bd9f186b0097 and project 5c81a97dfca44bf6af64fdcd5d50c549. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:43:09.788149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8d615a9a-8654-4ca4-b761-4ce64638a91e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:43:09.790840 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8d615a9a-8654-4ca4-b761-4ce64638a91e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:43:09.798195 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ca2730ed-3fbf-49ac-984b-15cf64d75ded tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:09.806991 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ca2730ed-3fbf-49ac-984b-15cf64d75ded tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1477 microversion: 2.1 time: 0.196919 Jul 25 12:43:09.807841 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 617/1249] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:09 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1477 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:09.812711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-776f0772-ebf2-4751-b418-af514cf00091 req-c0635568-15a2-49ab-8a43-00e5db9f3ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4a19ea-699a-40fe-a620-9bf5305da67c", "name": "network-vif-plugged", "status": "completed", "tag": "b1a768b8-dfe9-40eb-a595-524fadb9cb2c"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:09.823449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-776f0772-ebf2-4751-b418-af514cf00091 req-c0635568-15a2-49ab-8a43-00e5db9f3ead service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:09.823901 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-776f0772-ebf2-4751-b418-af514cf00091 req-c0635568-15a2-49ab-8a43-00e5db9f3ead service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:09.835660 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-776f0772-ebf2-4751-b418-af514cf00091 req-c0635568-15a2-49ab-8a43-00e5db9f3ead service nova] Creating event network-vif-plugged:b1a768b8-dfe9-40eb-a595-524fadb9cb2c for instance 2d4a19ea-699a-40fe-a620-9bf5305da67c on n-h1-848886-15 Jul 25 12:43:09.840922 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-776f0772-ebf2-4751-b418-af514cf00091 req-c0635568-15a2-49ab-8a43-00e5db9f3ead service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031716 Jul 25 12:43:09.842013 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 618/1250] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:09.849622 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4a94a751-fd22-49b3-a653-b3c668b7324d tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf99c5d30>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:09.855127 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8d615a9a-8654-4ca4-b761-4ce64638a91e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.629958 Jul 25 12:43:09.857811 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 633/1251] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:43:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:43:09.863372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-123e381d-b26c-4629-aa65-b189f379cd2b tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:09.864008 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-123e381d-b26c-4629-aa65-b189f379cd2b tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:09.881489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-123e381d-b26c-4629-aa65-b189f379cd2b tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:09.882189 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-123e381d-b26c-4629-aa65-b189f379cd2b tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:09.883251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-123e381d-b26c-4629-aa65-b189f379cd2b tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:09.883758 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-123e381d-b26c-4629-aa65-b189f379cd2b tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:09.931180 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4a94a751-fd22-49b3-a653-b3c668b7324d tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/77580041-bccb-4492-803a-43484ed1a352" status: 200 len: 1456 microversion: 2.1 time: 0.087366 Jul 25 12:43:09.932636 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 619/1252] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:09 2022] GET /compute/v2.1/images/77580041-bccb-4492-803a-43484ed1a352 => generated 1456 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:09.938106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9d616e6a-9194-44bb-8b43-cd9ca57bd704 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:09.938905 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9d616e6a-9194-44bb-8b43-cd9ca57bd704 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c9c04c11-ce42-44b4-a6fd-7f7658a05292] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:09.947809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9d616e6a-9194-44bb-8b43-cd9ca57bd704 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:09.948746 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9d616e6a-9194-44bb-8b43-cd9ca57bd704 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:09.949996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9d616e6a-9194-44bb-8b43-cd9ca57bd704 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:09.950594 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9d616e6a-9194-44bb-8b43-cd9ca57bd704 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:09.987125 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9d616e6a-9194-44bb-8b43-cd9ca57bd704 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c9c04c11-ce42-44b4-a6fd-7f7658a05292] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:43:09.999065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-123e381d-b26c-4629-aa65-b189f379cd2b tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lazy-loading 'services' on Instance uuid 2ad2b2a1-b3f1-47cc-a769-04744715a6ec {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:10.030497 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-123e381d-b26c-4629-aa65-b189f379cd2b tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1929 microversion: 2.75 time: 0.172108 Jul 25 12:43:10.031205 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 634/1253] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:09 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1929 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:10.036511 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-08b666a7-0c2c-45a2-9d19-03055fec793b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:10.037410 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-08b666a7-0c2c-45a2-9d19-03055fec793b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:10.097726 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9d616e6a-9194-44bb-8b43-cd9ca57bd704 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292" status: 204 len: 0 microversion: 2.1 time: 0.164197 Jul 25 12:43:10.104931 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 620/1254] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:43:09 2022] DELETE /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:43:10.135624 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-280141dc-bc61-44e0-a462-bcdd264d3af8 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:10.136531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-280141dc-bc61-44e0-a462-bcdd264d3af8 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: 159b5add-9666-4a2a-82e7-7571a120cabb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:10.148313 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-280141dc-bc61-44e0-a462-bcdd264d3af8 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:10.149085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-280141dc-bc61-44e0-a462-bcdd264d3af8 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:10.150556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-280141dc-bc61-44e0-a462-bcdd264d3af8 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:10.151226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-280141dc-bc61-44e0-a462-bcdd264d3af8 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:10.156944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-08b666a7-0c2c-45a2-9d19-03055fec793b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:10.164681 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-08b666a7-0c2c-45a2-9d19-03055fec793b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 200 len: 1216 microversion: 2.1 time: 0.132389 Jul 25 12:43:10.165637 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 635/1255] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:10 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 1216 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:10.249013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bf3afe2f-d580-4dbe-b001-d5ccd030eff1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:10.249723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bf3afe2f-d580-4dbe-b001-d5ccd030eff1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:10.265940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf3afe2f-d580-4dbe-b001-d5ccd030eff1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:10.266971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf3afe2f-d580-4dbe-b001-d5ccd030eff1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:10.270375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf3afe2f-d580-4dbe-b001-d5ccd030eff1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:10.272838 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf3afe2f-d580-4dbe-b001-d5ccd030eff1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:10.356720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-280141dc-bc61-44e0-a462-bcdd264d3af8 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:10.366773 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-280141dc-bc61-44e0-a462-bcdd264d3af8 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/159b5add-9666-4a2a-82e7-7571a120cabb" status: 200 len: 1467 microversion: 2.1 time: 0.259956 Jul 25 12:43:10.385519 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 621/1256] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:10 2022] GET /compute/v2.1/servers/159b5add-9666-4a2a-82e7-7571a120cabb => generated 1467 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:10.395316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e166cc55-0209-4299-aaa3-f05913c68d07 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1363790037", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "e35876fc-c9c4-48b7-9074-6fd9241d1669"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:10.467266 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-e166cc55-0209-4299-aaa3-f05913c68d07 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] validate_networks() for [('e35876fc-c9c4-48b7-9074-6fd9241d1669', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:43:10.641562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bf3afe2f-d580-4dbe-b001-d5ccd030eff1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:10.651819 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bf3afe2f-d580-4dbe-b001-d5ccd030eff1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1716 microversion: 2.1 time: 0.408893 Jul 25 12:43:10.652826 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 636/1257] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:10 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1716 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:43:10.657792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-383dda1a-e509-41b1-bc46-86ebbfcb4643 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-538597275"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:10.660196 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-383dda1a-e509-41b1-bc46-86ebbfcb4643 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:10.666284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-383dda1a-e509-41b1-bc46-86ebbfcb4643 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:10.666956 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-383dda1a-e509-41b1-bc46-86ebbfcb4643 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:10.667897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-383dda1a-e509-41b1-bc46-86ebbfcb4643 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:10.668336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-383dda1a-e509-41b1-bc46-86ebbfcb4643 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:10.879145 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-383dda1a-e509-41b1-bc46-86ebbfcb4643 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "POST /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620/action" status: 202 len: 0 microversion: 2.1 time: 0.224895 Jul 25 12:43:10.879912 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 637/1258] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:43:10 2022] POST /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 12:43:10.884909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-eee933db-0b28-4c83-81c1-bb563d206270 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:10.885823 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eee933db-0b28-4c83-81c1-bb563d206270 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:10.893275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eee933db-0b28-4c83-81c1-bb563d206270 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:10.893899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eee933db-0b28-4c83-81c1-bb563d206270 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:10.894690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eee933db-0b28-4c83-81c1-bb563d206270 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:10.895186 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eee933db-0b28-4c83-81c1-bb563d206270 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:11.216666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-eee933db-0b28-4c83-81c1-bb563d206270 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:11.226874 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-eee933db-0b28-4c83-81c1-bb563d206270 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1314 microversion: 2.1 time: 0.345876 Jul 25 12:43:11.227855 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 638/1259] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:10 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:11.229244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-e166cc55-0209-4299-aaa3-f05913c68d07 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:43:11.229790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-e166cc55-0209-4299-aaa3-f05913c68d07 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:43:11.230484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-e166cc55-0209-4299-aaa3-f05913c68d07 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:43:11.231049 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-e166cc55-0209-4299-aaa3-f05913c68d07 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:43:11.231620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-e166cc55-0209-4299-aaa3-f05913c68d07 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:43:11.237500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0d3d4f92-505f-45ca-a308-be5e02c8a520 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:11.238221 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0d3d4f92-505f-45ca-a308-be5e02c8a520 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:11.244974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e166cc55-0209-4299-aaa3-f05913c68d07 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:11.245728 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e166cc55-0209-4299-aaa3-f05913c68d07 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:11.245880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d3d4f92-505f-45ca-a308-be5e02c8a520 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:11.246761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d3d4f92-505f-45ca-a308-be5e02c8a520 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:11.247138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e166cc55-0209-4299-aaa3-f05913c68d07 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:11.247348 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d3d4f92-505f-45ca-a308-be5e02c8a520 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:11.247781 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d3d4f92-505f-45ca-a308-be5e02c8a520 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:11.248237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e166cc55-0209-4299-aaa3-f05913c68d07 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:11.266568 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-e166cc55-0209-4299-aaa3-f05913c68d07 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Getting quotas for project 85c0dc3e0d894a5a95b1628cbd20df9f. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:43:11.273908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-e166cc55-0209-4299-aaa3-f05913c68d07 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Getting quotas for user 53f799c73ceb4c189329bc86056bc048 and project 85c0dc3e0d894a5a95b1628cbd20df9f. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:43:11.291473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e166cc55-0209-4299-aaa3-f05913c68d07 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:43:11.294168 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e166cc55-0209-4299-aaa3-f05913c68d07 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:43:11.366324 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e166cc55-0209-4299-aaa3-f05913c68d07 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.978957 Jul 25 12:43:11.373679 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 622/1260] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:43:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:43:11.382953 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-30cde53a-2ba7-48d0-87d9-7755577ed07e tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9726f70>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:11.456433 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-30cde53a-2ba7-48d0-87d9-7755577ed07e tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c" status: 200 len: 1448 microversion: 2.1 time: 0.085147 Jul 25 12:43:11.457034 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 623/1261] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:11 2022] GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c => generated 1448 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:11.471970 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b1295442-911d-4393-98cd-633d8be0ed64 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:11.472836 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b1295442-911d-4393-98cd-633d8be0ed64 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:11.481261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b1295442-911d-4393-98cd-633d8be0ed64 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:11.482516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b1295442-911d-4393-98cd-633d8be0ed64 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:11.483325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b1295442-911d-4393-98cd-633d8be0ed64 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:11.484169 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b1295442-911d-4393-98cd-633d8be0ed64 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:11.621281 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0d3d4f92-505f-45ca-a308-be5e02c8a520 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:11.630892 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0d3d4f92-505f-45ca-a308-be5e02c8a520 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1477 microversion: 2.1 time: 0.401600 Jul 25 12:43:11.658651 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 639/1262] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:11 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1477 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:11.672612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1757a953-c582-45e1-97d2-114fa6e3a649 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:11.673537 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1757a953-c582-45e1-97d2-114fa6e3a649 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:11.680644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1757a953-c582-45e1-97d2-114fa6e3a649 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:11.681103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1757a953-c582-45e1-97d2-114fa6e3a649 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:11.681914 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1757a953-c582-45e1-97d2-114fa6e3a649 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:11.682367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1757a953-c582-45e1-97d2-114fa6e3a649 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:11.695385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-b1295442-911d-4393-98cd-633d8be0ed64 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lazy-loading 'services' on Instance uuid 2ad2b2a1-b3f1-47cc-a769-04744715a6ec {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:11.727634 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b1295442-911d-4393-98cd-633d8be0ed64 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1929 microversion: 2.75 time: 0.264940 Jul 25 12:43:11.742793 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 624/1263] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:11 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1929 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:11.754666 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-a6462ffd-2790-47e7-8784-528512e0f411 req-71e8e818-6902-447e-8a22-f1558d6a20df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2711752-4c19-477f-a5f0-e5097f2dc41a", "name": "network-vif-unplugged", "status": "completed", "tag": "9e34f7bb-4583-4a3f-875a-1441c142d908"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:11.767812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a6462ffd-2790-47e7-8784-528512e0f411 req-71e8e818-6902-447e-8a22-f1558d6a20df service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:11.768579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a6462ffd-2790-47e7-8784-528512e0f411 req-71e8e818-6902-447e-8a22-f1558d6a20df service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:11.768727 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1757a953-c582-45e1-97d2-114fa6e3a649 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:11.783898 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1757a953-c582-45e1-97d2-114fa6e3a649 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 200 len: 1220 microversion: 2.1 time: 0.121425 Jul 25 12:43:11.784541 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 640/1264] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:11 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 1220 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:11.793056 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-72f9ce1d-0e1e-4641-a1e5-7c1cb0fca93e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:11.794480 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-72f9ce1d-0e1e-4641-a1e5-7c1cb0fca93e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:11.799833 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-a6462ffd-2790-47e7-8784-528512e0f411 req-71e8e818-6902-447e-8a22-f1558d6a20df service nova] Creating event network-vif-unplugged:9e34f7bb-4583-4a3f-875a-1441c142d908 for instance d2711752-4c19-477f-a5f0-e5097f2dc41a on n-h1-848886-15 Jul 25 12:43:11.815237 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-a6462ffd-2790-47e7-8784-528512e0f411 req-71e8e818-6902-447e-8a22-f1558d6a20df service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067112 Jul 25 12:43:11.816897 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 625/1265] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:11.825328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f0c769cc-5a3f-4ae0-be41-170c83744a01 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:11.826350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f0c769cc-5a3f-4ae0-be41-170c83744a01 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:11.835476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0c769cc-5a3f-4ae0-be41-170c83744a01 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:11.835922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0c769cc-5a3f-4ae0-be41-170c83744a01 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:11.837046 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0c769cc-5a3f-4ae0-be41-170c83744a01 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:11.837403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0c769cc-5a3f-4ae0-be41-170c83744a01 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:11.844969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:11.900471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-72f9ce1d-0e1e-4641-a1e5-7c1cb0fca93e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:11.909947 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-72f9ce1d-0e1e-4641-a1e5-7c1cb0fca93e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1208 microversion: 2.1 time: 0.123614 Jul 25 12:43:11.911552 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 641/1266] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:11 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1208 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:11.925052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-a35b5832-b2ec-4913-ba29-2c4bba0e0079 req-f43be04f-e5dd-4380-bb5d-c384b30828db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9c04c11-ce42-44b4-a6fd-7f7658a05292", "name": "network-vif-unplugged", "status": "completed", "tag": "3844a30a-3f07-4f1e-9005-38e3c53d311a"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:11.951635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a35b5832-b2ec-4913-ba29-2c4bba0e0079 req-f43be04f-e5dd-4380-bb5d-c384b30828db service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:11.953069 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a35b5832-b2ec-4913-ba29-2c4bba0e0079 req-f43be04f-e5dd-4380-bb5d-c384b30828db service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:11.983262 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-a35b5832-b2ec-4913-ba29-2c4bba0e0079 req-f43be04f-e5dd-4380-bb5d-c384b30828db service nova] Creating event network-vif-unplugged:3844a30a-3f07-4f1e-9005-38e3c53d311a for instance c9c04c11-ce42-44b4-a6fd-7f7658a05292 on n-h1-848886-15 Jul 25 12:43:11.991525 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-a35b5832-b2ec-4913-ba29-2c4bba0e0079 req-f43be04f-e5dd-4380-bb5d-c384b30828db service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077724 Jul 25 12:43:11.996599 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 642/1267] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:12.147976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f0c769cc-5a3f-4ae0-be41-170c83744a01 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:12.160890 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f0c769cc-5a3f-4ae0-be41-170c83744a01 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1716 microversion: 2.1 time: 0.342093 Jul 25 12:43:12.161492 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 626/1268] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:11 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1716 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:12.248809 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f9937579-ca9c-481b-bdbd-21b91cd6a568 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:12.249807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f9937579-ca9c-481b-bdbd-21b91cd6a568 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:12.258026 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9937579-ca9c-481b-bdbd-21b91cd6a568 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:12.261673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9937579-ca9c-481b-bdbd-21b91cd6a568 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:12.265526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9937579-ca9c-481b-bdbd-21b91cd6a568 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:12.266262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9937579-ca9c-481b-bdbd-21b91cd6a568 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:12.442667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f9937579-ca9c-481b-bdbd-21b91cd6a568 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:12.452051 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f9937579-ca9c-481b-bdbd-21b91cd6a568 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1314 microversion: 2.1 time: 0.207901 Jul 25 12:43:12.453978 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 643/1269] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:12 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:12.471977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-27095504-ff11-4226-ad49-0d3cb15fbcf2 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf995b550>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:12.527298 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-27095504-ff11-4226-ad49-0d3cb15fbcf2 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c" status: 200 len: 1448 microversion: 2.1 time: 0.059590 Jul 25 12:43:12.528397 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 627/1270] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:12 2022] GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c => generated 1448 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:12.655158 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-75e1f61a-a4c4-472d-8e50-93752d9c9313 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:12.655891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-75e1f61a-a4c4-472d-8e50-93752d9c9313 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:12.665881 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75e1f61a-a4c4-472d-8e50-93752d9c9313 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:12.670187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75e1f61a-a4c4-472d-8e50-93752d9c9313 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:12.671276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75e1f61a-a4c4-472d-8e50-93752d9c9313 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:12.671816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75e1f61a-a4c4-472d-8e50-93752d9c9313 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:12.756480 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3db671f0-4157-4557-b90d-cdb7ff9d8359 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:12.757098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3db671f0-4157-4557-b90d-cdb7ff9d8359 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:12.763684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3db671f0-4157-4557-b90d-cdb7ff9d8359 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:12.764416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3db671f0-4157-4557-b90d-cdb7ff9d8359 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:12.765276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3db671f0-4157-4557-b90d-cdb7ff9d8359 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:12.765714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3db671f0-4157-4557-b90d-cdb7ff9d8359 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:12.858480 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-3db671f0-4157-4557-b90d-cdb7ff9d8359 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lazy-loading 'services' on Instance uuid 2ad2b2a1-b3f1-47cc-a769-04744715a6ec {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:12.877905 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3db671f0-4157-4557-b90d-cdb7ff9d8359 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1929 microversion: 2.75 time: 0.125550 Jul 25 12:43:12.878820 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 628/1271] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:12 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1929 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:43:12.883903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d0f221fb-ea64-414e-b890-e893ed3b3ce6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:12.884712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d0f221fb-ea64-414e-b890-e893ed3b3ce6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:12.891442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d0f221fb-ea64-414e-b890-e893ed3b3ce6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:12.892155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d0f221fb-ea64-414e-b890-e893ed3b3ce6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:12.893095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d0f221fb-ea64-414e-b890-e893ed3b3ce6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:12.893889 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d0f221fb-ea64-414e-b890-e893ed3b3ce6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:12.900630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-75e1f61a-a4c4-472d-8e50-93752d9c9313 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:12.929626 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-75e1f61a-a4c4-472d-8e50-93752d9c9313 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1477 microversion: 2.1 time: 0.278678 Jul 25 12:43:12.932465 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 644/1272] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:12 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1477 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:12.943641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f9b07670-8779-4a0d-ab3f-aed7bd8c2264 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:12.949692 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f9b07670-8779-4a0d-ab3f-aed7bd8c2264 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:12.959358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9b07670-8779-4a0d-ab3f-aed7bd8c2264 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:12.960991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9b07670-8779-4a0d-ab3f-aed7bd8c2264 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:12.962360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9b07670-8779-4a0d-ab3f-aed7bd8c2264 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:12.962992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9b07670-8779-4a0d-ab3f-aed7bd8c2264 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:12.994392 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d0f221fb-ea64-414e-b890-e893ed3b3ce6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:13.008505 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d0f221fb-ea64-414e-b890-e893ed3b3ce6 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 200 len: 1268 microversion: 2.1 time: 0.128343 Jul 25 12:43:13.009050 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 629/1273] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:12 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 1268 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:13.048750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f9b07670-8779-4a0d-ab3f-aed7bd8c2264 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:13.057521 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f9b07670-8779-4a0d-ab3f-aed7bd8c2264 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1260 microversion: 2.1 time: 0.123872 Jul 25 12:43:13.058311 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 645/1274] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:12 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1260 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:13.186801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-032067c3-fcd2-4979-bbd0-7f3143e9ce65 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:13.187695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-032067c3-fcd2-4979-bbd0-7f3143e9ce65 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:13.195313 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-032067c3-fcd2-4979-bbd0-7f3143e9ce65 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:13.197113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-032067c3-fcd2-4979-bbd0-7f3143e9ce65 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:13.198548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-032067c3-fcd2-4979-bbd0-7f3143e9ce65 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:13.199179 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-032067c3-fcd2-4979-bbd0-7f3143e9ce65 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:13.424246 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-032067c3-fcd2-4979-bbd0-7f3143e9ce65 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:13.450736 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-032067c3-fcd2-4979-bbd0-7f3143e9ce65 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1716 microversion: 2.1 time: 0.270649 Jul 25 12:43:13.451963 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 630/1275] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:13 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1716 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:13.476172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3fadfbe8-2916-4447-a6cd-3e3625f9468a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:13.476954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3fadfbe8-2916-4447-a6cd-3e3625f9468a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:13.483841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3fadfbe8-2916-4447-a6cd-3e3625f9468a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:13.484480 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3fadfbe8-2916-4447-a6cd-3e3625f9468a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:13.485336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3fadfbe8-2916-4447-a6cd-3e3625f9468a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:13.485769 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3fadfbe8-2916-4447-a6cd-3e3625f9468a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:13.543221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3243fa1a-2d13-43d1-920e-817cebd7f61c tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf995b550>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:13.601067 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3243fa1a-2d13-43d1-920e-817cebd7f61c tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c" status: 200 len: 1448 microversion: 2.1 time: 0.062358 Jul 25 12:43:13.602332 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 631/1276] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:13 2022] GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c => generated 1448 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:43:13.813814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3fadfbe8-2916-4447-a6cd-3e3625f9468a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:13.835409 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3fadfbe8-2916-4447-a6cd-3e3625f9468a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1499 microversion: 2.1 time: 0.365688 Jul 25 12:43:13.836026 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 646/1277] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:13 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1499 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:13.842529 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-44613c2f-4fde-45db-9b79-5710bfac7e73 req-6c3d3de3-51c8-4959-b027-9a8e6ae83421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2711752-4c19-477f-a5f0-e5097f2dc41a", "tag": "9e34f7bb-4583-4a3f-875a-1441c142d908"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:13.860080 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fa9159d8-abb1-48b9-a60c-e84a9eeb319a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:13.867024 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-44613c2f-4fde-45db-9b79-5710bfac7e73 req-6c3d3de3-51c8-4959-b027-9a8e6ae83421 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:13.867478 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-44613c2f-4fde-45db-9b79-5710bfac7e73 req-6c3d3de3-51c8-4959-b027-9a8e6ae83421 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:13.869677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fa9159d8-abb1-48b9-a60c-e84a9eeb319a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:13.879815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa9159d8-abb1-48b9-a60c-e84a9eeb319a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:13.880061 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-44613c2f-4fde-45db-9b79-5710bfac7e73 req-6c3d3de3-51c8-4959-b027-9a8e6ae83421 service nova] Creating event network-changed:9e34f7bb-4583-4a3f-875a-1441c142d908 for instance d2711752-4c19-477f-a5f0-e5097f2dc41a on n-h1-848886-15 Jul 25 12:43:13.885750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa9159d8-abb1-48b9-a60c-e84a9eeb319a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:13.885959 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-44613c2f-4fde-45db-9b79-5710bfac7e73 req-6c3d3de3-51c8-4959-b027-9a8e6ae83421 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046957 Jul 25 12:43:13.887212 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 632/1278] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:13.890580 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa9159d8-abb1-48b9-a60c-e84a9eeb319a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:13.891401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa9159d8-abb1-48b9-a60c-e84a9eeb319a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:13.912018 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-35664f45-351a-4bcf-8966-b3f705b27eff tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:13.916735 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-35664f45-351a-4bcf-8966-b3f705b27eff tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:13.924209 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-35664f45-351a-4bcf-8966-b3f705b27eff tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:13.924939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-35664f45-351a-4bcf-8966-b3f705b27eff tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:13.925917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-35664f45-351a-4bcf-8966-b3f705b27eff tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:13.926726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-35664f45-351a-4bcf-8966-b3f705b27eff tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:13.942715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:13.956685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-fa9159d8-abb1-48b9-a60c-e84a9eeb319a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lazy-loading 'flavor' on Instance uuid 2d4a19ea-699a-40fe-a620-9bf5305da67c {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:14.169874 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fa9159d8-abb1-48b9-a60c-e84a9eeb319a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "POST /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c/action" status: 200 len: 32 microversion: 2.1 time: 0.313736 Jul 25 12:43:14.171010 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 647/1279] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:43:13 2022] POST /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c/action => generated 32 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:43:14.181407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0663af3c-f7db-44d7-adde-42411921e6c6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:14.181642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-35664f45-351a-4bcf-8966-b3f705b27eff tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lazy-loading 'services' on Instance uuid 2ad2b2a1-b3f1-47cc-a769-04744715a6ec {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:14.183256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0663af3c-f7db-44d7-adde-42411921e6c6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:14.194872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0663af3c-f7db-44d7-adde-42411921e6c6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:14.195689 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0663af3c-f7db-44d7-adde-42411921e6c6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:14.200722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0663af3c-f7db-44d7-adde-42411921e6c6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:14.201995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0663af3c-f7db-44d7-adde-42411921e6c6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:14.223426 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-35664f45-351a-4bcf-8966-b3f705b27eff tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1929 microversion: 2.75 time: 0.318400 Jul 25 12:43:14.226361 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 633/1280] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:13 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1929 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:43:14.262052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7db2de01-2b32-4c46-9fe8-c08357fa435a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:14.269943 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7db2de01-2b32-4c46-9fe8-c08357fa435a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:14.292225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7db2de01-2b32-4c46-9fe8-c08357fa435a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:14.292913 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7db2de01-2b32-4c46-9fe8-c08357fa435a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:14.294103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7db2de01-2b32-4c46-9fe8-c08357fa435a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:14.294998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7db2de01-2b32-4c46-9fe8-c08357fa435a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:14.473305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7db2de01-2b32-4c46-9fe8-c08357fa435a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:14.485328 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7db2de01-2b32-4c46-9fe8-c08357fa435a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 200 len: 1274 microversion: 2.1 time: 0.245671 Jul 25 12:43:14.505032 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 634/1281] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:14 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 1274 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:14.516756 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-665e8d03-d2d7-4903-93f8-4539e66ebeb7 req-229c4e9d-2f68-4ae6-9752-a5b5ebc58aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9c04c11-ce42-44b4-a6fd-7f7658a05292", "name": "network-vif-deleted", "tag": "3844a30a-3f07-4f1e-9005-38e3c53d311a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:14.528743 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-665e8d03-d2d7-4903-93f8-4539e66ebeb7 req-229c4e9d-2f68-4ae6-9752-a5b5ebc58aac service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:14.529208 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-665e8d03-d2d7-4903-93f8-4539e66ebeb7 req-229c4e9d-2f68-4ae6-9752-a5b5ebc58aac service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:14.549092 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-665e8d03-d2d7-4903-93f8-4539e66ebeb7 req-229c4e9d-2f68-4ae6-9752-a5b5ebc58aac service nova] Creating event network-vif-deleted:3844a30a-3f07-4f1e-9005-38e3c53d311a for instance c9c04c11-ce42-44b4-a6fd-7f7658a05292 on n-h1-848886-15 Jul 25 12:43:14.557138 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-665e8d03-d2d7-4903-93f8-4539e66ebeb7 req-229c4e9d-2f68-4ae6-9752-a5b5ebc58aac service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050836 Jul 25 12:43:14.558556 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 635/1282] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:14.565939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-99b6297e-fa41-4f76-9a34-4b2c86c8ed41 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:14.567685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-99b6297e-fa41-4f76-9a34-4b2c86c8ed41 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:14.580161 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-99b6297e-fa41-4f76-9a34-4b2c86c8ed41 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:14.580452 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-99b6297e-fa41-4f76-9a34-4b2c86c8ed41 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:14.581388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-99b6297e-fa41-4f76-9a34-4b2c86c8ed41 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:14.582382 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-99b6297e-fa41-4f76-9a34-4b2c86c8ed41 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:15.398384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0663af3c-f7db-44d7-adde-42411921e6c6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:15.408540 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0663af3c-f7db-44d7-adde-42411921e6c6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1477 microversion: 2.1 time: 1.235781 Jul 25 12:43:15.409129 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 648/1283] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:14 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1477 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:15.417719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dd380a97-60c6-4210-b4d6-7d00559fd92e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:15.419339 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dd380a97-60c6-4210-b4d6-7d00559fd92e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:15.426224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd380a97-60c6-4210-b4d6-7d00559fd92e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:15.426944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd380a97-60c6-4210-b4d6-7d00559fd92e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:15.427726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd380a97-60c6-4210-b4d6-7d00559fd92e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:15.428164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd380a97-60c6-4210-b4d6-7d00559fd92e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:15.572031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-99b6297e-fa41-4f76-9a34-4b2c86c8ed41 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:15.581503 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-99b6297e-fa41-4f76-9a34-4b2c86c8ed41 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1308 microversion: 2.1 time: 1.021506 Jul 25 12:43:15.582667 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 636/1284] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:14 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1308 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:15.589098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6b5196e0-c4c5-44ad-9d01-0e20cb426f32 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:15.589998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6b5196e0-c4c5-44ad-9d01-0e20cb426f32 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:15.597781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b5196e0-c4c5-44ad-9d01-0e20cb426f32 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:15.598314 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b5196e0-c4c5-44ad-9d01-0e20cb426f32 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:15.599098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b5196e0-c4c5-44ad-9d01-0e20cb426f32 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:15.599535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b5196e0-c4c5-44ad-9d01-0e20cb426f32 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:15.817240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dd380a97-60c6-4210-b4d6-7d00559fd92e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:15.841798 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dd380a97-60c6-4210-b4d6-7d00559fd92e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1505 microversion: 2.1 time: 0.418771 Jul 25 12:43:15.841798 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 649/1285] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:15 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1505 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:15.847836 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8ab24098-2346-4ee1-b59d-d30b8f6b0f93 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9b5e1f0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:15.915710 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8ab24098-2346-4ee1-b59d-d30b8f6b0f93 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c" status: 200 len: 1448 microversion: 2.1 time: 0.083473 Jul 25 12:43:15.916382 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 650/1286] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:15 2022] GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c => generated 1448 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:15.921801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-779e9660-8be3-4928-b2fb-82d3617f9860 req-bfd5d4ff-8d25-47bb-a91e-74bcbbcf4186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159b5add-9666-4a2a-82e7-7571a120cabb", "name": "network-vif-unplugged", "status": "completed", "tag": "27e87312-289e-4818-b884-b357c21f7a9f"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:15.933972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-779e9660-8be3-4928-b2fb-82d3617f9860 req-bfd5d4ff-8d25-47bb-a91e-74bcbbcf4186 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:15.934425 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-779e9660-8be3-4928-b2fb-82d3617f9860 req-bfd5d4ff-8d25-47bb-a91e-74bcbbcf4186 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:15.947252 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-779e9660-8be3-4928-b2fb-82d3617f9860 req-bfd5d4ff-8d25-47bb-a91e-74bcbbcf4186 service nova] Creating event network-vif-unplugged:27e87312-289e-4818-b884-b357c21f7a9f for instance 159b5add-9666-4a2a-82e7-7571a120cabb on n-h2-848886-15 Jul 25 12:43:15.952218 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-779e9660-8be3-4928-b2fb-82d3617f9860 req-bfd5d4ff-8d25-47bb-a91e-74bcbbcf4186 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033938 Jul 25 12:43:15.953082 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 651/1287] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:15.958101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2fe5927e-7aa4-4bf4-b7a7-cf7762a951ed tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:15.958793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2fe5927e-7aa4-4bf4-b7a7-cf7762a951ed tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:15.965838 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2fe5927e-7aa4-4bf4-b7a7-cf7762a951ed tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:15.966206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2fe5927e-7aa4-4bf4-b7a7-cf7762a951ed tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:15.967260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2fe5927e-7aa4-4bf4-b7a7-cf7762a951ed tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:15.967699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2fe5927e-7aa4-4bf4-b7a7-cf7762a951ed tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:15.998088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6b5196e0-c4c5-44ad-9d01-0e20cb426f32 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:16.007817 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6b5196e0-c4c5-44ad-9d01-0e20cb426f32 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1716 microversion: 2.1 time: 0.423879 Jul 25 12:43:16.009097 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 637/1288] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:15 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1716 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:16.014126 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2c6e50ed-bda5-4dc3-8bec-b74d779090eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:16.015099 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2c6e50ed-bda5-4dc3-8bec-b74d779090eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:16.022279 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c6e50ed-bda5-4dc3-8bec-b74d779090eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:16.022885 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c6e50ed-bda5-4dc3-8bec-b74d779090eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:16.023881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c6e50ed-bda5-4dc3-8bec-b74d779090eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:16.024888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c6e50ed-bda5-4dc3-8bec-b74d779090eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:16.083259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-2fe5927e-7aa4-4bf4-b7a7-cf7762a951ed tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lazy-loading 'services' on Instance uuid 2ad2b2a1-b3f1-47cc-a769-04744715a6ec {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:16.101642 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2fe5927e-7aa4-4bf4-b7a7-cf7762a951ed tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1929 microversion: 2.75 time: 0.147299 Jul 25 12:43:16.102273 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 652/1289] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:15 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1929 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:16.160003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2c6e50ed-bda5-4dc3-8bec-b74d779090eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:16.167891 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2c6e50ed-bda5-4dc3-8bec-b74d779090eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 200 len: 1274 microversion: 2.1 time: 0.157472 Jul 25 12:43:16.168630 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 638/1290] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:16 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 1274 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:16.429893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-301d6209-685f-48c2-90ee-d282bab23543 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:16.430599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-301d6209-685f-48c2-90ee-d282bab23543 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:16.441863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-301d6209-685f-48c2-90ee-d282bab23543 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:16.443285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-301d6209-685f-48c2-90ee-d282bab23543 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:16.445491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-301d6209-685f-48c2-90ee-d282bab23543 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:16.446851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-301d6209-685f-48c2-90ee-d282bab23543 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:16.610173 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f35c78f8-40ca-4aaf-9908-d7b5699717f3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:16.610801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f35c78f8-40ca-4aaf-9908-d7b5699717f3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:16.636659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f35c78f8-40ca-4aaf-9908-d7b5699717f3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:16.637118 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f35c78f8-40ca-4aaf-9908-d7b5699717f3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:16.638145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f35c78f8-40ca-4aaf-9908-d7b5699717f3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:16.638741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f35c78f8-40ca-4aaf-9908-d7b5699717f3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:16.857226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-301d6209-685f-48c2-90ee-d282bab23543 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:16.870762 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-301d6209-685f-48c2-90ee-d282bab23543 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1477 microversion: 2.1 time: 0.445399 Jul 25 12:43:16.872240 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 653/1291] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:16 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1477 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:43:16.882631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4dac3f2b-f8dd-4826-88ac-fb5922fa3267 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:16.886797 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4dac3f2b-f8dd-4826-88ac-fb5922fa3267 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:16.899989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4dac3f2b-f8dd-4826-88ac-fb5922fa3267 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:16.900921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4dac3f2b-f8dd-4826-88ac-fb5922fa3267 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:16.904836 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4dac3f2b-f8dd-4826-88ac-fb5922fa3267 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:16.906766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4dac3f2b-f8dd-4826-88ac-fb5922fa3267 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:17.034458 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f35c78f8-40ca-4aaf-9908-d7b5699717f3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:17.047281 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f35c78f8-40ca-4aaf-9908-d7b5699717f3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1308 microversion: 2.1 time: 0.445547 Jul 25 12:43:17.048586 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 639/1292] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:16 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1308 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:17.060316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-04648447-63e5-4b22-b5eb-5a8d5a7f4510 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf97391f0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:17.169769 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-04648447-63e5-4b22-b5eb-5a8d5a7f4510 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c" status: 200 len: 1448 microversion: 2.1 time: 0.114406 Jul 25 12:43:17.172056 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 640/1293] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:17 2022] GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c => generated 1448 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:17.195923 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-95661730-fcaf-4ab2-8c43-8098905ae0d4 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:17.196839 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-95661730-fcaf-4ab2-8c43-8098905ae0d4 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:17.218194 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-95661730-fcaf-4ab2-8c43-8098905ae0d4 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:17.219152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-95661730-fcaf-4ab2-8c43-8098905ae0d4 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:17.220055 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-95661730-fcaf-4ab2-8c43-8098905ae0d4 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:17.225615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-95661730-fcaf-4ab2-8c43-8098905ae0d4 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:17.279151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4dac3f2b-f8dd-4826-88ac-fb5922fa3267 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:17.295353 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4dac3f2b-f8dd-4826-88ac-fb5922fa3267 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1505 microversion: 2.1 time: 0.417103 Jul 25 12:43:17.296636 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 654/1294] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:16 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1505 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:17.314577 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-60a5ee4c-3d97-48e2-a4ca-cc459e058cad tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:17.315820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-60a5ee4c-3d97-48e2-a4ca-cc459e058cad tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:17.332599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-60a5ee4c-3d97-48e2-a4ca-cc459e058cad tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:17.336119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-60a5ee4c-3d97-48e2-a4ca-cc459e058cad tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:17.337243 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-60a5ee4c-3d97-48e2-a4ca-cc459e058cad tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:17.339141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-60a5ee4c-3d97-48e2-a4ca-cc459e058cad tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:17.527286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-60a5ee4c-3d97-48e2-a4ca-cc459e058cad tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lazy-loading 'services' on Instance uuid 2ad2b2a1-b3f1-47cc-a769-04744715a6ec {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:17.593686 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-60a5ee4c-3d97-48e2-a4ca-cc459e058cad tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1929 microversion: 2.75 time: 0.291878 Jul 25 12:43:17.598155 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 655/1295] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:17 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1929 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:17.620022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b2275c20-e61c-4ce9-8afa-f7981323f1eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:17.626084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b2275c20-e61c-4ce9-8afa-f7981323f1eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:17.635847 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b2275c20-e61c-4ce9-8afa-f7981323f1eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:17.636927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b2275c20-e61c-4ce9-8afa-f7981323f1eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:17.638017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b2275c20-e61c-4ce9-8afa-f7981323f1eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:17.639377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b2275c20-e61c-4ce9-8afa-f7981323f1eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:17.732926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-95661730-fcaf-4ab2-8c43-8098905ae0d4 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:17.745687 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-95661730-fcaf-4ab2-8c43-8098905ae0d4 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1716 microversion: 2.1 time: 0.572240 Jul 25 12:43:17.747918 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 641/1296] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:17 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1716 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:17.752703 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-de0190ce-b9fb-413e-8668-3ef2671c5b55 req-ef18f67b-5772-4ca6-8950-a319a5b474b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7baf920-9e9f-472e-b57b-e6ed9f05daee", "tag": "b2e68ed8-3347-4769-ad93-207689dae18a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:17.779767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-de0190ce-b9fb-413e-8668-3ef2671c5b55 req-ef18f67b-5772-4ca6-8950-a319a5b474b7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:17.780128 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-de0190ce-b9fb-413e-8668-3ef2671c5b55 req-ef18f67b-5772-4ca6-8950-a319a5b474b7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:17.812174 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-de0190ce-b9fb-413e-8668-3ef2671c5b55 req-ef18f67b-5772-4ca6-8950-a319a5b474b7 service nova] Creating event network-changed:b2e68ed8-3347-4769-ad93-207689dae18a for instance e7baf920-9e9f-472e-b57b-e6ed9f05daee on n-h2-848886-15 Jul 25 12:43:17.817662 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-de0190ce-b9fb-413e-8668-3ef2671c5b55 req-ef18f67b-5772-4ca6-8950-a319a5b474b7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068575 Jul 25 12:43:17.818851 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 642/1297] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:17.897545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f2f69fd3-0e9f-4751-a45b-08090950ab04 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:17.898307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f2f69fd3-0e9f-4751-a45b-08090950ab04 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:17.912894 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f2f69fd3-0e9f-4751-a45b-08090950ab04 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:17.913749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f2f69fd3-0e9f-4751-a45b-08090950ab04 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:17.914948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f2f69fd3-0e9f-4751-a45b-08090950ab04 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:17.915543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f2f69fd3-0e9f-4751-a45b-08090950ab04 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:18.030657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b2275c20-e61c-4ce9-8afa-f7981323f1eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:18.040006 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b2275c20-e61c-4ce9-8afa-f7981323f1eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 200 len: 1316 microversion: 2.1 time: 0.437985 Jul 25 12:43:18.046308 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 656/1298] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:17 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:18.058282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-3ca70b8a-c09c-4094-8e3d-7fdaf4df5f3a req-f047da6b-149c-4432-a9a3-9aeb338a80df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2cc4389-ef66-4ad7-a6e5-ab70905b9620", "name": "network-vif-plugged", "status": "completed", "tag": "94f1f07a-a4dc-4d37-9c1f-822a76bcc0b8"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:18.069665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3ca70b8a-c09c-4094-8e3d-7fdaf4df5f3a req-f047da6b-149c-4432-a9a3-9aeb338a80df service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:18.070322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3ca70b8a-c09c-4094-8e3d-7fdaf4df5f3a req-f047da6b-149c-4432-a9a3-9aeb338a80df service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:18.097004 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-3ca70b8a-c09c-4094-8e3d-7fdaf4df5f3a req-f047da6b-149c-4432-a9a3-9aeb338a80df service nova] Creating event network-vif-plugged:94f1f07a-a4dc-4d37-9c1f-822a76bcc0b8 for instance f2cc4389-ef66-4ad7-a6e5-ab70905b9620 on n-h2-848886-15 Jul 25 12:43:18.103013 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-3ca70b8a-c09c-4094-8e3d-7fdaf4df5f3a req-f047da6b-149c-4432-a9a3-9aeb338a80df service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055483 Jul 25 12:43:18.104130 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 657/1299] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:18.112841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c47b84ab-80a8-423c-92db-c6a563639512 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:18.113488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c47b84ab-80a8-423c-92db-c6a563639512 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:18.126191 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c47b84ab-80a8-423c-92db-c6a563639512 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:18.126801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c47b84ab-80a8-423c-92db-c6a563639512 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:18.127959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c47b84ab-80a8-423c-92db-c6a563639512 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:18.128567 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c47b84ab-80a8-423c-92db-c6a563639512 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:18.308320 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f2f69fd3-0e9f-4751-a45b-08090950ab04 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:18.317362 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f2f69fd3-0e9f-4751-a45b-08090950ab04 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1477 microversion: 2.1 time: 0.424189 Jul 25 12:43:18.327149 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 643/1300] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:17 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1477 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:18.333051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-927f7b2b-a846-4534-8190-bb4d5721f2d0 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf991e0d0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:18.401872 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-927f7b2b-a846-4534-8190-bb4d5721f2d0 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c" status: 200 len: 1448 microversion: 2.1 time: 0.073471 Jul 25 12:43:18.409538 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 644/1301] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:18 2022] GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c => generated 1448 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:18.420489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c47b84ab-80a8-423c-92db-c6a563639512 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:18.425717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-87a044eb-51bc-43a0-8630-6a4c385aa636 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:18.432672 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c47b84ab-80a8-423c-92db-c6a563639512 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1308 microversion: 2.1 time: 0.324322 Jul 25 12:43:18.433535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-87a044eb-51bc-43a0-8630-6a4c385aa636 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:18.446858 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 658/1302] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:18 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1308 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:18.450597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87a044eb-51bc-43a0-8630-6a4c385aa636 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:18.451163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87a044eb-51bc-43a0-8630-6a4c385aa636 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:18.452050 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87a044eb-51bc-43a0-8630-6a4c385aa636 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:18.452725 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87a044eb-51bc-43a0-8630-6a4c385aa636 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:18.631390 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4a5e5671-4d68-4656-b84a-8e09a4de65f4 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:18.632115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4a5e5671-4d68-4656-b84a-8e09a4de65f4 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:18.651455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a5e5671-4d68-4656-b84a-8e09a4de65f4 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:18.653308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a5e5671-4d68-4656-b84a-8e09a4de65f4 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:18.653425 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-87a044eb-51bc-43a0-8630-6a4c385aa636 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:18.653541 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a5e5671-4d68-4656-b84a-8e09a4de65f4 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:18.654633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a5e5671-4d68-4656-b84a-8e09a4de65f4 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:18.663866 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-87a044eb-51bc-43a0-8630-6a4c385aa636 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1505 microversion: 2.1 time: 0.251499 Jul 25 12:43:18.670473 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 645/1303] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:18 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1505 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:18.740894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-4a5e5671-4d68-4656-b84a-8e09a4de65f4 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lazy-loading 'services' on Instance uuid 2ad2b2a1-b3f1-47cc-a769-04744715a6ec {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:18.760312 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4a5e5671-4d68-4656-b84a-8e09a4de65f4 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1929 microversion: 2.75 time: 0.133181 Jul 25 12:43:18.761971 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 659/1304] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:18 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1929 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:43:18.770511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-68f24e38-98e1-44ef-bb98-ab22c1d86f14 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:18.771776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-68f24e38-98e1-44ef-bb98-ab22c1d86f14 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:18.779344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68f24e38-98e1-44ef-bb98-ab22c1d86f14 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:18.780032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68f24e38-98e1-44ef-bb98-ab22c1d86f14 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:18.780993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68f24e38-98e1-44ef-bb98-ab22c1d86f14 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:18.781626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68f24e38-98e1-44ef-bb98-ab22c1d86f14 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:18.971832 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-68f24e38-98e1-44ef-bb98-ab22c1d86f14 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:18.980512 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-68f24e38-98e1-44ef-bb98-ab22c1d86f14 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1716 microversion: 2.1 time: 0.216146 Jul 25 12:43:18.981407 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 646/1305] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:18 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1716 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:19.070880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f8d07eaf-4975-44bc-9221-da5b3a66deed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:19.074015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f8d07eaf-4975-44bc-9221-da5b3a66deed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:19.081329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:19.100448 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8d07eaf-4975-44bc-9221-da5b3a66deed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:19.100448 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8d07eaf-4975-44bc-9221-da5b3a66deed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:19.101257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8d07eaf-4975-44bc-9221-da5b3a66deed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:19.101786 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8d07eaf-4975-44bc-9221-da5b3a66deed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:19.302888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f8d07eaf-4975-44bc-9221-da5b3a66deed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:19.312313 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f8d07eaf-4975-44bc-9221-da5b3a66deed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 200 len: 1316 microversion: 2.1 time: 0.246718 Jul 25 12:43:19.327572 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 660/1306] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:19 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 1316 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:19.348532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ef52fe07-c37f-4198-b09b-0b7cf767cead tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:19.349151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ef52fe07-c37f-4198-b09b-0b7cf767cead tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:19.355702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef52fe07-c37f-4198-b09b-0b7cf767cead tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:19.356144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef52fe07-c37f-4198-b09b-0b7cf767cead tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:19.357190 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef52fe07-c37f-4198-b09b-0b7cf767cead tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:19.357960 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef52fe07-c37f-4198-b09b-0b7cf767cead tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:19.417052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7ac1894e-100a-45d9-8b59-a7140f5cc528 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9b66280>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:19.499954 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7ac1894e-100a-45d9-8b59-a7140f5cc528 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c" status: 200 len: 1448 microversion: 2.1 time: 0.087275 Jul 25 12:43:19.500772 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 661/1307] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:19 2022] GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c => generated 1448 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:19.510429 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2145580b-6881-43ac-9db6-97cad7f53b8c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:19.510429 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2145580b-6881-43ac-9db6-97cad7f53b8c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:19.521513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2145580b-6881-43ac-9db6-97cad7f53b8c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:19.522005 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2145580b-6881-43ac-9db6-97cad7f53b8c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:19.522795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2145580b-6881-43ac-9db6-97cad7f53b8c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:19.523233 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2145580b-6881-43ac-9db6-97cad7f53b8c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:19.553691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ef52fe07-c37f-4198-b09b-0b7cf767cead tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:19.563074 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ef52fe07-c37f-4198-b09b-0b7cf767cead tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1477 microversion: 2.1 time: 0.218762 Jul 25 12:43:19.576902 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 647/1308] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:19 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1477 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:19.690967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ff8b3eca-8bf2-45d8-bf1d-93b2942da071 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:19.691700 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ff8b3eca-8bf2-45d8-bf1d-93b2942da071 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:19.701451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff8b3eca-8bf2-45d8-bf1d-93b2942da071 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:19.701956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff8b3eca-8bf2-45d8-bf1d-93b2942da071 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:19.710260 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff8b3eca-8bf2-45d8-bf1d-93b2942da071 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:19.710881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff8b3eca-8bf2-45d8-bf1d-93b2942da071 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:19.740595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:19.758539 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:19.784351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2145580b-6881-43ac-9db6-97cad7f53b8c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:19.800956 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2145580b-6881-43ac-9db6-97cad7f53b8c tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1308 microversion: 2.1 time: 0.299202 Jul 25 12:43:19.813864 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 662/1309] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:19 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1308 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:19.818154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ac9b9e8f-0fcb-44b9-ae14-28b782ba692e tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:19.818778 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ac9b9e8f-0fcb-44b9-ae14-28b782ba692e tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:19.833304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac9b9e8f-0fcb-44b9-ae14-28b782ba692e tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:19.834353 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac9b9e8f-0fcb-44b9-ae14-28b782ba692e tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:19.835149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac9b9e8f-0fcb-44b9-ae14-28b782ba692e tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:19.836240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac9b9e8f-0fcb-44b9-ae14-28b782ba692e tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:19.900986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ff8b3eca-8bf2-45d8-bf1d-93b2942da071 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:19.915261 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ff8b3eca-8bf2-45d8-bf1d-93b2942da071 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1505 microversion: 2.1 time: 0.228181 Jul 25 12:43:19.916249 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 648/1310] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:19 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:43:19.954319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-ac9b9e8f-0fcb-44b9-ae14-28b782ba692e tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lazy-loading 'services' on Instance uuid 2ad2b2a1-b3f1-47cc-a769-04744715a6ec {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:19.978496 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ac9b9e8f-0fcb-44b9-ae14-28b782ba692e tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1929 microversion: 2.75 time: 0.175501 Jul 25 12:43:19.979748 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 663/1311] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:19 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1929 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:20.003307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7226f871-1e03-4fc4-9fea-c6e891b827d8 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:20.004562 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7226f871-1e03-4fc4-9fea-c6e891b827d8 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:20.011710 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7226f871-1e03-4fc4-9fea-c6e891b827d8 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:20.012265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7226f871-1e03-4fc4-9fea-c6e891b827d8 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:20.013111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7226f871-1e03-4fc4-9fea-c6e891b827d8 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:20.013609 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7226f871-1e03-4fc4-9fea-c6e891b827d8 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:20.174071 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7226f871-1e03-4fc4-9fea-c6e891b827d8 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:20.183257 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7226f871-1e03-4fc4-9fea-c6e891b827d8 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1716 microversion: 2.1 time: 0.184438 Jul 25 12:43:20.216699 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 649/1312] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:19 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1716 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:20.334758 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2de0116f-c246-4363-a59a-0e811e7571cd tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:20.336030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2de0116f-c246-4363-a59a-0e811e7571cd tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:20.344418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2de0116f-c246-4363-a59a-0e811e7571cd tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:20.345203 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2de0116f-c246-4363-a59a-0e811e7571cd tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:20.346542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2de0116f-c246-4363-a59a-0e811e7571cd tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:20.347211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2de0116f-c246-4363-a59a-0e811e7571cd tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:20.351894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:20.530240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-55af04d0-333a-41ba-b7b5-9a6dd1bec5fe tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9d5e1f0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:20.618366 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-55af04d0-333a-41ba-b7b5-9a6dd1bec5fe tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c" status: 200 len: 1448 microversion: 2.1 time: 0.106865 Jul 25 12:43:20.625766 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 650/1313] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:20 2022] GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c => generated 1448 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:43:20.627903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-37a554d5-fe2b-48b1-968a-2747ca2bd6d4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:20.628650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-37a554d5-fe2b-48b1-968a-2747ca2bd6d4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:20.632874 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2de0116f-c246-4363-a59a-0e811e7571cd tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:20.636787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37a554d5-fe2b-48b1-968a-2747ca2bd6d4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:20.637962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37a554d5-fe2b-48b1-968a-2747ca2bd6d4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:20.638969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37a554d5-fe2b-48b1-968a-2747ca2bd6d4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:20.639539 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37a554d5-fe2b-48b1-968a-2747ca2bd6d4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:20.641425 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2de0116f-c246-4363-a59a-0e811e7571cd tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 200 len: 1316 microversion: 2.1 time: 0.310399 Jul 25 12:43:20.659566 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 664/1314] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:20 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:20.834458 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9b78e441-c700-42b5-9b18-1794d0a4f856 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:20.837435 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9b78e441-c700-42b5-9b18-1794d0a4f856 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:20.860676 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b78e441-c700-42b5-9b18-1794d0a4f856 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:20.861114 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b78e441-c700-42b5-9b18-1794d0a4f856 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:20.862120 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b78e441-c700-42b5-9b18-1794d0a4f856 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:20.862556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b78e441-c700-42b5-9b18-1794d0a4f856 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:20.904914 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-37a554d5-fe2b-48b1-968a-2747ca2bd6d4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:20.917378 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-37a554d5-fe2b-48b1-968a-2747ca2bd6d4 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1477 microversion: 2.1 time: 0.295976 Jul 25 12:43:20.918468 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 651/1315] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:20 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1477 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:20.940093 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3876847a-2372-4678-8abb-d6d28a8a8cea tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:20.940719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3876847a-2372-4678-8abb-d6d28a8a8cea tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:20.948196 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3876847a-2372-4678-8abb-d6d28a8a8cea tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:20.948654 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3876847a-2372-4678-8abb-d6d28a8a8cea tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:20.949431 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3876847a-2372-4678-8abb-d6d28a8a8cea tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:20.950091 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3876847a-2372-4678-8abb-d6d28a8a8cea tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:21.231644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9b78e441-c700-42b5-9b18-1794d0a4f856 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:21.239994 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9b78e441-c700-42b5-9b18-1794d0a4f856 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1308 microversion: 2.1 time: 0.420170 Jul 25 12:43:21.247488 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 665/1316] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:20 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1308 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:21.259329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3876847a-2372-4678-8abb-d6d28a8a8cea tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:21.261569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:21.264280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-40d4ed60-eb1b-4687-a9b5-6ac73475e10c tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:21.265285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-40d4ed60-eb1b-4687-a9b5-6ac73475e10c tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:21.272219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40d4ed60-eb1b-4687-a9b5-6ac73475e10c tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:21.274634 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3876847a-2372-4678-8abb-d6d28a8a8cea tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1505 microversion: 2.1 time: 0.338317 Jul 25 12:43:21.275012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40d4ed60-eb1b-4687-a9b5-6ac73475e10c tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:21.276287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40d4ed60-eb1b-4687-a9b5-6ac73475e10c tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:21.278871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40d4ed60-eb1b-4687-a9b5-6ac73475e10c tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:21.285268 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 652/1317] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:20 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:21.287251 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:21.299184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f6962999-fffd-4c9d-82fa-e1c9898b9602 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:21.300095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f6962999-fffd-4c9d-82fa-e1c9898b9602 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:21.314996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f6962999-fffd-4c9d-82fa-e1c9898b9602 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:21.318454 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f6962999-fffd-4c9d-82fa-e1c9898b9602 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:21.319419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f6962999-fffd-4c9d-82fa-e1c9898b9602 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:21.319950 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f6962999-fffd-4c9d-82fa-e1c9898b9602 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:21.431986 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-40d4ed60-eb1b-4687-a9b5-6ac73475e10c tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lazy-loading 'services' on Instance uuid 2ad2b2a1-b3f1-47cc-a769-04744715a6ec {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:21.473750 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-40d4ed60-eb1b-4687-a9b5-6ac73475e10c tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1929 microversion: 2.75 time: 0.225103 Jul 25 12:43:21.474848 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 666/1318] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:21 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1929 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:21.590553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f6962999-fffd-4c9d-82fa-e1c9898b9602 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:21.599928 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f6962999-fffd-4c9d-82fa-e1c9898b9602 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1716 microversion: 2.1 time: 0.313264 Jul 25 12:43:21.601079 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 653/1319] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:21 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1716 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:21.633016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-175e0477-edd3-4f0c-a872-4b27929cbd2c tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcfed194c0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:21.670042 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1044c4b5-6923-4b55-958e-5e5828cbeee2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:21.670968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1044c4b5-6923-4b55-958e-5e5828cbeee2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:21.685289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1044c4b5-6923-4b55-958e-5e5828cbeee2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:21.685741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1044c4b5-6923-4b55-958e-5e5828cbeee2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:21.688385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1044c4b5-6923-4b55-958e-5e5828cbeee2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:21.688833 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1044c4b5-6923-4b55-958e-5e5828cbeee2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:21.695917 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-175e0477-edd3-4f0c-a872-4b27929cbd2c tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c" status: 200 len: 1448 microversion: 2.1 time: 0.067195 Jul 25 12:43:21.696926 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 667/1320] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:21 2022] GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c => generated 1448 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:21.860865 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1044c4b5-6923-4b55-958e-5e5828cbeee2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:21.872925 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1044c4b5-6923-4b55-958e-5e5828cbeee2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 200 len: 1316 microversion: 2.1 time: 0.209627 Jul 25 12:43:21.877861 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 654/1321] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:21 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 1316 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:21.940545 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3fe2a529-ee38-4c85-934e-c93d2e895e55 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:21.942140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3fe2a529-ee38-4c85-934e-c93d2e895e55 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:21.949607 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=10 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:21.955073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3fe2a529-ee38-4c85-934e-c93d2e895e55 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:21.955988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3fe2a529-ee38-4c85-934e-c93d2e895e55 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:21.957027 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3fe2a529-ee38-4c85-934e-c93d2e895e55 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:21.957847 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3fe2a529-ee38-4c85-934e-c93d2e895e55 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:22.134029 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3fe2a529-ee38-4c85-934e-c93d2e895e55 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:22.142181 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3fe2a529-ee38-4c85-934e-c93d2e895e55 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1477 microversion: 2.1 time: 0.206614 Jul 25 12:43:22.154481 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 668/1322] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:21 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1477 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:22.268687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8d5caeb7-d163-4e88-a0e2-4ed5be5bcb82 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:22.270117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8d5caeb7-d163-4e88-a0e2-4ed5be5bcb82 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:22.277602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d5caeb7-d163-4e88-a0e2-4ed5be5bcb82 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:22.278585 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d5caeb7-d163-4e88-a0e2-4ed5be5bcb82 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:22.279561 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d5caeb7-d163-4e88-a0e2-4ed5be5bcb82 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:22.280294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d5caeb7-d163-4e88-a0e2-4ed5be5bcb82 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:22.295765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-81631778-64c1-4812-86a3-33696bd7b60a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:22.296843 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-81631778-64c1-4812-86a3-33696bd7b60a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:22.311535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-81631778-64c1-4812-86a3-33696bd7b60a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:22.313776 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-81631778-64c1-4812-86a3-33696bd7b60a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:22.315358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-81631778-64c1-4812-86a3-33696bd7b60a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:22.318213 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-81631778-64c1-4812-86a3-33696bd7b60a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:22.648927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-81631778-64c1-4812-86a3-33696bd7b60a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:22.663042 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-81631778-64c1-4812-86a3-33696bd7b60a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1505 microversion: 2.1 time: 0.370929 Jul 25 12:43:22.663795 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 669/1323] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:22 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1505 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:43:22.673207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6ef35481-f05f-4bfe-9ed3-38585750e2ca tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:22.681741 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6ef35481-f05f-4bfe-9ed3-38585750e2ca tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:22.718168 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ef35481-f05f-4bfe-9ed3-38585750e2ca tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:22.719425 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ef35481-f05f-4bfe-9ed3-38585750e2ca tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:22.720390 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ef35481-f05f-4bfe-9ed3-38585750e2ca tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:22.720981 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ef35481-f05f-4bfe-9ed3-38585750e2ca tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:22.871827 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8d5caeb7-d163-4e88-a0e2-4ed5be5bcb82 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:22.874259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-6ef35481-f05f-4bfe-9ed3-38585750e2ca tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lazy-loading 'services' on Instance uuid 2ad2b2a1-b3f1-47cc-a769-04744715a6ec {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:22.884931 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8d5caeb7-d163-4e88-a0e2-4ed5be5bcb82 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1308 microversion: 2.1 time: 0.617059 Jul 25 12:43:22.897955 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 655/1324] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:22 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1308 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:22.899031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0d502236-c037-4a37-ba3f-70646363371a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:22.900264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0d502236-c037-4a37-ba3f-70646363371a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:22.915235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d502236-c037-4a37-ba3f-70646363371a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:22.918108 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d502236-c037-4a37-ba3f-70646363371a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:22.924378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d502236-c037-4a37-ba3f-70646363371a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:22.924597 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6ef35481-f05f-4bfe-9ed3-38585750e2ca tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1929 microversion: 2.75 time: 0.259449 Jul 25 12:43:22.934724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d502236-c037-4a37-ba3f-70646363371a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:22.934946 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 670/1325] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:22 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1929 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:22.934946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-87fb0d21-74a7-40fb-b726-1c2763a9bfc8 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcfed92670>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:23.032787 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-87fb0d21-74a7-40fb-b726-1c2763a9bfc8 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c" status: 200 len: 1448 microversion: 2.1 time: 0.106607 Jul 25 12:43:23.033426 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 671/1326] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:22 2022] GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c => generated 1448 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:23.043962 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f07e7f5e-4b80-40cf-aada-e8e718dc743a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:23.044581 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f07e7f5e-4b80-40cf-aada-e8e718dc743a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:23.068796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f07e7f5e-4b80-40cf-aada-e8e718dc743a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:23.069264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f07e7f5e-4b80-40cf-aada-e8e718dc743a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:23.070212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f07e7f5e-4b80-40cf-aada-e8e718dc743a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:23.070753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f07e7f5e-4b80-40cf-aada-e8e718dc743a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:23.908972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0d502236-c037-4a37-ba3f-70646363371a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:23.922682 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0d502236-c037-4a37-ba3f-70646363371a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1716 microversion: 2.1 time: 1.035336 Jul 25 12:43:23.923880 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 656/1327] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:22 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1716 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:23.947894 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9ce80bc1-8518-40e2-b39a-7a2e5d0c71ca tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:23.954062 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9ce80bc1-8518-40e2-b39a-7a2e5d0c71ca tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:23.971683 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ce80bc1-8518-40e2-b39a-7a2e5d0c71ca tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:23.973307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ce80bc1-8518-40e2-b39a-7a2e5d0c71ca tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:23.975137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ce80bc1-8518-40e2-b39a-7a2e5d0c71ca tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:23.977465 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ce80bc1-8518-40e2-b39a-7a2e5d0c71ca tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:24.347750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f07e7f5e-4b80-40cf-aada-e8e718dc743a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:24.369973 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f07e7f5e-4b80-40cf-aada-e8e718dc743a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 200 len: 1316 microversion: 2.1 time: 1.329221 Jul 25 12:43:24.378962 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 672/1328] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:23 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 1316 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:24.399670 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-13464ef8-b6d7-42e4-89d8-a5207eb5d1ed tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:24.400242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-13464ef8-b6d7-42e4-89d8-a5207eb5d1ed tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:24.408142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-13464ef8-b6d7-42e4-89d8-a5207eb5d1ed tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:24.408592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-13464ef8-b6d7-42e4-89d8-a5207eb5d1ed tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:24.409572 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-13464ef8-b6d7-42e4-89d8-a5207eb5d1ed tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:24.410058 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-13464ef8-b6d7-42e4-89d8-a5207eb5d1ed tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:24.485344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9ce80bc1-8518-40e2-b39a-7a2e5d0c71ca tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:24.510030 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9ce80bc1-8518-40e2-b39a-7a2e5d0c71ca tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1477 microversion: 2.1 time: 0.572667 Jul 25 12:43:24.528185 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 657/1329] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:23 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1477 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:24.541786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0809482b-abe5-4d81-865b-0d52e4ba631d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:24.544428 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0809482b-abe5-4d81-865b-0d52e4ba631d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:24.576450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0809482b-abe5-4d81-865b-0d52e4ba631d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:24.577255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0809482b-abe5-4d81-865b-0d52e4ba631d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:24.580717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0809482b-abe5-4d81-865b-0d52e4ba631d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:24.581590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0809482b-abe5-4d81-865b-0d52e4ba631d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:24.978730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-13464ef8-b6d7-42e4-89d8-a5207eb5d1ed tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:24.990867 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-13464ef8-b6d7-42e4-89d8-a5207eb5d1ed tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1505 microversion: 2.1 time: 0.609410 Jul 25 12:43:25.006562 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 673/1330] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:24 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1505 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:25.016150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-859528bd-d4f1-4f31-a785-2bcf673c850d tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:25.023601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-859528bd-d4f1-4f31-a785-2bcf673c850d tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:25.032526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-859528bd-d4f1-4f31-a785-2bcf673c850d tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:25.033216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-859528bd-d4f1-4f31-a785-2bcf673c850d tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:25.039211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-859528bd-d4f1-4f31-a785-2bcf673c850d tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:25.039934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-859528bd-d4f1-4f31-a785-2bcf673c850d tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:25.217489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-859528bd-d4f1-4f31-a785-2bcf673c850d tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lazy-loading 'services' on Instance uuid 2ad2b2a1-b3f1-47cc-a769-04744715a6ec {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:25.226676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0809482b-abe5-4d81-865b-0d52e4ba631d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:25.237189 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0809482b-abe5-4d81-865b-0d52e4ba631d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1308 microversion: 2.1 time: 0.707627 Jul 25 12:43:25.237798 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 658/1331] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:24 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1308 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:25.252096 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-859528bd-d4f1-4f31-a785-2bcf673c850d tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1929 microversion: 2.75 time: 0.244083 Jul 25 12:43:25.253734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7e4cd0ac-98d3-4320-9ada-066bbf58c833 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9e934c0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:25.255396 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 674/1332] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:25 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1929 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:25.269679 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d30af666-f53e-4695-8ce7-c16f9563f482 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:25.270645 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d30af666-f53e-4695-8ce7-c16f9563f482 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:25.294529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d30af666-f53e-4695-8ce7-c16f9563f482 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:25.294993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d30af666-f53e-4695-8ce7-c16f9563f482 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:25.295799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d30af666-f53e-4695-8ce7-c16f9563f482 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:25.296463 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d30af666-f53e-4695-8ce7-c16f9563f482 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:25.339011 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7e4cd0ac-98d3-4320-9ada-066bbf58c833 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c" status: 200 len: 1448 microversion: 2.1 time: 0.100100 Jul 25 12:43:25.340612 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 659/1333] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:25 2022] GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c => generated 1448 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:25.408566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-309bc965-2df9-43f2-8f6b-5b8657c945c5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:25.411954 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-309bc965-2df9-43f2-8f6b-5b8657c945c5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:25.423443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-309bc965-2df9-43f2-8f6b-5b8657c945c5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:25.424094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-309bc965-2df9-43f2-8f6b-5b8657c945c5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:25.433369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-309bc965-2df9-43f2-8f6b-5b8657c945c5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:25.434769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-309bc965-2df9-43f2-8f6b-5b8657c945c5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:25.803456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d30af666-f53e-4695-8ce7-c16f9563f482 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:25.816533 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-309bc965-2df9-43f2-8f6b-5b8657c945c5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:25.816804 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d30af666-f53e-4695-8ce7-c16f9563f482 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1716 microversion: 2.1 time: 0.550866 Jul 25 12:43:25.829861 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 675/1334] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:25 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1716 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:25.840032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-954e91ab-9c00-43c6-ae69-e0da51498b28 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:25.844309 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-309bc965-2df9-43f2-8f6b-5b8657c945c5 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 200 len: 1316 microversion: 2.1 time: 0.441085 Jul 25 12:43:25.845255 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 660/1335] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:25 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:25.846684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-954e91ab-9c00-43c6-ae69-e0da51498b28 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:25.855633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-954e91ab-9c00-43c6-ae69-e0da51498b28 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:25.857861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-954e91ab-9c00-43c6-ae69-e0da51498b28 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:25.859499 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-954e91ab-9c00-43c6-ae69-e0da51498b28 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:25.860605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-954e91ab-9c00-43c6-ae69-e0da51498b28 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:25.925080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-a5dc2aaf-1ad5-4c3c-990f-b2365ef76f8b req-7c28236c-8b7d-4514-8769-585492cbb6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89024fb2-f607-462a-b8e4-f7004f7987ad", "tag": "94116aa6-64d7-4863-a19d-2ff08dcc7c4e"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:25.937678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:25.951186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a5dc2aaf-1ad5-4c3c-990f-b2365ef76f8b req-7c28236c-8b7d-4514-8769-585492cbb6a0 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:25.954218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a5dc2aaf-1ad5-4c3c-990f-b2365ef76f8b req-7c28236c-8b7d-4514-8769-585492cbb6a0 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:25.976992 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-a5dc2aaf-1ad5-4c3c-990f-b2365ef76f8b req-7c28236c-8b7d-4514-8769-585492cbb6a0 service nova] Creating event network-changed:94116aa6-64d7-4863-a19d-2ff08dcc7c4e for instance 89024fb2-f607-462a-b8e4-f7004f7987ad on n-h1-848886-15 Jul 25 12:43:25.992751 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-a5dc2aaf-1ad5-4c3c-990f-b2365ef76f8b req-7c28236c-8b7d-4514-8769-585492cbb6a0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073410 Jul 25 12:43:25.997029 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 661/1336] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:26.020726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f5925746-3026-4cc4-bf55-9dfae87b86f2 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:26.021605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f5925746-3026-4cc4-bf55-9dfae87b86f2 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:26.037866 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5925746-3026-4cc4-bf55-9dfae87b86f2 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:26.039892 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5925746-3026-4cc4-bf55-9dfae87b86f2 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:26.040807 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5925746-3026-4cc4-bf55-9dfae87b86f2 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:26.041350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5925746-3026-4cc4-bf55-9dfae87b86f2 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:26.450929 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f5925746-3026-4cc4-bf55-9dfae87b86f2 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:26.460972 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f5925746-3026-4cc4-bf55-9dfae87b86f2 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1505 microversion: 2.1 time: 0.442787 Jul 25 12:43:26.473882 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 662/1337] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:26 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1505 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:43:26.476846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-954e91ab-9c00-43c6-ae69-e0da51498b28 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:26.477195 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-c8e8ab40-f81c-4f36-b517-0cd92af4ce2d req-5e26c187-a495-404d-a100-bb7930030d5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7baf920-9e9f-472e-b57b-e6ed9f05daee", "name": "network-vif-plugged", "status": "completed", "tag": "b2e68ed8-3347-4769-ad93-207689dae18a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:26.480190 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-954e91ab-9c00-43c6-ae69-e0da51498b28 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1477 microversion: 2.1 time: 0.646245 Jul 25 12:43:26.485887 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 676/1338] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:25 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1477 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:26.487870 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c8e8ab40-f81c-4f36-b517-0cd92af4ce2d req-5e26c187-a495-404d-a100-bb7930030d5d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:26.488323 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c8e8ab40-f81c-4f36-b517-0cd92af4ce2d req-5e26c187-a495-404d-a100-bb7930030d5d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:26.494622 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-054b6bc6-ea83-4cf2-b78a-fe2c97978080 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:26.496387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-054b6bc6-ea83-4cf2-b78a-fe2c97978080 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:26.503807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-054b6bc6-ea83-4cf2-b78a-fe2c97978080 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:26.504651 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-054b6bc6-ea83-4cf2-b78a-fe2c97978080 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:26.508549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-054b6bc6-ea83-4cf2-b78a-fe2c97978080 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:26.509820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-054b6bc6-ea83-4cf2-b78a-fe2c97978080 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:26.512951 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-c8e8ab40-f81c-4f36-b517-0cd92af4ce2d req-5e26c187-a495-404d-a100-bb7930030d5d service nova] Creating event network-vif-plugged:b2e68ed8-3347-4769-ad93-207689dae18a for instance e7baf920-9e9f-472e-b57b-e6ed9f05daee on n-h2-848886-15 Jul 25 12:43:26.527489 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-c8e8ab40-f81c-4f36-b517-0cd92af4ce2d req-5e26c187-a495-404d-a100-bb7930030d5d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061095 Jul 25 12:43:26.528509 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 663/1339] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:26.533700 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3f52295d-c5d8-49ea-a561-24e5b4fb0fae tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:26.534436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3f52295d-c5d8-49ea-a561-24e5b4fb0fae tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:26.540963 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3f52295d-c5d8-49ea-a561-24e5b4fb0fae tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:26.541418 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3f52295d-c5d8-49ea-a561-24e5b4fb0fae tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:26.542238 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3f52295d-c5d8-49ea-a561-24e5b4fb0fae tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:26.542671 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3f52295d-c5d8-49ea-a561-24e5b4fb0fae tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:26.721300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-3f52295d-c5d8-49ea-a561-24e5b4fb0fae tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lazy-loading 'services' on Instance uuid 2ad2b2a1-b3f1-47cc-a769-04744715a6ec {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:26.767515 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3f52295d-c5d8-49ea-a561-24e5b4fb0fae tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1929 microversion: 2.75 time: 0.237664 Jul 25 12:43:26.768035 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 664/1340] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:26 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1929 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:26.783716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ee3fc52e-5b76-4b2c-b986-c8dd05cdc83b tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf991e550>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:26.850001 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ee3fc52e-5b76-4b2c-b986-c8dd05cdc83b tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c" status: 200 len: 1448 microversion: 2.1 time: 0.080892 Jul 25 12:43:26.857226 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 665/1341] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:26 2022] GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c => generated 1448 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:26.864157 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5c95e149-b159-4f57-9077-f3978cfd87ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-112002105", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "6ff0fb68-b414-4b82-96bf-e15dd2a7af95"}], "block_device_mapping_v2": [{"uuid": "53ed347d-2791-4645-8b3e-2ec09003097c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:26.964555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-5c95e149-b159-4f57-9077-f3978cfd87ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] validate_networks() for [('6ff0fb68-b414-4b82-96bf-e15dd2a7af95', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:43:26.999612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-054b6bc6-ea83-4cf2-b78a-fe2c97978080 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:27.009436 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-054b6bc6-ea83-4cf2-b78a-fe2c97978080 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1308 microversion: 2.1 time: 0.519227 Jul 25 12:43:27.010370 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 677/1342] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:26 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1308 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:27.015332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dc737def-ad54-4438-af3c-650a99ea3f9c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:27.016341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dc737def-ad54-4438-af3c-650a99ea3f9c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:27.023216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc737def-ad54-4438-af3c-650a99ea3f9c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:27.023904 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc737def-ad54-4438-af3c-650a99ea3f9c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:27.025221 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc737def-ad54-4438-af3c-650a99ea3f9c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:27.025850 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc737def-ad54-4438-af3c-650a99ea3f9c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:27.551786 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dc737def-ad54-4438-af3c-650a99ea3f9c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:27.562272 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dc737def-ad54-4438-af3c-650a99ea3f9c tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1706 microversion: 2.1 time: 0.550638 Jul 25 12:43:27.588411 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 678/1343] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:27 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1706 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:27.598239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e06c6bfd-9c79-4be2-9f21-873ea1ec34a9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:27.599200 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e06c6bfd-9c79-4be2-9f21-873ea1ec34a9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:27.611448 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e06c6bfd-9c79-4be2-9f21-873ea1ec34a9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:27.612219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e06c6bfd-9c79-4be2-9f21-873ea1ec34a9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:27.613456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e06c6bfd-9c79-4be2-9f21-873ea1ec34a9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:27.614107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e06c6bfd-9c79-4be2-9f21-873ea1ec34a9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:27.775882 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5c95e149-b159-4f57-9077-f3978cfd87ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:43:27.776409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5c95e149-b159-4f57-9077-f3978cfd87ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:43:27.776907 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5c95e149-b159-4f57-9077-f3978cfd87ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:43:27.777377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5c95e149-b159-4f57-9077-f3978cfd87ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:43:27.778016 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5c95e149-b159-4f57-9077-f3978cfd87ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:43:27.796655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c95e149-b159-4f57-9077-f3978cfd87ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:27.797275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c95e149-b159-4f57-9077-f3978cfd87ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:27.798180 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c95e149-b159-4f57-9077-f3978cfd87ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:27.798909 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c95e149-b159-4f57-9077-f3978cfd87ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:27.810449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e06c6bfd-9c79-4be2-9f21-873ea1ec34a9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:27.819017 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e06c6bfd-9c79-4be2-9f21-873ea1ec34a9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 200 len: 1316 microversion: 2.1 time: 0.228329 Jul 25 12:43:27.821273 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 679/1344] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:27 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 1316 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:27.821727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-5c95e149-b159-4f57-9077-f3978cfd87ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Getting quotas for project bdce4da5878543a4a609dc35e389763c. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:43:27.826384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5b72d38e-0c0a-4151-a0c6-45b05f7974b2 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:27.827167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5b72d38e-0c0a-4151-a0c6-45b05f7974b2 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:27.827905 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-5c95e149-b159-4f57-9077-f3978cfd87ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Getting quotas for user fa79a472f31b4e8eb0a6ad709bc84c01 and project bdce4da5878543a4a609dc35e389763c. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:43:27.833746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b72d38e-0c0a-4151-a0c6-45b05f7974b2 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:27.834443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b72d38e-0c0a-4151-a0c6-45b05f7974b2 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:27.835481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b72d38e-0c0a-4151-a0c6-45b05f7974b2 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:27.840645 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b72d38e-0c0a-4151-a0c6-45b05f7974b2 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:27.903236 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5c95e149-b159-4f57-9077-f3978cfd87ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:43:27.905325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5c95e149-b159-4f57-9077-f3978cfd87ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='53ed347d-2791-4645-8b3e-2ec09003097c',volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:43:27.995929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5b72d38e-0c0a-4151-a0c6-45b05f7974b2 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:28.006045 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5b72d38e-0c0a-4151-a0c6-45b05f7974b2 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1505 microversion: 2.1 time: 0.183347 Jul 25 12:43:28.014460 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 680/1345] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:27 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1505 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:28.022467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b0f68516-7287-4a4b-beb0-22af0c9caf24 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:28.023166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b0f68516-7287-4a4b-beb0-22af0c9caf24 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:28.042719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0f68516-7287-4a4b-beb0-22af0c9caf24 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:28.045449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0f68516-7287-4a4b-beb0-22af0c9caf24 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:28.046849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0f68516-7287-4a4b-beb0-22af0c9caf24 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:28.047560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0f68516-7287-4a4b-beb0-22af0c9caf24 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:28.085239 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5c95e149-b159-4f57-9077-f3978cfd87ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.229160 Jul 25 12:43:28.092148 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 666/1346] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Jul 25 12:43:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 12:43:28.097525 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ce1100e8-67fe-4a06-b7c9-b62500541df2 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Calling method '.version_select at 0x7efcf9a8f550>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:28.101854 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ce1100e8-67fe-4a06-b7c9-b62500541df2 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:28.102607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ce1100e8-67fe-4a06-b7c9-b62500541df2 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:28.132424 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ce1100e8-67fe-4a06-b7c9-b62500541df2 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 3929 microversion: 2.1 time: 0.038891 Jul 25 12:43:28.133741 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 667/1347] 10.222.0.49 () {58 vars in 1143 bytes} [Mon Jul 25 12:43:28 2022] GET /compute/v2.1/os-migrations => generated 3929 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:28.139119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8a6d5821-3ffe-413a-bf75-aa9be23808b8 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:28.139926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8a6d5821-3ffe-413a-bf75-aa9be23808b8 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:28.146980 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8a6d5821-3ffe-413a-bf75-aa9be23808b8 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:28.147666 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8a6d5821-3ffe-413a-bf75-aa9be23808b8 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:28.148646 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8a6d5821-3ffe-413a-bf75-aa9be23808b8 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:28.149600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8a6d5821-3ffe-413a-bf75-aa9be23808b8 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:28.217569 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b0f68516-7287-4a4b-beb0-22af0c9caf24 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:28.223827 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:28.231136 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b0f68516-7287-4a4b-beb0-22af0c9caf24 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1477 microversion: 2.1 time: 0.210827 Jul 25 12:43:28.231448 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 681/1348] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:28 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1477 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:28.239627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-29e6629c-4a3f-471c-b4af-71ba00b49a4c tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcfed8d790>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:28.284162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-8a6d5821-3ffe-413a-bf75-aa9be23808b8 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lazy-loading 'services' on Instance uuid 2ad2b2a1-b3f1-47cc-a769-04744715a6ec {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:28.293976 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-29e6629c-4a3f-471c-b4af-71ba00b49a4c tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c" status: 200 len: 1448 microversion: 2.1 time: 0.060697 Jul 25 12:43:28.294750 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 682/1349] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:28 2022] GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c => generated 1448 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:28.302479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7928d423-e716-4227-9b11-0b16f44fc4b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:28.302479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7928d423-e716-4227-9b11-0b16f44fc4b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:28.310651 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7928d423-e716-4227-9b11-0b16f44fc4b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:28.311628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7928d423-e716-4227-9b11-0b16f44fc4b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:28.313202 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7928d423-e716-4227-9b11-0b16f44fc4b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:28.313704 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7928d423-e716-4227-9b11-0b16f44fc4b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:28.314121 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8a6d5821-3ffe-413a-bf75-aa9be23808b8 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1929 microversion: 2.75 time: 0.178988 Jul 25 12:43:28.315023 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 668/1350] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:28 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1929 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:28.330593 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5889d214-d6d7-461c-8c1e-84696fc716e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:28.331221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5889d214-d6d7-461c-8c1e-84696fc716e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:28.406821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5889d214-d6d7-461c-8c1e-84696fc716e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:28.419850 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5889d214-d6d7-461c-8c1e-84696fc716e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:28.421709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5889d214-d6d7-461c-8c1e-84696fc716e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:28.424909 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5889d214-d6d7-461c-8c1e-84696fc716e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1103 microversion: 2.25 time: 0.107539 Jul 25 12:43:28.442304 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 669/1351] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:28 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1103 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:28.449011 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4fe1123d-5a38-47e8-8123-2665d291b125 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:28.451038 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4fe1123d-5a38-47e8-8123-2665d291b125 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:28.459351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4fe1123d-5a38-47e8-8123-2665d291b125 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:28.460090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4fe1123d-5a38-47e8-8123-2665d291b125 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:28.461496 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4fe1123d-5a38-47e8-8123-2665d291b125 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:28.462455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4fe1123d-5a38-47e8-8123-2665d291b125 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:28.591409 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7928d423-e716-4227-9b11-0b16f44fc4b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:28.602428 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7928d423-e716-4227-9b11-0b16f44fc4b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1308 microversion: 2.1 time: 0.306111 Jul 25 12:43:28.604477 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 683/1352] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:28 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1308 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:28.718794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:28.733480 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4fe1123d-5a38-47e8-8123-2665d291b125 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1859 microversion: 2.1 time: 0.288020 Jul 25 12:43:28.741864 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 670/1353] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:28 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1859 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:28.847057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-19fe3d82-e62d-45c8-b69b-95ae9bb381c8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:28.847875 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-19fe3d82-e62d-45c8-b69b-95ae9bb381c8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:28.854490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-19fe3d82-e62d-45c8-b69b-95ae9bb381c8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:28.855164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-19fe3d82-e62d-45c8-b69b-95ae9bb381c8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:28.857274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-19fe3d82-e62d-45c8-b69b-95ae9bb381c8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:28.858773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-19fe3d82-e62d-45c8-b69b-95ae9bb381c8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:28.888625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f867ab98-2946-47ae-9b88-73cb4febadc5 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:28.890421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f867ab98-2946-47ae-9b88-73cb4febadc5 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:28.898584 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f867ab98-2946-47ae-9b88-73cb4febadc5 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:28.899666 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f867ab98-2946-47ae-9b88-73cb4febadc5 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:28.900680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f867ab98-2946-47ae-9b88-73cb4febadc5 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:28.901392 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f867ab98-2946-47ae-9b88-73cb4febadc5 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:29.045286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-f867ab98-2946-47ae-9b88-73cb4febadc5 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lazy-loading 'services' on Instance uuid d2711752-4c19-477f-a5f0-e5097f2dc41a {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:29.223613 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f867ab98-2946-47ae-9b88-73cb4febadc5 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a/os-volume_attachments/12d85cbc-6af6-43fe-ae92-3275db3daa0c" status: 202 len: 0 microversion: 2.1 time: 0.338776 Jul 25 12:43:29.224941 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 671/1354] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Jul 25 12:43:28 2022] DELETE /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a/os-volume_attachments/12d85cbc-6af6-43fe-ae92-3275db3daa0c => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:43:29.230386 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d34da4e2-a2fb-4374-a139-188d08a94a68 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:29.231296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d34da4e2-a2fb-4374-a139-188d08a94a68 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:29.237296 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-19fe3d82-e62d-45c8-b69b-95ae9bb381c8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:29.238363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d34da4e2-a2fb-4374-a139-188d08a94a68 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:29.238814 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d34da4e2-a2fb-4374-a139-188d08a94a68 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:29.239640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d34da4e2-a2fb-4374-a139-188d08a94a68 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:29.240090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d34da4e2-a2fb-4374-a139-188d08a94a68 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:29.254776 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-19fe3d82-e62d-45c8-b69b-95ae9bb381c8 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 200 len: 1316 microversion: 2.1 time: 0.412504 Jul 25 12:43:29.256004 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 684/1355] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:28 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 1316 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:29.263367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b0f9a8fd-9383-4093-89c6-02c7faabfa9b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:29.266685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b0f9a8fd-9383-4093-89c6-02c7faabfa9b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:29.275200 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0f9a8fd-9383-4093-89c6-02c7faabfa9b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:29.276597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0f9a8fd-9383-4093-89c6-02c7faabfa9b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:29.277605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0f9a8fd-9383-4093-89c6-02c7faabfa9b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:29.279212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0f9a8fd-9383-4093-89c6-02c7faabfa9b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:29.326004 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b0f9a8fd-9383-4093-89c6-02c7faabfa9b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068550 Jul 25 12:43:29.326893 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 685/1356] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 12:43:29 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:29.331523 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-544f447f-9056-4b4f-9f7d-193f59a3c905 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:29.332128 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-544f447f-9056-4b4f-9f7d-193f59a3c905 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:29.347176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-544f447f-9056-4b4f-9f7d-193f59a3c905 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:29.347945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-544f447f-9056-4b4f-9f7d-193f59a3c905 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:29.348730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-544f447f-9056-4b4f-9f7d-193f59a3c905 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:29.349164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-544f447f-9056-4b4f-9f7d-193f59a3c905 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:29.416730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d34da4e2-a2fb-4374-a139-188d08a94a68 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:29.425704 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d34da4e2-a2fb-4374-a139-188d08a94a68 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1505 microversion: 2.1 time: 0.199306 Jul 25 12:43:29.426391 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 672/1357] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:29 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1505 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:29.431838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9134fcae-97ab-434a-aec0-1253dc06d4b0 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9a3b310>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:29.484433 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9134fcae-97ab-434a-aec0-1253dc06d4b0 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c" status: 200 len: 1448 microversion: 2.1 time: 0.056413 Jul 25 12:43:29.486412 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 673/1358] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:29 2022] GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c => generated 1448 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:29.492840 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-263955c6-3c11-4638-8837-af493f8e56b5 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:29.493993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-263955c6-3c11-4638-8837-af493f8e56b5 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:29.501048 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-263955c6-3c11-4638-8837-af493f8e56b5 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:29.501877 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-263955c6-3c11-4638-8837-af493f8e56b5 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:29.502893 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-263955c6-3c11-4638-8837-af493f8e56b5 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:29.503585 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-263955c6-3c11-4638-8837-af493f8e56b5 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:29.616531 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-544f447f-9056-4b4f-9f7d-193f59a3c905 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:29.632566 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-544f447f-9056-4b4f-9f7d-193f59a3c905 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1477 microversion: 2.1 time: 0.304485 Jul 25 12:43:29.632945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-263955c6-3c11-4638-8837-af493f8e56b5 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lazy-loading 'services' on Instance uuid 2ad2b2a1-b3f1-47cc-a769-04744715a6ec {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:29.634711 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 686/1359] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:29 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1477 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:29.642010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ebd2ce6f-6226-4d08-a5eb-70aa56378a2f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:29.643021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ebd2ce6f-6226-4d08-a5eb-70aa56378a2f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:29.650861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ebd2ce6f-6226-4d08-a5eb-70aa56378a2f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:29.651360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ebd2ce6f-6226-4d08-a5eb-70aa56378a2f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:29.652351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ebd2ce6f-6226-4d08-a5eb-70aa56378a2f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:29.652939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ebd2ce6f-6226-4d08-a5eb-70aa56378a2f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:29.686644 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-263955c6-3c11-4638-8837-af493f8e56b5 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1929 microversion: 2.75 time: 0.197891 Jul 25 12:43:29.688035 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 674/1360] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:29 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1929 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:29.696641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ef828e99-fd93-459a-8999-57c9bab136e7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:29.697573 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ef828e99-fd93-459a-8999-57c9bab136e7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:29.712055 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef828e99-fd93-459a-8999-57c9bab136e7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:29.713355 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef828e99-fd93-459a-8999-57c9bab136e7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:29.714409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef828e99-fd93-459a-8999-57c9bab136e7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:29.715288 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef828e99-fd93-459a-8999-57c9bab136e7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:29.723912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ebd2ce6f-6226-4d08-a5eb-70aa56378a2f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:29.735528 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ebd2ce6f-6226-4d08-a5eb-70aa56378a2f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:29.737132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ebd2ce6f-6226-4d08-a5eb-70aa56378a2f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:29.738648 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ebd2ce6f-6226-4d08-a5eb-70aa56378a2f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1240 microversion: 2.25 time: 0.102467 Jul 25 12:43:29.739838 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 687/1361] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:29 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1240 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:29.876082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ef828e99-fd93-459a-8999-57c9bab136e7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:29.884470 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ef828e99-fd93-459a-8999-57c9bab136e7 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1308 microversion: 2.1 time: 0.194993 Jul 25 12:43:29.885055 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 675/1362] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:29 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1308 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:30.276674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-89afba4b-80e0-4f33-b444-8e6d381ad385 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:30.277585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-89afba4b-80e0-4f33-b444-8e6d381ad385 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:30.284720 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-89afba4b-80e0-4f33-b444-8e6d381ad385 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:30.285253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-89afba4b-80e0-4f33-b444-8e6d381ad385 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:30.286590 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-89afba4b-80e0-4f33-b444-8e6d381ad385 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:30.287251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-89afba4b-80e0-4f33-b444-8e6d381ad385 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:30.340119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a2c6156c-a149-4274-b6a6-cd1a67416e82 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:30.343545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a2c6156c-a149-4274-b6a6-cd1a67416e82 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:30.352159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2c6156c-a149-4274-b6a6-cd1a67416e82 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:30.352896 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2c6156c-a149-4274-b6a6-cd1a67416e82 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:30.354086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2c6156c-a149-4274-b6a6-cd1a67416e82 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:30.354892 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2c6156c-a149-4274-b6a6-cd1a67416e82 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:30.389347 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a2c6156c-a149-4274-b6a6-cd1a67416e82 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053924 Jul 25 12:43:30.397886 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 676/1363] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 12:43:30 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:30.450593 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-364430b7-ace3-4a19-a987-013794eb7ab3 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:30.451766 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-364430b7-ace3-4a19-a987-013794eb7ab3 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:30.458778 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-364430b7-ace3-4a19-a987-013794eb7ab3 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:30.459467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-364430b7-ace3-4a19-a987-013794eb7ab3 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:30.460467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-364430b7-ace3-4a19-a987-013794eb7ab3 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:30.461122 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-364430b7-ace3-4a19-a987-013794eb7ab3 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:30.469590 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-89afba4b-80e0-4f33-b444-8e6d381ad385 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:30.478893 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-89afba4b-80e0-4f33-b444-8e6d381ad385 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 200 len: 1316 microversion: 2.1 time: 0.206739 Jul 25 12:43:30.480537 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 688/1364] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:30 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 1316 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:30.502527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-73ae36f6-e3e3-490a-835b-c7652da5a5c1 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcfed92280>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:30.553721 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-73ae36f6-e3e3-490a-835b-c7652da5a5c1 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c" status: 200 len: 1457 microversion: 2.1 time: 0.055122 Jul 25 12:43:30.554826 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 689/1365] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:30 2022] GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c => generated 1457 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:43:30.568935 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-731c2153-6325-43d5-b178-5a8409438f4b tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcfed8d040>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:30.623619 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-731c2153-6325-43d5-b178-5a8409438f4b tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c" status: 200 len: 1457 microversion: 2.1 time: 0.059300 Jul 25 12:43:30.624791 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 690/1366] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:30 2022] GET /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c => generated 1457 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:30.637500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4b1c319e-fe2b-4d9c-824d-a2acc33e2c58 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:30.641307 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4b1c319e-fe2b-4d9c-824d-a2acc33e2c58 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:30.648197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4b1c319e-fe2b-4d9c-824d-a2acc33e2c58 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:30.650809 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4b1c319e-fe2b-4d9c-824d-a2acc33e2c58 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:30.651769 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4b1c319e-fe2b-4d9c-824d-a2acc33e2c58 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:30.652372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4b1c319e-fe2b-4d9c-824d-a2acc33e2c58 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:30.765029 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-364430b7-ace3-4a19-a987-013794eb7ab3 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:30.776269 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-364430b7-ace3-4a19-a987-013794eb7ab3 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1505 microversion: 2.1 time: 0.329776 Jul 25 12:43:30.791831 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 677/1367] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:30 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:30.798385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b219d895-5940-487f-bd93-0b82b680ca76 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:30.799136 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b219d895-5940-487f-bd93-0b82b680ca76 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:30.807755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b219d895-5940-487f-bd93-0b82b680ca76 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:30.808226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b219d895-5940-487f-bd93-0b82b680ca76 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:30.809064 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b219d895-5940-487f-bd93-0b82b680ca76 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:30.809556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b219d895-5940-487f-bd93-0b82b680ca76 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:31.241064 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4b1c319e-fe2b-4d9c-824d-a2acc33e2c58 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:31.249668 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4b1c319e-fe2b-4d9c-824d-a2acc33e2c58 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1480 microversion: 2.1 time: 0.615972 Jul 25 12:43:31.251291 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 691/1368] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:30 2022] GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1480 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:31.260692 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-de3a9408-ca20-47a5-a761-b9df88801264 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:31.262464 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-de3a9408-ca20-47a5-a761-b9df88801264 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:31.273284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de3a9408-ca20-47a5-a761-b9df88801264 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:31.274659 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de3a9408-ca20-47a5-a761-b9df88801264 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:31.276961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de3a9408-ca20-47a5-a761-b9df88801264 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:31.279374 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de3a9408-ca20-47a5-a761-b9df88801264 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:31.404614 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-de3a9408-ca20-47a5-a761-b9df88801264 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lazy-loading 'services' on Instance uuid 2ad2b2a1-b3f1-47cc-a769-04744715a6ec {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:31.405993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b219d895-5940-487f-bd93-0b82b680ca76 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:31.416986 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b219d895-5940-487f-bd93-0b82b680ca76 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1477 microversion: 2.1 time: 0.623768 Jul 25 12:43:31.419338 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 678/1369] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:30 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1477 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:31.427074 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-de3a9408-ca20-47a5-a761-b9df88801264 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1929 microversion: 2.75 time: 0.174424 Jul 25 12:43:31.427433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-143ac632-f295-4742-af8d-bbc198863e98 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:31.428310 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 692/1370] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:31 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1929 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:31.429219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-143ac632-f295-4742-af8d-bbc198863e98 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:31.433021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-05117938-e190-47d7-9b84-699263259dc4 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:31.433901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-05117938-e190-47d7-9b84-699263259dc4 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:31.440747 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05117938-e190-47d7-9b84-699263259dc4 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:31.440960 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05117938-e190-47d7-9b84-699263259dc4 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:31.441982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05117938-e190-47d7-9b84-699263259dc4 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:31.442431 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05117938-e190-47d7-9b84-699263259dc4 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:31.451818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-143ac632-f295-4742-af8d-bbc198863e98 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:31.452848 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-143ac632-f295-4742-af8d-bbc198863e98 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:31.454336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-143ac632-f295-4742-af8d-bbc198863e98 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:31.455048 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-143ac632-f295-4742-af8d-bbc198863e98 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:31.729224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-05117938-e190-47d7-9b84-699263259dc4 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:31.737288 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-05117938-e190-47d7-9b84-699263259dc4 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1308 microversion: 2.1 time: 0.307889 Jul 25 12:43:31.757856 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 693/1371] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:31 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1308 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:31.757856 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7c8dc676-1010-4061-9a38-4bd079d4191b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:31.757856 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7c8dc676-1010-4061-9a38-4bd079d4191b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:31.764602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c8dc676-1010-4061-9a38-4bd079d4191b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:31.764602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c8dc676-1010-4061-9a38-4bd079d4191b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:31.764602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c8dc676-1010-4061-9a38-4bd079d4191b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:31.764602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c8dc676-1010-4061-9a38-4bd079d4191b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:31.819478 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-143ac632-f295-4742-af8d-bbc198863e98 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:31.826153 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7c8dc676-1010-4061-9a38-4bd079d4191b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077463 Jul 25 12:43:31.831314 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-143ac632-f295-4742-af8d-bbc198863e98 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:31.831764 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 694/1372] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 12:43:31 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:31.832797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-143ac632-f295-4742-af8d-bbc198863e98 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:31.834911 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-143ac632-f295-4742-af8d-bbc198863e98 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1292 microversion: 2.25 time: 0.413030 Jul 25 12:43:31.835320 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 679/1373] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:31 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1292 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:31.853073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3a6310e9-3bed-4131-983c-8c9ab439a81c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:31.854276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3a6310e9-3bed-4131-983c-8c9ab439a81c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:31.860700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-53661e17-430f-462a-baaa-85bb2661991d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:31.862616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a6310e9-3bed-4131-983c-8c9ab439a81c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:31.863877 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-53661e17-430f-462a-baaa-85bb2661991d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:31.864066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a6310e9-3bed-4131-983c-8c9ab439a81c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:31.865342 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a6310e9-3bed-4131-983c-8c9ab439a81c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:31.865591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a6310e9-3bed-4131-983c-8c9ab439a81c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:31.875826 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53661e17-430f-462a-baaa-85bb2661991d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:31.879869 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53661e17-430f-462a-baaa-85bb2661991d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:31.882721 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53661e17-430f-462a-baaa-85bb2661991d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:31.883294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53661e17-430f-462a-baaa-85bb2661991d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:32.220933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3a6310e9-3bed-4131-983c-8c9ab439a81c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:32.228781 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3a6310e9-3bed-4131-983c-8c9ab439a81c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1505 microversion: 2.1 time: 0.392173 Jul 25 12:43:32.232111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-53661e17-430f-462a-baaa-85bb2661991d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:32.247550 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 680/1374] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:31 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1505 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:32.247772 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-53661e17-430f-462a-baaa-85bb2661991d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 200 len: 1316 microversion: 2.1 time: 0.407452 Jul 25 12:43:32.247772 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 695/1375] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:31 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 1316 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:32.271528 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6c8e12a6-40f8-4689-94b1-2982f595e2dd tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:32.272145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6c8e12a6-40f8-4689-94b1-2982f595e2dd tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:32.278934 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c8e12a6-40f8-4689-94b1-2982f595e2dd tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:32.279389 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c8e12a6-40f8-4689-94b1-2982f595e2dd tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:32.280232 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c8e12a6-40f8-4689-94b1-2982f595e2dd tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:32.280676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c8e12a6-40f8-4689-94b1-2982f595e2dd tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:32.455319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d18b6083-b209-4722-bed2-a013b464ca8b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:32.455998 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d18b6083-b209-4722-bed2-a013b464ca8b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:32.463466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d18b6083-b209-4722-bed2-a013b464ca8b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:32.464168 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d18b6083-b209-4722-bed2-a013b464ca8b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:32.465129 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d18b6083-b209-4722-bed2-a013b464ca8b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:32.465723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d18b6083-b209-4722-bed2-a013b464ca8b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:32.490170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6c8e12a6-40f8-4689-94b1-2982f595e2dd tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:32.510393 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6c8e12a6-40f8-4689-94b1-2982f595e2dd tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1480 microversion: 2.1 time: 0.231307 Jul 25 12:43:32.511087 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 681/1376] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:32 2022] GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1480 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:32.528333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-079339cf-a16f-4f59-90e4-da0e98255d85 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:32.529118 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-079339cf-a16f-4f59-90e4-da0e98255d85 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:32.537899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-079339cf-a16f-4f59-90e4-da0e98255d85 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:32.538156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-079339cf-a16f-4f59-90e4-da0e98255d85 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:32.538989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-079339cf-a16f-4f59-90e4-da0e98255d85 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:32.539526 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-079339cf-a16f-4f59-90e4-da0e98255d85 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:32.661442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-079339cf-a16f-4f59-90e4-da0e98255d85 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lazy-loading 'services' on Instance uuid 2ad2b2a1-b3f1-47cc-a769-04744715a6ec {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:32.683545 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-079339cf-a16f-4f59-90e4-da0e98255d85 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1929 microversion: 2.75 time: 0.171275 Jul 25 12:43:32.684567 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 682/1377] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:32 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1929 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:32.726011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d18b6083-b209-4722-bed2-a013b464ca8b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:32.740614 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d18b6083-b209-4722-bed2-a013b464ca8b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1477 microversion: 2.1 time: 0.290594 Jul 25 12:43:32.741399 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 696/1378] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:32 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1477 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:43:32.772761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e1049b5b-f081-4553-82fa-a49fd08a8647 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:32.773557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e1049b5b-f081-4553-82fa-a49fd08a8647 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:32.782116 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1049b5b-f081-4553-82fa-a49fd08a8647 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:32.783440 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1049b5b-f081-4553-82fa-a49fd08a8647 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:32.784414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1049b5b-f081-4553-82fa-a49fd08a8647 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:32.785569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1049b5b-f081-4553-82fa-a49fd08a8647 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:32.839266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-61d01c52-9b9f-457c-8689-323ffba8c387 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:32.841563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-61d01c52-9b9f-457c-8689-323ffba8c387 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:32.848869 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-61d01c52-9b9f-457c-8689-323ffba8c387 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:32.849768 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-61d01c52-9b9f-457c-8689-323ffba8c387 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:32.850658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-61d01c52-9b9f-457c-8689-323ffba8c387 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:32.851157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-61d01c52-9b9f-457c-8689-323ffba8c387 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:32.882383 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-61d01c52-9b9f-457c-8689-323ffba8c387 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047271 Jul 25 12:43:32.883246 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 697/1379] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 12:43:32 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:32.893984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5eba24cd-5c6d-4317-9850-fe62206fe35c tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:32.894960 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5eba24cd-5c6d-4317-9850-fe62206fe35c tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:32.902736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5eba24cd-5c6d-4317-9850-fe62206fe35c tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:32.903414 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5eba24cd-5c6d-4317-9850-fe62206fe35c tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:32.904507 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5eba24cd-5c6d-4317-9850-fe62206fe35c tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:32.905154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5eba24cd-5c6d-4317-9850-fe62206fe35c tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:33.029530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e1049b5b-f081-4553-82fa-a49fd08a8647 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:33.041896 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e1049b5b-f081-4553-82fa-a49fd08a8647 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1308 microversion: 2.1 time: 0.271954 Jul 25 12:43:33.042394 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 683/1380] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:32 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1308 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:33.048504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-ee1cd288-5a49-4981-823a-cf86c4996407 req-50e9b838-56bf-4f6b-8989-8a54dc7bfd1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a21af85-54c8-424c-b815-3882ecf4a893", "tag": "067888a1-37d3-4817-9387-14f7ea43416c"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:33.062302 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ee1cd288-5a49-4981-823a-cf86c4996407 req-50e9b838-56bf-4f6b-8989-8a54dc7bfd1b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:33.063234 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ee1cd288-5a49-4981-823a-cf86c4996407 req-50e9b838-56bf-4f6b-8989-8a54dc7bfd1b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:33.079331 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5eba24cd-5c6d-4317-9850-fe62206fe35c tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:33.083129 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-ee1cd288-5a49-4981-823a-cf86c4996407 req-50e9b838-56bf-4f6b-8989-8a54dc7bfd1b service nova] Creating event network-changed:067888a1-37d3-4817-9387-14f7ea43416c for instance 8a21af85-54c8-424c-b815-3882ecf4a893 on n-h1-848886-15 Jul 25 12:43:33.088022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5eba24cd-5c6d-4317-9850-fe62206fe35c tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:33.089571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5eba24cd-5c6d-4317-9850-fe62206fe35c tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:33.090724 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5eba24cd-5c6d-4317-9850-fe62206fe35c tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1292 microversion: 2.25 time: 0.201995 Jul 25 12:43:33.090992 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-ee1cd288-5a49-4981-823a-cf86c4996407 req-50e9b838-56bf-4f6b-8989-8a54dc7bfd1b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047165 Jul 25 12:43:33.091281 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 698/1381] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:32 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1292 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:33.091846 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 684/1382] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:33.261410 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f5d1aba7-bb23-4079-bdf9-1e394262ccf7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:33.263705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7437cfae-fc60-4bd6-a2a7-bf621f2cc036 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:33.264416 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7437cfae-fc60-4bd6-a2a7-bf621f2cc036 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:33.265277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f5d1aba7-bb23-4079-bdf9-1e394262ccf7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:33.277782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7437cfae-fc60-4bd6-a2a7-bf621f2cc036 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:33.279686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5d1aba7-bb23-4079-bdf9-1e394262ccf7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:33.280032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5d1aba7-bb23-4079-bdf9-1e394262ccf7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:33.280300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7437cfae-fc60-4bd6-a2a7-bf621f2cc036 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:33.281477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7437cfae-fc60-4bd6-a2a7-bf621f2cc036 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:33.282680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5d1aba7-bb23-4079-bdf9-1e394262ccf7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:33.283215 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7437cfae-fc60-4bd6-a2a7-bf621f2cc036 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:33.283656 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5d1aba7-bb23-4079-bdf9-1e394262ccf7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:33.525865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7437cfae-fc60-4bd6-a2a7-bf621f2cc036 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:33.530287 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f5d1aba7-bb23-4079-bdf9-1e394262ccf7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:33.532608 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7437cfae-fc60-4bd6-a2a7-bf621f2cc036 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1505 microversion: 2.1 time: 0.279650 Jul 25 12:43:33.537887 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 699/1383] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:33 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:33.539548 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f5d1aba7-bb23-4079-bdf9-1e394262ccf7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 200 len: 1316 microversion: 2.1 time: 0.282339 Jul 25 12:43:33.546934 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 685/1384] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:33 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 1316 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:33.551522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1908e519-b7c2-4a30-813c-22faa9aaa236 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:33.552266 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1908e519-b7c2-4a30-813c-22faa9aaa236 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:33.558452 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1908e519-b7c2-4a30-813c-22faa9aaa236 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:33.558924 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1908e519-b7c2-4a30-813c-22faa9aaa236 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:33.559696 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1908e519-b7c2-4a30-813c-22faa9aaa236 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:33.560297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1908e519-b7c2-4a30-813c-22faa9aaa236 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:33.602540 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-87f10d07-af86-4108-a1b2-ebcaa65f100f req-5859e4b9-bc1b-4f79-b3a3-14589d284bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89024fb2-f607-462a-b8e4-f7004f7987ad", "name": "network-vif-plugged", "status": "completed", "tag": "94116aa6-64d7-4863-a19d-2ff08dcc7c4e"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:33.613900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-87f10d07-af86-4108-a1b2-ebcaa65f100f req-5859e4b9-bc1b-4f79-b3a3-14589d284bb9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:33.614235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-87f10d07-af86-4108-a1b2-ebcaa65f100f req-5859e4b9-bc1b-4f79-b3a3-14589d284bb9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:33.627405 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-87f10d07-af86-4108-a1b2-ebcaa65f100f req-5859e4b9-bc1b-4f79-b3a3-14589d284bb9 service nova] Creating event network-vif-plugged:94116aa6-64d7-4863-a19d-2ff08dcc7c4e for instance 89024fb2-f607-462a-b8e4-f7004f7987ad on n-h1-848886-15 Jul 25 12:43:33.642116 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-87f10d07-af86-4108-a1b2-ebcaa65f100f req-5859e4b9-bc1b-4f79-b3a3-14589d284bb9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107650 Jul 25 12:43:33.642913 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 700/1385] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:33.711479 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1908e519-b7c2-4a30-813c-22faa9aaa236 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:33.717728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9f1cfecc-8911-4fde-8d16-e849b168ef26 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:33.720958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9f1cfecc-8911-4fde-8d16-e849b168ef26 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:33.731120 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1908e519-b7c2-4a30-813c-22faa9aaa236 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1480 microversion: 2.1 time: 0.183182 Jul 25 12:43:33.734995 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 686/1386] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:33 2022] GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1480 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:33.747955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f1cfecc-8911-4fde-8d16-e849b168ef26 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:33.748479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f1cfecc-8911-4fde-8d16-e849b168ef26 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:33.749346 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f1cfecc-8911-4fde-8d16-e849b168ef26 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:33.749778 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f1cfecc-8911-4fde-8d16-e849b168ef26 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:33.763706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4be8be35-d42c-453f-83ea-911776e29eae tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:33.766716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4be8be35-d42c-453f-83ea-911776e29eae tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:33.777681 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4be8be35-d42c-453f-83ea-911776e29eae tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:33.778927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4be8be35-d42c-453f-83ea-911776e29eae tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:33.779890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4be8be35-d42c-453f-83ea-911776e29eae tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:33.780543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4be8be35-d42c-453f-83ea-911776e29eae tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:33.879072 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:33.885359 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-9f1cfecc-8911-4fde-8d16-e849b168ef26 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lazy-loading 'services' on Instance uuid 2ad2b2a1-b3f1-47cc-a769-04744715a6ec {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:33.906640 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9f1cfecc-8911-4fde-8d16-e849b168ef26 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1929 microversion: 2.75 time: 0.197230 Jul 25 12:43:33.921854 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 701/1387] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:33 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1929 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:43:33.924187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6af7fe1c-4f73-4156-8f21-9437097606a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:33.927466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6af7fe1c-4f73-4156-8f21-9437097606a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:33.934703 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6af7fe1c-4f73-4156-8f21-9437097606a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:33.935535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6af7fe1c-4f73-4156-8f21-9437097606a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:33.936653 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6af7fe1c-4f73-4156-8f21-9437097606a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:33.938118 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6af7fe1c-4f73-4156-8f21-9437097606a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:33.972306 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6af7fe1c-4f73-4156-8f21-9437097606a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052687 Jul 25 12:43:33.976531 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 702/1388] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 12:43:33 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:34.062676 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d74f70d0-15a2-495a-9402-a9bcf17b3c1d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:34.063535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d74f70d0-15a2-495a-9402-a9bcf17b3c1d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:34.070339 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d74f70d0-15a2-495a-9402-a9bcf17b3c1d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:34.070891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d74f70d0-15a2-495a-9402-a9bcf17b3c1d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:34.071738 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d74f70d0-15a2-495a-9402-a9bcf17b3c1d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:34.072179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d74f70d0-15a2-495a-9402-a9bcf17b3c1d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:34.208368 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4be8be35-d42c-453f-83ea-911776e29eae tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:34.210812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:34.219448 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4be8be35-d42c-453f-83ea-911776e29eae tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1477 microversion: 2.1 time: 0.459273 Jul 25 12:43:34.220288 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 687/1389] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:33 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1477 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:34.225175 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-483a7cc2-641f-4bf1-9266-740c4c168169 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:34.225788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-483a7cc2-641f-4bf1-9266-740c4c168169 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:34.235629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-483a7cc2-641f-4bf1-9266-740c4c168169 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:34.236093 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-483a7cc2-641f-4bf1-9266-740c4c168169 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:34.236890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-483a7cc2-641f-4bf1-9266-740c4c168169 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:34.237331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-483a7cc2-641f-4bf1-9266-740c4c168169 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:34.290043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d74f70d0-15a2-495a-9402-a9bcf17b3c1d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:34.298739 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d74f70d0-15a2-495a-9402-a9bcf17b3c1d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1308 microversion: 2.1 time: 0.240288 Jul 25 12:43:34.299598 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 703/1390] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:34 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1308 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:34.374520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-483a7cc2-641f-4bf1-9266-740c4c168169 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:34.383158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-483a7cc2-641f-4bf1-9266-740c4c168169 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:34.384825 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-483a7cc2-641f-4bf1-9266-740c4c168169 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:34.386080 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-483a7cc2-641f-4bf1-9266-740c4c168169 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1292 microversion: 2.25 time: 0.164922 Jul 25 12:43:34.386648 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 688/1391] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:34 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1292 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:34.554297 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4d01a342-53b7-4128-9b07-3ae2ac9fbab1 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:34.555411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4d01a342-53b7-4128-9b07-3ae2ac9fbab1 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:34.560355 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aa23d2cf-97a0-416e-818a-266b10c18dbe tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:34.561319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-aa23d2cf-97a0-416e-818a-266b10c18dbe tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:34.563002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d01a342-53b7-4128-9b07-3ae2ac9fbab1 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:34.563441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d01a342-53b7-4128-9b07-3ae2ac9fbab1 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:34.564500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d01a342-53b7-4128-9b07-3ae2ac9fbab1 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:34.564760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d01a342-53b7-4128-9b07-3ae2ac9fbab1 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:34.567983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa23d2cf-97a0-416e-818a-266b10c18dbe tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:34.568524 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa23d2cf-97a0-416e-818a-266b10c18dbe tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:34.570217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa23d2cf-97a0-416e-818a-266b10c18dbe tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:34.570217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa23d2cf-97a0-416e-818a-266b10c18dbe tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:34.763079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4d01a342-53b7-4128-9b07-3ae2ac9fbab1 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:34.766660 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-aa23d2cf-97a0-416e-818a-266b10c18dbe tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:34.771394 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4d01a342-53b7-4128-9b07-3ae2ac9fbab1 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1505 microversion: 2.1 time: 0.221117 Jul 25 12:43:34.772290 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 704/1392] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:34 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:34.777291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e9cbcd05-74ed-4b90-93b5-ada2cc044329 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:34.778067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e9cbcd05-74ed-4b90-93b5-ada2cc044329 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:34.783676 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aa23d2cf-97a0-416e-818a-266b10c18dbe tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 200 len: 1316 microversion: 2.1 time: 0.227192 Jul 25 12:43:34.784980 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9cbcd05-74ed-4b90-93b5-ada2cc044329 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:34.785677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9cbcd05-74ed-4b90-93b5-ada2cc044329 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:34.785868 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 689/1393] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:34 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 1316 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:34.786611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9cbcd05-74ed-4b90-93b5-ada2cc044329 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:34.787141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9cbcd05-74ed-4b90-93b5-ada2cc044329 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:34.931255 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e9cbcd05-74ed-4b90-93b5-ada2cc044329 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:34.932113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bb354f85-b109-462f-a73b-d825af2384af tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:34.932725 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bb354f85-b109-462f-a73b-d825af2384af tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:34.939013 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bb354f85-b109-462f-a73b-d825af2384af tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:34.939467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bb354f85-b109-462f-a73b-d825af2384af tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:34.939714 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e9cbcd05-74ed-4b90-93b5-ada2cc044329 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1480 microversion: 2.1 time: 0.166444 Jul 25 12:43:34.940251 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bb354f85-b109-462f-a73b-d825af2384af tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:34.940367 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 705/1394] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:34 2022] GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1480 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:34.940678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bb354f85-b109-462f-a73b-d825af2384af tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:34.984744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a4657e36-a720-4669-b46f-771d44771b47 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:34.987250 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a4657e36-a720-4669-b46f-771d44771b47 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:34.993681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4657e36-a720-4669-b46f-771d44771b47 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:34.994164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4657e36-a720-4669-b46f-771d44771b47 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:34.994953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4657e36-a720-4669-b46f-771d44771b47 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:34.995381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4657e36-a720-4669-b46f-771d44771b47 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:35.023912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-bb354f85-b109-462f-a73b-d825af2384af tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lazy-loading 'services' on Instance uuid 2ad2b2a1-b3f1-47cc-a769-04744715a6ec {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:35.028371 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a4657e36-a720-4669-b46f-771d44771b47 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047640 Jul 25 12:43:35.032830 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 706/1395] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 12:43:34 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:43:35.061720 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bb354f85-b109-462f-a73b-d825af2384af tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1935 microversion: 2.75 time: 0.133165 Jul 25 12:43:35.075248 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 690/1396] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:34 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1935 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:43:35.243708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9465fadb-d358-444a-8da3-0fb2d82a28ef tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:35.244382 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9465fadb-d358-444a-8da3-0fb2d82a28ef tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:35.254282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9465fadb-d358-444a-8da3-0fb2d82a28ef tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:35.254885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9465fadb-d358-444a-8da3-0fb2d82a28ef tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:35.255860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9465fadb-d358-444a-8da3-0fb2d82a28ef tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:35.256381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9465fadb-d358-444a-8da3-0fb2d82a28ef tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:35.319948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7b46d87c-c856-4947-a3dd-90b64fe566fd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:35.320537 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7b46d87c-c856-4947-a3dd-90b64fe566fd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:35.327706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b46d87c-c856-4947-a3dd-90b64fe566fd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:35.328139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b46d87c-c856-4947-a3dd-90b64fe566fd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:35.328999 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b46d87c-c856-4947-a3dd-90b64fe566fd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:35.329447 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b46d87c-c856-4947-a3dd-90b64fe566fd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:35.598682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9465fadb-d358-444a-8da3-0fb2d82a28ef tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:35.608010 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9465fadb-d358-444a-8da3-0fb2d82a28ef tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1477 microversion: 2.1 time: 0.370038 Jul 25 12:43:35.610372 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 707/1397] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:35 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1477 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:35.626680 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c5318012-5e7e-4664-88a4-da30458b90f2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:35.627461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c5318012-5e7e-4664-88a4-da30458b90f2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:35.628790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7b46d87c-c856-4947-a3dd-90b64fe566fd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:35.635196 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5318012-5e7e-4664-88a4-da30458b90f2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:35.635762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5318012-5e7e-4664-88a4-da30458b90f2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:35.636352 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7b46d87c-c856-4947-a3dd-90b64fe566fd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1308 microversion: 2.1 time: 0.320276 Jul 25 12:43:35.636936 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 691/1398] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:35 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1308 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:35.637543 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5318012-5e7e-4664-88a4-da30458b90f2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:35.638201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5318012-5e7e-4664-88a4-da30458b90f2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:35.793040 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8267c126-db93-4bea-8ed3-0d6c6fe6ece3 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:35.793903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8267c126-db93-4bea-8ed3-0d6c6fe6ece3 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:35.795500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c5318012-5e7e-4664-88a4-da30458b90f2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:35.801078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8267c126-db93-4bea-8ed3-0d6c6fe6ece3 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:35.801556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8267c126-db93-4bea-8ed3-0d6c6fe6ece3 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:35.802690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8267c126-db93-4bea-8ed3-0d6c6fe6ece3 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:35.803294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8267c126-db93-4bea-8ed3-0d6c6fe6ece3 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:35.805413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c5318012-5e7e-4664-88a4-da30458b90f2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:35.807230 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c5318012-5e7e-4664-88a4-da30458b90f2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:35.809996 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c5318012-5e7e-4664-88a4-da30458b90f2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1292 microversion: 2.25 time: 0.188901 Jul 25 12:43:35.810932 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 708/1399] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:35 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1292 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:35.815715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c5f0eab9-11f4-492a-bedb-6184e5f7f205 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:35.816382 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c5f0eab9-11f4-492a-bedb-6184e5f7f205 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:35.823140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5f0eab9-11f4-492a-bedb-6184e5f7f205 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:35.823588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5f0eab9-11f4-492a-bedb-6184e5f7f205 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:35.824998 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5f0eab9-11f4-492a-bedb-6184e5f7f205 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:35.825523 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5f0eab9-11f4-492a-bedb-6184e5f7f205 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:36.006674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8267c126-db93-4bea-8ed3-0d6c6fe6ece3 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:36.010673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c5f0eab9-11f4-492a-bedb-6184e5f7f205 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:36.015111 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8267c126-db93-4bea-8ed3-0d6c6fe6ece3 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1505 microversion: 2.1 time: 0.226364 Jul 25 12:43:36.015801 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 692/1400] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:35 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1505 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:43:36.018833 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c5f0eab9-11f4-492a-bedb-6184e5f7f205 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 200 len: 1316 microversion: 2.1 time: 0.206722 Jul 25 12:43:36.019411 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 709/1401] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:35 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 1316 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:36.021323 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ff0f4759-b821-49f2-b867-984355194579 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:36.022020 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ff0f4759-b821-49f2-b867-984355194579 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:36.028554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff0f4759-b821-49f2-b867-984355194579 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:36.029514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff0f4759-b821-49f2-b867-984355194579 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:36.030308 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff0f4759-b821-49f2-b867-984355194579 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:36.030738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff0f4759-b821-49f2-b867-984355194579 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:36.040904 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8ff995f7-0aa8-4e16-8968-c9501a8d8b77 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:36.043257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8ff995f7-0aa8-4e16-8968-c9501a8d8b77 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:36.045355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:36.051291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ff995f7-0aa8-4e16-8968-c9501a8d8b77 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:36.051734 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ff995f7-0aa8-4e16-8968-c9501a8d8b77 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:36.052608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ff995f7-0aa8-4e16-8968-c9501a8d8b77 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:36.053046 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ff995f7-0aa8-4e16-8968-c9501a8d8b77 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:36.088345 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8ff995f7-0aa8-4e16-8968-c9501a8d8b77 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051423 Jul 25 12:43:36.090289 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 710/1402] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 12:43:36 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 12:43:36.098325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-197494ac-ebd7-4354-8333-7cb78c56915a tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:36.098945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-197494ac-ebd7-4354-8333-7cb78c56915a tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:36.109377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-197494ac-ebd7-4354-8333-7cb78c56915a tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:36.110009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-197494ac-ebd7-4354-8333-7cb78c56915a tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:36.111418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-197494ac-ebd7-4354-8333-7cb78c56915a tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:36.111868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-197494ac-ebd7-4354-8333-7cb78c56915a tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:36.222023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-197494ac-ebd7-4354-8333-7cb78c56915a tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lazy-loading 'services' on Instance uuid 2ad2b2a1-b3f1-47cc-a769-04744715a6ec {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:36.242977 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-197494ac-ebd7-4354-8333-7cb78c56915a tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1935 microversion: 2.75 time: 0.149932 Jul 25 12:43:36.244156 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 711/1403] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:36 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1935 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:36.268202 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ff0f4759-b821-49f2-b867-984355194579 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:36.277177 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ff0f4759-b821-49f2-b867-984355194579 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1467 microversion: 2.1 time: 0.259939 Jul 25 12:43:36.292409 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 693/1404] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:36 2022] GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1467 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:36.298082 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5f98cc5b-fa3d-49b5-8de3-f54489e44bf0 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1542966217"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:36.301294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5f98cc5b-fa3d-49b5-8de3-f54489e44bf0 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: 159b5add-9666-4a2a-82e7-7571a120cabb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:36.306971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5f98cc5b-fa3d-49b5-8de3-f54489e44bf0 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:36.307521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5f98cc5b-fa3d-49b5-8de3-f54489e44bf0 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:36.308421 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5f98cc5b-fa3d-49b5-8de3-f54489e44bf0 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:36.308938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5f98cc5b-fa3d-49b5-8de3-f54489e44bf0 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:36.527844 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5f98cc5b-fa3d-49b5-8de3-f54489e44bf0 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "POST /compute/v2.1/servers/159b5add-9666-4a2a-82e7-7571a120cabb/action" status: 202 len: 0 microversion: 2.1 time: 0.233910 Jul 25 12:43:36.528722 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 712/1405] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:43:36 2022] POST /compute/v2.1/servers/159b5add-9666-4a2a-82e7-7571a120cabb/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 12:43:36.538981 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b3c18468-0c0e-481e-82f0-b55f0c43135e tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcfa192f70>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:36.595360 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b3c18468-0c0e-481e-82f0-b55f0c43135e tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/b62ae338-98ed-450b-91d0-c71ef958d32e" status: 200 len: 1449 microversion: 2.1 time: 0.060196 Jul 25 12:43:36.596112 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 694/1406] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:36 2022] GET /compute/v2.1/images/b62ae338-98ed-450b-91d0-c71ef958d32e => generated 1449 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:36.631787 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4d247bae-259c-4735-8f27-ac7af9fa9e10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:36.632545 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4d247bae-259c-4735-8f27-ac7af9fa9e10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:36.639709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d247bae-259c-4735-8f27-ac7af9fa9e10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:36.640250 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d247bae-259c-4735-8f27-ac7af9fa9e10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:36.641178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d247bae-259c-4735-8f27-ac7af9fa9e10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:36.641665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d247bae-259c-4735-8f27-ac7af9fa9e10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:36.663793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c79adb88-ec12-42f7-8ea0-6f909e9e4fe3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:36.664575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c79adb88-ec12-42f7-8ea0-6f909e9e4fe3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:36.674543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c79adb88-ec12-42f7-8ea0-6f909e9e4fe3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:36.675212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c79adb88-ec12-42f7-8ea0-6f909e9e4fe3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:36.676736 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c79adb88-ec12-42f7-8ea0-6f909e9e4fe3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:36.677358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c79adb88-ec12-42f7-8ea0-6f909e9e4fe3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:36.970179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4d247bae-259c-4735-8f27-ac7af9fa9e10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:36.981239 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4d247bae-259c-4735-8f27-ac7af9fa9e10 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1477 microversion: 2.1 time: 0.354815 Jul 25 12:43:36.994693 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 713/1407] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:36 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1477 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:37.001887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d94dbb1c-68ac-4e15-add5-6ff7c22af724 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:37.002509 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d94dbb1c-68ac-4e15-add5-6ff7c22af724 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:37.014338 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d94dbb1c-68ac-4e15-add5-6ff7c22af724 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:37.014983 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d94dbb1c-68ac-4e15-add5-6ff7c22af724 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:37.016812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d94dbb1c-68ac-4e15-add5-6ff7c22af724 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:37.017704 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d94dbb1c-68ac-4e15-add5-6ff7c22af724 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:37.023396 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c79adb88-ec12-42f7-8ea0-6f909e9e4fe3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:37.034772 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c79adb88-ec12-42f7-8ea0-6f909e9e4fe3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1308 microversion: 2.1 time: 0.375710 Jul 25 12:43:37.035212 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 695/1408] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:36 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1308 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:43:37.043901 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b32c6bf6-5b49-4353-95bc-ac90a3873e2b tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:37.044667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b32c6bf6-5b49-4353-95bc-ac90a3873e2b tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:37.051524 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b32c6bf6-5b49-4353-95bc-ac90a3873e2b tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:37.052237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b32c6bf6-5b49-4353-95bc-ac90a3873e2b tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:37.053341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b32c6bf6-5b49-4353-95bc-ac90a3873e2b tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:37.053870 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b32c6bf6-5b49-4353-95bc-ac90a3873e2b tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:37.561976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b32c6bf6-5b49-4353-95bc-ac90a3873e2b tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:37.570289 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b32c6bf6-5b49-4353-95bc-ac90a3873e2b tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1505 microversion: 2.1 time: 0.530463 Jul 25 12:43:37.582229 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 696/1409] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:37 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1505 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:37.586923 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6100e4d0-e552-4f48-b71f-f19c68d534d0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:37.588709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6100e4d0-e552-4f48-b71f-f19c68d534d0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:37.597686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d94dbb1c-68ac-4e15-add5-6ff7c22af724 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:37.613283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d94dbb1c-68ac-4e15-add5-6ff7c22af724 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:37.614967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6100e4d0-e552-4f48-b71f-f19c68d534d0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:37.615810 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d94dbb1c-68ac-4e15-add5-6ff7c22af724 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:37.617108 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6100e4d0-e552-4f48-b71f-f19c68d534d0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:37.617254 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d94dbb1c-68ac-4e15-add5-6ff7c22af724 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1292 microversion: 2.25 time: 0.621599 Jul 25 12:43:37.619530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6100e4d0-e552-4f48-b71f-f19c68d534d0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:37.620857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6100e4d0-e552-4f48-b71f-f19c68d534d0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:37.633092 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 714/1410] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:36 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1292 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:37.643445 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5c50d22b-3e77-4f5c-a989-1576d6108841 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:37.645702 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5c50d22b-3e77-4f5c-a989-1576d6108841 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:37.664247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c50d22b-3e77-4f5c-a989-1576d6108841 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:37.665774 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c50d22b-3e77-4f5c-a989-1576d6108841 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:37.667431 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c50d22b-3e77-4f5c-a989-1576d6108841 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:37.667864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c50d22b-3e77-4f5c-a989-1576d6108841 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:37.808087 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:38.252251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-5c50d22b-3e77-4f5c-a989-1576d6108841 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] Lazy-loading 'services' on Instance uuid 2ad2b2a1-b3f1-47cc-a769-04744715a6ec {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:38.286465 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5c50d22b-3e77-4f5c-a989-1576d6108841 tempest-ServersAdmin275Test-690291933 tempest-ServersAdmin275Test-690291933-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1920 microversion: 2.75 time: 0.650670 Jul 25 12:43:38.287781 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 715/1411] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:37 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1920 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:38.303308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2d44c19e-0924-4009-a691-4b359fa57a04 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9b923a0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:38.369884 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2d44c19e-0924-4009-a691-4b359fa57a04 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/b62ae338-98ed-450b-91d0-c71ef958d32e" status: 200 len: 1449 microversion: 2.1 time: 0.080375 Jul 25 12:43:38.372060 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 716/1412] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:38 2022] GET /compute/v2.1/images/b62ae338-98ed-450b-91d0-c71ef958d32e => generated 1449 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:38.385943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f7da09ae-5b2f-4115-aa57-6754edf05037 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:38.387115 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6100e4d0-e552-4f48-b71f-f19c68d534d0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:38.389309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f7da09ae-5b2f-4115-aa57-6754edf05037 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:38.400132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7da09ae-5b2f-4115-aa57-6754edf05037 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:38.400849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7da09ae-5b2f-4115-aa57-6754edf05037 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:38.402075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7da09ae-5b2f-4115-aa57-6754edf05037 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:38.402791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7da09ae-5b2f-4115-aa57-6754edf05037 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:38.402932 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6100e4d0-e552-4f48-b71f-f19c68d534d0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 200 len: 1466 microversion: 2.1 time: 0.822236 Jul 25 12:43:38.403415 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 697/1413] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:37 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 1466 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:38.417866 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5ca98bd4-6178-4a67-aa1f-abba4e20250e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:38.418744 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5ca98bd4-6178-4a67-aa1f-abba4e20250e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:38.420874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=8 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:38.428834 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:38.438271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ca98bd4-6178-4a67-aa1f-abba4e20250e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:38.438723 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ca98bd4-6178-4a67-aa1f-abba4e20250e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:38.439533 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ca98bd4-6178-4a67-aa1f-abba4e20250e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:38.439951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ca98bd4-6178-4a67-aa1f-abba4e20250e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:38.869869 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f7da09ae-5b2f-4115-aa57-6754edf05037 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:38.879428 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f7da09ae-5b2f-4115-aa57-6754edf05037 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1476 microversion: 2.1 time: 0.506087 Jul 25 12:43:38.881221 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 717/1414] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:38 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1476 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:38.887205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1968c648-89cc-43b7-8b70-3b076c7f7324 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:38.887205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1968c648-89cc-43b7-8b70-3b076c7f7324 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:38.910347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1968c648-89cc-43b7-8b70-3b076c7f7324 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:38.910639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1968c648-89cc-43b7-8b70-3b076c7f7324 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:38.911615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1968c648-89cc-43b7-8b70-3b076c7f7324 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:38.911870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1968c648-89cc-43b7-8b70-3b076c7f7324 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:38.929056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5ca98bd4-6178-4a67-aa1f-abba4e20250e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:38.939744 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5ca98bd4-6178-4a67-aa1f-abba4e20250e tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1488 microversion: 2.1 time: 0.535005 Jul 25 12:43:38.940576 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 698/1415] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:38 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1488 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:38.956276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3ba97ac7-4aaa-424a-94a9-2cd1034f9615 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:38.963581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3ba97ac7-4aaa-424a-94a9-2cd1034f9615 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:38.978150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3ba97ac7-4aaa-424a-94a9-2cd1034f9615 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:38.979389 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3ba97ac7-4aaa-424a-94a9-2cd1034f9615 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:38.981687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3ba97ac7-4aaa-424a-94a9-2cd1034f9615 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:38.982907 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3ba97ac7-4aaa-424a-94a9-2cd1034f9615 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:38.985639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1968c648-89cc-43b7-8b70-3b076c7f7324 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:43:39.134459 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1968c648-89cc-43b7-8b70-3b076c7f7324 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 204 len: 0 microversion: 2.75 time: 0.250229 Jul 25 12:43:39.139081 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 718/1416] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 12:43:38 2022] DELETE /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 12:43:39.145900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8d29037a-720e-4ac7-ac07-39fe2346c455 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:39.146696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8d29037a-720e-4ac7-ac07-39fe2346c455 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:39.154849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d29037a-720e-4ac7-ac07-39fe2346c455 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:39.155434 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d29037a-720e-4ac7-ac07-39fe2346c455 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:39.156510 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d29037a-720e-4ac7-ac07-39fe2346c455 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:39.157185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d29037a-720e-4ac7-ac07-39fe2346c455 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:39.435399 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3ba97ac7-4aaa-424a-94a9-2cd1034f9615 tempest-ServersOnMultiNodesTest-740078286 tempest-ServersOnMultiNodesTest-740078286-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 200 len: 1619 microversion: 2.1 time: 0.484150 Jul 25 12:43:39.436271 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 699/1417] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:38 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 1619 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:39.441977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-681419b9-245b-4ccb-93a1-3585fa607d6e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:39.444222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-681419b9-245b-4ccb-93a1-3585fa607d6e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:39.452297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-681419b9-245b-4ccb-93a1-3585fa607d6e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:39.453050 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-681419b9-245b-4ccb-93a1-3585fa607d6e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:39.454097 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-681419b9-245b-4ccb-93a1-3585fa607d6e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:39.454855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-681419b9-245b-4ccb-93a1-3585fa607d6e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:39.745526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8d29037a-720e-4ac7-ac07-39fe2346c455 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:39.755757 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8d29037a-720e-4ac7-ac07-39fe2346c455 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1505 microversion: 2.1 time: 0.617582 Jul 25 12:43:39.756746 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 719/1418] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:39 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1505 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:39.761743 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-523957c1-acbf-47c1-b334-d11bbb48a509 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-741883340"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:39.764362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-523957c1-acbf-47c1-b334-d11bbb48a509 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:39.771086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-523957c1-acbf-47c1-b334-d11bbb48a509 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:39.771613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-523957c1-acbf-47c1-b334-d11bbb48a509 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:39.773229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-523957c1-acbf-47c1-b334-d11bbb48a509 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:39.775296 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-523957c1-acbf-47c1-b334-d11bbb48a509 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:39.855039 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-681419b9-245b-4ccb-93a1-3585fa607d6e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:39.863987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-681419b9-245b-4ccb-93a1-3585fa607d6e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:39.865872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-681419b9-245b-4ccb-93a1-3585fa607d6e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:39.867203 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-681419b9-245b-4ccb-93a1-3585fa607d6e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1292 microversion: 2.25 time: 0.429844 Jul 25 12:43:39.868099 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 700/1419] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:39 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1292 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:39.873757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6c31af79-7e8f-4a59-bbcb-2058db64ef3a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:39.874557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6c31af79-7e8f-4a59-bbcb-2058db64ef3a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:39.880796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c31af79-7e8f-4a59-bbcb-2058db64ef3a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:39.881462 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c31af79-7e8f-4a59-bbcb-2058db64ef3a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:39.882439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c31af79-7e8f-4a59-bbcb-2058db64ef3a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:39.883036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c31af79-7e8f-4a59-bbcb-2058db64ef3a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:40.018403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6c31af79-7e8f-4a59-bbcb-2058db64ef3a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:40.051172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6c31af79-7e8f-4a59-bbcb-2058db64ef3a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:40.058477 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6c31af79-7e8f-4a59-bbcb-2058db64ef3a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:40.067967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:40.075363 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6c31af79-7e8f-4a59-bbcb-2058db64ef3a tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1443 microversion: 2.75 time: 0.205543 Jul 25 12:43:40.078904 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 701/1420] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:39 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1443 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:40.102470 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-34cbdc74-724f-4a23-ac56-748963516804 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf96b7670>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:40.113358 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-523957c1-acbf-47c1-b334-d11bbb48a509 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "POST /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee/action" status: 202 len: 0 microversion: 2.1 time: 0.355098 Jul 25 12:43:40.121958 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 720/1421] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:43:39 2022] POST /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 12:43:40.136273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-d93b20fc-ff9f-4958-88b5-92d20f1b4eea req-db20a692-8be7-4b2d-b26f-a4f2f14507ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2711752-4c19-477f-a5f0-e5097f2dc41a", "name": "network-vif-unplugged", "status": "completed", "tag": "9e34f7bb-4583-4a3f-875a-1441c142d908"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:40.154210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d93b20fc-ff9f-4958-88b5-92d20f1b4eea req-db20a692-8be7-4b2d-b26f-a4f2f14507ab service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:40.156981 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d93b20fc-ff9f-4958-88b5-92d20f1b4eea req-db20a692-8be7-4b2d-b26f-a4f2f14507ab service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:40.170949 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-d93b20fc-ff9f-4958-88b5-92d20f1b4eea req-db20a692-8be7-4b2d-b26f-a4f2f14507ab service nova] Creating event network-vif-unplugged:9e34f7bb-4583-4a3f-875a-1441c142d908 for instance d2711752-4c19-477f-a5f0-e5097f2dc41a on n-h1-848886-15 Jul 25 12:43:40.179213 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-d93b20fc-ff9f-4958-88b5-92d20f1b4eea req-db20a692-8be7-4b2d-b26f-a4f2f14507ab service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055677 Jul 25 12:43:40.180534 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 721/1422] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:40.194136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a1c04138-5b50-4fd8-b5ab-567606675b92 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:40.195029 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a1c04138-5b50-4fd8-b5ab-567606675b92 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:40.206594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1c04138-5b50-4fd8-b5ab-567606675b92 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:40.207586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1c04138-5b50-4fd8-b5ab-567606675b92 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:40.210678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1c04138-5b50-4fd8-b5ab-567606675b92 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:40.211490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1c04138-5b50-4fd8-b5ab-567606675b92 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:40.231236 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-34cbdc74-724f-4a23-ac56-748963516804 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/b62ae338-98ed-450b-91d0-c71ef958d32e" status: 200 len: 1449 microversion: 2.1 time: 0.149651 Jul 25 12:43:40.232886 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 702/1423] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:40 2022] GET /compute/v2.1/images/b62ae338-98ed-450b-91d0-c71ef958d32e => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:40.246188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ea6d1c4f-60cb-4384-89c8-fc4bf1f4bf80 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:40.248100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ea6d1c4f-60cb-4384-89c8-fc4bf1f4bf80 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:40.266631 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea6d1c4f-60cb-4384-89c8-fc4bf1f4bf80 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:40.268407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea6d1c4f-60cb-4384-89c8-fc4bf1f4bf80 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:40.269247 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea6d1c4f-60cb-4384-89c8-fc4bf1f4bf80 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:40.269700 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea6d1c4f-60cb-4384-89c8-fc4bf1f4bf80 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:40.279003 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a1c04138-5b50-4fd8-b5ab-567606675b92 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:43:40.464977 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a1c04138-5b50-4fd8-b5ab-567606675b92 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "DELETE /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 204 len: 0 microversion: 2.1 time: 0.282674 Jul 25 12:43:40.469084 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 722/1424] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:43:40 2022] DELETE /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:43:40.482765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b32eb230-db81-4e7d-8fde-5cdac6446896 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9b660d0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:40.554316 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b32eb230-db81-4e7d-8fde-5cdac6446896 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/e7b64aa6-2140-432f-94e2-fbb3c86eb7a9" status: 200 len: 1411 microversion: 2.1 time: 0.083702 Jul 25 12:43:40.563788 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 723/1425] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:40 2022] GET /compute/v2.1/images/e7b64aa6-2140-432f-94e2-fbb3c86eb7a9 => generated 1411 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:40.569362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-fba7b1fd-eb77-4781-96f4-13d7a678f0da req-c33b6732-c564-45c5-899f-086ff838f625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2cc4389-ef66-4ad7-a6e5-ab70905b9620", "name": "network-vif-unplugged", "status": "completed", "tag": "94f1f07a-a4dc-4d37-9c1f-822a76bcc0b8"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:40.581874 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fba7b1fd-eb77-4781-96f4-13d7a678f0da req-c33b6732-c564-45c5-899f-086ff838f625 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:40.582316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fba7b1fd-eb77-4781-96f4-13d7a678f0da req-c33b6732-c564-45c5-899f-086ff838f625 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:40.593423 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-fba7b1fd-eb77-4781-96f4-13d7a678f0da req-c33b6732-c564-45c5-899f-086ff838f625 service nova] Creating event network-vif-unplugged:94f1f07a-a4dc-4d37-9c1f-822a76bcc0b8 for instance f2cc4389-ef66-4ad7-a6e5-ab70905b9620 on n-h2-848886-15 Jul 25 12:43:40.600143 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-fba7b1fd-eb77-4781-96f4-13d7a678f0da req-c33b6732-c564-45c5-899f-086ff838f625 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033317 Jul 25 12:43:40.602059 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 724/1426] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:40.611557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a3f87fbb-4016-4f38-8062-73232bc850f9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:40.612664 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a3f87fbb-4016-4f38-8062-73232bc850f9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:40.622471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3f87fbb-4016-4f38-8062-73232bc850f9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:40.623132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3f87fbb-4016-4f38-8062-73232bc850f9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:40.624080 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3f87fbb-4016-4f38-8062-73232bc850f9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:40.624845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3f87fbb-4016-4f38-8062-73232bc850f9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:40.734332 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ea6d1c4f-60cb-4384-89c8-fc4bf1f4bf80 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:40.746088 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ea6d1c4f-60cb-4384-89c8-fc4bf1f4bf80 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1476 microversion: 2.1 time: 0.509701 Jul 25 12:43:40.749190 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 703/1427] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:40 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1476 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:40.759063 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-af0ae6ee-de65-4a0b-b074-af5830447320 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf96b7b80>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:40.844364 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-af0ae6ee-de65-4a0b-b074-af5830447320 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/e7b64aa6-2140-432f-94e2-fbb3c86eb7a9" status: 200 len: 1411 microversion: 2.1 time: 0.092173 Jul 25 12:43:40.846443 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 704/1428] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:40 2022] GET /compute/v2.1/images/e7b64aa6-2140-432f-94e2-fbb3c86eb7a9 => generated 1411 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:40.873664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f130b228-ad75-425e-b96d-efafed330928 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:40.879259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f130b228-ad75-425e-b96d-efafed330928 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:40.890674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f130b228-ad75-425e-b96d-efafed330928 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:40.893690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f130b228-ad75-425e-b96d-efafed330928 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:40.898375 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f130b228-ad75-425e-b96d-efafed330928 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:40.899374 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f130b228-ad75-425e-b96d-efafed330928 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:40.956548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a3f87fbb-4016-4f38-8062-73232bc850f9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:40.977244 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a3f87fbb-4016-4f38-8062-73232bc850f9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 200 len: 1472 microversion: 2.1 time: 0.370050 Jul 25 12:43:40.978511 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 725/1429] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:40 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 1472 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:40.992067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4c43ddcf-9161-4c15-a1b7-abcfadefffd2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcfec9dc10>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:41.188534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f130b228-ad75-425e-b96d-efafed330928 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:41.201667 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f130b228-ad75-425e-b96d-efafed330928 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1505 microversion: 2.1 time: 0.353368 Jul 25 12:43:41.202474 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 705/1430] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:40 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:41.209463 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-53b19f5e-0cae-4f04-a27a-7ae78237de1b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:41.210938 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-53b19f5e-0cae-4f04-a27a-7ae78237de1b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:41.218682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53b19f5e-0cae-4f04-a27a-7ae78237de1b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:41.220360 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53b19f5e-0cae-4f04-a27a-7ae78237de1b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:41.221517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53b19f5e-0cae-4f04-a27a-7ae78237de1b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:41.222234 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53b19f5e-0cae-4f04-a27a-7ae78237de1b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:41.246220 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4c43ddcf-9161-4c15-a1b7-abcfadefffd2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "DELETE /compute/v2.1/images/e7b64aa6-2140-432f-94e2-fbb3c86eb7a9" status: 204 len: 0 microversion: 2.1 time: 0.266386 Jul 25 12:43:41.247053 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 726/1431] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:40 2022] DELETE /compute/v2.1/images/e7b64aa6-2140-432f-94e2-fbb3c86eb7a9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:43:41.252940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2c33abc3-d4ba-4d80-a1e6-9dcd612cd0b0 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:41.253959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2c33abc3-d4ba-4d80-a1e6-9dcd612cd0b0 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:41.262214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c33abc3-d4ba-4d80-a1e6-9dcd612cd0b0 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:41.263122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c33abc3-d4ba-4d80-a1e6-9dcd612cd0b0 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:41.264224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c33abc3-d4ba-4d80-a1e6-9dcd612cd0b0 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:41.264830 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c33abc3-d4ba-4d80-a1e6-9dcd612cd0b0 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:41.380595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2c33abc3-d4ba-4d80-a1e6-9dcd612cd0b0 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:41.396878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2c33abc3-d4ba-4d80-a1e6-9dcd612cd0b0 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:41.400094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2c33abc3-d4ba-4d80-a1e6-9dcd612cd0b0 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:41.409210 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2c33abc3-d4ba-4d80-a1e6-9dcd612cd0b0 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1443 microversion: 2.75 time: 0.160804 Jul 25 12:43:41.410143 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 727/1432] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:41 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:41.410436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-53b19f5e-0cae-4f04-a27a-7ae78237de1b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:41.415296 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1b310d9f-fbc9-48df-ad1a-df5f83ee55a5 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9b925e0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:41.433202 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-53b19f5e-0cae-4f04-a27a-7ae78237de1b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:41.434771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-53b19f5e-0cae-4f04-a27a-7ae78237de1b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:41.435896 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-53b19f5e-0cae-4f04-a27a-7ae78237de1b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1280 microversion: 2.25 time: 0.232088 Jul 25 12:43:41.436530 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 706/1433] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:41 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1280 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:41.446631 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-269ba4fc-6fe1-460e-bcea-4763e8041f96 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9cfe820>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:41.468973 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1b310d9f-fbc9-48df-ad1a-df5f83ee55a5 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/b62ae338-98ed-450b-91d0-c71ef958d32e" status: 200 len: 1449 microversion: 2.1 time: 0.057054 Jul 25 12:43:41.469797 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 728/1434] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:41 2022] GET /compute/v2.1/images/b62ae338-98ed-450b-91d0-c71ef958d32e => generated 1449 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:41.482885 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-269ba4fc-6fe1-460e-bcea-4763e8041f96 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] HTTP exception thrown: Image not found. Jul 25 12:43:41.506820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-269ba4fc-6fe1-460e-bcea-4763e8041f96 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Request method failure captured: Jul 25 12:43:41.506820 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/images/e7b64aa6-2140-432f-94e2-fbb3c86eb7a9 HTTP/1.1 Jul 25 12:43:41.506820 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:43:41.506820 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:43:41.506820 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:43:41.506820 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:43:41.506820 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:43:41.506820 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:43:41.506820 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:43:41.506820 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:43:41.506820 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o8ooEvqjYaWjOGZnMs8tQpLLBhsAjkHwJkOVRpGlGZwu0wvKMkpNJnI6LZOFAyrSiJCS7QVibWBeuqRdRi4gUJ9NsSc1cd56Q9jsPyD-2qGdsZPXQyCOvO9G7fHO9bE1ZV48K1Uls75dq-yU_Qym4X7e94zqNZG0QEWXhF2DClBQCk Jul 25 12:43:41.506820 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:43:41.506820 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:43:41.506820 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:43:41.506820 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:43:41.506820 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:43:41.506820 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:43:41.506820 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:43:41.506820 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:43:41.506820 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:43:41.506820 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:43:41.508540 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85c0dc3e0d894a5a95b1628cbd20df9f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}] Jul 25 12:43:41.508540 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ImagesTestJSON-796718257 Jul 25 12:43:41.508540 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:43:41.508540 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:43:41.508540 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ImagesTestJSON-796718257-project Jul 25 12:43:41.508540 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:43:41.508540 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:43:41.508540 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 53f799c73ceb4c189329bc86056bc048 Jul 25 12:43:41.508540 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ImagesTestJSON-796718257-project Jul 25 12:43:41.508540 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:43:41.508540 n-d-848886-15 devstack@n-api.service[125883]: exception: Image not found. Jul 25 12:43:41.508540 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'e7b64aa6-2140-432f-94e2-fbb3c86eb7a9'} Jul 25 12:43:41.508540 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:43:41.508540 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:43:41.509500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 12:43:41.509500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 12:43:41.509500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:43:41.509500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:43:41.509500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 12:43:41.509500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 12:43:41.509500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:43:41.509500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:43:41.509500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 12:43:41.509500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 12:43:41.509500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 12:43:41.509500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 12:43:41.509500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:43:41.509500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:43:41.509500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:43:41.509500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:43:41.509500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e7b64aa6-2140-432f-94e2-fbb3c86eb7a9 Jul 25 12:43:41.509500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:43:41.510748 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:43:41.510748 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:43:41.510748 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:43:41.510748 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 25 12:43:41.510748 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 25 12:43:41.510748 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 12:43:41.510748 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 12:43:41.510748 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 12:43:41.510748 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 12:43:41.510748 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 12:43:41.510748 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 12:43:41.510748 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 12:43:41.510748 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 12:43:41.510748 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:43:41.510748 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:43:41.510748 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 12:43:41.510748 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 12:43:41.510748 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:43:41.510748 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:43:41.511985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 12:43:41.511985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 12:43:41.511985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 12:43:41.511985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 12:43:41.511985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:43:41.511985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:43:41.511985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:43:41.511985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:43:41.511985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e7b64aa6-2140-432f-94e2-fbb3c86eb7a9 could not be found. Jul 25 12:43:41.511985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:43:41.511985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:43:41.511985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:43:41.511985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:43:41.511985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:43:41.511985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:43:41.511985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:43:41.511985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:43:41.511985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:43:41.511985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:43:41.513622 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:43:41.513622 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:43:41.513622 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 25 12:43:41.513622 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 12:43:41.513622 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 12:43:41.513622 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:43:41.513622 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:43:41.513622 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:43:41.513622 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:43:41.513622 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:43:41.513622 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:43:41.513622 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:43:41.513622 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:43:41.513622 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 12:43:41.513622 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:43:41.513622 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-269ba4fc-6fe1-460e-bcea-4763e8041f96 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Returning 404 to user: Image not found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:43:41.513622 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-269ba4fc-6fe1-460e-bcea-4763e8041f96 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/images/e7b64aa6-2140-432f-94e2-fbb3c86eb7a9" status: 404 len: 62 microversion: 2.1 time: 0.070974 Jul 25 12:43:41.515022 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 707/1435] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:41 2022] GET /compute/v2.1/images/e7b64aa6-2140-432f-94e2-fbb3c86eb7a9 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:43:41.517368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0a95ad03-a3f1-4a3b-87c7-54a4077ee944 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:41.518019 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0a95ad03-a3f1-4a3b-87c7-54a4077ee944 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:41.524789 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a95ad03-a3f1-4a3b-87c7-54a4077ee944 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:41.525241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a95ad03-a3f1-4a3b-87c7-54a4077ee944 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:41.526043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a95ad03-a3f1-4a3b-87c7-54a4077ee944 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:41.526480 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a95ad03-a3f1-4a3b-87c7-54a4077ee944 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:41.664970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0a95ad03-a3f1-4a3b-87c7-54a4077ee944 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:41.674164 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0a95ad03-a3f1-4a3b-87c7-54a4077ee944 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1500 microversion: 2.1 time: 0.160598 Jul 25 12:43:41.674731 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 729/1436] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:41 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1500 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:41.770307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-45d1eaba-227e-4341-859c-8fad833c18cb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:41.771979 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-45d1eaba-227e-4341-859c-8fad833c18cb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:41.778909 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-45d1eaba-227e-4341-859c-8fad833c18cb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:41.779364 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-45d1eaba-227e-4341-859c-8fad833c18cb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:41.780159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-45d1eaba-227e-4341-859c-8fad833c18cb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:41.780592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-45d1eaba-227e-4341-859c-8fad833c18cb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:41.786035 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:41.918529 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-45d1eaba-227e-4341-859c-8fad833c18cb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:41.926705 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-45d1eaba-227e-4341-859c-8fad833c18cb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1476 microversion: 2.1 time: 0.161766 Jul 25 12:43:41.927278 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 708/1437] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:41 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1476 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:42.000452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-25f0b566-d57f-4648-8792-418519f17b2b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:42.001069 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-25f0b566-d57f-4648-8792-418519f17b2b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:42.007682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25f0b566-d57f-4648-8792-418519f17b2b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:42.008126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25f0b566-d57f-4648-8792-418519f17b2b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:42.008899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25f0b566-d57f-4648-8792-418519f17b2b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:42.009330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25f0b566-d57f-4648-8792-418519f17b2b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:42.178151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-25f0b566-d57f-4648-8792-418519f17b2b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:42.186785 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-25f0b566-d57f-4648-8792-418519f17b2b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 200 len: 1472 microversion: 2.1 time: 0.190164 Jul 25 12:43:42.187379 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 730/1438] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:41 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 1472 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:42.222824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fc561dc2-77b2-4bfc-8f12-1f2129a747f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:42.224812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fc561dc2-77b2-4bfc-8f12-1f2129a747f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:42.232831 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-a89c0637-857c-4eb1-914b-2f114cbd9a35 req-a0f925da-4b95-4c37-9eb8-d8522da24b2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb5975b-24da-4318-90ce-bd3b7d0d01f2", "name": "network-vif-unplugged", "status": "completed", "tag": "0012b1f8-03b2-4861-88f2-461bdd29f4d1"}, {"name": "network-changed", "server_uuid": "d2711752-4c19-477f-a5f0-e5097f2dc41a", "tag": "9e34f7bb-4583-4a3f-875a-1441c142d908"}, {"name": "network-changed", "server_uuid": "7eb5975b-24da-4318-90ce-bd3b7d0d01f2", "tag": "0012b1f8-03b2-4861-88f2-461bdd29f4d1"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:42.240801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fc561dc2-77b2-4bfc-8f12-1f2129a747f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:42.241253 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fc561dc2-77b2-4bfc-8f12-1f2129a747f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:42.242700 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fc561dc2-77b2-4bfc-8f12-1f2129a747f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:42.243305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fc561dc2-77b2-4bfc-8f12-1f2129a747f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:42.258314 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a89c0637-857c-4eb1-914b-2f114cbd9a35 req-a0f925da-4b95-4c37-9eb8-d8522da24b2d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:42.258892 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a89c0637-857c-4eb1-914b-2f114cbd9a35 req-a0f925da-4b95-4c37-9eb8-d8522da24b2d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:42.276366 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-a89c0637-857c-4eb1-914b-2f114cbd9a35 req-a0f925da-4b95-4c37-9eb8-d8522da24b2d service nova] Creating event network-vif-unplugged:0012b1f8-03b2-4861-88f2-461bdd29f4d1 for instance 7eb5975b-24da-4318-90ce-bd3b7d0d01f2 on n-h1-848886-15 Jul 25 12:43:42.276788 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-a89c0637-857c-4eb1-914b-2f114cbd9a35 req-a0f925da-4b95-4c37-9eb8-d8522da24b2d service nova] Creating event network-changed:9e34f7bb-4583-4a3f-875a-1441c142d908 for instance d2711752-4c19-477f-a5f0-e5097f2dc41a on n-h1-848886-15 Jul 25 12:43:42.277292 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-a89c0637-857c-4eb1-914b-2f114cbd9a35 req-a0f925da-4b95-4c37-9eb8-d8522da24b2d service nova] Creating event network-changed:0012b1f8-03b2-4861-88f2-461bdd29f4d1 for instance 7eb5975b-24da-4318-90ce-bd3b7d0d01f2 on n-h1-848886-15 Jul 25 12:43:42.283538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [req-a89c0637-857c-4eb1-914b-2f114cbd9a35 req-a0f925da-4b95-4c37-9eb8-d8522da24b2d service nova] Instance 7eb5975b-24da-4318-90ce-bd3b7d0d01f2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 12:43:42.300230 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-a89c0637-857c-4eb1-914b-2f114cbd9a35 req-a0f925da-4b95-4c37-9eb8-d8522da24b2d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.075448 Jul 25 12:43:42.301035 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 731/1439] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:42.435599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e2af2281-d8f6-4da7-8c55-17b416694378 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:42.436799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e2af2281-d8f6-4da7-8c55-17b416694378 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:42.451936 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2af2281-d8f6-4da7-8c55-17b416694378 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:42.452710 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2af2281-d8f6-4da7-8c55-17b416694378 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:42.454457 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2af2281-d8f6-4da7-8c55-17b416694378 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:42.456732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2af2281-d8f6-4da7-8c55-17b416694378 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:42.905754 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e2af2281-d8f6-4da7-8c55-17b416694378 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:42.916291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e2af2281-d8f6-4da7-8c55-17b416694378 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:42.926339 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e2af2281-d8f6-4da7-8c55-17b416694378 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb5916ce611c47cda8d150daefa0f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109279139d284b8b82da98c474a00dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:42.937587 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e2af2281-d8f6-4da7-8c55-17b416694378 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 200 len: 1443 microversion: 2.75 time: 0.506158 Jul 25 12:43:42.950966 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 732/1440] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:42 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 1443 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:43:42.962400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ebef6dd9-d06a-4202-88db-602bf6800918 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:42.963032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ebef6dd9-d06a-4202-88db-602bf6800918 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:42.969605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ebef6dd9-d06a-4202-88db-602bf6800918 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:42.970059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ebef6dd9-d06a-4202-88db-602bf6800918 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:42.970860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ebef6dd9-d06a-4202-88db-602bf6800918 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:42.972001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ebef6dd9-d06a-4202-88db-602bf6800918 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:43.037817 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:43:43.038247 n-d-848886-15 devstack@n-api.service[125884]: Mon Jul 25 12:43:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 (ip 10.222.0.49) !!! Jul 25 12:43:43.292772 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fc561dc2-77b2-4bfc-8f12-1f2129a747f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:43.306462 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fc561dc2-77b2-4bfc-8f12-1f2129a747f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1505 microversion: 2.1 time: 1.087502 Jul 25 12:43:43.308957 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 709/1441] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:42 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1505 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:43.330999 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9c1de3b0-dbb9-4702-b010-135cf332ec20 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf970e3a0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:43.791650 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ebef6dd9-d06a-4202-88db-602bf6800918 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:43.796941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:43.819301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ebef6dd9-d06a-4202-88db-602bf6800918 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:43.826274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ebef6dd9-d06a-4202-88db-602bf6800918 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:43.829976 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ebef6dd9-d06a-4202-88db-602bf6800918 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1280 microversion: 2.25 time: 0.877695 Jul 25 12:43:43.836256 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 733/1442] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:42 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1280 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:43.853132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-40b27730-0061-436e-aa69-56446598881e req-8b6646f5-fe97-4f02-b302-4aef20725772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2711752-4c19-477f-a5f0-e5097f2dc41a", "name": "network-vif-plugged", "status": "completed", "tag": "9e34f7bb-4583-4a3f-875a-1441c142d908"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:43.887242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-40b27730-0061-436e-aa69-56446598881e req-8b6646f5-fe97-4f02-b302-4aef20725772 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:43.889185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-40b27730-0061-436e-aa69-56446598881e req-8b6646f5-fe97-4f02-b302-4aef20725772 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:43.936958 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-40b27730-0061-436e-aa69-56446598881e req-8b6646f5-fe97-4f02-b302-4aef20725772 service nova] Creating event network-vif-plugged:9e34f7bb-4583-4a3f-875a-1441c142d908 for instance d2711752-4c19-477f-a5f0-e5097f2dc41a on n-h1-848886-15 Jul 25 12:43:43.948661 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-40b27730-0061-436e-aa69-56446598881e req-8b6646f5-fe97-4f02-b302-4aef20725772 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108827 Jul 25 12:43:43.956333 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 734/1443] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:43.970269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-73413b17-8f55-4c69-9185-45978b1060bc tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:43.974743 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-73413b17-8f55-4c69-9185-45978b1060bc tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:43.991062 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-73413b17-8f55-4c69-9185-45978b1060bc tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:43.991877 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-73413b17-8f55-4c69-9185-45978b1060bc tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:43.992893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-73413b17-8f55-4c69-9185-45978b1060bc tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:43.993852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-73413b17-8f55-4c69-9185-45978b1060bc tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:44.425801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-73413b17-8f55-4c69-9185-45978b1060bc tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:44.434428 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-73413b17-8f55-4c69-9185-45978b1060bc tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1501 microversion: 2.1 time: 0.476418 Jul 25 12:43:44.444222 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 735/1444] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:43 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1501 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:44.455674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-64985247-0bba-4e95-ab54-4472a0234a20 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:44.456381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-64985247-0bba-4e95-ab54-4472a0234a20 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:44.478304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64985247-0bba-4e95-ab54-4472a0234a20 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:44.479894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64985247-0bba-4e95-ab54-4472a0234a20 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:44.482060 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64985247-0bba-4e95-ab54-4472a0234a20 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:44.482844 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64985247-0bba-4e95-ab54-4472a0234a20 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:44.706758 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-64985247-0bba-4e95-ab54-4472a0234a20 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:44.716937 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-64985247-0bba-4e95-ab54-4472a0234a20 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1476 microversion: 2.1 time: 0.270807 Jul 25 12:43:44.732657 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 736/1445] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:44 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1476 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:44.740313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c944f5c7-306e-4536-8cd4-b7c63a929f83 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:44.741087 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c944f5c7-306e-4536-8cd4-b7c63a929f83 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:44.772234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c944f5c7-306e-4536-8cd4-b7c63a929f83 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:44.774755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c944f5c7-306e-4536-8cd4-b7c63a929f83 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:44.777117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c944f5c7-306e-4536-8cd4-b7c63a929f83 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:44.779167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c944f5c7-306e-4536-8cd4-b7c63a929f83 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:44.977149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c944f5c7-306e-4536-8cd4-b7c63a929f83 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:44.985996 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c944f5c7-306e-4536-8cd4-b7c63a929f83 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 200 len: 1301 microversion: 2.1 time: 0.250056 Jul 25 12:43:45.011835 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 737/1446] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:44 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 1301 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:45.011835 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7553a756-5141-477e-bbf4-7ced6b48f845 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:45.011835 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7553a756-5141-477e-bbf4-7ced6b48f845 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] [instance: 2ad2b2a1-b3f1-47cc-a769-04744715a6ec] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:45.038397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7553a756-5141-477e-bbf4-7ced6b48f845 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:45.039136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7553a756-5141-477e-bbf4-7ced6b48f845 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:45.040566 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7553a756-5141-477e-bbf4-7ced6b48f845 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:45.040885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7553a756-5141-477e-bbf4-7ced6b48f845 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:45.083074 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-7553a756-5141-477e-bbf4-7ced6b48f845 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] HTTP exception thrown: Instance 2ad2b2a1-b3f1-47cc-a769-04744715a6ec could not be found. Jul 25 12:43:45.085710 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7553a756-5141-477e-bbf4-7ced6b48f845 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Request method failure captured: Jul 25 12:43:45.085710 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec HTTP/1.1 Jul 25 12:43:45.085710 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:43:45.085710 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:43:45.085710 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:43:45.085710 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:43:45.085710 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:43:45.085710 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:43:45.085710 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:43:45.085710 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:43:45.085710 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o-rd-YA-atDlZOI6mxZbHfdZA9Bzdc3asJK_6ZZm6T8PnUU6f_TFQzOQts5UBoUyPhrvKfysERGlXYEG34wLjktUlHUZt1rLJovmr9blrEttBGDQgjLedLj4QvAyApUvTbxVt0Pnc5G4b7M2RsmnOw9IH2X8dbso5PgwLjdNU0jt-g Jul 25 12:43:45.085710 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:43:45.085710 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:43:45.085710 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:43:45.085710 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:43:45.085710 n-d-848886-15 devstack@n-api.service[125884]: X-Openstack-Nova-Api-Version: 2.75 Jul 25 12:43:45.085710 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:43:45.085710 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:43:45.085710 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 109279139d284b8b82da98c474a00dce Jul 25 12:43:45.085710 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersAdmin275Test-1281442345 Jul 25 12:43:45.085710 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:43:45.085710 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:43:45.087313 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_109279139d284b8b82da98c474a00dce", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/109279139d284b8b82da98c474a00dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/109279139d284b8b82da98c474a00dce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/109279139d284b8b82da98c474a00dce"}]}] Jul 25 12:43:45.087313 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersAdmin275Test-1281442345 Jul 25 12:43:45.087313 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 109279139d284b8b82da98c474a00dce Jul 25 12:43:45.087313 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersAdmin275Test-1281442345 Jul 25 12:43:45.087313 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersAdmin275Test-1281442345-project Jul 25 12:43:45.087313 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:43:45.087313 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:43:45.087313 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: eb5916ce611c47cda8d150daefa0f770 Jul 25 12:43:45.087313 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersAdmin275Test-1281442345-project Jul 25 12:43:45.087313 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:43:45.087313 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 2ad2b2a1-b3f1-47cc-a769-04744715a6ec could not be found. Jul 25 12:43:45.087313 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '2ad2b2a1-b3f1-47cc-a769-04744715a6ec'} Jul 25 12:43:45.088203 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:43:45.088203 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:43:45.088203 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:43:45.088203 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:43:45.088203 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:43:45.088203 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:43:45.088203 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:43:45.088203 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:43:45.088203 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:43:45.088203 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:43:45.088203 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ad2b2a1-b3f1-47cc-a769-04744715a6ec could not be found. Jul 25 12:43:45.088203 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:43:45.088203 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:43:45.088203 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:43:45.088203 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:43:45.088203 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:43:45.088203 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:43:45.088203 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:43:45.088203 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:43:45.088203 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:43:45.089608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:43:45.089608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:43:45.089608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:43:45.089608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:43:45.089608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:43:45.089608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:43:45.089608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:43:45.089608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ad2b2a1-b3f1-47cc-a769-04744715a6ec could not be found. Jul 25 12:43:45.089608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:43:45.089608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:43:45.089608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:43:45.089608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:43:45.089608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:43:45.089608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:43:45.089608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:43:45.089608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:43:45.089608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ad2b2a1-b3f1-47cc-a769-04744715a6ec could not be found. Jul 25 12:43:45.089608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:43:45.093275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7553a756-5141-477e-bbf4-7ced6b48f845 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] Returning 404 to user: Instance 2ad2b2a1-b3f1-47cc-a769-04744715a6ec could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:43:45.093275 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7553a756-5141-477e-bbf4-7ced6b48f845 tempest-ServersAdmin275Test-1281442345 tempest-ServersAdmin275Test-1281442345-project] 10.222.0.49 "GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec" status: 404 len: 111 microversion: 2.75 time: 0.084658 Jul 25 12:43:45.093275 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 738/1447] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:44 2022] GET /compute/v2.1/servers/2ad2b2a1-b3f1-47cc-a769-04744715a6ec => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:43:45.177094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-fe9b8e92-88d3-4757-8ff1-930c4bbd80fe req-98af8453-9e19-4cc6-a0d5-7e2af2099ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89024fb2-f607-462a-b8e4-f7004f7987ad", "name": "network-vif-deleted", "tag": "94116aa6-64d7-4863-a19d-2ff08dcc7c4e"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:45.190218 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fe9b8e92-88d3-4757-8ff1-930c4bbd80fe req-98af8453-9e19-4cc6-a0d5-7e2af2099ddd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:45.190984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fe9b8e92-88d3-4757-8ff1-930c4bbd80fe req-98af8453-9e19-4cc6-a0d5-7e2af2099ddd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:45.207997 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-fe9b8e92-88d3-4757-8ff1-930c4bbd80fe req-98af8453-9e19-4cc6-a0d5-7e2af2099ddd service nova] Creating event network-vif-deleted:94116aa6-64d7-4863-a19d-2ff08dcc7c4e for instance 89024fb2-f607-462a-b8e4-f7004f7987ad on n-h1-848886-15 Jul 25 12:43:45.218461 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-fe9b8e92-88d3-4757-8ff1-930c4bbd80fe req-98af8453-9e19-4cc6-a0d5-7e2af2099ddd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126947 Jul 25 12:43:45.220670 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 739/1448] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:45.230109 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-67fbf20d-d384-430e-b060-c5c081920e05 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:45.230834 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-67fbf20d-d384-430e-b060-c5c081920e05 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:45.238837 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-67fbf20d-d384-430e-b060-c5c081920e05 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:45.239305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-67fbf20d-d384-430e-b060-c5c081920e05 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:45.240268 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-67fbf20d-d384-430e-b060-c5c081920e05 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:45.240968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-67fbf20d-d384-430e-b060-c5c081920e05 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:45.583722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-67fbf20d-d384-430e-b060-c5c081920e05 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:45.596884 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-67fbf20d-d384-430e-b060-c5c081920e05 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1505 microversion: 2.1 time: 0.373781 Jul 25 12:43:45.597804 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 740/1449] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:45 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:45.880912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3159a15f-57b1-44ee-95be-685c804a40ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:45.881765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3159a15f-57b1-44ee-95be-685c804a40ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:45.891071 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3159a15f-57b1-44ee-95be-685c804a40ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:45.892569 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3159a15f-57b1-44ee-95be-685c804a40ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:45.895858 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3159a15f-57b1-44ee-95be-685c804a40ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:45.898278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3159a15f-57b1-44ee-95be-685c804a40ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:46.169747 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3159a15f-57b1-44ee-95be-685c804a40ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:46.180368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3159a15f-57b1-44ee-95be-685c804a40ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:46.181970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3159a15f-57b1-44ee-95be-685c804a40ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:46.183184 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3159a15f-57b1-44ee-95be-685c804a40ec tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1280 microversion: 2.25 time: 0.571846 Jul 25 12:43:46.186948 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 741/1450] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:45 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1280 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:46.202875 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-048c7198-3af8-487c-9855-4e42af9db9bd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:46.202875 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-048c7198-3af8-487c-9855-4e42af9db9bd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:46.240278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-048c7198-3af8-487c-9855-4e42af9db9bd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:46.241092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-048c7198-3af8-487c-9855-4e42af9db9bd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:46.242151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-048c7198-3af8-487c-9855-4e42af9db9bd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:46.242880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-048c7198-3af8-487c-9855-4e42af9db9bd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:46.580019 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-048c7198-3af8-487c-9855-4e42af9db9bd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:46.589612 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-048c7198-3af8-487c-9855-4e42af9db9bd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1501 microversion: 2.1 time: 0.403783 Jul 25 12:43:46.606529 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 742/1451] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:46 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1501 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:46.612373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3b7b11d1-eb5d-49a1-876f-a2bc409b09fb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:46.613232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3b7b11d1-eb5d-49a1-876f-a2bc409b09fb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:46.620340 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b7b11d1-eb5d-49a1-876f-a2bc409b09fb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:46.620990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b7b11d1-eb5d-49a1-876f-a2bc409b09fb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:46.622022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b7b11d1-eb5d-49a1-876f-a2bc409b09fb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:46.622621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b7b11d1-eb5d-49a1-876f-a2bc409b09fb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:46.887926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3b7b11d1-eb5d-49a1-876f-a2bc409b09fb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:46.898316 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3b7b11d1-eb5d-49a1-876f-a2bc409b09fb tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1474 microversion: 2.1 time: 0.290343 Jul 25 12:43:46.899930 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 743/1452] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:46 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1474 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:46.906375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-6ee30c66-6680-4cb1-8142-a2237398f69e req-8443fc9d-3afc-48dd-bd36-4978f5592942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159b5add-9666-4a2a-82e7-7571a120cabb", "name": "network-vif-plugged", "status": "completed", "tag": "27e87312-289e-4818-b884-b357c21f7a9f"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:46.918550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6ee30c66-6680-4cb1-8142-a2237398f69e req-8443fc9d-3afc-48dd-bd36-4978f5592942 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:46.919147 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6ee30c66-6680-4cb1-8142-a2237398f69e req-8443fc9d-3afc-48dd-bd36-4978f5592942 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:46.935030 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-6ee30c66-6680-4cb1-8142-a2237398f69e req-8443fc9d-3afc-48dd-bd36-4978f5592942 service nova] Creating event network-vif-plugged:27e87312-289e-4818-b884-b357c21f7a9f for instance 159b5add-9666-4a2a-82e7-7571a120cabb on n-h2-848886-15 Jul 25 12:43:46.940264 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-6ee30c66-6680-4cb1-8142-a2237398f69e req-8443fc9d-3afc-48dd-bd36-4978f5592942 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038978 Jul 25 12:43:46.941372 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 744/1453] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:46.946967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d2c66a2c-cf8a-4a1a-90f2-1355a5b8df5c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:46.947904 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d2c66a2c-cf8a-4a1a-90f2-1355a5b8df5c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 89024fb2-f607-462a-b8e4-f7004f7987ad] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:46.955059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2c66a2c-cf8a-4a1a-90f2-1355a5b8df5c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:46.955709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2c66a2c-cf8a-4a1a-90f2-1355a5b8df5c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:46.956655 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2c66a2c-cf8a-4a1a-90f2-1355a5b8df5c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:46.957238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2c66a2c-cf8a-4a1a-90f2-1355a5b8df5c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:46.974284 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-d2c66a2c-cf8a-4a1a-90f2-1355a5b8df5c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] HTTP exception thrown: Instance 89024fb2-f607-462a-b8e4-f7004f7987ad could not be found. Jul 25 12:43:46.976232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d2c66a2c-cf8a-4a1a-90f2-1355a5b8df5c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Request method failure captured: Jul 25 12:43:46.976232 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad HTTP/1.1 Jul 25 12:43:46.976232 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:43:46.976232 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:43:46.976232 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:43:46.976232 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:43:46.976232 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:43:46.976232 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:43:46.976232 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:43:46.976232 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:43:46.976232 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o9FI8xGtqP7_CW35BbEF7ISywkY3QBKklr5o1CS_fq6Lx6g68HVW9d3S-CvFf3EFHQ-I9augL8LNHoHSZQ7fotgZGp7jb0rcywXJ-uNBD0-jX_Y0mC9RxTzXhF95_ckH46T5WFeX6UZGziPb5X1dUcODvmDxxrVOVDn9AvlAmcUOhI Jul 25 12:43:46.976232 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:43:46.976232 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:43:46.976232 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:43:46.976232 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:43:46.976232 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:43:46.976232 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:43:46.976232 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5c81a97dfca44bf6af64fdcd5d50c549 Jul 25 12:43:46.976232 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:43:46.976232 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:43:46.976232 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:43:46.977878 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5c81a97dfca44bf6af64fdcd5d50c549", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5c81a97dfca44bf6af64fdcd5d50c549"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c81a97dfca44bf6af64fdcd5d50c549"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c81a97dfca44bf6af64fdcd5d50c549"}]}] Jul 25 12:43:46.977878 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:43:46.977878 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5c81a97dfca44bf6af64fdcd5d50c549 Jul 25 12:43:46.977878 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:43:46.977878 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersOnMultiNodesTest-1957362714-project Jul 25 12:43:46.977878 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:43:46.977878 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:43:46.977878 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 8c296447c2254c048f94bd9f186b0097 Jul 25 12:43:46.977878 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersOnMultiNodesTest-1957362714-project Jul 25 12:43:46.977878 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:43:46.977878 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 89024fb2-f607-462a-b8e4-f7004f7987ad could not be found. Jul 25 12:43:46.977878 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '89024fb2-f607-462a-b8e4-f7004f7987ad'} Jul 25 12:43:46.978951 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:43:46.978951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:43:46.978951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:43:46.978951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:43:46.978951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:43:46.978951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:43:46.978951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:43:46.978951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:43:46.978951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:43:46.978951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:43:46.978951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89024fb2-f607-462a-b8e4-f7004f7987ad could not be found. Jul 25 12:43:46.978951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:43:46.978951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:43:46.978951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:43:46.978951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:43:46.978951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:43:46.978951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:43:46.978951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:43:46.978951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:43:46.978951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:43:46.980326 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:43:46.980326 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:43:46.980326 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:43:46.980326 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:43:46.980326 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:43:46.980326 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:43:46.980326 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:43:46.980326 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89024fb2-f607-462a-b8e4-f7004f7987ad could not be found. Jul 25 12:43:46.980326 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:43:46.980326 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:43:46.980326 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:43:46.980326 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:43:46.980326 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:43:46.980326 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:43:46.980326 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:43:46.980326 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:43:46.980326 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89024fb2-f607-462a-b8e4-f7004f7987ad could not be found. Jul 25 12:43:46.980326 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:43:46.982636 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d2c66a2c-cf8a-4a1a-90f2-1355a5b8df5c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Returning 404 to user: Instance 89024fb2-f607-462a-b8e4-f7004f7987ad could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:43:46.983730 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d2c66a2c-cf8a-4a1a-90f2-1355a5b8df5c tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad" status: 404 len: 111 microversion: 2.1 time: 0.041077 Jul 25 12:43:46.984873 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 745/1454] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:46 2022] GET /compute/v2.1/servers/89024fb2-f607-462a-b8e4-f7004f7987ad => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:43:46.989936 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9c7ae491-ae27-45d7-af4d-6397d2b6b8f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:46.990653 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9c7ae491-ae27-45d7-af4d-6397d2b6b8f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:47.007215 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9c7ae491-ae27-45d7-af4d-6397d2b6b8f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:47.007668 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9c7ae491-ae27-45d7-af4d-6397d2b6b8f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:47.008452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9c7ae491-ae27-45d7-af4d-6397d2b6b8f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:47.008883 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9c7ae491-ae27-45d7-af4d-6397d2b6b8f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:47.225975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9c7ae491-ae27-45d7-af4d-6397d2b6b8f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:47.236191 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9c7ae491-ae27-45d7-af4d-6397d2b6b8f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1505 microversion: 2.1 time: 0.249956 Jul 25 12:43:47.237003 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 746/1455] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:46 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1505 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:47.241300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-25466f4d-0cc2-49dc-9d38-4ce65559b1b9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:47.241783 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-25466f4d-0cc2-49dc-9d38-4ce65559b1b9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 1c42ab74-7b7f-493e-a5b0-e0384beafd96] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:47.260542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25466f4d-0cc2-49dc-9d38-4ce65559b1b9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:47.261002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25466f4d-0cc2-49dc-9d38-4ce65559b1b9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:47.261795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25466f4d-0cc2-49dc-9d38-4ce65559b1b9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:47.262289 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25466f4d-0cc2-49dc-9d38-4ce65559b1b9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:47.319332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-25466f4d-0cc2-49dc-9d38-4ce65559b1b9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 1c42ab74-7b7f-493e-a5b0-e0384beafd96] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:43:47.449820 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-25466f4d-0cc2-49dc-9d38-4ce65559b1b9 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96" status: 204 len: 0 microversion: 2.1 time: 0.211526 Jul 25 12:43:47.451474 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 747/1456] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:43:47 2022] DELETE /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:43:47.464185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7647cb9b-999e-44af-8552-7b643ce83a4f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:47.465576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7647cb9b-999e-44af-8552-7b643ce83a4f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:47.479664 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7647cb9b-999e-44af-8552-7b643ce83a4f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:47.480845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7647cb9b-999e-44af-8552-7b643ce83a4f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:47.481648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7647cb9b-999e-44af-8552-7b643ce83a4f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:47.484703 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7647cb9b-999e-44af-8552-7b643ce83a4f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:47.709887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7647cb9b-999e-44af-8552-7b643ce83a4f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:47.721571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7647cb9b-999e-44af-8552-7b643ce83a4f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:47.724678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7647cb9b-999e-44af-8552-7b643ce83a4f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:47.726146 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7647cb9b-999e-44af-8552-7b643ce83a4f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1280 microversion: 2.25 time: 0.273221 Jul 25 12:43:47.726723 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 748/1457] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:47 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1280 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:47.750633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-68d28ba9-1eb4-47e6-a8a4-d3f936252d7d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:47.752058 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-68d28ba9-1eb4-47e6-a8a4-d3f936252d7d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 1c42ab74-7b7f-493e-a5b0-e0384beafd96] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:47.762416 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68d28ba9-1eb4-47e6-a8a4-d3f936252d7d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:47.763396 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68d28ba9-1eb4-47e6-a8a4-d3f936252d7d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:47.765559 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68d28ba9-1eb4-47e6-a8a4-d3f936252d7d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:47.766219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68d28ba9-1eb4-47e6-a8a4-d3f936252d7d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:47.960769 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-68d28ba9-1eb4-47e6-a8a4-d3f936252d7d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:47.980616 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-68d28ba9-1eb4-47e6-a8a4-d3f936252d7d tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96" status: 200 len: 1472 microversion: 2.1 time: 0.243371 Jul 25 12:43:47.980616 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 749/1458] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:47 2022] GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96 => generated 1472 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:47.990262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4315e66e-158c-45e7-818a-0199b6585d10 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:47.990740 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4315e66e-158c-45e7-818a-0199b6585d10 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:48.004289 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4315e66e-158c-45e7-818a-0199b6585d10 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:48.008307 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4315e66e-158c-45e7-818a-0199b6585d10 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:48.009622 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4315e66e-158c-45e7-818a-0199b6585d10 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:48.012229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4315e66e-158c-45e7-818a-0199b6585d10 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:48.199954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4315e66e-158c-45e7-818a-0199b6585d10 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:48.209045 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4315e66e-158c-45e7-818a-0199b6585d10 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1501 microversion: 2.1 time: 0.235980 Jul 25 12:43:48.221928 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 750/1459] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:47 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1501 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:48.594228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d90cca40-dfd8-43ac-bfe5-32de32978931 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:48.595293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d90cca40-dfd8-43ac-bfe5-32de32978931 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:48.598185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:48.612352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d90cca40-dfd8-43ac-bfe5-32de32978931 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:48.613959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d90cca40-dfd8-43ac-bfe5-32de32978931 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:48.614972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d90cca40-dfd8-43ac-bfe5-32de32978931 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:48.615416 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d90cca40-dfd8-43ac-bfe5-32de32978931 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:49.417554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d90cca40-dfd8-43ac-bfe5-32de32978931 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:49.426820 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d90cca40-dfd8-43ac-bfe5-32de32978931 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1474 microversion: 2.1 time: 1.215534 Jul 25 12:43:49.427306 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 751/1460] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:48 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1474 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:49.441716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0dd3519c-e41a-4820-9e39-123465366f73 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:49.442434 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0dd3519c-e41a-4820-9e39-123465366f73 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:49.452827 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0dd3519c-e41a-4820-9e39-123465366f73 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:49.457766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0dd3519c-e41a-4820-9e39-123465366f73 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:49.459564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0dd3519c-e41a-4820-9e39-123465366f73 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:49.460032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0dd3519c-e41a-4820-9e39-123465366f73 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:49.475781 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:50.327491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0dd3519c-e41a-4820-9e39-123465366f73 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:50.337108 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0dd3519c-e41a-4820-9e39-123465366f73 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1485 microversion: 2.1 time: 0.908745 Jul 25 12:43:50.337694 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 752/1461] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:49 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1485 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:50.357110 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1dd32377-c9c9-4fa9-8c2a-137befb5f6e2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:50.358447 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1dd32377-c9c9-4fa9-8c2a-137befb5f6e2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:50.375947 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dd32377-c9c9-4fa9-8c2a-137befb5f6e2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:50.376679 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dd32377-c9c9-4fa9-8c2a-137befb5f6e2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:50.377665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dd32377-c9c9-4fa9-8c2a-137befb5f6e2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:50.378296 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dd32377-c9c9-4fa9-8c2a-137befb5f6e2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:51.408358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1dd32377-c9c9-4fa9-8c2a-137befb5f6e2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:51.434438 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1dd32377-c9c9-4fa9-8c2a-137befb5f6e2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:51.440333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1dd32377-c9c9-4fa9-8c2a-137befb5f6e2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:51.442125 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1dd32377-c9c9-4fa9-8c2a-137befb5f6e2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1280 microversion: 2.25 time: 1.098002 Jul 25 12:43:51.445865 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 753/1462] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:50 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1280 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:51.452681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5aafafdc-f9c5-463d-ba4f-b8147d111407 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:51.453654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5aafafdc-f9c5-463d-ba4f-b8147d111407 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 1c42ab74-7b7f-493e-a5b0-e0384beafd96] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:51.460455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5aafafdc-f9c5-463d-ba4f-b8147d111407 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:51.461234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5aafafdc-f9c5-463d-ba4f-b8147d111407 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:51.462302 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5aafafdc-f9c5-463d-ba4f-b8147d111407 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:51.462971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5aafafdc-f9c5-463d-ba4f-b8147d111407 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:51.636696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5aafafdc-f9c5-463d-ba4f-b8147d111407 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:51.652703 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5aafafdc-f9c5-463d-ba4f-b8147d111407 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96" status: 200 len: 1430 microversion: 2.1 time: 0.202745 Jul 25 12:43:51.659642 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 754/1463] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:51 2022] GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96 => generated 1430 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:51.669493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-acaedcf1-152f-411b-9573-6ea22b4eecba tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:51.672232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-acaedcf1-152f-411b-9573-6ea22b4eecba tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:51.689638 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acaedcf1-152f-411b-9573-6ea22b4eecba tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:51.691548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acaedcf1-152f-411b-9573-6ea22b4eecba tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:51.693527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acaedcf1-152f-411b-9573-6ea22b4eecba tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:51.695156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acaedcf1-152f-411b-9573-6ea22b4eecba tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:52.067511 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-acaedcf1-152f-411b-9573-6ea22b4eecba tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:52.084790 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-acaedcf1-152f-411b-9573-6ea22b4eecba tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1501 microversion: 2.1 time: 0.422591 Jul 25 12:43:52.085400 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 755/1464] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:51 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1501 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:52.104089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-0f4b63a3-d3c5-4c28-a473-e8b5d7b8ecaa req-8f33f717-79b3-484c-a980-d2a0ae4ef65c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7baf920-9e9f-472e-b57b-e6ed9f05daee", "name": "network-vif-plugged", "status": "completed", "tag": "b2e68ed8-3347-4769-ad93-207689dae18a"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:52.154292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-0f4b63a3-d3c5-4c28-a473-e8b5d7b8ecaa req-8f33f717-79b3-484c-a980-d2a0ae4ef65c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:52.156340 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-0f4b63a3-d3c5-4c28-a473-e8b5d7b8ecaa req-8f33f717-79b3-484c-a980-d2a0ae4ef65c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:52.190070 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-0f4b63a3-d3c5-4c28-a473-e8b5d7b8ecaa req-8f33f717-79b3-484c-a980-d2a0ae4ef65c service nova] Creating event network-vif-plugged:b2e68ed8-3347-4769-ad93-207689dae18a for instance e7baf920-9e9f-472e-b57b-e6ed9f05daee on n-h2-848886-15 Jul 25 12:43:52.204047 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-0f4b63a3-d3c5-4c28-a473-e8b5d7b8ecaa req-8f33f717-79b3-484c-a980-d2a0ae4ef65c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109066 Jul 25 12:43:52.208050 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 756/1465] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:52.222382 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2e70ced8-4558-451e-b0f1-4b4b07d0b398 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:52.229334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2e70ced8-4558-451e-b0f1-4b4b07d0b398 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:52.240916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=11 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:52.258151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2e70ced8-4558-451e-b0f1-4b4b07d0b398 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:52.261531 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2e70ced8-4558-451e-b0f1-4b4b07d0b398 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:52.262753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2e70ced8-4558-451e-b0f1-4b4b07d0b398 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:52.264155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2e70ced8-4558-451e-b0f1-4b4b07d0b398 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:52.503372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2e70ced8-4558-451e-b0f1-4b4b07d0b398 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:52.516299 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2e70ced8-4558-451e-b0f1-4b4b07d0b398 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1471 microversion: 2.1 time: 0.303976 Jul 25 12:43:52.517006 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 757/1466] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:52 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1471 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:52.776271 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-27e9e248-72d7-4309-808c-bdae3678b733 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-534689196", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:53.297982 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=11 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:53.659180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-27e9e248-72d7-4309-808c-bdae3678b733 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] validate_networks() for None {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:43:53.661394 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9c1de3b0-dbb9-4702-b010-135cf332ec20 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/b62ae338-98ed-450b-91d0-c71ef958d32e" status: 200 len: 1449 microversion: 2.1 time: 10.330108 Jul 25 12:43:53.668547 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 710/1467] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:43 2022] GET /compute/v2.1/images/b62ae338-98ed-450b-91d0-c71ef958d32e => generated 1449 bytes in 10354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:53.681305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7c2b5124-cf9b-435c-9f0c-69e6e34f2e60 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1869339552", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:53.758823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-7c2b5124-cf9b-435c-9f0c-69e6e34f2e60 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] validate_networks() for [('c8484052-ee86-4e45-a84b-61b3e2a22acb', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:43:54.015346 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-27e9e248-72d7-4309-808c-bdae3678b733 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:43:54.016170 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-27e9e248-72d7-4309-808c-bdae3678b733 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:43:54.016893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-27e9e248-72d7-4309-808c-bdae3678b733 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:43:54.017977 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-27e9e248-72d7-4309-808c-bdae3678b733 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:43:54.018841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-27e9e248-72d7-4309-808c-bdae3678b733 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:43:54.040195 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27e9e248-72d7-4309-808c-bdae3678b733 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:54.041274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27e9e248-72d7-4309-808c-bdae3678b733 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:54.042206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27e9e248-72d7-4309-808c-bdae3678b733 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:54.044063 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27e9e248-72d7-4309-808c-bdae3678b733 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:54.087327 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-27e9e248-72d7-4309-808c-bdae3678b733 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Getting quotas for project e7330b3757794c94b7cbd4ce6886c78d. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:43:54.094774 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-27e9e248-72d7-4309-808c-bdae3678b733 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Getting quotas for user e0f15b1174154d848d010e48b5df98db and project e7330b3757794c94b7cbd4ce6886c78d. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:43:54.117672 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-27e9e248-72d7-4309-808c-bdae3678b733 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:43:54.127907 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-27e9e248-72d7-4309-808c-bdae3678b733 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:43:54.198171 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-27e9e248-72d7-4309-808c-bdae3678b733 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.679393 Jul 25 12:43:54.199039 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 758/1468] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:43:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:43:54.210678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-5437799a-f68f-4342-b072-171ae4b46281 req-ca43ddad-c935-4509-b2c7-9040f9053654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c42ab74-7b7f-493e-a5b0-e0384beafd96", "name": "network-vif-deleted", "tag": "c39cff1c-5245-48af-82fe-4998aae199ab"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:54.232828 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5437799a-f68f-4342-b072-171ae4b46281 req-ca43ddad-c935-4509-b2c7-9040f9053654 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:54.233310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5437799a-f68f-4342-b072-171ae4b46281 req-ca43ddad-c935-4509-b2c7-9040f9053654 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:54.256572 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-5437799a-f68f-4342-b072-171ae4b46281 req-ca43ddad-c935-4509-b2c7-9040f9053654 service nova] Creating event network-vif-deleted:c39cff1c-5245-48af-82fe-4998aae199ab for instance 1c42ab74-7b7f-493e-a5b0-e0384beafd96 on n-h2-848886-15 Jul 25 12:43:54.262420 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-5437799a-f68f-4342-b072-171ae4b46281 req-ca43ddad-c935-4509-b2c7-9040f9053654 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062134 Jul 25 12:43:54.263332 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 759/1469] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:54.268643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9361f1a5-6af5-4589-8384-03632a8431e1 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:54.269341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9361f1a5-6af5-4589-8384-03632a8431e1 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:54.281675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9361f1a5-6af5-4589-8384-03632a8431e1 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:54.282169 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9361f1a5-6af5-4589-8384-03632a8431e1 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:54.287038 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9361f1a5-6af5-4589-8384-03632a8431e1 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:54.287730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9361f1a5-6af5-4589-8384-03632a8431e1 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:54.588570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-7c2b5124-cf9b-435c-9f0c-69e6e34f2e60 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:43:54.590268 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-7c2b5124-cf9b-435c-9f0c-69e6e34f2e60 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:43:54.590948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-7c2b5124-cf9b-435c-9f0c-69e6e34f2e60 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:43:54.591575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-7c2b5124-cf9b-435c-9f0c-69e6e34f2e60 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:43:54.592138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-7c2b5124-cf9b-435c-9f0c-69e6e34f2e60 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:43:54.604643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9361f1a5-6af5-4589-8384-03632a8431e1 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:54.613814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9361f1a5-6af5-4589-8384-03632a8431e1 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:54.616364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9361f1a5-6af5-4589-8384-03632a8431e1 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:54.617633 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9361f1a5-6af5-4589-8384-03632a8431e1 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1280 microversion: 2.25 time: 0.353207 Jul 25 12:43:54.627831 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c2b5124-cf9b-435c-9f0c-69e6e34f2e60 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:54.628534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c2b5124-cf9b-435c-9f0c-69e6e34f2e60 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:54.629508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c2b5124-cf9b-435c-9f0c-69e6e34f2e60 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:54.630280 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c2b5124-cf9b-435c-9f0c-69e6e34f2e60 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:54.631098 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 760/1470] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:54 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1280 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:54.639657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7ec327d9-3543-4801-9335-0af8c4a9171f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:54.640233 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7ec327d9-3543-4801-9335-0af8c4a9171f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:54.653131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ec327d9-3543-4801-9335-0af8c4a9171f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:54.654052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ec327d9-3543-4801-9335-0af8c4a9171f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:54.655305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ec327d9-3543-4801-9335-0af8c4a9171f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:54.655906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ec327d9-3543-4801-9335-0af8c4a9171f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:54.675265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-7c2b5124-cf9b-435c-9f0c-69e6e34f2e60 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Getting quotas for project 7c39943d13c4455a8b7a18cce243d079. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:43:54.681529 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-7c2b5124-cf9b-435c-9f0c-69e6e34f2e60 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Getting quotas for user 66746994c09d40edb7f51ca444b7a5a7 and project 7c39943d13c4455a8b7a18cce243d079. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:43:54.695010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7c2b5124-cf9b-435c-9f0c-69e6e34f2e60 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:43:54.698757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7c2b5124-cf9b-435c-9f0c-69e6e34f2e60 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:43:54.771199 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7c2b5124-cf9b-435c-9f0c-69e6e34f2e60 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.105846 Jul 25 12:43:54.781204 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 711/1471] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:43:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:43:54.787599 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e4215d27-c430-4d0d-afce-d98552ef859b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:54.788684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e4215d27-c430-4d0d-afce-d98552ef859b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 1c42ab74-7b7f-493e-a5b0-e0384beafd96] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:54.797372 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4215d27-c430-4d0d-afce-d98552ef859b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:54.797746 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4215d27-c430-4d0d-afce-d98552ef859b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:54.798962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4215d27-c430-4d0d-afce-d98552ef859b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:54.799391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4215d27-c430-4d0d-afce-d98552ef859b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:54.819891 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-e4215d27-c430-4d0d-afce-d98552ef859b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] HTTP exception thrown: Instance 1c42ab74-7b7f-493e-a5b0-e0384beafd96 could not be found. Jul 25 12:43:54.838890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e4215d27-c430-4d0d-afce-d98552ef859b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Request method failure captured: Jul 25 12:43:54.838890 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96 HTTP/1.1 Jul 25 12:43:54.838890 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:43:54.838890 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:43:54.838890 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:43:54.838890 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:43:54.838890 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:43:54.838890 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:43:54.838890 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:43:54.838890 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:43:54.838890 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o9FI8xGtqP7_CW35BbEF7ISywkY3QBKklr5o1CS_fq6Lx6g68HVW9d3S-CvFf3EFHQ-I9augL8LNHoHSZQ7fotgZGp7jb0rcywXJ-uNBD0-jX_Y0mC9RxTzXhF95_ckH46T5WFeX6UZGziPb5X1dUcODvmDxxrVOVDn9AvlAmcUOhI Jul 25 12:43:54.838890 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:43:54.838890 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:43:54.838890 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:43:54.838890 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:43:54.838890 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:43:54.838890 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:43:54.838890 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 5c81a97dfca44bf6af64fdcd5d50c549 Jul 25 12:43:54.838890 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:43:54.838890 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:43:54.838890 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:43:54.840547 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5c81a97dfca44bf6af64fdcd5d50c549", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5c81a97dfca44bf6af64fdcd5d50c549"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c81a97dfca44bf6af64fdcd5d50c549"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c81a97dfca44bf6af64fdcd5d50c549"}]}] Jul 25 12:43:54.840547 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:43:54.840547 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 5c81a97dfca44bf6af64fdcd5d50c549 Jul 25 12:43:54.840547 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:43:54.840547 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersOnMultiNodesTest-1957362714-project Jul 25 12:43:54.840547 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:43:54.840547 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:43:54.840547 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8c296447c2254c048f94bd9f186b0097 Jul 25 12:43:54.840547 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersOnMultiNodesTest-1957362714-project Jul 25 12:43:54.840547 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:43:54.840547 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 1c42ab74-7b7f-493e-a5b0-e0384beafd96 could not be found. Jul 25 12:43:54.840547 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '1c42ab74-7b7f-493e-a5b0-e0384beafd96'} Jul 25 12:43:54.841456 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:43:54.841456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:43:54.841456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:43:54.841456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:43:54.841456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:43:54.841456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:43:54.841456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:43:54.841456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:43:54.841456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:43:54.841456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:43:54.841456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c42ab74-7b7f-493e-a5b0-e0384beafd96 could not be found. Jul 25 12:43:54.841456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:43:54.841456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:43:54.841456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:43:54.841456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:43:54.841456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:43:54.841456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:43:54.841456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:43:54.841456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:43:54.841456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:43:54.842929 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:43:54.842929 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:43:54.842929 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:43:54.842929 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:43:54.842929 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:43:54.842929 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:43:54.842929 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:43:54.842929 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c42ab74-7b7f-493e-a5b0-e0384beafd96 could not be found. Jul 25 12:43:54.842929 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:43:54.842929 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:43:54.842929 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:43:54.842929 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:43:54.842929 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:43:54.842929 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:43:54.842929 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:43:54.842929 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:43:54.842929 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c42ab74-7b7f-493e-a5b0-e0384beafd96 could not be found. Jul 25 12:43:54.842929 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:43:54.844418 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e4215d27-c430-4d0d-afce-d98552ef859b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Returning 404 to user: Instance 1c42ab74-7b7f-493e-a5b0-e0384beafd96 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:43:54.846702 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e4215d27-c430-4d0d-afce-d98552ef859b tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96" status: 404 len: 111 microversion: 2.1 time: 0.062778 Jul 25 12:43:54.849529 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 712/1472] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:54 2022] GET /compute/v2.1/servers/1c42ab74-7b7f-493e-a5b0-e0384beafd96 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:43:54.850662 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7ec327d9-3543-4801-9335-0af8c4a9171f tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "POST /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2/action" status: 202 len: 0 microversion: 2.1 time: 0.217595 Jul 25 12:43:54.854585 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 761/1473] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:43:54 2022] POST /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:43:54.860932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-50b77820-0776-45f9-b68f-37cc31e968b1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-639565270", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:54.863096 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d094d1a4-8f29-4d9a-b726-8cc56729b6f2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:54.866272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d094d1a4-8f29-4d9a-b726-8cc56729b6f2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:54.899590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d094d1a4-8f29-4d9a-b726-8cc56729b6f2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:54.900057 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d094d1a4-8f29-4d9a-b726-8cc56729b6f2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:54.915728 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d094d1a4-8f29-4d9a-b726-8cc56729b6f2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:54.917005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d094d1a4-8f29-4d9a-b726-8cc56729b6f2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:54.960270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-50b77820-0776-45f9-b68f-37cc31e968b1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] validate_networks() for None {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:43:55.431348 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d094d1a4-8f29-4d9a-b726-8cc56729b6f2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:55.445343 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d094d1a4-8f29-4d9a-b726-8cc56729b6f2 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1488 microversion: 2.1 time: 0.594099 Jul 25 12:43:55.460281 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 713/1474] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:54 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1488 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:55.473242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-e3010da2-3ce3-43e2-8d32-707d7540fc51 req-94c94fb5-1526-4ab1-b4b3-8b96e0695d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a21af85-54c8-424c-b815-3882ecf4a893", "name": "network-vif-plugged", "status": "completed", "tag": "067888a1-37d3-4817-9387-14f7ea43416c"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:55.501440 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e3010da2-3ce3-43e2-8d32-707d7540fc51 req-94c94fb5-1526-4ab1-b4b3-8b96e0695d9e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:55.502015 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e3010da2-3ce3-43e2-8d32-707d7540fc51 req-94c94fb5-1526-4ab1-b4b3-8b96e0695d9e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:55.527402 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-e3010da2-3ce3-43e2-8d32-707d7540fc51 req-94c94fb5-1526-4ab1-b4b3-8b96e0695d9e service nova] Creating event network-vif-plugged:067888a1-37d3-4817-9387-14f7ea43416c for instance 8a21af85-54c8-424c-b815-3882ecf4a893 on n-h1-848886-15 Jul 25 12:43:55.538297 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-e3010da2-3ce3-43e2-8d32-707d7540fc51 req-94c94fb5-1526-4ab1-b4b3-8b96e0695d9e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072298 Jul 25 12:43:55.539410 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 714/1475] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:55.545367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1d4ef1fc-ef3c-4cbb-ad3e-3f4c43d320f4 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9df7310>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:55.653874 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1d4ef1fc-ef3c-4cbb-ad3e-3f4c43d320f4 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/b62ae338-98ed-450b-91d0-c71ef958d32e" status: 200 len: 1449 microversion: 2.1 time: 0.111611 Jul 25 12:43:55.664759 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 715/1476] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:55 2022] GET /compute/v2.1/images/b62ae338-98ed-450b-91d0-c71ef958d32e => generated 1449 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:55.670714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2fd64de1-9605-4092-a289-44f0496f1c4c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:55.675880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2fd64de1-9605-4092-a289-44f0496f1c4c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:55.689254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fd64de1-9605-4092-a289-44f0496f1c4c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:55.694414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fd64de1-9605-4092-a289-44f0496f1c4c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:55.695759 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fd64de1-9605-4092-a289-44f0496f1c4c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:55.697640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fd64de1-9605-4092-a289-44f0496f1c4c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:55.932105 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2fd64de1-9605-4092-a289-44f0496f1c4c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:55.943984 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2fd64de1-9605-4092-a289-44f0496f1c4c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1218 microversion: 2.1 time: 0.277678 Jul 25 12:43:55.947283 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 716/1477] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:55 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1218 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:55.984985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fa23ace1-4e2c-4aee-9e4e-cbbc921b5dc2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:55.985415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fa23ace1-4e2c-4aee-9e4e-cbbc921b5dc2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: f7651c95-4705-42c3-8fc5-58644c0d8dc5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:56.016245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fa23ace1-4e2c-4aee-9e4e-cbbc921b5dc2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:56.017118 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fa23ace1-4e2c-4aee-9e4e-cbbc921b5dc2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:56.018694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fa23ace1-4e2c-4aee-9e4e-cbbc921b5dc2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:56.021220 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fa23ace1-4e2c-4aee-9e4e-cbbc921b5dc2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:56.025814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-50b77820-0776-45f9-b68f-37cc31e968b1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:43:56.026355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-50b77820-0776-45f9-b68f-37cc31e968b1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:43:56.026726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-50b77820-0776-45f9-b68f-37cc31e968b1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:43:56.027140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-50b77820-0776-45f9-b68f-37cc31e968b1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:43:56.027564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-50b77820-0776-45f9-b68f-37cc31e968b1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:43:56.049342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50b77820-0776-45f9-b68f-37cc31e968b1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:56.049798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50b77820-0776-45f9-b68f-37cc31e968b1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:56.057503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50b77820-0776-45f9-b68f-37cc31e968b1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:56.058001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50b77820-0776-45f9-b68f-37cc31e968b1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:56.095814 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fa23ace1-4e2c-4aee-9e4e-cbbc921b5dc2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: f7651c95-4705-42c3-8fc5-58644c0d8dc5] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:43:56.156256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-50b77820-0776-45f9-b68f-37cc31e968b1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Getting quotas for project e7330b3757794c94b7cbd4ce6886c78d. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:43:56.179044 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-50b77820-0776-45f9-b68f-37cc31e968b1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Getting quotas for user e0f15b1174154d848d010e48b5df98db and project e7330b3757794c94b7cbd4ce6886c78d. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:43:56.227948 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-50b77820-0776-45f9-b68f-37cc31e968b1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:43:56.232860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-50b77820-0776-45f9-b68f-37cc31e968b1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 965438e3-72fa-44e0-90fa-4fb0b24042ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:43:56.361990 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-50b77820-0776-45f9-b68f-37cc31e968b1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.503156 Jul 25 12:43:56.362976 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 762/1478] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:43:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:43:56.365279 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fa23ace1-4e2c-4aee-9e4e-cbbc921b5dc2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5" status: 204 len: 0 microversion: 2.1 time: 0.383425 Jul 25 12:43:56.370135 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 717/1479] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:43:55 2022] DELETE /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:43:56.371764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-515ed2cd-523d-4d28-b7ad-0267437f9eb5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:56.373493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-515ed2cd-523d-4d28-b7ad-0267437f9eb5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:56.386046 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-515ed2cd-523d-4d28-b7ad-0267437f9eb5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:56.386507 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-515ed2cd-523d-4d28-b7ad-0267437f9eb5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:56.387389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-515ed2cd-523d-4d28-b7ad-0267437f9eb5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:56.387834 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-515ed2cd-523d-4d28-b7ad-0267437f9eb5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:56.413897 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0fabde72-96cc-4a7f-8fed-92a8cd8ba62b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:56.414742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0fabde72-96cc-4a7f-8fed-92a8cd8ba62b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:56.433123 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0fabde72-96cc-4a7f-8fed-92a8cd8ba62b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:56.434056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0fabde72-96cc-4a7f-8fed-92a8cd8ba62b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:56.435079 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0fabde72-96cc-4a7f-8fed-92a8cd8ba62b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:56.442045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0fabde72-96cc-4a7f-8fed-92a8cd8ba62b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:56.522790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0fabde72-96cc-4a7f-8fed-92a8cd8ba62b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:43:56.757220 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0fabde72-96cc-4a7f-8fed-92a8cd8ba62b tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 204 len: 0 microversion: 2.1 time: 0.381443 Jul 25 12:43:56.758140 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 718/1480] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:43:56 2022] DELETE /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:43:56.766393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dbd7afe4-2e07-4f2c-88fc-d179e27701c3 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:56.767159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dbd7afe4-2e07-4f2c-88fc-d179e27701c3 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:56.783854 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbd7afe4-2e07-4f2c-88fc-d179e27701c3 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:56.785287 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbd7afe4-2e07-4f2c-88fc-d179e27701c3 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:56.787684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbd7afe4-2e07-4f2c-88fc-d179e27701c3 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:56.789646 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbd7afe4-2e07-4f2c-88fc-d179e27701c3 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:56.867064 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-515ed2cd-523d-4d28-b7ad-0267437f9eb5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:56.881746 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-515ed2cd-523d-4d28-b7ad-0267437f9eb5 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1470 microversion: 2.1 time: 0.517294 Jul 25 12:43:56.896516 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 763/1481] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:56 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1470 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:56.929950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6202d9f8-7eea-4096-9bb4-65bc6ad87215 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:56.931086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6202d9f8-7eea-4096-9bb4-65bc6ad87215 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 965438e3-72fa-44e0-90fa-4fb0b24042ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:57.294103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6202d9f8-7eea-4096-9bb4-65bc6ad87215 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:57.305109 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6202d9f8-7eea-4096-9bb4-65bc6ad87215 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff" status: 200 len: 1213 microversion: 2.1 time: 0.407045 Jul 25 12:43:57.306043 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 764/1482] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:56 2022] GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff => generated 1213 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:57.317549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b21cb52f-cff0-4df9-97a1-20652d4b0b7a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:57.324523 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b21cb52f-cff0-4df9-97a1-20652d4b0b7a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: f7651c95-4705-42c3-8fc5-58644c0d8dc5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:57.355417 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b21cb52f-cff0-4df9-97a1-20652d4b0b7a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:57.356160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b21cb52f-cff0-4df9-97a1-20652d4b0b7a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:57.357192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b21cb52f-cff0-4df9-97a1-20652d4b0b7a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:57.359028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b21cb52f-cff0-4df9-97a1-20652d4b0b7a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:57.662414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dbd7afe4-2e07-4f2c-88fc-d179e27701c3 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:57.671764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dbd7afe4-2e07-4f2c-88fc-d179e27701c3 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:57.682523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dbd7afe4-2e07-4f2c-88fc-d179e27701c3 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:57.683955 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dbd7afe4-2e07-4f2c-88fc-d179e27701c3 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1280 microversion: 2.25 time: 0.924436 Jul 25 12:43:57.684754 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 719/1483] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:56 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1280 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:57.693823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2b5cbd70-487a-4e74-b362-b4812e0e874d tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf96b71f0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:57.803947 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b21cb52f-cff0-4df9-97a1-20652d4b0b7a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:57.812721 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b21cb52f-cff0-4df9-97a1-20652d4b0b7a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5" status: 200 len: 1471 microversion: 2.1 time: 0.503102 Jul 25 12:43:57.818297 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 765/1484] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:57 2022] GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5 => generated 1471 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:57.835320 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4ffe30da-8fe7-4194-8252-ebde2ceaeb7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9c9fe50>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:57.854816 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2b5cbd70-487a-4e74-b362-b4812e0e874d tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/b62ae338-98ed-450b-91d0-c71ef958d32e" status: 200 len: 1449 microversion: 2.1 time: 0.168821 Jul 25 12:43:57.856129 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 720/1485] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:57 2022] GET /compute/v2.1/images/b62ae338-98ed-450b-91d0-c71ef958d32e => generated 1449 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:57.862661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-59d74475-09db-4c51-ad37-c8c1a9ce5c61 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:57.863326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-59d74475-09db-4c51-ad37-c8c1a9ce5c61 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:57.877122 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59d74475-09db-4c51-ad37-c8c1a9ce5c61 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:57.877582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59d74475-09db-4c51-ad37-c8c1a9ce5c61 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:57.879158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59d74475-09db-4c51-ad37-c8c1a9ce5c61 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:57.879602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59d74475-09db-4c51-ad37-c8c1a9ce5c61 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:57.911552 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-4ffe30da-8fe7-4194-8252-ebde2ceaeb7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] HTTP exception thrown: Image not found. Jul 25 12:43:57.961158 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4ffe30da-8fe7-4194-8252-ebde2ceaeb7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Request method failure captured: Jul 25 12:43:57.961158 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/images/e7b64aa6-2140-432f-94e2-fbb3c86eb7a9 HTTP/1.1 Jul 25 12:43:57.961158 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:43:57.961158 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:43:57.961158 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:43:57.961158 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:43:57.961158 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:43:57.961158 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:43:57.961158 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:43:57.961158 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:43:57.961158 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o8ooEvqjYaWjOGZnMs8tQpLLBhsAjkHwJkOVRpGlGZwu0wvKMkpNJnI6LZOFAyrSiJCS7QVibWBeuqRdRi4gUJ9NsSc1cd56Q9jsPyD-2qGdsZPXQyCOvO9G7fHO9bE1ZV48K1Uls75dq-yU_Qym4X7e94zqNZG0QEWXhF2DClBQCk Jul 25 12:43:57.961158 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:43:57.961158 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:43:57.961158 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:43:57.961158 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:43:57.961158 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:43:57.961158 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:43:57.961158 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:43:57.961158 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:43:57.961158 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:43:57.961158 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:43:57.962917 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85c0dc3e0d894a5a95b1628cbd20df9f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}] Jul 25 12:43:57.962917 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesTestJSON-796718257 Jul 25 12:43:57.962917 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:43:57.962917 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:43:57.962917 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesTestJSON-796718257-project Jul 25 12:43:57.962917 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:43:57.962917 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:43:57.962917 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 53f799c73ceb4c189329bc86056bc048 Jul 25 12:43:57.962917 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesTestJSON-796718257-project Jul 25 12:43:57.962917 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:43:57.962917 n-d-848886-15 devstack@n-api.service[125884]: exception: Image not found. Jul 25 12:43:57.962917 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'e7b64aa6-2140-432f-94e2-fbb3c86eb7a9'} Jul 25 12:43:57.962917 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:43:57.962917 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:43:57.964011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 12:43:57.964011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 12:43:57.964011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:43:57.964011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:43:57.964011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:43:57.964011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:43:57.964011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 12:43:57.964011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 12:43:57.964011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 12:43:57.964011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 12:43:57.964011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:43:57.964011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:43:57.964011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:43:57.964011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:43:57.964011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e7b64aa6-2140-432f-94e2-fbb3c86eb7a9 to delete Jul 25 12:43:57.964011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:43:57.964011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:43:57.964011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:43:57.964011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:43:57.965566 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 12:43:57.965566 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 12:43:57.965566 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 12:43:57.965566 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 12:43:57.965566 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 12:43:57.965566 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 12:43:57.965566 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e7b64aa6-2140-432f-94e2-fbb3c86eb7a9 could not be found. Jul 25 12:43:57.965566 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:43:57.965566 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:43:57.965566 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:43:57.965566 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:43:57.965566 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:43:57.965566 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:43:57.965566 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:43:57.965566 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:43:57.965566 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:43:57.965566 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:43:57.965566 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:43:57.965566 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:43:57.965566 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 12:43:57.967100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 12:43:57.967100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 12:43:57.967100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:43:57.967100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:43:57.967100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:43:57.967100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:43:57.967100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:43:57.967100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:43:57.967100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:43:57.967100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:43:57.967100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 12:43:57.967100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:43:57.969105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4ffe30da-8fe7-4194-8252-ebde2ceaeb7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Returning 404 to user: Image not found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:43:57.970310 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4ffe30da-8fe7-4194-8252-ebde2ceaeb7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "DELETE /compute/v2.1/images/e7b64aa6-2140-432f-94e2-fbb3c86eb7a9" status: 404 len: 62 microversion: 2.1 time: 0.150754 Jul 25 12:43:57.974159 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 766/1486] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:57 2022] DELETE /compute/v2.1/images/e7b64aa6-2140-432f-94e2-fbb3c86eb7a9 => generated 62 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:43:57.979165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-b5eb3507-fdf3-42a5-a030-ddbc41855f74 req-5fe5e073-ac13-4695-b590-ea29284dcdbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb5975b-24da-4318-90ce-bd3b7d0d01f2", "name": "network-vif-plugged", "status": "completed", "tag": "0012b1f8-03b2-4861-88f2-461bdd29f4d1"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:57.992767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-59d74475-09db-4c51-ad37-c8c1a9ce5c61 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:58.002158 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-59d74475-09db-4c51-ad37-c8c1a9ce5c61 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1266 microversion: 2.1 time: 0.144722 Jul 25 12:43:58.006647 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 721/1487] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:57 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:58.020397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b5eb3507-fdf3-42a5-a030-ddbc41855f74 req-5fe5e073-ac13-4695-b590-ea29284dcdbb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:58.021087 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b5eb3507-fdf3-42a5-a030-ddbc41855f74 req-5fe5e073-ac13-4695-b590-ea29284dcdbb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:58.023023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2fd36356-8d76-4e73-ba9d-cbb9009b7f13 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:58.023649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2fd36356-8d76-4e73-ba9d-cbb9009b7f13 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:58.040211 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-b5eb3507-fdf3-42a5-a030-ddbc41855f74 req-5fe5e073-ac13-4695-b590-ea29284dcdbb service nova] Creating event network-vif-plugged:0012b1f8-03b2-4861-88f2-461bdd29f4d1 for instance 7eb5975b-24da-4318-90ce-bd3b7d0d01f2 on n-h1-848886-15 Jul 25 12:43:58.045206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fd36356-8d76-4e73-ba9d-cbb9009b7f13 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:58.045934 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fd36356-8d76-4e73-ba9d-cbb9009b7f13 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:58.046961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fd36356-8d76-4e73-ba9d-cbb9009b7f13 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:58.047599 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fd36356-8d76-4e73-ba9d-cbb9009b7f13 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:58.057471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [req-b5eb3507-fdf3-42a5-a030-ddbc41855f74 req-5fe5e073-ac13-4695-b590-ea29284dcdbb service nova] Instance 7eb5975b-24da-4318-90ce-bd3b7d0d01f2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 12:43:58.088000 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-b5eb3507-fdf3-42a5-a030-ddbc41855f74 req-5fe5e073-ac13-4695-b590-ea29284dcdbb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112340 Jul 25 12:43:58.093286 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 767/1488] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:58.100952 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e5b08f50-487a-47d9-ae49-34291434ddba tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:58.101558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e5b08f50-487a-47d9-ae49-34291434ddba tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:58.109991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5b08f50-487a-47d9-ae49-34291434ddba tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:58.111413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5b08f50-487a-47d9-ae49-34291434ddba tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:58.112300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5b08f50-487a-47d9-ae49-34291434ddba tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:58.113377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5b08f50-487a-47d9-ae49-34291434ddba tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:58.149342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e5b08f50-487a-47d9-ae49-34291434ddba tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:43:58.242475 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.compute.api [None req-e5b08f50-487a-47d9-ae49-34291434ddba tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Instance is already in deleting state, ignoring this request Jul 25 12:43:58.245811 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e5b08f50-487a-47d9-ae49-34291434ddba tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 204 len: 0 microversion: 2.1 time: 0.150318 Jul 25 12:43:58.247352 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 768/1489] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:43:58 2022] DELETE /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:43:58.258685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-65c9407a-3b9f-480e-b3a3-abe73080ddc8 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:58.259634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-65c9407a-3b9f-480e-b3a3-abe73080ddc8 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:58.269139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65c9407a-3b9f-480e-b3a3-abe73080ddc8 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:58.269793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65c9407a-3b9f-480e-b3a3-abe73080ddc8 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:58.270794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65c9407a-3b9f-480e-b3a3-abe73080ddc8 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:58.271552 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65c9407a-3b9f-480e-b3a3-abe73080ddc8 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:58.879732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-65c9407a-3b9f-480e-b3a3-abe73080ddc8 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:58.902474 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-65c9407a-3b9f-480e-b3a3-abe73080ddc8 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1494 microversion: 2.1 time: 0.650050 Jul 25 12:43:58.924601 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 769/1490] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:58 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1494 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:43:58.933942 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5faa7cd3-d34a-40f1-ba93-a80ffda018fe tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:58.934777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5faa7cd3-d34a-40f1-ba93-a80ffda018fe tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 965438e3-72fa-44e0-90fa-4fb0b24042ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:58.955680 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5faa7cd3-d34a-40f1-ba93-a80ffda018fe tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:58.956461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5faa7cd3-d34a-40f1-ba93-a80ffda018fe tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:58.957491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5faa7cd3-d34a-40f1-ba93-a80ffda018fe tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:58.959893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5faa7cd3-d34a-40f1-ba93-a80ffda018fe tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:58.983423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2fd36356-8d76-4e73-ba9d-cbb9009b7f13 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:59.004809 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2fd36356-8d76-4e73-ba9d-cbb9009b7f13 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1470 microversion: 2.1 time: 0.993922 Jul 25 12:43:59.006284 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 722/1491] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:58 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1470 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:59.016612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-846446f6-5157-403d-9389-6efbb9a8723e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:59.021124 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-846446f6-5157-403d-9389-6efbb9a8723e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:59.049296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-846446f6-5157-403d-9389-6efbb9a8723e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:59.051869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-846446f6-5157-403d-9389-6efbb9a8723e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:59.053240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-846446f6-5157-403d-9389-6efbb9a8723e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:59.055549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-846446f6-5157-403d-9389-6efbb9a8723e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:59.139989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5faa7cd3-d34a-40f1-ba93-a80ffda018fe tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:59.143824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:59.151353 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5faa7cd3-d34a-40f1-ba93-a80ffda018fe tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff" status: 200 len: 1283 microversion: 2.1 time: 0.225242 Jul 25 12:43:59.161629 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 770/1492] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:58 2022] GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff => generated 1283 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:59.173674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2d53eae0-987b-4668-9602-62862075ba9a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:59.175218 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2d53eae0-987b-4668-9602-62862075ba9a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: f7651c95-4705-42c3-8fc5-58644c0d8dc5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:59.197591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d53eae0-987b-4668-9602-62862075ba9a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:59.197813 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d53eae0-987b-4668-9602-62862075ba9a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:59.204285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d53eae0-987b-4668-9602-62862075ba9a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:59.204765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d53eae0-987b-4668-9602-62862075ba9a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:59.583793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-846446f6-5157-403d-9389-6efbb9a8723e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:59.595153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-846446f6-5157-403d-9389-6efbb9a8723e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:59.601652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-846446f6-5157-403d-9389-6efbb9a8723e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:59.606796 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-846446f6-5157-403d-9389-6efbb9a8723e tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1475 microversion: 2.25 time: 0.596736 Jul 25 12:43:59.620988 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 723/1493] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:59 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1475 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:59.628997 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2d3d9d69-09e5-4a7f-8cdf-081fde7d4cfa tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf970e3a0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:59.695261 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2d3d9d69-09e5-4a7f-8cdf-081fde7d4cfa tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/b62ae338-98ed-450b-91d0-c71ef958d32e" status: 200 len: 1449 microversion: 2.1 time: 0.083397 Jul 25 12:43:59.703471 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 724/1494] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:43:59 2022] GET /compute/v2.1/images/b62ae338-98ed-450b-91d0-c71ef958d32e => generated 1449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:59.706325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-569e186d-cd13-471f-8af5-74ebc66e82b8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:59.715222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-569e186d-cd13-471f-8af5-74ebc66e82b8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:59.723586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-569e186d-cd13-471f-8af5-74ebc66e82b8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:59.724164 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-569e186d-cd13-471f-8af5-74ebc66e82b8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:59.725283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-569e186d-cd13-471f-8af5-74ebc66e82b8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:59.725814 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-569e186d-cd13-471f-8af5-74ebc66e82b8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:59.781782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2d53eae0-987b-4668-9602-62862075ba9a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:59.797394 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2d53eae0-987b-4668-9602-62862075ba9a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5" status: 200 len: 1471 microversion: 2.1 time: 0.634283 Jul 25 12:43:59.810435 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 771/1495] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:59 2022] GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5 => generated 1471 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:59.822107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f9a68dfb-aa78-451e-83ef-fe313fff2217 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:59.822876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f9a68dfb-aa78-451e-83ef-fe313fff2217 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:59.835701 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9a68dfb-aa78-451e-83ef-fe313fff2217 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:59.836297 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9a68dfb-aa78-451e-83ef-fe313fff2217 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:59.837216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9a68dfb-aa78-451e-83ef-fe313fff2217 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:59.841002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9a68dfb-aa78-451e-83ef-fe313fff2217 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:00.081977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-569e186d-cd13-471f-8af5-74ebc66e82b8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:00.093708 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-569e186d-cd13-471f-8af5-74ebc66e82b8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1274 microversion: 2.1 time: 0.395791 Jul 25 12:44:00.094438 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 725/1496] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:59 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1274 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:00.106777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-abb050a4-ec7c-4aa3-a6f7-aeb3fcb44dc0 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:00.107502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-abb050a4-ec7c-4aa3-a6f7-aeb3fcb44dc0 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:00.121779 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-abb050a4-ec7c-4aa3-a6f7-aeb3fcb44dc0 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:00.124766 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-abb050a4-ec7c-4aa3-a6f7-aeb3fcb44dc0 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:00.125976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-abb050a4-ec7c-4aa3-a6f7-aeb3fcb44dc0 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:00.126416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-abb050a4-ec7c-4aa3-a6f7-aeb3fcb44dc0 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:00.380531 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-f9a68dfb-aa78-451e-83ef-fe313fff2217 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lazy-loading 'services' on Instance uuid 8a21af85-54c8-424c-b815-3882ecf4a893 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:44:00.398284 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f9a68dfb-aa78-451e-83ef-fe313fff2217 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1969 microversion: 2.25 time: 0.586593 Jul 25 12:44:00.411956 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 772/1497] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:59 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1969 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:00.424827 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ff86c6e0-7b3c-4a14-8479-4499e9ab6e66 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:00.425910 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ff86c6e0-7b3c-4a14-8479-4499e9ab6e66 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:00.433112 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff86c6e0-7b3c-4a14-8479-4499e9ab6e66 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:00.433920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff86c6e0-7b3c-4a14-8479-4499e9ab6e66 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:00.434898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff86c6e0-7b3c-4a14-8479-4499e9ab6e66 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:00.435548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff86c6e0-7b3c-4a14-8479-4499e9ab6e66 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:00.457303 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-abb050a4-ec7c-4aa3-a6f7-aeb3fcb44dc0 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:00.477983 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-abb050a4-ec7c-4aa3-a6f7-aeb3fcb44dc0 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1494 microversion: 2.1 time: 0.368622 Jul 25 12:44:00.479106 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 726/1498] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:00 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1494 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:00.483818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-91829fca-70ad-4c95-abc3-2472fd56dff2 req-63dda87b-c9ef-4587-9d89-ad480ec66853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7baf920-9e9f-472e-b57b-e6ed9f05daee", "name": "network-vif-unplugged", "status": "completed", "tag": "b2e68ed8-3347-4769-ad93-207689dae18a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:00.497713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-91829fca-70ad-4c95-abc3-2472fd56dff2 req-63dda87b-c9ef-4587-9d89-ad480ec66853 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:00.502490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-91829fca-70ad-4c95-abc3-2472fd56dff2 req-63dda87b-c9ef-4587-9d89-ad480ec66853 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:00.521923 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-91829fca-70ad-4c95-abc3-2472fd56dff2 req-63dda87b-c9ef-4587-9d89-ad480ec66853 service nova] Creating event network-vif-unplugged:b2e68ed8-3347-4769-ad93-207689dae18a for instance e7baf920-9e9f-472e-b57b-e6ed9f05daee on n-h2-848886-15 Jul 25 12:44:00.529862 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-91829fca-70ad-4c95-abc3-2472fd56dff2 req-63dda87b-c9ef-4587-9d89-ad480ec66853 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049443 Jul 25 12:44:00.531113 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 727/1499] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:00.546320 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-afd1f42d-3b4e-4a3d-be32-ec5ebab8c4f9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:00.547809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-afd1f42d-3b4e-4a3d-be32-ec5ebab8c4f9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 965438e3-72fa-44e0-90fa-4fb0b24042ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:00.558109 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afd1f42d-3b4e-4a3d-be32-ec5ebab8c4f9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:00.558576 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afd1f42d-3b4e-4a3d-be32-ec5ebab8c4f9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:00.559965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afd1f42d-3b4e-4a3d-be32-ec5ebab8c4f9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:00.560467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afd1f42d-3b4e-4a3d-be32-ec5ebab8c4f9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:00.733164 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-afd1f42d-3b4e-4a3d-be32-ec5ebab8c4f9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:00.774409 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ff86c6e0-7b3c-4a14-8479-4499e9ab6e66 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:00.806479 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ff86c6e0-7b3c-4a14-8479-4499e9ab6e66 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1470 microversion: 2.1 time: 0.392804 Jul 25 12:44:00.818559 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-afd1f42d-3b4e-4a3d-be32-ec5ebab8c4f9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff" status: 200 len: 1271 microversion: 2.1 time: 0.260978 Jul 25 12:44:00.824126 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 773/1500] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:00 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1470 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:00.827198 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 728/1501] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:00 2022] GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff => generated 1271 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:00.851646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bdc681f6-07e7-459d-a030-118b322a3ba2 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:00.851805 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bdc681f6-07e7-459d-a030-118b322a3ba2 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:00.861809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8f8e60b7-8452-4bee-bbbd-03f6ecd74548 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9a99ca0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:00.891802 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bdc681f6-07e7-459d-a030-118b322a3ba2 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:00.893295 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bdc681f6-07e7-459d-a030-118b322a3ba2 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:00.896009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bdc681f6-07e7-459d-a030-118b322a3ba2 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:00.896965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bdc681f6-07e7-459d-a030-118b322a3ba2 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:00.938076 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8f8e60b7-8452-4bee-bbbd-03f6ecd74548 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/b62ae338-98ed-450b-91d0-c71ef958d32e" status: 200 len: 1458 microversion: 2.1 time: 0.107442 Jul 25 12:44:00.939847 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 729/1502] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:44:00 2022] GET /compute/v2.1/images/b62ae338-98ed-450b-91d0-c71ef958d32e => generated 1458 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:00.947521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d35da231-d145-48af-bace-fcb31b93b88e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:00.950086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d35da231-d145-48af-bace-fcb31b93b88e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: f7651c95-4705-42c3-8fc5-58644c0d8dc5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:00.960016 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d35da231-d145-48af-bace-fcb31b93b88e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:00.961047 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d35da231-d145-48af-bace-fcb31b93b88e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:00.962838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d35da231-d145-48af-bace-fcb31b93b88e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:00.963681 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d35da231-d145-48af-bace-fcb31b93b88e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:01.277543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d35da231-d145-48af-bace-fcb31b93b88e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:01.283378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:01.295597 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d35da231-d145-48af-bace-fcb31b93b88e tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5" status: 200 len: 1429 microversion: 2.1 time: 0.351808 Jul 25 12:44:01.297698 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 730/1503] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:00 2022] GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5 => generated 1429 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:01.318452 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a36ce57b-4afc-40da-b72f-dd7939b44be0 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcfa1928b0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:01.417504 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a36ce57b-4afc-40da-b72f-dd7939b44be0 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/b62ae338-98ed-450b-91d0-c71ef958d32e" status: 200 len: 1458 microversion: 2.1 time: 0.118316 Jul 25 12:44:01.418449 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 731/1504] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:44:01 2022] GET /compute/v2.1/images/b62ae338-98ed-450b-91d0-c71ef958d32e => generated 1458 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:01.423543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0a14ec76-f6d6-4d20-a5f6-463c440bd1d0 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:01.424170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0a14ec76-f6d6-4d20-a5f6-463c440bd1d0 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:01.444074 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a14ec76-f6d6-4d20-a5f6-463c440bd1d0 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:01.444476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a14ec76-f6d6-4d20-a5f6-463c440bd1d0 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:01.445403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a14ec76-f6d6-4d20-a5f6-463c440bd1d0 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:01.446252 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a14ec76-f6d6-4d20-a5f6-463c440bd1d0 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:01.640249 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0a14ec76-f6d6-4d20-a5f6-463c440bd1d0 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:01.649702 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0a14ec76-f6d6-4d20-a5f6-463c440bd1d0 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1272 microversion: 2.1 time: 0.230049 Jul 25 12:44:01.679523 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 732/1505] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:01 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1272 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:01.684750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3edb2813-b25e-4c84-9b51-c7f56eb5ece6 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:01.685404 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3edb2813-b25e-4c84-9b51-c7f56eb5ece6 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: 159b5add-9666-4a2a-82e7-7571a120cabb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:01.699602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3edb2813-b25e-4c84-9b51-c7f56eb5ece6 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:01.699970 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3edb2813-b25e-4c84-9b51-c7f56eb5ece6 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:01.700775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3edb2813-b25e-4c84-9b51-c7f56eb5ece6 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:01.701304 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3edb2813-b25e-4c84-9b51-c7f56eb5ece6 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:01.792131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-bdc681f6-07e7-459d-a030-118b322a3ba2 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lazy-loading 'services' on Instance uuid 8a21af85-54c8-424c-b815-3882ecf4a893 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:44:01.835988 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bdc681f6-07e7-459d-a030-118b322a3ba2 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1969 microversion: 2.25 time: 1.005762 Jul 25 12:44:01.847448 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 774/1506] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:00 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1969 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:02.053334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-2c0f2fc4-bf2e-415a-b96d-ca6e793bfc08 req-1b92b098-46e2-40c5-af88-2f8fb545ae08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7651c95-4705-42c3-8fc5-58644c0d8dc5", "name": "network-vif-deleted", "tag": "046ef6e8-f893-4e00-95e9-57298459c892"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:02.078976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-2c0f2fc4-bf2e-415a-b96d-ca6e793bfc08 req-1b92b098-46e2-40c5-af88-2f8fb545ae08 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:02.082214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-2c0f2fc4-bf2e-415a-b96d-ca6e793bfc08 req-1b92b098-46e2-40c5-af88-2f8fb545ae08 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:02.109073 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-2c0f2fc4-bf2e-415a-b96d-ca6e793bfc08 req-1b92b098-46e2-40c5-af88-2f8fb545ae08 service nova] Creating event network-vif-deleted:046ef6e8-f893-4e00-95e9-57298459c892 for instance f7651c95-4705-42c3-8fc5-58644c0d8dc5 on n-h2-848886-15 Jul 25 12:44:02.126161 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-2c0f2fc4-bf2e-415a-b96d-ca6e793bfc08 req-1b92b098-46e2-40c5-af88-2f8fb545ae08 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.276768 Jul 25 12:44:02.133867 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 775/1507] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:02.140542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ee5bcecb-c8ec-4f61-a104-e1abc5099c7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:02.141897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ee5bcecb-c8ec-4f61-a104-e1abc5099c7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:02.150757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee5bcecb-c8ec-4f61-a104-e1abc5099c7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:02.151497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee5bcecb-c8ec-4f61-a104-e1abc5099c7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:02.152534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee5bcecb-c8ec-4f61-a104-e1abc5099c7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:02.153131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee5bcecb-c8ec-4f61-a104-e1abc5099c7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:02.204283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee5bcecb-c8ec-4f61-a104-e1abc5099c7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:02.205719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee5bcecb-c8ec-4f61-a104-e1abc5099c7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:02.206421 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-ee5bcecb-c8ec-4f61-a104-e1abc5099c7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lazy-loading 'fault' on Instance uuid e7baf920-9e9f-472e-b57b-e6ed9f05daee {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:44:02.375297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3edb2813-b25e-4c84-9b51-c7f56eb5ece6 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:02.391202 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3edb2813-b25e-4c84-9b51-c7f56eb5ece6 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/159b5add-9666-4a2a-82e7-7571a120cabb" status: 200 len: 1467 microversion: 2.1 time: 0.723582 Jul 25 12:44:02.399160 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 733/1508] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:01 2022] GET /compute/v2.1/servers/159b5add-9666-4a2a-82e7-7571a120cabb => generated 1467 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:02.408561 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-8a392e10-6411-4aa0-ba89-646d68b19f97 req-86100879-19c6-4129-b030-9c6bbca9cd2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7baf920-9e9f-472e-b57b-e6ed9f05daee", "name": "network-vif-deleted", "tag": "b2e68ed8-3347-4769-ad93-207689dae18a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:02.441674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-8a392e10-6411-4aa0-ba89-646d68b19f97 req-86100879-19c6-4129-b030-9c6bbca9cd2a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:02.442538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-8a392e10-6411-4aa0-ba89-646d68b19f97 req-86100879-19c6-4129-b030-9c6bbca9cd2a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:02.445572 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ee5bcecb-c8ec-4f61-a104-e1abc5099c7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f799c73ceb4c189329bc86056bc048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c0dc3e0d894a5a95b1628cbd20df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:02.470090 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-8a392e10-6411-4aa0-ba89-646d68b19f97 req-86100879-19c6-4129-b030-9c6bbca9cd2a service nova] Creating event network-vif-deleted:b2e68ed8-3347-4769-ad93-207689dae18a for instance e7baf920-9e9f-472e-b57b-e6ed9f05daee on n-h2-848886-15 Jul 25 12:44:02.480449 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-8a392e10-6411-4aa0-ba89-646d68b19f97 req-86100879-19c6-4129-b030-9c6bbca9cd2a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077259 Jul 25 12:44:02.486724 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 734/1509] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:02.493284 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ee5bcecb-c8ec-4f61-a104-e1abc5099c7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 200 len: 1298 microversion: 2.1 time: 0.357289 Jul 25 12:44:02.494563 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 776/1510] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:02 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 1298 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:02.497789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9ab3f2de-aa6f-40cf-9478-17e09c71f586 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:02.501117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9ab3f2de-aa6f-40cf-9478-17e09c71f586 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:02.514154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2d36cb0b-e775-4d59-a2d7-0257146bb5f8 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:02.515083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2d36cb0b-e775-4d59-a2d7-0257146bb5f8 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 965438e3-72fa-44e0-90fa-4fb0b24042ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:02.521056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ab3f2de-aa6f-40cf-9478-17e09c71f586 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:02.521517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ab3f2de-aa6f-40cf-9478-17e09c71f586 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:02.530768 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ab3f2de-aa6f-40cf-9478-17e09c71f586 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:02.531325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ab3f2de-aa6f-40cf-9478-17e09c71f586 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:02.533013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d36cb0b-e775-4d59-a2d7-0257146bb5f8 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:02.533872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d36cb0b-e775-4d59-a2d7-0257146bb5f8 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:02.535210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d36cb0b-e775-4d59-a2d7-0257146bb5f8 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:02.536854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d36cb0b-e775-4d59-a2d7-0257146bb5f8 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:03.112643 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9ab3f2de-aa6f-40cf-9478-17e09c71f586 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:03.142395 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9ab3f2de-aa6f-40cf-9478-17e09c71f586 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1470 microversion: 2.1 time: 0.653239 Jul 25 12:44:03.144501 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 735/1511] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:02 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1470 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:03.154270 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c5e01047-81d6-4d9d-9b4f-925892d2a702 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:03.160153 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:44:03.160153 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:44:03.165600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5e01047-81d6-4d9d-9b4f-925892d2a702 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:03.173108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2d36cb0b-e775-4d59-a2d7-0257146bb5f8 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:03.181766 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2d36cb0b-e775-4d59-a2d7-0257146bb5f8 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff" status: 200 len: 1313 microversion: 2.1 time: 0.685862 Jul 25 12:44:03.182724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5e01047-81d6-4d9d-9b4f-925892d2a702 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:03.183830 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5e01047-81d6-4d9d-9b4f-925892d2a702 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:03.184614 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 777/1512] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:02 2022] GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff => generated 1313 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:03.185450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5e01047-81d6-4d9d-9b4f-925892d2a702 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:03.190444 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3a531af4-9a72-4fee-9373-be70e3c8a424 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:03.206590 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3a531af4-9a72-4fee-9373-be70e3c8a424 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: f7651c95-4705-42c3-8fc5-58644c0d8dc5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:03.223820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a531af4-9a72-4fee-9373-be70e3c8a424 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:03.230782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a531af4-9a72-4fee-9373-be70e3c8a424 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:03.234134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a531af4-9a72-4fee-9373-be70e3c8a424 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:03.234832 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a531af4-9a72-4fee-9373-be70e3c8a424 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:03.282797 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c5e01047-81d6-4d9d-9b4f-925892d2a702 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.135298 Jul 25 12:44:03.285015 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 736/1513] 10.222.0.49 () {60 vars in 1217 bytes} [Mon Jul 25 12:44:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:44:03.287613 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-3a531af4-9a72-4fee-9373-be70e3c8a424 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] HTTP exception thrown: Instance f7651c95-4705-42c3-8fc5-58644c0d8dc5 could not be found. Jul 25 12:44:03.292202 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3a531af4-9a72-4fee-9373-be70e3c8a424 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Request method failure captured: Jul 25 12:44:03.292202 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5 HTTP/1.1 Jul 25 12:44:03.292202 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:44:03.292202 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:44:03.292202 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:44:03.292202 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:44:03.292202 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:44:03.292202 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:44:03.292202 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:44:03.292202 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:03.292202 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o9FI8xGtqP7_CW35BbEF7ISywkY3QBKklr5o1CS_fq6Lx6g68HVW9d3S-CvFf3EFHQ-I9augL8LNHoHSZQ7fotgZGp7jb0rcywXJ-uNBD0-jX_Y0mC9RxTzXhF95_ckH46T5WFeX6UZGziPb5X1dUcODvmDxxrVOVDn9AvlAmcUOhI Jul 25 12:44:03.292202 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:44:03.292202 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:44:03.292202 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:44:03.292202 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:44:03.292202 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:44:03.292202 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:44:03.292202 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5c81a97dfca44bf6af64fdcd5d50c549 Jul 25 12:44:03.292202 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:44:03.292202 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:44:03.292202 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:44:03.294063 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5c81a97dfca44bf6af64fdcd5d50c549", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5c81a97dfca44bf6af64fdcd5d50c549"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c81a97dfca44bf6af64fdcd5d50c549"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c81a97dfca44bf6af64fdcd5d50c549"}]}] Jul 25 12:44:03.294063 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:44:03.294063 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5c81a97dfca44bf6af64fdcd5d50c549 Jul 25 12:44:03.294063 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:44:03.294063 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersOnMultiNodesTest-1957362714-project Jul 25 12:44:03.294063 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:44:03.294063 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:44:03.294063 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 8c296447c2254c048f94bd9f186b0097 Jul 25 12:44:03.294063 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersOnMultiNodesTest-1957362714-project Jul 25 12:44:03.294063 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:44:03.294063 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance f7651c95-4705-42c3-8fc5-58644c0d8dc5 could not be found. Jul 25 12:44:03.294063 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'f7651c95-4705-42c3-8fc5-58644c0d8dc5'} Jul 25 12:44:03.295029 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:03.295029 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:03.295029 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:44:03.295029 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:44:03.295029 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:44:03.295029 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:44:03.295029 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:44:03.295029 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:44:03.295029 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:44:03.295029 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:44:03.295029 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7651c95-4705-42c3-8fc5-58644c0d8dc5 could not be found. Jul 25 12:44:03.295029 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:03.295029 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:03.295029 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:03.295029 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:03.295029 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:03.295029 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:03.295029 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:03.295029 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:03.295029 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:03.296618 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:03.296618 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:44:03.296618 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:44:03.296618 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:44:03.296618 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:44:03.296618 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:44:03.296618 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:44:03.296618 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7651c95-4705-42c3-8fc5-58644c0d8dc5 could not be found. Jul 25 12:44:03.296618 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:03.296618 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:03.296618 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:03.296618 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:03.296618 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:03.296618 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:03.296618 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:03.296618 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:03.296618 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7651c95-4705-42c3-8fc5-58644c0d8dc5 could not be found. Jul 25 12:44:03.296618 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:03.300117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3a531af4-9a72-4fee-9373-be70e3c8a424 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Returning 404 to user: Instance f7651c95-4705-42c3-8fc5-58644c0d8dc5 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:03.301021 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3a531af4-9a72-4fee-9373-be70e3c8a424 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5" status: 404 len: 111 microversion: 2.1 time: 0.114398 Jul 25 12:44:03.310787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cf243f92-5380-404d-8985-c41cbd3e432a tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcfed743a0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:03.312907 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 778/1514] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:03 2022] GET /compute/v2.1/servers/f7651c95-4705-42c3-8fc5-58644c0d8dc5 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:44:03.322242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e8ba8a14-9d79-4a6b-b75c-0ea9c471946e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:03.322877 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e8ba8a14-9d79-4a6b-b75c-0ea9c471946e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:03.347909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8ba8a14-9d79-4a6b-b75c-0ea9c471946e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:03.348364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8ba8a14-9d79-4a6b-b75c-0ea9c471946e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:03.349121 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8ba8a14-9d79-4a6b-b75c-0ea9c471946e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:03.349553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8ba8a14-9d79-4a6b-b75c-0ea9c471946e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:03.495830 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cf243f92-5380-404d-8985-c41cbd3e432a tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images?changes-since=2022-07-25T12%3A42%3A19Z" status: 200 len: 1900 microversion: 2.1 time: 0.209096 Jul 25 12:44:03.509135 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 737/1515] 10.222.0.49 () {58 vars in 1199 bytes} [Mon Jul 25 12:44:03 2022] GET /compute/v2.1/images?changes-since=2022-07-25T12%3A42%3A19Z => generated 1900 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:03.516639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-95ee4c90-3701-449c-ae20-125cc032c88d req-7b1ca2d7-12e7-4cad-a680-811f9a11badb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159b5add-9666-4a2a-82e7-7571a120cabb", "name": "network-vif-unplugged", "status": "completed", "tag": "27e87312-289e-4818-b884-b357c21f7a9f"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:03.535157 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-95ee4c90-3701-449c-ae20-125cc032c88d req-7b1ca2d7-12e7-4cad-a680-811f9a11badb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:03.535869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-95ee4c90-3701-449c-ae20-125cc032c88d req-7b1ca2d7-12e7-4cad-a680-811f9a11badb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:03.549354 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-95ee4c90-3701-449c-ae20-125cc032c88d req-7b1ca2d7-12e7-4cad-a680-811f9a11badb service nova] Creating event network-vif-unplugged:27e87312-289e-4818-b884-b357c21f7a9f for instance 159b5add-9666-4a2a-82e7-7571a120cabb on n-h2-848886-15 Jul 25 12:44:03.555658 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-95ee4c90-3701-449c-ae20-125cc032c88d req-7b1ca2d7-12e7-4cad-a680-811f9a11badb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044613 Jul 25 12:44:03.561514 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 738/1516] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:03.569695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-521d448c-7d89-40f7-a85f-9103bfa74896 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-848886-15", "block_migration": "auto"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:03.574704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-521d448c-7d89-40f7-a85f-9103bfa74896 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:03.587603 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-521d448c-7d89-40f7-a85f-9103bfa74896 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:03.588331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-521d448c-7d89-40f7-a85f-9103bfa74896 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:03.589808 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-521d448c-7d89-40f7-a85f-9103bfa74896 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:03.590819 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-521d448c-7d89-40f7-a85f-9103bfa74896 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:03.624334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-521d448c-7d89-40f7-a85f-9103bfa74896 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lazy-loading 'flavor' on Instance uuid 8a21af85-54c8-424c-b815-3882ecf4a893 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:44:03.643064 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-521d448c-7d89-40f7-a85f-9103bfa74896 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Going to try to live migrate instance to n-h2-848886-15 {{(pid=125883) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 12:44:03.999188 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e8ba8a14-9d79-4a6b-b75c-0ea9c471946e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:04.009950 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e8ba8a14-9d79-4a6b-b75c-0ea9c471946e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1314 microversion: 2.1 time: 0.693623 Jul 25 12:44:04.011954 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 779/1517] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:03 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1314 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:04.026911 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8e64af82-8679-41be-b8db-0fa55cb91061 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:04.027771 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8e64af82-8679-41be-b8db-0fa55cb91061 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: dd308860-1e7f-4257-b285-3d2d3054d4ef] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:04.041483 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e64af82-8679-41be-b8db-0fa55cb91061 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:04.043784 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e64af82-8679-41be-b8db-0fa55cb91061 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:04.047279 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e64af82-8679-41be-b8db-0fa55cb91061 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:04.048046 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e64af82-8679-41be-b8db-0fa55cb91061 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:04.118011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8e64af82-8679-41be-b8db-0fa55cb91061 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: dd308860-1e7f-4257-b285-3d2d3054d4ef] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:44:04.384639 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8e64af82-8679-41be-b8db-0fa55cb91061 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dd308860-1e7f-4257-b285-3d2d3054d4ef" status: 204 len: 0 microversion: 2.1 time: 0.367231 Jul 25 12:44:04.386710 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 780/1518] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:44:04 2022] DELETE /compute/v2.1/servers/dd308860-1e7f-4257-b285-3d2d3054d4ef => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:04.397691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ef476001-0007-4204-98c9-a83c64c98681 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9b4cca0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:04.538214 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ef476001-0007-4204-98c9-a83c64c98681 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-894235844" status: 200 len: 484 microversion: 2.1 time: 0.149727 Jul 25 12:44:04.539303 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 781/1519] 10.222.0.49 () {58 vars in 1229 bytes} [Mon Jul 25 12:44:04 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-894235844 => generated 484 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:04.544808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3e79e693-f71f-4f9a-9ac5-3c0e5c6aa6b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:04.545718 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3e79e693-f71f-4f9a-9ac5-3c0e5c6aa6b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: e7baf920-9e9f-472e-b57b-e6ed9f05daee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:04.548084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:04.558534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e79e693-f71f-4f9a-9ac5-3c0e5c6aa6b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:04.559296 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e79e693-f71f-4f9a-9ac5-3c0e5c6aa6b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:04.560359 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e79e693-f71f-4f9a-9ac5-3c0e5c6aa6b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:04.561273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e79e693-f71f-4f9a-9ac5-3c0e5c6aa6b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:04.598174 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-3e79e693-f71f-4f9a-9ac5-3c0e5c6aa6b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] HTTP exception thrown: Instance e7baf920-9e9f-472e-b57b-e6ed9f05daee could not be found. Jul 25 12:44:04.600145 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3e79e693-f71f-4f9a-9ac5-3c0e5c6aa6b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Request method failure captured: Jul 25 12:44:04.600145 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee HTTP/1.1 Jul 25 12:44:04.600145 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:44:04.600145 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:44:04.600145 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:44:04.600145 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:44:04.600145 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:44:04.600145 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:44:04.600145 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:44:04.600145 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:04.600145 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o8ooEvqjYaWjOGZnMs8tQpLLBhsAjkHwJkOVRpGlGZwu0wvKMkpNJnI6LZOFAyrSiJCS7QVibWBeuqRdRi4gUJ9NsSc1cd56Q9jsPyD-2qGdsZPXQyCOvO9G7fHO9bE1ZV48K1Uls75dq-yU_Qym4X7e94zqNZG0QEWXhF2DClBQCk Jul 25 12:44:04.600145 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:44:04.600145 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:44:04.600145 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:44:04.600145 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:44:04.600145 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:44:04.600145 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:44:04.600145 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:44:04.600145 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:44:04.600145 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:44:04.600145 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:44:04.601556 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85c0dc3e0d894a5a95b1628cbd20df9f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}] Jul 25 12:44:04.601556 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesTestJSON-796718257 Jul 25 12:44:04.601556 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:44:04.601556 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:44:04.601556 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesTestJSON-796718257-project Jul 25 12:44:04.601556 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:44:04.601556 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:44:04.601556 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 53f799c73ceb4c189329bc86056bc048 Jul 25 12:44:04.601556 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesTestJSON-796718257-project Jul 25 12:44:04.601556 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:44:04.601556 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance e7baf920-9e9f-472e-b57b-e6ed9f05daee could not be found. Jul 25 12:44:04.601556 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'e7baf920-9e9f-472e-b57b-e6ed9f05daee'} Jul 25 12:44:04.601556 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:04.602572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:04.602572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:44:04.602572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:44:04.602572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:44:04.602572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:44:04.602572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:44:04.602572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:44:04.602572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:44:04.602572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:44:04.602572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7baf920-9e9f-472e-b57b-e6ed9f05daee could not be found. Jul 25 12:44:04.602572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:04.602572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:04.602572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:04.602572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:04.602572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:04.602572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:04.602572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:04.602572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:04.602572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:04.602572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:04.605072 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:44:04.605072 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:44:04.605072 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:44:04.605072 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:44:04.605072 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:44:04.605072 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:44:04.605072 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7baf920-9e9f-472e-b57b-e6ed9f05daee could not be found. Jul 25 12:44:04.605072 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:04.605072 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:04.605072 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:04.605072 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:04.605072 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:04.605072 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:04.605072 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:04.605072 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:04.605072 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7baf920-9e9f-472e-b57b-e6ed9f05daee could not be found. Jul 25 12:44:04.605072 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:04.607340 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3e79e693-f71f-4f9a-9ac5-3c0e5c6aa6b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Returning 404 to user: Instance e7baf920-9e9f-472e-b57b-e6ed9f05daee could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:04.607340 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3e79e693-f71f-4f9a-9ac5-3c0e5c6aa6b3 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee" status: 404 len: 111 microversion: 2.1 time: 0.064372 Jul 25 12:44:04.609069 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 782/1520] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:04 2022] GET /compute/v2.1/servers/e7baf920-9e9f-472e-b57b-e6ed9f05daee => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:44:04.615412 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a26761da-4060-4b6f-87e7-8a3944441be9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:04.616037 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a26761da-4060-4b6f-87e7-8a3944441be9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:04.634911 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a26761da-4060-4b6f-87e7-8a3944441be9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:04.635375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a26761da-4060-4b6f-87e7-8a3944441be9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:04.636184 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a26761da-4060-4b6f-87e7-8a3944441be9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:04.636605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a26761da-4060-4b6f-87e7-8a3944441be9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:04.690838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:04.847739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a26761da-4060-4b6f-87e7-8a3944441be9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:04.860203 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a26761da-4060-4b6f-87e7-8a3944441be9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1470 microversion: 2.1 time: 0.250078 Jul 25 12:44:04.861124 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 783/1521] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:04 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1470 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:04.866379 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-fe764c48-f6d6-4da4-b281-029f8b1be495 req-b57146ec-4f99-4981-b75b-3a9ddab53b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb5975b-24da-4318-90ce-bd3b7d0d01f2", "name": "network-vif-unplugged", "status": "completed", "tag": "0012b1f8-03b2-4861-88f2-461bdd29f4d1"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:04.880277 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fe764c48-f6d6-4da4-b281-029f8b1be495 req-b57146ec-4f99-4981-b75b-3a9ddab53b7c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:04.880733 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fe764c48-f6d6-4da4-b281-029f8b1be495 req-b57146ec-4f99-4981-b75b-3a9ddab53b7c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:04.894394 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-fe764c48-f6d6-4da4-b281-029f8b1be495 req-b57146ec-4f99-4981-b75b-3a9ddab53b7c service nova] Creating event network-vif-unplugged:0012b1f8-03b2-4861-88f2-461bdd29f4d1 for instance 7eb5975b-24da-4318-90ce-bd3b7d0d01f2 on n-h2-848886-15 Jul 25 12:44:04.901388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [req-fe764c48-f6d6-4da4-b281-029f8b1be495 req-b57146ec-4f99-4981-b75b-3a9ddab53b7c service nova] Instance 7eb5975b-24da-4318-90ce-bd3b7d0d01f2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 12:44:04.912621 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-fe764c48-f6d6-4da4-b281-029f8b1be495 req-b57146ec-4f99-4981-b75b-3a9ddab53b7c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050108 Jul 25 12:44:04.913365 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 784/1522] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:04.920799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-32070401-7af7-48a7-a48c-a376f3865715 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:04.921601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-32070401-7af7-48a7-a48c-a376f3865715 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 965438e3-72fa-44e0-90fa-4fb0b24042ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:04.928161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32070401-7af7-48a7-a48c-a376f3865715 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:04.928620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32070401-7af7-48a7-a48c-a376f3865715 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:04.929406 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32070401-7af7-48a7-a48c-a376f3865715 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:04.930006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32070401-7af7-48a7-a48c-a376f3865715 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:05.069256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-32070401-7af7-48a7-a48c-a376f3865715 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:05.078424 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-32070401-7af7-48a7-a48c-a376f3865715 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff" status: 200 len: 1313 microversion: 2.1 time: 0.162999 Jul 25 12:44:05.079336 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 785/1523] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:04 2022] GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:05.084541 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e58ec001-2e38-49ba-b554-f5103d65ff28 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:05.085235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e58ec001-2e38-49ba-b554-f5103d65ff28 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 10a61568-b301-4b9e-82f9-160490f071d7] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:05.093259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e58ec001-2e38-49ba-b554-f5103d65ff28 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:05.094296 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e58ec001-2e38-49ba-b554-f5103d65ff28 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:05.095765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e58ec001-2e38-49ba-b554-f5103d65ff28 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:05.096381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e58ec001-2e38-49ba-b554-f5103d65ff28 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:05.127463 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e58ec001-2e38-49ba-b554-f5103d65ff28 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 10a61568-b301-4b9e-82f9-160490f071d7] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:44:05.180041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:05.226902 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e58ec001-2e38-49ba-b554-f5103d65ff28 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "DELETE /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7" status: 204 len: 0 microversion: 2.1 time: 0.145444 Jul 25 12:44:05.229928 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 786/1524] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:44:05 2022] DELETE /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:05.237173 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b549a10c-056e-48df-810d-9e3c6f90865e tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9b66c10>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:05.331475 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b549a10c-056e-48df-810d-9e3c6f90865e tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images?server=159b5add-9666-4a2a-82e7-7571a120cabb" status: 200 len: 956 microversion: 2.1 time: 0.099650 Jul 25 12:44:05.332068 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 787/1525] 10.222.0.49 () {58 vars in 1209 bytes} [Mon Jul 25 12:44:05 2022] GET /compute/v2.1/images?server=159b5add-9666-4a2a-82e7-7571a120cabb => generated 956 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:05.336643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-11e16367-4072-43a4-964b-f6b1d9e03d23 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9cc6f70>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:05.359154 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-11e16367-4072-43a4-964b-f6b1d9e03d23 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] HTTP exception thrown: Image not found. Jul 25 12:44:05.361241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-11e16367-4072-43a4-964b-f6b1d9e03d23 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Request method failure captured: Jul 25 12:44:05.361241 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c HTTP/1.1 Jul 25 12:44:05.361241 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:44:05.361241 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:44:05.361241 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:44:05.361241 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:44:05.361241 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:44:05.361241 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:44:05.361241 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:44:05.361241 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:05.361241 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o8ooEvqjYaWjOGZnMs8tQpLLBhsAjkHwJkOVRpGlGZwu0wvKMkpNJnI6LZOFAyrSiJCS7QVibWBeuqRdRi4gUJ9NsSc1cd56Q9jsPyD-2qGdsZPXQyCOvO9G7fHO9bE1ZV48K1Uls75dq-yU_Qym4X7e94zqNZG0QEWXhF2DClBQCk Jul 25 12:44:05.361241 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:44:05.361241 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:44:05.361241 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:44:05.361241 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:44:05.361241 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:44:05.361241 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:44:05.361241 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:44:05.361241 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:44:05.361241 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:44:05.361241 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:44:05.363058 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85c0dc3e0d894a5a95b1628cbd20df9f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}] Jul 25 12:44:05.363058 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesTestJSON-796718257 Jul 25 12:44:05.363058 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:44:05.363058 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:44:05.363058 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesTestJSON-796718257-project Jul 25 12:44:05.363058 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:44:05.363058 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:44:05.363058 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 53f799c73ceb4c189329bc86056bc048 Jul 25 12:44:05.363058 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesTestJSON-796718257-project Jul 25 12:44:05.363058 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:44:05.363058 n-d-848886-15 devstack@n-api.service[125884]: exception: Image not found. Jul 25 12:44:05.363058 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'e766f513-fe8c-415a-add4-b46a9c09351c'} Jul 25 12:44:05.363058 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:05.363058 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:05.367407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 12:44:05.367407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 12:44:05.367407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:44:05.367407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:44:05.367407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:44:05.367407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:44:05.367407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 12:44:05.367407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 12:44:05.367407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 12:44:05.367407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 12:44:05.367407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:44:05.367407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:44:05.367407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:44:05.367407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:44:05.367407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e766f513-fe8c-415a-add4-b46a9c09351c to delete Jul 25 12:44:05.367407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:05.367407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:05.367407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:05.367407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:05.368835 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 12:44:05.368835 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 12:44:05.368835 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 12:44:05.368835 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 12:44:05.368835 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 12:44:05.368835 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 12:44:05.368835 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e766f513-fe8c-415a-add4-b46a9c09351c could not be found. Jul 25 12:44:05.368835 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:05.368835 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:05.368835 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:05.368835 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:05.368835 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:05.368835 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:05.368835 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:05.368835 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:05.368835 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:44:05.368835 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:44:05.368835 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:05.368835 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:05.368835 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 12:44:05.370491 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 12:44:05.370491 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 12:44:05.370491 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:05.370491 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:05.370491 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:05.370491 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:05.370491 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:05.370491 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:05.370491 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:05.370491 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:05.370491 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 12:44:05.370491 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:05.370491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-11e16367-4072-43a4-964b-f6b1d9e03d23 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Returning 404 to user: Image not found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:05.370491 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-11e16367-4072-43a4-964b-f6b1d9e03d23 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "DELETE /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c" status: 404 len: 62 microversion: 2.1 time: 0.029915 Jul 25 12:44:05.370491 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 788/1526] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:05 2022] DELETE /compute/v2.1/images/e766f513-fe8c-415a-add4-b46a9c09351c => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:44:05.382498 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bc1ff76f-e7c5-4cbf-9511-462a85315841 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-538324206", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "2f06aa7d-4566-4383-a6d0-5dee93546175"}], "block_device_mapping_v2": [{"uuid": "b3d0e8e0-8d06-493a-b6a7-1431ded51b1e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:05.459812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-bc1ff76f-e7c5-4cbf-9511-462a85315841 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] validate_networks() for [('2f06aa7d-4566-4383-a6d0-5dee93546175', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:44:06.091929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:06.293297 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bc1ff76f-e7c5-4cbf-9511-462a85315841 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:44:06.293714 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bc1ff76f-e7c5-4cbf-9511-462a85315841 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:44:06.294490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bc1ff76f-e7c5-4cbf-9511-462a85315841 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:44:06.295090 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bc1ff76f-e7c5-4cbf-9511-462a85315841 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:44:06.295510 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bc1ff76f-e7c5-4cbf-9511-462a85315841 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:44:06.304846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc1ff76f-e7c5-4cbf-9511-462a85315841 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:06.305581 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc1ff76f-e7c5-4cbf-9511-462a85315841 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:06.306471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc1ff76f-e7c5-4cbf-9511-462a85315841 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:06.306953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc1ff76f-e7c5-4cbf-9511-462a85315841 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:06.327522 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-bc1ff76f-e7c5-4cbf-9511-462a85315841 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Getting quotas for project 4946a18b68e146278158ac991143a243. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:44:06.333517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-bc1ff76f-e7c5-4cbf-9511-462a85315841 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Getting quotas for user a02530d4c6384518b3f45515208e83d8 and project 4946a18b68e146278158ac991143a243. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:44:06.401019 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bc1ff76f-e7c5-4cbf-9511-462a85315841 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:44:06.403383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bc1ff76f-e7c5-4cbf-9511-462a85315841 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b3d0e8e0-8d06-493a-b6a7-1431ded51b1e',volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:44:06.533901 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bc1ff76f-e7c5-4cbf-9511-462a85315841 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.168683 Jul 25 12:44:06.540376 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 789/1527] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:44:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:44:06.540376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-98b98829-dbf2-49e7-9c1b-1b9ead2cfe4f req-f30959ba-657e-4864-a2ac-a23129ac416b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e4075b4-1c73-4c86-b399-5aa825cc41cd", "tag": "b2e864ef-d364-4d7a-8b71-3339a78ee52f"}, {"name": "network-changed", "server_uuid": "965438e3-72fa-44e0-90fa-4fb0b24042ff", "tag": "22eacc86-1f73-4a81-89fe-aee538508ec8"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:06.563723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-98b98829-dbf2-49e7-9c1b-1b9ead2cfe4f req-f30959ba-657e-4864-a2ac-a23129ac416b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:06.564639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-98b98829-dbf2-49e7-9c1b-1b9ead2cfe4f req-f30959ba-657e-4864-a2ac-a23129ac416b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:06.578203 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-98b98829-dbf2-49e7-9c1b-1b9ead2cfe4f req-f30959ba-657e-4864-a2ac-a23129ac416b service nova] Creating event network-changed:b2e864ef-d364-4d7a-8b71-3339a78ee52f for instance 7e4075b4-1c73-4c86-b399-5aa825cc41cd on n-h2-848886-15 Jul 25 12:44:06.578711 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-98b98829-dbf2-49e7-9c1b-1b9ead2cfe4f req-f30959ba-657e-4864-a2ac-a23129ac416b service nova] Creating event network-changed:22eacc86-1f73-4a81-89fe-aee538508ec8 for instance 965438e3-72fa-44e0-90fa-4fb0b24042ff on n-h1-848886-15 Jul 25 12:44:06.586948 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-98b98829-dbf2-49e7-9c1b-1b9ead2cfe4f req-f30959ba-657e-4864-a2ac-a23129ac416b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.050905 Jul 25 12:44:06.587880 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 790/1528] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:06.593121 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-37aeec90-b114-4139-b8da-a647e161a5e5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:06.593982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-37aeec90-b114-4139-b8da-a647e161a5e5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:06.600570 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-37aeec90-b114-4139-b8da-a647e161a5e5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:06.601016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-37aeec90-b114-4139-b8da-a647e161a5e5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:06.601864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-37aeec90-b114-4139-b8da-a647e161a5e5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:06.602638 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-37aeec90-b114-4139-b8da-a647e161a5e5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:06.747417 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-37aeec90-b114-4139-b8da-a647e161a5e5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:06.759209 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-37aeec90-b114-4139-b8da-a647e161a5e5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1314 microversion: 2.1 time: 0.170126 Jul 25 12:44:06.759806 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 791/1529] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:06 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:06.764470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1675aa67-fc01-4a6f-a00d-f5635cd8bf11 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:06.765103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1675aa67-fc01-4a6f-a00d-f5635cd8bf11 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: dd308860-1e7f-4257-b285-3d2d3054d4ef] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:06.771237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1675aa67-fc01-4a6f-a00d-f5635cd8bf11 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:06.771681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1675aa67-fc01-4a6f-a00d-f5635cd8bf11 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:06.772650 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1675aa67-fc01-4a6f-a00d-f5635cd8bf11 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:06.773161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1675aa67-fc01-4a6f-a00d-f5635cd8bf11 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:06.836470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1675aa67-fc01-4a6f-a00d-f5635cd8bf11 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:06.844325 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1675aa67-fc01-4a6f-a00d-f5635cd8bf11 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/dd308860-1e7f-4257-b285-3d2d3054d4ef" status: 200 len: 1432 microversion: 2.1 time: 0.083533 Jul 25 12:44:06.844899 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 792/1530] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:06 2022] GET /compute/v2.1/servers/dd308860-1e7f-4257-b285-3d2d3054d4ef => generated 1432 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:06.849333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-67761fd6-580c-456d-8c6f-35358274605e tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9bde430>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:06.940373 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-67761fd6-580c-456d-8c6f-35358274605e tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fv2.1%2Fservers%2Ff2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 484 microversion: 2.1 time: 0.094411 Jul 25 12:44:06.940958 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 793/1531] 10.222.0.49 () {58 vars in 1317 bytes} [Mon Jul 25 12:44:06 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fv2.1%2Fservers%2Ff2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 484 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:06.945705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-390b0dfb-1e41-4c48-a779-b0d15a70bb14 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:06.946244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-390b0dfb-1e41-4c48-a779-b0d15a70bb14 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c9c04c11-ce42-44b4-a6fd-7f7658a05292] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:06.953025 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-390b0dfb-1e41-4c48-a779-b0d15a70bb14 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:06.953486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-390b0dfb-1e41-4c48-a779-b0d15a70bb14 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:06.954318 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-390b0dfb-1e41-4c48-a779-b0d15a70bb14 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:06.954761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-390b0dfb-1e41-4c48-a779-b0d15a70bb14 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:06.968845 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-390b0dfb-1e41-4c48-a779-b0d15a70bb14 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] HTTP exception thrown: Instance c9c04c11-ce42-44b4-a6fd-7f7658a05292 could not be found. Jul 25 12:44:06.970602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-390b0dfb-1e41-4c48-a779-b0d15a70bb14 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Request method failure captured: Jul 25 12:44:06.970602 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292 HTTP/1.1 Jul 25 12:44:06.970602 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:44:06.970602 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:44:06.970602 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:44:06.970602 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:44:06.970602 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:44:06.970602 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:44:06.970602 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:44:06.970602 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:06.970602 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o8ooEvqjYaWjOGZnMs8tQpLLBhsAjkHwJkOVRpGlGZwu0wvKMkpNJnI6LZOFAyrSiJCS7QVibWBeuqRdRi4gUJ9NsSc1cd56Q9jsPyD-2qGdsZPXQyCOvO9G7fHO9bE1ZV48K1Uls75dq-yU_Qym4X7e94zqNZG0QEWXhF2DClBQCk Jul 25 12:44:06.970602 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:44:06.970602 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:44:06.970602 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:44:06.970602 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:44:06.970602 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:44:06.970602 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:44:06.970602 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:44:06.970602 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:44:06.970602 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:44:06.970602 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:44:06.972257 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85c0dc3e0d894a5a95b1628cbd20df9f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}] Jul 25 12:44:06.972257 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesTestJSON-796718257 Jul 25 12:44:06.972257 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:44:06.972257 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:44:06.972257 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesTestJSON-796718257-project Jul 25 12:44:06.972257 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:44:06.972257 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:44:06.972257 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 53f799c73ceb4c189329bc86056bc048 Jul 25 12:44:06.972257 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesTestJSON-796718257-project Jul 25 12:44:06.972257 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:44:06.972257 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance c9c04c11-ce42-44b4-a6fd-7f7658a05292 could not be found. Jul 25 12:44:06.972257 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'c9c04c11-ce42-44b4-a6fd-7f7658a05292'} Jul 25 12:44:06.972257 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:06.973301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:06.973301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:44:06.973301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:44:06.973301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:44:06.973301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:44:06.973301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:44:06.973301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:44:06.973301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:44:06.973301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:44:06.973301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9c04c11-ce42-44b4-a6fd-7f7658a05292 could not be found. Jul 25 12:44:06.973301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:06.973301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:06.973301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:06.973301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:06.973301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:06.973301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:06.973301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:06.973301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:06.973301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:06.973301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:06.974977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:44:06.974977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:44:06.974977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:44:06.974977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:44:06.974977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:44:06.974977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:44:06.974977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:44:06.974977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:44:06.974977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9c04c11-ce42-44b4-a6fd-7f7658a05292 could not be found. Jul 25 12:44:06.974977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:06.974977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:06.974977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:06.974977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:06.974977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:06.974977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:06.974977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:06.974977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:06.974977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9c04c11-ce42-44b4-a6fd-7f7658a05292 could not be found. Jul 25 12:44:06.974977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:06.976392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-390b0dfb-1e41-4c48-a779-b0d15a70bb14 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Returning 404 to user: Instance c9c04c11-ce42-44b4-a6fd-7f7658a05292 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:06.976392 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-390b0dfb-1e41-4c48-a779-b0d15a70bb14 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292" status: 404 len: 111 microversion: 2.1 time: 0.030147 Jul 25 12:44:06.976392 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 794/1532] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:44:06 2022] DELETE /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:44:06.977318 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-94426b37-8589-48cc-8319-b9996adf06e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:06.977966 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-94426b37-8589-48cc-8319-b9996adf06e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:06.984022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94426b37-8589-48cc-8319-b9996adf06e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:06.984515 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94426b37-8589-48cc-8319-b9996adf06e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:06.985294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94426b37-8589-48cc-8319-b9996adf06e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:06.985736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94426b37-8589-48cc-8319-b9996adf06e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:07.269811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-94426b37-8589-48cc-8319-b9996adf06e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:07.278263 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-94426b37-8589-48cc-8319-b9996adf06e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1470 microversion: 2.1 time: 0.304690 Jul 25 12:44:07.278863 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 795/1533] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:06 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1470 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:07.283480 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e40bf935-d0db-4649-8af9-01e700070745 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:07.284085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e40bf935-d0db-4649-8af9-01e700070745 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 965438e3-72fa-44e0-90fa-4fb0b24042ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:07.290753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e40bf935-d0db-4649-8af9-01e700070745 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:07.291179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e40bf935-d0db-4649-8af9-01e700070745 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:07.291952 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e40bf935-d0db-4649-8af9-01e700070745 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:07.292386 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e40bf935-d0db-4649-8af9-01e700070745 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:07.434128 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e40bf935-d0db-4649-8af9-01e700070745 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:07.441972 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e40bf935-d0db-4649-8af9-01e700070745 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff" status: 200 len: 1313 microversion: 2.1 time: 0.162155 Jul 25 12:44:07.442544 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 796/1534] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:07 2022] GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:07.447478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-68d03882-4dca-48f6-aaf8-341ad33585a6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:07.448078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-68d03882-4dca-48f6-aaf8-341ad33585a6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:07.453822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68d03882-4dca-48f6-aaf8-341ad33585a6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:07.454302 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68d03882-4dca-48f6-aaf8-341ad33585a6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:07.455060 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68d03882-4dca-48f6-aaf8-341ad33585a6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:07.455501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68d03882-4dca-48f6-aaf8-341ad33585a6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:07.517562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-68d03882-4dca-48f6-aaf8-341ad33585a6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:07.527047 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-68d03882-4dca-48f6-aaf8-341ad33585a6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1102 microversion: 2.1 time: 0.082608 Jul 25 12:44:07.527628 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 797/1535] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:07 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1102 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:07.532013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-9f2c93c4-d17e-49df-bad5-28c2d1f5f8ed req-193310c2-4530-45be-98c9-dc45dea743dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eb5975b-24da-4318-90ce-bd3b7d0d01f2", "tag": "0012b1f8-03b2-4861-88f2-461bdd29f4d1"}, {"name": "network-changed", "server_uuid": "c6bb4f7e-67c3-4c86-8e69-92fd4061e26d", "tag": "b55028ef-4d91-4ac2-a60c-3406cbca7db4"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:07.543657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9f2c93c4-d17e-49df-bad5-28c2d1f5f8ed req-193310c2-4530-45be-98c9-dc45dea743dd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:07.544328 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9f2c93c4-d17e-49df-bad5-28c2d1f5f8ed req-193310c2-4530-45be-98c9-dc45dea743dd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:07.560758 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-9f2c93c4-d17e-49df-bad5-28c2d1f5f8ed req-193310c2-4530-45be-98c9-dc45dea743dd service nova] Creating event network-changed:0012b1f8-03b2-4861-88f2-461bdd29f4d1 for instance 7eb5975b-24da-4318-90ce-bd3b7d0d01f2 on n-h2-848886-15 Jul 25 12:44:07.561520 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-9f2c93c4-d17e-49df-bad5-28c2d1f5f8ed req-193310c2-4530-45be-98c9-dc45dea743dd service nova] Creating event network-changed:b55028ef-4d91-4ac2-a60c-3406cbca7db4 for instance c6bb4f7e-67c3-4c86-8e69-92fd4061e26d on n-h2-848886-15 Jul 25 12:44:07.567788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [req-9f2c93c4-d17e-49df-bad5-28c2d1f5f8ed req-193310c2-4530-45be-98c9-dc45dea743dd service nova] Instance 7eb5975b-24da-4318-90ce-bd3b7d0d01f2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 12:44:07.580467 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-9f2c93c4-d17e-49df-bad5-28c2d1f5f8ed req-193310c2-4530-45be-98c9-dc45dea743dd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.051650 Jul 25 12:44:07.581092 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 798/1536] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:07.586510 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d088cb7c-6b9d-48db-bf22-fe54ebbe7238 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9c04d30>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:07.639686 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d088cb7c-6b9d-48db-bf22-fe54ebbe7238 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fservers%2Ff2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 484 microversion: 2.1 time: 0.057239 Jul 25 12:44:07.640443 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 799/1537] 10.222.0.49 () {58 vars in 1303 bytes} [Mon Jul 25 12:44:07 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fservers%2Ff2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 484 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:07.645463 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b5ed86f5-902e-4e56-b3c8-c7b948e360dd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:07.646194 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b5ed86f5-902e-4e56-b3c8-c7b948e360dd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c9c04c11-ce42-44b4-a6fd-7f7658a05292] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:07.653480 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5ed86f5-902e-4e56-b3c8-c7b948e360dd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:07.654169 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5ed86f5-902e-4e56-b3c8-c7b948e360dd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:07.658591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5ed86f5-902e-4e56-b3c8-c7b948e360dd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:07.659043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5ed86f5-902e-4e56-b3c8-c7b948e360dd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:07.674192 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-b5ed86f5-902e-4e56-b3c8-c7b948e360dd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] HTTP exception thrown: Instance c9c04c11-ce42-44b4-a6fd-7f7658a05292 could not be found. Jul 25 12:44:07.678740 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b5ed86f5-902e-4e56-b3c8-c7b948e360dd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Request method failure captured: Jul 25 12:44:07.678740 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292 HTTP/1.1 Jul 25 12:44:07.678740 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:44:07.678740 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:44:07.678740 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:44:07.678740 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:44:07.678740 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:44:07.678740 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:44:07.678740 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:44:07.678740 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:07.678740 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o8ooEvqjYaWjOGZnMs8tQpLLBhsAjkHwJkOVRpGlGZwu0wvKMkpNJnI6LZOFAyrSiJCS7QVibWBeuqRdRi4gUJ9NsSc1cd56Q9jsPyD-2qGdsZPXQyCOvO9G7fHO9bE1ZV48K1Uls75dq-yU_Qym4X7e94zqNZG0QEWXhF2DClBQCk Jul 25 12:44:07.678740 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:44:07.678740 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:44:07.678740 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:44:07.678740 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:44:07.678740 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:44:07.678740 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:44:07.678740 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:44:07.678740 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:44:07.678740 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:44:07.678740 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:44:07.680370 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85c0dc3e0d894a5a95b1628cbd20df9f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}] Jul 25 12:44:07.680370 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesTestJSON-796718257 Jul 25 12:44:07.680370 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:44:07.680370 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:44:07.680370 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesTestJSON-796718257-project Jul 25 12:44:07.680370 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:44:07.680370 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:44:07.680370 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 53f799c73ceb4c189329bc86056bc048 Jul 25 12:44:07.680370 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesTestJSON-796718257-project Jul 25 12:44:07.680370 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:44:07.680370 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance c9c04c11-ce42-44b4-a6fd-7f7658a05292 could not be found. Jul 25 12:44:07.680370 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'c9c04c11-ce42-44b4-a6fd-7f7658a05292'} Jul 25 12:44:07.680370 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:07.683249 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:07.683249 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:44:07.683249 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:44:07.683249 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:44:07.683249 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:44:07.683249 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:44:07.683249 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:44:07.683249 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:44:07.683249 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:44:07.683249 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9c04c11-ce42-44b4-a6fd-7f7658a05292 could not be found. Jul 25 12:44:07.683249 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:07.683249 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:07.683249 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:07.683249 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:07.683249 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:07.683249 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:07.683249 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:07.683249 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:07.683249 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:07.683249 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:07.684488 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:44:07.684488 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:44:07.684488 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:44:07.684488 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:44:07.684488 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:44:07.684488 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:44:07.684488 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9c04c11-ce42-44b4-a6fd-7f7658a05292 could not be found. Jul 25 12:44:07.684488 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:07.684488 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:07.684488 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:07.684488 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:07.684488 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:07.684488 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:07.684488 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:07.684488 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:07.684488 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9c04c11-ce42-44b4-a6fd-7f7658a05292 could not be found. Jul 25 12:44:07.684488 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:07.685657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b5ed86f5-902e-4e56-b3c8-c7b948e360dd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Returning 404 to user: Instance c9c04c11-ce42-44b4-a6fd-7f7658a05292 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:07.685657 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b5ed86f5-902e-4e56-b3c8-c7b948e360dd tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292" status: 404 len: 111 microversion: 2.1 time: 0.038609 Jul 25 12:44:07.685657 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 800/1538] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:07 2022] GET /compute/v2.1/servers/c9c04c11-ce42-44b4-a6fd-7f7658a05292 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:44:07.689698 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-200c094d-d336-4e18-980b-ec1ec29b71cf tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9c04d30>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:07.804377 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-200c094d-d336-4e18-980b-ec1ec29b71cf tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3277 microversion: 2.1 time: 0.122016 Jul 25 12:44:07.805262 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 801/1539] 10.222.0.49 () {58 vars in 1149 bytes} [Mon Jul 25 12:44:07 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:07.819855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-82fb6313-1494-43b5-a7e6-ed40de6df9af tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9d0ae50>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:07.861264 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-82fb6313-1494-43b5-a7e6-ed40de6df9af tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] HTTP exception thrown: Image not found. Jul 25 12:44:07.865064 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-82fb6313-1494-43b5-a7e6-ed40de6df9af tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Request method failure captured: Jul 25 12:44:07.865064 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c HTTP/1.1 Jul 25 12:44:07.865064 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:44:07.865064 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:44:07.865064 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:44:07.865064 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:44:07.865064 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:44:07.865064 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:44:07.865064 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:44:07.865064 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:07.865064 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o8ooEvqjYaWjOGZnMs8tQpLLBhsAjkHwJkOVRpGlGZwu0wvKMkpNJnI6LZOFAyrSiJCS7QVibWBeuqRdRi4gUJ9NsSc1cd56Q9jsPyD-2qGdsZPXQyCOvO9G7fHO9bE1ZV48K1Uls75dq-yU_Qym4X7e94zqNZG0QEWXhF2DClBQCk Jul 25 12:44:07.865064 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:44:07.865064 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:44:07.865064 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:44:07.865064 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:44:07.865064 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:44:07.865064 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:44:07.865064 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:44:07.865064 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:44:07.865064 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:44:07.865064 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:44:07.866487 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85c0dc3e0d894a5a95b1628cbd20df9f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}] Jul 25 12:44:07.866487 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesTestJSON-796718257 Jul 25 12:44:07.866487 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:44:07.866487 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:44:07.866487 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesTestJSON-796718257-project Jul 25 12:44:07.866487 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:44:07.866487 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:44:07.866487 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 53f799c73ceb4c189329bc86056bc048 Jul 25 12:44:07.866487 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesTestJSON-796718257-project Jul 25 12:44:07.866487 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:44:07.866487 n-d-848886-15 devstack@n-api.service[125884]: exception: Image not found. Jul 25 12:44:07.866487 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'ffca66af-d83c-4548-b4b5-18b33618183c'} Jul 25 12:44:07.866487 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:07.866487 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:07.867797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 12:44:07.867797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 12:44:07.867797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:44:07.867797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:44:07.867797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:44:07.867797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:44:07.867797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 12:44:07.867797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 12:44:07.867797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 12:44:07.867797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 12:44:07.867797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:44:07.867797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:44:07.867797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:44:07.867797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:44:07.867797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ffca66af-d83c-4548-b4b5-18b33618183c to delete Jul 25 12:44:07.867797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:07.867797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:07.867797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:07.867797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:07.868965 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 12:44:07.868965 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 12:44:07.868965 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 12:44:07.868965 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 12:44:07.868965 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 12:44:07.868965 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 12:44:07.868965 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ffca66af-d83c-4548-b4b5-18b33618183c could not be found. Jul 25 12:44:07.868965 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:07.868965 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:07.868965 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:07.868965 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:07.868965 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:07.868965 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:07.868965 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:07.868965 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:07.868965 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:44:07.868965 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:44:07.868965 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:07.868965 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:07.868965 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 12:44:07.870342 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 12:44:07.870342 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 12:44:07.870342 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:07.870342 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:07.870342 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:07.870342 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:07.870342 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:07.870342 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:07.870342 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:07.870342 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:07.870342 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 12:44:07.870342 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:07.872252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-82fb6313-1494-43b5-a7e6-ed40de6df9af tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Returning 404 to user: Image not found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:07.873541 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-82fb6313-1494-43b5-a7e6-ed40de6df9af tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "DELETE /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c" status: 404 len: 62 microversion: 2.1 time: 0.057676 Jul 25 12:44:07.874188 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 802/1540] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:07 2022] DELETE /compute/v2.1/images/ffca66af-d83c-4548-b4b5-18b33618183c => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:44:07.882245 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-efa927cf-567b-4f6e-9b6f-341d2eca881e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:07.883205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-efa927cf-567b-4f6e-9b6f-341d2eca881e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:07.891205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-efa927cf-567b-4f6e-9b6f-341d2eca881e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:07.891992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-efa927cf-567b-4f6e-9b6f-341d2eca881e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:07.893034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-efa927cf-567b-4f6e-9b6f-341d2eca881e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:07.893655 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-efa927cf-567b-4f6e-9b6f-341d2eca881e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:08.082192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-efa927cf-567b-4f6e-9b6f-341d2eca881e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:08.090347 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-efa927cf-567b-4f6e-9b6f-341d2eca881e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1314 microversion: 2.1 time: 0.214919 Jul 25 12:44:08.090935 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 803/1541] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:07 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:08.096873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-36b9b38c-dada-486e-83e2-d1e7cfae73df tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcfed8dee0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:08.177874 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-36b9b38c-dada-486e-83e2-d1e7cfae73df tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.085213 Jul 25 12:44:08.178960 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 804/1542] 10.222.0.49 () {58 vars in 1149 bytes} [Mon Jul 25 12:44:08 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:08.184102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a17b3da2-7306-4cd3-87a1-014868c5fbe2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:08.185082 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a17b3da2-7306-4cd3-87a1-014868c5fbe2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: dd308860-1e7f-4257-b285-3d2d3054d4ef] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:08.193314 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a17b3da2-7306-4cd3-87a1-014868c5fbe2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:08.194186 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a17b3da2-7306-4cd3-87a1-014868c5fbe2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:08.195207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a17b3da2-7306-4cd3-87a1-014868c5fbe2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:08.195887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a17b3da2-7306-4cd3-87a1-014868c5fbe2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:08.248187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a17b3da2-7306-4cd3-87a1-014868c5fbe2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:08.248739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a17b3da2-7306-4cd3-87a1-014868c5fbe2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:08.249143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-a17b3da2-7306-4cd3-87a1-014868c5fbe2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lazy-loading 'fault' on Instance uuid dd308860-1e7f-4257-b285-3d2d3054d4ef {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:44:08.316379 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a17b3da2-7306-4cd3-87a1-014868c5fbe2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:08.332487 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a17b3da2-7306-4cd3-87a1-014868c5fbe2 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/dd308860-1e7f-4257-b285-3d2d3054d4ef" status: 200 len: 1309 microversion: 2.1 time: 0.152206 Jul 25 12:44:08.334801 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 805/1543] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:08 2022] GET /compute/v2.1/servers/dd308860-1e7f-4257-b285-3d2d3054d4ef => generated 1309 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:08.340601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a5ce440e-89f5-42e5-b1d3-259f3436bced tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:08.341091 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a5ce440e-89f5-42e5-b1d3-259f3436bced tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:08.347846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5ce440e-89f5-42e5-b1d3-259f3436bced tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:08.348501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5ce440e-89f5-42e5-b1d3-259f3436bced tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:08.349483 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5ce440e-89f5-42e5-b1d3-259f3436bced tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:08.350096 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5ce440e-89f5-42e5-b1d3-259f3436bced tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:08.382489 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-a5ce440e-89f5-42e5-b1d3-259f3436bced tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] HTTP exception thrown: Instance c2b91c2f-a489-4adc-9090-7bd3f4d40e16 could not be found. Jul 25 12:44:08.386536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a5ce440e-89f5-42e5-b1d3-259f3436bced tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Request method failure captured: Jul 25 12:44:08.386536 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 HTTP/1.1 Jul 25 12:44:08.386536 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:44:08.386536 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:44:08.386536 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:44:08.386536 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:44:08.386536 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:44:08.386536 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:44:08.386536 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:44:08.386536 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:08.386536 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o8ooEvqjYaWjOGZnMs8tQpLLBhsAjkHwJkOVRpGlGZwu0wvKMkpNJnI6LZOFAyrSiJCS7QVibWBeuqRdRi4gUJ9NsSc1cd56Q9jsPyD-2qGdsZPXQyCOvO9G7fHO9bE1ZV48K1Uls75dq-yU_Qym4X7e94zqNZG0QEWXhF2DClBQCk Jul 25 12:44:08.386536 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:44:08.386536 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:44:08.386536 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:44:08.386536 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:44:08.386536 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:44:08.386536 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:44:08.386536 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:44:08.386536 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:44:08.386536 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:44:08.386536 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:44:08.388222 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85c0dc3e0d894a5a95b1628cbd20df9f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}] Jul 25 12:44:08.388222 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesTestJSON-796718257 Jul 25 12:44:08.388222 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:44:08.388222 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:44:08.388222 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesTestJSON-796718257-project Jul 25 12:44:08.388222 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:44:08.388222 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:44:08.388222 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 53f799c73ceb4c189329bc86056bc048 Jul 25 12:44:08.388222 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesTestJSON-796718257-project Jul 25 12:44:08.388222 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:44:08.388222 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance c2b91c2f-a489-4adc-9090-7bd3f4d40e16 could not be found. Jul 25 12:44:08.388222 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'c2b91c2f-a489-4adc-9090-7bd3f4d40e16'} Jul 25 12:44:08.388222 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:08.389193 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:08.389193 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:44:08.389193 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:44:08.389193 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:44:08.389193 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:44:08.389193 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:44:08.389193 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:44:08.389193 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:44:08.389193 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:44:08.389193 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2b91c2f-a489-4adc-9090-7bd3f4d40e16 could not be found. Jul 25 12:44:08.389193 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:08.389193 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:08.389193 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:08.389193 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:08.389193 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:08.389193 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:08.389193 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:08.389193 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:08.389193 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:08.389193 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:08.390752 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:44:08.390752 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:44:08.390752 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:44:08.390752 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:44:08.390752 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:44:08.390752 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:44:08.390752 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:44:08.390752 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:44:08.390752 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2b91c2f-a489-4adc-9090-7bd3f4d40e16 could not be found. Jul 25 12:44:08.390752 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:08.390752 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:08.390752 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:08.390752 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:08.390752 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:08.390752 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:08.390752 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:08.390752 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:08.390752 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2b91c2f-a489-4adc-9090-7bd3f4d40e16 could not be found. Jul 25 12:44:08.390752 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:08.392803 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a5ce440e-89f5-42e5-b1d3-259f3436bced tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Returning 404 to user: Instance c2b91c2f-a489-4adc-9090-7bd3f4d40e16 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:08.392803 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a5ce440e-89f5-42e5-b1d3-259f3436bced tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 404 len: 111 microversion: 2.1 time: 0.053988 Jul 25 12:44:08.392803 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 806/1544] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:44:08 2022] DELETE /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:44:08.402400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-739096a2-3742-41a0-97ba-706fe2a3aa30 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9cc63a0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:08.530627 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-739096a2-3742-41a0-97ba-706fe2a3aa30 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.137061 Jul 25 12:44:08.542871 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 807/1545] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:44:08 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:08.551211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cc88d3a1-3dff-4de5-b196-04244153b12d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:08.552971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cc88d3a1-3dff-4de5-b196-04244153b12d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:08.563756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc88d3a1-3dff-4de5-b196-04244153b12d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:08.564424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc88d3a1-3dff-4de5-b196-04244153b12d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:08.565531 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc88d3a1-3dff-4de5-b196-04244153b12d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:08.566148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc88d3a1-3dff-4de5-b196-04244153b12d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:09.344158 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cc88d3a1-3dff-4de5-b196-04244153b12d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:09.362790 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cc88d3a1-3dff-4de5-b196-04244153b12d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1470 microversion: 2.1 time: 0.814526 Jul 25 12:44:09.363449 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 808/1546] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:08 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1470 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:09.368541 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-753a342a-70d0-4fac-a9ea-cd62737f7f7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:09.369209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-753a342a-70d0-4fac-a9ea-cd62737f7f7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: c2b91c2f-a489-4adc-9090-7bd3f4d40e16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:09.385634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-753a342a-70d0-4fac-a9ea-cd62737f7f7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:09.386138 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-753a342a-70d0-4fac-a9ea-cd62737f7f7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:09.386938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-753a342a-70d0-4fac-a9ea-cd62737f7f7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:09.387394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-753a342a-70d0-4fac-a9ea-cd62737f7f7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:09.408569 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-753a342a-70d0-4fac-a9ea-cd62737f7f7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] HTTP exception thrown: Instance c2b91c2f-a489-4adc-9090-7bd3f4d40e16 could not be found. Jul 25 12:44:09.410178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-753a342a-70d0-4fac-a9ea-cd62737f7f7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Request method failure captured: Jul 25 12:44:09.410178 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 HTTP/1.1 Jul 25 12:44:09.410178 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:44:09.410178 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:44:09.410178 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:44:09.410178 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:44:09.410178 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:44:09.410178 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:44:09.410178 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:44:09.410178 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:09.410178 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o8ooEvqjYaWjOGZnMs8tQpLLBhsAjkHwJkOVRpGlGZwu0wvKMkpNJnI6LZOFAyrSiJCS7QVibWBeuqRdRi4gUJ9NsSc1cd56Q9jsPyD-2qGdsZPXQyCOvO9G7fHO9bE1ZV48K1Uls75dq-yU_Qym4X7e94zqNZG0QEWXhF2DClBQCk Jul 25 12:44:09.410178 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:44:09.410178 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:44:09.410178 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:44:09.410178 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:44:09.410178 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:44:09.410178 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:44:09.410178 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:44:09.410178 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:44:09.410178 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:44:09.410178 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:44:09.411867 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85c0dc3e0d894a5a95b1628cbd20df9f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}] Jul 25 12:44:09.411867 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesTestJSON-796718257 Jul 25 12:44:09.411867 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:44:09.411867 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:44:09.411867 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesTestJSON-796718257-project Jul 25 12:44:09.411867 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:44:09.411867 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:44:09.411867 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 53f799c73ceb4c189329bc86056bc048 Jul 25 12:44:09.411867 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesTestJSON-796718257-project Jul 25 12:44:09.411867 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:44:09.411867 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance c2b91c2f-a489-4adc-9090-7bd3f4d40e16 could not be found. Jul 25 12:44:09.411867 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'c2b91c2f-a489-4adc-9090-7bd3f4d40e16'} Jul 25 12:44:09.411867 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:09.412969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:09.412969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:44:09.412969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:44:09.412969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:44:09.412969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:44:09.412969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:44:09.412969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:44:09.412969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:44:09.412969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:44:09.412969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2b91c2f-a489-4adc-9090-7bd3f4d40e16 could not be found. Jul 25 12:44:09.412969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:09.412969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:09.412969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:09.412969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:09.412969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:09.412969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:09.412969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:09.412969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:09.412969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:09.412969 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:09.414707 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:44:09.414707 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:44:09.414707 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:44:09.414707 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:44:09.414707 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:44:09.414707 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:44:09.414707 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2b91c2f-a489-4adc-9090-7bd3f4d40e16 could not be found. Jul 25 12:44:09.414707 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:09.414707 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:09.414707 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:09.414707 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:09.414707 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:09.414707 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:09.414707 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:09.414707 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:09.414707 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2b91c2f-a489-4adc-9090-7bd3f4d40e16 could not be found. Jul 25 12:44:09.414707 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:09.416119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-753a342a-70d0-4fac-a9ea-cd62737f7f7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Returning 404 to user: Instance c2b91c2f-a489-4adc-9090-7bd3f4d40e16 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:09.416119 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-753a342a-70d0-4fac-a9ea-cd62737f7f7a tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16" status: 404 len: 111 microversion: 2.1 time: 0.047033 Jul 25 12:44:09.416119 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 809/1547] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:09 2022] GET /compute/v2.1/servers/c2b91c2f-a489-4adc-9090-7bd3f4d40e16 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:44:09.418926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-775b23a5-8f9c-49f3-a5d8-b6a5ef3b159d tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:09.419548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-775b23a5-8f9c-49f3-a5d8-b6a5ef3b159d tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 965438e3-72fa-44e0-90fa-4fb0b24042ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:09.436104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-775b23a5-8f9c-49f3-a5d8-b6a5ef3b159d tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:09.437422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-775b23a5-8f9c-49f3-a5d8-b6a5ef3b159d tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:09.439153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-775b23a5-8f9c-49f3-a5d8-b6a5ef3b159d tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:09.440590 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-775b23a5-8f9c-49f3-a5d8-b6a5ef3b159d tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:09.735168 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-775b23a5-8f9c-49f3-a5d8-b6a5ef3b159d tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:09.746332 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-775b23a5-8f9c-49f3-a5d8-b6a5ef3b159d tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff" status: 200 len: 1313 microversion: 2.1 time: 0.332836 Jul 25 12:44:09.747591 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 810/1548] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:09 2022] GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:09.776760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1f2568f3-cced-4327-941c-306e49cb1402 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9cc6dc0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:09.970995 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1f2568f3-cced-4327-941c-306e49cb1402 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/detail?changes-since=2022-07-25T12%3A42%3A14Z" status: 200 len: 6312 microversion: 2.1 time: 0.221837 Jul 25 12:44:09.971615 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 811/1549] 10.222.0.49 () {58 vars in 1220 bytes} [Mon Jul 25 12:44:09 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-25T12%3A42%3A14Z => generated 6312 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:09.984373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a52c7057-9cc3-4ab3-9b51-222824cd6cb2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:09.988331 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a52c7057-9cc3-4ab3-9b51-222824cd6cb2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:10.007187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a52c7057-9cc3-4ab3-9b51-222824cd6cb2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:10.008001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a52c7057-9cc3-4ab3-9b51-222824cd6cb2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:10.008991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a52c7057-9cc3-4ab3-9b51-222824cd6cb2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:10.013281 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a52c7057-9cc3-4ab3-9b51-222824cd6cb2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:10.574094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a52c7057-9cc3-4ab3-9b51-222824cd6cb2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:10.585118 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a52c7057-9cc3-4ab3-9b51-222824cd6cb2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1210 microversion: 2.1 time: 0.609710 Jul 25 12:44:10.595433 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 812/1550] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:09 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1210 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:10.607095 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-d49ea829-6543-49a9-ae2d-763bc4e59f0a req-1d03561a-d571-4131-a1e3-95e27abe49d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd308860-1e7f-4257-b285-3d2d3054d4ef", "name": "network-vif-deleted", "tag": "95b22aa1-9462-42f8-be1e-7da968ced052"}, {"server_uuid": "10a61568-b301-4b9e-82f9-160490f071d7", "name": "network-vif-deleted", "tag": "c2f0713b-8145-47ab-9dec-7cf60284524b"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:10.619943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d49ea829-6543-49a9-ae2d-763bc4e59f0a req-1d03561a-d571-4131-a1e3-95e27abe49d9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:10.620527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d49ea829-6543-49a9-ae2d-763bc4e59f0a req-1d03561a-d571-4131-a1e3-95e27abe49d9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:10.639156 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-d49ea829-6543-49a9-ae2d-763bc4e59f0a req-1d03561a-d571-4131-a1e3-95e27abe49d9 service nova] Creating event network-vif-deleted:95b22aa1-9462-42f8-be1e-7da968ced052 for instance dd308860-1e7f-4257-b285-3d2d3054d4ef on n-h2-848886-15 Jul 25 12:44:10.639772 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-d49ea829-6543-49a9-ae2d-763bc4e59f0a req-1d03561a-d571-4131-a1e3-95e27abe49d9 service nova] Creating event network-vif-deleted:c2f0713b-8145-47ab-9dec-7cf60284524b for instance 10a61568-b301-4b9e-82f9-160490f071d7 on n-h1-848886-15 Jul 25 12:44:10.650929 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-d49ea829-6543-49a9-ae2d-763bc4e59f0a req-1d03561a-d571-4131-a1e3-95e27abe49d9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052832 Jul 25 12:44:10.651866 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 813/1551] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:10.660236 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5b17f745-fc68-478c-9454-e19539e999ce tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:10.661304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5b17f745-fc68-478c-9454-e19539e999ce tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:10.668521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b17f745-fc68-478c-9454-e19539e999ce tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:10.669065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b17f745-fc68-478c-9454-e19539e999ce tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:10.670002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b17f745-fc68-478c-9454-e19539e999ce tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:10.670439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b17f745-fc68-478c-9454-e19539e999ce tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:11.075868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5b17f745-fc68-478c-9454-e19539e999ce tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:11.090653 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5b17f745-fc68-478c-9454-e19539e999ce tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1314 microversion: 2.1 time: 0.435970 Jul 25 12:44:11.112262 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 814/1552] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:10 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:11.126308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9bd03ff3-abb7-4fab-9204-ad58a06ba3eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:11.127937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9bd03ff3-abb7-4fab-9204-ad58a06ba3eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: dd308860-1e7f-4257-b285-3d2d3054d4ef] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:11.140445 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9bd03ff3-abb7-4fab-9204-ad58a06ba3eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:11.141859 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9bd03ff3-abb7-4fab-9204-ad58a06ba3eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:11.143693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9bd03ff3-abb7-4fab-9204-ad58a06ba3eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:11.144381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9bd03ff3-abb7-4fab-9204-ad58a06ba3eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:11.190929 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-9bd03ff3-abb7-4fab-9204-ad58a06ba3eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] HTTP exception thrown: Instance dd308860-1e7f-4257-b285-3d2d3054d4ef could not be found. Jul 25 12:44:11.199848 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9bd03ff3-abb7-4fab-9204-ad58a06ba3eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Request method failure captured: Jul 25 12:44:11.199848 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/dd308860-1e7f-4257-b285-3d2d3054d4ef HTTP/1.1 Jul 25 12:44:11.199848 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:44:11.199848 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:44:11.199848 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:44:11.199848 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:44:11.199848 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:44:11.199848 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:44:11.199848 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:44:11.199848 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:11.199848 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o9FI8xGtqP7_CW35BbEF7ISywkY3QBKklr5o1CS_fq6Lx6g68HVW9d3S-CvFf3EFHQ-I9augL8LNHoHSZQ7fotgZGp7jb0rcywXJ-uNBD0-jX_Y0mC9RxTzXhF95_ckH46T5WFeX6UZGziPb5X1dUcODvmDxxrVOVDn9AvlAmcUOhI Jul 25 12:44:11.199848 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:44:11.199848 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:44:11.199848 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:44:11.199848 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:44:11.199848 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:44:11.199848 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:44:11.199848 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5c81a97dfca44bf6af64fdcd5d50c549 Jul 25 12:44:11.199848 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:44:11.199848 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:44:11.199848 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:44:11.201428 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5c81a97dfca44bf6af64fdcd5d50c549", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5c81a97dfca44bf6af64fdcd5d50c549"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c81a97dfca44bf6af64fdcd5d50c549"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c81a97dfca44bf6af64fdcd5d50c549"}]}] Jul 25 12:44:11.201428 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:44:11.201428 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5c81a97dfca44bf6af64fdcd5d50c549 Jul 25 12:44:11.201428 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:44:11.201428 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersOnMultiNodesTest-1957362714-project Jul 25 12:44:11.201428 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:44:11.201428 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:44:11.201428 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 8c296447c2254c048f94bd9f186b0097 Jul 25 12:44:11.201428 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersOnMultiNodesTest-1957362714-project Jul 25 12:44:11.201428 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:44:11.201428 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance dd308860-1e7f-4257-b285-3d2d3054d4ef could not be found. Jul 25 12:44:11.201428 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'dd308860-1e7f-4257-b285-3d2d3054d4ef'} Jul 25 12:44:11.202410 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:11.202410 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:11.202410 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:44:11.202410 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:44:11.202410 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:44:11.202410 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:44:11.202410 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:44:11.202410 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:44:11.202410 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:44:11.202410 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:44:11.202410 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd308860-1e7f-4257-b285-3d2d3054d4ef could not be found. Jul 25 12:44:11.202410 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:11.202410 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:11.202410 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:11.202410 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:11.202410 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:11.202410 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:11.202410 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:11.202410 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:11.202410 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:11.203992 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:11.203992 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:44:11.203992 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:44:11.203992 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:44:11.203992 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:44:11.203992 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:44:11.203992 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:44:11.203992 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd308860-1e7f-4257-b285-3d2d3054d4ef could not be found. Jul 25 12:44:11.203992 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:11.203992 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:11.203992 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:11.203992 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:11.203992 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:11.203992 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:11.203992 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:11.203992 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:11.203992 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd308860-1e7f-4257-b285-3d2d3054d4ef could not be found. Jul 25 12:44:11.203992 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:11.207957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9bd03ff3-abb7-4fab-9204-ad58a06ba3eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Returning 404 to user: Instance dd308860-1e7f-4257-b285-3d2d3054d4ef could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:11.209012 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9bd03ff3-abb7-4fab-9204-ad58a06ba3eb tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/dd308860-1e7f-4257-b285-3d2d3054d4ef" status: 404 len: 111 microversion: 2.1 time: 0.094239 Jul 25 12:44:11.210648 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 815/1553] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:11 2022] GET /compute/v2.1/servers/dd308860-1e7f-4257-b285-3d2d3054d4ef => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:44:11.220409 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fb336d7b-719a-40a9-83f9-6fdf46d9278d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '.version_select at 0x7efcf9d0e4c0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:11.261906 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-fb336d7b-719a-40a9-83f9-6fdf46d9278d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] HTTP exception thrown: Image not found. Jul 25 12:44:11.267404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fb336d7b-719a-40a9-83f9-6fdf46d9278d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Request method failure captured: Jul 25 12:44:11.267404 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da HTTP/1.1 Jul 25 12:44:11.267404 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:44:11.267404 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:44:11.267404 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:44:11.267404 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:44:11.267404 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:44:11.267404 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:44:11.267404 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:44:11.267404 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:11.267404 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o8ooEvqjYaWjOGZnMs8tQpLLBhsAjkHwJkOVRpGlGZwu0wvKMkpNJnI6LZOFAyrSiJCS7QVibWBeuqRdRi4gUJ9NsSc1cd56Q9jsPyD-2qGdsZPXQyCOvO9G7fHO9bE1ZV48K1Uls75dq-yU_Qym4X7e94zqNZG0QEWXhF2DClBQCk Jul 25 12:44:11.267404 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:44:11.267404 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:44:11.267404 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:44:11.267404 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:44:11.267404 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:44:11.267404 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:44:11.267404 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:44:11.267404 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:44:11.267404 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:44:11.267404 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:44:11.269059 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85c0dc3e0d894a5a95b1628cbd20df9f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}] Jul 25 12:44:11.269059 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesTestJSON-796718257 Jul 25 12:44:11.269059 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:44:11.269059 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:44:11.269059 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesTestJSON-796718257-project Jul 25 12:44:11.269059 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:44:11.269059 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:44:11.269059 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 53f799c73ceb4c189329bc86056bc048 Jul 25 12:44:11.269059 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesTestJSON-796718257-project Jul 25 12:44:11.269059 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:44:11.269059 n-d-848886-15 devstack@n-api.service[125884]: exception: Image not found. Jul 25 12:44:11.269059 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '99402886-51ed-4c9c-a841-7116be55e9da'} Jul 25 12:44:11.269059 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:11.269059 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:11.270168 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 12:44:11.270168 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 12:44:11.270168 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:44:11.270168 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:44:11.270168 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:44:11.270168 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:44:11.270168 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 12:44:11.270168 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 12:44:11.270168 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 12:44:11.270168 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 12:44:11.270168 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:44:11.270168 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:44:11.270168 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:44:11.270168 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:44:11.270168 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 99402886-51ed-4c9c-a841-7116be55e9da to delete Jul 25 12:44:11.270168 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:11.270168 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:11.270168 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:11.270168 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:11.271658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 12:44:11.271658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 12:44:11.271658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 12:44:11.271658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 12:44:11.271658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 12:44:11.271658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 12:44:11.271658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 99402886-51ed-4c9c-a841-7116be55e9da could not be found. Jul 25 12:44:11.271658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:11.271658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:11.271658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:11.271658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:11.271658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:11.271658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:11.271658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:11.271658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:11.271658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:44:11.271658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:44:11.271658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:11.271658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:11.271658 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 12:44:11.273196 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 12:44:11.273196 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 12:44:11.273196 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:11.273196 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:11.273196 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:11.273196 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:11.273196 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:11.273196 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:11.273196 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:11.273196 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:11.273196 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 12:44:11.273196 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:11.273196 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fb336d7b-719a-40a9-83f9-6fdf46d9278d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Returning 404 to user: Image not found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:11.273196 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fb336d7b-719a-40a9-83f9-6fdf46d9278d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "DELETE /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da" status: 404 len: 62 microversion: 2.1 time: 0.057186 Jul 25 12:44:11.274681 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 816/1554] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:11 2022] DELETE /compute/v2.1/images/99402886-51ed-4c9c-a841-7116be55e9da => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:44:11.279246 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-521d448c-7d89-40f7-a85f-9103bfa74896 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893/action" status: 202 len: 0 microversion: 2.25 time: 7.715911 Jul 25 12:44:11.284193 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 739/1555] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Jul 25 12:44:03 2022] POST /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893/action => generated 0 bytes in 7721 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:11.290297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f626f001-ce4d-401f-8949-587a095a7f5e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:11.290922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f626f001-ce4d-401f-8949-587a095a7f5e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:11.302362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d4ed3095-79a7-4a01-8eb5-05bb1d3208b3 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9cb35e0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:11.310729 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f626f001-ce4d-401f-8949-587a095a7f5e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:11.312965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f626f001-ce4d-401f-8949-587a095a7f5e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:11.313178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f626f001-ce4d-401f-8949-587a095a7f5e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:11.313624 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f626f001-ce4d-401f-8949-587a095a7f5e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:11.454278 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d4ed3095-79a7-4a01-8eb5-05bb1d3208b3 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-894235844" status: 200 len: 664 microversion: 2.1 time: 0.178843 Jul 25 12:44:11.457231 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 817/1556] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 25 12:44:11 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-894235844 => generated 664 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:11.472219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f7190b69-6120-4aa3-9453-e68832d54e09 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:11.472729 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f7190b69-6120-4aa3-9453-e68832d54e09 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 965438e3-72fa-44e0-90fa-4fb0b24042ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:11.485295 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7190b69-6120-4aa3-9453-e68832d54e09 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:11.487242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7190b69-6120-4aa3-9453-e68832d54e09 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:11.490877 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7190b69-6120-4aa3-9453-e68832d54e09 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:11.491532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7190b69-6120-4aa3-9453-e68832d54e09 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:11.955537 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f626f001-ce4d-401f-8949-587a095a7f5e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:11.966667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f7190b69-6120-4aa3-9453-e68832d54e09 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:11.968644 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f626f001-ce4d-401f-8949-587a095a7f5e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1463 microversion: 2.1 time: 0.681103 Jul 25 12:44:11.969477 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 740/1557] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:11 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1463 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:11.981407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e209ce88-87cb-4171-8907-5dd39ad8b70a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:11.983604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e209ce88-87cb-4171-8907-5dd39ad8b70a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 10a61568-b301-4b9e-82f9-160490f071d7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:11.989685 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f7190b69-6120-4aa3-9453-e68832d54e09 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff" status: 200 len: 1313 microversion: 2.1 time: 0.531090 Jul 25 12:44:11.990777 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 818/1558] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:11 2022] GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff => generated 1313 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:11.996453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2463fb17-649a-4262-a715-78606c207a3d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:12.006610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2463fb17-649a-4262-a715-78606c207a3d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: 913f3154-bc36-46f9-8dda-b29d58dd7903] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:12.008094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e209ce88-87cb-4171-8907-5dd39ad8b70a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:12.008750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e209ce88-87cb-4171-8907-5dd39ad8b70a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:12.009712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e209ce88-87cb-4171-8907-5dd39ad8b70a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:12.010325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e209ce88-87cb-4171-8907-5dd39ad8b70a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:12.024447 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2463fb17-649a-4262-a715-78606c207a3d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:12.025073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2463fb17-649a-4262-a715-78606c207a3d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:12.026074 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-e209ce88-87cb-4171-8907-5dd39ad8b70a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] HTTP exception thrown: Instance 10a61568-b301-4b9e-82f9-160490f071d7 could not be found. Jul 25 12:44:12.026371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2463fb17-649a-4262-a715-78606c207a3d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:12.026924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2463fb17-649a-4262-a715-78606c207a3d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:12.028829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e209ce88-87cb-4171-8907-5dd39ad8b70a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Request method failure captured: Jul 25 12:44:12.028829 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7 HTTP/1.1 Jul 25 12:44:12.028829 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:44:12.028829 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:44:12.028829 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:44:12.028829 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:44:12.028829 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:44:12.028829 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:44:12.028829 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:44:12.028829 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:12.028829 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o9FI8xGtqP7_CW35BbEF7ISywkY3QBKklr5o1CS_fq6Lx6g68HVW9d3S-CvFf3EFHQ-I9augL8LNHoHSZQ7fotgZGp7jb0rcywXJ-uNBD0-jX_Y0mC9RxTzXhF95_ckH46T5WFeX6UZGziPb5X1dUcODvmDxxrVOVDn9AvlAmcUOhI Jul 25 12:44:12.028829 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:44:12.028829 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:44:12.028829 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:44:12.028829 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:44:12.028829 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:44:12.028829 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:44:12.028829 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 5c81a97dfca44bf6af64fdcd5d50c549 Jul 25 12:44:12.028829 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:44:12.028829 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:44:12.028829 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:44:12.030619 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5c81a97dfca44bf6af64fdcd5d50c549", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5c81a97dfca44bf6af64fdcd5d50c549"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c81a97dfca44bf6af64fdcd5d50c549"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c81a97dfca44bf6af64fdcd5d50c549"}]}] Jul 25 12:44:12.030619 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:44:12.030619 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 5c81a97dfca44bf6af64fdcd5d50c549 Jul 25 12:44:12.030619 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:44:12.030619 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersOnMultiNodesTest-1957362714-project Jul 25 12:44:12.030619 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:44:12.030619 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:44:12.030619 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8c296447c2254c048f94bd9f186b0097 Jul 25 12:44:12.030619 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersOnMultiNodesTest-1957362714-project Jul 25 12:44:12.030619 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:44:12.030619 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 10a61568-b301-4b9e-82f9-160490f071d7 could not be found. Jul 25 12:44:12.030619 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '10a61568-b301-4b9e-82f9-160490f071d7'} Jul 25 12:44:12.031780 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:12.031780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:12.031780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:44:12.031780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:44:12.031780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:44:12.031780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:44:12.031780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:44:12.031780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:44:12.031780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:44:12.031780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:44:12.031780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10a61568-b301-4b9e-82f9-160490f071d7 could not be found. Jul 25 12:44:12.031780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:12.031780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:12.031780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:12.031780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:12.031780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:12.031780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:12.031780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:12.031780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:12.031780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:12.033270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:12.033270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:44:12.033270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:44:12.033270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:44:12.033270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:44:12.033270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:44:12.033270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:44:12.033270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10a61568-b301-4b9e-82f9-160490f071d7 could not be found. Jul 25 12:44:12.033270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:12.033270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:12.033270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:12.033270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:12.033270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:12.033270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:12.033270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:12.033270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:12.033270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10a61568-b301-4b9e-82f9-160490f071d7 could not be found. Jul 25 12:44:12.033270 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:12.035553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e209ce88-87cb-4171-8907-5dd39ad8b70a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Returning 404 to user: Instance 10a61568-b301-4b9e-82f9-160490f071d7 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:12.035553 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e209ce88-87cb-4171-8907-5dd39ad8b70a tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7" status: 404 len: 111 microversion: 2.1 time: 0.056304 Jul 25 12:44:12.035553 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 741/1559] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:11 2022] GET /compute/v2.1/servers/10a61568-b301-4b9e-82f9-160490f071d7 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:44:12.041200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dae950f6-6b2c-4a52-8f18-31f429213239 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:12.042097 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dae950f6-6b2c-4a52-8f18-31f429213239 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:12.051794 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-2463fb17-649a-4262-a715-78606c207a3d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] HTTP exception thrown: Instance 913f3154-bc36-46f9-8dda-b29d58dd7903 could not be found. Jul 25 12:44:12.052364 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dae950f6-6b2c-4a52-8f18-31f429213239 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:12.054440 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dae950f6-6b2c-4a52-8f18-31f429213239 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:12.055267 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dae950f6-6b2c-4a52-8f18-31f429213239 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:12.059470 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dae950f6-6b2c-4a52-8f18-31f429213239 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:12.059646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2463fb17-649a-4262-a715-78606c207a3d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Request method failure captured: Jul 25 12:44:12.059646 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903 HTTP/1.1 Jul 25 12:44:12.059646 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:44:12.059646 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:44:12.059646 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:44:12.059646 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:44:12.059646 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:44:12.059646 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:44:12.059646 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:44:12.059646 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:12.059646 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o8ooEvqjYaWjOGZnMs8tQpLLBhsAjkHwJkOVRpGlGZwu0wvKMkpNJnI6LZOFAyrSiJCS7QVibWBeuqRdRi4gUJ9NsSc1cd56Q9jsPyD-2qGdsZPXQyCOvO9G7fHO9bE1ZV48K1Uls75dq-yU_Qym4X7e94zqNZG0QEWXhF2DClBQCk Jul 25 12:44:12.059646 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:44:12.059646 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:44:12.059646 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:44:12.059646 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:44:12.059646 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:44:12.059646 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:44:12.059646 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:44:12.059646 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:44:12.059646 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:44:12.059646 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:44:12.061261 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85c0dc3e0d894a5a95b1628cbd20df9f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}] Jul 25 12:44:12.061261 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesTestJSON-796718257 Jul 25 12:44:12.061261 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:44:12.061261 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:44:12.061261 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesTestJSON-796718257-project Jul 25 12:44:12.061261 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:44:12.061261 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:44:12.061261 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 53f799c73ceb4c189329bc86056bc048 Jul 25 12:44:12.061261 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesTestJSON-796718257-project Jul 25 12:44:12.061261 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:44:12.061261 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 913f3154-bc36-46f9-8dda-b29d58dd7903 could not be found. Jul 25 12:44:12.061261 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '913f3154-bc36-46f9-8dda-b29d58dd7903'} Jul 25 12:44:12.061261 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:12.062353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:12.062353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:44:12.062353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:44:12.062353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:44:12.062353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:44:12.062353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:44:12.062353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:44:12.062353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:44:12.062353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:44:12.062353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 913f3154-bc36-46f9-8dda-b29d58dd7903 could not be found. Jul 25 12:44:12.062353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:12.062353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:12.062353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:12.062353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:12.062353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:12.062353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:12.062353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:12.062353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:12.062353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:12.062353 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:12.063824 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:44:12.063824 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:44:12.063824 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:44:12.063824 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:44:12.063824 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:44:12.063824 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:44:12.063824 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:44:12.063824 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:44:12.063824 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 913f3154-bc36-46f9-8dda-b29d58dd7903 could not be found. Jul 25 12:44:12.063824 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:12.063824 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:12.063824 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:12.063824 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:12.063824 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:12.063824 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:12.063824 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:12.063824 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:12.063824 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 913f3154-bc36-46f9-8dda-b29d58dd7903 could not be found. Jul 25 12:44:12.063824 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:12.065756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2463fb17-649a-4262-a715-78606c207a3d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Returning 404 to user: Instance 913f3154-bc36-46f9-8dda-b29d58dd7903 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:12.078573 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2463fb17-649a-4262-a715-78606c207a3d tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "DELETE /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903" status: 404 len: 111 microversion: 2.1 time: 0.086175 Jul 25 12:44:12.079815 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 819/1560] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:44:11 2022] DELETE /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:44:12.086986 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-8fcc9781-e367-477e-a829-71cae7ce671a req-e8cc0280-30b0-458d-aa32-0fc2289e2ffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4075b4-1c73-4c86-b399-5aa825cc41cd", "name": "network-vif-plugged", "status": "completed", "tag": "b2e864ef-d364-4d7a-8b71-3339a78ee52f"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:12.103757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-8fcc9781-e367-477e-a829-71cae7ce671a req-e8cc0280-30b0-458d-aa32-0fc2289e2ffd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:12.114428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-8fcc9781-e367-477e-a829-71cae7ce671a req-e8cc0280-30b0-458d-aa32-0fc2289e2ffd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:12.125820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:12.140454 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-8fcc9781-e367-477e-a829-71cae7ce671a req-e8cc0280-30b0-458d-aa32-0fc2289e2ffd service nova] Creating event network-vif-plugged:b2e864ef-d364-4d7a-8b71-3339a78ee52f for instance 7e4075b4-1c73-4c86-b399-5aa825cc41cd on n-h2-848886-15 Jul 25 12:44:12.147354 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-8fcc9781-e367-477e-a829-71cae7ce671a req-e8cc0280-30b0-458d-aa32-0fc2289e2ffd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066047 Jul 25 12:44:12.148863 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 820/1561] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:12.155243 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fe5c3cf2-1c0e-4057-b4b9-f84821342412 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcfed8dd30>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:12.215670 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fe5c3cf2-1c0e-4057-b4b9-f84821342412 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fv2.1%2Fservers%2Ff2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1460 microversion: 2.1 time: 0.065208 Jul 25 12:44:12.216933 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 821/1562] 10.222.0.49 () {58 vars in 1338 bytes} [Mon Jul 25 12:44:12 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fv2.1%2Fservers%2Ff2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1460 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:12.222205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d5ed9f98-6370-41f2-99d4-cba877e4af7a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:12.223266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d5ed9f98-6370-41f2-99d4-cba877e4af7a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:12.231589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5ed9f98-6370-41f2-99d4-cba877e4af7a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:12.232335 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5ed9f98-6370-41f2-99d4-cba877e4af7a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:12.233285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5ed9f98-6370-41f2-99d4-cba877e4af7a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:12.233953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5ed9f98-6370-41f2-99d4-cba877e4af7a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:12.883127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dae950f6-6b2c-4a52-8f18-31f429213239 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:12.905302 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dae950f6-6b2c-4a52-8f18-31f429213239 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:12.912312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dae950f6-6b2c-4a52-8f18-31f429213239 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:12.913534 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dae950f6-6b2c-4a52-8f18-31f429213239 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1485 microversion: 2.25 time: 0.878057 Jul 25 12:44:12.914135 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 742/1563] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:12 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1485 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:12.921096 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-802b1e39-5286-425e-a635-d9ca7695c1e5 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:12.922166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-802b1e39-5286-425e-a635-d9ca7695c1e5 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:12.939202 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-802b1e39-5286-425e-a635-d9ca7695c1e5 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:12.939713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-802b1e39-5286-425e-a635-d9ca7695c1e5 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:12.940441 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-802b1e39-5286-425e-a635-d9ca7695c1e5 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:12.940875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-802b1e39-5286-425e-a635-d9ca7695c1e5 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:13.105422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d5ed9f98-6370-41f2-99d4-cba877e4af7a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:13.115722 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d5ed9f98-6370-41f2-99d4-cba877e4af7a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1210 microversion: 2.1 time: 0.897302 Jul 25 12:44:13.136630 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 822/1564] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:12 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1210 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:13.142238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9e145558-4dfd-4f6b-adc2-038bd4f1d7f4 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:13.195665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:13.197825 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9e145558-4dfd-4f6b-adc2-038bd4f1d7f4 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/4ed2b1d5-e7d3-4cb9-a903-29a884e9882c" status: 204 len: 0 microversion: 2.1 time: 0.059280 Jul 25 12:44:13.198510 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 823/1565] 10.222.0.49 () {58 vars in 1266 bytes} [Mon Jul 25 12:44:13 2022] DELETE /compute/v2.1/os-server-groups/4ed2b1d5-e7d3-4cb9-a903-29a884e9882c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:13.205934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e533ca2f-9ec0-4f57-be94-e0c0e52cf5a4 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:13.206555 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e533ca2f-9ec0-4f57-be94-e0c0e52cf5a4 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] [instance: 913f3154-bc36-46f9-8dda-b29d58dd7903] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:13.213940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e533ca2f-9ec0-4f57-be94-e0c0e52cf5a4 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:13.215032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e533ca2f-9ec0-4f57-be94-e0c0e52cf5a4 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:13.216024 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e533ca2f-9ec0-4f57-be94-e0c0e52cf5a4 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:13.216461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e533ca2f-9ec0-4f57-be94-e0c0e52cf5a4 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:13.232485 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-e533ca2f-9ec0-4f57-be94-e0c0e52cf5a4 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] HTTP exception thrown: Instance 913f3154-bc36-46f9-8dda-b29d58dd7903 could not be found. Jul 25 12:44:13.234709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e533ca2f-9ec0-4f57-be94-e0c0e52cf5a4 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Request method failure captured: Jul 25 12:44:13.234709 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903 HTTP/1.1 Jul 25 12:44:13.234709 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:44:13.234709 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:44:13.234709 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:44:13.234709 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:44:13.234709 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:44:13.234709 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:44:13.234709 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:44:13.234709 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:13.234709 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o8ooEvqjYaWjOGZnMs8tQpLLBhsAjkHwJkOVRpGlGZwu0wvKMkpNJnI6LZOFAyrSiJCS7QVibWBeuqRdRi4gUJ9NsSc1cd56Q9jsPyD-2qGdsZPXQyCOvO9G7fHO9bE1ZV48K1Uls75dq-yU_Qym4X7e94zqNZG0QEWXhF2DClBQCk Jul 25 12:44:13.234709 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:44:13.234709 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:44:13.234709 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:44:13.234709 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:44:13.234709 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:44:13.234709 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:44:13.234709 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:44:13.234709 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:44:13.234709 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:44:13.234709 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:44:13.236416 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85c0dc3e0d894a5a95b1628cbd20df9f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85c0dc3e0d894a5a95b1628cbd20df9f"}]}] Jul 25 12:44:13.236416 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesTestJSON-796718257 Jul 25 12:44:13.236416 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 85c0dc3e0d894a5a95b1628cbd20df9f Jul 25 12:44:13.236416 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesTestJSON-796718257 Jul 25 12:44:13.236416 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesTestJSON-796718257-project Jul 25 12:44:13.236416 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:44:13.236416 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:44:13.236416 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 53f799c73ceb4c189329bc86056bc048 Jul 25 12:44:13.236416 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesTestJSON-796718257-project Jul 25 12:44:13.236416 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:44:13.236416 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 913f3154-bc36-46f9-8dda-b29d58dd7903 could not be found. Jul 25 12:44:13.236416 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '913f3154-bc36-46f9-8dda-b29d58dd7903'} Jul 25 12:44:13.236416 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:13.237370 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:13.237370 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:44:13.237370 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:44:13.237370 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:44:13.237370 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:44:13.237370 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:44:13.237370 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:44:13.237370 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:44:13.237370 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:44:13.237370 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 913f3154-bc36-46f9-8dda-b29d58dd7903 could not be found. Jul 25 12:44:13.237370 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:13.237370 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:13.237370 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:13.237370 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:13.237370 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:13.237370 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:13.237370 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:13.237370 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:13.237370 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:13.237370 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:13.239036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:44:13.239036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:44:13.239036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:44:13.239036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:44:13.239036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:44:13.239036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:44:13.239036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 913f3154-bc36-46f9-8dda-b29d58dd7903 could not be found. Jul 25 12:44:13.239036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:13.239036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:13.239036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:13.239036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:13.239036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:13.239036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:13.239036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:13.239036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:13.239036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 913f3154-bc36-46f9-8dda-b29d58dd7903 could not be found. Jul 25 12:44:13.239036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:13.241313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e533ca2f-9ec0-4f57-be94-e0c0e52cf5a4 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] Returning 404 to user: Instance 913f3154-bc36-46f9-8dda-b29d58dd7903 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:13.242235 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e533ca2f-9ec0-4f57-be94-e0c0e52cf5a4 tempest-ImagesTestJSON-796718257 tempest-ImagesTestJSON-796718257-project] 10.222.0.49 "GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903" status: 404 len: 111 microversion: 2.1 time: 0.042707 Jul 25 12:44:13.247049 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 824/1566] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:13 2022] GET /compute/v2.1/servers/913f3154-bc36-46f9-8dda-b29d58dd7903 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:44:13.252306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-87356d03-16b7-43a1-9982-01e45d42b401 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:13.252957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-87356d03-16b7-43a1-9982-01e45d42b401 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:13.259766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87356d03-16b7-43a1-9982-01e45d42b401 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:13.260223 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87356d03-16b7-43a1-9982-01e45d42b401 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:13.261009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87356d03-16b7-43a1-9982-01e45d42b401 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:13.261632 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87356d03-16b7-43a1-9982-01e45d42b401 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:13.665149 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-802b1e39-5286-425e-a635-d9ca7695c1e5 tempest-MigrationsAdminTest-1913682051 tempest-MigrationsAdminTest-1913682051-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1616 microversion: 2.1 time: 0.742819 Jul 25 12:44:13.666217 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 743/1567] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:12 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1616 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:13.675621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9cfb91e5-8f91-41d6-9617-32cc79b56c67 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcfed2bee0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:13.714453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-87356d03-16b7-43a1-9982-01e45d42b401 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:13.723504 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-87356d03-16b7-43a1-9982-01e45d42b401 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1314 microversion: 2.1 time: 0.475306 Jul 25 12:44:13.724560 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 825/1568] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:13 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:13.743943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-59121889-4d42-40e4-94fb-270938646506 req-e4c5db52-8ebc-4247-8805-5966478886ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "791ea14d-3fa9-4be1-afc1-82c8908395f4", "tag": "0f801405-35d3-471d-9010-4dc3d6d5eec1"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:13.755421 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-59121889-4d42-40e4-94fb-270938646506 req-e4c5db52-8ebc-4247-8805-5966478886ee service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:13.755717 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9cfb91e5-8f91-41d6-9617-32cc79b56c67 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fservers%2Ff2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1460 microversion: 2.1 time: 0.087288 Jul 25 12:44:13.756121 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-59121889-4d42-40e4-94fb-270938646506 req-e4c5db52-8ebc-4247-8805-5966478886ee service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:13.756688 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 744/1569] 10.222.0.49 () {58 vars in 1324 bytes} [Mon Jul 25 12:44:13 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fservers%2Ff2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1460 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:13.769262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9b9e0086-0db5-4367-b8c1-9de47e0ac7c5 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:13.774307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9b9e0086-0db5-4367-b8c1-9de47e0ac7c5 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 965438e3-72fa-44e0-90fa-4fb0b24042ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:13.780561 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-59121889-4d42-40e4-94fb-270938646506 req-e4c5db52-8ebc-4247-8805-5966478886ee service nova] Creating event network-changed:0f801405-35d3-471d-9010-4dc3d6d5eec1 for instance 791ea14d-3fa9-4be1-afc1-82c8908395f4 on n-h1-848886-15 Jul 25 12:44:13.786457 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-59121889-4d42-40e4-94fb-270938646506 req-e4c5db52-8ebc-4247-8805-5966478886ee service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050639 Jul 25 12:44:13.790945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b9e0086-0db5-4367-b8c1-9de47e0ac7c5 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:13.791876 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b9e0086-0db5-4367-b8c1-9de47e0ac7c5 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:13.792186 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 826/1570] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:13.793147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b9e0086-0db5-4367-b8c1-9de47e0ac7c5 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:13.793601 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b9e0086-0db5-4367-b8c1-9de47e0ac7c5 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:13.799131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3c37b369-5e52-4b63-9aee-7866a634de22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:13.800165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3c37b369-5e52-4b63-9aee-7866a634de22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: ce1a79d3-137b-485c-9757-bfa73c2dfbfb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:13.807888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3c37b369-5e52-4b63-9aee-7866a634de22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:13.808789 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3c37b369-5e52-4b63-9aee-7866a634de22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:13.809824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3c37b369-5e52-4b63-9aee-7866a634de22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:13.810715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3c37b369-5e52-4b63-9aee-7866a634de22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:13.841899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3c37b369-5e52-4b63-9aee-7866a634de22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: ce1a79d3-137b-485c-9757-bfa73c2dfbfb] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:44:13.956367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:13.966797 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3c37b369-5e52-4b63-9aee-7866a634de22 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ce1a79d3-137b-485c-9757-bfa73c2dfbfb" status: 204 len: 0 microversion: 2.1 time: 0.171728 Jul 25 12:44:13.971827 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 827/1571] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:44:13 2022] DELETE /compute/v2.1/servers/ce1a79d3-137b-485c-9757-bfa73c2dfbfb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:13.978838 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-93a8a754-eb0a-4543-a9f0-1dd90b540c9a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:13.980041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-93a8a754-eb0a-4543-a9f0-1dd90b540c9a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:13.989868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93a8a754-eb0a-4543-a9f0-1dd90b540c9a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:13.991164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93a8a754-eb0a-4543-a9f0-1dd90b540c9a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:13.992540 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93a8a754-eb0a-4543-a9f0-1dd90b540c9a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:13.993379 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93a8a754-eb0a-4543-a9f0-1dd90b540c9a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:14.027656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-93a8a754-eb0a-4543-a9f0-1dd90b540c9a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:44:14.042853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9b9e0086-0db5-4367-b8c1-9de47e0ac7c5 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:14.053990 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9b9e0086-0db5-4367-b8c1-9de47e0ac7c5 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff" status: 200 len: 1313 microversion: 2.1 time: 0.294939 Jul 25 12:44:14.055231 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 745/1572] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:13 2022] GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:14.060058 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8fe3fa77-84ce-452b-9d04-1e8d03ceeb00 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9916670>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:14.144447 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-93a8a754-eb0a-4543-a9f0-1dd90b540c9a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 204 len: 0 microversion: 2.1 time: 0.170712 Jul 25 12:44:14.145759 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 828/1573] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:44:13 2022] DELETE /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:14.157150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-419c8ae3-4a42-419b-a756-f3346d5928fc tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:14.162377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-419c8ae3-4a42-419b-a756-f3346d5928fc tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:14.173163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-419c8ae3-4a42-419b-a756-f3346d5928fc tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:14.180234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-419c8ae3-4a42-419b-a756-f3346d5928fc tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:14.181245 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-419c8ae3-4a42-419b-a756-f3346d5928fc tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:14.181860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-419c8ae3-4a42-419b-a756-f3346d5928fc tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:14.281997 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8fe3fa77-84ce-452b-9d04-1e8d03ceeb00 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7087 microversion: 2.1 time: 0.224528 Jul 25 12:44:14.284258 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 746/1574] 10.222.0.49 () {58 vars in 1170 bytes} [Mon Jul 25 12:44:14 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7087 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:14.293249 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bf411baa-7c8c-4578-8836-347f0e567aed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:14.298070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bf411baa-7c8c-4578-8836-347f0e567aed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 662e780d-2f9d-4eeb-9323-978b7679d299] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:14.316465 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf411baa-7c8c-4578-8836-347f0e567aed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:14.317209 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf411baa-7c8c-4578-8836-347f0e567aed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:14.318741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf411baa-7c8c-4578-8836-347f0e567aed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:14.321547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf411baa-7c8c-4578-8836-347f0e567aed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:14.355872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-419c8ae3-4a42-419b-a756-f3346d5928fc tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:14.367387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-419c8ae3-4a42-419b-a756-f3346d5928fc tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:14.373172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-419c8ae3-4a42-419b-a756-f3346d5928fc tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:14.379492 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-419c8ae3-4a42-419b-a756-f3346d5928fc tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1485 microversion: 2.25 time: 0.228824 Jul 25 12:44:14.380814 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 829/1575] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:14 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1485 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:14.385674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-508dea89-053c-4340-9ba3-4f901705ab05 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:14.388301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bf411baa-7c8c-4578-8836-347f0e567aed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 662e780d-2f9d-4eeb-9323-978b7679d299] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:44:14.389177 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-508dea89-053c-4340-9ba3-4f901705ab05 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:14.398953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-508dea89-053c-4340-9ba3-4f901705ab05 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:14.399551 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-508dea89-053c-4340-9ba3-4f901705ab05 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:14.400405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-508dea89-053c-4340-9ba3-4f901705ab05 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:14.400905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-508dea89-053c-4340-9ba3-4f901705ab05 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:14.557160 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bf411baa-7c8c-4578-8836-347f0e567aed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "DELETE /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299" status: 204 len: 0 microversion: 2.1 time: 0.271020 Jul 25 12:44:14.557768 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 747/1576] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:44:14 2022] DELETE /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:14.565629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6605cc0f-60f8-4c19-948d-1d59fd9127e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:14.573493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6605cc0f-60f8-4c19-948d-1d59fd9127e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:14.584918 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6605cc0f-60f8-4c19-948d-1d59fd9127e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:14.585374 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6605cc0f-60f8-4c19-948d-1d59fd9127e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:14.591824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6605cc0f-60f8-4c19-948d-1d59fd9127e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:14.592305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6605cc0f-60f8-4c19-948d-1d59fd9127e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:14.633299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-508dea89-053c-4340-9ba3-4f901705ab05 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:14.642148 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-508dea89-053c-4340-9ba3-4f901705ab05 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1210 microversion: 2.1 time: 0.260124 Jul 25 12:44:14.642950 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 830/1577] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:14 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1210 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:14.666143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-3c4d1b51-5cde-4e59-a1bd-92ae4c854578 req-044d3b7b-b807-4862-8814-300407de4b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "965438e3-72fa-44e0-90fa-4fb0b24042ff", "name": "network-vif-plugged", "status": "completed", "tag": "22eacc86-1f73-4a81-89fe-aee538508ec8"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:14.684886 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3c4d1b51-5cde-4e59-a1bd-92ae4c854578 req-044d3b7b-b807-4862-8814-300407de4b08 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:14.685502 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3c4d1b51-5cde-4e59-a1bd-92ae4c854578 req-044d3b7b-b807-4862-8814-300407de4b08 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:14.724335 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-3c4d1b51-5cde-4e59-a1bd-92ae4c854578 req-044d3b7b-b807-4862-8814-300407de4b08 service nova] Creating event network-vif-plugged:22eacc86-1f73-4a81-89fe-aee538508ec8 for instance 965438e3-72fa-44e0-90fa-4fb0b24042ff on n-h1-848886-15 Jul 25 12:44:14.736861 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-3c4d1b51-5cde-4e59-a1bd-92ae4c854578 req-044d3b7b-b807-4862-8814-300407de4b08 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092247 Jul 25 12:44:14.739568 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 831/1578] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:14.754380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0f3814ce-fe81-4606-b882-614a29be649a tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9c04160>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:14.846404 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0f3814ce-fe81-4606-b882-614a29be649a tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4356 microversion: 2.1 time: 0.105483 Jul 25 12:44:14.847487 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 832/1579] 10.222.0.49 () {58 vars in 1170 bytes} [Mon Jul 25 12:44:14 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:14.853469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a285167c-df9c-4ad9-9afe-7b6a535eeac7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:14.854392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a285167c-df9c-4ad9-9afe-7b6a535eeac7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: ce1a79d3-137b-485c-9757-bfa73c2dfbfb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:14.864575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a285167c-df9c-4ad9-9afe-7b6a535eeac7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:14.865006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a285167c-df9c-4ad9-9afe-7b6a535eeac7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:14.865791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a285167c-df9c-4ad9-9afe-7b6a535eeac7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:14.866397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a285167c-df9c-4ad9-9afe-7b6a535eeac7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:14.895573 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6605cc0f-60f8-4c19-948d-1d59fd9127e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:14.907622 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6605cc0f-60f8-4c19-948d-1d59fd9127e6 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1469 microversion: 2.1 time: 0.348320 Jul 25 12:44:14.913618 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 748/1580] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:14 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1469 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:14.922627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f5e82986-1581-4be5-a6f6-3d6d17a9dc7d tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:14.928349 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f5e82986-1581-4be5-a6f6-3d6d17a9dc7d tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:14.936662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5e82986-1581-4be5-a6f6-3d6d17a9dc7d tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:14.937492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5e82986-1581-4be5-a6f6-3d6d17a9dc7d tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:14.938501 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5e82986-1581-4be5-a6f6-3d6d17a9dc7d tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:14.939162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5e82986-1581-4be5-a6f6-3d6d17a9dc7d tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:15.092724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a285167c-df9c-4ad9-9afe-7b6a535eeac7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:15.104841 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a285167c-df9c-4ad9-9afe-7b6a535eeac7 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/ce1a79d3-137b-485c-9757-bfa73c2dfbfb" status: 200 len: 1474 microversion: 2.1 time: 0.255816 Jul 25 12:44:15.120749 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 833/1581] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:14 2022] GET /compute/v2.1/servers/ce1a79d3-137b-485c-9757-bfa73c2dfbfb => generated 1474 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:15.120749 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ef321702-a3f3-4523-9b7c-3d74ccc01877 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9d64940>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:15.185821 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ef321702-a3f3-4523-9b7c-3d74ccc01877 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/97beeed7-7564-4203-abda-feef7e93cd98" status: 200 len: 784 microversion: 2.1 time: 0.078622 Jul 25 12:44:15.188519 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 834/1582] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:44:15 2022] GET /compute/v2.1/images/97beeed7-7564-4203-abda-feef7e93cd98 => generated 784 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:15.200520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7f778b61-b2ce-4c41-b9cc-32e536f77760 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:15.201925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7f778b61-b2ce-4c41-b9cc-32e536f77760 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 965438e3-72fa-44e0-90fa-4fb0b24042ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:15.213008 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7f778b61-b2ce-4c41-b9cc-32e536f77760 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:15.214210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7f778b61-b2ce-4c41-b9cc-32e536f77760 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:15.215261 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7f778b61-b2ce-4c41-b9cc-32e536f77760 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:15.215968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7f778b61-b2ce-4c41-b9cc-32e536f77760 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:15.239614 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f5e82986-1581-4be5-a6f6-3d6d17a9dc7d tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:15.255712 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f5e82986-1581-4be5-a6f6-3d6d17a9dc7d tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1500 microversion: 2.1 time: 0.338445 Jul 25 12:44:15.256962 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 749/1583] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:14 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1500 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:15.267812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5a27ac12-8d14-400d-910b-37bb4a11e879 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcfed271f0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:15.349064 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5a27ac12-8d14-400d-910b-37bb4a11e879 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1605 microversion: 2.1 time: 0.090739 Jul 25 12:44:15.350164 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 750/1584] 10.222.0.49 () {58 vars in 1158 bytes} [Mon Jul 25 12:44:15 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1605 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:15.358318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bf934d64-0581-423d-aad3-a5b0369b90c7 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:15.368768 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bf934d64-0581-423d-aad3-a5b0369b90c7 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:15.377554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:15.396051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf934d64-0581-423d-aad3-a5b0369b90c7 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:15.398816 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf934d64-0581-423d-aad3-a5b0369b90c7 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:15.400676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf934d64-0581-423d-aad3-a5b0369b90c7 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:15.401136 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf934d64-0581-423d-aad3-a5b0369b90c7 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:15.427696 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:15.436448 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-bf934d64-0581-423d-aad3-a5b0369b90c7 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lazy-loading 'flavor' on Instance uuid 7e4075b4-1c73-4c86-b399-5aa825cc41cd {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:44:15.532067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7f778b61-b2ce-4c41-b9cc-32e536f77760 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:15.543490 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7f778b61-b2ce-4c41-b9cc-32e536f77760 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff" status: 200 len: 1313 microversion: 2.1 time: 0.349500 Jul 25 12:44:15.544086 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bf934d64-0581-423d-aad3-a5b0369b90c7 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "POST /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd/action" status: 200 len: 32 microversion: 2.1 time: 0.192577 Jul 25 12:44:15.544508 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 835/1585] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:15 2022] GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:15.545427 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 751/1586] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:44:15 2022] POST /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd/action => generated 32 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:44:15.551145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-43708e1d-73c4-4691-9bc5-e6689456712b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:15.551818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-43708e1d-73c4-4691-9bc5-e6689456712b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:15.566491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0e602e95-5c64-45e1-8f4d-4c7e3a3d3bab tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9c9fe50>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:15.571609 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43708e1d-73c4-4691-9bc5-e6689456712b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:15.573057 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43708e1d-73c4-4691-9bc5-e6689456712b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:15.573985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43708e1d-73c4-4691-9bc5-e6689456712b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:15.580353 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43708e1d-73c4-4691-9bc5-e6689456712b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:15.921884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-43708e1d-73c4-4691-9bc5-e6689456712b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:15.932420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-43708e1d-73c4-4691-9bc5-e6689456712b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:15.937290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-43708e1d-73c4-4691-9bc5-e6689456712b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:15.939843 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-43708e1d-73c4-4691-9bc5-e6689456712b tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1485 microversion: 2.25 time: 0.393242 Jul 25 12:44:15.941502 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 752/1587] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:15 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1485 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:15.964530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aabe0d77-99f2-4e3b-a375-f8628fd81ee8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:15.965381 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-aabe0d77-99f2-4e3b-a375-f8628fd81ee8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:15.973197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aabe0d77-99f2-4e3b-a375-f8628fd81ee8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:15.973811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aabe0d77-99f2-4e3b-a375-f8628fd81ee8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:15.975054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aabe0d77-99f2-4e3b-a375-f8628fd81ee8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:15.975701 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aabe0d77-99f2-4e3b-a375-f8628fd81ee8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:16.317788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:16.340969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=20 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:16.403947 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0e602e95-5c64-45e1-8f4d-4c7e3a3d3bab tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "DELETE /compute/v2.1/images/b62ae338-98ed-450b-91d0-c71ef958d32e" status: 204 len: 0 microversion: 2.1 time: 0.858347 Jul 25 12:44:16.405070 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 836/1588] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:15 2022] DELETE /compute/v2.1/images/b62ae338-98ed-450b-91d0-c71ef958d32e => generated 0 bytes in 860 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:16.413411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d660fbe5-20b8-4ea7-8f6c-03da5528728e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:16.414854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d660fbe5-20b8-4ea7-8f6c-03da5528728e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:16.455905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d660fbe5-20b8-4ea7-8f6c-03da5528728e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:16.456728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d660fbe5-20b8-4ea7-8f6c-03da5528728e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:16.458925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d660fbe5-20b8-4ea7-8f6c-03da5528728e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:16.459614 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d660fbe5-20b8-4ea7-8f6c-03da5528728e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:16.478827 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-aabe0d77-99f2-4e3b-a375-f8628fd81ee8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:16.496548 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aabe0d77-99f2-4e3b-a375-f8628fd81ee8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1506 microversion: 2.1 time: 0.536330 Jul 25 12:44:16.497471 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 753/1589] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:15 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1506 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:16.502133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9a02d392-5dcb-4bd5-8253-4f0ccb608f0e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:16.502745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9a02d392-5dcb-4bd5-8253-4f0ccb608f0e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:16.513475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a02d392-5dcb-4bd5-8253-4f0ccb608f0e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:16.513948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a02d392-5dcb-4bd5-8253-4f0ccb608f0e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:16.514910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a02d392-5dcb-4bd5-8253-4f0ccb608f0e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:16.515655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a02d392-5dcb-4bd5-8253-4f0ccb608f0e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:17.095654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d660fbe5-20b8-4ea7-8f6c-03da5528728e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:17.160968 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d660fbe5-20b8-4ea7-8f6c-03da5528728e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1210 microversion: 2.1 time: 0.753910 Jul 25 12:44:17.181244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9a02d392-5dcb-4bd5-8253-4f0ccb608f0e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:17.181891 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 837/1590] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:16 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1210 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:17.196112 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9a02d392-5dcb-4bd5-8253-4f0ccb608f0e tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 200 len: 1469 microversion: 2.1 time: 0.697509 Jul 25 12:44:17.196713 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 754/1591] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:16 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 1469 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:17.201442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f8a91159-3b3c-4c2d-953d-f8edf5df7c96 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcfed275e0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:17.206857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1181b698-9ac9-4c6e-8552-e7bf37c46f26 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:17.207654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1181b698-9ac9-4c6e-8552-e7bf37c46f26 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: ce1a79d3-137b-485c-9757-bfa73c2dfbfb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:17.235938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1181b698-9ac9-4c6e-8552-e7bf37c46f26 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:17.236401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1181b698-9ac9-4c6e-8552-e7bf37c46f26 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:17.237212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1181b698-9ac9-4c6e-8552-e7bf37c46f26 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:17.246280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1181b698-9ac9-4c6e-8552-e7bf37c46f26 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:18.001058 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f8a91159-3b3c-4c2d-953d-f8edf5df7c96 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "DELETE /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c" status: 204 len: 0 microversion: 2.1 time: 0.802875 Jul 25 12:44:18.001994 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 755/1592] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:17 2022] DELETE /compute/v2.1/images/f7947faf-f20a-470d-abbe-00eda52c1c0c => generated 0 bytes in 805 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:18.028722 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d22c9a60-30e4-4325-b75e-bf27d413586e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:18.030385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d22c9a60-30e4-4325-b75e-bf27d413586e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 965438e3-72fa-44e0-90fa-4fb0b24042ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:18.044305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d22c9a60-30e4-4325-b75e-bf27d413586e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:18.045225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d22c9a60-30e4-4325-b75e-bf27d413586e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:18.048398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d22c9a60-30e4-4325-b75e-bf27d413586e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:18.049055 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d22c9a60-30e4-4325-b75e-bf27d413586e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:18.185648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1181b698-9ac9-4c6e-8552-e7bf37c46f26 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:18.194954 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1181b698-9ac9-4c6e-8552-e7bf37c46f26 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/ce1a79d3-137b-485c-9757-bfa73c2dfbfb" status: 200 len: 1474 microversion: 2.1 time: 1.011617 Jul 25 12:44:18.216654 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 838/1593] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:17 2022] GET /compute/v2.1/servers/ce1a79d3-137b-485c-9757-bfa73c2dfbfb => generated 1474 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:18.216654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-9881d4d9-0632-46a9-bac8-fc00e142b431 req-5ac6f3b0-bd00-4fa0-8c2a-77323d26d6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6bb4f7e-67c3-4c86-8e69-92fd4061e26d", "name": "network-vif-plugged", "status": "completed", "tag": "b55028ef-4d91-4ac2-a60c-3406cbca7db4"}, {"server_uuid": "7eb5975b-24da-4318-90ce-bd3b7d0d01f2", "name": "network-vif-plugged", "status": "completed", "tag": "0012b1f8-03b2-4861-88f2-461bdd29f4d1"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:18.248386 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9881d4d9-0632-46a9-bac8-fc00e142b431 req-5ac6f3b0-bd00-4fa0-8c2a-77323d26d6f4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:18.248955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9881d4d9-0632-46a9-bac8-fc00e142b431 req-5ac6f3b0-bd00-4fa0-8c2a-77323d26d6f4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:18.275215 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-9881d4d9-0632-46a9-bac8-fc00e142b431 req-5ac6f3b0-bd00-4fa0-8c2a-77323d26d6f4 service nova] Creating event network-vif-plugged:b55028ef-4d91-4ac2-a60c-3406cbca7db4 for instance c6bb4f7e-67c3-4c86-8e69-92fd4061e26d on n-h2-848886-15 Jul 25 12:44:18.276378 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-9881d4d9-0632-46a9-bac8-fc00e142b431 req-5ac6f3b0-bd00-4fa0-8c2a-77323d26d6f4 service nova] Creating event network-vif-plugged:0012b1f8-03b2-4861-88f2-461bdd29f4d1 for instance 7eb5975b-24da-4318-90ce-bd3b7d0d01f2 on n-h2-848886-15 Jul 25 12:44:18.291916 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-9881d4d9-0632-46a9-bac8-fc00e142b431 req-5ac6f3b0-bd00-4fa0-8c2a-77323d26d6f4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083551 Jul 25 12:44:18.293118 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 839/1594] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:18.298803 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3f90451b-5c50-4d27-9f68-b0e8884bba48 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:18.314538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3f90451b-5c50-4d27-9f68-b0e8884bba48 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:18.321732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f90451b-5c50-4d27-9f68-b0e8884bba48 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:18.322616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f90451b-5c50-4d27-9f68-b0e8884bba48 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:18.323629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f90451b-5c50-4d27-9f68-b0e8884bba48 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:18.324284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f90451b-5c50-4d27-9f68-b0e8884bba48 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:19.173495 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d22c9a60-30e4-4325-b75e-bf27d413586e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:19.185482 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d22c9a60-30e4-4325-b75e-bf27d413586e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff" status: 200 len: 1313 microversion: 2.1 time: 1.174815 Jul 25 12:44:19.186710 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 756/1595] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:18 2022] GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff => generated 1313 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:19.194433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-86f571a0-e768-4073-b6b6-9b483a1de4ff tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:19.195605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-86f571a0-e768-4073-b6b6-9b483a1de4ff tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:19.203923 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86f571a0-e768-4073-b6b6-9b483a1de4ff tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:19.204619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86f571a0-e768-4073-b6b6-9b483a1de4ff tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:19.205793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86f571a0-e768-4073-b6b6-9b483a1de4ff tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:19.207013 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86f571a0-e768-4073-b6b6-9b483a1de4ff tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:19.299056 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3f90451b-5c50-4d27-9f68-b0e8884bba48 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:19.315668 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3f90451b-5c50-4d27-9f68-b0e8884bba48 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:19.324384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3f90451b-5c50-4d27-9f68-b0e8884bba48 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:19.334954 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3f90451b-5c50-4d27-9f68-b0e8884bba48 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1485 microversion: 2.25 time: 1.040253 Jul 25 12:44:19.335576 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 840/1596] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:18 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1485 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:19.365415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e3901f27-40d8-45d5-a6b0-efda7fd81192 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9d55700>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:19.884190 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-86f571a0-e768-4073-b6b6-9b483a1de4ff tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:19.892524 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-86f571a0-e768-4073-b6b6-9b483a1de4ff tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1506 microversion: 2.1 time: 0.704448 Jul 25 12:44:19.893978 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 757/1597] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:19 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1506 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:19.912691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e4cdda0a-f583-42d5-a32c-1fb833dd984e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:19.914350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e4cdda0a-f583-42d5-a32c-1fb833dd984e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:19.933679 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4cdda0a-f583-42d5-a32c-1fb833dd984e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:19.934412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4cdda0a-f583-42d5-a32c-1fb833dd984e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:19.936504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4cdda0a-f583-42d5-a32c-1fb833dd984e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:19.937871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4cdda0a-f583-42d5-a32c-1fb833dd984e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.226416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e4cdda0a-f583-42d5-a32c-1fb833dd984e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:20.242228 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e4cdda0a-f583-42d5-a32c-1fb833dd984e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1198 microversion: 2.1 time: 0.344485 Jul 25 12:44:20.242969 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 758/1598] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:19 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1198 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:20.265939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bea291ee-170f-4329-af6a-185b706d9620 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:20.267602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bea291ee-170f-4329-af6a-185b706d9620 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 7eb5975b-24da-4318-90ce-bd3b7d0d01f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:20.275062 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bea291ee-170f-4329-af6a-185b706d9620 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:20.276054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bea291ee-170f-4329-af6a-185b706d9620 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.278233 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bea291ee-170f-4329-af6a-185b706d9620 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:20.279008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bea291ee-170f-4329-af6a-185b706d9620 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.300086 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-bea291ee-170f-4329-af6a-185b706d9620 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] HTTP exception thrown: Instance 7eb5975b-24da-4318-90ce-bd3b7d0d01f2 could not be found. Jul 25 12:44:20.302095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bea291ee-170f-4329-af6a-185b706d9620 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Request method failure captured: Jul 25 12:44:20.302095 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 HTTP/1.1 Jul 25 12:44:20.302095 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:44:20.302095 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:44:20.302095 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:44:20.302095 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:44:20.302095 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:44:20.302095 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:44:20.302095 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:44:20.302095 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:20.302095 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7Tz0O7SSTbmDl0Z_49fiVulE4u2IVHWtJX8IhZRzdeY3RfzT5cF6XlRwH6pcEa6bCZXczC1oDltEE_WwkEgjlsc4Dn4JO42YSJ3wN5AuONFw1-5ANhhWBomhlw3yEv_CGvFeDIla6_OTsCNCdBF1OoYRpAauJXL0o5ty9W2TEu2BQ Jul 25 12:44:20.302095 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:44:20.302095 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:44:20.302095 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:44:20.302095 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:44:20.302095 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:44:20.302095 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:44:20.302095 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 5220cb7ebe7b4a89a8d1edabad2391a7 Jul 25 12:44:20.302095 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-MigrationsAdminTest-1010123982 Jul 25 12:44:20.302095 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:44:20.302095 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:44:20.303649 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5220cb7ebe7b4a89a8d1edabad2391a7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5220cb7ebe7b4a89a8d1edabad2391a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5220cb7ebe7b4a89a8d1edabad2391a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5220cb7ebe7b4a89a8d1edabad2391a7"}]}] Jul 25 12:44:20.303649 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-MigrationsAdminTest-1010123982 Jul 25 12:44:20.303649 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 5220cb7ebe7b4a89a8d1edabad2391a7 Jul 25 12:44:20.303649 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-MigrationsAdminTest-1010123982 Jul 25 12:44:20.303649 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-MigrationsAdminTest-1010123982-project Jul 25 12:44:20.303649 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:44:20.303649 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:44:20.303649 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 045d03491c1046609caffee111db48fc Jul 25 12:44:20.303649 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-MigrationsAdminTest-1010123982-project Jul 25 12:44:20.303649 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:44:20.303649 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 7eb5975b-24da-4318-90ce-bd3b7d0d01f2 could not be found. Jul 25 12:44:20.303649 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '7eb5975b-24da-4318-90ce-bd3b7d0d01f2'} Jul 25 12:44:20.304505 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:20.304505 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:20.304505 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:44:20.304505 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:44:20.304505 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:44:20.304505 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:44:20.304505 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:44:20.304505 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:44:20.304505 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:44:20.304505 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:44:20.304505 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eb5975b-24da-4318-90ce-bd3b7d0d01f2 could not be found. Jul 25 12:44:20.304505 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:20.304505 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:20.304505 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:20.304505 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:20.304505 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:20.304505 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:20.304505 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:20.304505 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:20.304505 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:20.305776 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:20.305776 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:44:20.305776 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:44:20.305776 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:44:20.305776 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:44:20.305776 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:44:20.305776 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:44:20.305776 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eb5975b-24da-4318-90ce-bd3b7d0d01f2 could not be found. Jul 25 12:44:20.305776 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:20.305776 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:20.305776 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:20.305776 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:20.305776 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:20.305776 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:20.305776 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:20.305776 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:20.305776 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eb5975b-24da-4318-90ce-bd3b7d0d01f2 could not be found. Jul 25 12:44:20.305776 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:20.308860 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bea291ee-170f-4329-af6a-185b706d9620 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Returning 404 to user: Instance 7eb5975b-24da-4318-90ce-bd3b7d0d01f2 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:20.309972 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bea291ee-170f-4329-af6a-185b706d9620 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2" status: 404 len: 111 microversion: 2.1 time: 0.050220 Jul 25 12:44:20.311241 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 759/1599] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:20 2022] GET /compute/v2.1/servers/7eb5975b-24da-4318-90ce-bd3b7d0d01f2 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:44:20.317158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-9a56c480-33b0-427b-9a17-cd032c201e9d req-f563b8df-8bb0-4e4d-b126-d09b376d401e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb5975b-24da-4318-90ce-bd3b7d0d01f2", "name": "network-vif-deleted", "tag": "0012b1f8-03b2-4861-88f2-461bdd29f4d1"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:20.329518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-9a56c480-33b0-427b-9a17-cd032c201e9d req-f563b8df-8bb0-4e4d-b126-d09b376d401e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:20.330372 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-9a56c480-33b0-427b-9a17-cd032c201e9d req-f563b8df-8bb0-4e4d-b126-d09b376d401e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.345387 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-9a56c480-33b0-427b-9a17-cd032c201e9d req-f563b8df-8bb0-4e4d-b126-d09b376d401e service nova] Creating event network-vif-deleted:0012b1f8-03b2-4861-88f2-461bdd29f4d1 for instance 7eb5975b-24da-4318-90ce-bd3b7d0d01f2 on n-h2-848886-15 Jul 25 12:44:20.351474 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-9a56c480-33b0-427b-9a17-cd032c201e9d req-f563b8df-8bb0-4e4d-b126-d09b376d401e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038666 Jul 25 12:44:20.356649 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 760/1600] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:20.362734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-fe77d782-9a54-4d42-9ba4-6f84cae14efe req-097130dc-c56d-4538-8580-9ad8c32cb1df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662e780d-2f9d-4eeb-9323-978b7679d299", "name": "network-vif-deleted", "tag": "8b7db3fa-056f-4964-8cb9-66f5bb712514"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:20.375461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fe77d782-9a54-4d42-9ba4-6f84cae14efe req-097130dc-c56d-4538-8580-9ad8c32cb1df service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:20.376374 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fe77d782-9a54-4d42-9ba4-6f84cae14efe req-097130dc-c56d-4538-8580-9ad8c32cb1df service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.392772 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-fe77d782-9a54-4d42-9ba4-6f84cae14efe req-097130dc-c56d-4538-8580-9ad8c32cb1df service nova] Creating event network-vif-deleted:8b7db3fa-056f-4964-8cb9-66f5bb712514 for instance 662e780d-2f9d-4eeb-9323-978b7679d299 on n-h1-848886-15 Jul 25 12:44:20.401339 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-fe77d782-9a54-4d42-9ba4-6f84cae14efe req-097130dc-c56d-4538-8580-9ad8c32cb1df service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043370 Jul 25 12:44:20.404716 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 761/1601] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:20.413215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7bfa3cad-1235-49d8-8391-ac562b7b08b4 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:20.414342 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7bfa3cad-1235-49d8-8391-ac562b7b08b4 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: ce1a79d3-137b-485c-9757-bfa73c2dfbfb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:20.424037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7bfa3cad-1235-49d8-8391-ac562b7b08b4 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:20.424851 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7bfa3cad-1235-49d8-8391-ac562b7b08b4 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.425946 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7bfa3cad-1235-49d8-8391-ac562b7b08b4 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:20.426599 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7bfa3cad-1235-49d8-8391-ac562b7b08b4 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.476531 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e3901f27-40d8-45d5-a6b0-efda7fd81192 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "DELETE /compute/v2.1/images/77580041-bccb-4492-803a-43484ed1a352" status: 204 len: 0 microversion: 2.1 time: 1.127277 Jul 25 12:44:20.477173 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 841/1602] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:19 2022] DELETE /compute/v2.1/images/77580041-bccb-4492-803a-43484ed1a352 => generated 0 bytes in 1131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:20.484168 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-92bb1eba-2b3c-4bc4-a1b3-bc1c07b33bad tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:20.485811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-92bb1eba-2b3c-4bc4-a1b3-bc1c07b33bad tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 965438e3-72fa-44e0-90fa-4fb0b24042ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:20.509646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-92bb1eba-2b3c-4bc4-a1b3-bc1c07b33bad tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:20.510068 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7bfa3cad-1235-49d8-8391-ac562b7b08b4 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:20.510286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-92bb1eba-2b3c-4bc4-a1b3-bc1c07b33bad tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.510732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7bfa3cad-1235-49d8-8391-ac562b7b08b4 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.511233 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-92bb1eba-2b3c-4bc4-a1b3-bc1c07b33bad tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:20.511362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-7bfa3cad-1235-49d8-8391-ac562b7b08b4 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lazy-loading 'fault' on Instance uuid ce1a79d3-137b-485c-9757-bfa73c2dfbfb {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:44:20.511674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-92bb1eba-2b3c-4bc4-a1b3-bc1c07b33bad tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.558211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7bfa3cad-1235-49d8-8391-ac562b7b08b4 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:20.567688 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7bfa3cad-1235-49d8-8391-ac562b7b08b4 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/ce1a79d3-137b-485c-9757-bfa73c2dfbfb" status: 200 len: 1308 microversion: 2.1 time: 0.161447 Jul 25 12:44:20.574451 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 762/1603] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:20 2022] GET /compute/v2.1/servers/ce1a79d3-137b-485c-9757-bfa73c2dfbfb => generated 1308 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:20.579972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c9ecc734-0556-491c-a4be-2c34c1a6595a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:20.584928 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c9ecc734-0556-491c-a4be-2c34c1a6595a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:20.596675 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c9ecc734-0556-491c-a4be-2c34c1a6595a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:20.602422 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c9ecc734-0556-491c-a4be-2c34c1a6595a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.603432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c9ecc734-0556-491c-a4be-2c34c1a6595a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:20.604257 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c9ecc734-0556-491c-a4be-2c34c1a6595a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.646846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c9ecc734-0556-491c-a4be-2c34c1a6595a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:44:20.729216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-92bb1eba-2b3c-4bc4-a1b3-bc1c07b33bad tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:20.736015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:20.738355 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-92bb1eba-2b3c-4bc4-a1b3-bc1c07b33bad tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff" status: 200 len: 1463 microversion: 2.1 time: 0.259271 Jul 25 12:44:20.738956 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 842/1604] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:20 2022] GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff => generated 1463 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:20.745052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-766c0993-758b-4848-91cd-8e7baab2d124 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:20.745916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-766c0993-758b-4848-91cd-8e7baab2d124 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:20.752367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-766c0993-758b-4848-91cd-8e7baab2d124 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:20.753041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-766c0993-758b-4848-91cd-8e7baab2d124 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.754055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-766c0993-758b-4848-91cd-8e7baab2d124 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:20.754668 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-766c0993-758b-4848-91cd-8e7baab2d124 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.779632 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c9ecc734-0556-491c-a4be-2c34c1a6595a tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 204 len: 0 microversion: 2.1 time: 0.203305 Jul 25 12:44:20.781948 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 763/1605] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:44:20 2022] DELETE /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:20.789181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-27c49442-dfb1-4de6-88f1-54db5e047ede tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:20.790219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-27c49442-dfb1-4de6-88f1-54db5e047ede tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:20.798888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27c49442-dfb1-4de6-88f1-54db5e047ede tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:20.799514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27c49442-dfb1-4de6-88f1-54db5e047ede tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.800631 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27c49442-dfb1-4de6-88f1-54db5e047ede tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:20.801090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27c49442-dfb1-4de6-88f1-54db5e047ede tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.839998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-27c49442-dfb1-4de6-88f1-54db5e047ede tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:44:20.909863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-766c0993-758b-4848-91cd-8e7baab2d124 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:20.920819 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-766c0993-758b-4848-91cd-8e7baab2d124 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:20.922875 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-766c0993-758b-4848-91cd-8e7baab2d124 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:20.924548 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-766c0993-758b-4848-91cd-8e7baab2d124 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1485 microversion: 2.25 time: 0.183262 Jul 25 12:44:20.925635 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 843/1606] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:20 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1485 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:20.930643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-01d9a5f2-f492-4d7c-a6c1-33a0fb3c11cc tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:20.931259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-01d9a5f2-f492-4d7c-a6c1-33a0fb3c11cc tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:20.939005 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01d9a5f2-f492-4d7c-a6c1-33a0fb3c11cc tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:20.939692 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01d9a5f2-f492-4d7c-a6c1-33a0fb3c11cc tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.940704 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01d9a5f2-f492-4d7c-a6c1-33a0fb3c11cc tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:20.941313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01d9a5f2-f492-4d7c-a6c1-33a0fb3c11cc tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.954427 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-27c49442-dfb1-4de6-88f1-54db5e047ede tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 204 len: 0 microversion: 2.1 time: 0.170324 Jul 25 12:44:20.957229 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 764/1607] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:44:20 2022] DELETE /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:20.966948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-da9ee921-f1e4-4fe0-9983-f714f66fa22b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:20.967852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-da9ee921-f1e4-4fe0-9983-f714f66fa22b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:20.975687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da9ee921-f1e4-4fe0-9983-f714f66fa22b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:20.976409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da9ee921-f1e4-4fe0-9983-f714f66fa22b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.977438 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da9ee921-f1e4-4fe0-9983-f714f66fa22b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:20.978051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da9ee921-f1e4-4fe0-9983-f714f66fa22b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.997036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:21.182713 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-01d9a5f2-f492-4d7c-a6c1-33a0fb3c11cc tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:21.187328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-da9ee921-f1e4-4fe0-9983-f714f66fa22b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:21.191722 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-01d9a5f2-f492-4d7c-a6c1-33a0fb3c11cc tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1463 microversion: 2.1 time: 0.264664 Jul 25 12:44:21.192473 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 844/1608] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:20 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1463 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:21.205968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f486c79c-e8fb-4fa4-87ee-2733c337275a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:21.205968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f486c79c-e8fb-4fa4-87ee-2733c337275a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:21.205968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f486c79c-e8fb-4fa4-87ee-2733c337275a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:21.205968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f486c79c-e8fb-4fa4-87ee-2733c337275a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:21.206854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f486c79c-e8fb-4fa4-87ee-2733c337275a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:21.206854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f486c79c-e8fb-4fa4-87ee-2733c337275a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:21.215378 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-da9ee921-f1e4-4fe0-9983-f714f66fa22b tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1532 microversion: 2.1 time: 0.256437 Jul 25 12:44:21.216495 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 765/1609] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:20 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1532 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:21.221845 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9601beba-930f-40a5-b589-12bcfb674279 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:21.222472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9601beba-930f-40a5-b589-12bcfb674279 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:21.229234 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9601beba-930f-40a5-b589-12bcfb674279 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:21.230369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9601beba-930f-40a5-b589-12bcfb674279 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:21.231357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9601beba-930f-40a5-b589-12bcfb674279 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:21.231947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9601beba-930f-40a5-b589-12bcfb674279 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:21.421183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f486c79c-e8fb-4fa4-87ee-2733c337275a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:21.429307 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f486c79c-e8fb-4fa4-87ee-2733c337275a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1506 microversion: 2.1 time: 0.235744 Jul 25 12:44:21.430103 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 845/1610] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:21 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:21.436531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9601beba-930f-40a5-b589-12bcfb674279 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:21.444770 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9601beba-930f-40a5-b589-12bcfb674279 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1473 microversion: 2.1 time: 0.227300 Jul 25 12:44:21.445350 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 766/1611] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:21 2022] GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1473 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:21.450051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cd707e50-e692-486a-84b8-984e30454521 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:21.450713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cd707e50-e692-486a-84b8-984e30454521 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:21.458088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd707e50-e692-486a-84b8-984e30454521 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:21.458619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd707e50-e692-486a-84b8-984e30454521 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:21.460043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd707e50-e692-486a-84b8-984e30454521 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:21.460656 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd707e50-e692-486a-84b8-984e30454521 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:21.548324 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b4bf0775-a3e6-4f2f-ad21-92aa33c25aba tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] 10.222.0.49 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.117347 Jul 25 12:44:21.549508 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 846/1612] 10.222.0.49 () {58 vars in 1128 bytes} [Mon Jul 25 12:44:21 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 12:44:21.554131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-672e90f3-4cb8-4337-b1e3-551c2c0203be tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-501146311", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "c6bb4f7e-67c3-4c86-8e69-92fd4061e26d"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:21.605118 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cd707e50-e692-486a-84b8-984e30454521 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:21.609974 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-672e90f3-4cb8-4337-b1e3-551c2c0203be tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] validate_networks() for None {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:44:21.613163 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cd707e50-e692-486a-84b8-984e30454521 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1198 microversion: 2.1 time: 0.166627 Jul 25 12:44:21.613936 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 767/1613] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:21 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1198 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:21.618532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-363faa98-766d-4f4c-aca5-0c41b8ee6615 tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] Calling method '.version_select at 0x7efcf9d118b0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:21.639726 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-363faa98-766d-4f4c-aca5-0c41b8ee6615 tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] HTTP exception thrown: Image not found. Jul 25 12:44:21.641691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-363faa98-766d-4f4c-aca5-0c41b8ee6615 tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] Request method failure captured: Jul 25 12:44:21.641691 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 25 12:44:21.641691 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:44:21.641691 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:44:21.641691 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:44:21.641691 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:44:21.641691 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:44:21.641691 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:44:21.641691 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:44:21.641691 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:21.641691 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pAk_pkqN1xBc50nZf5I-epPQisVhACnN87y2snqBnS_XaqFQ5apITlp2-fkpCB3JIafvJMTjbAOodWE8hEtWdK-UHq3CTLt3Fvx1NWjVxm5MvFStx9k8ZE791eRhXrSKdEujq0MRzD7G1JjIZ7neJhYW6MLAoMt3MQ_H4ZxQd5fPYk Jul 25 12:44:21.641691 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:44:21.641691 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:44:21.641691 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:44:21.641691 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:44:21.641691 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:44:21.641691 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:44:21.641691 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 39446837d42047109a62376b7b153c68 Jul 25 12:44:21.641691 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-405851957 Jul 25 12:44:21.641691 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:44:21.641691 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:44:21.643447 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_39446837d42047109a62376b7b153c68", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/39446837d42047109a62376b7b153c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/39446837d42047109a62376b7b153c68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/39446837d42047109a62376b7b153c68"}]}] Jul 25 12:44:21.643447 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-405851957 Jul 25 12:44:21.643447 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 39446837d42047109a62376b7b153c68 Jul 25 12:44:21.643447 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-405851957 Jul 25 12:44:21.643447 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ImagesDeleteNegativeTestJSON-405851957-project Jul 25 12:44:21.643447 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:44:21.643447 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:44:21.643447 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 22bef1af4cf54ced80a91c261990ad82 Jul 25 12:44:21.643447 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-405851957-project Jul 25 12:44:21.643447 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:44:21.643447 n-d-848886-15 devstack@n-api.service[125883]: exception: Image not found. Jul 25 12:44:21.643447 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '-1'} Jul 25 12:44:21.643447 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:21.643447 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:21.644626 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 12:44:21.644626 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 12:44:21.644626 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:44:21.644626 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:44:21.644626 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:44:21.644626 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:44:21.644626 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 12:44:21.644626 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 12:44:21.644626 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 12:44:21.644626 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 12:44:21.644626 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:44:21.644626 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:44:21.644626 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:44:21.644626 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:44:21.644626 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 25 12:44:21.644626 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.644626 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:21.644626 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.644626 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:21.646047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 12:44:21.646047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 12:44:21.646047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 12:44:21.646047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 12:44:21.646047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 12:44:21.646047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 12:44:21.646047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 25 12:44:21.646047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.646047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:21.646047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.646047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:21.646047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:21.646047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:21.646047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:21.646047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:21.646047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:44:21.646047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:44:21.646047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:21.646047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:21.646047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 12:44:21.647682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 12:44:21.647682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 12:44:21.647682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.647682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:21.647682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.647682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:21.647682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:21.647682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:21.647682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:21.647682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:21.647682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 12:44:21.647682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.647682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-363faa98-766d-4f4c-aca5-0c41b8ee6615 tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] Returning 404 to user: Image not found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:21.647682 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-363faa98-766d-4f4c-aca5-0c41b8ee6615 tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] 10.222.0.49 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.028433 Jul 25 12:44:21.647682 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 768/1614] 10.222.0.49 () {58 vars in 1134 bytes} [Mon Jul 25 12:44:21 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:44:21.651771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-32795a84-4b40-45ae-b556-db479a730e69 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:21.652381 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-32795a84-4b40-45ae-b556-db479a730e69 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: ce1a79d3-137b-485c-9757-bfa73c2dfbfb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:21.660904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-32795a84-4b40-45ae-b556-db479a730e69 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:21.661352 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-32795a84-4b40-45ae-b556-db479a730e69 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:21.662144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-32795a84-4b40-45ae-b556-db479a730e69 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:21.662577 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-32795a84-4b40-45ae-b556-db479a730e69 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:21.679656 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-32795a84-4b40-45ae-b556-db479a730e69 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] HTTP exception thrown: Instance ce1a79d3-137b-485c-9757-bfa73c2dfbfb could not be found. Jul 25 12:44:21.681261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-32795a84-4b40-45ae-b556-db479a730e69 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Request method failure captured: Jul 25 12:44:21.681261 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/ce1a79d3-137b-485c-9757-bfa73c2dfbfb HTTP/1.1 Jul 25 12:44:21.681261 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:44:21.681261 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:44:21.681261 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:44:21.681261 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:44:21.681261 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:44:21.681261 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:44:21.681261 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:44:21.681261 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:21.681261 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o9FI8xGtqP7_CW35BbEF7ISywkY3QBKklr5o1CS_fq6Lx6g68HVW9d3S-CvFf3EFHQ-I9augL8LNHoHSZQ7fotgZGp7jb0rcywXJ-uNBD0-jX_Y0mC9RxTzXhF95_ckH46T5WFeX6UZGziPb5X1dUcODvmDxxrVOVDn9AvlAmcUOhI Jul 25 12:44:21.681261 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:44:21.681261 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:44:21.681261 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:44:21.681261 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:44:21.681261 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:44:21.681261 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:44:21.681261 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 5c81a97dfca44bf6af64fdcd5d50c549 Jul 25 12:44:21.681261 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:44:21.681261 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:44:21.681261 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:44:21.682984 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5c81a97dfca44bf6af64fdcd5d50c549", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5c81a97dfca44bf6af64fdcd5d50c549"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c81a97dfca44bf6af64fdcd5d50c549"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c81a97dfca44bf6af64fdcd5d50c549"}]}] Jul 25 12:44:21.682984 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:44:21.682984 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 5c81a97dfca44bf6af64fdcd5d50c549 Jul 25 12:44:21.682984 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:44:21.682984 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersOnMultiNodesTest-1957362714-project Jul 25 12:44:21.682984 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:44:21.682984 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:44:21.682984 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8c296447c2254c048f94bd9f186b0097 Jul 25 12:44:21.682984 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersOnMultiNodesTest-1957362714-project Jul 25 12:44:21.682984 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:44:21.682984 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance ce1a79d3-137b-485c-9757-bfa73c2dfbfb could not be found. Jul 25 12:44:21.682984 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'ce1a79d3-137b-485c-9757-bfa73c2dfbfb'} Jul 25 12:44:21.684038 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:21.684038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:21.684038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:44:21.684038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:44:21.684038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:44:21.684038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:44:21.684038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:44:21.684038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:44:21.684038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:44:21.684038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:44:21.684038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce1a79d3-137b-485c-9757-bfa73c2dfbfb could not be found. Jul 25 12:44:21.684038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.684038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:21.684038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.684038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:21.684038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:21.684038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:21.684038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:21.684038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:21.684038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:21.685737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:21.685737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:44:21.685737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:44:21.685737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:44:21.685737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:44:21.685737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:44:21.685737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:44:21.685737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce1a79d3-137b-485c-9757-bfa73c2dfbfb could not be found. Jul 25 12:44:21.685737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.685737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:21.685737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.685737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:21.685737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:21.685737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:21.685737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:21.685737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:21.685737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce1a79d3-137b-485c-9757-bfa73c2dfbfb could not be found. Jul 25 12:44:21.685737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.687361 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-32795a84-4b40-45ae-b556-db479a730e69 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Returning 404 to user: Instance ce1a79d3-137b-485c-9757-bfa73c2dfbfb could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:21.687361 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-32795a84-4b40-45ae-b556-db479a730e69 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/ce1a79d3-137b-485c-9757-bfa73c2dfbfb" status: 404 len: 111 microversion: 2.1 time: 0.037352 Jul 25 12:44:21.687361 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 769/1615] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:21 2022] GET /compute/v2.1/servers/ce1a79d3-137b-485c-9757-bfa73c2dfbfb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:44:21.690190 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e6375c16-2373-4446-9ddb-973dff721a7e tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] Calling method '.version_select at 0x7efcfed270d0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:21.712733 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-e6375c16-2373-4446-9ddb-973dff721a7e tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] HTTP exception thrown: Image not found. Jul 25 12:44:21.714679 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e6375c16-2373-4446-9ddb-973dff721a7e tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] Request method failure captured: Jul 25 12:44:21.714679 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/images/18fc2850-40d8-4476-9c81-80e04ffeea1j HTTP/1.1 Jul 25 12:44:21.714679 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:44:21.714679 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:44:21.714679 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:44:21.714679 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:44:21.714679 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:44:21.714679 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:44:21.714679 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:44:21.714679 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:21.714679 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pAk_pkqN1xBc50nZf5I-epPQisVhACnN87y2snqBnS_XaqFQ5apITlp2-fkpCB3JIafvJMTjbAOodWE8hEtWdK-UHq3CTLt3Fvx1NWjVxm5MvFStx9k8ZE791eRhXrSKdEujq0MRzD7G1JjIZ7neJhYW6MLAoMt3MQ_H4ZxQd5fPYk Jul 25 12:44:21.714679 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:44:21.714679 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:44:21.714679 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:44:21.714679 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:44:21.714679 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:44:21.714679 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:44:21.714679 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 39446837d42047109a62376b7b153c68 Jul 25 12:44:21.714679 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-405851957 Jul 25 12:44:21.714679 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:44:21.714679 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:44:21.716348 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_39446837d42047109a62376b7b153c68", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/39446837d42047109a62376b7b153c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/39446837d42047109a62376b7b153c68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/39446837d42047109a62376b7b153c68"}]}] Jul 25 12:44:21.716348 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-405851957 Jul 25 12:44:21.716348 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 39446837d42047109a62376b7b153c68 Jul 25 12:44:21.716348 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-405851957 Jul 25 12:44:21.716348 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ImagesDeleteNegativeTestJSON-405851957-project Jul 25 12:44:21.716348 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:44:21.716348 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:44:21.716348 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 22bef1af4cf54ced80a91c261990ad82 Jul 25 12:44:21.716348 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-405851957-project Jul 25 12:44:21.716348 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:44:21.716348 n-d-848886-15 devstack@n-api.service[125883]: exception: Image not found. Jul 25 12:44:21.716348 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '18fc2850-40d8-4476-9c81-80e04ffeea1j'} Jul 25 12:44:21.716348 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:21.717257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:21.717257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 12:44:21.717257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 12:44:21.717257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:44:21.717257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:44:21.717257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:44:21.717257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:44:21.717257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 12:44:21.717257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 12:44:21.717257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 12:44:21.717257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 12:44:21.717257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:44:21.717257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:44:21.717257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:44:21.717257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:44:21.717257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 18fc2850-40d8-4476-9c81-80e04ffeea1j to delete Jul 25 12:44:21.717257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.717257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:21.717257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.718703 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:21.718703 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 12:44:21.718703 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 12:44:21.718703 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 12:44:21.718703 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 12:44:21.718703 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 12:44:21.718703 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 12:44:21.718703 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 18fc2850-40d8-4476-9c81-80e04ffeea1j could not be found. Jul 25 12:44:21.718703 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.718703 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:21.718703 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.718703 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:21.718703 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:21.718703 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:21.718703 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:21.718703 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:21.718703 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:44:21.718703 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:44:21.718703 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:21.718703 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:21.720053 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 12:44:21.720053 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 12:44:21.720053 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 12:44:21.720053 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.720053 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:21.720053 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.720053 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:21.720053 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:21.720053 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:21.720053 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:21.720053 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:21.720053 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 12:44:21.720053 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.720053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e6375c16-2373-4446-9ddb-973dff721a7e tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] Returning 404 to user: Image not found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:21.720053 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e6375c16-2373-4446-9ddb-973dff721a7e tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] 10.222.0.49 "DELETE /compute/v2.1/images/18fc2850-40d8-4476-9c81-80e04ffeea1j" status: 404 len: 62 microversion: 2.1 time: 0.031565 Jul 25 12:44:21.721286 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 770/1616] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:21 2022] DELETE /compute/v2.1/images/18fc2850-40d8-4476-9c81-80e04ffeea1j => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:44:21.721756 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-36827705-3791-4622-822b-413a577386bf tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:21.722306 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-36827705-3791-4622-822b-413a577386bf tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: 662e780d-2f9d-4eeb-9323-978b7679d299] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:21.730653 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36827705-3791-4622-822b-413a577386bf tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:21.731118 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36827705-3791-4622-822b-413a577386bf tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:21.732650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36827705-3791-4622-822b-413a577386bf tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:21.733096 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36827705-3791-4622-822b-413a577386bf tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:21.755372 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-36827705-3791-4622-822b-413a577386bf tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] HTTP exception thrown: Instance 662e780d-2f9d-4eeb-9323-978b7679d299 could not be found. Jul 25 12:44:21.756921 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-36827705-3791-4622-822b-413a577386bf tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Request method failure captured: Jul 25 12:44:21.756921 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299 HTTP/1.1 Jul 25 12:44:21.756921 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:44:21.756921 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:44:21.756921 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:44:21.756921 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:44:21.756921 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:44:21.756921 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:44:21.756921 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:44:21.756921 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:21.756921 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o9FI8xGtqP7_CW35BbEF7ISywkY3QBKklr5o1CS_fq6Lx6g68HVW9d3S-CvFf3EFHQ-I9augL8LNHoHSZQ7fotgZGp7jb0rcywXJ-uNBD0-jX_Y0mC9RxTzXhF95_ckH46T5WFeX6UZGziPb5X1dUcODvmDxxrVOVDn9AvlAmcUOhI Jul 25 12:44:21.756921 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:44:21.756921 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:44:21.756921 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:44:21.756921 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:44:21.756921 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:44:21.756921 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:44:21.756921 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 5c81a97dfca44bf6af64fdcd5d50c549 Jul 25 12:44:21.756921 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:44:21.756921 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:44:21.756921 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:44:21.758769 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5c81a97dfca44bf6af64fdcd5d50c549", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5c81a97dfca44bf6af64fdcd5d50c549"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c81a97dfca44bf6af64fdcd5d50c549"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c81a97dfca44bf6af64fdcd5d50c549"}]}] Jul 25 12:44:21.758769 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:44:21.758769 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 5c81a97dfca44bf6af64fdcd5d50c549 Jul 25 12:44:21.758769 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:44:21.758769 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersOnMultiNodesTest-1957362714-project Jul 25 12:44:21.758769 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:44:21.758769 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:44:21.758769 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8c296447c2254c048f94bd9f186b0097 Jul 25 12:44:21.758769 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersOnMultiNodesTest-1957362714-project Jul 25 12:44:21.758769 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:44:21.758769 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 662e780d-2f9d-4eeb-9323-978b7679d299 could not be found. Jul 25 12:44:21.758769 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '662e780d-2f9d-4eeb-9323-978b7679d299'} Jul 25 12:44:21.759844 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:21.759844 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:21.759844 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:44:21.759844 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:44:21.759844 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:44:21.759844 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:44:21.759844 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:44:21.759844 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:44:21.759844 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:44:21.759844 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:44:21.759844 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 662e780d-2f9d-4eeb-9323-978b7679d299 could not be found. Jul 25 12:44:21.759844 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.759844 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:21.759844 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.759844 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:21.759844 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:21.759844 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:21.759844 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:21.759844 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:21.759844 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:21.761225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:21.761225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:44:21.761225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:44:21.761225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:44:21.761225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:44:21.761225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:44:21.761225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:44:21.761225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 662e780d-2f9d-4eeb-9323-978b7679d299 could not be found. Jul 25 12:44:21.761225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.761225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:21.761225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.761225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:21.761225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:21.761225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:21.761225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:21.761225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:21.761225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 662e780d-2f9d-4eeb-9323-978b7679d299 could not be found. Jul 25 12:44:21.761225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.762595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-36827705-3791-4622-822b-413a577386bf tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Returning 404 to user: Instance 662e780d-2f9d-4eeb-9323-978b7679d299 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:21.762595 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-36827705-3791-4622-822b-413a577386bf tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299" status: 404 len: 111 microversion: 2.1 time: 0.040807 Jul 25 12:44:21.762595 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 771/1617] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:21 2022] GET /compute/v2.1/servers/662e780d-2f9d-4eeb-9323-978b7679d299 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:44:21.764414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bf50927e-f827-4b52-9afe-2232fd1a19d2 tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] Calling method '.version_select at 0x7efcfed2b550>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:21.786855 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-bf50927e-f827-4b52-9afe-2232fd1a19d2 tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] HTTP exception thrown: Image not found. Jul 25 12:44:21.788589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bf50927e-f827-4b52-9afe-2232fd1a19d2 tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] Request method failure captured: Jul 25 12:44:21.788589 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/images/3bd41009-92d3-4820-bbc8-92372c7d6ea91 HTTP/1.1 Jul 25 12:44:21.788589 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:44:21.788589 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:44:21.788589 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:44:21.788589 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:44:21.788589 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:44:21.788589 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:44:21.788589 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:44:21.788589 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:21.788589 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pAk_pkqN1xBc50nZf5I-epPQisVhACnN87y2snqBnS_XaqFQ5apITlp2-fkpCB3JIafvJMTjbAOodWE8hEtWdK-UHq3CTLt3Fvx1NWjVxm5MvFStx9k8ZE791eRhXrSKdEujq0MRzD7G1JjIZ7neJhYW6MLAoMt3MQ_H4ZxQd5fPYk Jul 25 12:44:21.788589 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:44:21.788589 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:44:21.788589 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:44:21.788589 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:44:21.788589 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:44:21.788589 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:44:21.788589 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 39446837d42047109a62376b7b153c68 Jul 25 12:44:21.788589 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-405851957 Jul 25 12:44:21.788589 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:44:21.788589 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:44:21.790373 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_39446837d42047109a62376b7b153c68", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/39446837d42047109a62376b7b153c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/39446837d42047109a62376b7b153c68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/39446837d42047109a62376b7b153c68"}]}] Jul 25 12:44:21.790373 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-405851957 Jul 25 12:44:21.790373 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 39446837d42047109a62376b7b153c68 Jul 25 12:44:21.790373 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-405851957 Jul 25 12:44:21.790373 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ImagesDeleteNegativeTestJSON-405851957-project Jul 25 12:44:21.790373 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:44:21.790373 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:44:21.790373 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 22bef1af4cf54ced80a91c261990ad82 Jul 25 12:44:21.790373 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-405851957-project Jul 25 12:44:21.790373 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:44:21.790373 n-d-848886-15 devstack@n-api.service[125883]: exception: Image not found. Jul 25 12:44:21.790373 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '3bd41009-92d3-4820-bbc8-92372c7d6ea91'} Jul 25 12:44:21.790373 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:21.791476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:21.791476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 12:44:21.791476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 12:44:21.791476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:44:21.791476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:44:21.791476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:44:21.791476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:44:21.791476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 12:44:21.791476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 12:44:21.791476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 12:44:21.791476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 12:44:21.791476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:44:21.791476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:44:21.791476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:44:21.791476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:44:21.791476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3bd41009-92d3-4820-bbc8-92372c7d6ea91 to delete Jul 25 12:44:21.791476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.791476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:21.791476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.794835 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:21.794835 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 12:44:21.794835 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 12:44:21.794835 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 12:44:21.794835 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 12:44:21.794835 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 12:44:21.794835 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 12:44:21.794835 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3bd41009-92d3-4820-bbc8-92372c7d6ea91 could not be found. Jul 25 12:44:21.794835 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.794835 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:21.794835 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.794835 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:21.794835 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:21.794835 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:21.794835 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:21.794835 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:21.794835 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:44:21.794835 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:44:21.794835 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:21.794835 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:21.796818 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 12:44:21.796818 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 12:44:21.796818 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 12:44:21.796818 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.796818 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:21.796818 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.796818 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:21.796818 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:21.796818 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:21.796818 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:21.796818 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:21.796818 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 12:44:21.796818 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:21.796818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bf50927e-f827-4b52-9afe-2232fd1a19d2 tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] Returning 404 to user: Image not found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:21.796818 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bf50927e-f827-4b52-9afe-2232fd1a19d2 tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] 10.222.0.49 "DELETE /compute/v2.1/images/3bd41009-92d3-4820-bbc8-92372c7d6ea91" status: 404 len: 62 microversion: 2.1 time: 0.029793 Jul 25 12:44:21.798359 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 772/1618] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:44:21 2022] DELETE /compute/v2.1/images/3bd41009-92d3-4820-bbc8-92372c7d6ea91 => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:44:21.798359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-01989c0d-9755-497b-9e87-89ca739faffa tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:21.826563 n-d-848886-15 devstack@n-api.service[125883]: ERROR oslo.messaging._drivers.impl_rabbit [None req-01989c0d-9755-497b-9e87-89ca739faffa tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [89d26934-5c76-41fd-a21c-3bc08c3f5e0b] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 12:44:21.876564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-672e90f3-4cb8-4337-b1e3-551c2c0203be tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:44:21.877028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-672e90f3-4cb8-4337-b1e3-551c2c0203be tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:44:21.877524 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-672e90f3-4cb8-4337-b1e3-551c2c0203be tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:44:21.877972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-672e90f3-4cb8-4337-b1e3-551c2c0203be tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:44:21.878438 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-672e90f3-4cb8-4337-b1e3-551c2c0203be tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:44:21.887895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-672e90f3-4cb8-4337-b1e3-551c2c0203be tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:21.888351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-672e90f3-4cb8-4337-b1e3-551c2c0203be tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:21.889161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-672e90f3-4cb8-4337-b1e3-551c2c0203be tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:21.889603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-672e90f3-4cb8-4337-b1e3-551c2c0203be tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:21.907658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-672e90f3-4cb8-4337-b1e3-551c2c0203be tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Getting quotas for project e7330b3757794c94b7cbd4ce6886c78d. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:44:21.914908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-672e90f3-4cb8-4337-b1e3-551c2c0203be tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Getting quotas for user e0f15b1174154d848d010e48b5df98db and project e7330b3757794c94b7cbd4ce6886c78d. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:44:21.929267 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-672e90f3-4cb8-4337-b1e3-551c2c0203be tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:44:21.931738 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-672e90f3-4cb8-4337-b1e3-551c2c0203be tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 4cb23110-97b4-4958-8ed7-5bf38b41a691] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:44:21.978679 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-672e90f3-4cb8-4337-b1e3-551c2c0203be tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.428243 Jul 25 12:44:21.979336 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 847/1619] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:44:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:44:21.984004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fa06a0cd-5f6d-4ddd-88f0-7840077b6587 tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] Calling method '.version_select at 0x7efcf9d34f70>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:22.011966 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-fa06a0cd-5f6d-4ddd-88f0-7840077b6587 tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] HTTP exception thrown: Image not found. Jul 25 12:44:22.013917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fa06a0cd-5f6d-4ddd-88f0-7840077b6587 tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] Request method failure captured: Jul 25 12:44:22.013917 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/images/tempest-invalid-402412745 HTTP/1.1 Jul 25 12:44:22.013917 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:44:22.013917 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:44:22.013917 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:44:22.013917 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:44:22.013917 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:44:22.013917 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:44:22.013917 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:44:22.013917 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:22.013917 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pAk_pkqN1xBc50nZf5I-epPQisVhACnN87y2snqBnS_XaqFQ5apITlp2-fkpCB3JIafvJMTjbAOodWE8hEtWdK-UHq3CTLt3Fvx1NWjVxm5MvFStx9k8ZE791eRhXrSKdEujq0MRzD7G1JjIZ7neJhYW6MLAoMt3MQ_H4ZxQd5fPYk Jul 25 12:44:22.013917 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:44:22.013917 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:44:22.013917 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:44:22.013917 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:44:22.013917 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:44:22.013917 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:44:22.013917 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 39446837d42047109a62376b7b153c68 Jul 25 12:44:22.013917 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-405851957 Jul 25 12:44:22.013917 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:44:22.013917 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:44:22.015720 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_39446837d42047109a62376b7b153c68", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/39446837d42047109a62376b7b153c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/39446837d42047109a62376b7b153c68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/39446837d42047109a62376b7b153c68"}]}] Jul 25 12:44:22.015720 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-405851957 Jul 25 12:44:22.015720 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 39446837d42047109a62376b7b153c68 Jul 25 12:44:22.015720 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-405851957 Jul 25 12:44:22.015720 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesDeleteNegativeTestJSON-405851957-project Jul 25 12:44:22.015720 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:44:22.015720 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:44:22.015720 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 22bef1af4cf54ced80a91c261990ad82 Jul 25 12:44:22.015720 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-405851957-project Jul 25 12:44:22.015720 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:44:22.015720 n-d-848886-15 devstack@n-api.service[125884]: exception: Image not found. Jul 25 12:44:22.015720 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'tempest-invalid-402412745'} Jul 25 12:44:22.015720 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:22.016755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:22.016755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 12:44:22.016755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 12:44:22.016755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:44:22.016755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:44:22.016755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:44:22.016755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:44:22.016755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 12:44:22.016755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 12:44:22.016755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 12:44:22.016755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 12:44:22.016755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:44:22.016755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:44:22.016755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:44:22.016755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:44:22.016755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-402412745 to delete Jul 25 12:44:22.016755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:22.016755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:22.016755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:22.018445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:22.018445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 12:44:22.018445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 12:44:22.018445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 12:44:22.018445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 12:44:22.018445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 12:44:22.018445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 12:44:22.018445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-402412745 could not be found. Jul 25 12:44:22.018445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:22.018445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:22.018445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:22.018445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:22.018445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:22.018445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:22.018445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:22.018445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:22.018445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:44:22.018445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:44:22.018445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:22.018445 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:22.020003 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 12:44:22.020003 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 12:44:22.020003 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 12:44:22.020003 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:22.020003 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:22.020003 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:22.020003 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:22.020003 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:22.020003 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:22.020003 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:22.020003 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:22.020003 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 12:44:22.020003 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:22.020003 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fa06a0cd-5f6d-4ddd-88f0-7840077b6587 tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] Returning 404 to user: Image not found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:22.020003 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fa06a0cd-5f6d-4ddd-88f0-7840077b6587 tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] 10.222.0.49 "DELETE /compute/v2.1/images/tempest-invalid-402412745" status: 404 len: 62 microversion: 2.1 time: 0.035065 Jul 25 12:44:22.021686 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 848/1620] 10.222.0.49 () {58 vars in 1203 bytes} [Mon Jul 25 12:44:21 2022] DELETE /compute/v2.1/images/tempest-invalid-402412745 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:44:22.026804 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ba50fd09-1cef-45e9-b3b7-f1c0991f3186 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:22.027344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ba50fd09-1cef-45e9-b3b7-f1c0991f3186 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:22.033866 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba50fd09-1cef-45e9-b3b7-f1c0991f3186 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:22.034360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba50fd09-1cef-45e9-b3b7-f1c0991f3186 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:22.035122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba50fd09-1cef-45e9-b3b7-f1c0991f3186 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:22.035560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba50fd09-1cef-45e9-b3b7-f1c0991f3186 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:22.178503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ba50fd09-1cef-45e9-b3b7-f1c0991f3186 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:22.187262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ba50fd09-1cef-45e9-b3b7-f1c0991f3186 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:22.188851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ba50fd09-1cef-45e9-b3b7-f1c0991f3186 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:22.190304 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ba50fd09-1cef-45e9-b3b7-f1c0991f3186 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1485 microversion: 2.25 time: 0.168643 Jul 25 12:44:22.190947 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 849/1621] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:22 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1485 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:22.195641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ee48e023-b63e-40c0-9feb-29620dfebe00 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:22.196825 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ee48e023-b63e-40c0-9feb-29620dfebe00 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 4cb23110-97b4-4958-8ed7-5bf38b41a691] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:22.261217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ee48e023-b63e-40c0-9feb-29620dfebe00 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:22.268732 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ee48e023-b63e-40c0-9feb-29620dfebe00 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691" status: 200 len: 1213 microversion: 2.1 time: 0.076773 Jul 25 12:44:22.269346 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 850/1622] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:22 2022] GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:22.274887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-91747bcc-287f-41c7-910f-64b187c99fb6 tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] Calling method '.version_select at 0x7efcf9d35040>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:22.298179 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-91747bcc-287f-41c7-910f-64b187c99fb6 tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] HTTP exception thrown: Image not found. Jul 25 12:44:22.300450 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-91747bcc-287f-41c7-910f-64b187c99fb6 tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] Request method failure captured: Jul 25 12:44:22.300450 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/images/958b1ea7-7bb9-4d26-8c33-209686f0ddc8 HTTP/1.1 Jul 25 12:44:22.300450 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:44:22.300450 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:44:22.300450 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:44:22.300450 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:44:22.300450 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:44:22.300450 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:44:22.300450 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:44:22.300450 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:22.300450 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pAk_pkqN1xBc50nZf5I-epPQisVhACnN87y2snqBnS_XaqFQ5apITlp2-fkpCB3JIafvJMTjbAOodWE8hEtWdK-UHq3CTLt3Fvx1NWjVxm5MvFStx9k8ZE791eRhXrSKdEujq0MRzD7G1JjIZ7neJhYW6MLAoMt3MQ_H4ZxQd5fPYk Jul 25 12:44:22.300450 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:44:22.300450 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:44:22.300450 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:44:22.300450 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:44:22.300450 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:44:22.300450 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:44:22.300450 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 39446837d42047109a62376b7b153c68 Jul 25 12:44:22.300450 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-405851957 Jul 25 12:44:22.300450 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:44:22.300450 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:44:22.301939 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_39446837d42047109a62376b7b153c68", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/39446837d42047109a62376b7b153c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/39446837d42047109a62376b7b153c68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/39446837d42047109a62376b7b153c68"}]}] Jul 25 12:44:22.301939 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-405851957 Jul 25 12:44:22.301939 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 39446837d42047109a62376b7b153c68 Jul 25 12:44:22.301939 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-405851957 Jul 25 12:44:22.301939 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesDeleteNegativeTestJSON-405851957-project Jul 25 12:44:22.301939 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:44:22.301939 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:44:22.301939 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 22bef1af4cf54ced80a91c261990ad82 Jul 25 12:44:22.301939 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-405851957-project Jul 25 12:44:22.301939 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:44:22.301939 n-d-848886-15 devstack@n-api.service[125884]: exception: Image not found. Jul 25 12:44:22.301939 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '958b1ea7-7bb9-4d26-8c33-209686f0ddc8'} Jul 25 12:44:22.301939 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:22.303005 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:22.303005 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 12:44:22.303005 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 12:44:22.303005 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:44:22.303005 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:44:22.303005 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:44:22.303005 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:44:22.303005 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 12:44:22.303005 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 12:44:22.303005 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 12:44:22.303005 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 12:44:22.303005 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:44:22.303005 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:44:22.303005 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:44:22.303005 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:44:22.303005 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 958b1ea7-7bb9-4d26-8c33-209686f0ddc8 to delete Jul 25 12:44:22.303005 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:22.303005 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:22.303005 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:22.306291 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:22.306291 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 12:44:22.306291 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 12:44:22.306291 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 12:44:22.306291 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 12:44:22.306291 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 12:44:22.306291 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 12:44:22.306291 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 958b1ea7-7bb9-4d26-8c33-209686f0ddc8 could not be found. Jul 25 12:44:22.306291 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:22.306291 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:22.306291 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:22.306291 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:22.306291 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:22.306291 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:22.306291 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:22.306291 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:22.306291 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:44:22.306291 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:44:22.306291 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:22.306291 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:22.310025 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 12:44:22.310025 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 12:44:22.310025 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 12:44:22.310025 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:22.310025 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:22.310025 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:22.310025 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:22.310025 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:22.310025 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:22.310025 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:22.310025 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:22.310025 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 12:44:22.310025 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:22.310025 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-91747bcc-287f-41c7-910f-64b187c99fb6 tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] Returning 404 to user: Image not found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:22.310025 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-91747bcc-287f-41c7-910f-64b187c99fb6 tempest-ImagesDeleteNegativeTestJSON-405851957 tempest-ImagesDeleteNegativeTestJSON-405851957-project] 10.222.0.49 "DELETE /compute/v2.1/images/958b1ea7-7bb9-4d26-8c33-209686f0ddc8" status: 404 len: 62 microversion: 2.1 time: 0.031331 Jul 25 12:44:22.312722 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 851/1623] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:22 2022] DELETE /compute/v2.1/images/958b1ea7-7bb9-4d26-8c33-209686f0ddc8 => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:44:22.312722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fa84999f-83dc-4442-84f9-418be8cf06a0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:22.313127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fa84999f-83dc-4442-84f9-418be8cf06a0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:22.319565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa84999f-83dc-4442-84f9-418be8cf06a0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:22.320006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa84999f-83dc-4442-84f9-418be8cf06a0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:22.320776 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa84999f-83dc-4442-84f9-418be8cf06a0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:22.321208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa84999f-83dc-4442-84f9-418be8cf06a0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:22.475620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fa84999f-83dc-4442-84f9-418be8cf06a0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:22.483619 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fa84999f-83dc-4442-84f9-418be8cf06a0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1532 microversion: 2.1 time: 0.180251 Jul 25 12:44:22.496986 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 852/1624] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:22 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1532 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:22.501951 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-51dd65f0-25ef-47b8-80ef-7651ba003bc8 req-1cdeae3a-6623-4191-9a9b-21bb5ae9dd1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce1a79d3-137b-485c-9757-bfa73c2dfbfb", "name": "network-vif-deleted", "tag": "4340e7ff-5786-4e4c-9869-3fe8f941e21a"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:22.511918 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-51dd65f0-25ef-47b8-80ef-7651ba003bc8 req-1cdeae3a-6623-4191-9a9b-21bb5ae9dd1d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:22.512412 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-51dd65f0-25ef-47b8-80ef-7651ba003bc8 req-1cdeae3a-6623-4191-9a9b-21bb5ae9dd1d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:22.525138 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-51dd65f0-25ef-47b8-80ef-7651ba003bc8 req-1cdeae3a-6623-4191-9a9b-21bb5ae9dd1d service nova] Creating event network-vif-deleted:4340e7ff-5786-4e4c-9869-3fe8f941e21a for instance ce1a79d3-137b-485c-9757-bfa73c2dfbfb on n-h1-848886-15 Jul 25 12:44:22.530536 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-51dd65f0-25ef-47b8-80ef-7651ba003bc8 req-1cdeae3a-6623-4191-9a9b-21bb5ae9dd1d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032329 Jul 25 12:44:22.531197 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 853/1625] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:22.536500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-40c96442-dce1-4a1f-84dd-166893a00c61 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:22.537191 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-40c96442-dce1-4a1f-84dd-166893a00c61 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:22.543423 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40c96442-dce1-4a1f-84dd-166893a00c61 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:22.543867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40c96442-dce1-4a1f-84dd-166893a00c61 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:22.544634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40c96442-dce1-4a1f-84dd-166893a00c61 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:22.545201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40c96442-dce1-4a1f-84dd-166893a00c61 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:22.680673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-40c96442-dce1-4a1f-84dd-166893a00c61 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:22.688786 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-40c96442-dce1-4a1f-84dd-166893a00c61 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1506 microversion: 2.1 time: 0.156303 Jul 25 12:44:22.689403 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 854/1626] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:22 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:22.694211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-05561453-13f8-47b5-9103-a27e92357556 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:22.694953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-05561453-13f8-47b5-9103-a27e92357556 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:22.700851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05561453-13f8-47b5-9103-a27e92357556 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:22.701311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05561453-13f8-47b5-9103-a27e92357556 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:22.702107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05561453-13f8-47b5-9103-a27e92357556 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:22.702572 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05561453-13f8-47b5-9103-a27e92357556 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:22.837822 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [None req-01989c0d-9755-497b-9e87-89ca739faffa tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [89d26934-5c76-41fd-a21c-3bc08c3f5e0b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 47944. Jul 25 12:44:22.844593 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-01989c0d-9755-497b-9e87-89ca739faffa tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/5f168769-42c4-41f2-afbc-424c2b01f168" status: 204 len: 0 microversion: 2.1 time: 1.052738 Jul 25 12:44:22.845775 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 773/1627] 10.222.0.49 () {58 vars in 1266 bytes} [Mon Jul 25 12:44:21 2022] DELETE /compute/v2.1/os-server-groups/5f168769-42c4-41f2-afbc-424c2b01f168 => generated 0 bytes in 1054 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:22.850951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-52f367f2-c763-4a2d-a239-031e9b17b766 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:22.851612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-52f367f2-c763-4a2d-a239-031e9b17b766 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:22.856087 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-05561453-13f8-47b5-9103-a27e92357556 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:22.866991 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-52f367f2-c763-4a2d-a239-031e9b17b766 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:22.867439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-52f367f2-c763-4a2d-a239-031e9b17b766 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:22.868219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-52f367f2-c763-4a2d-a239-031e9b17b766 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:22.868651 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-52f367f2-c763-4a2d-a239-031e9b17b766 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:22.875276 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-05561453-13f8-47b5-9103-a27e92357556 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1473 microversion: 2.1 time: 0.184564 Jul 25 12:44:22.876229 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 855/1628] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:22 2022] GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1473 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:22.881705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e13f3e7e-4a70-4409-9cec-3719cd813582 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:22.882677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e13f3e7e-4a70-4409-9cec-3719cd813582 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: b2467ff1-7d17-43ae-811d-e37437b3b0ba] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:22.889873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e13f3e7e-4a70-4409-9cec-3719cd813582 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:22.891123 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e13f3e7e-4a70-4409-9cec-3719cd813582 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:22.892495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e13f3e7e-4a70-4409-9cec-3719cd813582 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:22.893181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e13f3e7e-4a70-4409-9cec-3719cd813582 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:22.920457 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e13f3e7e-4a70-4409-9cec-3719cd813582 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: b2467ff1-7d17-43ae-811d-e37437b3b0ba] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:44:23.021767 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e13f3e7e-4a70-4409-9cec-3719cd813582 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba" status: 204 len: 0 microversion: 2.1 time: 0.144012 Jul 25 12:44:23.023110 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 856/1629] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:44:22 2022] DELETE /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:23.033141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-46f39cbd-62ca-47b8-bae9-b0c67095bfed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:23.034057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-46f39cbd-62ca-47b8-bae9-b0c67095bfed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: b2467ff1-7d17-43ae-811d-e37437b3b0ba] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:23.042144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-46f39cbd-62ca-47b8-bae9-b0c67095bfed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:23.042795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-52f367f2-c763-4a2d-a239-031e9b17b766 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:23.042975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-46f39cbd-62ca-47b8-bae9-b0c67095bfed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:23.043707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-46f39cbd-62ca-47b8-bae9-b0c67095bfed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:23.044308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-46f39cbd-62ca-47b8-bae9-b0c67095bfed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:23.051902 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-52f367f2-c763-4a2d-a239-031e9b17b766 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1198 microversion: 2.1 time: 0.204896 Jul 25 12:44:23.052574 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 774/1630] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:22 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1198 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:23.198682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-46f39cbd-62ca-47b8-bae9-b0c67095bfed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:23.207748 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-46f39cbd-62ca-47b8-bae9-b0c67095bfed tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba" status: 200 len: 1473 microversion: 2.1 time: 0.180119 Jul 25 12:44:23.209114 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 857/1631] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:23 2022] GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba => generated 1473 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:23.217974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c8f0c8f8-9486-4393-bf21-32bd512b5152 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:23.218862 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c8f0c8f8-9486-4393-bf21-32bd512b5152 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:23.224991 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8f0c8f8-9486-4393-bf21-32bd512b5152 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:23.225439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8f0c8f8-9486-4393-bf21-32bd512b5152 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:23.226240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8f0c8f8-9486-4393-bf21-32bd512b5152 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:23.226771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8f0c8f8-9486-4393-bf21-32bd512b5152 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:23.292833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2a30a7a6-b958-411d-973e-30db825303ec tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:23.294708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2a30a7a6-b958-411d-973e-30db825303ec tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 4cb23110-97b4-4958-8ed7-5bf38b41a691] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:23.302839 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a30a7a6-b958-411d-973e-30db825303ec tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:23.303640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a30a7a6-b958-411d-973e-30db825303ec tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:23.305078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a30a7a6-b958-411d-973e-30db825303ec tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:23.305739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a30a7a6-b958-411d-973e-30db825303ec tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:23.406975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2a30a7a6-b958-411d-973e-30db825303ec tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:23.414558 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2a30a7a6-b958-411d-973e-30db825303ec tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691" status: 200 len: 1217 microversion: 2.1 time: 0.126135 Jul 25 12:44:23.415144 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 858/1632] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:23 2022] GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691 => generated 1217 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:23.431362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c8f0c8f8-9486-4393-bf21-32bd512b5152 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:23.439499 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c8f0c8f8-9486-4393-bf21-32bd512b5152 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:23.441014 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c8f0c8f8-9486-4393-bf21-32bd512b5152 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:23.442222 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c8f0c8f8-9486-4393-bf21-32bd512b5152 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1485 microversion: 2.25 time: 0.230744 Jul 25 12:44:23.457580 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 775/1633] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:23 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1485 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:44:23.504344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-438c4494-72cd-44ef-bec0-41f996e670b9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:23.505338 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-438c4494-72cd-44ef-bec0-41f996e670b9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:23.514397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-438c4494-72cd-44ef-bec0-41f996e670b9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:23.515183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-438c4494-72cd-44ef-bec0-41f996e670b9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:23.516143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-438c4494-72cd-44ef-bec0-41f996e670b9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:23.517369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-438c4494-72cd-44ef-bec0-41f996e670b9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:23.710451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e3d62429-b342-4197-810a-70c110565a19 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:23.711135 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e3d62429-b342-4197-810a-70c110565a19 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:23.722867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3d62429-b342-4197-810a-70c110565a19 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:23.724031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3d62429-b342-4197-810a-70c110565a19 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:23.725020 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3d62429-b342-4197-810a-70c110565a19 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:23.725974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3d62429-b342-4197-810a-70c110565a19 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:23.811421 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-438c4494-72cd-44ef-bec0-41f996e670b9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:23.820615 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-438c4494-72cd-44ef-bec0-41f996e670b9 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1532 microversion: 2.1 time: 0.320100 Jul 25 12:44:23.821400 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 859/1634] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:23 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1532 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:24.002870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aed82d72-b9bf-4ace-a303-286d30f6385d tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Action: 'create', calling method: .version_select at 0x7efcf9c045e0>, body: {"keypair": {"name": "tempest-keypair-1770097729", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPx7Due+GUKwLmtgsi5R/CuWyfJ+P8OQy7z1K6p9Ya4111CyYwTsYhbizW6Kkm4qGQMvcNA/gtCs4nwf4slB+I7jblHTQZJBwzf+ksRe8Mf96o7AfaFUhBVBRRC5W5eGg=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:24.006667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e3d62429-b342-4197-810a-70c110565a19 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:24.022176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-aed82d72-b9bf-4ace-a303-286d30f6385d tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Getting quotas for project f4fa635e4ed7423fbe1d827cbdb9e6d3. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:44:24.023795 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e3d62429-b342-4197-810a-70c110565a19 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1506 microversion: 2.1 time: 0.313792 Jul 25 12:44:24.024444 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 776/1635] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:23 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1506 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:44:24.028942 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-aed82d72-b9bf-4ace-a303-286d30f6385d tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Getting quotas for user 9425b993a747464597bc1ffe66fa8f30 and project f4fa635e4ed7423fbe1d827cbdb9e6d3. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:44:24.029235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-96f0cb02-7e54-45ba-be28-f10292c190de tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:24.029866 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-96f0cb02-7e54-45ba-be28-f10292c190de tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:24.048442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-96f0cb02-7e54-45ba-be28-f10292c190de tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:24.049392 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-96f0cb02-7e54-45ba-be28-f10292c190de tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:24.050230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-96f0cb02-7e54-45ba-be28-f10292c190de tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:24.050867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-96f0cb02-7e54-45ba-be28-f10292c190de tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:24.068304 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-aed82d72-b9bf-4ace-a303-286d30f6385d tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.245241 Jul 25 12:44:24.076075 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 860/1636] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:44:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:24.211100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-96f0cb02-7e54-45ba-be28-f10292c190de tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:24.223591 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-96f0cb02-7e54-45ba-be28-f10292c190de tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 200 len: 1431 microversion: 2.1 time: 0.196260 Jul 25 12:44:24.239656 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 777/1637] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:24 2022] GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 1431 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:24.251583 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-442daec1-21a0-4894-9d36-cb2737af45b2 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Calling method '.version_select at 0x7efcfed25dc0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:24.272735 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-442daec1-21a0-4894-9d36-cb2737af45b2 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs/tempest-keypair-1770097729" status: 200 len: 497 microversion: 2.1 time: 0.029383 Jul 25 12:44:24.276746 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 778/1638] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Jul 25 12:44:24 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1770097729 => generated 497 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:24.285139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-c025c9b0-8b55-4c4e-8a02-f7ff2b778945 req-6237dfc8-7c9c-43cb-9f7d-2fbac6fb7340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2cc4389-ef66-4ad7-a6e5-ab70905b9620", "name": "network-vif-deleted", "tag": "94f1f07a-a4dc-4d37-9c1f-822a76bcc0b8"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:24.296633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-88235d34-74db-46a9-a926-a55edab88e03 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:24.297235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-88235d34-74db-46a9-a926-a55edab88e03 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:24.300312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c025c9b0-8b55-4c4e-8a02-f7ff2b778945 req-6237dfc8-7c9c-43cb-9f7d-2fbac6fb7340 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:24.300809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c025c9b0-8b55-4c4e-8a02-f7ff2b778945 req-6237dfc8-7c9c-43cb-9f7d-2fbac6fb7340 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:24.305439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88235d34-74db-46a9-a926-a55edab88e03 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:24.305913 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88235d34-74db-46a9-a926-a55edab88e03 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:24.306970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88235d34-74db-46a9-a926-a55edab88e03 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:24.308363 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88235d34-74db-46a9-a926-a55edab88e03 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:24.321931 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-c025c9b0-8b55-4c4e-8a02-f7ff2b778945 req-6237dfc8-7c9c-43cb-9f7d-2fbac6fb7340 service nova] Creating event network-vif-deleted:94f1f07a-a4dc-4d37-9c1f-822a76bcc0b8 for instance f2cc4389-ef66-4ad7-a6e5-ab70905b9620 on n-h2-848886-15 Jul 25 12:44:24.330276 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-c025c9b0-8b55-4c4e-8a02-f7ff2b778945 req-6237dfc8-7c9c-43cb-9f7d-2fbac6fb7340 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051972 Jul 25 12:44:24.334742 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 779/1639] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:24.341400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8bcc0619-aa81-40a8-9f8e-b30de7e62f42 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:24.342164 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8bcc0619-aa81-40a8-9f8e-b30de7e62f42 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: b2467ff1-7d17-43ae-811d-e37437b3b0ba] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:24.350090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bcc0619-aa81-40a8-9f8e-b30de7e62f42 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:24.350794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bcc0619-aa81-40a8-9f8e-b30de7e62f42 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:24.351578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bcc0619-aa81-40a8-9f8e-b30de7e62f42 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:24.352037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bcc0619-aa81-40a8-9f8e-b30de7e62f42 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:25.018700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-88235d34-74db-46a9-a926-a55edab88e03 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:25.029543 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-88235d34-74db-46a9-a926-a55edab88e03 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1198 microversion: 2.1 time: 0.952178 Jul 25 12:44:25.030467 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 861/1640] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:24 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1198 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:25.036237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-041bb159-367a-4391-a62d-1a271e8e4805 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Calling method '.version_select at 0x7efcf9daea60>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:25.059753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8bcc0619-aa81-40a8-9f8e-b30de7e62f42 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:25.063886 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-041bb159-367a-4391-a62d-1a271e8e4805 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1770097729" status: 202 len: 0 microversion: 2.1 time: 0.031985 Jul 25 12:44:25.064685 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 862/1641] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Jul 25 12:44:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1770097729 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:44:25.073015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-854f9b47-85d5-4349-8988-4369fc275887 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:25.074047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-854f9b47-85d5-4349-8988-4369fc275887 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 4cb23110-97b4-4958-8ed7-5bf38b41a691] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:25.077292 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8bcc0619-aa81-40a8-9f8e-b30de7e62f42 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba" status: 200 len: 1473 microversion: 2.1 time: 0.740556 Jul 25 12:44:25.078344 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 780/1642] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:24 2022] GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba => generated 1473 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:25.085121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-685034f6-5c4e-412d-b80e-f180f6d2b053 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:25.086008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-685034f6-5c4e-412d-b80e-f180f6d2b053 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:25.094212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-685034f6-5c4e-412d-b80e-f180f6d2b053 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:25.094512 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-854f9b47-85d5-4349-8988-4369fc275887 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:25.094640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-685034f6-5c4e-412d-b80e-f180f6d2b053 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:25.095171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-854f9b47-85d5-4349-8988-4369fc275887 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:25.095645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-685034f6-5c4e-412d-b80e-f180f6d2b053 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:25.096080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-685034f6-5c4e-412d-b80e-f180f6d2b053 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:25.097752 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-854f9b47-85d5-4349-8988-4369fc275887 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:25.098294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-854f9b47-85d5-4349-8988-4369fc275887 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:25.294206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-854f9b47-85d5-4349-8988-4369fc275887 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:25.303948 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-854f9b47-85d5-4349-8988-4369fc275887 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691" status: 200 len: 1271 microversion: 2.1 time: 0.237805 Jul 25 12:44:25.304730 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 863/1643] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:25 2022] GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691 => generated 1271 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:25.312527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fc81147f-32e5-4959-a3d4-eb8cfc6f23b0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:25.312527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fc81147f-32e5-4959-a3d4-eb8cfc6f23b0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:25.323926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:25.326509 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc81147f-32e5-4959-a3d4-eb8cfc6f23b0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:25.327094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc81147f-32e5-4959-a3d4-eb8cfc6f23b0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:25.328336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc81147f-32e5-4959-a3d4-eb8cfc6f23b0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:25.328867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc81147f-32e5-4959-a3d4-eb8cfc6f23b0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:25.368565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc81147f-32e5-4959-a3d4-eb8cfc6f23b0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:25.369432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc81147f-32e5-4959-a3d4-eb8cfc6f23b0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:25.369587 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-fc81147f-32e5-4959-a3d4-eb8cfc6f23b0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lazy-loading 'fault' on Instance uuid e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:44:25.468241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fc81147f-32e5-4959-a3d4-eb8cfc6f23b0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:25.473063 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:25.479907 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fc81147f-32e5-4959-a3d4-eb8cfc6f23b0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 200 len: 1368 microversion: 2.1 time: 0.173030 Jul 25 12:44:25.490533 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 864/1644] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:25 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:25.490533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-e23f03b9-54d3-4a7b-82e7-25f8befc7718 req-242da3e8-1813-4680-b55c-6317c5eede3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a", "name": "network-vif-deleted", "tag": "4dc52859-0016-4f90-b755-bb756ddacc11"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:25.497280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e23f03b9-54d3-4a7b-82e7-25f8befc7718 req-242da3e8-1813-4680-b55c-6317c5eede3e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:25.497280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e23f03b9-54d3-4a7b-82e7-25f8befc7718 req-242da3e8-1813-4680-b55c-6317c5eede3e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:25.506116 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-685034f6-5c4e-412d-b80e-f180f6d2b053 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:25.514248 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-e23f03b9-54d3-4a7b-82e7-25f8befc7718 req-242da3e8-1813-4680-b55c-6317c5eede3e service nova] Creating event network-vif-deleted:4dc52859-0016-4f90-b755-bb756ddacc11 for instance e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a on n-h2-848886-15 Jul 25 12:44:25.522202 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-685034f6-5c4e-412d-b80e-f180f6d2b053 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:25.522700 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-e23f03b9-54d3-4a7b-82e7-25f8befc7718 req-242da3e8-1813-4680-b55c-6317c5eede3e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039663 Jul 25 12:44:25.524299 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 865/1645] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:25.525556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-685034f6-5c4e-412d-b80e-f180f6d2b053 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:25.528063 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-685034f6-5c4e-412d-b80e-f180f6d2b053 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1485 microversion: 2.25 time: 0.448367 Jul 25 12:44:25.531032 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 781/1646] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:25 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1485 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:25.532478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-53642607-8b99-4015-a0c3-d8424742a4df tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:25.533242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-53642607-8b99-4015-a0c3-d8424742a4df tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:25.540866 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-849c2b5a-b63b-42c3-9655-2906e102f340 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Action: 'create', calling method: .version_select at 0x7efcfed2ba60>, body: {"keypair": {"name": "tempest-keypair-1316983184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtLuVXUwOV+Rh18+0qO+QOBaJK51ZucfWpH8QTqPj8cmo+DTyNzBrU8eDasPCoe4Ln1vLZMAelWO7KP5nD8zpQl8kcYKlLll/byz+hdtSlMNM9yD4u1N3XkJ8avjmwtCw=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:25.551787 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53642607-8b99-4015-a0c3-d8424742a4df tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:25.554812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53642607-8b99-4015-a0c3-d8424742a4df tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:25.555620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53642607-8b99-4015-a0c3-d8424742a4df tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:25.556055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53642607-8b99-4015-a0c3-d8424742a4df tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:25.559887 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-849c2b5a-b63b-42c3-9655-2906e102f340 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Getting quotas for project f4fa635e4ed7423fbe1d827cbdb9e6d3. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:44:25.567981 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-849c2b5a-b63b-42c3-9655-2906e102f340 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Getting quotas for user 9425b993a747464597bc1ffe66fa8f30 and project f4fa635e4ed7423fbe1d827cbdb9e6d3. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:44:25.609331 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-849c2b5a-b63b-42c3-9655-2906e102f340 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.076646 Jul 25 12:44:25.609990 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 782/1647] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:44:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:25.618836 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-58c6fc4d-6196-4db3-ba54-91a7fc3eb4fd tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:25.619446 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-58c6fc4d-6196-4db3-ba54-91a7fc3eb4fd tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: f2cc4389-ef66-4ad7-a6e5-ab70905b9620] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:25.626275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-58c6fc4d-6196-4db3-ba54-91a7fc3eb4fd tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:25.626715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-58c6fc4d-6196-4db3-ba54-91a7fc3eb4fd tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:25.627814 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-58c6fc4d-6196-4db3-ba54-91a7fc3eb4fd tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:25.628380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-58c6fc4d-6196-4db3-ba54-91a7fc3eb4fd tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:25.644905 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-58c6fc4d-6196-4db3-ba54-91a7fc3eb4fd tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] HTTP exception thrown: Instance f2cc4389-ef66-4ad7-a6e5-ab70905b9620 could not be found. Jul 25 12:44:25.646934 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-58c6fc4d-6196-4db3-ba54-91a7fc3eb4fd tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Request method failure captured: Jul 25 12:44:25.646934 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 HTTP/1.1 Jul 25 12:44:25.646934 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:44:25.646934 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:44:25.646934 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:44:25.646934 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:44:25.646934 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:44:25.646934 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:44:25.646934 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:44:25.646934 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:25.646934 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o-lI4VhTDB157EfAdR6Y-GvPz2fD-L0NpuTBSNtNe5WLMNeDIblJhj4-CV7zJwx342N9_Py3wRwy05QVBmRraHn0MAk0sG8Hu1QxXIhCOtLdx2GBK5QEUD9I0LYiUnNASh8hlR1gbWW_LnpPBXPkQOVpMpElUtE9vyYyjTpCdnrppc Jul 25 12:44:25.646934 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:44:25.646934 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:44:25.646934 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:44:25.646934 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:44:25.646934 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:44:25.646934 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:44:25.646934 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 29e28b1b4184471694b4dc157e452e93 Jul 25 12:44:25.646934 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ListImageFiltersTestJSON-2741385 Jul 25 12:44:25.646934 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:44:25.646934 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:44:25.649098 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_29e28b1b4184471694b4dc157e452e93", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/29e28b1b4184471694b4dc157e452e93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/29e28b1b4184471694b4dc157e452e93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/29e28b1b4184471694b4dc157e452e93"}]}] Jul 25 12:44:25.649098 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ListImageFiltersTestJSON-2741385 Jul 25 12:44:25.649098 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 29e28b1b4184471694b4dc157e452e93 Jul 25 12:44:25.649098 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-2741385 Jul 25 12:44:25.649098 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ListImageFiltersTestJSON-2741385-project Jul 25 12:44:25.649098 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:44:25.649098 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:44:25.649098 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: bbb37368bd444de3848966e7ff6def09 Jul 25 12:44:25.649098 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ListImageFiltersTestJSON-2741385-project Jul 25 12:44:25.649098 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:44:25.649098 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance f2cc4389-ef66-4ad7-a6e5-ab70905b9620 could not be found. Jul 25 12:44:25.649098 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'f2cc4389-ef66-4ad7-a6e5-ab70905b9620'} Jul 25 12:44:25.650226 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:25.650226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:25.650226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:44:25.650226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:44:25.650226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:44:25.650226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:44:25.650226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:44:25.650226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:44:25.650226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:44:25.650226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:44:25.650226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2cc4389-ef66-4ad7-a6e5-ab70905b9620 could not be found. Jul 25 12:44:25.650226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:25.650226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:25.650226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:25.650226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:25.650226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:25.650226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:25.650226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:25.650226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:25.650226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:25.653027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:25.653027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:44:25.653027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:44:25.653027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:44:25.653027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:44:25.653027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:44:25.653027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:44:25.653027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2cc4389-ef66-4ad7-a6e5-ab70905b9620 could not be found. Jul 25 12:44:25.653027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:25.653027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:25.653027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:25.653027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:25.653027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:25.653027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:25.653027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:25.653027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:25.653027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2cc4389-ef66-4ad7-a6e5-ab70905b9620 could not be found. Jul 25 12:44:25.653027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:25.655262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-58c6fc4d-6196-4db3-ba54-91a7fc3eb4fd tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Returning 404 to user: Instance f2cc4389-ef66-4ad7-a6e5-ab70905b9620 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:25.655262 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-58c6fc4d-6196-4db3-ba54-91a7fc3eb4fd tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620" status: 404 len: 111 microversion: 2.1 time: 0.037606 Jul 25 12:44:25.655262 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 783/1648] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:25 2022] GET /compute/v2.1/servers/f2cc4389-ef66-4ad7-a6e5-ab70905b9620 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:44:25.655262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4d85c255-6b16-4c60-88b3-4003cf4db074 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Calling method '.version_select at 0x7efcfed27310>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:25.674760 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4d85c255-6b16-4c60-88b3-4003cf4db074 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1316983184" status: 202 len: 0 microversion: 2.1 time: 0.024298 Jul 25 12:44:25.675344 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 784/1649] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Jul 25 12:44:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1316983184 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:44:25.680743 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-20e797c0-04b5-4d0d-8a81-abaf2e257148 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:25.681246 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-20e797c0-04b5-4d0d-8a81-abaf2e257148 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: 159b5add-9666-4a2a-82e7-7571a120cabb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:25.689436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20e797c0-04b5-4d0d-8a81-abaf2e257148 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:25.689914 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20e797c0-04b5-4d0d-8a81-abaf2e257148 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:25.690682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20e797c0-04b5-4d0d-8a81-abaf2e257148 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:25.691141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20e797c0-04b5-4d0d-8a81-abaf2e257148 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:25.718729 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-20e797c0-04b5-4d0d-8a81-abaf2e257148 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: 159b5add-9666-4a2a-82e7-7571a120cabb] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:44:25.822263 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-20e797c0-04b5-4d0d-8a81-abaf2e257148 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "DELETE /compute/v2.1/servers/159b5add-9666-4a2a-82e7-7571a120cabb" status: 204 len: 0 microversion: 2.1 time: 0.145155 Jul 25 12:44:25.823345 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 785/1650] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:44:25 2022] DELETE /compute/v2.1/servers/159b5add-9666-4a2a-82e7-7571a120cabb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:25.831751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2db8ea81-5573-49a3-9597-ab08aac5e0c1 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Action: 'create', calling method: .version_select at 0x7efcfece99d0>, body: {"keypair": {"name": "tempest-keypair-1804123417", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:25.839074 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=4,nova_api:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:25.850793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-2db8ea81-5573-49a3-9597-ab08aac5e0c1 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Getting quotas for project f4fa635e4ed7423fbe1d827cbdb9e6d3. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:44:25.858864 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-2db8ea81-5573-49a3-9597-ab08aac5e0c1 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Getting quotas for user 9425b993a747464597bc1ffe66fa8f30 and project f4fa635e4ed7423fbe1d827cbdb9e6d3. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:44:25.871238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-53642607-8b99-4015-a0c3-d8424742a4df tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:25.880074 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-53642607-8b99-4015-a0c3-d8424742a4df tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1506 microversion: 2.1 time: 0.354249 Jul 25 12:44:25.889929 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 866/1651] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:25 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:25.889929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-64daecbb-e81c-48b4-9e0c-daae20ec66d6 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:25.889929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-64daecbb-e81c-48b4-9e0c-daae20ec66d6 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: 159b5add-9666-4a2a-82e7-7571a120cabb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:25.893701 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2db8ea81-5573-49a3-9597-ab08aac5e0c1 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.068645 Jul 25 12:44:25.894450 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64daecbb-e81c-48b4-9e0c-daae20ec66d6 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:25.895112 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64daecbb-e81c-48b4-9e0c-daae20ec66d6 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:25.896448 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 786/1652] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:44:25 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:25.906702 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64daecbb-e81c-48b4-9e0c-daae20ec66d6 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:25.907370 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64daecbb-e81c-48b4-9e0c-daae20ec66d6 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:25.919623 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d5ae5b6a-51ef-4c47-aa09-5ff550a898e2 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Calling method '.version_select at 0x7efcfed27af0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:25.945971 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d5ae5b6a-51ef-4c47-aa09-5ff550a898e2 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804123417" status: 202 len: 0 microversion: 2.1 time: 0.042265 Jul 25 12:44:25.953546 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 787/1653] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Jul 25 12:44:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804123417 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 12:44:25.959328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b5eaf28a-196b-43ca-875e-3cb6904e74d8 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Action: 'create', calling method: .version_select at 0x7efcfed25c10>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1649958379", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlikpnLmnjsRQ7MUFlFpDs6khB8FKW/BBy7o/ifWxjVZLUArTMNU6er8rEOL7ACfQdbsGYbjcXrfYHwOT2tYkE0c17LpeeRSk0xt1qMi5FekCol3/ESdRLRAzFXh6yFzQ=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:25.976916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-b5eaf28a-196b-43ca-875e-3cb6904e74d8 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Getting quotas for project f4fa635e4ed7423fbe1d827cbdb9e6d3. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:44:25.983038 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-b5eaf28a-196b-43ca-875e-3cb6904e74d8 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Getting quotas for user 9425b993a747464597bc1ffe66fa8f30 and project f4fa635e4ed7423fbe1d827cbdb9e6d3. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:44:26.013562 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b5eaf28a-196b-43ca-875e-3cb6904e74d8 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.057925 Jul 25 12:44:26.014439 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 788/1654] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:44:25 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:26.030943 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1603e25f-6aee-4146-a76c-71d9da811472 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Action: 'create', calling method: .version_select at 0x7efcfecef040>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1484950242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkIISRGX1ZVRXIZxgnsD+bXlMg14ljK5uu/Nun19dImKNSBpczhCC+A8UvVeW2wnE54h5502OyRGD82PyFlPRDcVu3yyyG8FHgJy4OJgXPvzGAeMiGDZuTcxY7/iwe+6w=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:26.054302 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-1603e25f-6aee-4146-a76c-71d9da811472 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Getting quotas for project f4fa635e4ed7423fbe1d827cbdb9e6d3. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:44:26.061795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-1603e25f-6aee-4146-a76c-71d9da811472 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Getting quotas for user 9425b993a747464597bc1ffe66fa8f30 and project f4fa635e4ed7423fbe1d827cbdb9e6d3. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:44:26.103404 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1603e25f-6aee-4146-a76c-71d9da811472 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.077242 Jul 25 12:44:26.104979 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 789/1655] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:44:26 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:26.111250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4e90a163-72b0-49c0-936e-232a9389846f tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:26.112537 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4e90a163-72b0-49c0-936e-232a9389846f tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:26.122640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e90a163-72b0-49c0-936e-232a9389846f tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:26.123501 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e90a163-72b0-49c0-936e-232a9389846f tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:26.126820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e90a163-72b0-49c0-936e-232a9389846f tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:26.127294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e90a163-72b0-49c0-936e-232a9389846f tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:26.158997 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-64daecbb-e81c-48b4-9e0c-daae20ec66d6 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:26.175840 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-64daecbb-e81c-48b4-9e0c-daae20ec66d6 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/159b5add-9666-4a2a-82e7-7571a120cabb" status: 200 len: 1473 microversion: 2.1 time: 0.293565 Jul 25 12:44:26.176448 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 867/1656] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:25 2022] GET /compute/v2.1/servers/159b5add-9666-4a2a-82e7-7571a120cabb => generated 1473 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:26.188582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-98cfd479-ba2e-4ad3-8676-9adacc934db0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:26.189438 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-98cfd479-ba2e-4ad3-8676-9adacc934db0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: b2467ff1-7d17-43ae-811d-e37437b3b0ba] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:26.199727 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-98cfd479-ba2e-4ad3-8676-9adacc934db0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:26.200282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-98cfd479-ba2e-4ad3-8676-9adacc934db0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:26.201170 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-98cfd479-ba2e-4ad3-8676-9adacc934db0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:26.202200 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-98cfd479-ba2e-4ad3-8676-9adacc934db0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:26.242053 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-98cfd479-ba2e-4ad3-8676-9adacc934db0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:26.242504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-98cfd479-ba2e-4ad3-8676-9adacc934db0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:26.242961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-98cfd479-ba2e-4ad3-8676-9adacc934db0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lazy-loading 'fault' on Instance uuid b2467ff1-7d17-43ae-811d-e37437b3b0ba {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:44:26.317189 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-98cfd479-ba2e-4ad3-8676-9adacc934db0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c296447c2254c048f94bd9f186b0097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c81a97dfca44bf6af64fdcd5d50c549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:26.327215 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-98cfd479-ba2e-4ad3-8676-9adacc934db0 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba" status: 200 len: 1307 microversion: 2.1 time: 0.147386 Jul 25 12:44:26.342909 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 868/1657] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:26 2022] GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba => generated 1307 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:26.349965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4e90a163-72b0-49c0-936e-232a9389846f tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:26.359038 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3690d130-5c6c-4c52-ba1a-bfbd232ce295 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Action: 'create', calling method: .version_select at 0x7efcf9d3c1f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1419362945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUrNg89KpCFMuK8HAh4jSfSJG7ljmxalTjd71kwddW4vOfH85GlEx0f714h4lrlFoPBRG5WsYuy5XPVRGuThGIA+yx2wsxSM110jokk29x7FbyRNa4HBeP1thuBF4lvgw=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:26.362251 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4e90a163-72b0-49c0-936e-232a9389846f tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1198 microversion: 2.1 time: 0.255619 Jul 25 12:44:26.372948 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 790/1658] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:26 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1198 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:26.381401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-3690d130-5c6c-4c52-ba1a-bfbd232ce295 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Getting quotas for project f4fa635e4ed7423fbe1d827cbdb9e6d3. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:44:26.384826 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8e157206-bd11-49b3-ab4a-aa60e2edad22 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:26.385893 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8e157206-bd11-49b3-ab4a-aa60e2edad22 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 4cb23110-97b4-4958-8ed7-5bf38b41a691] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:26.387680 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-3690d130-5c6c-4c52-ba1a-bfbd232ce295 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Getting quotas for user 9425b993a747464597bc1ffe66fa8f30 and project f4fa635e4ed7423fbe1d827cbdb9e6d3. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:44:26.393172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8e157206-bd11-49b3-ab4a-aa60e2edad22 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:26.394446 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8e157206-bd11-49b3-ab4a-aa60e2edad22 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:26.395928 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8e157206-bd11-49b3-ab4a-aa60e2edad22 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:26.396906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8e157206-bd11-49b3-ab4a-aa60e2edad22 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:26.422009 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3690d130-5c6c-4c52-ba1a-bfbd232ce295 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.076849 Jul 25 12:44:26.423009 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 869/1659] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:44:26 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:26.435390 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ce4e3fa6-a3d2-4926-8de6-f47acee38214 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Calling method '.version_select at 0x7efcf9d35700>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:26.440579 n-d-848886-15 devstack@n-api.service[125884]: WARNING oslo_db.sqlalchemy.utils [None req-ce4e3fa6-a3d2-4926-8de6-f47acee38214 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 12:44:26.450912 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ce4e3fa6-a3d2-4926-8de6-f47acee38214 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.021342 Jul 25 12:44:26.458435 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 870/1660] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:44:26 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:44:26.464349 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-437894c1-18f2-4f69-a3df-e179e0a88856 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Calling method '.version_select at 0x7efcf9d43160>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:26.496744 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-437894c1-18f2-4f69-a3df-e179e0a88856 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1419362945" status: 202 len: 0 microversion: 2.1 time: 0.036539 Jul 25 12:44:26.497899 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 871/1661] 10.222.0.49 () {58 vars in 1278 bytes} [Mon Jul 25 12:44:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1419362945 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:44:26.509384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fd331bcf-afb8-4293-8b28-b436f1c84970 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:26.517626 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fd331bcf-afb8-4293-8b28-b436f1c84970 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:26.527854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd331bcf-afb8-4293-8b28-b436f1c84970 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:26.531477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd331bcf-afb8-4293-8b28-b436f1c84970 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:26.538248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd331bcf-afb8-4293-8b28-b436f1c84970 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:26.539254 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd331bcf-afb8-4293-8b28-b436f1c84970 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:26.559765 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-fd331bcf-afb8-4293-8b28-b436f1c84970 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] HTTP exception thrown: Instance e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a could not be found. Jul 25 12:44:26.562362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fd331bcf-afb8-4293-8b28-b436f1c84970 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Request method failure captured: Jul 25 12:44:26.562362 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a HTTP/1.1 Jul 25 12:44:26.562362 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:44:26.562362 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:44:26.562362 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:44:26.562362 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:44:26.562362 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:44:26.562362 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:44:26.562362 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:44:26.562362 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:26.562362 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o7Tz0O7SSTbmDl0Z_49fiVulE4u2IVHWtJX8IhZRzdeY3RfzT5cF6XlRwH6pcEa6bCZXczC1oDltEE_WwkEgjlsc4Dn4JO42YSJ3wN5AuONFw1-5ANhhWBomhlw3yEv_CGvFeDIla6_OTsCNCdBF1OoYRpAauJXL0o5ty9W2TEu2BQ Jul 25 12:44:26.562362 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:44:26.562362 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:44:26.562362 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:44:26.562362 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:44:26.562362 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:44:26.562362 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:44:26.562362 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5220cb7ebe7b4a89a8d1edabad2391a7 Jul 25 12:44:26.562362 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-MigrationsAdminTest-1010123982 Jul 25 12:44:26.562362 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:44:26.562362 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:44:26.563835 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5220cb7ebe7b4a89a8d1edabad2391a7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5220cb7ebe7b4a89a8d1edabad2391a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5220cb7ebe7b4a89a8d1edabad2391a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5220cb7ebe7b4a89a8d1edabad2391a7"}]}] Jul 25 12:44:26.563835 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-MigrationsAdminTest-1010123982 Jul 25 12:44:26.563835 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5220cb7ebe7b4a89a8d1edabad2391a7 Jul 25 12:44:26.563835 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-MigrationsAdminTest-1010123982 Jul 25 12:44:26.563835 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-MigrationsAdminTest-1010123982-project Jul 25 12:44:26.563835 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:44:26.563835 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:44:26.563835 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 045d03491c1046609caffee111db48fc Jul 25 12:44:26.563835 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-MigrationsAdminTest-1010123982-project Jul 25 12:44:26.563835 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:44:26.563835 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a could not be found. Jul 25 12:44:26.563835 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a'} Jul 25 12:44:26.564663 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:26.564663 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:26.564663 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:44:26.564663 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:44:26.564663 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:44:26.564663 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:44:26.564663 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:44:26.564663 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:44:26.564663 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:44:26.564663 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:44:26.564663 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a could not be found. Jul 25 12:44:26.564663 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:26.564663 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:26.564663 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:26.564663 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:26.564663 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:26.564663 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:26.564663 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:26.564663 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:26.564663 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:26.566458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:26.566458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:44:26.566458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:44:26.566458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:44:26.566458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:44:26.566458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:44:26.566458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:44:26.566458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a could not be found. Jul 25 12:44:26.566458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:26.566458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:26.566458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:26.566458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:26.566458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:26.566458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:26.566458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:26.566458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:26.566458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a could not be found. Jul 25 12:44:26.566458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:26.569252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fd331bcf-afb8-4293-8b28-b436f1c84970 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Returning 404 to user: Instance e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:26.570430 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fd331bcf-afb8-4293-8b28-b436f1c84970 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a" status: 404 len: 111 microversion: 2.1 time: 0.065519 Jul 25 12:44:26.571322 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 872/1662] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:26 2022] GET /compute/v2.1/servers/e2a2307b-a14b-43cc-9e6e-8cc6d1eecc6a => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:44:26.579199 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-05ecbe4b-1132-49c3-8a48-af42a0b70a78 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Calling method '.version_select at 0x7efcf9d550d0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:26.607459 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-05ecbe4b-1132-49c3-8a48-af42a0b70a78 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1484950242" status: 202 len: 0 microversion: 2.1 time: 0.029441 Jul 25 12:44:26.609022 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 873/1663] 10.222.0.49 () {58 vars in 1278 bytes} [Mon Jul 25 12:44:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1484950242 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:44:26.619769 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0649f027-0170-4420-948c-1bd4f2aebc24 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:26.620665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0649f027-0170-4420-948c-1bd4f2aebc24 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:26.629065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0649f027-0170-4420-948c-1bd4f2aebc24 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:26.629600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0649f027-0170-4420-948c-1bd4f2aebc24 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:26.630553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0649f027-0170-4420-948c-1bd4f2aebc24 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:26.631112 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0649f027-0170-4420-948c-1bd4f2aebc24 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:26.644619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8e157206-bd11-49b3-ab4a-aa60e2edad22 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:26.656793 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8e157206-bd11-49b3-ab4a-aa60e2edad22 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691" status: 200 len: 1313 microversion: 2.1 time: 0.282210 Jul 25 12:44:26.658997 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 791/1664] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:26 2022] GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:26.665615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-40926746-1045-4ac5-b3f1-3aeda7f99222 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '.version_select at 0x7efcfed27a60>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:26.719373 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-40926746-1045-4ac5-b3f1-3aeda7f99222 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1889547677" status: 202 len: 0 microversion: 2.1 time: 0.058503 Jul 25 12:44:26.720354 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 792/1665] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Jul 25 12:44:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1889547677 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:44:26.727642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1ca0ba5a-9ade-4acc-b84a-3f06af958b21 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] Calling method '.version_select at 0x7efcfecf0ca0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:26.754127 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1ca0ba5a-9ade-4acc-b84a-3f06af958b21 tempest-KeyPairsV2TestJSON-1556697318 tempest-KeyPairsV2TestJSON-1556697318-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1649958379" status: 202 len: 0 microversion: 2.1 time: 0.032010 Jul 25 12:44:26.759460 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 793/1666] 10.222.0.49 () {58 vars in 1278 bytes} [Mon Jul 25 12:44:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1649958379 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:44:26.765801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-97c39c07-8988-4775-9abf-62938d52ccc7 req-c3a07c01-a48a-4c0c-9659-f1e095e8ff45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "791ea14d-3fa9-4be1-afc1-82c8908395f4", "name": "network-vif-plugged", "status": "completed", "tag": "0f801405-35d3-471d-9010-4dc3d6d5eec1"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:26.784185 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-97c39c07-8988-4775-9abf-62938d52ccc7 req-c3a07c01-a48a-4c0c-9659-f1e095e8ff45 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:26.784905 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-97c39c07-8988-4775-9abf-62938d52ccc7 req-c3a07c01-a48a-4c0c-9659-f1e095e8ff45 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:26.809453 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-97c39c07-8988-4775-9abf-62938d52ccc7 req-c3a07c01-a48a-4c0c-9659-f1e095e8ff45 service nova] Creating event network-vif-plugged:0f801405-35d3-471d-9010-4dc3d6d5eec1 for instance 791ea14d-3fa9-4be1-afc1-82c8908395f4 on n-h1-848886-15 Jul 25 12:44:26.818644 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-97c39c07-8988-4775-9abf-62938d52ccc7 req-c3a07c01-a48a-4c0c-9659-f1e095e8ff45 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056662 Jul 25 12:44:26.819937 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 794/1667] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:26.832684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0649f027-0170-4420-948c-1bd4f2aebc24 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:26.843700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0649f027-0170-4420-948c-1bd4f2aebc24 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:26.845342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0649f027-0170-4420-948c-1bd4f2aebc24 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:26.847181 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0649f027-0170-4420-948c-1bd4f2aebc24 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1485 microversion: 2.25 time: 0.231886 Jul 25 12:44:26.848411 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 874/1668] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:26 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1485 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:26.905589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d00a120d-16a0-442e-b4fe-f37f7ac70612 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:26.906451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d00a120d-16a0-442e-b4fe-f37f7ac70612 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:26.913310 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d00a120d-16a0-442e-b4fe-f37f7ac70612 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:26.913886 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d00a120d-16a0-442e-b4fe-f37f7ac70612 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:26.914740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d00a120d-16a0-442e-b4fe-f37f7ac70612 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:26.916423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d00a120d-16a0-442e-b4fe-f37f7ac70612 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:27.160386 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d00a120d-16a0-442e-b4fe-f37f7ac70612 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:27.169414 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d00a120d-16a0-442e-b4fe-f37f7ac70612 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1506 microversion: 2.1 time: 0.268159 Jul 25 12:44:27.170393 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 795/1669] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:26 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:27.200490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3d4324ef-0a00-4236-b5e8-84d497da5bfe tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:27.201938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3d4324ef-0a00-4236-b5e8-84d497da5bfe tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: 159b5add-9666-4a2a-82e7-7571a120cabb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:27.208319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3d4324ef-0a00-4236-b5e8-84d497da5bfe tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:27.208971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3d4324ef-0a00-4236-b5e8-84d497da5bfe tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:27.209939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3d4324ef-0a00-4236-b5e8-84d497da5bfe tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:27.210383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3d4324ef-0a00-4236-b5e8-84d497da5bfe tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:27.354987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-568675f1-e87b-4a78-8f5c-15e2c1d9f378 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:27.356467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-568675f1-e87b-4a78-8f5c-15e2c1d9f378 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] [instance: b2467ff1-7d17-43ae-811d-e37437b3b0ba] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:27.367646 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-568675f1-e87b-4a78-8f5c-15e2c1d9f378 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:27.368769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-568675f1-e87b-4a78-8f5c-15e2c1d9f378 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:27.372183 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-568675f1-e87b-4a78-8f5c-15e2c1d9f378 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:27.377806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-568675f1-e87b-4a78-8f5c-15e2c1d9f378 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:27.389764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3d4324ef-0a00-4236-b5e8-84d497da5bfe tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:27.400647 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-568675f1-e87b-4a78-8f5c-15e2c1d9f378 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] HTTP exception thrown: Instance b2467ff1-7d17-43ae-811d-e37437b3b0ba could not be found. Jul 25 12:44:27.402529 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-568675f1-e87b-4a78-8f5c-15e2c1d9f378 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Request method failure captured: Jul 25 12:44:27.402529 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba HTTP/1.1 Jul 25 12:44:27.402529 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:44:27.402529 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:44:27.402529 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:44:27.402529 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:44:27.402529 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:44:27.402529 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:44:27.402529 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:44:27.402529 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:27.402529 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o9FI8xGtqP7_CW35BbEF7ISywkY3QBKklr5o1CS_fq6Lx6g68HVW9d3S-CvFf3EFHQ-I9augL8LNHoHSZQ7fotgZGp7jb0rcywXJ-uNBD0-jX_Y0mC9RxTzXhF95_ckH46T5WFeX6UZGziPb5X1dUcODvmDxxrVOVDn9AvlAmcUOhI Jul 25 12:44:27.402529 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:44:27.402529 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:44:27.402529 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:44:27.402529 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:44:27.402529 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:44:27.402529 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:44:27.402529 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 5c81a97dfca44bf6af64fdcd5d50c549 Jul 25 12:44:27.402529 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:44:27.402529 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:44:27.402529 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:44:27.404966 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5c81a97dfca44bf6af64fdcd5d50c549", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5c81a97dfca44bf6af64fdcd5d50c549"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c81a97dfca44bf6af64fdcd5d50c549"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c81a97dfca44bf6af64fdcd5d50c549"}]}] Jul 25 12:44:27.404966 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:44:27.404966 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 5c81a97dfca44bf6af64fdcd5d50c549 Jul 25 12:44:27.404966 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1957362714 Jul 25 12:44:27.404966 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersOnMultiNodesTest-1957362714-project Jul 25 12:44:27.404966 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:44:27.404966 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:44:27.404966 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8c296447c2254c048f94bd9f186b0097 Jul 25 12:44:27.404966 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersOnMultiNodesTest-1957362714-project Jul 25 12:44:27.404966 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:44:27.404966 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance b2467ff1-7d17-43ae-811d-e37437b3b0ba could not be found. Jul 25 12:44:27.404966 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'b2467ff1-7d17-43ae-811d-e37437b3b0ba'} Jul 25 12:44:27.406486 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:27.406486 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:27.406486 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:44:27.406486 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:44:27.406486 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:44:27.406486 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:44:27.406486 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:44:27.406486 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:44:27.406486 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:44:27.406486 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:44:27.406486 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2467ff1-7d17-43ae-811d-e37437b3b0ba could not be found. Jul 25 12:44:27.406486 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:27.406486 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:27.406486 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:27.406486 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:27.406486 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:27.406486 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:27.406486 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:27.406486 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:27.406486 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:27.408229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:27.408229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:44:27.408229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:44:27.408229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:44:27.408229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:44:27.408229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:44:27.408229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:44:27.408229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2467ff1-7d17-43ae-811d-e37437b3b0ba could not be found. Jul 25 12:44:27.408229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:27.408229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:27.408229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:27.408229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:27.408229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:27.408229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:27.408229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:27.408229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:27.408229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2467ff1-7d17-43ae-811d-e37437b3b0ba could not be found. Jul 25 12:44:27.408229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:27.409724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-568675f1-e87b-4a78-8f5c-15e2c1d9f378 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] Returning 404 to user: Instance b2467ff1-7d17-43ae-811d-e37437b3b0ba could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:27.409724 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-568675f1-e87b-4a78-8f5c-15e2c1d9f378 tempest-ServersOnMultiNodesTest-1957362714 tempest-ServersOnMultiNodesTest-1957362714-project] 10.222.0.49 "GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba" status: 404 len: 111 microversion: 2.1 time: 0.057671 Jul 25 12:44:27.409724 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 796/1670] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:27 2022] GET /compute/v2.1/servers/b2467ff1-7d17-43ae-811d-e37437b3b0ba => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:44:27.415711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-59b35b8e-1f98-413e-a47f-31e52177875e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:27.416768 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-59b35b8e-1f98-413e-a47f-31e52177875e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:27.425706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59b35b8e-1f98-413e-a47f-31e52177875e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:27.426199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59b35b8e-1f98-413e-a47f-31e52177875e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:27.426995 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59b35b8e-1f98-413e-a47f-31e52177875e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:27.428189 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59b35b8e-1f98-413e-a47f-31e52177875e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:27.436455 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3d4324ef-0a00-4236-b5e8-84d497da5bfe tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/159b5add-9666-4a2a-82e7-7571a120cabb" status: 200 len: 1473 microversion: 2.1 time: 0.205328 Jul 25 12:44:27.447639 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 875/1671] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:27 2022] GET /compute/v2.1/servers/159b5add-9666-4a2a-82e7-7571a120cabb => generated 1473 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:27.455665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:27.560573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-a5554d5f-440e-45f6-88e9-047d59a1b29f req-cf906617-ed4c-4b42-b675-93f1f0fae5c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2467ff1-7d17-43ae-811d-e37437b3b0ba", "name": "network-vif-deleted", "tag": "b3568573-7fe4-4107-a7fc-99ac9b7eb8df"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:27.590425 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a5554d5f-440e-45f6-88e9-047d59a1b29f req-cf906617-ed4c-4b42-b675-93f1f0fae5c9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:27.590974 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a5554d5f-440e-45f6-88e9-047d59a1b29f req-cf906617-ed4c-4b42-b675-93f1f0fae5c9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:27.610252 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-a5554d5f-440e-45f6-88e9-047d59a1b29f req-cf906617-ed4c-4b42-b675-93f1f0fae5c9 service nova] Creating event network-vif-deleted:b3568573-7fe4-4107-a7fc-99ac9b7eb8df for instance b2467ff1-7d17-43ae-811d-e37437b3b0ba on n-h1-848886-15 Jul 25 12:44:27.617866 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-a5554d5f-440e-45f6-88e9-047d59a1b29f req-cf906617-ed4c-4b42-b675-93f1f0fae5c9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060642 Jul 25 12:44:27.620425 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 876/1672] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:27.693753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4a8bf783-d2fa-469c-afc2-11180036af59 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:27.695699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4a8bf783-d2fa-469c-afc2-11180036af59 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 4cb23110-97b4-4958-8ed7-5bf38b41a691] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:27.704188 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a8bf783-d2fa-469c-afc2-11180036af59 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:27.705376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a8bf783-d2fa-469c-afc2-11180036af59 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:27.707153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a8bf783-d2fa-469c-afc2-11180036af59 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:27.707989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a8bf783-d2fa-469c-afc2-11180036af59 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:27.728339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-59b35b8e-1f98-413e-a47f-31e52177875e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:27.743161 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-59b35b8e-1f98-413e-a47f-31e52177875e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1198 microversion: 2.1 time: 0.332148 Jul 25 12:44:27.744601 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 797/1673] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:27 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1198 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:27.753929 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5e9d6739-f6a4-4589-9a2a-e1200882d7fa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:27.759831 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5e9d6739-f6a4-4589-9a2a-e1200882d7fa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:27.776578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5e9d6739-f6a4-4589-9a2a-e1200882d7fa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:27.777346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5e9d6739-f6a4-4589-9a2a-e1200882d7fa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:27.778966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5e9d6739-f6a4-4589-9a2a-e1200882d7fa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:27.783434 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5e9d6739-f6a4-4589-9a2a-e1200882d7fa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:27.850082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5e9d6739-f6a4-4589-9a2a-e1200882d7fa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:44:27.991023 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5e9d6739-f6a4-4589-9a2a-e1200882d7fa tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 204 len: 0 microversion: 2.1 time: 0.239510 Jul 25 12:44:27.994573 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 798/1674] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:44:27 2022] DELETE /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:28.001917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cf3450c0-e54f-4627-8b72-23826fbe3269 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:28.002942 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cf3450c0-e54f-4627-8b72-23826fbe3269 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:28.018363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf3450c0-e54f-4627-8b72-23826fbe3269 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:28.018827 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf3450c0-e54f-4627-8b72-23826fbe3269 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:28.019618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf3450c0-e54f-4627-8b72-23826fbe3269 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:28.020053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf3450c0-e54f-4627-8b72-23826fbe3269 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:28.164815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4a8bf783-d2fa-469c-afc2-11180036af59 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:28.177076 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4a8bf783-d2fa-469c-afc2-11180036af59 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691" status: 200 len: 1313 microversion: 2.1 time: 0.489450 Jul 25 12:44:28.182076 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 877/1675] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:27 2022] GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691 => generated 1313 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:44:28.188548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0b981078-c697-49cd-9ded-f6d96fe30da0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:28.189470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0b981078-c697-49cd-9ded-f6d96fe30da0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:28.197533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b981078-c697-49cd-9ded-f6d96fe30da0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:28.201139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b981078-c697-49cd-9ded-f6d96fe30da0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:28.202030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b981078-c697-49cd-9ded-f6d96fe30da0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:28.202654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b981078-c697-49cd-9ded-f6d96fe30da0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:28.397754 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cf3450c0-e54f-4627-8b72-23826fbe3269 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:28.412153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cf3450c0-e54f-4627-8b72-23826fbe3269 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:28.413858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cf3450c0-e54f-4627-8b72-23826fbe3269 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:28.415249 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cf3450c0-e54f-4627-8b72-23826fbe3269 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1485 microversion: 2.25 time: 0.419022 Jul 25 12:44:28.416633 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 799/1676] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:27 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1485 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:28.423161 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-063fb104-7f37-499e-b866-b9f749d9d8f9 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:28.424383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-063fb104-7f37-499e-b866-b9f749d9d8f9 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:28.434030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-063fb104-7f37-499e-b866-b9f749d9d8f9 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:28.434709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-063fb104-7f37-499e-b866-b9f749d9d8f9 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:28.435843 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-063fb104-7f37-499e-b866-b9f749d9d8f9 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:28.436285 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-063fb104-7f37-499e-b866-b9f749d9d8f9 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:28.642651 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0b981078-c697-49cd-9ded-f6d96fe30da0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:28.653429 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0b981078-c697-49cd-9ded-f6d96fe30da0 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1469 microversion: 2.1 time: 0.469788 Jul 25 12:44:28.667063 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 878/1677] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:28 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1469 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:28.687208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9f03f00f-ab45-47ec-b057-7d4a348bcc36 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:28.689147 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9f03f00f-ab45-47ec-b057-7d4a348bcc36 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: 159b5add-9666-4a2a-82e7-7571a120cabb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:28.697359 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f03f00f-ab45-47ec-b057-7d4a348bcc36 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:28.698064 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f03f00f-ab45-47ec-b057-7d4a348bcc36 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:28.699051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f03f00f-ab45-47ec-b057-7d4a348bcc36 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:28.699642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f03f00f-ab45-47ec-b057-7d4a348bcc36 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:29.147039 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-063fb104-7f37-499e-b866-b9f749d9d8f9 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:29.157941 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-063fb104-7f37-499e-b866-b9f749d9d8f9 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1506 microversion: 2.1 time: 0.738872 Jul 25 12:44:29.158984 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 800/1678] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:28 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1506 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:29.165035 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-10a168aa-a062-4dd0-8bfd-2aa7b249ef62 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:29.165698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-10a168aa-a062-4dd0-8bfd-2aa7b249ef62 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:29.173299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10a168aa-a062-4dd0-8bfd-2aa7b249ef62 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:29.174066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10a168aa-a062-4dd0-8bfd-2aa7b249ef62 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:29.174948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10a168aa-a062-4dd0-8bfd-2aa7b249ef62 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:29.175500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10a168aa-a062-4dd0-8bfd-2aa7b249ef62 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:29.318181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9f03f00f-ab45-47ec-b057-7d4a348bcc36 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb37368bd444de3848966e7ff6def09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e28b1b4184471694b4dc157e452e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:29.326965 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9f03f00f-ab45-47ec-b057-7d4a348bcc36 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/159b5add-9666-4a2a-82e7-7571a120cabb" status: 200 len: 1473 microversion: 2.1 time: 0.658427 Jul 25 12:44:29.327648 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 879/1679] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:28 2022] GET /compute/v2.1/servers/159b5add-9666-4a2a-82e7-7571a120cabb => generated 1473 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:29.476401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-10a168aa-a062-4dd0-8bfd-2aa7b249ef62 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:29.490265 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-10a168aa-a062-4dd0-8bfd-2aa7b249ef62 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1198 microversion: 2.1 time: 0.329957 Jul 25 12:44:29.491213 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 801/1680] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:29 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1198 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:29.496034 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cd258b1a-cbcb-4eb9-a93a-d3e470719819 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:29.503892 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cd258b1a-cbcb-4eb9-a93a-d3e470719819 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 4cb23110-97b4-4958-8ed7-5bf38b41a691] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:29.521662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd258b1a-cbcb-4eb9-a93a-d3e470719819 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:29.522147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd258b1a-cbcb-4eb9-a93a-d3e470719819 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:29.522935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd258b1a-cbcb-4eb9-a93a-d3e470719819 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:29.523740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd258b1a-cbcb-4eb9-a93a-d3e470719819 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:29.584206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-531d02a4-da3c-432b-a75b-1ac8fce30f5e tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Action: 'create', calling method: .version_select at 0x7efcfa332ee0>, body: {"keypair": {"name": "tempest-keypair-2013148866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMbAwbreYdRw8dHh3GBEXbMtfjqoYysxiKerHfMWozDs7jq6pa2ykAwCWaQrbS8m0HvMz/QIs4+nuZLxUdo2/ih5j1pc54+jLfEhW5vv6ov39J5Le5N85KXmLNSXp0sJg=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:29.602514 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-531d02a4-da3c-432b-a75b-1ac8fce30f5e tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Getting quotas for project fca886a1b06c42f9866404f8d3e834f0. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:44:29.620523 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-531d02a4-da3c-432b-a75b-1ac8fce30f5e tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Getting quotas for user 331b532489284f5988b1a428a5f5901d and project fca886a1b06c42f9866404f8d3e834f0. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:44:29.681075 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-531d02a4-da3c-432b-a75b-1ac8fce30f5e tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.341016 Jul 25 12:44:29.683936 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 880/1681] 10.222.0.49 () {62 vars in 1199 bytes} [Mon Jul 25 12:44:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 345 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 12:44:29.704506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a650540e-b714-44d1-bb90-7ae78760efc9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:29.705149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a650540e-b714-44d1-bb90-7ae78760efc9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:29.724563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a650540e-b714-44d1-bb90-7ae78760efc9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:29.725209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a650540e-b714-44d1-bb90-7ae78760efc9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:29.726957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a650540e-b714-44d1-bb90-7ae78760efc9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:29.734214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a650540e-b714-44d1-bb90-7ae78760efc9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:29.971660 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cd258b1a-cbcb-4eb9-a93a-d3e470719819 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:29.982927 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cd258b1a-cbcb-4eb9-a93a-d3e470719819 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691" status: 200 len: 1313 microversion: 2.1 time: 0.490307 Jul 25 12:44:29.983886 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 802/1682] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:29 2022] GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691 => generated 1313 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:30.005234 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-eae794b1-bd41-44e2-b6d9-18ddf36d1c23 req-4d1a7b13-921b-408c-8681-4d52124492d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159b5add-9666-4a2a-82e7-7571a120cabb", "name": "network-vif-deleted", "tag": "27e87312-289e-4818-b884-b357c21f7a9f"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:30.015695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-eae794b1-bd41-44e2-b6d9-18ddf36d1c23 req-4d1a7b13-921b-408c-8681-4d52124492d7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:30.018455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-eae794b1-bd41-44e2-b6d9-18ddf36d1c23 req-4d1a7b13-921b-408c-8681-4d52124492d7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:30.032385 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-eae794b1-bd41-44e2-b6d9-18ddf36d1c23 req-4d1a7b13-921b-408c-8681-4d52124492d7 service nova] Creating event network-vif-deleted:27e87312-289e-4818-b884-b357c21f7a9f for instance 159b5add-9666-4a2a-82e7-7571a120cabb on n-h2-848886-15 Jul 25 12:44:30.038847 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-eae794b1-bd41-44e2-b6d9-18ddf36d1c23 req-4d1a7b13-921b-408c-8681-4d52124492d7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052331 Jul 25 12:44:30.039697 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 803/1683] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:30.046597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-12bd61ea-8e99-4230-97ed-3087561ac54c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:30.047822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-12bd61ea-8e99-4230-97ed-3087561ac54c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:30.056050 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12bd61ea-8e99-4230-97ed-3087561ac54c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:30.056793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12bd61ea-8e99-4230-97ed-3087561ac54c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:30.058073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12bd61ea-8e99-4230-97ed-3087561ac54c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:30.058802 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12bd61ea-8e99-4230-97ed-3087561ac54c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:30.396406 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a650540e-b714-44d1-bb90-7ae78760efc9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:30.406140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a650540e-b714-44d1-bb90-7ae78760efc9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:30.407801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a650540e-b714-44d1-bb90-7ae78760efc9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:30.409553 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a650540e-b714-44d1-bb90-7ae78760efc9 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1485 microversion: 2.25 time: 0.715656 Jul 25 12:44:30.429856 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 881/1684] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:29 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1485 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:30.440987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dca52ec2-3224-44ad-9f46-277030345fcc tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Calling method '.version_select at 0x7efcf9d348b0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:30.471514 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dca52ec2-3224-44ad-9f46-277030345fcc tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs/tempest-keypair-2013148866" status: 200 len: 513 microversion: 2.2 time: 0.051696 Jul 25 12:44:30.472649 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 882/1685] 10.222.0.49 () {60 vars in 1258 bytes} [Mon Jul 25 12:44:30 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2013148866 => generated 513 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:30.487259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-ec480b21-be67-48dd-9f74-03c48953f348 req-28d67442-89e9-4782-a23c-cdc7eb474134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a21af85-54c8-424c-b815-3882ecf4a893", "name": "network-vif-unplugged", "status": "completed", "tag": "067888a1-37d3-4817-9387-14f7ea43416c"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:30.501730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-ec480b21-be67-48dd-9f74-03c48953f348 req-28d67442-89e9-4782-a23c-cdc7eb474134 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:30.502290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-ec480b21-be67-48dd-9f74-03c48953f348 req-28d67442-89e9-4782-a23c-cdc7eb474134 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:30.520441 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-ec480b21-be67-48dd-9f74-03c48953f348 req-28d67442-89e9-4782-a23c-cdc7eb474134 service nova] Creating event network-vif-unplugged:067888a1-37d3-4817-9387-14f7ea43416c for instance 8a21af85-54c8-424c-b815-3882ecf4a893 on n-h1-848886-15 Jul 25 12:44:30.526600 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-ec480b21-be67-48dd-9f74-03c48953f348 req-28d67442-89e9-4782-a23c-cdc7eb474134 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046080 Jul 25 12:44:30.527753 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 883/1686] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:30.533903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f34315fd-da41-4b41-bab8-3df52ecb0c36 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:30.535445 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f34315fd-da41-4b41-bab8-3df52ecb0c36 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:30.545080 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f34315fd-da41-4b41-bab8-3df52ecb0c36 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:30.545912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f34315fd-da41-4b41-bab8-3df52ecb0c36 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:30.546786 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f34315fd-da41-4b41-bab8-3df52ecb0c36 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:30.547635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f34315fd-da41-4b41-bab8-3df52ecb0c36 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:30.588164 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-12bd61ea-8e99-4230-97ed-3087561ac54c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:30.597359 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-12bd61ea-8e99-4230-97ed-3087561ac54c tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1469 microversion: 2.1 time: 0.556142 Jul 25 12:44:30.612257 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 804/1687] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:30 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1469 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:30.617651 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7ea2e194-bc4e-4daf-9eff-2ee11aad06f7 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:30.618471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7ea2e194-bc4e-4daf-9eff-2ee11aad06f7 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] [instance: 159b5add-9666-4a2a-82e7-7571a120cabb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:30.631357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ea2e194-bc4e-4daf-9eff-2ee11aad06f7 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:30.633127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ea2e194-bc4e-4daf-9eff-2ee11aad06f7 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:30.635399 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ea2e194-bc4e-4daf-9eff-2ee11aad06f7 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:30.636347 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ea2e194-bc4e-4daf-9eff-2ee11aad06f7 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:30.704529 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-7ea2e194-bc4e-4daf-9eff-2ee11aad06f7 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] HTTP exception thrown: Instance 159b5add-9666-4a2a-82e7-7571a120cabb could not be found. Jul 25 12:44:30.713605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7ea2e194-bc4e-4daf-9eff-2ee11aad06f7 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Request method failure captured: Jul 25 12:44:30.713605 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/159b5add-9666-4a2a-82e7-7571a120cabb HTTP/1.1 Jul 25 12:44:30.713605 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:44:30.713605 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:44:30.713605 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:44:30.713605 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:44:30.713605 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:44:30.713605 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:44:30.713605 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:44:30.713605 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:30.713605 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o-lI4VhTDB157EfAdR6Y-GvPz2fD-L0NpuTBSNtNe5WLMNeDIblJhj4-CV7zJwx342N9_Py3wRwy05QVBmRraHn0MAk0sG8Hu1QxXIhCOtLdx2GBK5QEUD9I0LYiUnNASh8hlR1gbWW_LnpPBXPkQOVpMpElUtE9vyYyjTpCdnrppc Jul 25 12:44:30.713605 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:44:30.713605 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:44:30.713605 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:44:30.713605 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:44:30.713605 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:44:30.713605 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:44:30.713605 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 29e28b1b4184471694b4dc157e452e93 Jul 25 12:44:30.713605 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ListImageFiltersTestJSON-2741385 Jul 25 12:44:30.713605 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:44:30.713605 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:44:30.715462 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_29e28b1b4184471694b4dc157e452e93", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/29e28b1b4184471694b4dc157e452e93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/29e28b1b4184471694b4dc157e452e93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/29e28b1b4184471694b4dc157e452e93"}]}] Jul 25 12:44:30.715462 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ListImageFiltersTestJSON-2741385 Jul 25 12:44:30.715462 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 29e28b1b4184471694b4dc157e452e93 Jul 25 12:44:30.715462 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-2741385 Jul 25 12:44:30.715462 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ListImageFiltersTestJSON-2741385-project Jul 25 12:44:30.715462 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:44:30.715462 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:44:30.715462 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: bbb37368bd444de3848966e7ff6def09 Jul 25 12:44:30.715462 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ListImageFiltersTestJSON-2741385-project Jul 25 12:44:30.715462 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:44:30.715462 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 159b5add-9666-4a2a-82e7-7571a120cabb could not be found. Jul 25 12:44:30.715462 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '159b5add-9666-4a2a-82e7-7571a120cabb'} Jul 25 12:44:30.716300 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:30.716300 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:30.716300 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:44:30.716300 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:44:30.716300 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:44:30.716300 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:44:30.716300 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:44:30.716300 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:44:30.716300 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:44:30.716300 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:44:30.716300 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 159b5add-9666-4a2a-82e7-7571a120cabb could not be found. Jul 25 12:44:30.716300 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:30.716300 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:30.716300 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:30.716300 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:30.716300 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:30.716300 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:30.716300 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:30.716300 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:30.716300 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:30.717721 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:30.717721 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:44:30.717721 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:44:30.717721 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:44:30.717721 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:44:30.717721 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:44:30.717721 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:44:30.717721 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 159b5add-9666-4a2a-82e7-7571a120cabb could not be found. Jul 25 12:44:30.717721 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:30.717721 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:30.717721 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:30.717721 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:30.717721 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:30.717721 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:30.717721 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:30.717721 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:30.717721 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 159b5add-9666-4a2a-82e7-7571a120cabb could not be found. Jul 25 12:44:30.717721 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:30.719366 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7ea2e194-bc4e-4daf-9eff-2ee11aad06f7 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Returning 404 to user: Instance 159b5add-9666-4a2a-82e7-7571a120cabb could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:30.719366 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7ea2e194-bc4e-4daf-9eff-2ee11aad06f7 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "GET /compute/v2.1/servers/159b5add-9666-4a2a-82e7-7571a120cabb" status: 404 len: 111 microversion: 2.1 time: 0.103484 Jul 25 12:44:30.719920 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 805/1688] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:30 2022] GET /compute/v2.1/servers/159b5add-9666-4a2a-82e7-7571a120cabb => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:44:30.733744 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e8c4104d-5f59-4855-b461-f7950a7f691d tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Calling method '.version_select at 0x7efcfed7c670>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:30.787649 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e8c4104d-5f59-4855-b461-f7950a7f691d tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2013148866" status: 204 len: 0 microversion: 2.2 time: 0.065119 Jul 25 12:44:30.788822 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 806/1689] 10.222.0.49 () {60 vars in 1261 bytes} [Mon Jul 25 12:44:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2013148866 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:30.799499 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5748b730-f98b-43f2-a871-c18d82822133 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:30.802192 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5748b730-f98b-43f2-a871-c18d82822133 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:30.822622 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5748b730-f98b-43f2-a871-c18d82822133 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:30.826646 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5748b730-f98b-43f2-a871-c18d82822133 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:30.829383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5748b730-f98b-43f2-a871-c18d82822133 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:30.831257 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5748b730-f98b-43f2-a871-c18d82822133 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:31.142338 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f34315fd-da41-4b41-bab8-3df52ecb0c36 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:31.161419 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f34315fd-da41-4b41-bab8-3df52ecb0c36 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1506 microversion: 2.1 time: 0.631142 Jul 25 12:44:31.168367 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 884/1690] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:30 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1506 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:31.182581 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-794a0994-45d6-428c-b707-1694f84c6503 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcf9d43a60>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:31.482610 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5748b730-f98b-43f2-a871-c18d82822133 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:31.496809 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5748b730-f98b-43f2-a871-c18d82822133 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1380 microversion: 2.1 time: 0.703582 Jul 25 12:44:31.497502 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 807/1691] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:30 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1380 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:31.508878 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7630e198-631a-4f04-bee1-7a5bd4b965a7 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Action: 'create', calling method: .version_select at 0x7efcfecef3a0>, body: {"keypair": {"name": "tempest-keypair-760417556", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB25G0B7lAyvBcizvzU2BN2GESGW5piG7O3nxpKedEaMdUhfS6dQZvHPO6mKQmiGZRmrDaPeqEy8Fd/x78MbqciujduX26qqfB756EMX61grADldzF322L7EXx7QLwh94g=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:31.547103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-7630e198-631a-4f04-bee1-7a5bd4b965a7 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Getting quotas for project fca886a1b06c42f9866404f8d3e834f0. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:44:31.559593 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-7630e198-631a-4f04-bee1-7a5bd4b965a7 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Getting quotas for user 331b532489284f5988b1a428a5f5901d and project fca886a1b06c42f9866404f8d3e834f0. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:44:31.636711 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7630e198-631a-4f04-bee1-7a5bd4b965a7 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.137135 Jul 25 12:44:31.637871 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 808/1692] 10.222.0.49 () {62 vars in 1199 bytes} [Mon Jul 25 12:44:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 140 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 12:44:31.649703 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-12deabec-acf4-465d-a1d8-ec973473319c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:31.652454 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-12deabec-acf4-465d-a1d8-ec973473319c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 4cb23110-97b4-4958-8ed7-5bf38b41a691] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:31.662093 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:31.667412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12deabec-acf4-465d-a1d8-ec973473319c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:31.667985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12deabec-acf4-465d-a1d8-ec973473319c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:31.669278 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12deabec-acf4-465d-a1d8-ec973473319c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:31.669768 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12deabec-acf4-465d-a1d8-ec973473319c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:31.678817 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-794a0994-45d6-428c-b707-1694f84c6503 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "DELETE /compute/v2.1/images/35a92216-909b-469f-94ec-278efa934030" status: 204 len: 0 microversion: 2.1 time: 0.508530 Jul 25 12:44:31.679396 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 885/1693] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:31 2022] DELETE /compute/v2.1/images/35a92216-909b-469f-94ec-278efa934030 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:31.684552 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-370ff5fa-df41-494f-bb2a-ccc0b05998b7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:31.685177 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-370ff5fa-df41-494f-bb2a-ccc0b05998b7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:31.703597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-370ff5fa-df41-494f-bb2a-ccc0b05998b7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:31.704098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-370ff5fa-df41-494f-bb2a-ccc0b05998b7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:31.705073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-370ff5fa-df41-494f-bb2a-ccc0b05998b7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:31.705569 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-370ff5fa-df41-494f-bb2a-ccc0b05998b7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:31.897472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:31.956916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-12deabec-acf4-465d-a1d8-ec973473319c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:31.969724 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-12deabec-acf4-465d-a1d8-ec973473319c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691" status: 200 len: 1313 microversion: 2.1 time: 0.330402 Jul 25 12:44:31.970782 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 809/1694] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:31 2022] GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691 => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:31.989534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4b02e30c-cb5d-4d2d-ba4a-8958c4ab775a tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:31.990448 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4b02e30c-cb5d-4d2d-ba4a-8958c4ab775a tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:32.001649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-370ff5fa-df41-494f-bb2a-ccc0b05998b7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:32.009293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b02e30c-cb5d-4d2d-ba4a-8958c4ab775a tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:32.010264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b02e30c-cb5d-4d2d-ba4a-8958c4ab775a tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:32.012282 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b02e30c-cb5d-4d2d-ba4a-8958c4ab775a tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:32.013148 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b02e30c-cb5d-4d2d-ba4a-8958c4ab775a tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:32.013981 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-370ff5fa-df41-494f-bb2a-ccc0b05998b7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:32.017081 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-370ff5fa-df41-494f-bb2a-ccc0b05998b7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:32.021169 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-370ff5fa-df41-494f-bb2a-ccc0b05998b7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1485 microversion: 2.25 time: 0.338706 Jul 25 12:44:32.021169 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 886/1695] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:31 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1485 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:32.026854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-705de797-0f12-4dd0-8005-7bad39df3b42 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:32.028042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-705de797-0f12-4dd0-8005-7bad39df3b42 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:32.037357 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-705de797-0f12-4dd0-8005-7bad39df3b42 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:32.037821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-705de797-0f12-4dd0-8005-7bad39df3b42 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:32.038677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-705de797-0f12-4dd0-8005-7bad39df3b42 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:32.039124 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-705de797-0f12-4dd0-8005-7bad39df3b42 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:32.123996 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-705de797-0f12-4dd0-8005-7bad39df3b42 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:32.125062 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-705de797-0f12-4dd0-8005-7bad39df3b42 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:32.136152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-705de797-0f12-4dd0-8005-7bad39df3b42 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lazy-loading 'fault' on Instance uuid ed7807bb-d3da-4dc2-baf9-e547d671f324 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:44:32.197755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-705de797-0f12-4dd0-8005-7bad39df3b42 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:32.208547 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-705de797-0f12-4dd0-8005-7bad39df3b42 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 200 len: 1303 microversion: 2.1 time: 0.186613 Jul 25 12:44:32.218646 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 887/1696] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:32 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 1303 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:32.225241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7b8595a4-a7d6-4f8d-b5ee-b7793b6af859 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Calling method '.version_select at 0x7efcf9d34f70>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:32.252895 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4b02e30c-cb5d-4d2d-ba4a-8958c4ab775a tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1533 microversion: 2.1 time: 0.273273 Jul 25 12:44:32.253480 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 810/1697] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:31 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1533 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:32.259552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-28068566-8edd-42d9-ad19-6c079a9884ca tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcfecb1f70>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:32.287267 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7b8595a4-a7d6-4f8d-b5ee-b7793b6af859 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-760417556" status: 204 len: 0 microversion: 2.2 time: 0.070373 Jul 25 12:44:32.289490 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 888/1698] 10.222.0.49 () {60 vars in 1258 bytes} [Mon Jul 25 12:44:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-760417556 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:32.300210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-fe657669-02dc-43ea-b815-fadea18146e9 req-c829beb4-4377-4678-b1a9-730e619a320d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cb23110-97b4-4958-8ed7-5bf38b41a691", "tag": "f47ea668-6bab-47e6-ba2e-12feac455939"}, {"server_uuid": "ed7807bb-d3da-4dc2-baf9-e547d671f324", "name": "network-vif-deleted", "tag": "6ef3a05b-5303-4d72-9ec0-6eeee9be1d2a"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:32.324817 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fe657669-02dc-43ea-b815-fadea18146e9 req-c829beb4-4377-4678-b1a9-730e619a320d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:32.325308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fe657669-02dc-43ea-b815-fadea18146e9 req-c829beb4-4377-4678-b1a9-730e619a320d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:32.340341 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-fe657669-02dc-43ea-b815-fadea18146e9 req-c829beb4-4377-4678-b1a9-730e619a320d service nova] Creating event network-changed:f47ea668-6bab-47e6-ba2e-12feac455939 for instance 4cb23110-97b4-4958-8ed7-5bf38b41a691 on n-h2-848886-15 Jul 25 12:44:32.340864 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-fe657669-02dc-43ea-b815-fadea18146e9 req-c829beb4-4377-4678-b1a9-730e619a320d service nova] Creating event network-vif-deleted:6ef3a05b-5303-4d72-9ec0-6eeee9be1d2a for instance ed7807bb-d3da-4dc2-baf9-e547d671f324 on n-h1-848886-15 Jul 25 12:44:32.356629 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-fe657669-02dc-43ea-b815-fadea18146e9 req-c829beb4-4377-4678-b1a9-730e619a320d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.065663 Jul 25 12:44:32.357453 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 889/1699] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:32.365042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f6a15931-f736-4719-bf68-381758b4b98b tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:32.366121 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f6a15931-f736-4719-bf68-381758b4b98b tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:32.373120 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f6a15931-f736-4719-bf68-381758b4b98b tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:32.373898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f6a15931-f736-4719-bf68-381758b4b98b tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:32.374964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f6a15931-f736-4719-bf68-381758b4b98b tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:32.375592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f6a15931-f736-4719-bf68-381758b4b98b tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:32.574031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f6a15931-f736-4719-bf68-381758b4b98b tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:32.575816 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-28068566-8edd-42d9-ad19-6c079a9884ca tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "DELETE /compute/v2.1/images/db4eca84-fc4e-45ed-80b0-8b171b7cda89" status: 204 len: 0 microversion: 2.1 time: 0.320985 Jul 25 12:44:32.580293 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 811/1700] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:32 2022] DELETE /compute/v2.1/images/db4eca84-fc4e-45ed-80b0-8b171b7cda89 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:32.586224 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f6a15931-f736-4719-bf68-381758b4b98b tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1506 microversion: 2.1 time: 0.227086 Jul 25 12:44:32.587537 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1bc7e79d-f952-4292-a717-31bac882e6af tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:32.587809 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 890/1701] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:32 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:32.588685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1bc7e79d-f952-4292-a717-31bac882e6af tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:32.593527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2c4bb665-5791-4642-8c05-f75846fe38e0 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Action: 'create', calling method: .version_select at 0x7efcf9d34430>, body: {"keypair": {"name": "tempest-keypair-316838508", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:32.607537 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1bc7e79d-f952-4292-a717-31bac882e6af tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:32.608425 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1bc7e79d-f952-4292-a717-31bac882e6af tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:32.611597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1bc7e79d-f952-4292-a717-31bac882e6af tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:32.612211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1bc7e79d-f952-4292-a717-31bac882e6af tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:32.627331 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-2c4bb665-5791-4642-8c05-f75846fe38e0 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Getting quotas for project fca886a1b06c42f9866404f8d3e834f0. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:44:32.632896 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-2c4bb665-5791-4642-8c05-f75846fe38e0 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Getting quotas for user 331b532489284f5988b1a428a5f5901d and project fca886a1b06c42f9866404f8d3e834f0. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:44:32.661418 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2c4bb665-5791-4642-8c05-f75846fe38e0 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.072424 Jul 25 12:44:32.668245 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 891/1702] 10.222.0.49 () {62 vars in 1199 bytes} [Mon Jul 25 12:44:32 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 78 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 12:44:32.674373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-77e5aeae-7b98-422d-964a-056d16b357ce req-2fe0e81e-f7fa-4d0d-930a-d830f994a44c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a21af85-54c8-424c-b815-3882ecf4a893", "tag": "067888a1-37d3-4817-9387-14f7ea43416c"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:32.690970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-77e5aeae-7b98-422d-964a-056d16b357ce req-2fe0e81e-f7fa-4d0d-930a-d830f994a44c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:32.692339 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-77e5aeae-7b98-422d-964a-056d16b357ce req-2fe0e81e-f7fa-4d0d-930a-d830f994a44c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:32.705889 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-77e5aeae-7b98-422d-964a-056d16b357ce req-2fe0e81e-f7fa-4d0d-930a-d830f994a44c service nova] Creating event network-changed:067888a1-37d3-4817-9387-14f7ea43416c for instance 8a21af85-54c8-424c-b815-3882ecf4a893 on n-h1-848886-15 Jul 25 12:44:32.724565 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-77e5aeae-7b98-422d-964a-056d16b357ce req-2fe0e81e-f7fa-4d0d-930a-d830f994a44c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056824 Jul 25 12:44:32.725894 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 892/1703] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:32.733486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e1da1f00-37fd-4127-a284-f852a32918e6 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] Calling method '.version_select at 0x7efcfa1e7040>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:32.763640 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1bc7e79d-f952-4292-a717-31bac882e6af tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1533 microversion: 2.1 time: 0.181418 Jul 25 12:44:32.764162 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 812/1704] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:32 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1533 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:32.782530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c1a0aa3a-2f39-48c4-96d1-ca73a1a979e1 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Calling method '.version_select at 0x7efcfecf09d0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:32.817226 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c1a0aa3a-2f39-48c4-96d1-ca73a1a979e1 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-316838508" status: 204 len: 0 microversion: 2.2 time: 0.052042 Jul 25 12:44:32.818224 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 813/1705] 10.222.0.49 () {60 vars in 1258 bytes} [Mon Jul 25 12:44:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-316838508 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:32.827140 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-30982f0d-0c01-439b-952d-59a35a8189c3 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:32.830176 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:44:32.830176 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:44:32.831628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30982f0d-0c01-439b-952d-59a35a8189c3 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:32.832098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30982f0d-0c01-439b-952d-59a35a8189c3 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:32.832898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30982f0d-0c01-439b-952d-59a35a8189c3 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:32.833530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30982f0d-0c01-439b-952d-59a35a8189c3 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:32.883669 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-30982f0d-0c01-439b-952d-59a35a8189c3 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.064315 Jul 25 12:44:32.891703 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 814/1706] 10.222.0.49 () {58 vars in 1176 bytes} [Mon Jul 25 12:44:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:32.899845 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9b49b6e2-8567-4363-8cb6-7ce7c0f8f164 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Action: 'create', calling method: .version_select at 0x7efcfece9ee0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1691835067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyG4/YjZPzu30QIRlfxeYKI8mxBW0uHWAHpZIuFZGGVPtS4KOEFhNkUFMPgAeroV7VFTUigzdIDhA+tikHdR1Hg+XFqABVw2+oXYte7ms5caKKLAs9HzJFLdSJk9TTBZg=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:32.965547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-9b49b6e2-8567-4363-8cb6-7ce7c0f8f164 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Getting quotas for project fca886a1b06c42f9866404f8d3e834f0. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:44:32.973080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-9b49b6e2-8567-4363-8cb6-7ce7c0f8f164 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Getting quotas for user 331b532489284f5988b1a428a5f5901d and project fca886a1b06c42f9866404f8d3e834f0. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:44:33.028315 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9b49b6e2-8567-4363-8cb6-7ce7c0f8f164 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.134886 Jul 25 12:44:33.029746 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 815/1707] 10.222.0.49 () {62 vars in 1199 bytes} [Mon Jul 25 12:44:32 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 12:44:33.034678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-963043a8-942e-46f0-b918-1971601d70ee tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-848886-15", "block_migration": false, "disk_over_commit": false}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:33.050675 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-963043a8-942e-46f0-b918-1971601d70ee tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:33.066637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-963043a8-942e-46f0-b918-1971601d70ee tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:33.068570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-963043a8-942e-46f0-b918-1971601d70ee tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:33.071792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-963043a8-942e-46f0-b918-1971601d70ee tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:33.072514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-963043a8-942e-46f0-b918-1971601d70ee tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:33.081308 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e1da1f00-37fd-4127-a284-f852a32918e6 tempest-ListImageFiltersTestJSON-2741385 tempest-ListImageFiltersTestJSON-2741385-project] 10.222.0.49 "DELETE /compute/v2.1/images/9fc01346-3991-4ca8-a50a-080c71b19e48" status: 204 len: 0 microversion: 2.1 time: 0.353912 Jul 25 12:44:33.082498 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 893/1708] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:32 2022] DELETE /compute/v2.1/images/9fc01346-3991-4ca8-a50a-080c71b19e48 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:33.092999 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e5220075-adc3-459b-a2c3-47229b209842 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:33.094534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e5220075-adc3-459b-a2c3-47229b209842 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 4cb23110-97b4-4958-8ed7-5bf38b41a691] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:33.102367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5220075-adc3-459b-a2c3-47229b209842 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:33.103150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5220075-adc3-459b-a2c3-47229b209842 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:33.104510 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5220075-adc3-459b-a2c3-47229b209842 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:33.105104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5220075-adc3-459b-a2c3-47229b209842 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:33.162770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-963043a8-942e-46f0-b918-1971601d70ee tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lazy-loading 'flavor' on Instance uuid 791ea14d-3fa9-4be1-afc1-82c8908395f4 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:44:33.183335 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-963043a8-942e-46f0-b918-1971601d70ee tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Going to try to live migrate instance to n-h2-848886-15 {{(pid=125883) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 12:44:33.998934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e5220075-adc3-459b-a2c3-47229b209842 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:34.001432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:34.011630 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e5220075-adc3-459b-a2c3-47229b209842 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691" status: 200 len: 1313 microversion: 2.1 time: 0.926649 Jul 25 12:44:34.012248 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 894/1709] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:33 2022] GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691 => generated 1313 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:34.025137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e6bbe841-ccb5-4f7f-9fa1-bb2d6b290cce tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Action: 'create', calling method: .version_select at 0x7efcfa040ca0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1028589992", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5r8uBWpVQhHHuHje6MwI44RH+UiGcJ6LFoWrii4flEuGSsxxbD7rZ557QDX2H8U3NgvIvLDzquEhOVqO5sVguFNnCVSGjCOxQxxtBB2i4XcmUgiBh5mCvUkaSg3FAzJg=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:34.036107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:34.065972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-e6bbe841-ccb5-4f7f-9fa1-bb2d6b290cce tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Getting quotas for project fca886a1b06c42f9866404f8d3e834f0. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:44:34.075640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-e6bbe841-ccb5-4f7f-9fa1-bb2d6b290cce tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Getting quotas for user 331b532489284f5988b1a428a5f5901d and project fca886a1b06c42f9866404f8d3e834f0. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:44:34.146444 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e6bbe841-ccb5-4f7f-9fa1-bb2d6b290cce tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.133112 Jul 25 12:44:34.147427 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 895/1710] 10.222.0.49 () {62 vars in 1199 bytes} [Mon Jul 25 12:44:34 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 12:44:34.156743 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ea514fa6-68fb-4938-9bd0-11b8fa2fa4a0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:34.159745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ea514fa6-68fb-4938-9bd0-11b8fa2fa4a0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:34.175029 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea514fa6-68fb-4938-9bd0-11b8fa2fa4a0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:34.175481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea514fa6-68fb-4938-9bd0-11b8fa2fa4a0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:34.176316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea514fa6-68fb-4938-9bd0-11b8fa2fa4a0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:34.176716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea514fa6-68fb-4938-9bd0-11b8fa2fa4a0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:34.850803 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ea514fa6-68fb-4938-9bd0-11b8fa2fa4a0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:34.872456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ea514fa6-68fb-4938-9bd0-11b8fa2fa4a0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:34.874421 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ea514fa6-68fb-4938-9bd0-11b8fa2fa4a0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:34.875984 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ea514fa6-68fb-4938-9bd0-11b8fa2fa4a0 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1485 microversion: 2.25 time: 0.726995 Jul 25 12:44:34.876730 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 896/1711] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:34 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1485 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:34.894754 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c73b4dd6-a733-4332-8c2d-a606fbb65446 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:34.895576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c73b4dd6-a733-4332-8c2d-a606fbb65446 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: ed7807bb-d3da-4dc2-baf9-e547d671f324] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:34.907106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c73b4dd6-a733-4332-8c2d-a606fbb65446 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:34.907833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c73b4dd6-a733-4332-8c2d-a606fbb65446 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:34.908795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c73b4dd6-a733-4332-8c2d-a606fbb65446 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:34.909434 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c73b4dd6-a733-4332-8c2d-a606fbb65446 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:34.929600 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-c73b4dd6-a733-4332-8c2d-a606fbb65446 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] HTTP exception thrown: Instance ed7807bb-d3da-4dc2-baf9-e547d671f324 could not be found. Jul 25 12:44:34.931692 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c73b4dd6-a733-4332-8c2d-a606fbb65446 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Request method failure captured: Jul 25 12:44:34.931692 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 HTTP/1.1 Jul 25 12:44:34.931692 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:44:34.931692 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:44:34.931692 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:44:34.931692 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:44:34.931692 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:44:34.931692 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:44:34.931692 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:44:34.931692 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:34.931692 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o7Tz0O7SSTbmDl0Z_49fiVulE4u2IVHWtJX8IhZRzdeY3RfzT5cF6XlRwH6pcEa6bCZXczC1oDltEE_WwkEgjlsc4Dn4JO42YSJ3wN5AuONFw1-5ANhhWBomhlw3yEv_CGvFeDIla6_OTsCNCdBF1OoYRpAauJXL0o5ty9W2TEu2BQ Jul 25 12:44:34.931692 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:44:34.931692 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:44:34.931692 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:44:34.931692 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:44:34.931692 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:44:34.931692 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:44:34.931692 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5220cb7ebe7b4a89a8d1edabad2391a7 Jul 25 12:44:34.931692 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-MigrationsAdminTest-1010123982 Jul 25 12:44:34.931692 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:44:34.931692 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:44:34.933601 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5220cb7ebe7b4a89a8d1edabad2391a7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5220cb7ebe7b4a89a8d1edabad2391a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5220cb7ebe7b4a89a8d1edabad2391a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5220cb7ebe7b4a89a8d1edabad2391a7"}]}] Jul 25 12:44:34.933601 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-MigrationsAdminTest-1010123982 Jul 25 12:44:34.933601 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5220cb7ebe7b4a89a8d1edabad2391a7 Jul 25 12:44:34.933601 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-MigrationsAdminTest-1010123982 Jul 25 12:44:34.933601 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-MigrationsAdminTest-1010123982-project Jul 25 12:44:34.933601 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:44:34.933601 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:44:34.933601 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 045d03491c1046609caffee111db48fc Jul 25 12:44:34.933601 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-MigrationsAdminTest-1010123982-project Jul 25 12:44:34.933601 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:44:34.933601 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance ed7807bb-d3da-4dc2-baf9-e547d671f324 could not be found. Jul 25 12:44:34.933601 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'ed7807bb-d3da-4dc2-baf9-e547d671f324'} Jul 25 12:44:34.934592 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:34.934592 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:34.934592 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:44:34.934592 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:44:34.934592 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:44:34.934592 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:44:34.934592 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:44:34.934592 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:44:34.934592 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:44:34.934592 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:44:34.934592 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed7807bb-d3da-4dc2-baf9-e547d671f324 could not be found. Jul 25 12:44:34.934592 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:34.934592 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:34.934592 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:34.934592 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:34.934592 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:34.934592 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:34.934592 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:34.934592 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:34.934592 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:34.936016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:34.936016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:44:34.936016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:44:34.936016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:44:34.936016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:44:34.936016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:44:34.936016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:44:34.936016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed7807bb-d3da-4dc2-baf9-e547d671f324 could not be found. Jul 25 12:44:34.936016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:34.936016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:34.936016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:34.936016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:34.936016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:34.936016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:34.936016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:34.936016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:34.936016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed7807bb-d3da-4dc2-baf9-e547d671f324 could not be found. Jul 25 12:44:34.936016 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:34.938789 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c73b4dd6-a733-4332-8c2d-a606fbb65446 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Returning 404 to user: Instance ed7807bb-d3da-4dc2-baf9-e547d671f324 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:34.940428 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c73b4dd6-a733-4332-8c2d-a606fbb65446 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324" status: 404 len: 111 microversion: 2.1 time: 0.062327 Jul 25 12:44:34.941339 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 897/1712] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:34 2022] GET /compute/v2.1/servers/ed7807bb-d3da-4dc2-baf9-e547d671f324 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:44:34.947218 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-928af300-eaf1-4304-9df4-8ad0bc8714ba tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:34.961262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-928af300-eaf1-4304-9df4-8ad0bc8714ba tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:34.971739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-928af300-eaf1-4304-9df4-8ad0bc8714ba tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:34.972482 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-928af300-eaf1-4304-9df4-8ad0bc8714ba tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:34.973522 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-928af300-eaf1-4304-9df4-8ad0bc8714ba tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:34.974230 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-928af300-eaf1-4304-9df4-8ad0bc8714ba tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:35.412154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-928af300-eaf1-4304-9df4-8ad0bc8714ba tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:35.441012 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-928af300-eaf1-4304-9df4-8ad0bc8714ba tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1506 microversion: 2.1 time: 0.498187 Jul 25 12:44:35.455575 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 898/1713] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:34 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1506 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:35.468546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a5310657-969f-4d35-a73a-640a65bbd84b tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Action: 'create', calling method: .version_select at 0x7efcfa2dbdc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2072379078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKxGpZHdiG2K1kOCOt0EbfIjrK7FQCPPDzR8r0Ztp6yoINKTqOnxHusljfmcj1EelSRDEh8wxYJBFhrfgxbAy8qf88LFESdAJl50/yqdaLlrPtztzfRAtTIedI4AQSBeg=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:35.507795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-a5310657-969f-4d35-a73a-640a65bbd84b tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Getting quotas for project fca886a1b06c42f9866404f8d3e834f0. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:44:35.528708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-a5310657-969f-4d35-a73a-640a65bbd84b tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Getting quotas for user 331b532489284f5988b1a428a5f5901d and project fca886a1b06c42f9866404f8d3e834f0. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:44:35.576131 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a5310657-969f-4d35-a73a-640a65bbd84b tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.118901 Jul 25 12:44:35.576772 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 899/1714] 10.222.0.49 () {62 vars in 1199 bytes} [Mon Jul 25 12:44:35 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 12:44:35.588677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-eb547af3-56d5-4aa3-ae1e-f16b00917535 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:35.589413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eb547af3-56d5-4aa3-ae1e-f16b00917535 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:35.603716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb547af3-56d5-4aa3-ae1e-f16b00917535 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:35.604181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb547af3-56d5-4aa3-ae1e-f16b00917535 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:35.605114 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb547af3-56d5-4aa3-ae1e-f16b00917535 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:35.605574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb547af3-56d5-4aa3-ae1e-f16b00917535 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:35.651941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eb547af3-56d5-4aa3-ae1e-f16b00917535 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:44:35.867810 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-eb547af3-56d5-4aa3-ae1e-f16b00917535 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "DELETE /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 204 len: 0 microversion: 2.1 time: 0.289341 Jul 25 12:44:35.868455 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 900/1715] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:44:35 2022] DELETE /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:35.882146 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-963043a8-942e-46f0-b918-1971601d70ee tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4/action" status: 202 len: 0 microversion: 2.1 time: 2.850628 Jul 25 12:44:35.883544 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 816/1716] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:44:33 2022] POST /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4/action => generated 0 bytes in 2853 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:44:35.885595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c0a97db9-0b7b-44e6-982a-14cebedd215f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:35.886579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c0a97db9-0b7b-44e6-982a-14cebedd215f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 4cb23110-97b4-4958-8ed7-5bf38b41a691] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:35.890554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f6b0b1bd-e13e-4725-8b0e-e2216c4adb49 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Calling method '.version_select at 0x7efcfed7c8b0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:35.901734 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c0a97db9-0b7b-44e6-982a-14cebedd215f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:35.902531 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c0a97db9-0b7b-44e6-982a-14cebedd215f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:35.903525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c0a97db9-0b7b-44e6-982a-14cebedd215f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:35.905139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c0a97db9-0b7b-44e6-982a-14cebedd215f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:35.915261 n-d-848886-15 devstack@n-api.service[125883]: WARNING oslo_db.sqlalchemy.utils [None req-f6b0b1bd-e13e-4725-8b0e-e2216c4adb49 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 12:44:35.925684 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f6b0b1bd-e13e-4725-8b0e-e2216c4adb49 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.040327 Jul 25 12:44:35.927833 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 817/1717] 10.222.0.49 () {60 vars in 1177 bytes} [Mon Jul 25 12:44:35 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:35.935289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-38e3f0b3-66cc-4242-a152-c533c4e9723d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:35.936345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-38e3f0b3-66cc-4242-a152-c533c4e9723d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:35.953509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-38e3f0b3-66cc-4242-a152-c533c4e9723d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:35.954552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-38e3f0b3-66cc-4242-a152-c533c4e9723d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:35.956472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-38e3f0b3-66cc-4242-a152-c533c4e9723d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:35.957180 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-38e3f0b3-66cc-4242-a152-c533c4e9723d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:35.989803 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:36.346872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c0a97db9-0b7b-44e6-982a-14cebedd215f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:36.363092 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c0a97db9-0b7b-44e6-982a-14cebedd215f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691" status: 200 len: 1313 microversion: 2.1 time: 0.489554 Jul 25 12:44:36.363719 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 901/1718] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:35 2022] GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691 => generated 1313 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:36.373069 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-77e2d0a7-64f5-4380-ae3f-5d69932b46ea tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:36.373938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-77e2d0a7-64f5-4380-ae3f-5d69932b46ea tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:36.385099 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-38e3f0b3-66cc-4242-a152-c533c4e9723d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:36.395580 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-77e2d0a7-64f5-4380-ae3f-5d69932b46ea tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:36.395924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-77e2d0a7-64f5-4380-ae3f-5d69932b46ea tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:36.396709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-77e2d0a7-64f5-4380-ae3f-5d69932b46ea tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:36.397336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-77e2d0a7-64f5-4380-ae3f-5d69932b46ea tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:36.398816 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-38e3f0b3-66cc-4242-a152-c533c4e9723d tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1467 microversion: 2.1 time: 0.469017 Jul 25 12:44:36.399584 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 818/1719] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:35 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1467 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:36.405242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-47d8a6de-9fd0-42f2-a0b3-d08bcf682bc2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:36.406296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-47d8a6de-9fd0-42f2-a0b3-d08bcf682bc2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:36.421201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47d8a6de-9fd0-42f2-a0b3-d08bcf682bc2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:36.422790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47d8a6de-9fd0-42f2-a0b3-d08bcf682bc2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:36.423721 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47d8a6de-9fd0-42f2-a0b3-d08bcf682bc2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:36.424293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47d8a6de-9fd0-42f2-a0b3-d08bcf682bc2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:36.692929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-77e2d0a7-64f5-4380-ae3f-5d69932b46ea tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:36.708385 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-77e2d0a7-64f5-4380-ae3f-5d69932b46ea tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 0.343345 Jul 25 12:44:36.709164 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 902/1720] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:36 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:36.714098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5e5c5146-e5ca-4412-9e21-fdd7168f9018 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Calling method '.version_select at 0x7efcfa0e7dc0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:36.730137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-47d8a6de-9fd0-42f2-a0b3-d08bcf682bc2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:36.739384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-47d8a6de-9fd0-42f2-a0b3-d08bcf682bc2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:36.745813 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-47d8a6de-9fd0-42f2-a0b3-d08bcf682bc2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:36.751450 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-47d8a6de-9fd0-42f2-a0b3-d08bcf682bc2 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1485 microversion: 2.25 time: 0.350524 Jul 25 12:44:36.752222 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 819/1721] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:36 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1485 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:36.759082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b2f00b47-99cd-41c7-99d6-690ecdafd7c5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:36.759904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b2f00b47-99cd-41c7-99d6-690ecdafd7c5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:36.768123 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5e5c5146-e5ca-4412-9e21-fdd7168f9018 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2072379078" status: 204 len: 0 microversion: 2.2 time: 0.057641 Jul 25 12:44:36.768742 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 903/1722] 10.222.0.49 () {60 vars in 1321 bytes} [Mon Jul 25 12:44:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2072379078 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:36.775048 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b2f00b47-99cd-41c7-99d6-690ecdafd7c5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:36.776410 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b2f00b47-99cd-41c7-99d6-690ecdafd7c5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:36.777593 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b2f00b47-99cd-41c7-99d6-690ecdafd7c5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:36.778317 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b2f00b47-99cd-41c7-99d6-690ecdafd7c5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:37.025935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b2f00b47-99cd-41c7-99d6-690ecdafd7c5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:37.040328 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b2f00b47-99cd-41c7-99d6-690ecdafd7c5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1506 microversion: 2.1 time: 0.283644 Jul 25 12:44:37.041235 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 820/1723] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:36 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:37.070467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5641fd70-0e25-4e9b-8802-d110200ff8e2 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Calling method '.version_select at 0x7efcfecf0ee0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:37.077052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-32f9035a-4baa-4a9f-9c68-25aa68dc1401 tempest-ListImageFiltersNegativeTestJSON-2039248219 tempest-ListImageFiltersNegativeTestJSON-2039248219-project] Calling method '.version_select at 0x7efcf9d35ee0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:37.110125 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5641fd70-0e25-4e9b-8802-d110200ff8e2 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1028589992" status: 204 len: 0 microversion: 2.2 time: 0.041832 Jul 25 12:44:37.112719 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 821/1724] 10.222.0.49 () {60 vars in 1321 bytes} [Mon Jul 25 12:44:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1028589992 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:37.114159 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-32f9035a-4baa-4a9f-9c68-25aa68dc1401 tempest-ListImageFiltersNegativeTestJSON-2039248219 tempest-ListImageFiltersNegativeTestJSON-2039248219-project] HTTP exception thrown: Image not found. Jul 25 12:44:37.117052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-32f9035a-4baa-4a9f-9c68-25aa68dc1401 tempest-ListImageFiltersNegativeTestJSON-2039248219 tempest-ListImageFiltersNegativeTestJSON-2039248219-project] Request method failure captured: Jul 25 12:44:37.117052 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/images/bd5493ab-070f-47b6-bfee-6ffba4c32b05 HTTP/1.1 Jul 25 12:44:37.117052 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:44:37.117052 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:44:37.117052 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:44:37.117052 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:44:37.117052 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:44:37.117052 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:44:37.117052 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:44:37.117052 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:37.117052 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pA07uokxS7NDKVQEJ-RTGwYWnCS8HBD7O2FGzENrd2oMaTjQh6k80M7-7yzE3wX9pzZAHgvKVsubf_k0oPhem-H23Nce8ZFRxHMJp2lGX7qAQ3ApaeMY1wWU7yzvB_r_CEHYu-6EU5q8cE30oSJjMvawgpUr6kBAmyqDqfnQAx8JkY Jul 25 12:44:37.117052 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:44:37.117052 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:44:37.117052 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:44:37.117052 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:44:37.117052 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:44:37.117052 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:44:37.117052 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 3b0ca6c805d74a4685919576c4a3afd8 Jul 25 12:44:37.117052 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-2039248219 Jul 25 12:44:37.117052 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:44:37.117052 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:44:37.118597 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3b0ca6c805d74a4685919576c4a3afd8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3b0ca6c805d74a4685919576c4a3afd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b0ca6c805d74a4685919576c4a3afd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b0ca6c805d74a4685919576c4a3afd8"}]}] Jul 25 12:44:37.118597 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-2039248219 Jul 25 12:44:37.118597 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 3b0ca6c805d74a4685919576c4a3afd8 Jul 25 12:44:37.118597 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-2039248219 Jul 25 12:44:37.118597 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ListImageFiltersNegativeTestJSON-2039248219-project Jul 25 12:44:37.118597 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:44:37.118597 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:44:37.118597 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 3bfd1fa14ae74bc2bc2528476156141c Jul 25 12:44:37.118597 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-2039248219-project Jul 25 12:44:37.118597 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:44:37.118597 n-d-848886-15 devstack@n-api.service[125884]: exception: Image not found. Jul 25 12:44:37.118597 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'bd5493ab-070f-47b6-bfee-6ffba4c32b05'} Jul 25 12:44:37.118597 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:37.119686 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:37.119686 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 12:44:37.119686 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 12:44:37.119686 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:44:37.119686 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:44:37.119686 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 12:44:37.119686 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 12:44:37.119686 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:44:37.119686 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:44:37.119686 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 12:44:37.119686 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 12:44:37.119686 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 12:44:37.119686 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 12:44:37.119686 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:44:37.119686 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:44:37.119686 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:44:37.119686 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:44:37.119686 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bd5493ab-070f-47b6-bfee-6ffba4c32b05 Jul 25 12:44:37.120890 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:37.120890 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:37.120890 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:37.120890 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:37.120890 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 25 12:44:37.120890 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 25 12:44:37.120890 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 12:44:37.120890 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 12:44:37.120890 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 12:44:37.120890 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 12:44:37.120890 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 12:44:37.120890 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 12:44:37.120890 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 12:44:37.120890 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 12:44:37.120890 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:44:37.120890 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:44:37.120890 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 12:44:37.120890 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 12:44:37.120890 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:44:37.120890 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:44:37.122294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 12:44:37.122294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 12:44:37.122294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 12:44:37.122294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 12:44:37.122294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:44:37.122294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:44:37.122294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:44:37.122294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:44:37.122294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bd5493ab-070f-47b6-bfee-6ffba4c32b05 could not be found. Jul 25 12:44:37.122294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:37.122294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:37.122294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:37.122294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:37.122294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:37.122294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:37.122294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:37.122294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:37.122294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:44:37.122294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:44:37.123671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:37.123671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:37.123671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 25 12:44:37.123671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 12:44:37.123671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 12:44:37.123671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:37.123671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:37.123671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:37.123671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:37.123671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:37.123671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:37.123671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:37.123671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:37.123671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 12:44:37.123671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:44:37.123671 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-32f9035a-4baa-4a9f-9c68-25aa68dc1401 tempest-ListImageFiltersNegativeTestJSON-2039248219 tempest-ListImageFiltersNegativeTestJSON-2039248219-project] Returning 404 to user: Image not found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:37.125048 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-32f9035a-4baa-4a9f-9c68-25aa68dc1401 tempest-ListImageFiltersNegativeTestJSON-2039248219 tempest-ListImageFiltersNegativeTestJSON-2039248219-project] 10.222.0.49 "GET /compute/v2.1/images/bd5493ab-070f-47b6-bfee-6ffba4c32b05" status: 404 len: 62 microversion: 2.1 time: 0.343042 Jul 25 12:44:37.125048 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 904/1725] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:44:36 2022] GET /compute/v2.1/images/bd5493ab-070f-47b6-bfee-6ffba4c32b05 => generated 62 bytes in 347 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:44:37.128793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7058bcdc-44de-4814-942c-64901dd3c867 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Calling method '.version_select at 0x7efcf9d353a0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:37.144773 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-2b328a33-5180-4a19-afee-aa754601eb70 req-7c1d91bb-b4b3-4d31-b1a0-f63a6f5baa13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a21af85-54c8-424c-b815-3882ecf4a893", "name": "network-vif-unplugged", "status": "completed", "tag": "067888a1-37d3-4817-9387-14f7ea43416c"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:37.175590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2b328a33-5180-4a19-afee-aa754601eb70 req-7c1d91bb-b4b3-4d31-b1a0-f63a6f5baa13 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:37.177167 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2b328a33-5180-4a19-afee-aa754601eb70 req-7c1d91bb-b4b3-4d31-b1a0-f63a6f5baa13 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:37.181646 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7058bcdc-44de-4814-942c-64901dd3c867 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1691835067" status: 204 len: 0 microversion: 2.2 time: 0.060978 Jul 25 12:44:37.182748 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 905/1726] 10.222.0.49 () {60 vars in 1321 bytes} [Mon Jul 25 12:44:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1691835067 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:37.195264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6d502f01-1893-42b9-92b2-bdc6932003ea tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Action: 'create', calling method: .version_select at 0x7efcfa0e7ca0>, body: {"keypair": {"name": "tempest-keypair-1299001803", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPlNZ68eqGOPURWwV6aLHL8GNJFQQzIZXBRn5psDlBbKATOVwcSfTqxkUTVJDSYw0tUEPz5u6CTTIrhfPOFY51NltJl946HvGC7tWZ5/Yt3LirGNYhK7v5A9z7G8N10UQ=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:37.212440 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-2b328a33-5180-4a19-afee-aa754601eb70 req-7c1d91bb-b4b3-4d31-b1a0-f63a6f5baa13 service nova] Creating event network-vif-unplugged:067888a1-37d3-4817-9387-14f7ea43416c for instance 8a21af85-54c8-424c-b815-3882ecf4a893 on n-h1-848886-15 Jul 25 12:44:37.225087 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-2b328a33-5180-4a19-afee-aa754601eb70 req-7c1d91bb-b4b3-4d31-b1a0-f63a6f5baa13 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109416 Jul 25 12:44:37.226065 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 822/1727] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:37.230359 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-6d502f01-1893-42b9-92b2-bdc6932003ea tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Getting quotas for project fca886a1b06c42f9866404f8d3e834f0. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:44:37.246785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-6d502f01-1893-42b9-92b2-bdc6932003ea tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Getting quotas for user 331b532489284f5988b1a428a5f5901d and project fca886a1b06c42f9866404f8d3e834f0. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:44:37.303255 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6d502f01-1893-42b9-92b2-bdc6932003ea tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.112189 Jul 25 12:44:37.304354 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 906/1728] 10.222.0.49 () {62 vars in 1199 bytes} [Mon Jul 25 12:44:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jul 25 12:44:37.316400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b9c0bda5-4a5c-4f7a-bf84-cf66f7b09a46 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Calling method '.version_select at 0x7efcfecb7f70>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:37.332814 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b9c0bda5-4a5c-4f7a-bf84-cf66f7b09a46 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs/tempest-keypair-1299001803" status: 200 len: 513 microversion: 2.2 time: 0.021075 Jul 25 12:44:37.335040 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 823/1729] 10.222.0.49 () {60 vars in 1258 bytes} [Mon Jul 25 12:44:37 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1299001803 => generated 513 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:37.348506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9555719a-13b0-4a19-acc4-187f89228513 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Calling method '.version_select at 0x7efcf9d553a0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:37.360082 n-d-848886-15 devstack@n-api.service[125884]: WARNING oslo_db.sqlalchemy.utils [None req-9555719a-13b0-4a19-acc4-187f89228513 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 12:44:37.389288 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-042f4c2a-b623-45ce-aac3-dc28a57dde9c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:37.389758 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9555719a-13b0-4a19-acc4-187f89228513 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.046332 Jul 25 12:44:37.390317 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-042f4c2a-b623-45ce-aac3-dc28a57dde9c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 4cb23110-97b4-4958-8ed7-5bf38b41a691] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:37.401014 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 907/1730] 10.222.0.49 () {60 vars in 1177 bytes} [Mon Jul 25 12:44:37 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:44:37.403086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-042f4c2a-b623-45ce-aac3-dc28a57dde9c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:37.404618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-042f4c2a-b623-45ce-aac3-dc28a57dde9c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:37.407983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-042f4c2a-b623-45ce-aac3-dc28a57dde9c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:37.408713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-042f4c2a-b623-45ce-aac3-dc28a57dde9c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:37.410108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cd90b063-f2c4-4440-8531-222a6320909a tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Calling method '.version_select at 0x7efcf9d34160>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:37.452854 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cd90b063-f2c4-4440-8531-222a6320909a tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1299001803" status: 204 len: 0 microversion: 2.2 time: 0.048678 Jul 25 12:44:37.454237 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 908/1731] 10.222.0.49 () {60 vars in 1261 bytes} [Mon Jul 25 12:44:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1299001803 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:37.460487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d2605109-716e-49d2-bb26-2237f20d5448 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:37.461335 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d2605109-716e-49d2-bb26-2237f20d5448 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:37.468915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2605109-716e-49d2-bb26-2237f20d5448 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:37.470711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2605109-716e-49d2-bb26-2237f20d5448 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:37.472072 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2605109-716e-49d2-bb26-2237f20d5448 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:37.472716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2605109-716e-49d2-bb26-2237f20d5448 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:37.922753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-042f4c2a-b623-45ce-aac3-dc28a57dde9c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:37.939368 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-042f4c2a-b623-45ce-aac3-dc28a57dde9c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691" status: 200 len: 1313 microversion: 2.1 time: 0.553291 Jul 25 12:44:37.957590 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 824/1732] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:37 2022] GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691 => generated 1313 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:37.969970 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-42cab8f9-a720-4c4f-9690-19d37a7c1caa tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Action: 'create', calling method: .version_select at 0x7efcf97c1700>, body: {"keypair": {"name": "tempest-keypair-178982433", "type": "x509"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:38.000196 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-42cab8f9-a720-4c4f-9690-19d37a7c1caa tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Getting quotas for project fca886a1b06c42f9866404f8d3e834f0. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:44:38.006461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-42cab8f9-a720-4c4f-9690-19d37a7c1caa tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Getting quotas for user 331b532489284f5988b1a428a5f5901d and project fca886a1b06c42f9866404f8d3e834f0. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:44:38.033872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.processutils [None req-42cab8f9-a720-4c4f-9690-19d37a7c1caa tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp64setemx/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp64setemx/temp.key -subj /CN=331b532489284f5988b1a428a5f5901d -extensions v3_req_client {{(pid=125883) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 25 12:44:38.246650 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d2605109-716e-49d2-bb26-2237f20d5448 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d03491c1046609caffee111db48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220cb7ebe7b4a89a8d1edabad2391a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:38.266697 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d2605109-716e-49d2-bb26-2237f20d5448 tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 200 len: 1467 microversion: 2.1 time: 0.810577 Jul 25 12:44:38.284192 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 909/1733] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:37 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 1467 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:38.292675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4d73aa67-6a8a-4766-9679-c1ad2f723fab tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:38.297295 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4d73aa67-6a8a-4766-9679-c1ad2f723fab tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:38.307940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d73aa67-6a8a-4766-9679-c1ad2f723fab tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:38.311832 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d73aa67-6a8a-4766-9679-c1ad2f723fab tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:38.312774 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d73aa67-6a8a-4766-9679-c1ad2f723fab tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:38.313225 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d73aa67-6a8a-4766-9679-c1ad2f723fab tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:38.625251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4d73aa67-6a8a-4766-9679-c1ad2f723fab tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:38.643453 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4d73aa67-6a8a-4766-9679-c1ad2f723fab tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 0.354157 Jul 25 12:44:38.657719 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 910/1734] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:38 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:38.669299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-981ccbd6-2bce-46b5-b5cd-0cb91e6f900d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:38.670301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-981ccbd6-2bce-46b5-b5cd-0cb91e6f900d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:38.676787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.processutils [None req-42cab8f9-a720-4c4f-9690-19d37a7c1caa tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp64setemx/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp64setemx/temp.key -subj /CN=331b532489284f5988b1a428a5f5901d -extensions v3_req_client" returned: 0 in 0.642s {{(pid=125883) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 25 12:44:38.679458 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.processutils [None req-42cab8f9-a720-4c4f-9690-19d37a7c1caa tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp64setemx/temp.key -password pass: {{(pid=125883) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 25 12:44:38.692579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-981ccbd6-2bce-46b5-b5cd-0cb91e6f900d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:38.692968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-981ccbd6-2bce-46b5-b5cd-0cb91e6f900d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:38.695049 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-981ccbd6-2bce-46b5-b5cd-0cb91e6f900d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:38.695980 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-981ccbd6-2bce-46b5-b5cd-0cb91e6f900d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:38.758957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.processutils [None req-42cab8f9-a720-4c4f-9690-19d37a7c1caa tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp64setemx/temp.key -password pass:" returned: 0 in 0.078s {{(pid=125883) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 25 12:44:38.870042 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-42cab8f9-a720-4c4f-9690-19d37a7c1caa tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Getting quotas for project fca886a1b06c42f9866404f8d3e834f0. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:44:38.878650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-42cab8f9-a720-4c4f-9690-19d37a7c1caa tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Getting quotas for user 331b532489284f5988b1a428a5f5901d and project fca886a1b06c42f9866404f8d3e834f0. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:44:38.910981 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-42cab8f9-a720-4c4f-9690-19d37a7c1caa tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.950819 Jul 25 12:44:38.912953 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 825/1735] 10.222.0.49 () {62 vars in 1198 bytes} [Mon Jul 25 12:44:37 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 955 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:38.919754 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ff00a5e2-be7e-4537-b3e7-d9906475d675 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:38.921152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ff00a5e2-be7e-4537-b3e7-d9906475d675 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:38.932575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff00a5e2-be7e-4537-b3e7-d9906475d675 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:38.933357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff00a5e2-be7e-4537-b3e7-d9906475d675 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:38.934505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff00a5e2-be7e-4537-b3e7-d9906475d675 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:38.935103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff00a5e2-be7e-4537-b3e7-d9906475d675 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:39.239306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-981ccbd6-2bce-46b5-b5cd-0cb91e6f900d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:39.253925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-981ccbd6-2bce-46b5-b5cd-0cb91e6f900d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:39.269287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-981ccbd6-2bce-46b5-b5cd-0cb91e6f900d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:39.271907 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-981ccbd6-2bce-46b5-b5cd-0cb91e6f900d tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1485 microversion: 2.25 time: 0.611843 Jul 25 12:44:39.275645 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 911/1736] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:38 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1485 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:39.291760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dad63107-8a35-4e0d-8701-59b1535a72c7 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Calling method '.version_select at 0x7efcf9d348b0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:39.317813 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dad63107-8a35-4e0d-8701-59b1535a72c7 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs/tempest-keypair-178982433" status: 200 len: 1533 microversion: 2.2 time: 0.040244 Jul 25 12:44:39.319110 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 912/1737] 10.222.0.49 () {60 vars in 1255 bytes} [Mon Jul 25 12:44:39 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-178982433 => generated 1533 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:39.330761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fa4989e9-ac4b-4cd1-a951-966405cb419c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:39.332022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fa4989e9-ac4b-4cd1-a951-966405cb419c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 4cb23110-97b4-4958-8ed7-5bf38b41a691] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:39.360570 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa4989e9-ac4b-4cd1-a951-966405cb419c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:39.361388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa4989e9-ac4b-4cd1-a951-966405cb419c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:39.363082 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa4989e9-ac4b-4cd1-a951-966405cb419c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:39.363836 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa4989e9-ac4b-4cd1-a951-966405cb419c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:40.132040 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ff00a5e2-be7e-4537-b3e7-d9906475d675 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:40.167340 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ff00a5e2-be7e-4537-b3e7-d9906475d675 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1506 microversion: 2.1 time: 1.253062 Jul 25 12:44:40.168150 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 826/1738] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:38 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1506 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:40.174583 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-f1e1c31a-5795-49d3-a2e1-7bf0429482f8 req-b2c139fd-1a47-46bd-a973-c5ccd8684399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73d77295-bfd7-4ff9-b2f9-09d175f81696", "name": "network-vif-deleted", "tag": "ed3b7b89-f69c-4f30-b4f9-ecff648c112d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:40.188359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-f1e1c31a-5795-49d3-a2e1-7bf0429482f8 req-b2c139fd-1a47-46bd-a973-c5ccd8684399 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:40.189087 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-f1e1c31a-5795-49d3-a2e1-7bf0429482f8 req-b2c139fd-1a47-46bd-a973-c5ccd8684399 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:40.203567 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-f1e1c31a-5795-49d3-a2e1-7bf0429482f8 req-b2c139fd-1a47-46bd-a973-c5ccd8684399 service nova] Creating event network-vif-deleted:ed3b7b89-f69c-4f30-b4f9-ecff648c112d for instance 73d77295-bfd7-4ff9-b2f9-09d175f81696 on n-h1-848886-15 Jul 25 12:44:40.214798 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-f1e1c31a-5795-49d3-a2e1-7bf0429482f8 req-b2c139fd-1a47-46bd-a973-c5ccd8684399 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044458 Jul 25 12:44:40.216593 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 827/1739] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:40.225976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2d4398f9-536a-42f9-9e21-38e7349ce5dc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:40.227051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2d4398f9-536a-42f9-9e21-38e7349ce5dc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] [instance: 73d77295-bfd7-4ff9-b2f9-09d175f81696] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:40.234730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d4398f9-536a-42f9-9e21-38e7349ce5dc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:40.235336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d4398f9-536a-42f9-9e21-38e7349ce5dc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:40.236336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d4398f9-536a-42f9-9e21-38e7349ce5dc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:40.237748 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d4398f9-536a-42f9-9e21-38e7349ce5dc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:40.262458 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-2d4398f9-536a-42f9-9e21-38e7349ce5dc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] HTTP exception thrown: Instance 73d77295-bfd7-4ff9-b2f9-09d175f81696 could not be found. Jul 25 12:44:40.264661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2d4398f9-536a-42f9-9e21-38e7349ce5dc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Request method failure captured: Jul 25 12:44:40.264661 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 HTTP/1.1 Jul 25 12:44:40.264661 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:44:40.264661 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:44:40.264661 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:44:40.264661 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:44:40.264661 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:44:40.264661 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:44:40.264661 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:44:40.264661 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:40.264661 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7Tz0O7SSTbmDl0Z_49fiVulE4u2IVHWtJX8IhZRzdeY3RfzT5cF6XlRwH6pcEa6bCZXczC1oDltEE_WwkEgjlsc4Dn4JO42YSJ3wN5AuONFw1-5ANhhWBomhlw3yEv_CGvFeDIla6_OTsCNCdBF1OoYRpAauJXL0o5ty9W2TEu2BQ Jul 25 12:44:40.264661 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:44:40.264661 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:44:40.264661 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:44:40.264661 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:44:40.264661 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:44:40.264661 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:44:40.264661 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 5220cb7ebe7b4a89a8d1edabad2391a7 Jul 25 12:44:40.264661 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-MigrationsAdminTest-1010123982 Jul 25 12:44:40.264661 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:44:40.264661 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:44:40.266238 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5220cb7ebe7b4a89a8d1edabad2391a7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5220cb7ebe7b4a89a8d1edabad2391a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5220cb7ebe7b4a89a8d1edabad2391a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5220cb7ebe7b4a89a8d1edabad2391a7"}]}] Jul 25 12:44:40.266238 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-MigrationsAdminTest-1010123982 Jul 25 12:44:40.266238 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 5220cb7ebe7b4a89a8d1edabad2391a7 Jul 25 12:44:40.266238 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-MigrationsAdminTest-1010123982 Jul 25 12:44:40.266238 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-MigrationsAdminTest-1010123982-project Jul 25 12:44:40.266238 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:44:40.266238 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:44:40.266238 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 045d03491c1046609caffee111db48fc Jul 25 12:44:40.266238 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-MigrationsAdminTest-1010123982-project Jul 25 12:44:40.266238 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:44:40.266238 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 73d77295-bfd7-4ff9-b2f9-09d175f81696 could not be found. Jul 25 12:44:40.266238 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '73d77295-bfd7-4ff9-b2f9-09d175f81696'} Jul 25 12:44:40.267111 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:40.267111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:40.267111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:44:40.267111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:44:40.267111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:44:40.267111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:44:40.267111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:44:40.267111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:44:40.267111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:44:40.267111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:44:40.267111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73d77295-bfd7-4ff9-b2f9-09d175f81696 could not be found. Jul 25 12:44:40.267111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:40.267111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:40.267111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:40.267111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:40.267111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:40.267111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:40.267111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:40.267111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:40.267111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:40.268569 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:40.268569 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:44:40.268569 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:44:40.268569 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:44:40.268569 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:44:40.268569 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:44:40.268569 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:44:40.268569 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73d77295-bfd7-4ff9-b2f9-09d175f81696 could not be found. Jul 25 12:44:40.268569 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:40.268569 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:40.268569 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:40.268569 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:40.268569 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:40.268569 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:40.268569 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:40.268569 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:40.268569 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73d77295-bfd7-4ff9-b2f9-09d175f81696 could not be found. Jul 25 12:44:40.268569 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:44:40.269768 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2d4398f9-536a-42f9-9e21-38e7349ce5dc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] Returning 404 to user: Instance 73d77295-bfd7-4ff9-b2f9-09d175f81696 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:40.269768 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2d4398f9-536a-42f9-9e21-38e7349ce5dc tempest-MigrationsAdminTest-1010123982 tempest-MigrationsAdminTest-1010123982-project] 10.222.0.49 "GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696" status: 404 len: 111 microversion: 2.1 time: 0.047993 Jul 25 12:44:40.269768 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 828/1740] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:40 2022] GET /compute/v2.1/servers/73d77295-bfd7-4ff9-b2f9-09d175f81696 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:44:40.276721 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a803541e-da2e-4598-9ba9-79d4d4e2fb3c tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Calling method '.version_select at 0x7efcfecb7790>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:40.281431 n-d-848886-15 devstack@n-api.service[125883]: WARNING oslo_db.sqlalchemy.utils [None req-a803541e-da2e-4598-9ba9-79d4d4e2fb3c tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 12:44:40.288411 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a803541e-da2e-4598-9ba9-79d4d4e2fb3c tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.018348 Jul 25 12:44:40.289410 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 829/1741] 10.222.0.49 () {60 vars in 1177 bytes} [Mon Jul 25 12:44:40 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:40.299149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fa4989e9-ac4b-4cd1-a951-966405cb419c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:40.301784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2d7de84e-d30e-488b-9004-6e8bbe93b877 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:40.302660 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2d7de84e-d30e-488b-9004-6e8bbe93b877 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:40.309970 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d7de84e-d30e-488b-9004-6e8bbe93b877 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:40.310326 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fa4989e9-ac4b-4cd1-a951-966405cb419c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691" status: 200 len: 1313 microversion: 2.1 time: 0.989880 Jul 25 12:44:40.310466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d7de84e-d30e-488b-9004-6e8bbe93b877 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:40.310922 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 913/1742] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:39 2022] GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691 => generated 1313 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:40.311235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d7de84e-d30e-488b-9004-6e8bbe93b877 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:40.312227 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d7de84e-d30e-488b-9004-6e8bbe93b877 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:40.322004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-ff8c9fc8-f0b4-4058-902b-18a5f49ffd22 req-a437f9e6-9dcf-4b05-ad02-c49ad3db44bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb23110-97b4-4958-8ed7-5bf38b41a691", "name": "network-vif-plugged", "status": "completed", "tag": "f47ea668-6bab-47e6-ba2e-12feac455939"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:40.345883 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-ff8c9fc8-f0b4-4058-902b-18a5f49ffd22 req-a437f9e6-9dcf-4b05-ad02-c49ad3db44bc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:40.349105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-ff8c9fc8-f0b4-4058-902b-18a5f49ffd22 req-a437f9e6-9dcf-4b05-ad02-c49ad3db44bc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:40.369991 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-ff8c9fc8-f0b4-4058-902b-18a5f49ffd22 req-a437f9e6-9dcf-4b05-ad02-c49ad3db44bc service nova] Creating event network-vif-plugged:f47ea668-6bab-47e6-ba2e-12feac455939 for instance 4cb23110-97b4-4958-8ed7-5bf38b41a691 on n-h2-848886-15 Jul 25 12:44:40.376686 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-ff8c9fc8-f0b4-4058-902b-18a5f49ffd22 req-a437f9e6-9dcf-4b05-ad02-c49ad3db44bc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062697 Jul 25 12:44:40.378449 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 914/1743] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:40.386500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-eb0a3ebc-0805-4d01-8649-bbcc7f8504a8 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] Calling method '.version_select at 0x7efcfa0e73a0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:40.425056 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-eb0a3ebc-0805-4d01-8649-bbcc7f8504a8 tempest-KeyPairsV22TestJSON-1854086661 tempest-KeyPairsV22TestJSON-1854086661-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-178982433" status: 204 len: 0 microversion: 2.2 time: 0.045057 Jul 25 12:44:40.427086 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 915/1744] 10.222.0.49 () {60 vars in 1258 bytes} [Mon Jul 25 12:44:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-178982433 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:40.436846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7ec1bc8a-ed25-43e5-b389-2c4576d2bde6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:40.437899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7ec1bc8a-ed25-43e5-b389-2c4576d2bde6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:40.446666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ec1bc8a-ed25-43e5-b389-2c4576d2bde6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:40.447130 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ec1bc8a-ed25-43e5-b389-2c4576d2bde6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:40.448132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ec1bc8a-ed25-43e5-b389-2c4576d2bde6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:40.449374 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ec1bc8a-ed25-43e5-b389-2c4576d2bde6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:40.852496 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2d7de84e-d30e-488b-9004-6e8bbe93b877 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:40.861587 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2d7de84e-d30e-488b-9004-6e8bbe93b877 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 0.571038 Jul 25 12:44:40.864640 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 830/1745] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:40 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:40.940079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7ec1bc8a-ed25-43e5-b389-2c4576d2bde6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:40.964081 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7ec1bc8a-ed25-43e5-b389-2c4576d2bde6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:40.969281 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7ec1bc8a-ed25-43e5-b389-2c4576d2bde6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:40.975247 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7ec1bc8a-ed25-43e5-b389-2c4576d2bde6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1485 microversion: 2.25 time: 0.546729 Jul 25 12:44:40.975832 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 916/1746] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:40 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1485 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:41.190919 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c35bd30e-8528-4331-bc04-6f4f8856a7ad tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:41.193465 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c35bd30e-8528-4331-bc04-6f4f8856a7ad tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:41.216903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c35bd30e-8528-4331-bc04-6f4f8856a7ad tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:41.218066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c35bd30e-8528-4331-bc04-6f4f8856a7ad tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:41.219596 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c35bd30e-8528-4331-bc04-6f4f8856a7ad tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:41.220244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c35bd30e-8528-4331-bc04-6f4f8856a7ad tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:41.334346 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b7988c4c-0543-45db-b090-de7239427fb9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:41.335081 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b7988c4c-0543-45db-b090-de7239427fb9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 4cb23110-97b4-4958-8ed7-5bf38b41a691] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:41.347328 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7988c4c-0543-45db-b090-de7239427fb9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:41.347839 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7988c4c-0543-45db-b090-de7239427fb9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:41.348695 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7988c4c-0543-45db-b090-de7239427fb9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:41.349083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7988c4c-0543-45db-b090-de7239427fb9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:41.922194 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c35bd30e-8528-4331-bc04-6f4f8856a7ad tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:41.946388 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c35bd30e-8528-4331-bc04-6f4f8856a7ad tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1506 microversion: 2.1 time: 0.756382 Jul 25 12:44:41.950832 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 831/1747] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:41 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1506 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:41.964509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e1834231-92b1-4da2-8aed-b3de6044d7a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:41.965018 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e1834231-92b1-4da2-8aed-b3de6044d7a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:41.978174 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1834231-92b1-4da2-8aed-b3de6044d7a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:41.978681 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1834231-92b1-4da2-8aed-b3de6044d7a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:41.980400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1834231-92b1-4da2-8aed-b3de6044d7a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:41.980849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1834231-92b1-4da2-8aed-b3de6044d7a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:42.472482 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b7988c4c-0543-45db-b090-de7239427fb9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:42.495219 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b7988c4c-0543-45db-b090-de7239427fb9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691" status: 200 len: 1313 microversion: 2.1 time: 1.162016 Jul 25 12:44:42.495881 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 917/1748] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:41 2022] GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691 => generated 1313 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:42.519297 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4f0ec68a-2dd6-47b2-b518-23592ba62bad tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:42.525703 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4f0ec68a-2dd6-47b2-b518-23592ba62bad tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:42.548303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f0ec68a-2dd6-47b2-b518-23592ba62bad tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:42.548902 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f0ec68a-2dd6-47b2-b518-23592ba62bad tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:42.550732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f0ec68a-2dd6-47b2-b518-23592ba62bad tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:42.555214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f0ec68a-2dd6-47b2-b518-23592ba62bad tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:42.866035 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:43.176445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e1834231-92b1-4da2-8aed-b3de6044d7a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:43.191032 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e1834231-92b1-4da2-8aed-b3de6044d7a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 1.230386 Jul 25 12:44:43.194450 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 832/1749] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:41 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:43.214550 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a9f6ef8a-4fde-4649-baa8-63ffcd63fe52 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:43.215599 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a9f6ef8a-4fde-4649-baa8-63ffcd63fe52 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:43.239231 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9f6ef8a-4fde-4649-baa8-63ffcd63fe52 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:43.246115 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9f6ef8a-4fde-4649-baa8-63ffcd63fe52 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:43.247692 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9f6ef8a-4fde-4649-baa8-63ffcd63fe52 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:43.250244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9f6ef8a-4fde-4649-baa8-63ffcd63fe52 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:44.067695 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4f0ec68a-2dd6-47b2-b518-23592ba62bad tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:44.088579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4f0ec68a-2dd6-47b2-b518-23592ba62bad tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:44.103864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4f0ec68a-2dd6-47b2-b518-23592ba62bad tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:44.108782 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4f0ec68a-2dd6-47b2-b518-23592ba62bad tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1485 microversion: 2.25 time: 1.608271 Jul 25 12:44:44.115514 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 918/1750] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:42 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1485 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:44.128227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-24e149da-84e3-4424-985d-91d707f3d33b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:44.132389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-24e149da-84e3-4424-985d-91d707f3d33b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 4cb23110-97b4-4958-8ed7-5bf38b41a691] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:44.151527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24e149da-84e3-4424-985d-91d707f3d33b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:44.152402 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24e149da-84e3-4424-985d-91d707f3d33b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:44.155942 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24e149da-84e3-4424-985d-91d707f3d33b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:44.156746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24e149da-84e3-4424-985d-91d707f3d33b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:44.572902 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a9f6ef8a-4fde-4649-baa8-63ffcd63fe52 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:44.583008 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a9f6ef8a-4fde-4649-baa8-63ffcd63fe52 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1506 microversion: 2.1 time: 1.387130 Jul 25 12:44:44.597880 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 833/1751] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:43 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1506 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:44.617644 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9ea5bfc8-4536-453a-b6ab-52dbac7caa22 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:44.619846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9ea5bfc8-4536-453a-b6ab-52dbac7caa22 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:44.646620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ea5bfc8-4536-453a-b6ab-52dbac7caa22 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:44.648905 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ea5bfc8-4536-453a-b6ab-52dbac7caa22 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:44.650666 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ea5bfc8-4536-453a-b6ab-52dbac7caa22 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:44.651951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ea5bfc8-4536-453a-b6ab-52dbac7caa22 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:44.897919 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-24e149da-84e3-4424-985d-91d707f3d33b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:44.926276 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-24e149da-84e3-4424-985d-91d707f3d33b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691" status: 200 len: 1463 microversion: 2.1 time: 0.805374 Jul 25 12:44:44.945504 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 919/1752] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:44 2022] GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691 => generated 1463 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:45.689667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-62808807-853e-4673-95db-d0340f3be0cd tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:45.695359 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-62808807-853e-4673-95db-d0340f3be0cd tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Searching by: {'deleted': False, 'project_id': '1c9f6c20160c4292b42086ed4f3a0b8b'} {{(pid=125884) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 12:44:45.703383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-62808807-853e-4673-95db-d0340f3be0cd tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:45.703674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-62808807-853e-4673-95db-d0340f3be0cd tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:45.705410 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-62808807-853e-4673-95db-d0340f3be0cd tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:45.707689 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-62808807-853e-4673-95db-d0340f3be0cd tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:45.973937 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9ea5bfc8-4536-453a-b6ab-52dbac7caa22 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:45.993632 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9ea5bfc8-4536-453a-b6ab-52dbac7caa22 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 1.397885 Jul 25 12:44:45.997966 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 834/1753] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:44 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:46.012150 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-62808807-853e-4673-95db-d0340f3be0cd tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 1.064962 Jul 25 12:44:46.013510 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 920/1754] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:44:44 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:44:46.015958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-23f88397-64ba-4a2b-8020-31713ed359df tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:46.017045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-23f88397-64ba-4a2b-8020-31713ed359df tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:46.022698 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2c052376-875a-422d-93bb-27407bb3d1b8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:46.027234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2c052376-875a-422d-93bb-27407bb3d1b8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:46.035763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c052376-875a-422d-93bb-27407bb3d1b8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:46.036449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c052376-875a-422d-93bb-27407bb3d1b8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:46.037741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-23f88397-64ba-4a2b-8020-31713ed359df tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:46.037948 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c052376-875a-422d-93bb-27407bb3d1b8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:46.039086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-23f88397-64ba-4a2b-8020-31713ed359df tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:46.039900 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-23f88397-64ba-4a2b-8020-31713ed359df tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:46.040802 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-23f88397-64ba-4a2b-8020-31713ed359df tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:46.045976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c052376-875a-422d-93bb-27407bb3d1b8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:46.874575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2c052376-875a-422d-93bb-27407bb3d1b8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:46.876469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-23f88397-64ba-4a2b-8020-31713ed359df tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:46.878883 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:46.895386 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2c052376-875a-422d-93bb-27407bb3d1b8 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1506 microversion: 2.1 time: 0.878149 Jul 25 12:44:46.897364 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 921/1755] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:46 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1506 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:46.901698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-23f88397-64ba-4a2b-8020-31713ed359df tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:46.904095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-23f88397-64ba-4a2b-8020-31713ed359df tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:46.905360 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-23f88397-64ba-4a2b-8020-31713ed359df tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1475 microversion: 2.25 time: 0.906079 Jul 25 12:44:46.908561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6749ac1f-f5b6-4285-a481-2c7701bbd7d6 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:46.912658 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 835/1756] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:45 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1475 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:46.921490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6749ac1f-f5b6-4285-a481-2c7701bbd7d6 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Searching by: {'deleted': False} {{(pid=125884) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 12:44:46.937145 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6749ac1f-f5b6-4285-a481-2c7701bbd7d6 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:46.938197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6749ac1f-f5b6-4285-a481-2c7701bbd7d6 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:46.944640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6749ac1f-f5b6-4285-a481-2c7701bbd7d6 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:46.950041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6749ac1f-f5b6-4285-a481-2c7701bbd7d6 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:47.205682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-44d2ed12-9abd-46da-bdba-da313cb76815 tempest-QuotaClassesAdmin257Test-16660797 tempest-QuotaClassesAdmin257Test-16660797-project-admin] Calling method '.version_select at 0x7efcfece95e0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:47.206988 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:44:47.206988 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:44:47.236136 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-44d2ed12-9abd-46da-bdba-da313cb76815 tempest-QuotaClassesAdmin257Test-16660797 tempest-QuotaClassesAdmin257Test-16660797-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.316869 Jul 25 12:44:47.239706 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 836/1757] 10.222.0.49 () {60 vars in 1226 bytes} [Mon Jul 25 12:44:46 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:44:47.243581 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.multi_cell_list [None req-6749ac1f-f5b6-4285-a481-2c7701bbd7d6 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Listed batch of 13 results from cell out of 1000 limit. Returned 13 total so far. {{(pid=125884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 12:44:47.252068 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a2adfb72-57fb-4675-9217-ec2b2eefa2a0 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Calling method '.version_select at 0x7efcfecba1f0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:47.257655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2adfb72-57fb-4675-9217-ec2b2eefa2a0 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:47.258140 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2adfb72-57fb-4675-9217-ec2b2eefa2a0 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:47.274597 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a2adfb72-57fb-4675-9217-ec2b2eefa2a0 tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 3898 microversion: 2.25 time: 0.026314 Jul 25 12:44:47.275865 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 837/1758] 10.222.0.49 () {60 vars in 1184 bytes} [Mon Jul 25 12:44:47 2022] GET /compute/v2.1/os-migrations => generated 3898 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:47.283253 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9c13f44a-4be0-4fca-b16f-b3774f58ec51 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:47.284212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9c13f44a-4be0-4fca-b16f-b3774f58ec51 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:47.287554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=36 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:47.292009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c13f44a-4be0-4fca-b16f-b3774f58ec51 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:47.292733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c13f44a-4be0-4fca-b16f-b3774f58ec51 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:47.294133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c13f44a-4be0-4fca-b16f-b3774f58ec51 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:47.294917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c13f44a-4be0-4fca-b16f-b3774f58ec51 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:47.502125 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:47.527902 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6749ac1f-f5b6-4285-a481-2c7701bbd7d6 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:47.528872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6749ac1f-f5b6-4285-a481-2c7701bbd7d6 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:48.282507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9c13f44a-4be0-4fca-b16f-b3774f58ec51 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:48.299087 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9c13f44a-4be0-4fca-b16f-b3774f58ec51 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 1.021891 Jul 25 12:44:48.301318 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 838/1759] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:47 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:48.311475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7f1524a1-c5ee-48ca-8afc-7e80fed2714b tempest-QuotaClassesAdmin257Test-16660797 tempest-QuotaClassesAdmin257Test-16660797-project-admin] Action: 'update', calling method: .version_select at 0x7efcfece94c0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:48.315071 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:44:48.315071 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:44:48.364156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:INSERT=2,nova_api:UPDATE=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:48.495493 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7f1524a1-c5ee-48ca-8afc-7e80fed2714b tempest-QuotaClassesAdmin257Test-16660797 tempest-QuotaClassesAdmin257Test-16660797-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.187759 Jul 25 12:44:48.496416 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 839/1760] 10.222.0.49 () {62 vars in 1247 bytes} [Mon Jul 25 12:44:48 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:44:48.512690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-676b7af7-1ba6-4e1b-b606-a14578370cfc tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:48.520259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-676b7af7-1ba6-4e1b-b606-a14578370cfc tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:48.532559 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-676b7af7-1ba6-4e1b-b606-a14578370cfc tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:48.533001 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-676b7af7-1ba6-4e1b-b606-a14578370cfc tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:48.537246 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-676b7af7-1ba6-4e1b-b606-a14578370cfc tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:48.537792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-676b7af7-1ba6-4e1b-b606-a14578370cfc tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:49.900022 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6749ac1f-f5b6-4285-a481-2c7701bbd7d6 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 21385 microversion: 2.1 time: 3.000843 Jul 25 12:44:49.903459 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 922/1761] 10.222.0.49 () {58 vars in 1171 bytes} [Mon Jul 25 12:44:46 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 21385 bytes in 3005 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:44:49.914803 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-02ee2c92-91d7-4195-a00c-75b91e4a284f tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:49.916034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-02ee2c92-91d7-4195-a00c-75b91e4a284f tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:49.920056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-676b7af7-1ba6-4e1b-b606-a14578370cfc tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] Lazy-loading 'services' on Instance uuid 8a21af85-54c8-424c-b815-3882ecf4a893 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:44:49.949624 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02ee2c92-91d7-4195-a00c-75b91e4a284f tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:49.950493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02ee2c92-91d7-4195-a00c-75b91e4a284f tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:49.959244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02ee2c92-91d7-4195-a00c-75b91e4a284f tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:49.959674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02ee2c92-91d7-4195-a00c-75b91e4a284f tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:49.985572 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-676b7af7-1ba6-4e1b-b606-a14578370cfc tempest-LiveAutoBlockMigrationV225Test-1330426040 tempest-LiveAutoBlockMigrationV225Test-1330426040-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1969 microversion: 2.25 time: 1.482422 Jul 25 12:44:49.989818 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 840/1762] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:48 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1969 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:49.998480 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b4dfe656-3b52-491c-9b72-21295396aa60 tempest-QuotaClassesAdmin257Test-16660797 tempest-QuotaClassesAdmin257Test-16660797-project-admin] Calling method '.version_select at 0x7efcfeccf160>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:50.008672 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:44:50.008672 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:44:50.044006 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b4dfe656-3b52-491c-9b72-21295396aa60 tempest-QuotaClassesAdmin257Test-16660797 tempest-QuotaClassesAdmin257Test-16660797-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.052470 Jul 25 12:44:50.044590 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 841/1763] 10.222.0.49 () {60 vars in 1226 bytes} [Mon Jul 25 12:44:49 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:44:50.089195 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a9af6449-787e-437b-aa7a-038458ffd0fc tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:50.092241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a9af6449-787e-437b-aa7a-038458ffd0fc tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:50.112713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9af6449-787e-437b-aa7a-038458ffd0fc tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:50.113176 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9af6449-787e-437b-aa7a-038458ffd0fc tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:50.114020 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9af6449-787e-437b-aa7a-038458ffd0fc tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:50.114458 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9af6449-787e-437b-aa7a-038458ffd0fc tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:51.817986 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-02ee2c92-91d7-4195-a00c-75b91e4a284f tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:51.842758 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a9af6449-787e-437b-aa7a-038458ffd0fc tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:51.860358 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a9af6449-787e-437b-aa7a-038458ffd0fc tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 1.809257 Jul 25 12:44:51.861706 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 842/1764] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:50 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:51.877723 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-02ee2c92-91d7-4195-a00c-75b91e4a284f tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1506 microversion: 2.1 time: 1.957184 Jul 25 12:44:51.890129 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 923/1765] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:49 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1506 bytes in 1976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:51.890264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-56e4a3b4-a0c0-4016-90c4-eb84ca2e9519 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:51.918253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d2271cf8-31d3-4ae5-a2ac-9ccbcffee971 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:51.919835 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d2271cf8-31d3-4ae5-a2ac-9ccbcffee971 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:51.926216 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-56e4a3b4-a0c0-4016-90c4-eb84ca2e9519 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Searching by: {'deleted': False, 'project_id': '1c9f6c20160c4292b42086ed4f3a0b8b'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 12:44:51.952206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56e4a3b4-a0c0-4016-90c4-eb84ca2e9519 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:51.953569 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2271cf8-31d3-4ae5-a2ac-9ccbcffee971 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:51.954585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2271cf8-31d3-4ae5-a2ac-9ccbcffee971 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:51.964415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56e4a3b4-a0c0-4016-90c4-eb84ca2e9519 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:51.965801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2271cf8-31d3-4ae5-a2ac-9ccbcffee971 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:51.971358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56e4a3b4-a0c0-4016-90c4-eb84ca2e9519 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:51.972135 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2271cf8-31d3-4ae5-a2ac-9ccbcffee971 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:51.977303 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56e4a3b4-a0c0-4016-90c4-eb84ca2e9519 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:52.112861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d2271cf8-31d3-4ae5-a2ac-9ccbcffee971 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:44:52.637381 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-56e4a3b4-a0c0-4016-90c4-eb84ca2e9519 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail?tenant_id=e7330b3757794c94b7cbd4ce6886c78d" status: 200 len: 15 microversion: 2.1 time: 0.766227 Jul 25 12:44:52.648843 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 843/1766] 10.222.0.49 () {58 vars in 1231 bytes} [Mon Jul 25 12:44:51 2022] GET /compute/v2.1/servers/detail?tenant_id=e7330b3757794c94b7cbd4ce6886c78d => generated 15 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:44:52.654292 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d2271cf8-31d3-4ae5-a2ac-9ccbcffee971 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 204 len: 0 microversion: 2.25 time: 0.755172 Jul 25 12:44:52.664424 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 924/1767] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 12:44:51 2022] DELETE /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 12:44:52.805579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-40d5580d-2dcd-44d5-a25b-d21bd7c894cd tempest-QuotaClassesAdmin257Test-16660797 tempest-QuotaClassesAdmin257Test-16660797-project-admin] Action: 'update', calling method: .version_select at 0x7efcfeccf160>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:52.809876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-59acad14-d67f-4ef9-891e-55b01152b79f tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:52.816185 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:44:52.816185 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:44:52.836922 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-59acad14-d67f-4ef9-891e-55b01152b79f tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Searching by: {'tenant_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'deleted': False} {{(pid=125884) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 12:44:52.856289 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59acad14-d67f-4ef9-891e-55b01152b79f tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:52.860157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59acad14-d67f-4ef9-891e-55b01152b79f tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:52.861268 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59acad14-d67f-4ef9-891e-55b01152b79f tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:52.862385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59acad14-d67f-4ef9-891e-55b01152b79f tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:53.046356 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-40d5580d-2dcd-44d5-a25b-d21bd7c894cd tempest-QuotaClassesAdmin257Test-16660797 tempest-QuotaClassesAdmin257Test-16660797-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.384451 Jul 25 12:44:53.050909 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 844/1768] 10.222.0.49 () {62 vars in 1247 bytes} [Mon Jul 25 12:44:52 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:44:53.051780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.multi_cell_list [None req-59acad14-d67f-4ef9-891e-55b01152b79f tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 12:44:53.087226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ee3a7cf6-070a-4b3e-888e-a23d15ab744a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:53.092089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ee3a7cf6-070a-4b3e-888e-a23d15ab744a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:53.138607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee3a7cf6-070a-4b3e-888e-a23d15ab744a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:53.146591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee3a7cf6-070a-4b3e-888e-a23d15ab744a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:53.151321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee3a7cf6-070a-4b3e-888e-a23d15ab744a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:53.156734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee3a7cf6-070a-4b3e-888e-a23d15ab744a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:53.558263 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59acad14-d67f-4ef9-891e-55b01152b79f tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:53.569956 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59acad14-d67f-4ef9-891e-55b01152b79f tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:53.879152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ee3a7cf6-070a-4b3e-888e-a23d15ab744a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:53.892473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ee3a7cf6-070a-4b3e-888e-a23d15ab744a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:53.902655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ee3a7cf6-070a-4b3e-888e-a23d15ab744a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:53.906651 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ee3a7cf6-070a-4b3e-888e-a23d15ab744a tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1481 microversion: 2.25 time: 0.845831 Jul 25 12:44:53.908594 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 845/1769] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:53 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1481 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:53.917033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d3fcbcef-b0f7-47b1-a722-f479f3050b8b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:53.920961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d3fcbcef-b0f7-47b1-a722-f479f3050b8b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:53.942415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d3fcbcef-b0f7-47b1-a722-f479f3050b8b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:53.943502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d3fcbcef-b0f7-47b1-a722-f479f3050b8b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:53.945675 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d3fcbcef-b0f7-47b1-a722-f479f3050b8b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:53.946369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d3fcbcef-b0f7-47b1-a722-f479f3050b8b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:53.951128 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:54.180176 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-59acad14-d67f-4ef9-891e-55b01152b79f tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e7330b3757794c94b7cbd4ce6886c78d" status: 200 len: 4831 microversion: 2.1 time: 1.513275 Jul 25 12:44:54.181659 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 925/1770] 10.222.0.49 () {58 vars in 1257 bytes} [Mon Jul 25 12:44:52 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e7330b3757794c94b7cbd4ce6886c78d => generated 4831 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:54.188505 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0aa62fa9-c91a-4f74-8a3c-5e2072b88997 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:54.189884 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0aa62fa9-c91a-4f74-8a3c-5e2072b88997 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:54.210691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0aa62fa9-c91a-4f74-8a3c-5e2072b88997 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:54.211354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0aa62fa9-c91a-4f74-8a3c-5e2072b88997 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:54.214383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0aa62fa9-c91a-4f74-8a3c-5e2072b88997 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:54.215019 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0aa62fa9-c91a-4f74-8a3c-5e2072b88997 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:54.351598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d3fcbcef-b0f7-47b1-a722-f479f3050b8b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:54.363597 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d3fcbcef-b0f7-47b1-a722-f479f3050b8b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 0.453392 Jul 25 12:44:54.365625 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 846/1771] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:53 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:54.377735 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5b169d2b-8061-4214-be97-d4f5598590e6 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:54.390699 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5b169d2b-8061-4214-be97-d4f5598590e6 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Searching by: {'tenant_id': '1c9f6c20160c4292b42086ed4f3a0b8b', 'deleted': False} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 12:44:54.408088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5b169d2b-8061-4214-be97-d4f5598590e6 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:54.408976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5b169d2b-8061-4214-be97-d4f5598590e6 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:54.410136 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5b169d2b-8061-4214-be97-d4f5598590e6 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:54.410818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5b169d2b-8061-4214-be97-d4f5598590e6 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:54.484279 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5b169d2b-8061-4214-be97-d4f5598590e6 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1c9f6c20160c4292b42086ed4f3a0b8b" status: 200 len: 15 microversion: 2.1 time: 0.110720 Jul 25 12:44:54.485459 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 847/1772] 10.222.0.49 () {58 vars in 1257 bytes} [Mon Jul 25 12:44:54 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1c9f6c20160c4292b42086ed4f3a0b8b => generated 15 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:44:54.514809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-21cff3d7-0945-4c9d-8aab-3e1694e60057 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:54.520473 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-21cff3d7-0945-4c9d-8aab-3e1694e60057 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.010364 Jul 25 12:44:54.525912 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 848/1773] 10.222.0.49 () {58 vars in 1189 bytes} [Mon Jul 25 12:44:54 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 12:44:54.555141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-401385d2-c958-45ef-9576-776632ff194e tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:54.557716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-401385d2-c958-45ef-9576-776632ff194e tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:54.582265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-401385d2-c958-45ef-9576-776632ff194e tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:54.583003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-401385d2-c958-45ef-9576-776632ff194e tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:54.585625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-401385d2-c958-45ef-9576-776632ff194e tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:54.587200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-401385d2-c958-45ef-9576-776632ff194e tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:54.769603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0aa62fa9-c91a-4f74-8a3c-5e2072b88997 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:54.787113 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0aa62fa9-c91a-4f74-8a3c-5e2072b88997 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1486 microversion: 2.1 time: 0.603917 Jul 25 12:44:54.788102 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 926/1774] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:54 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1486 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:54.800267 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-401385d2-c958-45ef-9576-776632ff194e tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d/action" status: 202 len: 0 microversion: 2.1 time: 0.249412 Jul 25 12:44:54.809518 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 849/1775] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:44:54 2022] POST /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:44:54.818004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c6335deb-22d1-4ce8-bc7e-caa99a04ff1b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:54.833507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-50a098d2-5efe-4c0b-ae5b-5122870d7de6 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:54.834251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c6335deb-22d1-4ce8-bc7e-caa99a04ff1b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:54.844242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c6335deb-22d1-4ce8-bc7e-caa99a04ff1b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d'} {{(pid=125884) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 12:44:54.848126 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-50a098d2-5efe-4c0b-ae5b-5122870d7de6 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:54.868068 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c6335deb-22d1-4ce8-bc7e-caa99a04ff1b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:54.870944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c6335deb-22d1-4ce8-bc7e-caa99a04ff1b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:54.875088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50a098d2-5efe-4c0b-ae5b-5122870d7de6 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:54.875413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c6335deb-22d1-4ce8-bc7e-caa99a04ff1b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:54.876645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50a098d2-5efe-4c0b-ae5b-5122870d7de6 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:54.876849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c6335deb-22d1-4ce8-bc7e-caa99a04ff1b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:54.884145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50a098d2-5efe-4c0b-ae5b-5122870d7de6 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:54.886851 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50a098d2-5efe-4c0b-ae5b-5122870d7de6 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:55.202647 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-50a098d2-5efe-4c0b-ae5b-5122870d7de6 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "POST /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd/action" status: 202 len: 0 microversion: 2.1 time: 0.379171 Jul 25 12:44:55.213467 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 850/1776] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:44:54 2022] POST /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:44:55.239200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9e1c0f7d-5943-400e-8a6a-7ff4217b3ad5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:55.245913 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9e1c0f7d-5943-400e-8a6a-7ff4217b3ad5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:55.280467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e1c0f7d-5943-400e-8a6a-7ff4217b3ad5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:55.284738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e1c0f7d-5943-400e-8a6a-7ff4217b3ad5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:55.290765 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e1c0f7d-5943-400e-8a6a-7ff4217b3ad5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:55.293259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e1c0f7d-5943-400e-8a6a-7ff4217b3ad5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:55.344326 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.multi_cell_list [None req-c6335deb-22d1-4ce8-bc7e-caa99a04ff1b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 12:44:55.550874 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c6335deb-22d1-4ce8-bc7e-caa99a04ff1b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.737055 Jul 25 12:44:55.574279 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 927/1777] 10.222.0.49 () {58 vars in 1150 bytes} [Mon Jul 25 12:44:54 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:55.579566 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-696a1578-8780-4efc-b18d-39fc0f6140ed tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:55.580199 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-696a1578-8780-4efc-b18d-39fc0f6140ed tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:55.601766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-696a1578-8780-4efc-b18d-39fc0f6140ed tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:55.602264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-696a1578-8780-4efc-b18d-39fc0f6140ed tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:55.603128 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-696a1578-8780-4efc-b18d-39fc0f6140ed tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:55.603564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-696a1578-8780-4efc-b18d-39fc0f6140ed tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:56.182491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9e1c0f7d-5943-400e-8a6a-7ff4217b3ad5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:56.206175 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9e1c0f7d-5943-400e-8a6a-7ff4217b3ad5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:56.214759 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9e1c0f7d-5943-400e-8a6a-7ff4217b3ad5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:56.219401 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9e1c0f7d-5943-400e-8a6a-7ff4217b3ad5 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1481 microversion: 2.25 time: 1.004955 Jul 25 12:44:56.225852 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 851/1778] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:55 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1481 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:56.248645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-beaf7268-55b4-47aa-8c9c-49de29b08203 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:56.250637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-beaf7268-55b4-47aa-8c9c-49de29b08203 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:56.281704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-beaf7268-55b4-47aa-8c9c-49de29b08203 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:56.284108 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-beaf7268-55b4-47aa-8c9c-49de29b08203 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:56.286249 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-beaf7268-55b4-47aa-8c9c-49de29b08203 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:56.286430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-beaf7268-55b4-47aa-8c9c-49de29b08203 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:56.913892 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-696a1578-8780-4efc-b18d-39fc0f6140ed tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:56.925228 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-696a1578-8780-4efc-b18d-39fc0f6140ed tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1494 microversion: 2.1 time: 1.349633 Jul 25 12:44:56.974492 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 928/1779] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:55 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1494 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:57.002900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fac267d0-63a3-43f8-8970-7ee633f95a51 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:57.024801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fac267d0-63a3-43f8-8970-7ee633f95a51 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:57.048288 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fac267d0-63a3-43f8-8970-7ee633f95a51 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:57.050224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fac267d0-63a3-43f8-8970-7ee633f95a51 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:57.051308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fac267d0-63a3-43f8-8970-7ee633f95a51 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:57.054492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fac267d0-63a3-43f8-8970-7ee633f95a51 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:57.423481 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fac267d0-63a3-43f8-8970-7ee633f95a51 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d/action" status: 202 len: 0 microversion: 2.1 time: 0.447177 Jul 25 12:44:57.424367 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 929/1780] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:44:56 2022] POST /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:44:57.445605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-c499496e-1ccc-42aa-8cdc-75b6ba293fbb req-d71686f3-1942-4bf9-aa7d-185465342f18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a21af85-54c8-424c-b815-3882ecf4a893", "name": "network-vif-deleted", "tag": "067888a1-37d3-4817-9387-14f7ea43416c"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:57.515779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c499496e-1ccc-42aa-8cdc-75b6ba293fbb req-d71686f3-1942-4bf9-aa7d-185465342f18 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:57.516726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c499496e-1ccc-42aa-8cdc-75b6ba293fbb req-d71686f3-1942-4bf9-aa7d-185465342f18 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:57.577299 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-c499496e-1ccc-42aa-8cdc-75b6ba293fbb req-d71686f3-1942-4bf9-aa7d-185465342f18 service nova] Creating event network-vif-deleted:067888a1-37d3-4817-9387-14f7ea43416c for instance 8a21af85-54c8-424c-b815-3882ecf4a893 on n-h2-848886-15 Jul 25 12:44:57.604723 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-c499496e-1ccc-42aa-8cdc-75b6ba293fbb req-d71686f3-1942-4bf9-aa7d-185465342f18 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174747 Jul 25 12:44:57.614016 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 930/1781] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:57.638210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-821aa520-55b2-4fc1-ab13-73df5b61a661 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:57.650313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-821aa520-55b2-4fc1-ab13-73df5b61a661 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:57.685069 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-821aa520-55b2-4fc1-ab13-73df5b61a661 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:57.708001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-821aa520-55b2-4fc1-ab13-73df5b61a661 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:57.709768 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-821aa520-55b2-4fc1-ab13-73df5b61a661 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:57.715808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-821aa520-55b2-4fc1-ab13-73df5b61a661 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:58.451830 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-821aa520-55b2-4fc1-ab13-73df5b61a661 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:58.469935 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-821aa520-55b2-4fc1-ab13-73df5b61a661 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:58.472573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-821aa520-55b2-4fc1-ab13-73df5b61a661 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:58.475026 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-821aa520-55b2-4fc1-ab13-73df5b61a661 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1265 microversion: 2.25 time: 0.856180 Jul 25 12:44:58.479255 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 931/1782] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:57 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1265 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:58.523880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9391d54f-c272-439d-b198-ce46d2df7de7 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:58.525006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9391d54f-c272-439d-b198-ce46d2df7de7 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:58.541939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9391d54f-c272-439d-b198-ce46d2df7de7 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:58.543471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9391d54f-c272-439d-b198-ce46d2df7de7 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:58.546439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9391d54f-c272-439d-b198-ce46d2df7de7 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:58.547365 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9391d54f-c272-439d-b198-ce46d2df7de7 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:59.092987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-beaf7268-55b4-47aa-8c9c-49de29b08203 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:59.125378 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-beaf7268-55b4-47aa-8c9c-49de29b08203 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 2.879947 Jul 25 12:44:59.154844 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 852/1783] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:56 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 2926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:59.174806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-89f8d4be-02dd-4b4b-acbc-400be762392a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:59.183338 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-89f8d4be-02dd-4b4b-acbc-400be762392a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:59.225467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89f8d4be-02dd-4b4b-acbc-400be762392a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:59.226353 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89f8d4be-02dd-4b4b-acbc-400be762392a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:59.226813 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89f8d4be-02dd-4b4b-acbc-400be762392a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:59.227264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89f8d4be-02dd-4b4b-acbc-400be762392a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:00.042239 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9391d54f-c272-439d-b198-ce46d2df7de7 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1616 microversion: 2.1 time: 1.557171 Jul 25 12:45:00.050400 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 932/1784] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:58 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1616 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:00.134394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c7143d3b-dc90-4fc1-8ad5-89c1da985811 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:00.135696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c7143d3b-dc90-4fc1-8ad5-89c1da985811 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:00.169075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7143d3b-dc90-4fc1-8ad5-89c1da985811 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:00.173525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7143d3b-dc90-4fc1-8ad5-89c1da985811 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:00.174675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7143d3b-dc90-4fc1-8ad5-89c1da985811 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:00.175110 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7143d3b-dc90-4fc1-8ad5-89c1da985811 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:00.378670 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c7143d3b-dc90-4fc1-8ad5-89c1da985811 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:00.407775 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c7143d3b-dc90-4fc1-8ad5-89c1da985811 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:00.411266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c7143d3b-dc90-4fc1-8ad5-89c1da985811 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:00.421077 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c7143d3b-dc90-4fc1-8ad5-89c1da985811 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1265 microversion: 2.25 time: 0.343881 Jul 25 12:45:00.423251 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 933/1785] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:00 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1265 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:00.437807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-71a6459f-4742-4bf3-95f5-a04d0fe53458 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:00.438737 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-71a6459f-4742-4bf3-95f5-a04d0fe53458 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:00.446716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71a6459f-4742-4bf3-95f5-a04d0fe53458 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:00.447460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71a6459f-4742-4bf3-95f5-a04d0fe53458 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:00.448416 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71a6459f-4742-4bf3-95f5-a04d0fe53458 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:00.448992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71a6459f-4742-4bf3-95f5-a04d0fe53458 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:00.474304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:01.108838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-89f8d4be-02dd-4b4b-acbc-400be762392a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:01.140316 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-89f8d4be-02dd-4b4b-acbc-400be762392a tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1494 microversion: 2.1 time: 1.982327 Jul 25 12:45:01.151570 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 853/1786] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:59 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1494 bytes in 1995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:01.158452 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-20b76bd4-dee5-4bfd-8776-0c98d5c55625 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:01.177779 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-20b76bd4-dee5-4bfd-8776-0c98d5c55625 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:01.207558 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20b76bd4-dee5-4bfd-8776-0c98d5c55625 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:01.208051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20b76bd4-dee5-4bfd-8776-0c98d5c55625 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:01.208810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20b76bd4-dee5-4bfd-8776-0c98d5c55625 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:01.209365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20b76bd4-dee5-4bfd-8776-0c98d5c55625 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:01.576339 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-71a6459f-4742-4bf3-95f5-a04d0fe53458 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1616 microversion: 2.1 time: 1.151723 Jul 25 12:45:01.578149 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 934/1787] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:00 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1616 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:02.486586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bc312d32-548b-4653-ac65-de8d56596c88 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Action: 'create', calling method: .version_select at 0x7efcf93fca60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2064504829", "description": "tempest-description-32605852"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:02.842982 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-20b76bd4-dee5-4bfd-8776-0c98d5c55625 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:02.867974 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-20b76bd4-dee5-4bfd-8776-0c98d5c55625 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 1.715166 Jul 25 12:45:02.885593 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 854/1788] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:01 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:02.904129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3c27494f-bbfd-40e6-a753-089f1f0bd286 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:02.909660 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3c27494f-bbfd-40e6-a753-089f1f0bd286 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:02.934318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c27494f-bbfd-40e6-a753-089f1f0bd286 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:02.943602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c27494f-bbfd-40e6-a753-089f1f0bd286 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:02.944971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c27494f-bbfd-40e6-a753-089f1f0bd286 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:02.948110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c27494f-bbfd-40e6-a753-089f1f0bd286 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:03.032222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=46,nova_cell0:UPDATE=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:03.136146 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3c27494f-bbfd-40e6-a753-089f1f0bd286 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:03.154393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3c27494f-bbfd-40e6-a753-089f1f0bd286 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:03.156001 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3c27494f-bbfd-40e6-a753-089f1f0bd286 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:03.157378 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3c27494f-bbfd-40e6-a753-089f1f0bd286 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1265 microversion: 2.25 time: 0.268634 Jul 25 12:45:03.157875 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 855/1789] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:02 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:03.168840 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-197ea4a5-103d-4169-9d15-ed3459071310 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:03.185138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-197ea4a5-103d-4169-9d15-ed3459071310 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Searching by: {'host': 'n-h2-848886-15', 'deleted': False} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 12:45:03.196485 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-197ea4a5-103d-4169-9d15-ed3459071310 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:03.196959 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-197ea4a5-103d-4169-9d15-ed3459071310 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:03.197965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-197ea4a5-103d-4169-9d15-ed3459071310 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:03.199574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-197ea4a5-103d-4169-9d15-ed3459071310 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:03.508707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:03.518203 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bc312d32-548b-4653-ac65-de8d56596c88 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.938742 Jul 25 12:45:03.519492 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 935/1790] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:45:01 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:03.532317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dfe45b6b-3dd9-4659-9f20-548cffde0067 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:03.533049 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dfe45b6b-3dd9-4659-9f20-548cffde0067 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:03.558696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dfe45b6b-3dd9-4659-9f20-548cffde0067 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:03.560248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dfe45b6b-3dd9-4659-9f20-548cffde0067 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:03.560248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dfe45b6b-3dd9-4659-9f20-548cffde0067 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:03.560611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dfe45b6b-3dd9-4659-9f20-548cffde0067 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:03.572289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-197ea4a5-103d-4169-9d15-ed3459071310 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 12:45:03.785802 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-197ea4a5-103d-4169-9d15-ed3459071310 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] 10.222.0.49 "GET /compute/v2.1/servers?host=n-h2-848886-15&all_tenants=1" status: 200 len: 2639 microversion: 2.1 time: 0.626502 Jul 25 12:45:03.793066 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 856/1791] 10.222.0.49 () {58 vars in 1192 bytes} [Mon Jul 25 12:45:03 2022] GET /compute/v2.1/servers?host=n-h2-848886-15&all_tenants=1 => generated 2639 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:03.800356 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cef0f565-5c75-4a72-8a23-a7d03f6e49c0 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Action: 'create', calling method: .version_select at 0x7efcfecb18b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-861488342", "description": "tempest-description-543840693"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:04.140964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dfe45b6b-3dd9-4659-9f20-548cffde0067 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:04.152308 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dfe45b6b-3dd9-4659-9f20-548cffde0067 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1494 microversion: 2.1 time: 0.631628 Jul 25 12:45:04.159578 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 936/1792] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:03 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1494 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:04.174310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e8debf25-7a18-435c-9466-e113fc9b3b99 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:04.181080 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e8debf25-7a18-435c-9466-e113fc9b3b99 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=125884) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 12:45:04.195995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8debf25-7a18-435c-9466-e113fc9b3b99 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:04.197100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8debf25-7a18-435c-9466-e113fc9b3b99 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:04.198130 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8debf25-7a18-435c-9466-e113fc9b3b99 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:04.198848 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8debf25-7a18-435c-9466-e113fc9b3b99 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:04.417134 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cef0f565-5c75-4a72-8a23-a7d03f6e49c0 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.622319 Jul 25 12:45:04.417746 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 857/1793] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:45:03 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:04.438361 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9453bb99-8370-44db-9e00-e79cdf93ee4b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:04.438983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9453bb99-8370-44db-9e00-e79cdf93ee4b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:04.460655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9453bb99-8370-44db-9e00-e79cdf93ee4b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:04.461363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9453bb99-8370-44db-9e00-e79cdf93ee4b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:04.462488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9453bb99-8370-44db-9e00-e79cdf93ee4b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:04.468197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9453bb99-8370-44db-9e00-e79cdf93ee4b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:04.507251 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e8debf25-7a18-435c-9466-e113fc9b3b99 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] 10.222.0.49 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.347100 Jul 25 12:45:04.512552 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 937/1794] 10.222.0.49 () {58 vars in 1196 bytes} [Mon Jul 25 12:45:04 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:45:04.536605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2445bd9e-a1b4-49e1-b10a-3e01285f709f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:04.538438 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2445bd9e-a1b4-49e1-b10a-3e01285f709f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:04.569553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2445bd9e-a1b4-49e1-b10a-3e01285f709f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:04.572634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2445bd9e-a1b4-49e1-b10a-3e01285f709f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:04.576677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2445bd9e-a1b4-49e1-b10a-3e01285f709f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:04.578648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2445bd9e-a1b4-49e1-b10a-3e01285f709f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:04.845478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2445bd9e-a1b4-49e1-b10a-3e01285f709f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:04.858790 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2445bd9e-a1b4-49e1-b10a-3e01285f709f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:04.863273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2445bd9e-a1b4-49e1-b10a-3e01285f709f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:04.864784 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2445bd9e-a1b4-49e1-b10a-3e01285f709f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1265 microversion: 2.25 time: 0.347847 Jul 25 12:45:04.867403 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 938/1795] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:04 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1265 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:04.894470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-735d8a13-b4c6-44e1-8b4e-d38e7bb93385 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:04.902558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-735d8a13-b4c6-44e1-8b4e-d38e7bb93385 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:04.920967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-735d8a13-b4c6-44e1-8b4e-d38e7bb93385 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:04.921712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-735d8a13-b4c6-44e1-8b4e-d38e7bb93385 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:04.922736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-735d8a13-b4c6-44e1-8b4e-d38e7bb93385 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:04.924612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-735d8a13-b4c6-44e1-8b4e-d38e7bb93385 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:04.951062 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9453bb99-8370-44db-9e00-e79cdf93ee4b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:04.959845 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9453bb99-8370-44db-9e00-e79cdf93ee4b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 0.526942 Jul 25 12:45:04.975387 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 858/1796] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:04 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:05.091319 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-735d8a13-b4c6-44e1-8b4e-d38e7bb93385 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d/action" status: 202 len: 0 microversion: 2.1 time: 0.203433 Jul 25 12:45:05.095717 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 939/1797] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:45:04 2022] POST /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:45:05.301578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1513bbd9-436f-4335-aa82-73e26feb56f1 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Action: 'create', calling method: .version_select at 0x7efcfed65310>, body: {"keypair": {"name": "tempest-keypair-94472135", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAU03PpDZDQYe9bMSrZHjdxSIc934qYebm/0/aoM8PtPf0zJzskTLRo10ESbQXnMlcmuKcPu3v07WH0x7lZJOkQYNr/11sqSYbHr8wfUl1GMT2XQJ2Cd4dRIMtBvubSzQ=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:05.356775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-1513bbd9-436f-4335-aa82-73e26feb56f1 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Getting quotas for project 2f16e25c9f6f4845922175f67e5583a1. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:45:05.384336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-1513bbd9-436f-4335-aa82-73e26feb56f1 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Getting quotas for user 388a9972b4da47d7bda9fd36985eeb95 and project 2f16e25c9f6f4845922175f67e5583a1. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:45:05.406271 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-971b4301-af40-4275-9188-13bc94caae7c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1456012529", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:05.438462 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1513bbd9-436f-4335-aa82-73e26feb56f1 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.461422 Jul 25 12:45:05.442347 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 859/1798] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:45:04 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:05.457531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0242e7fd-7c76-492a-8126-e0633974e0c2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1323301557", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "06e1c2ac-ecb5-41f4-b5b1-6c25d867c5e1"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:05.574809 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-971b4301-af40-4275-9188-13bc94caae7c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] validate_networks() for None {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:45:05.590761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-0242e7fd-7c76-492a-8126-e0633974e0c2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] validate_networks() for [('06e1c2ac-ecb5-41f4-b5b1-6c25d867c5e1', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:45:06.378591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-971b4301-af40-4275-9188-13bc94caae7c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:45:06.379004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-971b4301-af40-4275-9188-13bc94caae7c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:45:06.379726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-971b4301-af40-4275-9188-13bc94caae7c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:45:06.380243 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-971b4301-af40-4275-9188-13bc94caae7c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:45:06.381354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-971b4301-af40-4275-9188-13bc94caae7c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:45:06.419532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-971b4301-af40-4275-9188-13bc94caae7c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:06.422879 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-971b4301-af40-4275-9188-13bc94caae7c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:06.427326 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-971b4301-af40-4275-9188-13bc94caae7c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:06.431708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-971b4301-af40-4275-9188-13bc94caae7c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:06.523873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-971b4301-af40-4275-9188-13bc94caae7c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Getting quotas for project 255fa26649774caca18f3b9784863281. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:45:06.551717 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-971b4301-af40-4275-9188-13bc94caae7c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Getting quotas for user 9488de03a0cf4e10b18ba769cb2cf408 and project 255fa26649774caca18f3b9784863281. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:45:06.637300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-971b4301-af40-4275-9188-13bc94caae7c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:45:06.650815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-971b4301-af40-4275-9188-13bc94caae7c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 21390510-6525-44f6-818a-225eacdd5953] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:45:06.771087 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-971b4301-af40-4275-9188-13bc94caae7c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.671168 Jul 25 12:45:06.780845 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 940/1799] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:45:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:45:06.786239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e2301d8c-c497-4c9d-9907-fc91f74ca38e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "97beeed7-7564-4203-abda-feef7e93cd98"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:06.789150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e2301d8c-c497-4c9d-9907-fc91f74ca38e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:06.796175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2301d8c-c497-4c9d-9907-fc91f74ca38e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:06.798238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2301d8c-c497-4c9d-9907-fc91f74ca38e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:06.799369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2301d8c-c497-4c9d-9907-fc91f74ca38e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:06.799985 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2301d8c-c497-4c9d-9907-fc91f74ca38e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:06.978632 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e2301d8c-c497-4c9d-9907-fc91f74ca38e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:45:06.981588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e2301d8c-c497-4c9d-9907-fc91f74ca38e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:45:06.982387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e2301d8c-c497-4c9d-9907-fc91f74ca38e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:45:06.987157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e2301d8c-c497-4c9d-9907-fc91f74ca38e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:45:06.998371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e2301d8c-c497-4c9d-9907-fc91f74ca38e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:45:07.121889 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e2301d8c-c497-4c9d-9907-fc91f74ca38e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:07.139223 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2301d8c-c497-4c9d-9907-fc91f74ca38e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:07.141691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2301d8c-c497-4c9d-9907-fc91f74ca38e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:07.145911 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2301d8c-c497-4c9d-9907-fc91f74ca38e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:07.146889 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2301d8c-c497-4c9d-9907-fc91f74ca38e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:07.253182 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e2301d8c-c497-4c9d-9907-fc91f74ca38e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "POST /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d/action" status: 202 len: 1067 microversion: 2.1 time: 0.470838 Jul 25 12:45:07.261345 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 941/1800] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:45:06 2022] POST /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d/action => generated 1067 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 12:45:07.272733 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d12be70a-4d36-415c-9d69-e8326e18c004 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:07.273996 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d12be70a-4d36-415c-9d69-e8326e18c004 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:07.292514 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d12be70a-4d36-415c-9d69-e8326e18c004 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:07.293994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d12be70a-4d36-415c-9d69-e8326e18c004 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:07.295330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d12be70a-4d36-415c-9d69-e8326e18c004 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:07.299374 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d12be70a-4d36-415c-9d69-e8326e18c004 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:07.422676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-0242e7fd-7c76-492a-8126-e0633974e0c2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:45:07.423274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-0242e7fd-7c76-492a-8126-e0633974e0c2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:45:07.423549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-0242e7fd-7c76-492a-8126-e0633974e0c2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:45:07.424277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-0242e7fd-7c76-492a-8126-e0633974e0c2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:45:07.424881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-0242e7fd-7c76-492a-8126-e0633974e0c2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:45:07.466406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0242e7fd-7c76-492a-8126-e0633974e0c2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:07.467225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0242e7fd-7c76-492a-8126-e0633974e0c2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:07.468484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0242e7fd-7c76-492a-8126-e0633974e0c2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:07.469154 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0242e7fd-7c76-492a-8126-e0633974e0c2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:07.554767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-0242e7fd-7c76-492a-8126-e0633974e0c2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Getting quotas for project 8514497475b8462b86e28d48a16b0b20. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:45:07.588617 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-0242e7fd-7c76-492a-8126-e0633974e0c2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Getting quotas for user 3912af6bdd224191910f72160c42db30 and project 8514497475b8462b86e28d48a16b0b20. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:45:07.660979 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0242e7fd-7c76-492a-8126-e0633974e0c2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:45:07.668597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0242e7fd-7c76-492a-8126-e0633974e0c2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:45:07.867931 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0242e7fd-7c76-492a-8126-e0633974e0c2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.418678 Jul 25 12:45:07.877289 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 860/1801] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:45:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:45:07.885343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-74197136-8299-4556-a9b4-03c00d6e28a3 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:07.886281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-74197136-8299-4556-a9b4-03c00d6e28a3 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:07.898181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74197136-8299-4556-a9b4-03c00d6e28a3 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:07.899545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74197136-8299-4556-a9b4-03c00d6e28a3 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:07.900595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74197136-8299-4556-a9b4-03c00d6e28a3 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:07.901293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74197136-8299-4556-a9b4-03c00d6e28a3 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:07.962372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d12be70a-4d36-415c-9d69-e8326e18c004 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:07.972532 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d12be70a-4d36-415c-9d69-e8326e18c004 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1500 microversion: 2.1 time: 0.709324 Jul 25 12:45:07.973122 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 942/1802] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:07 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1500 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:07.993065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-865f8bd1-72ab-47f3-8b8d-06d7a764a207 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:07.993586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-865f8bd1-72ab-47f3-8b8d-06d7a764a207 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:08.100166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-865f8bd1-72ab-47f3-8b8d-06d7a764a207 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:08.102394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-865f8bd1-72ab-47f3-8b8d-06d7a764a207 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:08.103206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-865f8bd1-72ab-47f3-8b8d-06d7a764a207 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:08.109141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-865f8bd1-72ab-47f3-8b8d-06d7a764a207 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:08.202372 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-74197136-8299-4556-a9b4-03c00d6e28a3 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:08.224143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-74197136-8299-4556-a9b4-03c00d6e28a3 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:08.230809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-74197136-8299-4556-a9b4-03c00d6e28a3 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:08.237461 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-74197136-8299-4556-a9b4-03c00d6e28a3 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1265 microversion: 2.25 time: 0.358775 Jul 25 12:45:08.240052 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 861/1803] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:07 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1265 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:08.275194 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5a3a9417-e4ef-43c8-963b-5ebca7c77ad7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:08.277156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5a3a9417-e4ef-43c8-963b-5ebca7c77ad7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 21390510-6525-44f6-818a-225eacdd5953] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:08.293419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a3a9417-e4ef-43c8-963b-5ebca7c77ad7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:08.295123 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a3a9417-e4ef-43c8-963b-5ebca7c77ad7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:08.296078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a3a9417-e4ef-43c8-963b-5ebca7c77ad7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:08.297668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a3a9417-e4ef-43c8-963b-5ebca7c77ad7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:08.499699 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5a3a9417-e4ef-43c8-963b-5ebca7c77ad7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:08.509707 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5a3a9417-e4ef-43c8-963b-5ebca7c77ad7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953" status: 200 len: 1218 microversion: 2.1 time: 0.257479 Jul 25 12:45:08.510332 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 862/1804] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:08 2022] GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953 => generated 1218 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:08.542683 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f93bb475-4564-4e64-a4e2-52c71b824676 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:08.543343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f93bb475-4564-4e64-a4e2-52c71b824676 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:08.558680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=10,nova_api:INSERT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:08.560735 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f93bb475-4564-4e64-a4e2-52c71b824676 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:08.561218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f93bb475-4564-4e64-a4e2-52c71b824676 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:08.567151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f93bb475-4564-4e64-a4e2-52c71b824676 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:08.567938 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f93bb475-4564-4e64-a4e2-52c71b824676 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:08.761946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-865f8bd1-72ab-47f3-8b8d-06d7a764a207 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:08.779050 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-865f8bd1-72ab-47f3-8b8d-06d7a764a207 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 0.793957 Jul 25 12:45:08.789953 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 943/1805] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:07 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:08.794938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d3a76fb2-44e2-4d0c-b670-908486761900 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:08.795540 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d3a76fb2-44e2-4d0c-b670-908486761900 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:09.146144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d3a76fb2-44e2-4d0c-b670-908486761900 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:09.156360 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d3a76fb2-44e2-4d0c-b670-908486761900 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949" status: 200 len: 1216 microversion: 2.1 time: 0.365194 Jul 25 12:45:09.161222 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 944/1806] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:08 2022] GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949 => generated 1216 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:09.188316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-56562612-7d75-4e9c-9d8b-bf0257196b1e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:09.189194 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-56562612-7d75-4e9c-9d8b-bf0257196b1e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:09.211644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56562612-7d75-4e9c-9d8b-bf0257196b1e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:09.214667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56562612-7d75-4e9c-9d8b-bf0257196b1e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:09.215620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56562612-7d75-4e9c-9d8b-bf0257196b1e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:09.219633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56562612-7d75-4e9c-9d8b-bf0257196b1e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:09.348598 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-56562612-7d75-4e9c-9d8b-bf0257196b1e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:45:09.716446 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-56562612-7d75-4e9c-9d8b-bf0257196b1e tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 204 len: 0 microversion: 2.1 time: 0.552322 Jul 25 12:45:09.717149 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 945/1807] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:45:09 2022] DELETE /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:45:09.729239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2ac4c378-6801-4a1f-a95b-997ece35a412 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:09.734896 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2ac4c378-6801-4a1f-a95b-997ece35a412 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:09.752589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ac4c378-6801-4a1f-a95b-997ece35a412 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:09.762281 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ac4c378-6801-4a1f-a95b-997ece35a412 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:09.765670 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ac4c378-6801-4a1f-a95b-997ece35a412 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:09.766353 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ac4c378-6801-4a1f-a95b-997ece35a412 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:09.983665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f93bb475-4564-4e64-a4e2-52c71b824676 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:09.993006 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f93bb475-4564-4e64-a4e2-52c71b824676 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1471 microversion: 2.1 time: 1.461469 Jul 25 12:45:09.997759 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 863/1808] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:08 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1471 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:10.013530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-15376a67-8996-4864-bf40-4f9d29124c2a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:10.024626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-15376a67-8996-4864-bf40-4f9d29124c2a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 21390510-6525-44f6-818a-225eacdd5953] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:10.040777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2ac4c378-6801-4a1f-a95b-997ece35a412 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:10.052965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15376a67-8996-4864-bf40-4f9d29124c2a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:10.053612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15376a67-8996-4864-bf40-4f9d29124c2a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:10.055088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2ac4c378-6801-4a1f-a95b-997ece35a412 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:10.057096 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2ac4c378-6801-4a1f-a95b-997ece35a412 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:10.063229 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15376a67-8996-4864-bf40-4f9d29124c2a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:10.063693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15376a67-8996-4864-bf40-4f9d29124c2a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:10.064849 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2ac4c378-6801-4a1f-a95b-997ece35a412 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1265 microversion: 2.25 time: 0.346145 Jul 25 12:45:10.069249 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 946/1809] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:09 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1265 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:10.074193 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2cf1c695-5b5e-4610-82e7-f7c54658d546 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:10.079947 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2cf1c695-5b5e-4610-82e7-f7c54658d546 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:10.099619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2cf1c695-5b5e-4610-82e7-f7c54658d546 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:10.101961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2cf1c695-5b5e-4610-82e7-f7c54658d546 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:10.103984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2cf1c695-5b5e-4610-82e7-f7c54658d546 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:10.106575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2cf1c695-5b5e-4610-82e7-f7c54658d546 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:10.170509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:11.073676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-15376a67-8996-4864-bf40-4f9d29124c2a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:11.083661 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-15376a67-8996-4864-bf40-4f9d29124c2a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953" status: 200 len: 1280 microversion: 2.1 time: 1.077449 Jul 25 12:45:11.084982 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 864/1810] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:10 2022] GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953 => generated 1280 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:11.090682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4719abf8-69de-4b3c-8898-838f8e309e43 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:11.091904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4719abf8-69de-4b3c-8898-838f8e309e43 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:11.100022 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4719abf8-69de-4b3c-8898-838f8e309e43 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:11.100907 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4719abf8-69de-4b3c-8898-838f8e309e43 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:11.102107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4719abf8-69de-4b3c-8898-838f8e309e43 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:11.102717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4719abf8-69de-4b3c-8898-838f8e309e43 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:11.525180 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4719abf8-69de-4b3c-8898-838f8e309e43 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:11.538443 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4719abf8-69de-4b3c-8898-838f8e309e43 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 0.451764 Jul 25 12:45:11.542163 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 865/1811] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:11 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:11.553154 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-639d3fed-1f67-43f8-a6d7-8c9d30843807 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:11.553857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-639d3fed-1f67-43f8-a6d7-8c9d30843807 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:11.571956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-639d3fed-1f67-43f8-a6d7-8c9d30843807 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:11.572448 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-639d3fed-1f67-43f8-a6d7-8c9d30843807 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:11.574976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-639d3fed-1f67-43f8-a6d7-8c9d30843807 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:11.577678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-639d3fed-1f67-43f8-a6d7-8c9d30843807 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:11.724128 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-639d3fed-1f67-43f8-a6d7-8c9d30843807 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:11.742906 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-639d3fed-1f67-43f8-a6d7-8c9d30843807 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949" status: 200 len: 1274 microversion: 2.1 time: 0.199353 Jul 25 12:45:11.746381 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 866/1812] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:11 2022] GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949 => generated 1274 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:11.748607 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2cf1c695-5b5e-4610-82e7-f7c54658d546 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:11.753784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-edbb4984-0fb6-4d66-84fd-1333f37cd1c6 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:11.754534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-edbb4984-0fb6-4d66-84fd-1333f37cd1c6 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:11.759997 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2cf1c695-5b5e-4610-82e7-f7c54658d546 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1506 microversion: 2.1 time: 1.689385 Jul 25 12:45:11.762667 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 947/1813] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:10 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1506 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:11.771987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a1b3430f-edd5-4eac-ba9d-894fc0f90bfa tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:11.777253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a1b3430f-edd5-4eac-ba9d-894fc0f90bfa tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:11.779064 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-edbb4984-0fb6-4d66-84fd-1333f37cd1c6 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:11.779654 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-edbb4984-0fb6-4d66-84fd-1333f37cd1c6 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:11.785481 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-edbb4984-0fb6-4d66-84fd-1333f37cd1c6 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:11.789567 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-edbb4984-0fb6-4d66-84fd-1333f37cd1c6 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:11.790914 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1b3430f-edd5-4eac-ba9d-894fc0f90bfa tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:11.793488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1b3430f-edd5-4eac-ba9d-894fc0f90bfa tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:11.794421 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1b3430f-edd5-4eac-ba9d-894fc0f90bfa tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:11.794872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1b3430f-edd5-4eac-ba9d-894fc0f90bfa tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:12.074487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a1b3430f-edd5-4eac-ba9d-894fc0f90bfa tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:12.089534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a1b3430f-edd5-4eac-ba9d-894fc0f90bfa tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:12.091750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a1b3430f-edd5-4eac-ba9d-894fc0f90bfa tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:12.093644 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a1b3430f-edd5-4eac-ba9d-894fc0f90bfa tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1265 microversion: 2.25 time: 0.329801 Jul 25 12:45:12.115885 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 948/1814] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:11 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1265 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:12.140810 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-82792700-1bc4-4404-9354-a3f14f05e937 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:12.141756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-82792700-1bc4-4404-9354-a3f14f05e937 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 21390510-6525-44f6-818a-225eacdd5953] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:12.182636 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82792700-1bc4-4404-9354-a3f14f05e937 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:12.183562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82792700-1bc4-4404-9354-a3f14f05e937 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:12.184549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82792700-1bc4-4404-9354-a3f14f05e937 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:12.185185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82792700-1bc4-4404-9354-a3f14f05e937 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:12.189474 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:12.322486 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-edbb4984-0fb6-4d66-84fd-1333f37cd1c6 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:12.330735 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-edbb4984-0fb6-4d66-84fd-1333f37cd1c6 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1471 microversion: 2.1 time: 0.582769 Jul 25 12:45:12.344138 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 867/1815] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:11 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1471 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:12.370242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-82792700-1bc4-4404-9354-a3f14f05e937 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:12.428788 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-82792700-1bc4-4404-9354-a3f14f05e937 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953" status: 200 len: 1280 microversion: 2.1 time: 0.292895 Jul 25 12:45:12.437350 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 949/1816] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:12 2022] GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953 => generated 1280 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:12.566255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2e9cbefe-230d-4a0a-a5d9-7d0a970a7ca0 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:12.567215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2e9cbefe-230d-4a0a-a5d9-7d0a970a7ca0 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:12.574416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e9cbefe-230d-4a0a-a5d9-7d0a970a7ca0 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:12.575140 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e9cbefe-230d-4a0a-a5d9-7d0a970a7ca0 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:12.576312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e9cbefe-230d-4a0a-a5d9-7d0a970a7ca0 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:12.577028 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e9cbefe-230d-4a0a-a5d9-7d0a970a7ca0 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:12.777577 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2299eb85-c113-4e0e-ac28-a6f511e90226 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:12.779578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2299eb85-c113-4e0e-ac28-a6f511e90226 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:12.800523 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2299eb85-c113-4e0e-ac28-a6f511e90226 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:12.802653 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2299eb85-c113-4e0e-ac28-a6f511e90226 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:12.806964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2299eb85-c113-4e0e-ac28-a6f511e90226 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:12.807715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2299eb85-c113-4e0e-ac28-a6f511e90226 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:13.006185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2299eb85-c113-4e0e-ac28-a6f511e90226 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:13.016232 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2299eb85-c113-4e0e-ac28-a6f511e90226 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949" status: 200 len: 1274 microversion: 2.1 time: 0.244984 Jul 25 12:45:13.023376 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 950/1817] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:12 2022] GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949 => generated 1274 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:13.036497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c7187c72-926a-4eed-83d8-3a4ab397b7bd tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:13.037370 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c7187c72-926a-4eed-83d8-3a4ab397b7bd tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:13.048523 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7187c72-926a-4eed-83d8-3a4ab397b7bd tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:13.049193 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7187c72-926a-4eed-83d8-3a4ab397b7bd tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:13.050211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7187c72-926a-4eed-83d8-3a4ab397b7bd tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:13.052091 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7187c72-926a-4eed-83d8-3a4ab397b7bd tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:13.394837 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2e9cbefe-230d-4a0a-a5d9-7d0a970a7ca0 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:13.410226 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2e9cbefe-230d-4a0a-a5d9-7d0a970a7ca0 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 0.847745 Jul 25 12:45:13.411355 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 868/1818] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:12 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:13.431169 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ea00530c-546c-4dd6-9c84-70edc50b569f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:13.431873 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ea00530c-546c-4dd6-9c84-70edc50b569f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:13.440492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea00530c-546c-4dd6-9c84-70edc50b569f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:13.440948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea00530c-546c-4dd6-9c84-70edc50b569f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:13.441742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea00530c-546c-4dd6-9c84-70edc50b569f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:13.442210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea00530c-546c-4dd6-9c84-70edc50b569f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:13.671451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ea00530c-546c-4dd6-9c84-70edc50b569f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:13.682473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ea00530c-546c-4dd6-9c84-70edc50b569f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:13.684091 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ea00530c-546c-4dd6-9c84-70edc50b569f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:13.686722 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ea00530c-546c-4dd6-9c84-70edc50b569f tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 200 len: 1265 microversion: 2.25 time: 0.261456 Jul 25 12:45:13.699903 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 869/1819] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:13 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 1265 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:13.710740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c0a6f6e6-b2c3-4f20-9f60-23f5edf05707 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2081277940", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a57176f7-65e8-467b-9a9f-d7ce8c82cc68"}], "security_groups": [{"name": "tempest-securitygroup--1014906592"}], "key_name": "tempest-keypair-94472135", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:13.823051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c7187c72-926a-4eed-83d8-3a4ab397b7bd tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:13.835872 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c7187c72-926a-4eed-83d8-3a4ab397b7bd tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1506 microversion: 2.1 time: 0.811510 Jul 25 12:45:13.838369 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 951/1820] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:13 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1506 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:13.850672 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-20ba8a8a-77f7-47ac-be61-f95160261740 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:13.851450 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-20ba8a8a-77f7-47ac-be61-f95160261740 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:13.866619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20ba8a8a-77f7-47ac-be61-f95160261740 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:13.867464 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20ba8a8a-77f7-47ac-be61-f95160261740 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:13.872294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20ba8a8a-77f7-47ac-be61-f95160261740 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:13.873028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20ba8a8a-77f7-47ac-be61-f95160261740 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:14.270494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-c0a6f6e6-b2c3-4f20-9f60-23f5edf05707 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] validate_networks() for [('a57176f7-65e8-467b-9a9f-d7ce8c82cc68', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:45:14.850894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-20ba8a8a-77f7-47ac-be61-f95160261740 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:14.870161 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-20ba8a8a-77f7-47ac-be61-f95160261740 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1471 microversion: 2.1 time: 1.027184 Jul 25 12:45:14.871268 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 952/1821] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:13 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1471 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:14.882012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aae0b565-479b-4051-bcfe-372a46d94b06 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:14.882958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-aae0b565-479b-4051-bcfe-372a46d94b06 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 21390510-6525-44f6-818a-225eacdd5953] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:14.895723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aae0b565-479b-4051-bcfe-372a46d94b06 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:14.897381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aae0b565-479b-4051-bcfe-372a46d94b06 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:14.899360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aae0b565-479b-4051-bcfe-372a46d94b06 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:14.900766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aae0b565-479b-4051-bcfe-372a46d94b06 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:15.519401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-aae0b565-479b-4051-bcfe-372a46d94b06 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:15.537203 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-aae0b565-479b-4051-bcfe-372a46d94b06 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953" status: 200 len: 1322 microversion: 2.1 time: 0.662399 Jul 25 12:45:15.538215 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 953/1822] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:14 2022] GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953 => generated 1322 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:15.551924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4371668c-4837-4657-adc4-2f58decdbcc3 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:15.553464 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4371668c-4837-4657-adc4-2f58decdbcc3 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:15.564766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4371668c-4837-4657-adc4-2f58decdbcc3 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:15.565561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4371668c-4837-4657-adc4-2f58decdbcc3 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:15.566644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4371668c-4837-4657-adc4-2f58decdbcc3 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:15.567258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4371668c-4837-4657-adc4-2f58decdbcc3 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:16.220299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4371668c-4837-4657-adc4-2f58decdbcc3 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:16.254806 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4371668c-4837-4657-adc4-2f58decdbcc3 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949" status: 200 len: 1316 microversion: 2.1 time: 0.714103 Jul 25 12:45:16.257124 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 954/1823] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:15 2022] GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949 => generated 1316 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:16.266714 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fab689f2-c0bf-45f6-b63c-60f6a45b4ac7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:16.273312 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fab689f2-c0bf-45f6-b63c-60f6a45b4ac7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:16.285914 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fab689f2-c0bf-45f6-b63c-60f6a45b4ac7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:16.286768 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fab689f2-c0bf-45f6-b63c-60f6a45b4ac7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:16.287790 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fab689f2-c0bf-45f6-b63c-60f6a45b4ac7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:16.288446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fab689f2-c0bf-45f6-b63c-60f6a45b4ac7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:16.485311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=12 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:16.734954 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-c0a6f6e6-b2c3-4f20-9f60-23f5edf05707 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Getting quotas for project 2f16e25c9f6f4845922175f67e5583a1. Resources: dict_keys(['metadata_items']) {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:45:16.758406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-c0a6f6e6-b2c3-4f20-9f60-23f5edf05707 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Getting quotas for user 388a9972b4da47d7bda9fd36985eeb95 and project 2f16e25c9f6f4845922175f67e5583a1. Resources: dict_keys(['metadata_items']) {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:45:16.810922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c0a6f6e6-b2c3-4f20-9f60-23f5edf05707 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:45:16.811853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c0a6f6e6-b2c3-4f20-9f60-23f5edf05707 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:45:16.812857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c0a6f6e6-b2c3-4f20-9f60-23f5edf05707 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:45:16.813524 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c0a6f6e6-b2c3-4f20-9f60-23f5edf05707 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:45:16.814209 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c0a6f6e6-b2c3-4f20-9f60-23f5edf05707 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:45:16.852828 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0a6f6e6-b2c3-4f20-9f60-23f5edf05707 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:16.854308 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0a6f6e6-b2c3-4f20-9f60-23f5edf05707 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:16.857223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0a6f6e6-b2c3-4f20-9f60-23f5edf05707 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:16.858443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0a6f6e6-b2c3-4f20-9f60-23f5edf05707 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:16.880255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=9 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:16.902780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-c0a6f6e6-b2c3-4f20-9f60-23f5edf05707 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Getting quotas for project 2f16e25c9f6f4845922175f67e5583a1. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:45:16.902975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fab689f2-c0bf-45f6-b63c-60f6a45b4ac7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:16.907365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-c0a6f6e6-b2c3-4f20-9f60-23f5edf05707 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Getting quotas for user 388a9972b4da47d7bda9fd36985eeb95 and project 2f16e25c9f6f4845922175f67e5583a1. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:45:16.923607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c0a6f6e6-b2c3-4f20-9f60-23f5edf05707 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:45:16.925228 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fab689f2-c0bf-45f6-b63c-60f6a45b4ac7 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 0.666726 Jul 25 12:45:16.926594 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c0a6f6e6-b2c3-4f20-9f60-23f5edf05707 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] [instance: d4033cef-23be-4f49-8c7b-0be4ebde362f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:45:16.930330 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 955/1824] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:16 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:16.939294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8aed3b10-f8dd-4dcf-8f39-8b4f87746dd6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:16.940189 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8aed3b10-f8dd-4dcf-8f39-8b4f87746dd6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 8a21af85-54c8-424c-b815-3882ecf4a893] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:16.954736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:16.957618 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8aed3b10-f8dd-4dcf-8f39-8b4f87746dd6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:16.961130 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8aed3b10-f8dd-4dcf-8f39-8b4f87746dd6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:16.964097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8aed3b10-f8dd-4dcf-8f39-8b4f87746dd6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:16.965792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8aed3b10-f8dd-4dcf-8f39-8b4f87746dd6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:16.986563 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-8aed3b10-f8dd-4dcf-8f39-8b4f87746dd6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] HTTP exception thrown: Instance 8a21af85-54c8-424c-b815-3882ecf4a893 could not be found. Jul 25 12:45:16.990179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8aed3b10-f8dd-4dcf-8f39-8b4f87746dd6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Request method failure captured: Jul 25 12:45:16.990179 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 HTTP/1.1 Jul 25 12:45:16.990179 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:45:16.990179 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:45:16.990179 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:45:16.990179 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:45:16.990179 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:45:16.990179 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:45:16.990179 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:45:16.990179 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:45:16.990179 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o7Cd_8Lqp-0wEwAl8ClXlh_AIOMu3nTsYHwSfoINOAYpM9tKluLVBmtXxrBiVPCdhUkTyHT7iRks30CtQftHX9B2A5Biu0tF7UKx0LS0U7Z4vHIrZWCBQHnd32ujvJYompMUMG4hPPK6j9Oq9zHao-IAqdAE-XzANFWpF3FSd7pbYQ Jul 25 12:45:16.990179 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:45:16.990179 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:45:16.990179 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:45:16.990179 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:45:16.990179 n-d-848886-15 devstack@n-api.service[125884]: X-Openstack-Nova-Api-Version: 2.25 Jul 25 12:45:16.990179 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:45:16.990179 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:45:16.990179 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: bdce4da5878543a4a609dc35e389763c Jul 25 12:45:16.990179 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1761396001 Jul 25 12:45:16.990179 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:45:16.990179 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:45:16.992167 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bdce4da5878543a4a609dc35e389763c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bdce4da5878543a4a609dc35e389763c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bdce4da5878543a4a609dc35e389763c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bdce4da5878543a4a609dc35e389763c"}]}] Jul 25 12:45:16.992167 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1761396001 Jul 25 12:45:16.992167 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: bdce4da5878543a4a609dc35e389763c Jul 25 12:45:16.992167 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1761396001 Jul 25 12:45:16.992167 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-LiveAutoBlockMigrationV225Test-1761396001-project Jul 25 12:45:16.992167 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:45:16.992167 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:45:16.992167 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: fa79a472f31b4e8eb0a6ad709bc84c01 Jul 25 12:45:16.992167 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1761396001-project Jul 25 12:45:16.992167 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:45:16.992167 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 8a21af85-54c8-424c-b815-3882ecf4a893 could not be found. Jul 25 12:45:16.992167 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '8a21af85-54c8-424c-b815-3882ecf4a893'} Jul 25 12:45:16.993240 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:45:16.993240 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:16.993240 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:45:16.993240 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:45:16.993240 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:45:16.993240 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:45:16.993240 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:45:16.993240 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:45:16.993240 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:45:16.993240 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:45:16.993240 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a21af85-54c8-424c-b815-3882ecf4a893 could not be found. Jul 25 12:45:16.993240 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:16.993240 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:16.993240 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:16.993240 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:16.993240 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:16.993240 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:16.993240 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:45:16.993240 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:45:16.993240 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:45:16.994977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:45:16.994977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:45:16.994977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:45:16.994977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:45:16.994977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:45:16.994977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:45:16.994977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:45:16.994977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a21af85-54c8-424c-b815-3882ecf4a893 could not be found. Jul 25 12:45:16.994977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:16.994977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:16.994977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:16.994977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:16.994977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:16.994977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:16.994977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:45:16.994977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:45:16.994977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a21af85-54c8-424c-b815-3882ecf4a893 could not be found. Jul 25 12:45:16.994977 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:16.998245 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8aed3b10-f8dd-4dcf-8f39-8b4f87746dd6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Returning 404 to user: Instance 8a21af85-54c8-424c-b815-3882ecf4a893 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:45:17.002849 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8aed3b10-f8dd-4dcf-8f39-8b4f87746dd6 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893" status: 404 len: 111 microversion: 2.25 time: 0.071332 Jul 25 12:45:17.004485 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 956/1825] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:16 2022] GET /compute/v2.1/servers/8a21af85-54c8-424c-b815-3882ecf4a893 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:45:17.010372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-922d48c8-b9e5-4654-adc5-c1335b80f421 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:17.011154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-922d48c8-b9e5-4654-adc5-c1335b80f421 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:17.017974 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c0a6f6e6-b2c3-4f20-9f60-23f5edf05707 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.312925 Jul 25 12:45:17.019271 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-922d48c8-b9e5-4654-adc5-c1335b80f421 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:17.020073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-922d48c8-b9e5-4654-adc5-c1335b80f421 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:17.021044 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-922d48c8-b9e5-4654-adc5-c1335b80f421 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:17.021243 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 870/1826] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:45:13 2022] POST /compute/v2.1/servers => generated 407 bytes in 3321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:45:17.021920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-922d48c8-b9e5-4654-adc5-c1335b80f421 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:17.039307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bda6c258-98ac-488a-aa72-0947e91a951e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:17.040065 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bda6c258-98ac-488a-aa72-0947e91a951e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:17.063908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bda6c258-98ac-488a-aa72-0947e91a951e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:17.064553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bda6c258-98ac-488a-aa72-0947e91a951e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:17.065772 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bda6c258-98ac-488a-aa72-0947e91a951e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:17.066489 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bda6c258-98ac-488a-aa72-0947e91a951e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:17.149617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-922d48c8-b9e5-4654-adc5-c1335b80f421 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:17.153188 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-922d48c8-b9e5-4654-adc5-c1335b80f421 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:17.153727 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-922d48c8-b9e5-4654-adc5-c1335b80f421 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lazy-loading 'fault' on Instance uuid 7e4075b4-1c73-4c86-b399-5aa825cc41cd {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:45:17.469354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-922d48c8-b9e5-4654-adc5-c1335b80f421 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:17.480349 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-922d48c8-b9e5-4654-adc5-c1335b80f421 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 200 len: 1304 microversion: 2.1 time: 0.474461 Jul 25 12:45:17.495170 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 957/1827] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:17 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 1304 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:17.514737 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4044c0b3-2a88-4522-a969-2ca3c0aa8488 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:17.514737 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4044c0b3-2a88-4522-a969-2ca3c0aa8488 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 21390510-6525-44f6-818a-225eacdd5953] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:17.538970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4044c0b3-2a88-4522-a969-2ca3c0aa8488 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:17.539424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4044c0b3-2a88-4522-a969-2ca3c0aa8488 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:17.540216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4044c0b3-2a88-4522-a969-2ca3c0aa8488 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:17.540652 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4044c0b3-2a88-4522-a969-2ca3c0aa8488 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:17.911617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4044c0b3-2a88-4522-a969-2ca3c0aa8488 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:17.926317 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4044c0b3-2a88-4522-a969-2ca3c0aa8488 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953" status: 200 len: 1322 microversion: 2.1 time: 0.424467 Jul 25 12:45:17.930901 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 958/1828] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:17 2022] GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953 => generated 1322 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:17.942705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-bb32d090-6ca3-49cd-8f4f-66d11bb9a23c req-974d79cf-c881-445e-bcc5-9eedf68807b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4075b4-1c73-4c86-b399-5aa825cc41cd", "name": "network-vif-deleted", "tag": "b2e864ef-d364-4d7a-8b71-3339a78ee52f"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:17.965807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-bb32d090-6ca3-49cd-8f4f-66d11bb9a23c req-974d79cf-c881-445e-bcc5-9eedf68807b2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:17.966863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-bb32d090-6ca3-49cd-8f4f-66d11bb9a23c req-974d79cf-c881-445e-bcc5-9eedf68807b2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:17.994961 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-bb32d090-6ca3-49cd-8f4f-66d11bb9a23c req-974d79cf-c881-445e-bcc5-9eedf68807b2 service nova] Creating event network-vif-deleted:b2e864ef-d364-4d7a-8b71-3339a78ee52f for instance 7e4075b4-1c73-4c86-b399-5aa825cc41cd on n-h2-848886-15 Jul 25 12:45:18.006984 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-bb32d090-6ca3-49cd-8f4f-66d11bb9a23c req-974d79cf-c881-445e-bcc5-9eedf68807b2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074438 Jul 25 12:45:18.007949 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 959/1829] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:18.017899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-13fabc4a-8705-46f1-b67b-01ae445bf111 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:18.018967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-13fabc4a-8705-46f1-b67b-01ae445bf111 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] [instance: d4033cef-23be-4f49-8c7b-0be4ebde362f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:18.276428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-13fabc4a-8705-46f1-b67b-01ae445bf111 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388a9972b4da47d7bda9fd36985eeb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f16e25c9f6f4845922175f67e5583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:18.284159 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-13fabc4a-8705-46f1-b67b-01ae445bf111 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f" status: 200 len: 1268 microversion: 2.1 time: 0.274795 Jul 25 12:45:18.302004 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 960/1830] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:18 2022] GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f => generated 1268 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:18.307258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-09df84c4-9f42-44c5-ae4a-98c474ccfc65 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:18.310662 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-09df84c4-9f42-44c5-ae4a-98c474ccfc65 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:18.321476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09df84c4-9f42-44c5-ae4a-98c474ccfc65 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:18.321943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09df84c4-9f42-44c5-ae4a-98c474ccfc65 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:18.333362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09df84c4-9f42-44c5-ae4a-98c474ccfc65 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:18.334077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09df84c4-9f42-44c5-ae4a-98c474ccfc65 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:18.373246 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bda6c258-98ac-488a-aa72-0947e91a951e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:18.383906 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bda6c258-98ac-488a-aa72-0947e91a951e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1471 microversion: 2.1 time: 1.358861 Jul 25 12:45:18.395469 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 871/1831] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:17 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1471 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:18.405217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-205f0a97-3286-418b-be0f-5c9438886d3d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:18.416353 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-205f0a97-3286-418b-be0f-5c9438886d3d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:18.442331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-205f0a97-3286-418b-be0f-5c9438886d3d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:18.464241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-205f0a97-3286-418b-be0f-5c9438886d3d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:18.465264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-205f0a97-3286-418b-be0f-5c9438886d3d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:18.465819 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-205f0a97-3286-418b-be0f-5c9438886d3d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:18.848435 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-09df84c4-9f42-44c5-ae4a-98c474ccfc65 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:18.870044 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-09df84c4-9f42-44c5-ae4a-98c474ccfc65 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949" status: 200 len: 1316 microversion: 2.1 time: 0.566415 Jul 25 12:45:18.870657 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 961/1832] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:18 2022] GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949 => generated 1316 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:18.879895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3ed93f2a-9856-415c-9c80-9015e5c87543 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:18.880516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3ed93f2a-9856-415c-9c80-9015e5c87543 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 7e4075b4-1c73-4c86-b399-5aa825cc41cd] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:18.898352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ed93f2a-9856-415c-9c80-9015e5c87543 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:18.898798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ed93f2a-9856-415c-9c80-9015e5c87543 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:18.899599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ed93f2a-9856-415c-9c80-9015e5c87543 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:18.906239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ed93f2a-9856-415c-9c80-9015e5c87543 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:18.939683 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-3ed93f2a-9856-415c-9c80-9015e5c87543 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] HTTP exception thrown: Instance 7e4075b4-1c73-4c86-b399-5aa825cc41cd could not be found. Jul 25 12:45:18.941599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3ed93f2a-9856-415c-9c80-9015e5c87543 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Request method failure captured: Jul 25 12:45:18.941599 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd HTTP/1.1 Jul 25 12:45:18.941599 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:45:18.941599 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:45:18.941599 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:45:18.941599 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:45:18.941599 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:45:18.941599 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:45:18.941599 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:45:18.941599 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:45:18.941599 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o_EqbWNiW5g4opC8XpJxaHr1ZOTj0XKCGsWqeMraj1bpkLcxrWlCTcB_x8pFpfnSObr4vKnxIJEsl2cW84rJd7RqU6DaT9dX5mpUTTWt2EciAHmWuYhLGYqNguoZK9EP9ZBWtsjQJw87GfIds1_MNWPp7A8he-EVHDWh7R4taNsdVE Jul 25 12:45:18.941599 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:45:18.941599 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:45:18.941599 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:45:18.941599 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:45:18.941599 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:45:18.941599 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:45:18.941599 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 7c39943d13c4455a8b7a18cce243d079 Jul 25 12:45:18.941599 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerRescueTestJSON-1832879746 Jul 25 12:45:18.941599 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:45:18.941599 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:45:18.943371 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7c39943d13c4455a8b7a18cce243d079", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7c39943d13c4455a8b7a18cce243d079"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c39943d13c4455a8b7a18cce243d079"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c39943d13c4455a8b7a18cce243d079"}]}] Jul 25 12:45:18.943371 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerRescueTestJSON-1832879746 Jul 25 12:45:18.943371 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 7c39943d13c4455a8b7a18cce243d079 Jul 25 12:45:18.943371 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerRescueTestJSON-1832879746 Jul 25 12:45:18.943371 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerRescueTestJSON-1832879746-project Jul 25 12:45:18.943371 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:45:18.943371 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:45:18.943371 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 66746994c09d40edb7f51ca444b7a5a7 Jul 25 12:45:18.943371 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerRescueTestJSON-1832879746-project Jul 25 12:45:18.943371 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:45:18.943371 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 7e4075b4-1c73-4c86-b399-5aa825cc41cd could not be found. Jul 25 12:45:18.943371 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '7e4075b4-1c73-4c86-b399-5aa825cc41cd'} Jul 25 12:45:18.944499 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:45:18.944499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:18.944499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:45:18.944499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:45:18.944499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:45:18.944499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:45:18.944499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:45:18.944499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:45:18.944499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:45:18.944499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:45:18.944499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e4075b4-1c73-4c86-b399-5aa825cc41cd could not be found. Jul 25 12:45:18.944499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:18.944499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:18.944499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:18.944499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:18.944499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:18.944499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:18.944499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:45:18.944499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:45:18.944499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:45:18.946130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:45:18.946130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:45:18.946130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:45:18.946130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:45:18.946130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:45:18.946130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:45:18.946130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:45:18.946130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e4075b4-1c73-4c86-b399-5aa825cc41cd could not be found. Jul 25 12:45:18.946130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:18.946130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:18.946130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:18.946130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:18.946130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:18.946130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:18.946130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:45:18.946130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:45:18.946130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e4075b4-1c73-4c86-b399-5aa825cc41cd could not be found. Jul 25 12:45:18.946130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:18.947763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3ed93f2a-9856-415c-9c80-9015e5c87543 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Returning 404 to user: Instance 7e4075b4-1c73-4c86-b399-5aa825cc41cd could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:45:18.947763 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3ed93f2a-9856-415c-9c80-9015e5c87543 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd" status: 404 len: 111 microversion: 2.1 time: 0.071472 Jul 25 12:45:18.947763 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 962/1833] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:18 2022] GET /compute/v2.1/servers/7e4075b4-1c73-4c86-b399-5aa825cc41cd => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:45:18.952913 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-84f162b2-a182-4d7f-a31c-476aea58c04c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:18.953420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-84f162b2-a182-4d7f-a31c-476aea58c04c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:18.969322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84f162b2-a182-4d7f-a31c-476aea58c04c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:18.969632 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84f162b2-a182-4d7f-a31c-476aea58c04c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:18.976520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84f162b2-a182-4d7f-a31c-476aea58c04c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:18.976999 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84f162b2-a182-4d7f-a31c-476aea58c04c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:19.061077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-84f162b2-a182-4d7f-a31c-476aea58c04c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:45:19.302209 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-84f162b2-a182-4d7f-a31c-476aea58c04c tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 204 len: 0 microversion: 2.1 time: 0.352683 Jul 25 12:45:19.312889 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 963/1834] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:45:18 2022] DELETE /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 12:45:19.325999 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-593cafbc-7737-44cf-b6b2-5dfd14c2a6d4 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:19.327081 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-593cafbc-7737-44cf-b6b2-5dfd14c2a6d4 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 21390510-6525-44f6-818a-225eacdd5953] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:19.337911 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-593cafbc-7737-44cf-b6b2-5dfd14c2a6d4 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:19.338703 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-593cafbc-7737-44cf-b6b2-5dfd14c2a6d4 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:19.340097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-593cafbc-7737-44cf-b6b2-5dfd14c2a6d4 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:19.340768 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-593cafbc-7737-44cf-b6b2-5dfd14c2a6d4 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:19.768286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-205f0a97-3286-418b-be0f-5c9438886d3d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:19.777523 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-205f0a97-3286-418b-be0f-5c9438886d3d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 1.378512 Jul 25 12:45:19.778082 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 872/1835] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:18 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:19.786110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-631630b9-d14d-4bd0-8806-a4cdc2517867 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:19.792238 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-631630b9-d14d-4bd0-8806-a4cdc2517867 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] [instance: d4033cef-23be-4f49-8c7b-0be4ebde362f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:19.810018 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-631630b9-d14d-4bd0-8806-a4cdc2517867 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:19.810712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-631630b9-d14d-4bd0-8806-a4cdc2517867 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:19.811750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-631630b9-d14d-4bd0-8806-a4cdc2517867 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:19.812391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-631630b9-d14d-4bd0-8806-a4cdc2517867 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:19.922984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-631630b9-d14d-4bd0-8806-a4cdc2517867 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388a9972b4da47d7bda9fd36985eeb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f16e25c9f6f4845922175f67e5583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:19.934179 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-631630b9-d14d-4bd0-8806-a4cdc2517867 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f" status: 200 len: 1320 microversion: 2.1 time: 0.154972 Jul 25 12:45:19.938825 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 873/1836] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:19 2022] GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f => generated 1320 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:19.945034 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fead967c-36e3-4b0d-918a-08be3c29c485 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:19.946344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fead967c-36e3-4b0d-918a-08be3c29c485 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:19.958879 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-593cafbc-7737-44cf-b6b2-5dfd14c2a6d4 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:19.965276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fead967c-36e3-4b0d-918a-08be3c29c485 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:19.965841 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fead967c-36e3-4b0d-918a-08be3c29c485 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:19.966747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fead967c-36e3-4b0d-918a-08be3c29c485 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:19.967171 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-593cafbc-7737-44cf-b6b2-5dfd14c2a6d4 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953" status: 200 len: 1322 microversion: 2.1 time: 0.652256 Jul 25 12:45:19.967562 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fead967c-36e3-4b0d-918a-08be3c29c485 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:19.968649 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 964/1837] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:19 2022] GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953 => generated 1322 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:19.973533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-eed1c59b-c395-4892-b432-40e38f53db17 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:19.974157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eed1c59b-c395-4892-b432-40e38f53db17 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:19.980786 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eed1c59b-c395-4892-b432-40e38f53db17 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:19.981453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eed1c59b-c395-4892-b432-40e38f53db17 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:19.982446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eed1c59b-c395-4892-b432-40e38f53db17 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:19.983276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eed1c59b-c395-4892-b432-40e38f53db17 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:20.244169 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-eed1c59b-c395-4892-b432-40e38f53db17 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:20.254542 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-eed1c59b-c395-4892-b432-40e38f53db17 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1477 microversion: 2.1 time: 0.284470 Jul 25 12:45:20.257685 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 965/1838] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:19 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1477 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:20.270135 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3169b21e-89f4-4562-8d49-0c96707e539a tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:20.271106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3169b21e-89f4-4562-8d49-0c96707e539a tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:20.285705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3169b21e-89f4-4562-8d49-0c96707e539a tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:20.286900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3169b21e-89f4-4562-8d49-0c96707e539a tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:20.287968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3169b21e-89f4-4562-8d49-0c96707e539a tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:20.289779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3169b21e-89f4-4562-8d49-0c96707e539a tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:20.322575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fead967c-36e3-4b0d-918a-08be3c29c485 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:20.333800 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fead967c-36e3-4b0d-918a-08be3c29c485 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1491 microversion: 2.1 time: 0.390303 Jul 25 12:45:20.334781 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 874/1839] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:19 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1491 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:20.341410 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-30398e6b-25d6-48ec-ae12-150112dbb92e req-12707d6f-3bb1-4c67-b24f-0a4ea321dc8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21390510-6525-44f6-818a-225eacdd5953", "tag": "ab6ba094-9ede-486e-b9bb-483f805db9da"}, {"name": "network-changed", "server_uuid": "7a8bc4a2-d00c-4134-acdc-7b86e0ada949", "tag": "c9e83551-a9ab-4f05-a33e-1ebc6c00a03a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:20.365869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-30398e6b-25d6-48ec-ae12-150112dbb92e req-12707d6f-3bb1-4c67-b24f-0a4ea321dc8e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:20.366327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-30398e6b-25d6-48ec-ae12-150112dbb92e req-12707d6f-3bb1-4c67-b24f-0a4ea321dc8e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:20.395143 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-30398e6b-25d6-48ec-ae12-150112dbb92e req-12707d6f-3bb1-4c67-b24f-0a4ea321dc8e service nova] Creating event network-changed:ab6ba094-9ede-486e-b9bb-483f805db9da for instance 21390510-6525-44f6-818a-225eacdd5953 on n-h1-848886-15 Jul 25 12:45:20.395143 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-30398e6b-25d6-48ec-ae12-150112dbb92e req-12707d6f-3bb1-4c67-b24f-0a4ea321dc8e service nova] Creating event network-changed:c9e83551-a9ab-4f05-a33e-1ebc6c00a03a for instance 7a8bc4a2-d00c-4134-acdc-7b86e0ada949 on n-h1-848886-15 Jul 25 12:45:20.412744 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-30398e6b-25d6-48ec-ae12-150112dbb92e req-12707d6f-3bb1-4c67-b24f-0a4ea321dc8e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.076587 Jul 25 12:45:20.413368 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 875/1840] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:20.489197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3169b21e-89f4-4562-8d49-0c96707e539a tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:20.492850 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:20.500369 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3169b21e-89f4-4562-8d49-0c96707e539a tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949" status: 200 len: 1316 microversion: 2.1 time: 0.240880 Jul 25 12:45:20.501687 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 966/1841] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:20 2022] GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949 => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:20.801374 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0dbf442d-f512-4eb2-ad3d-8c4866f83043 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:20.802719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0dbf442d-f512-4eb2-ad3d-8c4866f83043 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:20.827187 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0dbf442d-f512-4eb2-ad3d-8c4866f83043 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:20.827660 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0dbf442d-f512-4eb2-ad3d-8c4866f83043 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:20.829796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0dbf442d-f512-4eb2-ad3d-8c4866f83043 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:20.831084 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0dbf442d-f512-4eb2-ad3d-8c4866f83043 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:20.959132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-191d2966-da27-4f60-a809-6600c837d0b3 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:20.960498 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-191d2966-da27-4f60-a809-6600c837d0b3 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] [instance: d4033cef-23be-4f49-8c7b-0be4ebde362f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:20.983172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-191d2966-da27-4f60-a809-6600c837d0b3 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:20.983896 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-191d2966-da27-4f60-a809-6600c837d0b3 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:20.985482 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-191d2966-da27-4f60-a809-6600c837d0b3 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:20.987568 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-191d2966-da27-4f60-a809-6600c837d0b3 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:21.106351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-191d2966-da27-4f60-a809-6600c837d0b3 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388a9972b4da47d7bda9fd36985eeb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f16e25c9f6f4845922175f67e5583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:21.115854 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-191d2966-da27-4f60-a809-6600c837d0b3 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f" status: 200 len: 1338 microversion: 2.1 time: 0.160450 Jul 25 12:45:21.129517 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 967/1842] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:20 2022] GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f => generated 1338 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:21.143298 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ab116884-2403-4960-883f-35803ba9e3c2 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:21.144025 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ab116884-2403-4960-883f-35803ba9e3c2 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 21390510-6525-44f6-818a-225eacdd5953] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:21.153816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ab116884-2403-4960-883f-35803ba9e3c2 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:21.160383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ab116884-2403-4960-883f-35803ba9e3c2 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:21.161360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ab116884-2403-4960-883f-35803ba9e3c2 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:21.161958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ab116884-2403-4960-883f-35803ba9e3c2 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:21.386526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ab116884-2403-4960-883f-35803ba9e3c2 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:21.395198 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ab116884-2403-4960-883f-35803ba9e3c2 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953" status: 200 len: 1322 microversion: 2.1 time: 0.264445 Jul 25 12:45:21.415224 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 968/1843] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:21 2022] GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:21.415224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-46bdd603-5ea0-4226-9684-6e29cbe896f0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:21.415224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-46bdd603-5ea0-4226-9684-6e29cbe896f0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:21.419161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-46bdd603-5ea0-4226-9684-6e29cbe896f0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:21.423792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-46bdd603-5ea0-4226-9684-6e29cbe896f0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:21.424728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-46bdd603-5ea0-4226-9684-6e29cbe896f0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:21.428016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-46bdd603-5ea0-4226-9684-6e29cbe896f0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:21.636193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0dbf442d-f512-4eb2-ad3d-8c4866f83043 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:21.644219 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0dbf442d-f512-4eb2-ad3d-8c4866f83043 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 0.847019 Jul 25 12:45:21.665131 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 876/1844] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:20 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:21.670293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c5cddf11-d5fb-45eb-bcc7-20e3a0f415f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:21.678080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c5cddf11-d5fb-45eb-bcc7-20e3a0f415f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:21.685695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5cddf11-d5fb-45eb-bcc7-20e3a0f415f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:21.688680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5cddf11-d5fb-45eb-bcc7-20e3a0f415f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:21.693715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5cddf11-d5fb-45eb-bcc7-20e3a0f415f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:21.694356 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5cddf11-d5fb-45eb-bcc7-20e3a0f415f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:22.072223 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-46bdd603-5ea0-4226-9684-6e29cbe896f0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:22.081246 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-46bdd603-5ea0-4226-9684-6e29cbe896f0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1477 microversion: 2.1 time: 0.677074 Jul 25 12:45:22.092954 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 969/1845] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:21 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1477 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:22.098194 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-46d95ffa-01dc-446f-956f-69a7195e9cf2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:22.098832 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-46d95ffa-01dc-446f-956f-69a7195e9cf2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:22.111256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-46d95ffa-01dc-446f-956f-69a7195e9cf2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:22.111813 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-46d95ffa-01dc-446f-956f-69a7195e9cf2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:22.112704 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-46d95ffa-01dc-446f-956f-69a7195e9cf2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:22.113319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-46d95ffa-01dc-446f-956f-69a7195e9cf2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:22.263538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c5cddf11-d5fb-45eb-bcc7-20e3a0f415f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66746994c09d40edb7f51ca444b7a5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c39943d13c4455a8b7a18cce243d079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:22.271593 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c5cddf11-d5fb-45eb-bcc7-20e3a0f415f5 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 200 len: 1491 microversion: 2.1 time: 0.605070 Jul 25 12:45:22.280125 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 877/1846] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:21 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 1491 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:22.285382 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9c06da2f-6063-4277-b13f-a879b457a421 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:22.286421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9c06da2f-6063-4277-b13f-a879b457a421 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] [instance: d4033cef-23be-4f49-8c7b-0be4ebde362f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:22.304647 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c06da2f-6063-4277-b13f-a879b457a421 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:22.309395 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c06da2f-6063-4277-b13f-a879b457a421 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:22.310582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c06da2f-6063-4277-b13f-a879b457a421 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:22.311277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c06da2f-6063-4277-b13f-a879b457a421 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:22.476233 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9c06da2f-6063-4277-b13f-a879b457a421 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388a9972b4da47d7bda9fd36985eeb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f16e25c9f6f4845922175f67e5583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:22.484575 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9c06da2f-6063-4277-b13f-a879b457a421 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f" status: 200 len: 1326 microversion: 2.1 time: 0.202962 Jul 25 12:45:22.506201 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 878/1847] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:22 2022] GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f => generated 1326 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:22.511322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-fa92faca-b46e-42fc-b32e-01b6893afb8d req-13099f83-2560-4d80-b81a-b59322748274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4a19ea-699a-40fe-a620-9bf5305da67c", "name": "network-vif-deleted", "tag": "b1a768b8-dfe9-40eb-a595-524fadb9cb2c"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:22.532844 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fa92faca-b46e-42fc-b32e-01b6893afb8d req-13099f83-2560-4d80-b81a-b59322748274 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:22.545367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fa92faca-b46e-42fc-b32e-01b6893afb8d req-13099f83-2560-4d80-b81a-b59322748274 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:22.558028 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-fa92faca-b46e-42fc-b32e-01b6893afb8d req-13099f83-2560-4d80-b81a-b59322748274 service nova] Creating event network-vif-deleted:b1a768b8-dfe9-40eb-a595-524fadb9cb2c for instance 2d4a19ea-699a-40fe-a620-9bf5305da67c on n-h1-848886-15 Jul 25 12:45:22.575484 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-fa92faca-b46e-42fc-b32e-01b6893afb8d req-13099f83-2560-4d80-b81a-b59322748274 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067576 Jul 25 12:45:22.576851 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 879/1848] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:22.584533 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-da803e04-789f-4f70-939d-68567b9b2f3e tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:22.593867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-46d95ffa-01dc-446f-956f-69a7195e9cf2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:22.598607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-da803e04-789f-4f70-939d-68567b9b2f3e tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 21390510-6525-44f6-818a-225eacdd5953] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:22.603240 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-46d95ffa-01dc-446f-956f-69a7195e9cf2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949" status: 200 len: 1316 microversion: 2.1 time: 0.508965 Jul 25 12:45:22.605924 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 970/1849] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:22 2022] GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949 => generated 1316 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:22.611324 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da803e04-789f-4f70-939d-68567b9b2f3e tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:22.616644 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da803e04-789f-4f70-939d-68567b9b2f3e tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:22.617776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da803e04-789f-4f70-939d-68567b9b2f3e tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:22.618482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da803e04-789f-4f70-939d-68567b9b2f3e tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:22.672856 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-08c21dab-f1cb-435b-ab5c-4ee01947b4df tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:22.673806 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-08c21dab-f1cb-435b-ab5c-4ee01947b4df tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:22.682471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-08c21dab-f1cb-435b-ab5c-4ee01947b4df tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:22.688418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-08c21dab-f1cb-435b-ab5c-4ee01947b4df tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:22.689661 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-08c21dab-f1cb-435b-ab5c-4ee01947b4df tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:22.690384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-08c21dab-f1cb-435b-ab5c-4ee01947b4df tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:23.701177 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-08c21dab-f1cb-435b-ab5c-4ee01947b4df tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:23.747597 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-08c21dab-f1cb-435b-ab5c-4ee01947b4df tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 1.078385 Jul 25 12:45:23.754870 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 971/1850] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:22 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:45:23.779143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-da803e04-789f-4f70-939d-68567b9b2f3e tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:23.798161 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-da803e04-789f-4f70-939d-68567b9b2f3e tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953" status: 200 len: 1322 microversion: 2.1 time: 1.219412 Jul 25 12:45:23.811513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e5cc9b50-8d88-44b9-81e6-0c7b3a617ce8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:23.811513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e5cc9b50-8d88-44b9-81e6-0c7b3a617ce8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:23.824919 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 880/1851] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:22 2022] GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953 => generated 1322 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:23.835299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5cc9b50-8d88-44b9-81e6-0c7b3a617ce8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:23.837899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5cc9b50-8d88-44b9-81e6-0c7b3a617ce8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:23.840102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5cc9b50-8d88-44b9-81e6-0c7b3a617ce8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:23.841050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5cc9b50-8d88-44b9-81e6-0c7b3a617ce8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:23.845611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ca72c8de-8118-4cc2-9d84-32c9e7b5c4bb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:23.846892 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ca72c8de-8118-4cc2-9d84-32c9e7b5c4bb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:23.864014 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca72c8de-8118-4cc2-9d84-32c9e7b5c4bb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:23.865526 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca72c8de-8118-4cc2-9d84-32c9e7b5c4bb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:23.867724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca72c8de-8118-4cc2-9d84-32c9e7b5c4bb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:23.869954 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca72c8de-8118-4cc2-9d84-32c9e7b5c4bb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:23.937682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e5cc9b50-8d88-44b9-81e6-0c7b3a617ce8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:45:24.142577 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e5cc9b50-8d88-44b9-81e6-0c7b3a617ce8 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 204 len: 0 microversion: 2.25 time: 0.384405 Jul 25 12:45:24.143451 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 972/1852] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 12:45:23 2022] DELETE /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 12:45:24.160691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d4105823-bde9-4032-9a2d-98aa3849a649 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:24.162719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d4105823-bde9-4032-9a2d-98aa3849a649 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] [instance: 2d4a19ea-699a-40fe-a620-9bf5305da67c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:24.182939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d4105823-bde9-4032-9a2d-98aa3849a649 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:24.184833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d4105823-bde9-4032-9a2d-98aa3849a649 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:24.186574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d4105823-bde9-4032-9a2d-98aa3849a649 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:24.190367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d4105823-bde9-4032-9a2d-98aa3849a649 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:24.247197 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-d4105823-bde9-4032-9a2d-98aa3849a649 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] HTTP exception thrown: Instance 2d4a19ea-699a-40fe-a620-9bf5305da67c could not be found. Jul 25 12:45:24.248920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d4105823-bde9-4032-9a2d-98aa3849a649 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Request method failure captured: Jul 25 12:45:24.248920 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c HTTP/1.1 Jul 25 12:45:24.248920 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:45:24.248920 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:45:24.248920 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:45:24.248920 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:45:24.248920 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:45:24.248920 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:45:24.248920 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:45:24.248920 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:45:24.248920 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o_EqbWNiW5g4opC8XpJxaHr1ZOTj0XKCGsWqeMraj1bpkLcxrWlCTcB_x8pFpfnSObr4vKnxIJEsl2cW84rJd7RqU6DaT9dX5mpUTTWt2EciAHmWuYhLGYqNguoZK9EP9ZBWtsjQJw87GfIds1_MNWPp7A8he-EVHDWh7R4taNsdVE Jul 25 12:45:24.248920 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:45:24.248920 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:45:24.248920 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:45:24.248920 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:45:24.248920 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:45:24.248920 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:45:24.248920 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 7c39943d13c4455a8b7a18cce243d079 Jul 25 12:45:24.248920 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerRescueTestJSON-1832879746 Jul 25 12:45:24.248920 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:45:24.248920 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:45:24.250759 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7c39943d13c4455a8b7a18cce243d079", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7c39943d13c4455a8b7a18cce243d079"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c39943d13c4455a8b7a18cce243d079"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c39943d13c4455a8b7a18cce243d079"}]}] Jul 25 12:45:24.250759 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerRescueTestJSON-1832879746 Jul 25 12:45:24.250759 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 7c39943d13c4455a8b7a18cce243d079 Jul 25 12:45:24.250759 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerRescueTestJSON-1832879746 Jul 25 12:45:24.250759 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerRescueTestJSON-1832879746-project Jul 25 12:45:24.250759 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:45:24.250759 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:45:24.250759 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 66746994c09d40edb7f51ca444b7a5a7 Jul 25 12:45:24.250759 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerRescueTestJSON-1832879746-project Jul 25 12:45:24.250759 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:45:24.250759 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 2d4a19ea-699a-40fe-a620-9bf5305da67c could not be found. Jul 25 12:45:24.250759 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '2d4a19ea-699a-40fe-a620-9bf5305da67c'} Jul 25 12:45:24.251791 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:45:24.251791 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:24.251791 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:45:24.251791 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:45:24.251791 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:45:24.251791 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:45:24.251791 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:45:24.251791 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:45:24.251791 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:45:24.251791 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:45:24.251791 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d4a19ea-699a-40fe-a620-9bf5305da67c could not be found. Jul 25 12:45:24.251791 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:24.251791 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:24.251791 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:24.251791 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:24.251791 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:24.251791 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:24.251791 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:45:24.251791 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:45:24.251791 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:45:24.253411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:45:24.253411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:45:24.253411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:45:24.253411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:45:24.253411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:45:24.253411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:45:24.253411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:45:24.253411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d4a19ea-699a-40fe-a620-9bf5305da67c could not be found. Jul 25 12:45:24.253411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:24.253411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:24.253411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:24.253411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:24.253411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:24.253411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:24.253411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:45:24.253411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:45:24.253411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d4a19ea-699a-40fe-a620-9bf5305da67c could not be found. Jul 25 12:45:24.253411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:24.260100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d4105823-bde9-4032-9a2d-98aa3849a649 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] Returning 404 to user: Instance 2d4a19ea-699a-40fe-a620-9bf5305da67c could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:45:24.260991 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d4105823-bde9-4032-9a2d-98aa3849a649 tempest-ServerRescueTestJSON-1832879746 tempest-ServerRescueTestJSON-1832879746-project] 10.222.0.49 "GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c" status: 404 len: 111 microversion: 2.1 time: 0.115968 Jul 25 12:45:24.261555 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 973/1853] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:24 2022] GET /compute/v2.1/servers/2d4a19ea-699a-40fe-a620-9bf5305da67c => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:45:24.285941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8583b712-f3c5-442f-81c6-5b329c250f70 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:24.286766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8583b712-f3c5-442f-81c6-5b329c250f70 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] [instance: d4033cef-23be-4f49-8c7b-0be4ebde362f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:24.295608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8583b712-f3c5-442f-81c6-5b329c250f70 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:24.296729 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8583b712-f3c5-442f-81c6-5b329c250f70 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:24.298663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8583b712-f3c5-442f-81c6-5b329c250f70 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:24.299867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8583b712-f3c5-442f-81c6-5b329c250f70 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:24.452808 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ca72c8de-8118-4cc2-9d84-32c9e7b5c4bb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:24.464119 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ca72c8de-8118-4cc2-9d84-32c9e7b5c4bb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1477 microversion: 2.1 time: 0.637427 Jul 25 12:45:24.466177 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 881/1854] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:23 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1477 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:24.489450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4ee8f28a-f750-4697-bde5-58fcaed2bad6 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:24.490782 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4ee8f28a-f750-4697-bde5-58fcaed2bad6 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:24.517787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ee8f28a-f750-4697-bde5-58fcaed2bad6 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:24.518976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ee8f28a-f750-4697-bde5-58fcaed2bad6 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:24.520086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ee8f28a-f750-4697-bde5-58fcaed2bad6 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:24.521291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ee8f28a-f750-4697-bde5-58fcaed2bad6 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:24.722938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8583b712-f3c5-442f-81c6-5b329c250f70 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388a9972b4da47d7bda9fd36985eeb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f16e25c9f6f4845922175f67e5583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:24.732856 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8583b712-f3c5-442f-81c6-5b329c250f70 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f" status: 200 len: 1394 microversion: 2.1 time: 0.462816 Jul 25 12:45:24.733497 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 974/1855] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:24 2022] GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f => generated 1394 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:24.751025 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-508bb285-fc93-4e96-a175-fe565679fb99 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:24.751905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-508bb285-fc93-4e96-a175-fe565679fb99 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:24.763377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-508bb285-fc93-4e96-a175-fe565679fb99 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:24.764178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-508bb285-fc93-4e96-a175-fe565679fb99 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:24.765140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-508bb285-fc93-4e96-a175-fe565679fb99 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:24.765901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-508bb285-fc93-4e96-a175-fe565679fb99 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:25.385080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4ee8f28a-f750-4697-bde5-58fcaed2bad6 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:25.394232 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4ee8f28a-f750-4697-bde5-58fcaed2bad6 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949" status: 200 len: 1316 microversion: 2.1 time: 0.926603 Jul 25 12:45:25.394907 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 882/1856] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:24 2022] GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949 => generated 1316 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:25.400242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-567cd4d5-80ec-42e2-b50a-f03a1b70593a req-4e4f74a0-a38e-476f-b9de-35a26f78d6cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "791ea14d-3fa9-4be1-afc1-82c8908395f4", "name": "network-vif-unplugged", "status": "completed", "tag": "0f801405-35d3-471d-9010-4dc3d6d5eec1"}, {"name": "network-changed", "server_uuid": "791ea14d-3fa9-4be1-afc1-82c8908395f4", "tag": "0f801405-35d3-471d-9010-4dc3d6d5eec1"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:25.410460 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-567cd4d5-80ec-42e2-b50a-f03a1b70593a req-4e4f74a0-a38e-476f-b9de-35a26f78d6cc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:25.410995 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-567cd4d5-80ec-42e2-b50a-f03a1b70593a req-4e4f74a0-a38e-476f-b9de-35a26f78d6cc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:25.414177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:25.424649 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-567cd4d5-80ec-42e2-b50a-f03a1b70593a req-4e4f74a0-a38e-476f-b9de-35a26f78d6cc service nova] Creating event network-vif-unplugged:0f801405-35d3-471d-9010-4dc3d6d5eec1 for instance 791ea14d-3fa9-4be1-afc1-82c8908395f4 on n-h1-848886-15 Jul 25 12:45:25.425241 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-567cd4d5-80ec-42e2-b50a-f03a1b70593a req-4e4f74a0-a38e-476f-b9de-35a26f78d6cc service nova] Creating event network-changed:0f801405-35d3-471d-9010-4dc3d6d5eec1 for instance 791ea14d-3fa9-4be1-afc1-82c8908395f4 on n-h1-848886-15 Jul 25 12:45:25.430416 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-567cd4d5-80ec-42e2-b50a-f03a1b70593a req-4e4f74a0-a38e-476f-b9de-35a26f78d6cc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.034104 Jul 25 12:45:25.431391 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 883/1857] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:25.436767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8efe621f-d538-4312-843a-b5f54ab9f449 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:25.437572 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8efe621f-d538-4312-843a-b5f54ab9f449 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:25.444626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8efe621f-d538-4312-843a-b5f54ab9f449 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:25.445155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8efe621f-d538-4312-843a-b5f54ab9f449 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:25.446055 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8efe621f-d538-4312-843a-b5f54ab9f449 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:25.446618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8efe621f-d538-4312-843a-b5f54ab9f449 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:25.475010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-508bb285-fc93-4e96-a175-fe565679fb99 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:25.484403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-508bb285-fc93-4e96-a175-fe565679fb99 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:25.486325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-508bb285-fc93-4e96-a175-fe565679fb99 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:25.487825 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-508bb285-fc93-4e96-a175-fe565679fb99 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1728 microversion: 2.25 time: 0.740830 Jul 25 12:45:25.488612 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 975/1858] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:24 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1728 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:25.493757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-153a5a86-7d21-4774-a32f-a91d8cd55814 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:25.494696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-153a5a86-7d21-4774-a32f-a91d8cd55814 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 21390510-6525-44f6-818a-225eacdd5953] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:25.501057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-153a5a86-7d21-4774-a32f-a91d8cd55814 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:25.501751 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-153a5a86-7d21-4774-a32f-a91d8cd55814 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:25.502885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-153a5a86-7d21-4774-a32f-a91d8cd55814 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:25.503821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-153a5a86-7d21-4774-a32f-a91d8cd55814 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:25.936938 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8efe621f-d538-4312-843a-b5f54ab9f449 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:25.945953 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8efe621f-d538-4312-843a-b5f54ab9f449 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 0.513082 Jul 25 12:45:25.959815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-153a5a86-7d21-4774-a32f-a91d8cd55814 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:25.960853 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 884/1859] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:25 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:25.966809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-68c811ab-c279-479e-82a0-97eda682c81b req-ffe45bd5-95d3-437b-8f7d-ae11b599cc26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6bb4f7e-67c3-4c86-8e69-92fd4061e26d", "name": "network-vif-unplugged", "status": "completed", "tag": "b55028ef-4d91-4ac2-a60c-3406cbca7db4"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:25.978143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-68c811ab-c279-479e-82a0-97eda682c81b req-ffe45bd5-95d3-437b-8f7d-ae11b599cc26 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:25.978918 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-68c811ab-c279-479e-82a0-97eda682c81b req-ffe45bd5-95d3-437b-8f7d-ae11b599cc26 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:25.984804 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-153a5a86-7d21-4774-a32f-a91d8cd55814 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953" status: 200 len: 1322 microversion: 2.1 time: 0.494950 Jul 25 12:45:25.985718 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 976/1860] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:25 2022] GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953 => generated 1322 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:26.011395 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-68c811ab-c279-479e-82a0-97eda682c81b req-ffe45bd5-95d3-437b-8f7d-ae11b599cc26 service nova] Creating event network-vif-unplugged:b55028ef-4d91-4ac2-a60c-3406cbca7db4 for instance c6bb4f7e-67c3-4c86-8e69-92fd4061e26d on n-h2-848886-15 Jul 25 12:45:26.021958 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-68c811ab-c279-479e-82a0-97eda682c81b req-ffe45bd5-95d3-437b-8f7d-ae11b599cc26 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059444 Jul 25 12:45:26.023782 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 885/1861] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:26.041179 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c95ee29b-4561-4f5e-99d0-d568fc6126d2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:26.042280 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c95ee29b-4561-4f5e-99d0-d568fc6126d2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:26.065810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c95ee29b-4561-4f5e-99d0-d568fc6126d2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:26.066559 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c95ee29b-4561-4f5e-99d0-d568fc6126d2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:26.076300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c95ee29b-4561-4f5e-99d0-d568fc6126d2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:26.077193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c95ee29b-4561-4f5e-99d0-d568fc6126d2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:26.285784 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5fd961bc-45ff-4018-ac01-b48b6d26d110 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Action: 'create', calling method: .version_select at 0x7efcf92fe040>, body: {"keypair": {"name": "tempest-keypair-897657228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8zJ9IW16tV32eZiYEMGMKuTGwQ1KkvDW+qMMtkb4Wc4KKk5zBt2I1ZvwZKcdpfuznRVc7SqRs+SZhXkITWZ+endE8uxpGr+EKKeseePP2enr7zPSouu98c7OS/GahQ4g=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:26.324870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-5fd961bc-45ff-4018-ac01-b48b6d26d110 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Getting quotas for project a59f31c830d544129310056d267f465c. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:45:26.334954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-5fd961bc-45ff-4018-ac01-b48b6d26d110 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Getting quotas for user 929ae21affaf4eb9b8eba955745aa751 and project a59f31c830d544129310056d267f465c. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:45:26.380179 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5fd961bc-45ff-4018-ac01-b48b6d26d110 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.392155 Jul 25 12:45:26.380807 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 977/1862] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:45:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:26.399739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4e28d1bf-c356-4dde-af77-7df43d38e293 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:26.401082 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4e28d1bf-c356-4dde-af77-7df43d38e293 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] [instance: d4033cef-23be-4f49-8c7b-0be4ebde362f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:26.412607 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e28d1bf-c356-4dde-af77-7df43d38e293 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:26.413442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e28d1bf-c356-4dde-af77-7df43d38e293 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:26.414968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e28d1bf-c356-4dde-af77-7df43d38e293 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:26.417291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e28d1bf-c356-4dde-af77-7df43d38e293 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:26.655657 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c95ee29b-4561-4f5e-99d0-d568fc6126d2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:26.663946 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c95ee29b-4561-4f5e-99d0-d568fc6126d2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1477 microversion: 2.1 time: 0.637822 Jul 25 12:45:26.685168 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 886/1863] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:26 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1477 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:26.692713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a080705f-61ff-4426-b425-5b5f97140b33 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:26.693338 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a080705f-61ff-4426-b425-5b5f97140b33 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:26.712121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a080705f-61ff-4426-b425-5b5f97140b33 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:26.713002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a080705f-61ff-4426-b425-5b5f97140b33 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:26.716469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a080705f-61ff-4426-b425-5b5f97140b33 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:26.717291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a080705f-61ff-4426-b425-5b5f97140b33 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:26.895226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:26.917547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=20 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:27.045580 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4e28d1bf-c356-4dde-af77-7df43d38e293 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388a9972b4da47d7bda9fd36985eeb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f16e25c9f6f4845922175f67e5583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:27.063564 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4e28d1bf-c356-4dde-af77-7df43d38e293 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f" status: 200 len: 1394 microversion: 2.1 time: 0.675508 Jul 25 12:45:27.077122 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 978/1864] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:26 2022] GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f => generated 1394 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:27.077122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fbe6b5cb-78da-4e64-87c5-21c7d499a0ca tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:27.077122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fbe6b5cb-78da-4e64-87c5-21c7d499a0ca tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:27.081536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fbe6b5cb-78da-4e64-87c5-21c7d499a0ca tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:27.082344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fbe6b5cb-78da-4e64-87c5-21c7d499a0ca tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:27.084072 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fbe6b5cb-78da-4e64-87c5-21c7d499a0ca tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:27.084686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fbe6b5cb-78da-4e64-87c5-21c7d499a0ca tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:27.164341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fbe6b5cb-78da-4e64-87c5-21c7d499a0ca tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:27.164996 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fbe6b5cb-78da-4e64-87c5-21c7d499a0ca tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:27.165616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-fbe6b5cb-78da-4e64-87c5-21c7d499a0ca tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lazy-loading 'fault' on Instance uuid c18f0b76-5dab-4e09-afb8-8a1de682b042 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:45:27.253732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a080705f-61ff-4426-b425-5b5f97140b33 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:27.269997 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a080705f-61ff-4426-b425-5b5f97140b33 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949" status: 200 len: 1316 microversion: 2.1 time: 0.578832 Jul 25 12:45:27.278506 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 887/1865] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:26 2022] GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949 => generated 1316 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:27.306683 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-089fd8a8-35cf-45bc-a4a0-6d238c501e2d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:27.321655 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fbe6b5cb-78da-4e64-87c5-21c7d499a0ca tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:27.328030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-089fd8a8-35cf-45bc-a4a0-6d238c501e2d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:27.336716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fbe6b5cb-78da-4e64-87c5-21c7d499a0ca tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:27.342594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fbe6b5cb-78da-4e64-87c5-21c7d499a0ca tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:27.348121 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fbe6b5cb-78da-4e64-87c5-21c7d499a0ca tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 200 len: 1374 microversion: 2.25 time: 0.279890 Jul 25 12:45:27.350515 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 979/1866] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:27 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 1374 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:27.352209 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-089fd8a8-35cf-45bc-a4a0-6d238c501e2d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:27.354813 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-089fd8a8-35cf-45bc-a4a0-6d238c501e2d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:27.356650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-089fd8a8-35cf-45bc-a4a0-6d238c501e2d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:27.360836 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-089fd8a8-35cf-45bc-a4a0-6d238c501e2d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:27.366615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-14ea96c3-d382-4a7e-8384-151dac679273 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:27.369175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-14ea96c3-d382-4a7e-8384-151dac679273 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 21390510-6525-44f6-818a-225eacdd5953] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:27.394144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14ea96c3-d382-4a7e-8384-151dac679273 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:27.395411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14ea96c3-d382-4a7e-8384-151dac679273 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:27.396381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14ea96c3-d382-4a7e-8384-151dac679273 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:27.397136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14ea96c3-d382-4a7e-8384-151dac679273 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:28.356265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-089fd8a8-35cf-45bc-a4a0-6d238c501e2d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:28.376666 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-089fd8a8-35cf-45bc-a4a0-6d238c501e2d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 1.093896 Jul 25 12:45:28.379173 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 888/1867] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:27 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:28.401665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-11b872cd-48ff-488b-b884-99a1a2fe5863 req-747574fc-0999-4c9f-8e3a-61d6d089f57c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4033cef-23be-4f49-8c7b-0be4ebde362f", "tag": "a89273b4-19ae-401f-9b9d-63eac14ed636"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:28.429740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-11b872cd-48ff-488b-b884-99a1a2fe5863 req-747574fc-0999-4c9f-8e3a-61d6d089f57c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:28.430564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-11b872cd-48ff-488b-b884-99a1a2fe5863 req-747574fc-0999-4c9f-8e3a-61d6d089f57c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:28.445417 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-14ea96c3-d382-4a7e-8384-151dac679273 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:28.455024 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-14ea96c3-d382-4a7e-8384-151dac679273 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953" status: 200 len: 1322 microversion: 2.1 time: 1.103255 Jul 25 12:45:28.457494 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-11b872cd-48ff-488b-b884-99a1a2fe5863 req-747574fc-0999-4c9f-8e3a-61d6d089f57c service nova] Creating event network-changed:a89273b4-19ae-401f-9b9d-63eac14ed636 for instance d4033cef-23be-4f49-8c7b-0be4ebde362f on n-h2-848886-15 Jul 25 12:45:28.460984 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 980/1868] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:27 2022] GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953 => generated 1322 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:28.464796 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-11b872cd-48ff-488b-b884-99a1a2fe5863 req-747574fc-0999-4c9f-8e3a-61d6d089f57c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082438 Jul 25 12:45:28.467253 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 889/1869] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:28.471385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-5c038750-c543-4345-a5ab-1e83a450f590 req-b678639e-3091-4498-acde-b35479eb3080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c18f0b76-5dab-4e09-afb8-8a1de682b042", "name": "network-vif-deleted", "tag": "b5d54db2-13f2-41e6-b4fa-4d037fc2e51e"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:28.477903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6d69b1cb-a021-405a-960b-24b3ae88f52e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:28.479016 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6d69b1cb-a021-405a-960b-24b3ae88f52e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:28.486967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5c038750-c543-4345-a5ab-1e83a450f590 req-b678639e-3091-4498-acde-b35479eb3080 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:28.488474 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6d69b1cb-a021-405a-960b-24b3ae88f52e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:28.489353 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6d69b1cb-a021-405a-960b-24b3ae88f52e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:28.489541 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5c038750-c543-4345-a5ab-1e83a450f590 req-b678639e-3091-4498-acde-b35479eb3080 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:28.491188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6d69b1cb-a021-405a-960b-24b3ae88f52e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:28.491905 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6d69b1cb-a021-405a-960b-24b3ae88f52e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:28.505888 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-5c038750-c543-4345-a5ab-1e83a450f590 req-b678639e-3091-4498-acde-b35479eb3080 service nova] Creating event network-vif-deleted:b5d54db2-13f2-41e6-b4fa-4d037fc2e51e for instance c18f0b76-5dab-4e09-afb8-8a1de682b042 on n-h2-848886-15 Jul 25 12:45:28.512228 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-5c038750-c543-4345-a5ab-1e83a450f590 req-b678639e-3091-4498-acde-b35479eb3080 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049985 Jul 25 12:45:28.513498 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 981/1870] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:28.520138 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-287acf32-c290-4b86-98bf-4bbf2f475f29 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:28.521127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-287acf32-c290-4b86-98bf-4bbf2f475f29 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] [instance: d4033cef-23be-4f49-8c7b-0be4ebde362f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:28.529329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-287acf32-c290-4b86-98bf-4bbf2f475f29 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:28.530253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-287acf32-c290-4b86-98bf-4bbf2f475f29 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:28.531350 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-287acf32-c290-4b86-98bf-4bbf2f475f29 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:28.532010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-287acf32-c290-4b86-98bf-4bbf2f475f29 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:28.895822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6d69b1cb-a021-405a-960b-24b3ae88f52e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:28.904623 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6d69b1cb-a021-405a-960b-24b3ae88f52e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1477 microversion: 2.1 time: 0.435759 Jul 25 12:45:28.918704 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 890/1871] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:28 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1477 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:28.923925 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-adce8c29-fb7c-40de-ac84-d46081b5cffb req-b54c9c96-5355-4960-bc85-cb71e6362017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6bb4f7e-67c3-4c86-8e69-92fd4061e26d", "name": "network-vif-plugged", "status": "completed", "tag": "b55028ef-4d91-4ac2-a60c-3406cbca7db4"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:28.946240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-adce8c29-fb7c-40de-ac84-d46081b5cffb req-b54c9c96-5355-4960-bc85-cb71e6362017 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:28.947007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-adce8c29-fb7c-40de-ac84-d46081b5cffb req-b54c9c96-5355-4960-bc85-cb71e6362017 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:28.964382 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-adce8c29-fb7c-40de-ac84-d46081b5cffb req-b54c9c96-5355-4960-bc85-cb71e6362017 service nova] Creating event network-vif-plugged:b55028ef-4d91-4ac2-a60c-3406cbca7db4 for instance c6bb4f7e-67c3-4c86-8e69-92fd4061e26d on n-h2-848886-15 Jul 25 12:45:28.977356 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-adce8c29-fb7c-40de-ac84-d46081b5cffb req-b54c9c96-5355-4960-bc85-cb71e6362017 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057091 Jul 25 12:45:28.978312 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 891/1872] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:28.989156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-54682804-8c70-451f-8e44-a5f05172d169 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:29.000854 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-54682804-8c70-451f-8e44-a5f05172d169 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:29.008420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54682804-8c70-451f-8e44-a5f05172d169 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:29.009152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54682804-8c70-451f-8e44-a5f05172d169 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:29.010186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54682804-8c70-451f-8e44-a5f05172d169 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:29.010779 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54682804-8c70-451f-8e44-a5f05172d169 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:29.055045 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-287acf32-c290-4b86-98bf-4bbf2f475f29 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388a9972b4da47d7bda9fd36985eeb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f16e25c9f6f4845922175f67e5583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:29.069455 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-287acf32-c290-4b86-98bf-4bbf2f475f29 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f" status: 200 len: 1394 microversion: 2.1 time: 0.554077 Jul 25 12:45:29.073236 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 982/1873] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:28 2022] GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f => generated 1394 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:29.084214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6db26d49-9a9c-4d07-ae18-f1af7cdc2288 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:29.085073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6db26d49-9a9c-4d07-ae18-f1af7cdc2288 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: c18f0b76-5dab-4e09-afb8-8a1de682b042] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:29.101991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6db26d49-9a9c-4d07-ae18-f1af7cdc2288 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:29.102317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6db26d49-9a9c-4d07-ae18-f1af7cdc2288 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:29.103678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6db26d49-9a9c-4d07-ae18-f1af7cdc2288 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:29.104132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6db26d49-9a9c-4d07-ae18-f1af7cdc2288 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:29.150036 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-6db26d49-9a9c-4d07-ae18-f1af7cdc2288 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] HTTP exception thrown: Instance c18f0b76-5dab-4e09-afb8-8a1de682b042 could not be found. Jul 25 12:45:29.152831 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6db26d49-9a9c-4d07-ae18-f1af7cdc2288 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Request method failure captured: Jul 25 12:45:29.152831 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 HTTP/1.1 Jul 25 12:45:29.152831 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:45:29.152831 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:45:29.152831 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:45:29.152831 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:45:29.152831 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:45:29.152831 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:45:29.152831 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:45:29.152831 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:45:29.152831 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o7Cd_8Lqp-0wEwAl8ClXlh_AIOMu3nTsYHwSfoINOAYpM9tKluLVBmtXxrBiVPCdhUkTyHT7iRks30CtQftHX9B2A5Biu0tF7UKx0LS0U7Z4vHIrZWCBQHnd32ujvJYompMUMG4hPPK6j9Oq9zHao-IAqdAE-XzANFWpF3FSd7pbYQ Jul 25 12:45:29.152831 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:45:29.152831 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:45:29.152831 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:45:29.152831 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:45:29.152831 n-d-848886-15 devstack@n-api.service[125884]: X-Openstack-Nova-Api-Version: 2.25 Jul 25 12:45:29.152831 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:45:29.152831 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:45:29.152831 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: bdce4da5878543a4a609dc35e389763c Jul 25 12:45:29.152831 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1761396001 Jul 25 12:45:29.152831 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:45:29.152831 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:45:29.154617 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bdce4da5878543a4a609dc35e389763c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bdce4da5878543a4a609dc35e389763c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bdce4da5878543a4a609dc35e389763c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bdce4da5878543a4a609dc35e389763c"}]}] Jul 25 12:45:29.154617 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1761396001 Jul 25 12:45:29.154617 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: bdce4da5878543a4a609dc35e389763c Jul 25 12:45:29.154617 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1761396001 Jul 25 12:45:29.154617 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-LiveAutoBlockMigrationV225Test-1761396001-project Jul 25 12:45:29.154617 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:45:29.154617 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:45:29.154617 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: fa79a472f31b4e8eb0a6ad709bc84c01 Jul 25 12:45:29.154617 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1761396001-project Jul 25 12:45:29.154617 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:45:29.154617 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance c18f0b76-5dab-4e09-afb8-8a1de682b042 could not be found. Jul 25 12:45:29.154617 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'c18f0b76-5dab-4e09-afb8-8a1de682b042'} Jul 25 12:45:29.155773 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:45:29.155773 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:29.155773 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:45:29.155773 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:45:29.155773 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:45:29.155773 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:45:29.155773 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:45:29.155773 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:45:29.155773 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:45:29.155773 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:45:29.155773 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c18f0b76-5dab-4e09-afb8-8a1de682b042 could not be found. Jul 25 12:45:29.155773 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:29.155773 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:29.155773 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:29.155773 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:29.155773 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:29.155773 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:29.155773 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:45:29.155773 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:45:29.155773 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:45:29.157404 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:45:29.157404 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:45:29.157404 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:45:29.157404 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:45:29.157404 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:45:29.157404 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:45:29.157404 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:45:29.157404 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c18f0b76-5dab-4e09-afb8-8a1de682b042 could not be found. Jul 25 12:45:29.157404 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:29.157404 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:29.157404 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:29.157404 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:29.157404 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:29.157404 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:29.157404 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:45:29.157404 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:45:29.157404 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c18f0b76-5dab-4e09-afb8-8a1de682b042 could not be found. Jul 25 12:45:29.157404 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:29.159581 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6db26d49-9a9c-4d07-ae18-f1af7cdc2288 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Returning 404 to user: Instance c18f0b76-5dab-4e09-afb8-8a1de682b042 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:45:29.165924 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6db26d49-9a9c-4d07-ae18-f1af7cdc2288 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042" status: 404 len: 111 microversion: 2.25 time: 0.091325 Jul 25 12:45:29.166997 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 983/1874] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:29 2022] GET /compute/v2.1/servers/c18f0b76-5dab-4e09-afb8-8a1de682b042 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:45:29.177295 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6e16c9b9-ebc4-441e-a3ea-cb3e040984af tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '.version_select at 0x7efcf93344c0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:29.229700 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6e16c9b9-ebc4-441e-a3ea-cb3e040984af tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-873107585" status: 204 len: 0 microversion: 2.25 time: 0.058419 Jul 25 12:45:29.234214 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 984/1875] 10.222.0.49 () {60 vars in 1259 bytes} [Mon Jul 25 12:45:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-873107585 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 12:45:29.332329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-54682804-8c70-451f-8e44-a5f05172d169 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:29.341111 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-54682804-8c70-451f-8e44-a5f05172d169 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949" status: 200 len: 1316 microversion: 2.1 time: 0.361409 Jul 25 12:45:29.353769 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 892/1876] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:28 2022] GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949 => generated 1316 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:29.405040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-96227be0-bc0e-42c4-8a80-e33973cb6788 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:29.405979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-96227be0-bc0e-42c4-8a80-e33973cb6788 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:29.425636 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-96227be0-bc0e-42c4-8a80-e33973cb6788 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:29.426125 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-96227be0-bc0e-42c4-8a80-e33973cb6788 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:29.426901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-96227be0-bc0e-42c4-8a80-e33973cb6788 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:29.427342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-96227be0-bc0e-42c4-8a80-e33973cb6788 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:29.456490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:29.489090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e019c3b7-fc9a-41f9-9d07-f1fb02719a68 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:29.492077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e019c3b7-fc9a-41f9-9d07-f1fb02719a68 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 21390510-6525-44f6-818a-225eacdd5953] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:29.517111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e019c3b7-fc9a-41f9-9d07-f1fb02719a68 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:29.518004 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e019c3b7-fc9a-41f9-9d07-f1fb02719a68 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:29.518978 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e019c3b7-fc9a-41f9-9d07-f1fb02719a68 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:29.519581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e019c3b7-fc9a-41f9-9d07-f1fb02719a68 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:29.863683 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-96227be0-bc0e-42c4-8a80-e33973cb6788 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:29.872187 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e019c3b7-fc9a-41f9-9d07-f1fb02719a68 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:29.875795 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-96227be0-bc0e-42c4-8a80-e33973cb6788 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 0.476137 Jul 25 12:45:29.889515 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 985/1877] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:29 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:29.905884 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e019c3b7-fc9a-41f9-9d07-f1fb02719a68 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953" status: 200 len: 1322 microversion: 2.1 time: 0.426923 Jul 25 12:45:29.921629 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 893/1878] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:29 2022] GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953 => generated 1322 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:29.949258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-87651fd3-84b2-4f25-8dc5-8f677f1d85ad tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:29.950770 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-87651fd3-84b2-4f25-8dc5-8f677f1d85ad tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:29.963011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87651fd3-84b2-4f25-8dc5-8f677f1d85ad tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:29.968631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87651fd3-84b2-4f25-8dc5-8f677f1d85ad tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:29.969876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87651fd3-84b2-4f25-8dc5-8f677f1d85ad tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:29.972270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87651fd3-84b2-4f25-8dc5-8f677f1d85ad tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:30.098546 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b739c638-2346-4a76-858e-743b225510dc tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:30.099870 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b739c638-2346-4a76-858e-743b225510dc tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] [instance: d4033cef-23be-4f49-8c7b-0be4ebde362f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:30.108329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b739c638-2346-4a76-858e-743b225510dc tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:30.109379 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b739c638-2346-4a76-858e-743b225510dc tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:30.110658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b739c638-2346-4a76-858e-743b225510dc tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:30.111937 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b739c638-2346-4a76-858e-743b225510dc tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:30.444888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-87651fd3-84b2-4f25-8dc5-8f677f1d85ad tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:30.455419 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-87651fd3-84b2-4f25-8dc5-8f677f1d85ad tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1477 microversion: 2.1 time: 0.511760 Jul 25 12:45:30.480732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b739c638-2346-4a76-858e-743b225510dc tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388a9972b4da47d7bda9fd36985eeb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f16e25c9f6f4845922175f67e5583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:30.491604 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 986/1879] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:29 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1477 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:30.495874 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b739c638-2346-4a76-858e-743b225510dc tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f" status: 200 len: 1394 microversion: 2.1 time: 0.405577 Jul 25 12:45:30.496234 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 894/1880] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:30 2022] GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f => generated 1394 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:45:30.503015 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7e7d349c-8e76-47a2-8761-565356cbf4a5 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1001082515", "imageRef": "3033e421-cdbd-45f6-9177-244352644aaa", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b68ce935-16e7-4542-adf4-2bf859f9880f"}], "security_groups": [{"name": "tempest-securitygroup--1449465796"}], "key_name": "tempest-keypair-897657228", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:30.543050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-10fffa99-ce40-4869-83a3-4abea2e84351 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:30.544287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-10fffa99-ce40-4869-83a3-4abea2e84351 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:30.566298 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10fffa99-ce40-4869-83a3-4abea2e84351 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:30.569471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10fffa99-ce40-4869-83a3-4abea2e84351 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:30.570558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10fffa99-ce40-4869-83a3-4abea2e84351 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:30.571240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10fffa99-ce40-4869-83a3-4abea2e84351 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:30.881636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-7e7d349c-8e76-47a2-8761-565356cbf4a5 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] validate_networks() for [('b68ce935-16e7-4542-adf4-2bf859f9880f', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:45:31.151400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-10fffa99-ce40-4869-83a3-4abea2e84351 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:31.160483 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-10fffa99-ce40-4869-83a3-4abea2e84351 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949" status: 200 len: 1316 microversion: 2.1 time: 0.657527 Jul 25 12:45:31.161606 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 987/1881] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:30 2022] GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949 => generated 1316 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:31.166251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aa25ea26-ebbd-484c-a7b2-b77b2aeec405 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:31.167049 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-aa25ea26-ebbd-484c-a7b2-b77b2aeec405 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:31.173234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa25ea26-ebbd-484c-a7b2-b77b2aeec405 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:31.173913 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa25ea26-ebbd-484c-a7b2-b77b2aeec405 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:31.174925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa25ea26-ebbd-484c-a7b2-b77b2aeec405 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:31.175515 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa25ea26-ebbd-484c-a7b2-b77b2aeec405 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:31.645876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-aa25ea26-ebbd-484c-a7b2-b77b2aeec405 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:31.655168 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-aa25ea26-ebbd-484c-a7b2-b77b2aeec405 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 0.492267 Jul 25 12:45:31.656479 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 988/1882] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:31 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:31.661484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-85891b76-c1c3-4099-9f1e-bd152dcda1e2 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:31.662287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-85891b76-c1c3-4099-9f1e-bd152dcda1e2 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 21390510-6525-44f6-818a-225eacdd5953] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:31.668462 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85891b76-c1c3-4099-9f1e-bd152dcda1e2 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:31.669041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85891b76-c1c3-4099-9f1e-bd152dcda1e2 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:31.670101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85891b76-c1c3-4099-9f1e-bd152dcda1e2 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:31.670651 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85891b76-c1c3-4099-9f1e-bd152dcda1e2 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:32.235559 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-85891b76-c1c3-4099-9f1e-bd152dcda1e2 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:32.245860 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-85891b76-c1c3-4099-9f1e-bd152dcda1e2 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953" status: 200 len: 1322 microversion: 2.1 time: 0.587633 Jul 25 12:45:32.246518 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 989/1883] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:31 2022] GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953 => generated 1322 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:32.251418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-e0c81088-7a87-4fda-a1f6-8f99d3f8e45b req-174b46be-82d1-4f66-a109-2344d0986f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21390510-6525-44f6-818a-225eacdd5953", "name": "network-vif-plugged", "status": "completed", "tag": "ab6ba094-9ede-486e-b9bb-483f805db9da"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:32.260966 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e0c81088-7a87-4fda-a1f6-8f99d3f8e45b req-174b46be-82d1-4f66-a109-2344d0986f38 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:32.261707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e0c81088-7a87-4fda-a1f6-8f99d3f8e45b req-174b46be-82d1-4f66-a109-2344d0986f38 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:32.275402 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-7e7d349c-8e76-47a2-8761-565356cbf4a5 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:45:32.276504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-7e7d349c-8e76-47a2-8761-565356cbf4a5 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:45:32.277793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-7e7d349c-8e76-47a2-8761-565356cbf4a5 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:45:32.278391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-7e7d349c-8e76-47a2-8761-565356cbf4a5 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:45:32.279835 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-7e7d349c-8e76-47a2-8761-565356cbf4a5 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:45:32.283451 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-e0c81088-7a87-4fda-a1f6-8f99d3f8e45b req-174b46be-82d1-4f66-a109-2344d0986f38 service nova] Creating event network-vif-plugged:ab6ba094-9ede-486e-b9bb-483f805db9da for instance 21390510-6525-44f6-818a-225eacdd5953 on n-h1-848886-15 Jul 25 12:45:32.288970 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-e0c81088-7a87-4fda-a1f6-8f99d3f8e45b req-174b46be-82d1-4f66-a109-2344d0986f38 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040824 Jul 25 12:45:32.290128 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 990/1884] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:32.295411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4efd621b-f11d-4288-9b8a-a9de54541f00 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:32.296053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e7d349c-8e76-47a2-8761-565356cbf4a5 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:32.296275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4efd621b-f11d-4288-9b8a-a9de54541f00 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:32.298290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e7d349c-8e76-47a2-8761-565356cbf4a5 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:32.299298 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e7d349c-8e76-47a2-8761-565356cbf4a5 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:32.300683 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e7d349c-8e76-47a2-8761-565356cbf4a5 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:32.302052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:32.304016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4efd621b-f11d-4288-9b8a-a9de54541f00 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:32.304685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4efd621b-f11d-4288-9b8a-a9de54541f00 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:32.305862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4efd621b-f11d-4288-9b8a-a9de54541f00 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:32.306388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4efd621b-f11d-4288-9b8a-a9de54541f00 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:32.339469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4efd621b-f11d-4288-9b8a-a9de54541f00 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:45:32.353992 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-7e7d349c-8e76-47a2-8761-565356cbf4a5 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Getting quotas for project a59f31c830d544129310056d267f465c. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:45:32.363329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-7e7d349c-8e76-47a2-8761-565356cbf4a5 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Getting quotas for user 929ae21affaf4eb9b8eba955745aa751 and project a59f31c830d544129310056d267f465c. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:45:32.379951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:32.381978 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7e7d349c-8e76-47a2-8761-565356cbf4a5 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:45:32.384816 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7e7d349c-8e76-47a2-8761-565356cbf4a5 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3033e421-cdbd-45f6-9177-244352644aaa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:45:32.451493 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4efd621b-f11d-4288-9b8a-a9de54541f00 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "DELETE /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 204 len: 0 microversion: 2.25 time: 0.159857 Jul 25 12:45:32.453512 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 991/1885] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 12:45:32 2022] DELETE /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 12:45:32.461057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-53cd594f-5832-4679-b98f-28ce724b14d1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:32.463238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-53cd594f-5832-4679-b98f-28ce724b14d1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:32.475233 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53cd594f-5832-4679-b98f-28ce724b14d1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:32.476059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53cd594f-5832-4679-b98f-28ce724b14d1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:32.477297 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53cd594f-5832-4679-b98f-28ce724b14d1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:32.478680 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53cd594f-5832-4679-b98f-28ce724b14d1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:32.487955 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7e7d349c-8e76-47a2-8761-565356cbf4a5 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.987154 Jul 25 12:45:32.492534 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 895/1886] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:45:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:45:32.504846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-16eda388-94de-4080-94e1-332d41f9d713 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:32.505391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-16eda388-94de-4080-94e1-332d41f9d713 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] [instance: d4033cef-23be-4f49-8c7b-0be4ebde362f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:32.518527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16eda388-94de-4080-94e1-332d41f9d713 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:32.519726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16eda388-94de-4080-94e1-332d41f9d713 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:32.521916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16eda388-94de-4080-94e1-332d41f9d713 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:32.542414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16eda388-94de-4080-94e1-332d41f9d713 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:32.814474 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-16eda388-94de-4080-94e1-332d41f9d713 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388a9972b4da47d7bda9fd36985eeb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f16e25c9f6f4845922175f67e5583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:32.823108 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-16eda388-94de-4080-94e1-332d41f9d713 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f" status: 200 len: 1394 microversion: 2.1 time: 0.326248 Jul 25 12:45:32.830475 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-53cd594f-5832-4679-b98f-28ce724b14d1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:32.831047 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 896/1887] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:32 2022] GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f => generated 1394 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:32.836968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5bfabbca-9572-45fb-b3d6-8a6b826a2bf5 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:32.837583 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5bfabbca-9572-45fb-b3d6-8a6b826a2bf5 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:32.845150 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-53cd594f-5832-4679-b98f-28ce724b14d1 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1463 microversion: 2.1 time: 0.389178 Jul 25 12:45:32.845675 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5bfabbca-9572-45fb-b3d6-8a6b826a2bf5 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:32.846171 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5bfabbca-9572-45fb-b3d6-8a6b826a2bf5 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:32.846799 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 992/1888] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:32 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1463 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:32.858917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5bfabbca-9572-45fb-b3d6-8a6b826a2bf5 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:32.859450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5bfabbca-9572-45fb-b3d6-8a6b826a2bf5 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:33.021702 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-06535ba3-6f4a-46ea-8b85-0d2f4f3db899 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1312187779", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": "none"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:33.095301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-06535ba3-6f4a-46ea-8b85-0d2f4f3db899 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:45:33.095301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-06535ba3-6f4a-46ea-8b85-0d2f4f3db899 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:45:33.096004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-06535ba3-6f4a-46ea-8b85-0d2f4f3db899 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:45:33.096584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-06535ba3-6f4a-46ea-8b85-0d2f4f3db899 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:45:33.097244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-06535ba3-6f4a-46ea-8b85-0d2f4f3db899 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:45:33.108828 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-06535ba3-6f4a-46ea-8b85-0d2f4f3db899 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:33.109604 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-06535ba3-6f4a-46ea-8b85-0d2f4f3db899 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:33.110751 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-06535ba3-6f4a-46ea-8b85-0d2f4f3db899 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:33.111285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-06535ba3-6f4a-46ea-8b85-0d2f4f3db899 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:33.124415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5bfabbca-9572-45fb-b3d6-8a6b826a2bf5 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:33.132891 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5bfabbca-9572-45fb-b3d6-8a6b826a2bf5 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949" status: 200 len: 1316 microversion: 2.1 time: 0.300469 Jul 25 12:45:33.136489 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 897/1889] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:32 2022] GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949 => generated 1316 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:33.140716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-06535ba3-6f4a-46ea-8b85-0d2f4f3db899 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Getting quotas for project 5b4515023e7349bcae2abe4915659a2a. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:45:33.144018 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5cb38fc4-4e59-47d0-a0a0-7d4066a74233 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:33.145358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5cb38fc4-4e59-47d0-a0a0-7d4066a74233 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:33.153708 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cb38fc4-4e59-47d0-a0a0-7d4066a74233 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:33.154210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cb38fc4-4e59-47d0-a0a0-7d4066a74233 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:33.155064 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cb38fc4-4e59-47d0-a0a0-7d4066a74233 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:33.155504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cb38fc4-4e59-47d0-a0a0-7d4066a74233 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:33.159223 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-06535ba3-6f4a-46ea-8b85-0d2f4f3db899 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Getting quotas for user 9932c91be25442bc9682cbe7a3440e88 and project 5b4515023e7349bcae2abe4915659a2a. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:45:33.182387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-06535ba3-6f4a-46ea-8b85-0d2f4f3db899 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:45:33.184751 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-06535ba3-6f4a-46ea-8b85-0d2f4f3db899 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:45:33.234265 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-06535ba3-6f4a-46ea-8b85-0d2f4f3db899 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.385567 Jul 25 12:45:33.241178 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 993/1890] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Jul 25 12:45:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 393 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 12:45:33.246961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-83eb4293-3dd4-4781-8d49-dd484b161b56 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:33.248289 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-83eb4293-3dd4-4781-8d49-dd484b161b56 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:33.255712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-83eb4293-3dd4-4781-8d49-dd484b161b56 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:33.256719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-83eb4293-3dd4-4781-8d49-dd484b161b56 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:33.258012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-83eb4293-3dd4-4781-8d49-dd484b161b56 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:33.258621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-83eb4293-3dd4-4781-8d49-dd484b161b56 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:33.434921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-83eb4293-3dd4-4781-8d49-dd484b161b56 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929ae21affaf4eb9b8eba955745aa751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59f31c830d544129310056d267f465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:33.451656 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-83eb4293-3dd4-4781-8d49-dd484b161b56 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e" status: 200 len: 1249 microversion: 2.1 time: 0.206772 Jul 25 12:45:33.453283 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 994/1891] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:33 2022] GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e => generated 1249 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:33.464777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2e903d2c-181b-4ce3-9e1d-fc285f47c529 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:33.466469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2e903d2c-181b-4ce3-9e1d-fc285f47c529 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:33.486655 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2e903d2c-181b-4ce3-9e1d-fc285f47c529 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:33.487329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2e903d2c-181b-4ce3-9e1d-fc285f47c529 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:33.488419 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2e903d2c-181b-4ce3-9e1d-fc285f47c529 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:33.489487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2e903d2c-181b-4ce3-9e1d-fc285f47c529 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:33.500009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5cb38fc4-4e59-47d0-a0a0-7d4066a74233 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:33.511898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5cb38fc4-4e59-47d0-a0a0-7d4066a74233 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:33.513693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5cb38fc4-4e59-47d0-a0a0-7d4066a74233 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:33.514935 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5cb38fc4-4e59-47d0-a0a0-7d4066a74233 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 200 len: 1547 microversion: 2.25 time: 0.377296 Jul 25 12:45:33.515563 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 898/1892] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:33 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 1547 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:33.529685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ce609ce1-a721-42c8-b7f9-8d7b7fff49eb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:33.539451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ce609ce1-a721-42c8-b7f9-8d7b7fff49eb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:33.568152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ce609ce1-a721-42c8-b7f9-8d7b7fff49eb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:33.568612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ce609ce1-a721-42c8-b7f9-8d7b7fff49eb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:33.569404 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ce609ce1-a721-42c8-b7f9-8d7b7fff49eb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:33.569856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ce609ce1-a721-42c8-b7f9-8d7b7fff49eb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:33.805291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2e903d2c-181b-4ce3-9e1d-fc285f47c529 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:33.819550 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2e903d2c-181b-4ce3-9e1d-fc285f47c529 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 0.360450 Jul 25 12:45:33.820580 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 995/1893] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:33 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:33.838237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f12200da-b1d8-4b98-b7cc-0f375bea880d tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:33.840426 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f12200da-b1d8-4b98-b7cc-0f375bea880d tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:33.887328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ce609ce1-a721-42c8-b7f9-8d7b7fff49eb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:33.906826 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ce609ce1-a721-42c8-b7f9-8d7b7fff49eb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1463 microversion: 2.1 time: 0.380798 Jul 25 12:45:33.907810 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 899/1894] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:33 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1463 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:33.913380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1e7476ad-f252-4089-a019-9f74c290b9c7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:33.914371 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1e7476ad-f252-4089-a019-9f74c290b9c7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 21390510-6525-44f6-818a-225eacdd5953] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:33.920856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1e7476ad-f252-4089-a019-9f74c290b9c7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:33.921639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1e7476ad-f252-4089-a019-9f74c290b9c7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:33.922656 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1e7476ad-f252-4089-a019-9f74c290b9c7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:33.923343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1e7476ad-f252-4089-a019-9f74c290b9c7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:33.961866 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f12200da-b1d8-4b98-b7cc-0f375bea880d tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:33.966089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=21 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:33.974558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f12200da-b1d8-4b98-b7cc-0f375bea880d tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:33.976442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f12200da-b1d8-4b98-b7cc-0f375bea880d tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:33.979002 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f12200da-b1d8-4b98-b7cc-0f375bea880d tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1278 microversion: 2.54 time: 0.156762 Jul 25 12:45:33.980665 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 996/1895] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:33 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:33.986375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-44baf75b-c64b-4557-89d9-3dc5c8496849 req-0fe0ae8a-3372-4897-8929-fe91a21b0d66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a28091-c9d3-44c2-8289-828c66b56c2b", "name": "network-vif-deleted", "tag": "5abc676c-0f69-43cf-b469-5e02f591bcab"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:34.023682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-44baf75b-c64b-4557-89d9-3dc5c8496849 req-0fe0ae8a-3372-4897-8929-fe91a21b0d66 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:34.024722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-44baf75b-c64b-4557-89d9-3dc5c8496849 req-0fe0ae8a-3372-4897-8929-fe91a21b0d66 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:34.048245 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-44baf75b-c64b-4557-89d9-3dc5c8496849 req-0fe0ae8a-3372-4897-8929-fe91a21b0d66 service nova] Creating event network-vif-deleted:5abc676c-0f69-43cf-b469-5e02f591bcab for instance 31a28091-c9d3-44c2-8289-828c66b56c2b on n-h2-848886-15 Jul 25 12:45:34.061157 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-44baf75b-c64b-4557-89d9-3dc5c8496849 req-0fe0ae8a-3372-4897-8929-fe91a21b0d66 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077292 Jul 25 12:45:34.062622 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 997/1896] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:34.070962 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c889db06-eec1-468c-ad7f-b665f8358855 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:34.072030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c889db06-eec1-468c-ad7f-b665f8358855 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] [instance: d4033cef-23be-4f49-8c7b-0be4ebde362f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:34.085043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c889db06-eec1-468c-ad7f-b665f8358855 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:34.085940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c889db06-eec1-468c-ad7f-b665f8358855 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:34.087035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c889db06-eec1-468c-ad7f-b665f8358855 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:34.088120 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c889db06-eec1-468c-ad7f-b665f8358855 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:34.221738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1e7476ad-f252-4089-a019-9f74c290b9c7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:34.230099 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1e7476ad-f252-4089-a019-9f74c290b9c7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953" status: 200 len: 1472 microversion: 2.1 time: 0.320993 Jul 25 12:45:34.231041 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 900/1897] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:33 2022] GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953 => generated 1472 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:34.236219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-380b0e4f-708b-4f46-9908-162335a8ceb2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "97beeed7-7564-4203-abda-feef7e93cd98"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:34.239433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-380b0e4f-708b-4f46-9908-162335a8ceb2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:34.246519 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-380b0e4f-708b-4f46-9908-162335a8ceb2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:34.247538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-380b0e4f-708b-4f46-9908-162335a8ceb2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:34.248559 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-380b0e4f-708b-4f46-9908-162335a8ceb2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:34.248999 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-380b0e4f-708b-4f46-9908-162335a8ceb2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:34.294526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c889db06-eec1-468c-ad7f-b665f8358855 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388a9972b4da47d7bda9fd36985eeb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f16e25c9f6f4845922175f67e5583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:34.303055 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c889db06-eec1-468c-ad7f-b665f8358855 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f" status: 200 len: 1394 microversion: 2.1 time: 0.238424 Jul 25 12:45:34.303549 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 998/1898] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:34 2022] GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f => generated 1394 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:34.308190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1a0ef660-7aac-415b-a892-1632c50fe8fd tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:34.309707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1a0ef660-7aac-415b-a892-1632c50fe8fd tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:34.342917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a0ef660-7aac-415b-a892-1632c50fe8fd tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:34.343368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a0ef660-7aac-415b-a892-1632c50fe8fd tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:34.349545 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a0ef660-7aac-415b-a892-1632c50fe8fd tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:34.353035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a0ef660-7aac-415b-a892-1632c50fe8fd tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:34.372579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-380b0e4f-708b-4f46-9908-162335a8ceb2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:45:34.373002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-380b0e4f-708b-4f46-9908-162335a8ceb2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:45:34.373591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-380b0e4f-708b-4f46-9908-162335a8ceb2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:45:34.374029 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-380b0e4f-708b-4f46-9908-162335a8ceb2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:45:34.374460 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-380b0e4f-708b-4f46-9908-162335a8ceb2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:45:34.458767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:34.487502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-380b0e4f-708b-4f46-9908-162335a8ceb2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:34.495312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-380b0e4f-708b-4f46-9908-162335a8ceb2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:34.495967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-380b0e4f-708b-4f46-9908-162335a8ceb2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:34.496908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-380b0e4f-708b-4f46-9908-162335a8ceb2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:34.497505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-380b0e4f-708b-4f46-9908-162335a8ceb2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:34.532378 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-380b0e4f-708b-4f46-9908-162335a8ceb2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "POST /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d/action" status: 202 len: 1067 microversion: 2.1 time: 0.299793 Jul 25 12:45:34.548640 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 901/1899] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:45:34 2022] POST /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d/action => generated 1067 bytes in 317 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 12:45:34.652400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1a0ef660-7aac-415b-a892-1632c50fe8fd tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:34.662598 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1a0ef660-7aac-415b-a892-1632c50fe8fd tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949" status: 200 len: 1316 microversion: 2.1 time: 0.357986 Jul 25 12:45:34.665862 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 999/1900] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:34 2022] GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949 => generated 1316 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:34.672390 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-2709e12f-03c2-43c3-a519-ff8056cbc3bf req-3fb0f29f-01b6-473d-a4f8-b1f741778cdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8bc4a2-d00c-4134-acdc-7b86e0ada949", "name": "network-vif-plugged", "status": "completed", "tag": "c9e83551-a9ab-4f05-a33e-1ebc6c00a03a"}, {"server_uuid": "791ea14d-3fa9-4be1-afc1-82c8908395f4", "name": "network-vif-unplugged", "status": "completed", "tag": "0f801405-35d3-471d-9010-4dc3d6d5eec1"}, {"server_uuid": "d4033cef-23be-4f49-8c7b-0be4ebde362f", "name": "network-vif-plugged", "status": "completed", "tag": "a89273b4-19ae-401f-9b9d-63eac14ed636"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:34.691059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-2709e12f-03c2-43c3-a519-ff8056cbc3bf req-3fb0f29f-01b6-473d-a4f8-b1f741778cdf service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:34.691505 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-2709e12f-03c2-43c3-a519-ff8056cbc3bf req-3fb0f29f-01b6-473d-a4f8-b1f741778cdf service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:34.708588 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-2709e12f-03c2-43c3-a519-ff8056cbc3bf req-3fb0f29f-01b6-473d-a4f8-b1f741778cdf service nova] Creating event network-vif-plugged:c9e83551-a9ab-4f05-a33e-1ebc6c00a03a for instance 7a8bc4a2-d00c-4134-acdc-7b86e0ada949 on n-h1-848886-15 Jul 25 12:45:34.709089 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-2709e12f-03c2-43c3-a519-ff8056cbc3bf req-3fb0f29f-01b6-473d-a4f8-b1f741778cdf service nova] Creating event network-vif-unplugged:0f801405-35d3-471d-9010-4dc3d6d5eec1 for instance 791ea14d-3fa9-4be1-afc1-82c8908395f4 on n-h1-848886-15 Jul 25 12:45:34.709893 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-2709e12f-03c2-43c3-a519-ff8056cbc3bf req-3fb0f29f-01b6-473d-a4f8-b1f741778cdf service nova] Creating event network-vif-plugged:a89273b4-19ae-401f-9b9d-63eac14ed636 for instance d4033cef-23be-4f49-8c7b-0be4ebde362f on n-h2-848886-15 Jul 25 12:45:34.721557 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-2709e12f-03c2-43c3-a519-ff8056cbc3bf req-3fb0f29f-01b6-473d-a4f8-b1f741778cdf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.053588 Jul 25 12:45:34.722557 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1000/1901] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:34.729540 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6f698ab7-8340-4293-ad6e-09167db37dfa tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:34.730508 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6f698ab7-8340-4293-ad6e-09167db37dfa tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:34.735932 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2055283d-4fd5-4c36-9547-be04761b4024 tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:34.736747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2055283d-4fd5-4c36-9547-be04761b4024 tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] [instance: ea2ea48b-aedb-4421-9be8-1d4120f98fcb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:34.744929 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-2055283d-4fd5-4c36-9547-be04761b4024 tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] HTTP exception thrown: Instance ea2ea48b-aedb-4421-9be8-1d4120f98fcb could not be found. Jul 25 12:45:34.749748 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6f698ab7-8340-4293-ad6e-09167db37dfa tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:34.750230 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6f698ab7-8340-4293-ad6e-09167db37dfa tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:34.751059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6f698ab7-8340-4293-ad6e-09167db37dfa tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:34.751494 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6f698ab7-8340-4293-ad6e-09167db37dfa tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:34.761793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2055283d-4fd5-4c36-9547-be04761b4024 tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Request method failure captured: Jul 25 12:45:34.761793 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/ea2ea48b-aedb-4421-9be8-1d4120f98fcb/action HTTP/1.1 Jul 25 12:45:34.761793 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:45:34.761793 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:45:34.761793 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:45:34.761793 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 15 Jul 25 12:45:34.761793 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:45:34.761793 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:45:34.761793 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:45:34.761793 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:45:34.761793 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pBQBLwJFdwnUXsG8USYDTGzLznZ8vbH_BkhQX7HMLOMb-MPdGY6zYPyjryc3VkVM4llqYjDcBMwtZr95RWdbno-clCxPG40GWrU0dfP0rzyY4VpxNj4iQk9gzj0uLNahV8zcRWQZD7b4q9w7aVb3Y7ri8akENoRSpl8t9IgqB3XA0I Jul 25 12:45:34.761793 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:45:34.761793 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:45:34.761793 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:45:34.761793 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:45:34.761793 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:45:34.761793 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:45:34.761793 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: eb320b2751364e54ab6e7c7d7b9c0748 Jul 25 12:45:34.761793 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-848826852 Jul 25 12:45:34.761793 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:45:34.761793 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:45:34.763790 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eb320b2751364e54ab6e7c7d7b9c0748", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eb320b2751364e54ab6e7c7d7b9c0748"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb320b2751364e54ab6e7c7d7b9c0748"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb320b2751364e54ab6e7c7d7b9c0748"}]}] Jul 25 12:45:34.763790 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersAdminNegativeTestJSON-848826852 Jul 25 12:45:34.763790 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: eb320b2751364e54ab6e7c7d7b9c0748 Jul 25 12:45:34.763790 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-848826852 Jul 25 12:45:34.763790 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersAdminNegativeTestJSON-848826852-project-admin Jul 25 12:45:34.763790 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:45:34.763790 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:45:34.763790 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: ce1ab9c3ff73425098d29b23fe4edd89 Jul 25 12:45:34.763790 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersAdminNegativeTestJSON-848826852-project-admin Jul 25 12:45:34.763790 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:45:34.763790 n-d-848886-15 devstack@n-api.service[125883]: {"migrate": {}} Jul 25 12:45:34.763790 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:45:34.763790 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance ea2ea48b-aedb-4421-9be8-1d4120f98fcb could not be found. Jul 25 12:45:34.765080 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'ea2ea48b-aedb-4421-9be8-1d4120f98fcb', 'body': {'migrate': {}}} Jul 25 12:45:34.765080 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:45:34.765080 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:34.765080 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:45:34.765080 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:45:34.765080 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:45:34.765080 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:45:34.765080 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 12:45:34.765080 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 12:45:34.765080 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea2ea48b-aedb-4421-9be8-1d4120f98fcb could not be found. Jul 25 12:45:34.765080 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:34.765080 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:34.765080 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:34.765080 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:34.765080 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:34.765080 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:34.765080 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:45:34.765080 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:45:34.765080 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:45:34.765080 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:45:34.766846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:45:34.766846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:45:34.766846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 25 12:45:34.766846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 25 12:45:34.766846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:45:34.766846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:45:34.766846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea2ea48b-aedb-4421-9be8-1d4120f98fcb could not be found. Jul 25 12:45:34.766846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:34.766846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:34.766846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:34.766846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:34.766846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:34.766846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:34.766846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:45:34.766846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:45:34.766846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea2ea48b-aedb-4421-9be8-1d4120f98fcb could not be found. Jul 25 12:45:34.766846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:34.769625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2055283d-4fd5-4c36-9547-be04761b4024 tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Returning 404 to user: Instance ea2ea48b-aedb-4421-9be8-1d4120f98fcb could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:45:34.771819 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2055283d-4fd5-4c36-9547-be04761b4024 tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/ea2ea48b-aedb-4421-9be8-1d4120f98fcb/action" status: 404 len: 111 microversion: 2.1 time: 0.221923 Jul 25 12:45:34.775637 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 902/1902] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:45:34 2022] POST /compute/v2.1/servers/ea2ea48b-aedb-4421-9be8-1d4120f98fcb/action => generated 111 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:45:34.789792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-40c88f81-db26-4ade-a272-82f2d7e91e38 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:34.792731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-40c88f81-db26-4ade-a272-82f2d7e91e38 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: 31a28091-c9d3-44c2-8289-828c66b56c2b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:34.812600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-40c88f81-db26-4ade-a272-82f2d7e91e38 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:34.813421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-40c88f81-db26-4ade-a272-82f2d7e91e38 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:34.814444 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-40c88f81-db26-4ade-a272-82f2d7e91e38 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:34.815205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-40c88f81-db26-4ade-a272-82f2d7e91e38 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:34.836045 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-40c88f81-db26-4ade-a272-82f2d7e91e38 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] HTTP exception thrown: Instance 31a28091-c9d3-44c2-8289-828c66b56c2b could not be found. Jul 25 12:45:34.837983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-40c88f81-db26-4ade-a272-82f2d7e91e38 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Request method failure captured: Jul 25 12:45:34.837983 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b HTTP/1.1 Jul 25 12:45:34.837983 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:45:34.837983 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:45:34.837983 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:45:34.837983 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:45:34.837983 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:45:34.837983 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:45:34.837983 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:45:34.837983 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:45:34.837983 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7Cd_8Lqp-0wEwAl8ClXlh_AIOMu3nTsYHwSfoINOAYpM9tKluLVBmtXxrBiVPCdhUkTyHT7iRks30CtQftHX9B2A5Biu0tF7UKx0LS0U7Z4vHIrZWCBQHnd32ujvJYompMUMG4hPPK6j9Oq9zHao-IAqdAE-XzANFWpF3FSd7pbYQ Jul 25 12:45:34.837983 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:45:34.837983 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:45:34.837983 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:45:34.837983 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:45:34.837983 n-d-848886-15 devstack@n-api.service[125883]: X-Openstack-Nova-Api-Version: 2.25 Jul 25 12:45:34.837983 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:45:34.837983 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:45:34.837983 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: bdce4da5878543a4a609dc35e389763c Jul 25 12:45:34.837983 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1761396001 Jul 25 12:45:34.837983 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:45:34.837983 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:45:34.840048 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bdce4da5878543a4a609dc35e389763c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bdce4da5878543a4a609dc35e389763c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bdce4da5878543a4a609dc35e389763c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bdce4da5878543a4a609dc35e389763c"}]}] Jul 25 12:45:34.840048 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1761396001 Jul 25 12:45:34.840048 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: bdce4da5878543a4a609dc35e389763c Jul 25 12:45:34.840048 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1761396001 Jul 25 12:45:34.840048 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-LiveAutoBlockMigrationV225Test-1761396001-project Jul 25 12:45:34.840048 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:45:34.840048 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:45:34.840048 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: fa79a472f31b4e8eb0a6ad709bc84c01 Jul 25 12:45:34.840048 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1761396001-project Jul 25 12:45:34.840048 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:45:34.840048 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 31a28091-c9d3-44c2-8289-828c66b56c2b could not be found. Jul 25 12:45:34.840048 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '31a28091-c9d3-44c2-8289-828c66b56c2b'} Jul 25 12:45:34.841070 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:45:34.841070 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:34.841070 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:45:34.841070 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:45:34.841070 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:45:34.841070 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:45:34.841070 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:45:34.841070 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:45:34.841070 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:45:34.841070 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:45:34.841070 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31a28091-c9d3-44c2-8289-828c66b56c2b could not be found. Jul 25 12:45:34.841070 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:34.841070 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:34.841070 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:34.841070 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:34.841070 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:34.841070 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:34.841070 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:45:34.841070 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:45:34.841070 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:45:34.843430 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:45:34.843430 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:45:34.843430 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:45:34.843430 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:45:34.843430 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:45:34.843430 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:45:34.843430 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:45:34.843430 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31a28091-c9d3-44c2-8289-828c66b56c2b could not be found. Jul 25 12:45:34.843430 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:34.843430 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:34.843430 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:34.843430 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:34.843430 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:34.843430 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:34.843430 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:45:34.843430 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:45:34.843430 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31a28091-c9d3-44c2-8289-828c66b56c2b could not be found. Jul 25 12:45:34.843430 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:34.846299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-40c88f81-db26-4ade-a272-82f2d7e91e38 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Returning 404 to user: Instance 31a28091-c9d3-44c2-8289-828c66b56c2b could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:45:34.847941 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-40c88f81-db26-4ade-a272-82f2d7e91e38 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b" status: 404 len: 111 microversion: 2.25 time: 0.071108 Jul 25 12:45:34.849008 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 903/1903] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:34 2022] GET /compute/v2.1/servers/31a28091-c9d3-44c2-8289-828c66b56c2b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:45:34.854162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-86899082-970a-4808-90dd-474b3bd9f7ba tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:34.855042 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-86899082-970a-4808-90dd-474b3bd9f7ba tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:34.864932 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86899082-970a-4808-90dd-474b3bd9f7ba tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:34.866113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86899082-970a-4808-90dd-474b3bd9f7ba tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:34.867681 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86899082-970a-4808-90dd-474b3bd9f7ba tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:34.868296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86899082-970a-4808-90dd-474b3bd9f7ba tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:34.908360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6f698ab7-8340-4293-ad6e-09167db37dfa tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929ae21affaf4eb9b8eba955745aa751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59f31c830d544129310056d267f465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:34.917361 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6f698ab7-8340-4293-ad6e-09167db37dfa tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e" status: 200 len: 1303 microversion: 2.1 time: 0.193387 Jul 25 12:45:34.923720 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1001/1904] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:34 2022] GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e => generated 1303 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:34.935420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f60eab02-2d21-4e71-a903-34eb7bc611db tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:34.936171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f60eab02-2d21-4e71-a903-34eb7bc611db tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:34.951537 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f60eab02-2d21-4e71-a903-34eb7bc611db tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:34.960435 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f60eab02-2d21-4e71-a903-34eb7bc611db tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:34.961290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f60eab02-2d21-4e71-a903-34eb7bc611db tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:34.961729 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f60eab02-2d21-4e71-a903-34eb7bc611db tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:35.324092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f60eab02-2d21-4e71-a903-34eb7bc611db tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:35.334570 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f60eab02-2d21-4e71-a903-34eb7bc611db tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1390 microversion: 2.1 time: 0.409644 Jul 25 12:45:35.335309 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1002/1905] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:34 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1390 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:35.346734 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9b16f176-f0d3-4495-9cb5-a0427f3395e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:35.347777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9b16f176-f0d3-4495-9cb5-a0427f3395e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:35.366587 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b16f176-f0d3-4495-9cb5-a0427f3395e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:35.374682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b16f176-f0d3-4495-9cb5-a0427f3395e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:35.375748 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b16f176-f0d3-4495-9cb5-a0427f3395e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:35.378505 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b16f176-f0d3-4495-9cb5-a0427f3395e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:35.428243 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-86899082-970a-4808-90dd-474b3bd9f7ba tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:35.441710 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-86899082-970a-4808-90dd-474b3bd9f7ba tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1472 microversion: 2.1 time: 0.591358 Jul 25 12:45:35.449223 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 904/1906] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:34 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1472 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:35.463033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f8650ebc-6edf-4b33-91b4-b4df8566418b tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:35.470040 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f8650ebc-6edf-4b33-91b4-b4df8566418b tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:35.476684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9b16f176-f0d3-4495-9cb5-a0427f3395e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:45:35.506643 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8650ebc-6edf-4b33-91b4-b4df8566418b tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:35.507196 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8650ebc-6edf-4b33-91b4-b4df8566418b tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:35.523372 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8650ebc-6edf-4b33-91b4-b4df8566418b tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:35.523915 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8650ebc-6edf-4b33-91b4-b4df8566418b tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:35.556800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:35.725805 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9b16f176-f0d3-4495-9cb5-a0427f3395e7 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 204 len: 0 microversion: 2.25 time: 0.383181 Jul 25 12:45:35.727886 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1003/1907] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 12:45:35 2022] DELETE /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 12:45:35.740482 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3806c3aa-7f6e-492e-98df-4e55a0ac4b88 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-223704628", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:35.794840 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f8650ebc-6edf-4b33-91b4-b4df8566418b tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:35.805695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f8650ebc-6edf-4b33-91b4-b4df8566418b tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:35.807462 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f8650ebc-6edf-4b33-91b4-b4df8566418b tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:35.809140 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f8650ebc-6edf-4b33-91b4-b4df8566418b tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1336 microversion: 2.54 time: 0.350656 Jul 25 12:45:35.826378 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 905/1908] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:35 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1336 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:35.832815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-25e16664-3c8c-4b8a-99ac-7237f1a8e02a tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:35.833684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-25e16664-3c8c-4b8a-99ac-7237f1a8e02a tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] [instance: d4033cef-23be-4f49-8c7b-0be4ebde362f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:35.834582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-3806c3aa-7f6e-492e-98df-4e55a0ac4b88 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] validate_networks() for None {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:45:35.843483 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-25e16664-3c8c-4b8a-99ac-7237f1a8e02a tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:35.843950 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-25e16664-3c8c-4b8a-99ac-7237f1a8e02a tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:35.844856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-25e16664-3c8c-4b8a-99ac-7237f1a8e02a tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:35.846053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-25e16664-3c8c-4b8a-99ac-7237f1a8e02a tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:36.215201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-25e16664-3c8c-4b8a-99ac-7237f1a8e02a tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388a9972b4da47d7bda9fd36985eeb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f16e25c9f6f4845922175f67e5583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:36.224165 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-25e16664-3c8c-4b8a-99ac-7237f1a8e02a tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f" status: 200 len: 1394 microversion: 2.1 time: 0.396468 Jul 25 12:45:36.228093 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 906/1909] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:35 2022] GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f => generated 1394 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:36.244711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9048056f-b234-4be4-a1d1-eab7ee401dc8 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:36.248708 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9048056f-b234-4be4-a1d1-eab7ee401dc8 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:36.278511 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-3806c3aa-7f6e-492e-98df-4e55a0ac4b88 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:45:36.279164 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9048056f-b234-4be4-a1d1-eab7ee401dc8 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:36.279278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-3806c3aa-7f6e-492e-98df-4e55a0ac4b88 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:45:36.279378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9048056f-b234-4be4-a1d1-eab7ee401dc8 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:36.279470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-3806c3aa-7f6e-492e-98df-4e55a0ac4b88 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:45:36.279817 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-3806c3aa-7f6e-492e-98df-4e55a0ac4b88 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:45:36.280076 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9048056f-b234-4be4-a1d1-eab7ee401dc8 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:36.280419 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-3806c3aa-7f6e-492e-98df-4e55a0ac4b88 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:45:36.280545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9048056f-b234-4be4-a1d1-eab7ee401dc8 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:36.290688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3806c3aa-7f6e-492e-98df-4e55a0ac4b88 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:36.291423 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3806c3aa-7f6e-492e-98df-4e55a0ac4b88 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:36.292430 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3806c3aa-7f6e-492e-98df-4e55a0ac4b88 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:36.293077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3806c3aa-7f6e-492e-98df-4e55a0ac4b88 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:36.331265 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-3806c3aa-7f6e-492e-98df-4e55a0ac4b88 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Getting quotas for project 255fa26649774caca18f3b9784863281. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:45:36.337923 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-3806c3aa-7f6e-492e-98df-4e55a0ac4b88 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Getting quotas for user 9488de03a0cf4e10b18ba769cb2cf408 and project 255fa26649774caca18f3b9784863281. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:45:36.373632 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3806c3aa-7f6e-492e-98df-4e55a0ac4b88 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:45:36.377204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3806c3aa-7f6e-492e-98df-4e55a0ac4b88 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 532fceed-acb2-4cc9-9a5c-60791fb1aab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:45:36.478264 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3806c3aa-7f6e-492e-98df-4e55a0ac4b88 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.746594 Jul 25 12:45:36.484669 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1004/1910] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:45:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:45:36.496290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cf4ce53a-42d8-4ee8-9680-fdba22b39b00 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:36.497734 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cf4ce53a-42d8-4ee8-9680-fdba22b39b00 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:36.535127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf4ce53a-42d8-4ee8-9680-fdba22b39b00 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:36.535856 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf4ce53a-42d8-4ee8-9680-fdba22b39b00 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:36.536925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf4ce53a-42d8-4ee8-9680-fdba22b39b00 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:36.537529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf4ce53a-42d8-4ee8-9680-fdba22b39b00 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:37.024011 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9048056f-b234-4be4-a1d1-eab7ee401dc8 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:37.036039 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9048056f-b234-4be4-a1d1-eab7ee401dc8 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949" status: 200 len: 1316 microversion: 2.1 time: 0.806733 Jul 25 12:45:37.036608 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 907/1911] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:36 2022] GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949 => generated 1316 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:37.048880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1d732a7b-1e96-4461-80e9-71278c539a71 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:37.050500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1d732a7b-1e96-4461-80e9-71278c539a71 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:37.074543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d732a7b-1e96-4461-80e9-71278c539a71 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:37.080397 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d732a7b-1e96-4461-80e9-71278c539a71 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:37.081621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d732a7b-1e96-4461-80e9-71278c539a71 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:37.082311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d732a7b-1e96-4461-80e9-71278c539a71 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:37.405521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cf4ce53a-42d8-4ee8-9680-fdba22b39b00 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:37.437688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cf4ce53a-42d8-4ee8-9680-fdba22b39b00 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:37.447998 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cf4ce53a-42d8-4ee8-9680-fdba22b39b00 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:37.449768 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cf4ce53a-42d8-4ee8-9680-fdba22b39b00 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 1562 microversion: 2.25 time: 0.969234 Jul 25 12:45:37.450623 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1005/1912] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:36 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 1562 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:37.459177 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c1e12713-3e9c-4db6-a940-acdbbe79cd95 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:37.460055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c1e12713-3e9c-4db6-a940-acdbbe79cd95 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:37.467683 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1e12713-3e9c-4db6-a940-acdbbe79cd95 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:37.468226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1e12713-3e9c-4db6-a940-acdbbe79cd95 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:37.468978 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1e12713-3e9c-4db6-a940-acdbbe79cd95 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:37.469408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1e12713-3e9c-4db6-a940-acdbbe79cd95 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:37.591505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1d732a7b-1e96-4461-80e9-71278c539a71 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929ae21affaf4eb9b8eba955745aa751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59f31c830d544129310056d267f465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:37.600643 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1d732a7b-1e96-4461-80e9-71278c539a71 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e" status: 200 len: 1371 microversion: 2.1 time: 0.561443 Jul 25 12:45:37.601519 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 908/1913] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:37 2022] GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e => generated 1371 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:37.621525 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e6d33136-b54b-45f6-b61b-7cd25059b05b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:37.622521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e6d33136-b54b-45f6-b61b-7cd25059b05b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:37.630918 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e6d33136-b54b-45f6-b61b-7cd25059b05b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:37.631806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e6d33136-b54b-45f6-b61b-7cd25059b05b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:37.633663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e6d33136-b54b-45f6-b61b-7cd25059b05b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:37.634141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e6d33136-b54b-45f6-b61b-7cd25059b05b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:37.808584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c1e12713-3e9c-4db6-a940-acdbbe79cd95 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:37.818391 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c1e12713-3e9c-4db6-a940-acdbbe79cd95 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1380 microversion: 2.1 time: 0.364814 Jul 25 12:45:37.819372 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1006/1914] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:37 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1380 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:37.825051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b4b24dd6-8a25-4332-9325-5afd892d51bc tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:37.826001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b4b24dd6-8a25-4332-9325-5afd892d51bc tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 532fceed-acb2-4cc9-9a5c-60791fb1aab3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:37.834173 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4b24dd6-8a25-4332-9325-5afd892d51bc tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:37.835298 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4b24dd6-8a25-4332-9325-5afd892d51bc tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:37.836485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4b24dd6-8a25-4332-9325-5afd892d51bc tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:37.837222 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4b24dd6-8a25-4332-9325-5afd892d51bc tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:37.905064 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e6d33136-b54b-45f6-b61b-7cd25059b05b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:37.920656 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e6d33136-b54b-45f6-b61b-7cd25059b05b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1472 microversion: 2.1 time: 0.304567 Jul 25 12:45:37.934682 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 909/1915] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:37 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1472 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:37.935989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b4b24dd6-8a25-4332-9325-5afd892d51bc tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:37.944231 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a26924c8-76a4-4e5e-89e9-3cbd6d4bbc6e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:37.945341 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b4b24dd6-8a25-4332-9325-5afd892d51bc tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3" status: 200 len: 1273 microversion: 2.1 time: 0.124594 Jul 25 12:45:37.945500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a26924c8-76a4-4e5e-89e9-3cbd6d4bbc6e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:37.959014 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1007/1916] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:37 2022] GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3 => generated 1273 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:37.959014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-64f927b8-9e40-427a-bf2a-611e8b365b12 req-b9d92c77-33f1-457b-a188-2891a23b6c4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3141f1ca-37c8-4fff-9aa7-518ce0d83f1e", "tag": "452b8c9e-e8cb-4a81-99b0-37868cce96be"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:37.959272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a26924c8-76a4-4e5e-89e9-3cbd6d4bbc6e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:37.959272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a26924c8-76a4-4e5e-89e9-3cbd6d4bbc6e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:37.959272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a26924c8-76a4-4e5e-89e9-3cbd6d4bbc6e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:37.959272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a26924c8-76a4-4e5e-89e9-3cbd6d4bbc6e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:37.965346 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-64f927b8-9e40-427a-bf2a-611e8b365b12 req-b9d92c77-33f1-457b-a188-2891a23b6c4d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:37.966726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-64f927b8-9e40-427a-bf2a-611e8b365b12 req-b9d92c77-33f1-457b-a188-2891a23b6c4d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:37.992598 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-64f927b8-9e40-427a-bf2a-611e8b365b12 req-b9d92c77-33f1-457b-a188-2891a23b6c4d service nova] Creating event network-changed:452b8c9e-e8cb-4a81-99b0-37868cce96be for instance 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e on n-h2-848886-15 Jul 25 12:45:37.999859 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-64f927b8-9e40-427a-bf2a-611e8b365b12 req-b9d92c77-33f1-457b-a188-2891a23b6c4d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050802 Jul 25 12:45:38.001334 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1008/1917] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:38.009644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8e28539d-2f67-4651-b6c0-473ea0d5de7b tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:38.010612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8e28539d-2f67-4651-b6c0-473ea0d5de7b tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] [instance: d4033cef-23be-4f49-8c7b-0be4ebde362f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:38.018428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e28539d-2f67-4651-b6c0-473ea0d5de7b tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:38.019243 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e28539d-2f67-4651-b6c0-473ea0d5de7b tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:38.020024 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e28539d-2f67-4651-b6c0-473ea0d5de7b tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:38.020457 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e28539d-2f67-4651-b6c0-473ea0d5de7b tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:38.174212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a26924c8-76a4-4e5e-89e9-3cbd6d4bbc6e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:38.189945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a26924c8-76a4-4e5e-89e9-3cbd6d4bbc6e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:38.192214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a26924c8-76a4-4e5e-89e9-3cbd6d4bbc6e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:38.193396 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a26924c8-76a4-4e5e-89e9-3cbd6d4bbc6e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1336 microversion: 2.54 time: 0.255853 Jul 25 12:45:38.194001 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 910/1918] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:37 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1336 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:38.216190 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8d260d7b-9caf-4960-88c3-3db0617bcaba tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Calling method '.version_select at 0x7efcf90093a0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:38.220851 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d260d7b-9caf-4960-88c3-3db0617bcaba tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:38.221539 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d260d7b-9caf-4960-88c3-3db0617bcaba tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:38.232278 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8d260d7b-9caf-4960-88c3-3db0617bcaba tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 1952 microversion: 2.1 time: 0.022371 Jul 25 12:45:38.234251 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 911/1919] 10.222.0.49 () {58 vars in 1143 bytes} [Mon Jul 25 12:45:38 2022] GET /compute/v2.1/os-migrations => generated 1952 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:38.240520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-15fd0125-e3d1-42ea-90a2-c12ed186ff99 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:38.241432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-15fd0125-e3d1-42ea-90a2-c12ed186ff99 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:38.250238 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15fd0125-e3d1-42ea-90a2-c12ed186ff99 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:38.251009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15fd0125-e3d1-42ea-90a2-c12ed186ff99 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:38.251997 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15fd0125-e3d1-42ea-90a2-c12ed186ff99 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:38.252706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15fd0125-e3d1-42ea-90a2-c12ed186ff99 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:38.462707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8e28539d-2f67-4651-b6c0-473ea0d5de7b tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388a9972b4da47d7bda9fd36985eeb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f16e25c9f6f4845922175f67e5583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:38.471102 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8e28539d-2f67-4651-b6c0-473ea0d5de7b tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f" status: 200 len: 1394 microversion: 2.1 time: 0.468061 Jul 25 12:45:38.471700 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1009/1920] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:38 2022] GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f => generated 1394 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:38.497728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e93217cc-6313-43f0-88d9-9e1ee09bafe0 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:38.498605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e93217cc-6313-43f0-88d9-9e1ee09bafe0 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:38.509113 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e93217cc-6313-43f0-88d9-9e1ee09bafe0 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:38.510160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e93217cc-6313-43f0-88d9-9e1ee09bafe0 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:38.511596 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e93217cc-6313-43f0-88d9-9e1ee09bafe0 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:38.512331 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e93217cc-6313-43f0-88d9-9e1ee09bafe0 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:38.603785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-15fd0125-e3d1-42ea-90a2-c12ed186ff99 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:38.616105 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-15fd0125-e3d1-42ea-90a2-c12ed186ff99 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949" status: 200 len: 1504 microversion: 2.1 time: 0.380318 Jul 25 12:45:38.617437 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 912/1921] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:38 2022] GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949 => generated 1504 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:38.623662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-8ed4e460-58ee-4e96-9958-2ecd28d3772f req-1a3988f1-6d91-4343-9c50-26642f535ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc20036c-d36c-4fef-a606-0d1820814320", "name": "network-vif-deleted", "tag": "92cf7b8c-f2ba-49cf-9e6d-a32bdb600392"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:38.635729 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-8ed4e460-58ee-4e96-9958-2ecd28d3772f req-1a3988f1-6d91-4343-9c50-26642f535ae2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:38.636816 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-8ed4e460-58ee-4e96-9958-2ecd28d3772f req-1a3988f1-6d91-4343-9c50-26642f535ae2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:38.675275 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-8ed4e460-58ee-4e96-9958-2ecd28d3772f req-1a3988f1-6d91-4343-9c50-26642f535ae2 service nova] Creating event network-vif-deleted:92cf7b8c-f2ba-49cf-9e6d-a32bdb600392 for instance dc20036c-d36c-4fef-a606-0d1820814320 on n-h1-848886-15 Jul 25 12:45:38.681999 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-8ed4e460-58ee-4e96-9958-2ecd28d3772f req-1a3988f1-6d91-4343-9c50-26642f535ae2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062492 Jul 25 12:45:38.683293 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 913/1922] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:38.692630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bba2dcc2-77fd-4abd-9006-1892f65f3e40 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:38.693763 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bba2dcc2-77fd-4abd-9006-1892f65f3e40 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:38.728143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bba2dcc2-77fd-4abd-9006-1892f65f3e40 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:38.730717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bba2dcc2-77fd-4abd-9006-1892f65f3e40 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:38.735369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bba2dcc2-77fd-4abd-9006-1892f65f3e40 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:38.736906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bba2dcc2-77fd-4abd-9006-1892f65f3e40 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:38.827658 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e93217cc-6313-43f0-88d9-9e1ee09bafe0 tempest-LiveMigrationTest-95640908 tempest-LiveMigrationTest-95640908-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1533 microversion: 2.1 time: 0.354085 Jul 25 12:45:38.828171 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1010/1923] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:38 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1533 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:38.832887 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bba2dcc2-77fd-4abd-9006-1892f65f3e40 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:38.833351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bba2dcc2-77fd-4abd-9006-1892f65f3e40 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:38.834177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-bba2dcc2-77fd-4abd-9006-1892f65f3e40 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lazy-loading 'fault' on Instance uuid dc20036c-d36c-4fef-a606-0d1820814320 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:45:38.843023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-14a3fe50-d2dd-458b-8c12-cfcd6344728d tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:38.851085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-14a3fe50-d2dd-458b-8c12-cfcd6344728d tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:38.893860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14a3fe50-d2dd-458b-8c12-cfcd6344728d tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:38.893860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14a3fe50-d2dd-458b-8c12-cfcd6344728d tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:38.893860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14a3fe50-d2dd-458b-8c12-cfcd6344728d tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:38.898847 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14a3fe50-d2dd-458b-8c12-cfcd6344728d tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:39.012714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bba2dcc2-77fd-4abd-9006-1892f65f3e40 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:39.026734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bba2dcc2-77fd-4abd-9006-1892f65f3e40 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:39.028336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bba2dcc2-77fd-4abd-9006-1892f65f3e40 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa79a472f31b4e8eb0a6ad709bc84c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdce4da5878543a4a609dc35e389763c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:39.029616 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bba2dcc2-77fd-4abd-9006-1892f65f3e40 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 200 len: 1351 microversion: 2.25 time: 0.344573 Jul 25 12:45:39.030577 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 914/1924] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:38 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 1351 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:39.035863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-96fe8722-96e9-42db-a204-5826ac25f060 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2064504829"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:39.036412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-96fe8722-96e9-42db-a204-5826ac25f060 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:39.043725 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-96fe8722-96e9-42db-a204-5826ac25f060 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:39.044538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-96fe8722-96e9-42db-a204-5826ac25f060 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:39.045655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-96fe8722-96e9-42db-a204-5826ac25f060 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:39.046370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-96fe8722-96e9-42db-a204-5826ac25f060 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:39.607087 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.network.security_group_api [None req-96fe8722-96e9-42db-a204-5826ac25f060 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Adding security group e6246bb0-4610-48c0-abdb-bde7daf9b373 to port c9e83551-a9ab-4f05-a33e-1ebc6c00a03a Jul 25 12:45:39.680954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-14a3fe50-d2dd-458b-8c12-cfcd6344728d tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929ae21affaf4eb9b8eba955745aa751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59f31c830d544129310056d267f465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:39.704370 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-14a3fe50-d2dd-458b-8c12-cfcd6344728d tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e" status: 200 len: 1371 microversion: 2.1 time: 0.865083 Jul 25 12:45:39.726171 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1011/1925] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:38 2022] GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e => generated 1371 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:39.733073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-909a2b06-12ce-4038-b00f-17a0f7ceb737 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:39.734145 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-909a2b06-12ce-4038-b00f-17a0f7ceb737 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:39.743103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-909a2b06-12ce-4038-b00f-17a0f7ceb737 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:39.743616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-909a2b06-12ce-4038-b00f-17a0f7ceb737 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:39.745334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-909a2b06-12ce-4038-b00f-17a0f7ceb737 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:39.745776 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-909a2b06-12ce-4038-b00f-17a0f7ceb737 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:39.792211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-909a2b06-12ce-4038-b00f-17a0f7ceb737 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:45:39.900749 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-909a2b06-12ce-4038-b00f-17a0f7ceb737 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "DELETE /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 204 len: 0 microversion: 2.1 time: 0.172310 Jul 25 12:45:39.904258 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1012/1926] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:45:39 2022] DELETE /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:45:39.909343 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-284ab3b7-ed0d-439b-8ed2-c97cd57e2c17 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:39.910260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-284ab3b7-ed0d-439b-8ed2-c97cd57e2c17 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 532fceed-acb2-4cc9-9a5c-60791fb1aab3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:39.920389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-284ab3b7-ed0d-439b-8ed2-c97cd57e2c17 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:39.920880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-284ab3b7-ed0d-439b-8ed2-c97cd57e2c17 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:39.921660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-284ab3b7-ed0d-439b-8ed2-c97cd57e2c17 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:39.922899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-284ab3b7-ed0d-439b-8ed2-c97cd57e2c17 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:40.080983 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-284ab3b7-ed0d-439b-8ed2-c97cd57e2c17 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:40.092391 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-284ab3b7-ed0d-439b-8ed2-c97cd57e2c17 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3" status: 200 len: 1279 microversion: 2.1 time: 0.188627 Jul 25 12:45:40.098014 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1013/1927] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:39 2022] GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3 => generated 1279 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:40.099662 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5006218e-0d39-47f5-876f-5318eda31fb9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:40.099662 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5006218e-0d39-47f5-876f-5318eda31fb9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:40.117864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5006218e-0d39-47f5-876f-5318eda31fb9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:40.117864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5006218e-0d39-47f5-876f-5318eda31fb9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:40.117864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5006218e-0d39-47f5-876f-5318eda31fb9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:40.117864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5006218e-0d39-47f5-876f-5318eda31fb9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:40.370070 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5006218e-0d39-47f5-876f-5318eda31fb9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:40.379753 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5006218e-0d39-47f5-876f-5318eda31fb9 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1472 microversion: 2.1 time: 0.284985 Jul 25 12:45:40.380934 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1014/1928] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:40 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1472 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:40.385645 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-486d1295-5f81-4d91-a934-bfeb0b071561 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:40.386365 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-486d1295-5f81-4d91-a934-bfeb0b071561 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:40.404774 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-486d1295-5f81-4d91-a934-bfeb0b071561 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:40.405485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-486d1295-5f81-4d91-a934-bfeb0b071561 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:40.406413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-486d1295-5f81-4d91-a934-bfeb0b071561 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:40.407481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-486d1295-5f81-4d91-a934-bfeb0b071561 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:40.502880 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-96fe8722-96e9-42db-a204-5826ac25f060 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "POST /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949/action" status: 202 len: 0 microversion: 2.1 time: 1.470828 Jul 25 12:45:40.503887 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 915/1929] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:45:39 2022] POST /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949/action => generated 0 bytes in 1472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:45:40.511464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f9dcebf0-527f-458a-87e7-5a8caa248a06 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:40.512409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f9dcebf0-527f-458a-87e7-5a8caa248a06 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] [instance: d4033cef-23be-4f49-8c7b-0be4ebde362f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:40.529429 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9dcebf0-527f-458a-87e7-5a8caa248a06 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:40.530411 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9dcebf0-527f-458a-87e7-5a8caa248a06 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:40.532754 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9dcebf0-527f-458a-87e7-5a8caa248a06 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:40.535157 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9dcebf0-527f-458a-87e7-5a8caa248a06 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:40.645841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-486d1295-5f81-4d91-a934-bfeb0b071561 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:40.659781 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-486d1295-5f81-4d91-a934-bfeb0b071561 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:40.668554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-486d1295-5f81-4d91-a934-bfeb0b071561 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:40.670320 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-486d1295-5f81-4d91-a934-bfeb0b071561 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1336 microversion: 2.54 time: 0.288046 Jul 25 12:45:40.681857 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1015/1930] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:40 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1336 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:40.689004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ee7d336a-2f58-414d-a01f-5d986a92377b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:40.689629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ee7d336a-2f58-414d-a01f-5d986a92377b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:40.701646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee7d336a-2f58-414d-a01f-5d986a92377b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:40.702759 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee7d336a-2f58-414d-a01f-5d986a92377b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:40.706813 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee7d336a-2f58-414d-a01f-5d986a92377b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:40.707303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee7d336a-2f58-414d-a01f-5d986a92377b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:41.071454 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f9dcebf0-527f-458a-87e7-5a8caa248a06 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388a9972b4da47d7bda9fd36985eeb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f16e25c9f6f4845922175f67e5583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:41.086493 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f9dcebf0-527f-458a-87e7-5a8caa248a06 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f" status: 200 len: 1394 microversion: 2.1 time: 0.578833 Jul 25 12:45:41.087308 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 916/1931] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:40 2022] GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f => generated 1394 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:41.092329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7cd8827a-c08c-4937-87bc-c0d125f221e4 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:41.093431 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7cd8827a-c08c-4937-87bc-c0d125f221e4 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] [instance: dc20036c-d36c-4fef-a606-0d1820814320] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:41.102340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7cd8827a-c08c-4937-87bc-c0d125f221e4 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:41.108180 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7cd8827a-c08c-4937-87bc-c0d125f221e4 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:41.108180 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7cd8827a-c08c-4937-87bc-c0d125f221e4 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:41.108180 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7cd8827a-c08c-4937-87bc-c0d125f221e4 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:41.162673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ee7d336a-2f58-414d-a01f-5d986a92377b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:41.171099 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ee7d336a-2f58-414d-a01f-5d986a92377b tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1386 microversion: 2.1 time: 0.498998 Jul 25 12:45:41.171666 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1016/1932] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:40 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1386 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:41.178796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-43abdbb2-179e-4bf4-915c-74d3edc18ddb tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-861488342"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:41.179329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-43abdbb2-179e-4bf4-915c-74d3edc18ddb tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:41.181844 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-7cd8827a-c08c-4937-87bc-c0d125f221e4 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] HTTP exception thrown: Instance dc20036c-d36c-4fef-a606-0d1820814320 could not be found. Jul 25 12:45:41.188785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7cd8827a-c08c-4937-87bc-c0d125f221e4 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Request method failure captured: Jul 25 12:45:41.188785 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 HTTP/1.1 Jul 25 12:45:41.188785 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:45:41.188785 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:45:41.188785 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:45:41.188785 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:45:41.188785 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:45:41.188785 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:45:41.188785 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:45:41.188785 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:45:41.188785 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7Cd_8Lqp-0wEwAl8ClXlh_AIOMu3nTsYHwSfoINOAYpM9tKluLVBmtXxrBiVPCdhUkTyHT7iRks30CtQftHX9B2A5Biu0tF7UKx0LS0U7Z4vHIrZWCBQHnd32ujvJYompMUMG4hPPK6j9Oq9zHao-IAqdAE-XzANFWpF3FSd7pbYQ Jul 25 12:45:41.188785 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:45:41.188785 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:45:41.188785 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:45:41.188785 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:45:41.188785 n-d-848886-15 devstack@n-api.service[125883]: X-Openstack-Nova-Api-Version: 2.25 Jul 25 12:45:41.188785 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:45:41.188785 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:45:41.188785 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: bdce4da5878543a4a609dc35e389763c Jul 25 12:45:41.188785 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1761396001 Jul 25 12:45:41.188785 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:45:41.188785 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:45:41.190563 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bdce4da5878543a4a609dc35e389763c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bdce4da5878543a4a609dc35e389763c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bdce4da5878543a4a609dc35e389763c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bdce4da5878543a4a609dc35e389763c"}]}] Jul 25 12:45:41.190563 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1761396001 Jul 25 12:45:41.190563 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: bdce4da5878543a4a609dc35e389763c Jul 25 12:45:41.190563 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1761396001 Jul 25 12:45:41.190563 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-LiveAutoBlockMigrationV225Test-1761396001-project Jul 25 12:45:41.190563 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:45:41.190563 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:45:41.190563 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: fa79a472f31b4e8eb0a6ad709bc84c01 Jul 25 12:45:41.190563 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1761396001-project Jul 25 12:45:41.190563 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:45:41.190563 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance dc20036c-d36c-4fef-a606-0d1820814320 could not be found. Jul 25 12:45:41.190563 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'dc20036c-d36c-4fef-a606-0d1820814320'} Jul 25 12:45:41.191501 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:45:41.191501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:41.191501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:45:41.191501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:45:41.191501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:45:41.191501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:45:41.191501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:45:41.191501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:45:41.191501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:45:41.191501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:45:41.191501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc20036c-d36c-4fef-a606-0d1820814320 could not be found. Jul 25 12:45:41.191501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:41.191501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:41.191501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:41.191501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:41.191501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:41.191501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:41.191501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:45:41.191501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:45:41.191501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:45:41.192918 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:45:41.192918 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:45:41.192918 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:45:41.192918 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:45:41.192918 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:45:41.192918 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:45:41.192918 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:45:41.192918 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc20036c-d36c-4fef-a606-0d1820814320 could not be found. Jul 25 12:45:41.192918 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:41.192918 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:41.192918 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:41.192918 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:41.192918 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:41.192918 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:41.192918 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:45:41.192918 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:45:41.192918 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc20036c-d36c-4fef-a606-0d1820814320 could not be found. Jul 25 12:45:41.192918 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:41.197449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:41.199844 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-43abdbb2-179e-4bf4-915c-74d3edc18ddb tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:41.200116 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7cd8827a-c08c-4937-87bc-c0d125f221e4 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] Returning 404 to user: Instance dc20036c-d36c-4fef-a606-0d1820814320 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:45:41.200308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-43abdbb2-179e-4bf4-915c-74d3edc18ddb tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:41.201105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-43abdbb2-179e-4bf4-915c-74d3edc18ddb tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:41.201660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-43abdbb2-179e-4bf4-915c-74d3edc18ddb tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:41.202139 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7cd8827a-c08c-4937-87bc-c0d125f221e4 tempest-LiveAutoBlockMigrationV225Test-1761396001 tempest-LiveAutoBlockMigrationV225Test-1761396001-project] 10.222.0.49 "GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320" status: 404 len: 111 microversion: 2.25 time: 0.113108 Jul 25 12:45:41.204326 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 917/1933] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:41 2022] GET /compute/v2.1/servers/dc20036c-d36c-4fef-a606-0d1820814320 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:45:41.212076 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-c55ca067-6ca5-4cd2-94d8-ddd76b5de58b req-02ec8a5d-0ee0-496c-85f4-b49f0d21fba9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8bc4a2-d00c-4134-acdc-7b86e0ada949", "tag": "c9e83551-a9ab-4f05-a33e-1ebc6c00a03a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:41.230508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c55ca067-6ca5-4cd2-94d8-ddd76b5de58b req-02ec8a5d-0ee0-496c-85f4-b49f0d21fba9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:41.231356 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c55ca067-6ca5-4cd2-94d8-ddd76b5de58b req-02ec8a5d-0ee0-496c-85f4-b49f0d21fba9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:41.255590 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-c55ca067-6ca5-4cd2-94d8-ddd76b5de58b req-02ec8a5d-0ee0-496c-85f4-b49f0d21fba9 service nova] Creating event network-changed:c9e83551-a9ab-4f05-a33e-1ebc6c00a03a for instance 7a8bc4a2-d00c-4134-acdc-7b86e0ada949 on n-h1-848886-15 Jul 25 12:45:41.267686 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-c55ca067-6ca5-4cd2-94d8-ddd76b5de58b req-02ec8a5d-0ee0-496c-85f4-b49f0d21fba9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061754 Jul 25 12:45:41.270060 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 918/1934] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:41.281810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3c804b1f-5e75-4cd4-b0a9-06b320d8ca34 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:41.284339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3c804b1f-5e75-4cd4-b0a9-06b320d8ca34 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:41.310181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c804b1f-5e75-4cd4-b0a9-06b320d8ca34 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:41.310864 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c804b1f-5e75-4cd4-b0a9-06b320d8ca34 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:41.312563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c804b1f-5e75-4cd4-b0a9-06b320d8ca34 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:41.312563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c804b1f-5e75-4cd4-b0a9-06b320d8ca34 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:41.931717 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.network.security_group_api [None req-43abdbb2-179e-4bf4-915c-74d3edc18ddb tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Adding security group 0448c389-1a73-4182-98bf-c83dc1c55081 to port c9e83551-a9ab-4f05-a33e-1ebc6c00a03a Jul 25 12:45:42.031408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3c804b1f-5e75-4cd4-b0a9-06b320d8ca34 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929ae21affaf4eb9b8eba955745aa751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59f31c830d544129310056d267f465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:42.039793 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3c804b1f-5e75-4cd4-b0a9-06b320d8ca34 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e" status: 200 len: 1371 microversion: 2.1 time: 0.767735 Jul 25 12:45:42.053874 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 919/1935] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:41 2022] GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e => generated 1371 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:42.068963 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-23b4915f-05f1-4ffd-a0fd-787ad708d8b3 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:42.071551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-23b4915f-05f1-4ffd-a0fd-787ad708d8b3 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 532fceed-acb2-4cc9-9a5c-60791fb1aab3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:42.085434 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-23b4915f-05f1-4ffd-a0fd-787ad708d8b3 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:42.096751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-23b4915f-05f1-4ffd-a0fd-787ad708d8b3 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:42.098003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-23b4915f-05f1-4ffd-a0fd-787ad708d8b3 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:42.098560 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-23b4915f-05f1-4ffd-a0fd-787ad708d8b3 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:42.339191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:42.375341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:42.755036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-23b4915f-05f1-4ffd-a0fd-787ad708d8b3 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:42.770301 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-23b4915f-05f1-4ffd-a0fd-787ad708d8b3 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3" status: 200 len: 1321 microversion: 2.1 time: 0.724303 Jul 25 12:45:42.772049 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 920/1936] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:42 2022] GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3 => generated 1321 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:42.791698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-24eec08a-1d55-48b9-b400-437b30f3c7c0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:42.793077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-24eec08a-1d55-48b9-b400-437b30f3c7c0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:42.803071 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-24eec08a-1d55-48b9-b400-437b30f3c7c0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:42.803977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-24eec08a-1d55-48b9-b400-437b30f3c7c0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:42.806210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-24eec08a-1d55-48b9-b400-437b30f3c7c0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:42.807905 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-24eec08a-1d55-48b9-b400-437b30f3c7c0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:43.704858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-24eec08a-1d55-48b9-b400-437b30f3c7c0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:43.719580 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-24eec08a-1d55-48b9-b400-437b30f3c7c0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1472 microversion: 2.1 time: 0.934021 Jul 25 12:45:43.735511 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 921/1937] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:42 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1472 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:43.742392 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3b2eea67-791c-41e9-a1b3-bff61a2dcc50 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:43.743634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3b2eea67-791c-41e9-a1b3-bff61a2dcc50 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:43.752152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b2eea67-791c-41e9-a1b3-bff61a2dcc50 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:43.753559 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b2eea67-791c-41e9-a1b3-bff61a2dcc50 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:43.754669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b2eea67-791c-41e9-a1b3-bff61a2dcc50 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:43.755268 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b2eea67-791c-41e9-a1b3-bff61a2dcc50 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:43.783281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:43.888207 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3b2eea67-791c-41e9-a1b3-bff61a2dcc50 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:43.928031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3b2eea67-791c-41e9-a1b3-bff61a2dcc50 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:43.933281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3b2eea67-791c-41e9-a1b3-bff61a2dcc50 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:43.935427 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3b2eea67-791c-41e9-a1b3-bff61a2dcc50 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1336 microversion: 2.54 time: 0.197886 Jul 25 12:45:43.939623 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 922/1938] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:43 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1336 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:43.949293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cafe55ed-fe8e-42f6-9929-1d0eccbcbf0f tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:43.954438 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cafe55ed-fe8e-42f6-9929-1d0eccbcbf0f tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] [instance: d4033cef-23be-4f49-8c7b-0be4ebde362f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:43.969032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cafe55ed-fe8e-42f6-9929-1d0eccbcbf0f tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:43.971493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cafe55ed-fe8e-42f6-9929-1d0eccbcbf0f tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:43.972440 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cafe55ed-fe8e-42f6-9929-1d0eccbcbf0f tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:43.974262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cafe55ed-fe8e-42f6-9929-1d0eccbcbf0f tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:43.979649 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-43abdbb2-179e-4bf4-915c-74d3edc18ddb tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "POST /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949/action" status: 202 len: 0 microversion: 2.1 time: 2.807009 Jul 25 12:45:43.980636 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1017/1939] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:45:41 2022] POST /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949/action => generated 0 bytes in 2808 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:45:43.985697 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0cebaa71-2aa3-4550-b2ea-271c6eaab3c6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:43.986371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0cebaa71-2aa3-4550-b2ea-271c6eaab3c6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:44.005126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0cebaa71-2aa3-4550-b2ea-271c6eaab3c6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:44.005580 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0cebaa71-2aa3-4550-b2ea-271c6eaab3c6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:44.006633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0cebaa71-2aa3-4550-b2ea-271c6eaab3c6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:44.007075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0cebaa71-2aa3-4550-b2ea-271c6eaab3c6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:44.709063 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cafe55ed-fe8e-42f6-9929-1d0eccbcbf0f tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388a9972b4da47d7bda9fd36985eeb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f16e25c9f6f4845922175f67e5583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:44.719788 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cafe55ed-fe8e-42f6-9929-1d0eccbcbf0f tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f" status: 200 len: 1575 microversion: 2.1 time: 0.778754 Jul 25 12:45:44.720961 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 923/1940] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:43 2022] GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f => generated 1575 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:44.739151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-03e4b6bc-d03c-4bd4-94e6-4ef32c156c04 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:44.740258 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-03e4b6bc-d03c-4bd4-94e6-4ef32c156c04 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:44.754108 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-03e4b6bc-d03c-4bd4-94e6-4ef32c156c04 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:44.754939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-03e4b6bc-d03c-4bd4-94e6-4ef32c156c04 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:44.756005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-03e4b6bc-d03c-4bd4-94e6-4ef32c156c04 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:44.756639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-03e4b6bc-d03c-4bd4-94e6-4ef32c156c04 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:44.855127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0cebaa71-2aa3-4550-b2ea-271c6eaab3c6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:44.863220 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0cebaa71-2aa3-4550-b2ea-271c6eaab3c6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1386 microversion: 2.1 time: 0.881238 Jul 25 12:45:44.864042 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1018/1941] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:43 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1386 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:44.869188 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-91eee452-adea-434c-b817-7a052e8351b7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:44.870035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-91eee452-adea-434c-b817-7a052e8351b7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 532fceed-acb2-4cc9-9a5c-60791fb1aab3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:44.876311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91eee452-adea-434c-b817-7a052e8351b7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:44.876985 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91eee452-adea-434c-b817-7a052e8351b7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:44.878015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91eee452-adea-434c-b817-7a052e8351b7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:44.878454 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91eee452-adea-434c-b817-7a052e8351b7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:44.881433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:45.045734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-03e4b6bc-d03c-4bd4-94e6-4ef32c156c04 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929ae21affaf4eb9b8eba955745aa751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59f31c830d544129310056d267f465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:45.071017 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-03e4b6bc-d03c-4bd4-94e6-4ef32c156c04 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e" status: 200 len: 1371 microversion: 2.1 time: 0.348536 Jul 25 12:45:45.086662 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 924/1942] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:44 2022] GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e => generated 1371 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:45.092057 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-604cd7f9-a85b-47a6-8e29-a4e08419485e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:45.093500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-604cd7f9-a85b-47a6-8e29-a4e08419485e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:45.106507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-604cd7f9-a85b-47a6-8e29-a4e08419485e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:45.107243 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-604cd7f9-a85b-47a6-8e29-a4e08419485e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:45.108319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-604cd7f9-a85b-47a6-8e29-a4e08419485e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:45.108931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-604cd7f9-a85b-47a6-8e29-a4e08419485e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:45.177795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-91eee452-adea-434c-b817-7a052e8351b7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:45.187791 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-91eee452-adea-434c-b817-7a052e8351b7 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3" status: 200 len: 1321 microversion: 2.1 time: 0.322423 Jul 25 12:45:45.202353 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1019/1943] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:44 2022] GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3 => generated 1321 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:45.207548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-e35a2803-0e89-457d-9d7f-9bd83831ac17 req-cdcc7fe7-11db-4d5e-a068-5459e85efe62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8bc4a2-d00c-4134-acdc-7b86e0ada949", "tag": "c9e83551-a9ab-4f05-a33e-1ebc6c00a03a"}, {"name": "network-changed", "server_uuid": "532fceed-acb2-4cc9-9a5c-60791fb1aab3", "tag": "d85ec8b3-b47d-46d5-9f3e-348d4076256a"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:45.220575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e35a2803-0e89-457d-9d7f-9bd83831ac17 req-cdcc7fe7-11db-4d5e-a068-5459e85efe62 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:45.221328 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e35a2803-0e89-457d-9d7f-9bd83831ac17 req-cdcc7fe7-11db-4d5e-a068-5459e85efe62 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:45.237475 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-e35a2803-0e89-457d-9d7f-9bd83831ac17 req-cdcc7fe7-11db-4d5e-a068-5459e85efe62 service nova] Creating event network-changed:c9e83551-a9ab-4f05-a33e-1ebc6c00a03a for instance 7a8bc4a2-d00c-4134-acdc-7b86e0ada949 on n-h1-848886-15 Jul 25 12:45:45.238342 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-e35a2803-0e89-457d-9d7f-9bd83831ac17 req-cdcc7fe7-11db-4d5e-a068-5459e85efe62 service nova] Creating event network-changed:d85ec8b3-b47d-46d5-9f3e-348d4076256a for instance 532fceed-acb2-4cc9-9a5c-60791fb1aab3 on n-h1-848886-15 Jul 25 12:45:45.244998 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-e35a2803-0e89-457d-9d7f-9bd83831ac17 req-cdcc7fe7-11db-4d5e-a068-5459e85efe62 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040962 Jul 25 12:45:45.246225 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1020/1944] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:45.251661 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2e74ef08-cc6f-4bdf-a077-09d74865297c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:45.253421 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2e74ef08-cc6f-4bdf-a077-09d74865297c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:45.260996 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2e74ef08-cc6f-4bdf-a077-09d74865297c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:45.261771 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2e74ef08-cc6f-4bdf-a077-09d74865297c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:45.262753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2e74ef08-cc6f-4bdf-a077-09d74865297c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:45.263347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2e74ef08-cc6f-4bdf-a077-09d74865297c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:45.572845 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-604cd7f9-a85b-47a6-8e29-a4e08419485e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.484949 Jul 25 12:45:45.573669 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 925/1945] 10.222.0.49 () {58 vars in 1293 bytes} [Mon Jul 25 12:45:45 2022] GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949/os-security-groups => generated 1155 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:45.581730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-09aa8541-8841-4de7-97d1-68f35c37c8d9 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:45.582503 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-09aa8541-8841-4de7-97d1-68f35c37c8d9 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] [instance: d4033cef-23be-4f49-8c7b-0be4ebde362f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:45.590319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09aa8541-8841-4de7-97d1-68f35c37c8d9 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:45.591406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09aa8541-8841-4de7-97d1-68f35c37c8d9 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:45.592810 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2e74ef08-cc6f-4bdf-a077-09d74865297c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:45.593278 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09aa8541-8841-4de7-97d1-68f35c37c8d9 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:45.594239 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09aa8541-8841-4de7-97d1-68f35c37c8d9 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:45.601691 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2e74ef08-cc6f-4bdf-a077-09d74865297c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1472 microversion: 2.1 time: 0.354050 Jul 25 12:45:45.603570 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1021/1946] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:45 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1472 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:45.615152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0ef52bb8-85c5-4c74-811a-7294869de30a tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:45.615779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0ef52bb8-85c5-4c74-811a-7294869de30a tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:45.637760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ef52bb8-85c5-4c74-811a-7294869de30a tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:45.638333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ef52bb8-85c5-4c74-811a-7294869de30a tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:45.639205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ef52bb8-85c5-4c74-811a-7294869de30a tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:45.639776 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ef52bb8-85c5-4c74-811a-7294869de30a tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:45.806646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0ef52bb8-85c5-4c74-811a-7294869de30a tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:45.817414 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0ef52bb8-85c5-4c74-811a-7294869de30a tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:45.819212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0ef52bb8-85c5-4c74-811a-7294869de30a tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:45.820736 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0ef52bb8-85c5-4c74-811a-7294869de30a tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1336 microversion: 2.54 time: 0.215949 Jul 25 12:45:45.822171 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1022/1947] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:45 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1336 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:45.827242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-375ef9d3-e791-4efe-9437-8a6c4627263e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Action: 'create', calling method: .version_select at 0x7efcf93349d0>, body: {"security_group": {"name": " tempest-securitygroup -1815107375 ", "description": "tempest-description-692259142"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:45.832404 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-09aa8541-8841-4de7-97d1-68f35c37c8d9 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.257410 Jul 25 12:45:45.834008 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 926/1948] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 12:45:45 2022] GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f/os-interface => generated 285 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:45.884547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6b83ed20-df53-4804-9e0d-1a9a382e84e9 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:45.885167 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6b83ed20-df53-4804-9e0d-1a9a382e84e9 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:45.899551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b83ed20-df53-4804-9e0d-1a9a382e84e9 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:45.899551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b83ed20-df53-4804-9e0d-1a9a382e84e9 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:45.899551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b83ed20-df53-4804-9e0d-1a9a382e84e9 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:45.899551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b83ed20-df53-4804-9e0d-1a9a382e84e9 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:46.308663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:46.367557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=7 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:46.456918 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6b83ed20-df53-4804-9e0d-1a9a382e84e9 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:46.465291 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6b83ed20-df53-4804-9e0d-1a9a382e84e9 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1386 microversion: 2.1 time: 0.584648 Jul 25 12:45:46.478182 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 927/1949] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:45 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1386 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:45:46.484559 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c3b08598-cf80-4022-8567-09a1aa6ec36e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:46.485301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c3b08598-cf80-4022-8567-09a1aa6ec36e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:46.492724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3b08598-cf80-4022-8567-09a1aa6ec36e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:46.493627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3b08598-cf80-4022-8567-09a1aa6ec36e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:46.494690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3b08598-cf80-4022-8567-09a1aa6ec36e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:46.495221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3b08598-cf80-4022-8567-09a1aa6ec36e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:47.018655 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-375ef9d3-e791-4efe-9437-8a6c4627263e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 1.194896 Jul 25 12:45:47.019751 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1023/1950] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:45:45 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:47.026397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9ac690aa-c480-49e3-8b6d-ce0c759cd622 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:47.027408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9ac690aa-c480-49e3-8b6d-ce0c759cd622 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 532fceed-acb2-4cc9-9a5c-60791fb1aab3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:47.052693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ac690aa-c480-49e3-8b6d-ce0c759cd622 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:47.054666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ac690aa-c480-49e3-8b6d-ce0c759cd622 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:47.058270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ac690aa-c480-49e3-8b6d-ce0c759cd622 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:47.059531 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ac690aa-c480-49e3-8b6d-ce0c759cd622 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:47.663243 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c3b08598-cf80-4022-8567-09a1aa6ec36e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929ae21affaf4eb9b8eba955745aa751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59f31c830d544129310056d267f465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:47.682119 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c3b08598-cf80-4022-8567-09a1aa6ec36e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e" status: 200 len: 1371 microversion: 2.1 time: 1.202495 Jul 25 12:45:47.695972 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 928/1951] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:46 2022] GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e => generated 1371 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:47.704281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dcddeb71-85e7-4c9b-bf9b-c7581fcc0d1f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:47.705997 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dcddeb71-85e7-4c9b-bf9b-c7581fcc0d1f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:47.713806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dcddeb71-85e7-4c9b-bf9b-c7581fcc0d1f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:47.714651 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dcddeb71-85e7-4c9b-bf9b-c7581fcc0d1f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:47.716270 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dcddeb71-85e7-4c9b-bf9b-c7581fcc0d1f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:47.716714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dcddeb71-85e7-4c9b-bf9b-c7581fcc0d1f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:47.811994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9ac690aa-c480-49e3-8b6d-ce0c759cd622 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:47.824402 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9ac690aa-c480-49e3-8b6d-ce0c759cd622 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3" status: 200 len: 1321 microversion: 2.1 time: 0.802293 Jul 25 12:45:47.825341 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1024/1952] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:47 2022] GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3 => generated 1321 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:47.831912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8c45516c-d3d2-4843-8350-3fc1ca4044ee tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:47.832868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8c45516c-d3d2-4843-8350-3fc1ca4044ee tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:47.841209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c45516c-d3d2-4843-8350-3fc1ca4044ee tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:47.842284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c45516c-d3d2-4843-8350-3fc1ca4044ee tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:47.843340 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c45516c-d3d2-4843-8350-3fc1ca4044ee tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:47.844602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c45516c-d3d2-4843-8350-3fc1ca4044ee tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:48.035404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8c45516c-d3d2-4843-8350-3fc1ca4044ee tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:48.047237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8c45516c-d3d2-4843-8350-3fc1ca4044ee tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:48.049178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8c45516c-d3d2-4843-8350-3fc1ca4044ee tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:48.051536 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8c45516c-d3d2-4843-8350-3fc1ca4044ee tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1357 microversion: 2.54 time: 0.224977 Jul 25 12:45:48.052932 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1025/1953] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:47 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1357 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:48.065540 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dbe72ce6-19a6-424c-9ab6-08120893cdaf tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcf93fc9d0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:48.347719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dcddeb71-85e7-4c9b-bf9b-c7581fcc0d1f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:48.355382 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dcddeb71-85e7-4c9b-bf9b-c7581fcc0d1f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1472 microversion: 2.1 time: 0.655088 Jul 25 12:45:48.369641 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 929/1954] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:47 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1472 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:48.375141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4bcb7348-c02a-4f65-b485-0954e0e2e0b1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:48.375760 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4bcb7348-c02a-4f65-b485-0954e0e2e0b1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:48.382665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4bcb7348-c02a-4f65-b485-0954e0e2e0b1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:48.383432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4bcb7348-c02a-4f65-b485-0954e0e2e0b1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:48.384389 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4bcb7348-c02a-4f65-b485-0954e0e2e0b1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:48.385017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4bcb7348-c02a-4f65-b485-0954e0e2e0b1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:48.444020 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dbe72ce6-19a6-424c-9ab6-08120893cdaf tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/cf6b7471-bc6c-4c81-909e-6965851a515b" status: 200 len: 223 microversion: 2.1 time: 0.389708 Jul 25 12:45:48.445379 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1026/1955] 10.222.0.49 () {58 vars in 1269 bytes} [Mon Jul 25 12:45:48 2022] GET /compute/v2.1/os-security-groups/cf6b7471-bc6c-4c81-909e-6965851a515b => generated 223 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:48.451688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a67a4d60-b17a-45f6-be68-83844e00c543 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Action: 'create', calling method: .version_select at 0x7efcf92fe940>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1976479063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvjbVXH3E7H98JxNMqWWc4k3E2diTa1mPEBKUnLgQuZSyozk2agocYGUNWSit/9NZTEEd94qcZYg3dTr/0NRYRX9QuziupvMiKLH6X85hAAZ0vJG/UJEpFKKsgVKiKOTA=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:48.471384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-a67a4d60-b17a-45f6-be68-83844e00c543 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Getting quotas for project 5b4515023e7349bcae2abe4915659a2a. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:45:48.477751 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-a67a4d60-b17a-45f6-be68-83844e00c543 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Getting quotas for user 9932c91be25442bc9682cbe7a3440e88 and project 5b4515023e7349bcae2abe4915659a2a. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:45:48.519158 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a67a4d60-b17a-45f6-be68-83844e00c543 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.072352 Jul 25 12:45:48.520083 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1027/1956] 10.222.0.49 () {62 vars in 1200 bytes} [Mon Jul 25 12:45:48 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 74 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 12:45:48.525187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b088c5bf-7f96-40d2-ad7a-6dcc9ede2a8b tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcf9fe44c0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:48.551636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4bcb7348-c02a-4f65-b485-0954e0e2e0b1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:48.559758 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4bcb7348-c02a-4f65-b485-0954e0e2e0b1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1344 microversion: 2.1 time: 0.188730 Jul 25 12:45:48.560353 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 930/1957] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:48 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1344 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:48.565191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-41b4f3f7-4860-435e-a2b3-ca1e3edd4727 req-b1fb8f02-2128-4214-91d7-06854a342e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "791ea14d-3fa9-4be1-afc1-82c8908395f4", "name": "network-vif-deleted", "tag": "0f801405-35d3-471d-9010-4dc3d6d5eec1"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:48.576705 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-41b4f3f7-4860-435e-a2b3-ca1e3edd4727 req-b1fb8f02-2128-4214-91d7-06854a342e3d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:48.577363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-41b4f3f7-4860-435e-a2b3-ca1e3edd4727 req-b1fb8f02-2128-4214-91d7-06854a342e3d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:48.597430 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-41b4f3f7-4860-435e-a2b3-ca1e3edd4727 req-b1fb8f02-2128-4214-91d7-06854a342e3d service nova] Creating event network-vif-deleted:0f801405-35d3-471d-9010-4dc3d6d5eec1 for instance 791ea14d-3fa9-4be1-afc1-82c8908395f4 on n-h2-848886-15 Jul 25 12:45:48.606211 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-41b4f3f7-4860-435e-a2b3-ca1e3edd4727 req-b1fb8f02-2128-4214-91d7-06854a342e3d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043388 Jul 25 12:45:48.607874 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 931/1958] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:48.620749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-163acb55-48f1-4164-8a46-edaf0576daa2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1976479063", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:48.624783 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-163acb55-48f1-4164-8a46-edaf0576daa2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:48.641812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-163acb55-48f1-4164-8a46-edaf0576daa2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:48.642471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-163acb55-48f1-4164-8a46-edaf0576daa2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:48.643466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-163acb55-48f1-4164-8a46-edaf0576daa2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:48.643996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-163acb55-48f1-4164-8a46-edaf0576daa2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:48.776985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-163acb55-48f1-4164-8a46-edaf0576daa2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:45:48.777701 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-163acb55-48f1-4164-8a46-edaf0576daa2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:45:48.778235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-163acb55-48f1-4164-8a46-edaf0576daa2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:45:48.778745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-163acb55-48f1-4164-8a46-edaf0576daa2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:45:48.779250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-163acb55-48f1-4164-8a46-edaf0576daa2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:45:48.995728 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-163acb55-48f1-4164-8a46-edaf0576daa2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:49.663180 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-163acb55-48f1-4164-8a46-edaf0576daa2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:49.666058 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-163acb55-48f1-4164-8a46-edaf0576daa2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:49.667229 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-163acb55-48f1-4164-8a46-edaf0576daa2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:49.670678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-163acb55-48f1-4164-8a46-edaf0576daa2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:49.783271 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-163acb55-48f1-4164-8a46-edaf0576daa2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "POST /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea/action" status: 202 len: 1140 microversion: 2.54 time: 1.174026 Jul 25 12:45:49.795678 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 932/1959] 10.222.0.49 () {62 vars in 1320 bytes} [Mon Jul 25 12:45:48 2022] POST /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea/action => generated 1140 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 12:45:49.802605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-de551479-8b53-412a-9e27-de401e32fed2 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:49.803230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-de551479-8b53-412a-9e27-de401e32fed2 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:49.827562 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de551479-8b53-412a-9e27-de401e32fed2 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:49.828045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de551479-8b53-412a-9e27-de401e32fed2 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:49.828852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de551479-8b53-412a-9e27-de401e32fed2 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:49.830982 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de551479-8b53-412a-9e27-de401e32fed2 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:50.278244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-de551479-8b53-412a-9e27-de401e32fed2 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929ae21affaf4eb9b8eba955745aa751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59f31c830d544129310056d267f465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:50.293381 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-de551479-8b53-412a-9e27-de401e32fed2 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e" status: 200 len: 1371 microversion: 2.1 time: 0.494457 Jul 25 12:45:50.295069 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 933/1960] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:49 2022] GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e => generated 1371 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:50.308676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-38435851-a5ac-4adb-9b3e-21b35385eccc req-794990ce-2cc3-4b75-b8ca-e7098f8c28c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "532fceed-acb2-4cc9-9a5c-60791fb1aab3", "name": "network-vif-plugged", "status": "completed", "tag": "d85ec8b3-b47d-46d5-9f3e-348d4076256a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:50.331299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-38435851-a5ac-4adb-9b3e-21b35385eccc req-794990ce-2cc3-4b75-b8ca-e7098f8c28c9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:50.334311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-38435851-a5ac-4adb-9b3e-21b35385eccc req-794990ce-2cc3-4b75-b8ca-e7098f8c28c9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:50.354354 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b088c5bf-7f96-40d2-ad7a-6dcc9ede2a8b tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/cf6b7471-bc6c-4c81-909e-6965851a515b" status: 202 len: 0 microversion: 2.1 time: 1.833269 Jul 25 12:45:50.355733 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1028/1961] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:45:48 2022] DELETE /compute/v2.1/os-security-groups/cf6b7471-bc6c-4c81-909e-6965851a515b => generated 0 bytes in 1835 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:45:50.360693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0e3f6769-f0b9-458b-9aac-553cfa5eb453 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:50.361535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0e3f6769-f0b9-458b-9aac-553cfa5eb453 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 532fceed-acb2-4cc9-9a5c-60791fb1aab3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:50.395377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e3f6769-f0b9-458b-9aac-553cfa5eb453 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:50.396159 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e3f6769-f0b9-458b-9aac-553cfa5eb453 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:50.397021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e3f6769-f0b9-458b-9aac-553cfa5eb453 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:50.397751 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-38435851-a5ac-4adb-9b3e-21b35385eccc req-794990ce-2cc3-4b75-b8ca-e7098f8c28c9 service nova] Creating event network-vif-plugged:d85ec8b3-b47d-46d5-9f3e-348d4076256a for instance 532fceed-acb2-4cc9-9a5c-60791fb1aab3 on n-h1-848886-15 Jul 25 12:45:50.398396 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e3f6769-f0b9-458b-9aac-553cfa5eb453 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:50.403203 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-38435851-a5ac-4adb-9b3e-21b35385eccc req-794990ce-2cc3-4b75-b8ca-e7098f8c28c9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105323 Jul 25 12:45:50.404542 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 934/1962] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:50.416049 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5d3f29a9-64dd-4cba-932e-7d3f8b7e5d29 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:50.417478 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5d3f29a9-64dd-4cba-932e-7d3f8b7e5d29 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:50.426406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d3f29a9-64dd-4cba-932e-7d3f8b7e5d29 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:50.428830 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d3f29a9-64dd-4cba-932e-7d3f8b7e5d29 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:50.430334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d3f29a9-64dd-4cba-932e-7d3f8b7e5d29 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:50.432690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d3f29a9-64dd-4cba-932e-7d3f8b7e5d29 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:51.090518 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0e3f6769-f0b9-458b-9aac-553cfa5eb453 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:51.101413 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0e3f6769-f0b9-458b-9aac-553cfa5eb453 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3" status: 200 len: 1321 microversion: 2.1 time: 0.744385 Jul 25 12:45:51.102048 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1029/1963] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:50 2022] GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3 => generated 1321 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:51.112296 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c937bd69-4e31-4842-ba06-d6d3a88098e3 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:51.112922 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c937bd69-4e31-4842-ba06-d6d3a88098e3 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:51.120311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5d3f29a9-64dd-4cba-932e-7d3f8b7e5d29 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:51.127142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c937bd69-4e31-4842-ba06-d6d3a88098e3 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:51.127602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c937bd69-4e31-4842-ba06-d6d3a88098e3 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:51.128410 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c937bd69-4e31-4842-ba06-d6d3a88098e3 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:51.128852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c937bd69-4e31-4842-ba06-d6d3a88098e3 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:51.132453 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5d3f29a9-64dd-4cba-932e-7d3f8b7e5d29 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1472 microversion: 2.1 time: 0.726320 Jul 25 12:45:51.152677 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 935/1964] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:50 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1472 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:51.158582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-744fe89d-267d-452c-84a7-9a1f7af716c2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:51.159874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-744fe89d-267d-452c-84a7-9a1f7af716c2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:51.169260 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-744fe89d-267d-452c-84a7-9a1f7af716c2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:51.170178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-744fe89d-267d-452c-84a7-9a1f7af716c2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:51.171333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-744fe89d-267d-452c-84a7-9a1f7af716c2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:51.171988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-744fe89d-267d-452c-84a7-9a1f7af716c2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:51.251157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c937bd69-4e31-4842-ba06-d6d3a88098e3 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:51.265520 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c937bd69-4e31-4842-ba06-d6d3a88098e3 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1183 microversion: 2.1 time: 0.162252 Jul 25 12:45:51.267018 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1030/1965] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:51 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:51.277504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-039af39d-589a-4a3c-b6f2-6f6b23f59ca0 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcf9273d30>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:51.513972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-744fe89d-267d-452c-84a7-9a1f7af716c2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:51.529491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-744fe89d-267d-452c-84a7-9a1f7af716c2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:51.531444 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-744fe89d-267d-452c-84a7-9a1f7af716c2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:51.536987 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-744fe89d-267d-452c-84a7-9a1f7af716c2 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1409 microversion: 2.54 time: 0.380764 Jul 25 12:45:51.538509 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 936/1966] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:51 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1409 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:51.548032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a31f9997-1714-49e3-b5e1-d299228968f9 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:51.548898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a31f9997-1714-49e3-b5e1-d299228968f9 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] [instance: d4033cef-23be-4f49-8c7b-0be4ebde362f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:51.555526 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a31f9997-1714-49e3-b5e1-d299228968f9 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:51.555849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG neutronclient.v2_0.client [None req-039af39d-589a-4a3c-b6f2-6f6b23f59ca0 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cf6b7471-bc6c-4c81-909e-6965851a515b does not exist", "detail": ""}} {{(pid=125884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:45:51.556342 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a31f9997-1714-49e3-b5e1-d299228968f9 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:51.556453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.security_group_api [None req-039af39d-589a-4a3c-b6f2-6f6b23f59ca0 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Neutron security group cf6b7471-bc6c-4c81-909e-6965851a515b not found {{(pid=125884) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 12:45:51.556751 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-039af39d-589a-4a3c-b6f2-6f6b23f59ca0 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] HTTP exception thrown: Security group cf6b7471-bc6c-4c81-909e-6965851a515b does not exist Jul 25 12:45:51.556751 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-1bcf4049-43aa-4414-a9e6-26069686b8f0'] Jul 25 12:45:51.557047 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a31f9997-1714-49e3-b5e1-d299228968f9 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:51.557443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a31f9997-1714-49e3-b5e1-d299228968f9 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:51.558849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-039af39d-589a-4a3c-b6f2-6f6b23f59ca0 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Request method failure captured: Jul 25 12:45:51.558849 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/os-security-groups/cf6b7471-bc6c-4c81-909e-6965851a515b HTTP/1.1 Jul 25 12:45:51.558849 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:45:51.558849 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:45:51.558849 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:45:51.558849 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:45:51.558849 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:45:51.558849 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:45:51.558849 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:45:51.558849 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:45:51.558849 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pBMnvMCkXPIxtXS4OZUlYvEfqLzk8eVB6uOa00GC7XzG0Qi-IKZscbMEZM1xj3l2F-5d5lIAdtnOADbgV21wrMS4dvC7LWzHzoCd7ieXebifkHeaO9Mp4wm9vR5m7HEh9yMTTXFHMqap1mzBebGWb33cT_Byxbl27G3bMxoNj8QlS0 Jul 25 12:45:51.558849 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:45:51.558849 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:45:51.558849 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:45:51.558849 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:45:51.558849 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:45:51.558849 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:45:51.558849 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:45:51.558849 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:45:51.558849 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:45:51.558849 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:45:51.560851 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8514497475b8462b86e28d48a16b0b20", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}] Jul 25 12:45:51.560851 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:45:51.560851 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:45:51.560851 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:45:51.560851 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:45:51.560851 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:45:51.560851 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:45:51.560851 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 3912af6bdd224191910f72160c42db30 Jul 25 12:45:51.560851 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:45:51.560851 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:45:51.560851 n-d-848886-15 devstack@n-api.service[125884]: exception: Security group cf6b7471-bc6c-4c81-909e-6965851a515b does not exist Jul 25 12:45:51.560851 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-1bcf4049-43aa-4414-a9e6-26069686b8f0'] Jul 25 12:45:51.560851 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'cf6b7471-bc6c-4c81-909e-6965851a515b'} Jul 25 12:45:51.562227 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:45:51.562227 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:51.562227 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 12:45:51.562227 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 12:45:51.562227 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:45:51.562227 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:45:51.562227 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 12:45:51.562227 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 12:45:51.562227 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:45:51.562227 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:45:51.562227 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 12:45:51.562227 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 12:45:51.562227 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:45:51.562227 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:45:51.562227 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:45:51.562227 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:45:51.562227 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:45:51.562227 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:45:51.562227 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:45:51.564033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:45:51.564033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:45:51.564033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:45:51.564033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:45:51.564033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:45:51.564033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:45:51.564033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:45:51.564033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cf6b7471-bc6c-4c81-909e-6965851a515b does not exist Jul 25 12:45:51.564033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1bcf4049-43aa-4414-a9e6-26069686b8f0'] Jul 25 12:45:51.564033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:51.564033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:51.564033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:51.564033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:51.564033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 25 12:45:51.564033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 12:45:51.564033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 12:45:51.564033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 12:45:51.564033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cf6b7471-bc6c-4c81-909e-6965851a515b does not exist Jul 25 12:45:51.565628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1bcf4049-43aa-4414-a9e6-26069686b8f0'] Jul 25 12:45:51.565628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:51.565628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:51.565628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:51.565628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:51.565628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:51.565628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:51.565628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:45:51.565628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:45:51.565628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:45:51.565628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:45:51.565628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:45:51.565628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:45:51.565628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 25 12:45:51.565628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 12:45:51.565628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cf6b7471-bc6c-4c81-909e-6965851a515b does not exist Jul 25 12:45:51.565628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1bcf4049-43aa-4414-a9e6-26069686b8f0'] Jul 25 12:45:51.565628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:51.565628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:51.565628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:51.565628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:51.567871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:51.567871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:51.567871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:45:51.567871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:45:51.567871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cf6b7471-bc6c-4c81-909e-6965851a515b does not exist Jul 25 12:45:51.567871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1bcf4049-43aa-4414-a9e6-26069686b8f0'] Jul 25 12:45:51.567871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:51.567871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-039af39d-589a-4a3c-b6f2-6f6b23f59ca0 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Returning 404 to user: Security group cf6b7471-bc6c-4c81-909e-6965851a515b does not exist Jul 25 12:45:51.567871 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-1bcf4049-43aa-4414-a9e6-26069686b8f0'] {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:45:51.567871 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-039af39d-589a-4a3c-b6f2-6f6b23f59ca0 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/cf6b7471-bc6c-4c81-909e-6965851a515b" status: 404 len: 194 microversion: 2.1 time: 0.291641 Jul 25 12:45:51.567871 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1031/1967] 10.222.0.49 () {58 vars in 1269 bytes} [Mon Jul 25 12:45:51 2022] GET /compute/v2.1/os-security-groups/cf6b7471-bc6c-4c81-909e-6965851a515b => generated 194 bytes in 293 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:45:51.571878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-f862d0f8-83ef-4de0-b504-1520ca8a59cb req-c401f9fa-c6d1-473c-b6d7-2998636b22fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4033cef-23be-4f49-8c7b-0be4ebde362f", "tag": "a89273b4-19ae-401f-9b9d-63eac14ed636"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:51.595985 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f862d0f8-83ef-4de0-b504-1520ca8a59cb req-c401f9fa-c6d1-473c-b6d7-2998636b22fc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:51.598327 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f862d0f8-83ef-4de0-b504-1520ca8a59cb req-c401f9fa-c6d1-473c-b6d7-2998636b22fc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:51.619667 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-f862d0f8-83ef-4de0-b504-1520ca8a59cb req-c401f9fa-c6d1-473c-b6d7-2998636b22fc service nova] Creating event network-changed:a89273b4-19ae-401f-9b9d-63eac14ed636 for instance d4033cef-23be-4f49-8c7b-0be4ebde362f on n-h2-848886-15 Jul 25 12:45:51.646728 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-f862d0f8-83ef-4de0-b504-1520ca8a59cb req-c401f9fa-c6d1-473c-b6d7-2998636b22fc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083767 Jul 25 12:45:51.648706 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1032/1968] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:51.664690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7de1fc7f-fcd4-4ae9-9851-e05f73d60786 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:51.667817 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7de1fc7f-fcd4-4ae9-9851-e05f73d60786 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:51.678203 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7de1fc7f-fcd4-4ae9-9851-e05f73d60786 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:51.684133 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7de1fc7f-fcd4-4ae9-9851-e05f73d60786 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:51.685219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7de1fc7f-fcd4-4ae9-9851-e05f73d60786 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:51.685856 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7de1fc7f-fcd4-4ae9-9851-e05f73d60786 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:51.863564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a31f9997-1714-49e3-b5e1-d299228968f9 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388a9972b4da47d7bda9fd36985eeb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f16e25c9f6f4845922175f67e5583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:51.879992 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a31f9997-1714-49e3-b5e1-d299228968f9 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f" status: 200 len: 1575 microversion: 2.1 time: 0.338896 Jul 25 12:45:51.881096 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 937/1969] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:51 2022] GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f => generated 1575 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:51.886129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-15564acc-c782-4499-a56d-2ba8af1a6ac1 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Action: 'create', calling method: .version_select at 0x7efcf905c4c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-88048756", "description": "tempest-description-399600421"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:52.202362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7de1fc7f-fcd4-4ae9-9851-e05f73d60786 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929ae21affaf4eb9b8eba955745aa751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59f31c830d544129310056d267f465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:52.214496 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7de1fc7f-fcd4-4ae9-9851-e05f73d60786 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e" status: 200 len: 1371 microversion: 2.1 time: 0.564144 Jul 25 12:45:52.226922 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1033/1970] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:51 2022] GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e => generated 1371 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:52.235466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b9241423-e6d4-4703-9565-7dc00904de2a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:52.236848 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b9241423-e6d4-4703-9565-7dc00904de2a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 532fceed-acb2-4cc9-9a5c-60791fb1aab3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:52.243667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b9241423-e6d4-4703-9565-7dc00904de2a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:52.244365 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b9241423-e6d4-4703-9565-7dc00904de2a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:52.245410 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b9241423-e6d4-4703-9565-7dc00904de2a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:52.247106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b9241423-e6d4-4703-9565-7dc00904de2a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:52.613736 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-15564acc-c782-4499-a56d-2ba8af1a6ac1 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.731363 Jul 25 12:45:52.614624 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 938/1971] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:45:51 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:52.621935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b302c702-5fc8-480c-bab3-f637f14c31cf tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:52.621935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b302c702-5fc8-480c-bab3-f637f14c31cf tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:52.632644 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:52.635073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b302c702-5fc8-480c-bab3-f637f14c31cf tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:52.635539 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b302c702-5fc8-480c-bab3-f637f14c31cf tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:52.636335 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b302c702-5fc8-480c-bab3-f637f14c31cf tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:52.636774 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b302c702-5fc8-480c-bab3-f637f14c31cf tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:52.650181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b9241423-e6d4-4703-9565-7dc00904de2a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:52.659615 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b9241423-e6d4-4703-9565-7dc00904de2a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3" status: 200 len: 1321 microversion: 2.1 time: 0.430924 Jul 25 12:45:52.677860 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1034/1972] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:52 2022] GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3 => generated 1321 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:52.683016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fb9fb61b-0f83-4429-9ead-d311b93624a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:52.684212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fb9fb61b-0f83-4429-9ead-d311b93624a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:52.692410 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:52.696629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb9fb61b-0f83-4429-9ead-d311b93624a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:52.697284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb9fb61b-0f83-4429-9ead-d311b93624a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:52.698205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb9fb61b-0f83-4429-9ead-d311b93624a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:52.698789 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb9fb61b-0f83-4429-9ead-d311b93624a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:52.917246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fb9fb61b-0f83-4429-9ead-d311b93624a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:52.929677 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fb9fb61b-0f83-4429-9ead-d311b93624a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1183 microversion: 2.1 time: 0.261009 Jul 25 12:45:52.932969 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1035/1973] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:52 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1183 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:52.942990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5fcf78ec-1611-45fd-a457-d545bb986c77 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:52.954701 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5fcf78ec-1611-45fd-a457-d545bb986c77 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:52.970954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5fcf78ec-1611-45fd-a457-d545bb986c77 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:52.971415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5fcf78ec-1611-45fd-a457-d545bb986c77 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:52.972199 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5fcf78ec-1611-45fd-a457-d545bb986c77 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:52.972631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5fcf78ec-1611-45fd-a457-d545bb986c77 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:52.995494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b302c702-5fc8-480c-bab3-f637f14c31cf tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:53.003911 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b302c702-5fc8-480c-bab3-f637f14c31cf tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1472 microversion: 2.1 time: 0.387824 Jul 25 12:45:53.007598 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 939/1974] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:52 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1472 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:53.019053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a86c29e2-dfd0-45b9-af19-dfe45b145bdc tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Action: 'create', calling method: .version_select at 0x7efcf906ce50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1925164759", "description": "tempest-description-1574803583"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:53.405566 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5fcf78ec-1611-45fd-a457-d545bb986c77 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:53.425495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5fcf78ec-1611-45fd-a457-d545bb986c77 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:53.430863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5fcf78ec-1611-45fd-a457-d545bb986c77 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:53.434133 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5fcf78ec-1611-45fd-a457-d545bb986c77 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1409 microversion: 2.54 time: 0.499205 Jul 25 12:45:53.435953 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1036/1975] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:52 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1409 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:53.444093 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0677b619-c1d3-4290-a891-ab6c281798d9 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:53.445385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0677b619-c1d3-4290-a891-ab6c281798d9 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:53.456485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0677b619-c1d3-4290-a891-ab6c281798d9 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:53.457437 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0677b619-c1d3-4290-a891-ab6c281798d9 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:53.459206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0677b619-c1d3-4290-a891-ab6c281798d9 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:53.460109 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0677b619-c1d3-4290-a891-ab6c281798d9 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:53.857559 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0677b619-c1d3-4290-a891-ab6c281798d9 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929ae21affaf4eb9b8eba955745aa751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59f31c830d544129310056d267f465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:53.866040 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0677b619-c1d3-4290-a891-ab6c281798d9 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e" status: 200 len: 1371 microversion: 2.1 time: 0.427294 Jul 25 12:45:53.880997 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1037/1976] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:53 2022] GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e => generated 1371 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:53.906010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5362dc37-f341-4413-93eb-6e6bc8fa3549 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:53.907424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5362dc37-f341-4413-93eb-6e6bc8fa3549 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 532fceed-acb2-4cc9-9a5c-60791fb1aab3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:53.914561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5362dc37-f341-4413-93eb-6e6bc8fa3549 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:53.915034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5362dc37-f341-4413-93eb-6e6bc8fa3549 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:53.915816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5362dc37-f341-4413-93eb-6e6bc8fa3549 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:53.916723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5362dc37-f341-4413-93eb-6e6bc8fa3549 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:53.936592 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a86c29e2-dfd0-45b9-af19-dfe45b145bdc tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.927550 Jul 25 12:45:53.938678 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 940/1977] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:45:53 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:53.951842 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ba834a70-f8fa-487a-aaa2-3d2910981c26 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Action: 'create', calling method: .version_select at 0x7efcfeccf700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1009572167", "description": "tempest-description-1490781844"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:54.286438 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5362dc37-f341-4413-93eb-6e6bc8fa3549 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:54.298026 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5362dc37-f341-4413-93eb-6e6bc8fa3549 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3" status: 200 len: 1471 microversion: 2.1 time: 0.415565 Jul 25 12:45:54.301153 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1038/1978] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:53 2022] GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3 => generated 1471 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:54.314287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-77dbb1a3-74f4-48bc-a6dc-b8b90131d5a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:54.314905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-77dbb1a3-74f4-48bc-a6dc-b8b90131d5a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:54.327216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-77dbb1a3-74f4-48bc-a6dc-b8b90131d5a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:54.327691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-77dbb1a3-74f4-48bc-a6dc-b8b90131d5a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:54.328467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-77dbb1a3-74f4-48bc-a6dc-b8b90131d5a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:54.328923 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-77dbb1a3-74f4-48bc-a6dc-b8b90131d5a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:54.393786 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ba834a70-f8fa-487a-aaa2-3d2910981c26 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.446049 Jul 25 12:45:54.395631 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 941/1979] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:45:53 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:45:54.403747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6502bd01-d2c9-4fb3-86bd-c100c38ca340 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:54.405183 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6502bd01-d2c9-4fb3-86bd-c100c38ca340 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:54.414324 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6502bd01-d2c9-4fb3-86bd-c100c38ca340 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:54.415111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6502bd01-d2c9-4fb3-86bd-c100c38ca340 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:54.416514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6502bd01-d2c9-4fb3-86bd-c100c38ca340 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:54.417188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6502bd01-d2c9-4fb3-86bd-c100c38ca340 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:54.439684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-77dbb1a3-74f4-48bc-a6dc-b8b90131d5a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:54.448730 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-77dbb1a3-74f4-48bc-a6dc-b8b90131d5a2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1183 microversion: 2.1 time: 0.146418 Jul 25 12:45:54.449483 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1039/1980] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:54 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:54.454358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-6ebc25ab-b023-443f-be9a-dc083f3fd026 req-e047efe9-2226-4cf1-9514-58aa78a07189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3141f1ca-37c8-4fff-9aa7-518ce0d83f1e", "name": "network-vif-plugged", "status": "completed", "tag": "452b8c9e-e8cb-4a81-99b0-37868cce96be"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:54.466444 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6ebc25ab-b023-443f-be9a-dc083f3fd026 req-e047efe9-2226-4cf1-9514-58aa78a07189 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:54.467653 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6ebc25ab-b023-443f-be9a-dc083f3fd026 req-e047efe9-2226-4cf1-9514-58aa78a07189 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:54.481900 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-6ebc25ab-b023-443f-be9a-dc083f3fd026 req-e047efe9-2226-4cf1-9514-58aa78a07189 service nova] Creating event network-vif-plugged:452b8c9e-e8cb-4a81-99b0-37868cce96be for instance 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e on n-h2-848886-15 Jul 25 12:45:54.492094 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-6ebc25ab-b023-443f-be9a-dc083f3fd026 req-e047efe9-2226-4cf1-9514-58aa78a07189 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038043 Jul 25 12:45:54.496414 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1040/1981] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:54.502331 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1619394e-cd64-4c8f-8a43-1c1783e9b789 tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:54.502954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1619394e-cd64-4c8f-8a43-1c1783e9b789 tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] [instance: 532fceed-acb2-4cc9-9a5c-60791fb1aab3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:54.509639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1619394e-cd64-4c8f-8a43-1c1783e9b789 tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:54.510232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1619394e-cd64-4c8f-8a43-1c1783e9b789 tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:54.511014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1619394e-cd64-4c8f-8a43-1c1783e9b789 tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:54.511733 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1619394e-cd64-4c8f-8a43-1c1783e9b789 tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:54.540013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-1619394e-cd64-4c8f-8a43-1c1783e9b789 tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Lazy-loading 'flavor' on Instance uuid 532fceed-acb2-4cc9-9a5c-60791fb1aab3 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:45:54.581088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:54.605547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6502bd01-d2c9-4fb3-86bd-c100c38ca340 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:54.613013 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1619394e-cd64-4c8f-8a43-1c1783e9b789 tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3/action" status: 202 len: 0 microversion: 2.1 time: 0.114465 Jul 25 12:45:54.616855 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1041/1982] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:45:54 2022] POST /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:45:54.625583 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6502bd01-d2c9-4fb3-86bd-c100c38ca340 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1472 microversion: 2.1 time: 0.228651 Jul 25 12:45:54.629883 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 942/1983] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:54 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1472 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:54.639912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9cc41341-2d98-4157-8150-7b12af215fd2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcf906ca60>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:54.775034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2ef24a0a-f0bd-4b04-84f2-2509862fe20d tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] Action: 'update', calling method: .version_select at 0x7efcf9406c10>, body: {"quota_set": {"ram": "5120"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:54.868971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ef24a0a-f0bd-4b04-84f2-2509862fe20d tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:54.869626 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ef24a0a-f0bd-4b04-84f2-2509862fe20d tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:54.872102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ef24a0a-f0bd-4b04-84f2-2509862fe20d tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:54.874242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ef24a0a-f0bd-4b04-84f2-2509862fe20d tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:54.905990 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9cc41341-2d98-4157-8150-7b12af215fd2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 0.276814 Jul 25 12:45:54.906776 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 943/1984] 10.222.0.49 () {58 vars in 1158 bytes} [Mon Jul 25 12:45:54 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:54.911684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-18a11ba6-8e93-438c-8f7d-285f2bb687dc tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:54.913812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-18a11ba6-8e93-438c-8f7d-285f2bb687dc tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:54.928942 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18a11ba6-8e93-438c-8f7d-285f2bb687dc tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:54.932822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18a11ba6-8e93-438c-8f7d-285f2bb687dc tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:54.933967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18a11ba6-8e93-438c-8f7d-285f2bb687dc tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:54.934414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18a11ba6-8e93-438c-8f7d-285f2bb687dc tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:54.950227 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2ef24a0a-f0bd-4b04-84f2-2509862fe20d tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/9b66885428394031b1c4b20e2900869e" status: 200 len: 240 microversion: 2.36 time: 0.331863 Jul 25 12:45:54.954089 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1042/1985] 10.222.0.49 () {62 vars in 1303 bytes} [Mon Jul 25 12:45:54 2022] PUT /compute/v2.1/os-quota-sets/9b66885428394031b1c4b20e2900869e => generated 240 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:45:54.959382 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d24c624a-790e-4db3-9ae3-f0d757cb459f tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:54.960339 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d24c624a-790e-4db3-9ae3-f0d757cb459f tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] [instance: 532fceed-acb2-4cc9-9a5c-60791fb1aab3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:54.966822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d24c624a-790e-4db3-9ae3-f0d757cb459f tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:54.967656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d24c624a-790e-4db3-9ae3-f0d757cb459f tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:54.968633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d24c624a-790e-4db3-9ae3-f0d757cb459f tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:54.969235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d24c624a-790e-4db3-9ae3-f0d757cb459f tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:55.038972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-18a11ba6-8e93-438c-8f7d-285f2bb687dc tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:55.048429 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-18a11ba6-8e93-438c-8f7d-285f2bb687dc tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:55.050023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-18a11ba6-8e93-438c-8f7d-285f2bb687dc tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:55.051417 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-18a11ba6-8e93-438c-8f7d-285f2bb687dc tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1409 microversion: 2.54 time: 0.143520 Jul 25 12:45:55.051996 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 944/1986] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:54 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1409 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:55.061106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-73970ffc-491d-48b7-abfb-935616bd3832 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:55.062045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-73970ffc-491d-48b7-abfb-935616bd3832 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:55.070305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73970ffc-491d-48b7-abfb-935616bd3832 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:55.070764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73970ffc-491d-48b7-abfb-935616bd3832 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:55.071840 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73970ffc-491d-48b7-abfb-935616bd3832 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:55.072273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73970ffc-491d-48b7-abfb-935616bd3832 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:55.258977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-73970ffc-491d-48b7-abfb-935616bd3832 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929ae21affaf4eb9b8eba955745aa751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59f31c830d544129310056d267f465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:55.268237 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-73970ffc-491d-48b7-abfb-935616bd3832 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e" status: 200 len: 1371 microversion: 2.1 time: 0.214163 Jul 25 12:45:55.269105 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 945/1987] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:55 2022] GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:55.280979 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-14bfa547-4ba2-436f-be25-caf242bcd56b tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcf903c820>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:55.355205 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d24c624a-790e-4db3-9ae3-f0d757cb459f tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3" status: 200 len: 1632 microversion: 2.1 time: 0.399680 Jul 25 12:45:55.356816 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1043/1988] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:54 2022] GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3 => generated 1632 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:55.362640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-de7e017a-065b-43fd-95c3-458ba4ebcce2 tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] Calling method '.version_select at 0x7efcf9273ca0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:55.438060 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de7e017a-065b-43fd-95c3-458ba4ebcce2 tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:55.438560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de7e017a-065b-43fd-95c3-458ba4ebcce2 tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:55.439892 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de7e017a-065b-43fd-95c3-458ba4ebcce2 tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:55.440472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de7e017a-065b-43fd-95c3-458ba4ebcce2 tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:55.461736 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-de7e017a-065b-43fd-95c3-458ba4ebcce2 tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/9b66885428394031b1c4b20e2900869e/detail" status: 200 len: 672 microversion: 2.36 time: 0.103011 Jul 25 12:45:55.462696 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1044/1989] 10.222.0.49 () {60 vars in 1304 bytes} [Mon Jul 25 12:45:55 2022] GET /compute/v2.1/os-quota-sets/9b66885428394031b1c4b20e2900869e/detail => generated 672 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:45:55.483520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ea58b446-d973-4b5c-8114-a05c952f9912 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:55.484403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ea58b446-d973-4b5c-8114-a05c952f9912 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:55.493031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea58b446-d973-4b5c-8114-a05c952f9912 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:55.493476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea58b446-d973-4b5c-8114-a05c952f9912 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:55.494325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea58b446-d973-4b5c-8114-a05c952f9912 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:55.494751 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea58b446-d973-4b5c-8114-a05c952f9912 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:55.522583 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-14bfa547-4ba2-436f-be25-caf242bcd56b tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/1329bd2a-6f37-4921-925d-cdddf29adcb1" status: 202 len: 0 microversion: 2.1 time: 0.251864 Jul 25 12:45:55.523682 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 946/1990] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:45:55 2022] DELETE /compute/v2.1/os-security-groups/1329bd2a-6f37-4921-925d-cdddf29adcb1 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:45:55.531475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4e7b428c-1ac1-4e77-b8bb-b0e73563db58 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcf906cd30>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:55.567805 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea58b446-d973-4b5c-8114-a05c952f9912 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:55.568855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea58b446-d973-4b5c-8114-a05c952f9912 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:55.573307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG neutronclient.v2_0.client [None req-4e7b428c-1ac1-4e77-b8bb-b0e73563db58 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1329bd2a-6f37-4921-925d-cdddf29adcb1 does not exist", "detail": ""}} {{(pid=125883) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:45:55.573985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.security_group_api [None req-4e7b428c-1ac1-4e77-b8bb-b0e73563db58 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Neutron security group 1329bd2a-6f37-4921-925d-cdddf29adcb1 not found {{(pid=125883) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 12:45:55.574180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-ea58b446-d973-4b5c-8114-a05c952f9912 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lazy-loading 'fault' on Instance uuid 791ea14d-3fa9-4be1-afc1-82c8908395f4 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:45:55.575204 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-4e7b428c-1ac1-4e77-b8bb-b0e73563db58 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] HTTP exception thrown: Security group 1329bd2a-6f37-4921-925d-cdddf29adcb1 does not exist Jul 25 12:45:55.575204 n-d-848886-15 devstack@n-api.service[125883]: Neutron server returns request_ids: ['req-c0ab4d67-eb8d-4dc2-a3e6-5410f0078b46'] Jul 25 12:45:55.578775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4e7b428c-1ac1-4e77-b8bb-b0e73563db58 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Request method failure captured: Jul 25 12:45:55.578775 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-security-groups/1329bd2a-6f37-4921-925d-cdddf29adcb1 HTTP/1.1 Jul 25 12:45:55.578775 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:45:55.578775 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:45:55.578775 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:45:55.578775 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:45:55.578775 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:45:55.578775 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:45:55.578775 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:45:55.578775 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:45:55.578775 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pBMnvMCkXPIxtXS4OZUlYvEfqLzk8eVB6uOa00GC7XzG0Qi-IKZscbMEZM1xj3l2F-5d5lIAdtnOADbgV21wrMS4dvC7LWzHzoCd7ieXebifkHeaO9Mp4wm9vR5m7HEh9yMTTXFHMqap1mzBebGWb33cT_Byxbl27G3bMxoNj8QlS0 Jul 25 12:45:55.578775 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:45:55.578775 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:45:55.578775 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:45:55.578775 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:45:55.578775 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:45:55.578775 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:45:55.578775 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:45:55.578775 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:45:55.578775 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:45:55.578775 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:45:55.580355 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8514497475b8462b86e28d48a16b0b20", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}] Jul 25 12:45:55.580355 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:45:55.580355 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:45:55.580355 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:45:55.580355 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:45:55.580355 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:45:55.580355 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:45:55.580355 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 3912af6bdd224191910f72160c42db30 Jul 25 12:45:55.580355 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:45:55.580355 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:45:55.580355 n-d-848886-15 devstack@n-api.service[125883]: exception: Security group 1329bd2a-6f37-4921-925d-cdddf29adcb1 does not exist Jul 25 12:45:55.580355 n-d-848886-15 devstack@n-api.service[125883]: Neutron server returns request_ids: ['req-c0ab4d67-eb8d-4dc2-a3e6-5410f0078b46'] Jul 25 12:45:55.580355 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '1329bd2a-6f37-4921-925d-cdddf29adcb1'} Jul 25 12:45:55.582148 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:45:55.582148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:55.582148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 12:45:55.582148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 12:45:55.582148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:45:55.582148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:45:55.582148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 12:45:55.582148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 12:45:55.582148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:45:55.582148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:45:55.582148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 12:45:55.582148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 12:45:55.582148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:45:55.582148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:45:55.582148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:45:55.582148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:45:55.582148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:45:55.582148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:45:55.582148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:45:55.584715 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:45:55.584715 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:45:55.584715 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:45:55.584715 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:45:55.584715 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:45:55.584715 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:45:55.584715 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:45:55.584715 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1329bd2a-6f37-4921-925d-cdddf29adcb1 does not exist Jul 25 12:45:55.584715 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0ab4d67-eb8d-4dc2-a3e6-5410f0078b46'] Jul 25 12:45:55.584715 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:55.584715 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:55.584715 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:55.584715 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:55.584715 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 25 12:45:55.584715 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 12:45:55.584715 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 12:45:55.584715 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 12:45:55.584715 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1329bd2a-6f37-4921-925d-cdddf29adcb1 does not exist Jul 25 12:45:55.587288 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0ab4d67-eb8d-4dc2-a3e6-5410f0078b46'] Jul 25 12:45:55.587288 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:55.587288 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:55.587288 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:55.587288 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:55.587288 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:55.587288 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:55.587288 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:45:55.587288 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:45:55.587288 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:45:55.587288 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:45:55.587288 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:45:55.587288 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:45:55.587288 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 25 12:45:55.587288 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 12:45:55.587288 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1329bd2a-6f37-4921-925d-cdddf29adcb1 does not exist Jul 25 12:45:55.587288 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0ab4d67-eb8d-4dc2-a3e6-5410f0078b46'] Jul 25 12:45:55.587288 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:55.587288 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:55.587288 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:55.587288 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:55.591092 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:55.591092 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:55.591092 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:45:55.591092 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:45:55.591092 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1329bd2a-6f37-4921-925d-cdddf29adcb1 does not exist Jul 25 12:45:55.591092 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0ab4d67-eb8d-4dc2-a3e6-5410f0078b46'] Jul 25 12:45:55.591092 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:55.591092 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4e7b428c-1ac1-4e77-b8bb-b0e73563db58 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Returning 404 to user: Security group 1329bd2a-6f37-4921-925d-cdddf29adcb1 does not exist Jul 25 12:45:55.591092 n-d-848886-15 devstack@n-api.service[125883]: Neutron server returns request_ids: ['req-c0ab4d67-eb8d-4dc2-a3e6-5410f0078b46'] {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:45:55.591092 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4e7b428c-1ac1-4e77-b8bb-b0e73563db58 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/1329bd2a-6f37-4921-925d-cdddf29adcb1" status: 404 len: 194 microversion: 2.1 time: 0.052918 Jul 25 12:45:55.591092 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 947/1991] 10.222.0.49 () {58 vars in 1269 bytes} [Mon Jul 25 12:45:55 2022] GET /compute/v2.1/os-security-groups/1329bd2a-6f37-4921-925d-cdddf29adcb1 => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:45:55.593618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9860bb7a-7487-42eb-9a14-dba0ed8f4993 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcfeccf700>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:55.650435 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ea58b446-d973-4b5c-8114-a05c952f9912 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:55.658493 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ea58b446-d973-4b5c-8114-a05c952f9912 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 200 len: 1188 microversion: 2.1 time: 0.187981 Jul 25 12:45:55.659062 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1045/1992] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:55 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 1188 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:55.664015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b85d02cf-f8aa-4957-a504-5dd087b7c01b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:55.664815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b85d02cf-f8aa-4957-a504-5dd087b7c01b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:55.671185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b85d02cf-f8aa-4957-a504-5dd087b7c01b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:55.671856 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b85d02cf-f8aa-4957-a504-5dd087b7c01b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:55.672892 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b85d02cf-f8aa-4957-a504-5dd087b7c01b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:55.673373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b85d02cf-f8aa-4957-a504-5dd087b7c01b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:55.884875 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b85d02cf-f8aa-4957-a504-5dd087b7c01b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:55.895014 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b85d02cf-f8aa-4957-a504-5dd087b7c01b tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1472 microversion: 2.1 time: 0.234469 Jul 25 12:45:55.896135 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1046/1993] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:55 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1472 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:55.901491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0a7aa0d1-f689-4d96-b7db-4ab53199204b tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] Action: 'update', calling method: .version_select at 0x7efcf9334af0>, body: {"quota_set": {"ram": "2048"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:55.929959 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9860bb7a-7487-42eb-9a14-dba0ed8f4993 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/c86400ef-e7e7-4bf3-99eb-5dc4187d31b4" status: 202 len: 0 microversion: 2.1 time: 0.344554 Jul 25 12:45:55.934449 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 948/1994] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:45:55 2022] DELETE /compute/v2.1/os-security-groups/c86400ef-e7e7-4bf3-99eb-5dc4187d31b4 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:45:55.940133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8b206312-916d-4071-8e5d-01739c56d87d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcf9042940>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:55.998318 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a7aa0d1-f689-4d96-b7db-4ab53199204b tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:55.998779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a7aa0d1-f689-4d96-b7db-4ab53199204b tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:55.999755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a7aa0d1-f689-4d96-b7db-4ab53199204b tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:56.000389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a7aa0d1-f689-4d96-b7db-4ab53199204b tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:56.006727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG neutronclient.v2_0.client [None req-8b206312-916d-4071-8e5d-01739c56d87d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c86400ef-e7e7-4bf3-99eb-5dc4187d31b4 does not exist", "detail": ""}} {{(pid=125883) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:45:56.007345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.security_group_api [None req-8b206312-916d-4071-8e5d-01739c56d87d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Neutron security group c86400ef-e7e7-4bf3-99eb-5dc4187d31b4 not found {{(pid=125883) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 12:45:56.007878 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-8b206312-916d-4071-8e5d-01739c56d87d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] HTTP exception thrown: Security group c86400ef-e7e7-4bf3-99eb-5dc4187d31b4 does not exist Jul 25 12:45:56.007878 n-d-848886-15 devstack@n-api.service[125883]: Neutron server returns request_ids: ['req-ab63a692-06d6-4a02-b076-301ce5befc1d'] Jul 25 12:45:56.010104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8b206312-916d-4071-8e5d-01739c56d87d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Request method failure captured: Jul 25 12:45:56.010104 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-security-groups/c86400ef-e7e7-4bf3-99eb-5dc4187d31b4 HTTP/1.1 Jul 25 12:45:56.010104 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:45:56.010104 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:45:56.010104 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:45:56.010104 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:45:56.010104 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:45:56.010104 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:45:56.010104 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:45:56.010104 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:45:56.010104 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pBMnvMCkXPIxtXS4OZUlYvEfqLzk8eVB6uOa00GC7XzG0Qi-IKZscbMEZM1xj3l2F-5d5lIAdtnOADbgV21wrMS4dvC7LWzHzoCd7ieXebifkHeaO9Mp4wm9vR5m7HEh9yMTTXFHMqap1mzBebGWb33cT_Byxbl27G3bMxoNj8QlS0 Jul 25 12:45:56.010104 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:45:56.010104 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:45:56.010104 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:45:56.010104 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:45:56.010104 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:45:56.010104 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:45:56.010104 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:45:56.010104 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:45:56.010104 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:45:56.010104 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:45:56.011598 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8514497475b8462b86e28d48a16b0b20", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}] Jul 25 12:45:56.011598 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:45:56.011598 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:45:56.011598 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:45:56.011598 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:45:56.011598 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:45:56.011598 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:45:56.011598 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 3912af6bdd224191910f72160c42db30 Jul 25 12:45:56.011598 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:45:56.011598 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:45:56.011598 n-d-848886-15 devstack@n-api.service[125883]: exception: Security group c86400ef-e7e7-4bf3-99eb-5dc4187d31b4 does not exist Jul 25 12:45:56.011598 n-d-848886-15 devstack@n-api.service[125883]: Neutron server returns request_ids: ['req-ab63a692-06d6-4a02-b076-301ce5befc1d'] Jul 25 12:45:56.011598 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'c86400ef-e7e7-4bf3-99eb-5dc4187d31b4'} Jul 25 12:45:56.012544 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:45:56.012544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:56.012544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 12:45:56.012544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 12:45:56.012544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:45:56.012544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:45:56.012544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 12:45:56.012544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 12:45:56.012544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:45:56.012544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:45:56.012544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 12:45:56.012544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 12:45:56.012544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:45:56.012544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:45:56.012544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:45:56.012544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:45:56.012544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:45:56.012544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:45:56.012544 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:45:56.014526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:45:56.014526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:45:56.014526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:45:56.014526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:45:56.014526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:45:56.014526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:45:56.014526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:45:56.014526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c86400ef-e7e7-4bf3-99eb-5dc4187d31b4 does not exist Jul 25 12:45:56.014526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab63a692-06d6-4a02-b076-301ce5befc1d'] Jul 25 12:45:56.014526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.014526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:56.014526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.014526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:56.014526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 25 12:45:56.014526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 12:45:56.014526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 12:45:56.014526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 12:45:56.014526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c86400ef-e7e7-4bf3-99eb-5dc4187d31b4 does not exist Jul 25 12:45:56.017016 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab63a692-06d6-4a02-b076-301ce5befc1d'] Jul 25 12:45:56.017016 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.017016 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:56.017016 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.017016 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:56.017016 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:56.017016 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:56.017016 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:45:56.017016 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:45:56.017016 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:45:56.017016 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:45:56.017016 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:45:56.017016 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:45:56.017016 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 25 12:45:56.017016 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 12:45:56.017016 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c86400ef-e7e7-4bf3-99eb-5dc4187d31b4 does not exist Jul 25 12:45:56.017016 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab63a692-06d6-4a02-b076-301ce5befc1d'] Jul 25 12:45:56.017016 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.017016 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:56.017016 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.017016 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:56.020007 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:56.020007 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:56.020007 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:45:56.020007 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:45:56.020007 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c86400ef-e7e7-4bf3-99eb-5dc4187d31b4 does not exist Jul 25 12:45:56.020007 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab63a692-06d6-4a02-b076-301ce5befc1d'] Jul 25 12:45:56.020007 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.020007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8b206312-916d-4071-8e5d-01739c56d87d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Returning 404 to user: Security group c86400ef-e7e7-4bf3-99eb-5dc4187d31b4 does not exist Jul 25 12:45:56.020007 n-d-848886-15 devstack@n-api.service[125883]: Neutron server returns request_ids: ['req-ab63a692-06d6-4a02-b076-301ce5befc1d'] {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:45:56.020007 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8b206312-916d-4071-8e5d-01739c56d87d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/c86400ef-e7e7-4bf3-99eb-5dc4187d31b4" status: 404 len: 194 microversion: 2.1 time: 0.076073 Jul 25 12:45:56.020007 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 949/1995] 10.222.0.49 () {58 vars in 1269 bytes} [Mon Jul 25 12:45:55 2022] GET /compute/v2.1/os-security-groups/c86400ef-e7e7-4bf3-99eb-5dc4187d31b4 => generated 194 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:45:56.023704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-227aa399-d116-4312-bb59-d88e155c349a tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcfecbda60>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:56.053366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a7aa0d1-f689-4d96-b7db-4ab53199204b tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:56.054295 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a7aa0d1-f689-4d96-b7db-4ab53199204b tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:56.055354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a7aa0d1-f689-4d96-b7db-4ab53199204b tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:56.055864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a7aa0d1-f689-4d96-b7db-4ab53199204b tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:56.122849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:56.139406 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0a7aa0d1-f689-4d96-b7db-4ab53199204b tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/9b66885428394031b1c4b20e2900869e?user_id=2156fcce26a7425eadc85a404f5dc4e6" status: 200 len: 240 microversion: 2.36 time: 0.241932 Jul 25 12:45:56.146603 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1047/1996] 10.222.0.49 () {62 vars in 1384 bytes} [Mon Jul 25 12:45:55 2022] PUT /compute/v2.1/os-quota-sets/9b66885428394031b1c4b20e2900869e?user_id=2156fcce26a7425eadc85a404f5dc4e6 => generated 240 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:45:56.152305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a0f5c657-b208-46db-a64c-208388d4281c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:56.153044 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a0f5c657-b208-46db-a64c-208388d4281c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:56.159928 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0f5c657-b208-46db-a64c-208388d4281c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:56.160494 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0f5c657-b208-46db-a64c-208388d4281c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:56.161380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0f5c657-b208-46db-a64c-208388d4281c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:56.161885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0f5c657-b208-46db-a64c-208388d4281c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:56.255420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a0f5c657-b208-46db-a64c-208388d4281c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:56.265512 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a0f5c657-b208-46db-a64c-208388d4281c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:56.267089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a0f5c657-b208-46db-a64c-208388d4281c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:56.268334 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a0f5c657-b208-46db-a64c-208388d4281c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1409 microversion: 2.54 time: 0.120820 Jul 25 12:45:56.268917 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1048/1997] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:56 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1409 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:56.286253 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-227aa399-d116-4312-bb59-d88e155c349a tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/d849702a-28a2-443a-b77b-c8a812531402" status: 202 len: 0 microversion: 2.1 time: 0.268814 Jul 25 12:45:56.286993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b8704e74-7624-4b24-b2ed-16c2b0120e5c tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] Calling method '.version_select at 0x7efcf9273040>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:56.292101 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 950/1998] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:45:56 2022] DELETE /compute/v2.1/os-security-groups/d849702a-28a2-443a-b77b-c8a812531402 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:45:56.299197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0e44fb8d-387a-4bfa-89fc-4a2af6f82d3e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:56.305643 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0e44fb8d-387a-4bfa-89fc-4a2af6f82d3e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:56.335563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e44fb8d-387a-4bfa-89fc-4a2af6f82d3e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:56.336032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e44fb8d-387a-4bfa-89fc-4a2af6f82d3e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:56.336836 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e44fb8d-387a-4bfa-89fc-4a2af6f82d3e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:56.338695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e44fb8d-387a-4bfa-89fc-4a2af6f82d3e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:56.402020 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b8704e74-7624-4b24-b2ed-16c2b0120e5c tempest-QuotasAdminTestV236-1963576370 tempest-QuotasAdminTestV236-1963576370-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/9b66885428394031b1c4b20e2900869e?user_id=2156fcce26a7425eadc85a404f5dc4e6" status: 200 len: 282 microversion: 2.36 time: 0.131760 Jul 25 12:45:56.408771 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1049/1999] 10.222.0.49 () {60 vars in 1364 bytes} [Mon Jul 25 12:45:56 2022] GET /compute/v2.1/os-quota-sets/9b66885428394031b1c4b20e2900869e?user_id=2156fcce26a7425eadc85a404f5dc4e6 => generated 282 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:45:56.408963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-907c7c70-1ecf-4f98-b6d0-cdd8b9dc2f2f tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcf92e3a60>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:56.486074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG neutronclient.v2_0.client [None req-907c7c70-1ecf-4f98-b6d0-cdd8b9dc2f2f tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d849702a-28a2-443a-b77b-c8a812531402 does not exist", "detail": ""}} {{(pid=125884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:45:56.487397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.security_group_api [None req-907c7c70-1ecf-4f98-b6d0-cdd8b9dc2f2f tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Neutron security group d849702a-28a2-443a-b77b-c8a812531402 not found {{(pid=125884) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 12:45:56.488523 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-907c7c70-1ecf-4f98-b6d0-cdd8b9dc2f2f tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] HTTP exception thrown: Security group d849702a-28a2-443a-b77b-c8a812531402 does not exist Jul 25 12:45:56.488523 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-b6007899-e361-4cec-94ef-dfd2dd29b685'] Jul 25 12:45:56.492827 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-907c7c70-1ecf-4f98-b6d0-cdd8b9dc2f2f tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Request method failure captured: Jul 25 12:45:56.492827 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/os-security-groups/d849702a-28a2-443a-b77b-c8a812531402 HTTP/1.1 Jul 25 12:45:56.492827 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:45:56.492827 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:45:56.492827 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:45:56.492827 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:45:56.492827 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:45:56.492827 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:45:56.492827 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:45:56.492827 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:45:56.492827 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pBMnvMCkXPIxtXS4OZUlYvEfqLzk8eVB6uOa00GC7XzG0Qi-IKZscbMEZM1xj3l2F-5d5lIAdtnOADbgV21wrMS4dvC7LWzHzoCd7ieXebifkHeaO9Mp4wm9vR5m7HEh9yMTTXFHMqap1mzBebGWb33cT_Byxbl27G3bMxoNj8QlS0 Jul 25 12:45:56.492827 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:45:56.492827 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:45:56.492827 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:45:56.492827 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:45:56.492827 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:45:56.492827 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:45:56.492827 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:45:56.492827 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:45:56.492827 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:45:56.492827 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:45:56.494694 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8514497475b8462b86e28d48a16b0b20", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}] Jul 25 12:45:56.494694 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:45:56.494694 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:45:56.494694 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:45:56.494694 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:45:56.494694 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:45:56.494694 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:45:56.494694 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 3912af6bdd224191910f72160c42db30 Jul 25 12:45:56.494694 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:45:56.494694 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:45:56.494694 n-d-848886-15 devstack@n-api.service[125884]: exception: Security group d849702a-28a2-443a-b77b-c8a812531402 does not exist Jul 25 12:45:56.494694 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-b6007899-e361-4cec-94ef-dfd2dd29b685'] Jul 25 12:45:56.494694 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'd849702a-28a2-443a-b77b-c8a812531402'} Jul 25 12:45:56.495696 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:45:56.495696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:56.495696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 12:45:56.495696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 12:45:56.495696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:45:56.495696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:45:56.495696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 12:45:56.495696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 12:45:56.495696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:45:56.495696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:45:56.495696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 12:45:56.495696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 12:45:56.495696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:45:56.495696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:45:56.495696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:45:56.495696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:45:56.495696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:45:56.495696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:45:56.495696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:45:56.497279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:45:56.497279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:45:56.497279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:45:56.497279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:45:56.497279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:45:56.497279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:45:56.497279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:45:56.497279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d849702a-28a2-443a-b77b-c8a812531402 does not exist Jul 25 12:45:56.497279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6007899-e361-4cec-94ef-dfd2dd29b685'] Jul 25 12:45:56.497279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.497279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:56.497279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.497279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:56.497279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 25 12:45:56.497279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 12:45:56.497279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 12:45:56.497279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 12:45:56.497279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d849702a-28a2-443a-b77b-c8a812531402 does not exist Jul 25 12:45:56.500236 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6007899-e361-4cec-94ef-dfd2dd29b685'] Jul 25 12:45:56.500236 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.500236 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:56.500236 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.500236 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:56.500236 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:56.500236 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:56.500236 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:45:56.500236 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:45:56.500236 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:45:56.500236 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:45:56.500236 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:45:56.500236 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:45:56.500236 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 25 12:45:56.500236 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 12:45:56.500236 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d849702a-28a2-443a-b77b-c8a812531402 does not exist Jul 25 12:45:56.500236 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6007899-e361-4cec-94ef-dfd2dd29b685'] Jul 25 12:45:56.500236 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.500236 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:56.500236 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.500236 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:56.503459 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:56.503459 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:56.503459 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:45:56.503459 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:45:56.503459 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d849702a-28a2-443a-b77b-c8a812531402 does not exist Jul 25 12:45:56.503459 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6007899-e361-4cec-94ef-dfd2dd29b685'] Jul 25 12:45:56.503459 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.505322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-907c7c70-1ecf-4f98-b6d0-cdd8b9dc2f2f tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Returning 404 to user: Security group d849702a-28a2-443a-b77b-c8a812531402 does not exist Jul 25 12:45:56.505322 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-b6007899-e361-4cec-94ef-dfd2dd29b685'] {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:45:56.506514 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-907c7c70-1ecf-4f98-b6d0-cdd8b9dc2f2f tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/d849702a-28a2-443a-b77b-c8a812531402" status: 404 len: 194 microversion: 2.1 time: 0.102358 Jul 25 12:45:56.507407 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1050/2000] 10.222.0.49 () {58 vars in 1269 bytes} [Mon Jul 25 12:45:56 2022] GET /compute/v2.1/os-security-groups/d849702a-28a2-443a-b77b-c8a812531402 => generated 194 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:45:56.513362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c1958778-ea66-46f6-abe3-b55478843d3c tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:56.514939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c1958778-ea66-46f6-abe3-b55478843d3c tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] [instance: 532fceed-acb2-4cc9-9a5c-60791fb1aab3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:56.525194 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1958778-ea66-46f6-abe3-b55478843d3c tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:56.526272 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1958778-ea66-46f6-abe3-b55478843d3c tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:56.527360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1958778-ea66-46f6-abe3-b55478843d3c tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:56.528115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1958778-ea66-46f6-abe3-b55478843d3c tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:56.570525 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0e44fb8d-387a-4bfa-89fc-4a2af6f82d3e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929ae21affaf4eb9b8eba955745aa751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59f31c830d544129310056d267f465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:56.582430 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0e44fb8d-387a-4bfa-89fc-4a2af6f82d3e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e" status: 200 len: 1371 microversion: 2.1 time: 0.288876 Jul 25 12:45:56.599089 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 951/2001] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:56 2022] GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e => generated 1371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:56.608989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3ae10e0c-b924-4763-a242-c7576dce479d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcfecbd430>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:56.779437 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c1958778-ea66-46f6-abe3-b55478843d3c tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3" status: 200 len: 1615 microversion: 2.1 time: 0.270008 Jul 25 12:45:56.781001 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1051/2002] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:56 2022] GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3 => generated 1615 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:56.786723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cec9836a-f208-438a-b98d-15e6cc150b48 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:56.787344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cec9836a-f208-438a-b98d-15e6cc150b48 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 791ea14d-3fa9-4be1-afc1-82c8908395f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:56.806165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cec9836a-f208-438a-b98d-15e6cc150b48 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:56.806962 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cec9836a-f208-438a-b98d-15e6cc150b48 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:56.807936 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cec9836a-f208-438a-b98d-15e6cc150b48 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:56.808740 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cec9836a-f208-438a-b98d-15e6cc150b48 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:56.837261 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-cec9836a-f208-438a-b98d-15e6cc150b48 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] HTTP exception thrown: Instance 791ea14d-3fa9-4be1-afc1-82c8908395f4 could not be found. Jul 25 12:45:56.838878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cec9836a-f208-438a-b98d-15e6cc150b48 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Request method failure captured: Jul 25 12:45:56.838878 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 HTTP/1.1 Jul 25 12:45:56.838878 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:45:56.838878 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:45:56.838878 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:45:56.838878 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:45:56.838878 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:45:56.838878 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:45:56.838878 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:45:56.838878 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:45:56.838878 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o7poLIdxb27XVu2RKEtMCxaMxCaSjEIgSKcBXkPISZGHxHjR8c675dy5vog8O3kZ3T4LROBGt9vfRYVx5q8QHV3paRvph-9huVqLwyVUVmFlsOpM7fWTJsYcsA1ALabDrXfnA-ARL6wA0kcPD3fLNQ2-771ZbEbR0JFe41wdmHqAp8 Jul 25 12:45:56.838878 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:45:56.838878 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:45:56.838878 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:45:56.838878 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:45:56.838878 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:45:56.838878 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:45:56.838878 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 4946a18b68e146278158ac991143a243 Jul 25 12:45:56.838878 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-LiveMigrationTest-1701369834 Jul 25 12:45:56.838878 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:45:56.838878 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:45:56.840696 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4946a18b68e146278158ac991143a243", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4946a18b68e146278158ac991143a243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4946a18b68e146278158ac991143a243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4946a18b68e146278158ac991143a243"}]}] Jul 25 12:45:56.840696 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-LiveMigrationTest-1701369834 Jul 25 12:45:56.840696 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 4946a18b68e146278158ac991143a243 Jul 25 12:45:56.840696 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-LiveMigrationTest-1701369834 Jul 25 12:45:56.840696 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-LiveMigrationTest-1701369834-project Jul 25 12:45:56.840696 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:45:56.840696 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:45:56.840696 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: a02530d4c6384518b3f45515208e83d8 Jul 25 12:45:56.840696 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-LiveMigrationTest-1701369834-project Jul 25 12:45:56.840696 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:45:56.840696 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 791ea14d-3fa9-4be1-afc1-82c8908395f4 could not be found. Jul 25 12:45:56.840696 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '791ea14d-3fa9-4be1-afc1-82c8908395f4'} Jul 25 12:45:56.841954 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:45:56.841954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:56.841954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:45:56.841954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:45:56.841954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:45:56.841954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:45:56.841954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:45:56.841954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:45:56.841954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:45:56.841954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:45:56.841954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 791ea14d-3fa9-4be1-afc1-82c8908395f4 could not be found. Jul 25 12:45:56.841954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.841954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:56.841954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.841954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:56.841954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:56.841954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:56.841954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:45:56.841954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:45:56.841954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:45:56.843626 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:45:56.843626 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:45:56.843626 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:45:56.843626 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:45:56.843626 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:45:56.843626 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:45:56.843626 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:45:56.843626 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 791ea14d-3fa9-4be1-afc1-82c8908395f4 could not be found. Jul 25 12:45:56.843626 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.843626 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:56.843626 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.843626 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:56.843626 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:56.843626 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:56.843626 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:45:56.843626 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:45:56.843626 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 791ea14d-3fa9-4be1-afc1-82c8908395f4 could not be found. Jul 25 12:45:56.843626 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.845124 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cec9836a-f208-438a-b98d-15e6cc150b48 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Returning 404 to user: Instance 791ea14d-3fa9-4be1-afc1-82c8908395f4 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:45:56.845124 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cec9836a-f208-438a-b98d-15e6cc150b48 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4" status: 404 len: 111 microversion: 2.1 time: 0.057418 Jul 25 12:45:56.854237 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1052/2003] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:56 2022] GET /compute/v2.1/servers/791ea14d-3fa9-4be1-afc1-82c8908395f4 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:45:56.859804 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e61d1456-e45f-4d45-b10a-32e56dabd09f tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:56.870820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e61d1456-e45f-4d45-b10a-32e56dabd09f tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] [instance: 532fceed-acb2-4cc9-9a5c-60791fb1aab3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:56.877873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e61d1456-e45f-4d45-b10a-32e56dabd09f tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:56.878610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e61d1456-e45f-4d45-b10a-32e56dabd09f tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:56.879587 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e61d1456-e45f-4d45-b10a-32e56dabd09f tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:56.880260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e61d1456-e45f-4d45-b10a-32e56dabd09f tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:56.943828 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3ae10e0c-b924-4763-a242-c7576dce479d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.340721 Jul 25 12:45:56.945118 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 952/2004] 10.222.0.49 () {58 vars in 1158 bytes} [Mon Jul 25 12:45:56 2022] GET /compute/v2.1/os-security-groups => generated 1155 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:56.954044 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b3483b38-cd1a-4060-8c17-6ae3ba87ff61 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:56.954044 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b3483b38-cd1a-4060-8c17-6ae3ba87ff61 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:56.991469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3483b38-cd1a-4060-8c17-6ae3ba87ff61 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:56.992338 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3483b38-cd1a-4060-8c17-6ae3ba87ff61 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:56.993449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3483b38-cd1a-4060-8c17-6ae3ba87ff61 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:56.997770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3483b38-cd1a-4060-8c17-6ae3ba87ff61 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:57.079948 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-e61d1456-e45f-4d45-b10a-32e56dabd09f tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] HTTP exception thrown: Cannot 'migrate' instance 532fceed-acb2-4cc9-9a5c-60791fb1aab3 while it is in vm_state suspended Jul 25 12:45:57.102891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e61d1456-e45f-4d45-b10a-32e56dabd09f tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Request method failure captured: Jul 25 12:45:57.102891 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3/action HTTP/1.1 Jul 25 12:45:57.102891 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:45:57.102891 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:45:57.102891 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:45:57.102891 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 15 Jul 25 12:45:57.102891 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:45:57.102891 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:45:57.102891 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:45:57.102891 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:45:57.102891 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pBQBLwJFdwnUXsG8USYDTGzLznZ8vbH_BkhQX7HMLOMb-MPdGY6zYPyjryc3VkVM4llqYjDcBMwtZr95RWdbno-clCxPG40GWrU0dfP0rzyY4VpxNj4iQk9gzj0uLNahV8zcRWQZD7b4q9w7aVb3Y7ri8akENoRSpl8t9IgqB3XA0I Jul 25 12:45:57.102891 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:45:57.102891 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:45:57.102891 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:45:57.102891 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:45:57.102891 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:45:57.102891 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:45:57.102891 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: eb320b2751364e54ab6e7c7d7b9c0748 Jul 25 12:45:57.102891 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-848826852 Jul 25 12:45:57.102891 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,admin,member Jul 25 12:45:57.102891 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,admin,member Jul 25 12:45:57.104682 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eb320b2751364e54ab6e7c7d7b9c0748", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eb320b2751364e54ab6e7c7d7b9c0748"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb320b2751364e54ab6e7c7d7b9c0748"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb320b2751364e54ab6e7c7d7b9c0748"}]}] Jul 25 12:45:57.104682 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersAdminNegativeTestJSON-848826852 Jul 25 12:45:57.104682 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: eb320b2751364e54ab6e7c7d7b9c0748 Jul 25 12:45:57.104682 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-848826852 Jul 25 12:45:57.104682 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersAdminNegativeTestJSON-848826852-project-admin Jul 25 12:45:57.104682 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:45:57.104682 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:45:57.104682 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: ce1ab9c3ff73425098d29b23fe4edd89 Jul 25 12:45:57.104682 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersAdminNegativeTestJSON-848826852-project-admin Jul 25 12:45:57.104682 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:45:57.104682 n-d-848886-15 devstack@n-api.service[125884]: {"migrate": {}} Jul 25 12:45:57.104682 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:45:57.104682 n-d-848886-15 devstack@n-api.service[125884]: exception: Cannot 'migrate' instance 532fceed-acb2-4cc9-9a5c-60791fb1aab3 while it is in vm_state suspended Jul 25 12:45:57.105645 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '532fceed-acb2-4cc9-9a5c-60791fb1aab3', 'body': {'migrate': {}}} Jul 25 12:45:57.105645 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:45:57.105645 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:57.105645 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 25 12:45:57.105645 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 25 12:45:57.105645 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 12:45:57.105645 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 12:45:57.105645 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 12:45:57.105645 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 12:45:57.105645 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 12:45:57.105645 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 12:45:57.105645 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 12:45:57.105645 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 12:45:57.105645 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 12:45:57.105645 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 12:45:57.105645 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 12:45:57.105645 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 12:45:57.105645 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 532fceed-acb2-4cc9-9a5c-60791fb1aab3 in vm_state suspended. Cannot resize while the instance is in this state. Jul 25 12:45:57.105645 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.107676 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:57.107676 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.107676 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:57.107676 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:57.107676 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:57.107676 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:45:57.107676 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:45:57.107676 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:45:57.107676 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:45:57.107676 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:45:57.107676 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:45:57.107676 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 25 12:45:57.107676 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 12:45:57.107676 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 12:45:57.107676 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 12:45:57.107676 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 532fceed-acb2-4cc9-9a5c-60791fb1aab3 while it is in vm_state suspended Jul 25 12:45:57.107676 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.107676 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:57.107676 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.107676 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:57.110433 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:57.110433 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:57.110433 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:45:57.110433 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:45:57.110433 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 532fceed-acb2-4cc9-9a5c-60791fb1aab3 while it is in vm_state suspended Jul 25 12:45:57.110433 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.110433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e61d1456-e45f-4d45-b10a-32e56dabd09f tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Returning 409 to user: Cannot 'migrate' instance 532fceed-acb2-4cc9-9a5c-60791fb1aab3 while it is in vm_state suspended {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:45:57.110433 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e61d1456-e45f-4d45-b10a-32e56dabd09f tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3/action" status: 409 len: 148 microversion: 2.1 time: 0.241847 Jul 25 12:45:57.110433 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1053/2005] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:45:56 2022] POST /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3/action => generated 148 bytes in 243 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:45:57.117923 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cd6c996e-136a-4190-b227-f65a70db5edb tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Action: 'create', calling method: .version_select at 0x7efcf92fe280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-354150042", "description": "tempest-description-870714665"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:57.456632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b3483b38-cd1a-4060-8c17-6ae3ba87ff61 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:57.475982 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b3483b38-cd1a-4060-8c17-6ae3ba87ff61 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1472 microversion: 2.1 time: 0.525432 Jul 25 12:45:57.482061 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 953/2006] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:56 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1472 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:57.487463 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cd6c996e-136a-4190-b227-f65a70db5edb tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.387932 Jul 25 12:45:57.488692 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1054/2007] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:45:57 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:57.495469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ad61b8f2-7acb-4f66-be81-04fa8af383bd tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:57.501558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ad61b8f2-7acb-4f66-be81-04fa8af383bd tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:57.504590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-41d2ef24-1371-4741-998e-a5bc2a16343a tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:57.509224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-41d2ef24-1371-4741-998e-a5bc2a16343a tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Request method failure captured: Jul 25 12:45:57.509224 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953/action HTTP/1.1 Jul 25 12:45:57.509224 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:45:57.509224 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:45:57.509224 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:45:57.509224 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 39 Jul 25 12:45:57.509224 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:45:57.509224 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:45:57.509224 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:45:57.509224 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:45:57.509224 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pBQBLwJFdwnUXsG8USYDTGzLznZ8vbH_BkhQX7HMLOMb-MPdGY6zYPyjryc3VkVM4llqYjDcBMwtZr95RWdbno-clCxPG40GWrU0dfP0rzyY4VpxNj4iQk9gzj0uLNahV8zcRWQZD7b4q9w7aVb3Y7ri8akENoRSpl8t9IgqB3XA0I Jul 25 12:45:57.509224 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:45:57.509224 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:45:57.509224 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:45:57.509224 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:45:57.509224 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:45:57.509224 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:45:57.509224 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: eb320b2751364e54ab6e7c7d7b9c0748 Jul 25 12:45:57.509224 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-848826852 Jul 25 12:45:57.509224 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:45:57.509224 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:45:57.511058 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eb320b2751364e54ab6e7c7d7b9c0748", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eb320b2751364e54ab6e7c7d7b9c0748"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb320b2751364e54ab6e7c7d7b9c0748"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb320b2751364e54ab6e7c7d7b9c0748"}]}] Jul 25 12:45:57.511058 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersAdminNegativeTestJSON-848826852 Jul 25 12:45:57.511058 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: eb320b2751364e54ab6e7c7d7b9c0748 Jul 25 12:45:57.511058 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-848826852 Jul 25 12:45:57.511058 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersAdminNegativeTestJSON-848826852-project-admin Jul 25 12:45:57.511058 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:45:57.511058 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:45:57.511058 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: ce1ab9c3ff73425098d29b23fe4edd89 Jul 25 12:45:57.511058 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersAdminNegativeTestJSON-848826852-project-admin Jul 25 12:45:57.511058 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:45:57.511058 n-d-848886-15 devstack@n-api.service[125883]: {"os-resetState": {"state": "invalid"}} Jul 25 12:45:57.511058 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:45:57.512347 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 25 12:45:57.512347 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '21390510-6525-44f6-818a-225eacdd5953', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 25 12:45:57.512347 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:45:57.512347 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:57.512347 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:45:57.512347 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:45:57.512347 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:45:57.512347 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:45:57.512347 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 25 12:45:57.512347 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.512347 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 25 12:45:57.512347 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 25 12:45:57.512347 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.512347 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 25 12:45:57.512347 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'invalid' Jul 25 12:45:57.512347 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.512347 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:57.512347 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.512347 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:57.512347 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:57.512347 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:57.512347 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:45:57.514915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:45:57.514915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:45:57.514915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:45:57.514915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:45:57.514915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:45:57.514915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:45:57.514915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:45:57.514915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:45:57.514915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:45:57.514915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 25 12:45:57.514915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.514915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:57.514915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.514915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:57.514915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:57.514915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:57.514915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:45:57.514915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:45:57.514915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 25 12:45:57.516643 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.518006 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-41d2ef24-1371-4741-998e-a5bc2a16343a tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:45:57.519050 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-41d2ef24-1371-4741-998e-a5bc2a16343a tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953/action" status: 400 len: 144 microversion: 2.1 time: 0.035676 Jul 25 12:45:57.520114 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 954/2008] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:45:57 2022] POST /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953/action => generated 144 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:45:57.531182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-946a9956-0bd5-47a1-95f1-1a5d3120805d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Action: 'create', calling method: .version_select at 0x7efcfecbd940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1457500407", "description": "tempest-description-490978917"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:57.533247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ad61b8f2-7acb-4f66-be81-04fa8af383bd tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:57.535423 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ad61b8f2-7acb-4f66-be81-04fa8af383bd tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:57.537215 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ad61b8f2-7acb-4f66-be81-04fa8af383bd tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:57.539625 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ad61b8f2-7acb-4f66-be81-04fa8af383bd tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:57.677917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ad61b8f2-7acb-4f66-be81-04fa8af383bd tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:57.690192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ad61b8f2-7acb-4f66-be81-04fa8af383bd tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:57.691955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ad61b8f2-7acb-4f66-be81-04fa8af383bd tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:57.693586 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ad61b8f2-7acb-4f66-be81-04fa8af383bd tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1409 microversion: 2.54 time: 0.203776 Jul 25 12:45:57.706549 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1055/2009] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:57 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1409 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:57.711359 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a0687ba8-ebb2-4e68-addc-2aa1cac4d07f tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:57.717182 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a0687ba8-ebb2-4e68-addc-2aa1cac4d07f tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Request method failure captured: Jul 25 12:45:57.717182 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953/action HTTP/1.1 Jul 25 12:45:57.717182 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:45:57.717182 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:45:57.717182 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:45:57.717182 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 31 Jul 25 12:45:57.717182 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:45:57.717182 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:45:57.717182 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:45:57.717182 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:45:57.717182 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pBQBLwJFdwnUXsG8USYDTGzLznZ8vbH_BkhQX7HMLOMb-MPdGY6zYPyjryc3VkVM4llqYjDcBMwtZr95RWdbno-clCxPG40GWrU0dfP0rzyY4VpxNj4iQk9gzj0uLNahV8zcRWQZD7b4q9w7aVb3Y7ri8akENoRSpl8t9IgqB3XA0I Jul 25 12:45:57.717182 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:45:57.717182 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:45:57.717182 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:45:57.717182 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:45:57.717182 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:45:57.717182 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:45:57.717182 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: eb320b2751364e54ab6e7c7d7b9c0748 Jul 25 12:45:57.717182 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-848826852 Jul 25 12:45:57.717182 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,admin,member Jul 25 12:45:57.717182 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,admin,member Jul 25 12:45:57.719115 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eb320b2751364e54ab6e7c7d7b9c0748", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eb320b2751364e54ab6e7c7d7b9c0748"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb320b2751364e54ab6e7c7d7b9c0748"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb320b2751364e54ab6e7c7d7b9c0748"}]}] Jul 25 12:45:57.719115 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersAdminNegativeTestJSON-848826852 Jul 25 12:45:57.719115 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: eb320b2751364e54ab6e7c7d7b9c0748 Jul 25 12:45:57.719115 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-848826852 Jul 25 12:45:57.719115 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersAdminNegativeTestJSON-848826852-project-admin Jul 25 12:45:57.719115 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:45:57.719115 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:45:57.719115 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: ce1ab9c3ff73425098d29b23fe4edd89 Jul 25 12:45:57.719115 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersAdminNegativeTestJSON-848826852-project-admin Jul 25 12:45:57.719115 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:45:57.719115 n-d-848886-15 devstack@n-api.service[125884]: {"os-resetState": {"state": 1}} Jul 25 12:45:57.719115 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:45:57.719115 n-d-848886-15 devstack@n-api.service[125884]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 25 12:45:57.720069 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '21390510-6525-44f6-818a-225eacdd5953', 'body': {'os-resetState': {'state': 1}}} Jul 25 12:45:57.720069 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:45:57.720069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:57.720069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:45:57.720069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:45:57.720069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:45:57.720069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:45:57.720069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 25 12:45:57.720069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.720069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 25 12:45:57.720069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 25 12:45:57.720069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.720069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 25 12:45:57.720069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 1 Jul 25 12:45:57.720069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.720069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:57.720069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.720069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:57.720069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:57.720069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:57.720069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:45:57.720069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:45:57.721599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:45:57.721599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:45:57.721599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:45:57.721599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:45:57.721599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:45:57.721599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:45:57.721599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:45:57.721599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:45:57.721599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 25 12:45:57.721599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.721599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:57.721599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.721599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:57.721599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:57.721599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:57.721599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:45:57.721599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:45:57.721599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 25 12:45:57.721599 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.738143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a0687ba8-ebb2-4e68-addc-2aa1cac4d07f tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:45:57.742815 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a0687ba8-ebb2-4e68-addc-2aa1cac4d07f tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953/action" status: 400 len: 120 microversion: 2.1 time: 0.046690 Jul 25 12:45:57.743713 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1056/2010] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:45:57 2022] POST /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953/action => generated 120 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:45:57.759611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ef6f8f17-71fd-4063-8178-975913eaa64e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:57.760757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ef6f8f17-71fd-4063-8178-975913eaa64e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:57.784935 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef6f8f17-71fd-4063-8178-975913eaa64e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:57.785396 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef6f8f17-71fd-4063-8178-975913eaa64e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:57.789036 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef6f8f17-71fd-4063-8178-975913eaa64e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:57.790680 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef6f8f17-71fd-4063-8178-975913eaa64e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:57.840457 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-946a9956-0bd5-47a1-95f1-1a5d3120805d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.317492 Jul 25 12:45:57.853123 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 955/2011] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:45:57 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:57.857368 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-49f043a7-e08f-4a0b-9d9c-a4fbe8ff2b08 tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:57.860819 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-49f043a7-e08f-4a0b-9d9c-a4fbe8ff2b08 tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Failed to fetch instance by id 999 {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 12:45:57.861351 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-49f043a7-e08f-4a0b-9d9c-a4fbe8ff2b08 tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 25 12:45:57.867883 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-49f043a7-e08f-4a0b-9d9c-a4fbe8ff2b08 tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Request method failure captured: Jul 25 12:45:57.867883 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 25 12:45:57.867883 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:45:57.867883 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:45:57.867883 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:45:57.867883 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 37 Jul 25 12:45:57.867883 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:45:57.867883 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:45:57.867883 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:45:57.867883 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:45:57.867883 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pBQBLwJFdwnUXsG8USYDTGzLznZ8vbH_BkhQX7HMLOMb-MPdGY6zYPyjryc3VkVM4llqYjDcBMwtZr95RWdbno-clCxPG40GWrU0dfP0rzyY4VpxNj4iQk9gzj0uLNahV8zcRWQZD7b4q9w7aVb3Y7ri8akENoRSpl8t9IgqB3XA0I Jul 25 12:45:57.867883 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:45:57.867883 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:45:57.867883 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:45:57.867883 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:45:57.867883 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:45:57.867883 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:45:57.867883 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: eb320b2751364e54ab6e7c7d7b9c0748 Jul 25 12:45:57.867883 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-848826852 Jul 25 12:45:57.867883 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:45:57.867883 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:45:57.869366 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eb320b2751364e54ab6e7c7d7b9c0748", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eb320b2751364e54ab6e7c7d7b9c0748"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb320b2751364e54ab6e7c7d7b9c0748"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb320b2751364e54ab6e7c7d7b9c0748"}]}] Jul 25 12:45:57.869366 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersAdminNegativeTestJSON-848826852 Jul 25 12:45:57.869366 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: eb320b2751364e54ab6e7c7d7b9c0748 Jul 25 12:45:57.869366 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-848826852 Jul 25 12:45:57.869366 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersAdminNegativeTestJSON-848826852-project-admin Jul 25 12:45:57.869366 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:45:57.869366 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:45:57.869366 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: ce1ab9c3ff73425098d29b23fe4edd89 Jul 25 12:45:57.869366 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersAdminNegativeTestJSON-848826852-project-admin Jul 25 12:45:57.869366 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:45:57.869366 n-d-848886-15 devstack@n-api.service[125883]: {"os-resetState": {"state": "error"}} Jul 25 12:45:57.869366 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:45:57.869366 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 999 could not be found. Jul 25 12:45:57.870346 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 25 12:45:57.870346 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:45:57.870346 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:57.870346 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:45:57.870346 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:45:57.870346 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 12:45:57.870346 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 12:45:57.870346 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 25 12:45:57.870346 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.870346 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:57.870346 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.870346 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:57.870346 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:57.870346 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:57.870346 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:45:57.870346 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:45:57.870346 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:45:57.870346 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:45:57.870346 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:45:57.870346 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:45:57.870346 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 25 12:45:57.871898 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 12:45:57.871898 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:45:57.871898 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:45:57.871898 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 25 12:45:57.871898 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.871898 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:57.871898 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.871898 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:57.871898 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:57.871898 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:57.871898 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:45:57.871898 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:45:57.871898 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 25 12:45:57.871898 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:45:57.871898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-49f043a7-e08f-4a0b-9d9c-a4fbe8ff2b08 tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:45:57.871898 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-49f043a7-e08f-4a0b-9d9c-a4fbe8ff2b08 tempest-ServersAdminNegativeTestJSON-848826852 tempest-ServersAdminNegativeTestJSON-848826852-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.026809 Jul 25 12:45:57.876140 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 956/2012] 10.222.0.49 () {60 vars in 1179 bytes} [Mon Jul 25 12:45:57 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:45:57.879224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-36797335-b917-4b0c-b43d-90caf2f07f5b tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:57.879728 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-36797335-b917-4b0c-b43d-90caf2f07f5b tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 532fceed-acb2-4cc9-9a5c-60791fb1aab3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:57.893518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36797335-b917-4b0c-b43d-90caf2f07f5b tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:57.902338 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36797335-b917-4b0c-b43d-90caf2f07f5b tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:57.903223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36797335-b917-4b0c-b43d-90caf2f07f5b tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:57.903676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36797335-b917-4b0c-b43d-90caf2f07f5b tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:57.957649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-36797335-b917-4b0c-b43d-90caf2f07f5b tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 532fceed-acb2-4cc9-9a5c-60791fb1aab3] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:45:58.064623 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ef6f8f17-71fd-4063-8178-975913eaa64e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929ae21affaf4eb9b8eba955745aa751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59f31c830d544129310056d267f465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:58.076678 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ef6f8f17-71fd-4063-8178-975913eaa64e tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e" status: 200 len: 1557 microversion: 2.1 time: 0.328989 Jul 25 12:45:58.077616 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1057/2013] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:57 2022] GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e => generated 1557 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:58.086593 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bd15700f-3666-4bac-a2db-c8e0549af0d1 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1898057630", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "06e1c2ac-ecb5-41f4-b5b1-6c25d867c5e1"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:58.113195 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-36797335-b917-4b0c-b43d-90caf2f07f5b tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "DELETE /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3" status: 204 len: 0 microversion: 2.1 time: 0.237344 Jul 25 12:45:58.127341 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 957/2014] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:45:57 2022] DELETE /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:45:58.144328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-92b7031b-b6cb-488d-916d-951c8520ca19 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:58.146737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-92b7031b-b6cb-488d-916d-951c8520ca19 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:58.163949 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92b7031b-b6cb-488d-916d-951c8520ca19 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:58.165720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92b7031b-b6cb-488d-916d-951c8520ca19 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:58.168318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92b7031b-b6cb-488d-916d-951c8520ca19 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:58.169810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92b7031b-b6cb-488d-916d-951c8520ca19 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:58.191296 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-bd15700f-3666-4bac-a2db-c8e0549af0d1 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] validate_networks() for [('06e1c2ac-ecb5-41f4-b5b1-6c25d867c5e1', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:45:58.364362 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-92b7031b-b6cb-488d-916d-951c8520ca19 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.227639 Jul 25 12:45:58.367581 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 958/2015] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 12:45:58 2022] GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e/os-interface => generated 284 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:58.380292 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2e52bb73-5e44-4f53-bcc9-0e6cacfb6fc0 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:58.381107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2e52bb73-5e44-4f53-bcc9-0e6cacfb6fc0 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 532fceed-acb2-4cc9-9a5c-60791fb1aab3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:58.396945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e52bb73-5e44-4f53-bcc9-0e6cacfb6fc0 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:58.397780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e52bb73-5e44-4f53-bcc9-0e6cacfb6fc0 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:58.403639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e52bb73-5e44-4f53-bcc9-0e6cacfb6fc0 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:58.408598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e52bb73-5e44-4f53-bcc9-0e6cacfb6fc0 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:59.085218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2e52bb73-5e44-4f53-bcc9-0e6cacfb6fc0 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:59.101085 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2e52bb73-5e44-4f53-bcc9-0e6cacfb6fc0 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3" status: 200 len: 1468 microversion: 2.1 time: 0.729009 Jul 25 12:45:59.106053 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 959/2016] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:58 2022] GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3 => generated 1468 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:59.114954 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-96523a75-3fd6-44c7-97ca-bfbf2a55f69a tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:59.118459 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-96523a75-3fd6-44c7-97ca-bfbf2a55f69a tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:59.132249 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-96523a75-3fd6-44c7-97ca-bfbf2a55f69a tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:59.132912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-96523a75-3fd6-44c7-97ca-bfbf2a55f69a tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:59.133922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-96523a75-3fd6-44c7-97ca-bfbf2a55f69a tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:59.134550 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-96523a75-3fd6-44c7-97ca-bfbf2a55f69a tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:59.362301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bd15700f-3666-4bac-a2db-c8e0549af0d1 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:45:59.363271 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bd15700f-3666-4bac-a2db-c8e0549af0d1 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:45:59.363998 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bd15700f-3666-4bac-a2db-c8e0549af0d1 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:45:59.364603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bd15700f-3666-4bac-a2db-c8e0549af0d1 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:45:59.365197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bd15700f-3666-4bac-a2db-c8e0549af0d1 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:45:59.384099 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd15700f-3666-4bac-a2db-c8e0549af0d1 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:59.386515 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd15700f-3666-4bac-a2db-c8e0549af0d1 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:59.389074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd15700f-3666-4bac-a2db-c8e0549af0d1 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:59.389756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd15700f-3666-4bac-a2db-c8e0549af0d1 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:59.423934 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-96523a75-3fd6-44c7-97ca-bfbf2a55f69a tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:59.433911 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-96523a75-3fd6-44c7-97ca-bfbf2a55f69a tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1472 microversion: 2.1 time: 0.326437 Jul 25 12:45:59.434517 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 960/2017] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:59 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1472 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:59.454778 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-bd15700f-3666-4bac-a2db-c8e0549af0d1 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Getting quotas for project 8514497475b8462b86e28d48a16b0b20. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:45:59.458112 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9a90da94-1177-4bfd-91ff-6a7a24aee509 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:59.458794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9a90da94-1177-4bfd-91ff-6a7a24aee509 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:59.469057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-bd15700f-3666-4bac-a2db-c8e0549af0d1 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Getting quotas for user 3912af6bdd224191910f72160c42db30 and project 8514497475b8462b86e28d48a16b0b20. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:45:59.474966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a90da94-1177-4bfd-91ff-6a7a24aee509 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:59.475427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a90da94-1177-4bfd-91ff-6a7a24aee509 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:59.476242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a90da94-1177-4bfd-91ff-6a7a24aee509 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:59.476678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a90da94-1177-4bfd-91ff-6a7a24aee509 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:59.495343 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bd15700f-3666-4bac-a2db-c8e0549af0d1 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:45:59.508485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bd15700f-3666-4bac-a2db-c8e0549af0d1 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:45:59.605987 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bd15700f-3666-4bac-a2db-c8e0549af0d1 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.527183 Jul 25 12:45:59.609239 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1058/2018] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:45:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:45:59.618970 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9a90da94-1177-4bfd-91ff-6a7a24aee509 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:59.640952 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9a90da94-1177-4bfd-91ff-6a7a24aee509 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:59.642717 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6f59af57-ddb3-4d1b-afde-cef413e95b72 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:59.643762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6f59af57-ddb3-4d1b-afde-cef413e95b72 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:59.648353 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9a90da94-1177-4bfd-91ff-6a7a24aee509 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:59.649642 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9a90da94-1177-4bfd-91ff-6a7a24aee509 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1409 microversion: 2.54 time: 0.209664 Jul 25 12:45:59.655021 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 961/2019] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:59 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1409 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:59.753473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6f59af57-ddb3-4d1b-afde-cef413e95b72 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:59.773937 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6f59af57-ddb3-4d1b-afde-cef413e95b72 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 200 len: 1216 microversion: 2.1 time: 0.149411 Jul 25 12:45:59.781130 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1059/2020] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:59 2022] GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 1216 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:00.124583 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2973436b-aa55-4da9-9889-71a8a217a9ee tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:00.125996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2973436b-aa55-4da9-9889-71a8a217a9ee tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 532fceed-acb2-4cc9-9a5c-60791fb1aab3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:00.137433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2973436b-aa55-4da9-9889-71a8a217a9ee tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:00.137925 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2973436b-aa55-4da9-9889-71a8a217a9ee tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:00.142493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2973436b-aa55-4da9-9889-71a8a217a9ee tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:00.143013 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2973436b-aa55-4da9-9889-71a8a217a9ee tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:00.263838 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-58ed741d-78f5-4972-858c-1b742f26bb13 req-91d1c6e7-0588-4e55-8340-3dcafcee3510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3141f1ca-37c8-4fff-9aa7-518ce0d83f1e", "tag": "452b8c9e-e8cb-4a81-99b0-37868cce96be"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:00.297533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-58ed741d-78f5-4972-858c-1b742f26bb13 req-91d1c6e7-0588-4e55-8340-3dcafcee3510 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:00.298419 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-58ed741d-78f5-4972-858c-1b742f26bb13 req-91d1c6e7-0588-4e55-8340-3dcafcee3510 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:00.330608 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-58ed741d-78f5-4972-858c-1b742f26bb13 req-91d1c6e7-0588-4e55-8340-3dcafcee3510 service nova] Creating event network-changed:452b8c9e-e8cb-4a81-99b0-37868cce96be for instance 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e on n-h2-848886-15 Jul 25 12:46:00.353203 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-58ed741d-78f5-4972-858c-1b742f26bb13 req-91d1c6e7-0588-4e55-8340-3dcafcee3510 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093704 Jul 25 12:46:00.353869 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1060/2021] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:46:00.457364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-440b5c10-7d90-4258-96bd-bd00e8bcfd02 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:00.458127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-440b5c10-7d90-4258-96bd-bd00e8bcfd02 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:00.468350 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-440b5c10-7d90-4258-96bd-bd00e8bcfd02 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:00.474565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-440b5c10-7d90-4258-96bd-bd00e8bcfd02 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:00.477372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-440b5c10-7d90-4258-96bd-bd00e8bcfd02 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:00.477960 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-440b5c10-7d90-4258-96bd-bd00e8bcfd02 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:01.216269 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2973436b-aa55-4da9-9889-71a8a217a9ee tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:01.243071 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2973436b-aa55-4da9-9889-71a8a217a9ee tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3" status: 200 len: 1468 microversion: 2.1 time: 1.122704 Jul 25 12:46:01.243964 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 962/2022] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:00 2022] GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3 => generated 1468 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:01.258253 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0984772e-76b7-461a-bf0c-f69d79759ada tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:01.282486 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0984772e-76b7-461a-bf0c-f69d79759ada tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:01.312927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0984772e-76b7-461a-bf0c-f69d79759ada tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:01.314451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0984772e-76b7-461a-bf0c-f69d79759ada tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:01.319351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0984772e-76b7-461a-bf0c-f69d79759ada tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:01.320207 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0984772e-76b7-461a-bf0c-f69d79759ada tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:01.594619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0984772e-76b7-461a-bf0c-f69d79759ada tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:01.612880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0984772e-76b7-461a-bf0c-f69d79759ada tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:01.614967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0984772e-76b7-461a-bf0c-f69d79759ada tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:01.618511 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0984772e-76b7-461a-bf0c-f69d79759ada tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1409 microversion: 2.54 time: 0.372797 Jul 25 12:46:01.619808 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 963/2023] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:01 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1409 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:01.628239 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d1a6e2ac-c623-47cd-a325-1a96745662bc tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:01.632964 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d1a6e2ac-c623-47cd-a325-1a96745662bc tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:01.652194 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1a6e2ac-c623-47cd-a325-1a96745662bc tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:01.652972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1a6e2ac-c623-47cd-a325-1a96745662bc tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:01.655934 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1a6e2ac-c623-47cd-a325-1a96745662bc tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:01.656812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1a6e2ac-c623-47cd-a325-1a96745662bc tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:01.677141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-440b5c10-7d90-4258-96bd-bd00e8bcfd02 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:01.701382 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-440b5c10-7d90-4258-96bd-bd00e8bcfd02 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1472 microversion: 2.1 time: 1.248433 Jul 25 12:46:01.702027 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1061/2024] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:00 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1472 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:46:01.820809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d1a6e2ac-c623-47cd-a325-1a96745662bc tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:01.840061 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d1a6e2ac-c623-47cd-a325-1a96745662bc tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 200 len: 1274 microversion: 2.1 time: 0.216626 Jul 25 12:46:01.841183 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 964/2025] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:01 2022] GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 1274 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:02.258833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-fe101f1b-7c59-4d3d-89f9-02b74d26b751 req-e3adf84f-50e1-44bc-b593-820487ee8617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "532fceed-acb2-4cc9-9a5c-60791fb1aab3", "name": "network-vif-deleted", "tag": "d85ec8b3-b47d-46d5-9f3e-348d4076256a"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:02.269620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b41c7f63-75eb-44cb-a9bc-257b36de8c72 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:02.270243 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b41c7f63-75eb-44cb-a9bc-257b36de8c72 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 532fceed-acb2-4cc9-9a5c-60791fb1aab3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:02.287753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b41c7f63-75eb-44cb-a9bc-257b36de8c72 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:02.288095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b41c7f63-75eb-44cb-a9bc-257b36de8c72 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:02.289382 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b41c7f63-75eb-44cb-a9bc-257b36de8c72 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:02.290026 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b41c7f63-75eb-44cb-a9bc-257b36de8c72 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:02.291308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fe101f1b-7c59-4d3d-89f9-02b74d26b751 req-e3adf84f-50e1-44bc-b593-820487ee8617 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:02.295680 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fe101f1b-7c59-4d3d-89f9-02b74d26b751 req-e3adf84f-50e1-44bc-b593-820487ee8617 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:02.335348 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-fe101f1b-7c59-4d3d-89f9-02b74d26b751 req-e3adf84f-50e1-44bc-b593-820487ee8617 service nova] Creating event network-vif-deleted:d85ec8b3-b47d-46d5-9f3e-348d4076256a for instance 532fceed-acb2-4cc9-9a5c-60791fb1aab3 on n-h1-848886-15 Jul 25 12:46:02.351584 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-fe101f1b-7c59-4d3d-89f9-02b74d26b751 req-e3adf84f-50e1-44bc-b593-820487ee8617 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097135 Jul 25 12:46:02.352446 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1062/2026] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:46:02.434844 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b41c7f63-75eb-44cb-a9bc-257b36de8c72 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:02.447604 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b41c7f63-75eb-44cb-a9bc-257b36de8c72 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3" status: 200 len: 1297 microversion: 2.1 time: 0.181909 Jul 25 12:46:02.448240 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 965/2027] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:02 2022] GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3 => generated 1297 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:02.549024 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bf51629b-00af-46e3-9235-a1030b76681a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:02.549951 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bf51629b-00af-46e3-9235-a1030b76681a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:02.560309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf51629b-00af-46e3-9235-a1030b76681a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:02.560792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf51629b-00af-46e3-9235-a1030b76681a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:02.561593 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf51629b-00af-46e3-9235-a1030b76681a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:02.562217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf51629b-00af-46e3-9235-a1030b76681a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:02.590160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bf51629b-00af-46e3-9235-a1030b76681a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:46:02.656937 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0f718ead-c77f-413d-9142-7b51d2072659 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:02.674455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0f718ead-c77f-413d-9142-7b51d2072659 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:02.702697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f718ead-c77f-413d-9142-7b51d2072659 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:02.703161 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f718ead-c77f-413d-9142-7b51d2072659 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:02.708674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f718ead-c77f-413d-9142-7b51d2072659 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:02.709975 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f718ead-c77f-413d-9142-7b51d2072659 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:02.733502 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bf51629b-00af-46e3-9235-a1030b76681a tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 204 len: 0 microversion: 2.1 time: 0.188823 Jul 25 12:46:02.736196 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1063/2028] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:46:02 2022] DELETE /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:46:02.744785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2b165e60-e09a-41e3-a4b5-694387ac54e2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:02.746736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2b165e60-e09a-41e3-a4b5-694387ac54e2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:02.757579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2b165e60-e09a-41e3-a4b5-694387ac54e2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:02.758325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2b165e60-e09a-41e3-a4b5-694387ac54e2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:02.759965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2b165e60-e09a-41e3-a4b5-694387ac54e2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:02.760711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2b165e60-e09a-41e3-a4b5-694387ac54e2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:02.953371 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0f718ead-c77f-413d-9142-7b51d2072659 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:02.956072 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:02.967145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0f718ead-c77f-413d-9142-7b51d2072659 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:02.969077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0f718ead-c77f-413d-9142-7b51d2072659 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:02.970845 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0f718ead-c77f-413d-9142-7b51d2072659 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1409 microversion: 2.54 time: 0.330027 Jul 25 12:46:02.971767 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 966/2029] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:02 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1409 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:46:02.977316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-efe88328-48af-4786-9065-02cdabe4ba25 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:02.978241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-efe88328-48af-4786-9065-02cdabe4ba25 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:02.986571 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-efe88328-48af-4786-9065-02cdabe4ba25 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:02.988188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-efe88328-48af-4786-9065-02cdabe4ba25 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:02.989512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-efe88328-48af-4786-9065-02cdabe4ba25 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:02.990339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-efe88328-48af-4786-9065-02cdabe4ba25 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:03.140928 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2b165e60-e09a-41e3-a4b5-694387ac54e2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:03.152403 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2b165e60-e09a-41e3-a4b5-694387ac54e2 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1472 microversion: 2.1 time: 0.414146 Jul 25 12:46:03.153633 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1064/2030] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:02 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1472 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:03.159327 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1ace4303-85cf-429b-b953-105cf8200f7e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:03.160630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1ace4303-85cf-429b-b953-105cf8200f7e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:03.167599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ace4303-85cf-429b-b953-105cf8200f7e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:03.174523 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ace4303-85cf-429b-b953-105cf8200f7e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:03.176172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ace4303-85cf-429b-b953-105cf8200f7e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:03.177446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ace4303-85cf-429b-b953-105cf8200f7e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:03.183533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:03.265382 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-efe88328-48af-4786-9065-02cdabe4ba25 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:03.280046 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-efe88328-48af-4786-9065-02cdabe4ba25 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1666 microversion: 2.1 time: 0.306575 Jul 25 12:46:03.286642 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 967/2031] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:02 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1666 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:03.423161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1ace4303-85cf-429b-b953-105cf8200f7e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:03.432375 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1ace4303-85cf-429b-b953-105cf8200f7e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 200 len: 1316 microversion: 2.1 time: 0.277174 Jul 25 12:46:03.433051 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1065/2032] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:03 2022] GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 1316 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:03.455312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5a190d19-78cb-4e9d-90e7-377a6166b8f1 tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] Action: 'update', calling method: .version_select at 0x7efcfed25b80>, body: {"quota_set": {"ram": "5120"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:03.473666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-03de5217-963d-4185-8d3c-418d3bffad4c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:03.474321 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-03de5217-963d-4185-8d3c-418d3bffad4c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 532fceed-acb2-4cc9-9a5c-60791fb1aab3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:03.482763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-03de5217-963d-4185-8d3c-418d3bffad4c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:03.483219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-03de5217-963d-4185-8d3c-418d3bffad4c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:03.485498 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-03de5217-963d-4185-8d3c-418d3bffad4c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:03.487716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-03de5217-963d-4185-8d3c-418d3bffad4c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:03.506169 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-03de5217-963d-4185-8d3c-418d3bffad4c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] HTTP exception thrown: Instance 532fceed-acb2-4cc9-9a5c-60791fb1aab3 could not be found. Jul 25 12:46:03.508389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-03de5217-963d-4185-8d3c-418d3bffad4c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Request method failure captured: Jul 25 12:46:03.508389 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3 HTTP/1.1 Jul 25 12:46:03.508389 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:46:03.508389 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:46:03.508389 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:46:03.508389 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:46:03.508389 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:46:03.508389 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:46:03.508389 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:46:03.508389 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:03.508389 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pBObqscFZDHwI53XHUog2qlLqkwA8tpmptNND1yna5q_ka7bv8C3FxtEZGZFt2UxTU3MGdnEialqIOUblpsqAN993S1bCfJ2w_i88Q6k2QOPnCN9NXGjOKrh0iWHlcjp-sfWU1OyXZrssrxKOm-F_enwsfeU2ZBm3lwhYaf_ibMID8 Jul 25 12:46:03.508389 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:46:03.508389 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:46:03.508389 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:46:03.508389 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:46:03.508389 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:46:03.508389 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:46:03.508389 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 255fa26649774caca18f3b9784863281 Jul 25 12:46:03.508389 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1107055732 Jul 25 12:46:03.508389 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:46:03.508389 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:46:03.510577 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_255fa26649774caca18f3b9784863281", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/255fa26649774caca18f3b9784863281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/255fa26649774caca18f3b9784863281"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/255fa26649774caca18f3b9784863281"}]}] Jul 25 12:46:03.510577 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1107055732 Jul 25 12:46:03.510577 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 255fa26649774caca18f3b9784863281 Jul 25 12:46:03.510577 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1107055732 Jul 25 12:46:03.510577 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersAdminNegativeTestJSON-1107055732-project Jul 25 12:46:03.510577 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:46:03.510577 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:46:03.510577 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 9488de03a0cf4e10b18ba769cb2cf408 Jul 25 12:46:03.510577 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1107055732-project Jul 25 12:46:03.510577 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:46:03.510577 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 532fceed-acb2-4cc9-9a5c-60791fb1aab3 could not be found. Jul 25 12:46:03.510577 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '532fceed-acb2-4cc9-9a5c-60791fb1aab3'} Jul 25 12:46:03.511556 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:03.511556 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:03.511556 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:46:03.511556 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:46:03.511556 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:46:03.511556 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:46:03.511556 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:46:03.511556 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:46:03.511556 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:46:03.511556 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:46:03.511556 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 532fceed-acb2-4cc9-9a5c-60791fb1aab3 could not be found. Jul 25 12:46:03.511556 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:03.511556 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:03.511556 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:03.511556 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:03.511556 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:03.511556 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:03.511556 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:03.511556 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:03.511556 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:03.512978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:03.512978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:46:03.512978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:46:03.512978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:46:03.512978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:46:03.512978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:46:03.512978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:46:03.512978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 532fceed-acb2-4cc9-9a5c-60791fb1aab3 could not be found. Jul 25 12:46:03.512978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:03.512978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:03.512978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:03.512978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:03.512978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:03.512978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:03.512978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:03.512978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:03.512978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 532fceed-acb2-4cc9-9a5c-60791fb1aab3 could not be found. Jul 25 12:46:03.512978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:03.514983 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-03de5217-963d-4185-8d3c-418d3bffad4c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Returning 404 to user: Instance 532fceed-acb2-4cc9-9a5c-60791fb1aab3 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:03.514983 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-03de5217-963d-4185-8d3c-418d3bffad4c tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3" status: 404 len: 111 microversion: 2.1 time: 0.045627 Jul 25 12:46:03.514983 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1066/2033] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:03 2022] GET /compute/v2.1/servers/532fceed-acb2-4cc9-9a5c-60791fb1aab3 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:46:03.518844 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4a56d1d8-beb2-4cc2-b95b-a1488663470a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:03.519406 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4a56d1d8-beb2-4cc2-b95b-a1488663470a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 21390510-6525-44f6-818a-225eacdd5953] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:03.526898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a56d1d8-beb2-4cc2-b95b-a1488663470a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:03.527425 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a56d1d8-beb2-4cc2-b95b-a1488663470a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:03.528224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a56d1d8-beb2-4cc2-b95b-a1488663470a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:03.528672 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a56d1d8-beb2-4cc2-b95b-a1488663470a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:03.537643 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a190d19-78cb-4e9d-90e7-377a6166b8f1 tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:03.538438 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a190d19-78cb-4e9d-90e7-377a6166b8f1 tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:03.539414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a190d19-78cb-4e9d-90e7-377a6166b8f1 tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:03.539944 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a190d19-78cb-4e9d-90e7-377a6166b8f1 tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:03.558470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4a56d1d8-beb2-4cc2-b95b-a1488663470a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 21390510-6525-44f6-818a-225eacdd5953] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:46:03.591553 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5a190d19-78cb-4e9d-90e7-377a6166b8f1 tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/4dbd0e4cb4fe4569a08c31695099b9d9" status: 200 len: 148 microversion: 2.57 time: 0.302740 Jul 25 12:46:03.592332 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 968/2034] 10.222.0.49 () {62 vars in 1303 bytes} [Mon Jul 25 12:46:03 2022] PUT /compute/v2.1/os-quota-sets/4dbd0e4cb4fe4569a08c31695099b9d9 => generated 148 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:46:03.604577 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-732e8489-98e0-420a-b3a3-046cd1ca484d tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] Calling method '.version_select at 0x7efcf903c160>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:03.657517 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4a56d1d8-beb2-4cc2-b95b-a1488663470a tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "DELETE /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953" status: 204 len: 0 microversion: 2.1 time: 0.142058 Jul 25 12:46:03.658335 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1067/2035] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:46:03 2022] DELETE /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:46:03.666859 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ccc79cb2-b2c4-4c47-8b85-092e1d03da38 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:03.667410 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ccc79cb2-b2c4-4c47-8b85-092e1d03da38 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 21390510-6525-44f6-818a-225eacdd5953] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:03.673584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccc79cb2-b2c4-4c47-8b85-092e1d03da38 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:03.674086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccc79cb2-b2c4-4c47-8b85-092e1d03da38 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:03.674917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccc79cb2-b2c4-4c47-8b85-092e1d03da38 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:03.675358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccc79cb2-b2c4-4c47-8b85-092e1d03da38 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:03.684636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-732e8489-98e0-420a-b3a3-046cd1ca484d tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:03.685209 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-732e8489-98e0-420a-b3a3-046cd1ca484d tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:03.686195 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-732e8489-98e0-420a-b3a3-046cd1ca484d tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:03.686635 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-732e8489-98e0-420a-b3a3-046cd1ca484d tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:03.705587 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-732e8489-98e0-420a-b3a3-046cd1ca484d tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/4dbd0e4cb4fe4569a08c31695099b9d9/detail" status: 200 len: 463 microversion: 2.57 time: 0.105543 Jul 25 12:46:03.706189 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 969/2036] 10.222.0.49 () {60 vars in 1304 bytes} [Mon Jul 25 12:46:03 2022] GET /compute/v2.1/os-quota-sets/4dbd0e4cb4fe4569a08c31695099b9d9/detail => generated 463 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:46:03.812728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ccc79cb2-b2c4-4c47-8b85-092e1d03da38 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:03.821300 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ccc79cb2-b2c4-4c47-8b85-092e1d03da38 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953" status: 200 len: 1478 microversion: 2.1 time: 0.158556 Jul 25 12:46:03.822125 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1068/2037] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:03 2022] GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953 => generated 1478 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:46:03.841591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-68c5f085-95dc-4748-b3b2-df0246d94c97 tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] Action: 'update', calling method: .version_select at 0x7efcfed25e50>, body: {"quota_set": {"ram": "2048"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:03.907664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68c5f085-95dc-4748-b3b2-df0246d94c97 tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:03.908114 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68c5f085-95dc-4748-b3b2-df0246d94c97 tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:03.908909 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68c5f085-95dc-4748-b3b2-df0246d94c97 tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:03.909336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68c5f085-95dc-4748-b3b2-df0246d94c97 tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:03.944343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68c5f085-95dc-4748-b3b2-df0246d94c97 tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:03.944857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68c5f085-95dc-4748-b3b2-df0246d94c97 tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:03.945639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68c5f085-95dc-4748-b3b2-df0246d94c97 tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:03.946161 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68c5f085-95dc-4748-b3b2-df0246d94c97 tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:03.995030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0cf54594-b825-4083-bea2-3c2f7f080e57 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:03.995578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0cf54594-b825-4083-bea2-3c2f7f080e57 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:04.002040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0cf54594-b825-4083-bea2-3c2f7f080e57 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:04.002604 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0cf54594-b825-4083-bea2-3c2f7f080e57 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:04.003143 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-68c5f085-95dc-4748-b3b2-df0246d94c97 tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/4dbd0e4cb4fe4569a08c31695099b9d9?user_id=d993dc20d73d4305a6ffa12d8a089275" status: 200 len: 148 microversion: 2.57 time: 0.165323 Jul 25 12:46:04.003462 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0cf54594-b825-4083-bea2-3c2f7f080e57 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:04.007564 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 970/2038] 10.222.0.49 () {62 vars in 1384 bytes} [Mon Jul 25 12:46:03 2022] PUT /compute/v2.1/os-quota-sets/4dbd0e4cb4fe4569a08c31695099b9d9?user_id=d993dc20d73d4305a6ffa12d8a089275 => generated 148 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:46:04.007752 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0cf54594-b825-4083-bea2-3c2f7f080e57 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:04.014491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-170f457f-2f9c-4dc3-b784-3b3bf0fd3c48 tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] Calling method '.version_select at 0x7efcfecef040>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:04.077483 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0cf54594-b825-4083-bea2-3c2f7f080e57 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:04.085712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0cf54594-b825-4083-bea2-3c2f7f080e57 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:04.087253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0cf54594-b825-4083-bea2-3c2f7f080e57 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:04.088465 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0cf54594-b825-4083-bea2-3c2f7f080e57 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1409 microversion: 2.54 time: 0.097536 Jul 25 12:46:04.089019 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1069/2039] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:03 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1409 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:04.099971 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-170f457f-2f9c-4dc3-b784-3b3bf0fd3c48 tempest-QuotasAdminTestV257-849737769 tempest-QuotasAdminTestV257-849737769-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/4dbd0e4cb4fe4569a08c31695099b9d9?user_id=d993dc20d73d4305a6ffa12d8a089275" status: 200 len: 190 microversion: 2.57 time: 0.089191 Jul 25 12:46:04.100563 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 971/2040] 10.222.0.49 () {60 vars in 1364 bytes} [Mon Jul 25 12:46:04 2022] GET /compute/v2.1/os-quota-sets/4dbd0e4cb4fe4569a08c31695099b9d9?user_id=d993dc20d73d4305a6ffa12d8a089275 => generated 190 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:46:04.178188 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dc419077-58dd-4793-9f82-212fdf89d604 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:04.178804 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dc419077-58dd-4793-9f82-212fdf89d604 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:04.185066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc419077-58dd-4793-9f82-212fdf89d604 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:04.185562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc419077-58dd-4793-9f82-212fdf89d604 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:04.186548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc419077-58dd-4793-9f82-212fdf89d604 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:04.186978 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc419077-58dd-4793-9f82-212fdf89d604 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:04.300731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d60120f0-6d0a-416f-b6f2-c8b893cd1f63 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:04.301549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d60120f0-6d0a-416f-b6f2-c8b893cd1f63 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:04.308428 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d60120f0-6d0a-416f-b6f2-c8b893cd1f63 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:04.308992 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d60120f0-6d0a-416f-b6f2-c8b893cd1f63 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:04.309898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d60120f0-6d0a-416f-b6f2-c8b893cd1f63 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:04.310570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d60120f0-6d0a-416f-b6f2-c8b893cd1f63 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:04.332571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dc419077-58dd-4793-9f82-212fdf89d604 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:04.341448 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dc419077-58dd-4793-9f82-212fdf89d604 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1472 microversion: 2.1 time: 0.167088 Jul 25 12:46:04.353881 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1070/2041] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:04 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1472 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:04.453976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-27b5601d-f38b-4aab-bca6-c9f2508c0db2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:04.454969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-27b5601d-f38b-4aab-bca6-c9f2508c0db2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:04.461472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27b5601d-f38b-4aab-bca6-c9f2508c0db2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:04.462021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27b5601d-f38b-4aab-bca6-c9f2508c0db2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:04.462797 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27b5601d-f38b-4aab-bca6-c9f2508c0db2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:04.463642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27b5601d-f38b-4aab-bca6-c9f2508c0db2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:04.513453 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d60120f0-6d0a-416f-b6f2-c8b893cd1f63 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:04.521474 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d60120f0-6d0a-416f-b6f2-c8b893cd1f63 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1666 microversion: 2.1 time: 0.224668 Jul 25 12:46:04.522724 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 972/2042] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:04 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1666 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:46:04.718998 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-27b5601d-f38b-4aab-bca6-c9f2508c0db2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:04.727141 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-27b5601d-f38b-4aab-bca6-c9f2508c0db2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 200 len: 1316 microversion: 2.1 time: 0.278472 Jul 25 12:46:04.727831 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1071/2043] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:04 2022] GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:04.843115 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fb321208-1e32-49f4-bf09-5d68f97a506f tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:04.843732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fb321208-1e32-49f4-bf09-5d68f97a506f tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 21390510-6525-44f6-818a-225eacdd5953] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:04.850137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb321208-1e32-49f4-bf09-5d68f97a506f tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:04.850589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb321208-1e32-49f4-bf09-5d68f97a506f tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:04.851359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb321208-1e32-49f4-bf09-5d68f97a506f tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:04.851791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb321208-1e32-49f4-bf09-5d68f97a506f tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:05.041778 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fb321208-1e32-49f4-bf09-5d68f97a506f tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:05.055153 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fb321208-1e32-49f4-bf09-5d68f97a506f tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953" status: 200 len: 1478 microversion: 2.1 time: 0.215827 Jul 25 12:46:05.071168 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 973/2044] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:04 2022] GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953 => generated 1478 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:05.113610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f8e05751-8528-4681-af5d-4b1f673f4931 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:05.115988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f8e05751-8528-4681-af5d-4b1f673f4931 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:05.127436 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8e05751-8528-4681-af5d-4b1f673f4931 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:05.129062 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8e05751-8528-4681-af5d-4b1f673f4931 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:05.130501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8e05751-8528-4681-af5d-4b1f673f4931 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:05.131195 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8e05751-8528-4681-af5d-4b1f673f4931 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:05.241725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f8e05751-8528-4681-af5d-4b1f673f4931 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:05.250873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f8e05751-8528-4681-af5d-4b1f673f4931 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:05.252498 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f8e05751-8528-4681-af5d-4b1f673f4931 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:05.253993 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f8e05751-8528-4681-af5d-4b1f673f4931 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1409 microversion: 2.54 time: 0.145525 Jul 25 12:46:05.254738 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1072/2045] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:05 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1409 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:05.306622 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-ea772f4e-5cd3-4021-87e1-73d7298bc3bd req-28d5f9a4-a578-4501-8db3-62446976be2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f541b63-ccc7-488a-b5a4-8ee5b0f5e682", "tag": "75bbc764-2330-471d-8fc8-f7402e8094db"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:05.334635 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ea772f4e-5cd3-4021-87e1-73d7298bc3bd req-28d5f9a4-a578-4501-8db3-62446976be2b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:05.336153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ea772f4e-5cd3-4021-87e1-73d7298bc3bd req-28d5f9a4-a578-4501-8db3-62446976be2b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:05.356898 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-ea772f4e-5cd3-4021-87e1-73d7298bc3bd req-28d5f9a4-a578-4501-8db3-62446976be2b service nova] Creating event network-changed:75bbc764-2330-471d-8fc8-f7402e8094db for instance 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 on n-h1-848886-15 Jul 25 12:46:05.367687 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-84d6de92-40b4-4e6d-8867-7b9dc961c209 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:05.368505 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-84d6de92-40b4-4e6d-8867-7b9dc961c209 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:05.375247 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-ea772f4e-5cd3-4021-87e1-73d7298bc3bd req-28d5f9a4-a578-4501-8db3-62446976be2b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074505 Jul 25 12:46:05.377280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84d6de92-40b4-4e6d-8867-7b9dc961c209 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:05.377861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84d6de92-40b4-4e6d-8867-7b9dc961c209 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:05.378752 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84d6de92-40b4-4e6d-8867-7b9dc961c209 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:05.379362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84d6de92-40b4-4e6d-8867-7b9dc961c209 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:05.382658 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 974/2046] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:05.531916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-84d6de92-40b4-4e6d-8867-7b9dc961c209 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:05.540361 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-84d6de92-40b4-4e6d-8867-7b9dc961c209 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1472 microversion: 2.1 time: 0.176659 Jul 25 12:46:05.540877 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1073/2047] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:05 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1472 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:05.545593 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ee7b621d-9ed7-404c-89a6-0d8e0c1e52b2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:05.546331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ee7b621d-9ed7-404c-89a6-0d8e0c1e52b2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:05.554086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee7b621d-9ed7-404c-89a6-0d8e0c1e52b2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:05.554409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee7b621d-9ed7-404c-89a6-0d8e0c1e52b2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:05.555209 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee7b621d-9ed7-404c-89a6-0d8e0c1e52b2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:05.555645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee7b621d-9ed7-404c-89a6-0d8e0c1e52b2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:05.702579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ee7b621d-9ed7-404c-89a6-0d8e0c1e52b2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:05.712131 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ee7b621d-9ed7-404c-89a6-0d8e0c1e52b2 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1666 microversion: 2.1 time: 0.171851 Jul 25 12:46:05.712928 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 975/2048] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:05 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1666 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:46:05.748105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-96f5fbf9-c1c3-447d-84ce-3a343c674ee8 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:05.748733 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-96f5fbf9-c1c3-447d-84ce-3a343c674ee8 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:05.755484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-96f5fbf9-c1c3-447d-84ce-3a343c674ee8 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:05.756084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-96f5fbf9-c1c3-447d-84ce-3a343c674ee8 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:05.756714 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-96f5fbf9-c1c3-447d-84ce-3a343c674ee8 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:05.757160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-96f5fbf9-c1c3-447d-84ce-3a343c674ee8 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:06.077415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4ed3f856-dcfb-4457-a5f4-2080cede777d tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:06.078742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4ed3f856-dcfb-4457-a5f4-2080cede777d tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 21390510-6525-44f6-818a-225eacdd5953] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:06.085422 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ed3f856-dcfb-4457-a5f4-2080cede777d tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:06.086203 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ed3f856-dcfb-4457-a5f4-2080cede777d tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:06.087172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ed3f856-dcfb-4457-a5f4-2080cede777d tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:06.087833 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ed3f856-dcfb-4457-a5f4-2080cede777d tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:06.102652 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-96f5fbf9-c1c3-447d-84ce-3a343c674ee8 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:06.116697 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-96f5fbf9-c1c3-447d-84ce-3a343c674ee8 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 200 len: 1316 microversion: 2.1 time: 0.372398 Jul 25 12:46:06.132590 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1074/2049] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:05 2022] GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 1316 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:06.277986 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-089a59ae-4d7d-432d-8b54-25c471dc4c1f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:06.279214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-089a59ae-4d7d-432d-8b54-25c471dc4c1f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:06.286908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-089a59ae-4d7d-432d-8b54-25c471dc4c1f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:06.288122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-089a59ae-4d7d-432d-8b54-25c471dc4c1f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:06.289095 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-089a59ae-4d7d-432d-8b54-25c471dc4c1f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:06.289696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-089a59ae-4d7d-432d-8b54-25c471dc4c1f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:06.595675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-089a59ae-4d7d-432d-8b54-25c471dc4c1f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:06.604747 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-089a59ae-4d7d-432d-8b54-25c471dc4c1f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:06.606686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-089a59ae-4d7d-432d-8b54-25c471dc4c1f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:06.608225 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-089a59ae-4d7d-432d-8b54-25c471dc4c1f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1409 microversion: 2.54 time: 0.334280 Jul 25 12:46:06.609313 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1075/2050] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:06 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1409 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:06.622799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-e9512c2f-0946-4363-adcf-d0c691bc0b12 req-4be4781c-3da6-4e9b-8c6f-38cce90a1c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21390510-6525-44f6-818a-225eacdd5953", "name": "network-vif-deleted", "tag": "ab6ba094-9ede-486e-b9bb-483f805db9da"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:06.636000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e9512c2f-0946-4363-adcf-d0c691bc0b12 req-4be4781c-3da6-4e9b-8c6f-38cce90a1c42 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:06.636450 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e9512c2f-0946-4363-adcf-d0c691bc0b12 req-4be4781c-3da6-4e9b-8c6f-38cce90a1c42 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:06.649207 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-e9512c2f-0946-4363-adcf-d0c691bc0b12 req-4be4781c-3da6-4e9b-8c6f-38cce90a1c42 service nova] Creating event network-vif-deleted:ab6ba094-9ede-486e-b9bb-483f805db9da for instance 21390510-6525-44f6-818a-225eacdd5953 on n-h1-848886-15 Jul 25 12:46:06.655865 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-e9512c2f-0946-4363-adcf-d0c691bc0b12 req-4be4781c-3da6-4e9b-8c6f-38cce90a1c42 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044970 Jul 25 12:46:06.656441 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1076/2051] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:06.663465 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2e6a2518-0da5-42d2-9a18-afaba54ffd91 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:06.664406 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2e6a2518-0da5-42d2-9a18-afaba54ffd91 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:06.671836 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2e6a2518-0da5-42d2-9a18-afaba54ffd91 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:06.672532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2e6a2518-0da5-42d2-9a18-afaba54ffd91 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:06.673493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2e6a2518-0da5-42d2-9a18-afaba54ffd91 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:06.674118 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2e6a2518-0da5-42d2-9a18-afaba54ffd91 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:06.849025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4ed3f856-dcfb-4457-a5f4-2080cede777d tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9488de03a0cf4e10b18ba769cb2cf408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255fa26649774caca18f3b9784863281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:06.859026 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4ed3f856-dcfb-4457-a5f4-2080cede777d tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953" status: 200 len: 1478 microversion: 2.1 time: 0.786201 Jul 25 12:46:06.859622 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 976/2052] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:06 2022] GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953 => generated 1478 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:46:06.880679 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a02ec8b8-7c91-4557-8b55-013150e5fea6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:06.881616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a02ec8b8-7c91-4557-8b55-013150e5fea6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:06.889094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a02ec8b8-7c91-4557-8b55-013150e5fea6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:06.889849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a02ec8b8-7c91-4557-8b55-013150e5fea6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:06.890805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a02ec8b8-7c91-4557-8b55-013150e5fea6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:06.891407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a02ec8b8-7c91-4557-8b55-013150e5fea6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:07.213757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2e6a2518-0da5-42d2-9a18-afaba54ffd91 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:07.222533 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2e6a2518-0da5-42d2-9a18-afaba54ffd91 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1472 microversion: 2.1 time: 0.564758 Jul 25 12:46:07.236790 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1077/2053] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:06 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1472 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:07.242035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-71a67ffa-9a32-42b1-9b68-c6001f3785e5 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:07.242764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-71a67ffa-9a32-42b1-9b68-c6001f3785e5 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:07.249254 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71a67ffa-9a32-42b1-9b68-c6001f3785e5 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:07.250065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71a67ffa-9a32-42b1-9b68-c6001f3785e5 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:07.250926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71a67ffa-9a32-42b1-9b68-c6001f3785e5 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:07.251448 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71a67ffa-9a32-42b1-9b68-c6001f3785e5 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:07.367831 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a02ec8b8-7c91-4557-8b55-013150e5fea6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:07.377435 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a02ec8b8-7c91-4557-8b55-013150e5fea6 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1666 microversion: 2.1 time: 0.502030 Jul 25 12:46:07.378235 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 977/2054] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:06 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1666 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:07.571720 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-71a67ffa-9a32-42b1-9b68-c6001f3785e5 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:07.580213 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-71a67ffa-9a32-42b1-9b68-c6001f3785e5 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 200 len: 1316 microversion: 2.1 time: 0.342193 Jul 25 12:46:07.581441 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1078/2055] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:07 2022] GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 1316 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:07.631467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c85f8f2c-92e3-4df3-941a-071cb68bf29e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:07.632089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c85f8f2c-92e3-4df3-941a-071cb68bf29e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:07.641177 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c85f8f2c-92e3-4df3-941a-071cb68bf29e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:07.647463 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c85f8f2c-92e3-4df3-941a-071cb68bf29e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:07.648310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c85f8f2c-92e3-4df3-941a-071cb68bf29e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:07.649206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c85f8f2c-92e3-4df3-941a-071cb68bf29e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:07.686868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1dc61e53-94c3-413a-b3a2-abd09b3fedce tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:07.689732 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:46:07.689732 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:46:07.690990 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1dc61e53-94c3-413a-b3a2-abd09b3fedce tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:07.691447 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1dc61e53-94c3-413a-b3a2-abd09b3fedce tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:07.692253 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1dc61e53-94c3-413a-b3a2-abd09b3fedce tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:07.692900 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1dc61e53-94c3-413a-b3a2-abd09b3fedce tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:07.708732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:07.720160 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1dc61e53-94c3-413a-b3a2-abd09b3fedce tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.188459 Jul 25 12:46:07.720873 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 978/2056] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:46:07 2022] GET /compute/v2.1/os-services => generated 949 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:07.732739 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f95231c6-b3ac-4d4d-a7f1-c47ef6f2f8b0 tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:07.735301 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:46:07.735301 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:46:07.736559 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f95231c6-b3ac-4d4d-a7f1-c47ef6f2f8b0 tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:07.736981 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f95231c6-b3ac-4d4d-a7f1-c47ef6f2f8b0 tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:07.738079 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f95231c6-b3ac-4d4d-a7f1-c47ef6f2f8b0 tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:07.738522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f95231c6-b3ac-4d4d-a7f1-c47ef6f2f8b0 tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:07.763587 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f95231c6-b3ac-4d4d-a7f1-c47ef6f2f8b0 tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?host=n-d-848886-15" status: 200 len: 581 microversion: 2.1 time: 0.034335 Jul 25 12:46:07.764163 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 979/2057] 10.222.0.49 () {58 vars in 1174 bytes} [Mon Jul 25 12:46:07 2022] GET /compute/v2.1/os-services?host=n-d-848886-15 => generated 581 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:46:07.777924 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-579685fd-2d2e-4922-9939-35bed4215ec8 tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:07.780493 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:46:07.780493 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:46:07.780729 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c85f8f2c-92e3-4df3-941a-071cb68bf29e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:07.781898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-579685fd-2d2e-4922-9939-35bed4215ec8 tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:07.782371 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-579685fd-2d2e-4922-9939-35bed4215ec8 tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:07.783326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-579685fd-2d2e-4922-9939-35bed4215ec8 tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:07.783889 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-579685fd-2d2e-4922-9939-35bed4215ec8 tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:07.789711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c85f8f2c-92e3-4df3-941a-071cb68bf29e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:07.791485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c85f8f2c-92e3-4df3-941a-071cb68bf29e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:07.792763 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c85f8f2c-92e3-4df3-941a-071cb68bf29e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1409 microversion: 2.54 time: 0.165457 Jul 25 12:46:07.793435 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1079/2058] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:07 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1409 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:46:07.808967 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-579685fd-2d2e-4922-9939-35bed4215ec8 tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.034836 Jul 25 12:46:07.809596 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 980/2059] 10.222.0.49 () {58 vars in 1176 bytes} [Mon Jul 25 12:46:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:46:07.822081 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2472e938-9a79-4f26-bc93-20b973b25f1f tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:07.824768 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:46:07.824768 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:46:07.826161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2472e938-9a79-4f26-bc93-20b973b25f1f tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:07.826601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2472e938-9a79-4f26-bc93-20b973b25f1f tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:07.827408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2472e938-9a79-4f26-bc93-20b973b25f1f tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:07.827844 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2472e938-9a79-4f26-bc93-20b973b25f1f tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:07.851877 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2472e938-9a79-4f26-bc93-20b973b25f1f tempest-ServicesAdminTestJSON-1062788465 tempest-ServicesAdminTestJSON-1062788465-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.033807 Jul 25 12:46:07.852506 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1080/2060] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:46:07 2022] GET /compute/v2.1/os-services => generated 949 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:07.890327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-15f4c948-4ff1-4eec-8ef1-89eab39606f8 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:07.891620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-15f4c948-4ff1-4eec-8ef1-89eab39606f8 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] [instance: 21390510-6525-44f6-818a-225eacdd5953] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:07.900393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15f4c948-4ff1-4eec-8ef1-89eab39606f8 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:07.901210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15f4c948-4ff1-4eec-8ef1-89eab39606f8 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:07.902359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15f4c948-4ff1-4eec-8ef1-89eab39606f8 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:07.903019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15f4c948-4ff1-4eec-8ef1-89eab39606f8 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:07.925054 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-15f4c948-4ff1-4eec-8ef1-89eab39606f8 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] HTTP exception thrown: Instance 21390510-6525-44f6-818a-225eacdd5953 could not be found. Jul 25 12:46:07.927597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-15f4c948-4ff1-4eec-8ef1-89eab39606f8 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Request method failure captured: Jul 25 12:46:07.927597 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953 HTTP/1.1 Jul 25 12:46:07.927597 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:46:07.927597 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:46:07.927597 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:46:07.927597 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:46:07.927597 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:46:07.927597 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:46:07.927597 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:46:07.927597 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:07.927597 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pBObqscFZDHwI53XHUog2qlLqkwA8tpmptNND1yna5q_ka7bv8C3FxtEZGZFt2UxTU3MGdnEialqIOUblpsqAN993S1bCfJ2w_i88Q6k2QOPnCN9NXGjOKrh0iWHlcjp-sfWU1OyXZrssrxKOm-F_enwsfeU2ZBm3lwhYaf_ibMID8 Jul 25 12:46:07.927597 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:46:07.927597 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:46:07.927597 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:46:07.927597 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:46:07.927597 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:46:07.927597 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:46:07.927597 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 255fa26649774caca18f3b9784863281 Jul 25 12:46:07.927597 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1107055732 Jul 25 12:46:07.927597 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:46:07.927597 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:46:07.929621 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_255fa26649774caca18f3b9784863281", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/255fa26649774caca18f3b9784863281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/255fa26649774caca18f3b9784863281"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/255fa26649774caca18f3b9784863281"}]}] Jul 25 12:46:07.929621 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1107055732 Jul 25 12:46:07.929621 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 255fa26649774caca18f3b9784863281 Jul 25 12:46:07.929621 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1107055732 Jul 25 12:46:07.929621 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersAdminNegativeTestJSON-1107055732-project Jul 25 12:46:07.929621 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:46:07.929621 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:46:07.929621 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 9488de03a0cf4e10b18ba769cb2cf408 Jul 25 12:46:07.929621 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1107055732-project Jul 25 12:46:07.929621 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:46:07.929621 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 21390510-6525-44f6-818a-225eacdd5953 could not be found. Jul 25 12:46:07.929621 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '21390510-6525-44f6-818a-225eacdd5953'} Jul 25 12:46:07.930683 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:07.930683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:07.930683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:46:07.930683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:46:07.930683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:46:07.930683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:46:07.930683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:46:07.930683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:46:07.930683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:46:07.930683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:46:07.930683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21390510-6525-44f6-818a-225eacdd5953 could not be found. Jul 25 12:46:07.930683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:07.930683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:07.930683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:07.930683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:07.930683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:07.930683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:07.930683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:07.930683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:07.930683 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:07.932409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:07.932409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:46:07.932409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:46:07.932409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:46:07.932409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:46:07.932409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:46:07.932409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:46:07.932409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21390510-6525-44f6-818a-225eacdd5953 could not be found. Jul 25 12:46:07.932409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:07.932409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:07.932409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:07.932409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:07.932409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:07.932409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:07.932409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:07.932409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:07.932409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21390510-6525-44f6-818a-225eacdd5953 could not be found. Jul 25 12:46:07.932409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:07.933967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-15f4c948-4ff1-4eec-8ef1-89eab39606f8 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] Returning 404 to user: Instance 21390510-6525-44f6-818a-225eacdd5953 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:07.936020 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-15f4c948-4ff1-4eec-8ef1-89eab39606f8 tempest-ServersAdminNegativeTestJSON-1107055732 tempest-ServersAdminNegativeTestJSON-1107055732-project] 10.222.0.49 "GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953" status: 404 len: 111 microversion: 2.1 time: 0.051376 Jul 25 12:46:07.936722 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 981/2061] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:07 2022] GET /compute/v2.1/servers/21390510-6525-44f6-818a-225eacdd5953 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:46:08.090067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-e15e33e7-dd79-433c-b45e-3a3ec237070a req-46944613-0651-4fc0-9d39-9241e0223735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2711752-4c19-477f-a5f0-e5097f2dc41a", "name": "network-vif-deleted", "tag": "9e34f7bb-4583-4a3f-875a-1441c142d908"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:08.104695 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e15e33e7-dd79-433c-b45e-3a3ec237070a req-46944613-0651-4fc0-9d39-9241e0223735 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:08.105139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e15e33e7-dd79-433c-b45e-3a3ec237070a req-46944613-0651-4fc0-9d39-9241e0223735 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:08.139398 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-e15e33e7-dd79-433c-b45e-3a3ec237070a req-46944613-0651-4fc0-9d39-9241e0223735 service nova] Creating event network-vif-deleted:9e34f7bb-4583-4a3f-875a-1441c142d908 for instance d2711752-4c19-477f-a5f0-e5097f2dc41a on n-h1-848886-15 Jul 25 12:46:08.145161 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-e15e33e7-dd79-433c-b45e-3a3ec237070a req-46944613-0651-4fc0-9d39-9241e0223735 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059754 Jul 25 12:46:08.146325 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1081/2062] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:08.244389 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6a5d9ed8-c913-4e06-b526-c5590ba7b6cf tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:08.245297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6a5d9ed8-c913-4e06-b526-c5590ba7b6cf tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:08.251874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a5d9ed8-c913-4e06-b526-c5590ba7b6cf tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:08.252551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a5d9ed8-c913-4e06-b526-c5590ba7b6cf tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:08.253677 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a5d9ed8-c913-4e06-b526-c5590ba7b6cf tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:08.254299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a5d9ed8-c913-4e06-b526-c5590ba7b6cf tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:08.402174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aaad7e8d-c493-437c-a4b9-cdbf0f98d2d8 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:08.403034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-aaad7e8d-c493-437c-a4b9-cdbf0f98d2d8 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:08.406309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:08.410379 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aaad7e8d-c493-437c-a4b9-cdbf0f98d2d8 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:08.410828 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aaad7e8d-c493-437c-a4b9-cdbf0f98d2d8 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:08.411729 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aaad7e8d-c493-437c-a4b9-cdbf0f98d2d8 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:08.412037 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aaad7e8d-c493-437c-a4b9-cdbf0f98d2d8 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:08.511743 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-aaad7e8d-c493-437c-a4b9-cdbf0f98d2d8 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:08.517624 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6a5d9ed8-c913-4e06-b526-c5590ba7b6cf tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:08.519815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:08.526880 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-aaad7e8d-c493-437c-a4b9-cdbf0f98d2d8 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 200 len: 1598 microversion: 2.1 time: 0.130762 Jul 25 12:46:08.542322 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1082/2063] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:08 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 1598 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:46:08.542730 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6a5d9ed8-c913-4e06-b526-c5590ba7b6cf tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1478 microversion: 2.1 time: 0.290944 Jul 25 12:46:08.542730 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 982/2064] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:08 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1478 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:08.606065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-18d2320b-9e1b-4349-870a-13fea7a42195 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:08.606965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-18d2320b-9e1b-4349-870a-13fea7a42195 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:08.623249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-18d2320b-9e1b-4349-870a-13fea7a42195 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:08.623715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-18d2320b-9e1b-4349-870a-13fea7a42195 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:08.630846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-18d2320b-9e1b-4349-870a-13fea7a42195 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:08.631513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-18d2320b-9e1b-4349-870a-13fea7a42195 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:08.819384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6cb07ecf-4380-4868-b4db-edef66db0cd5 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:08.820935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6cb07ecf-4380-4868-b4db-edef66db0cd5 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:08.834125 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6cb07ecf-4380-4868-b4db-edef66db0cd5 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:08.834877 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6cb07ecf-4380-4868-b4db-edef66db0cd5 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:08.835893 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6cb07ecf-4380-4868-b4db-edef66db0cd5 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:08.837002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6cb07ecf-4380-4868-b4db-edef66db0cd5 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:08.914527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-18d2320b-9e1b-4349-870a-13fea7a42195 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:08.920823 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-18d2320b-9e1b-4349-870a-13fea7a42195 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 200 len: 1316 microversion: 2.1 time: 0.320835 Jul 25 12:46:08.921510 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1083/2065] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:08 2022] GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 1316 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:08.955513 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6cb07ecf-4380-4868-b4db-edef66db0cd5 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:08.966417 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6cb07ecf-4380-4868-b4db-edef66db0cd5 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:08.968004 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6cb07ecf-4380-4868-b4db-edef66db0cd5 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:08.969222 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6cb07ecf-4380-4868-b4db-edef66db0cd5 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1409 microversion: 2.54 time: 0.155906 Jul 25 12:46:08.970401 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 983/2066] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:08 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1409 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:09.549729 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c5d1c4ce-fc78-4493-aebc-0822c40f5308 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:09.551244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c5d1c4ce-fc78-4493-aebc-0822c40f5308 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: d2711752-4c19-477f-a5f0-e5097f2dc41a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:09.558040 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-eb2ff499-01b4-43db-8758-975fc5b895a7 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:09.560167 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-eb2ff499-01b4-43db-8758-975fc5b895a7 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:09.561557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5d1c4ce-fc78-4493-aebc-0822c40f5308 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:09.562306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5d1c4ce-fc78-4493-aebc-0822c40f5308 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:09.563325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5d1c4ce-fc78-4493-aebc-0822c40f5308 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:09.564288 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5d1c4ce-fc78-4493-aebc-0822c40f5308 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:09.585513 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb2ff499-01b4-43db-8758-975fc5b895a7 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:09.586008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb2ff499-01b4-43db-8758-975fc5b895a7 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:09.587608 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb2ff499-01b4-43db-8758-975fc5b895a7 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:09.588063 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb2ff499-01b4-43db-8758-975fc5b895a7 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:09.592525 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-c5d1c4ce-fc78-4493-aebc-0822c40f5308 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] HTTP exception thrown: Instance d2711752-4c19-477f-a5f0-e5097f2dc41a could not be found. Jul 25 12:46:09.594472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c5d1c4ce-fc78-4493-aebc-0822c40f5308 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Request method failure captured: Jul 25 12:46:09.594472 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a HTTP/1.1 Jul 25 12:46:09.594472 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:46:09.594472 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:46:09.594472 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:46:09.594472 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:46:09.594472 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:46:09.594472 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:46:09.594472 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:46:09.594472 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:09.594472 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o7poLIdxb27XVu2RKEtMCxaMxCaSjEIgSKcBXkPISZGHxHjR8c675dy5vog8O3kZ3T4LROBGt9vfRYVx5q8QHV3paRvph-9huVqLwyVUVmFlsOpM7fWTJsYcsA1ALabDrXfnA-ARL6wA0kcPD3fLNQ2-771ZbEbR0JFe41wdmHqAp8 Jul 25 12:46:09.594472 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:46:09.594472 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:46:09.594472 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:46:09.594472 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:46:09.594472 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:46:09.594472 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:46:09.594472 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 4946a18b68e146278158ac991143a243 Jul 25 12:46:09.594472 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-LiveMigrationTest-1701369834 Jul 25 12:46:09.594472 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:46:09.594472 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:46:09.596336 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4946a18b68e146278158ac991143a243", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4946a18b68e146278158ac991143a243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4946a18b68e146278158ac991143a243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4946a18b68e146278158ac991143a243"}]}] Jul 25 12:46:09.596336 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-LiveMigrationTest-1701369834 Jul 25 12:46:09.596336 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 4946a18b68e146278158ac991143a243 Jul 25 12:46:09.596336 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-LiveMigrationTest-1701369834 Jul 25 12:46:09.596336 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-LiveMigrationTest-1701369834-project Jul 25 12:46:09.596336 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:46:09.596336 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:46:09.596336 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: a02530d4c6384518b3f45515208e83d8 Jul 25 12:46:09.596336 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-LiveMigrationTest-1701369834-project Jul 25 12:46:09.596336 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:46:09.596336 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance d2711752-4c19-477f-a5f0-e5097f2dc41a could not be found. Jul 25 12:46:09.596336 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'd2711752-4c19-477f-a5f0-e5097f2dc41a'} Jul 25 12:46:09.597540 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:09.597540 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:09.597540 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:46:09.597540 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:46:09.597540 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:46:09.597540 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:46:09.597540 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:46:09.597540 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:46:09.597540 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:46:09.597540 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:46:09.597540 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2711752-4c19-477f-a5f0-e5097f2dc41a could not be found. Jul 25 12:46:09.597540 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:09.597540 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:09.597540 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:09.597540 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:09.597540 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:09.597540 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:09.597540 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:09.597540 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:09.597540 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:09.599382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:09.599382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:46:09.599382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:46:09.599382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:46:09.599382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:46:09.599382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:46:09.599382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:46:09.599382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2711752-4c19-477f-a5f0-e5097f2dc41a could not be found. Jul 25 12:46:09.599382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:09.599382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:09.599382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:09.599382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:09.599382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:09.599382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:09.599382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:09.599382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:09.599382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2711752-4c19-477f-a5f0-e5097f2dc41a could not be found. Jul 25 12:46:09.599382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:09.600962 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c5d1c4ce-fc78-4493-aebc-0822c40f5308 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Returning 404 to user: Instance d2711752-4c19-477f-a5f0-e5097f2dc41a could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:09.600962 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c5d1c4ce-fc78-4493-aebc-0822c40f5308 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a" status: 404 len: 111 microversion: 2.1 time: 0.054072 Jul 25 12:46:09.604081 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1084/2067] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:09 2022] GET /compute/v2.1/servers/d2711752-4c19-477f-a5f0-e5097f2dc41a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:46:09.609811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2e8de8f6-0122-448e-bf16-b69acb5859b5 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '.version_select at 0x7efcf92bc550>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:09.637164 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2e8de8f6-0122-448e-bf16-b69acb5859b5 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-508096258" status: 202 len: 0 microversion: 2.1 time: 0.031750 Jul 25 12:46:09.641715 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1085/2068] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Jul 25 12:46:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-508096258 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:46:09.817242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-eb2ff499-01b4-43db-8758-975fc5b895a7 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:09.826516 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-eb2ff499-01b4-43db-8758-975fc5b895a7 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1478 microversion: 2.1 time: 0.275249 Jul 25 12:46:09.827221 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 984/2069] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:09 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1478 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:46:09.939990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=38 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:09.945218 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0a356e06-e3c9-4df4-b479-e5c0143a7454 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:09.945870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0a356e06-e3c9-4df4-b479-e5c0143a7454 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:09.955491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a356e06-e3c9-4df4-b479-e5c0143a7454 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:09.956208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a356e06-e3c9-4df4-b479-e5c0143a7454 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:09.956990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a356e06-e3c9-4df4-b479-e5c0143a7454 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:09.957683 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a356e06-e3c9-4df4-b479-e5c0143a7454 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:09.999045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-925abaef-cc9a-4c9f-9453-aebfdddadbbb tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:10.000437 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-925abaef-cc9a-4c9f-9453-aebfdddadbbb tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:10.019535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-925abaef-cc9a-4c9f-9453-aebfdddadbbb tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:10.021453 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-925abaef-cc9a-4c9f-9453-aebfdddadbbb tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:10.023599 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-925abaef-cc9a-4c9f-9453-aebfdddadbbb tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:10.025622 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-925abaef-cc9a-4c9f-9453-aebfdddadbbb tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:10.123475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-925abaef-cc9a-4c9f-9453-aebfdddadbbb tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:10.143340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-925abaef-cc9a-4c9f-9453-aebfdddadbbb tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:10.147844 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-925abaef-cc9a-4c9f-9453-aebfdddadbbb tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:10.151016 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-925abaef-cc9a-4c9f-9453-aebfdddadbbb tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1409 microversion: 2.54 time: 0.156500 Jul 25 12:46:10.151591 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 985/2070] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:09 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1409 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:10.203453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0a356e06-e3c9-4df4-b479-e5c0143a7454 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:10.213484 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0a356e06-e3c9-4df4-b479-e5c0143a7454 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 200 len: 1316 microversion: 2.1 time: 0.274182 Jul 25 12:46:10.223044 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1086/2071] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:09 2022] GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 1316 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:10.358495 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ecb6a3a3-73c5-46f5-8d03-2de274add931 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:10.359321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ecb6a3a3-73c5-46f5-8d03-2de274add931 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:10.366600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ecb6a3a3-73c5-46f5-8d03-2de274add931 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:10.367144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ecb6a3a3-73c5-46f5-8d03-2de274add931 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:10.368031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ecb6a3a3-73c5-46f5-8d03-2de274add931 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:10.368561 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ecb6a3a3-73c5-46f5-8d03-2de274add931 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:10.407266 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ecb6a3a3-73c5-46f5-8d03-2de274add931 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:46:10.502900 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ecb6a3a3-73c5-46f5-8d03-2de274add931 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "DELETE /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 204 len: 0 microversion: 2.1 time: 0.148891 Jul 25 12:46:10.506727 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 986/2072] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:46:10 2022] DELETE /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:46:10.513735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8af6a2a9-0383-4ceb-b620-15714285b024 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:10.514425 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8af6a2a9-0383-4ceb-b620-15714285b024 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:10.526331 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8af6a2a9-0383-4ceb-b620-15714285b024 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:10.526964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8af6a2a9-0383-4ceb-b620-15714285b024 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:10.528441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8af6a2a9-0383-4ceb-b620-15714285b024 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:10.528890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8af6a2a9-0383-4ceb-b620-15714285b024 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:10.784165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8af6a2a9-0383-4ceb-b620-15714285b024 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:10.797732 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8af6a2a9-0383-4ceb-b620-15714285b024 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 200 len: 1485 microversion: 2.1 time: 0.289435 Jul 25 12:46:10.799555 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1087/2073] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:10 2022] GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 1485 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:10.853244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-30e0575b-0227-4881-81e1-d23a6ac5a10e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:10.853945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-30e0575b-0227-4881-81e1-d23a6ac5a10e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:10.862129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30e0575b-0227-4881-81e1-d23a6ac5a10e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:10.862921 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30e0575b-0227-4881-81e1-d23a6ac5a10e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:10.864008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30e0575b-0227-4881-81e1-d23a6ac5a10e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:10.864874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30e0575b-0227-4881-81e1-d23a6ac5a10e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:10.886268 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:11.175807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-71eb5b24-29fa-4e70-b438-d4989985d7e7 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:11.176516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-71eb5b24-29fa-4e70-b438-d4989985d7e7 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:11.183309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71eb5b24-29fa-4e70-b438-d4989985d7e7 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:11.184040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71eb5b24-29fa-4e70-b438-d4989985d7e7 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:11.185074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71eb5b24-29fa-4e70-b438-d4989985d7e7 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:11.185860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71eb5b24-29fa-4e70-b438-d4989985d7e7 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:11.205803 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-30e0575b-0227-4881-81e1-d23a6ac5a10e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:11.215715 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-30e0575b-0227-4881-81e1-d23a6ac5a10e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1478 microversion: 2.1 time: 0.366694 Jul 25 12:46:11.230528 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 987/2074] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:10 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1478 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:11.235801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-75a92fb4-b09f-40f7-8c66-68bf4e6f4067 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:11.236489 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-75a92fb4-b09f-40f7-8c66-68bf4e6f4067 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:11.244094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-75a92fb4-b09f-40f7-8c66-68bf4e6f4067 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:11.244904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-75a92fb4-b09f-40f7-8c66-68bf4e6f4067 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:11.245756 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-75a92fb4-b09f-40f7-8c66-68bf4e6f4067 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:11.246515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-75a92fb4-b09f-40f7-8c66-68bf4e6f4067 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:11.328765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-71eb5b24-29fa-4e70-b438-d4989985d7e7 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:11.337868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-71eb5b24-29fa-4e70-b438-d4989985d7e7 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:11.339368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-71eb5b24-29fa-4e70-b438-d4989985d7e7 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:11.340796 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-71eb5b24-29fa-4e70-b438-d4989985d7e7 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1409 microversion: 2.54 time: 0.169110 Jul 25 12:46:11.341930 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1088/2075] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:11 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1409 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:11.820818 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4dc72b46-d7a6-4307-ad4d-52f66c8e9915 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:11.822294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4dc72b46-d7a6-4307-ad4d-52f66c8e9915 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:11.830034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4dc72b46-d7a6-4307-ad4d-52f66c8e9915 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:11.830497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4dc72b46-d7a6-4307-ad4d-52f66c8e9915 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:11.831290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4dc72b46-d7a6-4307-ad4d-52f66c8e9915 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:11.832227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4dc72b46-d7a6-4307-ad4d-52f66c8e9915 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:11.929008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-75a92fb4-b09f-40f7-8c66-68bf4e6f4067 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:11.936991 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-75a92fb4-b09f-40f7-8c66-68bf4e6f4067 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 200 len: 1316 microversion: 2.1 time: 0.705091 Jul 25 12:46:11.937568 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 988/2076] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:11 2022] GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 1316 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:12.201127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4dc72b46-d7a6-4307-ad4d-52f66c8e9915 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:12.217562 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4dc72b46-d7a6-4307-ad4d-52f66c8e9915 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 200 len: 1485 microversion: 2.1 time: 0.399797 Jul 25 12:46:12.218583 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1089/2077] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:11 2022] GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 1485 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:12.240523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-14000ec7-cabc-4876-b8b8-58ec62ed6f2e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:12.242049 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-14000ec7-cabc-4876-b8b8-58ec62ed6f2e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:12.249484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14000ec7-cabc-4876-b8b8-58ec62ed6f2e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:12.250231 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14000ec7-cabc-4876-b8b8-58ec62ed6f2e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:12.251775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14000ec7-cabc-4876-b8b8-58ec62ed6f2e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:12.252380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14000ec7-cabc-4876-b8b8-58ec62ed6f2e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:12.281352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-86bd14b0-43c8-4ac2-bd11-f0769428bcde req-cbf1a7dd-5e52-4144-bca1-3c7490a5e73e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6bb4f7e-67c3-4c86-8e69-92fd4061e26d", "name": "network-vif-unplugged", "status": "completed", "tag": "b55028ef-4d91-4ac2-a60c-3406cbca7db4"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:12.305454 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-86bd14b0-43c8-4ac2-bd11-f0769428bcde req-cbf1a7dd-5e52-4144-bca1-3c7490a5e73e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:12.306399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-86bd14b0-43c8-4ac2-bd11-f0769428bcde req-cbf1a7dd-5e52-4144-bca1-3c7490a5e73e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:12.329045 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-86bd14b0-43c8-4ac2-bd11-f0769428bcde req-cbf1a7dd-5e52-4144-bca1-3c7490a5e73e service nova] Creating event network-vif-unplugged:b55028ef-4d91-4ac2-a60c-3406cbca7db4 for instance c6bb4f7e-67c3-4c86-8e69-92fd4061e26d on n-h2-848886-15 Jul 25 12:46:12.340596 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-86bd14b0-43c8-4ac2-bd11-f0769428bcde req-cbf1a7dd-5e52-4144-bca1-3c7490a5e73e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074397 Jul 25 12:46:12.342991 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1090/2078] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:46:12.368233 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e2e32803-35b0-4d90-b82d-91a07d126ced tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:12.369018 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e2e32803-35b0-4d90-b82d-91a07d126ced tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:12.380837 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2e32803-35b0-4d90-b82d-91a07d126ced tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:12.382088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2e32803-35b0-4d90-b82d-91a07d126ced tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:12.382989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2e32803-35b0-4d90-b82d-91a07d126ced tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:12.383868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2e32803-35b0-4d90-b82d-91a07d126ced tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:12.521227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e2e32803-35b0-4d90-b82d-91a07d126ced tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:12.540137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e2e32803-35b0-4d90-b82d-91a07d126ced tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:12.542627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e2e32803-35b0-4d90-b82d-91a07d126ced tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:12.545124 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e2e32803-35b0-4d90-b82d-91a07d126ced tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1409 microversion: 2.54 time: 0.183191 Jul 25 12:46:12.546480 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1091/2079] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:12 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1409 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:46:12.632776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-14000ec7-cabc-4876-b8b8-58ec62ed6f2e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:12.651936 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-14000ec7-cabc-4876-b8b8-58ec62ed6f2e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1478 microversion: 2.1 time: 0.418267 Jul 25 12:46:12.669667 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 989/2080] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:12 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1478 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:12.728562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-9b531cac-e345-4f0b-a780-cf202ab9b4a6 req-d4cb34de-35c6-4a0b-b1f2-4af82a294263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "742583f4-0949-418b-a666-dc715ab936d5", "name": "network-vif-deleted", "tag": "32b54c20-b2ca-4697-b32a-a4dbd0903730"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:12.769237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9b531cac-e345-4f0b-a780-cf202ab9b4a6 req-d4cb34de-35c6-4a0b-b1f2-4af82a294263 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:12.772333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9b531cac-e345-4f0b-a780-cf202ab9b4a6 req-d4cb34de-35c6-4a0b-b1f2-4af82a294263 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:12.819644 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-9b531cac-e345-4f0b-a780-cf202ab9b4a6 req-d4cb34de-35c6-4a0b-b1f2-4af82a294263 service nova] Creating event network-vif-deleted:32b54c20-b2ca-4697-b32a-a4dbd0903730 for instance 742583f4-0949-418b-a666-dc715ab936d5 on n-h2-848886-15 Jul 25 12:46:12.852611 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-9b531cac-e345-4f0b-a780-cf202ab9b4a6 req-d4cb34de-35c6-4a0b-b1f2-4af82a294263 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131849 Jul 25 12:46:12.857122 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1092/2081] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:12.960700 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b3e9df0c-da86-4477-95c3-317fcee0153f tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:12.961645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b3e9df0c-da86-4477-95c3-317fcee0153f tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:12.973590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3e9df0c-da86-4477-95c3-317fcee0153f tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:12.974207 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3e9df0c-da86-4477-95c3-317fcee0153f tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:12.975079 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3e9df0c-da86-4477-95c3-317fcee0153f tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:12.975519 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3e9df0c-da86-4477-95c3-317fcee0153f tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:13.220201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b3e9df0c-da86-4477-95c3-317fcee0153f tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:13.230390 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b3e9df0c-da86-4477-95c3-317fcee0153f tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 200 len: 1316 microversion: 2.1 time: 0.275254 Jul 25 12:46:13.231218 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 990/2082] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:12 2022] GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 1316 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:13.240490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7c4fe869-0133-46ed-80a7-bab2295d076e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:13.241496 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7c4fe869-0133-46ed-80a7-bab2295d076e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:13.264853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c4fe869-0133-46ed-80a7-bab2295d076e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:13.269079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c4fe869-0133-46ed-80a7-bab2295d076e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:13.272235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c4fe869-0133-46ed-80a7-bab2295d076e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:13.274100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c4fe869-0133-46ed-80a7-bab2295d076e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:13.336459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c4fe869-0133-46ed-80a7-bab2295d076e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:13.336904 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c4fe869-0133-46ed-80a7-bab2295d076e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:13.340704 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-7c4fe869-0133-46ed-80a7-bab2295d076e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lazy-loading 'fault' on Instance uuid 742583f4-0949-418b-a666-dc715ab936d5 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:46:13.469754 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7c4fe869-0133-46ed-80a7-bab2295d076e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:13.481944 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7c4fe869-0133-46ed-80a7-bab2295d076e tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 200 len: 1301 microversion: 2.1 time: 0.245591 Jul 25 12:46:13.483209 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1093/2083] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:13 2022] GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 1301 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:13.572397 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-13c7ff7d-5759-4911-903e-54ab1349000e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:13.573744 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-13c7ff7d-5759-4911-903e-54ab1349000e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:13.582448 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13c7ff7d-5759-4911-903e-54ab1349000e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:13.583816 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13c7ff7d-5759-4911-903e-54ab1349000e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:13.585002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13c7ff7d-5759-4911-903e-54ab1349000e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:13.585596 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13c7ff7d-5759-4911-903e-54ab1349000e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:13.678301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bd5d2b35-f1b4-40dc-89da-c1f851d0f5eb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:13.681965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bd5d2b35-f1b4-40dc-89da-c1f851d0f5eb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:13.689945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd5d2b35-f1b4-40dc-89da-c1f851d0f5eb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:13.690742 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd5d2b35-f1b4-40dc-89da-c1f851d0f5eb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:13.691824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd5d2b35-f1b4-40dc-89da-c1f851d0f5eb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:13.692433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd5d2b35-f1b4-40dc-89da-c1f851d0f5eb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:13.721223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-13c7ff7d-5759-4911-903e-54ab1349000e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:13.731521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-13c7ff7d-5759-4911-903e-54ab1349000e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:13.733532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-13c7ff7d-5759-4911-903e-54ab1349000e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:13.735145 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-13c7ff7d-5759-4911-903e-54ab1349000e tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1409 microversion: 2.54 time: 0.169482 Jul 25 12:46:13.735904 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 991/2084] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:13 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1409 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:13.978915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bd5d2b35-f1b4-40dc-89da-c1f851d0f5eb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:13.987499 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bd5d2b35-f1b4-40dc-89da-c1f851d0f5eb tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1478 microversion: 2.1 time: 0.314274 Jul 25 12:46:13.988596 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1094/2085] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:13 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1478 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:14.257801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9fb1a4d5-670b-4411-89c0-feee09f1d29d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:14.258960 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9fb1a4d5-670b-4411-89c0-feee09f1d29d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:14.279766 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=26 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:14.283951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9fb1a4d5-670b-4411-89c0-feee09f1d29d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:14.284731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9fb1a4d5-670b-4411-89c0-feee09f1d29d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:14.285771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9fb1a4d5-670b-4411-89c0-feee09f1d29d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:14.286451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9fb1a4d5-670b-4411-89c0-feee09f1d29d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:14.399148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-31c61514-a240-4f67-84f8-fb0883a565f0 req-c1c89aa0-ce0d-41fc-845f-47f4150b10d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f541b63-ccc7-488a-b5a4-8ee5b0f5e682", "name": "network-vif-plugged", "status": "completed", "tag": "75bbc764-2330-471d-8fc8-f7402e8094db"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:14.419232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-31c61514-a240-4f67-84f8-fb0883a565f0 req-c1c89aa0-ce0d-41fc-845f-47f4150b10d9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:14.420122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-31c61514-a240-4f67-84f8-fb0883a565f0 req-c1c89aa0-ce0d-41fc-845f-47f4150b10d9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:14.441396 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-31c61514-a240-4f67-84f8-fb0883a565f0 req-c1c89aa0-ce0d-41fc-845f-47f4150b10d9 service nova] Creating event network-vif-plugged:75bbc764-2330-471d-8fc8-f7402e8094db for instance 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 on n-h1-848886-15 Jul 25 12:46:14.469818 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-31c61514-a240-4f67-84f8-fb0883a565f0 req-c1c89aa0-ce0d-41fc-845f-47f4150b10d9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079912 Jul 25 12:46:14.472547 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1095/2086] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:14.516557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d316d481-89fd-4b67-ad2b-e11fd89cc489 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:14.521596 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d316d481-89fd-4b67-ad2b-e11fd89cc489 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: 742583f4-0949-418b-a666-dc715ab936d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:14.540016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d316d481-89fd-4b67-ad2b-e11fd89cc489 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:14.540574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d316d481-89fd-4b67-ad2b-e11fd89cc489 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:14.544169 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d316d481-89fd-4b67-ad2b-e11fd89cc489 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:14.545384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d316d481-89fd-4b67-ad2b-e11fd89cc489 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:14.572989 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-d316d481-89fd-4b67-ad2b-e11fd89cc489 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] HTTP exception thrown: Instance 742583f4-0949-418b-a666-dc715ab936d5 could not be found. Jul 25 12:46:14.584493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d316d481-89fd-4b67-ad2b-e11fd89cc489 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Request method failure captured: Jul 25 12:46:14.584493 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 HTTP/1.1 Jul 25 12:46:14.584493 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:46:14.584493 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:46:14.584493 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:46:14.584493 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:46:14.584493 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:46:14.584493 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:46:14.584493 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:46:14.584493 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:14.584493 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3o7poLIdxb27XVu2RKEtMCxaMxCaSjEIgSKcBXkPISZGHxHjR8c675dy5vog8O3kZ3T4LROBGt9vfRYVx5q8QHV3paRvph-9huVqLwyVUVmFlsOpM7fWTJsYcsA1ALabDrXfnA-ARL6wA0kcPD3fLNQ2-771ZbEbR0JFe41wdmHqAp8 Jul 25 12:46:14.584493 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:46:14.584493 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:46:14.584493 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:46:14.584493 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:46:14.584493 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:46:14.584493 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:46:14.584493 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 4946a18b68e146278158ac991143a243 Jul 25 12:46:14.584493 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-LiveMigrationTest-1701369834 Jul 25 12:46:14.584493 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:46:14.584493 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:46:14.586570 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4946a18b68e146278158ac991143a243", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4946a18b68e146278158ac991143a243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4946a18b68e146278158ac991143a243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4946a18b68e146278158ac991143a243"}]}] Jul 25 12:46:14.586570 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-LiveMigrationTest-1701369834 Jul 25 12:46:14.586570 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 4946a18b68e146278158ac991143a243 Jul 25 12:46:14.586570 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-LiveMigrationTest-1701369834 Jul 25 12:46:14.586570 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-LiveMigrationTest-1701369834-project Jul 25 12:46:14.586570 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:46:14.586570 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:46:14.586570 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: a02530d4c6384518b3f45515208e83d8 Jul 25 12:46:14.586570 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-LiveMigrationTest-1701369834-project Jul 25 12:46:14.586570 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:46:14.586570 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 742583f4-0949-418b-a666-dc715ab936d5 could not be found. Jul 25 12:46:14.586570 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '742583f4-0949-418b-a666-dc715ab936d5'} Jul 25 12:46:14.587620 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:14.587620 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:14.587620 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:46:14.587620 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:46:14.587620 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:46:14.587620 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:46:14.587620 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:46:14.587620 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:46:14.587620 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:46:14.587620 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:46:14.587620 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 742583f4-0949-418b-a666-dc715ab936d5 could not be found. Jul 25 12:46:14.587620 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:14.587620 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:14.587620 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:14.587620 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:14.587620 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:14.587620 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:14.587620 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:14.587620 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:14.587620 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:14.589265 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:14.589265 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:46:14.589265 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:46:14.589265 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:46:14.589265 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:46:14.589265 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:46:14.589265 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:46:14.589265 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 742583f4-0949-418b-a666-dc715ab936d5 could not be found. Jul 25 12:46:14.589265 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:14.589265 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:14.589265 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:14.589265 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:14.589265 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:14.589265 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:14.589265 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:14.589265 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:14.589265 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 742583f4-0949-418b-a666-dc715ab936d5 could not be found. Jul 25 12:46:14.589265 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:14.591911 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d316d481-89fd-4b67-ad2b-e11fd89cc489 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Returning 404 to user: Instance 742583f4-0949-418b-a666-dc715ab936d5 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:14.593936 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d316d481-89fd-4b67-ad2b-e11fd89cc489 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5" status: 404 len: 111 microversion: 2.1 time: 0.082964 Jul 25 12:46:14.595755 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1096/2087] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:14 2022] GET /compute/v2.1/servers/742583f4-0949-418b-a666-dc715ab936d5 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:46:14.610441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-71d4cde7-d0ae-44a0-8ecf-dd0d7afad8b1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:14.612493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-71d4cde7-d0ae-44a0-8ecf-dd0d7afad8b1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:14.629615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71d4cde7-d0ae-44a0-8ecf-dd0d7afad8b1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:14.630578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71d4cde7-d0ae-44a0-8ecf-dd0d7afad8b1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:14.631614 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71d4cde7-d0ae-44a0-8ecf-dd0d7afad8b1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:14.632289 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71d4cde7-d0ae-44a0-8ecf-dd0d7afad8b1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:14.689295 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-71d4cde7-d0ae-44a0-8ecf-dd0d7afad8b1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:46:14.749719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9fb1a4d5-670b-4411-89c0-feee09f1d29d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:14.763590 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9fb1a4d5-670b-4411-89c0-feee09f1d29d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 200 len: 1316 microversion: 2.1 time: 0.514484 Jul 25 12:46:14.766241 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 992/2088] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:14 2022] GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 1316 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:46:14.773210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2dae8be6-c34f-42ab-aa66-09e083b03eaf tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:14.777669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2dae8be6-c34f-42ab-aa66-09e083b03eaf tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:14.785222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2dae8be6-c34f-42ab-aa66-09e083b03eaf tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:14.786316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2dae8be6-c34f-42ab-aa66-09e083b03eaf tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:14.787283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2dae8be6-c34f-42ab-aa66-09e083b03eaf tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:14.787898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2dae8be6-c34f-42ab-aa66-09e083b03eaf tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:14.872919 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-71d4cde7-d0ae-44a0-8ecf-dd0d7afad8b1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "DELETE /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 204 len: 0 microversion: 2.1 time: 0.270660 Jul 25 12:46:14.879548 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1097/2089] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:46:14 2022] DELETE /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:46:14.897399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9db36746-667e-4895-8cc6-b7ac06b2db3d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:14.899496 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9db36746-667e-4895-8cc6-b7ac06b2db3d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:14.907326 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9db36746-667e-4895-8cc6-b7ac06b2db3d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:14.908595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9db36746-667e-4895-8cc6-b7ac06b2db3d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:14.909870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9db36746-667e-4895-8cc6-b7ac06b2db3d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:14.911869 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9db36746-667e-4895-8cc6-b7ac06b2db3d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:15.082532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2dae8be6-c34f-42ab-aa66-09e083b03eaf tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:15.093594 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2dae8be6-c34f-42ab-aa66-09e083b03eaf tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:15.095193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2dae8be6-c34f-42ab-aa66-09e083b03eaf tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:15.096354 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2dae8be6-c34f-42ab-aa66-09e083b03eaf tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1409 microversion: 2.54 time: 0.328858 Jul 25 12:46:15.108529 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 993/2090] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:14 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1409 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:15.137000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f7b09b63-a036-4ccb-96b8-e304be42a816 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:15.139830 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f7b09b63-a036-4ccb-96b8-e304be42a816 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:15.157754 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7b09b63-a036-4ccb-96b8-e304be42a816 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:15.160015 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7b09b63-a036-4ccb-96b8-e304be42a816 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:15.161274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7b09b63-a036-4ccb-96b8-e304be42a816 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:15.169901 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7b09b63-a036-4ccb-96b8-e304be42a816 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:15.323664 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9db36746-667e-4895-8cc6-b7ac06b2db3d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:15.332586 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9db36746-667e-4895-8cc6-b7ac06b2db3d tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 200 len: 1499 microversion: 2.1 time: 0.451153 Jul 25 12:46:15.341548 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1098/2091] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:14 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 1499 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:15.593745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f7b09b63-a036-4ccb-96b8-e304be42a816 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:15.604146 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f7b09b63-a036-4ccb-96b8-e304be42a816 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1478 microversion: 2.1 time: 0.494169 Jul 25 12:46:15.604756 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 994/2092] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:15 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1478 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:15.799577 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f58ef40b-4a60-4d2a-8974-3d42aedd5b8a tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:15.801112 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f58ef40b-4a60-4d2a-8974-3d42aedd5b8a tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:15.814797 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f58ef40b-4a60-4d2a-8974-3d42aedd5b8a tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:15.815364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f58ef40b-4a60-4d2a-8974-3d42aedd5b8a tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:15.823808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f58ef40b-4a60-4d2a-8974-3d42aedd5b8a tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:15.824424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f58ef40b-4a60-4d2a-8974-3d42aedd5b8a tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:16.134516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-181595cb-ef33-47bd-a684-1c55e6f46fa5 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:16.135727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-181595cb-ef33-47bd-a684-1c55e6f46fa5 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:16.148828 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-181595cb-ef33-47bd-a684-1c55e6f46fa5 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:16.149575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-181595cb-ef33-47bd-a684-1c55e6f46fa5 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:16.150621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-181595cb-ef33-47bd-a684-1c55e6f46fa5 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:16.160686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-181595cb-ef33-47bd-a684-1c55e6f46fa5 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:16.591411 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-181595cb-ef33-47bd-a684-1c55e6f46fa5 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:16.602704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-181595cb-ef33-47bd-a684-1c55e6f46fa5 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:16.604218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-181595cb-ef33-47bd-a684-1c55e6f46fa5 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:16.605433 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-181595cb-ef33-47bd-a684-1c55e6f46fa5 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1409 microversion: 2.54 time: 0.475672 Jul 25 12:46:16.620445 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 995/2093] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:16 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1409 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:46:16.642558 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7983f0ac-f5f2-447e-8a11-88c1e2bc1a42 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:16.643176 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7983f0ac-f5f2-447e-8a11-88c1e2bc1a42 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:16.669323 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7983f0ac-f5f2-447e-8a11-88c1e2bc1a42 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:16.669895 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7983f0ac-f5f2-447e-8a11-88c1e2bc1a42 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:16.670731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7983f0ac-f5f2-447e-8a11-88c1e2bc1a42 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:16.671309 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7983f0ac-f5f2-447e-8a11-88c1e2bc1a42 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:16.747591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f58ef40b-4a60-4d2a-8974-3d42aedd5b8a tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:16.760060 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f58ef40b-4a60-4d2a-8974-3d42aedd5b8a tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 200 len: 1316 microversion: 2.1 time: 0.972978 Jul 25 12:46:16.774440 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1099/2094] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:15 2022] GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 1316 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:16.788555 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7401634f-c84b-48c1-a128-51b5b3473d9c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:16.789193 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7401634f-c84b-48c1-a128-51b5b3473d9c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:16.806832 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7401634f-c84b-48c1-a128-51b5b3473d9c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:16.807526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7401634f-c84b-48c1-a128-51b5b3473d9c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:16.808541 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7401634f-c84b-48c1-a128-51b5b3473d9c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:16.812541 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7401634f-c84b-48c1-a128-51b5b3473d9c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:17.277363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7983f0ac-f5f2-447e-8a11-88c1e2bc1a42 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:17.294775 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7983f0ac-f5f2-447e-8a11-88c1e2bc1a42 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 200 len: 1499 microversion: 2.1 time: 0.673017 Jul 25 12:46:17.295369 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 996/2095] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:16 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 1499 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:17.300043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-2b77934e-8358-4d06-a896-93948cb6fb35 req-b356c899-a26d-4621-84ff-12670d9f7944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6bb4f7e-67c3-4c86-8e69-92fd4061e26d", "name": "network-vif-plugged", "status": "completed", "tag": "b55028ef-4d91-4ac2-a60c-3406cbca7db4"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:17.325638 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2b77934e-8358-4d06-a896-93948cb6fb35 req-b356c899-a26d-4621-84ff-12670d9f7944 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:17.326522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2b77934e-8358-4d06-a896-93948cb6fb35 req-b356c899-a26d-4621-84ff-12670d9f7944 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:17.349036 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-2b77934e-8358-4d06-a896-93948cb6fb35 req-b356c899-a26d-4621-84ff-12670d9f7944 service nova] Creating event network-vif-plugged:b55028ef-4d91-4ac2-a60c-3406cbca7db4 for instance c6bb4f7e-67c3-4c86-8e69-92fd4061e26d on n-h2-848886-15 Jul 25 12:46:17.363042 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-2b77934e-8358-4d06-a896-93948cb6fb35 req-b356c899-a26d-4621-84ff-12670d9f7944 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066245 Jul 25 12:46:17.363962 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 997/2096] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:17.383902 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7401634f-c84b-48c1-a128-51b5b3473d9c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:17.411690 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7401634f-c84b-48c1-a128-51b5b3473d9c tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1478 microversion: 2.1 time: 0.635811 Jul 25 12:46:17.427814 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1100/2097] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:16 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1478 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:17.635313 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c49d43c7-9a6e-4494-b334-f6d264d03f6f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:17.635994 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c49d43c7-9a6e-4494-b334-f6d264d03f6f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:17.650143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c49d43c7-9a6e-4494-b334-f6d264d03f6f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:17.656951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c49d43c7-9a6e-4494-b334-f6d264d03f6f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:17.658094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c49d43c7-9a6e-4494-b334-f6d264d03f6f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:17.664225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c49d43c7-9a6e-4494-b334-f6d264d03f6f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:17.788910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=15 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:17.833380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=13 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:17.841823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c49d43c7-9a6e-4494-b334-f6d264d03f6f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:17.854193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c49d43c7-9a6e-4494-b334-f6d264d03f6f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:17.855889 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c49d43c7-9a6e-4494-b334-f6d264d03f6f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:17.857877 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c49d43c7-9a6e-4494-b334-f6d264d03f6f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1409 microversion: 2.54 time: 0.227974 Jul 25 12:46:17.859003 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 998/2098] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:17 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1409 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:17.867702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-53a023f5-0b6c-4bf3-99da-ba5287e39c9b tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:17.868842 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-53a023f5-0b6c-4bf3-99da-ba5287e39c9b tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:17.882382 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53a023f5-0b6c-4bf3-99da-ba5287e39c9b tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:17.884485 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53a023f5-0b6c-4bf3-99da-ba5287e39c9b tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:17.885614 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53a023f5-0b6c-4bf3-99da-ba5287e39c9b tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:17.886266 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53a023f5-0b6c-4bf3-99da-ba5287e39c9b tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:17.972425 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-afb85a8a-0d76-4b3a-a7a7-869723f5c72d tempest-FloatingIPDetailsTestJSON-529319416 tempest-FloatingIPDetailsTestJSON-529319416-project] Action: 'create', calling method: .version_select at 0x7efcf9d35160>, body: {"pool": null} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:18.387188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-53a023f5-0b6c-4bf3-99da-ba5287e39c9b tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:18.397797 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-53a023f5-0b6c-4bf3-99da-ba5287e39c9b tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 200 len: 1505 microversion: 2.1 time: 0.537369 Jul 25 12:46:18.410953 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 999/2099] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:17 2022] GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 1505 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:18.427410 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-39fee210-99a8-4061-b42e-60e8da28f8aa tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:18.432796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-39fee210-99a8-4061-b42e-60e8da28f8aa tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '388a9972b4da47d7bda9fd36985eeb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f16e25c9f6f4845922175f67e5583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:18.436974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-39fee210-99a8-4061-b42e-60e8da28f8aa tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Searching by: {'deleted': False, 'project_id': '2f16e25c9f6f4845922175f67e5583a1'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 12:46:18.447755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39fee210-99a8-4061-b42e-60e8da28f8aa tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:18.448198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39fee210-99a8-4061-b42e-60e8da28f8aa tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:18.448988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39fee210-99a8-4061-b42e-60e8da28f8aa tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:18.449419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39fee210-99a8-4061-b42e-60e8da28f8aa tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:18.513553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-39fee210-99a8-4061-b42e-60e8da28f8aa tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 12:46:18.582407 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-39fee210-99a8-4061-b42e-60e8da28f8aa tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.169868 Jul 25 12:46:18.582999 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1000/2100] 10.222.0.49 () {58 vars in 1125 bytes} [Mon Jul 25 12:46:18 2022] GET /compute/v2.1/servers => generated 334 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:18.589721 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e5ce4e80-0bc6-4836-98ca-a37e839e09cd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:18.592595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e5ce4e80-0bc6-4836-98ca-a37e839e09cd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:18.602911 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e5ce4e80-0bc6-4836-98ca-a37e839e09cd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:18.603655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e5ce4e80-0bc6-4836-98ca-a37e839e09cd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:18.604706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e5ce4e80-0bc6-4836-98ca-a37e839e09cd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:18.605398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e5ce4e80-0bc6-4836-98ca-a37e839e09cd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:18.673630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e5ce4e80-0bc6-4836-98ca-a37e839e09cd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:18.674102 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e5ce4e80-0bc6-4836-98ca-a37e839e09cd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:18.674563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-e5ce4e80-0bc6-4836-98ca-a37e839e09cd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lazy-loading 'fault' on Instance uuid daf4e818-31a5-4311-87b2-eb63a90f7bc0 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:46:18.726456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e5ce4e80-0bc6-4836-98ca-a37e839e09cd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02530d4c6384518b3f45515208e83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4946a18b68e146278158ac991143a243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:18.734937 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e5ce4e80-0bc6-4836-98ca-a37e839e09cd tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 200 len: 1300 microversion: 2.1 time: 0.148909 Jul 25 12:46:18.742961 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1001/2101] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:18 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 1300 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:18.743836 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-f44cce84-c27f-436a-92cc-e02e1fd8a2e1 req-ef562a21-cd10-40bc-9c53-8e868d4b5e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daf4e818-31a5-4311-87b2-eb63a90f7bc0", "name": "network-vif-deleted", "tag": "64524d32-78e7-4db4-bec6-a6228c8ab21c"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:18.770680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-f44cce84-c27f-436a-92cc-e02e1fd8a2e1 req-ef562a21-cd10-40bc-9c53-8e868d4b5e07 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:18.771131 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-f44cce84-c27f-436a-92cc-e02e1fd8a2e1 req-ef562a21-cd10-40bc-9c53-8e868d4b5e07 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:18.800288 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-f44cce84-c27f-436a-92cc-e02e1fd8a2e1 req-ef562a21-cd10-40bc-9c53-8e868d4b5e07 service nova] Creating event network-vif-deleted:64524d32-78e7-4db4-bec6-a6228c8ab21c for instance daf4e818-31a5-4311-87b2-eb63a90f7bc0 on n-h2-848886-15 Jul 25 12:46:18.808694 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-f44cce84-c27f-436a-92cc-e02e1fd8a2e1 req-ef562a21-cd10-40bc-9c53-8e868d4b5e07 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068352 Jul 25 12:46:18.822294 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1002/2102] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:18.827951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-37d5af1f-e255-4162-8182-4aeec6f8cf96 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:18.838202 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-37d5af1f-e255-4162-8182-4aeec6f8cf96 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:18.849382 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37d5af1f-e255-4162-8182-4aeec6f8cf96 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:18.858830 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37d5af1f-e255-4162-8182-4aeec6f8cf96 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:18.862542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37d5af1f-e255-4162-8182-4aeec6f8cf96 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:18.863173 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37d5af1f-e255-4162-8182-4aeec6f8cf96 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:19.089248 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-37d5af1f-e255-4162-8182-4aeec6f8cf96 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:19.097500 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-37d5af1f-e255-4162-8182-4aeec6f8cf96 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1478 microversion: 2.1 time: 0.273794 Jul 25 12:46:19.100429 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1003/2103] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:18 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1478 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:19.107536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3c0799fd-58d1-4520-a097-ce16dca29b3f tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-354150042"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:19.117679 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3c0799fd-58d1-4520-a097-ce16dca29b3f tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:19.129796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c0799fd-58d1-4520-a097-ce16dca29b3f tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:19.140742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c0799fd-58d1-4520-a097-ce16dca29b3f tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:19.141728 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c0799fd-58d1-4520-a097-ce16dca29b3f tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:19.142232 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c0799fd-58d1-4520-a097-ce16dca29b3f tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:19.393944 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.network.security_group_api [None req-3c0799fd-58d1-4520-a097-ce16dca29b3f tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Adding security group b4f4617a-5bb9-41fe-8408-e0e6986e511a to port 75bbc764-2330-471d-8fc8-f7402e8094db Jul 25 12:46:20.221240 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3c0799fd-58d1-4520-a097-ce16dca29b3f tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "POST /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682/action" status: 202 len: 0 microversion: 2.1 time: 1.117577 Jul 25 12:46:20.222357 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1004/2104] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:46:19 2022] POST /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682/action => generated 0 bytes in 1119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:46:20.229271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ee6e0586-532b-4921-bd3d-308db0bb4347 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:20.257354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ee6e0586-532b-4921-bd3d-308db0bb4347 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '388a9972b4da47d7bda9fd36985eeb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f16e25c9f6f4845922175f67e5583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:20.261183 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ee6e0586-532b-4921-bd3d-308db0bb4347 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Searching by: {'deleted': False, 'project_id': '2f16e25c9f6f4845922175f67e5583a1'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 12:46:20.279656 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee6e0586-532b-4921-bd3d-308db0bb4347 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:20.280427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee6e0586-532b-4921-bd3d-308db0bb4347 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:20.282889 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee6e0586-532b-4921-bd3d-308db0bb4347 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:20.284522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee6e0586-532b-4921-bd3d-308db0bb4347 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:20.330235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:20.369302 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-ee6e0586-532b-4921-bd3d-308db0bb4347 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 12:46:20.559791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ee6e0586-532b-4921-bd3d-308db0bb4347 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388a9972b4da47d7bda9fd36985eeb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f16e25c9f6f4845922175f67e5583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:20.579153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee6e0586-532b-4921-bd3d-308db0bb4347 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:20.579914 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee6e0586-532b-4921-bd3d-308db0bb4347 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:20.836585 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-afb85a8a-0d76-4b3a-a7a7-869723f5c72d tempest-FloatingIPDetailsTestJSON-529319416 tempest-FloatingIPDetailsTestJSON-529319416-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.093110 Jul 25 12:46:20.838282 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1101/2105] 10.222.0.49 () {60 vars in 1170 bytes} [Mon Jul 25 12:46:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3096 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:46:20.846702 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b5bb648d-cb86-4630-b845-b85eeecabe4c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:20.852850 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b5bb648d-cb86-4630-b845-b85eeecabe4c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:20.869435 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5bb648d-cb86-4630-b845-b85eeecabe4c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:20.870122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5bb648d-cb86-4630-b845-b85eeecabe4c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:20.876283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5bb648d-cb86-4630-b845-b85eeecabe4c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:20.877787 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5bb648d-cb86-4630-b845-b85eeecabe4c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:21.024181 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ee6e0586-532b-4921-bd3d-308db0bb4347 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.800339 Jul 25 12:46:21.041403 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1005/2106] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:46:20 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:21.047618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-769a2919-2551-4dc7-a516-4c80cdf781a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:21.049285 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-769a2919-2551-4dc7-a516-4c80cdf781a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] [instance: daf4e818-31a5-4311-87b2-eb63a90f7bc0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:21.067334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-769a2919-2551-4dc7-a516-4c80cdf781a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:21.068098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-769a2919-2551-4dc7-a516-4c80cdf781a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:21.071720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-769a2919-2551-4dc7-a516-4c80cdf781a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:21.073289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-769a2919-2551-4dc7-a516-4c80cdf781a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:21.110002 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-769a2919-2551-4dc7-a516-4c80cdf781a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] HTTP exception thrown: Instance daf4e818-31a5-4311-87b2-eb63a90f7bc0 could not be found. Jul 25 12:46:21.115024 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-769a2919-2551-4dc7-a516-4c80cdf781a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Request method failure captured: Jul 25 12:46:21.115024 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 HTTP/1.1 Jul 25 12:46:21.115024 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:46:21.115024 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:46:21.115024 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:46:21.115024 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:46:21.115024 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:46:21.115024 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:46:21.115024 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:46:21.115024 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:21.115024 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3o7poLIdxb27XVu2RKEtMCxaMxCaSjEIgSKcBXkPISZGHxHjR8c675dy5vog8O3kZ3T4LROBGt9vfRYVx5q8QHV3paRvph-9huVqLwyVUVmFlsOpM7fWTJsYcsA1ALabDrXfnA-ARL6wA0kcPD3fLNQ2-771ZbEbR0JFe41wdmHqAp8 Jul 25 12:46:21.115024 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:46:21.115024 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:46:21.115024 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:46:21.115024 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:46:21.115024 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:46:21.115024 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:46:21.115024 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 4946a18b68e146278158ac991143a243 Jul 25 12:46:21.115024 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-LiveMigrationTest-1701369834 Jul 25 12:46:21.115024 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:46:21.115024 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:46:21.116679 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4946a18b68e146278158ac991143a243", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4946a18b68e146278158ac991143a243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4946a18b68e146278158ac991143a243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4946a18b68e146278158ac991143a243"}]}] Jul 25 12:46:21.116679 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-LiveMigrationTest-1701369834 Jul 25 12:46:21.116679 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 4946a18b68e146278158ac991143a243 Jul 25 12:46:21.116679 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-LiveMigrationTest-1701369834 Jul 25 12:46:21.116679 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-LiveMigrationTest-1701369834-project Jul 25 12:46:21.116679 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:46:21.116679 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:46:21.116679 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: a02530d4c6384518b3f45515208e83d8 Jul 25 12:46:21.116679 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-LiveMigrationTest-1701369834-project Jul 25 12:46:21.116679 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:46:21.116679 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance daf4e818-31a5-4311-87b2-eb63a90f7bc0 could not be found. Jul 25 12:46:21.116679 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'daf4e818-31a5-4311-87b2-eb63a90f7bc0'} Jul 25 12:46:21.117601 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:21.117601 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:21.117601 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:46:21.117601 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:46:21.117601 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:46:21.117601 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:46:21.117601 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:46:21.117601 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:46:21.117601 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:46:21.117601 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:46:21.117601 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daf4e818-31a5-4311-87b2-eb63a90f7bc0 could not be found. Jul 25 12:46:21.117601 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:21.117601 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:21.117601 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:21.117601 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:21.117601 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:21.117601 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:21.117601 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:21.117601 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:21.117601 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:21.119941 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:21.119941 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:46:21.119941 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:46:21.119941 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:46:21.119941 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:46:21.119941 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:46:21.119941 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:46:21.119941 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daf4e818-31a5-4311-87b2-eb63a90f7bc0 could not be found. Jul 25 12:46:21.119941 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:21.119941 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:21.119941 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:21.119941 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:21.119941 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:21.119941 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:21.119941 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:21.119941 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:21.119941 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daf4e818-31a5-4311-87b2-eb63a90f7bc0 could not be found. Jul 25 12:46:21.119941 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:21.122312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-769a2919-2551-4dc7-a516-4c80cdf781a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] Returning 404 to user: Instance daf4e818-31a5-4311-87b2-eb63a90f7bc0 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:21.122312 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-769a2919-2551-4dc7-a516-4c80cdf781a1 tempest-LiveMigrationTest-1701369834 tempest-LiveMigrationTest-1701369834-project] 10.222.0.49 "GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0" status: 404 len: 111 microversion: 2.1 time: 0.076612 Jul 25 12:46:21.123236 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1006/2107] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:21 2022] GET /compute/v2.1/servers/daf4e818-31a5-4311-87b2-eb63a90f7bc0 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:46:21.135694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f508371d-79df-4eef-b59d-09bcb6ef9391 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:21.136370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f508371d-79df-4eef-b59d-09bcb6ef9391 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:21.146459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b5bb648d-cb86-4630-b845-b85eeecabe4c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:21.153040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:21.162512 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b5bb648d-cb86-4630-b845-b85eeecabe4c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:21.165172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b5bb648d-cb86-4630-b845-b85eeecabe4c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:21.165345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f508371d-79df-4eef-b59d-09bcb6ef9391 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:21.165655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f508371d-79df-4eef-b59d-09bcb6ef9391 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:21.166472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f508371d-79df-4eef-b59d-09bcb6ef9391 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:21.166905 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f508371d-79df-4eef-b59d-09bcb6ef9391 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:21.167560 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b5bb648d-cb86-4630-b845-b85eeecabe4c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1409 microversion: 2.54 time: 0.327583 Jul 25 12:46:21.168395 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1102/2108] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:20 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1409 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:21.173095 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-79c5327f-37f6-43c0-941d-9179ef9f07b3 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcfa2dbaf0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:22.241335 n-d-848886-15 devstack@n-api.service[125884]: DEBUG neutronclient.v2_0.client [None req-79c5327f-37f6-43c0-941d-9179ef9f07b3 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group b4f4617a-5bb9-41fe-8408-e0e6986e511a in use.", "detail": ""}} {{(pid=125884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:46:22.242899 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-79c5327f-37f6-43c0-941d-9179ef9f07b3 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] HTTP exception thrown: Security Group b4f4617a-5bb9-41fe-8408-e0e6986e511a in use. Jul 25 12:46:22.242899 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-a7181ec7-679b-4db2-8ec9-d2a6e8f2133c'] Jul 25 12:46:22.245423 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-79c5327f-37f6-43c0-941d-9179ef9f07b3 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Request method failure captured: Jul 25 12:46:22.245423 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/os-security-groups/b4f4617a-5bb9-41fe-8408-e0e6986e511a HTTP/1.1 Jul 25 12:46:22.245423 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:46:22.245423 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:46:22.245423 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:46:22.245423 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:46:22.245423 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:46:22.245423 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:46:22.245423 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:46:22.245423 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:22.245423 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pBMnvMCkXPIxtXS4OZUlYvEfqLzk8eVB6uOa00GC7XzG0Qi-IKZscbMEZM1xj3l2F-5d5lIAdtnOADbgV21wrMS4dvC7LWzHzoCd7ieXebifkHeaO9Mp4wm9vR5m7HEh9yMTTXFHMqap1mzBebGWb33cT_Byxbl27G3bMxoNj8QlS0 Jul 25 12:46:22.245423 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:46:22.245423 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:46:22.245423 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:46:22.245423 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:46:22.245423 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:46:22.245423 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:46:22.245423 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:22.245423 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:22.245423 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:46:22.245423 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:46:22.247335 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8514497475b8462b86e28d48a16b0b20", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}] Jul 25 12:46:22.247335 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:22.247335 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:22.247335 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:22.247335 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:22.247335 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:46:22.247335 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:46:22.247335 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 3912af6bdd224191910f72160c42db30 Jul 25 12:46:22.247335 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:22.247335 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:46:22.247335 n-d-848886-15 devstack@n-api.service[125884]: exception: Security Group b4f4617a-5bb9-41fe-8408-e0e6986e511a in use. Jul 25 12:46:22.247335 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-a7181ec7-679b-4db2-8ec9-d2a6e8f2133c'] Jul 25 12:46:22.247335 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'b4f4617a-5bb9-41fe-8408-e0e6986e511a'} Jul 25 12:46:22.248515 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:22.248515 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:22.248515 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 25 12:46:22.248515 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 25 12:46:22.248515 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:22.248515 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:22.248515 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 25 12:46:22.248515 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 25 12:46:22.248515 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:22.248515 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:22.248515 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 25 12:46:22.248515 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 25 12:46:22.248515 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:22.248515 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:22.248515 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:46:22.248515 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:46:22.248515 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:22.248515 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:22.248515 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:46:22.250142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:46:22.250142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:22.250142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:22.250142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:46:22.250142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:46:22.250142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:46:22.250142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:46:22.250142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group b4f4617a-5bb9-41fe-8408-e0e6986e511a in use. Jul 25 12:46:22.250142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a7181ec7-679b-4db2-8ec9-d2a6e8f2133c'] Jul 25 12:46:22.250142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:22.250142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:22.250142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:22.250142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:22.250142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 25 12:46:22.250142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 25 12:46:22.250142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 25 12:46:22.250142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 25 12:46:22.250142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group b4f4617a-5bb9-41fe-8408-e0e6986e511a in use. Jul 25 12:46:22.250142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a7181ec7-679b-4db2-8ec9-d2a6e8f2133c'] Jul 25 12:46:22.251743 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:22.251743 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:22.251743 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:22.251743 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:22.251743 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:22.251743 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:22.251743 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:22.251743 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:22.251743 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:46:22.251743 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:46:22.251743 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:22.251743 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:22.251743 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 25 12:46:22.251743 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 12:46:22.251743 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group b4f4617a-5bb9-41fe-8408-e0e6986e511a in use. Jul 25 12:46:22.251743 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a7181ec7-679b-4db2-8ec9-d2a6e8f2133c'] Jul 25 12:46:22.251743 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:22.251743 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:22.251743 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:22.251743 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:22.251743 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:22.253485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:22.253485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:22.253485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:22.253485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group b4f4617a-5bb9-41fe-8408-e0e6986e511a in use. Jul 25 12:46:22.253485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a7181ec7-679b-4db2-8ec9-d2a6e8f2133c'] Jul 25 12:46:22.253485 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:22.257457 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-79c5327f-37f6-43c0-941d-9179ef9f07b3 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Returning 400 to user: Security Group b4f4617a-5bb9-41fe-8408-e0e6986e511a in use. Jul 25 12:46:22.257457 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-a7181ec7-679b-4db2-8ec9-d2a6e8f2133c'] {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:22.258881 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-79c5327f-37f6-43c0-941d-9179ef9f07b3 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/b4f4617a-5bb9-41fe-8408-e0e6986e511a" status: 400 len: 185 microversion: 2.1 time: 1.089823 Jul 25 12:46:22.260038 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1103/2109] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:46:21 2022] DELETE /compute/v2.1/os-security-groups/b4f4617a-5bb9-41fe-8408-e0e6986e511a => generated 185 bytes in 1091 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:46:22.267882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c93c2d7d-35e3-4695-b712-f8be234314f5 tempest-FloatingIPDetailsTestJSON-529319416 tempest-FloatingIPDetailsTestJSON-529319416-project] Action: 'create', calling method: .version_select at 0x7efcf9daec10>, body: {"pool": null} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:22.311922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f508371d-79df-4eef-b59d-09bcb6ef9391 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:22.327064 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f508371d-79df-4eef-b59d-09bcb6ef9391 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1463 microversion: 2.1 time: 1.199054 Jul 25 12:46:22.328691 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1007/2110] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:21 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1463 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:22.334770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-47db1301-31fa-4ad7-9fc9-c9c925ca7542 req-2cb3e7a8-c9a4-4dad-8069-3061d8c242c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f541b63-ccc7-488a-b5a4-8ee5b0f5e682", "tag": "75bbc764-2330-471d-8fc8-f7402e8094db"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:22.348539 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-47db1301-31fa-4ad7-9fc9-c9c925ca7542 req-2cb3e7a8-c9a4-4dad-8069-3061d8c242c3 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:22.349177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-47db1301-31fa-4ad7-9fc9-c9c925ca7542 req-2cb3e7a8-c9a4-4dad-8069-3061d8c242c3 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:22.365765 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-47db1301-31fa-4ad7-9fc9-c9c925ca7542 req-2cb3e7a8-c9a4-4dad-8069-3061d8c242c3 service nova] Creating event network-changed:75bbc764-2330-471d-8fc8-f7402e8094db for instance 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 on n-h1-848886-15 Jul 25 12:46:22.374606 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-47db1301-31fa-4ad7-9fc9-c9c925ca7542 req-2cb3e7a8-c9a4-4dad-8069-3061d8c242c3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044316 Jul 25 12:46:22.376169 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1008/2111] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:22.383741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a77b90c1-0109-4d05-b5ba-4d17703eeb65 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:22.395465 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a77b90c1-0109-4d05-b5ba-4d17703eeb65 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016942 Jul 25 12:46:22.396324 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1009/2112] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:46:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:22.402418 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b670e237-cc85-4859-87c9-c1b5a3c8821f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:22.403627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b670e237-cc85-4859-87c9-c1b5a3c8821f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:22.413225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b670e237-cc85-4859-87c9-c1b5a3c8821f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:22.413690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b670e237-cc85-4859-87c9-c1b5a3c8821f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:22.414536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b670e237-cc85-4859-87c9-c1b5a3c8821f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:22.414966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b670e237-cc85-4859-87c9-c1b5a3c8821f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:22.555595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b670e237-cc85-4859-87c9-c1b5a3c8821f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:22.569579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b670e237-cc85-4859-87c9-c1b5a3c8821f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:22.571476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b670e237-cc85-4859-87c9-c1b5a3c8821f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:22.573019 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b670e237-cc85-4859-87c9-c1b5a3c8821f tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1415 microversion: 2.54 time: 0.175106 Jul 25 12:46:22.573598 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1010/2113] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:22 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1415 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:22.588714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-89ae3312-1f4d-4465-916f-ae149006dcae tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:22.591680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-89ae3312-1f4d-4465-916f-ae149006dcae tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:22.600241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89ae3312-1f4d-4465-916f-ae149006dcae tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:22.600695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89ae3312-1f4d-4465-916f-ae149006dcae tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:22.601542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89ae3312-1f4d-4465-916f-ae149006dcae tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:22.603116 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89ae3312-1f4d-4465-916f-ae149006dcae tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:22.758771 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-89ae3312-1f4d-4465-916f-ae149006dcae tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "POST /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682/action" status: 202 len: 0 microversion: 2.1 time: 0.175576 Jul 25 12:46:22.759515 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1011/2114] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:46:22 2022] POST /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:46:22.765757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cc5690f0-08fa-486a-90f8-2f3c25f7af6d tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:22.768145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cc5690f0-08fa-486a-90f8-2f3c25f7af6d tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:22.791023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cc5690f0-08fa-486a-90f8-2f3c25f7af6d tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:22.791023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cc5690f0-08fa-486a-90f8-2f3c25f7af6d tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:22.791786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cc5690f0-08fa-486a-90f8-2f3c25f7af6d tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:22.792224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cc5690f0-08fa-486a-90f8-2f3c25f7af6d tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:22.910186 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cc5690f0-08fa-486a-90f8-2f3c25f7af6d tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d/action" status: 202 len: 0 microversion: 2.1 time: 0.149250 Jul 25 12:46:22.913746 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1012/2115] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:46:22 2022] POST /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:46:22.920720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-97929343-006c-47be-b003-c92754d22e10 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:22.922831 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-97929343-006c-47be-b003-c92754d22e10 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:22.931104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97929343-006c-47be-b003-c92754d22e10 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:22.931632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97929343-006c-47be-b003-c92754d22e10 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:22.932499 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97929343-006c-47be-b003-c92754d22e10 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:22.933037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97929343-006c-47be-b003-c92754d22e10 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:23.563188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-97929343-006c-47be-b003-c92754d22e10 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:23.572064 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-97929343-006c-47be-b003-c92754d22e10 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 200 len: 1575 microversion: 2.1 time: 0.656709 Jul 25 12:46:23.575007 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1013/2116] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:22 2022] GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 1575 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:23.580633 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1009c22c-0a52-44c8-8b2e-b3510fff4487 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:23.588883 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1009c22c-0a52-44c8-8b2e-b3510fff4487 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:23.598985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1009c22c-0a52-44c8-8b2e-b3510fff4487 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:23.608694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1009c22c-0a52-44c8-8b2e-b3510fff4487 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:23.609727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1009c22c-0a52-44c8-8b2e-b3510fff4487 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:23.610312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1009c22c-0a52-44c8-8b2e-b3510fff4487 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:23.674902 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1009c22c-0a52-44c8-8b2e-b3510fff4487 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:23.675487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1009c22c-0a52-44c8-8b2e-b3510fff4487 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:23.675990 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-1009c22c-0a52-44c8-8b2e-b3510fff4487 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lazy-loading 'fault' on Instance uuid c6bb4f7e-67c3-4c86-8e69-92fd4061e26d {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:46:24.454255 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1009c22c-0a52-44c8-8b2e-b3510fff4487 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1599 microversion: 2.1 time: 0.877064 Jul 25 12:46:24.454763 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1014/2117] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:23 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1599 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:24.460245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fd346718-3958-48bb-82ae-df952b216ee4 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:24.460757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fd346718-3958-48bb-82ae-df952b216ee4 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] [instance: d4033cef-23be-4f49-8c7b-0be4ebde362f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:24.467572 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd346718-3958-48bb-82ae-df952b216ee4 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:24.468281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd346718-3958-48bb-82ae-df952b216ee4 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:24.469296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd346718-3958-48bb-82ae-df952b216ee4 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:24.469941 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd346718-3958-48bb-82ae-df952b216ee4 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:24.501636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fd346718-3958-48bb-82ae-df952b216ee4 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] [instance: d4033cef-23be-4f49-8c7b-0be4ebde362f] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:46:24.614045 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fd346718-3958-48bb-82ae-df952b216ee4 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f" status: 204 len: 0 microversion: 2.1 time: 0.154632 Jul 25 12:46:24.615684 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1015/2118] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:46:24 2022] DELETE /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:46:24.624781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4d881ace-76d3-4fb5-80b6-5c632b7e6726 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:24.625497 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4d881ace-76d3-4fb5-80b6-5c632b7e6726 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:24.631261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:24.633089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4d881ace-76d3-4fb5-80b6-5c632b7e6726 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:24.633726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4d881ace-76d3-4fb5-80b6-5c632b7e6726 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:24.634830 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4d881ace-76d3-4fb5-80b6-5c632b7e6726 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:24.635445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4d881ace-76d3-4fb5-80b6-5c632b7e6726 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:24.801552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4d881ace-76d3-4fb5-80b6-5c632b7e6726 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:24.814335 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4d881ace-76d3-4fb5-80b6-5c632b7e6726 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:24.819921 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4d881ace-76d3-4fb5-80b6-5c632b7e6726 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:24.823303 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4d881ace-76d3-4fb5-80b6-5c632b7e6726 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1415 microversion: 2.54 time: 0.203240 Jul 25 12:46:24.830338 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1016/2119] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:24 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1415 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:24.841985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ed4d8721-83ad-46c3-b344-bb72ccaf876d tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:24.844383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ed4d8721-83ad-46c3-b344-bb72ccaf876d tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:24.853600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ed4d8721-83ad-46c3-b344-bb72ccaf876d tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:24.854106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ed4d8721-83ad-46c3-b344-bb72ccaf876d tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:24.854907 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ed4d8721-83ad-46c3-b344-bb72ccaf876d tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:24.855358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ed4d8721-83ad-46c3-b344-bb72ccaf876d tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:24.984052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:25.012461 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ed4d8721-83ad-46c3-b344-bb72ccaf876d tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d/action" status: 202 len: 0 microversion: 2.1 time: 0.180874 Jul 25 12:46:25.013325 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1017/2120] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:46:24 2022] POST /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:46:25.022537 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e1ef821f-cfb0-4fb6-9156-f922155c6c81 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:25.023162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e1ef821f-cfb0-4fb6-9156-f922155c6c81 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:25.039074 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1ef821f-cfb0-4fb6-9156-f922155c6c81 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:25.039877 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1ef821f-cfb0-4fb6-9156-f922155c6c81 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:25.040987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1ef821f-cfb0-4fb6-9156-f922155c6c81 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:25.041616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1ef821f-cfb0-4fb6-9156-f922155c6c81 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:25.566225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e1ef821f-cfb0-4fb6-9156-f922155c6c81 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:25.574706 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e1ef821f-cfb0-4fb6-9156-f922155c6c81 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 200 len: 1575 microversion: 2.1 time: 0.557294 Jul 25 12:46:25.578947 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1018/2121] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:25 2022] GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 1575 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:25.592206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3de66513-0ee5-48e2-97d0-42cb1dc46471 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:25.592206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3de66513-0ee5-48e2-97d0-42cb1dc46471 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] [instance: d4033cef-23be-4f49-8c7b-0be4ebde362f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:25.611050 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3de66513-0ee5-48e2-97d0-42cb1dc46471 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:25.611525 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3de66513-0ee5-48e2-97d0-42cb1dc46471 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:25.612350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3de66513-0ee5-48e2-97d0-42cb1dc46471 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:25.612789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3de66513-0ee5-48e2-97d0-42cb1dc46471 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:25.976079 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3de66513-0ee5-48e2-97d0-42cb1dc46471 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388a9972b4da47d7bda9fd36985eeb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f16e25c9f6f4845922175f67e5583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:25.983946 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3de66513-0ee5-48e2-97d0-42cb1dc46471 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f" status: 200 len: 1700 microversion: 2.1 time: 0.403900 Jul 25 12:46:25.984532 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1019/2122] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:25 2022] GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f => generated 1700 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:25.989474 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-00ea939b-290d-48a6-8c9a-75979ef064e9 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:25.990436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-00ea939b-290d-48a6-8c9a-75979ef064e9 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:25.996891 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00ea939b-290d-48a6-8c9a-75979ef064e9 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:25.997715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00ea939b-290d-48a6-8c9a-75979ef064e9 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:25.998757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00ea939b-290d-48a6-8c9a-75979ef064e9 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:25.999486 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00ea939b-290d-48a6-8c9a-75979ef064e9 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:26.783243 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-00ea939b-290d-48a6-8c9a-75979ef064e9 tempest-ServersAdminTestJSON-1654695192 tempest-ServersAdminTestJSON-1654695192-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1616 microversion: 2.1 time: 0.797243 Jul 25 12:46:26.784442 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1020/2123] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:25 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1616 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:26.789424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fea0af80-6c38-4943-b9c4-d71943677f7c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:26.790280 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fea0af80-6c38-4943-b9c4-d71943677f7c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:26.802563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fea0af80-6c38-4943-b9c4-d71943677f7c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:26.806725 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fea0af80-6c38-4943-b9c4-d71943677f7c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:26.807765 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fea0af80-6c38-4943-b9c4-d71943677f7c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:26.818628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fea0af80-6c38-4943-b9c4-d71943677f7c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:27.428407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fea0af80-6c38-4943-b9c4-d71943677f7c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:27.437889 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fea0af80-6c38-4943-b9c4-d71943677f7c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:27.439899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fea0af80-6c38-4943-b9c4-d71943677f7c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:27.441474 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fea0af80-6c38-4943-b9c4-d71943677f7c tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1400 microversion: 2.54 time: 0.655871 Jul 25 12:46:27.461511 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1021/2124] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:26 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1400 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:27.467747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-afc5c727-63e8-456b-b835-0dcb1b0b2e91 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:27.468848 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-afc5c727-63e8-456b-b835-0dcb1b0b2e91 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:27.476293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afc5c727-63e8-456b-b835-0dcb1b0b2e91 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:27.477556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afc5c727-63e8-456b-b835-0dcb1b0b2e91 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:27.478615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afc5c727-63e8-456b-b835-0dcb1b0b2e91 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:27.479742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afc5c727-63e8-456b-b835-0dcb1b0b2e91 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:27.910933 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c93c2d7d-35e3-4695-b712-f8be234314f5 tempest-FloatingIPDetailsTestJSON-529319416 tempest-FloatingIPDetailsTestJSON-529319416-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.648924 Jul 25 12:46:27.921353 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1104/2125] 10.222.0.49 () {60 vars in 1170 bytes} [Mon Jul 25 12:46:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:27.926625 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-60421f40-24a7-41ec-94e1-8fd88b0b12a0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:27.927549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-60421f40-24a7-41ec-94e1-8fd88b0b12a0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 4cb23110-97b4-4958-8ed7-5bf38b41a691] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:27.939485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-60421f40-24a7-41ec-94e1-8fd88b0b12a0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:27.941153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-60421f40-24a7-41ec-94e1-8fd88b0b12a0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:27.942559 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-60421f40-24a7-41ec-94e1-8fd88b0b12a0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:27.943268 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-60421f40-24a7-41ec-94e1-8fd88b0b12a0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:27.992039 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-60421f40-24a7-41ec-94e1-8fd88b0b12a0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 4cb23110-97b4-4958-8ed7-5bf38b41a691] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:46:28.112009 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-60421f40-24a7-41ec-94e1-8fd88b0b12a0 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691" status: 204 len: 0 microversion: 2.1 time: 0.188933 Jul 25 12:46:28.113556 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1105/2126] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:46:27 2022] DELETE /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:46:28.121352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f12c29e4-470e-43b0-8519-3159bf7e8b44 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:28.123045 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f12c29e4-470e-43b0-8519-3159bf7e8b44 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] [instance: d4033cef-23be-4f49-8c7b-0be4ebde362f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:28.134469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f12c29e4-470e-43b0-8519-3159bf7e8b44 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:28.135193 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f12c29e4-470e-43b0-8519-3159bf7e8b44 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:28.137025 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f12c29e4-470e-43b0-8519-3159bf7e8b44 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:28.137540 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f12c29e4-470e-43b0-8519-3159bf7e8b44 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:28.273555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-afc5c727-63e8-456b-b835-0dcb1b0b2e91 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:28.287853 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-afc5c727-63e8-456b-b835-0dcb1b0b2e91 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 200 len: 1575 microversion: 2.1 time: 0.824661 Jul 25 12:46:28.288648 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1022/2127] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:27 2022] GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 1575 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:28.296599 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fc70cfe8-b607-4e20-afce-fd0999653500 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '.version_select at 0x7efcfed74ee0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:28.321043 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fc70cfe8-b607-4e20-afce-fd0999653500 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1976479063" status: 204 len: 0 microversion: 2.54 time: 0.030873 Jul 25 12:46:28.321744 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1023/2128] 10.222.0.49 () {60 vars in 1319 bytes} [Mon Jul 25 12:46:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1976479063 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 12:46:28.326840 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-790bdbf1-22d8-4639-8a6f-b3e310f16ec9 tempest-FloatingIPDetailsTestJSON-529319416 tempest-FloatingIPDetailsTestJSON-529319416-project] Action: 'create', calling method: .version_select at 0x7efcf9cfe820>, body: {"pool": null} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:28.998884 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f12c29e4-470e-43b0-8519-3159bf7e8b44 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388a9972b4da47d7bda9fd36985eeb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f16e25c9f6f4845922175f67e5583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:29.011757 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f12c29e4-470e-43b0-8519-3159bf7e8b44 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f" status: 200 len: 1700 microversion: 2.1 time: 0.896509 Jul 25 12:46:29.025864 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1106/2129] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:28 2022] GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f => generated 1700 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:29.030554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cb7ad4a7-999d-463e-b81c-05c29387f62d tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:29.033093 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cb7ad4a7-999d-463e-b81c-05c29387f62d tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 4cb23110-97b4-4958-8ed7-5bf38b41a691] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:29.065366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb7ad4a7-999d-463e-b81c-05c29387f62d tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:29.066092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb7ad4a7-999d-463e-b81c-05c29387f62d tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:29.066959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb7ad4a7-999d-463e-b81c-05c29387f62d tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:29.067403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb7ad4a7-999d-463e-b81c-05c29387f62d tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:29.672732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cb7ad4a7-999d-463e-b81c-05c29387f62d tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:29.683245 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cb7ad4a7-999d-463e-b81c-05c29387f62d tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691" status: 200 len: 1469 microversion: 2.1 time: 0.667196 Jul 25 12:46:29.685808 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1107/2130] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:29 2022] GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691 => generated 1469 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:29.691485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3570833a-bfff-4c23-abab-ba6ffa5ec050 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:29.691989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3570833a-bfff-4c23-abab-ba6ffa5ec050 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:29.698373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3570833a-bfff-4c23-abab-ba6ffa5ec050 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:29.699064 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3570833a-bfff-4c23-abab-ba6ffa5ec050 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:29.700057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3570833a-bfff-4c23-abab-ba6ffa5ec050 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:29.700773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3570833a-bfff-4c23-abab-ba6ffa5ec050 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:29.762448 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3570833a-bfff-4c23-abab-ba6ffa5ec050 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:46:29.923949 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3570833a-bfff-4c23-abab-ba6ffa5ec050 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "DELETE /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 204 len: 0 microversion: 2.54 time: 0.235485 Jul 25 12:46:29.925115 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1108/2131] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 12:46:29 2022] DELETE /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 12:46:29.952410 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d9c67ffc-fd13-400a-ac06-b880c5497fde tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:29.954151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d9c67ffc-fd13-400a-ac06-b880c5497fde tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:29.962722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9c67ffc-fd13-400a-ac06-b880c5497fde tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:29.963323 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9c67ffc-fd13-400a-ac06-b880c5497fde tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:29.974971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9c67ffc-fd13-400a-ac06-b880c5497fde tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:29.979916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9c67ffc-fd13-400a-ac06-b880c5497fde tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:30.321764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:30.552008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:30.880407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d9c67ffc-fd13-400a-ac06-b880c5497fde tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:30.889203 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d9c67ffc-fd13-400a-ac06-b880c5497fde tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 200 len: 1573 microversion: 2.1 time: 0.957270 Jul 25 12:46:30.890353 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1109/2132] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:29 2022] GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 1573 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:31.099725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-603a3e8d-6ecf-43e7-b64c-c3e743717e8e tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Action: 'create', calling method: .version_select at 0x7efcf9d648b0>, body: {"keypair": {"name": "tempest-keypair-1848458293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwK5xGIxpMb0dpj7pV34fxTBXgKHC3pZ/zLk8v4Qi4xY4MANCwKqJywfY8AV+SDyD01gy+HXChgzH3yt2RZHk2DFzKAwUW2mZJHkFyIansJPSK9f1hTsIBpJ5sk1iqexQ=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:31.125126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-603a3e8d-6ecf-43e7-b64c-c3e743717e8e tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Getting quotas for project 63ce4c7d231540e29b9d66e0f8c276bb. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:46:31.139335 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-603a3e8d-6ecf-43e7-b64c-c3e743717e8e tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Getting quotas for user 8908d857fbae4fd49d6c8cd90529397b and project 63ce4c7d231540e29b9d66e0f8c276bb. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:46:31.166371 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-603a3e8d-6ecf-43e7-b64c-c3e743717e8e tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.274669 Jul 25 12:46:31.167445 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1110/2133] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:46:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:31.172783 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c2e246a0-bc92-47e3-858a-cb53df11b507 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:31.173766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c2e246a0-bc92-47e3-858a-cb53df11b507 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:31.185027 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c2e246a0-bc92-47e3-858a-cb53df11b507 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:31.185816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c2e246a0-bc92-47e3-858a-cb53df11b507 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:31.186866 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c2e246a0-bc92-47e3-858a-cb53df11b507 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:31.188240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c2e246a0-bc92-47e3-858a-cb53df11b507 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:31.353435 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c2e246a0-bc92-47e3-858a-cb53df11b507 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:31.367441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c2e246a0-bc92-47e3-858a-cb53df11b507 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:31.369078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c2e246a0-bc92-47e3-858a-cb53df11b507 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9932c91be25442bc9682cbe7a3440e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4515023e7349bcae2abe4915659a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:31.370292 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c2e246a0-bc92-47e3-858a-cb53df11b507 tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 200 len: 1406 microversion: 2.54 time: 0.201629 Jul 25 12:46:31.370869 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1111/2134] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:31 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:31.382552 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-04d15e98-0197-4983-a8f4-d65c49ce1d6b tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:31.386264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-04d15e98-0197-4983-a8f4-d65c49ce1d6b tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] [instance: d4033cef-23be-4f49-8c7b-0be4ebde362f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:31.403981 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04d15e98-0197-4983-a8f4-d65c49ce1d6b tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:31.404669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04d15e98-0197-4983-a8f4-d65c49ce1d6b tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:31.405710 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04d15e98-0197-4983-a8f4-d65c49ce1d6b tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:31.408157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04d15e98-0197-4983-a8f4-d65c49ce1d6b tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:31.484038 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04d15e98-0197-4983-a8f4-d65c49ce1d6b tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:31.484530 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04d15e98-0197-4983-a8f4-d65c49ce1d6b tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:31.485273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-04d15e98-0197-4983-a8f4-d65c49ce1d6b tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lazy-loading 'fault' on Instance uuid d4033cef-23be-4f49-8c7b-0be4ebde362f {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:46:31.715684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-04d15e98-0197-4983-a8f4-d65c49ce1d6b tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388a9972b4da47d7bda9fd36985eeb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f16e25c9f6f4845922175f67e5583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:31.730279 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-04d15e98-0197-4983-a8f4-d65c49ce1d6b tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f" status: 200 len: 1358 microversion: 2.1 time: 0.351596 Jul 25 12:46:31.731521 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1112/2135] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:31 2022] GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f => generated 1358 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:31.737406 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7f9ae445-770a-4aff-ba66-65fa5a08fba3 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:31.740092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7f9ae445-770a-4aff-ba66-65fa5a08fba3 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 4cb23110-97b4-4958-8ed7-5bf38b41a691] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:31.750766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7f9ae445-770a-4aff-ba66-65fa5a08fba3 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:31.753035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7f9ae445-770a-4aff-ba66-65fa5a08fba3 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:31.767131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7f9ae445-770a-4aff-ba66-65fa5a08fba3 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:31.769768 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7f9ae445-770a-4aff-ba66-65fa5a08fba3 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:31.992560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7f9ae445-770a-4aff-ba66-65fa5a08fba3 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:32.010087 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7f9ae445-770a-4aff-ba66-65fa5a08fba3 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691" status: 200 len: 1427 microversion: 2.1 time: 0.270958 Jul 25 12:46:32.020830 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1113/2136] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:31 2022] GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691 => generated 1427 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:32.028378 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3509d8a3-ffee-469b-a671-83c02d54015d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1457500407"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:32.029417 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3509d8a3-ffee-469b-a671-83c02d54015d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:32.036330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3509d8a3-ffee-469b-a671-83c02d54015d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:32.038372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3509d8a3-ffee-469b-a671-83c02d54015d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:32.046950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3509d8a3-ffee-469b-a671-83c02d54015d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:32.048526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3509d8a3-ffee-469b-a671-83c02d54015d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:32.342405 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.network.security_group_api [None req-3509d8a3-ffee-469b-a671-83c02d54015d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Adding security group fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9 to port 75bbc764-2330-471d-8fc8-f7402e8094db Jul 25 12:46:33.361243 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-790bdbf1-22d8-4639-8a6f-b3e310f16ec9 tempest-FloatingIPDetailsTestJSON-529319416 tempest-FloatingIPDetailsTestJSON-529319416-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.038073 Jul 25 12:46:33.364585 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1024/2137] 10.222.0.49 () {60 vars in 1170 bytes} [Mon Jul 25 12:46:28 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:33.370193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-020013ad-5007-45e2-96f4-6292fc4fead3 req-4dfba0cb-b970-4b80-a8b3-a701bd88e9ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4033cef-23be-4f49-8c7b-0be4ebde362f", "name": "network-vif-deleted", "tag": "a89273b4-19ae-401f-9b9d-63eac14ed636"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:33.406618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-020013ad-5007-45e2-96f4-6292fc4fead3 req-4dfba0cb-b970-4b80-a8b3-a701bd88e9ba service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:33.407273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-020013ad-5007-45e2-96f4-6292fc4fead3 req-4dfba0cb-b970-4b80-a8b3-a701bd88e9ba service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:33.445498 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-020013ad-5007-45e2-96f4-6292fc4fead3 req-4dfba0cb-b970-4b80-a8b3-a701bd88e9ba service nova] Creating event network-vif-deleted:a89273b4-19ae-401f-9b9d-63eac14ed636 for instance d4033cef-23be-4f49-8c7b-0be4ebde362f on n-h2-848886-15 Jul 25 12:46:33.457403 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-020013ad-5007-45e2-96f4-6292fc4fead3 req-4dfba0cb-b970-4b80-a8b3-a701bd88e9ba service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091304 Jul 25 12:46:33.465411 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1025/2138] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:33.471288 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8d527d49-1435-4188-9fd4-2789a9157bbb tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:33.472281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8d527d49-1435-4188-9fd4-2789a9157bbb tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] [instance: 80fa0018-6a89-4dcb-b777-a4fa5788e5ea] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:33.480013 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d527d49-1435-4188-9fd4-2789a9157bbb tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:33.480664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d527d49-1435-4188-9fd4-2789a9157bbb tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:33.482814 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d527d49-1435-4188-9fd4-2789a9157bbb tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:33.483431 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d527d49-1435-4188-9fd4-2789a9157bbb tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:33.519804 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-8d527d49-1435-4188-9fd4-2789a9157bbb tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] HTTP exception thrown: Instance 80fa0018-6a89-4dcb-b777-a4fa5788e5ea could not be found. Jul 25 12:46:33.523394 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8d527d49-1435-4188-9fd4-2789a9157bbb tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Request method failure captured: Jul 25 12:46:33.523394 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea HTTP/1.1 Jul 25 12:46:33.523394 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:46:33.523394 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:46:33.523394 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:46:33.523394 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:46:33.523394 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:46:33.523394 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:46:33.523394 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:46:33.523394 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:33.523394 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pBsEUuZOWRANrIg70SCyjp7tUjtYn4KpmawHDWDt3y9y7_9xRjGypU8hh6o24pAblGU0K3Bh-1tZqbHCiqSdvekgD-QEjHfm5GugDCiafU0okoeMpI-HCnBQSxKntuGMS0-xA3_k4O-_EJ8aCOpy8rp_Nh0EC-LzVZHLBvDQcXsjOM Jul 25 12:46:33.523394 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:46:33.523394 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:46:33.523394 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:46:33.523394 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:46:33.523394 n-d-848886-15 devstack@n-api.service[125883]: X-Openstack-Nova-Api-Version: 2.54 Jul 25 12:46:33.523394 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:46:33.523394 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:46:33.523394 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 5b4515023e7349bcae2abe4915659a2a Jul 25 12:46:33.523394 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerShowV254Test-1050390403 Jul 25 12:46:33.523394 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:46:33.523394 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:46:33.525369 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5b4515023e7349bcae2abe4915659a2a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5b4515023e7349bcae2abe4915659a2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b4515023e7349bcae2abe4915659a2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b4515023e7349bcae2abe4915659a2a"}]}] Jul 25 12:46:33.525369 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerShowV254Test-1050390403 Jul 25 12:46:33.525369 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 5b4515023e7349bcae2abe4915659a2a Jul 25 12:46:33.525369 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerShowV254Test-1050390403 Jul 25 12:46:33.525369 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerShowV254Test-1050390403-project Jul 25 12:46:33.525369 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:46:33.525369 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:46:33.525369 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 9932c91be25442bc9682cbe7a3440e88 Jul 25 12:46:33.525369 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerShowV254Test-1050390403-project Jul 25 12:46:33.525369 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:46:33.525369 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 80fa0018-6a89-4dcb-b777-a4fa5788e5ea could not be found. Jul 25 12:46:33.525369 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '80fa0018-6a89-4dcb-b777-a4fa5788e5ea'} Jul 25 12:46:33.526563 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:33.526563 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:33.526563 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:46:33.526563 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:46:33.526563 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:46:33.526563 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:46:33.526563 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:46:33.526563 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:46:33.526563 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:46:33.526563 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:46:33.526563 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80fa0018-6a89-4dcb-b777-a4fa5788e5ea could not be found. Jul 25 12:46:33.526563 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:33.526563 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:33.526563 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:33.526563 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:33.526563 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:33.526563 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:33.526563 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:33.526563 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:33.526563 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:33.528248 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:33.528248 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:46:33.528248 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:46:33.528248 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:46:33.528248 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:46:33.528248 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:46:33.528248 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:46:33.528248 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80fa0018-6a89-4dcb-b777-a4fa5788e5ea could not be found. Jul 25 12:46:33.528248 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:33.528248 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:33.528248 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:33.528248 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:33.528248 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:33.528248 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:33.528248 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:33.528248 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:33.528248 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80fa0018-6a89-4dcb-b777-a4fa5788e5ea could not be found. Jul 25 12:46:33.528248 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:33.530872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8d527d49-1435-4188-9fd4-2789a9157bbb tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] Returning 404 to user: Instance 80fa0018-6a89-4dcb-b777-a4fa5788e5ea could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:33.530872 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8d527d49-1435-4188-9fd4-2789a9157bbb tempest-ServerShowV254Test-1050390403 tempest-ServerShowV254Test-1050390403-project] 10.222.0.49 "GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea" status: 404 len: 111 microversion: 2.54 time: 0.058221 Jul 25 12:46:33.544814 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1026/2139] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:33 2022] GET /compute/v2.1/servers/80fa0018-6a89-4dcb-b777-a4fa5788e5ea => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:46:33.554634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-583074f9-f225-48bd-8022-4904a62163c0 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:33.555165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-583074f9-f225-48bd-8022-4904a62163c0 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] [instance: d4033cef-23be-4f49-8c7b-0be4ebde362f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:33.558611 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3509d8a3-ffee-469b-a671-83c02d54015d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "POST /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682/action" status: 202 len: 0 microversion: 2.1 time: 1.535594 Jul 25 12:46:33.559584 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1114/2140] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:46:32 2022] POST /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682/action => generated 0 bytes in 1538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:46:33.565610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-38de4364-e6cc-4f4b-bb86-fcb33749b6dd tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:33.566615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-38de4364-e6cc-4f4b-bb86-fcb33749b6dd tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 4cb23110-97b4-4958-8ed7-5bf38b41a691] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:33.584504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-583074f9-f225-48bd-8022-4904a62163c0 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:33.584972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-583074f9-f225-48bd-8022-4904a62163c0 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:33.585773 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-583074f9-f225-48bd-8022-4904a62163c0 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:33.586212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38de4364-e6cc-4f4b-bb86-fcb33749b6dd tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:33.586347 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-583074f9-f225-48bd-8022-4904a62163c0 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:33.586833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38de4364-e6cc-4f4b-bb86-fcb33749b6dd tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:33.587677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38de4364-e6cc-4f4b-bb86-fcb33749b6dd tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:33.588115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38de4364-e6cc-4f4b-bb86-fcb33749b6dd tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:33.612521 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-38de4364-e6cc-4f4b-bb86-fcb33749b6dd tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] HTTP exception thrown: Instance 4cb23110-97b4-4958-8ed7-5bf38b41a691 could not be found. Jul 25 12:46:33.614507 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-38de4364-e6cc-4f4b-bb86-fcb33749b6dd tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Request method failure captured: Jul 25 12:46:33.614507 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691 HTTP/1.1 Jul 25 12:46:33.614507 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:46:33.614507 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:46:33.614507 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:46:33.614507 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:46:33.614507 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:46:33.614507 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:46:33.614507 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:46:33.614507 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:33.614507 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pAEGoaUoxz2yBFfqqglYkxhIrYBVaOUaf3KcG2_RDuTsRrx4FuPhTlTS972SUpGcxEKbxzscMltNzIS1NNCmAvDeaF4upJy4B9WPFP2oLz_fsCXJn1EFVcHzee1AP2VmEgKVKFpZDZ0dcMYeFmbyrUVaGzpvhoi5im9ziBqG8vOObA Jul 25 12:46:33.614507 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:46:33.614507 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:46:33.614507 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:46:33.614507 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:46:33.614507 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:46:33.614507 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:46:33.614507 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: e7330b3757794c94b7cbd4ce6886c78d Jul 25 12:46:33.614507 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersAdminTestJSON-2021075583 Jul 25 12:46:33.614507 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:46:33.614507 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:46:33.616302 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e7330b3757794c94b7cbd4ce6886c78d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e7330b3757794c94b7cbd4ce6886c78d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e7330b3757794c94b7cbd4ce6886c78d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e7330b3757794c94b7cbd4ce6886c78d"}]}] Jul 25 12:46:33.616302 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersAdminTestJSON-2021075583 Jul 25 12:46:33.616302 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: e7330b3757794c94b7cbd4ce6886c78d Jul 25 12:46:33.616302 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersAdminTestJSON-2021075583 Jul 25 12:46:33.616302 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersAdminTestJSON-2021075583-project Jul 25 12:46:33.616302 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:46:33.616302 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:46:33.616302 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: e0f15b1174154d848d010e48b5df98db Jul 25 12:46:33.616302 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersAdminTestJSON-2021075583-project Jul 25 12:46:33.616302 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:46:33.616302 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 4cb23110-97b4-4958-8ed7-5bf38b41a691 could not be found. Jul 25 12:46:33.616302 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '4cb23110-97b4-4958-8ed7-5bf38b41a691'} Jul 25 12:46:33.617337 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:33.617337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:33.617337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:46:33.617337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:46:33.617337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:46:33.617337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:46:33.617337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:46:33.617337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:46:33.617337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:46:33.617337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:46:33.617337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cb23110-97b4-4958-8ed7-5bf38b41a691 could not be found. Jul 25 12:46:33.617337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:33.617337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:33.617337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:33.617337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:33.617337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:33.617337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:33.617337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:33.617337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:33.617337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:33.619340 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:33.619340 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:46:33.619340 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:46:33.619340 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:46:33.619340 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:46:33.619340 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:46:33.619340 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:46:33.619340 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cb23110-97b4-4958-8ed7-5bf38b41a691 could not be found. Jul 25 12:46:33.619340 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:33.619340 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:33.619340 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:33.619340 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:33.619340 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:33.619340 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:33.619340 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:33.619340 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:33.619340 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cb23110-97b4-4958-8ed7-5bf38b41a691 could not be found. Jul 25 12:46:33.619340 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:33.622106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-38de4364-e6cc-4f4b-bb86-fcb33749b6dd tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Returning 404 to user: Instance 4cb23110-97b4-4958-8ed7-5bf38b41a691 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:33.622106 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-38de4364-e6cc-4f4b-bb86-fcb33749b6dd tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691" status: 404 len: 111 microversion: 2.1 time: 0.057059 Jul 25 12:46:33.622513 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-583074f9-f225-48bd-8022-4904a62163c0 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] HTTP exception thrown: Instance d4033cef-23be-4f49-8c7b-0be4ebde362f could not be found. Jul 25 12:46:33.622689 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1115/2141] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:33 2022] GET /compute/v2.1/servers/4cb23110-97b4-4958-8ed7-5bf38b41a691 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:46:33.624350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-583074f9-f225-48bd-8022-4904a62163c0 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Request method failure captured: Jul 25 12:46:33.624350 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f HTTP/1.1 Jul 25 12:46:33.624350 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:46:33.624350 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:46:33.624350 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:46:33.624350 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:46:33.624350 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:46:33.624350 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:46:33.624350 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:46:33.624350 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:33.624350 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pBQT1-NADndkYJPW8xRPG9YtttqnmjRYSyeNCBm_QXIFuvdN8aYXsTjBTciHJGYzCxb8zD7jNvIbmRFtUPJTTwqm7M5rDVeu5YTf0Kb8YoicuCfo12bssRxsj1Ukc8MU_lGx2_KQLahhYhVdCDdutaoHrvET1nKvQepE03pk2AdfW0 Jul 25 12:46:33.624350 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:46:33.624350 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:46:33.624350 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:46:33.624350 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:46:33.624350 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:46:33.624350 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:46:33.624350 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 2f16e25c9f6f4845922175f67e5583a1 Jul 25 12:46:33.624350 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersTestJSON-1991704701 Jul 25 12:46:33.624350 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:46:33.624350 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:46:33.627637 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2f16e25c9f6f4845922175f67e5583a1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2f16e25c9f6f4845922175f67e5583a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2f16e25c9f6f4845922175f67e5583a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2f16e25c9f6f4845922175f67e5583a1"}]}] Jul 25 12:46:33.627637 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersTestJSON-1991704701 Jul 25 12:46:33.627637 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 2f16e25c9f6f4845922175f67e5583a1 Jul 25 12:46:33.627637 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersTestJSON-1991704701 Jul 25 12:46:33.627637 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersTestJSON-1991704701-project Jul 25 12:46:33.627637 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:46:33.627637 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:46:33.627637 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 388a9972b4da47d7bda9fd36985eeb95 Jul 25 12:46:33.627637 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersTestJSON-1991704701-project Jul 25 12:46:33.627637 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:46:33.627637 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance d4033cef-23be-4f49-8c7b-0be4ebde362f could not be found. Jul 25 12:46:33.627637 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'd4033cef-23be-4f49-8c7b-0be4ebde362f'} Jul 25 12:46:33.629727 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:33.629727 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:33.629727 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:46:33.629727 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:46:33.629727 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:46:33.629727 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:46:33.629727 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:46:33.629727 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:46:33.629727 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:46:33.629727 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:46:33.629727 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4033cef-23be-4f49-8c7b-0be4ebde362f could not be found. Jul 25 12:46:33.629727 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:33.629727 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:33.629727 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:33.629727 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:33.629727 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:33.629727 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:33.629727 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:33.629727 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:33.629727 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:33.632672 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:33.632672 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:46:33.632672 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:46:33.632672 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:46:33.632672 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:46:33.632672 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:46:33.632672 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:46:33.632672 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4033cef-23be-4f49-8c7b-0be4ebde362f could not be found. Jul 25 12:46:33.632672 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:33.632672 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:33.632672 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:33.632672 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:33.632672 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:33.632672 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:33.632672 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:33.632672 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:33.632672 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4033cef-23be-4f49-8c7b-0be4ebde362f could not be found. Jul 25 12:46:33.632672 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:33.635381 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-583074f9-f225-48bd-8022-4904a62163c0 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Returning 404 to user: Instance d4033cef-23be-4f49-8c7b-0be4ebde362f could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:33.635381 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-583074f9-f225-48bd-8022-4904a62163c0 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f" status: 404 len: 111 microversion: 2.1 time: 0.078590 Jul 25 12:46:33.635381 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1027/2142] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:33 2022] GET /compute/v2.1/servers/d4033cef-23be-4f49-8c7b-0be4ebde362f => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:46:33.635860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-04235f4d-a3de-448c-9e63-7673efdcc5cb tempest-FloatingIPDetailsTestJSON-529319416 tempest-FloatingIPDetailsTestJSON-529319416-project] Action: 'create', calling method: .version_select at 0x7efcf9d643a0>, body: {"pool": null} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:33.638865 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8eb9d2a7-f6a5-4534-959a-d9164e2a60b2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcf9cfeb80>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:34.078846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG neutronclient.v2_0.client [None req-8eb9d2a7-f6a5-4534-959a-d9164e2a60b2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9 in use.", "detail": ""}} {{(pid=125883) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:46:34.079663 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-8eb9d2a7-f6a5-4534-959a-d9164e2a60b2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] HTTP exception thrown: Security Group fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9 in use. Jul 25 12:46:34.079663 n-d-848886-15 devstack@n-api.service[125883]: Neutron server returns request_ids: ['req-7bd2706e-377a-47d1-84a4-56efd4aa4ace'] Jul 25 12:46:34.081747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8eb9d2a7-f6a5-4534-959a-d9164e2a60b2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Request method failure captured: Jul 25 12:46:34.081747 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/os-security-groups/fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9 HTTP/1.1 Jul 25 12:46:34.081747 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:46:34.081747 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:46:34.081747 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:46:34.081747 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:46:34.081747 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:46:34.081747 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:46:34.081747 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:46:34.081747 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:34.081747 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pBMnvMCkXPIxtXS4OZUlYvEfqLzk8eVB6uOa00GC7XzG0Qi-IKZscbMEZM1xj3l2F-5d5lIAdtnOADbgV21wrMS4dvC7LWzHzoCd7ieXebifkHeaO9Mp4wm9vR5m7HEh9yMTTXFHMqap1mzBebGWb33cT_Byxbl27G3bMxoNj8QlS0 Jul 25 12:46:34.081747 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:46:34.081747 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:46:34.081747 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:46:34.081747 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:46:34.081747 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:46:34.081747 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:46:34.081747 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:34.081747 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:34.081747 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:46:34.081747 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:46:34.085535 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8514497475b8462b86e28d48a16b0b20", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}] Jul 25 12:46:34.085535 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:34.085535 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:34.085535 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:34.085535 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:34.085535 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:46:34.085535 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:46:34.085535 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 3912af6bdd224191910f72160c42db30 Jul 25 12:46:34.085535 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:34.085535 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:46:34.085535 n-d-848886-15 devstack@n-api.service[125883]: exception: Security Group fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9 in use. Jul 25 12:46:34.085535 n-d-848886-15 devstack@n-api.service[125883]: Neutron server returns request_ids: ['req-7bd2706e-377a-47d1-84a4-56efd4aa4ace'] Jul 25 12:46:34.085535 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9'} Jul 25 12:46:34.086710 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:34.086710 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:34.086710 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 25 12:46:34.086710 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 25 12:46:34.086710 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:34.086710 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:34.086710 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 25 12:46:34.086710 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 25 12:46:34.086710 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:34.086710 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:34.086710 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 25 12:46:34.086710 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 25 12:46:34.086710 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:34.086710 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:34.086710 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:46:34.086710 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:46:34.086710 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:34.086710 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:34.086710 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:46:34.088276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:46:34.088276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:34.088276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:34.088276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:46:34.088276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:46:34.088276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:46:34.088276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:46:34.088276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9 in use. Jul 25 12:46:34.088276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7bd2706e-377a-47d1-84a4-56efd4aa4ace'] Jul 25 12:46:34.088276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:34.088276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:34.088276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:34.088276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:34.088276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 25 12:46:34.088276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 25 12:46:34.088276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 25 12:46:34.088276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 25 12:46:34.088276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9 in use. Jul 25 12:46:34.088276 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7bd2706e-377a-47d1-84a4-56efd4aa4ace'] Jul 25 12:46:34.089851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:34.089851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:34.089851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:34.089851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:34.089851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:34.089851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:34.089851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:34.089851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:34.089851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:46:34.089851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:46:34.089851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:34.089851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:34.089851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 25 12:46:34.089851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 12:46:34.089851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9 in use. Jul 25 12:46:34.089851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7bd2706e-377a-47d1-84a4-56efd4aa4ace'] Jul 25 12:46:34.089851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:34.089851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:34.089851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:34.089851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:34.089851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:34.091682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:34.091682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:34.091682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:34.091682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9 in use. Jul 25 12:46:34.091682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7bd2706e-377a-47d1-84a4-56efd4aa4ace'] Jul 25 12:46:34.091682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:34.091682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8eb9d2a7-f6a5-4534-959a-d9164e2a60b2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Returning 400 to user: Security Group fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9 in use. Jul 25 12:46:34.091682 n-d-848886-15 devstack@n-api.service[125883]: Neutron server returns request_ids: ['req-7bd2706e-377a-47d1-84a4-56efd4aa4ace'] {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:34.091682 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8eb9d2a7-f6a5-4534-959a-d9164e2a60b2 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9" status: 400 len: 185 microversion: 2.1 time: 0.454873 Jul 25 12:46:34.091682 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1028/2143] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:46:33 2022] DELETE /compute/v2.1/os-security-groups/fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9 => generated 185 bytes in 456 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:46:34.095787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c4c9437d-2f1d-4b7e-a64f-4a9bef6cbd08 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:34.111090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c4c9437d-2f1d-4b7e-a64f-4a9bef6cbd08 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 965438e3-72fa-44e0-90fa-4fb0b24042ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:34.137116 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4c9437d-2f1d-4b7e-a64f-4a9bef6cbd08 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:34.138003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4c9437d-2f1d-4b7e-a64f-4a9bef6cbd08 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:34.139131 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4c9437d-2f1d-4b7e-a64f-4a9bef6cbd08 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:34.139823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4c9437d-2f1d-4b7e-a64f-4a9bef6cbd08 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:34.168183 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c4c9437d-2f1d-4b7e-a64f-4a9bef6cbd08 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 965438e3-72fa-44e0-90fa-4fb0b24042ff] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:46:34.307700 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c4c9437d-2f1d-4b7e-a64f-4a9bef6cbd08 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "DELETE /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff" status: 204 len: 0 microversion: 2.1 time: 0.219143 Jul 25 12:46:34.308831 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1029/2144] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:46:34 2022] DELETE /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:46:34.316920 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-94e6152b-5221-4cb7-8e41-0a45af8b27a1 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] Calling method '.version_select at 0x7efcf905caf0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:34.347461 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-94e6152b-5221-4cb7-8e41-0a45af8b27a1 tempest-ServersTestJSON-1991704701 tempest-ServersTestJSON-1991704701-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-94472135" status: 202 len: 0 microversion: 2.1 time: 0.036954 Jul 25 12:46:34.348495 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1030/2145] 10.222.0.49 () {58 vars in 1215 bytes} [Mon Jul 25 12:46:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-94472135 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:46:34.357011 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e4f8a3a1-73c0-4884-b57b-90655f210607 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:34.358641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e4f8a3a1-73c0-4884-b57b-90655f210607 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:34.369134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4f8a3a1-73c0-4884-b57b-90655f210607 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:34.370764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4f8a3a1-73c0-4884-b57b-90655f210607 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:34.371833 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4f8a3a1-73c0-4884-b57b-90655f210607 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:34.373902 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4f8a3a1-73c0-4884-b57b-90655f210607 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:34.419543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e4f8a3a1-73c0-4884-b57b-90655f210607 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:46:34.569144 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e4f8a3a1-73c0-4884-b57b-90655f210607 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 204 len: 0 microversion: 2.1 time: 0.218814 Jul 25 12:46:34.570696 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1031/2146] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:46:34 2022] DELETE /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:46:34.581925 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-62db9812-de90-44fd-b2ad-6dd31f370605 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:34.582844 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-62db9812-de90-44fd-b2ad-6dd31f370605 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 965438e3-72fa-44e0-90fa-4fb0b24042ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:34.590829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62db9812-de90-44fd-b2ad-6dd31f370605 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:34.591314 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62db9812-de90-44fd-b2ad-6dd31f370605 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:34.592181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62db9812-de90-44fd-b2ad-6dd31f370605 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:34.592748 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62db9812-de90-44fd-b2ad-6dd31f370605 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:35.398698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-62db9812-de90-44fd-b2ad-6dd31f370605 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:35.410748 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-62db9812-de90-44fd-b2ad-6dd31f370605 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff" status: 200 len: 1469 microversion: 2.1 time: 0.837483 Jul 25 12:46:35.411492 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1032/2147] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:34 2022] GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff => generated 1469 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:35.425603 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9b6f9ff8-2ee1-4e13-9d9b-ab3dff6e4244 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:35.428867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9b6f9ff8-2ee1-4e13-9d9b-ab3dff6e4244 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:35.443534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b6f9ff8-2ee1-4e13-9d9b-ab3dff6e4244 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:35.444781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b6f9ff8-2ee1-4e13-9d9b-ab3dff6e4244 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:35.445788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b6f9ff8-2ee1-4e13-9d9b-ab3dff6e4244 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:35.446426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b6f9ff8-2ee1-4e13-9d9b-ab3dff6e4244 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:36.117951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9b6f9ff8-2ee1-4e13-9d9b-ab3dff6e4244 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:36.136240 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9b6f9ff8-2ee1-4e13-9d9b-ab3dff6e4244 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 200 len: 1648 microversion: 2.1 time: 0.721950 Jul 25 12:46:36.136907 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1033/2148] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:35 2022] GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 1648 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:36.148280 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b05aceba-aa32-4d49-bd10-99b2279053fa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-729851937", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "02367158-0cb5-4ee6-b8d9-660c13689517"}], "security_groups": [{"name": "tempest-securitygroup--681002938"}], "key_name": "tempest-keypair-1848458293", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:36.430810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-b05aceba-aa32-4d49-bd10-99b2279053fa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] validate_networks() for [('02367158-0cb5-4ee6-b8d9-660c13689517', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:46:38.605010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-b05aceba-aa32-4d49-bd10-99b2279053fa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:46:38.605619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-b05aceba-aa32-4d49-bd10-99b2279053fa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:46:38.606024 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-b05aceba-aa32-4d49-bd10-99b2279053fa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:46:38.606655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-b05aceba-aa32-4d49-bd10-99b2279053fa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:46:38.607278 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-b05aceba-aa32-4d49-bd10-99b2279053fa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:46:38.621988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b05aceba-aa32-4d49-bd10-99b2279053fa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:38.622475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b05aceba-aa32-4d49-bd10-99b2279053fa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:38.623481 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b05aceba-aa32-4d49-bd10-99b2279053fa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:38.624476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b05aceba-aa32-4d49-bd10-99b2279053fa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:38.648010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-b05aceba-aa32-4d49-bd10-99b2279053fa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Getting quotas for project 63ce4c7d231540e29b9d66e0f8c276bb. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:46:38.654070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-b05aceba-aa32-4d49-bd10-99b2279053fa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Getting quotas for user 8908d857fbae4fd49d6c8cd90529397b and project 63ce4c7d231540e29b9d66e0f8c276bb. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:46:38.670276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b05aceba-aa32-4d49-bd10-99b2279053fa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:46:38.672974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b05aceba-aa32-4d49-bd10-99b2279053fa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:46:38.756494 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b05aceba-aa32-4d49-bd10-99b2279053fa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.617661 Jul 25 12:46:38.760548 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1034/2149] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:46:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 2622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:46:38.772588 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-c57753c4-55f9-4d15-a06b-5a2e381764de req-c47e9a32-c3f7-44d0-8d14-4d5ae2cbdc88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb23110-97b4-4958-8ed7-5bf38b41a691", "name": "network-vif-deleted", "tag": "f47ea668-6bab-47e6-ba2e-12feac455939"}, {"name": "network-changed", "server_uuid": "9f541b63-ccc7-488a-b5a4-8ee5b0f5e682", "tag": "75bbc764-2330-471d-8fc8-f7402e8094db"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:38.791342 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c57753c4-55f9-4d15-a06b-5a2e381764de req-c47e9a32-c3f7-44d0-8d14-4d5ae2cbdc88 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:38.792147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c57753c4-55f9-4d15-a06b-5a2e381764de req-c47e9a32-c3f7-44d0-8d14-4d5ae2cbdc88 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:38.811169 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-c57753c4-55f9-4d15-a06b-5a2e381764de req-c47e9a32-c3f7-44d0-8d14-4d5ae2cbdc88 service nova] Creating event network-vif-deleted:f47ea668-6bab-47e6-ba2e-12feac455939 for instance 4cb23110-97b4-4958-8ed7-5bf38b41a691 on n-h2-848886-15 Jul 25 12:46:38.812170 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-c57753c4-55f9-4d15-a06b-5a2e381764de req-c47e9a32-c3f7-44d0-8d14-4d5ae2cbdc88 service nova] Creating event network-changed:75bbc764-2330-471d-8fc8-f7402e8094db for instance 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 on n-h1-848886-15 Jul 25 12:46:38.820966 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-c57753c4-55f9-4d15-a06b-5a2e381764de req-c47e9a32-c3f7-44d0-8d14-4d5ae2cbdc88 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.057956 Jul 25 12:46:38.822049 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1035/2150] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:38.827527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7ba5d5f4-8fb4-42d0-8f28-13e5c55f8c4e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:38.828516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7ba5d5f4-8fb4-42d0-8f28-13e5c55f8c4e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 965438e3-72fa-44e0-90fa-4fb0b24042ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:38.836055 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ba5d5f4-8fb4-42d0-8f28-13e5c55f8c4e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:38.836736 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ba5d5f4-8fb4-42d0-8f28-13e5c55f8c4e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:38.837737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ba5d5f4-8fb4-42d0-8f28-13e5c55f8c4e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:38.839347 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ba5d5f4-8fb4-42d0-8f28-13e5c55f8c4e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:38.856586 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-04235f4d-a3de-448c-9e63-7673efdcc5cb tempest-FloatingIPDetailsTestJSON-529319416 tempest-FloatingIPDetailsTestJSON-529319416-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.233407 Jul 25 12:46:38.863101 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1116/2151] 10.222.0.49 () {60 vars in 1170 bytes} [Mon Jul 25 12:46:33 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:39.055685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e2d6c33c-f339-46c1-b69e-7e09ed3f71b3 tempest-ExtensionsTest-1956378466 tempest-ExtensionsTest-1956378466-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:39.057659 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e2d6c33c-f339-46c1-b69e-7e09ed3f71b3 tempest-ExtensionsTest-1956378466 tempest-ExtensionsTest-1956378466-project] 10.222.0.49 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.192950 Jul 25 12:46:39.058257 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1117/2152] 10.222.0.49 () {58 vars in 1170 bytes} [Mon Jul 25 12:46:38 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:39.067260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3ae63c97-6bce-453f-9b4b-0e19d5eaa43e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:39.068071 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3ae63c97-6bce-453f-9b4b-0e19d5eaa43e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:39.073698 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:39.075376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ae63c97-6bce-453f-9b4b-0e19d5eaa43e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:39.075908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ae63c97-6bce-453f-9b4b-0e19d5eaa43e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:39.076939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ae63c97-6bce-453f-9b4b-0e19d5eaa43e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:39.077472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ae63c97-6bce-453f-9b4b-0e19d5eaa43e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:39.205404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3ae63c97-6bce-453f-9b4b-0e19d5eaa43e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:39.218737 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3ae63c97-6bce-453f-9b4b-0e19d5eaa43e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 200 len: 1469 microversion: 2.1 time: 0.157851 Jul 25 12:46:39.221313 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1118/2153] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:39 2022] GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 1469 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:39.232752 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ada56e4b-1990-481a-999a-8e9ab50fd626 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:39.234234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ada56e4b-1990-481a-999a-8e9ab50fd626 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:39.550344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ada56e4b-1990-481a-999a-8e9ab50fd626 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8908d857fbae4fd49d6c8cd90529397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ce4c7d231540e29b9d66e0f8c276bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:39.561775 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ada56e4b-1990-481a-999a-8e9ab50fd626 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb" status: 200 len: 1241 microversion: 2.1 time: 0.335660 Jul 25 12:46:39.588753 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1119/2154] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:39 2022] GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb => generated 1241 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:39.611169 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a3fbc9fd-5f57-4514-be35-8f93283c9aaf tempest-FloatingIPDetailsTestJSON-529319416 tempest-FloatingIPDetailsTestJSON-529319416-project] Calling method '.version_select at 0x7efcf9d648b0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:39.814936 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7ba5d5f4-8fb4-42d0-8f28-13e5c55f8c4e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:39.825904 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7ba5d5f4-8fb4-42d0-8f28-13e5c55f8c4e tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff" status: 200 len: 1469 microversion: 2.1 time: 1.002270 Jul 25 12:46:39.853736 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1036/2155] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:38 2022] GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff => generated 1469 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:39.878124 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2240f486-17c2-45df-aa30-ad08ffa5d89a tempest-ExtensionsTest-1956378466 tempest-ExtensionsTest-1956378466-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:39.891040 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2240f486-17c2-45df-aa30-ad08ffa5d89a tempest-ExtensionsTest-1956378466 tempest-ExtensionsTest-1956378466-project] 10.222.0.49 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.033086 Jul 25 12:46:39.893535 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1037/2156] 10.222.0.49 () {58 vars in 1134 bytes} [Mon Jul 25 12:46:39 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:46:39.913045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fbd04254-a483-435c-a196-fcd13f64898c tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56dce919-0c94-4198-840d-cc9c49f8feac"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:39.917388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fbd04254-a483-435c-a196-fcd13f64898c tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:39.941367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fbd04254-a483-435c-a196-fcd13f64898c tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:39.942871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fbd04254-a483-435c-a196-fcd13f64898c tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:39.946285 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fbd04254-a483-435c-a196-fcd13f64898c tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:39.950272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fbd04254-a483-435c-a196-fcd13f64898c tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:40.160821 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a3fbc9fd-5f57-4514-be35-8f93283c9aaf tempest-FloatingIPDetailsTestJSON-529319416 tempest-FloatingIPDetailsTestJSON-529319416-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips/c4bc69f3-87ce-40ad-8199-1e7813ef3618" status: 200 len: 141 microversion: 2.1 time: 0.566383 Jul 25 12:46:40.162081 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1120/2157] 10.222.0.49 () {58 vars in 1260 bytes} [Mon Jul 25 12:46:39 2022] GET /compute/v2.1/os-floating-ips/c4bc69f3-87ce-40ad-8199-1e7813ef3618 => generated 141 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:40.175194 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c276d3b3-5d4c-49d3-af04-9bbd30a30374 tempest-FloatingIPDetailsTestJSON-529319416 tempest-FloatingIPDetailsTestJSON-529319416-project] Calling method '.version_select at 0x7efcfa2dbc10>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:40.199078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:40.402461 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fbd04254-a483-435c-a196-fcd13f64898c tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "POST /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.507012 Jul 25 12:46:40.403941 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1038/2158] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Jul 25 12:46:39 2022] POST /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e/os-volume_attachments => generated 194 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:40.430480 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e2e19e17-758d-4a14-9902-509f0b1a23de tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:40.432533 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e2e19e17-758d-4a14-9902-509f0b1a23de tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:40.457507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2e19e17-758d-4a14-9902-509f0b1a23de tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:40.458068 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2e19e17-758d-4a14-9902-509f0b1a23de tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:40.460745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2e19e17-758d-4a14-9902-509f0b1a23de tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:40.463761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2e19e17-758d-4a14-9902-509f0b1a23de tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:40.579638 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2e19e17-758d-4a14-9902-509f0b1a23de tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:40.580115 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2e19e17-758d-4a14-9902-509f0b1a23de tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:40.580601 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-e2e19e17-758d-4a14-9902-509f0b1a23de tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lazy-loading 'fault' on Instance uuid 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:46:40.653465 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e2e19e17-758d-4a14-9902-509f0b1a23de tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:40.666332 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e2e19e17-758d-4a14-9902-509f0b1a23de tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 200 len: 1474 microversion: 2.1 time: 0.256761 Jul 25 12:46:40.666845 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1039/2159] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:40 2022] GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 1474 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:40.682750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f0c2209d-2388-4209-a495-484fba9323e2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:40.684155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f0c2209d-2388-4209-a495-484fba9323e2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:40.698494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0c2209d-2388-4209-a495-484fba9323e2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:40.699274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0c2209d-2388-4209-a495-484fba9323e2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:40.700295 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0c2209d-2388-4209-a495-484fba9323e2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:40.701009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0c2209d-2388-4209-a495-484fba9323e2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:40.869515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f0c2209d-2388-4209-a495-484fba9323e2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8908d857fbae4fd49d6c8cd90529397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ce4c7d231540e29b9d66e0f8c276bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:40.884786 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f0c2209d-2388-4209-a495-484fba9323e2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb" status: 200 len: 1293 microversion: 2.1 time: 0.216588 Jul 25 12:46:40.886143 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1040/2160] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:40 2022] GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb => generated 1293 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:40.895984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f8091764-82be-4122-b93f-a7660a69af18 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:40.896991 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f8091764-82be-4122-b93f-a7660a69af18 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 965438e3-72fa-44e0-90fa-4fb0b24042ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:40.913945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8091764-82be-4122-b93f-a7660a69af18 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:40.916527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8091764-82be-4122-b93f-a7660a69af18 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:40.919098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8091764-82be-4122-b93f-a7660a69af18 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:40.920303 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8091764-82be-4122-b93f-a7660a69af18 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:41.006258 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8091764-82be-4122-b93f-a7660a69af18 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:41.009233 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8091764-82be-4122-b93f-a7660a69af18 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:41.010038 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-f8091764-82be-4122-b93f-a7660a69af18 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lazy-loading 'fault' on Instance uuid 965438e3-72fa-44e0-90fa-4fb0b24042ff {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:46:41.722423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f8091764-82be-4122-b93f-a7660a69af18 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:41.732534 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f8091764-82be-4122-b93f-a7660a69af18 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff" status: 200 len: 1303 microversion: 2.1 time: 0.844767 Jul 25 12:46:41.734438 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1041/2161] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:40 2022] GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff => generated 1303 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:41.752948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-63299bc8-dc0e-44b8-a5ae-a6a3576ece73 req-ecbd6b73-bb0e-4b69-b773-0cc390efedb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f541b63-ccc7-488a-b5a4-8ee5b0f5e682", "name": "network-vif-deleted", "tag": "75bbc764-2330-471d-8fc8-f7402e8094db"}, {"server_uuid": "965438e3-72fa-44e0-90fa-4fb0b24042ff", "name": "network-vif-deleted", "tag": "22eacc86-1f73-4a81-89fe-aee538508ec8"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:41.798168 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-63299bc8-dc0e-44b8-a5ae-a6a3576ece73 req-ecbd6b73-bb0e-4b69-b773-0cc390efedb1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:41.798829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-63299bc8-dc0e-44b8-a5ae-a6a3576ece73 req-ecbd6b73-bb0e-4b69-b773-0cc390efedb1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:41.848330 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-63299bc8-dc0e-44b8-a5ae-a6a3576ece73 req-ecbd6b73-bb0e-4b69-b773-0cc390efedb1 service nova] Creating event network-vif-deleted:75bbc764-2330-471d-8fc8-f7402e8094db for instance 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 on n-h1-848886-15 Jul 25 12:46:41.848977 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-63299bc8-dc0e-44b8-a5ae-a6a3576ece73 req-ecbd6b73-bb0e-4b69-b773-0cc390efedb1 service nova] Creating event network-vif-deleted:22eacc86-1f73-4a81-89fe-aee538508ec8 for instance 965438e3-72fa-44e0-90fa-4fb0b24042ff on n-h1-848886-15 Jul 25 12:46:41.875032 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-63299bc8-dc0e-44b8-a5ae-a6a3576ece73 req-ecbd6b73-bb0e-4b69-b773-0cc390efedb1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.138257 Jul 25 12:46:41.875756 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1042/2162] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:41.888875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6912761a-eb5b-4c11-aafa-728318573c68 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:41.889600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6912761a-eb5b-4c11-aafa-728318573c68 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:41.922284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6912761a-eb5b-4c11-aafa-728318573c68 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:41.922751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6912761a-eb5b-4c11-aafa-728318573c68 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:41.923586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6912761a-eb5b-4c11-aafa-728318573c68 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:41.924032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6912761a-eb5b-4c11-aafa-728318573c68 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:41.978795 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-6912761a-eb5b-4c11-aafa-728318573c68 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] HTTP exception thrown: Instance 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 could not be found. Jul 25 12:46:41.982857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6912761a-eb5b-4c11-aafa-728318573c68 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Request method failure captured: Jul 25 12:46:41.982857 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 HTTP/1.1 Jul 25 12:46:41.982857 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:46:41.982857 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:46:41.982857 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:46:41.982857 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:46:41.982857 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:46:41.982857 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:46:41.982857 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:46:41.982857 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:41.982857 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pBMnvMCkXPIxtXS4OZUlYvEfqLzk8eVB6uOa00GC7XzG0Qi-IKZscbMEZM1xj3l2F-5d5lIAdtnOADbgV21wrMS4dvC7LWzHzoCd7ieXebifkHeaO9Mp4wm9vR5m7HEh9yMTTXFHMqap1mzBebGWb33cT_Byxbl27G3bMxoNj8QlS0 Jul 25 12:46:41.982857 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:46:41.982857 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:46:41.982857 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:46:41.982857 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:46:41.982857 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:46:41.982857 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:46:41.982857 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:41.982857 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:41.982857 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:46:41.982857 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:46:41.984832 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8514497475b8462b86e28d48a16b0b20", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}] Jul 25 12:46:41.984832 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:41.984832 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:41.984832 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:41.984832 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:41.984832 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:46:41.984832 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:46:41.984832 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 3912af6bdd224191910f72160c42db30 Jul 25 12:46:41.984832 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:41.984832 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:46:41.984832 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 could not be found. Jul 25 12:46:41.984832 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '9f541b63-ccc7-488a-b5a4-8ee5b0f5e682'} Jul 25 12:46:41.986058 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:41.986058 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:41.986058 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:46:41.986058 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:46:41.986058 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:46:41.986058 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:46:41.986058 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:46:41.986058 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:46:41.986058 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:46:41.986058 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:46:41.986058 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 could not be found. Jul 25 12:46:41.986058 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:41.986058 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:41.986058 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:41.986058 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:41.986058 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:41.986058 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:41.986058 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:41.986058 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:41.986058 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:41.987842 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:41.987842 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:46:41.987842 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:46:41.987842 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:46:41.987842 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:46:41.987842 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:46:41.987842 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:46:41.987842 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 could not be found. Jul 25 12:46:41.987842 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:41.987842 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:41.987842 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:41.987842 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:41.987842 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:41.987842 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:41.987842 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:41.987842 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:41.987842 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 could not be found. Jul 25 12:46:41.987842 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:41.989437 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6912761a-eb5b-4c11-aafa-728318573c68 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Returning 404 to user: Instance 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:41.989437 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6912761a-eb5b-4c11-aafa-728318573c68 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 404 len: 111 microversion: 2.1 time: 0.107513 Jul 25 12:46:41.989437 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1043/2163] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:41 2022] GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:46:42.001754 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-82c366fd-6f3e-440c-904a-9975d2eaf62e tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:42.002411 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-82c366fd-6f3e-440c-904a-9975d2eaf62e tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:42.036161 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82c366fd-6f3e-440c-904a-9975d2eaf62e tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:42.037793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82c366fd-6f3e-440c-904a-9975d2eaf62e tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:42.039620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82c366fd-6f3e-440c-904a-9975d2eaf62e tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:42.042088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82c366fd-6f3e-440c-904a-9975d2eaf62e tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:43.081868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-82c366fd-6f3e-440c-904a-9975d2eaf62e tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8908d857fbae4fd49d6c8cd90529397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ce4c7d231540e29b9d66e0f8c276bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:43.090506 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-82c366fd-6f3e-440c-904a-9975d2eaf62e tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb" status: 200 len: 1366 microversion: 2.1 time: 1.104564 Jul 25 12:46:43.105620 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1044/2164] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:41 2022] GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb => generated 1366 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:43.111730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f53e8739-ae1b-43ef-81e4-4d34c11ec5a6 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcfa112ee0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:43.737629 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c276d3b3-5d4c-49d3-af04-9bbd30a30374 tempest-FloatingIPDetailsTestJSON-529319416 tempest-FloatingIPDetailsTestJSON-529319416-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/c4bc69f3-87ce-40ad-8199-1e7813ef3618" status: 202 len: 0 microversion: 2.1 time: 3.566829 Jul 25 12:46:43.742875 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1121/2165] 10.222.0.49 () {58 vars in 1263 bytes} [Mon Jul 25 12:46:40 2022] DELETE /compute/v2.1/os-floating-ips/c4bc69f3-87ce-40ad-8199-1e7813ef3618 => generated 0 bytes in 3572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 12:46:43.748348 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7e75e083-7619-426e-8be9-d6499c54a741 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:43.748976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7e75e083-7619-426e-8be9-d6499c54a741 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: 965438e3-72fa-44e0-90fa-4fb0b24042ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:43.761021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e75e083-7619-426e-8be9-d6499c54a741 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:43.763696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e75e083-7619-426e-8be9-d6499c54a741 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:43.768002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e75e083-7619-426e-8be9-d6499c54a741 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:43.769758 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e75e083-7619-426e-8be9-d6499c54a741 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:43.825761 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-7e75e083-7619-426e-8be9-d6499c54a741 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] HTTP exception thrown: Instance 965438e3-72fa-44e0-90fa-4fb0b24042ff could not be found. Jul 25 12:46:43.831059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7e75e083-7619-426e-8be9-d6499c54a741 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Request method failure captured: Jul 25 12:46:43.831059 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff HTTP/1.1 Jul 25 12:46:43.831059 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:46:43.831059 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:46:43.831059 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:46:43.831059 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:46:43.831059 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:46:43.831059 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:46:43.831059 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:46:43.831059 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:43.831059 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pAEGoaUoxz2yBFfqqglYkxhIrYBVaOUaf3KcG2_RDuTsRrx4FuPhTlTS972SUpGcxEKbxzscMltNzIS1NNCmAvDeaF4upJy4B9WPFP2oLz_fsCXJn1EFVcHzee1AP2VmEgKVKFpZDZ0dcMYeFmbyrUVaGzpvhoi5im9ziBqG8vOObA Jul 25 12:46:43.831059 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:46:43.831059 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:46:43.831059 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:46:43.831059 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:46:43.831059 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:46:43.831059 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:46:43.831059 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: e7330b3757794c94b7cbd4ce6886c78d Jul 25 12:46:43.831059 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersAdminTestJSON-2021075583 Jul 25 12:46:43.831059 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:46:43.831059 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:46:43.832859 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e7330b3757794c94b7cbd4ce6886c78d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e7330b3757794c94b7cbd4ce6886c78d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e7330b3757794c94b7cbd4ce6886c78d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e7330b3757794c94b7cbd4ce6886c78d"}]}] Jul 25 12:46:43.832859 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersAdminTestJSON-2021075583 Jul 25 12:46:43.832859 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: e7330b3757794c94b7cbd4ce6886c78d Jul 25 12:46:43.832859 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersAdminTestJSON-2021075583 Jul 25 12:46:43.832859 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersAdminTestJSON-2021075583-project Jul 25 12:46:43.832859 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:46:43.832859 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:46:43.832859 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: e0f15b1174154d848d010e48b5df98db Jul 25 12:46:43.832859 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersAdminTestJSON-2021075583-project Jul 25 12:46:43.832859 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:46:43.832859 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 965438e3-72fa-44e0-90fa-4fb0b24042ff could not be found. Jul 25 12:46:43.832859 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '965438e3-72fa-44e0-90fa-4fb0b24042ff'} Jul 25 12:46:43.834021 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:43.834021 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:43.834021 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:46:43.834021 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:46:43.834021 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:46:43.834021 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:46:43.834021 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:46:43.834021 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:46:43.834021 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:46:43.834021 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:46:43.834021 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 965438e3-72fa-44e0-90fa-4fb0b24042ff could not be found. Jul 25 12:46:43.834021 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:43.834021 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:43.834021 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:43.834021 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:43.834021 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:43.834021 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:43.834021 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:43.834021 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:43.834021 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:43.836893 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:43.836893 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:46:43.836893 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:46:43.836893 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:46:43.836893 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:46:43.836893 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:46:43.836893 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:46:43.836893 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 965438e3-72fa-44e0-90fa-4fb0b24042ff could not be found. Jul 25 12:46:43.836893 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:43.836893 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:43.836893 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:43.836893 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:43.836893 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:43.836893 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:43.836893 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:43.836893 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:43.836893 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 965438e3-72fa-44e0-90fa-4fb0b24042ff could not be found. Jul 25 12:46:43.836893 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:43.840363 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7e75e083-7619-426e-8be9-d6499c54a741 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Returning 404 to user: Instance 965438e3-72fa-44e0-90fa-4fb0b24042ff could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:43.841660 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7e75e083-7619-426e-8be9-d6499c54a741 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff" status: 404 len: 111 microversion: 2.1 time: 0.097668 Jul 25 12:46:43.846028 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1122/2166] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:43 2022] GET /compute/v2.1/servers/965438e3-72fa-44e0-90fa-4fb0b24042ff => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:46:43.851704 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-6d12448d-8796-46e1-b7ab-7939f6e8dff2 req-b5b0c068-69ce-4d0e-b728-4b2b57aaed69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a09b0fac-fbdd-4e0d-83b5-4b0573183adb", "tag": "fe424d38-2c55-446d-8969-95ae660f2f4f"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:43.872448 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6d12448d-8796-46e1-b7ab-7939f6e8dff2 req-b5b0c068-69ce-4d0e-b728-4b2b57aaed69 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:43.874873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6d12448d-8796-46e1-b7ab-7939f6e8dff2 req-b5b0c068-69ce-4d0e-b728-4b2b57aaed69 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:43.904341 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-6d12448d-8796-46e1-b7ab-7939f6e8dff2 req-b5b0c068-69ce-4d0e-b728-4b2b57aaed69 service nova] Creating event network-changed:fe424d38-2c55-446d-8969-95ae660f2f4f for instance a09b0fac-fbdd-4e0d-83b5-4b0573183adb on n-h1-848886-15 Jul 25 12:46:43.920953 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-6d12448d-8796-46e1-b7ab-7939f6e8dff2 req-b5b0c068-69ce-4d0e-b728-4b2b57aaed69 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073123 Jul 25 12:46:43.923655 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1123/2167] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:43.942973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0104d424-8e81-46d9-aea9-a90aae3c00ae tempest-FloatingIPDetailsTestJSON-529319416 tempest-FloatingIPDetailsTestJSON-529319416-project] Calling method '.version_select at 0x7efcf9d678b0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:44.359364 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0104d424-8e81-46d9-aea9-a90aae3c00ae tempest-FloatingIPDetailsTestJSON-529319416 tempest-FloatingIPDetailsTestJSON-529319416-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.433379 Jul 25 12:46:44.367240 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1124/2168] 10.222.0.49 () {58 vars in 1164 bytes} [Mon Jul 25 12:46:43 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:46:44.374213 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f96c4848-e17b-4a72-af1c-3a5c72de714a tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:44.375213 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f96c4848-e17b-4a72-af1c-3a5c72de714a tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:44.382317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f96c4848-e17b-4a72-af1c-3a5c72de714a tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:44.393430 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f96c4848-e17b-4a72-af1c-3a5c72de714a tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:44.399528 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f96c4848-e17b-4a72-af1c-3a5c72de714a tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:44.400584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f96c4848-e17b-4a72-af1c-3a5c72de714a tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:44.404980 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f53e8739-ae1b-43ef-81e4-4d34c11ec5a6 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/b4f4617a-5bb9-41fe-8408-e0e6986e511a" status: 202 len: 0 microversion: 2.1 time: 1.297543 Jul 25 12:46:44.406139 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1045/2169] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:46:43 2022] DELETE /compute/v2.1/os-security-groups/b4f4617a-5bb9-41fe-8408-e0e6986e511a => generated 0 bytes in 1299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:46:44.418676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a10944bd-9115-4e96-8e97-2aa2dc7ae5ec tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:44.419636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a10944bd-9115-4e96-8e97-2aa2dc7ae5ec tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:44.429786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a10944bd-9115-4e96-8e97-2aa2dc7ae5ec tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:44.432744 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a10944bd-9115-4e96-8e97-2aa2dc7ae5ec tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:44.433886 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a10944bd-9115-4e96-8e97-2aa2dc7ae5ec tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:44.434592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a10944bd-9115-4e96-8e97-2aa2dc7ae5ec tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:44.474321 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f96c4848-e17b-4a72-af1c-3a5c72de714a tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:46:44.586066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:44.660575 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f96c4848-e17b-4a72-af1c-3a5c72de714a tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 204 len: 0 microversion: 2.1 time: 0.291386 Jul 25 12:46:44.661607 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1125/2170] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:46:44 2022] DELETE /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:46:44.681103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9772e01d-f607-4b79-9251-0782b50d8dc3 tempest-FloatingIPDetailsTestJSON-529319416 tempest-FloatingIPDetailsTestJSON-529319416-project] Calling method '.version_select at 0x7efcf9d67ca0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:45.317419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a10944bd-9115-4e96-8e97-2aa2dc7ae5ec tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8908d857fbae4fd49d6c8cd90529397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ce4c7d231540e29b9d66e0f8c276bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:45.325223 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a10944bd-9115-4e96-8e97-2aa2dc7ae5ec tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb" status: 200 len: 1366 microversion: 2.1 time: 0.917081 Jul 25 12:46:45.333313 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1046/2171] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:44 2022] GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb => generated 1366 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:45.338588 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6df8801b-511b-4d7f-8506-b91f2ca30c12 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcf9e0d670>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:45.751915 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9772e01d-f607-4b79-9251-0782b50d8dc3 tempest-FloatingIPDetailsTestJSON-529319416 tempest-FloatingIPDetailsTestJSON-529319416-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 1.078216 Jul 25 12:46:45.752501 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1126/2172] 10.222.0.49 () {58 vars in 1149 bytes} [Mon Jul 25 12:46:44 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:45.768211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3d55db6d-51c7-437b-91f9-c9b092b1fa7f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:45.768969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3d55db6d-51c7-437b-91f9-c9b092b1fa7f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:45.801456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3d55db6d-51c7-437b-91f9-c9b092b1fa7f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:45.802046 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3d55db6d-51c7-437b-91f9-c9b092b1fa7f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:45.802744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3d55db6d-51c7-437b-91f9-c9b092b1fa7f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:45.803189 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3d55db6d-51c7-437b-91f9-c9b092b1fa7f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:46.303543 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3d55db6d-51c7-437b-91f9-c9b092b1fa7f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:46.322418 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3d55db6d-51c7-437b-91f9-c9b092b1fa7f tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1469 microversion: 2.1 time: 0.559465 Jul 25 12:46:46.323030 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1127/2173] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:45 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1469 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:46.333990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-df81122a-263d-4331-9674-dc31d306815d tempest-FloatingIPDetailsTestJSON-529319416 tempest-FloatingIPDetailsTestJSON-529319416-project] Calling method '.version_select at 0x7efcfa240700>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:46.467559 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6df8801b-511b-4d7f-8506-b91f2ca30c12 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9" status: 202 len: 0 microversion: 2.1 time: 1.132676 Jul 25 12:46:46.468198 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1047/2174] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:46:45 2022] DELETE /compute/v2.1/os-security-groups/fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9 => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:46:46.476358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-48ad5e78-c912-4724-b7d6-0ffb6b60827a tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:46.476993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-48ad5e78-c912-4724-b7d6-0ffb6b60827a tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:46.495510 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48ad5e78-c912-4724-b7d6-0ffb6b60827a tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:46.495968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48ad5e78-c912-4724-b7d6-0ffb6b60827a tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:46.496978 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48ad5e78-c912-4724-b7d6-0ffb6b60827a tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:46.497657 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48ad5e78-c912-4724-b7d6-0ffb6b60827a tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:47.069337 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-48ad5e78-c912-4724-b7d6-0ffb6b60827a tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8908d857fbae4fd49d6c8cd90529397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ce4c7d231540e29b9d66e0f8c276bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:47.086582 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-48ad5e78-c912-4724-b7d6-0ffb6b60827a tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb" status: 200 len: 1366 microversion: 2.1 time: 0.615539 Jul 25 12:46:47.090379 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1048/2175] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:46 2022] GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb => generated 1366 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:47.112445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-78921e20-4547-4427-8d01-fc20f231b43d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Action: 'create', calling method: .version_select at 0x7efcf9e93ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1568501124", "description": "tempest-description-1196348312"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:47.981509 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-78921e20-4547-4427-8d01-fc20f231b43d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.889308 Jul 25 12:46:47.990644 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1049/2176] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:46:47 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:47.996225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-474c9e2b-e374-4632-ad6e-65d59ea2a347 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:47.998286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-474c9e2b-e374-4632-ad6e-65d59ea2a347 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:48.016406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-474c9e2b-e374-4632-ad6e-65d59ea2a347 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:48.021031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-474c9e2b-e374-4632-ad6e-65d59ea2a347 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:48.023250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-474c9e2b-e374-4632-ad6e-65d59ea2a347 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:48.023737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-474c9e2b-e374-4632-ad6e-65d59ea2a347 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:48.637679 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:48.664927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-474c9e2b-e374-4632-ad6e-65d59ea2a347 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f15b1174154d848d010e48b5df98db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7330b3757794c94b7cbd4ce6886c78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:48.685025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:48.690620 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-474c9e2b-e374-4632-ad6e-65d59ea2a347 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 200 len: 1427 microversion: 2.1 time: 0.698437 Jul 25 12:46:48.704771 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1050/2177] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:47 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 1427 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:48.711724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9baffcc0-ab52-4be0-a751-2fed92dfe0c0 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Action: 'update', calling method: .version_select at 0x7efcf96a1040>, body: {"security_group": {"name": "tempest-sg-hth-1811307414", "description": "tempest-description-hth-358682029"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:49.164697 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9baffcc0-ab52-4be0-a751-2fed92dfe0c0 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "PUT /compute/v2.1/os-security-groups/e78b6f41-2b2b-4c69-af39-7e1b7275e9cb" status: 200 len: 217 microversion: 2.1 time: 0.454253 Jul 25 12:46:49.164697 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1051/2178] 10.222.0.49 () {60 vars in 1290 bytes} [Mon Jul 25 12:46:48 2022] PUT /compute/v2.1/os-security-groups/e78b6f41-2b2b-4c69-af39-7e1b7275e9cb => generated 217 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:49.169289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fd69263c-8bbc-449b-87c1-2daedab25931 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:49.169289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fd69263c-8bbc-449b-87c1-2daedab25931 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:49.177878 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd69263c-8bbc-449b-87c1-2daedab25931 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:49.178497 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd69263c-8bbc-449b-87c1-2daedab25931 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:49.180452 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd69263c-8bbc-449b-87c1-2daedab25931 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:49.180452 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd69263c-8bbc-449b-87c1-2daedab25931 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:49.283013 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-df81122a-263d-4331-9674-dc31d306815d tempest-FloatingIPDetailsTestJSON-529319416 tempest-FloatingIPDetailsTestJSON-529319416-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/4c8c7d8a-b5d0-4db5-af53-ec908ea61f49" status: 202 len: 0 microversion: 2.1 time: 2.958339 Jul 25 12:46:49.287344 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1128/2179] 10.222.0.49 () {58 vars in 1263 bytes} [Mon Jul 25 12:46:46 2022] DELETE /compute/v2.1/os-floating-ips/4c8c7d8a-b5d0-4db5-af53-ec908ea61f49 => generated 0 bytes in 2963 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:46:49.295304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-22024f20-4ab0-4022-9fcd-55c9585fbb7c req-08e8fd20-f912-4692-852e-14d6b45adb62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6bb4f7e-67c3-4c86-8e69-92fd4061e26d", "name": "network-vif-deleted", "tag": "b55028ef-4d91-4ac2-a60c-3406cbca7db4"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:49.313874 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-22024f20-4ab0-4022-9fcd-55c9585fbb7c req-08e8fd20-f912-4692-852e-14d6b45adb62 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:49.314498 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-22024f20-4ab0-4022-9fcd-55c9585fbb7c req-08e8fd20-f912-4692-852e-14d6b45adb62 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:49.330122 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-22024f20-4ab0-4022-9fcd-55c9585fbb7c req-08e8fd20-f912-4692-852e-14d6b45adb62 service nova] Creating event network-vif-deleted:b55028ef-4d91-4ac2-a60c-3406cbca7db4 for instance c6bb4f7e-67c3-4c86-8e69-92fd4061e26d on n-h2-848886-15 Jul 25 12:46:49.343226 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-22024f20-4ab0-4022-9fcd-55c9585fbb7c req-08e8fd20-f912-4692-852e-14d6b45adb62 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054245 Jul 25 12:46:49.343840 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1129/2180] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:49.352305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-83e524d4-1eff-470d-a627-4f5a2eebcac7 req-96fb9ed7-2644-4162-b814-e52fceb5d91a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a09b0fac-fbdd-4e0d-83b5-4b0573183adb", "name": "network-vif-plugged", "status": "completed", "tag": "fe424d38-2c55-446d-8969-95ae660f2f4f"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:49.364765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-83e524d4-1eff-470d-a627-4f5a2eebcac7 req-96fb9ed7-2644-4162-b814-e52fceb5d91a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:49.365237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-83e524d4-1eff-470d-a627-4f5a2eebcac7 req-96fb9ed7-2644-4162-b814-e52fceb5d91a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:49.391921 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-83e524d4-1eff-470d-a627-4f5a2eebcac7 req-96fb9ed7-2644-4162-b814-e52fceb5d91a service nova] Creating event network-vif-plugged:fe424d38-2c55-446d-8969-95ae660f2f4f for instance a09b0fac-fbdd-4e0d-83b5-4b0573183adb on n-h1-848886-15 Jul 25 12:46:49.403501 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-83e524d4-1eff-470d-a627-4f5a2eebcac7 req-96fb9ed7-2644-4162-b814-e52fceb5d91a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055715 Jul 25 12:46:49.404632 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1130/2181] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:49.412319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0979032d-b78c-4a00-a795-444f2b8288ee tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcf92f4430>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:49.437491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fd69263c-8bbc-449b-87c1-2daedab25931 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8908d857fbae4fd49d6c8cd90529397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ce4c7d231540e29b9d66e0f8c276bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:49.447119 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fd69263c-8bbc-449b-87c1-2daedab25931 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb" status: 200 len: 1366 microversion: 2.1 time: 0.293895 Jul 25 12:46:49.450135 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1052/2182] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:49 2022] GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:49.458043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a44ccb1c-68d6-4b4b-a849-5556dd93aac4 tempest-FloatingIPDetailsTestJSON-529319416 tempest-FloatingIPDetailsTestJSON-529319416-project] Calling method '.version_select at 0x7efcf97a3160>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:49.526779 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0979032d-b78c-4a00-a795-444f2b8288ee tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/e78b6f41-2b2b-4c69-af39-7e1b7275e9cb" status: 200 len: 217 microversion: 2.1 time: 0.120789 Jul 25 12:46:49.528519 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1131/2183] 10.222.0.49 () {58 vars in 1269 bytes} [Mon Jul 25 12:46:49 2022] GET /compute/v2.1/os-security-groups/e78b6f41-2b2b-4c69-af39-7e1b7275e9cb => generated 217 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:49.547465 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2b399da2-1583-439c-bb0e-90c8af194ebf tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcfa240ee0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:49.559395 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:50.144186 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2b399da2-1583-439c-bb0e-90c8af194ebf tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/e78b6f41-2b2b-4c69-af39-7e1b7275e9cb" status: 202 len: 0 microversion: 2.1 time: 0.601130 Jul 25 12:46:50.145019 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1132/2184] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:46:49 2022] DELETE /compute/v2.1/os-security-groups/e78b6f41-2b2b-4c69-af39-7e1b7275e9cb => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:46:50.150085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2567f168-6faf-4c91-8458-637d5754b902 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:50.151151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2567f168-6faf-4c91-8458-637d5754b902 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] [instance: c6bb4f7e-67c3-4c86-8e69-92fd4061e26d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:50.159078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2567f168-6faf-4c91-8458-637d5754b902 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:50.159837 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2567f168-6faf-4c91-8458-637d5754b902 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:50.161059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2567f168-6faf-4c91-8458-637d5754b902 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:50.161716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2567f168-6faf-4c91-8458-637d5754b902 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:50.180986 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-2567f168-6faf-4c91-8458-637d5754b902 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] HTTP exception thrown: Instance c6bb4f7e-67c3-4c86-8e69-92fd4061e26d could not be found. Jul 25 12:46:50.183153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2567f168-6faf-4c91-8458-637d5754b902 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Request method failure captured: Jul 25 12:46:50.183153 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d HTTP/1.1 Jul 25 12:46:50.183153 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:46:50.183153 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:46:50.183153 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:46:50.183153 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:46:50.183153 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:46:50.183153 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:46:50.183153 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:46:50.183153 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:50.183153 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pAEGoaUoxz2yBFfqqglYkxhIrYBVaOUaf3KcG2_RDuTsRrx4FuPhTlTS972SUpGcxEKbxzscMltNzIS1NNCmAvDeaF4upJy4B9WPFP2oLz_fsCXJn1EFVcHzee1AP2VmEgKVKFpZDZ0dcMYeFmbyrUVaGzpvhoi5im9ziBqG8vOObA Jul 25 12:46:50.183153 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:46:50.183153 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:46:50.183153 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:46:50.183153 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:46:50.183153 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:46:50.183153 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:46:50.183153 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: e7330b3757794c94b7cbd4ce6886c78d Jul 25 12:46:50.183153 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersAdminTestJSON-2021075583 Jul 25 12:46:50.183153 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:46:50.183153 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:46:50.184370 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e7330b3757794c94b7cbd4ce6886c78d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e7330b3757794c94b7cbd4ce6886c78d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e7330b3757794c94b7cbd4ce6886c78d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e7330b3757794c94b7cbd4ce6886c78d"}]}] Jul 25 12:46:50.184370 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersAdminTestJSON-2021075583 Jul 25 12:46:50.184370 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: e7330b3757794c94b7cbd4ce6886c78d Jul 25 12:46:50.184370 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersAdminTestJSON-2021075583 Jul 25 12:46:50.184370 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersAdminTestJSON-2021075583-project Jul 25 12:46:50.184370 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:46:50.184370 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:46:50.184370 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: e0f15b1174154d848d010e48b5df98db Jul 25 12:46:50.184370 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersAdminTestJSON-2021075583-project Jul 25 12:46:50.184370 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:46:50.184370 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance c6bb4f7e-67c3-4c86-8e69-92fd4061e26d could not be found. Jul 25 12:46:50.184370 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'c6bb4f7e-67c3-4c86-8e69-92fd4061e26d'} Jul 25 12:46:50.185527 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:50.185527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.185527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:46:50.185527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:46:50.185527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:46:50.185527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:46:50.185527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:46:50.185527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:46:50.185527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:46:50.185527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:46:50.185527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6bb4f7e-67c3-4c86-8e69-92fd4061e26d could not be found. Jul 25 12:46:50.185527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.185527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:50.185527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.185527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.185527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:50.185527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:50.185527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:50.185527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:50.185527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:50.186483 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:50.186483 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:46:50.186483 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:46:50.186483 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:46:50.186483 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:46:50.186483 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:46:50.186483 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:46:50.186483 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6bb4f7e-67c3-4c86-8e69-92fd4061e26d could not be found. Jul 25 12:46:50.186483 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.186483 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:50.186483 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.186483 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.186483 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:50.186483 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:50.186483 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:50.186483 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:50.186483 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6bb4f7e-67c3-4c86-8e69-92fd4061e26d could not be found. Jul 25 12:46:50.186483 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.187277 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2567f168-6faf-4c91-8458-637d5754b902 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] Returning 404 to user: Instance c6bb4f7e-67c3-4c86-8e69-92fd4061e26d could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:50.187277 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2567f168-6faf-4c91-8458-637d5754b902 tempest-ServersAdminTestJSON-2021075583 tempest-ServersAdminTestJSON-2021075583-project] 10.222.0.49 "GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d" status: 404 len: 111 microversion: 2.1 time: 0.038994 Jul 25 12:46:50.189221 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1133/2185] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:50 2022] GET /compute/v2.1/servers/c6bb4f7e-67c3-4c86-8e69-92fd4061e26d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:46:50.194745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fa3c7fa2-c387-4d04-862e-886440b3c0c9 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:50.195553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fa3c7fa2-c387-4d04-862e-886440b3c0c9 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:50.202780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa3c7fa2-c387-4d04-862e-886440b3c0c9 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:50.203541 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa3c7fa2-c387-4d04-862e-886440b3c0c9 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:50.204690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa3c7fa2-c387-4d04-862e-886440b3c0c9 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:50.205607 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa3c7fa2-c387-4d04-862e-886440b3c0c9 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:50.226864 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-fa3c7fa2-c387-4d04-862e-886440b3c0c9 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] HTTP exception thrown: Instance 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 could not be found. Jul 25 12:46:50.229115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fa3c7fa2-c387-4d04-862e-886440b3c0c9 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Request method failure captured: Jul 25 12:46:50.229115 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 HTTP/1.1 Jul 25 12:46:50.229115 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:46:50.229115 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:46:50.229115 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:46:50.229115 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:46:50.229115 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:46:50.229115 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:46:50.229115 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:46:50.229115 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:50.229115 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pBMnvMCkXPIxtXS4OZUlYvEfqLzk8eVB6uOa00GC7XzG0Qi-IKZscbMEZM1xj3l2F-5d5lIAdtnOADbgV21wrMS4dvC7LWzHzoCd7ieXebifkHeaO9Mp4wm9vR5m7HEh9yMTTXFHMqap1mzBebGWb33cT_Byxbl27G3bMxoNj8QlS0 Jul 25 12:46:50.229115 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:46:50.229115 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:46:50.229115 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:46:50.229115 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:46:50.229115 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:46:50.229115 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:46:50.229115 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:50.229115 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:50.229115 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:46:50.229115 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:46:50.230196 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8514497475b8462b86e28d48a16b0b20", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}] Jul 25 12:46:50.230196 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:50.230196 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:50.230196 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:50.230196 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:50.230196 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:46:50.230196 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:46:50.230196 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 3912af6bdd224191910f72160c42db30 Jul 25 12:46:50.230196 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:50.230196 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:46:50.230196 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 could not be found. Jul 25 12:46:50.230196 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '9f541b63-ccc7-488a-b5a4-8ee5b0f5e682'} Jul 25 12:46:50.230756 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:50.230756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.230756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:46:50.230756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:46:50.230756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:46:50.230756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:46:50.230756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:46:50.230756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:46:50.230756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:46:50.230756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:46:50.230756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 could not be found. Jul 25 12:46:50.230756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.230756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:50.230756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.230756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.230756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:50.230756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:50.230756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:50.230756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:50.230756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:50.232141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:50.232141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:46:50.232141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:46:50.232141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:46:50.232141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:46:50.232141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:46:50.232141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:46:50.232141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:46:50.232141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:46:50.232141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 could not be found. Jul 25 12:46:50.232141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.232141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:50.232141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.232141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.232141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:50.232141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:50.232141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:50.232141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:50.232141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 could not be found. Jul 25 12:46:50.232141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.234802 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fa3c7fa2-c387-4d04-862e-886440b3c0c9 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Returning 404 to user: Instance 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:50.235909 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fa3c7fa2-c387-4d04-862e-886440b3c0c9 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 404 len: 111 microversion: 2.1 time: 0.045231 Jul 25 12:46:50.236620 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1134/2186] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:46:50 2022] DELETE /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:46:50.246964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cb093190-7376-4bd0-96da-78ae81d95300 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:50.248056 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cb093190-7376-4bd0-96da-78ae81d95300 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:50.255015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb093190-7376-4bd0-96da-78ae81d95300 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:50.255642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb093190-7376-4bd0-96da-78ae81d95300 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:50.256572 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb093190-7376-4bd0-96da-78ae81d95300 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:50.257013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb093190-7376-4bd0-96da-78ae81d95300 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:50.272654 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-cb093190-7376-4bd0-96da-78ae81d95300 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] HTTP exception thrown: Instance 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 could not be found. Jul 25 12:46:50.274414 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cb093190-7376-4bd0-96da-78ae81d95300 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Request method failure captured: Jul 25 12:46:50.274414 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 HTTP/1.1 Jul 25 12:46:50.274414 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:46:50.274414 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:46:50.274414 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:46:50.274414 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:46:50.274414 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:46:50.274414 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:46:50.274414 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:46:50.274414 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:50.274414 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pBMnvMCkXPIxtXS4OZUlYvEfqLzk8eVB6uOa00GC7XzG0Qi-IKZscbMEZM1xj3l2F-5d5lIAdtnOADbgV21wrMS4dvC7LWzHzoCd7ieXebifkHeaO9Mp4wm9vR5m7HEh9yMTTXFHMqap1mzBebGWb33cT_Byxbl27G3bMxoNj8QlS0 Jul 25 12:46:50.274414 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:46:50.274414 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:46:50.274414 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:46:50.274414 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:46:50.274414 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:46:50.274414 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:46:50.274414 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:50.274414 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:50.274414 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:46:50.274414 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:46:50.275363 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8514497475b8462b86e28d48a16b0b20", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}] Jul 25 12:46:50.275363 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:50.275363 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:50.275363 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:50.275363 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:50.275363 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:46:50.275363 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:46:50.275363 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 3912af6bdd224191910f72160c42db30 Jul 25 12:46:50.275363 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:50.275363 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:46:50.275363 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 could not be found. Jul 25 12:46:50.275363 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '9f541b63-ccc7-488a-b5a4-8ee5b0f5e682'} Jul 25 12:46:50.275915 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:50.275915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.275915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:46:50.275915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:46:50.275915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:46:50.275915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:46:50.275915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:46:50.275915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:46:50.275915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:46:50.275915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:46:50.275915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 could not be found. Jul 25 12:46:50.275915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.275915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:50.275915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.275915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.275915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:50.275915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:50.275915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:50.275915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:50.275915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:50.276768 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:50.276768 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:46:50.276768 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:46:50.276768 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:46:50.276768 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:46:50.276768 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:46:50.276768 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:46:50.276768 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 could not be found. Jul 25 12:46:50.276768 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.276768 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:50.276768 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.276768 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.276768 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:50.276768 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:50.276768 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:50.276768 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:50.276768 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 could not be found. Jul 25 12:46:50.276768 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.277573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cb093190-7376-4bd0-96da-78ae81d95300 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Returning 404 to user: Instance 9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:50.277573 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cb093190-7376-4bd0-96da-78ae81d95300 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682" status: 404 len: 111 microversion: 2.1 time: 0.034834 Jul 25 12:46:50.280739 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1135/2187] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:50 2022] GET /compute/v2.1/servers/9f541b63-ccc7-488a-b5a4-8ee5b0f5e682 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:46:50.289754 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1cee28ce-c48f-4c69-85df-228819d2138e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcfa0a60d0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:50.327438 n-d-848886-15 devstack@n-api.service[125884]: DEBUG neutronclient.v2_0.client [None req-1cee28ce-c48f-4c69-85df-228819d2138e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9 does not exist", "detail": ""}} {{(pid=125884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:46:50.328046 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.security_group_api [None req-1cee28ce-c48f-4c69-85df-228819d2138e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Neutron security group fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9 not found {{(pid=125884) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 12:46:50.329605 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-1cee28ce-c48f-4c69-85df-228819d2138e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] HTTP exception thrown: Security group fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9 does not exist Jul 25 12:46:50.329605 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-ae3cbe0e-5f04-4e88-a955-aace0a523390'] Jul 25 12:46:50.338147 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1cee28ce-c48f-4c69-85df-228819d2138e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Request method failure captured: Jul 25 12:46:50.338147 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/os-security-groups/fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9 HTTP/1.1 Jul 25 12:46:50.338147 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:46:50.338147 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:46:50.338147 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:46:50.338147 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:46:50.338147 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:46:50.338147 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:46:50.338147 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:46:50.338147 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:50.338147 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pBMnvMCkXPIxtXS4OZUlYvEfqLzk8eVB6uOa00GC7XzG0Qi-IKZscbMEZM1xj3l2F-5d5lIAdtnOADbgV21wrMS4dvC7LWzHzoCd7ieXebifkHeaO9Mp4wm9vR5m7HEh9yMTTXFHMqap1mzBebGWb33cT_Byxbl27G3bMxoNj8QlS0 Jul 25 12:46:50.338147 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:46:50.338147 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:46:50.338147 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:46:50.338147 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:46:50.338147 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:46:50.338147 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:46:50.338147 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:50.338147 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:50.338147 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:46:50.338147 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:46:50.339203 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8514497475b8462b86e28d48a16b0b20", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}] Jul 25 12:46:50.339203 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:50.339203 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:50.339203 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:50.339203 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:50.339203 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:46:50.339203 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:46:50.339203 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 3912af6bdd224191910f72160c42db30 Jul 25 12:46:50.339203 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:50.339203 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:46:50.339203 n-d-848886-15 devstack@n-api.service[125884]: exception: Security group fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9 does not exist Jul 25 12:46:50.339203 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-ae3cbe0e-5f04-4e88-a955-aace0a523390'] Jul 25 12:46:50.339203 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9'} Jul 25 12:46:50.339772 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:50.339772 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.339772 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 12:46:50.339772 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 12:46:50.339772 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:50.339772 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:50.339772 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 12:46:50.339772 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 12:46:50.339772 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:50.339772 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:50.339772 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 12:46:50.339772 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 12:46:50.339772 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:50.339772 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:50.339772 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:46:50.339772 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:46:50.339772 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:50.339772 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:50.339772 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:46:50.341038 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:46:50.341038 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:50.341038 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:50.341038 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:46:50.341038 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:46:50.341038 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:46:50.341038 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:46:50.341038 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9 does not exist Jul 25 12:46:50.341038 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae3cbe0e-5f04-4e88-a955-aace0a523390'] Jul 25 12:46:50.341038 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.341038 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:50.341038 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.341038 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.341038 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 12:46:50.341038 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 12:46:50.341038 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 12:46:50.341038 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 12:46:50.341038 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9 does not exist Jul 25 12:46:50.341991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae3cbe0e-5f04-4e88-a955-aace0a523390'] Jul 25 12:46:50.341991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.341991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:50.341991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.341991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.341991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:50.341991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:50.341991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:50.341991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:50.341991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:46:50.341991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:46:50.341991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:50.341991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:50.341991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 12:46:50.341991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 12:46:50.341991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9 does not exist Jul 25 12:46:50.341991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae3cbe0e-5f04-4e88-a955-aace0a523390'] Jul 25 12:46:50.341991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.341991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:50.341991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.341991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.343064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:50.343064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:50.343064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:50.343064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:50.343064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9 does not exist Jul 25 12:46:50.343064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae3cbe0e-5f04-4e88-a955-aace0a523390'] Jul 25 12:46:50.343064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.347250 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1cee28ce-c48f-4c69-85df-228819d2138e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Returning 404 to user: Security group fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9 does not exist Jul 25 12:46:50.347250 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-ae3cbe0e-5f04-4e88-a955-aace0a523390'] {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:50.350303 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1cee28ce-c48f-4c69-85df-228819d2138e tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9" status: 404 len: 194 microversion: 2.1 time: 0.068254 Jul 25 12:46:50.352587 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1136/2188] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:46:50 2022] DELETE /compute/v2.1/os-security-groups/fbaa8864-61a0-42d7-bd7d-b25ddbc6dcf9 => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:46:50.365042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0b285365-2c32-478b-bf4e-433a9eb777b8 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcf9d67f70>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:50.446767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG neutronclient.v2_0.client [None req-0b285365-2c32-478b-bf4e-433a9eb777b8 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b4f4617a-5bb9-41fe-8408-e0e6986e511a does not exist", "detail": ""}} {{(pid=125884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:46:50.447614 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.security_group_api [None req-0b285365-2c32-478b-bf4e-433a9eb777b8 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Neutron security group b4f4617a-5bb9-41fe-8408-e0e6986e511a not found {{(pid=125884) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 12:46:50.448509 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-0b285365-2c32-478b-bf4e-433a9eb777b8 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] HTTP exception thrown: Security group b4f4617a-5bb9-41fe-8408-e0e6986e511a does not exist Jul 25 12:46:50.448509 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-3c7f944c-5b36-4000-80b0-f3aa60188777'] Jul 25 12:46:50.451304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0b285365-2c32-478b-bf4e-433a9eb777b8 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Request method failure captured: Jul 25 12:46:50.451304 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/os-security-groups/b4f4617a-5bb9-41fe-8408-e0e6986e511a HTTP/1.1 Jul 25 12:46:50.451304 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:46:50.451304 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:46:50.451304 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:46:50.451304 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:46:50.451304 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:46:50.451304 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:46:50.451304 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:46:50.451304 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:50.451304 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pBMnvMCkXPIxtXS4OZUlYvEfqLzk8eVB6uOa00GC7XzG0Qi-IKZscbMEZM1xj3l2F-5d5lIAdtnOADbgV21wrMS4dvC7LWzHzoCd7ieXebifkHeaO9Mp4wm9vR5m7HEh9yMTTXFHMqap1mzBebGWb33cT_Byxbl27G3bMxoNj8QlS0 Jul 25 12:46:50.451304 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:46:50.451304 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:46:50.451304 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:46:50.451304 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:46:50.451304 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:46:50.451304 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:46:50.451304 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:50.451304 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:50.451304 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:46:50.451304 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:46:50.452375 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8514497475b8462b86e28d48a16b0b20", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}] Jul 25 12:46:50.452375 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:50.452375 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:50.452375 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:50.452375 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:50.452375 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:46:50.452375 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:46:50.452375 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 3912af6bdd224191910f72160c42db30 Jul 25 12:46:50.452375 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:50.452375 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:46:50.452375 n-d-848886-15 devstack@n-api.service[125884]: exception: Security group b4f4617a-5bb9-41fe-8408-e0e6986e511a does not exist Jul 25 12:46:50.452375 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-3c7f944c-5b36-4000-80b0-f3aa60188777'] Jul 25 12:46:50.452375 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'b4f4617a-5bb9-41fe-8408-e0e6986e511a'} Jul 25 12:46:50.452954 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:50.452954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.452954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 12:46:50.452954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 12:46:50.452954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:50.452954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:50.452954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 12:46:50.452954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 12:46:50.452954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:50.452954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:50.452954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 12:46:50.452954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 12:46:50.452954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:50.452954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:50.452954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:46:50.452954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:46:50.452954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:50.452954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:50.452954 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:46:50.453776 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:46:50.453776 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:50.453776 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:50.453776 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:46:50.453776 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:46:50.453776 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:46:50.453776 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:46:50.453776 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b4f4617a-5bb9-41fe-8408-e0e6986e511a does not exist Jul 25 12:46:50.453776 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c7f944c-5b36-4000-80b0-f3aa60188777'] Jul 25 12:46:50.453776 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.453776 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:50.453776 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.453776 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.453776 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 12:46:50.453776 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 12:46:50.453776 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 12:46:50.453776 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 12:46:50.453776 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b4f4617a-5bb9-41fe-8408-e0e6986e511a does not exist Jul 25 12:46:50.455142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c7f944c-5b36-4000-80b0-f3aa60188777'] Jul 25 12:46:50.455142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.455142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:50.455142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.455142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.455142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:50.455142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:50.455142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:50.455142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:50.455142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:46:50.455142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:46:50.455142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:50.455142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:50.455142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 12:46:50.455142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 12:46:50.455142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b4f4617a-5bb9-41fe-8408-e0e6986e511a does not exist Jul 25 12:46:50.455142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c7f944c-5b36-4000-80b0-f3aa60188777'] Jul 25 12:46:50.455142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.455142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:50.455142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.455142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.456572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:50.456572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:50.456572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:50.456572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:50.456572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b4f4617a-5bb9-41fe-8408-e0e6986e511a does not exist Jul 25 12:46:50.456572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c7f944c-5b36-4000-80b0-f3aa60188777'] Jul 25 12:46:50.456572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.456572 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0b285365-2c32-478b-bf4e-433a9eb777b8 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Returning 404 to user: Security group b4f4617a-5bb9-41fe-8408-e0e6986e511a does not exist Jul 25 12:46:50.456572 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-3c7f944c-5b36-4000-80b0-f3aa60188777'] {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:50.458953 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0b285365-2c32-478b-bf4e-433a9eb777b8 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/b4f4617a-5bb9-41fe-8408-e0e6986e511a" status: 404 len: 194 microversion: 2.1 time: 0.099710 Jul 25 12:46:50.460165 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1137/2189] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:46:50 2022] DELETE /compute/v2.1/os-security-groups/b4f4617a-5bb9-41fe-8408-e0e6986e511a => generated 194 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:46:50.474513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5bea0a86-1880-4f96-a4c6-21a5710c6c51 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcf92f4d30>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:50.528560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG neutronclient.v2_0.client [None req-5bea0a86-1880-4f96-a4c6-21a5710c6c51 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d849702a-28a2-443a-b77b-c8a812531402 does not exist", "detail": ""}} {{(pid=125884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:46:50.529372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.security_group_api [None req-5bea0a86-1880-4f96-a4c6-21a5710c6c51 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Neutron security group d849702a-28a2-443a-b77b-c8a812531402 not found {{(pid=125884) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 12:46:50.530134 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-5bea0a86-1880-4f96-a4c6-21a5710c6c51 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] HTTP exception thrown: Security group d849702a-28a2-443a-b77b-c8a812531402 does not exist Jul 25 12:46:50.530134 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-6a4630cd-341e-4a76-8624-3157bc44af12'] Jul 25 12:46:50.533250 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5bea0a86-1880-4f96-a4c6-21a5710c6c51 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Request method failure captured: Jul 25 12:46:50.533250 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/os-security-groups/d849702a-28a2-443a-b77b-c8a812531402 HTTP/1.1 Jul 25 12:46:50.533250 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:46:50.533250 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:46:50.533250 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:46:50.533250 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:46:50.533250 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:46:50.533250 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:46:50.533250 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:46:50.533250 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:50.533250 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pBMnvMCkXPIxtXS4OZUlYvEfqLzk8eVB6uOa00GC7XzG0Qi-IKZscbMEZM1xj3l2F-5d5lIAdtnOADbgV21wrMS4dvC7LWzHzoCd7ieXebifkHeaO9Mp4wm9vR5m7HEh9yMTTXFHMqap1mzBebGWb33cT_Byxbl27G3bMxoNj8QlS0 Jul 25 12:46:50.533250 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:46:50.533250 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:46:50.533250 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:46:50.533250 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:46:50.533250 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:46:50.533250 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:46:50.533250 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:50.533250 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:50.533250 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:46:50.533250 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:46:50.534319 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8514497475b8462b86e28d48a16b0b20", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}] Jul 25 12:46:50.534319 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:50.534319 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:50.534319 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:50.534319 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:50.534319 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:46:50.534319 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:46:50.534319 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 3912af6bdd224191910f72160c42db30 Jul 25 12:46:50.534319 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:50.534319 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:46:50.534319 n-d-848886-15 devstack@n-api.service[125884]: exception: Security group d849702a-28a2-443a-b77b-c8a812531402 does not exist Jul 25 12:46:50.534319 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-6a4630cd-341e-4a76-8624-3157bc44af12'] Jul 25 12:46:50.534319 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'd849702a-28a2-443a-b77b-c8a812531402'} Jul 25 12:46:50.534919 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:50.534919 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.534919 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 12:46:50.534919 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 12:46:50.534919 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:50.534919 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:50.534919 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 12:46:50.534919 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 12:46:50.534919 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:50.534919 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:50.534919 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 12:46:50.534919 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 12:46:50.534919 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:50.534919 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:50.534919 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:46:50.534919 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:46:50.534919 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:50.534919 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:50.534919 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:46:50.535749 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:46:50.535749 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:50.535749 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:50.535749 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:46:50.535749 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:46:50.535749 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:46:50.535749 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:46:50.535749 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d849702a-28a2-443a-b77b-c8a812531402 does not exist Jul 25 12:46:50.535749 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a4630cd-341e-4a76-8624-3157bc44af12'] Jul 25 12:46:50.535749 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.535749 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:50.535749 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.535749 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.535749 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 12:46:50.535749 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 12:46:50.535749 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 12:46:50.535749 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 12:46:50.535749 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d849702a-28a2-443a-b77b-c8a812531402 does not exist Jul 25 12:46:50.536539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a4630cd-341e-4a76-8624-3157bc44af12'] Jul 25 12:46:50.536539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.536539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:50.536539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.536539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.536539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:50.536539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:50.536539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:50.536539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:50.536539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:46:50.536539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:46:50.536539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:50.536539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:50.536539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 12:46:50.536539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 12:46:50.536539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d849702a-28a2-443a-b77b-c8a812531402 does not exist Jul 25 12:46:50.536539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a4630cd-341e-4a76-8624-3157bc44af12'] Jul 25 12:46:50.536539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.536539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:50.536539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.536539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.537442 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:50.537442 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:50.537442 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:50.537442 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:50.537442 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d849702a-28a2-443a-b77b-c8a812531402 does not exist Jul 25 12:46:50.537442 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a4630cd-341e-4a76-8624-3157bc44af12'] Jul 25 12:46:50.537442 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.539530 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5bea0a86-1880-4f96-a4c6-21a5710c6c51 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Returning 404 to user: Security group d849702a-28a2-443a-b77b-c8a812531402 does not exist Jul 25 12:46:50.539530 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-6a4630cd-341e-4a76-8624-3157bc44af12'] {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:50.540648 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5bea0a86-1880-4f96-a4c6-21a5710c6c51 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/d849702a-28a2-443a-b77b-c8a812531402" status: 404 len: 194 microversion: 2.1 time: 0.076399 Jul 25 12:46:50.542202 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1138/2190] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:46:50 2022] DELETE /compute/v2.1/os-security-groups/d849702a-28a2-443a-b77b-c8a812531402 => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:46:50.548091 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b4d39659-8f64-46b3-9ecb-5ba11308c4aa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:50.554926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b4d39659-8f64-46b3-9ecb-5ba11308c4aa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:50.570500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4d39659-8f64-46b3-9ecb-5ba11308c4aa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:50.571355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4d39659-8f64-46b3-9ecb-5ba11308c4aa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:50.572583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4d39659-8f64-46b3-9ecb-5ba11308c4aa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:50.573199 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4d39659-8f64-46b3-9ecb-5ba11308c4aa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:50.608227 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a44ccb1c-68d6-4b4b-a849-5556dd93aac4 tempest-FloatingIPDetailsTestJSON-529319416 tempest-FloatingIPDetailsTestJSON-529319416-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/17c7ee00-10a3-4e91-9660-20676f72e986" status: 202 len: 0 microversion: 2.1 time: 1.153519 Jul 25 12:46:50.612905 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1053/2191] 10.222.0.49 () {58 vars in 1263 bytes} [Mon Jul 25 12:46:49 2022] DELETE /compute/v2.1/os-floating-ips/17c7ee00-10a3-4e91-9660-20676f72e986 => generated 0 bytes in 1159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:46:50.619554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e0307149-ebd6-425a-98bc-f61a0863650b tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcf96a1dc0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:50.650289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG neutronclient.v2_0.client [None req-e0307149-ebd6-425a-98bc-f61a0863650b tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c86400ef-e7e7-4bf3-99eb-5dc4187d31b4 does not exist", "detail": ""}} {{(pid=125883) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:46:50.651125 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.security_group_api [None req-e0307149-ebd6-425a-98bc-f61a0863650b tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Neutron security group c86400ef-e7e7-4bf3-99eb-5dc4187d31b4 not found {{(pid=125883) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 12:46:50.652193 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-e0307149-ebd6-425a-98bc-f61a0863650b tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] HTTP exception thrown: Security group c86400ef-e7e7-4bf3-99eb-5dc4187d31b4 does not exist Jul 25 12:46:50.652193 n-d-848886-15 devstack@n-api.service[125883]: Neutron server returns request_ids: ['req-cd7e1210-ff12-48d9-aff5-6c49e1542032'] Jul 25 12:46:50.655360 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e0307149-ebd6-425a-98bc-f61a0863650b tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Request method failure captured: Jul 25 12:46:50.655360 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/os-security-groups/c86400ef-e7e7-4bf3-99eb-5dc4187d31b4 HTTP/1.1 Jul 25 12:46:50.655360 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:46:50.655360 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:46:50.655360 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:46:50.655360 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:46:50.655360 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:46:50.655360 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:46:50.655360 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:46:50.655360 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:50.655360 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pBMnvMCkXPIxtXS4OZUlYvEfqLzk8eVB6uOa00GC7XzG0Qi-IKZscbMEZM1xj3l2F-5d5lIAdtnOADbgV21wrMS4dvC7LWzHzoCd7ieXebifkHeaO9Mp4wm9vR5m7HEh9yMTTXFHMqap1mzBebGWb33cT_Byxbl27G3bMxoNj8QlS0 Jul 25 12:46:50.655360 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:46:50.655360 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:46:50.655360 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:46:50.655360 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:46:50.655360 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:46:50.655360 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:46:50.655360 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:50.655360 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:50.655360 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:46:50.655360 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:46:50.656560 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8514497475b8462b86e28d48a16b0b20", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}] Jul 25 12:46:50.656560 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:50.656560 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:50.656560 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:50.656560 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:50.656560 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:46:50.656560 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:46:50.656560 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 3912af6bdd224191910f72160c42db30 Jul 25 12:46:50.656560 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:50.656560 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:46:50.656560 n-d-848886-15 devstack@n-api.service[125883]: exception: Security group c86400ef-e7e7-4bf3-99eb-5dc4187d31b4 does not exist Jul 25 12:46:50.656560 n-d-848886-15 devstack@n-api.service[125883]: Neutron server returns request_ids: ['req-cd7e1210-ff12-48d9-aff5-6c49e1542032'] Jul 25 12:46:50.656560 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'c86400ef-e7e7-4bf3-99eb-5dc4187d31b4'} Jul 25 12:46:50.657298 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:50.657298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.657298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 12:46:50.657298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 12:46:50.657298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:50.657298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:50.657298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 12:46:50.657298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 12:46:50.657298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:50.657298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:50.657298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 12:46:50.657298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 12:46:50.657298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:50.657298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:50.657298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:46:50.657298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:46:50.657298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:50.657298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:50.657298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:46:50.658384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:46:50.658384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:50.658384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:50.658384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:46:50.658384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:46:50.658384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:46:50.658384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:46:50.658384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c86400ef-e7e7-4bf3-99eb-5dc4187d31b4 does not exist Jul 25 12:46:50.658384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd7e1210-ff12-48d9-aff5-6c49e1542032'] Jul 25 12:46:50.658384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.658384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:50.658384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.658384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.658384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 12:46:50.658384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 12:46:50.658384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 12:46:50.658384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 12:46:50.658384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c86400ef-e7e7-4bf3-99eb-5dc4187d31b4 does not exist Jul 25 12:46:50.660095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd7e1210-ff12-48d9-aff5-6c49e1542032'] Jul 25 12:46:50.660095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.660095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:50.660095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.660095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.660095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:50.660095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:50.660095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:50.660095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:50.660095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:46:50.660095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:46:50.660095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:50.660095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:50.660095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 12:46:50.660095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 12:46:50.660095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c86400ef-e7e7-4bf3-99eb-5dc4187d31b4 does not exist Jul 25 12:46:50.660095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd7e1210-ff12-48d9-aff5-6c49e1542032'] Jul 25 12:46:50.660095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.660095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:50.660095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.660095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:50.662272 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:50.662272 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:50.662272 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:50.662272 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:50.662272 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c86400ef-e7e7-4bf3-99eb-5dc4187d31b4 does not exist Jul 25 12:46:50.662272 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd7e1210-ff12-48d9-aff5-6c49e1542032'] Jul 25 12:46:50.662272 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:50.662272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e0307149-ebd6-425a-98bc-f61a0863650b tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Returning 404 to user: Security group c86400ef-e7e7-4bf3-99eb-5dc4187d31b4 does not exist Jul 25 12:46:50.662272 n-d-848886-15 devstack@n-api.service[125883]: Neutron server returns request_ids: ['req-cd7e1210-ff12-48d9-aff5-6c49e1542032'] {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:50.663340 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e0307149-ebd6-425a-98bc-f61a0863650b tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/c86400ef-e7e7-4bf3-99eb-5dc4187d31b4" status: 404 len: 194 microversion: 2.1 time: 0.047936 Jul 25 12:46:50.663809 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1054/2192] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:46:50 2022] DELETE /compute/v2.1/os-security-groups/c86400ef-e7e7-4bf3-99eb-5dc4187d31b4 => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:46:50.670815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d48e6f62-a927-4f6e-ae3c-03d19b78d9f5 tempest-FloatingIPDetailsTestJSON-529319416 tempest-FloatingIPDetailsTestJSON-529319416-project] Calling method '.version_select at 0x7efcfa023040>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:50.940588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b4d39659-8f64-46b3-9ecb-5ba11308c4aa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8908d857fbae4fd49d6c8cd90529397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ce4c7d231540e29b9d66e0f8c276bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:50.962889 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b4d39659-8f64-46b3-9ecb-5ba11308c4aa tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb" status: 200 len: 1366 microversion: 2.1 time: 0.419448 Jul 25 12:46:50.967530 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1139/2193] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:50 2022] GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb => generated 1366 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:50.975266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f2a19c6e-a4fd-4a3a-a32b-7310801105b7 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcf9d0ea60>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:51.022917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG neutronclient.v2_0.client [None req-f2a19c6e-a4fd-4a3a-a32b-7310801105b7 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1329bd2a-6f37-4921-925d-cdddf29adcb1 does not exist", "detail": ""}} {{(pid=125884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:46:51.023576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.security_group_api [None req-f2a19c6e-a4fd-4a3a-a32b-7310801105b7 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Neutron security group 1329bd2a-6f37-4921-925d-cdddf29adcb1 not found {{(pid=125884) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 12:46:51.024100 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-f2a19c6e-a4fd-4a3a-a32b-7310801105b7 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] HTTP exception thrown: Security group 1329bd2a-6f37-4921-925d-cdddf29adcb1 does not exist Jul 25 12:46:51.024100 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-0854b13a-12db-402d-8903-63162b372668'] Jul 25 12:46:51.026545 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f2a19c6e-a4fd-4a3a-a32b-7310801105b7 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Request method failure captured: Jul 25 12:46:51.026545 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/os-security-groups/1329bd2a-6f37-4921-925d-cdddf29adcb1 HTTP/1.1 Jul 25 12:46:51.026545 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:46:51.026545 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:46:51.026545 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:46:51.026545 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:46:51.026545 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:46:51.026545 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:46:51.026545 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:46:51.026545 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:51.026545 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pBMnvMCkXPIxtXS4OZUlYvEfqLzk8eVB6uOa00GC7XzG0Qi-IKZscbMEZM1xj3l2F-5d5lIAdtnOADbgV21wrMS4dvC7LWzHzoCd7ieXebifkHeaO9Mp4wm9vR5m7HEh9yMTTXFHMqap1mzBebGWb33cT_Byxbl27G3bMxoNj8QlS0 Jul 25 12:46:51.026545 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:46:51.026545 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:46:51.026545 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:46:51.026545 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:46:51.026545 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:46:51.026545 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:46:51.026545 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:51.026545 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:51.026545 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:46:51.026545 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:46:51.027903 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8514497475b8462b86e28d48a16b0b20", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}] Jul 25 12:46:51.027903 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:51.027903 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:51.027903 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:51.027903 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:51.027903 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:46:51.027903 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:46:51.027903 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 3912af6bdd224191910f72160c42db30 Jul 25 12:46:51.027903 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:51.027903 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:46:51.027903 n-d-848886-15 devstack@n-api.service[125884]: exception: Security group 1329bd2a-6f37-4921-925d-cdddf29adcb1 does not exist Jul 25 12:46:51.027903 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-0854b13a-12db-402d-8903-63162b372668'] Jul 25 12:46:51.027903 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '1329bd2a-6f37-4921-925d-cdddf29adcb1'} Jul 25 12:46:51.029007 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:51.029007 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:51.029007 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 12:46:51.029007 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 12:46:51.029007 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:51.029007 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:51.029007 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 12:46:51.029007 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 12:46:51.029007 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:51.029007 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:51.029007 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 12:46:51.029007 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 12:46:51.029007 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:51.029007 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:51.029007 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:46:51.029007 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:46:51.029007 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:51.029007 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:51.029007 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:46:51.030149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:46:51.030149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:51.030149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:51.030149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:46:51.030149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:46:51.030149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:46:51.030149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:46:51.030149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1329bd2a-6f37-4921-925d-cdddf29adcb1 does not exist Jul 25 12:46:51.030149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0854b13a-12db-402d-8903-63162b372668'] Jul 25 12:46:51.030149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:51.030149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:51.030149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:51.030149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:51.030149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 12:46:51.030149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 12:46:51.030149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 12:46:51.030149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 12:46:51.030149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1329bd2a-6f37-4921-925d-cdddf29adcb1 does not exist Jul 25 12:46:51.031458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0854b13a-12db-402d-8903-63162b372668'] Jul 25 12:46:51.031458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:51.031458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:51.031458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:51.031458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:51.031458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:51.031458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:51.031458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:51.031458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:51.031458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:46:51.031458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:46:51.031458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:51.031458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:51.031458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 12:46:51.031458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 12:46:51.031458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1329bd2a-6f37-4921-925d-cdddf29adcb1 does not exist Jul 25 12:46:51.031458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0854b13a-12db-402d-8903-63162b372668'] Jul 25 12:46:51.031458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:51.031458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:51.031458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:51.031458 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:51.032627 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:51.032627 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:51.032627 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:51.032627 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:51.032627 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1329bd2a-6f37-4921-925d-cdddf29adcb1 does not exist Jul 25 12:46:51.032627 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0854b13a-12db-402d-8903-63162b372668'] Jul 25 12:46:51.032627 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:51.032627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f2a19c6e-a4fd-4a3a-a32b-7310801105b7 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Returning 404 to user: Security group 1329bd2a-6f37-4921-925d-cdddf29adcb1 does not exist Jul 25 12:46:51.032627 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-0854b13a-12db-402d-8903-63162b372668'] {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:51.032627 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f2a19c6e-a4fd-4a3a-a32b-7310801105b7 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/1329bd2a-6f37-4921-925d-cdddf29adcb1" status: 404 len: 194 microversion: 2.1 time: 0.060195 Jul 25 12:46:51.032627 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1140/2194] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:46:50 2022] DELETE /compute/v2.1/os-security-groups/1329bd2a-6f37-4921-925d-cdddf29adcb1 => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:46:51.042067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dd6fcdc3-e3ee-45ac-bfc5-2c60f0d94f3d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcf9d0a820>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:51.098422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG neutronclient.v2_0.client [None req-dd6fcdc3-e3ee-45ac-bfc5-2c60f0d94f3d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cf6b7471-bc6c-4c81-909e-6965851a515b does not exist", "detail": ""}} {{(pid=125884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:46:51.099024 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.security_group_api [None req-dd6fcdc3-e3ee-45ac-bfc5-2c60f0d94f3d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Neutron security group cf6b7471-bc6c-4c81-909e-6965851a515b not found {{(pid=125884) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 12:46:51.099549 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-dd6fcdc3-e3ee-45ac-bfc5-2c60f0d94f3d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] HTTP exception thrown: Security group cf6b7471-bc6c-4c81-909e-6965851a515b does not exist Jul 25 12:46:51.099549 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-a48259a7-f63e-4884-a14c-6d8fc08fed77'] Jul 25 12:46:51.104211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dd6fcdc3-e3ee-45ac-bfc5-2c60f0d94f3d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Request method failure captured: Jul 25 12:46:51.104211 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/os-security-groups/cf6b7471-bc6c-4c81-909e-6965851a515b HTTP/1.1 Jul 25 12:46:51.104211 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:46:51.104211 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:46:51.104211 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:46:51.104211 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:46:51.104211 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:46:51.104211 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:46:51.104211 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:46:51.104211 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:51.104211 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pBMnvMCkXPIxtXS4OZUlYvEfqLzk8eVB6uOa00GC7XzG0Qi-IKZscbMEZM1xj3l2F-5d5lIAdtnOADbgV21wrMS4dvC7LWzHzoCd7ieXebifkHeaO9Mp4wm9vR5m7HEh9yMTTXFHMqap1mzBebGWb33cT_Byxbl27G3bMxoNj8QlS0 Jul 25 12:46:51.104211 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:46:51.104211 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:46:51.104211 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:46:51.104211 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:46:51.104211 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:46:51.104211 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:46:51.104211 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:51.104211 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:51.104211 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:46:51.104211 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:46:51.105683 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8514497475b8462b86e28d48a16b0b20", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}] Jul 25 12:46:51.105683 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:51.105683 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:51.105683 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:51.105683 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:51.105683 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:46:51.105683 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:46:51.105683 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 3912af6bdd224191910f72160c42db30 Jul 25 12:46:51.105683 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:51.105683 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:46:51.105683 n-d-848886-15 devstack@n-api.service[125884]: exception: Security group cf6b7471-bc6c-4c81-909e-6965851a515b does not exist Jul 25 12:46:51.105683 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-a48259a7-f63e-4884-a14c-6d8fc08fed77'] Jul 25 12:46:51.105683 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'cf6b7471-bc6c-4c81-909e-6965851a515b'} Jul 25 12:46:51.106567 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:51.106567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:51.106567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 12:46:51.106567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 12:46:51.106567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:51.106567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:51.106567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 12:46:51.106567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 12:46:51.106567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:51.106567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:51.106567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 12:46:51.106567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 12:46:51.106567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:51.106567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:51.106567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:46:51.106567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:46:51.106567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:51.106567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:51.106567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:46:51.107602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:46:51.107602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:46:51.107602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:46:51.107602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:46:51.107602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:46:51.107602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:46:51.107602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:46:51.107602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cf6b7471-bc6c-4c81-909e-6965851a515b does not exist Jul 25 12:46:51.107602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a48259a7-f63e-4884-a14c-6d8fc08fed77'] Jul 25 12:46:51.107602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:51.107602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:51.107602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:51.107602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:51.107602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 12:46:51.107602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 12:46:51.107602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 12:46:51.107602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 12:46:51.107602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cf6b7471-bc6c-4c81-909e-6965851a515b does not exist Jul 25 12:46:51.108427 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a48259a7-f63e-4884-a14c-6d8fc08fed77'] Jul 25 12:46:51.108427 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:51.108427 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:51.108427 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:51.108427 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:51.108427 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:51.108427 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:51.108427 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:51.108427 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:51.108427 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:46:51.108427 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:46:51.108427 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:51.108427 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:51.108427 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 12:46:51.108427 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 12:46:51.108427 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cf6b7471-bc6c-4c81-909e-6965851a515b does not exist Jul 25 12:46:51.108427 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a48259a7-f63e-4884-a14c-6d8fc08fed77'] Jul 25 12:46:51.108427 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:51.108427 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:51.108427 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:51.108427 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:51.109611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:51.109611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:51.109611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:51.109611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:51.109611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cf6b7471-bc6c-4c81-909e-6965851a515b does not exist Jul 25 12:46:51.109611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a48259a7-f63e-4884-a14c-6d8fc08fed77'] Jul 25 12:46:51.109611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:51.109611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dd6fcdc3-e3ee-45ac-bfc5-2c60f0d94f3d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Returning 404 to user: Security group cf6b7471-bc6c-4c81-909e-6965851a515b does not exist Jul 25 12:46:51.109611 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-a48259a7-f63e-4884-a14c-6d8fc08fed77'] {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:51.109611 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dd6fcdc3-e3ee-45ac-bfc5-2c60f0d94f3d tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/cf6b7471-bc6c-4c81-909e-6965851a515b" status: 404 len: 194 microversion: 2.1 time: 0.070815 Jul 25 12:46:51.109611 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1141/2195] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:46:51 2022] DELETE /compute/v2.1/os-security-groups/cf6b7471-bc6c-4c81-909e-6965851a515b => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:46:51.129993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-85ec9092-ba49-4dcf-8f58-60615a6dcb49 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:51.132174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-85ec9092-ba49-4dcf-8f58-60615a6dcb49 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:51.151388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85ec9092-ba49-4dcf-8f58-60615a6dcb49 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:51.152009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85ec9092-ba49-4dcf-8f58-60615a6dcb49 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:51.152950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85ec9092-ba49-4dcf-8f58-60615a6dcb49 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:51.156017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85ec9092-ba49-4dcf-8f58-60615a6dcb49 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:51.208327 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-85ec9092-ba49-4dcf-8f58-60615a6dcb49 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:46:51.371730 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-85ec9092-ba49-4dcf-8f58-60615a6dcb49 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949" status: 204 len: 0 microversion: 2.1 time: 0.255649 Jul 25 12:46:51.380585 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1142/2196] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:46:51 2022] DELETE /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:46:51.387148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1b334ca6-1a83-45a9-b0b8-2fabbda30caf tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:51.389552 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1b334ca6-1a83-45a9-b0b8-2fabbda30caf tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:51.404303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b334ca6-1a83-45a9-b0b8-2fabbda30caf tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:51.406344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b334ca6-1a83-45a9-b0b8-2fabbda30caf tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:51.407276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b334ca6-1a83-45a9-b0b8-2fabbda30caf tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:51.410924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b334ca6-1a83-45a9-b0b8-2fabbda30caf tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:51.761650 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1b334ca6-1a83-45a9-b0b8-2fabbda30caf tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:51.774972 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1b334ca6-1a83-45a9-b0b8-2fabbda30caf tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949" status: 200 len: 1647 microversion: 2.1 time: 0.393117 Jul 25 12:46:51.776034 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1143/2197] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:51 2022] GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949 => generated 1647 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:46:51.917280 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d48e6f62-a927-4f6e-ae3c-03d19b78d9f5 tempest-FloatingIPDetailsTestJSON-529319416 tempest-FloatingIPDetailsTestJSON-529319416-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/3b75a704-4b00-4f2c-802b-61014500f360" status: 202 len: 0 microversion: 2.1 time: 1.251869 Jul 25 12:46:51.918175 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1055/2198] 10.222.0.49 () {58 vars in 1263 bytes} [Mon Jul 25 12:46:50 2022] DELETE /compute/v2.1/os-floating-ips/3b75a704-4b00-4f2c-802b-61014500f360 => generated 0 bytes in 1254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:46:51.985134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ccc14f68-3b73-4ff5-acaf-5600c1728c92 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:51.986129 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ccc14f68-3b73-4ff5-acaf-5600c1728c92 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:51.993018 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccc14f68-3b73-4ff5-acaf-5600c1728c92 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:51.993781 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccc14f68-3b73-4ff5-acaf-5600c1728c92 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:51.994805 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccc14f68-3b73-4ff5-acaf-5600c1728c92 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:51.995575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccc14f68-3b73-4ff5-acaf-5600c1728c92 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:52.176447 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ccc14f68-3b73-4ff5-acaf-5600c1728c92 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8908d857fbae4fd49d6c8cd90529397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ce4c7d231540e29b9d66e0f8c276bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:52.190479 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ccc14f68-3b73-4ff5-acaf-5600c1728c92 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb" status: 200 len: 1555 microversion: 2.1 time: 0.209481 Jul 25 12:46:52.191092 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1144/2199] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:51 2022] GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb => generated 1555 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:46:52.216380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fd0b04e5-0c20-481a-9571-1f5b3ad01ed2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:52.217330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fd0b04e5-0c20-481a-9571-1f5b3ad01ed2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:52.227352 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd0b04e5-0c20-481a-9571-1f5b3ad01ed2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:52.230066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd0b04e5-0c20-481a-9571-1f5b3ad01ed2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:52.232547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd0b04e5-0c20-481a-9571-1f5b3ad01ed2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:52.233709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd0b04e5-0c20-481a-9571-1f5b3ad01ed2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:52.368956 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fd0b04e5-0c20-481a-9571-1f5b3ad01ed2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158113 Jul 25 12:46:52.369648 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1056/2200] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 12:46:52 2022] GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:52.796832 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-288cac5a-5074-4fe6-9177-2024e78246f4 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:52.797447 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-288cac5a-5074-4fe6-9177-2024e78246f4 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:52.809178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-288cac5a-5074-4fe6-9177-2024e78246f4 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:52.812181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-288cac5a-5074-4fe6-9177-2024e78246f4 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:52.813270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-288cac5a-5074-4fe6-9177-2024e78246f4 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:52.822969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-288cac5a-5074-4fe6-9177-2024e78246f4 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:53.227453 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6252bcf4-a0fa-4f85-9550-c063e2cf996c tempest-MultipleCreateNegativeTestJSON-1309556429 tempest-MultipleCreateNegativeTestJSON-1309556429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1544122688", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:53.241061 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-6252bcf4-a0fa-4f85-9550-c063e2cf996c tempest-MultipleCreateNegativeTestJSON-1309556429 tempest-MultipleCreateNegativeTestJSON-1309556429-project] HTTP exception thrown: min_count must be <= max_count Jul 25 12:46:53.242829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6252bcf4-a0fa-4f85-9550-c063e2cf996c tempest-MultipleCreateNegativeTestJSON-1309556429 tempest-MultipleCreateNegativeTestJSON-1309556429-project] Request method failure captured: Jul 25 12:46:53.242829 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 12:46:53.242829 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:46:53.242829 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:46:53.242829 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:46:53.242829 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 184 Jul 25 12:46:53.242829 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:46:53.242829 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:46:53.242829 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:46:53.242829 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:53.242829 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pC89lbLwPPEx5PO9xhi7u9kAOADqximR6gi_eZUgY1Ku1HGqAo-2ICnJ19v8hTaPQ0IVYMK6rjyFXBN-ix7Umx-KLCgaQ5R0pjGTWw5AFfgOK30iwgotYcgGwAGz9k3GQ-vh9w6fKcJs4j2JnbPgXsnsO_eQR5MfC1ZG7UkNwHKchY Jul 25 12:46:53.242829 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:46:53.242829 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:46:53.242829 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:46:53.242829 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:46:53.242829 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:46:53.242829 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:46:53.242829 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: ebae06df2a6c4c66ba812693d64d7d76 Jul 25 12:46:53.242829 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1309556429 Jul 25 12:46:53.242829 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:46:53.242829 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:46:53.244093 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebae06df2a6c4c66ba812693d64d7d76", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "tempest-type-1017011991", "name": "tempest-service-1737775612", "endpoints": [{"region": "tempest-region-1380443328", "publicURL": "https://url-1997649468.com"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebae06df2a6c4c66ba812693d64d7d76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebae06df2a6c4c66ba812693d64d7d76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebae06df2a6c4c66ba812693d64d7d76"}]}] Jul 25 12:46:53.244093 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1309556429 Jul 25 12:46:53.244093 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: ebae06df2a6c4c66ba812693d64d7d76 Jul 25 12:46:53.244093 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1309556429 Jul 25 12:46:53.244093 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-MultipleCreateNegativeTestJSON-1309556429-project Jul 25 12:46:53.244093 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:46:53.244093 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:46:53.244093 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 69fa83902a704600af31f77bfd213c2e Jul 25 12:46:53.244093 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1309556429-project Jul 25 12:46:53.244093 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:46:53.244680 n-d-848886-15 devstack@n-api.service[125883]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1544122688", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 25 12:46:53.244680 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:46:53.244680 n-d-848886-15 devstack@n-api.service[125883]: exception: min_count must be <= max_count Jul 25 12:46:53.244680 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1544122688', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 25 12:46:53.244680 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:53.244680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:53.244680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:53.244680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:53.244680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:53.244680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:53.244680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:53.244680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:53.244680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:46:53.244680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:46:53.244680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:46:53.244680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:46:53.244680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:46:53.244680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:46:53.244680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 12:46:53.245696 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 25 12:46:53.245696 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 25 12:46:53.245696 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 25 12:46:53.245696 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:53.245696 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:53.245696 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:53.245696 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:53.245696 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:53.245696 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:53.245696 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:53.245696 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:53.245696 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 25 12:46:53.245696 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:53.247249 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6252bcf4-a0fa-4f85-9550-c063e2cf996c tempest-MultipleCreateNegativeTestJSON-1309556429 tempest-MultipleCreateNegativeTestJSON-1309556429-project] Returning 400 to user: min_count must be <= max_count {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:53.248273 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6252bcf4-a0fa-4f85-9550-c063e2cf996c tempest-MultipleCreateNegativeTestJSON-1309556429 tempest-MultipleCreateNegativeTestJSON-1309556429-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.334685 Jul 25 12:46:53.249022 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1057/2201] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:46:52 2022] POST /compute/v2.1/servers => generated 74 bytes in 336 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:46:53.266428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-288cac5a-5074-4fe6-9177-2024e78246f4 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:53.281029 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-288cac5a-5074-4fe6-9177-2024e78246f4 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949" status: 200 len: 1647 microversion: 2.1 time: 0.488318 Jul 25 12:46:53.281662 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1145/2202] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:52 2022] GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949 => generated 1647 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:46:53.504078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-242ceae2-09ac-4e25-bff8-1802fa70e847 tempest-MultipleCreateNegativeTestJSON-1309556429 tempest-MultipleCreateNegativeTestJSON-1309556429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-337795191", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "max_count": 0}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:53.510454 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-242ceae2-09ac-4e25-bff8-1802fa70e847 tempest-MultipleCreateNegativeTestJSON-1309556429 tempest-MultipleCreateNegativeTestJSON-1309556429-project] Request method failure captured: Jul 25 12:46:53.510454 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 12:46:53.510454 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:46:53.510454 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:46:53.510454 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:46:53.510454 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 167 Jul 25 12:46:53.510454 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:46:53.510454 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:46:53.510454 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:46:53.510454 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:53.510454 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pC89lbLwPPEx5PO9xhi7u9kAOADqximR6gi_eZUgY1Ku1HGqAo-2ICnJ19v8hTaPQ0IVYMK6rjyFXBN-ix7Umx-KLCgaQ5R0pjGTWw5AFfgOK30iwgotYcgGwAGz9k3GQ-vh9w6fKcJs4j2JnbPgXsnsO_eQR5MfC1ZG7UkNwHKchY Jul 25 12:46:53.510454 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:46:53.510454 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:46:53.510454 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:46:53.510454 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:46:53.510454 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:46:53.510454 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:46:53.510454 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: ebae06df2a6c4c66ba812693d64d7d76 Jul 25 12:46:53.510454 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1309556429 Jul 25 12:46:53.510454 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:46:53.510454 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:46:53.511616 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebae06df2a6c4c66ba812693d64d7d76", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "tempest-type-1017011991", "name": "tempest-service-1737775612", "endpoints": [{"region": "tempest-region-1380443328", "publicURL": "https://url-1997649468.com"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebae06df2a6c4c66ba812693d64d7d76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebae06df2a6c4c66ba812693d64d7d76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebae06df2a6c4c66ba812693d64d7d76"}]}] Jul 25 12:46:53.511616 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1309556429 Jul 25 12:46:53.511616 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: ebae06df2a6c4c66ba812693d64d7d76 Jul 25 12:46:53.511616 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1309556429 Jul 25 12:46:53.511616 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-MultipleCreateNegativeTestJSON-1309556429-project Jul 25 12:46:53.511616 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:46:53.511616 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:46:53.511616 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 69fa83902a704600af31f77bfd213c2e Jul 25 12:46:53.511616 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1309556429-project Jul 25 12:46:53.511616 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:46:53.512148 n-d-848886-15 devstack@n-api.service[125883]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-337795191", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "max_count": 0}} Jul 25 12:46:53.512148 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:46:53.512148 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 25 12:46:53.512148 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-337795191', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452', 'max_count': 0}}} Jul 25 12:46:53.512148 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:53.512148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:53.512148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:46:53.512148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:46:53.512148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:46:53.512148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:46:53.512148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 25 12:46:53.512148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:53.512148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 25 12:46:53.512148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 12:46:53.512148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 25 12:46:53.512148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 12:46:53.512148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 12:46:53.512148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:53.512148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 12:46:53.512148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 0 Jul 25 12:46:53.512148 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:53.513216 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:53.513216 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:53.513216 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:53.513216 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:53.513216 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:53.513216 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:53.513216 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:53.513216 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:53.513216 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:53.513216 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:46:53.513216 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:46:53.513216 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:46:53.513216 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:46:53.513216 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:46:53.513216 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:46:53.513216 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:46:53.513216 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:46:53.513216 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 25 12:46:53.513216 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:53.513216 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:53.514477 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:53.514477 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:53.514477 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:53.514477 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:53.514477 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:46:53.514477 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:46:53.514477 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 25 12:46:53.514477 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:53.514477 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-242ceae2-09ac-4e25-bff8-1802fa70e847 tempest-MultipleCreateNegativeTestJSON-1309556429 tempest-MultipleCreateNegativeTestJSON-1309556429-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:53.514477 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-242ceae2-09ac-4e25-bff8-1802fa70e847 tempest-MultipleCreateNegativeTestJSON-1309556429 tempest-MultipleCreateNegativeTestJSON-1309556429-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.013812 Jul 25 12:46:53.529956 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1058/2203] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:46:53 2022] POST /compute/v2.1/servers => generated 130 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:46:53.778702 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-23a5c609-4aca-4f37-beb2-724c322646ef tempest-MultipleCreateNegativeTestJSON-1309556429 tempest-MultipleCreateNegativeTestJSON-1309556429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1016871120", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "max_count": 2.5}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:53.819720 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-23a5c609-4aca-4f37-beb2-724c322646ef tempest-MultipleCreateNegativeTestJSON-1309556429 tempest-MultipleCreateNegativeTestJSON-1309556429-project] Request method failure captured: Jul 25 12:46:53.819720 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 12:46:53.819720 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:46:53.819720 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:46:53.819720 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:46:53.819720 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 170 Jul 25 12:46:53.819720 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:46:53.819720 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:46:53.819720 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:46:53.819720 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:53.819720 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pC89lbLwPPEx5PO9xhi7u9kAOADqximR6gi_eZUgY1Ku1HGqAo-2ICnJ19v8hTaPQ0IVYMK6rjyFXBN-ix7Umx-KLCgaQ5R0pjGTWw5AFfgOK30iwgotYcgGwAGz9k3GQ-vh9w6fKcJs4j2JnbPgXsnsO_eQR5MfC1ZG7UkNwHKchY Jul 25 12:46:53.819720 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:46:53.819720 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:46:53.819720 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:46:53.819720 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:46:53.819720 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:46:53.819720 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:46:53.819720 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: ebae06df2a6c4c66ba812693d64d7d76 Jul 25 12:46:53.819720 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1309556429 Jul 25 12:46:53.819720 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:46:53.819720 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:46:53.821282 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebae06df2a6c4c66ba812693d64d7d76", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "tempest-type-1017011991", "name": "tempest-service-1737775612", "endpoints": [{"region": "tempest-region-1380443328", "publicURL": "https://url-1997649468.com"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebae06df2a6c4c66ba812693d64d7d76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebae06df2a6c4c66ba812693d64d7d76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebae06df2a6c4c66ba812693d64d7d76"}]}] Jul 25 12:46:53.821282 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1309556429 Jul 25 12:46:53.821282 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: ebae06df2a6c4c66ba812693d64d7d76 Jul 25 12:46:53.821282 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1309556429 Jul 25 12:46:53.821282 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-MultipleCreateNegativeTestJSON-1309556429-project Jul 25 12:46:53.821282 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:46:53.821282 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:46:53.821282 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 69fa83902a704600af31f77bfd213c2e Jul 25 12:46:53.821282 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1309556429-project Jul 25 12:46:53.821282 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:46:53.821848 n-d-848886-15 devstack@n-api.service[125884]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1016871120", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "max_count": 2.5}} Jul 25 12:46:53.821848 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:46:53.821848 n-d-848886-15 devstack@n-api.service[125884]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 12:46:53.821848 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1016871120', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452', 'max_count': 2.5}}} Jul 25 12:46:53.821848 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:53.821848 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:53.821848 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:46:53.821848 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:46:53.821848 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:46:53.821848 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:46:53.821848 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 25 12:46:53.821848 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:53.821848 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 25 12:46:53.821848 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 12:46:53.821848 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 25 12:46:53.821848 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 12:46:53.821848 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 12:46:53.821848 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:53.821848 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 12:46:53.821848 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 2.5 Jul 25 12:46:53.821848 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:53.822881 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:53.822881 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:53.822881 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:53.822881 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:53.822881 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:53.822881 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:53.822881 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:53.822881 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:53.822881 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:53.822881 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:46:53.822881 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:46:53.822881 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:46:53.822881 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:46:53.822881 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:46:53.822881 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:46:53.822881 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:46:53.822881 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:46:53.822881 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 12:46:53.822881 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:53.822881 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:53.823819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:53.823819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:53.823819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:53.823819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:53.823819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:46:53.823819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:46:53.823819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 12:46:53.823819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:53.823819 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-23a5c609-4aca-4f37-beb2-724c322646ef tempest-MultipleCreateNegativeTestJSON-1309556429 tempest-MultipleCreateNegativeTestJSON-1309556429-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:53.823819 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-23a5c609-4aca-4f37-beb2-724c322646ef tempest-MultipleCreateNegativeTestJSON-1309556429 tempest-MultipleCreateNegativeTestJSON-1309556429-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.049260 Jul 25 12:46:53.838112 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1146/2204] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:46:53 2022] POST /compute/v2.1/servers => generated 139 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:46:54.012326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0cd79078-908c-450e-892a-97b899a1c50d tempest-MultipleCreateNegativeTestJSON-1309556429 tempest-MultipleCreateNegativeTestJSON-1309556429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1789337203", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "min_count": 0}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:54.016512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0cd79078-908c-450e-892a-97b899a1c50d tempest-MultipleCreateNegativeTestJSON-1309556429 tempest-MultipleCreateNegativeTestJSON-1309556429-project] Request method failure captured: Jul 25 12:46:54.016512 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 12:46:54.016512 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:46:54.016512 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:46:54.016512 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:46:54.016512 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 168 Jul 25 12:46:54.016512 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:46:54.016512 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:46:54.016512 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:46:54.016512 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:54.016512 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pC89lbLwPPEx5PO9xhi7u9kAOADqximR6gi_eZUgY1Ku1HGqAo-2ICnJ19v8hTaPQ0IVYMK6rjyFXBN-ix7Umx-KLCgaQ5R0pjGTWw5AFfgOK30iwgotYcgGwAGz9k3GQ-vh9w6fKcJs4j2JnbPgXsnsO_eQR5MfC1ZG7UkNwHKchY Jul 25 12:46:54.016512 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:46:54.016512 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:46:54.016512 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:46:54.016512 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:46:54.016512 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:46:54.016512 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:46:54.016512 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: ebae06df2a6c4c66ba812693d64d7d76 Jul 25 12:46:54.016512 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1309556429 Jul 25 12:46:54.016512 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:46:54.016512 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:46:54.017579 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebae06df2a6c4c66ba812693d64d7d76", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "tempest-type-1017011991", "name": "tempest-service-1737775612", "endpoints": [{"region": "tempest-region-1380443328", "publicURL": "https://url-1997649468.com"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebae06df2a6c4c66ba812693d64d7d76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebae06df2a6c4c66ba812693d64d7d76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebae06df2a6c4c66ba812693d64d7d76"}]}] Jul 25 12:46:54.017579 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1309556429 Jul 25 12:46:54.017579 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: ebae06df2a6c4c66ba812693d64d7d76 Jul 25 12:46:54.017579 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1309556429 Jul 25 12:46:54.017579 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-MultipleCreateNegativeTestJSON-1309556429-project Jul 25 12:46:54.017579 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:46:54.017579 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:46:54.017579 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 69fa83902a704600af31f77bfd213c2e Jul 25 12:46:54.017579 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1309556429-project Jul 25 12:46:54.017579 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:46:54.018095 n-d-848886-15 devstack@n-api.service[125883]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1789337203", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "min_count": 0}} Jul 25 12:46:54.018095 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:46:54.018095 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 25 12:46:54.018095 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1789337203', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452', 'min_count': 0}}} Jul 25 12:46:54.018095 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:54.018095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:54.018095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:46:54.018095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:46:54.018095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:46:54.018095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:46:54.018095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 25 12:46:54.018095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:54.018095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 25 12:46:54.018095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 12:46:54.018095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 25 12:46:54.018095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 12:46:54.018095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 12:46:54.018095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:54.018095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 12:46:54.018095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 0 Jul 25 12:46:54.018095 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:54.019072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:54.019072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:54.019072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:54.019072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:54.019072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:54.019072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:54.019072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:54.019072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:54.019072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:54.019072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:46:54.019072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:46:54.019072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:46:54.019072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:46:54.019072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:46:54.019072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:46:54.019072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:46:54.019072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:46:54.019072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 25 12:46:54.019072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:54.019072 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:54.020003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:54.020003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:54.020003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:54.020003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:54.020003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:46:54.020003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:46:54.020003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 25 12:46:54.020003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:54.020719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0cd79078-908c-450e-892a-97b899a1c50d tempest-MultipleCreateNegativeTestJSON-1309556429 tempest-MultipleCreateNegativeTestJSON-1309556429-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:54.023550 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0cd79078-908c-450e-892a-97b899a1c50d tempest-MultipleCreateNegativeTestJSON-1309556429 tempest-MultipleCreateNegativeTestJSON-1309556429-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.014341 Jul 25 12:46:54.024151 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1059/2205] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:46:54 2022] POST /compute/v2.1/servers => generated 130 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:46:54.091329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-c0645b21-e09d-4ac9-8d9f-0b1014f6c479 req-7afd5732-a370-40c0-b8cb-d68495ea0628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8bc4a2-d00c-4134-acdc-7b86e0ada949", "name": "network-vif-deleted", "tag": "c9e83551-a9ab-4f05-a33e-1ebc6c00a03a"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:54.116976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c0645b21-e09d-4ac9-8d9f-0b1014f6c479 req-7afd5732-a370-40c0-b8cb-d68495ea0628 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:54.120954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c0645b21-e09d-4ac9-8d9f-0b1014f6c479 req-7afd5732-a370-40c0-b8cb-d68495ea0628 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:54.146526 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-c0645b21-e09d-4ac9-8d9f-0b1014f6c479 req-7afd5732-a370-40c0-b8cb-d68495ea0628 service nova] Creating event network-vif-deleted:c9e83551-a9ab-4f05-a33e-1ebc6c00a03a for instance 7a8bc4a2-d00c-4134-acdc-7b86e0ada949 on n-h1-848886-15 Jul 25 12:46:54.159568 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-c0645b21-e09d-4ac9-8d9f-0b1014f6c479 req-7afd5732-a370-40c0-b8cb-d68495ea0628 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072971 Jul 25 12:46:54.161403 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1147/2206] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:54.293597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d6b0f780-ef95-4605-a251-8e16e44ccf7e tempest-MultipleCreateNegativeTestJSON-1309556429 tempest-MultipleCreateNegativeTestJSON-1309556429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1063080313", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "min_count": 2.5}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:54.304247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-743f184f-8f04-4bcd-af0f-cd50664a63ed tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:54.305151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-743f184f-8f04-4bcd-af0f-cd50664a63ed tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:54.306164 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d6b0f780-ef95-4605-a251-8e16e44ccf7e tempest-MultipleCreateNegativeTestJSON-1309556429 tempest-MultipleCreateNegativeTestJSON-1309556429-project] Request method failure captured: Jul 25 12:46:54.306164 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 12:46:54.306164 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:46:54.306164 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:46:54.306164 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:46:54.306164 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 170 Jul 25 12:46:54.306164 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:46:54.306164 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:46:54.306164 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:46:54.306164 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:54.306164 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pC89lbLwPPEx5PO9xhi7u9kAOADqximR6gi_eZUgY1Ku1HGqAo-2ICnJ19v8hTaPQ0IVYMK6rjyFXBN-ix7Umx-KLCgaQ5R0pjGTWw5AFfgOK30iwgotYcgGwAGz9k3GQ-vh9w6fKcJs4j2JnbPgXsnsO_eQR5MfC1ZG7UkNwHKchY Jul 25 12:46:54.306164 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:46:54.306164 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:46:54.306164 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:46:54.306164 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:46:54.306164 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:46:54.306164 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:46:54.306164 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: ebae06df2a6c4c66ba812693d64d7d76 Jul 25 12:46:54.306164 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1309556429 Jul 25 12:46:54.306164 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:46:54.306164 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:46:54.307504 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebae06df2a6c4c66ba812693d64d7d76", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "tempest-type-1017011991", "name": "tempest-service-1737775612", "endpoints": [{"region": "tempest-region-1380443328", "publicURL": "https://url-1997649468.com"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebae06df2a6c4c66ba812693d64d7d76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebae06df2a6c4c66ba812693d64d7d76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebae06df2a6c4c66ba812693d64d7d76"}]}] Jul 25 12:46:54.307504 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1309556429 Jul 25 12:46:54.307504 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: ebae06df2a6c4c66ba812693d64d7d76 Jul 25 12:46:54.307504 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1309556429 Jul 25 12:46:54.307504 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-MultipleCreateNegativeTestJSON-1309556429-project Jul 25 12:46:54.307504 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:46:54.307504 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:46:54.307504 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 69fa83902a704600af31f77bfd213c2e Jul 25 12:46:54.307504 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1309556429-project Jul 25 12:46:54.307504 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:46:54.308126 n-d-848886-15 devstack@n-api.service[125883]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1063080313", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "min_count": 2.5}} Jul 25 12:46:54.308126 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:46:54.308126 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 12:46:54.308126 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1063080313', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452', 'min_count': 2.5}}} Jul 25 12:46:54.308126 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:54.308126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:54.308126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:46:54.308126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:46:54.308126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:46:54.308126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:46:54.308126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 25 12:46:54.308126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:54.308126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 25 12:46:54.308126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 12:46:54.308126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 25 12:46:54.308126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 12:46:54.308126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 12:46:54.308126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:54.308126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 12:46:54.308126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 2.5 Jul 25 12:46:54.308126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:54.309409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:54.309409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:54.309409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:54.309409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:54.309409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:54.309409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:54.309409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:54.309409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:54.309409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:54.309409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:46:54.309409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:46:54.309409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:46:54.309409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:46:54.309409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:46:54.309409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:46:54.309409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:46:54.309409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:46:54.309409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 12:46:54.309409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:54.309409 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:54.311094 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:54.311094 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:54.311094 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:54.311094 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:54.311094 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:46:54.311094 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:46:54.311094 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 12:46:54.311094 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:54.311094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d6b0f780-ef95-4605-a251-8e16e44ccf7e tempest-MultipleCreateNegativeTestJSON-1309556429 tempest-MultipleCreateNegativeTestJSON-1309556429-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:54.311094 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d6b0f780-ef95-4605-a251-8e16e44ccf7e tempest-MultipleCreateNegativeTestJSON-1309556429 tempest-MultipleCreateNegativeTestJSON-1309556429-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020609 Jul 25 12:46:54.313638 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1060/2207] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:46:54 2022] POST /compute/v2.1/servers => generated 139 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:46:54.325138 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-743f184f-8f04-4bcd-af0f-cd50664a63ed tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:54.327587 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-743f184f-8f04-4bcd-af0f-cd50664a63ed tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:54.328876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-743f184f-8f04-4bcd-af0f-cd50664a63ed tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:54.329391 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-743f184f-8f04-4bcd-af0f-cd50664a63ed tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:54.388471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-743f184f-8f04-4bcd-af0f-cd50664a63ed tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:54.389094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-743f184f-8f04-4bcd-af0f-cd50664a63ed tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:54.389630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-743f184f-8f04-4bcd-af0f-cd50664a63ed tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lazy-loading 'fault' on Instance uuid 7a8bc4a2-d00c-4134-acdc-7b86e0ada949 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:46:54.483483 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-743f184f-8f04-4bcd-af0f-cd50664a63ed tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3912af6bdd224191910f72160c42db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8514497475b8462b86e28d48a16b0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:54.493770 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-743f184f-8f04-4bcd-af0f-cd50664a63ed tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949" status: 200 len: 1306 microversion: 2.1 time: 0.194557 Jul 25 12:46:54.506415 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1148/2208] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:54 2022] GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949 => generated 1306 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:54.678983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-0d069b2d-e593-4630-8a95-12c9a9cbbf2f req-e225b89f-5885-4fa8-91b2-1671c0c31738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a09b0fac-fbdd-4e0d-83b5-4b0573183adb", "tag": "fe424d38-2c55-446d-8969-95ae660f2f4f"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:54.694644 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:54.702146 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0d069b2d-e593-4630-8a95-12c9a9cbbf2f req-e225b89f-5885-4fa8-91b2-1671c0c31738 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:54.702596 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0d069b2d-e593-4630-8a95-12c9a9cbbf2f req-e225b89f-5885-4fa8-91b2-1671c0c31738 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:54.757302 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-0d069b2d-e593-4630-8a95-12c9a9cbbf2f req-e225b89f-5885-4fa8-91b2-1671c0c31738 service nova] Creating event network-changed:fe424d38-2c55-446d-8969-95ae660f2f4f for instance a09b0fac-fbdd-4e0d-83b5-4b0573183adb on n-h1-848886-15 Jul 25 12:46:54.765467 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-0d069b2d-e593-4630-8a95-12c9a9cbbf2f req-e225b89f-5885-4fa8-91b2-1671c0c31738 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090735 Jul 25 12:46:54.773918 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1061/2209] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:55.099662 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0e2b9874-4745-420e-b72e-9ebf39fa523c tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:55.103618 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0e2b9874-4745-420e-b72e-9ebf39fa523c tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:55.120786 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e2b9874-4745-420e-b72e-9ebf39fa523c tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:55.122068 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e2b9874-4745-420e-b72e-9ebf39fa523c tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:55.123109 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e2b9874-4745-420e-b72e-9ebf39fa523c tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:55.124380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e2b9874-4745-420e-b72e-9ebf39fa523c tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:55.177338 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0e2b9874-4745-420e-b72e-9ebf39fa523c tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082866 Jul 25 12:46:55.178558 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1149/2210] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 12:46:55 2022] GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:55.190737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-80471cce-203f-4385-a11c-98622e3ad8ba tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:55.192255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-80471cce-203f-4385-a11c-98622e3ad8ba tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:55.200919 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80471cce-203f-4385-a11c-98622e3ad8ba tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:55.201855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80471cce-203f-4385-a11c-98622e3ad8ba tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:55.203026 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80471cce-203f-4385-a11c-98622e3ad8ba tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:55.203740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80471cce-203f-4385-a11c-98622e3ad8ba tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:55.400264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-80471cce-203f-4385-a11c-98622e3ad8ba tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lazy-loading 'services' on Instance uuid 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:46:55.519550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-03468a2d-218d-487b-8e84-4fcf86da1175 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:55.520629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-03468a2d-218d-487b-8e84-4fcf86da1175 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] [instance: 7a8bc4a2-d00c-4134-acdc-7b86e0ada949] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:55.538398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-03468a2d-218d-487b-8e84-4fcf86da1175 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:55.540451 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-03468a2d-218d-487b-8e84-4fcf86da1175 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:55.543363 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-03468a2d-218d-487b-8e84-4fcf86da1175 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:55.545404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-03468a2d-218d-487b-8e84-4fcf86da1175 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:55.546314 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-80471cce-203f-4385-a11c-98622e3ad8ba tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e/os-volume_attachments/56dce919-0c94-4198-840d-cc9c49f8feac" status: 202 len: 0 microversion: 2.1 time: 0.358162 Jul 25 12:46:55.554746 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1062/2211] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Jul 25 12:46:55 2022] DELETE /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e/os-volume_attachments/56dce919-0c94-4198-840d-cc9c49f8feac => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:46:55.596840 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-03468a2d-218d-487b-8e84-4fcf86da1175 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] HTTP exception thrown: Instance 7a8bc4a2-d00c-4134-acdc-7b86e0ada949 could not be found. Jul 25 12:46:55.604393 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-03468a2d-218d-487b-8e84-4fcf86da1175 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Request method failure captured: Jul 25 12:46:55.604393 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949 HTTP/1.1 Jul 25 12:46:55.604393 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:46:55.604393 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:46:55.604393 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:46:55.604393 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:46:55.604393 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:46:55.604393 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:46:55.604393 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:46:55.604393 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:55.604393 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pBMnvMCkXPIxtXS4OZUlYvEfqLzk8eVB6uOa00GC7XzG0Qi-IKZscbMEZM1xj3l2F-5d5lIAdtnOADbgV21wrMS4dvC7LWzHzoCd7ieXebifkHeaO9Mp4wm9vR5m7HEh9yMTTXFHMqap1mzBebGWb33cT_Byxbl27G3bMxoNj8QlS0 Jul 25 12:46:55.604393 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:46:55.604393 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:46:55.604393 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:46:55.604393 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:46:55.604393 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:46:55.604393 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:46:55.604393 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:55.604393 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:55.604393 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:46:55.604393 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:46:55.605434 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8514497475b8462b86e28d48a16b0b20", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8514497475b8462b86e28d48a16b0b20"}]}] Jul 25 12:46:55.605434 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:55.605434 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 8514497475b8462b86e28d48a16b0b20 Jul 25 12:46:55.605434 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1553270194 Jul 25 12:46:55.605434 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:55.605434 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:46:55.605434 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:46:55.605434 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 3912af6bdd224191910f72160c42db30 Jul 25 12:46:55.605434 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-SecurityGroupsTestJSON-1553270194-project Jul 25 12:46:55.605434 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:46:55.605434 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 7a8bc4a2-d00c-4134-acdc-7b86e0ada949 could not be found. Jul 25 12:46:55.605434 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '7a8bc4a2-d00c-4134-acdc-7b86e0ada949'} Jul 25 12:46:55.606206 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:55.606206 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:55.606206 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:46:55.606206 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:46:55.606206 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:46:55.606206 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:46:55.606206 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:46:55.606206 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:46:55.606206 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:46:55.606206 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:46:55.606206 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a8bc4a2-d00c-4134-acdc-7b86e0ada949 could not be found. Jul 25 12:46:55.606206 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:55.606206 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:55.606206 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:55.606206 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:55.606206 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:55.606206 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:55.606206 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:55.606206 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:55.606206 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:55.607350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:55.607350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:46:55.607350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:46:55.607350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:46:55.607350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:46:55.607350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:46:55.607350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:46:55.607350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a8bc4a2-d00c-4134-acdc-7b86e0ada949 could not be found. Jul 25 12:46:55.607350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:55.607350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:55.607350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:55.607350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:55.607350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:55.607350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:55.607350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:55.607350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:55.607350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a8bc4a2-d00c-4134-acdc-7b86e0ada949 could not be found. Jul 25 12:46:55.607350 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:46:55.608181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-03468a2d-218d-487b-8e84-4fcf86da1175 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Returning 404 to user: Instance 7a8bc4a2-d00c-4134-acdc-7b86e0ada949 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:55.608267 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-03468a2d-218d-487b-8e84-4fcf86da1175 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949" status: 404 len: 111 microversion: 2.1 time: 0.094931 Jul 25 12:46:55.614883 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1150/2212] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:55 2022] GET /compute/v2.1/servers/7a8bc4a2-d00c-4134-acdc-7b86e0ada949 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:46:55.625706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1428aa89-1e88-4308-981f-2d907a27fa62 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcf9a3bdc0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:56.408172 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1428aa89-1e88-4308-981f-2d907a27fa62 tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/0448c389-1a73-4182-98bf-c83dc1c55081" status: 202 len: 0 microversion: 2.1 time: 0.788830 Jul 25 12:46:56.409990 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1063/2213] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:46:55 2022] DELETE /compute/v2.1/os-security-groups/0448c389-1a73-4182-98bf-c83dc1c55081 => generated 0 bytes in 792 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:46:56.418767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3ee65419-2ab5-40cc-b76a-353a7ca0976c tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] Calling method '.version_select at 0x7efcf9d354c0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:57.822821 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3ee65419-2ab5-40cc-b76a-353a7ca0976c tempest-SecurityGroupsTestJSON-1553270194 tempest-SecurityGroupsTestJSON-1553270194-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/e6246bb0-4610-48c0-abdb-bde7daf9b373" status: 202 len: 0 microversion: 2.1 time: 1.408888 Jul 25 12:46:57.824302 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1151/2214] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:46:56 2022] DELETE /compute/v2.1/os-security-groups/e6246bb0-4610-48c0-abdb-bde7daf9b373 => generated 0 bytes in 1411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:46:59.573045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0e83b7ad-4a06-4d50-85c8-abb42faf0155 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Action: 'update', calling method: .version_select at 0x7efcfecbd4c0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:59.577643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e6356d73-e83a-4b60-908f-7a7b83a6b77a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1027984761", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": "none"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:59.580763 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:46:59.580763 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:46:59.589669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e83b7ad-4a06-4d50-85c8-abb42faf0155 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:59.590912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e83b7ad-4a06-4d50-85c8-abb42faf0155 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:59.636518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e83b7ad-4a06-4d50-85c8-abb42faf0155 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:59.641779 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e83b7ad-4a06-4d50-85c8-abb42faf0155 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:59.655424 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-0e83b7ad-4a06-4d50-85c8-abb42faf0155 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] HTTP exception thrown: Service 09cf99e5-8a8b-4c13-9a33-561c34b06d45 could not be found. Jul 25 12:46:59.668591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0e83b7ad-4a06-4d50-85c8-abb42faf0155 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Request method failure captured: Jul 25 12:46:59.668591 n-d-848886-15 devstack@n-api.service[125883]: request: PUT /compute/v2.1/os-services/09cf99e5-8a8b-4c13-9a33-561c34b06d45 HTTP/1.1 Jul 25 12:46:59.668591 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:46:59.668591 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:46:59.668591 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:46:59.668591 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 56 Jul 25 12:46:59.668591 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:46:59.668591 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:46:59.668591 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:46:59.668591 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:59.668591 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDC9bwWjrD0GuOV8B3-Zz1nJPYkh6IE1v89GupPmOrvLIiynh_FZajCKa11ZOHQQS4MINE82CgS1s_VpsHcqEsdV5_qVjBVD19SnrWpX6cY1oPF-L1gfsX9mPha0wHl5xTPO1CqF62djm930asYpJwafWAl0GzZoROUZz-rcstjH0c Jul 25 12:46:59.668591 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:46:59.668591 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:46:59.668591 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:46:59.668591 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:46:59.668591 n-d-848886-15 devstack@n-api.service[125883]: X-Openstack-Nova-Api-Version: 2.53 Jul 25 12:46:59.668591 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:46:59.668591 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:46:59.668591 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 28357d21aac0443b87a0ca6939c3569b Jul 25 12:46:59.668591 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1291693739 Jul 25 12:46:59.668591 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:46:59.668591 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:46:59.670944 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_28357d21aac0443b87a0ca6939c3569b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/28357d21aac0443b87a0ca6939c3569b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/28357d21aac0443b87a0ca6939c3569b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/28357d21aac0443b87a0ca6939c3569b"}]}] Jul 25 12:46:59.670944 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1291693739 Jul 25 12:46:59.670944 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 28357d21aac0443b87a0ca6939c3569b Jul 25 12:46:59.670944 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1291693739 Jul 25 12:46:59.670944 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin Jul 25 12:46:59.670944 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:46:59.670944 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:46:59.670944 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 03bceeb79dbd45089b24c947045e726e Jul 25 12:46:59.670944 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin Jul 25 12:46:59.670944 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:46:59.670944 n-d-848886-15 devstack@n-api.service[125883]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 25 12:46:59.670944 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:46:59.670944 n-d-848886-15 devstack@n-api.service[125883]: exception: Service 09cf99e5-8a8b-4c13-9a33-561c34b06d45 could not be found. Jul 25 12:46:59.671795 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '09cf99e5-8a8b-4c13-9a33-561c34b06d45', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 25 12:46:59.671795 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:59.671795 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:59.671795 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 25 12:46:59.671795 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 25 12:46:59.671795 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 25 12:46:59.671795 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 25 12:46:59.671795 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 25 12:46:59.671795 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:59.671795 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:59.671795 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:59.671795 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:59.671795 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 25 12:46:59.671795 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 25 12:46:59.671795 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 25 12:46:59.671795 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:46:59.671795 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 09cf99e5-8a8b-4c13-9a33-561c34b06d45 could not be found. Jul 25 12:46:59.671795 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:59.671795 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:59.671795 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:59.671795 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:59.673015 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:59.673015 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:59.673015 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:59.673015 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:59.673015 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:46:59.673015 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:46:59.673015 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:59.673015 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:59.673015 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:46:59.673015 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:46:59.673015 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 25 12:46:59.673015 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:46:59.673015 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 09cf99e5-8a8b-4c13-9a33-561c34b06d45 could not be found. Jul 25 12:46:59.673015 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:59.673015 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:59.673015 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:59.673015 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:59.673015 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:59.673015 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:59.673015 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:59.674232 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:59.674232 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 09cf99e5-8a8b-4c13-9a33-561c34b06d45 could not be found. Jul 25 12:46:59.674232 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:59.674232 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0e83b7ad-4a06-4d50-85c8-abb42faf0155 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Returning 404 to user: Service 09cf99e5-8a8b-4c13-9a33-561c34b06d45 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:59.676191 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0e83b7ad-4a06-4d50-85c8-abb42faf0155 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-services/09cf99e5-8a8b-4c13-9a33-561c34b06d45" status: 404 len: 110 microversion: 2.53 time: 0.821283 Jul 25 12:46:59.681322 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1064/2215] 10.222.0.49 () {62 vars in 1309 bytes} [Mon Jul 25 12:46:58 2022] PUT /compute/v2.1/os-services/09cf99e5-8a8b-4c13-9a33-561c34b06d45 => generated 110 bytes in 830 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:46:59.705570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a1695ee5-bf2a-445b-bc30-2b58d13e9c82 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Action: 'update', calling method: .version_select at 0x7efcf9939310>, body: {"status": "disabled"} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:59.713855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a1695ee5-bf2a-445b-bc30-2b58d13e9c82 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:59.714326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a1695ee5-bf2a-445b-bc30-2b58d13e9c82 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:59.754394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e6356d73-e83a-4b60-908f-7a7b83a6b77a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:46:59.755538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e6356d73-e83a-4b60-908f-7a7b83a6b77a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:46:59.756170 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e6356d73-e83a-4b60-908f-7a7b83a6b77a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:46:59.758037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a1695ee5-bf2a-445b-bc30-2b58d13e9c82 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:59.758417 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a1695ee5-bf2a-445b-bc30-2b58d13e9c82 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:59.759658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e6356d73-e83a-4b60-908f-7a7b83a6b77a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:46:59.760120 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e6356d73-e83a-4b60-908f-7a7b83a6b77a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:46:59.776786 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-a1695ee5-bf2a-445b-bc30-2b58d13e9c82 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] HTTP exception thrown: Service 09cf99e5-8a8b-4c13-9a33-561c34b06d45 could not be found. Jul 25 12:46:59.785215 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e6356d73-e83a-4b60-908f-7a7b83a6b77a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:59.785914 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e6356d73-e83a-4b60-908f-7a7b83a6b77a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:59.786973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e6356d73-e83a-4b60-908f-7a7b83a6b77a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:59.787578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e6356d73-e83a-4b60-908f-7a7b83a6b77a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:59.787780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a1695ee5-bf2a-445b-bc30-2b58d13e9c82 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Request method failure captured: Jul 25 12:46:59.787780 n-d-848886-15 devstack@n-api.service[125883]: request: PUT /compute/v2.1/os-services/09cf99e5-8a8b-4c13-9a33-561c34b06d45 HTTP/1.1 Jul 25 12:46:59.787780 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:46:59.787780 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:46:59.787780 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:46:59.787780 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 22 Jul 25 12:46:59.787780 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:46:59.787780 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:46:59.787780 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:46:59.787780 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:59.787780 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDC9bwWjrD0GuOV8B3-Zz1nJPYkh6IE1v89GupPmOrvLIiynh_FZajCKa11ZOHQQS4MINE82CgS1s_VpsHcqEsdV5_qVjBVD19SnrWpX6cY1oPF-L1gfsX9mPha0wHl5xTPO1CqF62djm930asYpJwafWAl0GzZoROUZz-rcstjH0c Jul 25 12:46:59.787780 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:46:59.787780 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:46:59.787780 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:46:59.787780 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:46:59.787780 n-d-848886-15 devstack@n-api.service[125883]: X-Openstack-Nova-Api-Version: 2.53 Jul 25 12:46:59.787780 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:46:59.787780 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:46:59.787780 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 28357d21aac0443b87a0ca6939c3569b Jul 25 12:46:59.787780 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1291693739 Jul 25 12:46:59.787780 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:46:59.787780 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:46:59.789104 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_28357d21aac0443b87a0ca6939c3569b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/28357d21aac0443b87a0ca6939c3569b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/28357d21aac0443b87a0ca6939c3569b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/28357d21aac0443b87a0ca6939c3569b"}]}] Jul 25 12:46:59.789104 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1291693739 Jul 25 12:46:59.789104 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 28357d21aac0443b87a0ca6939c3569b Jul 25 12:46:59.789104 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1291693739 Jul 25 12:46:59.789104 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin Jul 25 12:46:59.789104 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:46:59.789104 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:46:59.789104 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 03bceeb79dbd45089b24c947045e726e Jul 25 12:46:59.789104 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin Jul 25 12:46:59.789104 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:46:59.789104 n-d-848886-15 devstack@n-api.service[125883]: {"status": "disabled"} Jul 25 12:46:59.789104 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:46:59.789104 n-d-848886-15 devstack@n-api.service[125883]: exception: Service 09cf99e5-8a8b-4c13-9a33-561c34b06d45 could not be found. Jul 25 12:46:59.789104 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '09cf99e5-8a8b-4c13-9a33-561c34b06d45', 'body': {'status': 'disabled'}} Jul 25 12:46:59.789966 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:59.789966 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:59.789966 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 25 12:46:59.789966 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 25 12:46:59.789966 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 25 12:46:59.789966 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 25 12:46:59.789966 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 25 12:46:59.789966 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:59.789966 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:59.789966 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:59.789966 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:59.789966 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 25 12:46:59.789966 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 25 12:46:59.789966 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 25 12:46:59.789966 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:46:59.789966 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 09cf99e5-8a8b-4c13-9a33-561c34b06d45 could not be found. Jul 25 12:46:59.789966 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:59.789966 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:59.789966 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:59.789966 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:59.789966 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:59.791241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:59.791241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:59.791241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:59.791241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:46:59.791241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:46:59.791241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:59.791241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:59.791241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:46:59.791241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:46:59.791241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 25 12:46:59.791241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:46:59.791241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 09cf99e5-8a8b-4c13-9a33-561c34b06d45 could not be found. Jul 25 12:46:59.791241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:59.791241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:59.791241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:59.791241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:59.791241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:59.791241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:59.791241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:59.791241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:59.792426 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 09cf99e5-8a8b-4c13-9a33-561c34b06d45 could not be found. Jul 25 12:46:59.792426 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:59.792426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a1695ee5-bf2a-445b-bc30-2b58d13e9c82 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Returning 404 to user: Service 09cf99e5-8a8b-4c13-9a33-561c34b06d45 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:59.792426 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a1695ee5-bf2a-445b-bc30-2b58d13e9c82 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-services/09cf99e5-8a8b-4c13-9a33-561c34b06d45" status: 404 len: 110 microversion: 2.53 time: 0.103085 Jul 25 12:46:59.795665 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1065/2216] 10.222.0.49 () {62 vars in 1309 bytes} [Mon Jul 25 12:46:59 2022] PUT /compute/v2.1/os-services/09cf99e5-8a8b-4c13-9a33-561c34b06d45 => generated 110 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:46:59.802708 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-45326b4c-4396-4c07-84b7-d12ce7fede88 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Action: 'update', calling method: .version_select at 0x7efcf9d70af0>, body: {"status": "enabled"} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:59.819158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-45326b4c-4396-4c07-84b7-d12ce7fede88 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:59.826600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-45326b4c-4396-4c07-84b7-d12ce7fede88 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:59.836562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-e6356d73-e83a-4b60-908f-7a7b83a6b77a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Getting quotas for project e5f95fba8dde4f3b8f9ba08feb0d593a. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:46:59.849342 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-45326b4c-4396-4c07-84b7-d12ce7fede88 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:59.853241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-e6356d73-e83a-4b60-908f-7a7b83a6b77a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Getting quotas for user ad9439fbab1a4ae58f9a9b48f00e2c82 and project e5f95fba8dde4f3b8f9ba08feb0d593a. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:46:59.855606 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-45326b4c-4396-4c07-84b7-d12ce7fede88 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:59.876042 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-45326b4c-4396-4c07-84b7-d12ce7fede88 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] HTTP exception thrown: Service 09cf99e5-8a8b-4c13-9a33-561c34b06d45 could not be found. Jul 25 12:46:59.883818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-45326b4c-4396-4c07-84b7-d12ce7fede88 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Request method failure captured: Jul 25 12:46:59.883818 n-d-848886-15 devstack@n-api.service[125883]: request: PUT /compute/v2.1/os-services/09cf99e5-8a8b-4c13-9a33-561c34b06d45 HTTP/1.1 Jul 25 12:46:59.883818 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:46:59.883818 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:46:59.883818 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:46:59.883818 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 21 Jul 25 12:46:59.883818 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:46:59.883818 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:46:59.883818 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:46:59.883818 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:59.883818 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDC9bwWjrD0GuOV8B3-Zz1nJPYkh6IE1v89GupPmOrvLIiynh_FZajCKa11ZOHQQS4MINE82CgS1s_VpsHcqEsdV5_qVjBVD19SnrWpX6cY1oPF-L1gfsX9mPha0wHl5xTPO1CqF62djm930asYpJwafWAl0GzZoROUZz-rcstjH0c Jul 25 12:46:59.883818 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:46:59.883818 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:46:59.883818 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:46:59.883818 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:46:59.883818 n-d-848886-15 devstack@n-api.service[125883]: X-Openstack-Nova-Api-Version: 2.53 Jul 25 12:46:59.883818 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:46:59.883818 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:46:59.883818 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 28357d21aac0443b87a0ca6939c3569b Jul 25 12:46:59.883818 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1291693739 Jul 25 12:46:59.883818 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:46:59.883818 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:46:59.885324 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_28357d21aac0443b87a0ca6939c3569b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/28357d21aac0443b87a0ca6939c3569b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/28357d21aac0443b87a0ca6939c3569b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/28357d21aac0443b87a0ca6939c3569b"}]}] Jul 25 12:46:59.885324 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1291693739 Jul 25 12:46:59.885324 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 28357d21aac0443b87a0ca6939c3569b Jul 25 12:46:59.885324 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1291693739 Jul 25 12:46:59.885324 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin Jul 25 12:46:59.885324 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:46:59.885324 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:46:59.885324 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 03bceeb79dbd45089b24c947045e726e Jul 25 12:46:59.885324 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin Jul 25 12:46:59.885324 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:46:59.885324 n-d-848886-15 devstack@n-api.service[125883]: {"status": "enabled"} Jul 25 12:46:59.885324 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:46:59.885324 n-d-848886-15 devstack@n-api.service[125883]: exception: Service 09cf99e5-8a8b-4c13-9a33-561c34b06d45 could not be found. Jul 25 12:46:59.885324 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '09cf99e5-8a8b-4c13-9a33-561c34b06d45', 'body': {'status': 'enabled'}} Jul 25 12:46:59.886221 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:59.886221 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:59.886221 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 25 12:46:59.886221 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 25 12:46:59.886221 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 25 12:46:59.886221 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 25 12:46:59.886221 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 25 12:46:59.886221 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:59.886221 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:59.886221 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:59.886221 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:59.886221 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 25 12:46:59.886221 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 25 12:46:59.886221 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 25 12:46:59.886221 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:46:59.886221 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 09cf99e5-8a8b-4c13-9a33-561c34b06d45 could not be found. Jul 25 12:46:59.886221 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:59.886221 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:59.886221 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:59.886221 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:59.886221 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:59.887455 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:59.887455 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:59.887455 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:59.887455 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:46:59.887455 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:46:59.887455 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:59.887455 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:59.887455 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:46:59.887455 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:46:59.887455 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 25 12:46:59.887455 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:46:59.887455 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 09cf99e5-8a8b-4c13-9a33-561c34b06d45 could not be found. Jul 25 12:46:59.887455 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:59.887455 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:59.887455 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:59.887455 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:59.887455 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:59.887455 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:59.887455 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:59.887455 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:59.888565 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 09cf99e5-8a8b-4c13-9a33-561c34b06d45 could not be found. Jul 25 12:46:59.888565 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:46:59.889650 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e6356d73-e83a-4b60-908f-7a7b83a6b77a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:46:59.891758 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-45326b4c-4396-4c07-84b7-d12ce7fede88 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Returning 404 to user: Service 09cf99e5-8a8b-4c13-9a33-561c34b06d45 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:59.894487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e6356d73-e83a-4b60-908f-7a7b83a6b77a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 0f10bdfd-d085-4e27-8681-4f324045e884] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:46:59.900057 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-45326b4c-4396-4c07-84b7-d12ce7fede88 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-services/09cf99e5-8a8b-4c13-9a33-561c34b06d45" status: 404 len: 110 microversion: 2.53 time: 0.098335 Jul 25 12:46:59.906104 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1066/2217] 10.222.0.49 () {62 vars in 1309 bytes} [Mon Jul 25 12:46:59 2022] PUT /compute/v2.1/os-services/09cf99e5-8a8b-4c13-9a33-561c34b06d45 => generated 110 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 25 12:46:59.915234 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ccba6cb9-d3ab-437b-84ee-7b1e6e391508 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:59.928317 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:46:59.928317 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:46:59.933659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ccba6cb9-d3ab-437b-84ee-7b1e6e391508 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:59.934223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ccba6cb9-d3ab-437b-84ee-7b1e6e391508 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:59.935981 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ccba6cb9-d3ab-437b-84ee-7b1e6e391508 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:59.939334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ccba6cb9-d3ab-437b-84ee-7b1e6e391508 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:00.014227 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e6356d73-e83a-4b60-908f-7a7b83a6b77a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.746505 Jul 25 12:47:00.024119 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1152/2218] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Jul 25 12:46:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 25 12:47:00.040183 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ccba6cb9-d3ab-437b-84ee-7b1e6e391508 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.128167 Jul 25 12:47:00.051361 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1067/2219] 10.222.0.49 () {60 vars in 1178 bytes} [Mon Jul 25 12:46:59 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:00.057973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-60fda894-7cae-460f-9eff-f18057b02d05 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:00.058937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-60fda894-7cae-460f-9eff-f18057b02d05 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 0f10bdfd-d085-4e27-8681-4f324045e884] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:00.060358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f33459d4-9b52-4d20-9c17-e10a4af5d9db tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:00.074359 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:47:00.074359 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:47:00.074359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f33459d4-9b52-4d20-9c17-e10a4af5d9db tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:00.074359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f33459d4-9b52-4d20-9c17-e10a4af5d9db tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:00.082280 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f33459d4-9b52-4d20-9c17-e10a4af5d9db tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:00.082753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f33459d4-9b52-4d20-9c17-e10a4af5d9db tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:00.166827 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f33459d4-9b52-4d20-9c17-e10a4af5d9db tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.113291 Jul 25 12:47:00.167507 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1068/2220] 10.222.0.49 () {60 vars in 1211 bytes} [Mon Jul 25 12:47:00 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:00.188663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dafdc525-a1df-40e2-9ea9-f3f34e6f5347 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:00.199180 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:47:00.199180 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:47:00.200697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dafdc525-a1df-40e2-9ea9-f3f34e6f5347 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:00.201156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dafdc525-a1df-40e2-9ea9-f3f34e6f5347 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:00.207749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dafdc525-a1df-40e2-9ea9-f3f34e6f5347 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:00.208418 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dafdc525-a1df-40e2-9ea9-f3f34e6f5347 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:00.272669 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dafdc525-a1df-40e2-9ea9-f3f34e6f5347 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.092371 Jul 25 12:47:00.283247 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1069/2221] 10.222.0.49 () {60 vars in 1178 bytes} [Mon Jul 25 12:47:00 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:00.288933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aab33920-f214-4b41-902f-e20de4681b6f tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:00.292031 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:47:00.292031 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:47:00.294624 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aab33920-f214-4b41-902f-e20de4681b6f tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:00.295303 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aab33920-f214-4b41-902f-e20de4681b6f tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:00.296326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aab33920-f214-4b41-902f-e20de4681b6f tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:00.296992 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aab33920-f214-4b41-902f-e20de4681b6f tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:00.331608 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aab33920-f214-4b41-902f-e20de4681b6f tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?host=n-d-848886-15&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.046418 Jul 25 12:47:00.341084 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1070/2222] 10.222.0.49 () {60 vars in 1237 bytes} [Mon Jul 25 12:47:00 2022] GET /compute/v2.1/os-services?host=n-d-848886-15&binary=xxx => generated 16 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:00.348091 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8d0f5067-b73b-491f-bf7b-cb96e411f154 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:00.351646 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:47:00.351646 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:47:00.352940 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d0f5067-b73b-491f-bf7b-cb96e411f154 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:00.353744 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d0f5067-b73b-491f-bf7b-cb96e411f154 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:00.354953 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d0f5067-b73b-491f-bf7b-cb96e411f154 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:00.355574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d0f5067-b73b-491f-bf7b-cb96e411f154 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:00.387409 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8d0f5067-b73b-491f-bf7b-cb96e411f154 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.044315 Jul 25 12:47:00.395600 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1071/2223] 10.222.0.49 () {60 vars in 1178 bytes} [Mon Jul 25 12:47:00 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:00.401330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-54057b22-f09b-475a-99f7-863f82a49bf7 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:00.404901 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:47:00.404901 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:47:00.407539 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54057b22-f09b-475a-99f7-863f82a49bf7 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:00.408226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54057b22-f09b-475a-99f7-863f82a49bf7 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:00.409878 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54057b22-f09b-475a-99f7-863f82a49bf7 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:00.410898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54057b22-f09b-475a-99f7-863f82a49bf7 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:00.425504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-60fda894-7cae-460f-9eff-f18057b02d05 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:00.440762 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-54057b22-f09b-475a-99f7-863f82a49bf7 tempest-ServicesAdminNegativeV253TestJSON-1291693739 tempest-ServicesAdminNegativeV253TestJSON-1291693739-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.043369 Jul 25 12:47:00.445465 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-60fda894-7cae-460f-9eff-f18057b02d05 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:00.447901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-60fda894-7cae-460f-9eff-f18057b02d05 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:00.449927 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1072/2224] 10.222.0.49 () {60 vars in 1239 bytes} [Mon Jul 25 12:47:00 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:00.459172 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-60fda894-7cae-460f-9eff-f18057b02d05 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/0f10bdfd-d085-4e27-8681-4f324045e884" status: 200 len: 1278 microversion: 2.47 time: 0.426875 Jul 25 12:47:00.459864 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1153/2225] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:00 2022] GET /compute/v2.1/servers/0f10bdfd-d085-4e27-8681-4f324045e884 => generated 1278 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:00.971946 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2c1990c4-e71d-4e47-b864-daa7f2fabca4 tempest-ServicesAdminNegativeV253TestJSON-712912969 tempest-ServicesAdminNegativeV253TestJSON-712912969-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:00.979541 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:47:00.979541 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:47:00.985242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2c1990c4-e71d-4e47-b864-daa7f2fabca4 tempest-ServicesAdminNegativeV253TestJSON-712912969 tempest-ServicesAdminNegativeV253TestJSON-712912969-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '1db5ab0f39c0413bbb4d05286b2b2e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6701d489755d4867aa9cfdb0eec8ba10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:00.995357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2c1990c4-e71d-4e47-b864-daa7f2fabca4 tempest-ServicesAdminNegativeV253TestJSON-712912969 tempest-ServicesAdminNegativeV253TestJSON-712912969-project] Request method failure captured: Jul 25 12:47:00.995357 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 25 12:47:00.995357 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:47:00.995357 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:47:00.995357 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:47:00.995357 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:47:00.995357 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:47:00.995357 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:47:00.995357 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:47:00.995357 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:00.995357 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDAcsBcSyc_mqzPf2qqLVtOVhaBKMEX7mqEl7qHnZcy3HxhVaCpT9qgANKajcLXi4P8ftoGgPkx3lqUNfoDhut3zVW1bZIZV2jgm_E1DM1KweNkj0NdY3uQWsvuC6LgWjAMUI0xtpVA70TfWzVTyK9DsPHc0zub-60W5hmSSWShCyM Jul 25 12:47:00.995357 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:47:00.995357 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:47:00.995357 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:47:00.995357 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:47:00.995357 n-d-848886-15 devstack@n-api.service[125883]: X-Openstack-Nova-Api-Version: 2.53 Jul 25 12:47:00.995357 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:47:00.995357 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:47:00.995357 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 6701d489755d4867aa9cfdb0eec8ba10 Jul 25 12:47:00.995357 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-712912969 Jul 25 12:47:00.995357 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:47:00.995357 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:47:00.996635 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6701d489755d4867aa9cfdb0eec8ba10", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6701d489755d4867aa9cfdb0eec8ba10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6701d489755d4867aa9cfdb0eec8ba10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6701d489755d4867aa9cfdb0eec8ba10"}]}] Jul 25 12:47:00.996635 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-712912969 Jul 25 12:47:00.996635 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 6701d489755d4867aa9cfdb0eec8ba10 Jul 25 12:47:00.996635 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-712912969 Jul 25 12:47:00.996635 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServicesAdminNegativeV253TestJSON-712912969-project Jul 25 12:47:00.996635 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:47:00.996635 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:47:00.996635 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 1db5ab0f39c0413bbb4d05286b2b2e19 Jul 25 12:47:00.996635 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-712912969-project Jul 25 12:47:00.996635 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:47:00.996635 n-d-848886-15 devstack@n-api.service[125883]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 12:47:00.996635 n-d-848886-15 devstack@n-api.service[125883]: action_args: {} Jul 25 12:47:00.997250 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:00.997250 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:00.997250 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:00.997250 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:00.997250 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:00.997250 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:00.997250 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 12:47:00.997250 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:00.997250 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 12:47:00.997250 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:00.997250 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:00.997250 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:00.997250 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 25 12:47:00.997250 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 25 12:47:00.997250 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:47:00.997250 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:47:00.997250 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:47:00.997250 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:47:00.997250 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:47:00.998268 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:47:00.998268 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:47:00.998268 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:47:00.998268 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:47:00.998268 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:47:00.998268 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:47:00.998268 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:47:00.998268 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:47:00.998268 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:47:00.998268 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 12:47:00.998268 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:00.998268 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:00.998268 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:00.998268 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:00.998268 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:00.998268 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:00.998268 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:47:00.998268 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:47:00.998268 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 12:47:00.998268 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:01.004948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2c1990c4-e71d-4e47-b864-daa7f2fabca4 tempest-ServicesAdminNegativeV253TestJSON-712912969 tempest-ServicesAdminNegativeV253TestJSON-712912969-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:01.007416 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2c1990c4-e71d-4e47-b864-daa7f2fabca4 tempest-ServicesAdminNegativeV253TestJSON-712912969 tempest-ServicesAdminNegativeV253TestJSON-712912969-project] 10.222.0.49 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.555913 Jul 25 12:47:01.016672 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1073/2226] 10.222.0.49 () {60 vars in 1178 bytes} [Mon Jul 25 12:47:00 2022] GET /compute/v2.1/os-services => generated 112 bytes in 566 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:47:01.035216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-679bd7a1-5859-4424-a707-0b79589386d9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1425599717", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": "none"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:01.162591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-679bd7a1-5859-4424-a707-0b79589386d9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:47:01.163477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-679bd7a1-5859-4424-a707-0b79589386d9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:47:01.165463 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-679bd7a1-5859-4424-a707-0b79589386d9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:47:01.166688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-679bd7a1-5859-4424-a707-0b79589386d9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:47:01.168248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-679bd7a1-5859-4424-a707-0b79589386d9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:47:01.202450 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-679bd7a1-5859-4424-a707-0b79589386d9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:01.204356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-679bd7a1-5859-4424-a707-0b79589386d9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:01.208969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-679bd7a1-5859-4424-a707-0b79589386d9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:01.210609 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-679bd7a1-5859-4424-a707-0b79589386d9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:01.240356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-679bd7a1-5859-4424-a707-0b79589386d9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Getting quotas for project e5f95fba8dde4f3b8f9ba08feb0d593a. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:47:01.246373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-679bd7a1-5859-4424-a707-0b79589386d9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Getting quotas for user ad9439fbab1a4ae58f9a9b48f00e2c82 and project e5f95fba8dde4f3b8f9ba08feb0d593a. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:47:01.281177 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-679bd7a1-5859-4424-a707-0b79589386d9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:47:01.287740 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-679bd7a1-5859-4424-a707-0b79589386d9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:47:01.458934 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-679bd7a1-5859-4424-a707-0b79589386d9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.428578 Jul 25 12:47:01.459659 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1154/2227] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Jul 25 12:47:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 430 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 12:47:01.472100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b96d7389-9883-4f43-b04c-2a10f849ef4b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:01.480778 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b96d7389-9883-4f43-b04c-2a10f849ef4b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:01.570817 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b96d7389-9883-4f43-b04c-2a10f849ef4b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "PUT /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 992 microversion: 2.47 time: 0.102629 Jul 25 12:47:01.572966 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1074/2228] 10.222.0.49 () {62 vars in 1297 bytes} [Mon Jul 25 12:47:01 2022] PUT /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 992 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:47:01.592057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f9cc1693-7eeb-40bb-bff5-19f2a92f4a77 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:01.596245 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f9cc1693-7eeb-40bb-bff5-19f2a92f4a77 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:01.911272 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f9cc1693-7eeb-40bb-bff5-19f2a92f4a77 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:01.919722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f9cc1693-7eeb-40bb-bff5-19f2a92f4a77 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:01.921376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f9cc1693-7eeb-40bb-bff5-19f2a92f4a77 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:01.923700 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f9cc1693-7eeb-40bb-bff5-19f2a92f4a77 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1278 microversion: 2.47 time: 0.336762 Jul 25 12:47:01.947161 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1155/2229] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:01 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1278 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:47:02.954110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e90445ac-0975-4a56-aa43-937ceb7aea58 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:02.954765 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e90445ac-0975-4a56-aa43-937ceb7aea58 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:02.975302 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e90445ac-0975-4a56-aa43-937ceb7aea58 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:02.977813 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e90445ac-0975-4a56-aa43-937ceb7aea58 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:02.981177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e90445ac-0975-4a56-aa43-937ceb7aea58 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:02.981787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e90445ac-0975-4a56-aa43-937ceb7aea58 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:03.066904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:03.160308 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e90445ac-0975-4a56-aa43-937ceb7aea58 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:03.170018 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e90445ac-0975-4a56-aa43-937ceb7aea58 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:03.172193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e90445ac-0975-4a56-aa43-937ceb7aea58 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:03.174382 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e90445ac-0975-4a56-aa43-937ceb7aea58 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1330 microversion: 2.47 time: 0.228179 Jul 25 12:47:03.175767 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1075/2230] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:02 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1330 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:04.202511 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aedcc804-d7e1-4858-beaa-caefa52da18d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:04.203428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-aedcc804-d7e1-4858-beaa-caefa52da18d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:04.221943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aedcc804-d7e1-4858-beaa-caefa52da18d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:04.222530 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aedcc804-d7e1-4858-beaa-caefa52da18d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:04.223333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aedcc804-d7e1-4858-beaa-caefa52da18d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:04.223862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aedcc804-d7e1-4858-beaa-caefa52da18d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:04.614333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-aedcc804-d7e1-4858-beaa-caefa52da18d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:04.647320 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-aedcc804-d7e1-4858-beaa-caefa52da18d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:04.659451 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-aedcc804-d7e1-4858-beaa-caefa52da18d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:04.663422 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-aedcc804-d7e1-4858-beaa-caefa52da18d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1336 microversion: 2.47 time: 0.464206 Jul 25 12:47:04.665674 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1156/2231] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:04 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1336 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:04.816841 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b728500e-65ce-4e6d-8f4e-e7b45832477b tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:04.819247 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b728500e-65ce-4e6d-8f4e-e7b45832477b tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:04.827089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b728500e-65ce-4e6d-8f4e-e7b45832477b tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:04.827861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b728500e-65ce-4e6d-8f4e-e7b45832477b tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:04.828800 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b728500e-65ce-4e6d-8f4e-e7b45832477b tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:04.842278 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b728500e-65ce-4e6d-8f4e-e7b45832477b tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:04.909343 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b728500e-65ce-4e6d-8f4e-e7b45832477b tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096424 Jul 25 12:47:04.910262 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1076/2232] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 12:47:04 2022] GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:47:05.022154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-57beb432-57dc-4f95-b558-44a66af231b3 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:05.025607 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-57beb432-57dc-4f95-b558-44a66af231b3 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:05.034432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57beb432-57dc-4f95-b558-44a66af231b3 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:05.035185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57beb432-57dc-4f95-b558-44a66af231b3 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:05.037192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57beb432-57dc-4f95-b558-44a66af231b3 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:05.038195 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57beb432-57dc-4f95-b558-44a66af231b3 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:05.086601 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-57beb432-57dc-4f95-b558-44a66af231b3 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069443 Jul 25 12:47:05.094324 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1157/2233] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 12:47:05 2022] GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:47:05.184381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0b425b31-7efb-4999-a87c-3f57763dd771 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:05.185125 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0b425b31-7efb-4999-a87c-3f57763dd771 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:05.187589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:05.199485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b425b31-7efb-4999-a87c-3f57763dd771 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:05.200436 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b425b31-7efb-4999-a87c-3f57763dd771 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:05.201691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b425b31-7efb-4999-a87c-3f57763dd771 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:05.203173 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b425b31-7efb-4999-a87c-3f57763dd771 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:05.239423 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0b425b31-7efb-4999-a87c-3f57763dd771 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:47:05.264918 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:05.289725 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-62637f2b-fc11-49c4-a05a-0ade2d8ecfe3 tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] Calling method '.version_select at 0x7efcfed74d30>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:05.323329 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-62637f2b-fc11-49c4-a05a-0ade2d8ecfe3 tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] HTTP exception thrown: Image not found. Jul 25 12:47:05.329601 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-62637f2b-fc11-49c4-a05a-0ade2d8ecfe3 tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] Request method failure captured: Jul 25 12:47:05.329601 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/images/c6a32515-15c0-48e8-9627-05ba9d963a1f/metadata/os_distro HTTP/1.1 Jul 25 12:47:05.329601 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:47:05.329601 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:47:05.329601 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:47:05.329601 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:47:05.329601 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:47:05.329601 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:47:05.329601 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:47:05.329601 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:05.329601 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDIyFV_erfFsURB4H5VpRX_oF9Ecv_jaHajLOoFtKIA0GqXlWiJg2EWUBmtKRpD2UnE96WF9zVuzmFGHk4mEc6hvIvtMC7cOx1w5IO7JRyVGaAsedXBtrdSxL7UtzZuruSBsa60jtTVdo9-cwOHD_Y1q0ufq43vBmCp88ckncd_PUk Jul 25 12:47:05.329601 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:47:05.329601 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:47:05.329601 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:47:05.329601 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:47:05.329601 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:47:05.329601 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:47:05.329601 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 30dc7d8433ac4f3c81d2f3e798929bfd Jul 25 12:47:05.329601 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1885791776 Jul 25 12:47:05.329601 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:47:05.329601 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:47:05.331019 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_30dc7d8433ac4f3c81d2f3e798929bfd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/30dc7d8433ac4f3c81d2f3e798929bfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30dc7d8433ac4f3c81d2f3e798929bfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30dc7d8433ac4f3c81d2f3e798929bfd"}]}] Jul 25 12:47:05.331019 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1885791776 Jul 25 12:47:05.331019 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 30dc7d8433ac4f3c81d2f3e798929bfd Jul 25 12:47:05.331019 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1885791776 Jul 25 12:47:05.331019 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ImagesMetadataNegativeTestJSON-1885791776-project Jul 25 12:47:05.331019 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:47:05.331019 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:47:05.331019 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: b3bfbf8e85d049c285474b82ade8cdf1 Jul 25 12:47:05.331019 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1885791776-project Jul 25 12:47:05.331019 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:47:05.331019 n-d-848886-15 devstack@n-api.service[125883]: exception: Image not found. Jul 25 12:47:05.331019 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'image_id': 'c6a32515-15c0-48e8-9627-05ba9d963a1f', 'id': 'os_distro'} Jul 25 12:47:05.331019 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:05.332027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.332027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 12:47:05.332027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 12:47:05.332027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:47:05.332027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:47:05.332027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 12:47:05.332027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 12:47:05.332027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:47:05.332027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:47:05.332027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 12:47:05.332027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 12:47:05.332027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 12:47:05.332027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 12:47:05.332027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:47:05.332027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:47:05.332027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:47:05.332027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:47:05.332027 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c6a32515-15c0-48e8-9627-05ba9d963a1f Jul 25 12:47:05.333140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.333140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:05.333140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.333140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.333140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 12:47:05.333140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 12:47:05.333140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 12:47:05.333140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 12:47:05.333140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 12:47:05.333140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 12:47:05.333140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 12:47:05.333140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 12:47:05.333140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 12:47:05.333140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 12:47:05.333140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:47:05.333140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:47:05.333140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 12:47:05.333140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 12:47:05.333140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:47:05.333140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:47:05.334462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 12:47:05.334462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 12:47:05.334462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 12:47:05.334462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 12:47:05.334462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:47:05.334462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:47:05.334462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:47:05.334462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:47:05.334462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c6a32515-15c0-48e8-9627-05ba9d963a1f could not be found. Jul 25 12:47:05.334462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.334462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:05.334462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.334462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.334462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:05.334462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:05.334462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:05.334462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:05.334462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:47:05.334462 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:47:05.335744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:05.335744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:05.335744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 25 12:47:05.335744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 25 12:47:05.335744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 12:47:05.335744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 12:47:05.335744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 12:47:05.335744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.335744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:05.335744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.335744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.335744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:05.335744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:05.335744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:05.335744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:05.335744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 12:47:05.335744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.338492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-62637f2b-fc11-49c4-a05a-0ade2d8ecfe3 tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] Returning 404 to user: Image not found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:05.339538 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-62637f2b-fc11-49c4-a05a-0ade2d8ecfe3 tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] 10.222.0.49 "DELETE /compute/v2.1/images/c6a32515-15c0-48e8-9627-05ba9d963a1f/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.294927 Jul 25 12:47:05.340641 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1077/2234] 10.222.0.49 () {58 vars in 1293 bytes} [Mon Jul 25 12:47:05 2022] DELETE /compute/v2.1/images/c6a32515-15c0-48e8-9627-05ba9d963a1f/metadata/os_distro => generated 62 bytes in 296 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:47:05.351371 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-430d4e45-f4ba-4f68-9fd5-babe22448eea tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] Calling method '.version_select at 0x7efcf9ec8c10>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:05.383057 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-430d4e45-f4ba-4f68-9fd5-babe22448eea tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] HTTP exception thrown: Image not found. Jul 25 12:47:05.385711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-430d4e45-f4ba-4f68-9fd5-babe22448eea tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] Request method failure captured: Jul 25 12:47:05.385711 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/images/50e42f12-ee6f-47e1-82de-850aeafda998/metadata/os_version HTTP/1.1 Jul 25 12:47:05.385711 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:47:05.385711 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:47:05.385711 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:47:05.385711 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:47:05.385711 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:47:05.385711 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:47:05.385711 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:47:05.385711 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:05.385711 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDIyFV_erfFsURB4H5VpRX_oF9Ecv_jaHajLOoFtKIA0GqXlWiJg2EWUBmtKRpD2UnE96WF9zVuzmFGHk4mEc6hvIvtMC7cOx1w5IO7JRyVGaAsedXBtrdSxL7UtzZuruSBsa60jtTVdo9-cwOHD_Y1q0ufq43vBmCp88ckncd_PUk Jul 25 12:47:05.385711 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:47:05.385711 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:47:05.385711 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:47:05.385711 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:47:05.385711 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:47:05.385711 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:47:05.385711 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 30dc7d8433ac4f3c81d2f3e798929bfd Jul 25 12:47:05.385711 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1885791776 Jul 25 12:47:05.385711 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:47:05.385711 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:47:05.387035 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_30dc7d8433ac4f3c81d2f3e798929bfd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/30dc7d8433ac4f3c81d2f3e798929bfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30dc7d8433ac4f3c81d2f3e798929bfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30dc7d8433ac4f3c81d2f3e798929bfd"}]}] Jul 25 12:47:05.387035 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1885791776 Jul 25 12:47:05.387035 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 30dc7d8433ac4f3c81d2f3e798929bfd Jul 25 12:47:05.387035 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1885791776 Jul 25 12:47:05.387035 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ImagesMetadataNegativeTestJSON-1885791776-project Jul 25 12:47:05.387035 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:47:05.387035 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:47:05.387035 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: b3bfbf8e85d049c285474b82ade8cdf1 Jul 25 12:47:05.387035 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1885791776-project Jul 25 12:47:05.387035 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:47:05.387035 n-d-848886-15 devstack@n-api.service[125883]: exception: Image not found. Jul 25 12:47:05.387035 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'image_id': '50e42f12-ee6f-47e1-82de-850aeafda998', 'id': 'os_version'} Jul 25 12:47:05.387035 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:05.387684 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.387684 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 12:47:05.387684 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 12:47:05.387684 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:47:05.387684 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:47:05.387684 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 12:47:05.387684 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 12:47:05.387684 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:47:05.387684 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:47:05.387684 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 12:47:05.387684 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 12:47:05.387684 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 12:47:05.387684 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 12:47:05.387684 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:47:05.387684 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:47:05.387684 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:47:05.387684 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:47:05.387684 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 50e42f12-ee6f-47e1-82de-850aeafda998 Jul 25 12:47:05.388598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.388598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:05.388598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.388598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.388598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 12:47:05.388598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 12:47:05.388598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 12:47:05.388598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 12:47:05.388598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 12:47:05.388598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 12:47:05.388598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 12:47:05.388598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 12:47:05.388598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 12:47:05.388598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 12:47:05.388598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:47:05.388598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:47:05.388598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 12:47:05.388598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 12:47:05.388598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:47:05.388598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:47:05.389559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 12:47:05.389559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 12:47:05.389559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 12:47:05.389559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 12:47:05.389559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:47:05.389559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:47:05.389559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:47:05.389559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:47:05.389559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 50e42f12-ee6f-47e1-82de-850aeafda998 could not be found. Jul 25 12:47:05.389559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.389559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:05.389559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.389559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.389559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:05.389559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:05.389559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:05.389559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:05.389559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:47:05.389559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:47:05.390863 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:05.390863 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:05.390863 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 25 12:47:05.390863 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 25 12:47:05.390863 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 12:47:05.390863 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 12:47:05.390863 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 12:47:05.390863 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.390863 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:05.390863 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.390863 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.390863 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:05.390863 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:05.390863 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:05.390863 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:05.390863 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 12:47:05.390863 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.390863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-430d4e45-f4ba-4f68-9fd5-babe22448eea tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] Returning 404 to user: Image not found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:05.392055 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-430d4e45-f4ba-4f68-9fd5-babe22448eea tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] 10.222.0.49 "GET /compute/v2.1/images/50e42f12-ee6f-47e1-82de-850aeafda998/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.040822 Jul 25 12:47:05.392055 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1078/2235] 10.222.0.49 () {58 vars in 1293 bytes} [Mon Jul 25 12:47:05 2022] GET /compute/v2.1/images/50e42f12-ee6f-47e1-82de-850aeafda998/metadata/os_version => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:47:05.401459 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fd08aa3d-df26-48a0-86c6-554caf35a60c tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] Calling method '.version_select at 0x7efcf9d70550>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:05.403437 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0b425b31-7efb-4999-a87c-3f57763dd771 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e" status: 204 len: 0 microversion: 2.1 time: 0.222394 Jul 25 12:47:05.405156 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1158/2236] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:47:05 2022] DELETE /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:47:05.414510 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7653f5f7-65e6-4f25-87e0-87c218fc2995 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:05.415488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7653f5f7-65e6-4f25-87e0-87c218fc2995 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:05.422812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7653f5f7-65e6-4f25-87e0-87c218fc2995 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:05.423271 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7653f5f7-65e6-4f25-87e0-87c218fc2995 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:05.424052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7653f5f7-65e6-4f25-87e0-87c218fc2995 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:05.424482 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7653f5f7-65e6-4f25-87e0-87c218fc2995 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:05.425944 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-fd08aa3d-df26-48a0-86c6-554caf35a60c tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] HTTP exception thrown: Image not found. Jul 25 12:47:05.428846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fd08aa3d-df26-48a0-86c6-554caf35a60c tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] Request method failure captured: Jul 25 12:47:05.428846 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/images/e4b1f458-425f-4ca5-a7a9-f5f5b466c8db/metadata HTTP/1.1 Jul 25 12:47:05.428846 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:47:05.428846 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:47:05.428846 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:47:05.428846 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:47:05.428846 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:47:05.428846 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:47:05.428846 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:47:05.428846 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:05.428846 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDIyFV_erfFsURB4H5VpRX_oF9Ecv_jaHajLOoFtKIA0GqXlWiJg2EWUBmtKRpD2UnE96WF9zVuzmFGHk4mEc6hvIvtMC7cOx1w5IO7JRyVGaAsedXBtrdSxL7UtzZuruSBsa60jtTVdo9-cwOHD_Y1q0ufq43vBmCp88ckncd_PUk Jul 25 12:47:05.428846 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:47:05.428846 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:47:05.428846 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:47:05.428846 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:47:05.428846 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:47:05.428846 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:47:05.428846 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 30dc7d8433ac4f3c81d2f3e798929bfd Jul 25 12:47:05.428846 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1885791776 Jul 25 12:47:05.428846 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:47:05.428846 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:47:05.430411 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_30dc7d8433ac4f3c81d2f3e798929bfd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/30dc7d8433ac4f3c81d2f3e798929bfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30dc7d8433ac4f3c81d2f3e798929bfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30dc7d8433ac4f3c81d2f3e798929bfd"}]}] Jul 25 12:47:05.430411 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1885791776 Jul 25 12:47:05.430411 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 30dc7d8433ac4f3c81d2f3e798929bfd Jul 25 12:47:05.430411 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1885791776 Jul 25 12:47:05.430411 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ImagesMetadataNegativeTestJSON-1885791776-project Jul 25 12:47:05.430411 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:47:05.430411 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:47:05.430411 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: b3bfbf8e85d049c285474b82ade8cdf1 Jul 25 12:47:05.430411 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1885791776-project Jul 25 12:47:05.430411 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:47:05.430411 n-d-848886-15 devstack@n-api.service[125883]: exception: Image not found. Jul 25 12:47:05.430411 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'image_id': 'e4b1f458-425f-4ca5-a7a9-f5f5b466c8db'} Jul 25 12:47:05.430411 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:05.431307 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.431307 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 12:47:05.431307 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 12:47:05.431307 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:47:05.431307 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:47:05.431307 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 12:47:05.431307 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 12:47:05.431307 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:47:05.431307 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:47:05.431307 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 12:47:05.431307 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 12:47:05.431307 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 12:47:05.431307 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 12:47:05.431307 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:47:05.431307 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:47:05.431307 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:47:05.431307 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:47:05.431307 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e4b1f458-425f-4ca5-a7a9-f5f5b466c8db Jul 25 12:47:05.432419 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.432419 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:05.432419 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.432419 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.432419 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 12:47:05.432419 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 12:47:05.432419 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 12:47:05.432419 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 12:47:05.432419 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 12:47:05.432419 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 12:47:05.432419 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 12:47:05.432419 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 12:47:05.432419 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 12:47:05.432419 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 12:47:05.432419 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:47:05.432419 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:47:05.432419 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 12:47:05.432419 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 12:47:05.432419 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:47:05.432419 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:47:05.433599 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 12:47:05.433599 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 12:47:05.433599 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 12:47:05.433599 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 12:47:05.433599 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:47:05.433599 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:47:05.433599 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:47:05.433599 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:47:05.433599 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e4b1f458-425f-4ca5-a7a9-f5f5b466c8db could not be found. Jul 25 12:47:05.433599 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.433599 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:05.433599 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.433599 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.433599 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:05.433599 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:05.433599 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:05.433599 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:05.433599 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:47:05.433599 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:47:05.434659 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:05.434659 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:05.434659 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 25 12:47:05.434659 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 25 12:47:05.434659 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 12:47:05.434659 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 12:47:05.434659 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 12:47:05.434659 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.434659 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:05.434659 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.434659 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.434659 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:05.434659 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:05.434659 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:05.434659 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:05.434659 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 12:47:05.434659 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.434659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fd08aa3d-df26-48a0-86c6-554caf35a60c tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] Returning 404 to user: Image not found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:05.435583 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fd08aa3d-df26-48a0-86c6-554caf35a60c tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] 10.222.0.49 "GET /compute/v2.1/images/e4b1f458-425f-4ca5-a7a9-f5f5b466c8db/metadata" status: 404 len: 62 microversion: 2.1 time: 0.036761 Jul 25 12:47:05.435583 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1079/2237] 10.222.0.49 () {58 vars in 1260 bytes} [Mon Jul 25 12:47:05 2022] GET /compute/v2.1/images/e4b1f458-425f-4ca5-a7a9-f5f5b466c8db/metadata => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 25 12:47:05.446352 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a7b48dd3-250c-4ba5-97cb-68f6323953af tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] Action: 'update_all', calling method: .version_select at 0x7efcf9e97310>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:05.484585 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-a7b48dd3-250c-4ba5-97cb-68f6323953af tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] HTTP exception thrown: Image not found. Jul 25 12:47:05.487806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a7b48dd3-250c-4ba5-97cb-68f6323953af tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] Request method failure captured: Jul 25 12:47:05.487806 n-d-848886-15 devstack@n-api.service[125883]: request: PUT /compute/v2.1/images/47559842-3b12-4338-b2fb-e341ffc28b2b/metadata HTTP/1.1 Jul 25 12:47:05.487806 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:47:05.487806 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:47:05.487806 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:47:05.487806 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 57 Jul 25 12:47:05.487806 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:47:05.487806 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:47:05.487806 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:47:05.487806 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:05.487806 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDIyFV_erfFsURB4H5VpRX_oF9Ecv_jaHajLOoFtKIA0GqXlWiJg2EWUBmtKRpD2UnE96WF9zVuzmFGHk4mEc6hvIvtMC7cOx1w5IO7JRyVGaAsedXBtrdSxL7UtzZuruSBsa60jtTVdo9-cwOHD_Y1q0ufq43vBmCp88ckncd_PUk Jul 25 12:47:05.487806 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:47:05.487806 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:47:05.487806 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:47:05.487806 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:47:05.487806 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:47:05.487806 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:47:05.487806 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 30dc7d8433ac4f3c81d2f3e798929bfd Jul 25 12:47:05.487806 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1885791776 Jul 25 12:47:05.487806 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:47:05.487806 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:47:05.489191 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_30dc7d8433ac4f3c81d2f3e798929bfd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/30dc7d8433ac4f3c81d2f3e798929bfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30dc7d8433ac4f3c81d2f3e798929bfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30dc7d8433ac4f3c81d2f3e798929bfd"}]}] Jul 25 12:47:05.489191 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1885791776 Jul 25 12:47:05.489191 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 30dc7d8433ac4f3c81d2f3e798929bfd Jul 25 12:47:05.489191 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1885791776 Jul 25 12:47:05.489191 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ImagesMetadataNegativeTestJSON-1885791776-project Jul 25 12:47:05.489191 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:47:05.489191 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:47:05.489191 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: b3bfbf8e85d049c285474b82ade8cdf1 Jul 25 12:47:05.489191 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1885791776-project Jul 25 12:47:05.489191 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:47:05.489191 n-d-848886-15 devstack@n-api.service[125883]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 25 12:47:05.489191 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:47:05.489191 n-d-848886-15 devstack@n-api.service[125883]: exception: Image not found. Jul 25 12:47:05.489191 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'image_id': '47559842-3b12-4338-b2fb-e341ffc28b2b', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 25 12:47:05.490191 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:05.490191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.490191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 12:47:05.490191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 12:47:05.490191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:47:05.490191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:47:05.490191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 12:47:05.490191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 12:47:05.490191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:47:05.490191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:47:05.490191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 12:47:05.490191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 12:47:05.490191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 12:47:05.490191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 12:47:05.490191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:47:05.490191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:47:05.490191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:47:05.490191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:47:05.491334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 47559842-3b12-4338-b2fb-e341ffc28b2b Jul 25 12:47:05.491334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.491334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:05.491334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.491334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.491334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 12:47:05.491334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 12:47:05.491334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 12:47:05.491334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 12:47:05.491334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 12:47:05.491334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 12:47:05.491334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 12:47:05.491334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 12:47:05.491334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 12:47:05.491334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 12:47:05.491334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:47:05.491334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:47:05.491334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 12:47:05.491334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 12:47:05.492494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:47:05.492494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:47:05.492494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 12:47:05.492494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 12:47:05.492494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 12:47:05.492494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 12:47:05.492494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:47:05.492494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:47:05.492494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:47:05.492494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:47:05.492494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 47559842-3b12-4338-b2fb-e341ffc28b2b could not be found. Jul 25 12:47:05.492494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.492494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:05.492494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.492494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.492494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:05.492494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:05.492494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:05.492494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:05.493636 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:47:05.493636 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:47:05.493636 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:05.493636 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:05.493636 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:05.493636 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:05.493636 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 25 12:47:05.493636 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 25 12:47:05.493636 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 12:47:05.493636 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 12:47:05.493636 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 12:47:05.493636 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.493636 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:05.493636 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.493636 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.493636 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:05.493636 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:05.493636 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:05.493636 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:05.493636 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 12:47:05.493636 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.496225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a7b48dd3-250c-4ba5-97cb-68f6323953af tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] Returning 404 to user: Image not found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:05.498016 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a7b48dd3-250c-4ba5-97cb-68f6323953af tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] 10.222.0.49 "PUT /compute/v2.1/images/47559842-3b12-4338-b2fb-e341ffc28b2b/metadata" status: 404 len: 62 microversion: 2.1 time: 0.060187 Jul 25 12:47:05.499177 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1080/2238] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 12:47:05 2022] PUT /compute/v2.1/images/47559842-3b12-4338-b2fb-e341ffc28b2b/metadata => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:47:05.508359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e2bd4bef-e8aa-411d-8c88-d139e9b6184a tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] Action: 'update', calling method: .version_select at 0x7efcfeccf280>, body: {"meta": {"os_distro": "alt"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:05.539709 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-e2bd4bef-e8aa-411d-8c88-d139e9b6184a tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] HTTP exception thrown: Image not found. Jul 25 12:47:05.541887 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e2bd4bef-e8aa-411d-8c88-d139e9b6184a tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] Request method failure captured: Jul 25 12:47:05.541887 n-d-848886-15 devstack@n-api.service[125883]: request: PUT /compute/v2.1/images/87c02851-b0a4-400f-98bf-810ebb1b82f9/metadata/os_distro HTTP/1.1 Jul 25 12:47:05.541887 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:47:05.541887 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:47:05.541887 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:47:05.541887 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 30 Jul 25 12:47:05.541887 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:47:05.541887 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:47:05.541887 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:47:05.541887 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:05.541887 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDIyFV_erfFsURB4H5VpRX_oF9Ecv_jaHajLOoFtKIA0GqXlWiJg2EWUBmtKRpD2UnE96WF9zVuzmFGHk4mEc6hvIvtMC7cOx1w5IO7JRyVGaAsedXBtrdSxL7UtzZuruSBsa60jtTVdo9-cwOHD_Y1q0ufq43vBmCp88ckncd_PUk Jul 25 12:47:05.541887 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:47:05.541887 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:47:05.541887 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:47:05.541887 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:47:05.541887 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:47:05.541887 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:47:05.541887 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 30dc7d8433ac4f3c81d2f3e798929bfd Jul 25 12:47:05.541887 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1885791776 Jul 25 12:47:05.541887 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:47:05.541887 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:47:05.542987 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_30dc7d8433ac4f3c81d2f3e798929bfd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/30dc7d8433ac4f3c81d2f3e798929bfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30dc7d8433ac4f3c81d2f3e798929bfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30dc7d8433ac4f3c81d2f3e798929bfd"}]}] Jul 25 12:47:05.542987 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1885791776 Jul 25 12:47:05.542987 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 30dc7d8433ac4f3c81d2f3e798929bfd Jul 25 12:47:05.542987 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1885791776 Jul 25 12:47:05.542987 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ImagesMetadataNegativeTestJSON-1885791776-project Jul 25 12:47:05.542987 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:47:05.542987 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:47:05.542987 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: b3bfbf8e85d049c285474b82ade8cdf1 Jul 25 12:47:05.542987 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1885791776-project Jul 25 12:47:05.542987 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:47:05.542987 n-d-848886-15 devstack@n-api.service[125883]: {"meta": {"os_distro": "alt"}} Jul 25 12:47:05.542987 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:47:05.542987 n-d-848886-15 devstack@n-api.service[125883]: exception: Image not found. Jul 25 12:47:05.542987 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'image_id': '87c02851-b0a4-400f-98bf-810ebb1b82f9', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 25 12:47:05.543864 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:05.543864 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.543864 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 12:47:05.543864 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 12:47:05.543864 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:47:05.543864 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:47:05.543864 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 12:47:05.543864 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 12:47:05.543864 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:47:05.543864 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:47:05.543864 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 12:47:05.543864 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 12:47:05.543864 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 12:47:05.543864 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 12:47:05.543864 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:47:05.543864 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:47:05.543864 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:47:05.543864 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:47:05.546658 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 87c02851-b0a4-400f-98bf-810ebb1b82f9 Jul 25 12:47:05.546658 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.546658 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:05.546658 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.546658 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.546658 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 12:47:05.546658 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 12:47:05.546658 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 12:47:05.546658 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 12:47:05.546658 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 12:47:05.546658 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 12:47:05.546658 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 12:47:05.546658 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 12:47:05.546658 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 12:47:05.546658 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 12:47:05.546658 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:47:05.546658 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:47:05.546658 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 12:47:05.546658 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 12:47:05.547606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:47:05.547606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:47:05.547606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 12:47:05.547606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 12:47:05.547606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 12:47:05.547606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 12:47:05.547606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:47:05.547606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:47:05.547606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:47:05.547606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:47:05.547606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 87c02851-b0a4-400f-98bf-810ebb1b82f9 could not be found. Jul 25 12:47:05.547606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.547606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:05.547606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.547606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.547606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:05.547606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:05.547606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:05.547606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:05.548527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:47:05.548527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:47:05.548527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:05.548527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:05.548527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:05.548527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:05.548527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 25 12:47:05.548527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 25 12:47:05.548527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 12:47:05.548527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 12:47:05.548527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 12:47:05.548527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.548527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:05.548527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.548527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.548527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:05.548527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:05.548527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:05.548527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:05.548527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 12:47:05.548527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.549561 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e2bd4bef-e8aa-411d-8c88-d139e9b6184a tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] Returning 404 to user: Image not found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:05.549561 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e2bd4bef-e8aa-411d-8c88-d139e9b6184a tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] 10.222.0.49 "PUT /compute/v2.1/images/87c02851-b0a4-400f-98bf-810ebb1b82f9/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.039018 Jul 25 12:47:05.549561 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1081/2239] 10.222.0.49 () {60 vars in 1310 bytes} [Mon Jul 25 12:47:05 2022] PUT /compute/v2.1/images/87c02851-b0a4-400f-98bf-810ebb1b82f9/metadata/os_distro => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 25 12:47:05.560577 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f5c598e0-96f5-4213-acbc-c8fc9b3bc86b tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] Action: 'create', calling method: .version_select at 0x7efcf96a1310>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:05.598174 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-f5c598e0-96f5-4213-acbc-c8fc9b3bc86b tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] HTTP exception thrown: Image not found. Jul 25 12:47:05.602376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7653f5f7-65e6-4f25-87e0-87c218fc2995 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929ae21affaf4eb9b8eba955745aa751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59f31c830d544129310056d267f465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:05.605090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f5c598e0-96f5-4213-acbc-c8fc9b3bc86b tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] Request method failure captured: Jul 25 12:47:05.605090 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/images/a1301ab0-d072-4db6-a55e-3a5b607f1b7d/metadata HTTP/1.1 Jul 25 12:47:05.605090 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:47:05.605090 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:47:05.605090 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:47:05.605090 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 57 Jul 25 12:47:05.605090 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:47:05.605090 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:47:05.605090 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:47:05.605090 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:05.605090 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDIyFV_erfFsURB4H5VpRX_oF9Ecv_jaHajLOoFtKIA0GqXlWiJg2EWUBmtKRpD2UnE96WF9zVuzmFGHk4mEc6hvIvtMC7cOx1w5IO7JRyVGaAsedXBtrdSxL7UtzZuruSBsa60jtTVdo9-cwOHD_Y1q0ufq43vBmCp88ckncd_PUk Jul 25 12:47:05.605090 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:47:05.605090 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:47:05.605090 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:47:05.605090 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:47:05.605090 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:47:05.605090 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:47:05.605090 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 30dc7d8433ac4f3c81d2f3e798929bfd Jul 25 12:47:05.605090 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1885791776 Jul 25 12:47:05.605090 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:47:05.605090 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:47:05.606686 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_30dc7d8433ac4f3c81d2f3e798929bfd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/30dc7d8433ac4f3c81d2f3e798929bfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30dc7d8433ac4f3c81d2f3e798929bfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30dc7d8433ac4f3c81d2f3e798929bfd"}]}] Jul 25 12:47:05.606686 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1885791776 Jul 25 12:47:05.606686 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 30dc7d8433ac4f3c81d2f3e798929bfd Jul 25 12:47:05.606686 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1885791776 Jul 25 12:47:05.606686 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ImagesMetadataNegativeTestJSON-1885791776-project Jul 25 12:47:05.606686 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:47:05.606686 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:47:05.606686 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: b3bfbf8e85d049c285474b82ade8cdf1 Jul 25 12:47:05.606686 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1885791776-project Jul 25 12:47:05.606686 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:47:05.606686 n-d-848886-15 devstack@n-api.service[125883]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 25 12:47:05.606686 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:47:05.606686 n-d-848886-15 devstack@n-api.service[125883]: exception: Image not found. Jul 25 12:47:05.606686 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'image_id': 'a1301ab0-d072-4db6-a55e-3a5b607f1b7d', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 25 12:47:05.607389 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:05.607389 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.607389 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 12:47:05.607389 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 12:47:05.607389 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:47:05.607389 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:47:05.607389 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 12:47:05.607389 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 12:47:05.607389 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:47:05.607389 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:47:05.607389 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 12:47:05.607389 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 12:47:05.607389 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 12:47:05.607389 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 12:47:05.607389 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:47:05.607389 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:47:05.607389 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:47:05.607389 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:47:05.608257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a1301ab0-d072-4db6-a55e-3a5b607f1b7d Jul 25 12:47:05.608257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.608257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:05.608257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.608257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.608257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 12:47:05.608257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 12:47:05.608257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 12:47:05.608257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 12:47:05.608257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 12:47:05.608257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 12:47:05.608257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 12:47:05.608257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 12:47:05.608257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 12:47:05.608257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 12:47:05.608257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:47:05.608257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:47:05.608257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 12:47:05.608257 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 12:47:05.609258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:47:05.609258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:47:05.609258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 12:47:05.609258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 12:47:05.609258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 12:47:05.609258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 12:47:05.609258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:47:05.609258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:47:05.609258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:47:05.609258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:47:05.609258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a1301ab0-d072-4db6-a55e-3a5b607f1b7d could not be found. Jul 25 12:47:05.609258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.609258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:05.609258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.609258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.609258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:05.609258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:05.609258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:05.609258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:05.610237 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:47:05.610237 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:47:05.610237 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:05.610237 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:05.610237 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:05.610237 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:05.610237 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 25 12:47:05.610237 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 25 12:47:05.610237 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 12:47:05.610237 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 12:47:05.610237 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 12:47:05.610237 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.610237 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:05.610237 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.610237 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:05.610237 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:05.610237 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:05.610237 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:05.610237 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:05.610237 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 12:47:05.610237 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:05.613641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f5c598e0-96f5-4213-acbc-c8fc9b3bc86b tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] Returning 404 to user: Image not found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:05.613641 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f5c598e0-96f5-4213-acbc-c8fc9b3bc86b tempest-ImagesMetadataNegativeTestJSON-1885791776 tempest-ImagesMetadataNegativeTestJSON-1885791776-project] 10.222.0.49 "POST /compute/v2.1/images/a1301ab0-d072-4db6-a55e-3a5b607f1b7d/metadata" status: 404 len: 62 microversion: 2.1 time: 0.055923 Jul 25 12:47:05.613641 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1082/2240] 10.222.0.49 () {60 vars in 1281 bytes} [Mon Jul 25 12:47:05 2022] POST /compute/v2.1/images/a1301ab0-d072-4db6-a55e-3a5b607f1b7d/metadata => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:47:05.616877 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7653f5f7-65e6-4f25-87e0-87c218fc2995 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e" status: 200 len: 1681 microversion: 2.1 time: 0.207060 Jul 25 12:47:05.621885 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1159/2241] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:05 2022] GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e => generated 1681 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:05.691591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c4611e1d-1e97-4d97-a2aa-398dabb16a5b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:05.692208 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c4611e1d-1e97-4d97-a2aa-398dabb16a5b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:05.702726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4611e1d-1e97-4d97-a2aa-398dabb16a5b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:05.703232 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4611e1d-1e97-4d97-a2aa-398dabb16a5b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:05.704197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4611e1d-1e97-4d97-a2aa-398dabb16a5b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:05.705594 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4611e1d-1e97-4d97-a2aa-398dabb16a5b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:05.791672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c4611e1d-1e97-4d97-a2aa-398dabb16a5b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:05.801498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c4611e1d-1e97-4d97-a2aa-398dabb16a5b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:05.803205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c4611e1d-1e97-4d97-a2aa-398dabb16a5b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:05.804731 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c4611e1d-1e97-4d97-a2aa-398dabb16a5b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1336 microversion: 2.47 time: 0.116965 Jul 25 12:47:05.805421 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1083/2242] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:05 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1336 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:06.372762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2fb7a47f-125d-4259-9275-ae21511cc221 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:06.381592 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:47:06.381592 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:47:06.383067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2fb7a47f-125d-4259-9275-ae21511cc221 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:06.383703 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2fb7a47f-125d-4259-9275-ae21511cc221 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:06.384510 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2fb7a47f-125d-4259-9275-ae21511cc221 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:06.385166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2fb7a47f-125d-4259-9275-ae21511cc221 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:06.411631 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2fb7a47f-125d-4259-9275-ae21511cc221 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.551727 Jul 25 12:47:06.412234 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1160/2243] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:47:05 2022] GET /compute/v2.1/os-services => generated 949 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:06.428549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e5dadf2a-063a-4492-915d-fba756165411 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:06.431367 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:47:06.431367 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:47:06.436005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e5dadf2a-063a-4492-915d-fba756165411 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:06.436005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e5dadf2a-063a-4492-915d-fba756165411 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:06.436005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e5dadf2a-063a-4492-915d-fba756165411 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:06.436504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e5dadf2a-063a-4492-915d-fba756165411 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:06.461563 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e5dadf2a-063a-4492-915d-fba756165411 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.036641 Jul 25 12:47:06.462432 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1084/2244] 10.222.0.49 () {58 vars in 1170 bytes} [Mon Jul 25 12:47:06 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:06.479017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9c671186-2360-45d2-8481-75071f7c5ea0 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:06.481862 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:47:06.481862 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:47:06.483361 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9c671186-2360-45d2-8481-75071f7c5ea0 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:06.483884 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9c671186-2360-45d2-8481-75071f7c5ea0 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:06.484894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9c671186-2360-45d2-8481-75071f7c5ea0 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:06.485629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9c671186-2360-45d2-8481-75071f7c5ea0 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:06.522429 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9c671186-2360-45d2-8481-75071f7c5ea0 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.047204 Jul 25 12:47:06.523629 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1161/2245] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:47:06 2022] GET /compute/v2.1/os-services => generated 949 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:06.535917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-774f0ce8-bd60-4104-b7af-34254d5f93eb tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:06.538686 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:47:06.538686 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:47:06.540052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-774f0ce8-bd60-4104-b7af-34254d5f93eb tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:06.540495 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-774f0ce8-bd60-4104-b7af-34254d5f93eb tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:06.541318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-774f0ce8-bd60-4104-b7af-34254d5f93eb tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:06.541761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-774f0ce8-bd60-4104-b7af-34254d5f93eb tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:06.569963 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-774f0ce8-bd60-4104-b7af-34254d5f93eb tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?host=n-d-848886-15&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.037808 Jul 25 12:47:06.583134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f91d50e5-c7ca-4dca-8ed3-2a59cc5ab212 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:06.585941 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:47:06.585941 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:47:06.587358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f91d50e5-c7ca-4dca-8ed3-2a59cc5ab212 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:06.587817 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f91d50e5-c7ca-4dca-8ed3-2a59cc5ab212 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:06.588666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f91d50e5-c7ca-4dca-8ed3-2a59cc5ab212 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:06.589128 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f91d50e5-c7ca-4dca-8ed3-2a59cc5ab212 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:06.589361 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1085/2246] 10.222.0.49 () {58 vars in 1196 bytes} [Mon Jul 25 12:47:06 2022] GET /compute/v2.1/os-services?host=n-d-848886-15&binary=xxx => generated 16 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 12:47:06.617508 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f91d50e5-c7ca-4dca-8ed3-2a59cc5ab212 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.038449 Jul 25 12:47:06.625155 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1162/2247] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:47:06 2022] GET /compute/v2.1/os-services => generated 949 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:47:06.630354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-640b5f3a-3457-427e-b346-a519551b0045 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:06.633249 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:47:06.633249 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:47:06.635845 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-640b5f3a-3457-427e-b346-a519551b0045 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:06.636471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-640b5f3a-3457-427e-b346-a519551b0045 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:06.642591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-640b5f3a-3457-427e-b346-a519551b0045 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:06.643464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-640b5f3a-3457-427e-b346-a519551b0045 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:06.648655 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-59065811-2794-468d-a411-1f5df1da3d18 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:06.649313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-59065811-2794-468d-a411-1f5df1da3d18 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:06.661533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59065811-2794-468d-a411-1f5df1da3d18 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:06.662389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59065811-2794-468d-a411-1f5df1da3d18 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:06.665620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59065811-2794-468d-a411-1f5df1da3d18 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:06.666268 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59065811-2794-468d-a411-1f5df1da3d18 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:06.688180 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-640b5f3a-3457-427e-b346-a519551b0045 tempest-ServicesAdminNegativeTestJSON-1110686008 tempest-ServicesAdminNegativeTestJSON-1110686008-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.061481 Jul 25 12:47:06.696675 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1086/2248] 10.222.0.49 () {58 vars in 1198 bytes} [Mon Jul 25 12:47:06 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:47:06.898162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-59065811-2794-468d-a411-1f5df1da3d18 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929ae21affaf4eb9b8eba955745aa751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59f31c830d544129310056d267f465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:06.912280 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-59065811-2794-468d-a411-1f5df1da3d18 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e" status: 200 len: 1681 microversion: 2.1 time: 0.272653 Jul 25 12:47:06.926980 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1163/2249] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:06 2022] GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e => generated 1681 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:06.934218 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2f4294fe-b32c-4df6-b698-c1c279a07b25 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:06.935153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2f4294fe-b32c-4df6-b698-c1c279a07b25 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:06.945167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2f4294fe-b32c-4df6-b698-c1c279a07b25 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:06.946282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2f4294fe-b32c-4df6-b698-c1c279a07b25 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:06.947799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2f4294fe-b32c-4df6-b698-c1c279a07b25 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:06.948205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2f4294fe-b32c-4df6-b698-c1c279a07b25 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:07.059035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2f4294fe-b32c-4df6-b698-c1c279a07b25 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:07.071812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2f4294fe-b32c-4df6-b698-c1c279a07b25 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:07.073646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2f4294fe-b32c-4df6-b698-c1c279a07b25 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:07.075552 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2f4294fe-b32c-4df6-b698-c1c279a07b25 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1336 microversion: 2.47 time: 0.147366 Jul 25 12:47:07.076648 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1164/2250] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:06 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1336 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:07.115170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d0b885ec-89f2-4694-a388-7e2b372f767b tempest-ServicesAdminNegativeTestJSON-1588684115 tempest-ServicesAdminNegativeTestJSON-1588684115-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:07.119258 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:47:07.119258 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 12:47:07.121145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d0b885ec-89f2-4694-a388-7e2b372f767b tempest-ServicesAdminNegativeTestJSON-1588684115 tempest-ServicesAdminNegativeTestJSON-1588684115-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '474d98d869544e75b20ab1a1afbf726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01db0cc399ef44b8ac597520f094ee27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:07.128721 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d0b885ec-89f2-4694-a388-7e2b372f767b tempest-ServicesAdminNegativeTestJSON-1588684115 tempest-ServicesAdminNegativeTestJSON-1588684115-project] Request method failure captured: Jul 25 12:47:07.128721 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 25 12:47:07.128721 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:47:07.128721 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:47:07.128721 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:47:07.128721 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:47:07.128721 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:47:07.128721 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:47:07.128721 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:47:07.128721 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:07.128721 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDHZTyeWZEhEoOtXCOnBOvvE_TKSA8C_EnWnxtw7kI6iuKKl1SLssT4bAgItlz3HlsX9J59Ip1Pq8u2lCRBx5x99jOWTa3H2dDGY6zyeipCMBpPWoCQPmJoRp_ArvTUnDUORQpMFaZnnsvLYPkTuAIJYS3yYG1Wxw-I_7FAWoXqo0A Jul 25 12:47:07.128721 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:47:07.128721 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:47:07.128721 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:47:07.128721 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:47:07.128721 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:47:07.128721 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:47:07.128721 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 01db0cc399ef44b8ac597520f094ee27 Jul 25 12:47:07.128721 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1588684115 Jul 25 12:47:07.128721 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:47:07.128721 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:47:07.129857 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_01db0cc399ef44b8ac597520f094ee27", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/01db0cc399ef44b8ac597520f094ee27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01db0cc399ef44b8ac597520f094ee27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01db0cc399ef44b8ac597520f094ee27"}]}] Jul 25 12:47:07.129857 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1588684115 Jul 25 12:47:07.129857 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 01db0cc399ef44b8ac597520f094ee27 Jul 25 12:47:07.129857 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1588684115 Jul 25 12:47:07.129857 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServicesAdminNegativeTestJSON-1588684115-project Jul 25 12:47:07.129857 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:47:07.129857 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:47:07.129857 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 474d98d869544e75b20ab1a1afbf726a Jul 25 12:47:07.129857 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1588684115-project Jul 25 12:47:07.129857 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:47:07.129857 n-d-848886-15 devstack@n-api.service[125883]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 12:47:07.129857 n-d-848886-15 devstack@n-api.service[125883]: action_args: {} Jul 25 12:47:07.130718 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:07.130718 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:07.130718 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:07.130718 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:07.130718 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:07.130718 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:07.130718 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 12:47:07.130718 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:07.130718 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 12:47:07.130718 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:07.130718 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:07.130718 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:07.130718 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 25 12:47:07.130718 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 25 12:47:07.130718 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 12:47:07.130718 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 12:47:07.130718 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 12:47:07.130718 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 12:47:07.130718 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:47:07.131652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:47:07.131652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:47:07.131652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:47:07.131652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 12:47:07.131652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 12:47:07.131652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 12:47:07.131652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 12:47:07.131652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 12:47:07.131652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 12:47:07.131652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 12:47:07.131652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:07.131652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:07.131652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:07.131652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:07.131652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:07.131652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:07.131652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 12:47:07.131652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 12:47:07.131652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 12:47:07.131652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:07.135066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d0b885ec-89f2-4694-a388-7e2b372f767b tempest-ServicesAdminNegativeTestJSON-1588684115 tempest-ServicesAdminNegativeTestJSON-1588684115-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:07.136666 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d0b885ec-89f2-4694-a388-7e2b372f767b tempest-ServicesAdminNegativeTestJSON-1588684115 tempest-ServicesAdminNegativeTestJSON-1588684115-project] 10.222.0.49 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.438193 Jul 25 12:47:07.137291 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1087/2251] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:47:06 2022] GET /compute/v2.1/os-services => generated 112 bytes in 440 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:47:07.939518 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-de59c211-890e-4340-a4ac-5695eb7597fa tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:07.941406 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-de59c211-890e-4340-a4ac-5695eb7597fa tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:07.951201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de59c211-890e-4340-a4ac-5695eb7597fa tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:07.951907 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de59c211-890e-4340-a4ac-5695eb7597fa tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:07.954685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de59c211-890e-4340-a4ac-5695eb7597fa tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:07.955907 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de59c211-890e-4340-a4ac-5695eb7597fa tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:08.035426 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-de59c211-890e-4340-a4ac-5695eb7597fa tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929ae21affaf4eb9b8eba955745aa751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59f31c830d544129310056d267f465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:08.047040 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-de59c211-890e-4340-a4ac-5695eb7597fa tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e" status: 200 len: 1613 microversion: 2.1 time: 0.112104 Jul 25 12:47:08.047791 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1165/2252] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:07 2022] GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e => generated 1613 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:08.105046 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-05635be1-c895-4097-aa75-9875bf4ac58f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:08.106140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-05635be1-c895-4097-aa75-9875bf4ac58f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:08.115709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05635be1-c895-4097-aa75-9875bf4ac58f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:08.117052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05635be1-c895-4097-aa75-9875bf4ac58f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:08.118653 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05635be1-c895-4097-aa75-9875bf4ac58f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:08.119305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05635be1-c895-4097-aa75-9875bf4ac58f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:08.230601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-05635be1-c895-4097-aa75-9875bf4ac58f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:08.251859 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-05635be1-c895-4097-aa75-9875bf4ac58f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:08.255429 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-05635be1-c895-4097-aa75-9875bf4ac58f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:08.258057 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-05635be1-c895-4097-aa75-9875bf4ac58f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1357 microversion: 2.47 time: 0.161751 Jul 25 12:47:08.261204 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1166/2253] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:08 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:08.292655 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9258c1ef-a686-4775-abc6-67a15b1dac36 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "97beeed7-7564-4203-abda-feef7e93cd98"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:08.305630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9258c1ef-a686-4775-abc6-67a15b1dac36 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:08.333805 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9258c1ef-a686-4775-abc6-67a15b1dac36 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:08.336011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9258c1ef-a686-4775-abc6-67a15b1dac36 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:08.337499 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9258c1ef-a686-4775-abc6-67a15b1dac36 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:08.341635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9258c1ef-a686-4775-abc6-67a15b1dac36 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:08.580356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-9258c1ef-a686-4775-abc6-67a15b1dac36 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:47:08.580790 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-9258c1ef-a686-4775-abc6-67a15b1dac36 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:47:08.581274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-9258c1ef-a686-4775-abc6-67a15b1dac36 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:47:08.581685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-9258c1ef-a686-4775-abc6-67a15b1dac36 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:47:08.582177 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-9258c1ef-a686-4775-abc6-67a15b1dac36 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:47:08.634894 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9d9807e3-412e-4bd7-9d03-716e73516d4b tempest-ListImagesTestJSON-758851148 tempest-ListImagesTestJSON-758851148-project] Calling method '.version_select at 0x7efcf9e35430>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:08.692204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9258c1ef-a686-4775-abc6-67a15b1dac36 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:08.702297 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9d9807e3-412e-4bd7-9d03-716e73516d4b tempest-ListImagesTestJSON-758851148 tempest-ListImagesTestJSON-758851148-project] 10.222.0.49 "GET /compute/v2.1/images/97beeed7-7564-4203-abda-feef7e93cd98" status: 200 len: 784 microversion: 2.1 time: 0.632841 Jul 25 12:47:08.703381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9258c1ef-a686-4775-abc6-67a15b1dac36 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:08.704486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9258c1ef-a686-4775-abc6-67a15b1dac36 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:08.705809 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9258c1ef-a686-4775-abc6-67a15b1dac36 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:08.707045 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9258c1ef-a686-4775-abc6-67a15b1dac36 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:08.707851 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1088/2254] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:47:08 2022] GET /compute/v2.1/images/97beeed7-7564-4203-abda-feef7e93cd98 => generated 784 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:08.743509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-8f8cf839-59d7-413e-857a-b0695aa79884 req-2e084912-8b36-4b1d-9037-c8bafb868128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3141f1ca-37c8-4fff-9aa7-518ce0d83f1e", "name": "network-vif-deleted", "tag": "452b8c9e-e8cb-4a81-99b0-37868cce96be"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:08.777881 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9258c1ef-a686-4775-abc6-67a15b1dac36 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "POST /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605/action" status: 202 len: 1079 microversion: 2.47 time: 0.494374 Jul 25 12:47:08.790565 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1167/2255] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Jul 25 12:47:08 2022] POST /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605/action => generated 1079 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 12:47:08.790769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-8f8cf839-59d7-413e-857a-b0695aa79884 req-2e084912-8b36-4b1d-9037-c8bafb868128 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:08.790769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-8f8cf839-59d7-413e-857a-b0695aa79884 req-2e084912-8b36-4b1d-9037-c8bafb868128 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:08.801897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aeac1490-9134-44ff-82eb-3b4fd46c0999 tempest-ListImagesTestJSON-758851148 tempest-ListImagesTestJSON-758851148-project] Calling method '.version_select at 0x7efcf9c9fb80>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:08.807370 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-8f8cf839-59d7-413e-857a-b0695aa79884 req-2e084912-8b36-4b1d-9037-c8bafb868128 service nova] Creating event network-vif-deleted:452b8c9e-e8cb-4a81-99b0-37868cce96be for instance 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e on n-h2-848886-15 Jul 25 12:47:08.817599 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-8f8cf839-59d7-413e-857a-b0695aa79884 req-2e084912-8b36-4b1d-9037-c8bafb868128 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098269 Jul 25 12:47:08.818962 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1089/2256] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:08.829470 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a2c253a6-fd22-48c6-bcd8-a8643d7cf9a0 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:08.831715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a2c253a6-fd22-48c6-bcd8-a8643d7cf9a0 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:08.841003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2c253a6-fd22-48c6-bcd8-a8643d7cf9a0 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:08.841678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2c253a6-fd22-48c6-bcd8-a8643d7cf9a0 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:08.842782 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2c253a6-fd22-48c6-bcd8-a8643d7cf9a0 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:08.853268 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2c253a6-fd22-48c6-bcd8-a8643d7cf9a0 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:08.926801 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-aeac1490-9134-44ff-82eb-3b4fd46c0999 tempest-ListImagesTestJSON-758851148 tempest-ListImagesTestJSON-758851148-project] 10.222.0.49 "GET /compute/v2.1/images" status: 200 len: 871 microversion: 2.1 time: 0.145089 Jul 25 12:47:08.929191 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1168/2257] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Jul 25 12:47:08 2022] GET /compute/v2.1/images => generated 871 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:08.944141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a10d158f-686c-4c41-b3d4-6e33d72d8ef5 tempest-ListImagesTestJSON-758851148 tempest-ListImagesTestJSON-758851148-project] Calling method '.version_select at 0x7efcfa1fbd30>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:08.963121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a2c253a6-fd22-48c6-bcd8-a8643d7cf9a0 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:08.976371 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a2c253a6-fd22-48c6-bcd8-a8643d7cf9a0 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:08.978006 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a2c253a6-fd22-48c6-bcd8-a8643d7cf9a0 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:08.980065 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a2c253a6-fd22-48c6-bcd8-a8643d7cf9a0 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1366 microversion: 2.47 time: 0.159063 Jul 25 12:47:08.980875 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1090/2258] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:08 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:09.049695 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a10d158f-686c-4c41-b3d4-6e33d72d8ef5 tempest-ListImagesTestJSON-758851148 tempest-ListImagesTestJSON-758851148-project] 10.222.0.49 "GET /compute/v2.1/images/detail" status: 200 len: 1475 microversion: 2.1 time: 0.110788 Jul 25 12:47:09.050688 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1169/2259] 10.222.0.49 () {58 vars in 1143 bytes} [Mon Jul 25 12:47:08 2022] GET /compute/v2.1/images/detail => generated 1475 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:47:09.070559 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-383e7f2a-5354-46a5-b560-66bfd4b6e5ab tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:09.071295 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-383e7f2a-5354-46a5-b560-66bfd4b6e5ab tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:09.079871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-383e7f2a-5354-46a5-b560-66bfd4b6e5ab tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:09.080328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-383e7f2a-5354-46a5-b560-66bfd4b6e5ab tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:09.081140 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-383e7f2a-5354-46a5-b560-66bfd4b6e5ab tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:09.081586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-383e7f2a-5354-46a5-b560-66bfd4b6e5ab tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:09.162141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-383e7f2a-5354-46a5-b560-66bfd4b6e5ab tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:09.165487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-383e7f2a-5354-46a5-b560-66bfd4b6e5ab tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:09.166246 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-383e7f2a-5354-46a5-b560-66bfd4b6e5ab tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lazy-loading 'fault' on Instance uuid 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:47:09.250451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-383e7f2a-5354-46a5-b560-66bfd4b6e5ab tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929ae21affaf4eb9b8eba955745aa751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59f31c830d544129310056d267f465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:09.259237 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-383e7f2a-5354-46a5-b560-66bfd4b6e5ab tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e" status: 200 len: 1331 microversion: 2.1 time: 0.194441 Jul 25 12:47:09.275394 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1091/2260] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:09 2022] GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e => generated 1331 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:10.046657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-58d0b484-5bea-46d1-9e46-4ed5290e4f2f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:10.050418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-58d0b484-5bea-46d1-9e46-4ed5290e4f2f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:10.083274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58d0b484-5bea-46d1-9e46-4ed5290e4f2f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:10.084513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58d0b484-5bea-46d1-9e46-4ed5290e4f2f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:10.087724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58d0b484-5bea-46d1-9e46-4ed5290e4f2f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:10.088773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58d0b484-5bea-46d1-9e46-4ed5290e4f2f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:10.286322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-58d0b484-5bea-46d1-9e46-4ed5290e4f2f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:10.290323 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-02a654b5-0f24-453e-923e-24f0cf2d949d tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:10.293063 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-02a654b5-0f24-453e-923e-24f0cf2d949d tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:10.302498 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-58d0b484-5bea-46d1-9e46-4ed5290e4f2f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:10.312937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-58d0b484-5bea-46d1-9e46-4ed5290e4f2f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:10.314893 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02a654b5-0f24-453e-923e-24f0cf2d949d tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:10.317627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02a654b5-0f24-453e-923e-24f0cf2d949d tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:10.330907 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-58d0b484-5bea-46d1-9e46-4ed5290e4f2f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1366 microversion: 2.47 time: 0.325975 Jul 25 12:47:10.332744 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02a654b5-0f24-453e-923e-24f0cf2d949d tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:10.333324 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02a654b5-0f24-453e-923e-24f0cf2d949d tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:10.338704 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1170/2261] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:10 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:10.382273 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-02a654b5-0f24-453e-923e-24f0cf2d949d tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] HTTP exception thrown: Instance 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e could not be found. Jul 25 12:47:10.385485 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-02a654b5-0f24-453e-923e-24f0cf2d949d tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Request method failure captured: Jul 25 12:47:10.385485 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e HTTP/1.1 Jul 25 12:47:10.385485 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:47:10.385485 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:47:10.385485 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:47:10.385485 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:47:10.385485 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:47:10.385485 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:47:10.385485 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:47:10.385485 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:10.385485 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pA1WAerhsx-yhxoohtA9tjYvc6rK_qSmTf7q7vWZHCkRD54gGL2jWNfWfBfxBzIrqGOUBrG4CQro5w42cH8P6nmmrR6jeleVZGuk-P_ulk3iX2meENv1CPCLiz38BibsL6qLwRc4bbZ4ZfBP6VHynmunpa25J-Vfs9pcn9xXQwlao8 Jul 25 12:47:10.385485 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:47:10.385485 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:47:10.385485 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:47:10.385485 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:47:10.385485 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:47:10.385485 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:47:10.385485 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: a59f31c830d544129310056d267f465c Jul 25 12:47:10.385485 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1397180338 Jul 25 12:47:10.385485 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:47:10.385485 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:47:10.387616 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a59f31c830d544129310056d267f465c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a59f31c830d544129310056d267f465c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a59f31c830d544129310056d267f465c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a59f31c830d544129310056d267f465c"}]}] Jul 25 12:47:10.387616 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1397180338 Jul 25 12:47:10.387616 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: a59f31c830d544129310056d267f465c Jul 25 12:47:10.387616 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1397180338 Jul 25 12:47:10.387616 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AttachSCSIVolumeTestJSON-1397180338-project Jul 25 12:47:10.387616 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:47:10.387616 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:47:10.387616 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 929ae21affaf4eb9b8eba955745aa751 Jul 25 12:47:10.387616 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1397180338-project Jul 25 12:47:10.387616 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:47:10.387616 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e could not be found. Jul 25 12:47:10.387616 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '3141f1ca-37c8-4fff-9aa7-518ce0d83f1e'} Jul 25 12:47:10.389262 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:10.389262 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:10.389262 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:47:10.389262 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:47:10.389262 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:47:10.389262 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:47:10.389262 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:47:10.389262 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:47:10.389262 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:47:10.389262 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:47:10.389262 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e could not be found. Jul 25 12:47:10.389262 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:10.389262 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:10.389262 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:10.389262 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:10.389262 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:10.389262 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:10.389262 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:10.389262 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:10.389262 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:10.391399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:10.391399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:47:10.391399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:47:10.391399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:47:10.391399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:47:10.391399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:47:10.391399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:47:10.391399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e could not be found. Jul 25 12:47:10.391399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:10.391399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:10.391399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:10.391399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:10.391399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:10.391399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:10.391399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:10.391399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:10.391399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e could not be found. Jul 25 12:47:10.391399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:10.393657 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-02a654b5-0f24-453e-923e-24f0cf2d949d tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Returning 404 to user: Instance 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:10.393657 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-02a654b5-0f24-453e-923e-24f0cf2d949d tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e" status: 404 len: 111 microversion: 2.1 time: 0.110296 Jul 25 12:47:10.393657 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1092/2262] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:10 2022] GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 12:47:10.403876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a959c049-d716-4d26-9237-c0ffe84a1615 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '.version_select at 0x7efcf9cafc10>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:10.432382 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a959c049-d716-4d26-9237-c0ffe84a1615 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-897657228" status: 202 len: 0 microversion: 2.1 time: 0.037474 Jul 25 12:47:10.433337 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1171/2263] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Jul 25 12:47:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-897657228 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:47:11.366791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8c03bf52-e7e1-45c3-b50c-a0e371858773 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:11.367930 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8c03bf52-e7e1-45c3-b50c-a0e371858773 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:11.398122 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c03bf52-e7e1-45c3-b50c-a0e371858773 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:11.403834 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c03bf52-e7e1-45c3-b50c-a0e371858773 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:11.405345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c03bf52-e7e1-45c3-b50c-a0e371858773 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:11.412604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c03bf52-e7e1-45c3-b50c-a0e371858773 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:11.692805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8c03bf52-e7e1-45c3-b50c-a0e371858773 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:11.708545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8c03bf52-e7e1-45c3-b50c-a0e371858773 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:11.710580 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8c03bf52-e7e1-45c3-b50c-a0e371858773 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:11.717076 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8c03bf52-e7e1-45c3-b50c-a0e371858773 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1366 microversion: 2.47 time: 0.359087 Jul 25 12:47:11.718852 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1093/2264] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:11 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:12.743134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=16 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:12.748280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b9808cfb-6956-45c5-8e6f-3fb59d45a066 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:12.748911 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b9808cfb-6956-45c5-8e6f-3fb59d45a066 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:12.773459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b9808cfb-6956-45c5-8e6f-3fb59d45a066 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:12.773945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b9808cfb-6956-45c5-8e6f-3fb59d45a066 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:12.783205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b9808cfb-6956-45c5-8e6f-3fb59d45a066 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:12.783673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b9808cfb-6956-45c5-8e6f-3fb59d45a066 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:13.143062 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b9808cfb-6956-45c5-8e6f-3fb59d45a066 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:13.176717 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b9808cfb-6956-45c5-8e6f-3fb59d45a066 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:13.191010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b9808cfb-6956-45c5-8e6f-3fb59d45a066 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:13.192371 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b9808cfb-6956-45c5-8e6f-3fb59d45a066 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1366 microversion: 2.47 time: 0.450996 Jul 25 12:47:13.199038 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1172/2265] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:12 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1366 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:14.235010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e1b1b163-73fb-47c5-8107-a35508c053fb tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:14.235795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e1b1b163-73fb-47c5-8107-a35508c053fb tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:14.245887 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1b1b163-73fb-47c5-8107-a35508c053fb tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:14.251540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1b1b163-73fb-47c5-8107-a35508c053fb tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:14.254916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1b1b163-73fb-47c5-8107-a35508c053fb tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:14.256939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1b1b163-73fb-47c5-8107-a35508c053fb tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:14.438301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e1b1b163-73fb-47c5-8107-a35508c053fb tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:14.458044 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e1b1b163-73fb-47c5-8107-a35508c053fb tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:14.460059 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e1b1b163-73fb-47c5-8107-a35508c053fb tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:14.461312 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e1b1b163-73fb-47c5-8107-a35508c053fb tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1366 microversion: 2.47 time: 0.230439 Jul 25 12:47:14.467016 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1094/2266] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:14 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:15.428062 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b10fbe5f-2694-4012-bd21-e310fdaa6da7 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Action: 'create', calling method: .version_select at 0x7efcfa1fb3a0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7+aTLzu+9BoO1blowqrWZ1sWWlIrqDtaHZo3okxtM73/s1Nn2wGwVShzBQgK8qp1Bi8geXpKRvjAfGOj5BTnmRnwRfLnjn+W+ldEhQe+ni6CFBNdYupXtsys8n8Q0Vaw=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:15.446338 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-b10fbe5f-2694-4012-bd21-e310fdaa6da7 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 25 12:47:15.454643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b10fbe5f-2694-4012-bd21-e310fdaa6da7 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Request method failure captured: Jul 25 12:47:15.454643 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 12:47:15.454643 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:47:15.454643 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:47:15.454643 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:47:15.454643 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 257 Jul 25 12:47:15.454643 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:47:15.454643 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:47:15.454643 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:47:15.454643 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:15.454643 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pDSKj4FRokRwmaLsYyoAMYfpUXDyWOFL8pVJQbp6hZh3v95UjK5w5b1CrBnXHyb6h1q7GnWfQGBTO4G4bfMTHVGPaIoWoQGQHy0geWLULE_5i0ckMF_0tqrZaq_eT3GQRf5lD0pIdCv6eeKNR9rksMr-FRFsJyLcuUX0p_vrlK8VbA Jul 25 12:47:15.454643 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:47:15.454643 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:47:15.454643 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:47:15.454643 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:47:15.454643 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:47:15.454643 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:47:15.454643 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 1b2660199928428b82cd3e273bcc1c62 Jul 25 12:47:15.454643 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:15.454643 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:47:15.454643 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:47:15.456030 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1b2660199928428b82cd3e273bcc1c62", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1b2660199928428b82cd3e273bcc1c62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b2660199928428b82cd3e273bcc1c62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b2660199928428b82cd3e273bcc1c62"}]}] Jul 25 12:47:15.456030 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:15.456030 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 1b2660199928428b82cd3e273bcc1c62 Jul 25 12:47:15.456030 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:15.456030 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-KeyPairsNegativeTestJSON-2081038681-project Jul 25 12:47:15.456030 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:47:15.456030 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:47:15.456030 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 40da25ca84c242c0aafb589c9857fde6 Jul 25 12:47:15.456030 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2081038681-project Jul 25 12:47:15.456030 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:47:15.456030 n-d-848886-15 devstack@n-api.service[125884]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7+aTLzu+9BoO1blowqrWZ1sWWlIrqDtaHZo3okxtM73/s1Nn2wGwVShzBQgK8qp1Bi8geXpKRvjAfGOj5BTnmRnwRfLnjn+W+ldEhQe+ni6CFBNdYupXtsys8n8Q0Vaw=="}} Jul 25 12:47:15.456030 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:47:15.456784 n-d-848886-15 devstack@n-api.service[125884]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 25 12:47:15.456784 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7+aTLzu+9BoO1blowqrWZ1sWWlIrqDtaHZo3okxtM73/s1Nn2wGwVShzBQgK8qp1Bi8geXpKRvjAfGOj5BTnmRnwRfLnjn+W+ldEhQe+ni6CFBNdYupXtsys8n8Q0Vaw=='}}} Jul 25 12:47:15.456784 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:15.456784 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:15.456784 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 25 12:47:15.456784 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 25 12:47:15.456784 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 12:47:15.456784 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 12:47:15.456784 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:47:15.456784 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:47:15.456784 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:47:15.456784 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:47:15.456784 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 12:47:15.456784 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 12:47:15.456784 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 25 12:47:15.456784 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 25 12:47:15.456784 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 25 12:47:15.456784 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 25 12:47:15.462622 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 25 12:47:15.462622 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:15.462622 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:15.462622 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:15.462622 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:15.462622 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:15.462622 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:15.462622 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:15.462622 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:15.462622 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:47:15.462622 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:47:15.462622 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:15.462622 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:15.462622 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:15.462622 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:15.462622 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:15.462622 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:15.462622 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 25 12:47:15.462622 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 25 12:47:15.462622 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 25 12:47:15.463845 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 25 12:47:15.463845 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 25 12:47:15.463845 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:15.463845 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:15.463845 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:15.463845 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:15.463845 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:15.463845 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:15.463845 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:15.463845 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:15.463845 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 25 12:47:15.463845 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:15.463845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b10fbe5f-2694-4012-bd21-e310fdaa6da7 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:15.463845 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b10fbe5f-2694-4012-bd21-e310fdaa6da7 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.820401 Jul 25 12:47:15.464873 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1173/2267] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:47:14 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 829 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:47:15.477260 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-75a70603-6703-413e-ac30-ed239287ed83 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Action: 'create', calling method: .version_select at 0x7efcf9e979d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-510993588", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:15.493641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-20a9293e-f553-4a66-9563-1be4f10295c2 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:15.500594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-20a9293e-f553-4a66-9563-1be4f10295c2 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:15.550620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-75a70603-6703-413e-ac30-ed239287ed83 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Getting quotas for project 1b2660199928428b82cd3e273bcc1c62. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:47:15.564984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20a9293e-f553-4a66-9563-1be4f10295c2 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:15.566020 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20a9293e-f553-4a66-9563-1be4f10295c2 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:15.568035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20a9293e-f553-4a66-9563-1be4f10295c2 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:15.572670 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-75a70603-6703-413e-ac30-ed239287ed83 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Getting quotas for user 40da25ca84c242c0aafb589c9857fde6 and project 1b2660199928428b82cd3e273bcc1c62. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:47:15.579100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20a9293e-f553-4a66-9563-1be4f10295c2 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:15.658179 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-75a70603-6703-413e-ac30-ed239287ed83 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-75a70603-6703-413e-ac30-ed239287ed83 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Request method failure captured: Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 2166 Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDSKj4FRokRwmaLsYyoAMYfpUXDyWOFL8pVJQbp6hZh3v95UjK5w5b1CrBnXHyb6h1q7GnWfQGBTO4G4bfMTHVGPaIoWoQGQHy0geWLULE_5i0ckMF_0tqrZaq_eT3GQRf5lD0pIdCv6eeKNR9rksMr-FRFsJyLcuUX0p_vrlK8VbA Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 1b2660199928428b82cd3e273bcc1c62 Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1b2660199928428b82cd3e273bcc1c62", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1b2660199928428b82cd3e273bcc1c62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b2660199928428b82cd3e273bcc1c62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b2660199928428b82cd3e273bcc1c62"}]}] Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 1b2660199928428b82cd3e273bcc1c62 Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-KeyPairsNegativeTestJSON-2081038681-project Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 40da25ca84c242c0aafb589c9857fde6 Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2081038681-project Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-510993588", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:47:15.673523 n-d-848886-15 devstack@n-api.service[125883]: exception: Keypair data is invalid: failed to generate fingerprint Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-510993588', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:15.675570 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:15.677756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:15.677756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:15.677756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:15.677756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:15.677756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 25 12:47:15.677756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 25 12:47:15.677756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 25 12:47:15.677756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 25 12:47:15.677756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 25 12:47:15.677756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:15.677756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:15.677756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:15.677756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:15.677756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:15.677756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:15.677756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:15.677756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:15.677756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 25 12:47:15.677756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:15.677756 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-75a70603-6703-413e-ac30-ed239287ed83 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:15.677756 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-75a70603-6703-413e-ac30-ed239287ed83 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.210686 Jul 25 12:47:15.677756 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1095/2268] 10.222.0.49 () {60 vars in 1160 bytes} [Mon Jul 25 12:47:15 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 213 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:47:15.695376 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3fe205f8-a4b5-42ac-9649-3c31411237bc tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Action: 'create', calling method: .version_select at 0x7efcf9e97c10>, body: {"keypair": {"name": "tempest-keypair-1249401878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSFkuuRgKvqmk2Bs0kms8T6CAumWxJBNjvOG9+bZIKQ+MyRXzcDfrv1Z3RQwe/jOE193CWXIc6bqczW/yLeBEFRvRKmLqSpU9fr1AqJpdn8DLmeFS84rMMFHKGOZlPkLQ=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:15.742751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-3fe205f8-a4b5-42ac-9649-3c31411237bc tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Getting quotas for project 1b2660199928428b82cd3e273bcc1c62. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:47:15.767764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-3fe205f8-a4b5-42ac-9649-3c31411237bc tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Getting quotas for user 40da25ca84c242c0aafb589c9857fde6 and project 1b2660199928428b82cd3e273bcc1c62. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:47:15.847926 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3fe205f8-a4b5-42ac-9649-3c31411237bc tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.159695 Jul 25 12:47:15.849215 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1096/2269] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:47:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:47:15.864007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2b887d62-cd03-4ddc-9291-aff5ce394837 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Action: 'create', calling method: .version_select at 0x7efcf9a99040>, body: {"keypair": {"name": "tempest-keypair-1249401878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrf6niS/aUyTFzoU0OS+SUJR83dS4EDpMCwLhTWbUQIiCtBEVm/cU7Ah+5FLmzMyg0wMG62VUcyZK78EuMNDXcTniAwmmcIxOzvqW5RnnU9HqGi+tH8aLx6j9khTmV3KA=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:15.928006 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-2b887d62-cd03-4ddc-9291-aff5ce394837 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Getting quotas for project 1b2660199928428b82cd3e273bcc1c62. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:47:15.951888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-2b887d62-cd03-4ddc-9291-aff5ce394837 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Getting quotas for user 40da25ca84c242c0aafb589c9857fde6 and project 1b2660199928428b82cd3e273bcc1c62. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:47:16.042097 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:16.056591 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-2b887d62-cd03-4ddc-9291-aff5ce394837 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] HTTP exception thrown: Key pair 'tempest-keypair-1249401878' already exists. Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2b887d62-cd03-4ddc-9291-aff5ce394837 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Request method failure captured: Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 273 Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDSKj4FRokRwmaLsYyoAMYfpUXDyWOFL8pVJQbp6hZh3v95UjK5w5b1CrBnXHyb6h1q7GnWfQGBTO4G4bfMTHVGPaIoWoQGQHy0geWLULE_5i0ckMF_0tqrZaq_eT3GQRf5lD0pIdCv6eeKNR9rksMr-FRFsJyLcuUX0p_vrlK8VbA Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 1b2660199928428b82cd3e273bcc1c62 Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1b2660199928428b82cd3e273bcc1c62", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1b2660199928428b82cd3e273bcc1c62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b2660199928428b82cd3e273bcc1c62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b2660199928428b82cd3e273bcc1c62"}]}] Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 1b2660199928428b82cd3e273bcc1c62 Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-KeyPairsNegativeTestJSON-2081038681-project Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 40da25ca84c242c0aafb589c9857fde6 Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2081038681-project Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: {"keypair": {"name": "tempest-keypair-1249401878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrf6niS/aUyTFzoU0OS+SUJR83dS4EDpMCwLhTWbUQIiCtBEVm/cU7Ah+5FLmzMyg0wMG62VUcyZK78EuMNDXcTniAwmmcIxOzvqW5RnnU9HqGi+tH8aLx6j9khTmV3KA=="}} Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: exception: Key pair 'tempest-keypair-1249401878' already exists. Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1249401878', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrf6niS/aUyTFzoU0OS+SUJR83dS4EDpMCwLhTWbUQIiCtBEVm/cU7Ah+5FLmzMyg0wMG62VUcyZK78EuMNDXcTniAwmmcIxOzvqW5RnnU9HqGi+tH8aLx6j9khTmV3KA=='}}} Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result.read() Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '40da25ca84c242c0aafb589c9857fde6-tempest-keypair-1249401878' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 25 12:47:16.083126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi session.flush() Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result.read() Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 12:47:16.090957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '40da25ca84c242c0aafb589c9857fde6-tempest-keypair-1249401878' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 25, 12, 47, 16, 33507), 'updated_at': None, 'name': 'tempest-keypair-1249401878', 'user_id': '40da25ca84c242c0aafb589c9857fde6', 'fingerprint': '80:d6:80:13:03:25:0f:70:05:b8:63:8e:8a:06:45:aa', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrf6niS/aUyTFzoU0OS+SUJR83dS4EDpMCwLhTWbUQIiCtBEVm/cU7Ah+5FLmzMyg0wMG62VUcyZK78EuMNDXcTniAwmmcIxOzvqW5RnnU9HqGi+tH8aLx6j9khTmV3KA==', 'type': 'ssh'}] Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi keypair.create() Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._create() Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1249401878' already exists. Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 25 12:47:16.095180 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1249401878' already exists. Jul 25 12:47:16.099263 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.099263 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:16.099263 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.099263 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:16.099263 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:16.099263 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:16.099263 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:16.099263 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:16.099263 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1249401878' already exists. Jul 25 12:47:16.099263 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.099263 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2b887d62-cd03-4ddc-9291-aff5ce394837 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Returning 409 to user: Key pair 'tempest-keypair-1249401878' already exists. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:16.099263 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2b887d62-cd03-4ddc-9291-aff5ce394837 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.226508 Jul 25 12:47:16.099263 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1097/2270] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:47:15 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 228 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:47:16.104235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b7a80e5a-b6e3-43cc-a4d0-74dffe42e6ae tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Calling method '.version_select at 0x7efcf96a1ca0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:16.177147 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b7a80e5a-b6e3-43cc-a4d0-74dffe42e6ae tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1249401878" status: 202 len: 0 microversion: 2.1 time: 0.087262 Jul 25 12:47:16.186718 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1098/2271] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Jul 25 12:47:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1249401878 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 12:47:16.197397 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5de0eb3c-03a3-4609-bc44-8639bb1fc634 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Action: 'create', calling method: .version_select at 0x7efcf9a3b3a0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmy4f3I5qv0l4UkKAs2OTzw9Hjm9Wbc4Lo5PL0dJuhw+REi0AB+zmg/Vcv4KwvPvxAcTUgLU6idf8w+TJyYusriCFRjPDGO4558TcHQjc/tcxBBjQ/Fybr0Po9/rD8GMA=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5de0eb3c-03a3-4609-bc44-8639bb1fc634 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Request method failure captured: Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 247 Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDSKj4FRokRwmaLsYyoAMYfpUXDyWOFL8pVJQbp6hZh3v95UjK5w5b1CrBnXHyb6h1q7GnWfQGBTO4G4bfMTHVGPaIoWoQGQHy0geWLULE_5i0ckMF_0tqrZaq_eT3GQRf5lD0pIdCv6eeKNR9rksMr-FRFsJyLcuUX0p_vrlK8VbA Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 1b2660199928428b82cd3e273bcc1c62 Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1b2660199928428b82cd3e273bcc1c62", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1b2660199928428b82cd3e273bcc1c62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b2660199928428b82cd3e273bcc1c62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b2660199928428b82cd3e273bcc1c62"}]}] Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 1b2660199928428b82cd3e273bcc1c62 Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-KeyPairsNegativeTestJSON-2081038681-project Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 40da25ca84c242c0aafb589c9857fde6 Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2081038681-project Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmy4f3I5qv0l4UkKAs2OTzw9Hjm9Wbc4Lo5PL0dJuhw+REi0AB+zmg/Vcv4KwvPvxAcTUgLU6idf8w+TJyYusriCFRjPDGO4558TcHQjc/tcxBBjQ/Fybr0Po9/rD8GMA=="}} Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmy4f3I5qv0l4UkKAs2OTzw9Hjm9Wbc4Lo5PL0dJuhw+REi0AB+zmg/Vcv4KwvPvxAcTUgLU6idf8w+TJyYusriCFRjPDGO4558TcHQjc/tcxBBjQ/Fybr0Po9/rD8GMA=='}}} Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi '' Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:47:16.206342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:47:16.211023 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:47:16.211023 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:47:16.211023 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:47:16.211023 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:47:16.211023 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 25 12:47:16.211023 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.211023 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:16.211023 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.211023 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:16.211023 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:16.211023 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:16.211023 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:47:16.211023 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:47:16.211023 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 25 12:47:16.211023 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.211023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5de0eb3c-03a3-4609-bc44-8639bb1fc634 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:16.211023 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5de0eb3c-03a3-4609-bc44-8639bb1fc634 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.018118 Jul 25 12:47:16.216683 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1099/2272] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:47:16 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:47:16.223223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aba59bce-0fae-4823-a6ab-df9dadd009e8 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Action: 'create', calling method: .version_select at 0x7efcf9930ca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-314949638", "public_key": " "}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:16.248401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-aba59bce-0fae-4823-a6ab-df9dadd009e8 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Getting quotas for project 1b2660199928428b82cd3e273bcc1c62. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:47:16.256945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-aba59bce-0fae-4823-a6ab-df9dadd009e8 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Getting quotas for user 40da25ca84c242c0aafb589c9857fde6 and project 1b2660199928428b82cd3e273bcc1c62. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:47:16.279308 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-aba59bce-0fae-4823-a6ab-df9dadd009e8 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aba59bce-0fae-4823-a6ab-df9dadd009e8 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Request method failure captured: Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 94 Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDSKj4FRokRwmaLsYyoAMYfpUXDyWOFL8pVJQbp6hZh3v95UjK5w5b1CrBnXHyb6h1q7GnWfQGBTO4G4bfMTHVGPaIoWoQGQHy0geWLULE_5i0ckMF_0tqrZaq_eT3GQRf5lD0pIdCv6eeKNR9rksMr-FRFsJyLcuUX0p_vrlK8VbA Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 1b2660199928428b82cd3e273bcc1c62 Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1b2660199928428b82cd3e273bcc1c62", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1b2660199928428b82cd3e273bcc1c62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b2660199928428b82cd3e273bcc1c62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b2660199928428b82cd3e273bcc1c62"}]}] Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 1b2660199928428b82cd3e273bcc1c62 Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-KeyPairsNegativeTestJSON-2081038681-project Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 40da25ca84c242c0aafb589c9857fde6 Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2081038681-project Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-314949638", "public_key": " "}} Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: exception: Keypair data is invalid: failed to generate fingerprint Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-314949638', 'public_key': ' '}}} Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:16.281474 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aba59bce-0fae-4823-a6ab-df9dadd009e8 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:16.288385 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aba59bce-0fae-4823-a6ab-df9dadd009e8 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.065220 Jul 25 12:47:16.292339 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1100/2273] 10.222.0.49 () {60 vars in 1158 bytes} [Mon Jul 25 12:47:16 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:47:16.298827 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-90b5dff0-0edc-42c2-a4dd-31bd4208fdaf tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Action: 'create', calling method: .version_select at 0x7efcf9930f70>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIol1UA0ZFYzsSmj7jeE4WTgZIYHZBWQm8npZedTSJ2xlbKNd/V+Nhtkg4QU08CmQuhStPEPD7bPPBEeGXYtvt4/Qmj4H2q22CR0AhD3vUEccRrnlKTj6UtzbOz6GqDJA=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-90b5dff0-0edc-42c2-a4dd-31bd4208fdaf tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Request method failure captured: Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 507 Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDSKj4FRokRwmaLsYyoAMYfpUXDyWOFL8pVJQbp6hZh3v95UjK5w5b1CrBnXHyb6h1q7GnWfQGBTO4G4bfMTHVGPaIoWoQGQHy0geWLULE_5i0ckMF_0tqrZaq_eT3GQRf5lD0pIdCv6eeKNR9rksMr-FRFsJyLcuUX0p_vrlK8VbA Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 1b2660199928428b82cd3e273bcc1c62 Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1b2660199928428b82cd3e273bcc1c62", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1b2660199928428b82cd3e273bcc1c62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b2660199928428b82cd3e273bcc1c62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b2660199928428b82cd3e273bcc1c62"}]}] Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 1b2660199928428b82cd3e273bcc1c62 Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-KeyPairsNegativeTestJSON-2081038681-project Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 40da25ca84c242c0aafb589c9857fde6 Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2081038681-project Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIol1UA0ZFYzsSmj7jeE4WTgZIYHZBWQm8npZedTSJ2xlbKNd/V+Nhtkg4QU08CmQuhStPEPD7bPPBEeGXYtvt4/Qmj4H2q22CR0AhD3vUEccRrnlKTj6UtzbOz6GqDJA=="}} Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIol1UA0ZFYzsSmj7jeE4WTgZIYHZBWQm8npZedTSJ2xlbKNd/V+Nhtkg4QU08CmQuhStPEPD7bPPBEeGXYtvt4/Qmj4H2q22CR0AhD3vUEccRrnlKTj6UtzbOz6GqDJA=='}}} Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 25 12:47:16.303664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-90b5dff0-0edc-42c2-a4dd-31bd4208fdaf tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:16.306712 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-90b5dff0-0edc-42c2-a4dd-31bd4208fdaf tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.011433 Jul 25 12:47:16.311459 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1101/2274] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:47:16 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:47:16.319708 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-33c795dc-9d1c-4b62-80d4-2a4b75570018 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Action: 'create', calling method: .version_select at 0x7efcf995b9d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1722510572", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:16.344162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-33c795dc-9d1c-4b62-80d4-2a4b75570018 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Getting quotas for project 1b2660199928428b82cd3e273bcc1c62. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:47:16.351334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-33c795dc-9d1c-4b62-80d4-2a4b75570018 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Getting quotas for user 40da25ca84c242c0aafb589c9857fde6 and project 1b2660199928428b82cd3e273bcc1c62. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:47:16.388865 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-33c795dc-9d1c-4b62-80d4-2a4b75570018 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-33c795dc-9d1c-4b62-80d4-2a4b75570018 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Request method failure captured: Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 118 Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDSKj4FRokRwmaLsYyoAMYfpUXDyWOFL8pVJQbp6hZh3v95UjK5w5b1CrBnXHyb6h1q7GnWfQGBTO4G4bfMTHVGPaIoWoQGQHy0geWLULE_5i0ckMF_0tqrZaq_eT3GQRf5lD0pIdCv6eeKNR9rksMr-FRFsJyLcuUX0p_vrlK8VbA Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 1b2660199928428b82cd3e273bcc1c62 Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1b2660199928428b82cd3e273bcc1c62", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1b2660199928428b82cd3e273bcc1c62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b2660199928428b82cd3e273bcc1c62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b2660199928428b82cd3e273bcc1c62"}]}] Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 1b2660199928428b82cd3e273bcc1c62 Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-KeyPairsNegativeTestJSON-2081038681-project Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 40da25ca84c242c0aafb589c9857fde6 Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2081038681-project Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1722510572", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: exception: Keypair data is invalid: failed to generate fingerprint Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1722510572', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 25 12:47:16.392336 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-33c795dc-9d1c-4b62-80d4-2a4b75570018 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:16.396143 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-33c795dc-9d1c-4b62-80d4-2a4b75570018 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.078532 Jul 25 12:47:16.402851 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1102/2275] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:47:16 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 88 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:47:16.405248 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5492fbc7-888d-4d6d-a201-2d8c6c338e29 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Calling method '.version_select at 0x7efcf99448b0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:16.421288 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-5492fbc7-888d-4d6d-a201-2d8c6c338e29 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-658035935 not found for user 40da25ca84c242c0aafb589c9857fde6 Jul 25 12:47:16.421546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-20a9293e-f553-4a66-9563-1be4f10295c2 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5492fbc7-888d-4d6d-a201-2d8c6c338e29 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Request method failure captured: Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-658035935 HTTP/1.1 Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDSKj4FRokRwmaLsYyoAMYfpUXDyWOFL8pVJQbp6hZh3v95UjK5w5b1CrBnXHyb6h1q7GnWfQGBTO4G4bfMTHVGPaIoWoQGQHy0geWLULE_5i0ckMF_0tqrZaq_eT3GQRf5lD0pIdCv6eeKNR9rksMr-FRFsJyLcuUX0p_vrlK8VbA Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 1b2660199928428b82cd3e273bcc1c62 Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1b2660199928428b82cd3e273bcc1c62", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1b2660199928428b82cd3e273bcc1c62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b2660199928428b82cd3e273bcc1c62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b2660199928428b82cd3e273bcc1c62"}]}] Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 1b2660199928428b82cd3e273bcc1c62 Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2081038681 Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-KeyPairsNegativeTestJSON-2081038681-project Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 40da25ca84c242c0aafb589c9857fde6 Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2081038681-project Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: exception: Keypair tempest-keypair-non-existent-658035935 not found for user 40da25ca84c242c0aafb589c9857fde6 Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'tempest-keypair-non-existent-658035935'} Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-658035935 not found for user 40da25ca84c242c0aafb589c9857fde6 Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.423970 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-658035935 not found for user 40da25ca84c242c0aafb589c9857fde6 Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-658035935 not found for user 40da25ca84c242c0aafb589c9857fde6 Jul 25 12:47:16.430122 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:16.434994 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5492fbc7-888d-4d6d-a201-2d8c6c338e29 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] Returning 404 to user: Keypair tempest-keypair-non-existent-658035935 not found for user 40da25ca84c242c0aafb589c9857fde6 {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:16.435845 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5492fbc7-888d-4d6d-a201-2d8c6c338e29 tempest-KeyPairsNegativeTestJSON-2081038681 tempest-KeyPairsNegativeTestJSON-2081038681-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-658035935" status: 404 len: 144 microversion: 2.1 time: 0.034900 Jul 25 12:47:16.438543 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-20a9293e-f553-4a66-9563-1be4f10295c2 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:16.440786 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1103/2276] 10.222.0.49 () {58 vars in 1257 bytes} [Mon Jul 25 12:47:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-658035935 => generated 144 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:47:16.446706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-20a9293e-f553-4a66-9563-1be4f10295c2 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:16.447969 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-20a9293e-f553-4a66-9563-1be4f10295c2 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1366 microversion: 2.47 time: 0.959085 Jul 25 12:47:16.448549 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1174/2277] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:15 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1366 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:16.655963 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=24 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:17.474130 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5495c8fc-05e7-410c-b70a-ab4f82fad771 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:17.475812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5495c8fc-05e7-410c-b70a-ab4f82fad771 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:17.489225 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=10 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:17.493594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5495c8fc-05e7-410c-b70a-ab4f82fad771 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:17.496686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5495c8fc-05e7-410c-b70a-ab4f82fad771 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:17.500890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5495c8fc-05e7-410c-b70a-ab4f82fad771 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:17.501542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5495c8fc-05e7-410c-b70a-ab4f82fad771 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:17.544419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fb0f08dd-0226-4014-a660-7d8e929f68b5 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1565031748", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:17.690565 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-fb0f08dd-0226-4014-a660-7d8e929f68b5 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] validate_networks() for None {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:47:17.731853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5495c8fc-05e7-410c-b70a-ab4f82fad771 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:17.745084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5495c8fc-05e7-410c-b70a-ab4f82fad771 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:17.756499 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5495c8fc-05e7-410c-b70a-ab4f82fad771 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:17.757761 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5495c8fc-05e7-410c-b70a-ab4f82fad771 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1366 microversion: 2.47 time: 0.289058 Jul 25 12:47:17.758360 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1175/2278] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:17 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:47:18.233397 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-fb0f08dd-0226-4014-a660-7d8e929f68b5 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:47:18.234814 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-fb0f08dd-0226-4014-a660-7d8e929f68b5 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:47:18.236162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-fb0f08dd-0226-4014-a660-7d8e929f68b5 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:47:18.237258 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-fb0f08dd-0226-4014-a660-7d8e929f68b5 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:47:18.238328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-fb0f08dd-0226-4014-a660-7d8e929f68b5 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:47:18.271789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb0f08dd-0226-4014-a660-7d8e929f68b5 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:18.276016 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb0f08dd-0226-4014-a660-7d8e929f68b5 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:18.279489 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb0f08dd-0226-4014-a660-7d8e929f68b5 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:18.279954 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb0f08dd-0226-4014-a660-7d8e929f68b5 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:18.398100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-fb0f08dd-0226-4014-a660-7d8e929f68b5 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Getting quotas for project 9fa3abd8185141ceb259088196783624. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:47:18.437177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-fb0f08dd-0226-4014-a660-7d8e929f68b5 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Getting quotas for user 63e6e13a37eb4938ae622cb28cf9b002 and project 9fa3abd8185141ceb259088196783624. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:47:18.494757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fb0f08dd-0226-4014-a660-7d8e929f68b5 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:47:18.497998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fb0f08dd-0226-4014-a660-7d8e929f68b5 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] [instance: 06a283fa-f27c-493e-aa85-074a513b24d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:47:18.680798 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fb0f08dd-0226-4014-a660-7d8e929f68b5 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.042497 Jul 25 12:47:18.690239 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1104/2279] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:47:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:47:18.704538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c7f402d2-da53-41ab-89e2-8ee7e39b6a8c tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:18.705304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c7f402d2-da53-41ab-89e2-8ee7e39b6a8c tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] [instance: 06a283fa-f27c-493e-aa85-074a513b24d4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:18.790613 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-87224a01-5349-4aeb-9fb9-d3ba2a83361a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:18.805699 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-87224a01-5349-4aeb-9fb9-d3ba2a83361a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:18.861344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87224a01-5349-4aeb-9fb9-d3ba2a83361a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:18.861811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87224a01-5349-4aeb-9fb9-d3ba2a83361a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:18.862660 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87224a01-5349-4aeb-9fb9-d3ba2a83361a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:18.863089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87224a01-5349-4aeb-9fb9-d3ba2a83361a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:19.009773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c7f402d2-da53-41ab-89e2-8ee7e39b6a8c tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6e13a37eb4938ae622cb28cf9b002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3abd8185141ceb259088196783624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:19.029364 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c7f402d2-da53-41ab-89e2-8ee7e39b6a8c tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] 10.222.0.49 "GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4" status: 200 len: 1214 microversion: 2.1 time: 0.337232 Jul 25 12:47:19.030051 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1176/2280] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:18 2022] GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4 => generated 1214 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:19.273865 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-87224a01-5349-4aeb-9fb9-d3ba2a83361a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:19.282828 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-87224a01-5349-4aeb-9fb9-d3ba2a83361a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:19.284427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-87224a01-5349-4aeb-9fb9-d3ba2a83361a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:19.303843 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-87224a01-5349-4aeb-9fb9-d3ba2a83361a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1366 microversion: 2.47 time: 0.525781 Jul 25 12:47:19.308349 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1105/2281] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:18 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1366 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:20.052263 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b45fe728-26eb-432c-b52b-ce7c7cdeb670 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:20.052880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b45fe728-26eb-432c-b52b-ce7c7cdeb670 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] [instance: 06a283fa-f27c-493e-aa85-074a513b24d4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:20.331057 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7790300e-cb47-41a3-a74e-b7fecfd8ca78 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:20.332162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7790300e-cb47-41a3-a74e-b7fecfd8ca78 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:20.350906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b45fe728-26eb-432c-b52b-ce7c7cdeb670 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6e13a37eb4938ae622cb28cf9b002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3abd8185141ceb259088196783624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:20.383892 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7790300e-cb47-41a3-a74e-b7fecfd8ca78 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:20.384233 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b45fe728-26eb-432c-b52b-ce7c7cdeb670 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] 10.222.0.49 "GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4" status: 200 len: 1214 microversion: 2.1 time: 0.320831 Jul 25 12:47:20.387897 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1177/2282] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:20 2022] GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4 => generated 1214 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:20.388554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7790300e-cb47-41a3-a74e-b7fecfd8ca78 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:20.389506 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7790300e-cb47-41a3-a74e-b7fecfd8ca78 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:20.389983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7790300e-cb47-41a3-a74e-b7fecfd8ca78 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:20.886541 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7790300e-cb47-41a3-a74e-b7fecfd8ca78 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:20.900801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7790300e-cb47-41a3-a74e-b7fecfd8ca78 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:20.907047 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7790300e-cb47-41a3-a74e-b7fecfd8ca78 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:20.910562 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7790300e-cb47-41a3-a74e-b7fecfd8ca78 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1366 microversion: 2.47 time: 0.586780 Jul 25 12:47:20.913947 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1106/2283] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:20 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1366 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:21.410497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b42e6bb9-8ed5-4de9-a030-774d31348aea tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:21.414598 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b42e6bb9-8ed5-4de9-a030-774d31348aea tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] [instance: 06a283fa-f27c-493e-aa85-074a513b24d4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:21.461967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b42e6bb9-8ed5-4de9-a030-774d31348aea tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:21.462443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b42e6bb9-8ed5-4de9-a030-774d31348aea tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:21.472870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b42e6bb9-8ed5-4de9-a030-774d31348aea tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:21.473532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b42e6bb9-8ed5-4de9-a030-774d31348aea tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:21.827433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b42e6bb9-8ed5-4de9-a030-774d31348aea tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6e13a37eb4938ae622cb28cf9b002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3abd8185141ceb259088196783624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:21.875987 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b42e6bb9-8ed5-4de9-a030-774d31348aea tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] 10.222.0.49 "GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4" status: 200 len: 1284 microversion: 2.1 time: 0.469068 Jul 25 12:47:21.879789 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1178/2284] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:21 2022] GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4 => generated 1284 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:21.944598 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-88dfaf52-c22e-465f-9311-c617168e0871 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:21.945341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-88dfaf52-c22e-465f-9311-c617168e0871 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:21.960521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88dfaf52-c22e-465f-9311-c617168e0871 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:21.961770 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88dfaf52-c22e-465f-9311-c617168e0871 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:21.965339 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88dfaf52-c22e-465f-9311-c617168e0871 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:21.966926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88dfaf52-c22e-465f-9311-c617168e0871 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:22.115701 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-89f69979-4755-44b8-b83f-4091d08d6100 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Action: 'create', calling method: .version_select at 0x7efcf9a3b5e0>, body: {"keypair": {"name": "tempest-keypair-934386481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5nriIDS1wT99G3mVaXKdv5rFhktZq7hRQ0yE65414JCReKw0m9IouiX7PUk4Rp0B/PWX6M83HlxPJQTCJfUfnxWCxUjuKFNm95hpi9CFfq6UKhpiy5uUIBjDWDa4In3Q=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:22.176157 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-89f69979-4755-44b8-b83f-4091d08d6100 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Getting quotas for project 620d373382a442ceb132f66c002517a0. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:47:22.213028 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-89f69979-4755-44b8-b83f-4091d08d6100 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Getting quotas for user 7b4c0e44f8964dec8564b4066656a879 and project 620d373382a442ceb132f66c002517a0. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:47:22.322727 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-88dfaf52-c22e-465f-9311-c617168e0871 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:22.342912 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-89f69979-4755-44b8-b83f-4091d08d6100 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.705513 Jul 25 12:47:22.343821 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1107/2285] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:47:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:47:22.366414 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-88dfaf52-c22e-465f-9311-c617168e0871 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:22.368381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-88dfaf52-c22e-465f-9311-c617168e0871 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:22.374775 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-88dfaf52-c22e-465f-9311-c617168e0871 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1366 microversion: 2.47 time: 0.438335 Jul 25 12:47:22.387431 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1179/2286] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:21 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1366 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:47:22.914126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-41411519-2139-4633-a781-1601f04ba6ad tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:22.915174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-41411519-2139-4633-a781-1601f04ba6ad tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] [instance: 06a283fa-f27c-493e-aa85-074a513b24d4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:22.959788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-41411519-2139-4633-a781-1601f04ba6ad tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:22.966711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-41411519-2139-4633-a781-1601f04ba6ad tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:22.987656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-41411519-2139-4633-a781-1601f04ba6ad tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:22.988873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-41411519-2139-4633-a781-1601f04ba6ad tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:23.015456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:23.237635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-41411519-2139-4633-a781-1601f04ba6ad tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6e13a37eb4938ae622cb28cf9b002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3abd8185141ceb259088196783624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:23.250359 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-41411519-2139-4633-a781-1601f04ba6ad tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] 10.222.0.49 "GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4" status: 200 len: 1272 microversion: 2.1 time: 0.342407 Jul 25 12:47:23.262127 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1180/2287] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:22 2022] GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4 => generated 1272 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:47:23.278062 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d23fb844-ece9-4cc1-b397-487f76b54457 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:23.278615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d23fb844-ece9-4cc1-b397-487f76b54457 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:23.297273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d23fb844-ece9-4cc1-b397-487f76b54457 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:23.299492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d23fb844-ece9-4cc1-b397-487f76b54457 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:23.303712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d23fb844-ece9-4cc1-b397-487f76b54457 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:23.304212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d23fb844-ece9-4cc1-b397-487f76b54457 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:23.340843 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-d23fb844-ece9-4cc1-b397-487f76b54457 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] HTTP exception thrown: Instance 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e could not be found. Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d23fb844-ece9-4cc1-b397-487f76b54457 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Request method failure captured: Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e HTTP/1.1 Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pA1WAerhsx-yhxoohtA9tjYvc6rK_qSmTf7q7vWZHCkRD54gGL2jWNfWfBfxBzIrqGOUBrG4CQro5w42cH8P6nmmrR6jeleVZGuk-P_ulk3iX2meENv1CPCLiz38BibsL6qLwRc4bbZ4ZfBP6VHynmunpa25J-Vfs9pcn9xXQwlao8 Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: a59f31c830d544129310056d267f465c Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1397180338 Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a59f31c830d544129310056d267f465c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a59f31c830d544129310056d267f465c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a59f31c830d544129310056d267f465c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a59f31c830d544129310056d267f465c"}]}] Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1397180338 Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: a59f31c830d544129310056d267f465c Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1397180338 Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-AttachSCSIVolumeTestJSON-1397180338-project Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 929ae21affaf4eb9b8eba955745aa751 Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1397180338-project Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e could not be found. Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '3141f1ca-37c8-4fff-9aa7-518ce0d83f1e'} Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e could not be found. Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:47:23.342871 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:47:23.347763 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e could not be found. Jul 25 12:47:23.347763 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:23.347763 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:23.347763 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:23.347763 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:23.347763 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:23.347763 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:23.347763 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:23.347763 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:23.347763 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e could not be found. Jul 25 12:47:23.347763 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:23.351075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d23fb844-ece9-4cc1-b397-487f76b54457 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Returning 404 to user: Instance 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:23.352488 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d23fb844-ece9-4cc1-b397-487f76b54457 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e" status: 404 len: 111 microversion: 2.1 time: 0.098669 Jul 25 12:47:23.353619 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1181/2288] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:47:23 2022] DELETE /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:47:23.372632 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bf75fa6d-7011-452c-8ddc-460933116462 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:23.373630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bf75fa6d-7011-452c-8ddc-460933116462 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] [instance: 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:23.392871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf75fa6d-7011-452c-8ddc-460933116462 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:23.394688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf75fa6d-7011-452c-8ddc-460933116462 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:23.399098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf75fa6d-7011-452c-8ddc-460933116462 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:23.403042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf75fa6d-7011-452c-8ddc-460933116462 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:23.444884 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-bf75fa6d-7011-452c-8ddc-460933116462 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] HTTP exception thrown: Instance 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e could not be found. Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bf75fa6d-7011-452c-8ddc-460933116462 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Request method failure captured: Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e HTTP/1.1 Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pA1WAerhsx-yhxoohtA9tjYvc6rK_qSmTf7q7vWZHCkRD54gGL2jWNfWfBfxBzIrqGOUBrG4CQro5w42cH8P6nmmrR6jeleVZGuk-P_ulk3iX2meENv1CPCLiz38BibsL6qLwRc4bbZ4ZfBP6VHynmunpa25J-Vfs9pcn9xXQwlao8 Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: a59f31c830d544129310056d267f465c Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1397180338 Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a59f31c830d544129310056d267f465c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a59f31c830d544129310056d267f465c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a59f31c830d544129310056d267f465c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a59f31c830d544129310056d267f465c"}]}] Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1397180338 Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: a59f31c830d544129310056d267f465c Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1397180338 Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-AttachSCSIVolumeTestJSON-1397180338-project Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 929ae21affaf4eb9b8eba955745aa751 Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1397180338-project Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e could not be found. Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '3141f1ca-37c8-4fff-9aa7-518ce0d83f1e'} Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e could not be found. Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e could not be found. Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:23.448127 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:23.451736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:23.451736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:23.451736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:23.451736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:23.451736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:23.451736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e could not be found. Jul 25 12:47:23.451736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:23.456333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bf75fa6d-7011-452c-8ddc-460933116462 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] Returning 404 to user: Instance 3141f1ca-37c8-4fff-9aa7-518ce0d83f1e could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:23.459988 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bf75fa6d-7011-452c-8ddc-460933116462 tempest-AttachSCSIVolumeTestJSON-1397180338 tempest-AttachSCSIVolumeTestJSON-1397180338-project] 10.222.0.49 "GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e" status: 404 len: 111 microversion: 2.1 time: 0.100884 Jul 25 12:47:23.461060 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1182/2289] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:23 2022] GET /compute/v2.1/servers/3141f1ca-37c8-4fff-9aa7-518ce0d83f1e => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:47:23.471897 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4902cb49-711b-405c-a647-072b4834c5db tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1050483445", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "a6f54b0c-c351-4711-aa7a-a0f7f5852543"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:23.478388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a6ac81b6-51cf-4645-a96b-91aee4660d8c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:23.479490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a6ac81b6-51cf-4645-a96b-91aee4660d8c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:23.495028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a6ac81b6-51cf-4645-a96b-91aee4660d8c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:23.495976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a6ac81b6-51cf-4645-a96b-91aee4660d8c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:23.497020 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a6ac81b6-51cf-4645-a96b-91aee4660d8c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:23.502083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a6ac81b6-51cf-4645-a96b-91aee4660d8c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:23.600795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-4902cb49-711b-405c-a647-072b4834c5db tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] validate_networks() for [('a6f54b0c-c351-4711-aa7a-a0f7f5852543', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:47:23.838209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a6ac81b6-51cf-4645-a96b-91aee4660d8c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:23.854796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a6ac81b6-51cf-4645-a96b-91aee4660d8c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:23.857757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a6ac81b6-51cf-4645-a96b-91aee4660d8c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:23.862844 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a6ac81b6-51cf-4645-a96b-91aee4660d8c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1366 microversion: 2.47 time: 0.399325 Jul 25 12:47:23.864108 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1183/2290] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:23 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1366 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:24.436176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-975fde91-595d-47d2-a7ed-1849a6499e35 tempest-AbsoluteLimitsNegativeTestJSON-87681462 tempest-AbsoluteLimitsNegativeTestJSON-87681462-project] Calling method '.version_select at 0x7efcf9c2d430>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:24.471154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-975fde91-595d-47d2-a7ed-1849a6499e35 tempest-AbsoluteLimitsNegativeTestJSON-87681462 tempest-AbsoluteLimitsNegativeTestJSON-87681462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:24.473863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-975fde91-595d-47d2-a7ed-1849a6499e35 tempest-AbsoluteLimitsNegativeTestJSON-87681462 tempest-AbsoluteLimitsNegativeTestJSON-87681462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:24.476439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-975fde91-595d-47d2-a7ed-1849a6499e35 tempest-AbsoluteLimitsNegativeTestJSON-87681462 tempest-AbsoluteLimitsNegativeTestJSON-87681462-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:24.477608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-975fde91-595d-47d2-a7ed-1849a6499e35 tempest-AbsoluteLimitsNegativeTestJSON-87681462 tempest-AbsoluteLimitsNegativeTestJSON-87681462-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:24.552766 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-975fde91-595d-47d2-a7ed-1849a6499e35 tempest-AbsoluteLimitsNegativeTestJSON-87681462 tempest-AbsoluteLimitsNegativeTestJSON-87681462-project] 10.222.0.49 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.687044 Jul 25 12:47:24.554006 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1184/2291] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Jul 25 12:47:23 2022] GET /compute/v2.1/limits => generated 511 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:24.576183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6dd1161c-c594-4d92-bae1-a287e6021398 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:24.577100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6dd1161c-c594-4d92-bae1-a287e6021398 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] [instance: 06a283fa-f27c-493e-aa85-074a513b24d4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:24.619828 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6dd1161c-c594-4d92-bae1-a287e6021398 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:24.624686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6dd1161c-c594-4d92-bae1-a287e6021398 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:24.630178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6dd1161c-c594-4d92-bae1-a287e6021398 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:24.634450 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6dd1161c-c594-4d92-bae1-a287e6021398 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:25.026817 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4902cb49-711b-405c-a647-072b4834c5db tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:47:25.028043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4902cb49-711b-405c-a647-072b4834c5db tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:47:25.028687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4902cb49-711b-405c-a647-072b4834c5db tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:47:25.029264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4902cb49-711b-405c-a647-072b4834c5db tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:47:25.029854 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4902cb49-711b-405c-a647-072b4834c5db tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:47:25.050237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4902cb49-711b-405c-a647-072b4834c5db tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:25.051145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4902cb49-711b-405c-a647-072b4834c5db tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:25.058737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4902cb49-711b-405c-a647-072b4834c5db tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:25.059642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4902cb49-711b-405c-a647-072b4834c5db tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:25.103658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-4902cb49-711b-405c-a647-072b4834c5db tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Getting quotas for project 35482ec73a054bafa24c83aea2b08636. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:47:25.123256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-4902cb49-711b-405c-a647-072b4834c5db tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Getting quotas for user bedadaad3cf44edb8fd8037aebd2ee25 and project 35482ec73a054bafa24c83aea2b08636. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:47:25.159363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4902cb49-711b-405c-a647-072b4834c5db tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:47:25.163934 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4902cb49-711b-405c-a647-072b4834c5db tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:47:25.308976 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4902cb49-711b-405c-a647-072b4834c5db tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.626524 Jul 25 12:47:25.311128 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1108/2292] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:47:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:47:25.325767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b729c111-c9fa-473a-aa78-2154e180f705 tempest-AbsoluteLimitsNegativeTestJSON-87681462 tempest-AbsoluteLimitsNegativeTestJSON-87681462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-236653141", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:25.483848 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-b729c111-c9fa-473a-aa78-2154e180f705 tempest-AbsoluteLimitsNegativeTestJSON-87681462 tempest-AbsoluteLimitsNegativeTestJSON-87681462-project] validate_networks() for None {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:47:25.504861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6dd1161c-c594-4d92-bae1-a287e6021398 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6e13a37eb4938ae622cb28cf9b002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3abd8185141ceb259088196783624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:25.544602 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6dd1161c-c594-4d92-bae1-a287e6021398 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] 10.222.0.49 "GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4" status: 200 len: 1314 microversion: 2.1 time: 0.974702 Jul 25 12:47:25.546243 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1185/2293] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:24 2022] GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4 => generated 1314 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:25.582761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-11e88d54-df60-4803-b6ff-5c6a03cbe16b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:25.597754 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-11e88d54-df60-4803-b6ff-5c6a03cbe16b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:25.636934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11e88d54-df60-4803-b6ff-5c6a03cbe16b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:25.650498 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11e88d54-df60-4803-b6ff-5c6a03cbe16b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:25.653190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11e88d54-df60-4803-b6ff-5c6a03cbe16b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:25.654047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11e88d54-df60-4803-b6ff-5c6a03cbe16b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:26.752088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-11e88d54-df60-4803-b6ff-5c6a03cbe16b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:26.778894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-11e88d54-df60-4803-b6ff-5c6a03cbe16b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:26.788595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-11e88d54-df60-4803-b6ff-5c6a03cbe16b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:26.795266 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-11e88d54-df60-4803-b6ff-5c6a03cbe16b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1366 microversion: 2.47 time: 1.241518 Jul 25 12:47:26.806948 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1186/2294] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:25 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1366 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:26.814155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-423843c2-f7cf-4396-9628-b425fadd119a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:26.821999 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-423843c2-f7cf-4396-9628-b425fadd119a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:26.866205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-423843c2-f7cf-4396-9628-b425fadd119a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:26.868576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-423843c2-f7cf-4396-9628-b425fadd119a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:26.879513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-423843c2-f7cf-4396-9628-b425fadd119a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:26.881132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-423843c2-f7cf-4396-9628-b425fadd119a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:26.983810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-b729c111-c9fa-473a-aa78-2154e180f705 tempest-AbsoluteLimitsNegativeTestJSON-87681462 tempest-AbsoluteLimitsNegativeTestJSON-87681462-project] Getting quotas for project 31647cebbe9e42de8076d3dd33154787. Resources: dict_keys(['metadata_items']) {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:47:27.002959 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-b729c111-c9fa-473a-aa78-2154e180f705 tempest-AbsoluteLimitsNegativeTestJSON-87681462 tempest-AbsoluteLimitsNegativeTestJSON-87681462-project] Getting quotas for user adceaa3e746a4f5dbc20a242912df4b5 and project 31647cebbe9e42de8076d3dd33154787. Resources: dict_keys(['metadata_items']) {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:47:27.051616 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-b729c111-c9fa-473a-aa78-2154e180f705 tempest-AbsoluteLimitsNegativeTestJSON-87681462 tempest-AbsoluteLimitsNegativeTestJSON-87681462-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b729c111-c9fa-473a-aa78-2154e180f705 tempest-AbsoluteLimitsNegativeTestJSON-87681462 tempest-AbsoluteLimitsNegativeTestJSON-87681462-project] Request method failure captured: Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 1751 Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDbwJRP878mJj8pVDFUZGoSw6b1OUHwJaoe2kKRGRUfSLhpCC8aaww338Q7aVWKFqRz2Ge63Zj0PDxgWQNamL0cWR9yln8Ej8wPCnBcwstysaf_KFnn88zu3KZBQWojEECNuaq8-K7QwIdd7iDNlakH5hOC-y9PJ9NuzD2VP0dbtvs Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 31647cebbe9e42de8076d3dd33154787 Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-87681462 Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_31647cebbe9e42de8076d3dd33154787", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/31647cebbe9e42de8076d3dd33154787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/31647cebbe9e42de8076d3dd33154787"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/31647cebbe9e42de8076d3dd33154787"}]}] Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-87681462 Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 31647cebbe9e42de8076d3dd33154787 Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-87681462 Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-87681462-project Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: adceaa3e746a4f5dbc20a242912df4b5 Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-87681462-project Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-236653141", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:47:27.054747 n-d-848886-15 devstack@n-api.service[125883]: exception: Maximum number of metadata items exceeds 128 Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-236653141', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:27.059140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:27.065011 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:27.065011 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 12:47:27.065011 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 25 12:47:27.065011 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 12:47:27.065011 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 25 12:47:27.065011 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:27.065011 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:27.065011 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:27.065011 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:27.065011 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:27.065011 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:27.065011 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:27.065011 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:27.065011 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 25 12:47:27.065011 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:27.065011 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b729c111-c9fa-473a-aa78-2154e180f705 tempest-AbsoluteLimitsNegativeTestJSON-87681462 tempest-AbsoluteLimitsNegativeTestJSON-87681462-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:27.065011 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b729c111-c9fa-473a-aa78-2154e180f705 tempest-AbsoluteLimitsNegativeTestJSON-87681462 tempest-AbsoluteLimitsNegativeTestJSON-87681462-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.743396 Jul 25 12:47:27.065011 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1109/2295] 10.222.0.49 () {60 vars in 1148 bytes} [Mon Jul 25 12:47:25 2022] POST /compute/v2.1/servers => generated 87 bytes in 1750 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:47:27.070542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bf719ad2-8ebf-4619-ad73-66b9ed912ef3 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:27.070542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bf719ad2-8ebf-4619-ad73-66b9ed912ef3 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] [instance: 06a283fa-f27c-493e-aa85-074a513b24d4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:27.084190 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf719ad2-8ebf-4619-ad73-66b9ed912ef3 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:27.085430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf719ad2-8ebf-4619-ad73-66b9ed912ef3 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:27.086510 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf719ad2-8ebf-4619-ad73-66b9ed912ef3 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:27.086962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf719ad2-8ebf-4619-ad73-66b9ed912ef3 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:27.357402 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-423843c2-f7cf-4396-9628-b425fadd119a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:27.410715 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-423843c2-f7cf-4396-9628-b425fadd119a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1229 microversion: 2.1 time: 0.606776 Jul 25 12:47:27.417009 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1187/2296] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:26 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1229 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:27.839193 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5e0ff5e3-c1c6-4cf3-8b54-29c656b0d14d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:27.843464 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5e0ff5e3-c1c6-4cf3-8b54-29c656b0d14d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:27.888324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e0ff5e3-c1c6-4cf3-8b54-29c656b0d14d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:27.890544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e0ff5e3-c1c6-4cf3-8b54-29c656b0d14d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:27.895484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e0ff5e3-c1c6-4cf3-8b54-29c656b0d14d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:27.896659 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e0ff5e3-c1c6-4cf3-8b54-29c656b0d14d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:28.268661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bf719ad2-8ebf-4619-ad73-66b9ed912ef3 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6e13a37eb4938ae622cb28cf9b002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3abd8185141ceb259088196783624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:28.274724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5e0ff5e3-c1c6-4cf3-8b54-29c656b0d14d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:28.333020 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bf719ad2-8ebf-4619-ad73-66b9ed912ef3 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] 10.222.0.49 "GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4" status: 200 len: 1314 microversion: 2.1 time: 1.265817 Jul 25 12:47:28.341931 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1110/2297] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:27 2022] GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4 => generated 1314 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:28.342962 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5e0ff5e3-c1c6-4cf3-8b54-29c656b0d14d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:28.353177 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5e0ff5e3-c1c6-4cf3-8b54-29c656b0d14d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:28.357496 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5e0ff5e3-c1c6-4cf3-8b54-29c656b0d14d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1366 microversion: 2.47 time: 0.528054 Jul 25 12:47:28.362483 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1188/2298] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:27 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1366 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:47:28.439623 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9d77ff83-44da-4166-a7b6-9bcd81401115 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:28.440609 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9d77ff83-44da-4166-a7b6-9bcd81401115 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:28.461667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9d77ff83-44da-4166-a7b6-9bcd81401115 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:28.477723 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9d77ff83-44da-4166-a7b6-9bcd81401115 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:28.478809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9d77ff83-44da-4166-a7b6-9bcd81401115 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:28.479471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9d77ff83-44da-4166-a7b6-9bcd81401115 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:28.686111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9d77ff83-44da-4166-a7b6-9bcd81401115 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:28.729295 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9d77ff83-44da-4166-a7b6-9bcd81401115 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1283 microversion: 2.1 time: 0.297443 Jul 25 12:47:28.733233 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1111/2299] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:28 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1283 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:29.003040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-372951cb-2aef-46d7-a248-8211b7b0c2df req-26f099ab-776a-41ab-bb13-0f8ccf36cace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06a283fa-f27c-493e-aa85-074a513b24d4", "tag": "9e6ee92e-2c99-4f9c-ad97-08f123f5b2a6"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:29.031329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-372951cb-2aef-46d7-a248-8211b7b0c2df req-26f099ab-776a-41ab-bb13-0f8ccf36cace service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:29.032175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-372951cb-2aef-46d7-a248-8211b7b0c2df req-26f099ab-776a-41ab-bb13-0f8ccf36cace service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:29.075770 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-372951cb-2aef-46d7-a248-8211b7b0c2df req-26f099ab-776a-41ab-bb13-0f8ccf36cace service nova] Creating event network-changed:9e6ee92e-2c99-4f9c-ad97-08f123f5b2a6 for instance 06a283fa-f27c-493e-aa85-074a513b24d4 on n-h2-848886-15 Jul 25 12:47:29.106522 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-372951cb-2aef-46d7-a248-8211b7b0c2df req-26f099ab-776a-41ab-bb13-0f8ccf36cace service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090873 Jul 25 12:47:29.142679 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1189/2300] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:29.362520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ab94f708-e45f-4593-ad41-8edd5a8b4626 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:29.367342 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ab94f708-e45f-4593-ad41-8edd5a8b4626 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] [instance: 06a283fa-f27c-493e-aa85-074a513b24d4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:29.401926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7d6a1940-ae8a-4a93-b46a-a28a87f3ee5a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:29.403274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7d6a1940-ae8a-4a93-b46a-a28a87f3ee5a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:29.449941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d6a1940-ae8a-4a93-b46a-a28a87f3ee5a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:29.450237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ab94f708-e45f-4593-ad41-8edd5a8b4626 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:29.450418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d6a1940-ae8a-4a93-b46a-a28a87f3ee5a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:29.451036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ab94f708-e45f-4593-ad41-8edd5a8b4626 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:29.451456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d6a1940-ae8a-4a93-b46a-a28a87f3ee5a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:29.452132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d6a1940-ae8a-4a93-b46a-a28a87f3ee5a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:29.452583 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ab94f708-e45f-4593-ad41-8edd5a8b4626 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:29.453308 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ab94f708-e45f-4593-ad41-8edd5a8b4626 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:29.632490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7d6a1940-ae8a-4a93-b46a-a28a87f3ee5a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:29.652632 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7d6a1940-ae8a-4a93-b46a-a28a87f3ee5a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:29.654985 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7d6a1940-ae8a-4a93-b46a-a28a87f3ee5a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:29.680893 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7d6a1940-ae8a-4a93-b46a-a28a87f3ee5a tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1366 microversion: 2.47 time: 0.282863 Jul 25 12:47:29.682394 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1190/2301] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:29 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:29.762368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-22def4d9-0413-4ec7-8897-0e33c84777c5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:29.762990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-22def4d9-0413-4ec7-8897-0e33c84777c5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:29.797413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-22def4d9-0413-4ec7-8897-0e33c84777c5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:29.798298 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-22def4d9-0413-4ec7-8897-0e33c84777c5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:29.799759 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-22def4d9-0413-4ec7-8897-0e33c84777c5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:29.810217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-22def4d9-0413-4ec7-8897-0e33c84777c5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:30.086220 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-22def4d9-0413-4ec7-8897-0e33c84777c5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:30.121568 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-22def4d9-0413-4ec7-8897-0e33c84777c5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1283 microversion: 2.1 time: 0.364164 Jul 25 12:47:30.138707 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1191/2302] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:29 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1283 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:47:30.435002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ab94f708-e45f-4593-ad41-8edd5a8b4626 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6e13a37eb4938ae622cb28cf9b002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3abd8185141ceb259088196783624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:30.461899 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ab94f708-e45f-4593-ad41-8edd5a8b4626 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] 10.222.0.49 "GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4" status: 200 len: 1314 microversion: 2.1 time: 1.109774 Jul 25 12:47:30.481014 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1112/2303] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:29 2022] GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4 => generated 1314 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:30.722101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a10feeb0-d3bf-40da-a747-5cee13504ad4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:30.723393 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a10feeb0-d3bf-40da-a747-5cee13504ad4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:30.751797 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a10feeb0-d3bf-40da-a747-5cee13504ad4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:30.752597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a10feeb0-d3bf-40da-a747-5cee13504ad4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:30.754057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a10feeb0-d3bf-40da-a747-5cee13504ad4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:30.754851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a10feeb0-d3bf-40da-a747-5cee13504ad4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:30.943076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a10feeb0-d3bf-40da-a747-5cee13504ad4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:30.953247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a10feeb0-d3bf-40da-a747-5cee13504ad4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:30.954829 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a10feeb0-d3bf-40da-a747-5cee13504ad4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:30.957703 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a10feeb0-d3bf-40da-a747-5cee13504ad4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1366 microversion: 2.47 time: 0.248367 Jul 25 12:47:30.958954 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1192/2304] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:30 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:31.165221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-881e1739-3142-47e9-84f8-86e42e0458b6 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:31.167359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-881e1739-3142-47e9-84f8-86e42e0458b6 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:31.191983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-881e1739-3142-47e9-84f8-86e42e0458b6 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:31.193146 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-881e1739-3142-47e9-84f8-86e42e0458b6 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:31.198426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-881e1739-3142-47e9-84f8-86e42e0458b6 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:31.199551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-881e1739-3142-47e9-84f8-86e42e0458b6 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:31.499647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-65eb4d24-0c77-4f82-9158-862f89da18a7 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:31.501644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-65eb4d24-0c77-4f82-9158-862f89da18a7 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] [instance: 06a283fa-f27c-493e-aa85-074a513b24d4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:31.543195 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65eb4d24-0c77-4f82-9158-862f89da18a7 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:31.544317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65eb4d24-0c77-4f82-9158-862f89da18a7 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:31.550219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65eb4d24-0c77-4f82-9158-862f89da18a7 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:31.551454 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65eb4d24-0c77-4f82-9158-862f89da18a7 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:31.597411 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-881e1739-3142-47e9-84f8-86e42e0458b6 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:31.648728 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-881e1739-3142-47e9-84f8-86e42e0458b6 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1283 microversion: 2.1 time: 0.492618 Jul 25 12:47:31.663778 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1113/2305] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:31 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1283 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:31.695910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d1423f68-3572-4fb5-bb11-c972191c2c45 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1557420750", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d2b96073-10d1-4b9e-bd9c-0c848c08afaa"}], "security_groups": [{"name": "tempest-securitygroup--2023963861"}], "key_name": "tempest-keypair-934386481", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:32.663258 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-d1423f68-3572-4fb5-bb11-c972191c2c45 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] validate_networks() for [('d2b96073-10d1-4b9e-bd9c-0c848c08afaa', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:47:33.197076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-65eb4d24-0c77-4f82-9158-862f89da18a7 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6e13a37eb4938ae622cb28cf9b002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3abd8185141ceb259088196783624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:33.205313 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-65eb4d24-0c77-4f82-9158-862f89da18a7 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] 10.222.0.49 "GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4" status: 200 len: 1314 microversion: 2.1 time: 1.711596 Jul 25 12:47:33.209792 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1193/2306] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:31 2022] GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4 => generated 1314 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:33.215259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5f536ba5-29b3-4e4a-b952-6964bc687fb4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:33.221768 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5f536ba5-29b3-4e4a-b952-6964bc687fb4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:33.240701 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5f536ba5-29b3-4e4a-b952-6964bc687fb4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:33.241375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5f536ba5-29b3-4e4a-b952-6964bc687fb4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:33.242614 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5f536ba5-29b3-4e4a-b952-6964bc687fb4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:33.243361 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5f536ba5-29b3-4e4a-b952-6964bc687fb4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:33.645573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5f536ba5-29b3-4e4a-b952-6964bc687fb4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:33.677394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5f536ba5-29b3-4e4a-b952-6964bc687fb4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:33.686430 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5f536ba5-29b3-4e4a-b952-6964bc687fb4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:33.688047 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5f536ba5-29b3-4e4a-b952-6964bc687fb4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1366 microversion: 2.47 time: 0.477107 Jul 25 12:47:33.691662 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1194/2307] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:33 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1366 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:33.704849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-12337f06-284e-4d00-af8b-bf7694b2fd28 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:33.705648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-12337f06-284e-4d00-af8b-bf7694b2fd28 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:33.716772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-12337f06-284e-4d00-af8b-bf7694b2fd28 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:33.717228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-12337f06-284e-4d00-af8b-bf7694b2fd28 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:33.719960 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-12337f06-284e-4d00-af8b-bf7694b2fd28 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:33.722481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-12337f06-284e-4d00-af8b-bf7694b2fd28 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:34.321393 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-12337f06-284e-4d00-af8b-bf7694b2fd28 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:34.334269 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-12337f06-284e-4d00-af8b-bf7694b2fd28 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1325 microversion: 2.1 time: 0.641194 Jul 25 12:47:34.335514 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1195/2308] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:33 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1325 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:34.344491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-db1a4957-73ae-4d94-9108-84471e4ca96b tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95ca2022-2e91-45b7-9e50-5aa493a0d2b9"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:34.360794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-db1a4957-73ae-4d94-9108-84471e4ca96b tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:34.371139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-db1a4957-73ae-4d94-9108-84471e4ca96b tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:34.371839 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-db1a4957-73ae-4d94-9108-84471e4ca96b tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:34.372886 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-db1a4957-73ae-4d94-9108-84471e4ca96b tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:34.373567 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-db1a4957-73ae-4d94-9108-84471e4ca96b tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:34.428197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-d1423f68-3572-4fb5-bb11-c972191c2c45 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Getting quotas for project 620d373382a442ceb132f66c002517a0. Resources: dict_keys(['metadata_items']) {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:47:34.443871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=91,nova_api:DELETE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:34.445498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-d1423f68-3572-4fb5-bb11-c972191c2c45 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Getting quotas for user 7b4c0e44f8964dec8564b4066656a879 and project 620d373382a442ceb132f66c002517a0. Resources: dict_keys(['metadata_items']) {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:47:34.469021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:34.472920 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-d1423f68-3572-4fb5-bb11-c972191c2c45 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:47:34.476555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-d1423f68-3572-4fb5-bb11-c972191c2c45 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:47:34.477465 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-d1423f68-3572-4fb5-bb11-c972191c2c45 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:47:34.478095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-d1423f68-3572-4fb5-bb11-c972191c2c45 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:47:34.478696 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-d1423f68-3572-4fb5-bb11-c972191c2c45 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:47:34.504805 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:34.531654 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1423f68-3572-4fb5-bb11-c972191c2c45 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:34.532211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1423f68-3572-4fb5-bb11-c972191c2c45 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:34.532935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1423f68-3572-4fb5-bb11-c972191c2c45 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:34.533369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1423f68-3572-4fb5-bb11-c972191c2c45 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:34.552690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=91 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:34.630946 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-d1423f68-3572-4fb5-bb11-c972191c2c45 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Getting quotas for project 620d373382a442ceb132f66c002517a0. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:47:34.654788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-d1423f68-3572-4fb5-bb11-c972191c2c45 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Getting quotas for user 7b4c0e44f8964dec8564b4066656a879 and project 620d373382a442ceb132f66c002517a0. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:47:34.725351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d1423f68-3572-4fb5-bb11-c972191c2c45 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:47:34.729069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d1423f68-3572-4fb5-bb11-c972191c2c45 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:47:34.870997 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d1423f68-3572-4fb5-bb11-c972191c2c45 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.205494 Jul 25 12:47:34.876060 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1114/2309] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:47:31 2022] POST /compute/v2.1/servers => generated 409 bytes in 3212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:47:34.891900 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-79dd3860-93c5-4dcd-b514-3c1994d96e55 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:34.892540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-79dd3860-93c5-4dcd-b514-3c1994d96e55 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] [instance: 06a283fa-f27c-493e-aa85-074a513b24d4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:34.910706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79dd3860-93c5-4dcd-b514-3c1994d96e55 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:34.911163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79dd3860-93c5-4dcd-b514-3c1994d96e55 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:34.911964 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79dd3860-93c5-4dcd-b514-3c1994d96e55 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:34.912399 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79dd3860-93c5-4dcd-b514-3c1994d96e55 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:35.112049 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-db1a4957-73ae-4d94-9108-84471e4ca96b tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "POST /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.769946 Jul 25 12:47:35.165598 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1196/2310] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Jul 25 12:47:34 2022] POST /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments => generated 194 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:35.189802 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-19817816-db3c-41cd-936c-89e8f2dab8f1 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:35.213881 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-19817816-db3c-41cd-936c-89e8f2dab8f1 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:35.247955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:35.254372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-19817816-db3c-41cd-936c-89e8f2dab8f1 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:35.255893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-19817816-db3c-41cd-936c-89e8f2dab8f1 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:35.259937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-19817816-db3c-41cd-936c-89e8f2dab8f1 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:35.260930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-19817816-db3c-41cd-936c-89e8f2dab8f1 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:35.537793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-19817816-db3c-41cd-936c-89e8f2dab8f1 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:35.547879 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-79dd3860-93c5-4dcd-b514-3c1994d96e55 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6e13a37eb4938ae622cb28cf9b002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3abd8185141ceb259088196783624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:35.561020 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-19817816-db3c-41cd-936c-89e8f2dab8f1 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:35.569484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-19817816-db3c-41cd-936c-89e8f2dab8f1 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:35.571581 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-19817816-db3c-41cd-936c-89e8f2dab8f1 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1366 microversion: 2.47 time: 0.404032 Jul 25 12:47:35.572948 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1197/2311] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:35 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1366 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:35.610406 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-79dd3860-93c5-4dcd-b514-3c1994d96e55 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] 10.222.0.49 "GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4" status: 200 len: 1314 microversion: 2.1 time: 0.732303 Jul 25 12:47:35.615372 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1115/2312] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:34 2022] GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4 => generated 1314 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:35.652834 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5225797b-dbcd-4e9b-82f1-d2b544228068 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:35.656928 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5225797b-dbcd-4e9b-82f1-d2b544228068 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:35.940229 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5225797b-dbcd-4e9b-82f1-d2b544228068 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4c0e44f8964dec8564b4066656a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d373382a442ceb132f66c002517a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:35.963556 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5225797b-dbcd-4e9b-82f1-d2b544228068 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45" status: 200 len: 1277 microversion: 2.1 time: 0.344410 Jul 25 12:47:35.991401 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1116/2313] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:35 2022] GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45 => generated 1277 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:36.013612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-90f5acae-34cd-4460-bbd9-6e6acb438243 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:36.015946 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-90f5acae-34cd-4460-bbd9-6e6acb438243 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:36.036693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-90f5acae-34cd-4460-bbd9-6e6acb438243 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:36.038956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-90f5acae-34cd-4460-bbd9-6e6acb438243 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:36.042940 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-90f5acae-34cd-4460-bbd9-6e6acb438243 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:36.043518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-90f5acae-34cd-4460-bbd9-6e6acb438243 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:36.361709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c290c9f8-fbc3-44cd-8501-b411d662e076 tempest-AZV2TestJSON-1019694640 tempest-AZV2TestJSON-1019694640-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:36.363936 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c290c9f8-fbc3-44cd-8501-b411d662e076 tempest-AZV2TestJSON-1019694640 tempest-AZV2TestJSON-1019694640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:36.365982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c290c9f8-fbc3-44cd-8501-b411d662e076 tempest-AZV2TestJSON-1019694640 tempest-AZV2TestJSON-1019694640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:36.370318 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c290c9f8-fbc3-44cd-8501-b411d662e076 tempest-AZV2TestJSON-1019694640 tempest-AZV2TestJSON-1019694640-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:36.373597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c290c9f8-fbc3-44cd-8501-b411d662e076 tempest-AZV2TestJSON-1019694640 tempest-AZV2TestJSON-1019694640-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:36.385337 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:36.450765 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c290c9f8-fbc3-44cd-8501-b411d662e076 tempest-AZV2TestJSON-1019694640 tempest-AZV2TestJSON-1019694640-project] 10.222.0.49 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.873878 Jul 25 12:47:36.460550 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1198/2314] 10.222.0.49 () {58 vars in 1164 bytes} [Mon Jul 25 12:47:35 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:47:36.618591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-42562693-b78b-44ed-b945-c80779240b52 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:36.619626 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-42562693-b78b-44ed-b945-c80779240b52 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:36.671062 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-42562693-b78b-44ed-b945-c80779240b52 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:36.676035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-42562693-b78b-44ed-b945-c80779240b52 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:36.682908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-42562693-b78b-44ed-b945-c80779240b52 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:36.683537 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-42562693-b78b-44ed-b945-c80779240b52 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:36.715223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-90f5acae-34cd-4460-bbd9-6e6acb438243 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:36.729959 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-90f5acae-34cd-4460-bbd9-6e6acb438243 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1325 microversion: 2.1 time: 0.736738 Jul 25 12:47:36.735352 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1117/2315] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:35 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1325 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:36.757870 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cac55e2d-951b-4632-9041-bb18ef5f4ffe tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:36.758454 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cac55e2d-951b-4632-9041-bb18ef5f4ffe tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] [instance: 06a283fa-f27c-493e-aa85-074a513b24d4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:36.793863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cac55e2d-951b-4632-9041-bb18ef5f4ffe tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:36.794542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cac55e2d-951b-4632-9041-bb18ef5f4ffe tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:36.795654 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cac55e2d-951b-4632-9041-bb18ef5f4ffe tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:36.796225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cac55e2d-951b-4632-9041-bb18ef5f4ffe tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:37.116023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-42562693-b78b-44ed-b945-c80779240b52 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:37.165845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-42562693-b78b-44ed-b945-c80779240b52 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:37.168041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-42562693-b78b-44ed-b945-c80779240b52 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:37.169325 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-42562693-b78b-44ed-b945-c80779240b52 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1372 microversion: 2.47 time: 0.559461 Jul 25 12:47:37.180979 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1199/2316] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:36 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1372 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:37.188565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-39fe27ec-8157-4341-9122-7249beb2bb2b req-9263f4fe-1d1d-4f24-90a6-328e42253a73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aec454db-239e-49ed-a021-297e11579b04", "tag": "4efa19f7-1e52-4bc9-9cca-24a1ec66a5db"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:37.228440 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-39fe27ec-8157-4341-9122-7249beb2bb2b req-9263f4fe-1d1d-4f24-90a6-328e42253a73 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:37.228770 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-39fe27ec-8157-4341-9122-7249beb2bb2b req-9263f4fe-1d1d-4f24-90a6-328e42253a73 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:37.277552 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-39fe27ec-8157-4341-9122-7249beb2bb2b req-9263f4fe-1d1d-4f24-90a6-328e42253a73 service nova] Creating event network-changed:4efa19f7-1e52-4bc9-9cca-24a1ec66a5db for instance aec454db-239e-49ed-a021-297e11579b04 on n-h1-848886-15 Jul 25 12:47:37.311067 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-39fe27ec-8157-4341-9122-7249beb2bb2b req-9263f4fe-1d1d-4f24-90a6-328e42253a73 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128150 Jul 25 12:47:37.311837 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1200/2317] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:37.330334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b0d12ae2-8168-4c55-b17e-fa83a0c5684b tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:37.331513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b0d12ae2-8168-4c55-b17e-fa83a0c5684b tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:37.354108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0d12ae2-8168-4c55-b17e-fa83a0c5684b tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:37.359617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0d12ae2-8168-4c55-b17e-fa83a0c5684b tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:37.361923 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0d12ae2-8168-4c55-b17e-fa83a0c5684b tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:37.362761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0d12ae2-8168-4c55-b17e-fa83a0c5684b tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:37.482406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cac55e2d-951b-4632-9041-bb18ef5f4ffe tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6e13a37eb4938ae622cb28cf9b002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3abd8185141ceb259088196783624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:37.501593 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cac55e2d-951b-4632-9041-bb18ef5f4ffe tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] 10.222.0.49 "GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4" status: 200 len: 1314 microversion: 2.1 time: 0.763700 Jul 25 12:47:37.502835 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1118/2318] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:36 2022] GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4 => generated 1314 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:37.534882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b0d12ae2-8168-4c55-b17e-fa83a0c5684b tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4c0e44f8964dec8564b4066656a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d373382a442ceb132f66c002517a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:37.548136 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b0d12ae2-8168-4c55-b17e-fa83a0c5684b tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45" status: 200 len: 1329 microversion: 2.1 time: 0.234206 Jul 25 12:47:37.580596 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1201/2319] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:37 2022] GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45 => generated 1329 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:37.761174 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ead3772e-7901-481a-b67b-cc67d3704c89 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:37.761899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ead3772e-7901-481a-b67b-cc67d3704c89 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:37.774052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ead3772e-7901-481a-b67b-cc67d3704c89 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:37.774650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ead3772e-7901-481a-b67b-cc67d3704c89 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:37.775558 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ead3772e-7901-481a-b67b-cc67d3704c89 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:37.777201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ead3772e-7901-481a-b67b-cc67d3704c89 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:38.207061 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e8245169-6430-469e-b93a-b07b86fab27b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:38.207802 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e8245169-6430-469e-b93a-b07b86fab27b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:38.221917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8245169-6430-469e-b93a-b07b86fab27b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:38.222602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8245169-6430-469e-b93a-b07b86fab27b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:38.223590 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8245169-6430-469e-b93a-b07b86fab27b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:38.224175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8245169-6430-469e-b93a-b07b86fab27b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:38.408371 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ead3772e-7901-481a-b67b-cc67d3704c89 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:38.425065 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ead3772e-7901-481a-b67b-cc67d3704c89 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1325 microversion: 2.1 time: 0.668750 Jul 25 12:47:38.432203 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1119/2320] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:37 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1325 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:38.475510 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e8245169-6430-469e-b93a-b07b86fab27b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:38.486814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e8245169-6430-469e-b93a-b07b86fab27b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:38.488338 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e8245169-6430-469e-b93a-b07b86fab27b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:38.494948 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e8245169-6430-469e-b93a-b07b86fab27b tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1372 microversion: 2.47 time: 0.291842 Jul 25 12:47:38.496069 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1202/2321] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:38 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1372 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:38.529489 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-860df054-7da5-4d30-9bb6-f7975f89428d tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:38.530458 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-860df054-7da5-4d30-9bb6-f7975f89428d tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] [instance: 06a283fa-f27c-493e-aa85-074a513b24d4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:38.549373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-860df054-7da5-4d30-9bb6-f7975f89428d tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:38.557474 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-860df054-7da5-4d30-9bb6-f7975f89428d tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:38.560086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-860df054-7da5-4d30-9bb6-f7975f89428d tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:38.561401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-860df054-7da5-4d30-9bb6-f7975f89428d tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:38.588576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1c145731-86b4-47ef-9b93-4062b9cc0a0f tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:38.589784 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1c145731-86b4-47ef-9b93-4062b9cc0a0f tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:38.607553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1c145731-86b4-47ef-9b93-4062b9cc0a0f tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:38.608907 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1c145731-86b4-47ef-9b93-4062b9cc0a0f tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:38.614072 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1c145731-86b4-47ef-9b93-4062b9cc0a0f tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:38.615792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1c145731-86b4-47ef-9b93-4062b9cc0a0f tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:38.941627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1c145731-86b4-47ef-9b93-4062b9cc0a0f tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4c0e44f8964dec8564b4066656a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d373382a442ceb132f66c002517a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:38.957168 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1c145731-86b4-47ef-9b93-4062b9cc0a0f tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45" status: 200 len: 1335 microversion: 2.1 time: 0.372950 Jul 25 12:47:38.957789 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1203/2322] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:38 2022] GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45 => generated 1335 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:47:38.975881 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-7c5d9a77-8fde-4be9-aab5-f58395de0bea req-de12c490-452b-4538-aa4a-f797aa5090cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a283fa-f27c-493e-aa85-074a513b24d4", "name": "network-vif-plugged", "status": "completed", "tag": "9e6ee92e-2c99-4f9c-ad97-08f123f5b2a6"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:39.003583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-7c5d9a77-8fde-4be9-aab5-f58395de0bea req-de12c490-452b-4538-aa4a-f797aa5090cf service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:39.004269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-7c5d9a77-8fde-4be9-aab5-f58395de0bea req-de12c490-452b-4538-aa4a-f797aa5090cf service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:39.032813 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-7c5d9a77-8fde-4be9-aab5-f58395de0bea req-de12c490-452b-4538-aa4a-f797aa5090cf service nova] Creating event network-vif-plugged:9e6ee92e-2c99-4f9c-ad97-08f123f5b2a6 for instance 06a283fa-f27c-493e-aa85-074a513b24d4 on n-h2-848886-15 Jul 25 12:47:39.040040 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-7c5d9a77-8fde-4be9-aab5-f58395de0bea req-de12c490-452b-4538-aa4a-f797aa5090cf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072148 Jul 25 12:47:39.041389 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1204/2323] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:39.434971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-860df054-7da5-4d30-9bb6-f7975f89428d tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6e13a37eb4938ae622cb28cf9b002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3abd8185141ceb259088196783624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:39.446595 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-860df054-7da5-4d30-9bb6-f7975f89428d tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] 10.222.0.49 "GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4" status: 200 len: 1314 microversion: 2.1 time: 0.922206 Jul 25 12:47:39.454912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8c365dca-9d69-4f89-8b8a-118faf00bdf1 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:39.456636 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8c365dca-9d69-4f89-8b8a-118faf00bdf1 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:39.482026 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1120/2324] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:38 2022] GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4 => generated 1314 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:39.489377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c365dca-9d69-4f89-8b8a-118faf00bdf1 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:39.489980 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c365dca-9d69-4f89-8b8a-118faf00bdf1 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:39.491683 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c365dca-9d69-4f89-8b8a-118faf00bdf1 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:39.492209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c365dca-9d69-4f89-8b8a-118faf00bdf1 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:39.524212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b3133dd8-35dc-400f-9e3c-307a7d9ad1aa tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:39.525240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b3133dd8-35dc-400f-9e3c-307a7d9ad1aa tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:39.542985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3133dd8-35dc-400f-9e3c-307a7d9ad1aa tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:39.543785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3133dd8-35dc-400f-9e3c-307a7d9ad1aa tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:39.544838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3133dd8-35dc-400f-9e3c-307a7d9ad1aa tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:39.545499 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3133dd8-35dc-400f-9e3c-307a7d9ad1aa tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:39.745681 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b3133dd8-35dc-400f-9e3c-307a7d9ad1aa tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:39.762715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b3133dd8-35dc-400f-9e3c-307a7d9ad1aa tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:39.764780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b3133dd8-35dc-400f-9e3c-307a7d9ad1aa tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:39.766179 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b3133dd8-35dc-400f-9e3c-307a7d9ad1aa tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1357 microversion: 2.47 time: 0.247054 Jul 25 12:47:39.772632 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1121/2325] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:39 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1357 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:39.799121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fd92543d-7a77-4709-abae-ad74c00746b8 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:39.807758 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fd92543d-7a77-4709-abae-ad74c00746b8 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:39.808689 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fd92543d-7a77-4709-abae-ad74c00746b8 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Searching by: {'deleted': False, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 12:47:39.819426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd92543d-7a77-4709-abae-ad74c00746b8 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:39.820069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd92543d-7a77-4709-abae-ad74c00746b8 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:39.821030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd92543d-7a77-4709-abae-ad74c00746b8 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:39.821612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd92543d-7a77-4709-abae-ad74c00746b8 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:40.022211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-fd92543d-7a77-4709-abae-ad74c00746b8 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 12:47:40.074791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8c365dca-9d69-4f89-8b8a-118faf00bdf1 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:40.090562 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8c365dca-9d69-4f89-8b8a-118faf00bdf1 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1325 microversion: 2.1 time: 0.641562 Jul 25 12:47:40.091170 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1205/2326] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:39 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1325 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:40.108787 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-af2c1490-b7df-45e6-94d6-5246da38e65e tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:40.109794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-af2c1490-b7df-45e6-94d6-5246da38e65e tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:40.118296 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-af2c1490-b7df-45e6-94d6-5246da38e65e tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:40.118944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-af2c1490-b7df-45e6-94d6-5246da38e65e tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:40.119905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-af2c1490-b7df-45e6-94d6-5246da38e65e tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:40.120611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-af2c1490-b7df-45e6-94d6-5246da38e65e tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:40.232515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=53 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:40.243242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fd92543d-7a77-4709-abae-ad74c00746b8 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:40.262704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd92543d-7a77-4709-abae-ad74c00746b8 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:40.263151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd92543d-7a77-4709-abae-ad74c00746b8 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:40.294636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fd92543d-7a77-4709-abae-ad74c00746b8 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:40.296708 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fd92543d-7a77-4709-abae-ad74c00746b8 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:41.126209 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fd92543d-7a77-4709-abae-ad74c00746b8 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 1.331304 Jul 25 12:47:41.128070 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1122/2327] 10.222.0.49 () {60 vars in 1187 bytes} [Mon Jul 25 12:47:39 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:47:41.136379 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b270e73b-a4eb-4331-b3f5-d7f1646f4d2b tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:41.143045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b270e73b-a4eb-4331-b3f5-d7f1646f4d2b tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] [instance: 06a283fa-f27c-493e-aa85-074a513b24d4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:41.146882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-af2c1490-b7df-45e6-94d6-5246da38e65e tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4c0e44f8964dec8564b4066656a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d373382a442ceb132f66c002517a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:41.159356 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b270e73b-a4eb-4331-b3f5-d7f1646f4d2b tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:41.165925 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b270e73b-a4eb-4331-b3f5-d7f1646f4d2b tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:41.168133 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-af2c1490-b7df-45e6-94d6-5246da38e65e tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45" status: 200 len: 1335 microversion: 2.1 time: 1.060291 Jul 25 12:47:41.169364 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b270e73b-a4eb-4331-b3f5-d7f1646f4d2b tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:41.169979 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b270e73b-a4eb-4331-b3f5-d7f1646f4d2b tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:41.170945 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1206/2328] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:40 2022] GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45 => generated 1335 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:41.181909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d40237c5-2b3b-42c4-86ce-db1ae3b7a1be tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:41.185706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d40237c5-2b3b-42c4-86ce-db1ae3b7a1be tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:41.199284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d40237c5-2b3b-42c4-86ce-db1ae3b7a1be tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:41.200392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d40237c5-2b3b-42c4-86ce-db1ae3b7a1be tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:41.201459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d40237c5-2b3b-42c4-86ce-db1ae3b7a1be tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:41.202151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d40237c5-2b3b-42c4-86ce-db1ae3b7a1be tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:41.826048 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b270e73b-a4eb-4331-b3f5-d7f1646f4d2b tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6e13a37eb4938ae622cb28cf9b002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3abd8185141ceb259088196783624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:41.845058 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b270e73b-a4eb-4331-b3f5-d7f1646f4d2b tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] 10.222.0.49 "GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4" status: 200 len: 1464 microversion: 2.1 time: 0.715150 Jul 25 12:47:41.845816 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1123/2329] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:41 2022] GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4 => generated 1464 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:41.851218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-599f96c9-7e06-48dc-8ed3-d2c72e47702f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:41.860566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-599f96c9-7e06-48dc-8ed3-d2c72e47702f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:41.869011 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-599f96c9-7e06-48dc-8ed3-d2c72e47702f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:41.874582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-599f96c9-7e06-48dc-8ed3-d2c72e47702f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:41.876175 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-599f96c9-7e06-48dc-8ed3-d2c72e47702f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:41.876708 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-599f96c9-7e06-48dc-8ed3-d2c72e47702f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:41.930756 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-599f96c9-7e06-48dc-8ed3-d2c72e47702f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:47:42.006837 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d40237c5-2b3b-42c4-86ce-db1ae3b7a1be tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:42.023096 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d40237c5-2b3b-42c4-86ce-db1ae3b7a1be tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1325 microversion: 2.1 time: 0.850568 Jul 25 12:47:42.024125 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1207/2330] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:41 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1325 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:42.089809 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-599f96c9-7e06-48dc-8ed3-d2c72e47702f tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 204 len: 0 microversion: 2.47 time: 0.242588 Jul 25 12:47:42.091355 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1124/2331] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 12:47:41 2022] DELETE /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 12:47:42.101170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-602a811f-6c15-4846-859d-62b8d5ba82a9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:42.106079 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-602a811f-6c15-4846-859d-62b8d5ba82a9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:42.117565 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-602a811f-6c15-4846-859d-62b8d5ba82a9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:42.126457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-602a811f-6c15-4846-859d-62b8d5ba82a9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:42.127949 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-602a811f-6c15-4846-859d-62b8d5ba82a9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:42.128563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-602a811f-6c15-4846-859d-62b8d5ba82a9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:42.384902 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-602a811f-6c15-4846-859d-62b8d5ba82a9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:42.404298 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-602a811f-6c15-4846-859d-62b8d5ba82a9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:42.410143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-602a811f-6c15-4846-859d-62b8d5ba82a9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:42.418744 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-602a811f-6c15-4846-859d-62b8d5ba82a9 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1363 microversion: 2.47 time: 0.321246 Jul 25 12:47:42.422114 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1125/2332] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:42 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:42.449978 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7607b5c2-0120-414f-896e-0ed6074e5486 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:42.451260 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7607b5c2-0120-414f-896e-0ed6074e5486 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:42.460549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7607b5c2-0120-414f-896e-0ed6074e5486 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:42.461330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7607b5c2-0120-414f-896e-0ed6074e5486 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:42.462337 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7607b5c2-0120-414f-896e-0ed6074e5486 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:42.462954 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7607b5c2-0120-414f-896e-0ed6074e5486 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:42.697736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7e3fda32-222d-4f3e-816f-727b91e2f471 tempest-TenantUsagesTestJSON-1560568982 tempest-TenantUsagesTestJSON-1560568982-project-admin] Calling method '.version_select at 0x7efcf9bb7310>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:42.709044 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e3fda32-222d-4f3e-816f-727b91e2f471 tempest-TenantUsagesTestJSON-1560568982 tempest-TenantUsagesTestJSON-1560568982-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:42.709714 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e3fda32-222d-4f3e-816f-727b91e2f471 tempest-TenantUsagesTestJSON-1560568982 tempest-TenantUsagesTestJSON-1560568982-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:42.729769 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e3fda32-222d-4f3e-816f-727b91e2f471 tempest-TenantUsagesTestJSON-1560568982 tempest-TenantUsagesTestJSON-1560568982-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:42.730965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e3fda32-222d-4f3e-816f-727b91e2f471 tempest-TenantUsagesTestJSON-1560568982 tempest-TenantUsagesTestJSON-1560568982-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:42.753187 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7e3fda32-222d-4f3e-816f-727b91e2f471 tempest-TenantUsagesTestJSON-1560568982 tempest-TenantUsagesTestJSON-1560568982-project-admin] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage/9fa3abd8185141ceb259088196783624?start=2022-07-24T12%3A47%3A41.863346&end=2022-07-26T12%3A47%3A41.863346" status: 200 len: 695 microversion: 2.1 time: 0.727872 Jul 25 12:47:42.764385 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1208/2333] 10.222.0.49 () {58 vars in 1412 bytes} [Mon Jul 25 12:47:42 2022] GET /compute/v2.1/os-simple-tenant-usage/9fa3abd8185141ceb259088196783624?start=2022-07-24T12%3A47%3A41.863346&end=2022-07-26T12%3A47%3A41.863346 => generated 695 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:42.770543 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7f6fed2c-8bc7-4bf3-8397-30df6f1f3a40 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Calling method '.version_select at 0x7efcf9b40550>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:42.779890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7f6fed2c-8bc7-4bf3-8397-30df6f1f3a40 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:42.780337 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7f6fed2c-8bc7-4bf3-8397-30df6f1f3a40 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:42.792436 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7f6fed2c-8bc7-4bf3-8397-30df6f1f3a40 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:42.793034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7f6fed2c-8bc7-4bf3-8397-30df6f1f3a40 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:42.811999 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7f6fed2c-8bc7-4bf3-8397-30df6f1f3a40 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage/9fa3abd8185141ceb259088196783624?start=2022-07-24T12%3A47%3A41.863346&end=2022-07-26T12%3A47%3A41.863346" status: 200 len: 695 microversion: 2.1 time: 0.046358 Jul 25 12:47:42.822944 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1209/2334] 10.222.0.49 () {58 vars in 1412 bytes} [Mon Jul 25 12:47:42 2022] GET /compute/v2.1/os-simple-tenant-usage/9fa3abd8185141ceb259088196783624?start=2022-07-24T12%3A47%3A41.863346&end=2022-07-26T12%3A47%3A41.863346 => generated 695 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:42.828171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6fedb5b5-fba2-425e-890d-d2591120bfc7 tempest-TenantUsagesTestJSON-1560568982 tempest-TenantUsagesTestJSON-1560568982-project-admin] Calling method '.version_select at 0x7efcfa332af0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:42.841024 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6fedb5b5-fba2-425e-890d-d2591120bfc7 tempest-TenantUsagesTestJSON-1560568982 tempest-TenantUsagesTestJSON-1560568982-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:42.841966 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6fedb5b5-fba2-425e-890d-d2591120bfc7 tempest-TenantUsagesTestJSON-1560568982 tempest-TenantUsagesTestJSON-1560568982-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:42.864298 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6fedb5b5-fba2-425e-890d-d2591120bfc7 tempest-TenantUsagesTestJSON-1560568982 tempest-TenantUsagesTestJSON-1560568982-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:42.864845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6fedb5b5-fba2-425e-890d-d2591120bfc7 tempest-TenantUsagesTestJSON-1560568982 tempest-TenantUsagesTestJSON-1560568982-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:42.994882 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6fedb5b5-fba2-425e-890d-d2591120bfc7 tempest-TenantUsagesTestJSON-1560568982 tempest-TenantUsagesTestJSON-1560568982-project-admin] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-24T12%3A47%3A41.863346&end=2022-07-26T12%3A47%3A41.863346&detailed=1" status: 200 len: 27992 microversion: 2.1 time: 0.170257 Jul 25 12:47:43.006629 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1210/2335] 10.222.0.49 () {58 vars in 1335 bytes} [Mon Jul 25 12:47:42 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-24T12%3A47%3A41.863346&end=2022-07-26T12%3A47%3A41.863346&detailed=1 => generated 27992 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:47:43.037137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6dbd48ae-95f4-4c49-918f-01248d854116 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:43.037638 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6dbd48ae-95f4-4c49-918f-01248d854116 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] [instance: 06a283fa-f27c-493e-aa85-074a513b24d4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:43.046570 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6dbd48ae-95f4-4c49-918f-01248d854116 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:43.046931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6dbd48ae-95f4-4c49-918f-01248d854116 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:43.047847 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6dbd48ae-95f4-4c49-918f-01248d854116 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:43.048645 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6dbd48ae-95f4-4c49-918f-01248d854116 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:43.066219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7607b5c2-0120-414f-896e-0ed6074e5486 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4c0e44f8964dec8564b4066656a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d373382a442ceb132f66c002517a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:43.088699 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7607b5c2-0120-414f-896e-0ed6074e5486 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45" status: 200 len: 1403 microversion: 2.1 time: 0.651153 Jul 25 12:47:43.089307 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1126/2336] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:42 2022] GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45 => generated 1403 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:43.120846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ac47f8f7-4759-467e-9527-db1e3e47b2c4 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:43.124028 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ac47f8f7-4759-467e-9527-db1e3e47b2c4 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:43.140707 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ac47f8f7-4759-467e-9527-db1e3e47b2c4 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:43.144616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6dbd48ae-95f4-4c49-918f-01248d854116 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] [instance: 06a283fa-f27c-493e-aa85-074a513b24d4] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:47:43.145340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ac47f8f7-4759-467e-9527-db1e3e47b2c4 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:43.146446 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ac47f8f7-4759-467e-9527-db1e3e47b2c4 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:43.148959 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ac47f8f7-4759-467e-9527-db1e3e47b2c4 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:43.305266 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6dbd48ae-95f4-4c49-918f-01248d854116 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] 10.222.0.49 "DELETE /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4" status: 204 len: 0 microversion: 2.1 time: 0.272309 Jul 25 12:47:43.309804 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1211/2337] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:47:43 2022] DELETE /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 12:47:43.319736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1948e2ac-99ab-4d61-8bf3-cc1b92cfa694 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:43.320725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1948e2ac-99ab-4d61-8bf3-cc1b92cfa694 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] [instance: 06a283fa-f27c-493e-aa85-074a513b24d4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:43.329750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1948e2ac-99ab-4d61-8bf3-cc1b92cfa694 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:43.329750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1948e2ac-99ab-4d61-8bf3-cc1b92cfa694 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:43.330981 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1948e2ac-99ab-4d61-8bf3-cc1b92cfa694 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:43.331429 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1948e2ac-99ab-4d61-8bf3-cc1b92cfa694 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:43.703414 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1948e2ac-99ab-4d61-8bf3-cc1b92cfa694 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6e13a37eb4938ae622cb28cf9b002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3abd8185141ceb259088196783624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:43.719874 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1948e2ac-99ab-4d61-8bf3-cc1b92cfa694 tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] 10.222.0.49 "GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4" status: 200 len: 1470 microversion: 2.1 time: 0.407907 Jul 25 12:47:43.721455 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1212/2338] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:43 2022] GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4 => generated 1470 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:43.737610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d65f2a3f-a629-414f-82a7-257917318811 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:43.738311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d65f2a3f-a629-414f-82a7-257917318811 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:43.746795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d65f2a3f-a629-414f-82a7-257917318811 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:43.747466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d65f2a3f-a629-414f-82a7-257917318811 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:43.748495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d65f2a3f-a629-414f-82a7-257917318811 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:43.749210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d65f2a3f-a629-414f-82a7-257917318811 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:43.774752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ac47f8f7-4759-467e-9527-db1e3e47b2c4 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:43.783642 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ac47f8f7-4759-467e-9527-db1e3e47b2c4 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1325 microversion: 2.1 time: 0.673897 Jul 25 12:47:43.785205 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1127/2339] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:43 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1325 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:43.790680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-72b3c596-9d86-41b1-bd19-3eaa799bcfde req-63cc98ea-bdbb-463b-9fa6-a7bfe69caf19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aec454db-239e-49ed-a021-297e11579b04", "name": "network-vif-plugged", "status": "completed", "tag": "4efa19f7-1e52-4bc9-9cca-24a1ec66a5db"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:43.801038 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-72b3c596-9d86-41b1-bd19-3eaa799bcfde req-63cc98ea-bdbb-463b-9fa6-a7bfe69caf19 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:43.802007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-72b3c596-9d86-41b1-bd19-3eaa799bcfde req-63cc98ea-bdbb-463b-9fa6-a7bfe69caf19 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:43.817561 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-72b3c596-9d86-41b1-bd19-3eaa799bcfde req-63cc98ea-bdbb-463b-9fa6-a7bfe69caf19 service nova] Creating event network-vif-plugged:4efa19f7-1e52-4bc9-9cca-24a1ec66a5db for instance aec454db-239e-49ed-a021-297e11579b04 on n-h1-848886-15 Jul 25 12:47:43.824780 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-72b3c596-9d86-41b1-bd19-3eaa799bcfde req-63cc98ea-bdbb-463b-9fa6-a7bfe69caf19 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037669 Jul 25 12:47:43.826094 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1128/2340] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:43.896216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d65f2a3f-a629-414f-82a7-257917318811 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:43.911932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d65f2a3f-a629-414f-82a7-257917318811 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:43.913436 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d65f2a3f-a629-414f-82a7-257917318811 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:43.914677 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d65f2a3f-a629-414f-82a7-257917318811 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1363 microversion: 2.47 time: 0.192178 Jul 25 12:47:43.915231 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1213/2341] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:43 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:44.025283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-07e965f9-348e-46e3-8131-5addef5cf976 req-f1909d14-6208-48d4-bc41-5796b2bb97b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cad4f60e-6cce-41a5-8152-28e755601c45", "tag": "561998ef-8060-4a06-a853-5c9a717c1b7f"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:44.062664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-07e965f9-348e-46e3-8131-5addef5cf976 req-f1909d14-6208-48d4-bc41-5796b2bb97b3 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:44.063187 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-07e965f9-348e-46e3-8131-5addef5cf976 req-f1909d14-6208-48d4-bc41-5796b2bb97b3 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:44.083573 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-07e965f9-348e-46e3-8131-5addef5cf976 req-f1909d14-6208-48d4-bc41-5796b2bb97b3 service nova] Creating event network-changed:561998ef-8060-4a06-a853-5c9a717c1b7f for instance cad4f60e-6cce-41a5-8152-28e755601c45 on n-h2-848886-15 Jul 25 12:47:44.089886 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-07e965f9-348e-46e3-8131-5addef5cf976 req-f1909d14-6208-48d4-bc41-5796b2bb97b3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069645 Jul 25 12:47:44.091090 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1129/2342] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:44.113890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0944027a-ff06-4609-8ff4-52ec203f3d5e tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:44.113890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0944027a-ff06-4609-8ff4-52ec203f3d5e tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:44.129031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0944027a-ff06-4609-8ff4-52ec203f3d5e tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:44.129490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0944027a-ff06-4609-8ff4-52ec203f3d5e tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:44.130312 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0944027a-ff06-4609-8ff4-52ec203f3d5e tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:44.139618 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0944027a-ff06-4609-8ff4-52ec203f3d5e tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:44.555003 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0944027a-ff06-4609-8ff4-52ec203f3d5e tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4c0e44f8964dec8564b4066656a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d373382a442ceb132f66c002517a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:44.563699 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0944027a-ff06-4609-8ff4-52ec203f3d5e tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45" status: 200 len: 1403 microversion: 2.1 time: 0.456213 Jul 25 12:47:44.567899 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1214/2343] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:44 2022] GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45 => generated 1403 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:44.745598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-03ddb6c8-10d5-482c-afc5-58f18e6878ef tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:44.746390 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-03ddb6c8-10d5-482c-afc5-58f18e6878ef tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] [instance: 06a283fa-f27c-493e-aa85-074a513b24d4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:44.756405 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-03ddb6c8-10d5-482c-afc5-58f18e6878ef tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:44.756868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-03ddb6c8-10d5-482c-afc5-58f18e6878ef tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:44.757667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-03ddb6c8-10d5-482c-afc5-58f18e6878ef tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:44.758134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-03ddb6c8-10d5-482c-afc5-58f18e6878ef tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:44.804825 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-edecfd0b-7355-4643-acc6-0b18d744dfb3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:44.806256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-edecfd0b-7355-4643-acc6-0b18d744dfb3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:44.815678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-edecfd0b-7355-4643-acc6-0b18d744dfb3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:44.816798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-edecfd0b-7355-4643-acc6-0b18d744dfb3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:44.818437 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-edecfd0b-7355-4643-acc6-0b18d744dfb3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:44.819056 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-edecfd0b-7355-4643-acc6-0b18d744dfb3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:45.294713 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-edecfd0b-7355-4643-acc6-0b18d744dfb3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:45.307636 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-edecfd0b-7355-4643-acc6-0b18d744dfb3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1325 microversion: 2.1 time: 0.505096 Jul 25 12:47:45.318653 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1215/2344] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:44 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1325 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:45.324876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ba4ebeda-9894-459c-ae9b-9986688812c4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:45.330004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ba4ebeda-9894-459c-ae9b-9986688812c4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:45.345777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba4ebeda-9894-459c-ae9b-9986688812c4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:45.346139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba4ebeda-9894-459c-ae9b-9986688812c4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:45.346760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba4ebeda-9894-459c-ae9b-9986688812c4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:45.347191 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba4ebeda-9894-459c-ae9b-9986688812c4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:45.392898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-03ddb6c8-10d5-482c-afc5-58f18e6878ef tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6e13a37eb4938ae622cb28cf9b002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3abd8185141ceb259088196783624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:45.409961 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-03ddb6c8-10d5-482c-afc5-58f18e6878ef tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] 10.222.0.49 "GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4" status: 200 len: 1470 microversion: 2.1 time: 0.672633 Jul 25 12:47:45.411378 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1130/2345] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:44 2022] GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4 => generated 1470 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:45.530287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ba4ebeda-9894-459c-ae9b-9986688812c4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:45.542600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ba4ebeda-9894-459c-ae9b-9986688812c4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:45.549964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ba4ebeda-9894-459c-ae9b-9986688812c4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:45.554423 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ba4ebeda-9894-459c-ae9b-9986688812c4 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 200 len: 1363 microversion: 2.47 time: 0.231597 Jul 25 12:47:45.555550 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1216/2346] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:45 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:45.591287 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d365ad6a-67c6-431f-931a-51f26c63386f tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:45.591907 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d365ad6a-67c6-431f-931a-51f26c63386f tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:45.603826 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d365ad6a-67c6-431f-931a-51f26c63386f tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:45.604365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d365ad6a-67c6-431f-931a-51f26c63386f tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:45.608685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d365ad6a-67c6-431f-931a-51f26c63386f tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:45.609143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d365ad6a-67c6-431f-931a-51f26c63386f tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:45.680092 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:46.151533 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d365ad6a-67c6-431f-931a-51f26c63386f tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4c0e44f8964dec8564b4066656a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d373382a442ceb132f66c002517a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:46.170801 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d365ad6a-67c6-431f-931a-51f26c63386f tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45" status: 200 len: 1403 microversion: 2.1 time: 0.583529 Jul 25 12:47:46.183080 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1131/2347] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:45 2022] GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45 => generated 1403 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:46.339868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f670143f-4dcd-4c8b-a120-17491bcc10f7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:46.340487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f670143f-4dcd-4c8b-a120-17491bcc10f7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:46.347889 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f670143f-4dcd-4c8b-a120-17491bcc10f7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:46.348395 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f670143f-4dcd-4c8b-a120-17491bcc10f7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:46.349181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f670143f-4dcd-4c8b-a120-17491bcc10f7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:46.349614 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f670143f-4dcd-4c8b-a120-17491bcc10f7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:46.354889 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:46.435815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d865b5fc-2b33-4d5d-b845-2306c1efe4ef tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:46.436599 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d865b5fc-2b33-4d5d-b845-2306c1efe4ef tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] [instance: 06a283fa-f27c-493e-aa85-074a513b24d4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:46.450914 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d865b5fc-2b33-4d5d-b845-2306c1efe4ef tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:46.451359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d865b5fc-2b33-4d5d-b845-2306c1efe4ef tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:46.455054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d865b5fc-2b33-4d5d-b845-2306c1efe4ef tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:46.455794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d865b5fc-2b33-4d5d-b845-2306c1efe4ef tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:46.700742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d865b5fc-2b33-4d5d-b845-2306c1efe4ef tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6e13a37eb4938ae622cb28cf9b002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3abd8185141ceb259088196783624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:46.712166 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d865b5fc-2b33-4d5d-b845-2306c1efe4ef tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] 10.222.0.49 "GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4" status: 200 len: 1428 microversion: 2.1 time: 0.280471 Jul 25 12:47:46.712725 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1132/2348] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:46 2022] GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4 => generated 1428 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:47:46.724657 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d45f9530-2e67-4204-aabf-942ab86f207c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:46.725750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d45f9530-2e67-4204-aabf-942ab86f207c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 5fff9467-2a43-46d0-a36d-af5ba7012605] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:46.740561 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d45f9530-2e67-4204-aabf-942ab86f207c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:46.741411 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d45f9530-2e67-4204-aabf-942ab86f207c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:46.744066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d45f9530-2e67-4204-aabf-942ab86f207c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:46.744746 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d45f9530-2e67-4204-aabf-942ab86f207c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:46.794596 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-d45f9530-2e67-4204-aabf-942ab86f207c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] HTTP exception thrown: Instance 5fff9467-2a43-46d0-a36d-af5ba7012605 could not be found. Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d45f9530-2e67-4204-aabf-942ab86f207c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Request method failure captured: Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 HTTP/1.1 Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDCKmdNP71OI0_nO--IosA8eMEp14GUebIundUiw_qM2vOvVYN8GMGpf8TwjQ-aoxp03zSCPZuEjsi0lBjwC2MHnDu7HV-fyR1fCdkblLGWwZGsDie2g6WdRdssgbIajB0KmuIQfTkWVBfeUcwy5cPt_aKWBWYLxtMUL5S4OvmbuFg Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: X-Openstack-Nova-Api-Version: 2.47 Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: e5f95fba8dde4f3b8f9ba08feb0d593a Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerShowV247Test-1212237309 Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e5f95fba8dde4f3b8f9ba08feb0d593a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e5f95fba8dde4f3b8f9ba08feb0d593a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e5f95fba8dde4f3b8f9ba08feb0d593a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e5f95fba8dde4f3b8f9ba08feb0d593a"}]}] Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerShowV247Test-1212237309 Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: e5f95fba8dde4f3b8f9ba08feb0d593a Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerShowV247Test-1212237309 Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerShowV247Test-1212237309-project Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: ad9439fbab1a4ae58f9a9b48f00e2c82 Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerShowV247Test-1212237309-project Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 5fff9467-2a43-46d0-a36d-af5ba7012605 could not be found. Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '5fff9467-2a43-46d0-a36d-af5ba7012605'} Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fff9467-2a43-46d0-a36d-af5ba7012605 could not be found. Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fff9467-2a43-46d0-a36d-af5ba7012605 could not be found. Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:46.796374 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:46.805543 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:46.805543 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:46.805543 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:46.805543 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:46.805543 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:46.805543 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fff9467-2a43-46d0-a36d-af5ba7012605 could not be found. Jul 25 12:47:46.805543 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:46.805543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d45f9530-2e67-4204-aabf-942ab86f207c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Returning 404 to user: Instance 5fff9467-2a43-46d0-a36d-af5ba7012605 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:46.805543 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d45f9530-2e67-4204-aabf-942ab86f207c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605" status: 404 len: 111 microversion: 2.47 time: 0.084082 Jul 25 12:47:46.805543 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1133/2349] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:46 2022] GET /compute/v2.1/servers/5fff9467-2a43-46d0-a36d-af5ba7012605 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:47:46.811722 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-3378b5d3-2a3a-42f6-a7f2-ab5a539da146 req-7c2e9197-2ce4-4ce8-8e8a-72cd992a30ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a283fa-f27c-493e-aa85-074a513b24d4", "name": "network-vif-deleted", "tag": "9e6ee92e-2c99-4f9c-ad97-08f123f5b2a6"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:46.834131 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-3378b5d3-2a3a-42f6-a7f2-ab5a539da146 req-7c2e9197-2ce4-4ce8-8e8a-72cd992a30ad service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:46.834798 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-3378b5d3-2a3a-42f6-a7f2-ab5a539da146 req-7c2e9197-2ce4-4ce8-8e8a-72cd992a30ad service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:46.877491 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-3378b5d3-2a3a-42f6-a7f2-ab5a539da146 req-7c2e9197-2ce4-4ce8-8e8a-72cd992a30ad service nova] Creating event network-vif-deleted:9e6ee92e-2c99-4f9c-ad97-08f123f5b2a6 for instance 06a283fa-f27c-493e-aa85-074a513b24d4 on n-h2-848886-15 Jul 25 12:47:46.885341 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-3378b5d3-2a3a-42f6-a7f2-ab5a539da146 req-7c2e9197-2ce4-4ce8-8e8a-72cd992a30ad service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085504 Jul 25 12:47:46.886192 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1134/2350] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:46.899232 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d61f2949-b6c6-4780-8b65-0a58cb79684c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:46.899682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d61f2949-b6c6-4780-8b65-0a58cb79684c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 0f10bdfd-d085-4e27-8681-4f324045e884] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:46.918544 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d61f2949-b6c6-4780-8b65-0a58cb79684c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:46.919231 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d61f2949-b6c6-4780-8b65-0a58cb79684c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:46.920224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d61f2949-b6c6-4780-8b65-0a58cb79684c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:46.921003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d61f2949-b6c6-4780-8b65-0a58cb79684c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:46.956301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d61f2949-b6c6-4780-8b65-0a58cb79684c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 0f10bdfd-d085-4e27-8681-4f324045e884] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:47:47.075781 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d61f2949-b6c6-4780-8b65-0a58cb79684c tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0f10bdfd-d085-4e27-8681-4f324045e884" status: 204 len: 0 microversion: 2.47 time: 0.187435 Jul 25 12:47:47.076845 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1135/2351] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 12:47:46 2022] DELETE /compute/v2.1/servers/0f10bdfd-d085-4e27-8681-4f324045e884 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 12:47:47.096084 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fc20ed30-2442-406d-9328-e24d3748743d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:47.099025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fc20ed30-2442-406d-9328-e24d3748743d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 0f10bdfd-d085-4e27-8681-4f324045e884] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:47.109465 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fc20ed30-2442-406d-9328-e24d3748743d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:47.112832 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fc20ed30-2442-406d-9328-e24d3748743d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:47.136823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fc20ed30-2442-406d-9328-e24d3748743d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:47.137648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fc20ed30-2442-406d-9328-e24d3748743d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:47.384246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f670143f-4dcd-4c8b-a120-17491bcc10f7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:47.410079 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f670143f-4dcd-4c8b-a120-17491bcc10f7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1522 microversion: 2.1 time: 1.074766 Jul 25 12:47:47.413396 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1217/2352] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:46 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1522 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:47.424228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8240c436-b28b-4140-aff2-3860cceb5f9c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:47.426844 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8240c436-b28b-4140-aff2-3860cceb5f9c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:47.436656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8240c436-b28b-4140-aff2-3860cceb5f9c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:47.437753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8240c436-b28b-4140-aff2-3860cceb5f9c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:47.439348 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8240c436-b28b-4140-aff2-3860cceb5f9c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:47.441381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8240c436-b28b-4140-aff2-3860cceb5f9c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:47.504672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fc20ed30-2442-406d-9328-e24d3748743d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:47.516345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fc20ed30-2442-406d-9328-e24d3748743d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:47.518530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fc20ed30-2442-406d-9328-e24d3748743d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:47.520585 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fc20ed30-2442-406d-9328-e24d3748743d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/0f10bdfd-d085-4e27-8681-4f324045e884" status: 200 len: 1363 microversion: 2.47 time: 0.439518 Jul 25 12:47:47.525224 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1136/2353] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:47 2022] GET /compute/v2.1/servers/0f10bdfd-d085-4e27-8681-4f324045e884 => generated 1363 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:47:47.531783 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0e06e4d9-adaf-4429-88c3-1a1164db05c7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:47.532849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0e06e4d9-adaf-4429-88c3-1a1164db05c7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:47.540128 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e06e4d9-adaf-4429-88c3-1a1164db05c7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:47.540855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e06e4d9-adaf-4429-88c3-1a1164db05c7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:47.541793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e06e4d9-adaf-4429-88c3-1a1164db05c7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:47.542261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e06e4d9-adaf-4429-88c3-1a1164db05c7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:47.862403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8240c436-b28b-4140-aff2-3860cceb5f9c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4c0e44f8964dec8564b4066656a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d373382a442ceb132f66c002517a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:47.877938 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8240c436-b28b-4140-aff2-3860cceb5f9c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45" status: 200 len: 1403 microversion: 2.1 time: 0.462224 Jul 25 12:47:47.880963 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1218/2354] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:47 2022] GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45 => generated 1403 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:47.893877 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-68f5f854-94fe-437e-aa75-46961b047c6a tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:47.895839 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-68f5f854-94fe-437e-aa75-46961b047c6a tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] [instance: 06a283fa-f27c-493e-aa85-074a513b24d4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:47.908589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68f5f854-94fe-437e-aa75-46961b047c6a tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:47.910204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68f5f854-94fe-437e-aa75-46961b047c6a tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:47.911901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68f5f854-94fe-437e-aa75-46961b047c6a tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:47.912952 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68f5f854-94fe-437e-aa75-46961b047c6a tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:47.959516 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-68f5f854-94fe-437e-aa75-46961b047c6a tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] HTTP exception thrown: Instance 06a283fa-f27c-493e-aa85-074a513b24d4 could not be found. Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-68f5f854-94fe-437e-aa75-46961b047c6a tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Request method failure captured: Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4 HTTP/1.1 Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pDRVzq9_JwQWWgOT7XdsHbuOZ_hzPLGdRBOjsModUybvZFPOJG4_KhqfkwI5tGH0k_R_JqEO6biZdjvICZ-KcnLkTYaaUYEjTLoytwJnkS_DQtCAEn73zRaiBVqvFdKVG3NKATVS-vMSZ61wT_g1fZ14DlsPzvhNuk9-rp9gYRLQ0Q Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 9fa3abd8185141ceb259088196783624 Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TenantUsagesTestJSON-901919072 Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9fa3abd8185141ceb259088196783624", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9fa3abd8185141ceb259088196783624"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9fa3abd8185141ceb259088196783624"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9fa3abd8185141ceb259088196783624"}]}] Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TenantUsagesTestJSON-901919072 Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 9fa3abd8185141ceb259088196783624 Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TenantUsagesTestJSON-901919072 Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TenantUsagesTestJSON-901919072-project Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 63e6e13a37eb4938ae622cb28cf9b002 Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TenantUsagesTestJSON-901919072-project Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 06a283fa-f27c-493e-aa85-074a513b24d4 could not be found. Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '06a283fa-f27c-493e-aa85-074a513b24d4'} Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06a283fa-f27c-493e-aa85-074a513b24d4 could not be found. Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06a283fa-f27c-493e-aa85-074a513b24d4 could not be found. Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:47.964673 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:47.979179 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:47.979179 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:47.979179 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:47.979179 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:47.979179 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:47.979179 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06a283fa-f27c-493e-aa85-074a513b24d4 could not be found. Jul 25 12:47:47.979179 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:47.979179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-68f5f854-94fe-437e-aa75-46961b047c6a tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] Returning 404 to user: Instance 06a283fa-f27c-493e-aa85-074a513b24d4 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:47.979179 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-68f5f854-94fe-437e-aa75-46961b047c6a tempest-TenantUsagesTestJSON-901919072 tempest-TenantUsagesTestJSON-901919072-project] 10.222.0.49 "GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4" status: 404 len: 111 microversion: 2.1 time: 0.086108 Jul 25 12:47:47.979179 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1219/2355] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:47 2022] GET /compute/v2.1/servers/06a283fa-f27c-493e-aa85-074a513b24d4 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:47:48.025148 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0e06e4d9-adaf-4429-88c3-1a1164db05c7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:48.074239 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0e06e4d9-adaf-4429-88c3-1a1164db05c7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1522 microversion: 2.1 time: 0.546557 Jul 25 12:47:48.100808 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1137/2356] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:47 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1522 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:48.124284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bfd6524b-52be-4d6e-b739-0ead201d3234 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1251178637", "metadata": {"": ""}}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bfd6524b-52be-4d6e-b739-0ead201d3234 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Request method failure captured: Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04/action HTTP/1.1 Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 107 Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pDaiP1mn9moxuV0sEhHjcxs4YL6Wxk-LuBvL9sVonTARIUb0VcjcYQ7ntJp6sU09-7y0ZY4v6v4uSXBdkSQ_CiPsK7WXJf7MhcmeBPhydkepNAywcsaes9TYKg1Cs1S98mShfAYCBZemu8j0o07ISZt2oaK0_iQPi_CmMif6E2gpQ0 Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_35482ec73a054bafa24c83aea2b08636", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}] Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: bedadaad3cf44edb8fd8037aebd2ee25 Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1251178637", "metadata": {"": ""}}} Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'aec454db-239e-49ed-a021-297e11579b04', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1251178637', 'metadata': {'': ''}}}} Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi {'': ''} Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:48.129344 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:47:48.133090 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:47:48.133090 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:47:48.133090 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:47:48.133090 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:47:48.133090 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:47:48.133090 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 12:47:48.133090 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:48.133090 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:48.133090 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:48.133090 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:48.133090 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:48.133090 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:48.133090 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:47:48.133090 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:47:48.133090 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 12:47:48.133090 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:48.139027 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bfd6524b-52be-4d6e-b739-0ead201d3234 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:48.140383 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bfd6524b-52be-4d6e-b739-0ead201d3234 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "POST /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04/action" status: 400 len: 170 microversion: 2.1 time: 0.020628 Jul 25 12:47:48.142193 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1220/2357] 10.222.0.49 () {60 vars in 1279 bytes} [Mon Jul 25 12:47:48 2022] POST /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04/action => generated 170 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:47:48.151942 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b30a654b-7cc7-45cd-a8e1-b65614341be3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:48.152594 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b30a654b-7cc7-45cd-a8e1-b65614341be3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:48.160036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b30a654b-7cc7-45cd-a8e1-b65614341be3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:48.160490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b30a654b-7cc7-45cd-a8e1-b65614341be3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:48.161460 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b30a654b-7cc7-45cd-a8e1-b65614341be3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:48.162136 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b30a654b-7cc7-45cd-a8e1-b65614341be3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:48.440157 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b30a654b-7cc7-45cd-a8e1-b65614341be3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:48.459354 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b30a654b-7cc7-45cd-a8e1-b65614341be3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1522 microversion: 2.1 time: 0.311563 Jul 25 12:47:48.478495 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1138/2358] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:48 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:48.508342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-44c39f19-6885-4a0d-a47f-6c897da4fa99 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:48.509877 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-44c39f19-6885-4a0d-a47f-6c897da4fa99 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:48.528856 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44c39f19-6885-4a0d-a47f-6c897da4fa99 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:48.529322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44c39f19-6885-4a0d-a47f-6c897da4fa99 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:48.533969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44c39f19-6885-4a0d-a47f-6c897da4fa99 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:48.534444 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44c39f19-6885-4a0d-a47f-6c897da4fa99 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:48.553286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-23868405-977d-44df-b6a8-968a4b11841d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:48.557714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-23868405-977d-44df-b6a8-968a4b11841d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 0f10bdfd-d085-4e27-8681-4f324045e884] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:48.590709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-23868405-977d-44df-b6a8-968a4b11841d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:48.591517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-23868405-977d-44df-b6a8-968a4b11841d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:48.596253 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-23868405-977d-44df-b6a8-968a4b11841d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:48.597311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-23868405-977d-44df-b6a8-968a4b11841d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:48.800399 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-23868405-977d-44df-b6a8-968a4b11841d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:48.809952 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-23868405-977d-44df-b6a8-968a4b11841d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:48.811547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-23868405-977d-44df-b6a8-968a4b11841d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:48.812854 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-23868405-977d-44df-b6a8-968a4b11841d tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/0f10bdfd-d085-4e27-8681-4f324045e884" status: 200 len: 1363 microversion: 2.47 time: 0.267897 Jul 25 12:47:48.813435 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1139/2359] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:48 2022] GET /compute/v2.1/servers/0f10bdfd-d085-4e27-8681-4f324045e884 => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:48.823162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-44c39f19-6885-4a0d-a47f-6c897da4fa99 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:48.834277 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-44c39f19-6885-4a0d-a47f-6c897da4fa99 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1522 microversion: 2.1 time: 0.335074 Jul 25 12:47:48.837292 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1221/2360] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:48 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:48.858498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f5ac1cec-dec0-4ca5-ab8d-1449549e232b tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1496543843", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f5ac1cec-dec0-4ca5-ab8d-1449549e232b tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Request method failure captured: Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04/action HTTP/1.1 Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 619 Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDaiP1mn9moxuV0sEhHjcxs4YL6Wxk-LuBvL9sVonTARIUb0VcjcYQ7ntJp6sU09-7y0ZY4v6v4uSXBdkSQ_CiPsK7WXJf7MhcmeBPhydkepNAywcsaes9TYKg1Cs1S98mShfAYCBZemu8j0o07ISZt2oaK0_iQPi_CmMif6E2gpQ0 Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_35482ec73a054bafa24c83aea2b08636", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}] Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: bedadaad3cf44edb8fd8037aebd2ee25 Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1496543843", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'aec454db-239e-49ed-a021-297e11579b04', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1496543843', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:47:48.868715 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 12:47:48.871219 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:48.879663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f5ac1cec-dec0-4ca5-ab8d-1449549e232b tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:48.879663 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f5ac1cec-dec0-4ca5-ab8d-1449549e232b tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "POST /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04/action" status: 400 len: 938 microversion: 2.1 time: 0.016736 Jul 25 12:47:48.879663 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1140/2361] 10.222.0.49 () {60 vars in 1279 bytes} [Mon Jul 25 12:47:48 2022] POST /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04/action => generated 938 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:47:48.883113 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1ce6952d-233d-4b8d-b705-795b84188041 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:48.883723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1ce6952d-233d-4b8d-b705-795b84188041 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:48.890817 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ce6952d-233d-4b8d-b705-795b84188041 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:48.891136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ce6952d-233d-4b8d-b705-795b84188041 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:48.891878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ce6952d-233d-4b8d-b705-795b84188041 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:48.895025 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ce6952d-233d-4b8d-b705-795b84188041 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:48.901101 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4e58c839-4511-4f5c-9e8d-dbf8946a38a1 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:48.901879 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4e58c839-4511-4f5c-9e8d-dbf8946a38a1 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:48.919659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e58c839-4511-4f5c-9e8d-dbf8946a38a1 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:48.920124 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e58c839-4511-4f5c-9e8d-dbf8946a38a1 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:48.923703 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e58c839-4511-4f5c-9e8d-dbf8946a38a1 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:48.924152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e58c839-4511-4f5c-9e8d-dbf8946a38a1 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:49.225951 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1ce6952d-233d-4b8d-b705-795b84188041 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:49.231610 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4e58c839-4511-4f5c-9e8d-dbf8946a38a1 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4c0e44f8964dec8564b4066656a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d373382a442ceb132f66c002517a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:49.239852 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4e58c839-4511-4f5c-9e8d-dbf8946a38a1 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45" status: 200 len: 1403 microversion: 2.1 time: 0.342742 Jul 25 12:47:49.240804 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1141/2362] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:48 2022] GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45 => generated 1403 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:47:49.243669 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1ce6952d-233d-4b8d-b705-795b84188041 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1522 microversion: 2.1 time: 0.364313 Jul 25 12:47:49.244935 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1222/2363] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:48 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:49.273886 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8bd17e5a-878c-44a8-931d-274841d6366b tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:49.276599 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8bd17e5a-878c-44a8-931d-274841d6366b tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:49.285964 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bd17e5a-878c-44a8-931d-274841d6366b tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:49.287127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bd17e5a-878c-44a8-931d-274841d6366b tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:49.288151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bd17e5a-878c-44a8-931d-274841d6366b tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:49.288929 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bd17e5a-878c-44a8-931d-274841d6366b tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:49.566289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8bd17e5a-878c-44a8-931d-274841d6366b tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:49.575691 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8bd17e5a-878c-44a8-931d-274841d6366b tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1522 microversion: 2.1 time: 0.307512 Jul 25 12:47:49.578086 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1142/2364] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:49 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:49.598196 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5c60d119-c7cc-4e8c-bcbf-7847a552ed1d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5c60d119-c7cc-4e8c-bcbf-7847a552ed1d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Request method failure captured: Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04/action HTTP/1.1 Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 285 Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pDaiP1mn9moxuV0sEhHjcxs4YL6Wxk-LuBvL9sVonTARIUb0VcjcYQ7ntJp6sU09-7y0ZY4v6v4uSXBdkSQ_CiPsK7WXJf7MhcmeBPhydkepNAywcsaes9TYKg1Cs1S98mShfAYCBZemu8j0o07ISZt2oaK0_iQPi_CmMif6E2gpQ0 Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_35482ec73a054bafa24c83aea2b08636", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}] Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: bedadaad3cf44edb8fd8037aebd2ee25 Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'aec454db-239e-49ed-a021-297e11579b04', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:49.603867 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 12:47:49.608552 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:49.611308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5c60d119-c7cc-4e8c-bcbf-7847a552ed1d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:49.612299 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5c60d119-c7cc-4e8c-bcbf-7847a552ed1d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "POST /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04/action" status: 400 len: 619 microversion: 2.1 time: 0.018412 Jul 25 12:47:49.613317 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1223/2365] 10.222.0.49 () {60 vars in 1279 bytes} [Mon Jul 25 12:47:49 2022] POST /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04/action => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:47:49.621494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-19b6bc65-be3e-44b9-a8f4-c7b784ca6bcf tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:49.622950 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-19b6bc65-be3e-44b9-a8f4-c7b784ca6bcf tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:49.630595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19b6bc65-be3e-44b9-a8f4-c7b784ca6bcf tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:49.631435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19b6bc65-be3e-44b9-a8f4-c7b784ca6bcf tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:49.632319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19b6bc65-be3e-44b9-a8f4-c7b784ca6bcf tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:49.632854 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19b6bc65-be3e-44b9-a8f4-c7b784ca6bcf tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:49.843457 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-53ffabc6-ead9-43bc-b5b9-5d21794677d1 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:49.844267 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-53ffabc6-ead9-43bc-b5b9-5d21794677d1 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 0f10bdfd-d085-4e27-8681-4f324045e884] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:49.857505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-19b6bc65-be3e-44b9-a8f4-c7b784ca6bcf tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:49.862427 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53ffabc6-ead9-43bc-b5b9-5d21794677d1 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:49.863534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53ffabc6-ead9-43bc-b5b9-5d21794677d1 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:49.864322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53ffabc6-ead9-43bc-b5b9-5d21794677d1 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:49.864760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53ffabc6-ead9-43bc-b5b9-5d21794677d1 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:49.870424 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-19b6bc65-be3e-44b9-a8f4-c7b784ca6bcf tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1522 microversion: 2.1 time: 0.250517 Jul 25 12:47:49.872260 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1143/2366] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:49 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:49.898995 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-de28d9c3-5187-4280-8ac1-7b28d3179acd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:49.900989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-de28d9c3-5187-4280-8ac1-7b28d3179acd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:49.909109 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de28d9c3-5187-4280-8ac1-7b28d3179acd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:49.910056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de28d9c3-5187-4280-8ac1-7b28d3179acd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:49.911089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de28d9c3-5187-4280-8ac1-7b28d3179acd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:49.911740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de28d9c3-5187-4280-8ac1-7b28d3179acd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:49.948380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53ffabc6-ead9-43bc-b5b9-5d21794677d1 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:49.948836 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53ffabc6-ead9-43bc-b5b9-5d21794677d1 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:49.949300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-53ffabc6-ead9-43bc-b5b9-5d21794677d1 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lazy-loading 'fault' on Instance uuid 0f10bdfd-d085-4e27-8681-4f324045e884 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:47:49.954413 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=8 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:50.077244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-53ffabc6-ead9-43bc-b5b9-5d21794677d1 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:50.086484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-53ffabc6-ead9-43bc-b5b9-5d21794677d1 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:50.088760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-53ffabc6-ead9-43bc-b5b9-5d21794677d1 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad9439fbab1a4ae58f9a9b48f00e2c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f95fba8dde4f3b8f9ba08feb0d593a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:50.090006 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-53ffabc6-ead9-43bc-b5b9-5d21794677d1 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/0f10bdfd-d085-4e27-8681-4f324045e884" status: 200 len: 1368 microversion: 2.47 time: 0.251390 Jul 25 12:47:50.094378 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1224/2367] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:49 2022] GET /compute/v2.1/servers/0f10bdfd-d085-4e27-8681-4f324045e884 => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:50.172569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-de28d9c3-5187-4280-8ac1-7b28d3179acd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:50.184452 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-de28d9c3-5187-4280-8ac1-7b28d3179acd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1522 microversion: 2.1 time: 0.291749 Jul 25 12:47:50.193415 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1144/2368] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:49 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:47:50.205820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-32804139-782a-45b7-a15e-c9a02ecc91a2 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-878591927"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:50.218857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-32804139-782a-45b7-a15e-c9a02ecc91a2 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:50.239130 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32804139-782a-45b7-a15e-c9a02ecc91a2 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:50.241753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32804139-782a-45b7-a15e-c9a02ecc91a2 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:50.242920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32804139-782a-45b7-a15e-c9a02ecc91a2 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:50.246083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32804139-782a-45b7-a15e-c9a02ecc91a2 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:50.265819 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-111c7c66-a880-4376-b2c3-a314edd3f394 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:50.266060 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-111c7c66-a880-4376-b2c3-a314edd3f394 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:50.268235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:50.283947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-111c7c66-a880-4376-b2c3-a314edd3f394 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:50.287580 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-111c7c66-a880-4376-b2c3-a314edd3f394 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:50.289231 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-111c7c66-a880-4376-b2c3-a314edd3f394 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:50.289678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-111c7c66-a880-4376-b2c3-a314edd3f394 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:50.665772 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-32804139-782a-45b7-a15e-c9a02ecc91a2 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "POST /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04/action" status: 202 len: 0 microversion: 2.1 time: 0.464324 Jul 25 12:47:50.673500 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1225/2369] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:47:50 2022] POST /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 12:47:50.677644 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-111c7c66-a880-4376-b2c3-a314edd3f394 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4c0e44f8964dec8564b4066656a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d373382a442ceb132f66c002517a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:50.680694 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-91111f82-b58c-4019-890b-8a91202fea49 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-195184116"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:50.684280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-91111f82-b58c-4019-890b-8a91202fea49 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:50.686542 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-111c7c66-a880-4376-b2c3-a314edd3f394 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45" status: 200 len: 1403 microversion: 2.1 time: 0.427577 Jul 25 12:47:50.687149 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1145/2370] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:50 2022] GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45 => generated 1403 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:50.693801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91111f82-b58c-4019-890b-8a91202fea49 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:50.694358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91111f82-b58c-4019-890b-8a91202fea49 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:50.695424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91111f82-b58c-4019-890b-8a91202fea49 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:50.696058 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91111f82-b58c-4019-890b-8a91202fea49 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:50.753773 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-91111f82-b58c-4019-890b-8a91202fea49 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] HTTP exception thrown: Cannot 'createImage' instance aec454db-239e-49ed-a021-297e11579b04 while it is in task_state image_snapshot_pending Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-91111f82-b58c-4019-890b-8a91202fea49 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Request method failure captured: Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04/action HTTP/1.1 Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 84 Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pDaiP1mn9moxuV0sEhHjcxs4YL6Wxk-LuBvL9sVonTARIUb0VcjcYQ7ntJp6sU09-7y0ZY4v6v4uSXBdkSQ_CiPsK7WXJf7MhcmeBPhydkepNAywcsaes9TYKg1Cs1S98mShfAYCBZemu8j0o07ISZt2oaK0_iQPi_CmMif6E2gpQ0 Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_35482ec73a054bafa24c83aea2b08636", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}] Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: bedadaad3cf44edb8fd8037aebd2ee25 Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-195184116"}} Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: exception: Cannot 'createImage' instance aec454db-239e-49ed-a021-297e11579b04 while it is in task_state image_snapshot_pending Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'aec454db-239e-49ed-a021-297e11579b04', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-195184116'}}} Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aec454db-239e-49ed-a021-297e11579b04 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 12:47:50.755788 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 12:47:50.759294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance aec454db-239e-49ed-a021-297e11579b04 while it is in task_state image_snapshot_pending Jul 25 12:47:50.759294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:50.759294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:50.759294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:50.759294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:50.759294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:50.759294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:50.759294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:50.759294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:50.759294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance aec454db-239e-49ed-a021-297e11579b04 while it is in task_state image_snapshot_pending Jul 25 12:47:50.759294 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:47:50.759294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-91111f82-b58c-4019-890b-8a91202fea49 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Returning 409 to user: Cannot 'createImage' instance aec454db-239e-49ed-a021-297e11579b04 while it is in task_state image_snapshot_pending {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:50.759294 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-91111f82-b58c-4019-890b-8a91202fea49 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "POST /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04/action" status: 409 len: 167 microversion: 2.1 time: 0.082327 Jul 25 12:47:50.762861 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1226/2371] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:47:50 2022] POST /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04/action => generated 167 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:47:50.767871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-67abf5dc-0b64-4c26-ae08-0e6fe3d88a03 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '.version_select at 0x7efcf970e4c0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:51.030567 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-67abf5dc-0b64-4c26-ae08-0e6fe3d88a03 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "DELETE /compute/v2.1/images/9b0bb492-2db9-4825-b199-c70810e15da6" status: 204 len: 0 microversion: 2.1 time: 0.267865 Jul 25 12:47:51.031418 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1146/2372] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:50 2022] DELETE /compute/v2.1/images/9b0bb492-2db9-4825-b199-c70810e15da6 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 12:47:51.050452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d2a57374-60a8-4532-93b7-a7f9d1e36798 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:51.051152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d2a57374-60a8-4532-93b7-a7f9d1e36798 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:51.094911 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2a57374-60a8-4532-93b7-a7f9d1e36798 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:51.095383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2a57374-60a8-4532-93b7-a7f9d1e36798 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:51.096209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2a57374-60a8-4532-93b7-a7f9d1e36798 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:51.096684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2a57374-60a8-4532-93b7-a7f9d1e36798 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:51.113534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b952b2b0-c0aa-4475-9797-81be8fbdae02 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:51.114380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b952b2b0-c0aa-4475-9797-81be8fbdae02 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] [instance: 0f10bdfd-d085-4e27-8681-4f324045e884] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:51.127049 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b952b2b0-c0aa-4475-9797-81be8fbdae02 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:51.133271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b952b2b0-c0aa-4475-9797-81be8fbdae02 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:51.134785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b952b2b0-c0aa-4475-9797-81be8fbdae02 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:51.139259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b952b2b0-c0aa-4475-9797-81be8fbdae02 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:51.193401 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-b952b2b0-c0aa-4475-9797-81be8fbdae02 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] HTTP exception thrown: Instance 0f10bdfd-d085-4e27-8681-4f324045e884 could not be found. Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b952b2b0-c0aa-4475-9797-81be8fbdae02 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Request method failure captured: Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/0f10bdfd-d085-4e27-8681-4f324045e884 HTTP/1.1 Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDCKmdNP71OI0_nO--IosA8eMEp14GUebIundUiw_qM2vOvVYN8GMGpf8TwjQ-aoxp03zSCPZuEjsi0lBjwC2MHnDu7HV-fyR1fCdkblLGWwZGsDie2g6WdRdssgbIajB0KmuIQfTkWVBfeUcwy5cPt_aKWBWYLxtMUL5S4OvmbuFg Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: X-Openstack-Nova-Api-Version: 2.47 Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: e5f95fba8dde4f3b8f9ba08feb0d593a Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerShowV247Test-1212237309 Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e5f95fba8dde4f3b8f9ba08feb0d593a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e5f95fba8dde4f3b8f9ba08feb0d593a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e5f95fba8dde4f3b8f9ba08feb0d593a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e5f95fba8dde4f3b8f9ba08feb0d593a"}]}] Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerShowV247Test-1212237309 Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: e5f95fba8dde4f3b8f9ba08feb0d593a Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerShowV247Test-1212237309 Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerShowV247Test-1212237309-project Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: ad9439fbab1a4ae58f9a9b48f00e2c82 Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerShowV247Test-1212237309-project Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 0f10bdfd-d085-4e27-8681-4f324045e884 could not be found. Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '0f10bdfd-d085-4e27-8681-4f324045e884'} Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f10bdfd-d085-4e27-8681-4f324045e884 could not be found. Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f10bdfd-d085-4e27-8681-4f324045e884 could not be found. Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:51.195508 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:51.199660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:51.199660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:51.199660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:51.199660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:51.199660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:51.199660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f10bdfd-d085-4e27-8681-4f324045e884 could not be found. Jul 25 12:47:51.199660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:51.201886 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b952b2b0-c0aa-4475-9797-81be8fbdae02 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] Returning 404 to user: Instance 0f10bdfd-d085-4e27-8681-4f324045e884 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:51.203570 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b952b2b0-c0aa-4475-9797-81be8fbdae02 tempest-ServerShowV247Test-1212237309 tempest-ServerShowV247Test-1212237309-project] 10.222.0.49 "GET /compute/v2.1/servers/0f10bdfd-d085-4e27-8681-4f324045e884" status: 404 len: 111 microversion: 2.47 time: 0.094580 Jul 25 12:47:51.211159 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1147/2373] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:51 2022] GET /compute/v2.1/servers/0f10bdfd-d085-4e27-8681-4f324045e884 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 25 12:47:51.613198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d2a57374-60a8-4532-93b7-a7f9d1e36798 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:51.627551 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d2a57374-60a8-4532-93b7-a7f9d1e36798 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1534 microversion: 2.1 time: 0.585433 Jul 25 12:47:51.633139 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1227/2374] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:51 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1534 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:51.710050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1268af84-3bc9-49bb-9b66-7e40d48d9453 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:51.711547 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1268af84-3bc9-49bb-9b66-7e40d48d9453 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:51.742092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1268af84-3bc9-49bb-9b66-7e40d48d9453 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:51.745451 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1268af84-3bc9-49bb-9b66-7e40d48d9453 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:51.752135 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1268af84-3bc9-49bb-9b66-7e40d48d9453 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:51.754739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1268af84-3bc9-49bb-9b66-7e40d48d9453 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:52.092175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1268af84-3bc9-49bb-9b66-7e40d48d9453 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4c0e44f8964dec8564b4066656a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d373382a442ceb132f66c002517a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:52.101566 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1268af84-3bc9-49bb-9b66-7e40d48d9453 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45" status: 200 len: 1403 microversion: 2.1 time: 0.397528 Jul 25 12:47:52.102610 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1228/2375] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:51 2022] GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45 => generated 1403 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:52.303815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0c1963ce-cb64-4da8-ac2f-cf9bf0095bec tempest-VolumesAdminNegativeTest-1472528604 tempest-VolumesAdminNegativeTest-1472528604-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "03838111-0dad-43f0-bf48-8c26e3395b5c"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:52.306771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0c1963ce-cb64-4da8-ac2f-cf9bf0095bec tempest-VolumesAdminNegativeTest-1472528604 tempest-VolumesAdminNegativeTest-1472528604-project-admin] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:52.316760 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c1963ce-cb64-4da8-ac2f-cf9bf0095bec tempest-VolumesAdminNegativeTest-1472528604 tempest-VolumesAdminNegativeTest-1472528604-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:52.317405 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c1963ce-cb64-4da8-ac2f-cf9bf0095bec tempest-VolumesAdminNegativeTest-1472528604 tempest-VolumesAdminNegativeTest-1472528604-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:52.318972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c1963ce-cb64-4da8-ac2f-cf9bf0095bec tempest-VolumesAdminNegativeTest-1472528604 tempest-VolumesAdminNegativeTest-1472528604-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:52.320555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c1963ce-cb64-4da8-ac2f-cf9bf0095bec tempest-VolumesAdminNegativeTest-1472528604 tempest-VolumesAdminNegativeTest-1472528604-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:52.549317 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-0c1963ce-cb64-4da8-ac2f-cf9bf0095bec tempest-VolumesAdminNegativeTest-1472528604 tempest-VolumesAdminNegativeTest-1472528604-project-admin] HTTP exception thrown: Volume 03838111-0dad-43f0-bf48-8c26e3395b5c could not be found. Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0c1963ce-cb64-4da8-ac2f-cf9bf0095bec tempest-VolumesAdminNegativeTest-1472528604 tempest-VolumesAdminNegativeTest-1472528604-project-admin] Request method failure captured: Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: request: PUT /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments/95ca2022-2e91-45b7-9e50-5aa493a0d2b9 HTTP/1.1 Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 74 Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pCleTHRrp_VXIAMcSlB1sxB0LSmHU0LNIZAT68ZZV5TnZmUTxMIKaUx8abRS0ubQvvH8dNJDkyaKh6-3aCjL9_eyySGY8as8VMEQ7VYhjYeZJ9FYYzkL6KXgEDgGy6S5wY41V9mD__ocPY7N-F7iPWbIefGfttxuMesepdZ_OfjNLo Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 5ddd5a3033754bf6aa1df607a1a57e42 Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-VolumesAdminNegativeTest-1472528604 Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5ddd5a3033754bf6aa1df607a1a57e42", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5ddd5a3033754bf6aa1df607a1a57e42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5ddd5a3033754bf6aa1df607a1a57e42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5ddd5a3033754bf6aa1df607a1a57e42"}]}] Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-VolumesAdminNegativeTest-1472528604 Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 5ddd5a3033754bf6aa1df607a1a57e42 Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1472528604 Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-VolumesAdminNegativeTest-1472528604-project-admin Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 3ed2d8c41de046a1b1005b79c298e2d9 Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-VolumesAdminNegativeTest-1472528604-project-admin Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: {"volumeAttachment": {"volumeId": "03838111-0dad-43f0-bf48-8c26e3395b5c"}} Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: exception: Volume 03838111-0dad-43f0-bf48-8c26e3395b5c could not be found. Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'server_id': 'a09b0fac-fbdd-4e0d-83b5-4b0573183adb', 'id': '95ca2022-2e91-45b7-9e50-5aa493a0d2b9', 'body': {'volumeAttachment': {'volumeId': '03838111-0dad-43f0-bf48-8c26e3395b5c'}}} Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 03838111-0dad-43f0-bf48-8c26e3395b5c could not be found. (HTTP 404) (Request-ID: req-2b47c190-9d5f-47e1-8f1d-458dc930686d) Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 12:47:52.596494 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 03838111-0dad-43f0-bf48-8c26e3395b5c could not be found. Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 03838111-0dad-43f0-bf48-8c26e3395b5c could not be found. Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 03838111-0dad-43f0-bf48-8c26e3395b5c could not be found. Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0c1963ce-cb64-4da8-ac2f-cf9bf0095bec tempest-VolumesAdminNegativeTest-1472528604 tempest-VolumesAdminNegativeTest-1472528604-project-admin] Returning 400 to user: Volume 03838111-0dad-43f0-bf48-8c26e3395b5c could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:52.600224 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0c1963ce-cb64-4da8-ac2f-cf9bf0095bec tempest-VolumesAdminNegativeTest-1472528604 tempest-VolumesAdminNegativeTest-1472528604-project-admin] 10.222.0.49 "PUT /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments/95ca2022-2e91-45b7-9e50-5aa493a0d2b9" status: 400 len: 107 microversion: 2.1 time: 1.246352 Jul 25 12:47:52.603223 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1148/2376] 10.222.0.49 () {60 vars in 1433 bytes} [Mon Jul 25 12:47:51 2022] PUT /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments/95ca2022-2e91-45b7-9e50-5aa493a0d2b9 => generated 107 bytes in 1248 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 12:47:52.659665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a5a08559-1422-40aa-8ab4-57498aff1765 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:52.660689 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a5a08559-1422-40aa-8ab4-57498aff1765 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:52.672845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5a08559-1422-40aa-8ab4-57498aff1765 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:52.673358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5a08559-1422-40aa-8ab4-57498aff1765 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:52.674115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5a08559-1422-40aa-8ab4-57498aff1765 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:52.674552 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5a08559-1422-40aa-8ab4-57498aff1765 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:52.750718 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b0ce1139-c571-411f-9081-c0398b6e17d9 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:52.753225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b0ce1139-c571-411f-9081-c0398b6e17d9 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:52.756475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:52.796013 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b0ce1139-c571-411f-9081-c0398b6e17d9 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:52.796751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b0ce1139-c571-411f-9081-c0398b6e17d9 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:52.799470 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b0ce1139-c571-411f-9081-c0398b6e17d9 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:52.800868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b0ce1139-c571-411f-9081-c0398b6e17d9 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:52.857115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=8 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:53.046012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-b0ce1139-c571-411f-9081-c0398b6e17d9 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lazy-loading 'services' on Instance uuid a09b0fac-fbdd-4e0d-83b5-4b0573183adb {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:47:53.171076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a5a08559-1422-40aa-8ab4-57498aff1765 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:53.179513 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a5a08559-1422-40aa-8ab4-57498aff1765 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1540 microversion: 2.1 time: 0.524154 Jul 25 12:47:53.190867 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1229/2377] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:52 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1540 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:53.195978 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-46fb0a47-22b1-489d-bc97-88d14618ef63 req-a73b273b-fb0f-4ef8-a131-24cb2093a7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cad4f60e-6cce-41a5-8152-28e755601c45", "name": "network-vif-plugged", "status": "completed", "tag": "561998ef-8060-4a06-a853-5c9a717c1b7f"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:53.239519 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b0ce1139-c571-411f-9081-c0398b6e17d9 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments/95ca2022-2e91-45b7-9e50-5aa493a0d2b9" status: 202 len: 0 microversion: 2.1 time: 0.506784 Jul 25 12:47:53.241216 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1149/2378] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Jul 25 12:47:52 2022] DELETE /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments/95ca2022-2e91-45b7-9e50-5aa493a0d2b9 => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:47:53.247755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-50245680-b656-4ce8-8edc-bcb758c52024 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:53.249113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-50245680-b656-4ce8-8edc-bcb758c52024 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:53.251427 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-46fb0a47-22b1-489d-bc97-88d14618ef63 req-a73b273b-fb0f-4ef8-a131-24cb2093a7f0 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:53.259623 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50245680-b656-4ce8-8edc-bcb758c52024 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:53.260735 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50245680-b656-4ce8-8edc-bcb758c52024 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:53.261532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-46fb0a47-22b1-489d-bc97-88d14618ef63 req-a73b273b-fb0f-4ef8-a131-24cb2093a7f0 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:53.262668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50245680-b656-4ce8-8edc-bcb758c52024 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:53.263417 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50245680-b656-4ce8-8edc-bcb758c52024 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:53.270932 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:53.318944 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-46fb0a47-22b1-489d-bc97-88d14618ef63 req-a73b273b-fb0f-4ef8-a131-24cb2093a7f0 service nova] Creating event network-vif-plugged:561998ef-8060-4a06-a853-5c9a717c1b7f for instance cad4f60e-6cce-41a5-8152-28e755601c45 on n-h2-848886-15 Jul 25 12:47:53.333048 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-46fb0a47-22b1-489d-bc97-88d14618ef63 req-a73b273b-fb0f-4ef8-a131-24cb2093a7f0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138497 Jul 25 12:47:53.334476 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1230/2379] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:53.351163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-742df6a8-b297-40ef-92da-a9ab346cf657 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:53.353960 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-742df6a8-b297-40ef-92da-a9ab346cf657 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:53.410663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-742df6a8-b297-40ef-92da-a9ab346cf657 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:53.422561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-742df6a8-b297-40ef-92da-a9ab346cf657 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:53.424149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-742df6a8-b297-40ef-92da-a9ab346cf657 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:53.426014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-742df6a8-b297-40ef-92da-a9ab346cf657 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:53.535194 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-742df6a8-b297-40ef-92da-a9ab346cf657 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199360 Jul 25 12:47:53.536081 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1231/2380] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 12:47:53 2022] GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:53.975969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-50245680-b656-4ce8-8edc-bcb758c52024 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4c0e44f8964dec8564b4066656a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d373382a442ceb132f66c002517a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:53.989820 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-50245680-b656-4ce8-8edc-bcb758c52024 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45" status: 200 len: 1403 microversion: 2.1 time: 0.743823 Jul 25 12:47:53.991149 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1150/2381] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:53 2022] GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45 => generated 1403 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:54.224191 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7c7c0216-56dc-4720-a6da-a7f0cbd0de76 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:54.229992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7c7c0216-56dc-4720-a6da-a7f0cbd0de76 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:54.242832 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c7c0216-56dc-4720-a6da-a7f0cbd0de76 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:54.244299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c7c0216-56dc-4720-a6da-a7f0cbd0de76 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:54.245323 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c7c0216-56dc-4720-a6da-a7f0cbd0de76 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:54.245859 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c7c0216-56dc-4720-a6da-a7f0cbd0de76 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:54.504510 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7c7c0216-56dc-4720-a6da-a7f0cbd0de76 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:54.514905 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7c7c0216-56dc-4720-a6da-a7f0cbd0de76 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1540 microversion: 2.1 time: 0.302859 Jul 25 12:47:54.515942 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1232/2382] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:54 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1540 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:54.548794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-30577213-fd8e-48ab-af2b-41307c6d7e5c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:54.551681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-30577213-fd8e-48ab-af2b-41307c6d7e5c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:54.566101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-30577213-fd8e-48ab-af2b-41307c6d7e5c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:54.566755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-30577213-fd8e-48ab-af2b-41307c6d7e5c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:54.567569 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-30577213-fd8e-48ab-af2b-41307c6d7e5c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:54.568503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-30577213-fd8e-48ab-af2b-41307c6d7e5c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:54.681741 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-30577213-fd8e-48ab-af2b-41307c6d7e5c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137269 Jul 25 12:47:54.688605 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1233/2383] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 12:47:54 2022] GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:55.015034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-52fd6bcd-6d9b-4bf3-be53-c9bb28e92f01 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:55.015871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-52fd6bcd-6d9b-4bf3-be53-c9bb28e92f01 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:55.025141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-746a2da5-0dfb-43c2-896d-37785c86689e tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Action: 'create', calling method: .version_select at 0x7efcf96d21f0>, body: {"keypair": {"name": "tempest-keypair-1414037427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxZ6eN3xHVGBjMF5vfu+e8i1zbKJPVfPFDbLRBwH/5Q4yB5cF9kZdx9mwI2WFgp3bc2UpqsNWMiPboC0QhP4XuQq+xn8hbSzu9eERX2YkviB7ei0yOG6FOtsZcAEM7JFA=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:55.048700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-52fd6bcd-6d9b-4bf3-be53-c9bb28e92f01 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:55.051277 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-52fd6bcd-6d9b-4bf3-be53-c9bb28e92f01 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:55.054242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-52fd6bcd-6d9b-4bf3-be53-c9bb28e92f01 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:55.058283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-52fd6bcd-6d9b-4bf3-be53-c9bb28e92f01 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:55.086874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-746a2da5-0dfb-43c2-896d-37785c86689e tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Getting quotas for project f088db318e364b5caf92d51ea9e5b562. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:47:55.118516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-746a2da5-0dfb-43c2-896d-37785c86689e tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Getting quotas for user dcae4341ba9e4cc0b93e00998c653d53 and project f088db318e364b5caf92d51ea9e5b562. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:47:55.214303 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-746a2da5-0dfb-43c2-896d-37785c86689e tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.701091 Jul 25 12:47:55.221473 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1151/2384] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:47:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:47:55.382365 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-52fd6bcd-6d9b-4bf3-be53-c9bb28e92f01 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4c0e44f8964dec8564b4066656a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d373382a442ceb132f66c002517a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:55.397078 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-52fd6bcd-6d9b-4bf3-be53-c9bb28e92f01 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45" status: 200 len: 1403 microversion: 2.1 time: 0.387800 Jul 25 12:47:55.397669 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1234/2385] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:55 2022] GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45 => generated 1403 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:55.539544 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-006b5707-90ca-454a-aacc-073b52f6e908 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:55.541354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-006b5707-90ca-454a-aacc-073b52f6e908 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:55.557098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-006b5707-90ca-454a-aacc-073b52f6e908 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:55.557750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-006b5707-90ca-454a-aacc-073b52f6e908 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:55.558765 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-006b5707-90ca-454a-aacc-073b52f6e908 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:55.559391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-006b5707-90ca-454a-aacc-073b52f6e908 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:55.695385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-450ea42b-f4d4-41a4-ba95-db7796c7fd3c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:55.700944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-450ea42b-f4d4-41a4-ba95-db7796c7fd3c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:55.719589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-450ea42b-f4d4-41a4-ba95-db7796c7fd3c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:55.720053 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-450ea42b-f4d4-41a4-ba95-db7796c7fd3c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:55.720873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-450ea42b-f4d4-41a4-ba95-db7796c7fd3c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:55.721313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-450ea42b-f4d4-41a4-ba95-db7796c7fd3c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:55.816517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:55.858279 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-450ea42b-f4d4-41a4-ba95-db7796c7fd3c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167479 Jul 25 12:47:55.867948 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1235/2386] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 12:47:55 2022] GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:55.911660 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-006b5707-90ca-454a-aacc-073b52f6e908 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:55.920017 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-006b5707-90ca-454a-aacc-073b52f6e908 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1522 microversion: 2.1 time: 0.384784 Jul 25 12:47:55.934106 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1152/2387] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:55 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:55.948796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f725d5e7-45a1-4f18-a477-9aa4c3614077 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:55.949309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f725d5e7-45a1-4f18-a477-9aa4c3614077 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:55.961283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f725d5e7-45a1-4f18-a477-9aa4c3614077 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:55.961743 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f725d5e7-45a1-4f18-a477-9aa4c3614077 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:55.969086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f725d5e7-45a1-4f18-a477-9aa4c3614077 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:55.969548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f725d5e7-45a1-4f18-a477-9aa4c3614077 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:56.040933 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f725d5e7-45a1-4f18-a477-9aa4c3614077 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:47:56.255353 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f725d5e7-45a1-4f18-a477-9aa4c3614077 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "DELETE /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 204 len: 0 microversion: 2.1 time: 0.312802 Jul 25 12:47:56.259055 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1236/2388] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:47:55 2022] DELETE /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:47:56.299466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-531ec8e2-a85c-4051-aed8-00c41c64d5b6 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:56.300618 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-531ec8e2-a85c-4051-aed8-00c41c64d5b6 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:56.319851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-531ec8e2-a85c-4051-aed8-00c41c64d5b6 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:56.320295 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-531ec8e2-a85c-4051-aed8-00c41c64d5b6 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:56.321123 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-531ec8e2-a85c-4051-aed8-00c41c64d5b6 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:56.321619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-531ec8e2-a85c-4051-aed8-00c41c64d5b6 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:56.735985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ac845f14-87a6-4fc5-b85f-854d7188e49b tempest-FlavorsV2NegativeTest-72375397 tempest-FlavorsV2NegativeTest-72375397-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:56.790303 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ac845f14-87a6-4fc5-b85f-854d7188e49b tempest-FlavorsV2NegativeTest-72375397 tempest-FlavorsV2NegativeTest-72375397-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.772100 Jul 25 12:47:56.791181 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1153/2389] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:47:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:56.840188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1d5ed164-d5d6-4702-b366-44ecf4c29a14 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:56.841158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1d5ed164-d5d6-4702-b366-44ecf4c29a14 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:56.865018 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d5ed164-d5d6-4702-b366-44ecf4c29a14 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:56.866440 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d5ed164-d5d6-4702-b366-44ecf4c29a14 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:56.870509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d5ed164-d5d6-4702-b366-44ecf4c29a14 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:56.875820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d5ed164-d5d6-4702-b366-44ecf4c29a14 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:56.997768 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-531ec8e2-a85c-4051-aed8-00c41c64d5b6 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:57.008994 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-531ec8e2-a85c-4051-aed8-00c41c64d5b6 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1528 microversion: 2.1 time: 0.745620 Jul 25 12:47:57.014015 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1237/2390] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:56 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1528 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:47:57.061081 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b477f1a1-eee6-4bdf-afa7-73771ef26094 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:57.072081 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b477f1a1-eee6-4bdf-afa7-73771ef26094 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:57.108574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b477f1a1-eee6-4bdf-afa7-73771ef26094 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:57.109043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b477f1a1-eee6-4bdf-afa7-73771ef26094 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:57.109861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b477f1a1-eee6-4bdf-afa7-73771ef26094 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:57.110315 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b477f1a1-eee6-4bdf-afa7-73771ef26094 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:57.248795 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b477f1a1-eee6-4bdf-afa7-73771ef26094 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.218177 Jul 25 12:47:57.261431 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1238/2391] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 12:47:57 2022] GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments => generated 197 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:57.873210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-da7fc383-5b0c-41a4-a644-c942067d60fc req-413aeec2-9777-4534-b952-8b34deef359b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aec454db-239e-49ed-a021-297e11579b04", "name": "network-vif-plugged", "status": "completed", "tag": "4efa19f7-1e52-4bc9-9cca-24a1ec66a5db"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:57.905894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-da7fc383-5b0c-41a4-a644-c942067d60fc req-413aeec2-9777-4534-b952-8b34deef359b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:57.909155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-da7fc383-5b0c-41a4-a644-c942067d60fc req-413aeec2-9777-4534-b952-8b34deef359b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:57.948896 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-da7fc383-5b0c-41a4-a644-c942067d60fc req-413aeec2-9777-4534-b952-8b34deef359b service nova] Creating event network-vif-plugged:4efa19f7-1e52-4bc9-9cca-24a1ec66a5db for instance aec454db-239e-49ed-a021-297e11579b04 on n-h1-848886-15 Jul 25 12:47:57.970005 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-da7fc383-5b0c-41a4-a644-c942067d60fc req-413aeec2-9777-4534-b952-8b34deef359b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100805 Jul 25 12:47:57.973559 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1239/2392] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:47:58.041425 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c78b8caa-b329-4c42-94ab-193e73a23913 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:58.042278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c78b8caa-b329-4c42-94ab-193e73a23913 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:58.053596 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c78b8caa-b329-4c42-94ab-193e73a23913 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:58.063365 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c78b8caa-b329-4c42-94ab-193e73a23913 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:58.065750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c78b8caa-b329-4c42-94ab-193e73a23913 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:58.067869 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c78b8caa-b329-4c42-94ab-193e73a23913 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:58.475881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1d5ed164-d5d6-4702-b366-44ecf4c29a14 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4c0e44f8964dec8564b4066656a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d373382a442ceb132f66c002517a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:58.491733 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1d5ed164-d5d6-4702-b366-44ecf4c29a14 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45" status: 200 len: 1591 microversion: 2.1 time: 1.679382 Jul 25 12:47:58.495865 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1154/2393] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:56 2022] GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45 => generated 1591 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:58.520352 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b60a3b6d-8ecb-4a14-8ac0-64e993a6ebbf tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:58.535110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b60a3b6d-8ecb-4a14-8ac0-64e993a6ebbf tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:58.576012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b60a3b6d-8ecb-4a14-8ac0-64e993a6ebbf tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:58.577329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b60a3b6d-8ecb-4a14-8ac0-64e993a6ebbf tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:58.578328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b60a3b6d-8ecb-4a14-8ac0-64e993a6ebbf tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:58.589060 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b60a3b6d-8ecb-4a14-8ac0-64e993a6ebbf tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:58.711635 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b60a3b6d-8ecb-4a14-8ac0-64e993a6ebbf tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.213817 Jul 25 12:47:58.721522 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1155/2394] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 12:47:58 2022] GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments => generated 197 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:58.739491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bc405e12-b086-4a4a-b578-a70e92f8e5d9 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:58.743772 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bc405e12-b086-4a4a-b578-a70e92f8e5d9 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:58.771703 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc405e12-b086-4a4a-b578-a70e92f8e5d9 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:58.772460 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc405e12-b086-4a4a-b578-a70e92f8e5d9 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:58.775923 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc405e12-b086-4a4a-b578-a70e92f8e5d9 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:58.776695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc405e12-b086-4a4a-b578-a70e92f8e5d9 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:59.281720 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c78b8caa-b329-4c42-94ab-193e73a23913 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:59.292383 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c78b8caa-b329-4c42-94ab-193e73a23913 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1528 microversion: 2.1 time: 1.255519 Jul 25 12:47:59.293338 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1240/2395] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:58 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1528 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:59.309953 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bc405e12-b086-4a4a-b578-a70e92f8e5d9 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.586640 Jul 25 12:47:59.310993 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1156/2396] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 12:47:58 2022] GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45/os-interface => generated 285 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:59.321932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8f04198f-afc8-4cfe-8ce4-c8ea342cc02d tempest-FlavorsV2NegativeTest-72375397 tempest-FlavorsV2NegativeTest-72375397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-34521383", "imageRef": "322125a1-9d84-4dfd-a796-d7687958f2e9", "flavorRef": "452"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:59.349681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:59.435769 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-8f04198f-afc8-4cfe-8ce4-c8ea342cc02d tempest-FlavorsV2NegativeTest-72375397 tempest-FlavorsV2NegativeTest-72375397-project] validate_networks() for None {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:47:59.730261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-43a2a0d0-04bd-484d-8609-cc45575a0f7a tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:59.732843 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-43a2a0d0-04bd-484d-8609-cc45575a0f7a tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:59.768434 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43a2a0d0-04bd-484d-8609-cc45575a0f7a tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:59.772007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43a2a0d0-04bd-484d-8609-cc45575a0f7a tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:59.772987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43a2a0d0-04bd-484d-8609-cc45575a0f7a tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:59.776368 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43a2a0d0-04bd-484d-8609-cc45575a0f7a tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:59.930201 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-43a2a0d0-04bd-484d-8609-cc45575a0f7a tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205219 Jul 25 12:47:59.940949 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1157/2397] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 12:47:59 2022] GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments => generated 197 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:59.979316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-f7914775-225b-4e40-bc40-b620455975f5 req-04ee8b3b-f29d-4f51-a968-ca3100fe11f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aec454db-239e-49ed-a021-297e11579b04", "name": "network-vif-deleted", "tag": "4efa19f7-1e52-4bc9-9cca-24a1ec66a5db"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:00.030916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-f7914775-225b-4e40-bc40-b620455975f5 req-04ee8b3b-f29d-4f51-a968-ca3100fe11f5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:00.032844 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-f7914775-225b-4e40-bc40-b620455975f5 req-04ee8b3b-f29d-4f51-a968-ca3100fe11f5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:00.103371 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-f7914775-225b-4e40-bc40-b620455975f5 req-04ee8b3b-f29d-4f51-a968-ca3100fe11f5 service nova] Creating event network-vif-deleted:4efa19f7-1e52-4bc9-9cca-24a1ec66a5db for instance aec454db-239e-49ed-a021-297e11579b04 on n-h1-848886-15 Jul 25 12:48:00.117261 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-f7914775-225b-4e40-bc40-b620455975f5 req-04ee8b3b-f29d-4f51-a968-ca3100fe11f5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141867 Jul 25 12:48:00.122507 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1158/2398] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:48:00.315322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-73cd303c-dc0f-4ce0-bbf9-6ce4cb005843 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:00.316142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-73cd303c-dc0f-4ce0-bbf9-6ce4cb005843 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:00.330368 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73cd303c-dc0f-4ce0-bbf9-6ce4cb005843 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:00.340284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73cd303c-dc0f-4ce0-bbf9-6ce4cb005843 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:00.350199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73cd303c-dc0f-4ce0-bbf9-6ce4cb005843 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:00.350957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73cd303c-dc0f-4ce0-bbf9-6ce4cb005843 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:00.506399 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73cd303c-dc0f-4ce0-bbf9-6ce4cb005843 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:00.507477 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73cd303c-dc0f-4ce0-bbf9-6ce4cb005843 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:00.511088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-73cd303c-dc0f-4ce0-bbf9-6ce4cb005843 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lazy-loading 'fault' on Instance uuid aec454db-239e-49ed-a021-297e11579b04 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:48:02.384365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-73cd303c-dc0f-4ce0-bbf9-6ce4cb005843 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:02.392940 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-73cd303c-dc0f-4ce0-bbf9-6ce4cb005843 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 200 len: 1315 microversion: 2.1 time: 2.081913 Jul 25 12:48:02.396475 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1159/2399] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:00 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 1315 bytes in 2083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:48:02.410007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-367c381d-9928-47d2-90d3-de770fe0f745 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:02.429719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-367c381d-9928-47d2-90d3-de770fe0f745 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:02.469083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-367c381d-9928-47d2-90d3-de770fe0f745 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:02.470480 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-367c381d-9928-47d2-90d3-de770fe0f745 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:02.473479 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-367c381d-9928-47d2-90d3-de770fe0f745 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:02.481251 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-367c381d-9928-47d2-90d3-de770fe0f745 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:02.562948 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-367c381d-9928-47d2-90d3-de770fe0f745 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165148 Jul 25 12:48:02.564404 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1160/2400] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 12:48:02 2022] GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:02.888700 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-8f04198f-afc8-4cfe-8ce4-c8ea342cc02d tempest-FlavorsV2NegativeTest-72375397 tempest-FlavorsV2NegativeTest-72375397-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8f04198f-afc8-4cfe-8ce4-c8ea342cc02d tempest-FlavorsV2NegativeTest-72375397 tempest-FlavorsV2NegativeTest-72375397-project] Request method failure captured: Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 141 Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pD7HasrohC9Zx_1hHUBm8qGgyqyPh6j50jMBg3vhkP4uzYYCtBZiU1ssBJiAUFh7OAANXJs9eyorqW7ll0xqRqjO16js_LnmfgRp6zPS7HbcLYUyJWgFLOSeW7M89EUwUg4-s8xSfhjLNHbxIuugmCcQr1lCPwnKWRnvVMNO2ZfTl8 Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: bb8e2a2e7f884a578a9c36ecb4f7be94 Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-FlavorsV2NegativeTest-72375397 Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bb8e2a2e7f884a578a9c36ecb4f7be94", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bb8e2a2e7f884a578a9c36ecb4f7be94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bb8e2a2e7f884a578a9c36ecb4f7be94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bb8e2a2e7f884a578a9c36ecb4f7be94"}]}] Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-FlavorsV2NegativeTest-72375397 Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: bb8e2a2e7f884a578a9c36ecb4f7be94 Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-72375397 Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-FlavorsV2NegativeTest-72375397-project Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: f1ebfa26c8d1450abb91546e94b7e4b1 Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-FlavorsV2NegativeTest-72375397-project Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-34521383", "imageRef": "322125a1-9d84-4dfd-a796-d7687958f2e9", "flavorRef": "452"}} Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: exception: Flavor's memory is too small for requested image. Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-34521383', 'imageRef': '322125a1-9d84-4dfd-a796-d7687958f2e9', 'flavorRef': '452'}}} Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:48:02.890572 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:48:02.895454 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:48:02.895454 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:48:02.895454 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 12:48:02.895454 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 25 12:48:02.895454 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 25 12:48:02.895454 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 25 12:48:02.895454 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:02.895454 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:02.895454 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:02.895454 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:02.895454 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:02.895454 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:02.895454 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:48:02.895454 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:48:02.895454 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 25 12:48:02.895454 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:02.898050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8f04198f-afc8-4cfe-8ce4-c8ea342cc02d tempest-FlavorsV2NegativeTest-72375397 tempest-FlavorsV2NegativeTest-72375397-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:48:02.899374 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8f04198f-afc8-4cfe-8ce4-c8ea342cc02d tempest-FlavorsV2NegativeTest-72375397 tempest-FlavorsV2NegativeTest-72375397-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 3.589473 Jul 25 12:48:02.900282 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1241/2401] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:47:59 2022] POST /compute/v2.1/servers => generated 93 bytes in 3591 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:48:03.438111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e5b39be9-bf7a-4060-8ee6-dedf9f662fc5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:03.439540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e5b39be9-bf7a-4060-8ee6-dedf9f662fc5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:03.460054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e5b39be9-bf7a-4060-8ee6-dedf9f662fc5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:03.462718 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e5b39be9-bf7a-4060-8ee6-dedf9f662fc5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:03.463642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e5b39be9-bf7a-4060-8ee6-dedf9f662fc5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:03.464848 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a1904063-5542-4196-b83f-f762bf37ce9c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:03.465494 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a1904063-5542-4196-b83f-f762bf37ce9c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:03.466073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e5b39be9-bf7a-4060-8ee6-dedf9f662fc5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:03.480159 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1904063-5542-4196-b83f-f762bf37ce9c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:03.480600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1904063-5542-4196-b83f-f762bf37ce9c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:03.481348 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1904063-5542-4196-b83f-f762bf37ce9c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:03.481788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1904063-5542-4196-b83f-f762bf37ce9c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:03.511364 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-e5b39be9-bf7a-4060-8ee6-dedf9f662fc5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] HTTP exception thrown: Instance aec454db-239e-49ed-a021-297e11579b04 could not be found. Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e5b39be9-bf7a-4060-8ee6-dedf9f662fc5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Request method failure captured: Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 HTTP/1.1 Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDaiP1mn9moxuV0sEhHjcxs4YL6Wxk-LuBvL9sVonTARIUb0VcjcYQ7ntJp6sU09-7y0ZY4v6v4uSXBdkSQ_CiPsK7WXJf7MhcmeBPhydkepNAywcsaes9TYKg1Cs1S98mShfAYCBZemu8j0o07ISZt2oaK0_iQPi_CmMif6E2gpQ0 Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_35482ec73a054bafa24c83aea2b08636", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}] Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: bedadaad3cf44edb8fd8037aebd2ee25 Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance aec454db-239e-49ed-a021-297e11579b04 could not be found. Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'aec454db-239e-49ed-a021-297e11579b04'} Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aec454db-239e-49ed-a021-297e11579b04 could not be found. Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aec454db-239e-49ed-a021-297e11579b04 could not be found. Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:03.520313 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:03.524477 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:03.524477 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:03.524477 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:03.524477 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:03.524477 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:48:03.524477 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:48:03.524477 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aec454db-239e-49ed-a021-297e11579b04 could not be found. Jul 25 12:48:03.524477 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:03.527514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e5b39be9-bf7a-4060-8ee6-dedf9f662fc5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Returning 404 to user: Instance aec454db-239e-49ed-a021-297e11579b04 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:48:03.530732 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e5b39be9-bf7a-4060-8ee6-dedf9f662fc5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 404 len: 111 microversion: 2.1 time: 0.097197 Jul 25 12:48:03.541819 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1161/2402] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:03 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:48:03.554985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f99ce7f4-c44e-4b03-82d1-8475647baaf8 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Action: 'create', calling method: .version_select at 0x7efcf9d0fa60>, body: {"keypair": {"name": "tempest-keypair-529475566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExNMrDP2Cn/1OUh2JpH03DgRJoDjOl98MFSqBkNYUJYOMQor0CBFzG04M4vdjsdw8dpW1owMjvZvkfUwEmXk6uzzlKkcyoFzNxqT26kNRgHheno2fsLqp1rbZOtpYTEEA=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:03.590779 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-f99ce7f4-c44e-4b03-82d1-8475647baaf8 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Getting quotas for project 35482ec73a054bafa24c83aea2b08636. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:48:03.598266 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-f99ce7f4-c44e-4b03-82d1-8475647baaf8 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Getting quotas for user bedadaad3cf44edb8fd8037aebd2ee25 and project 35482ec73a054bafa24c83aea2b08636. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:48:03.627249 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f99ce7f4-c44e-4b03-82d1-8475647baaf8 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.083331 Jul 25 12:48:03.628169 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1162/2403] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:48:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:03.641358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c9f4ccf9-3174-4f99-9e33-930016947a85 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:03.645452 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c9f4ccf9-3174-4f99-9e33-930016947a85 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:03.653070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c9f4ccf9-3174-4f99-9e33-930016947a85 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:03.653787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c9f4ccf9-3174-4f99-9e33-930016947a85 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:03.655078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c9f4ccf9-3174-4f99-9e33-930016947a85 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:03.655668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c9f4ccf9-3174-4f99-9e33-930016947a85 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:03.692401 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c9f4ccf9-3174-4f99-9e33-930016947a85 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056469 Jul 25 12:48:03.693509 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1163/2404] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 12:48:03 2022] GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:03.702796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-5ff9d9c2-a6f0-47cf-aeeb-751490b024f2 req-a9672e8a-6b67-48fb-a69e-ca16a4db2fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cad4f60e-6cce-41a5-8152-28e755601c45", "tag": "561998ef-8060-4a06-a853-5c9a717c1b7f"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:03.717450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-5ff9d9c2-a6f0-47cf-aeeb-751490b024f2 req-a9672e8a-6b67-48fb-a69e-ca16a4db2fc3 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:03.718281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-5ff9d9c2-a6f0-47cf-aeeb-751490b024f2 req-a9672e8a-6b67-48fb-a69e-ca16a4db2fc3 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:03.753341 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-5ff9d9c2-a6f0-47cf-aeeb-751490b024f2 req-a9672e8a-6b67-48fb-a69e-ca16a4db2fc3 service nova] Creating event network-changed:561998ef-8060-4a06-a853-5c9a717c1b7f for instance cad4f60e-6cce-41a5-8152-28e755601c45 on n-h2-848886-15 Jul 25 12:48:03.771901 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-5ff9d9c2-a6f0-47cf-aeeb-751490b024f2 req-a9672e8a-6b67-48fb-a69e-ca16a4db2fc3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074557 Jul 25 12:48:03.775815 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1164/2405] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:04.706803 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-05fc3514-3120-4fd2-9400-e6d6d8cfed6d tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:04.709098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-05fc3514-3120-4fd2-9400-e6d6d8cfed6d tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:04.728161 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05fc3514-3120-4fd2-9400-e6d6d8cfed6d tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:04.735942 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05fc3514-3120-4fd2-9400-e6d6d8cfed6d tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:04.737324 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05fc3514-3120-4fd2-9400-e6d6d8cfed6d tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:04.738094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05fc3514-3120-4fd2-9400-e6d6d8cfed6d tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:04.826148 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-05fc3514-3120-4fd2-9400-e6d6d8cfed6d tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.125062 Jul 25 12:48:04.831461 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1165/2406] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 12:48:04 2022] GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:48:05.310811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-52ed6247-0fd5-4477-834d-5a95aab61f3c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1243895535", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "02367158-0cb5-4ee6-b8d9-660c13689517"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:05.380379 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a1904063-5542-4196-b83f-f762bf37ce9c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4c0e44f8964dec8564b4066656a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d373382a442ceb132f66c002517a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:05.393253 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a1904063-5542-4196-b83f-f762bf37ce9c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45" status: 200 len: 1591 microversion: 2.1 time: 1.929886 Jul 25 12:48:05.397915 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1242/2407] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:03 2022] GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45 => generated 1591 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:05.521566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-52ed6247-0fd5-4477-834d-5a95aab61f3c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] validate_networks() for [('02367158-0cb5-4ee6-b8d9-660c13689517', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:48:07.503245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-52ed6247-0fd5-4477-834d-5a95aab61f3c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:48:07.503826 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-52ed6247-0fd5-4477-834d-5a95aab61f3c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:48:07.504146 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-52ed6247-0fd5-4477-834d-5a95aab61f3c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:48:07.504732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-52ed6247-0fd5-4477-834d-5a95aab61f3c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:48:07.505297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-52ed6247-0fd5-4477-834d-5a95aab61f3c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:48:07.523191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-52ed6247-0fd5-4477-834d-5a95aab61f3c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:07.525469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-52ed6247-0fd5-4477-834d-5a95aab61f3c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:07.528780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-52ed6247-0fd5-4477-834d-5a95aab61f3c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:07.532938 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-52ed6247-0fd5-4477-834d-5a95aab61f3c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:07.608201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-52ed6247-0fd5-4477-834d-5a95aab61f3c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Getting quotas for project 63ce4c7d231540e29b9d66e0f8c276bb. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:48:07.621655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-52ed6247-0fd5-4477-834d-5a95aab61f3c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Getting quotas for user 8908d857fbae4fd49d6c8cd90529397b and project 63ce4c7d231540e29b9d66e0f8c276bb. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:48:07.655893 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-52ed6247-0fd5-4477-834d-5a95aab61f3c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:48:07.658838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-52ed6247-0fd5-4477-834d-5a95aab61f3c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: cd2e4e93-2db4-4b87-b159-a2b324ba4d20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:48:07.751786 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-52ed6247-0fd5-4477-834d-5a95aab61f3c tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.445516 Jul 25 12:48:07.764546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ca77b703-d42a-43c9-b9fa-267c44787657 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:07.765204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ca77b703-d42a-43c9-b9fa-267c44787657 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: cd2e4e93-2db4-4b87-b159-a2b324ba4d20] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:07.769904 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1166/2408] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:48:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:48:07.868156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ca77b703-d42a-43c9-b9fa-267c44787657 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8908d857fbae4fd49d6c8cd90529397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ce4c7d231540e29b9d66e0f8c276bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:07.875764 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ca77b703-d42a-43c9-b9fa-267c44787657 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20" status: 200 len: 1218 microversion: 2.1 time: 0.116155 Jul 25 12:48:07.879588 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1243/2409] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:07 2022] GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20 => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:48:08.902322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e37346ba-d435-47b6-9a76-e23b2b4351e5 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:08.903707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e37346ba-d435-47b6-9a76-e23b2b4351e5 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: cd2e4e93-2db4-4b87-b159-a2b324ba4d20] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:08.923774 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e37346ba-d435-47b6-9a76-e23b2b4351e5 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:08.930959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e37346ba-d435-47b6-9a76-e23b2b4351e5 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:08.935288 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e37346ba-d435-47b6-9a76-e23b2b4351e5 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:08.937612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e37346ba-d435-47b6-9a76-e23b2b4351e5 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:09.074324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e37346ba-d435-47b6-9a76-e23b2b4351e5 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8908d857fbae4fd49d6c8cd90529397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ce4c7d231540e29b9d66e0f8c276bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:09.098476 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e37346ba-d435-47b6-9a76-e23b2b4351e5 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20" status: 200 len: 1270 microversion: 2.1 time: 0.200746 Jul 25 12:48:09.103528 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1244/2410] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:08 2022] GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20 => generated 1270 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:48:09.292899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7de44eac-057f-4a8b-a7d2-f7d6a8fe3512 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-2140626087", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "ed77714d-fc10-4be7-95b5-2243f030b780"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:09.679932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d7eb76ce-83e8-437c-a873-ca18b65b6a52 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-444172524", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:10.256341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-7de44eac-057f-4a8b-a7d2-f7d6a8fe3512 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] validate_networks() for [('ed77714d-fc10-4be7-95b5-2243f030b780', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:48:10.265688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-d7eb76ce-83e8-437c-a873-ca18b65b6a52 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] validate_networks() for [('a6f54b0c-c351-4711-aa7a-a0f7f5852543', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:48:11.725901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d7eb76ce-83e8-437c-a873-ca18b65b6a52 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:48:11.727035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d7eb76ce-83e8-437c-a873-ca18b65b6a52 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:48:11.727704 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d7eb76ce-83e8-437c-a873-ca18b65b6a52 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:48:11.728398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d7eb76ce-83e8-437c-a873-ca18b65b6a52 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:48:11.729016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d7eb76ce-83e8-437c-a873-ca18b65b6a52 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:48:11.754678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7eb76ce-83e8-437c-a873-ca18b65b6a52 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:11.757257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7eb76ce-83e8-437c-a873-ca18b65b6a52 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:11.760137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7eb76ce-83e8-437c-a873-ca18b65b6a52 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:11.760617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7eb76ce-83e8-437c-a873-ca18b65b6a52 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:11.825445 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-d7eb76ce-83e8-437c-a873-ca18b65b6a52 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Getting quotas for project 35482ec73a054bafa24c83aea2b08636. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:48:11.873483 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-d7eb76ce-83e8-437c-a873-ca18b65b6a52 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Getting quotas for user bedadaad3cf44edb8fd8037aebd2ee25 and project 35482ec73a054bafa24c83aea2b08636. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:48:11.913119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d7eb76ce-83e8-437c-a873-ca18b65b6a52 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:48:11.919724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d7eb76ce-83e8-437c-a873-ca18b65b6a52 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:48:12.072059 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d7eb76ce-83e8-437c-a873-ca18b65b6a52 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.396237 Jul 25 12:48:12.076880 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1245/2411] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:48:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 2402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:48:12.088798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9de5a783-825a-4d84-a2d1-ac2921018617 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:12.095545 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9de5a783-825a-4d84-a2d1-ac2921018617 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: cd2e4e93-2db4-4b87-b159-a2b324ba4d20] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:12.136915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9de5a783-825a-4d84-a2d1-ac2921018617 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:12.137610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9de5a783-825a-4d84-a2d1-ac2921018617 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:12.138682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9de5a783-825a-4d84-a2d1-ac2921018617 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:12.144665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9de5a783-825a-4d84-a2d1-ac2921018617 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:12.392667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-7de44eac-057f-4a8b-a7d2-f7d6a8fe3512 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:48:12.393775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-7de44eac-057f-4a8b-a7d2-f7d6a8fe3512 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:48:12.394791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-7de44eac-057f-4a8b-a7d2-f7d6a8fe3512 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:48:12.395748 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-7de44eac-057f-4a8b-a7d2-f7d6a8fe3512 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:48:12.396684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-7de44eac-057f-4a8b-a7d2-f7d6a8fe3512 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:48:12.430018 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7de44eac-057f-4a8b-a7d2-f7d6a8fe3512 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:12.430742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7de44eac-057f-4a8b-a7d2-f7d6a8fe3512 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:12.432420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7de44eac-057f-4a8b-a7d2-f7d6a8fe3512 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:12.443129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7de44eac-057f-4a8b-a7d2-f7d6a8fe3512 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:12.501745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-7de44eac-057f-4a8b-a7d2-f7d6a8fe3512 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Getting quotas for project cb2e2224745745edab22c1745cbfcf84. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:48:12.512078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-7de44eac-057f-4a8b-a7d2-f7d6a8fe3512 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Getting quotas for user 1958cc5af89240e6b88ba2b13556230a and project cb2e2224745745edab22c1745cbfcf84. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:48:12.556213 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7de44eac-057f-4a8b-a7d2-f7d6a8fe3512 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:48:12.561528 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7de44eac-057f-4a8b-a7d2-f7d6a8fe3512 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] [instance: e7c1af33-c872-479c-a302-781e0c0b3835] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:48:12.666239 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7de44eac-057f-4a8b-a7d2-f7d6a8fe3512 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.964764 Jul 25 12:48:12.667749 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1167/2412] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:48:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:48:12.673166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-435103b8-8dbe-418c-a8fb-54bd2de3ba87 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:12.674014 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-435103b8-8dbe-418c-a8fb-54bd2de3ba87 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:12.740868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9de5a783-825a-4d84-a2d1-ac2921018617 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8908d857fbae4fd49d6c8cd90529397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ce4c7d231540e29b9d66e0f8c276bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:12.752761 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9de5a783-825a-4d84-a2d1-ac2921018617 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20" status: 200 len: 1318 microversion: 2.1 time: 0.674176 Jul 25 12:48:12.757097 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1246/2413] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:12 2022] GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20 => generated 1318 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:12.769456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d346fd59-3e1c-4ea3-9684-423c2477bd3e tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:12.771083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d346fd59-3e1c-4ea3-9684-423c2477bd3e tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] [instance: e7c1af33-c872-479c-a302-781e0c0b3835] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:12.874955 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-435103b8-8dbe-418c-a8fb-54bd2de3ba87 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:12.883598 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-435103b8-8dbe-418c-a8fb-54bd2de3ba87 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 200 len: 1224 microversion: 2.1 time: 0.214586 Jul 25 12:48:12.884208 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1168/2414] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:12 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 1224 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:13.004007 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d346fd59-3e1c-4ea3-9684-423c2477bd3e tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1958cc5af89240e6b88ba2b13556230a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e2224745745edab22c1745cbfcf84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:13.042162 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d346fd59-3e1c-4ea3-9684-423c2477bd3e tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835" status: 200 len: 1216 microversion: 2.1 time: 0.282427 Jul 25 12:48:13.046039 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1247/2415] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:12 2022] GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835 => generated 1216 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:13.781358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9940761c-f2e1-498b-b321-f4a988dbf57b tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:13.782723 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9940761c-f2e1-498b-b321-f4a988dbf57b tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: cd2e4e93-2db4-4b87-b159-a2b324ba4d20] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:13.805474 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9940761c-f2e1-498b-b321-f4a988dbf57b tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:13.805982 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9940761c-f2e1-498b-b321-f4a988dbf57b tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:13.809764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9940761c-f2e1-498b-b321-f4a988dbf57b tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:13.810260 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9940761c-f2e1-498b-b321-f4a988dbf57b tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:13.912335 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ea2133a6-73dc-419d-af23-ad1f1d2e8164 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:13.913006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ea2133a6-73dc-419d-af23-ad1f1d2e8164 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:13.930121 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea2133a6-73dc-419d-af23-ad1f1d2e8164 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:13.931404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea2133a6-73dc-419d-af23-ad1f1d2e8164 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:13.934808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea2133a6-73dc-419d-af23-ad1f1d2e8164 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:13.935518 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea2133a6-73dc-419d-af23-ad1f1d2e8164 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:14.353546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ea2133a6-73dc-419d-af23-ad1f1d2e8164 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:14.374715 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ea2133a6-73dc-419d-af23-ad1f1d2e8164 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 200 len: 1228 microversion: 2.1 time: 0.464974 Jul 25 12:48:14.377989 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1248/2416] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:13 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 1228 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:14.398918 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-144bab70-c4d5-4540-8127-a0e1855e855d tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:14.401700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-144bab70-c4d5-4540-8127-a0e1855e855d tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] [instance: e7c1af33-c872-479c-a302-781e0c0b3835] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:14.635192 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9940761c-f2e1-498b-b321-f4a988dbf57b tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8908d857fbae4fd49d6c8cd90529397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ce4c7d231540e29b9d66e0f8c276bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:14.662169 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9940761c-f2e1-498b-b321-f4a988dbf57b tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20" status: 200 len: 1318 microversion: 2.1 time: 0.884599 Jul 25 12:48:14.665263 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1169/2417] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:13 2022] GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20 => generated 1318 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:48:14.690916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-0521f8a5-6d28-453e-88e3-15ef8caa23b2 req-e1c81b0f-7ed3-44a4-bf2f-0b6fa8976d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd2e4e93-2db4-4b87-b159-a2b324ba4d20", "tag": "4c9a41d3-68ec-4cb7-a986-620aa344862d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:14.735222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0521f8a5-6d28-453e-88e3-15ef8caa23b2 req-e1c81b0f-7ed3-44a4-bf2f-0b6fa8976d97 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:14.741536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0521f8a5-6d28-453e-88e3-15ef8caa23b2 req-e1c81b0f-7ed3-44a4-bf2f-0b6fa8976d97 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:14.783387 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-0521f8a5-6d28-453e-88e3-15ef8caa23b2 req-e1c81b0f-7ed3-44a4-bf2f-0b6fa8976d97 service nova] Creating event network-changed:4c9a41d3-68ec-4cb7-a986-620aa344862d for instance cd2e4e93-2db4-4b87-b159-a2b324ba4d20 on n-h1-848886-15 Jul 25 12:48:14.793703 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-0521f8a5-6d28-453e-88e3-15ef8caa23b2 req-e1c81b0f-7ed3-44a4-bf2f-0b6fa8976d97 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125355 Jul 25 12:48:14.796723 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1170/2418] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:14.818277 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-144bab70-c4d5-4540-8127-a0e1855e855d tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1958cc5af89240e6b88ba2b13556230a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e2224745745edab22c1745cbfcf84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:14.833919 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-144bab70-c4d5-4540-8127-a0e1855e855d tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835" status: 200 len: 1216 microversion: 2.1 time: 0.452802 Jul 25 12:48:14.837824 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1249/2419] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:14 2022] GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835 => generated 1216 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:15.403951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b7447b1d-2d52-4b76-9197-8972539f2adc tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:15.405218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b7447b1d-2d52-4b76-9197-8972539f2adc tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:15.421418 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b7447b1d-2d52-4b76-9197-8972539f2adc tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:15.422710 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b7447b1d-2d52-4b76-9197-8972539f2adc tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:15.425441 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b7447b1d-2d52-4b76-9197-8972539f2adc tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:15.427517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b7447b1d-2d52-4b76-9197-8972539f2adc tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:15.691262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e9f99829-e5b8-46b3-9e9c-814d3c2b14ba tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:15.691984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e9f99829-e5b8-46b3-9e9c-814d3c2b14ba tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: cd2e4e93-2db4-4b87-b159-a2b324ba4d20] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:15.708075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9f99829-e5b8-46b3-9e9c-814d3c2b14ba tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:15.708075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9f99829-e5b8-46b3-9e9c-814d3c2b14ba tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:15.714419 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9f99829-e5b8-46b3-9e9c-814d3c2b14ba tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:15.716640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9f99829-e5b8-46b3-9e9c-814d3c2b14ba tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:15.989549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b7447b1d-2d52-4b76-9197-8972539f2adc tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:16.001522 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b7447b1d-2d52-4b76-9197-8972539f2adc tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 200 len: 1294 microversion: 2.1 time: 0.608488 Jul 25 12:48:16.021267 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1171/2420] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:15 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 1294 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:16.036309 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-377910c2-375c-4136-ae20-de678514a4a3 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:16.037271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-377910c2-375c-4136-ae20-de678514a4a3 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] [instance: e7c1af33-c872-479c-a302-781e0c0b3835] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:16.043932 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-377910c2-375c-4136-ae20-de678514a4a3 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:16.044955 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-377910c2-375c-4136-ae20-de678514a4a3 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:16.046217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-377910c2-375c-4136-ae20-de678514a4a3 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:16.047104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-377910c2-375c-4136-ae20-de678514a4a3 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:16.232311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-377910c2-375c-4136-ae20-de678514a4a3 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1958cc5af89240e6b88ba2b13556230a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e2224745745edab22c1745cbfcf84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:16.246742 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-377910c2-375c-4136-ae20-de678514a4a3 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835" status: 200 len: 1276 microversion: 2.1 time: 0.229324 Jul 25 12:48:16.253373 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1172/2421] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:16 2022] GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835 => generated 1276 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:16.761134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e9f99829-e5b8-46b3-9e9c-814d3c2b14ba tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8908d857fbae4fd49d6c8cd90529397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ce4c7d231540e29b9d66e0f8c276bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:16.784189 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e9f99829-e5b8-46b3-9e9c-814d3c2b14ba tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20" status: 200 len: 1318 microversion: 2.1 time: 1.102325 Jul 25 12:48:16.802986 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1250/2422] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:15 2022] GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20 => generated 1318 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:17.076909 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7689b206-62e3-4994-8974-61e7f0be52ac tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:17.079067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7689b206-62e3-4994-8974-61e7f0be52ac tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:17.105401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:17.132287 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7689b206-62e3-4994-8974-61e7f0be52ac tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:17.133667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7689b206-62e3-4994-8974-61e7f0be52ac tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:17.137633 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7689b206-62e3-4994-8974-61e7f0be52ac tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:17.144279 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7689b206-62e3-4994-8974-61e7f0be52ac tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:17.293145 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ad0d6f5d-176c-49fc-b97c-2c06e6694c15 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:17.294269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ad0d6f5d-176c-49fc-b97c-2c06e6694c15 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] [instance: e7c1af33-c872-479c-a302-781e0c0b3835] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:17.301926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ad0d6f5d-176c-49fc-b97c-2c06e6694c15 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:17.302453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ad0d6f5d-176c-49fc-b97c-2c06e6694c15 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:17.303689 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ad0d6f5d-176c-49fc-b97c-2c06e6694c15 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:17.304344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ad0d6f5d-176c-49fc-b97c-2c06e6694c15 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:17.323592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7689b206-62e3-4994-8974-61e7f0be52ac tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:17.344222 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7689b206-62e3-4994-8974-61e7f0be52ac tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 200 len: 1282 microversion: 2.1 time: 0.289401 Jul 25 12:48:17.346629 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1173/2423] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:17 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 1282 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:17.544259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ad0d6f5d-176c-49fc-b97c-2c06e6694c15 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1958cc5af89240e6b88ba2b13556230a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e2224745745edab22c1745cbfcf84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:17.560217 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ad0d6f5d-176c-49fc-b97c-2c06e6694c15 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835" status: 200 len: 1274 microversion: 2.1 time: 0.266844 Jul 25 12:48:17.570925 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1251/2424] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:17 2022] GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835 => generated 1274 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:17.829446 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e948805a-5200-4f0a-99ac-89be6c9264a3 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:17.830435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e948805a-5200-4f0a-99ac-89be6c9264a3 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: cd2e4e93-2db4-4b87-b159-a2b324ba4d20] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:17.837993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e948805a-5200-4f0a-99ac-89be6c9264a3 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:17.839191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e948805a-5200-4f0a-99ac-89be6c9264a3 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:17.840226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e948805a-5200-4f0a-99ac-89be6c9264a3 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:17.840860 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e948805a-5200-4f0a-99ac-89be6c9264a3 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:18.379051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e6114fba-4ca5-4eb3-960e-444a9cba71cc tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:18.381178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e6114fba-4ca5-4eb3-960e-444a9cba71cc tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:18.381564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e948805a-5200-4f0a-99ac-89be6c9264a3 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8908d857fbae4fd49d6c8cd90529397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ce4c7d231540e29b9d66e0f8c276bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:18.398333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:18.403374 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e6114fba-4ca5-4eb3-960e-444a9cba71cc tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:18.403940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e6114fba-4ca5-4eb3-960e-444a9cba71cc tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:18.404774 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e6114fba-4ca5-4eb3-960e-444a9cba71cc tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:18.405218 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e6114fba-4ca5-4eb3-960e-444a9cba71cc tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:18.433134 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e948805a-5200-4f0a-99ac-89be6c9264a3 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20" status: 200 len: 1318 microversion: 2.1 time: 0.608308 Jul 25 12:48:18.457044 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1174/2425] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:17 2022] GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20 => generated 1318 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:18.591843 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8d9ed6af-7075-4f02-bd0d-6a1845ad62bf tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:18.595984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8d9ed6af-7075-4f02-bd0d-6a1845ad62bf tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] [instance: e7c1af33-c872-479c-a302-781e0c0b3835] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:18.607675 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d9ed6af-7075-4f02-bd0d-6a1845ad62bf tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:18.615318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d9ed6af-7075-4f02-bd0d-6a1845ad62bf tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:18.617957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d9ed6af-7075-4f02-bd0d-6a1845ad62bf tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:18.619921 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d9ed6af-7075-4f02-bd0d-6a1845ad62bf tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:19.175197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e6114fba-4ca5-4eb3-960e-444a9cba71cc tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:19.187662 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e6114fba-4ca5-4eb3-960e-444a9cba71cc tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 200 len: 1324 microversion: 2.1 time: 0.819582 Jul 25 12:48:19.188277 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1252/2426] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:18 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 1324 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:19.217761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8d9ed6af-7075-4f02-bd0d-6a1845ad62bf tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1958cc5af89240e6b88ba2b13556230a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e2224745745edab22c1745cbfcf84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:19.232368 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8d9ed6af-7075-4f02-bd0d-6a1845ad62bf tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835" status: 200 len: 1316 microversion: 2.1 time: 0.650962 Jul 25 12:48:19.234794 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1175/2427] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:18 2022] GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835 => generated 1316 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:19.465689 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7c0658fe-4876-4c49-bb50-ed8442d56de2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:19.467602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7c0658fe-4876-4c49-bb50-ed8442d56de2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: cd2e4e93-2db4-4b87-b159-a2b324ba4d20] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:19.485208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c0658fe-4876-4c49-bb50-ed8442d56de2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:19.486529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c0658fe-4876-4c49-bb50-ed8442d56de2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:19.487486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c0658fe-4876-4c49-bb50-ed8442d56de2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:19.488073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c0658fe-4876-4c49-bb50-ed8442d56de2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:19.963878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7c0658fe-4876-4c49-bb50-ed8442d56de2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8908d857fbae4fd49d6c8cd90529397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ce4c7d231540e29b9d66e0f8c276bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:19.978411 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7c0658fe-4876-4c49-bb50-ed8442d56de2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20" status: 200 len: 1318 microversion: 2.1 time: 0.512333 Jul 25 12:48:19.979946 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1253/2428] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:19 2022] GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20 => generated 1318 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:48:20.220733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bf1e4536-4c3d-4305-983b-b31abd246549 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:20.222256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bf1e4536-4c3d-4305-983b-b31abd246549 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:20.248346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf1e4536-4c3d-4305-983b-b31abd246549 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:20.249152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf1e4536-4c3d-4305-983b-b31abd246549 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:20.250010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf1e4536-4c3d-4305-983b-b31abd246549 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:20.250450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf1e4536-4c3d-4305-983b-b31abd246549 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:20.276923 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ee8afe23-f728-4c37-94d3-465375a56a66 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:20.286744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ee8afe23-f728-4c37-94d3-465375a56a66 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] [instance: e7c1af33-c872-479c-a302-781e0c0b3835] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:20.308070 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee8afe23-f728-4c37-94d3-465375a56a66 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:20.311806 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee8afe23-f728-4c37-94d3-465375a56a66 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:20.320016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee8afe23-f728-4c37-94d3-465375a56a66 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:20.321259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee8afe23-f728-4c37-94d3-465375a56a66 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:21.690551 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ee8afe23-f728-4c37-94d3-465375a56a66 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1958cc5af89240e6b88ba2b13556230a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e2224745745edab22c1745cbfcf84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:21.700579 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ee8afe23-f728-4c37-94d3-465375a56a66 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835" status: 200 len: 1316 microversion: 2.1 time: 1.427643 Jul 25 12:48:21.708935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bf1e4536-4c3d-4305-983b-b31abd246549 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:21.733054 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1254/2429] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:20 2022] GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835 => generated 1316 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:48:21.738440 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bf1e4536-4c3d-4305-983b-b31abd246549 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 200 len: 1324 microversion: 2.1 time: 1.506372 Jul 25 12:48:21.750212 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1176/2430] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:20 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 1324 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:21.755505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9588f9c0-4aa0-4fe4-bc60-d6ccd2c66728 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:21.756157 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9588f9c0-4aa0-4fe4-bc60-d6ccd2c66728 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: cd2e4e93-2db4-4b87-b159-a2b324ba4d20] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:21.758575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-a54f07e1-d2e3-4ca6-bd63-2c5baf444712 req-2406c03a-17d1-4ffe-8389-e25844253b1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7c1af33-c872-479c-a302-781e0c0b3835", "tag": "bda02458-c398-4d2f-ae84-acc4c4be0d21"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:21.785012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9588f9c0-4aa0-4fe4-bc60-d6ccd2c66728 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:21.785463 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9588f9c0-4aa0-4fe4-bc60-d6ccd2c66728 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:21.786504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9588f9c0-4aa0-4fe4-bc60-d6ccd2c66728 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:21.787122 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9588f9c0-4aa0-4fe4-bc60-d6ccd2c66728 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:21.791894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a54f07e1-d2e3-4ca6-bd63-2c5baf444712 req-2406c03a-17d1-4ffe-8389-e25844253b1b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:21.793711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a54f07e1-d2e3-4ca6-bd63-2c5baf444712 req-2406c03a-17d1-4ffe-8389-e25844253b1b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:21.815298 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:21.826468 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-a54f07e1-d2e3-4ca6-bd63-2c5baf444712 req-2406c03a-17d1-4ffe-8389-e25844253b1b service nova] Creating event network-changed:bda02458-c398-4d2f-ae84-acc4c4be0d21 for instance e7c1af33-c872-479c-a302-781e0c0b3835 on n-h2-848886-15 Jul 25 12:48:21.925957 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-a54f07e1-d2e3-4ca6-bd63-2c5baf444712 req-2406c03a-17d1-4ffe-8389-e25844253b1b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190865 Jul 25 12:48:21.926963 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1255/2431] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:21.949051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-9ecf2d05-4db1-40f2-877f-d74921106593 req-01fc6baa-d83c-4140-8513-26291ca76674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd2e4e93-2db4-4b87-b159-a2b324ba4d20", "name": "network-vif-plugged", "status": "completed", "tag": "4c9a41d3-68ec-4cb7-a986-620aa344862d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:21.967733 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9ecf2d05-4db1-40f2-877f-d74921106593 req-01fc6baa-d83c-4140-8513-26291ca76674 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:21.969521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9ecf2d05-4db1-40f2-877f-d74921106593 req-01fc6baa-d83c-4140-8513-26291ca76674 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:21.984291 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-9ecf2d05-4db1-40f2-877f-d74921106593 req-01fc6baa-d83c-4140-8513-26291ca76674 service nova] Creating event network-vif-plugged:4c9a41d3-68ec-4cb7-a986-620aa344862d for instance cd2e4e93-2db4-4b87-b159-a2b324ba4d20 on n-h1-848886-15 Jul 25 12:48:21.990421 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-9ecf2d05-4db1-40f2-877f-d74921106593 req-01fc6baa-d83c-4140-8513-26291ca76674 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061069 Jul 25 12:48:21.991081 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1256/2432] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:22.469549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9588f9c0-4aa0-4fe4-bc60-d6ccd2c66728 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8908d857fbae4fd49d6c8cd90529397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ce4c7d231540e29b9d66e0f8c276bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:22.478163 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9588f9c0-4aa0-4fe4-bc60-d6ccd2c66728 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20" status: 200 len: 1318 microversion: 2.1 time: 0.726614 Jul 25 12:48:22.490690 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1177/2433] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:21 2022] GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20 => generated 1318 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:22.656866 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-89c873d2-5540-4b7c-8e55-692d382a4d56 req-ee3acc45-5b2e-46a5-89cf-dc066a8faeef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f12fbbe-fd19-45f7-8693-36f61bc9db41", "tag": "361d7d5d-0b94-47b3-84f7-dee57ebbfdaf"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:22.695553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-89c873d2-5540-4b7c-8e55-692d382a4d56 req-ee3acc45-5b2e-46a5-89cf-dc066a8faeef service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:22.696172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-89c873d2-5540-4b7c-8e55-692d382a4d56 req-ee3acc45-5b2e-46a5-89cf-dc066a8faeef service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:22.700641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:22.732176 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-89c873d2-5540-4b7c-8e55-692d382a4d56 req-ee3acc45-5b2e-46a5-89cf-dc066a8faeef service nova] Creating event network-changed:361d7d5d-0b94-47b3-84f7-dee57ebbfdaf for instance 3f12fbbe-fd19-45f7-8693-36f61bc9db41 on n-h2-848886-15 Jul 25 12:48:22.740919 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-60111552-742d-47f0-b9cd-785af75468d2 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:22.741783 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-60111552-742d-47f0-b9cd-785af75468d2 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] [instance: e7c1af33-c872-479c-a302-781e0c0b3835] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:22.744098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:22.744725 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-89c873d2-5540-4b7c-8e55-692d382a4d56 req-ee3acc45-5b2e-46a5-89cf-dc066a8faeef service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094815 Jul 25 12:48:22.749637 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1257/2434] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:22.765200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-60111552-742d-47f0-b9cd-785af75468d2 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:22.768381 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-60111552-742d-47f0-b9cd-785af75468d2 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:22.772812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-60111552-742d-47f0-b9cd-785af75468d2 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:22.773623 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-60111552-742d-47f0-b9cd-785af75468d2 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:22.781704 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c71870e6-1b57-4ee7-a78c-d8524c68c5ef tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:22.783678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c71870e6-1b57-4ee7-a78c-d8524c68c5ef tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:22.812658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c71870e6-1b57-4ee7-a78c-d8524c68c5ef tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:22.817224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c71870e6-1b57-4ee7-a78c-d8524c68c5ef tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:22.823553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c71870e6-1b57-4ee7-a78c-d8524c68c5ef tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:22.825029 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c71870e6-1b57-4ee7-a78c-d8524c68c5ef tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:22.910121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=22 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:23.572280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c71870e6-1b57-4ee7-a78c-d8524c68c5ef tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:23.580440 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c71870e6-1b57-4ee7-a78c-d8524c68c5ef tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 200 len: 1324 microversion: 2.1 time: 0.819782 Jul 25 12:48:23.581036 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1258/2435] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:22 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 1324 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:23.598932 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-60111552-742d-47f0-b9cd-785af75468d2 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1958cc5af89240e6b88ba2b13556230a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e2224745745edab22c1745cbfcf84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:23.600048 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-acce0c54-f836-490b-9eda-d03218f9a277 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:23.600686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-acce0c54-f836-490b-9eda-d03218f9a277 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: cd2e4e93-2db4-4b87-b159-a2b324ba4d20] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:23.608516 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-60111552-742d-47f0-b9cd-785af75468d2 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835" status: 200 len: 1316 microversion: 2.1 time: 0.871928 Jul 25 12:48:23.615004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acce0c54-f836-490b-9eda-d03218f9a277 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:23.622246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acce0c54-f836-490b-9eda-d03218f9a277 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:23.623068 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acce0c54-f836-490b-9eda-d03218f9a277 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:23.624684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acce0c54-f836-490b-9eda-d03218f9a277 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:23.626081 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1178/2436] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:22 2022] GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835 => generated 1316 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:24.149956 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-acce0c54-f836-490b-9eda-d03218f9a277 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8908d857fbae4fd49d6c8cd90529397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ce4c7d231540e29b9d66e0f8c276bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:24.181440 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-acce0c54-f836-490b-9eda-d03218f9a277 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20" status: 200 len: 1507 microversion: 2.1 time: 0.595195 Jul 25 12:48:24.185778 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1259/2437] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:23 2022] GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20 => generated 1507 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:24.613003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bd49683c-8285-4076-8394-e349410de525 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:24.613950 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bd49683c-8285-4076-8394-e349410de525 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:24.629104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-04615137-abb9-49d7-b2f1-47aaf50556ca tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:24.629739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-04615137-abb9-49d7-b2f1-47aaf50556ca tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] [instance: e7c1af33-c872-479c-a302-781e0c0b3835] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:24.640886 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd49683c-8285-4076-8394-e349410de525 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:24.642554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd49683c-8285-4076-8394-e349410de525 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:24.645503 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd49683c-8285-4076-8394-e349410de525 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:24.646757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04615137-abb9-49d7-b2f1-47aaf50556ca tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:24.647223 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04615137-abb9-49d7-b2f1-47aaf50556ca tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:24.648036 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04615137-abb9-49d7-b2f1-47aaf50556ca tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:24.648476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04615137-abb9-49d7-b2f1-47aaf50556ca tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:24.649079 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd49683c-8285-4076-8394-e349410de525 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:24.823517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=12 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:25.140201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-04615137-abb9-49d7-b2f1-47aaf50556ca tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1958cc5af89240e6b88ba2b13556230a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e2224745745edab22c1745cbfcf84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:25.150919 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-04615137-abb9-49d7-b2f1-47aaf50556ca tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835" status: 200 len: 1316 microversion: 2.1 time: 0.524942 Jul 25 12:48:25.152223 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1260/2438] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:24 2022] GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835 => generated 1316 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:25.258901 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bd49683c-8285-4076-8394-e349410de525 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:25.281528 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bd49683c-8285-4076-8394-e349410de525 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 200 len: 1324 microversion: 2.1 time: 0.674373 Jul 25 12:48:25.284518 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1179/2439] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:24 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 1324 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:26.175756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6d9e8188-3b09-4649-9e4a-d83bbc6e4e67 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:26.177499 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6d9e8188-3b09-4649-9e4a-d83bbc6e4e67 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] [instance: e7c1af33-c872-479c-a302-781e0c0b3835] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:26.208915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6d9e8188-3b09-4649-9e4a-d83bbc6e4e67 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:26.209588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6d9e8188-3b09-4649-9e4a-d83bbc6e4e67 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:26.210394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6d9e8188-3b09-4649-9e4a-d83bbc6e4e67 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:26.210840 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6d9e8188-3b09-4649-9e4a-d83bbc6e4e67 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:26.311516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ecd6e633-d9c6-4b9f-a8de-85f8e053cd8e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:26.312306 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ecd6e633-d9c6-4b9f-a8de-85f8e053cd8e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:26.340423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ecd6e633-d9c6-4b9f-a8de-85f8e053cd8e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:26.340884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ecd6e633-d9c6-4b9f-a8de-85f8e053cd8e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:26.341707 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ecd6e633-d9c6-4b9f-a8de-85f8e053cd8e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:26.352859 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ecd6e633-d9c6-4b9f-a8de-85f8e053cd8e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:26.769109 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6d9e8188-3b09-4649-9e4a-d83bbc6e4e67 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1958cc5af89240e6b88ba2b13556230a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e2224745745edab22c1745cbfcf84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:26.785594 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6d9e8188-3b09-4649-9e4a-d83bbc6e4e67 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835" status: 200 len: 1316 microversion: 2.1 time: 0.613874 Jul 25 12:48:26.802960 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1261/2440] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:26 2022] GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835 => generated 1316 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:26.877769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ecd6e633-d9c6-4b9f-a8de-85f8e053cd8e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:26.886746 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ecd6e633-d9c6-4b9f-a8de-85f8e053cd8e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 200 len: 1324 microversion: 2.1 time: 0.579205 Jul 25 12:48:26.890708 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1180/2441] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:26 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 1324 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:27.210161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d75902c3-f18b-44dd-857d-32e423e020de tempest-VolumesAdminNegativeTest-1472528604 tempest-VolumesAdminNegativeTest-1472528604-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "043b5d39-d859-4bce-ba5e-7f747f146cb1"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:27.219142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d75902c3-f18b-44dd-857d-32e423e020de tempest-VolumesAdminNegativeTest-1472528604 tempest-VolumesAdminNegativeTest-1472528604-project-admin] [instance: cd2e4e93-2db4-4b87-b159-a2b324ba4d20] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:27.250434 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d75902c3-f18b-44dd-857d-32e423e020de tempest-VolumesAdminNegativeTest-1472528604 tempest-VolumesAdminNegativeTest-1472528604-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:27.252895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d75902c3-f18b-44dd-857d-32e423e020de tempest-VolumesAdminNegativeTest-1472528604 tempest-VolumesAdminNegativeTest-1472528604-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:27.255646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d75902c3-f18b-44dd-857d-32e423e020de tempest-VolumesAdminNegativeTest-1472528604 tempest-VolumesAdminNegativeTest-1472528604-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:27.259211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d75902c3-f18b-44dd-857d-32e423e020de tempest-VolumesAdminNegativeTest-1472528604 tempest-VolumesAdminNegativeTest-1472528604-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:27.330957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-bb271866-3ce9-4f81-a294-79e7d84eb4ff req-57371e2a-38bf-4f41-8c82-49418404d6e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c1af33-c872-479c-a302-781e0c0b3835", "name": "network-vif-plugged", "status": "completed", "tag": "bda02458-c398-4d2f-ae84-acc4c4be0d21"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:27.363775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-bb271866-3ce9-4f81-a294-79e7d84eb4ff req-57371e2a-38bf-4f41-8c82-49418404d6e4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:27.364228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-bb271866-3ce9-4f81-a294-79e7d84eb4ff req-57371e2a-38bf-4f41-8c82-49418404d6e4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:27.398109 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-bb271866-3ce9-4f81-a294-79e7d84eb4ff req-57371e2a-38bf-4f41-8c82-49418404d6e4 service nova] Creating event network-vif-plugged:bda02458-c398-4d2f-ae84-acc4c4be0d21 for instance e7c1af33-c872-479c-a302-781e0c0b3835 on n-h2-848886-15 Jul 25 12:48:27.407342 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-d75902c3-f18b-44dd-857d-32e423e020de tempest-VolumesAdminNegativeTest-1472528604 tempest-VolumesAdminNegativeTest-1472528604-project-admin] HTTP exception thrown: Volume 5bc01569-c282-4104-babb-69a6e080683b could not be found. Jul 25 12:48:27.413087 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-bb271866-3ce9-4f81-a294-79e7d84eb4ff req-57371e2a-38bf-4f41-8c82-49418404d6e4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085776 Jul 25 12:48:27.414162 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1181/2442] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d75902c3-f18b-44dd-857d-32e423e020de tempest-VolumesAdminNegativeTest-1472528604 tempest-VolumesAdminNegativeTest-1472528604-project-admin] Request method failure captured: Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: request: PUT /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20/os-volume_attachments/5bc01569-c282-4104-babb-69a6e080683b HTTP/1.1 Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 74 Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pCleTHRrp_VXIAMcSlB1sxB0LSmHU0LNIZAT68ZZV5TnZmUTxMIKaUx8abRS0ubQvvH8dNJDkyaKh6-3aCjL9_eyySGY8as8VMEQ7VYhjYeZJ9FYYzkL6KXgEDgGy6S5wY41V9mD__ocPY7N-F7iPWbIefGfttxuMesepdZ_OfjNLo Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5ddd5a3033754bf6aa1df607a1a57e42 Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-VolumesAdminNegativeTest-1472528604 Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,admin,member Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,admin,member Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5ddd5a3033754bf6aa1df607a1a57e42", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5ddd5a3033754bf6aa1df607a1a57e42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5ddd5a3033754bf6aa1df607a1a57e42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5ddd5a3033754bf6aa1df607a1a57e42"}]}] Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-VolumesAdminNegativeTest-1472528604 Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5ddd5a3033754bf6aa1df607a1a57e42 Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1472528604 Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-VolumesAdminNegativeTest-1472528604-project-admin Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 3ed2d8c41de046a1b1005b79c298e2d9 Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-VolumesAdminNegativeTest-1472528604-project-admin Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: {"volumeAttachment": {"volumeId": "043b5d39-d859-4bce-ba5e-7f747f146cb1"}} Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: exception: Volume 5bc01569-c282-4104-babb-69a6e080683b could not be found. Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'server_id': 'cd2e4e93-2db4-4b87-b159-a2b324ba4d20', 'id': '5bc01569-c282-4104-babb-69a6e080683b', 'body': {'volumeAttachment': {'volumeId': '043b5d39-d859-4bce-ba5e-7f747f146cb1'}}} Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5bc01569-c282-4104-babb-69a6e080683b could not be found. (HTTP 404) (Request-ID: req-2b913728-8182-41a1-9b70-014d3f6ea95c) Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 12:48:27.415764 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5bc01569-c282-4104-babb-69a6e080683b could not be found. Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5bc01569-c282-4104-babb-69a6e080683b could not be found. Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5bc01569-c282-4104-babb-69a6e080683b could not be found. Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d75902c3-f18b-44dd-857d-32e423e020de tempest-VolumesAdminNegativeTest-1472528604 tempest-VolumesAdminNegativeTest-1472528604-project-admin] Returning 404 to user: Volume 5bc01569-c282-4104-babb-69a6e080683b could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d75902c3-f18b-44dd-857d-32e423e020de tempest-VolumesAdminNegativeTest-1472528604 tempest-VolumesAdminNegativeTest-1472528604-project-admin] 10.222.0.49 "PUT /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20/os-volume_attachments/5bc01569-c282-4104-babb-69a6e080683b" status: 404 len: 109 microversion: 2.1 time: 0.218181 Jul 25 12:48:27.419611 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1262/2443] 10.222.0.49 () {60 vars in 1433 bytes} [Mon Jul 25 12:48:27 2022] PUT /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20/os-volume_attachments/5bc01569-c282-4104-babb-69a6e080683b => generated 109 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:48:27.809759 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-79e23b32-d024-40a9-8d53-8f79ac06d2ca tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:27.810527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-79e23b32-d024-40a9-8d53-8f79ac06d2ca tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] [instance: e7c1af33-c872-479c-a302-781e0c0b3835] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:27.825373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79e23b32-d024-40a9-8d53-8f79ac06d2ca tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:27.828055 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79e23b32-d024-40a9-8d53-8f79ac06d2ca tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:27.832876 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79e23b32-d024-40a9-8d53-8f79ac06d2ca tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:27.834215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79e23b32-d024-40a9-8d53-8f79ac06d2ca tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:27.920969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1948ac45-52db-4ae5-8339-9c41aff1ce82 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:27.922070 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1948ac45-52db-4ae5-8339-9c41aff1ce82 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:27.938237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1948ac45-52db-4ae5-8339-9c41aff1ce82 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:27.946795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1948ac45-52db-4ae5-8339-9c41aff1ce82 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:27.948001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1948ac45-52db-4ae5-8339-9c41aff1ce82 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:27.953599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1948ac45-52db-4ae5-8339-9c41aff1ce82 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:28.276244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-79e23b32-d024-40a9-8d53-8f79ac06d2ca tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1958cc5af89240e6b88ba2b13556230a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e2224745745edab22c1745cbfcf84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:28.285739 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-79e23b32-d024-40a9-8d53-8f79ac06d2ca tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835" status: 200 len: 1316 microversion: 2.1 time: 0.480572 Jul 25 12:48:28.296162 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1182/2444] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:27 2022] GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835 => generated 1316 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:28.446071 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1948ac45-52db-4ae5-8339-9c41aff1ce82 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:28.454553 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1948ac45-52db-4ae5-8339-9c41aff1ce82 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 200 len: 1324 microversion: 2.1 time: 0.540334 Jul 25 12:48:28.456697 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1263/2445] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:27 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 1324 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:48:29.320362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-59edccfa-c0b8-4a7f-84a5-edc25400b253 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:29.321008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-59edccfa-c0b8-4a7f-84a5-edc25400b253 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] [instance: e7c1af33-c872-479c-a302-781e0c0b3835] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:29.349065 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59edccfa-c0b8-4a7f-84a5-edc25400b253 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:29.349647 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59edccfa-c0b8-4a7f-84a5-edc25400b253 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:29.350552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59edccfa-c0b8-4a7f-84a5-edc25400b253 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:29.350980 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59edccfa-c0b8-4a7f-84a5-edc25400b253 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:29.479356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7e9675e9-0854-44de-ae87-b924a004eceb tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:29.479982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7e9675e9-0854-44de-ae87-b924a004eceb tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:29.483905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:29.509319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e9675e9-0854-44de-ae87-b924a004eceb tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:29.509822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e9675e9-0854-44de-ae87-b924a004eceb tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:29.514579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e9675e9-0854-44de-ae87-b924a004eceb tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:29.515249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e9675e9-0854-44de-ae87-b924a004eceb tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:29.602813 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-59edccfa-c0b8-4a7f-84a5-edc25400b253 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1958cc5af89240e6b88ba2b13556230a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e2224745745edab22c1745cbfcf84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:29.615884 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-59edccfa-c0b8-4a7f-84a5-edc25400b253 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835" status: 200 len: 1504 microversion: 2.1 time: 0.308817 Jul 25 12:48:29.619480 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1183/2446] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:29 2022] GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835 => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:29.648004 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bd057af9-12fb-4116-9866-36fb0ca7f0a7 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:29.648868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bd057af9-12fb-4116-9866-36fb0ca7f0a7 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] [instance: e7c1af33-c872-479c-a302-781e0c0b3835] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:29.663578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd057af9-12fb-4116-9866-36fb0ca7f0a7 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:29.682314 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd057af9-12fb-4116-9866-36fb0ca7f0a7 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:29.684852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd057af9-12fb-4116-9866-36fb0ca7f0a7 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:29.685551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd057af9-12fb-4116-9866-36fb0ca7f0a7 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:29.780005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bd057af9-12fb-4116-9866-36fb0ca7f0a7 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] [instance: e7c1af33-c872-479c-a302-781e0c0b3835] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:48:29.966309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7e9675e9-0854-44de-ae87-b924a004eceb tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:29.974994 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7e9675e9-0854-44de-ae87-b924a004eceb tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 200 len: 1324 microversion: 2.1 time: 0.500946 Jul 25 12:48:29.981326 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1264/2447] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:29 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 1324 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:48:30.146878 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bd057af9-12fb-4116-9866-36fb0ca7f0a7 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835" status: 204 len: 0 microversion: 2.1 time: 0.508186 Jul 25 12:48:30.147507 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1184/2448] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:48:29 2022] DELETE /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:48:30.163213 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-825c49f6-0a3e-48f3-aa67-da02cbe319e8 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:30.165211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-825c49f6-0a3e-48f3-aa67-da02cbe319e8 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] [instance: e7c1af33-c872-479c-a302-781e0c0b3835] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:30.196533 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-825c49f6-0a3e-48f3-aa67-da02cbe319e8 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:30.196533 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-825c49f6-0a3e-48f3-aa67-da02cbe319e8 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:30.196533 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-825c49f6-0a3e-48f3-aa67-da02cbe319e8 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:30.196925 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-825c49f6-0a3e-48f3-aa67-da02cbe319e8 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:30.585372 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-825c49f6-0a3e-48f3-aa67-da02cbe319e8 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1958cc5af89240e6b88ba2b13556230a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e2224745745edab22c1745cbfcf84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:30.600801 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-825c49f6-0a3e-48f3-aa67-da02cbe319e8 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835" status: 200 len: 1510 microversion: 2.1 time: 0.447517 Jul 25 12:48:30.610678 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1185/2449] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:30 2022] GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835 => generated 1510 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:48:30.754967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0b3d283a-f050-4fd1-9b7d-5b005e69bef8 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-986202257", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "7d1be83b-0749-4f29-a888-d00c9f337335"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:30.891030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-0b3d283a-f050-4fd1-9b7d-5b005e69bef8 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] validate_networks() for [('7d1be83b-0749-4f29-a888-d00c9f337335', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:48:31.000521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-12347eaa-cd9b-41e2-93b7-f4ee5a2588d2 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:31.001150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-12347eaa-cd9b-41e2-93b7-f4ee5a2588d2 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:31.008964 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12347eaa-cd9b-41e2-93b7-f4ee5a2588d2 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:31.009434 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12347eaa-cd9b-41e2-93b7-f4ee5a2588d2 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:31.010270 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12347eaa-cd9b-41e2-93b7-f4ee5a2588d2 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:31.010712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12347eaa-cd9b-41e2-93b7-f4ee5a2588d2 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:31.396853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-12347eaa-cd9b-41e2-93b7-f4ee5a2588d2 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:31.407677 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-12347eaa-cd9b-41e2-93b7-f4ee5a2588d2 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 200 len: 1324 microversion: 2.1 time: 0.411399 Jul 25 12:48:31.424776 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1186/2450] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:30 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 1324 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:48:31.631606 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fb26782c-fc93-4039-8e36-ff0a17ae942b tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:31.633202 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fb26782c-fc93-4039-8e36-ff0a17ae942b tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] [instance: e7c1af33-c872-479c-a302-781e0c0b3835] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:31.660368 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb26782c-fc93-4039-8e36-ff0a17ae942b tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:31.664078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb26782c-fc93-4039-8e36-ff0a17ae942b tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:31.667495 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb26782c-fc93-4039-8e36-ff0a17ae942b tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:31.674635 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb26782c-fc93-4039-8e36-ff0a17ae942b tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:32.040347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-0b3d283a-f050-4fd1-9b7d-5b005e69bef8 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:48:32.041728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-0b3d283a-f050-4fd1-9b7d-5b005e69bef8 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:48:32.042481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-0b3d283a-f050-4fd1-9b7d-5b005e69bef8 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:48:32.043041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-0b3d283a-f050-4fd1-9b7d-5b005e69bef8 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:48:32.044058 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-0b3d283a-f050-4fd1-9b7d-5b005e69bef8 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:48:32.077136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b3d283a-f050-4fd1-9b7d-5b005e69bef8 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:32.078078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b3d283a-f050-4fd1-9b7d-5b005e69bef8 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:32.081416 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b3d283a-f050-4fd1-9b7d-5b005e69bef8 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:32.082080 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b3d283a-f050-4fd1-9b7d-5b005e69bef8 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:32.167763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-0b3d283a-f050-4fd1-9b7d-5b005e69bef8 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Getting quotas for project 777390f07e0c4d398c2a5916bc558ed2. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:48:32.186122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-0b3d283a-f050-4fd1-9b7d-5b005e69bef8 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Getting quotas for user 8245528326d34330ae7f790ef6b0b62b and project 777390f07e0c4d398c2a5916bc558ed2. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:48:32.211409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fb26782c-fc93-4039-8e36-ff0a17ae942b tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1958cc5af89240e6b88ba2b13556230a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e2224745745edab22c1745cbfcf84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:32.222166 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fb26782c-fc93-4039-8e36-ff0a17ae942b tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835" status: 200 len: 1510 microversion: 2.1 time: 0.594697 Jul 25 12:48:32.228448 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1187/2451] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:31 2022] GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835 => generated 1510 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:32.250734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7fd0ec64-e2a3-4a43-8e0e-17a8c6e7b1c3 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:32.255446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0b3d283a-f050-4fd1-9b7d-5b005e69bef8 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:48:32.260838 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0b3d283a-f050-4fd1-9b7d-5b005e69bef8 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:48:32.269844 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7fd0ec64-e2a3-4a43-8e0e-17a8c6e7b1c3 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b4c0e44f8964dec8564b4066656a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d373382a442ceb132f66c002517a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:32.270577 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7fd0ec64-e2a3-4a43-8e0e-17a8c6e7b1c3 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Searching by: {'deleted': False, 'project_id': '620d373382a442ceb132f66c002517a0'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 12:48:32.307384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7fd0ec64-e2a3-4a43-8e0e-17a8c6e7b1c3 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:32.313971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7fd0ec64-e2a3-4a43-8e0e-17a8c6e7b1c3 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:32.315194 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7fd0ec64-e2a3-4a43-8e0e-17a8c6e7b1c3 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:32.317154 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7fd0ec64-e2a3-4a43-8e0e-17a8c6e7b1c3 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:32.386604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-7fd0ec64-e2a3-4a43-8e0e-17a8c6e7b1c3 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 12:48:32.398364 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0b3d283a-f050-4fd1-9b7d-5b005e69bef8 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.415697 Jul 25 12:48:32.399118 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1265/2452] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:48:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:48:32.433351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ee95ff09-eaf4-48ef-a85d-a902a1bfd2e1 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:32.434236 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ee95ff09-eaf4-48ef-a85d-a902a1bfd2e1 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:32.468275 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7fd0ec64-e2a3-4a43-8e0e-17a8c6e7b1c3 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.232739 Jul 25 12:48:32.478432 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1188/2453] 10.222.0.49 () {58 vars in 1125 bytes} [Mon Jul 25 12:48:32 2022] GET /compute/v2.1/servers => generated 340 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:32.485634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b9b4ebf7-25ce-48d4-a04b-6c353865bfe5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:32.486986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b9b4ebf7-25ce-48d4-a04b-6c353865bfe5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:32.497554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b9b4ebf7-25ce-48d4-a04b-6c353865bfe5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:32.498800 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b9b4ebf7-25ce-48d4-a04b-6c353865bfe5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:32.500045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b9b4ebf7-25ce-48d4-a04b-6c353865bfe5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:32.500893 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b9b4ebf7-25ce-48d4-a04b-6c353865bfe5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:32.563126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ee95ff09-eaf4-48ef-a85d-a902a1bfd2e1 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:32.578427 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ee95ff09-eaf4-48ef-a85d-a902a1bfd2e1 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c" status: 200 len: 1223 microversion: 2.1 time: 0.165926 Jul 25 12:48:32.579350 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1266/2454] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:32 2022] GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c => generated 1223 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:32.584348 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-36609942-6fbf-4de0-9043-990c555acb5a tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:32.599071 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-36609942-6fbf-4de0-9043-990c555acb5a tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b4c0e44f8964dec8564b4066656a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d373382a442ceb132f66c002517a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:32.623153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-36609942-6fbf-4de0-9043-990c555acb5a tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Searching by: {'deleted': False, 'project_id': '620d373382a442ceb132f66c002517a0'} {{(pid=125884) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 12:48:32.633058 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36609942-6fbf-4de0-9043-990c555acb5a tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:32.633619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36609942-6fbf-4de0-9043-990c555acb5a tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:32.634392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36609942-6fbf-4de0-9043-990c555acb5a tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:32.634829 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36609942-6fbf-4de0-9043-990c555acb5a tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:32.752163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.multi_cell_list [None req-36609942-6fbf-4de0-9043-990c555acb5a tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 12:48:32.827615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b9b4ebf7-25ce-48d4-a04b-6c353865bfe5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:32.831560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-36609942-6fbf-4de0-9043-990c555acb5a tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4c0e44f8964dec8564b4066656a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d373382a442ceb132f66c002517a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:32.837272 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b9b4ebf7-25ce-48d4-a04b-6c353865bfe5 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 200 len: 1324 microversion: 2.1 time: 0.357206 Jul 25 12:48:32.837898 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1189/2455] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:32 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 1324 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:32.847053 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36609942-6fbf-4de0-9043-990c555acb5a tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:32.848473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36609942-6fbf-4de0-9043-990c555acb5a tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:33.261945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c94b6868-7c1b-4e27-9af6-37a8dd07d17a tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:33.262958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c94b6868-7c1b-4e27-9af6-37a8dd07d17a tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] [instance: e7c1af33-c872-479c-a302-781e0c0b3835] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:33.279075 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c94b6868-7c1b-4e27-9af6-37a8dd07d17a tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:33.292923 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c94b6868-7c1b-4e27-9af6-37a8dd07d17a tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:33.296664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c94b6868-7c1b-4e27-9af6-37a8dd07d17a tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:33.297390 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c94b6868-7c1b-4e27-9af6-37a8dd07d17a tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:33.301280 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-36609942-6fbf-4de0-9043-990c555acb5a tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 1713 microversion: 2.1 time: 0.720612 Jul 25 12:48:33.302098 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1267/2456] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:48:32 2022] GET /compute/v2.1/servers/detail => generated 1713 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:33.336310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4b324c6d-32c7-4c27-875e-d085dce5c166 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:33.360145 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4b324c6d-32c7-4c27-875e-d085dce5c166 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027836 Jul 25 12:48:33.371819 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1268/2457] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:48:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:48:33.479709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:33.520253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-17569da4-fa00-41d2-b708-58ae8ebb41d2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:33.520751 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-17569da4-fa00-41d2-b708-58ae8ebb41d2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: cd2e4e93-2db4-4b87-b159-a2b324ba4d20] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:33.542958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-17569da4-fa00-41d2-b708-58ae8ebb41d2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:33.543437 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-17569da4-fa00-41d2-b708-58ae8ebb41d2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:33.546054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-17569da4-fa00-41d2-b708-58ae8ebb41d2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:33.554350 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-17569da4-fa00-41d2-b708-58ae8ebb41d2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:33.655112 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-17569da4-fa00-41d2-b708-58ae8ebb41d2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: cd2e4e93-2db4-4b87-b159-a2b324ba4d20] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:48:33.754254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c94b6868-7c1b-4e27-9af6-37a8dd07d17a tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1958cc5af89240e6b88ba2b13556230a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e2224745745edab22c1745cbfcf84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:33.782165 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c94b6868-7c1b-4e27-9af6-37a8dd07d17a tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835" status: 200 len: 1468 microversion: 2.1 time: 0.522610 Jul 25 12:48:33.802918 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1190/2458] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:33 2022] GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835 => generated 1468 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:33.815873 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0a96b053-d022-450a-b4a9-7501e033a56e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:33.816853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0a96b053-d022-450a-b4a9-7501e033a56e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:33.826554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a96b053-d022-450a-b4a9-7501e033a56e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:33.827435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a96b053-d022-450a-b4a9-7501e033a56e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:33.828681 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a96b053-d022-450a-b4a9-7501e033a56e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:33.829976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a96b053-d022-450a-b4a9-7501e033a56e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:33.962576 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-17569da4-fa00-41d2-b708-58ae8ebb41d2 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20" status: 204 len: 0 microversion: 2.1 time: 0.445882 Jul 25 12:48:33.966322 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1269/2459] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:48:33 2022] DELETE /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 12:48:33.980509 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d1754b69-443b-45ae-a3bb-a231f2cdaca0 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:33.981793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d1754b69-443b-45ae-a3bb-a231f2cdaca0 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:33.986154 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0a96b053-d022-450a-b4a9-7501e033a56e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:34.001605 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0a96b053-d022-450a-b4a9-7501e033a56e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c" status: 200 len: 1227 microversion: 2.1 time: 0.193476 Jul 25 12:48:34.005001 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1191/2460] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:33 2022] GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c => generated 1227 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:34.024616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1754b69-443b-45ae-a3bb-a231f2cdaca0 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:34.026972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1754b69-443b-45ae-a3bb-a231f2cdaca0 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:34.028135 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-873572c5-4d8e-4026-8c0a-48d68487a3c4 req-1d142bf1-e58f-4308-ba8c-dd1a9aeca45d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c1af33-c872-479c-a302-781e0c0b3835", "name": "network-vif-deleted", "tag": "bda02458-c398-4d2f-ae84-acc4c4be0d21"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:34.032284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1754b69-443b-45ae-a3bb-a231f2cdaca0 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:34.035650 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1754b69-443b-45ae-a3bb-a231f2cdaca0 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:34.069262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-873572c5-4d8e-4026-8c0a-48d68487a3c4 req-1d142bf1-e58f-4308-ba8c-dd1a9aeca45d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:34.071563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-873572c5-4d8e-4026-8c0a-48d68487a3c4 req-1d142bf1-e58f-4308-ba8c-dd1a9aeca45d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:34.117041 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-873572c5-4d8e-4026-8c0a-48d68487a3c4 req-1d142bf1-e58f-4308-ba8c-dd1a9aeca45d service nova] Creating event network-vif-deleted:bda02458-c398-4d2f-ae84-acc4c4be0d21 for instance e7c1af33-c872-479c-a302-781e0c0b3835 on n-h2-848886-15 Jul 25 12:48:34.140705 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-873572c5-4d8e-4026-8c0a-48d68487a3c4 req-1d142bf1-e58f-4308-ba8c-dd1a9aeca45d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126983 Jul 25 12:48:34.146891 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1192/2461] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:34.157809 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d1754b69-443b-45ae-a3bb-a231f2cdaca0 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:48:34.187095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3da98705-8e48-4382-a8cd-1a19889d69e7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:34.188127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3da98705-8e48-4382-a8cd-1a19889d69e7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:34.209499 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3da98705-8e48-4382-a8cd-1a19889d69e7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:34.210003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3da98705-8e48-4382-a8cd-1a19889d69e7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:34.210811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3da98705-8e48-4382-a8cd-1a19889d69e7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:34.211258 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3da98705-8e48-4382-a8cd-1a19889d69e7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:34.376383 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d1754b69-443b-45ae-a3bb-a231f2cdaca0 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45" status: 204 len: 0 microversion: 2.1 time: 0.409385 Jul 25 12:48:34.382785 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1270/2462] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:48:33 2022] DELETE /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:48:34.402274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ec89379f-6d5d-4588-8329-c784c2a7fb2b tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:34.404183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ec89379f-6d5d-4588-8329-c784c2a7fb2b tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: cd2e4e93-2db4-4b87-b159-a2b324ba4d20] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:34.423211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ec89379f-6d5d-4588-8329-c784c2a7fb2b tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:34.426343 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ec89379f-6d5d-4588-8329-c784c2a7fb2b tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:34.427582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ec89379f-6d5d-4588-8329-c784c2a7fb2b tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:34.430830 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ec89379f-6d5d-4588-8329-c784c2a7fb2b tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:34.500278 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3da98705-8e48-4382-a8cd-1a19889d69e7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:34.531717 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3da98705-8e48-4382-a8cd-1a19889d69e7 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 200 len: 1324 microversion: 2.1 time: 0.381421 Jul 25 12:48:34.533098 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1193/2463] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:34 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 1324 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:34.754888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ec89379f-6d5d-4588-8329-c784c2a7fb2b tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8908d857fbae4fd49d6c8cd90529397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ce4c7d231540e29b9d66e0f8c276bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:34.769085 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ec89379f-6d5d-4588-8329-c784c2a7fb2b tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20" status: 200 len: 1513 microversion: 2.1 time: 0.384372 Jul 25 12:48:34.769817 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1271/2464] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:34 2022] GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20 => generated 1513 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:34.782228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d3f8e496-7242-46a9-ae3b-55a040a2364c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:34.783150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d3f8e496-7242-46a9-ae3b-55a040a2364c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:34.799388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3f8e496-7242-46a9-ae3b-55a040a2364c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:34.811161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3f8e496-7242-46a9-ae3b-55a040a2364c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:34.816779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3f8e496-7242-46a9-ae3b-55a040a2364c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:34.817496 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3f8e496-7242-46a9-ae3b-55a040a2364c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:34.846950 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-44333ef2-3ae8-4881-b353-841c6f4740f7 req-ffbf62be-352e-4b23-af88-c8ec6b8a680e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f12fbbe-fd19-45f7-8693-36f61bc9db41", "name": "network-vif-plugged", "status": "completed", "tag": "361d7d5d-0b94-47b3-84f7-dee57ebbfdaf"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:34.860829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-44333ef2-3ae8-4881-b353-841c6f4740f7 req-ffbf62be-352e-4b23-af88-c8ec6b8a680e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:34.861278 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-44333ef2-3ae8-4881-b353-841c6f4740f7 req-ffbf62be-352e-4b23-af88-c8ec6b8a680e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:34.894537 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-44333ef2-3ae8-4881-b353-841c6f4740f7 req-ffbf62be-352e-4b23-af88-c8ec6b8a680e service nova] Creating event network-vif-plugged:361d7d5d-0b94-47b3-84f7-dee57ebbfdaf for instance 3f12fbbe-fd19-45f7-8693-36f61bc9db41 on n-h2-848886-15 Jul 25 12:48:34.909128 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-44333ef2-3ae8-4881-b353-841c6f4740f7 req-ffbf62be-352e-4b23-af88-c8ec6b8a680e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.374011 Jul 25 12:48:34.910327 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1194/2465] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:34.916492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ea6bda0d-d06c-402c-912a-e652613d6ff8 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:34.917411 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ea6bda0d-d06c-402c-912a-e652613d6ff8 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] [instance: e7c1af33-c872-479c-a302-781e0c0b3835] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:34.931275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea6bda0d-d06c-402c-912a-e652613d6ff8 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:34.933685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea6bda0d-d06c-402c-912a-e652613d6ff8 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:34.935340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea6bda0d-d06c-402c-912a-e652613d6ff8 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:34.936417 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea6bda0d-d06c-402c-912a-e652613d6ff8 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:35.022224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea6bda0d-d06c-402c-912a-e652613d6ff8 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:35.022680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea6bda0d-d06c-402c-912a-e652613d6ff8 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:35.023155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-ea6bda0d-d06c-402c-912a-e652613d6ff8 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lazy-loading 'fault' on Instance uuid e7c1af33-c872-479c-a302-781e0c0b3835 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:48:35.087219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ea6bda0d-d06c-402c-912a-e652613d6ff8 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1958cc5af89240e6b88ba2b13556230a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e2224745745edab22c1745cbfcf84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:35.107088 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ea6bda0d-d06c-402c-912a-e652613d6ff8 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835" status: 200 len: 1306 microversion: 2.1 time: 0.195341 Jul 25 12:48:35.112705 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1195/2466] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:34 2022] GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835 => generated 1306 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:35.138610 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d37ef5f6-58e1-42d8-b63f-f96c4bc5a836 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:35.143673 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d37ef5f6-58e1-42d8-b63f-f96c4bc5a836 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:35.171835 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d37ef5f6-58e1-42d8-b63f-f96c4bc5a836 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:35.172300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d37ef5f6-58e1-42d8-b63f-f96c4bc5a836 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:35.173106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d37ef5f6-58e1-42d8-b63f-f96c4bc5a836 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:35.173601 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d37ef5f6-58e1-42d8-b63f-f96c4bc5a836 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:35.186487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d3f8e496-7242-46a9-ae3b-55a040a2364c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4c0e44f8964dec8564b4066656a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d373382a442ceb132f66c002517a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:35.201351 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d3f8e496-7242-46a9-ae3b-55a040a2364c tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45" status: 200 len: 1716 microversion: 2.1 time: 0.428104 Jul 25 12:48:35.208167 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1272/2467] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:34 2022] GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45 => generated 1716 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:35.269029 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d37ef5f6-58e1-42d8-b63f-f96c4bc5a836 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:35.281589 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d37ef5f6-58e1-42d8-b63f-f96c4bc5a836 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c" status: 200 len: 1219 microversion: 2.1 time: 0.155889 Jul 25 12:48:35.284403 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1196/2468] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:35 2022] GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c => generated 1219 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:35.554915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6081cd8c-d5ff-46ae-96ea-dbe4030d0f33 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:35.556384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6081cd8c-d5ff-46ae-96ea-dbe4030d0f33 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:35.569251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6081cd8c-d5ff-46ae-96ea-dbe4030d0f33 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:35.575917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6081cd8c-d5ff-46ae-96ea-dbe4030d0f33 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:35.577874 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6081cd8c-d5ff-46ae-96ea-dbe4030d0f33 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:35.578581 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6081cd8c-d5ff-46ae-96ea-dbe4030d0f33 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:35.639266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:35.796093 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f271586b-921f-4c84-8f1f-b673b9bf4b81 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:35.797665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f271586b-921f-4c84-8f1f-b673b9bf4b81 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: cd2e4e93-2db4-4b87-b159-a2b324ba4d20] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:35.806024 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f271586b-921f-4c84-8f1f-b673b9bf4b81 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:35.808227 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f271586b-921f-4c84-8f1f-b673b9bf4b81 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:35.811884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f271586b-921f-4c84-8f1f-b673b9bf4b81 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:35.812609 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f271586b-921f-4c84-8f1f-b673b9bf4b81 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:36.364097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6081cd8c-d5ff-46ae-96ea-dbe4030d0f33 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:36.378166 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6081cd8c-d5ff-46ae-96ea-dbe4030d0f33 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 200 len: 1324 microversion: 2.1 time: 0.827128 Jul 25 12:48:36.380603 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1273/2469] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:35 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 1324 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:36.393388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6cfa9b5a-6e0d-49c4-b46a-6114683be551 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:36.395230 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6cfa9b5a-6e0d-49c4-b46a-6114683be551 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] [instance: e7c1af33-c872-479c-a302-781e0c0b3835] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:36.412155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cfa9b5a-6e0d-49c4-b46a-6114683be551 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:36.412631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cfa9b5a-6e0d-49c4-b46a-6114683be551 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:36.415747 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cfa9b5a-6e0d-49c4-b46a-6114683be551 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:36.416675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cfa9b5a-6e0d-49c4-b46a-6114683be551 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:36.458118 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-6cfa9b5a-6e0d-49c4-b46a-6114683be551 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] HTTP exception thrown: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6cfa9b5a-6e0d-49c4-b46a-6114683be551 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Request method failure captured: Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835 HTTP/1.1 Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pEIUufPDhqu7IG7Iobv2pbxDTAT56WTAq7UwlAL5S8VhYx8yuDjvZ8oZ-HF_dfyCAiVC5LPfsH6zJeOdlrInayarnLaqk73U4wuJhGdVd5C20kuM90x75sKBZnVC4xJtvU7sazNwEpYJMdqXNp_g-envCIYPAtmW0EKZSvi2-KIetM Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: cb2e2224745745edab22c1745cbfcf84 Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesNegativeTestJSON-1580774301 Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb2e2224745745edab22c1745cbfcf84", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb2e2224745745edab22c1745cbfcf84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb2e2224745745edab22c1745cbfcf84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb2e2224745745edab22c1745cbfcf84"}]}] Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesNegativeTestJSON-1580774301 Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: cb2e2224745745edab22c1745cbfcf84 Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1580774301 Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesNegativeTestJSON-1580774301-project Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 1958cc5af89240e6b88ba2b13556230a Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesNegativeTestJSON-1580774301-project Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'e7c1af33-c872-479c-a302-781e0c0b3835'} Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:36.462929 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:36.467256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:36.467256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:36.467256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:36.467256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:48:36.467256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:48:36.467256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. Jul 25 12:48:36.467256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:36.467256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6cfa9b5a-6e0d-49c4-b46a-6114683be551 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Returning 404 to user: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:48:36.467256 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6cfa9b5a-6e0d-49c4-b46a-6114683be551 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835" status: 404 len: 111 microversion: 2.1 time: 0.082546 Jul 25 12:48:36.471530 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1274/2470] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:36 2022] GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:48:36.485656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7b8cc656-8eb4-462a-9aee-6e3b53b3032a tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:36.486504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7b8cc656-8eb4-462a-9aee-6e3b53b3032a tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:36.499745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7b8cc656-8eb4-462a-9aee-6e3b53b3032a tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:36.500204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7b8cc656-8eb4-462a-9aee-6e3b53b3032a tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:36.500988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7b8cc656-8eb4-462a-9aee-6e3b53b3032a tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:36.502036 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7b8cc656-8eb4-462a-9aee-6e3b53b3032a tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:36.926526 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f271586b-921f-4c84-8f1f-b673b9bf4b81 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8908d857fbae4fd49d6c8cd90529397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ce4c7d231540e29b9d66e0f8c276bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:36.937972 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f271586b-921f-4c84-8f1f-b673b9bf4b81 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20" status: 200 len: 1513 microversion: 2.1 time: 1.147591 Jul 25 12:48:36.938588 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1197/2471] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:35 2022] GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20 => generated 1513 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:37.003582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-af795f5b-4157-4c9c-9d03-1a3e360ea7be tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:37.005240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-af795f5b-4157-4c9c-9d03-1a3e360ea7be tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:37.020964 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af795f5b-4157-4c9c-9d03-1a3e360ea7be tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:37.036273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af795f5b-4157-4c9c-9d03-1a3e360ea7be tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:37.038499 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af795f5b-4157-4c9c-9d03-1a3e360ea7be tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:37.043530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af795f5b-4157-4c9c-9d03-1a3e360ea7be tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:37.070865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7b8cc656-8eb4-462a-9aee-6e3b53b3032a tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4c0e44f8964dec8564b4066656a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d373382a442ceb132f66c002517a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:37.093425 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7b8cc656-8eb4-462a-9aee-6e3b53b3032a tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45" status: 200 len: 1716 microversion: 2.1 time: 0.618755 Jul 25 12:48:37.096254 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1275/2472] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:36 2022] GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45 => generated 1716 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:37.115835 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c10bf6ab-a318-44b9-bd65-c44947a0578a tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-748513447", "metadata": {"image_type": "test"}}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:37.167253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c10bf6ab-a318-44b9-bd65-c44947a0578a tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] [instance: e7c1af33-c872-479c-a302-781e0c0b3835] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:37.190292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c10bf6ab-a318-44b9-bd65-c44947a0578a tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:37.193213 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c10bf6ab-a318-44b9-bd65-c44947a0578a tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:37.195539 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c10bf6ab-a318-44b9-bd65-c44947a0578a tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:37.197105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c10bf6ab-a318-44b9-bd65-c44947a0578a tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:37.231728 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-c10bf6ab-a318-44b9-bd65-c44947a0578a tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] HTTP exception thrown: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c10bf6ab-a318-44b9-bd65-c44947a0578a tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Request method failure captured: Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835/action HTTP/1.1 Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 111 Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pEIUufPDhqu7IG7Iobv2pbxDTAT56WTAq7UwlAL5S8VhYx8yuDjvZ8oZ-HF_dfyCAiVC5LPfsH6zJeOdlrInayarnLaqk73U4wuJhGdVd5C20kuM90x75sKBZnVC4xJtvU7sazNwEpYJMdqXNp_g-envCIYPAtmW0EKZSvi2-KIetM Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: cb2e2224745745edab22c1745cbfcf84 Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesNegativeTestJSON-1580774301 Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb2e2224745745edab22c1745cbfcf84", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb2e2224745745edab22c1745cbfcf84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb2e2224745745edab22c1745cbfcf84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb2e2224745745edab22c1745cbfcf84"}]}] Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesNegativeTestJSON-1580774301 Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: cb2e2224745745edab22c1745cbfcf84 Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1580774301 Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesNegativeTestJSON-1580774301-project Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 1958cc5af89240e6b88ba2b13556230a Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesNegativeTestJSON-1580774301-project Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-748513447", "metadata": {"image_type": "test"}}} Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'e7c1af33-c872-479c-a302-781e0c0b3835', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-748513447', 'metadata': {'image_type': 'test'}}}} Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 12:48:37.235153 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:48:37.239374 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:48:37.239374 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:48:37.239374 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:48:37.239374 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. Jul 25 12:48:37.239374 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.239374 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:37.239374 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.239374 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:37.239374 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:37.239374 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:37.239374 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:48:37.239374 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:48:37.239374 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. Jul 25 12:48:37.239374 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.242369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c10bf6ab-a318-44b9-bd65-c44947a0578a tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Returning 404 to user: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:48:37.244588 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c10bf6ab-a318-44b9-bd65-c44947a0578a tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "POST /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835/action" status: 404 len: 111 microversion: 2.1 time: 0.146055 Jul 25 12:48:37.246628 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1276/2473] 10.222.0.49 () {60 vars in 1279 bytes} [Mon Jul 25 12:48:37 2022] POST /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835/action => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:48:37.253585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-6703fae7-97c9-4e6f-8040-1cc5414b6510 req-2b35b7ee-a8a8-46ca-b9da-fd307b2797fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd2e4e93-2db4-4b87-b159-a2b324ba4d20", "name": "network-vif-deleted", "tag": "4c9a41d3-68ec-4cb7-a986-620aa344862d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:37.279141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6703fae7-97c9-4e6f-8040-1cc5414b6510 req-2b35b7ee-a8a8-46ca-b9da-fd307b2797fc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:37.281003 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6703fae7-97c9-4e6f-8040-1cc5414b6510 req-2b35b7ee-a8a8-46ca-b9da-fd307b2797fc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:37.299178 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-6703fae7-97c9-4e6f-8040-1cc5414b6510 req-2b35b7ee-a8a8-46ca-b9da-fd307b2797fc service nova] Creating event network-vif-deleted:4c9a41d3-68ec-4cb7-a986-620aa344862d for instance cd2e4e93-2db4-4b87-b159-a2b324ba4d20 on n-h1-848886-15 Jul 25 12:48:37.308396 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-6703fae7-97c9-4e6f-8040-1cc5414b6510 req-2b35b7ee-a8a8-46ca-b9da-fd307b2797fc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060283 Jul 25 12:48:37.310062 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1277/2474] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:37.318579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-668f0da5-7e51-4107-b4b0-f2fab88b20dd tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1088003429", "metadata": {"image_type": "test"}}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:37.322264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-668f0da5-7e51-4107-b4b0-f2fab88b20dd tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Failed to fetch instance by id tempest-invalid-1134616694 {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 12:48:37.323557 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-668f0da5-7e51-4107-b4b0-f2fab88b20dd tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] HTTP exception thrown: Instance tempest-invalid-1134616694 could not be found. Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-668f0da5-7e51-4107-b4b0-f2fab88b20dd tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Request method failure captured: Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/tempest-invalid-1134616694/action HTTP/1.1 Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 112 Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pEIUufPDhqu7IG7Iobv2pbxDTAT56WTAq7UwlAL5S8VhYx8yuDjvZ8oZ-HF_dfyCAiVC5LPfsH6zJeOdlrInayarnLaqk73U4wuJhGdVd5C20kuM90x75sKBZnVC4xJtvU7sazNwEpYJMdqXNp_g-envCIYPAtmW0EKZSvi2-KIetM Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: cb2e2224745745edab22c1745cbfcf84 Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesNegativeTestJSON-1580774301 Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb2e2224745745edab22c1745cbfcf84", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb2e2224745745edab22c1745cbfcf84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb2e2224745745edab22c1745cbfcf84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb2e2224745745edab22c1745cbfcf84"}]}] Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesNegativeTestJSON-1580774301 Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: cb2e2224745745edab22c1745cbfcf84 Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1580774301 Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesNegativeTestJSON-1580774301-project Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 1958cc5af89240e6b88ba2b13556230a Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesNegativeTestJSON-1580774301-project Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1088003429", "metadata": {"image_type": "test"}}} Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance tempest-invalid-1134616694 could not be found. Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'tempest-invalid-1134616694', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1088003429', 'metadata': {'image_type': 'test'}}}} Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1134616694 could not be found. Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:48:37.327082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1134616694 could not be found. Jul 25 12:48:37.332252 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.332252 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:37.332252 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.332252 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:37.332252 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:37.332252 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:37.332252 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:48:37.332252 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:48:37.332252 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1134616694 could not be found. Jul 25 12:48:37.332252 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.334812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-668f0da5-7e51-4107-b4b0-f2fab88b20dd tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Returning 404 to user: Instance tempest-invalid-1134616694 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:48:37.336451 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-668f0da5-7e51-4107-b4b0-f2fab88b20dd tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "POST /compute/v2.1/servers/tempest-invalid-1134616694/action" status: 404 len: 101 microversion: 2.1 time: 0.024565 Jul 25 12:48:37.338388 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1278/2475] 10.222.0.49 () {60 vars in 1249 bytes} [Mon Jul 25 12:48:37 2022] POST /compute/v2.1/servers/tempest-invalid-1134616694/action => generated 101 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:48:37.352151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-caeb97fd-0e31-4b2d-8bb2-968111b8723d tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1806855578"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:37.355418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-caeb97fd-0e31-4b2d-8bb2-968111b8723d tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 12:48:37.356248 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-caeb97fd-0e31-4b2d-8bb2-968111b8723d tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-caeb97fd-0e31-4b2d-8bb2-968111b8723d tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Request method failure captured: Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 57 Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pEIUufPDhqu7IG7Iobv2pbxDTAT56WTAq7UwlAL5S8VhYx8yuDjvZ8oZ-HF_dfyCAiVC5LPfsH6zJeOdlrInayarnLaqk73U4wuJhGdVd5C20kuM90x75sKBZnVC4xJtvU7sazNwEpYJMdqXNp_g-envCIYPAtmW0EKZSvi2-KIetM Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: cb2e2224745745edab22c1745cbfcf84 Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesNegativeTestJSON-1580774301 Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb2e2224745745edab22c1745cbfcf84", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb2e2224745745edab22c1745cbfcf84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb2e2224745745edab22c1745cbfcf84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb2e2224745745edab22c1745cbfcf84"}]}] Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesNegativeTestJSON-1580774301 Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: cb2e2224745745edab22c1745cbfcf84 Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1580774301 Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesNegativeTestJSON-1580774301-project Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 1958cc5af89240e6b88ba2b13556230a Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesNegativeTestJSON-1580774301-project Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: {"createImage": {"name": "tempest-test-snap-1806855578"}} Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1806855578'}}} Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 12:48:37.358478 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.363518 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:37.363518 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.363518 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:37.363518 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:37.363518 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:37.363518 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:48:37.363518 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:48:37.363518 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 12:48:37.363518 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.366030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-caeb97fd-0e31-4b2d-8bb2-968111b8723d tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:48:37.367448 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-caeb97fd-0e31-4b2d-8bb2-968111b8723d tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.023339 Jul 25 12:48:37.374540 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1279/2476] 10.222.0.49 () {60 vars in 1275 bytes} [Mon Jul 25 12:48:37 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:48:37.384945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9f0b790d-313b-47c3-a3aa-a3120ae6c3d3 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1269452602"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:37.388333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9f0b790d-313b-47c3-a3aa-a3120ae6c3d3 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 12:48:37.389330 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-9f0b790d-313b-47c3-a3aa-a3120ae6c3d3 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9f0b790d-313b-47c3-a3aa-a3120ae6c3d3 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Request method failure captured: Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 57 Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pEIUufPDhqu7IG7Iobv2pbxDTAT56WTAq7UwlAL5S8VhYx8yuDjvZ8oZ-HF_dfyCAiVC5LPfsH6zJeOdlrInayarnLaqk73U4wuJhGdVd5C20kuM90x75sKBZnVC4xJtvU7sazNwEpYJMdqXNp_g-envCIYPAtmW0EKZSvi2-KIetM Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: cb2e2224745745edab22c1745cbfcf84 Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesNegativeTestJSON-1580774301 Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb2e2224745745edab22c1745cbfcf84", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb2e2224745745edab22c1745cbfcf84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb2e2224745745edab22c1745cbfcf84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb2e2224745745edab22c1745cbfcf84"}]}] Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesNegativeTestJSON-1580774301 Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: cb2e2224745745edab22c1745cbfcf84 Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1580774301 Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesNegativeTestJSON-1580774301-project Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 1958cc5af89240e6b88ba2b13556230a Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesNegativeTestJSON-1580774301-project Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: {"createImage": {"name": "tempest-test-snap-1269452602"}} Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1269452602'}}} Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 12:48:37.391411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.396460 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:37.396460 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.396460 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:37.396460 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:37.396460 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:37.396460 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:48:37.396460 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:48:37.396460 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 12:48:37.396460 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.399764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9f0b790d-313b-47c3-a3aa-a3120ae6c3d3 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:48:37.401389 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9f0b790d-313b-47c3-a3aa-a3120ae6c3d3 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.024760 Jul 25 12:48:37.407001 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1280/2477] 10.222.0.49 () {60 vars in 1281 bytes} [Mon Jul 25 12:48:37 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:48:37.413566 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-04be29ac-ac33-4eb1-bf49-58ee0526e499 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:37.414733 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-04be29ac-ac33-4eb1-bf49-58ee0526e499 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:37.422672 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04be29ac-ac33-4eb1-bf49-58ee0526e499 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:37.423389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04be29ac-ac33-4eb1-bf49-58ee0526e499 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:37.424427 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04be29ac-ac33-4eb1-bf49-58ee0526e499 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:37.425066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04be29ac-ac33-4eb1-bf49-58ee0526e499 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:37.615275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-af795f5b-4157-4c9c-9d03-1a3e360ea7be tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:37.646879 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-af795f5b-4157-4c9c-9d03-1a3e360ea7be tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c" status: 200 len: 1281 microversion: 2.1 time: 0.656318 Jul 25 12:48:37.647620 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1198/2478] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:36 2022] GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c => generated 1281 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:37.654678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-90ad6736-f75b-4325-8692-89bf79220f17 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:37.656324 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-90ad6736-f75b-4325-8692-89bf79220f17 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] [instance: e7c1af33-c872-479c-a302-781e0c0b3835] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:37.669713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-90ad6736-f75b-4325-8692-89bf79220f17 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:37.670562 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-90ad6736-f75b-4325-8692-89bf79220f17 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:37.671643 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-90ad6736-f75b-4325-8692-89bf79220f17 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:37.672256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-90ad6736-f75b-4325-8692-89bf79220f17 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:37.687745 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-90ad6736-f75b-4325-8692-89bf79220f17 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] HTTP exception thrown: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-90ad6736-f75b-4325-8692-89bf79220f17 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Request method failure captured: Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835 HTTP/1.1 Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pEIUufPDhqu7IG7Iobv2pbxDTAT56WTAq7UwlAL5S8VhYx8yuDjvZ8oZ-HF_dfyCAiVC5LPfsH6zJeOdlrInayarnLaqk73U4wuJhGdVd5C20kuM90x75sKBZnVC4xJtvU7sazNwEpYJMdqXNp_g-envCIYPAtmW0EKZSvi2-KIetM Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: cb2e2224745745edab22c1745cbfcf84 Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ImagesNegativeTestJSON-1580774301 Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb2e2224745745edab22c1745cbfcf84", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb2e2224745745edab22c1745cbfcf84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb2e2224745745edab22c1745cbfcf84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb2e2224745745edab22c1745cbfcf84"}]}] Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ImagesNegativeTestJSON-1580774301 Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: cb2e2224745745edab22c1745cbfcf84 Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1580774301 Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ImagesNegativeTestJSON-1580774301-project Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 1958cc5af89240e6b88ba2b13556230a Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ImagesNegativeTestJSON-1580774301-project Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'e7c1af33-c872-479c-a302-781e0c0b3835'} Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:48:37.689501 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:48:37.693457 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. Jul 25 12:48:37.693457 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.693457 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:37.693457 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.693457 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:37.693457 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:37.693457 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:37.693457 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:48:37.693457 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:48:37.693457 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. Jul 25 12:48:37.693457 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.695012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-90ad6736-f75b-4325-8692-89bf79220f17 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Returning 404 to user: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:48:37.697478 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-90ad6736-f75b-4325-8692-89bf79220f17 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835" status: 404 len: 111 microversion: 2.1 time: 0.046407 Jul 25 12:48:37.702156 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1199/2479] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:48:37 2022] DELETE /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:48:37.707181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-29c33210-7770-4c48-a430-e582504554b6 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:37.707811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-29c33210-7770-4c48-a430-e582504554b6 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] [instance: e7c1af33-c872-479c-a302-781e0c0b3835] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:37.714344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29c33210-7770-4c48-a430-e582504554b6 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:37.714995 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29c33210-7770-4c48-a430-e582504554b6 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:37.715947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29c33210-7770-4c48-a430-e582504554b6 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:37.716544 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29c33210-7770-4c48-a430-e582504554b6 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:37.741041 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-29c33210-7770-4c48-a430-e582504554b6 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] HTTP exception thrown: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-29c33210-7770-4c48-a430-e582504554b6 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Request method failure captured: Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835 HTTP/1.1 Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pEIUufPDhqu7IG7Iobv2pbxDTAT56WTAq7UwlAL5S8VhYx8yuDjvZ8oZ-HF_dfyCAiVC5LPfsH6zJeOdlrInayarnLaqk73U4wuJhGdVd5C20kuM90x75sKBZnVC4xJtvU7sazNwEpYJMdqXNp_g-envCIYPAtmW0EKZSvi2-KIetM Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: cb2e2224745745edab22c1745cbfcf84 Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ImagesNegativeTestJSON-1580774301 Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb2e2224745745edab22c1745cbfcf84", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb2e2224745745edab22c1745cbfcf84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb2e2224745745edab22c1745cbfcf84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb2e2224745745edab22c1745cbfcf84"}]}] Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ImagesNegativeTestJSON-1580774301 Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: cb2e2224745745edab22c1745cbfcf84 Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1580774301 Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ImagesNegativeTestJSON-1580774301-project Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 1958cc5af89240e6b88ba2b13556230a Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ImagesNegativeTestJSON-1580774301-project Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'e7c1af33-c872-479c-a302-781e0c0b3835'} Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:37.744698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.748496 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:37.748496 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:37.748496 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:37.748496 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:48:37.748496 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:48:37.748496 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. Jul 25 12:48:37.748496 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:37.754327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-29c33210-7770-4c48-a430-e582504554b6 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] Returning 404 to user: Instance e7c1af33-c872-479c-a302-781e0c0b3835 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:48:37.756417 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-29c33210-7770-4c48-a430-e582504554b6 tempest-ImagesNegativeTestJSON-1580774301 tempest-ImagesNegativeTestJSON-1580774301-project] 10.222.0.49 "GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835" status: 404 len: 111 microversion: 2.1 time: 0.053209 Jul 25 12:48:37.759545 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1200/2480] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:37 2022] GET /compute/v2.1/servers/e7c1af33-c872-479c-a302-781e0c0b3835 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:48:37.961767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-77d609b6-b290-42d6-960e-b4bbc2404d44 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:37.963181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-77d609b6-b290-42d6-960e-b4bbc2404d44 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: cd2e4e93-2db4-4b87-b159-a2b324ba4d20] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:37.978483 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77d609b6-b290-42d6-960e-b4bbc2404d44 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:37.980184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77d609b6-b290-42d6-960e-b4bbc2404d44 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:37.981209 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77d609b6-b290-42d6-960e-b4bbc2404d44 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:37.981807 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77d609b6-b290-42d6-960e-b4bbc2404d44 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:37.999474 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-77d609b6-b290-42d6-960e-b4bbc2404d44 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] HTTP exception thrown: Instance cd2e4e93-2db4-4b87-b159-a2b324ba4d20 could not be found. Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-77d609b6-b290-42d6-960e-b4bbc2404d44 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Request method failure captured: Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20 HTTP/1.1 Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pCd4aZGikyA06WXwZH8YdlJBmsHTMLS-oy8Cqbmz--Fibn-p8REqU8S1dBRcmf3bs9Yx4KmjF_TZbgCpAlC64JxUIFl1QUezxDzbF1l-QfANJOu10ZyEjrvHQUwnFlczkyXY66MPU9c9zKJtBGH4uhxB18T1_Zw5H18LAtJQDRs1oE Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 63ce4c7d231540e29b9d66e0f8c276bb Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-VolumesAdminNegativeTest-1700900855 Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_63ce4c7d231540e29b9d66e0f8c276bb", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/63ce4c7d231540e29b9d66e0f8c276bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/63ce4c7d231540e29b9d66e0f8c276bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/63ce4c7d231540e29b9d66e0f8c276bb"}]}] Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-VolumesAdminNegativeTest-1700900855 Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 63ce4c7d231540e29b9d66e0f8c276bb Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1700900855 Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-VolumesAdminNegativeTest-1700900855-project Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8908d857fbae4fd49d6c8cd90529397b Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-VolumesAdminNegativeTest-1700900855-project Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance cd2e4e93-2db4-4b87-b159-a2b324ba4d20 could not be found. Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'cd2e4e93-2db4-4b87-b159-a2b324ba4d20'} Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd2e4e93-2db4-4b87-b159-a2b324ba4d20 could not be found. Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd2e4e93-2db4-4b87-b159-a2b324ba4d20 could not be found. Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:38.001342 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:38.005021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:38.005021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:38.005021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:38.005021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:48:38.005021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:48:38.005021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd2e4e93-2db4-4b87-b159-a2b324ba4d20 could not be found. Jul 25 12:48:38.005021 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:38.007170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-77d609b6-b290-42d6-960e-b4bbc2404d44 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Returning 404 to user: Instance cd2e4e93-2db4-4b87-b159-a2b324ba4d20 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:48:38.008362 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-77d609b6-b290-42d6-960e-b4bbc2404d44 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20" status: 404 len: 111 microversion: 2.1 time: 0.051194 Jul 25 12:48:38.009195 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1201/2481] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:37 2022] GET /compute/v2.1/servers/cd2e4e93-2db4-4b87-b159-a2b324ba4d20 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:48:38.063025 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-04be29ac-ac33-4eb1-bf49-58ee0526e499 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:38.077779 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-04be29ac-ac33-4eb1-bf49-58ee0526e499 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 200 len: 1522 microversion: 2.1 time: 0.668622 Jul 25 12:48:38.079906 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1281/2482] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:37 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 1522 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:38.118673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d97fc93c-a744-4dbe-bec7-d80b7e509d63 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:38.120184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cb33aec4-1f05-4880-822a-21cd96c21687 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:38.120971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cb33aec4-1f05-4880-822a-21cd96c21687 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:38.121127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d97fc93c-a744-4dbe-bec7-d80b7e509d63 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:38.146635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d97fc93c-a744-4dbe-bec7-d80b7e509d63 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:38.152338 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb33aec4-1f05-4880-822a-21cd96c21687 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:38.152748 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb33aec4-1f05-4880-822a-21cd96c21687 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:38.153539 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb33aec4-1f05-4880-822a-21cd96c21687 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:38.154142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb33aec4-1f05-4880-822a-21cd96c21687 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:38.156270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d97fc93c-a744-4dbe-bec7-d80b7e509d63 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:38.157667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d97fc93c-a744-4dbe-bec7-d80b7e509d63 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:38.160015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d97fc93c-a744-4dbe-bec7-d80b7e509d63 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:38.960387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d97fc93c-a744-4dbe-bec7-d80b7e509d63 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4c0e44f8964dec8564b4066656a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d373382a442ceb132f66c002517a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:38.978841 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d97fc93c-a744-4dbe-bec7-d80b7e509d63 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45" status: 200 len: 1648 microversion: 2.1 time: 0.861842 Jul 25 12:48:38.982815 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1282/2483] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:38 2022] GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45 => generated 1648 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:39.002718 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-596b88ab-dea2-4ee6-a576-35e7cfd3c5b7 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:39.003672 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-596b88ab-dea2-4ee6-a576-35e7cfd3c5b7 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:39.021074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-596b88ab-dea2-4ee6-a576-35e7cfd3c5b7 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:39.024745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-596b88ab-dea2-4ee6-a576-35e7cfd3c5b7 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:39.026910 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-596b88ab-dea2-4ee6-a576-35e7cfd3c5b7 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:39.029715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-596b88ab-dea2-4ee6-a576-35e7cfd3c5b7 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:39.845294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-596b88ab-dea2-4ee6-a576-35e7cfd3c5b7 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:39.858886 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-596b88ab-dea2-4ee6-a576-35e7cfd3c5b7 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c" status: 200 len: 1281 microversion: 2.1 time: 0.869839 Jul 25 12:48:39.878458 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1283/2484] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:38 2022] GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c => generated 1281 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:40.005037 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9e4a4ebe-20fe-444a-8c34-e6a5c346a807 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:40.005663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9e4a4ebe-20fe-444a-8c34-e6a5c346a807 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:40.014100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e4a4ebe-20fe-444a-8c34-e6a5c346a807 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:40.014571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e4a4ebe-20fe-444a-8c34-e6a5c346a807 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:40.015353 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e4a4ebe-20fe-444a-8c34-e6a5c346a807 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:40.015796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e4a4ebe-20fe-444a-8c34-e6a5c346a807 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:40.059403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cb33aec4-1f05-4880-822a-21cd96c21687 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:40.068641 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cb33aec4-1f05-4880-822a-21cd96c21687 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 200 len: 1522 microversion: 2.1 time: 1.960141 Jul 25 12:48:40.072906 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1202/2485] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:38 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 1522 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:40.095851 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-497b61fc-5171-4ef0-a142-3c2456f1923b tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-429007574"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:40.099012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-497b61fc-5171-4ef0-a142-3c2456f1923b tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:40.113153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-497b61fc-5171-4ef0-a142-3c2456f1923b tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:40.114315 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-497b61fc-5171-4ef0-a142-3c2456f1923b tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:40.115326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-497b61fc-5171-4ef0-a142-3c2456f1923b tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:40.118601 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-497b61fc-5171-4ef0-a142-3c2456f1923b tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:40.238674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9e4a4ebe-20fe-444a-8c34-e6a5c346a807 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4c0e44f8964dec8564b4066656a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d373382a442ceb132f66c002517a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:40.258742 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9e4a4ebe-20fe-444a-8c34-e6a5c346a807 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45" status: 200 len: 1648 microversion: 2.1 time: 0.257518 Jul 25 12:48:40.259360 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1284/2486] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:39 2022] GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45 => generated 1648 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:48:40.629577 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-497b61fc-5171-4ef0-a142-3c2456f1923b tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "POST /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41/action" status: 202 len: 0 microversion: 2.1 time: 0.538484 Jul 25 12:48:40.636394 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1203/2487] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:48:40 2022] POST /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 12:48:40.642711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0b5a0a5e-d5be-4c04-b9a5-48f10291aa61 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '.version_select at 0x7efcf91d6550>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:40.882369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f89a6bcb-d65b-43cd-b662-942dddb3b179 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:40.883423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f89a6bcb-d65b-43cd-b662-942dddb3b179 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:40.895472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f89a6bcb-d65b-43cd-b662-942dddb3b179 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:40.912395 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f89a6bcb-d65b-43cd-b662-942dddb3b179 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:40.913887 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f89a6bcb-d65b-43cd-b662-942dddb3b179 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:40.916146 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f89a6bcb-d65b-43cd-b662-942dddb3b179 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:40.980158 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0b5a0a5e-d5be-4c04-b9a5-48f10291aa61 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "DELETE /compute/v2.1/images/826826cb-5d37-4dfb-bfe6-7fc2953dfea3" status: 204 len: 0 microversion: 2.1 time: 0.342199 Jul 25 12:48:40.980747 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1285/2488] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:40 2022] DELETE /compute/v2.1/images/826826cb-5d37-4dfb-bfe6-7fc2953dfea3 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 12:48:40.990302 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c0abed84-f1f2-4023-9195-3886d1c6bb5a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '.version_select at 0x7efcfee87790>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:41.046576 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-c0abed84-f1f2-4023-9195-3886d1c6bb5a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] HTTP exception thrown: Image not found. Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c0abed84-f1f2-4023-9195-3886d1c6bb5a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Request method failure captured: Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/images/826826cb-5d37-4dfb-bfe6-7fc2953dfea3 HTTP/1.1 Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pDaiP1mn9moxuV0sEhHjcxs4YL6Wxk-LuBvL9sVonTARIUb0VcjcYQ7ntJp6sU09-7y0ZY4v6v4uSXBdkSQ_CiPsK7WXJf7MhcmeBPhydkepNAywcsaes9TYKg1Cs1S98mShfAYCBZemu8j0o07ISZt2oaK0_iQPi_CmMif6E2gpQ0 Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_35482ec73a054bafa24c83aea2b08636", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}] Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: bedadaad3cf44edb8fd8037aebd2ee25 Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: exception: Image not found. Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '826826cb-5d37-4dfb-bfe6-7fc2953dfea3'} Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 826826cb-5d37-4dfb-bfe6-7fc2953dfea3 Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 12:48:41.049000 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 826826cb-5d37-4dfb-bfe6-7fc2953dfea3 could not be found. Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 12:48:41.053408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:41.057339 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c0abed84-f1f2-4023-9195-3886d1c6bb5a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Returning 404 to user: Image not found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:48:41.058456 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c0abed84-f1f2-4023-9195-3886d1c6bb5a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/images/826826cb-5d37-4dfb-bfe6-7fc2953dfea3" status: 404 len: 62 microversion: 2.1 time: 0.072542 Jul 25 12:48:41.061465 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1286/2489] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:48:40 2022] GET /compute/v2.1/images/826826cb-5d37-4dfb-bfe6-7fc2953dfea3 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:48:41.090819 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7ee0320a-a519-46fb-8d7b-26e5d668ce2d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:41.091433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7ee0320a-a519-46fb-8d7b-26e5d668ce2d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:41.117028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ee0320a-a519-46fb-8d7b-26e5d668ce2d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:41.120490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ee0320a-a519-46fb-8d7b-26e5d668ce2d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:41.123940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ee0320a-a519-46fb-8d7b-26e5d668ce2d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:41.124902 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ee0320a-a519-46fb-8d7b-26e5d668ce2d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:41.612821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7ee0320a-a519-46fb-8d7b-26e5d668ce2d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:41.636516 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7ee0320a-a519-46fb-8d7b-26e5d668ce2d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 200 len: 1534 microversion: 2.1 time: 0.569702 Jul 25 12:48:41.646485 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1287/2490] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:41 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 1534 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:41.653865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-b2c9dbfe-16b3-4b38-8050-7fae28de1b7c req-fbdb6cfd-191e-4205-9576-b1ace7c1e6fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cad4f60e-6cce-41a5-8152-28e755601c45", "name": "network-vif-deleted", "tag": "561998ef-8060-4a06-a853-5c9a717c1b7f"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:41.666680 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b2c9dbfe-16b3-4b38-8050-7fae28de1b7c req-fbdb6cfd-191e-4205-9576-b1ace7c1e6fd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:41.667297 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b2c9dbfe-16b3-4b38-8050-7fae28de1b7c req-fbdb6cfd-191e-4205-9576-b1ace7c1e6fd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:41.682845 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-b2c9dbfe-16b3-4b38-8050-7fae28de1b7c req-fbdb6cfd-191e-4205-9576-b1ace7c1e6fd service nova] Creating event network-vif-deleted:561998ef-8060-4a06-a853-5c9a717c1b7f for instance cad4f60e-6cce-41a5-8152-28e755601c45 on n-h2-848886-15 Jul 25 12:48:41.692592 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-b2c9dbfe-16b3-4b38-8050-7fae28de1b7c req-fbdb6cfd-191e-4205-9576-b1ace7c1e6fd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043547 Jul 25 12:48:41.693709 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1288/2491] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:41.703659 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-157f1aee-55c7-4f86-b88b-281da7867fea tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:41.706738 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-157f1aee-55c7-4f86-b88b-281da7867fea tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:41.714944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-157f1aee-55c7-4f86-b88b-281da7867fea tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:41.715685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-157f1aee-55c7-4f86-b88b-281da7867fea tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:41.717075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-157f1aee-55c7-4f86-b88b-281da7867fea tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:41.718278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-157f1aee-55c7-4f86-b88b-281da7867fea tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:41.763593 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-157f1aee-55c7-4f86-b88b-281da7867fea tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:41.764275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-157f1aee-55c7-4f86-b88b-281da7867fea tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:41.764982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-157f1aee-55c7-4f86-b88b-281da7867fea tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lazy-loading 'fault' on Instance uuid cad4f60e-6cce-41a5-8152-28e755601c45 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:48:41.853247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-157f1aee-55c7-4f86-b88b-281da7867fea tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4c0e44f8964dec8564b4066656a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d373382a442ceb132f66c002517a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:41.877386 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-157f1aee-55c7-4f86-b88b-281da7867fea tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45" status: 200 len: 1367 microversion: 2.1 time: 0.181069 Jul 25 12:48:41.879204 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1289/2492] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:41 2022] GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:41.889650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f89a6bcb-d65b-43cd-b662-942dddb3b179 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:41.906847 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f89a6bcb-d65b-43cd-b662-942dddb3b179 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c" status: 200 len: 1323 microversion: 2.1 time: 1.029810 Jul 25 12:48:41.907766 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1204/2493] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:40 2022] GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c => generated 1323 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:42.554141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bc13a290-edb5-4aab-9494-959c983256a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-242604027", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1b6b78ea-34f8-4a68-bef9-56ece8230a86"}], "security_groups": [{"name": "tempest-securitygroup--1224401673"}], "key_name": "tempest-keypair-1414037427", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "3656958c-83d1-4b60-829e-9a54f7a42058", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:42.668028 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9cccb563-2794-48f5-9b54-42192dd1235d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:42.669030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9cccb563-2794-48f5-9b54-42192dd1235d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:42.690737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:42.701711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:42.704260 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9cccb563-2794-48f5-9b54-42192dd1235d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:42.711313 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9cccb563-2794-48f5-9b54-42192dd1235d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:42.712586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9cccb563-2794-48f5-9b54-42192dd1235d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:42.714297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9cccb563-2794-48f5-9b54-42192dd1235d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:42.823978 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=10 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:43.175606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-bc13a290-edb5-4aab-9494-959c983256a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] validate_networks() for [('1b6b78ea-34f8-4a68-bef9-56ece8230a86', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:48:43.713725 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9cccb563-2794-48f5-9b54-42192dd1235d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:43.733314 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9cccb563-2794-48f5-9b54-42192dd1235d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 200 len: 1540 microversion: 2.1 time: 1.068511 Jul 25 12:48:43.736070 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1205/2494] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:42 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 1540 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:48:43.752515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0890580e-67ea-4696-a2fb-b1d727812b12 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:43.754074 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0890580e-67ea-4696-a2fb-b1d727812b12 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] [instance: cad4f60e-6cce-41a5-8152-28e755601c45] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:43.772013 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0890580e-67ea-4696-a2fb-b1d727812b12 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:43.774675 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0890580e-67ea-4696-a2fb-b1d727812b12 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:43.777109 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0890580e-67ea-4696-a2fb-b1d727812b12 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:43.779247 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0890580e-67ea-4696-a2fb-b1d727812b12 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:43.825962 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-0890580e-67ea-4696-a2fb-b1d727812b12 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] HTTP exception thrown: Instance cad4f60e-6cce-41a5-8152-28e755601c45 could not be found. Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0890580e-67ea-4696-a2fb-b1d727812b12 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Request method failure captured: Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45 HTTP/1.1 Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDZfYdCvp9-7oFBIOSuAC15ZIOnJQUziiXVOTUvRXQITAdZANjidy_0TAr52dN2Xtr1t78f4BVZ1KXOCckmoF8nMhVsDLCn2BpSn8NSRLn_fyiU_6bfc3eFwyQIv7V_iEUcrxnKQ6p6TT5F9YIqxBBXZva0gTsXQ-LFr_zIYkE2wok Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 620d373382a442ceb132f66c002517a0 Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersTestManualDisk-1513859276 Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_620d373382a442ceb132f66c002517a0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/620d373382a442ceb132f66c002517a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/620d373382a442ceb132f66c002517a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/620d373382a442ceb132f66c002517a0"}]}] Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersTestManualDisk-1513859276 Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 620d373382a442ceb132f66c002517a0 Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersTestManualDisk-1513859276 Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersTestManualDisk-1513859276-project Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 7b4c0e44f8964dec8564b4066656a879 Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersTestManualDisk-1513859276-project Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance cad4f60e-6cce-41a5-8152-28e755601c45 could not be found. Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'cad4f60e-6cce-41a5-8152-28e755601c45'} Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cad4f60e-6cce-41a5-8152-28e755601c45 could not be found. Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cad4f60e-6cce-41a5-8152-28e755601c45 could not be found. Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:43.830805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:43.836187 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:43.836187 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:43.836187 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:43.836187 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:48:43.836187 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:48:43.836187 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cad4f60e-6cce-41a5-8152-28e755601c45 could not be found. Jul 25 12:48:43.836187 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:48:43.836187 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0890580e-67ea-4696-a2fb-b1d727812b12 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Returning 404 to user: Instance cad4f60e-6cce-41a5-8152-28e755601c45 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:48:43.840351 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0890580e-67ea-4696-a2fb-b1d727812b12 tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45" status: 404 len: 111 microversion: 2.1 time: 0.100756 Jul 25 12:48:43.846215 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1206/2495] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:43 2022] GET /compute/v2.1/servers/cad4f60e-6cce-41a5-8152-28e755601c45 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:48:43.895366 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-caf3bc0e-1d11-4c16-9ec8-4db886dc7b39 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:43.896607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-caf3bc0e-1d11-4c16-9ec8-4db886dc7b39 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:43.938922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-caf3bc0e-1d11-4c16-9ec8-4db886dc7b39 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:43.940372 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-caf3bc0e-1d11-4c16-9ec8-4db886dc7b39 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:43.942403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-caf3bc0e-1d11-4c16-9ec8-4db886dc7b39 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:43.943360 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-caf3bc0e-1d11-4c16-9ec8-4db886dc7b39 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:44.729570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-caf3bc0e-1d11-4c16-9ec8-4db886dc7b39 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:44.737931 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-caf3bc0e-1d11-4c16-9ec8-4db886dc7b39 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c" status: 200 len: 1323 microversion: 2.1 time: 0.863241 Jul 25 12:48:44.746230 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1207/2496] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:43 2022] GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c => generated 1323 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:44.752042 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b09ab21d-5610-41e1-9705-af99fd4f114f tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] Calling method '.version_select at 0x7efcf9009430>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:44.825431 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b09ab21d-5610-41e1-9705-af99fd4f114f tempest-ServersTestManualDisk-1513859276 tempest-ServersTestManualDisk-1513859276-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-934386481" status: 202 len: 0 microversion: 2.1 time: 0.076317 Jul 25 12:48:44.827284 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1208/2497] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Jul 25 12:48:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-934386481 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:48:44.874206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-0ba959b1-8ce2-4816-a99d-01ba772a929f req-9caf92d4-8d95-4f86-aae6-799de6ae9e9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3c4f646-aa62-4629-9c15-e57a9058a04c", "tag": "14a08691-36d3-4ae2-aa10-f18a2799fbb3"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:44.925442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0ba959b1-8ce2-4816-a99d-01ba772a929f req-9caf92d4-8d95-4f86-aae6-799de6ae9e9d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:44.937340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0ba959b1-8ce2-4816-a99d-01ba772a929f req-9caf92d4-8d95-4f86-aae6-799de6ae9e9d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:44.985706 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-0ba959b1-8ce2-4816-a99d-01ba772a929f req-9caf92d4-8d95-4f86-aae6-799de6ae9e9d service nova] Creating event network-changed:14a08691-36d3-4ae2-aa10-f18a2799fbb3 for instance d3c4f646-aa62-4629-9c15-e57a9058a04c on n-h1-848886-15 Jul 25 12:48:45.015425 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-0ba959b1-8ce2-4816-a99d-01ba772a929f req-9caf92d4-8d95-4f86-aae6-799de6ae9e9d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171682 Jul 25 12:48:45.016336 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1209/2498] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:45.022288 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-67a70553-0b07-4fa5-90db-2773086127ef tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:45.023001 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-67a70553-0b07-4fa5-90db-2773086127ef tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:45.041810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-67a70553-0b07-4fa5-90db-2773086127ef tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:45.042296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-67a70553-0b07-4fa5-90db-2773086127ef tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:45.043071 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-67a70553-0b07-4fa5-90db-2773086127ef tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:45.043710 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-67a70553-0b07-4fa5-90db-2773086127ef tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:45.308705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-bc13a290-edb5-4aab-9494-959c983256a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Getting quotas for project f088db318e364b5caf92d51ea9e5b562. Resources: dict_keys(['metadata_items']) {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:48:45.325756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-bc13a290-edb5-4aab-9494-959c983256a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Getting quotas for user dcae4341ba9e4cc0b93e00998c653d53 and project f088db318e364b5caf92d51ea9e5b562. Resources: dict_keys(['metadata_items']) {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:48:45.358245 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bc13a290-edb5-4aab-9494-959c983256a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:48:45.358680 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bc13a290-edb5-4aab-9494-959c983256a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:48:45.359166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bc13a290-edb5-4aab-9494-959c983256a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:48:45.364086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bc13a290-edb5-4aab-9494-959c983256a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:48:45.367176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bc13a290-edb5-4aab-9494-959c983256a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:48:45.387103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc13a290-edb5-4aab-9494-959c983256a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:45.388422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc13a290-edb5-4aab-9494-959c983256a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:45.389392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc13a290-edb5-4aab-9494-959c983256a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:45.390147 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc13a290-edb5-4aab-9494-959c983256a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:45.410603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-bc13a290-edb5-4aab-9494-959c983256a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Getting quotas for project f088db318e364b5caf92d51ea9e5b562. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:48:45.419661 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-bc13a290-edb5-4aab-9494-959c983256a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Getting quotas for user dcae4341ba9e4cc0b93e00998c653d53 and project f088db318e364b5caf92d51ea9e5b562. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:48:45.551344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bc13a290-edb5-4aab-9494-959c983256a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:48:45.553929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bc13a290-edb5-4aab-9494-959c983256a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3656958c-83d1-4b60-829e-9a54f7a42058',volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:48:45.618008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-67a70553-0b07-4fa5-90db-2773086127ef tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:45.620384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:45.636053 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-67a70553-0b07-4fa5-90db-2773086127ef tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 200 len: 1522 microversion: 2.1 time: 0.617929 Jul 25 12:48:45.636808 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1210/2499] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:45 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 1522 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:45.649136 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e55d8d27-3b99-4586-9bc4-42ecaca28657 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:45.654861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e55d8d27-3b99-4586-9bc4-42ecaca28657 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:45.664187 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e55d8d27-3b99-4586-9bc4-42ecaca28657 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:45.664875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e55d8d27-3b99-4586-9bc4-42ecaca28657 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:45.665573 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e55d8d27-3b99-4586-9bc4-42ecaca28657 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:45.666080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e55d8d27-3b99-4586-9bc4-42ecaca28657 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:45.729985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e55d8d27-3b99-4586-9bc4-42ecaca28657 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:48:45.846697 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bc13a290-edb5-4aab-9494-959c983256a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.293643 Jul 25 12:48:45.853336 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1290/2500] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:48:42 2022] POST /compute/v2.1/servers => generated 407 bytes in 3305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:48:45.868348 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-64f08919-ad15-469e-8d6c-21273435fd5f tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:45.873966 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-64f08919-ad15-469e-8d6c-21273435fd5f tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:45.907247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:45.911867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64f08919-ad15-469e-8d6c-21273435fd5f tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:45.914500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64f08919-ad15-469e-8d6c-21273435fd5f tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:45.915618 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64f08919-ad15-469e-8d6c-21273435fd5f tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:45.917989 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e55d8d27-3b99-4586-9bc4-42ecaca28657 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb" status: 204 len: 0 microversion: 2.1 time: 0.279963 Jul 25 12:48:45.919708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64f08919-ad15-469e-8d6c-21273435fd5f tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:45.920165 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1211/2501] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:48:45 2022] DELETE /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:48:45.939170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-26b1a53d-c609-440b-a1f9-3949ebd308df tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:45.944226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-26b1a53d-c609-440b-a1f9-3949ebd308df tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:45.958746 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26b1a53d-c609-440b-a1f9-3949ebd308df tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:45.959200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26b1a53d-c609-440b-a1f9-3949ebd308df tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:45.966395 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-64f08919-ad15-469e-8d6c-21273435fd5f tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:48:45.966539 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26b1a53d-c609-440b-a1f9-3949ebd308df tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:45.966915 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26b1a53d-c609-440b-a1f9-3949ebd308df tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:46.095216 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-64f08919-ad15-469e-8d6c-21273435fd5f tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 204 len: 0 microversion: 2.1 time: 0.239986 Jul 25 12:48:46.095775 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1291/2502] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:48:45 2022] DELETE /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:48:46.102346 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-5984f061-dbbc-46e0-b830-d6686c5a7346 req-6100e74c-abd3-48b1-9e90-ad32d2700e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f12fbbe-fd19-45f7-8693-36f61bc9db41", "name": "network-vif-plugged", "status": "completed", "tag": "361d7d5d-0b94-47b3-84f7-dee57ebbfdaf"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:46.114210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5984f061-dbbc-46e0-b830-d6686c5a7346 req-6100e74c-abd3-48b1-9e90-ad32d2700e73 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:46.114905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5984f061-dbbc-46e0-b830-d6686c5a7346 req-6100e74c-abd3-48b1-9e90-ad32d2700e73 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:46.129087 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-5984f061-dbbc-46e0-b830-d6686c5a7346 req-6100e74c-abd3-48b1-9e90-ad32d2700e73 service nova] Creating event network-vif-plugged:361d7d5d-0b94-47b3-84f7-dee57ebbfdaf for instance 3f12fbbe-fd19-45f7-8693-36f61bc9db41 on n-h2-848886-15 Jul 25 12:48:46.138526 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-5984f061-dbbc-46e0-b830-d6686c5a7346 req-6100e74c-abd3-48b1-9e90-ad32d2700e73 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040624 Jul 25 12:48:46.142653 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1292/2503] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:46.153707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5f3baf22-41ac-455a-9dc4-7c7c008396e5 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:46.157304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5f3baf22-41ac-455a-9dc4-7c7c008396e5 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:46.440771 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5f3baf22-41ac-455a-9dc4-7c7c008396e5 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:46.457121 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5f3baf22-41ac-455a-9dc4-7c7c008396e5 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1121 microversion: 2.1 time: 0.303662 Jul 25 12:48:46.458151 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1293/2504] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:46 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1121 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:46.463409 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a4e8dd53-bd8a-4f77-b894-b38a1664fe50 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:46.463883 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a4e8dd53-bd8a-4f77-b894-b38a1664fe50 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:46.482007 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4e8dd53-bd8a-4f77-b894-b38a1664fe50 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:46.482468 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4e8dd53-bd8a-4f77-b894-b38a1664fe50 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:46.483275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4e8dd53-bd8a-4f77-b894-b38a1664fe50 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:46.483770 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4e8dd53-bd8a-4f77-b894-b38a1664fe50 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:46.722945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-26b1a53d-c609-440b-a1f9-3949ebd308df tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:46.736637 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-26b1a53d-c609-440b-a1f9-3949ebd308df tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c" status: 200 len: 1323 microversion: 2.1 time: 0.813410 Jul 25 12:48:46.750995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a4e8dd53-bd8a-4f77-b894-b38a1664fe50 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8908d857fbae4fd49d6c8cd90529397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ce4c7d231540e29b9d66e0f8c276bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:46.755617 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1212/2505] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:45 2022] GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c => generated 1323 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:46.759685 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a4e8dd53-bd8a-4f77-b894-b38a1664fe50 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb" status: 200 len: 1679 microversion: 2.1 time: 0.300230 Jul 25 12:48:46.760298 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1294/2506] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:46 2022] GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb => generated 1679 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:46.763301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-920b8117-f9a7-472d-8986-3c337e688f89 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:46.764806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-920b8117-f9a7-472d-8986-3c337e688f89 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:46.773566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-920b8117-f9a7-472d-8986-3c337e688f89 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:46.774954 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-920b8117-f9a7-472d-8986-3c337e688f89 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:46.776685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-920b8117-f9a7-472d-8986-3c337e688f89 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:46.777337 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-920b8117-f9a7-472d-8986-3c337e688f89 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:47.359744 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-920b8117-f9a7-472d-8986-3c337e688f89 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:47.370013 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-920b8117-f9a7-472d-8986-3c337e688f89 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 200 len: 1528 microversion: 2.1 time: 0.612852 Jul 25 12:48:47.370822 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1213/2507] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:46 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 1528 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:47.483626 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-357aee9e-5c47-4774-b481-52e2b7021fd6 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:47.485556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-357aee9e-5c47-4774-b481-52e2b7021fd6 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:47.499282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-357aee9e-5c47-4774-b481-52e2b7021fd6 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:47.499821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-357aee9e-5c47-4774-b481-52e2b7021fd6 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:47.500917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-357aee9e-5c47-4774-b481-52e2b7021fd6 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:47.501675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-357aee9e-5c47-4774-b481-52e2b7021fd6 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:47.708401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-357aee9e-5c47-4774-b481-52e2b7021fd6 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:47.720547 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-357aee9e-5c47-4774-b481-52e2b7021fd6 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1163 microversion: 2.1 time: 0.244787 Jul 25 12:48:47.725018 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1295/2508] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:47 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1163 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:47.763902 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-edbd3e43-aae5-4eb6-a355-cf1c3a6e0c04 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:47.765246 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-edbd3e43-aae5-4eb6-a355-cf1c3a6e0c04 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:47.775385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:47.782057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9d9ccd36-8087-43b8-becf-84dde5e2dd18 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:47.782680 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9d9ccd36-8087-43b8-becf-84dde5e2dd18 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:47.787799 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-edbd3e43-aae5-4eb6-a355-cf1c3a6e0c04 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:47.788252 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-edbd3e43-aae5-4eb6-a355-cf1c3a6e0c04 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:47.791417 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-edbd3e43-aae5-4eb6-a355-cf1c3a6e0c04 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:47.793115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d9ccd36-8087-43b8-becf-84dde5e2dd18 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:47.793575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d9ccd36-8087-43b8-becf-84dde5e2dd18 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:47.794031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-edbd3e43-aae5-4eb6-a355-cf1c3a6e0c04 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:47.794397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d9ccd36-8087-43b8-becf-84dde5e2dd18 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:47.794839 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d9ccd36-8087-43b8-becf-84dde5e2dd18 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:48.380956 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9d9ccd36-8087-43b8-becf-84dde5e2dd18 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8908d857fbae4fd49d6c8cd90529397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ce4c7d231540e29b9d66e0f8c276bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:48.389406 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9d9ccd36-8087-43b8-becf-84dde5e2dd18 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb" status: 200 len: 1679 microversion: 2.1 time: 0.611620 Jul 25 12:48:48.395412 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1296/2509] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:47 2022] GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb => generated 1679 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:48.400575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e8ff7453-53a8-4d74-a08c-09b709fbd28d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:48.405946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e8ff7453-53a8-4d74-a08c-09b709fbd28d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:48.414942 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-edbd3e43-aae5-4eb6-a355-cf1c3a6e0c04 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:48.419344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8ff7453-53a8-4d74-a08c-09b709fbd28d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:48.419929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8ff7453-53a8-4d74-a08c-09b709fbd28d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:48.426841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8ff7453-53a8-4d74-a08c-09b709fbd28d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:48.427400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8ff7453-53a8-4d74-a08c-09b709fbd28d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:48.428755 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-edbd3e43-aae5-4eb6-a355-cf1c3a6e0c04 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c" status: 200 len: 1323 microversion: 2.1 time: 0.669489 Jul 25 12:48:48.439150 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1214/2510] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:47 2022] GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c => generated 1323 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:48.751223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7434c433-a1b9-49a7-8121-5a19542b051d tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:48.751223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7434c433-a1b9-49a7-8121-5a19542b051d tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:48.761536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7434c433-a1b9-49a7-8121-5a19542b051d tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:48.762241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7434c433-a1b9-49a7-8121-5a19542b051d tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:48.763194 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7434c433-a1b9-49a7-8121-5a19542b051d tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:48.763786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7434c433-a1b9-49a7-8121-5a19542b051d tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:49.060644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e8ff7453-53a8-4d74-a08c-09b709fbd28d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:49.070366 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e8ff7453-53a8-4d74-a08c-09b709fbd28d tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 200 len: 1528 microversion: 2.1 time: 0.673582 Jul 25 12:48:49.088580 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1297/2511] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:48 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 1528 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:49.168522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7434c433-a1b9-49a7-8121-5a19542b051d tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:49.180179 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7434c433-a1b9-49a7-8121-5a19542b051d tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1237 microversion: 2.1 time: 0.434331 Jul 25 12:48:49.184767 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1215/2512] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:48 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1237 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:48:49.419247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-408609c4-8bc6-4c8a-b6cd-d329f200085d tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:49.420134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-408609c4-8bc6-4c8a-b6cd-d329f200085d tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:49.428086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-408609c4-8bc6-4c8a-b6cd-d329f200085d tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:49.431386 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-408609c4-8bc6-4c8a-b6cd-d329f200085d tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:49.432206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-408609c4-8bc6-4c8a-b6cd-d329f200085d tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:49.432686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-408609c4-8bc6-4c8a-b6cd-d329f200085d tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:49.452949 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9fc5a9cb-95a7-43b5-94f4-a3a76bce165b tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:49.453869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9fc5a9cb-95a7-43b5-94f4-a3a76bce165b tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:49.463945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:49.466212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9fc5a9cb-95a7-43b5-94f4-a3a76bce165b tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:49.469527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9fc5a9cb-95a7-43b5-94f4-a3a76bce165b tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:49.491457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9fc5a9cb-95a7-43b5-94f4-a3a76bce165b tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:49.493445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9fc5a9cb-95a7-43b5-94f4-a3a76bce165b tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:49.671661 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-408609c4-8bc6-4c8a-b6cd-d329f200085d tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8908d857fbae4fd49d6c8cd90529397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ce4c7d231540e29b9d66e0f8c276bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:49.692065 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-408609c4-8bc6-4c8a-b6cd-d329f200085d tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb" status: 200 len: 1612 microversion: 2.1 time: 0.276616 Jul 25 12:48:49.694870 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1298/2513] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:49 2022] GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb => generated 1612 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:49.710066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-ca31ecd8-d3c1-4307-a122-42b800109036 req-5d48c30a-c137-4d1d-ad22-3d4451ecd80d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f12fbbe-fd19-45f7-8693-36f61bc9db41", "name": "network-vif-deleted", "tag": "361d7d5d-0b94-47b3-84f7-dee57ebbfdaf"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:49.738324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-ca31ecd8-d3c1-4307-a122-42b800109036 req-5d48c30a-c137-4d1d-ad22-3d4451ecd80d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:49.747927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-ca31ecd8-d3c1-4307-a122-42b800109036 req-5d48c30a-c137-4d1d-ad22-3d4451ecd80d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:49.817319 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-ca31ecd8-d3c1-4307-a122-42b800109036 req-5d48c30a-c137-4d1d-ad22-3d4451ecd80d service nova] Creating event network-vif-deleted:361d7d5d-0b94-47b3-84f7-dee57ebbfdaf for instance 3f12fbbe-fd19-45f7-8693-36f61bc9db41 on n-h2-848886-15 Jul 25 12:48:49.822760 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-ca31ecd8-d3c1-4307-a122-42b800109036 req-5d48c30a-c137-4d1d-ad22-3d4451ecd80d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125632 Jul 25 12:48:49.823497 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1299/2514] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:50.096858 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b996fe66-7ba4-4fe5-891e-4cbae1d85c65 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:50.098673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b996fe66-7ba4-4fe5-891e-4cbae1d85c65 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:50.146015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b996fe66-7ba4-4fe5-891e-4cbae1d85c65 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:50.147891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b996fe66-7ba4-4fe5-891e-4cbae1d85c65 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:50.151355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b996fe66-7ba4-4fe5-891e-4cbae1d85c65 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:50.151865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b996fe66-7ba4-4fe5-891e-4cbae1d85c65 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:50.300152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9fc5a9cb-95a7-43b5-94f4-a3a76bce165b tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:50.309771 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9fc5a9cb-95a7-43b5-94f4-a3a76bce165b tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c" status: 200 len: 1323 microversion: 2.1 time: 0.860869 Jul 25 12:48:50.317605 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1216/2515] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:49 2022] GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c => generated 1323 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:50.336120 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b996fe66-7ba4-4fe5-891e-4cbae1d85c65 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:50.337753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b996fe66-7ba4-4fe5-891e-4cbae1d85c65 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:50.338274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-b996fe66-7ba4-4fe5-891e-4cbae1d85c65 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lazy-loading 'fault' on Instance uuid 3f12fbbe-fd19-45f7-8693-36f61bc9db41 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:48:50.339335 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f18535ba-74da-474e-9f10-44a02c432501 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:50.340245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f18535ba-74da-474e-9f10-44a02c432501 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:50.359423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f18535ba-74da-474e-9f10-44a02c432501 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:50.363222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f18535ba-74da-474e-9f10-44a02c432501 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:50.365222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f18535ba-74da-474e-9f10-44a02c432501 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:50.370618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f18535ba-74da-474e-9f10-44a02c432501 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:50.603696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b996fe66-7ba4-4fe5-891e-4cbae1d85c65 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:50.614240 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b996fe66-7ba4-4fe5-891e-4cbae1d85c65 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 200 len: 1314 microversion: 2.1 time: 0.525235 Jul 25 12:48:50.620960 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1300/2516] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:50 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:50.717561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8c2d2e50-0dc8-4f14-962a-d603c1bd4d84 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:50.718698 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8c2d2e50-0dc8-4f14-962a-d603c1bd4d84 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:50.734543 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c2d2e50-0dc8-4f14-962a-d603c1bd4d84 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:50.736441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c2d2e50-0dc8-4f14-962a-d603c1bd4d84 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:50.738072 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c2d2e50-0dc8-4f14-962a-d603c1bd4d84 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:50.740917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c2d2e50-0dc8-4f14-962a-d603c1bd4d84 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:50.755720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f18535ba-74da-474e-9f10-44a02c432501 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:50.775900 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f18535ba-74da-474e-9f10-44a02c432501 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1237 microversion: 2.1 time: 0.445153 Jul 25 12:48:50.781959 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1217/2517] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:50 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1237 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:51.193113 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8c2d2e50-0dc8-4f14-962a-d603c1bd4d84 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8908d857fbae4fd49d6c8cd90529397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ce4c7d231540e29b9d66e0f8c276bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:51.203721 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8c2d2e50-0dc8-4f14-962a-d603c1bd4d84 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb" status: 200 len: 1612 microversion: 2.1 time: 0.490809 Jul 25 12:48:51.204336 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1301/2518] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:50 2022] GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb => generated 1612 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:51.352143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-9e9e090f-58de-4daa-84a7-f8579a493a84 req-58fc6a1c-6f3a-4ebf-96e5-fdd8942c4315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a09b0fac-fbdd-4e0d-83b5-4b0573183adb", "name": "network-vif-deleted", "tag": "fe424d38-2c55-446d-8969-95ae660f2f4f"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:51.388086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-9e9e090f-58de-4daa-84a7-f8579a493a84 req-58fc6a1c-6f3a-4ebf-96e5-fdd8942c4315 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:51.388639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-9e9e090f-58de-4daa-84a7-f8579a493a84 req-58fc6a1c-6f3a-4ebf-96e5-fdd8942c4315 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:51.416204 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-9e9e090f-58de-4daa-84a7-f8579a493a84 req-58fc6a1c-6f3a-4ebf-96e5-fdd8942c4315 service nova] Creating event network-vif-deleted:fe424d38-2c55-446d-8969-95ae660f2f4f for instance a09b0fac-fbdd-4e0d-83b5-4b0573183adb on n-h1-848886-15 Jul 25 12:48:51.429593 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-9e9e090f-58de-4daa-84a7-f8579a493a84 req-58fc6a1c-6f3a-4ebf-96e5-fdd8942c4315 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.643451 Jul 25 12:48:51.431846 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1218/2519] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:51.439972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3c081fa0-c671-413b-829f-3c6273bd5e10 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:51.440999 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3c081fa0-c671-413b-829f-3c6273bd5e10 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:51.449362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c081fa0-c671-413b-829f-3c6273bd5e10 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:51.450249 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c081fa0-c671-413b-829f-3c6273bd5e10 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:51.451696 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c081fa0-c671-413b-829f-3c6273bd5e10 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:51.452424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c081fa0-c671-413b-829f-3c6273bd5e10 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:51.735818 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1f41299d-1560-419a-addc-256b080946f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1283554142 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1283554142-project-admin] Calling method '.version_select at 0x7efcf91fb040>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:51.736712 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:48:51.736712 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:48:51.743033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f41299d-1560-419a-addc-256b080946f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1283554142 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1283554142-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:51.743504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f41299d-1560-419a-addc-256b080946f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1283554142 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1283554142-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:51.777246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f41299d-1560-419a-addc-256b080946f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1283554142 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1283554142-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:51.777702 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f41299d-1560-419a-addc-256b080946f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1283554142 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1283554142-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:51.813226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f41299d-1560-419a-addc-256b080946f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1283554142 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1283554142-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:51.818546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f41299d-1560-419a-addc-256b080946f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1283554142 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1283554142-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:51.829693 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1f41299d-1560-419a-addc-256b080946f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1283554142 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1283554142-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.624264 Jul 25 12:48:51.833897 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1302/2520] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:48:51 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:51.841952 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-baec7754-5444-4406-80c2-34c9a2f9d73e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:51.849077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-baec7754-5444-4406-80c2-34c9a2f9d73e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:51.860260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-baec7754-5444-4406-80c2-34c9a2f9d73e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:51.860712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-baec7754-5444-4406-80c2-34c9a2f9d73e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:51.861496 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-baec7754-5444-4406-80c2-34c9a2f9d73e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:51.867257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-baec7754-5444-4406-80c2-34c9a2f9d73e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:51.908917 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-baec7754-5444-4406-80c2-34c9a2f9d73e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] HTTP exception thrown: Instance 3f12fbbe-fd19-45f7-8693-36f61bc9db41 could not be found. Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-baec7754-5444-4406-80c2-34c9a2f9d73e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Request method failure captured: Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 HTTP/1.1 Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pDaiP1mn9moxuV0sEhHjcxs4YL6Wxk-LuBvL9sVonTARIUb0VcjcYQ7ntJp6sU09-7y0ZY4v6v4uSXBdkSQ_CiPsK7WXJf7MhcmeBPhydkepNAywcsaes9TYKg1Cs1S98mShfAYCBZemu8j0o07ISZt2oaK0_iQPi_CmMif6E2gpQ0 Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_35482ec73a054bafa24c83aea2b08636", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}] Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: bedadaad3cf44edb8fd8037aebd2ee25 Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 3f12fbbe-fd19-45f7-8693-36f61bc9db41 could not be found. Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '3f12fbbe-fd19-45f7-8693-36f61bc9db41'} Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f12fbbe-fd19-45f7-8693-36f61bc9db41 could not be found. Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f12fbbe-fd19-45f7-8693-36f61bc9db41 could not be found. Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:51.917446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:51.922198 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:51.922198 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:51.922198 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:51.922198 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:51.922198 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:48:51.922198 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:48:51.922198 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f12fbbe-fd19-45f7-8693-36f61bc9db41 could not be found. Jul 25 12:48:51.922198 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:51.922198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-baec7754-5444-4406-80c2-34c9a2f9d73e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Returning 404 to user: Instance 3f12fbbe-fd19-45f7-8693-36f61bc9db41 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:48:51.922198 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-baec7754-5444-4406-80c2-34c9a2f9d73e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 404 len: 111 microversion: 2.1 time: 0.081776 Jul 25 12:48:51.922198 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1303/2521] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:51 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:48:51.954287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a982cfb0-471c-4964-8ac3-3698a968b5a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:51.955017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a982cfb0-471c-4964-8ac3-3698a968b5a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:51.966591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a982cfb0-471c-4964-8ac3-3698a968b5a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:51.967227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a982cfb0-471c-4964-8ac3-3698a968b5a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:51.968035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a982cfb0-471c-4964-8ac3-3698a968b5a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:51.968473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a982cfb0-471c-4964-8ac3-3698a968b5a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:52.135503 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3c081fa0-c671-413b-829f-3c6273bd5e10 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:52.160954 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3c081fa0-c671-413b-829f-3c6273bd5e10 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c" status: 200 len: 1323 microversion: 2.1 time: 0.725944 Jul 25 12:48:52.164284 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1219/2522] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:51 2022] GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c => generated 1323 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:52.188560 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4cd89bd9-6555-4349-8c90-e2d9c41568cd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1279390636", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:52.310882 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-4cd89bd9-6555-4349-8c90-e2d9c41568cd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] validate_networks() for [('a6f54b0c-c351-4711-aa7a-a0f7f5852543', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:48:53.223791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a982cfb0-471c-4964-8ac3-3698a968b5a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:53.241192 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a982cfb0-471c-4964-8ac3-3698a968b5a9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1305 microversion: 2.1 time: 1.294741 Jul 25 12:48:53.242697 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1304/2523] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:51 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1305 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:53.251098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-346113c0-802e-400e-b7ad-5a5ee5670cb8 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:53.258352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-346113c0-802e-400e-b7ad-5a5ee5670cb8 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] [instance: a09b0fac-fbdd-4e0d-83b5-4b0573183adb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:53.273432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-346113c0-802e-400e-b7ad-5a5ee5670cb8 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:53.277184 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-346113c0-802e-400e-b7ad-5a5ee5670cb8 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:53.278484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-346113c0-802e-400e-b7ad-5a5ee5670cb8 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:53.279150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-346113c0-802e-400e-b7ad-5a5ee5670cb8 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:53.299177 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-346113c0-802e-400e-b7ad-5a5ee5670cb8 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] HTTP exception thrown: Instance a09b0fac-fbdd-4e0d-83b5-4b0573183adb could not be found. Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-346113c0-802e-400e-b7ad-5a5ee5670cb8 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Request method failure captured: Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb HTTP/1.1 Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pCd4aZGikyA06WXwZH8YdlJBmsHTMLS-oy8Cqbmz--Fibn-p8REqU8S1dBRcmf3bs9Yx4KmjF_TZbgCpAlC64JxUIFl1QUezxDzbF1l-QfANJOu10ZyEjrvHQUwnFlczkyXY66MPU9c9zKJtBGH4uhxB18T1_Zw5H18LAtJQDRs1oE Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 63ce4c7d231540e29b9d66e0f8c276bb Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-VolumesAdminNegativeTest-1700900855 Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_63ce4c7d231540e29b9d66e0f8c276bb", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/63ce4c7d231540e29b9d66e0f8c276bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/63ce4c7d231540e29b9d66e0f8c276bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/63ce4c7d231540e29b9d66e0f8c276bb"}]}] Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-VolumesAdminNegativeTest-1700900855 Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 63ce4c7d231540e29b9d66e0f8c276bb Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1700900855 Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-VolumesAdminNegativeTest-1700900855-project Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 8908d857fbae4fd49d6c8cd90529397b Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-VolumesAdminNegativeTest-1700900855-project Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance a09b0fac-fbdd-4e0d-83b5-4b0573183adb could not be found. Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'a09b0fac-fbdd-4e0d-83b5-4b0573183adb'} Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a09b0fac-fbdd-4e0d-83b5-4b0573183adb could not be found. Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a09b0fac-fbdd-4e0d-83b5-4b0573183adb could not be found. Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:53.301519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:53.305433 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:53.305433 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:53.305433 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:53.305433 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:48:53.305433 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:48:53.305433 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a09b0fac-fbdd-4e0d-83b5-4b0573183adb could not be found. Jul 25 12:48:53.305433 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:48:53.307459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-346113c0-802e-400e-b7ad-5a5ee5670cb8 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Returning 404 to user: Instance a09b0fac-fbdd-4e0d-83b5-4b0573183adb could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:48:53.308952 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-346113c0-802e-400e-b7ad-5a5ee5670cb8 tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb" status: 404 len: 111 microversion: 2.1 time: 0.061899 Jul 25 12:48:53.313103 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1305/2524] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:53 2022] GET /compute/v2.1/servers/a09b0fac-fbdd-4e0d-83b5-4b0573183adb => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:48:53.320625 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-73aaa5e0-7219-4a5c-a130-89d312e16a81 req-a5007458-816f-47f9-89db-bda657f12e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c4f646-aa62-4629-9c15-e57a9058a04c", "name": "network-vif-plugged", "status": "completed", "tag": "14a08691-36d3-4ae2-aa10-f18a2799fbb3"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:53.333686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-73aaa5e0-7219-4a5c-a130-89d312e16a81 req-a5007458-816f-47f9-89db-bda657f12e39 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:53.335676 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-73aaa5e0-7219-4a5c-a130-89d312e16a81 req-a5007458-816f-47f9-89db-bda657f12e39 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:53.376561 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-73aaa5e0-7219-4a5c-a130-89d312e16a81 req-a5007458-816f-47f9-89db-bda657f12e39 service nova] Creating event network-vif-plugged:14a08691-36d3-4ae2-aa10-f18a2799fbb3 for instance d3c4f646-aa62-4629-9c15-e57a9058a04c on n-h1-848886-15 Jul 25 12:48:53.413630 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-73aaa5e0-7219-4a5c-a130-89d312e16a81 req-a5007458-816f-47f9-89db-bda657f12e39 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094033 Jul 25 12:48:53.414401 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1306/2525] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:53.434245 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1125053e-9fd6-402f-818c-c35cc0205ef7 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:53.436236 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1125053e-9fd6-402f-818c-c35cc0205ef7 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:53.460496 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1125053e-9fd6-402f-818c-c35cc0205ef7 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:53.461351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1125053e-9fd6-402f-818c-c35cc0205ef7 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:53.462448 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1125053e-9fd6-402f-818c-c35cc0205ef7 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:53.463228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1125053e-9fd6-402f-818c-c35cc0205ef7 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:54.579101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1125053e-9fd6-402f-818c-c35cc0205ef7 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:54.598934 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1125053e-9fd6-402f-818c-c35cc0205ef7 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c" status: 200 len: 1323 microversion: 2.1 time: 1.177504 Jul 25 12:48:54.613924 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1307/2526] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:53 2022] GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c => generated 1323 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:54.633071 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-37e0514d-5923-4fab-ad63-ffdcde66e8ee tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] Calling method '.version_select at 0x7efcf91d6820>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:54.703334 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-37e0514d-5923-4fab-ad63-ffdcde66e8ee tempest-VolumesAdminNegativeTest-1700900855 tempest-VolumesAdminNegativeTest-1700900855-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1848458293" status: 202 len: 0 microversion: 2.1 time: 0.094935 Jul 25 12:48:54.704477 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1308/2527] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Jul 25 12:48:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1848458293 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:48:54.722225 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0d31b20e-62af-4c37-99a0-0ec4dbfa5674 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:54.722886 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0d31b20e-62af-4c37-99a0-0ec4dbfa5674 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:54.772364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d31b20e-62af-4c37-99a0-0ec4dbfa5674 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:54.772834 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d31b20e-62af-4c37-99a0-0ec4dbfa5674 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:54.780936 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d31b20e-62af-4c37-99a0-0ec4dbfa5674 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:54.781409 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d31b20e-62af-4c37-99a0-0ec4dbfa5674 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:55.012274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4cd89bd9-6555-4349-8c90-e2d9c41568cd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:48:55.014598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4cd89bd9-6555-4349-8c90-e2d9c41568cd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:48:55.015370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4cd89bd9-6555-4349-8c90-e2d9c41568cd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:48:55.018110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4cd89bd9-6555-4349-8c90-e2d9c41568cd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:48:55.020058 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4cd89bd9-6555-4349-8c90-e2d9c41568cd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:48:55.046159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4cd89bd9-6555-4349-8c90-e2d9c41568cd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:55.046992 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4cd89bd9-6555-4349-8c90-e2d9c41568cd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:55.048777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4cd89bd9-6555-4349-8c90-e2d9c41568cd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:55.050317 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4cd89bd9-6555-4349-8c90-e2d9c41568cd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:55.137467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-4cd89bd9-6555-4349-8c90-e2d9c41568cd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Getting quotas for project 35482ec73a054bafa24c83aea2b08636. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:48:55.142534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0d31b20e-62af-4c37-99a0-0ec4dbfa5674 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:55.152338 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0d31b20e-62af-4c37-99a0-0ec4dbfa5674 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1305 microversion: 2.1 time: 0.446603 Jul 25 12:48:55.155222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-4cd89bd9-6555-4349-8c90-e2d9c41568cd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Getting quotas for user bedadaad3cf44edb8fd8037aebd2ee25 and project 35482ec73a054bafa24c83aea2b08636. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:48:55.157663 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1309/2528] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:54 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1305 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:55.195292 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4cd89bd9-6555-4349-8c90-e2d9c41568cd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:48:55.197759 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4cd89bd9-6555-4349-8c90-e2d9c41568cd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 1782b8c1-8224-4c76-93ac-932362b12672] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:48:55.318627 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4cd89bd9-6555-4349-8c90-e2d9c41568cd tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.150677 Jul 25 12:48:55.325570 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1220/2529] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:48:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 3160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:48:55.331794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-79a82dd9-651a-4697-8eb0-b37f9a5c2851 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:55.332476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-79a82dd9-651a-4697-8eb0-b37f9a5c2851 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 1782b8c1-8224-4c76-93ac-932362b12672] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:55.399466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:55.461447 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-79a82dd9-651a-4697-8eb0-b37f9a5c2851 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:55.473969 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-79a82dd9-651a-4697-8eb0-b37f9a5c2851 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672" status: 200 len: 1225 microversion: 2.1 time: 0.146466 Jul 25 12:48:55.476234 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1310/2530] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:55 2022] GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672 => generated 1225 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:48:55.627830 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b5650824-3096-404a-bfc2-f3d3ece710d4 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:55.628448 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b5650824-3096-404a-bfc2-f3d3ece710d4 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:55.646770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b5650824-3096-404a-bfc2-f3d3ece710d4 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:55.647192 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b5650824-3096-404a-bfc2-f3d3ece710d4 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:55.647990 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b5650824-3096-404a-bfc2-f3d3ece710d4 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:55.648425 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b5650824-3096-404a-bfc2-f3d3ece710d4 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:56.104195 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b5650824-3096-404a-bfc2-f3d3ece710d4 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:56.130942 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b5650824-3096-404a-bfc2-f3d3ece710d4 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c" status: 200 len: 1519 microversion: 2.1 time: 0.502939 Jul 25 12:48:56.134047 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1221/2531] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:55 2022] GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c => generated 1519 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:56.178143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cf75c6c7-9366-418e-b02b-d2686ea33c8c tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:56.179044 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cf75c6c7-9366-418e-b02b-d2686ea33c8c tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:56.191761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-286c63ce-dac8-4247-8549-a9eee3f860c4 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Action: 'create', calling method: .version_select at 0x7efcf917b310>, body: {"pool": null} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:56.196198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf75c6c7-9366-418e-b02b-d2686ea33c8c tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:56.196659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf75c6c7-9366-418e-b02b-d2686ea33c8c tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:56.203079 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf75c6c7-9366-418e-b02b-d2686ea33c8c tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:56.203752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf75c6c7-9366-418e-b02b-d2686ea33c8c tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:57.546195 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cf75c6c7-9366-418e-b02b-d2686ea33c8c tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:57.558781 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cf75c6c7-9366-418e-b02b-d2686ea33c8c tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1305 microversion: 2.1 time: 1.384975 Jul 25 12:48:57.563948 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1222/2532] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:56 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1305 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:57.572073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-de35ee22-706f-4605-9d61-e9a36e4f7c6c req-6f0a22bd-8c47-4976-9da0-bcc23587387f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a467b47-ccc6-4656-aefe-48797aab42b4", "tag": "a717f19c-082c-42c4-9467-fd733519794a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:57.591341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-de35ee22-706f-4605-9d61-e9a36e4f7c6c req-6f0a22bd-8c47-4976-9da0-bcc23587387f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:57.592008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-de35ee22-706f-4605-9d61-e9a36e4f7c6c req-6f0a22bd-8c47-4976-9da0-bcc23587387f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:57.608912 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-de35ee22-706f-4605-9d61-e9a36e4f7c6c req-6f0a22bd-8c47-4976-9da0-bcc23587387f service nova] Creating event network-changed:a717f19c-082c-42c4-9467-fd733519794a for instance 3a467b47-ccc6-4656-aefe-48797aab42b4 on n-h2-848886-15 Jul 25 12:48:57.614527 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-de35ee22-706f-4605-9d61-e9a36e4f7c6c req-6f0a22bd-8c47-4976-9da0-bcc23587387f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048889 Jul 25 12:48:57.615490 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1223/2533] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:57.621284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bc60f113-3421-46aa-935d-d549be5ab5de tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:57.623166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bc60f113-3421-46aa-935d-d549be5ab5de tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 1782b8c1-8224-4c76-93ac-932362b12672] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:57.637541 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc60f113-3421-46aa-935d-d549be5ab5de tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:57.640388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc60f113-3421-46aa-935d-d549be5ab5de tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:57.641402 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc60f113-3421-46aa-935d-d549be5ab5de tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:57.644586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc60f113-3421-46aa-935d-d549be5ab5de tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:57.863531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bc60f113-3421-46aa-935d-d549be5ab5de tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:57.877086 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bc60f113-3421-46aa-935d-d549be5ab5de tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672" status: 200 len: 1283 microversion: 2.1 time: 0.260339 Jul 25 12:48:57.889970 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1224/2534] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:57 2022] GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672 => generated 1283 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:58.583532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3de1d896-8b41-4d31-9dac-96ab8d4c90f0 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:58.584811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3de1d896-8b41-4d31-9dac-96ab8d4c90f0 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:58.599674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3de1d896-8b41-4d31-9dac-96ab8d4c90f0 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:58.600139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3de1d896-8b41-4d31-9dac-96ab8d4c90f0 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:58.600998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3de1d896-8b41-4d31-9dac-96ab8d4c90f0 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:58.601442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3de1d896-8b41-4d31-9dac-96ab8d4c90f0 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:59.134962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3de1d896-8b41-4d31-9dac-96ab8d4c90f0 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:59.147359 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3de1d896-8b41-4d31-9dac-96ab8d4c90f0 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1305 microversion: 2.1 time: 0.567507 Jul 25 12:48:59.148380 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1225/2535] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:58 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1305 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:59.166671 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-022fef21-a4ae-4334-9cc4-452c61471b8e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:59.167299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-022fef21-a4ae-4334-9cc4-452c61471b8e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 1782b8c1-8224-4c76-93ac-932362b12672] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:59.174226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-022fef21-a4ae-4334-9cc4-452c61471b8e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:59.174347 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-022fef21-a4ae-4334-9cc4-452c61471b8e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:59.175096 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-022fef21-a4ae-4334-9cc4-452c61471b8e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:59.175806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-022fef21-a4ae-4334-9cc4-452c61471b8e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:59.280385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-022fef21-a4ae-4334-9cc4-452c61471b8e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:59.290199 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-022fef21-a4ae-4334-9cc4-452c61471b8e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672" status: 200 len: 1283 microversion: 2.1 time: 0.140799 Jul 25 12:48:59.290803 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1226/2536] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:59 2022] GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672 => generated 1283 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:00.168603 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aa06f6ab-c737-471f-9ff8-faa5063e00ab tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:00.169307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-aa06f6ab-c737-471f-9ff8-faa5063e00ab tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:00.178041 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa06f6ab-c737-471f-9ff8-faa5063e00ab tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:00.179522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa06f6ab-c737-471f-9ff8-faa5063e00ab tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:00.180603 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa06f6ab-c737-471f-9ff8-faa5063e00ab tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:00.181625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa06f6ab-c737-471f-9ff8-faa5063e00ab tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:00.461047 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-286c63ce-dac8-4247-8549-a9eee3f860c4 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.304868 Jul 25 12:49:00.462932 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1311/2537] 10.222.0.49 () {60 vars in 1170 bytes} [Mon Jul 25 12:48:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:00.470256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2108a3d2-2a8c-4ad3-b33f-d179c3370313 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:00.472247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2108a3d2-2a8c-4ad3-b33f-d179c3370313 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 1782b8c1-8224-4c76-93ac-932362b12672] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:00.491252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2108a3d2-2a8c-4ad3-b33f-d179c3370313 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:00.491716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2108a3d2-2a8c-4ad3-b33f-d179c3370313 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:00.496889 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2108a3d2-2a8c-4ad3-b33f-d179c3370313 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:00.499483 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2108a3d2-2a8c-4ad3-b33f-d179c3370313 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:00.630203 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-aa06f6ab-c737-471f-9ff8-faa5063e00ab tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:00.647554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:00.651509 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aa06f6ab-c737-471f-9ff8-faa5063e00ab tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1293 microversion: 2.1 time: 0.486722 Jul 25 12:49:00.670150 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1227/2538] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:00 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1293 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:49:00.698532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2108a3d2-2a8c-4ad3-b33f-d179c3370313 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:00.708277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b9615b98-3792-4a64-a667-0d7d9e6fcd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1997533914", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "7d1be83b-0749-4f29-a888-d00c9f337335"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:00.710326 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2108a3d2-2a8c-4ad3-b33f-d179c3370313 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672" status: 200 len: 1283 microversion: 2.1 time: 0.244241 Jul 25 12:49:00.726348 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1312/2539] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:00 2022] GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672 => generated 1283 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:00.817604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-b9615b98-3792-4a64-a667-0d7d9e6fcd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] validate_networks() for [('7d1be83b-0749-4f29-a888-d00c9f337335', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:49:01.695732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4cfde758-3b07-4e90-a916-ee44f1ae546f tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:01.698544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4cfde758-3b07-4e90-a916-ee44f1ae546f tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:01.728779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4cfde758-3b07-4e90-a916-ee44f1ae546f tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:01.729863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4cfde758-3b07-4e90-a916-ee44f1ae546f tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:01.731624 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4cfde758-3b07-4e90-a916-ee44f1ae546f tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:01.732512 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4cfde758-3b07-4e90-a916-ee44f1ae546f tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:01.977433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-b9615b98-3792-4a64-a667-0d7d9e6fcd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:49:01.978897 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-b9615b98-3792-4a64-a667-0d7d9e6fcd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:49:01.979784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-b9615b98-3792-4a64-a667-0d7d9e6fcd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:49:01.980924 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-b9615b98-3792-4a64-a667-0d7d9e6fcd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:49:01.981857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-b9615b98-3792-4a64-a667-0d7d9e6fcd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:49:02.021117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b9615b98-3792-4a64-a667-0d7d9e6fcd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:02.021815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b9615b98-3792-4a64-a667-0d7d9e6fcd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:02.022891 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b9615b98-3792-4a64-a667-0d7d9e6fcd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:02.026316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b9615b98-3792-4a64-a667-0d7d9e6fcd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:02.064195 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-b9615b98-3792-4a64-a667-0d7d9e6fcd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Getting quotas for project 777390f07e0c4d398c2a5916bc558ed2. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:49:02.085775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-b9615b98-3792-4a64-a667-0d7d9e6fcd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Getting quotas for user 8245528326d34330ae7f790ef6b0b62b and project 777390f07e0c4d398c2a5916bc558ed2. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:49:02.107702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b9615b98-3792-4a64-a667-0d7d9e6fcd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:49:02.110325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b9615b98-3792-4a64-a667-0d7d9e6fcd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:49:02.216797 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b9615b98-3792-4a64-a667-0d7d9e6fcd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.513837 Jul 25 12:49:02.218180 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1228/2540] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:49:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 12:49:02.222981 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d435c692-e37c-442a-88d0-13c51cde750c tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:02.234770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d435c692-e37c-442a-88d0-13c51cde750c tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 1782b8c1-8224-4c76-93ac-932362b12672] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:02.241483 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d435c692-e37c-442a-88d0-13c51cde750c tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:02.242273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d435c692-e37c-442a-88d0-13c51cde750c tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:02.245052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d435c692-e37c-442a-88d0-13c51cde750c tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:02.247102 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d435c692-e37c-442a-88d0-13c51cde750c tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:02.379542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4cfde758-3b07-4e90-a916-ee44f1ae546f tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:02.394012 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4cfde758-3b07-4e90-a916-ee44f1ae546f tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1293 microversion: 2.1 time: 0.719414 Jul 25 12:49:02.394633 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1313/2541] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:01 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1293 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:02.419333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-52bb8761-f8d2-4964-8bde-b7ec333c7777 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:02.422811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-52bb8761-f8d2-4964-8bde-b7ec333c7777 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:02.850900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-52bb8761-f8d2-4964-8bde-b7ec333c7777 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:02.858143 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-52bb8761-f8d2-4964-8bde-b7ec333c7777 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944" status: 200 len: 1224 microversion: 2.1 time: 0.445389 Jul 25 12:49:02.860671 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1314/2542] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:02 2022] GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944 => generated 1224 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:03.182892 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d435c692-e37c-442a-88d0-13c51cde750c tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:03.199537 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d435c692-e37c-442a-88d0-13c51cde750c tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672" status: 200 len: 1325 microversion: 2.1 time: 0.976253 Jul 25 12:49:03.214838 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1229/2543] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:02 2022] GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672 => generated 1325 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:03.296709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-97f1c0bd-662e-481c-b677-fc98a1a39a29 req-c1dcc88a-a735-4bd0-a04d-d47e6b035287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1782b8c1-8224-4c76-93ac-932362b12672", "tag": "58c0ac92-a151-4d9a-a42e-4f631d0a39bc"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:03.323281 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-97f1c0bd-662e-481c-b677-fc98a1a39a29 req-c1dcc88a-a735-4bd0-a04d-d47e6b035287 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:03.324353 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-97f1c0bd-662e-481c-b677-fc98a1a39a29 req-c1dcc88a-a735-4bd0-a04d-d47e6b035287 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:03.360803 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-97f1c0bd-662e-481c-b677-fc98a1a39a29 req-c1dcc88a-a735-4bd0-a04d-d47e6b035287 service nova] Creating event network-changed:58c0ac92-a151-4d9a-a42e-4f631d0a39bc for instance 1782b8c1-8224-4c76-93ac-932362b12672 on n-h1-848886-15 Jul 25 12:49:03.368611 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-97f1c0bd-662e-481c-b677-fc98a1a39a29 req-c1dcc88a-a735-4bd0-a04d-d47e6b035287 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075459 Jul 25 12:49:03.369700 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1315/2544] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:03.417108 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b079c9f2-d32e-4209-b19b-9a1f12593ecd tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:03.418087 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b079c9f2-d32e-4209-b19b-9a1f12593ecd tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:03.427964 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b079c9f2-d32e-4209-b19b-9a1f12593ecd tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:03.430726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b079c9f2-d32e-4209-b19b-9a1f12593ecd tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:03.433663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b079c9f2-d32e-4209-b19b-9a1f12593ecd tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:03.435786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b079c9f2-d32e-4209-b19b-9a1f12593ecd tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:03.882380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d85b0a5a-72be-4b9e-88b7-198b2170605d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:03.883217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d85b0a5a-72be-4b9e-88b7-198b2170605d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:03.897639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d85b0a5a-72be-4b9e-88b7-198b2170605d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:03.898180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d85b0a5a-72be-4b9e-88b7-198b2170605d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:03.899476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d85b0a5a-72be-4b9e-88b7-198b2170605d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:03.900838 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d85b0a5a-72be-4b9e-88b7-198b2170605d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:03.938874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b079c9f2-d32e-4209-b19b-9a1f12593ecd tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:03.947678 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b079c9f2-d32e-4209-b19b-9a1f12593ecd tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1293 microversion: 2.1 time: 0.537070 Jul 25 12:49:03.948284 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1230/2545] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:03 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1293 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:04.032016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d85b0a5a-72be-4b9e-88b7-198b2170605d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:04.046499 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d85b0a5a-72be-4b9e-88b7-198b2170605d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944" status: 200 len: 1276 microversion: 2.1 time: 0.169841 Jul 25 12:49:04.048211 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1316/2546] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:03 2022] GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944 => generated 1276 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:04.235375 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1d4d3e97-0be1-4762-b137-2cefd370398a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:04.236087 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1d4d3e97-0be1-4762-b137-2cefd370398a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 1782b8c1-8224-4c76-93ac-932362b12672] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:04.254085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d4d3e97-0be1-4762-b137-2cefd370398a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:04.255582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d4d3e97-0be1-4762-b137-2cefd370398a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:04.256628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d4d3e97-0be1-4762-b137-2cefd370398a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:04.257272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d4d3e97-0be1-4762-b137-2cefd370398a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:04.941072 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1d4d3e97-0be1-4762-b137-2cefd370398a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:04.952350 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1d4d3e97-0be1-4762-b137-2cefd370398a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672" status: 200 len: 1325 microversion: 2.1 time: 0.729043 Jul 25 12:49:04.955647 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1231/2547] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:04 2022] GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672 => generated 1325 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:04.973087 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0e91362b-355c-4b9d-a3eb-e02b793802ab tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:04.973992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0e91362b-355c-4b9d-a3eb-e02b793802ab tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:04.985104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e91362b-355c-4b9d-a3eb-e02b793802ab tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:04.991347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e91362b-355c-4b9d-a3eb-e02b793802ab tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:04.992310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e91362b-355c-4b9d-a3eb-e02b793802ab tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:04.992775 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e91362b-355c-4b9d-a3eb-e02b793802ab tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:05.071206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3538f268-32b8-46ab-823c-17485d8ec3ee tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:05.072501 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3538f268-32b8-46ab-823c-17485d8ec3ee tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:05.101676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3538f268-32b8-46ab-823c-17485d8ec3ee tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:05.103638 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3538f268-32b8-46ab-823c-17485d8ec3ee tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:05.104790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3538f268-32b8-46ab-823c-17485d8ec3ee tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:05.105445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3538f268-32b8-46ab-823c-17485d8ec3ee tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:05.239005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3538f268-32b8-46ab-823c-17485d8ec3ee tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:05.248283 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3538f268-32b8-46ab-823c-17485d8ec3ee tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944" status: 200 len: 1282 microversion: 2.1 time: 0.183465 Jul 25 12:49:05.248893 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1232/2548] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:05 2022] GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944 => generated 1282 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:05.595131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0e91362b-355c-4b9d-a3eb-e02b793802ab tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:05.607584 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0e91362b-355c-4b9d-a3eb-e02b793802ab tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1293 microversion: 2.1 time: 0.642608 Jul 25 12:49:05.608643 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1317/2549] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:04 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1293 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:05.977968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a8f0a0f7-103c-4336-bf3e-3bfe1061393e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:05.978803 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a8f0a0f7-103c-4336-bf3e-3bfe1061393e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 1782b8c1-8224-4c76-93ac-932362b12672] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:05.995683 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a8f0a0f7-103c-4336-bf3e-3bfe1061393e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:05.996140 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a8f0a0f7-103c-4336-bf3e-3bfe1061393e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:05.996937 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a8f0a0f7-103c-4336-bf3e-3bfe1061393e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:05.997557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a8f0a0f7-103c-4336-bf3e-3bfe1061393e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:06.270917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b6324d5b-285e-4215-a90e-9d1084bbee44 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:06.272249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b6324d5b-285e-4215-a90e-9d1084bbee44 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:06.289309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6324d5b-285e-4215-a90e-9d1084bbee44 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:06.292549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6324d5b-285e-4215-a90e-9d1084bbee44 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:06.296171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6324d5b-285e-4215-a90e-9d1084bbee44 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:06.296854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6324d5b-285e-4215-a90e-9d1084bbee44 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:06.514469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a8f0a0f7-103c-4336-bf3e-3bfe1061393e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:06.517670 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b6324d5b-285e-4215-a90e-9d1084bbee44 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:06.530296 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b6324d5b-285e-4215-a90e-9d1084bbee44 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944" status: 200 len: 1282 microversion: 2.1 time: 0.265082 Jul 25 12:49:06.530520 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a8f0a0f7-103c-4336-bf3e-3bfe1061393e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672" status: 200 len: 1325 microversion: 2.1 time: 0.556941 Jul 25 12:49:06.531139 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1233/2550] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:05 2022] GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672 => generated 1325 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:06.532240 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1318/2551] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:06 2022] GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944 => generated 1282 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:06.628743 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1be2dc35-2caf-4152-acc1-4fcd2ced3ee9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:06.629358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1be2dc35-2caf-4152-acc1-4fcd2ced3ee9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:06.645614 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1be2dc35-2caf-4152-acc1-4fcd2ced3ee9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:06.646332 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1be2dc35-2caf-4152-acc1-4fcd2ced3ee9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:06.647341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1be2dc35-2caf-4152-acc1-4fcd2ced3ee9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:06.647768 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1be2dc35-2caf-4152-acc1-4fcd2ced3ee9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:06.933216 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1be2dc35-2caf-4152-acc1-4fcd2ced3ee9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:06.952136 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1be2dc35-2caf-4152-acc1-4fcd2ced3ee9 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1293 microversion: 2.1 time: 0.326838 Jul 25 12:49:06.966853 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1234/2552] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:06 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1293 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:07.554641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aea241da-0f8d-48e8-9a1c-7bc2d437cd96 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:07.556184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-aea241da-0f8d-48e8-9a1c-7bc2d437cd96 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 1782b8c1-8224-4c76-93ac-932362b12672] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:07.557754 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4e07d1a2-9a56-4df1-9d3f-1b6b3667f6f4 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:07.558815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4e07d1a2-9a56-4df1-9d3f-1b6b3667f6f4 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:07.564347 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aea241da-0f8d-48e8-9a1c-7bc2d437cd96 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:07.566476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aea241da-0f8d-48e8-9a1c-7bc2d437cd96 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:07.567545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aea241da-0f8d-48e8-9a1c-7bc2d437cd96 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:07.567845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e07d1a2-9a56-4df1-9d3f-1b6b3667f6f4 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:07.568310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e07d1a2-9a56-4df1-9d3f-1b6b3667f6f4 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:07.568722 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aea241da-0f8d-48e8-9a1c-7bc2d437cd96 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:07.570407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e07d1a2-9a56-4df1-9d3f-1b6b3667f6f4 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:07.570861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e07d1a2-9a56-4df1-9d3f-1b6b3667f6f4 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:07.743728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4e07d1a2-9a56-4df1-9d3f-1b6b3667f6f4 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:07.760440 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4e07d1a2-9a56-4df1-9d3f-1b6b3667f6f4 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944" status: 200 len: 1282 microversion: 2.1 time: 0.207692 Jul 25 12:49:07.768066 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1319/2553] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:07 2022] GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944 => generated 1282 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:07.944910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-aea241da-0f8d-48e8-9a1c-7bc2d437cd96 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:07.960464 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aea241da-0f8d-48e8-9a1c-7bc2d437cd96 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672" status: 200 len: 1325 microversion: 2.1 time: 0.408425 Jul 25 12:49:07.962725 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1235/2554] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:07 2022] GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672 => generated 1325 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:49:07.979573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-48fb2f47-a102-47c2-817c-cefbb533b777 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:07.980862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-48fb2f47-a102-47c2-817c-cefbb533b777 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:07.988086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48fb2f47-a102-47c2-817c-cefbb533b777 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:07.988853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48fb2f47-a102-47c2-817c-cefbb533b777 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:07.989819 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48fb2f47-a102-47c2-817c-cefbb533b777 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:07.990465 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48fb2f47-a102-47c2-817c-cefbb533b777 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:08.791740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c0ae1d73-35e4-4117-8fba-b14ff9854f15 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:08.794070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c0ae1d73-35e4-4117-8fba-b14ff9854f15 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:08.803468 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0ae1d73-35e4-4117-8fba-b14ff9854f15 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:08.805185 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0ae1d73-35e4-4117-8fba-b14ff9854f15 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:08.807651 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0ae1d73-35e4-4117-8fba-b14ff9854f15 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:08.810080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0ae1d73-35e4-4117-8fba-b14ff9854f15 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:08.943466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-48fb2f47-a102-47c2-817c-cefbb533b777 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:08.952978 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-48fb2f47-a102-47c2-817c-cefbb533b777 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1293 microversion: 2.1 time: 0.984040 Jul 25 12:49:08.957334 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1320/2555] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:07 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1293 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:08.983581 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-04990d94-b54b-4530-ac34-48f0435e1745 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:08.984219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-04990d94-b54b-4530-ac34-48f0435e1745 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 1782b8c1-8224-4c76-93ac-932362b12672] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:08.999232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04990d94-b54b-4530-ac34-48f0435e1745 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:09.000198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04990d94-b54b-4530-ac34-48f0435e1745 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:09.001151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04990d94-b54b-4530-ac34-48f0435e1745 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:09.001980 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04990d94-b54b-4530-ac34-48f0435e1745 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:09.540926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c0ae1d73-35e4-4117-8fba-b14ff9854f15 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:09.555611 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c0ae1d73-35e4-4117-8fba-b14ff9854f15 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944" status: 200 len: 1324 microversion: 2.1 time: 0.773937 Jul 25 12:49:09.556616 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1236/2556] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:08 2022] GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944 => generated 1324 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:09.729127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-04990d94-b54b-4530-ac34-48f0435e1745 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:09.733552 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:09.749736 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-04990d94-b54b-4530-ac34-48f0435e1745 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672" status: 200 len: 1325 microversion: 2.1 time: 0.770100 Jul 25 12:49:09.753541 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1321/2557] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:08 2022] GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672 => generated 1325 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:09.796741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6b0500d8-6579-45b5-b039-e63c1616bb26 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Action: 'create', calling method: .version_select at 0x7efcfecb7d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-315790516", "description": "tempest-description-1974124336"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:09.984476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7da4803b-e373-4b5c-b097-21ca0476b6d6 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:09.985101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7da4803b-e373-4b5c-b097-21ca0476b6d6 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:09.996486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7da4803b-e373-4b5c-b097-21ca0476b6d6 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:09.997150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7da4803b-e373-4b5c-b097-21ca0476b6d6 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:10.000034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7da4803b-e373-4b5c-b097-21ca0476b6d6 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:10.000706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7da4803b-e373-4b5c-b097-21ca0476b6d6 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:10.980762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7da4803b-e373-4b5c-b097-21ca0476b6d6 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:10.991172 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7da4803b-e373-4b5c-b097-21ca0476b6d6 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1293 microversion: 2.1 time: 1.015754 Jul 25 12:49:10.996082 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1322/2558] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:09 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1293 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:49:11.014324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-51737d3c-1357-49ce-a007-a8b7ca1e95a3 req-9babe38a-3003-4c25-a233-25738f5428c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c7a7e2b-9643-44dc-91b8-d753b1d90944", "tag": "90dd5757-925f-4846-8df1-a75d5939d05f"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:11.043652 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-51737d3c-1357-49ce-a007-a8b7ca1e95a3 req-9babe38a-3003-4c25-a233-25738f5428c9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:11.044303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-51737d3c-1357-49ce-a007-a8b7ca1e95a3 req-9babe38a-3003-4c25-a233-25738f5428c9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:11.066632 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-51737d3c-1357-49ce-a007-a8b7ca1e95a3 req-9babe38a-3003-4c25-a233-25738f5428c9 service nova] Creating event network-changed:90dd5757-925f-4846-8df1-a75d5939d05f for instance 3c7a7e2b-9643-44dc-91b8-d753b1d90944 on n-h2-848886-15 Jul 25 12:49:11.079770 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-51737d3c-1357-49ce-a007-a8b7ca1e95a3 req-9babe38a-3003-4c25-a233-25738f5428c9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081350 Jul 25 12:49:11.083358 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1323/2559] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:11.091038 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7a7d17d2-c114-4b71-955e-ddae5160bc02 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:11.096182 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7a7d17d2-c114-4b71-955e-ddae5160bc02 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:11.113462 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a7d17d2-c114-4b71-955e-ddae5160bc02 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:11.114222 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a7d17d2-c114-4b71-955e-ddae5160bc02 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:11.115192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a7d17d2-c114-4b71-955e-ddae5160bc02 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:11.119363 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a7d17d2-c114-4b71-955e-ddae5160bc02 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:11.177125 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6b0500d8-6579-45b5-b039-e63c1616bb26 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.541605 Jul 25 12:49:11.189983 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1237/2560] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:49:09 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:11.196603 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-0bd341e0-d978-4503-8fee-6427e2e3e963 req-68489583-341a-470b-b1c7-e6e8349f45cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a467b47-ccc6-4656-aefe-48797aab42b4", "name": "network-vif-plugged", "status": "completed", "tag": "a717f19c-082c-42c4-9467-fd733519794a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:11.215840 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0bd341e0-d978-4503-8fee-6427e2e3e963 req-68489583-341a-470b-b1c7-e6e8349f45cf service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:11.216502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0bd341e0-d978-4503-8fee-6427e2e3e963 req-68489583-341a-470b-b1c7-e6e8349f45cf service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:11.236379 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-0bd341e0-d978-4503-8fee-6427e2e3e963 req-68489583-341a-470b-b1c7-e6e8349f45cf service nova] Creating event network-vif-plugged:a717f19c-082c-42c4-9467-fd733519794a for instance 3a467b47-ccc6-4656-aefe-48797aab42b4 on n-h2-848886-15 Jul 25 12:49:11.245815 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-0bd341e0-d978-4503-8fee-6427e2e3e963 req-68489583-341a-470b-b1c7-e6e8349f45cf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053094 Jul 25 12:49:11.246989 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1238/2561] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:11.263087 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-27582387-62cf-4dc3-a540-c314922b1add tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:11.299466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-27582387-62cf-4dc3-a540-c314922b1add tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 1782b8c1-8224-4c76-93ac-932362b12672] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:11.328296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27582387-62cf-4dc3-a540-c314922b1add tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:11.330661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27582387-62cf-4dc3-a540-c314922b1add tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:11.334315 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27582387-62cf-4dc3-a540-c314922b1add tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:11.338229 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27582387-62cf-4dc3-a540-c314922b1add tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:12.046465 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:12.096050 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=12 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:12.576083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7a7d17d2-c114-4b71-955e-ddae5160bc02 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:12.596606 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7a7d17d2-c114-4b71-955e-ddae5160bc02 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944" status: 200 len: 1324 microversion: 2.1 time: 1.511911 Jul 25 12:49:12.610172 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1324/2562] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:11 2022] GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944 => generated 1324 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:12.615331 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a93ffdd4-6c30-4ae9-823a-725dc5908bb1 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Action: 'create', calling method: .version_select at 0x7efcfee4b790>, body: {"security_group_rule": {"parent_group_id": "b405d876-049f-4ac8-ad04-6b778615e359", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:12.673755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-27582387-62cf-4dc3-a540-c314922b1add tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:12.688351 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-27582387-62cf-4dc3-a540-c314922b1add tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672" status: 200 len: 1325 microversion: 2.1 time: 1.439367 Jul 25 12:49:12.689343 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1239/2563] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:11 2022] GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672 => generated 1325 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:12.707448 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6ee33f67-8672-480e-ab87-baf6c8c500b5 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:12.708077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6ee33f67-8672-480e-ab87-baf6c8c500b5 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:12.726839 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6ee33f67-8672-480e-ab87-baf6c8c500b5 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:12.727305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6ee33f67-8672-480e-ab87-baf6c8c500b5 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:12.728082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6ee33f67-8672-480e-ab87-baf6c8c500b5 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:12.728507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6ee33f67-8672-480e-ab87-baf6c8c500b5 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:12.857926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=16 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:13.108003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6ee33f67-8672-480e-ab87-baf6c8c500b5 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:13.132442 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6ee33f67-8672-480e-ab87-baf6c8c500b5 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1293 microversion: 2.1 time: 0.425545 Jul 25 12:49:13.144886 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1240/2564] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:12 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1293 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:13.298127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-f039af8b-4208-4f2a-bc17-522361cc590d req-4ab4cd0d-1b44-4fd1-b1df-fbc910ba5a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1782b8c1-8224-4c76-93ac-932362b12672", "name": "network-vif-plugged", "status": "completed", "tag": "58c0ac92-a151-4d9a-a42e-4f631d0a39bc"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:13.318961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-f039af8b-4208-4f2a-bc17-522361cc590d req-4ab4cd0d-1b44-4fd1-b1df-fbc910ba5a5c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:13.319416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-f039af8b-4208-4f2a-bc17-522361cc590d req-4ab4cd0d-1b44-4fd1-b1df-fbc910ba5a5c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:13.352117 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-f039af8b-4208-4f2a-bc17-522361cc590d req-4ab4cd0d-1b44-4fd1-b1df-fbc910ba5a5c service nova] Creating event network-vif-plugged:58c0ac92-a151-4d9a-a42e-4f631d0a39bc for instance 1782b8c1-8224-4c76-93ac-932362b12672 on n-h1-848886-15 Jul 25 12:49:13.364516 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-f039af8b-4208-4f2a-bc17-522361cc590d req-4ab4cd0d-1b44-4fd1-b1df-fbc910ba5a5c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071176 Jul 25 12:49:13.365212 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1241/2565] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:49:13.504895 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a93ffdd4-6c30-4ae9-823a-725dc5908bb1 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.893446 Jul 25 12:49:13.505507 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1325/2566] 10.222.0.49 () {60 vars in 1195 bytes} [Mon Jul 25 12:49:12 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:13.524755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-33b61217-c712-4fa2-b0a8-eb673557a4ad tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Action: 'create', calling method: .version_select at 0x7efcfa6b5c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1652152350", "description": "tempest-description-952105572"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:13.617542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-56002178-b019-4d2b-bc94-98fc478543e6 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:13.618222 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-56002178-b019-4d2b-bc94-98fc478543e6 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:13.643267 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56002178-b019-4d2b-bc94-98fc478543e6 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:13.644382 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56002178-b019-4d2b-bc94-98fc478543e6 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:13.661385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56002178-b019-4d2b-bc94-98fc478543e6 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:13.663106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56002178-b019-4d2b-bc94-98fc478543e6 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:14.170688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-56002178-b019-4d2b-bc94-98fc478543e6 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:14.196338 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-56002178-b019-4d2b-bc94-98fc478543e6 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944" status: 200 len: 1324 microversion: 2.1 time: 0.581213 Jul 25 12:49:14.200386 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1326/2567] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:13 2022] GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944 => generated 1324 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:49:14.244346 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cd566988-71a4-4d01-92e3-e8b43cd68e74 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:14.246549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cd566988-71a4-4d01-92e3-e8b43cd68e74 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 1782b8c1-8224-4c76-93ac-932362b12672] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:14.257789 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cd566988-71a4-4d01-92e3-e8b43cd68e74 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:14.258784 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cd566988-71a4-4d01-92e3-e8b43cd68e74 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:14.259148 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-33b61217-c712-4fa2-b0a8-eb673557a4ad tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.739017 Jul 25 12:49:14.260424 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1242/2568] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:49:13 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:14.264791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cd566988-71a4-4d01-92e3-e8b43cd68e74 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:14.265474 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cd566988-71a4-4d01-92e3-e8b43cd68e74 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:14.273044 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b3004257-8012-41a6-8396-ab4157480276 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:14.273915 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b3004257-8012-41a6-8396-ab4157480276 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:14.287214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3004257-8012-41a6-8396-ab4157480276 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:14.289025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3004257-8012-41a6-8396-ab4157480276 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:14.294302 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3004257-8012-41a6-8396-ab4157480276 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:14.301747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3004257-8012-41a6-8396-ab4157480276 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:14.947026 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b3004257-8012-41a6-8396-ab4157480276 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:14.959289 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b3004257-8012-41a6-8396-ab4157480276 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1485 microversion: 2.1 time: 0.697529 Jul 25 12:49:14.959902 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1243/2569] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:14 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1485 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:14.975192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cd566988-71a4-4d01-92e3-e8b43cd68e74 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:14.977618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c6c3579d-f628-4326-a991-bacf5712da7f tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Action: 'create', calling method: .version_select at 0x7efcf904d3a0>, body: {"security_group_rule": {"parent_group_id": "242ecab3-ff29-4c41-81d5-be58df580312", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:15.000012 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cd566988-71a4-4d01-92e3-e8b43cd68e74 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672" status: 200 len: 1325 microversion: 2.1 time: 0.798038 Jul 25 12:49:15.002632 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1327/2570] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:14 2022] GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672 => generated 1325 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:15.030202 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-359d41dc-d6c5-4e92-a0bf-b14fcae21f01 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:15.030765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-359d41dc-d6c5-4e92-a0bf-b14fcae21f01 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:15.056939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-359d41dc-d6c5-4e92-a0bf-b14fcae21f01 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:15.057398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-359d41dc-d6c5-4e92-a0bf-b14fcae21f01 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:15.058220 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-359d41dc-d6c5-4e92-a0bf-b14fcae21f01 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:15.058659 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-359d41dc-d6c5-4e92-a0bf-b14fcae21f01 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:15.324007 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-359d41dc-d6c5-4e92-a0bf-b14fcae21f01 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.304947 Jul 25 12:49:15.324891 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1328/2571] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 12:49:15 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4/os-interface => generated 285 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:15.332356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-55c94d57-71c0-46a9-8a66-16e4e83f0006 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:15.333316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-55c94d57-71c0-46a9-8a66-16e4e83f0006 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:15.345587 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-55c94d57-71c0-46a9-8a66-16e4e83f0006 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:15.348846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-55c94d57-71c0-46a9-8a66-16e4e83f0006 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:15.351012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-55c94d57-71c0-46a9-8a66-16e4e83f0006 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:15.352603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-55c94d57-71c0-46a9-8a66-16e4e83f0006 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:15.850624 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c6c3579d-f628-4326-a991-bacf5712da7f tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.889550 Jul 25 12:49:15.852463 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1244/2572] 10.222.0.49 () {60 vars in 1195 bytes} [Mon Jul 25 12:49:14 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:15.866299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8ec69138-628e-4b43-8797-f1a73dbf9273 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Action: 'create', calling method: .version_select at 0x7efcf8fa7790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1478897383", "description": "tempest-description-1302310607"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:16.142421 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-55c94d57-71c0-46a9-8a66-16e4e83f0006 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:16.157174 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-55c94d57-71c0-46a9-8a66-16e4e83f0006 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944" status: 200 len: 1324 microversion: 2.1 time: 0.830862 Jul 25 12:49:16.161107 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1329/2573] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:15 2022] GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944 => generated 1324 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:16.172297 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6eb4340b-276a-4c92-a37f-d19cd6922579 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:16.176663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6eb4340b-276a-4c92-a37f-d19cd6922579 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 1782b8c1-8224-4c76-93ac-932362b12672] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:16.190939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:16.192997 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6eb4340b-276a-4c92-a37f-d19cd6922579 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:16.193952 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6eb4340b-276a-4c92-a37f-d19cd6922579 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:16.195969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6eb4340b-276a-4c92-a37f-d19cd6922579 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:16.198573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6eb4340b-276a-4c92-a37f-d19cd6922579 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:16.816895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6eb4340b-276a-4c92-a37f-d19cd6922579 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:16.832875 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6eb4340b-276a-4c92-a37f-d19cd6922579 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672" status: 200 len: 1522 microversion: 2.1 time: 0.668395 Jul 25 12:49:16.833654 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1330/2574] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:16 2022] GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672 => generated 1522 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:16.862808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-97697f0b-ff8a-42c5-9b57-08a79b6c292a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:16.863459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-97697f0b-ff8a-42c5-9b57-08a79b6c292a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 1782b8c1-8224-4c76-93ac-932362b12672] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:16.878312 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-97697f0b-ff8a-42c5-9b57-08a79b6c292a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:16.879142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-97697f0b-ff8a-42c5-9b57-08a79b6c292a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:16.880586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-97697f0b-ff8a-42c5-9b57-08a79b6c292a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:16.881175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-97697f0b-ff8a-42c5-9b57-08a79b6c292a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:16.885218 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8ec69138-628e-4b43-8797-f1a73dbf9273 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.023089 Jul 25 12:49:16.904823 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1245/2575] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:49:15 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:16.913366 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-207e2f33-2689-4bd4-8e27-d62d696b2649 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Action: 'create', calling method: .version_select at 0x7efcf8e2a940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-247233757", "description": "tempest-description-887996545"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:16.954516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-97697f0b-ff8a-42c5-9b57-08a79b6c292a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 1782b8c1-8224-4c76-93ac-932362b12672] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:49:17.067229 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-97697f0b-ff8a-42c5-9b57-08a79b6c292a tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672" status: 204 len: 0 microversion: 2.1 time: 0.209116 Jul 25 12:49:17.070985 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1331/2576] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:49:16 2022] DELETE /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 12:49:17.083745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c972b9dc-0128-4d03-adf6-d2778d5d5eb1 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:17.083745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c972b9dc-0128-4d03-adf6-d2778d5d5eb1 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 1782b8c1-8224-4c76-93ac-932362b12672] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:17.093921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c972b9dc-0128-4d03-adf6-d2778d5d5eb1 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:17.094492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c972b9dc-0128-4d03-adf6-d2778d5d5eb1 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:17.096015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c972b9dc-0128-4d03-adf6-d2778d5d5eb1 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:17.096015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c972b9dc-0128-4d03-adf6-d2778d5d5eb1 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:18.091690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c972b9dc-0128-4d03-adf6-d2778d5d5eb1 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:18.107607 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c972b9dc-0128-4d03-adf6-d2778d5d5eb1 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672" status: 200 len: 1528 microversion: 2.1 time: 1.030410 Jul 25 12:49:18.121923 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1332/2577] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:17 2022] GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672 => generated 1528 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:18.138131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b83c3435-ea91-4595-b915-6b6f87bb6d8d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:18.139648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b83c3435-ea91-4595-b915-6b6f87bb6d8d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:18.159356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b83c3435-ea91-4595-b915-6b6f87bb6d8d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:18.159821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b83c3435-ea91-4595-b915-6b6f87bb6d8d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:18.162202 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b83c3435-ea91-4595-b915-6b6f87bb6d8d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:18.162887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b83c3435-ea91-4595-b915-6b6f87bb6d8d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:18.238669 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-207e2f33-2689-4bd4-8e27-d62d696b2649 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.331111 Jul 25 12:49:18.240831 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1246/2578] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:49:16 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:18.254563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-666b20ee-dfcd-40aa-83f2-c3ede1a2a8fb req-2aa71ea4-d996-44c9-aa6b-09c45dc5ce2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c7a7e2b-9643-44dc-91b8-d753b1d90944", "name": "network-vif-plugged", "status": "completed", "tag": "90dd5757-925f-4846-8df1-a75d5939d05f"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:18.270498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:18.275969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-666b20ee-dfcd-40aa-83f2-c3ede1a2a8fb req-2aa71ea4-d996-44c9-aa6b-09c45dc5ce2e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:18.276701 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-666b20ee-dfcd-40aa-83f2-c3ede1a2a8fb req-2aa71ea4-d996-44c9-aa6b-09c45dc5ce2e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:18.297042 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-666b20ee-dfcd-40aa-83f2-c3ede1a2a8fb req-2aa71ea4-d996-44c9-aa6b-09c45dc5ce2e service nova] Creating event network-vif-plugged:90dd5757-925f-4846-8df1-a75d5939d05f for instance 3c7a7e2b-9643-44dc-91b8-d753b1d90944 on n-h2-848886-15 Jul 25 12:49:18.304330 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-666b20ee-dfcd-40aa-83f2-c3ede1a2a8fb req-2aa71ea4-d996-44c9-aa6b-09c45dc5ce2e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061910 Jul 25 12:49:18.305772 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1247/2579] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:18.316857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-eabd874e-b0ee-4237-99b6-36daffb8a265 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Action: 'create', calling method: .version_select at 0x7efcf9d0f280>, body: {"security_group_rule": {"parent_group_id": "40d23536-c70f-4234-979b-b17f49b93494", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "7e3f461a-bf37-42f7-bd13-d4f8c90774be"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:18.685484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b83c3435-ea91-4595-b915-6b6f87bb6d8d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:18.695542 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b83c3435-ea91-4595-b915-6b6f87bb6d8d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944" status: 200 len: 1324 microversion: 2.1 time: 0.569544 Jul 25 12:49:18.706521 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1333/2580] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:18 2022] GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944 => generated 1324 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:18.868649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7a68c42b-7728-4ff8-87fe-fcdab4183fdd tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Action: 'create', calling method: .version_select at 0x7efcf917b430>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-778526309", "policies": ["affinity"]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:18.888359 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-7a68c42b-7728-4ff8-87fe-fcdab4183fdd tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_groups'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:49:18.894925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-7a68c42b-7728-4ff8-87fe-fcdab4183fdd tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for user 557df3df55844c1588203a9319158934 and project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_groups'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:49:18.974371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-7a68c42b-7728-4ff8-87fe-fcdab4183fdd tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_groups'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:49:19.000544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-7a68c42b-7728-4ff8-87fe-fcdab4183fdd tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for user 557df3df55844c1588203a9319158934 and project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_groups'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:49:19.036305 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7a68c42b-7728-4ff8-87fe-fcdab4183fdd tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.328004 Jul 25 12:49:19.051018 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1334/2581] 10.222.0.49 () {60 vars in 1174 bytes} [Mon Jul 25 12:49:18 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:19.059874 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8dad97a0-6c81-4ac5-92e3-09869cad2d71 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Action: 'create', calling method: .version_select at 0x7efcf917bd30>, body: {"server_group": {"name": "tempest-server-group-401782465", "policies": ["affinity"]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:19.110339 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-8dad97a0-6c81-4ac5-92e3-09869cad2d71 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_groups'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:49:19.123377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-8dad97a0-6c81-4ac5-92e3-09869cad2d71 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for user 557df3df55844c1588203a9319158934 and project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_groups'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:49:19.296997 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-8dad97a0-6c81-4ac5-92e3-09869cad2d71 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_groups'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:49:19.313494 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-8dad97a0-6c81-4ac5-92e3-09869cad2d71 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for user 557df3df55844c1588203a9319158934 and project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_groups'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:49:19.346328 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8dad97a0-6c81-4ac5-92e3-09869cad2d71 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.293869 Jul 25 12:49:19.347164 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1335/2582] 10.222.0.49 () {60 vars in 1173 bytes} [Mon Jul 25 12:49:19 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:19.353725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-72f96b28-e23f-424f-a2f1-38078d78db5e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:19.354381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-72f96b28-e23f-424f-a2f1-38078d78db5e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 1782b8c1-8224-4c76-93ac-932362b12672] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:19.370061 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-72f96b28-e23f-424f-a2f1-38078d78db5e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:19.372321 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-72f96b28-e23f-424f-a2f1-38078d78db5e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:19.374908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-72f96b28-e23f-424f-a2f1-38078d78db5e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:19.376375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-72f96b28-e23f-424f-a2f1-38078d78db5e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:19.834584 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-eabd874e-b0ee-4237-99b6-36daffb8a265 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.522828 Jul 25 12:49:19.836624 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1248/2583] 10.222.0.49 () {60 vars in 1195 bytes} [Mon Jul 25 12:49:18 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:19.842176 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1a1448b7-b04e-438c-b929-a38a8083f954 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:19.845099 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1a1448b7-b04e-438c-b929-a38a8083f954 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:19.864843 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a1448b7-b04e-438c-b929-a38a8083f954 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:19.873416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a1448b7-b04e-438c-b929-a38a8083f954 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:19.874124 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a1448b7-b04e-438c-b929-a38a8083f954 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:19.874564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a1448b7-b04e-438c-b929-a38a8083f954 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:19.923473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-72f96b28-e23f-424f-a2f1-38078d78db5e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bedadaad3cf44edb8fd8037aebd2ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35482ec73a054bafa24c83aea2b08636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:19.942664 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-72f96b28-e23f-424f-a2f1-38078d78db5e tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672" status: 200 len: 1528 microversion: 2.1 time: 0.594565 Jul 25 12:49:19.946247 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1336/2584] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:19 2022] GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672 => generated 1528 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:20.589747 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-351744f9-eea3-4311-b799-eeebdc7b4542 req-94206463-3be7-4e77-b2c8-eda3a8ebd6aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a467b47-ccc6-4656-aefe-48797aab42b4", "tag": "a717f19c-082c-42c4-9467-fd733519794a"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:20.616853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-351744f9-eea3-4311-b799-eeebdc7b4542 req-94206463-3be7-4e77-b2c8-eda3a8ebd6aa service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:20.617884 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-351744f9-eea3-4311-b799-eeebdc7b4542 req-94206463-3be7-4e77-b2c8-eda3a8ebd6aa service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:20.652871 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-351744f9-eea3-4311-b799-eeebdc7b4542 req-94206463-3be7-4e77-b2c8-eda3a8ebd6aa service nova] Creating event network-changed:a717f19c-082c-42c4-9467-fd733519794a for instance 3a467b47-ccc6-4656-aefe-48797aab42b4 on n-h2-848886-15 Jul 25 12:49:20.664947 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-351744f9-eea3-4311-b799-eeebdc7b4542 req-94206463-3be7-4e77-b2c8-eda3a8ebd6aa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.717147 Jul 25 12:49:20.667533 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1337/2585] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:20.681343 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c26114d5-01e0-4269-8eec-801f23cacb50 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Action: 'create', calling method: .version_select at 0x7efcf917b160>, body: {"server_group": {"name": "tempest-server-group-401782465", "policies": ["affinity"]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:20.725368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-c26114d5-01e0-4269-8eec-801f23cacb50 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_groups'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:49:20.746963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-c26114d5-01e0-4269-8eec-801f23cacb50 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for user 557df3df55844c1588203a9319158934 and project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_groups'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:49:20.842924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-c26114d5-01e0-4269-8eec-801f23cacb50 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_groups'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:49:20.857654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-c26114d5-01e0-4269-8eec-801f23cacb50 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for user 557df3df55844c1588203a9319158934 and project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_groups'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:49:20.892385 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c26114d5-01e0-4269-8eec-801f23cacb50 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.222855 Jul 25 12:49:20.893614 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1338/2586] 10.222.0.49 () {60 vars in 1173 bytes} [Mon Jul 25 12:49:20 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:20.907956 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-695417e4-e327-4fce-957b-f20ce965233e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:20.908719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-695417e4-e327-4fce-957b-f20ce965233e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:20.912184 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:20.928556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-695417e4-e327-4fce-957b-f20ce965233e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:20.928556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-695417e4-e327-4fce-957b-f20ce965233e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:20.929225 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-695417e4-e327-4fce-957b-f20ce965233e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:20.929669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-695417e4-e327-4fce-957b-f20ce965233e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:20.958205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1a1448b7-b04e-438c-b929-a38a8083f954 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:20.970359 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1a1448b7-b04e-438c-b929-a38a8083f954 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1485 microversion: 2.1 time: 1.132420 Jul 25 12:49:20.981869 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1249/2587] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:19 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1485 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:20.981869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d7cd10e7-bdf4-46bb-911e-10cbcee0eefd tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Action: 'create', calling method: .version_select at 0x7efcf8fe3310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-951910655", "description": "tempest-description-901040845"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:21.711071 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-695417e4-e327-4fce-957b-f20ce965233e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:21.724429 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-695417e4-e327-4fce-957b-f20ce965233e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944" status: 200 len: 1521 microversion: 2.1 time: 0.828311 Jul 25 12:49:21.725047 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1339/2588] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:20 2022] GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944 => generated 1521 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:21.741105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-4209470c-6b49-4e26-bf95-ec56d673b645 req-666272ac-ee01-47a8-9e37-1d932b89e110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1782b8c1-8224-4c76-93ac-932362b12672", "name": "network-vif-deleted", "tag": "58c0ac92-a151-4d9a-a42e-4f631d0a39bc"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:21.765686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4209470c-6b49-4e26-bf95-ec56d673b645 req-666272ac-ee01-47a8-9e37-1d932b89e110 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:21.767144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4209470c-6b49-4e26-bf95-ec56d673b645 req-666272ac-ee01-47a8-9e37-1d932b89e110 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:21.796581 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-4209470c-6b49-4e26-bf95-ec56d673b645 req-666272ac-ee01-47a8-9e37-1d932b89e110 service nova] Creating event network-vif-deleted:58c0ac92-a151-4d9a-a42e-4f631d0a39bc for instance 1782b8c1-8224-4c76-93ac-932362b12672 on n-h1-848886-15 Jul 25 12:49:21.807520 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-4209470c-6b49-4e26-bf95-ec56d673b645 req-666272ac-ee01-47a8-9e37-1d932b89e110 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081256 Jul 25 12:49:21.811024 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1340/2589] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:21.821371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d3c7d94f-f665-4ac4-8ac9-739b956d09b8 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:21.886404 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d3c7d94f-f665-4ac4-8ac9-739b956d09b8 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/da4a73b1-f8ef-4a4e-8439-997fcdd45ffb" status: 204 len: 0 microversion: 2.1 time: 0.073924 Jul 25 12:49:21.887010 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1341/2590] 10.222.0.49 () {58 vars in 1266 bytes} [Mon Jul 25 12:49:21 2022] DELETE /compute/v2.1/os-server-groups/da4a73b1-f8ef-4a4e-8439-997fcdd45ffb => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:49:21.892008 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-17269277-2389-437f-bf18-40607ab99873 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:21.892773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-17269277-2389-437f-bf18-40607ab99873 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 1782b8c1-8224-4c76-93ac-932362b12672] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:21.910847 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-17269277-2389-437f-bf18-40607ab99873 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:21.911669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-17269277-2389-437f-bf18-40607ab99873 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:21.913015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-17269277-2389-437f-bf18-40607ab99873 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:21.913954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-17269277-2389-437f-bf18-40607ab99873 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:21.965671 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-17269277-2389-437f-bf18-40607ab99873 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] HTTP exception thrown: Instance 1782b8c1-8224-4c76-93ac-932362b12672 could not be found. Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-17269277-2389-437f-bf18-40607ab99873 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Request method failure captured: Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672 HTTP/1.1 Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pDaiP1mn9moxuV0sEhHjcxs4YL6Wxk-LuBvL9sVonTARIUb0VcjcYQ7ntJp6sU09-7y0ZY4v6v4uSXBdkSQ_CiPsK7WXJf7MhcmeBPhydkepNAywcsaes9TYKg1Cs1S98mShfAYCBZemu8j0o07ISZt2oaK0_iQPi_CmMif6E2gpQ0 Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_35482ec73a054bafa24c83aea2b08636", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}] Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: bedadaad3cf44edb8fd8037aebd2ee25 Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 1782b8c1-8224-4c76-93ac-932362b12672 could not be found. Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '1782b8c1-8224-4c76-93ac-932362b12672'} Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1782b8c1-8224-4c76-93ac-932362b12672 could not be found. Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1782b8c1-8224-4c76-93ac-932362b12672 could not be found. Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:21.980141 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:21.985497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:21.985497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:21.985497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:21.985497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:21.985497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:49:21.985497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:49:21.985497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1782b8c1-8224-4c76-93ac-932362b12672 could not be found. Jul 25 12:49:21.985497 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:21.985497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-17269277-2389-437f-bf18-40607ab99873 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Returning 404 to user: Instance 1782b8c1-8224-4c76-93ac-932362b12672 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:49:21.986922 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-17269277-2389-437f-bf18-40607ab99873 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672" status: 404 len: 111 microversion: 2.1 time: 0.096140 Jul 25 12:49:21.987503 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1342/2591] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:21 2022] GET /compute/v2.1/servers/1782b8c1-8224-4c76-93ac-932362b12672 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:49:22.004320 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fb5a200f-184e-483c-94c0-cbf4e95dfc3c tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.181"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:22.009547 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fb5a200f-184e-483c-94c0-cbf4e95dfc3c tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:22.018377 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d7cd10e7-bdf4-46bb-911e-10cbcee0eefd tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.045949 Jul 25 12:49:22.019626 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1250/2592] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:49:20 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:22.024881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e5fc3af5-d5f1-4626-9111-a1021ae4c394 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:22.032434 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb5a200f-184e-483c-94c0-cbf4e95dfc3c tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:22.032746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb5a200f-184e-483c-94c0-cbf4e95dfc3c tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:22.033538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb5a200f-184e-483c-94c0-cbf4e95dfc3c tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:22.041440 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb5a200f-184e-483c-94c0-cbf4e95dfc3c tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:22.097376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb5a200f-184e-483c-94c0-cbf4e95dfc3c tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Acquired lock "refresh_cache-d3c4f646-aa62-4629-9c15-e57a9058a04c" {{(pid=125884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 12:49:22.101749 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e5fc3af5-d5f1-4626-9111-a1021ae4c394 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.065089 Jul 25 12:49:22.102463 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1251/2593] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:49:22 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:22.119317 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-15e4b928-ee30-460a-95b5-eb97d9e28afa tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '.version_select at 0x7efcf8db7a60>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:22.165398 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-15e4b928-ee30-460a-95b5-eb97d9e28afa tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] HTTP exception thrown: Image not found. Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-15e4b928-ee30-460a-95b5-eb97d9e28afa tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Request method failure captured: Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/images/826826cb-5d37-4dfb-bfe6-7fc2953dfea3 HTTP/1.1 Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDaiP1mn9moxuV0sEhHjcxs4YL6Wxk-LuBvL9sVonTARIUb0VcjcYQ7ntJp6sU09-7y0ZY4v6v4uSXBdkSQ_CiPsK7WXJf7MhcmeBPhydkepNAywcsaes9TYKg1Cs1S98mShfAYCBZemu8j0o07ISZt2oaK0_iQPi_CmMif6E2gpQ0 Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_35482ec73a054bafa24c83aea2b08636", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}] Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: bedadaad3cf44edb8fd8037aebd2ee25 Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: exception: Image not found. Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '826826cb-5d37-4dfb-bfe6-7fc2953dfea3'} Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 826826cb-5d37-4dfb-bfe6-7fc2953dfea3 to delete Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 826826cb-5d37-4dfb-bfe6-7fc2953dfea3 could not be found. Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:22.167652 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-15e4b928-ee30-460a-95b5-eb97d9e28afa tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Returning 404 to user: Image not found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:49:22.172174 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-15e4b928-ee30-460a-95b5-eb97d9e28afa tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "DELETE /compute/v2.1/images/826826cb-5d37-4dfb-bfe6-7fc2953dfea3" status: 404 len: 62 microversion: 2.1 time: 0.065718 Jul 25 12:49:22.178522 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1252/2594] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:22 2022] DELETE /compute/v2.1/images/826826cb-5d37-4dfb-bfe6-7fc2953dfea3 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:49:22.186794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ec0a019c-8935-4f79-9ca4-7c0a247262a2 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Action: 'create', calling method: .version_select at 0x7efcf9916310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-347452589", "description": "tempest-description-613100128"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:23.412843 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ec0a019c-8935-4f79-9ca4-7c0a247262a2 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.233086 Jul 25 12:49:23.414959 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1253/2595] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:49:22 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:23.419919 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-828f73cb-e676-43f5-bda9-1a6e048a36bf tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:23.452576 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-828f73cb-e676-43f5-bda9-1a6e048a36bf tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/1366d1f5-93f9-4228-ace9-9e37f7fb4600" status: 204 len: 0 microversion: 2.1 time: 0.036348 Jul 25 12:49:23.453703 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1254/2596] 10.222.0.49 () {58 vars in 1266 bytes} [Mon Jul 25 12:49:23 2022] DELETE /compute/v2.1/os-server-groups/1366d1f5-93f9-4228-ace9-9e37f7fb4600 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:49:23.459340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-141f5bce-76c2-43f4-85a4-f00f6bfc73f3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:23.459869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-141f5bce-76c2-43f4-85a4-f00f6bfc73f3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:23.467275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-141f5bce-76c2-43f4-85a4-f00f6bfc73f3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:23.468589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-141f5bce-76c2-43f4-85a4-f00f6bfc73f3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:23.469466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-141f5bce-76c2-43f4-85a4-f00f6bfc73f3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:23.472179 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-141f5bce-76c2-43f4-85a4-f00f6bfc73f3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:23.493498 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-141f5bce-76c2-43f4-85a4-f00f6bfc73f3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] HTTP exception thrown: Instance 3f12fbbe-fd19-45f7-8693-36f61bc9db41 could not be found. Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-141f5bce-76c2-43f4-85a4-f00f6bfc73f3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Request method failure captured: Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 HTTP/1.1 Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDaiP1mn9moxuV0sEhHjcxs4YL6Wxk-LuBvL9sVonTARIUb0VcjcYQ7ntJp6sU09-7y0ZY4v6v4uSXBdkSQ_CiPsK7WXJf7MhcmeBPhydkepNAywcsaes9TYKg1Cs1S98mShfAYCBZemu8j0o07ISZt2oaK0_iQPi_CmMif6E2gpQ0 Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_35482ec73a054bafa24c83aea2b08636", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}] Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: bedadaad3cf44edb8fd8037aebd2ee25 Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 3f12fbbe-fd19-45f7-8693-36f61bc9db41 could not be found. Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '3f12fbbe-fd19-45f7-8693-36f61bc9db41'} Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f12fbbe-fd19-45f7-8693-36f61bc9db41 could not be found. Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:49:23.495998 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:49:23.501231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f12fbbe-fd19-45f7-8693-36f61bc9db41 could not be found. Jul 25 12:49:23.501231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:23.501231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:23.501231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:23.501231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:23.501231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:23.501231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:23.501231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:49:23.501231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:49:23.501231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f12fbbe-fd19-45f7-8693-36f61bc9db41 could not be found. Jul 25 12:49:23.501231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:23.505087 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-141f5bce-76c2-43f4-85a4-f00f6bfc73f3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Returning 404 to user: Instance 3f12fbbe-fd19-45f7-8693-36f61bc9db41 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:49:23.506700 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-141f5bce-76c2-43f4-85a4-f00f6bfc73f3 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 404 len: 111 microversion: 2.1 time: 0.051678 Jul 25 12:49:23.508813 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1255/2597] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:49:23 2022] DELETE /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:49:23.518399 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-703cd34b-a957-4c50-89ab-52bb31430f90 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Action: 'create', calling method: .version_select at 0x7efcf90095e0>, body: {"security_group_rule": {"parent_group_id": "b68413e9-a990-4d9f-a0cf-efe1fcbdd9d5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "8d4aa7b3-f603-4034-9157-4568543b5b45"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:24.467163 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-703cd34b-a957-4c50-89ab-52bb31430f90 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.956033 Jul 25 12:49:24.476360 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1256/2598] 10.222.0.49 () {60 vars in 1195 bytes} [Mon Jul 25 12:49:23 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:24.484178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cc21b512-8b77-4a0f-aaef-5aaa32d4bdda tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:24.502605 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cc21b512-8b77-4a0f-aaef-5aaa32d4bdda tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.024799 Jul 25 12:49:24.536588 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1257/2599] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:49:24 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:24.552137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1b0b91bb-77f5-477d-bb16-bd0665c48519 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:24.552764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1b0b91bb-77f5-477d-bb16-bd0665c48519 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: 3f12fbbe-fd19-45f7-8693-36f61bc9db41] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:24.559758 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b0b91bb-77f5-477d-bb16-bd0665c48519 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:24.560579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b0b91bb-77f5-477d-bb16-bd0665c48519 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:24.561620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b0b91bb-77f5-477d-bb16-bd0665c48519 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:24.562231 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b0b91bb-77f5-477d-bb16-bd0665c48519 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:24.577766 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-1b0b91bb-77f5-477d-bb16-bd0665c48519 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] HTTP exception thrown: Instance 3f12fbbe-fd19-45f7-8693-36f61bc9db41 could not be found. Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1b0b91bb-77f5-477d-bb16-bd0665c48519 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Request method failure captured: Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 HTTP/1.1 Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pDaiP1mn9moxuV0sEhHjcxs4YL6Wxk-LuBvL9sVonTARIUb0VcjcYQ7ntJp6sU09-7y0ZY4v6v4uSXBdkSQ_CiPsK7WXJf7MhcmeBPhydkepNAywcsaes9TYKg1Cs1S98mShfAYCBZemu8j0o07ISZt2oaK0_iQPi_CmMif6E2gpQ0 Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_35482ec73a054bafa24c83aea2b08636", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}] Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: bedadaad3cf44edb8fd8037aebd2ee25 Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 3f12fbbe-fd19-45f7-8693-36f61bc9db41 could not be found. Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '3f12fbbe-fd19-45f7-8693-36f61bc9db41'} Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f12fbbe-fd19-45f7-8693-36f61bc9db41 could not be found. Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f12fbbe-fd19-45f7-8693-36f61bc9db41 could not be found. Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:24.579410 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:24.583901 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:24.583901 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:24.583901 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:24.583901 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:24.583901 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:49:24.583901 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:49:24.583901 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f12fbbe-fd19-45f7-8693-36f61bc9db41 could not be found. Jul 25 12:49:24.583901 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:24.585242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1b0b91bb-77f5-477d-bb16-bd0665c48519 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Returning 404 to user: Instance 3f12fbbe-fd19-45f7-8693-36f61bc9db41 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:49:24.586353 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1b0b91bb-77f5-477d-bb16-bd0665c48519 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41" status: 404 len: 111 microversion: 2.1 time: 0.048729 Jul 25 12:49:24.590595 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1258/2600] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:24 2022] GET /compute/v2.1/servers/3f12fbbe-fd19-45f7-8693-36f61bc9db41 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:49:24.595810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c5b9a13e-4b82-439a-8f17-0e92ccf37eba tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Calling method '.version_select at 0x7efcf8dc6b80>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:24.943775 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-fb5a200f-184e-483c-94c0-cbf4e95dfc3c tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Building network info cache for instance {{(pid=125884) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 12:49:25.016128 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c5b9a13e-4b82-439a-8f17-0e92ccf37eba tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/8d4aa7b3-f603-4034-9157-4568543b5b45" status: 202 len: 0 microversion: 2.1 time: 0.423646 Jul 25 12:49:25.021124 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1259/2601] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:49:24 2022] DELETE /compute/v2.1/os-security-groups/8d4aa7b3-f603-4034-9157-4568543b5b45 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:49:25.028129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-75083f67-64c3-4560-9075-4984ce628bea tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Action: 'create', calling method: .version_select at 0x7efcf9009670>, body: {"server_group": {"name": "tempest-server-group-724811557", "policies": ["affinity"]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:25.087198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-75083f67-64c3-4560-9075-4984ce628bea tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_groups'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:49:25.106507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-75083f67-64c3-4560-9075-4984ce628bea tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for user 557df3df55844c1588203a9319158934 and project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_groups'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:49:25.212041 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-75083f67-64c3-4560-9075-4984ce628bea tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_groups'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:49:25.218672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-75083f67-64c3-4560-9075-4984ce628bea tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for user 557df3df55844c1588203a9319158934 and project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_groups'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:49:25.238771 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-75083f67-64c3-4560-9075-4984ce628bea tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.215729 Jul 25 12:49:25.239501 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1260/2602] 10.222.0.49 () {60 vars in 1173 bytes} [Mon Jul 25 12:49:25 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:25.244939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6e791b3c-37da-4b8a-b5e1-d6ddbca5cd98 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '.version_select at 0x7efcf8dcc790>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:25.292075 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6e791b3c-37da-4b8a-b5e1-d6ddbca5cd98 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-529475566" status: 202 len: 0 microversion: 2.1 time: 0.050861 Jul 25 12:49:25.294711 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1261/2603] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Jul 25 12:49:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-529475566 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:49:25.305365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-fecc8748-f790-4a2f-a117-de6ebfe53c01 req-070b29c0-b5b5-4482-9e18-04fbd6805fbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3c4f646-aa62-4629-9c15-e57a9058a04c", "tag": "14a08691-36d3-4ae2-aa10-f18a2799fbb3"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:25.316584 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fecc8748-f790-4a2f-a117-de6ebfe53c01 req-070b29c0-b5b5-4482-9e18-04fbd6805fbe service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:25.317675 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fecc8748-f790-4a2f-a117-de6ebfe53c01 req-070b29c0-b5b5-4482-9e18-04fbd6805fbe service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:25.334676 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-fecc8748-f790-4a2f-a117-de6ebfe53c01 req-070b29c0-b5b5-4482-9e18-04fbd6805fbe service nova] Creating event network-changed:14a08691-36d3-4ae2-aa10-f18a2799fbb3 for instance d3c4f646-aa62-4629-9c15-e57a9058a04c on n-h1-848886-15 Jul 25 12:49:25.343283 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-fecc8748-f790-4a2f-a117-de6ebfe53c01 req-070b29c0-b5b5-4482-9e18-04fbd6805fbe service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046747 Jul 25 12:49:25.344843 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1262/2604] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:25.353796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-41ae141d-a6e3-4bc0-a57e-a260c2bea47b tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Calling method '.version_select at 0x7efcf8e16940>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:25.603860 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-41ae141d-a6e3-4bc0-a57e-a260c2bea47b tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/b68413e9-a990-4d9f-a0cf-efe1fcbdd9d5" status: 200 len: 246 microversion: 2.1 time: 0.257097 Jul 25 12:49:25.604576 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1263/2605] 10.222.0.49 () {58 vars in 1269 bytes} [Mon Jul 25 12:49:25 2022] GET /compute/v2.1/os-security-groups/b68413e9-a990-4d9f-a0cf-efe1fcbdd9d5 => generated 246 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:25.609755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3e4f9622-5bd5-453e-a541-b043f2ebb15b tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:25.681968 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3e4f9622-5bd5-453e-a541-b043f2ebb15b tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/2309a287-2df1-4959-8ce8-f76d658be2ba" status: 204 len: 0 microversion: 2.1 time: 0.074829 Jul 25 12:49:25.683297 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1264/2606] 10.222.0.49 () {58 vars in 1266 bytes} [Mon Jul 25 12:49:25 2022] DELETE /compute/v2.1/os-server-groups/2309a287-2df1-4959-8ce8-f76d658be2ba => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:49:25.693338 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aa985c5b-7baf-4bb5-8568-3706d9949f4f tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Action: 'create', calling method: .version_select at 0x7efcf8dcc8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-686901195", "description": "tempest-description-1654995841"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:26.154157 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aa985c5b-7baf-4bb5-8568-3706d9949f4f tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.469456 Jul 25 12:49:26.155697 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1265/2607] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 12:49:25 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:26.161565 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7388835c-d864-4b3e-9909-6b06d4873cbc tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:26.186176 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7388835c-d864-4b3e-9909-6b06d4873cbc tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.028533 Jul 25 12:49:26.187018 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1266/2608] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:49:26 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:26.454620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-fb5a200f-184e-483c-94c0-cbf4e95dfc3c tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Updating instance_info_cache with network_info: [{"id": "14a08691-36d3-4ae2-aa10-f18a2799fbb3", "address": "fa:16:3e:56:54:b3", "network": {"id": "7d1be83b-0749-4f29-a888-d00c9f337335", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1624626287-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "777390f07e0c4d398c2a5916bc558ed2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap14a08691-36", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125884) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 12:49:26.480675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb5a200f-184e-483c-94c0-cbf4e95dfc3c tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Releasing lock "refresh_cache-d3c4f646-aa62-4629-9c15-e57a9058a04c" {{(pid=125884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 12:49:26.481687 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fb5a200f-184e-483c-94c0-cbf4e95dfc3c tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "POST /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c/action" status: 202 len: 0 microversion: 2.1 time: 4.493154 Jul 25 12:49:26.482489 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1343/2609] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:49:21 2022] POST /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c/action => generated 0 bytes in 4494 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 12:49:26.494661 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-87018cc7-5885-4fec-a363-fb52539cb03f tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Action: 'create', calling method: .version_select at 0x7efcfa1e71f0>, body: {"security_group_rule": {"parent_group_id": "11e05f33-5190-4e4c-afcd-4668f3d286ab", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:26.573165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-811dbbe8-01b4-4622-9ded-a79bae2774c7 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:26.588624 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-811dbbe8-01b4-4622-9ded-a79bae2774c7 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.400314 Jul 25 12:49:26.589800 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1267/2610] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:49:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:26.609251 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-08b9d4b0-570f-43f8-b2cd-07ced83dfe1c tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Action: 'create', calling method: .version_select at 0x7efcf8db78b0>, body: {"server_group": {"name": "tempest-server-group-678923644", "policies": ["anti-affinity"]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:26.647456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-08b9d4b0-570f-43f8-b2cd-07ced83dfe1c tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_groups'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:49:26.662352 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-08b9d4b0-570f-43f8-b2cd-07ced83dfe1c tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for user 557df3df55844c1588203a9319158934 and project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_groups'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:49:26.754127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-08b9d4b0-570f-43f8-b2cd-07ced83dfe1c tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_groups'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:49:26.777761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-08b9d4b0-570f-43f8-b2cd-07ced83dfe1c tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for user 557df3df55844c1588203a9319158934 and project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_groups'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:49:26.809064 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-08b9d4b0-570f-43f8-b2cd-07ced83dfe1c tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.217899 Jul 25 12:49:26.810428 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1268/2611] 10.222.0.49 () {60 vars in 1173 bytes} [Mon Jul 25 12:49:26 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:26.818738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0b1a99c2-2e30-495a-9555-51bb51e96390 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.181"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:26.824054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0b1a99c2-2e30-495a-9555-51bb51e96390 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:26.843415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0b1a99c2-2e30-495a-9555-51bb51e96390 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:26.844204 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0b1a99c2-2e30-495a-9555-51bb51e96390 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:26.846002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0b1a99c2-2e30-495a-9555-51bb51e96390 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:26.846630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0b1a99c2-2e30-495a-9555-51bb51e96390 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:26.879205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0b1a99c2-2e30-495a-9555-51bb51e96390 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Acquired lock "refresh_cache-3c7a7e2b-9643-44dc-91b8-d753b1d90944" {{(pid=125883) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 12:49:26.988697 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-87018cc7-5885-4fec-a363-fb52539cb03f tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.505057 Jul 25 12:49:26.989718 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1344/2612] 10.222.0.49 () {60 vars in 1195 bytes} [Mon Jul 25 12:49:26 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:26.995849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e803f892-40e3-4cf2-a684-74ef8fb9a84d tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:27.018468 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e803f892-40e3-4cf2-a684-74ef8fb9a84d tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] 10.222.0.49 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.027229 Jul 25 12:49:27.019053 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1345/2613] 10.222.0.49 () {58 vars in 1125 bytes} [Mon Jul 25 12:49:26 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:27.024070 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8d807bbf-ccdf-4b6f-86b0-409b018d8588 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:27.052665 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8d807bbf-ccdf-4b6f-86b0-409b018d8588 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/1c072a45-8905-4041-85fa-c80769e5e145" status: 204 len: 0 microversion: 2.1 time: 0.032451 Jul 25 12:49:27.053249 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1346/2614] 10.222.0.49 () {58 vars in 1266 bytes} [Mon Jul 25 12:49:27 2022] DELETE /compute/v2.1/os-server-groups/1c072a45-8905-4041-85fa-c80769e5e145 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:49:27.058930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4234fe22-7a26-4474-9ef5-2358ba6de7c4 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '.version_select at 0x7efcf91aba60>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:27.092626 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-4234fe22-7a26-4474-9ef5-2358ba6de7c4 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] HTTP exception thrown: Image not found. Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4234fe22-7a26-4474-9ef5-2358ba6de7c4 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Request method failure captured: Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/images/9b0bb492-2db9-4825-b199-c70810e15da6 HTTP/1.1 Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pDaiP1mn9moxuV0sEhHjcxs4YL6Wxk-LuBvL9sVonTARIUb0VcjcYQ7ntJp6sU09-7y0ZY4v6v4uSXBdkSQ_CiPsK7WXJf7MhcmeBPhydkepNAywcsaes9TYKg1Cs1S98mShfAYCBZemu8j0o07ISZt2oaK0_iQPi_CmMif6E2gpQ0 Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_35482ec73a054bafa24c83aea2b08636", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}] Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: bedadaad3cf44edb8fd8037aebd2ee25 Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: exception: Image not found. Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '9b0bb492-2db9-4825-b199-c70810e15da6'} Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9b0bb492-2db9-4825-b199-c70810e15da6 to delete Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9b0bb492-2db9-4825-b199-c70810e15da6 could not be found. Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:27.095066 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4234fe22-7a26-4474-9ef5-2358ba6de7c4 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Returning 404 to user: Image not found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:49:27.099688 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4234fe22-7a26-4474-9ef5-2358ba6de7c4 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "DELETE /compute/v2.1/images/9b0bb492-2db9-4825-b199-c70810e15da6" status: 404 len: 62 microversion: 2.1 time: 0.042325 Jul 25 12:49:27.101596 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1347/2615] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:27 2022] DELETE /compute/v2.1/images/9b0bb492-2db9-4825-b199-c70810e15da6 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:49:27.108717 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1ab649e4-ae62-4a3e-8514-aa112642a52d tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Action: 'create', calling method: .version_select at 0x7efcf917b5e0>, body: {"security_group_rule": {"parent_group_id": "11e05f33-5190-4e4c-afcd-4668f3d286ab", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:27.598556 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1ab649e4-ae62-4a3e-8514-aa112642a52d tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.495973 Jul 25 12:49:27.599503 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1348/2616] 10.222.0.49 () {60 vars in 1195 bytes} [Mon Jul 25 12:49:27 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:27.604972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1886b383-e3f1-4374-86d7-fc9c95bcd791 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:27.620657 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1886b383-e3f1-4374-86d7-fc9c95bcd791 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017019 Jul 25 12:49:27.621934 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1349/2617] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:49:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:27.630401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1b26d5bd-b255-4fb0-8288-a9435a79d7ae tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:27.662830 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1b26d5bd-b255-4fb0-8288-a9435a79d7ae tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.039312 Jul 25 12:49:27.664271 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1350/2618] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:49:27 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:27.671283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f0c08d12-6ed8-4519-b531-2c8d45b28486 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:27.672116 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f0c08d12-6ed8-4519-b531-2c8d45b28486 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:27.679521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f0c08d12-6ed8-4519-b531-2c8d45b28486 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:27.680832 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f0c08d12-6ed8-4519-b531-2c8d45b28486 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:27.681927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f0c08d12-6ed8-4519-b531-2c8d45b28486 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:27.682969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f0c08d12-6ed8-4519-b531-2c8d45b28486 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:27.702007 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:27.704354 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-f0c08d12-6ed8-4519-b531-2c8d45b28486 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] HTTP exception thrown: Instance aec454db-239e-49ed-a021-297e11579b04 could not be found. Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f0c08d12-6ed8-4519-b531-2c8d45b28486 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Request method failure captured: Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 HTTP/1.1 Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pDaiP1mn9moxuV0sEhHjcxs4YL6Wxk-LuBvL9sVonTARIUb0VcjcYQ7ntJp6sU09-7y0ZY4v6v4uSXBdkSQ_CiPsK7WXJf7MhcmeBPhydkepNAywcsaes9TYKg1Cs1S98mShfAYCBZemu8j0o07ISZt2oaK0_iQPi_CmMif6E2gpQ0 Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_35482ec73a054bafa24c83aea2b08636", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}] Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: bedadaad3cf44edb8fd8037aebd2ee25 Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance aec454db-239e-49ed-a021-297e11579b04 could not be found. Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'aec454db-239e-49ed-a021-297e11579b04'} Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aec454db-239e-49ed-a021-297e11579b04 could not be found. Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:49:27.706746 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:49:27.710583 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aec454db-239e-49ed-a021-297e11579b04 could not be found. Jul 25 12:49:27.710583 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:27.710583 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:27.710583 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:27.710583 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:27.710583 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:27.710583 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:27.710583 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:49:27.710583 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:49:27.710583 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aec454db-239e-49ed-a021-297e11579b04 could not be found. Jul 25 12:49:27.710583 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:27.712185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f0c08d12-6ed8-4519-b531-2c8d45b28486 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Returning 404 to user: Instance aec454db-239e-49ed-a021-297e11579b04 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:49:27.713361 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f0c08d12-6ed8-4519-b531-2c8d45b28486 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "DELETE /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 404 len: 111 microversion: 2.1 time: 0.047808 Jul 25 12:49:27.717549 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1351/2619] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:49:27 2022] DELETE /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:49:27.723658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a0a6446b-3fcd-4da7-a635-3febd2a7fd49 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Calling method '.version_select at 0x7efcf9141e50>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:27.925654 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a0a6446b-3fcd-4da7-a635-3febd2a7fd49 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/11e05f33-5190-4e4c-afcd-4668f3d286ab" status: 200 len: 664 microversion: 2.1 time: 0.206557 Jul 25 12:49:27.926326 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1352/2620] 10.222.0.49 () {58 vars in 1269 bytes} [Mon Jul 25 12:49:27 2022] GET /compute/v2.1/os-security-groups/11e05f33-5190-4e4c-afcd-4668f3d286ab => generated 664 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:27.939557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-146f97ad-65df-40d4-8a7f-415e0e6661ae tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:27.962416 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-146f97ad-65df-40d4-8a7f-415e0e6661ae tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031683 Jul 25 12:49:27.964012 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1353/2621] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:49:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:27.974993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ddae8f98-1c8c-4fd6-8d19-0783ff68cb53 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:27.975801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ddae8f98-1c8c-4fd6-8d19-0783ff68cb53 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] [instance: aec454db-239e-49ed-a021-297e11579b04] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:27.982920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ddae8f98-1c8c-4fd6-8d19-0783ff68cb53 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:27.983487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ddae8f98-1c8c-4fd6-8d19-0783ff68cb53 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:27.984274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ddae8f98-1c8c-4fd6-8d19-0783ff68cb53 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:27.984715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ddae8f98-1c8c-4fd6-8d19-0783ff68cb53 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:28.002538 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-ddae8f98-1c8c-4fd6-8d19-0783ff68cb53 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] HTTP exception thrown: Instance aec454db-239e-49ed-a021-297e11579b04 could not be found. Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ddae8f98-1c8c-4fd6-8d19-0783ff68cb53 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Request method failure captured: Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 HTTP/1.1 Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pDaiP1mn9moxuV0sEhHjcxs4YL6Wxk-LuBvL9sVonTARIUb0VcjcYQ7ntJp6sU09-7y0ZY4v6v4uSXBdkSQ_CiPsK7WXJf7MhcmeBPhydkepNAywcsaes9TYKg1Cs1S98mShfAYCBZemu8j0o07ISZt2oaK0_iQPi_CmMif6E2gpQ0 Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_35482ec73a054bafa24c83aea2b08636", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/35482ec73a054bafa24c83aea2b08636"}]}] Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 35482ec73a054bafa24c83aea2b08636 Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515 Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: bedadaad3cf44edb8fd8037aebd2ee25 Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1748441515-project Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance aec454db-239e-49ed-a021-297e11579b04 could not be found. Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'aec454db-239e-49ed-a021-297e11579b04'} Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aec454db-239e-49ed-a021-297e11579b04 could not be found. Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aec454db-239e-49ed-a021-297e11579b04 could not be found. Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:28.004349 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:28.012132 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:28.012132 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:28.012132 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:28.012132 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:28.012132 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:49:28.012132 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:49:28.012132 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aec454db-239e-49ed-a021-297e11579b04 could not be found. Jul 25 12:49:28.012132 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:28.012132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ddae8f98-1c8c-4fd6-8d19-0783ff68cb53 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] Returning 404 to user: Instance aec454db-239e-49ed-a021-297e11579b04 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:49:28.012132 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ddae8f98-1c8c-4fd6-8d19-0783ff68cb53 tempest-ImagesOneServerNegativeTestJSON-1748441515 tempest-ImagesOneServerNegativeTestJSON-1748441515-project] 10.222.0.49 "GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04" status: 404 len: 111 microversion: 2.1 time: 0.040585 Jul 25 12:49:28.012132 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1354/2622] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:27 2022] GET /compute/v2.1/servers/aec454db-239e-49ed-a021-297e11579b04 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:49:28.012132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6aabdb2f-8094-4851-81f5-d4afe8bb6752 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-57145525", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "4f61fa08-8902-46f2-a3f7-a1d865ba02a8"}]}, "os:scheduler_hints": {"group": "85dc53dd-42e2-41de-be66-a3ff9c3fca0a"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:28.079134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-6aabdb2f-8094-4851-81f5-d4afe8bb6752 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] validate_networks() for [('4f61fa08-8902-46f2-a3f7-a1d865ba02a8', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:49:29.498471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-6aabdb2f-8094-4851-81f5-d4afe8bb6752 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:49:29.501083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-6aabdb2f-8094-4851-81f5-d4afe8bb6752 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:49:29.501798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-6aabdb2f-8094-4851-81f5-d4afe8bb6752 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:49:29.502474 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-6aabdb2f-8094-4851-81f5-d4afe8bb6752 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:49:29.549678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-6aabdb2f-8094-4851-81f5-d4afe8bb6752 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:49:29.586494 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6aabdb2f-8094-4851-81f5-d4afe8bb6752 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:29.587213 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6aabdb2f-8094-4851-81f5-d4afe8bb6752 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:29.588213 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6aabdb2f-8094-4851-81f5-d4afe8bb6752 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:29.588849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6aabdb2f-8094-4851-81f5-d4afe8bb6752 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:29.627335 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-6aabdb2f-8094-4851-81f5-d4afe8bb6752 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:49:29.635253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-6aabdb2f-8094-4851-81f5-d4afe8bb6752 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for user 557df3df55844c1588203a9319158934 and project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:49:29.656752 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6aabdb2f-8094-4851-81f5-d4afe8bb6752 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:49:29.659725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6aabdb2f-8094-4851-81f5-d4afe8bb6752 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] [instance: 75942dad-aafa-4c5e-a8fc-daf088be1015] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:49:29.762398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-6aabdb2f-8094-4851-81f5-d4afe8bb6752 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_group_members'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:49:29.782708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-6aabdb2f-8094-4851-81f5-d4afe8bb6752 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for user 557df3df55844c1588203a9319158934 and project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_group_members'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:49:29.869042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-6aabdb2f-8094-4851-81f5-d4afe8bb6752 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_group_members'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:49:29.888794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-6aabdb2f-8094-4851-81f5-d4afe8bb6752 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Getting quotas for user 557df3df55844c1588203a9319158934 and project 5b6ebc431b4d48fabc48c7efb261aeda. Resources: {'server_group_members'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:49:29.966473 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6aabdb2f-8094-4851-81f5-d4afe8bb6752 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.958552 Jul 25 12:49:29.972103 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1355/2623] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:49:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:49:29.983907 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ddc9da49-6834-494f-9e92-7883a14ce9d2 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Calling method '.version_select at 0x7efcf9d0ad30>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:31.158288 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.network.neutron [None req-0b1a99c2-2e30-495a-9555-51bb51e96390 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] re-assign floating IP 172.25.7.181 from instance d3c4f646-aa62-4629-9c15-e57a9058a04c Jul 25 12:49:31.164703 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=92 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:31.282384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-0b1a99c2-2e30-495a-9555-51bb51e96390 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Building network info cache for instance {{(pid=125883) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 12:49:31.720427 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ddc9da49-6834-494f-9e92-7883a14ce9d2 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-group-rules/c47059f9-2750-4098-bc5b-d5feab681013" status: 202 len: 0 microversion: 2.1 time: 1.746787 Jul 25 12:49:31.722756 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1356/2624] 10.222.0.49 () {58 vars in 1287 bytes} [Mon Jul 25 12:49:29 2022] DELETE /compute/v2.1/os-security-group-rules/c47059f9-2750-4098-bc5b-d5feab681013 => generated 0 bytes in 1750 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:49:31.730215 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4ca307b6-b294-4a75-a567-2e3d03e91538 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:31.782881 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4ca307b6-b294-4a75-a567-2e3d03e91538 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.058650 Jul 25 12:49:31.798482 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1357/2625] 10.222.0.49 () {58 vars in 1165 bytes} [Mon Jul 25 12:49:31 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:31.806080 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1034ee3c-6757-48b8-8ecc-e9c5761057df tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:31.808370 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1034ee3c-6757-48b8-8ecc-e9c5761057df tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] [instance: 75942dad-aafa-4c5e-a8fc-daf088be1015] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:31.819759 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1034ee3c-6757-48b8-8ecc-e9c5761057df tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:31.820654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1034ee3c-6757-48b8-8ecc-e9c5761057df tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:31.821697 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1034ee3c-6757-48b8-8ecc-e9c5761057df tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:31.822306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1034ee3c-6757-48b8-8ecc-e9c5761057df tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:31.992352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1034ee3c-6757-48b8-8ecc-e9c5761057df tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557df3df55844c1588203a9319158934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6ebc431b4d48fabc48c7efb261aeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:32.000120 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1034ee3c-6757-48b8-8ecc-e9c5761057df tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015" status: 200 len: 1269 microversion: 2.1 time: 0.200030 Jul 25 12:49:32.001071 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1358/2626] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:31 2022] GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015 => generated 1269 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:32.006070 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-f6408f62-7b4b-47e8-9947-80569e23f281 req-db0a7c22-b9d9-484e-a79b-a085db1055b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3c4f646-aa62-4629-9c15-e57a9058a04c", "tag": "14a08691-36d3-4ae2-aa10-f18a2799fbb3"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:32.020362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f6408f62-7b4b-47e8-9947-80569e23f281 req-db0a7c22-b9d9-484e-a79b-a085db1055b5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:32.021157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f6408f62-7b4b-47e8-9947-80569e23f281 req-db0a7c22-b9d9-484e-a79b-a085db1055b5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:32.045268 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-f6408f62-7b4b-47e8-9947-80569e23f281 req-db0a7c22-b9d9-484e-a79b-a085db1055b5 service nova] Creating event network-changed:14a08691-36d3-4ae2-aa10-f18a2799fbb3 for instance d3c4f646-aa62-4629-9c15-e57a9058a04c on n-h1-848886-15 Jul 25 12:49:32.055582 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-f6408f62-7b4b-47e8-9947-80569e23f281 req-db0a7c22-b9d9-484e-a79b-a085db1055b5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051245 Jul 25 12:49:32.068092 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1359/2627] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:32.075039 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7c9353bc-96d6-4fc0-9941-5ae2b6e473af tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Calling method '.version_select at 0x7efcf91858b0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:33.148127 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7c9353bc-96d6-4fc0-9941-5ae2b6e473af tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/11e05f33-5190-4e4c-afcd-4668f3d286ab" status: 202 len: 0 microversion: 2.1 time: 1.077756 Jul 25 12:49:33.150319 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1360/2628] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:49:32 2022] DELETE /compute/v2.1/os-security-groups/11e05f33-5190-4e4c-afcd-4668f3d286ab => generated 0 bytes in 1081 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:49:33.160546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1ba0be50-bfc1-4179-9c52-3f38971e0543 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:33.181386 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1ba0be50-bfc1-4179-9c52-3f38971e0543 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025358 Jul 25 12:49:33.182345 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1361/2629] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:49:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:33.192534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6ac93ddd-9b25-4014-806b-3f2f94886ac5 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:33.196756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6ac93ddd-9b25-4014-806b-3f2f94886ac5 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] [instance: 75942dad-aafa-4c5e-a8fc-daf088be1015] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:33.217865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ac93ddd-9b25-4014-806b-3f2f94886ac5 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:33.218541 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ac93ddd-9b25-4014-806b-3f2f94886ac5 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:33.219550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ac93ddd-9b25-4014-806b-3f2f94886ac5 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:33.223795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ac93ddd-9b25-4014-806b-3f2f94886ac5 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:33.282966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-0b1a99c2-2e30-495a-9555-51bb51e96390 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Updating instance_info_cache with network_info: [{"id": "14a08691-36d3-4ae2-aa10-f18a2799fbb3", "address": "fa:16:3e:56:54:b3", "network": {"id": "7d1be83b-0749-4f29-a888-d00c9f337335", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1624626287-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "777390f07e0c4d398c2a5916bc558ed2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap14a08691-36", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125883) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 12:49:33.309528 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-0b1a99c2-2e30-495a-9555-51bb51e96390 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] Building network info cache for instance {{(pid=125883) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 12:49:34.570549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6ac93ddd-9b25-4014-806b-3f2f94886ac5 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557df3df55844c1588203a9319158934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6ebc431b4d48fabc48c7efb261aeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:34.587015 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6ac93ddd-9b25-4014-806b-3f2f94886ac5 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015" status: 200 len: 1311 microversion: 2.1 time: 1.403347 Jul 25 12:49:34.603684 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1362/2630] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:33 2022] GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015 => generated 1311 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:34.633635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bb4f6681-f2b2-4a12-b25e-d0047118f304 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Calling method '.version_select at 0x7efcf91b13a0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:34.708132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG neutronclient.v2_0.client [None req-bb4f6681-f2b2-4a12-b25e-d0047118f304 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8d4aa7b3-f603-4034-9157-4568543b5b45 does not exist", "detail": ""}} {{(pid=125884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:49:34.709479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.security_group_api [None req-bb4f6681-f2b2-4a12-b25e-d0047118f304 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Neutron security group 8d4aa7b3-f603-4034-9157-4568543b5b45 not found {{(pid=125884) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 12:49:34.710188 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-bb4f6681-f2b2-4a12-b25e-d0047118f304 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] HTTP exception thrown: Security group 8d4aa7b3-f603-4034-9157-4568543b5b45 does not exist Jul 25 12:49:34.710188 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-7ee8888c-1925-4833-af77-c51cd419c1aa'] Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bb4f6681-f2b2-4a12-b25e-d0047118f304 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Request method failure captured: Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/os-security-groups/8d4aa7b3-f603-4034-9157-4568543b5b45 HTTP/1.1 Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pFFFDqH5vpXnbdgv4WslPU10gr8ORYis1db_KnvtWfBYc4wXz-vHGH0wAIlDAbPINK_iMIldflc41vSOZleHGufNvY2Lsnm66SxeFRxVVAvdjCdjpWD-XX7GAlEy5TfXIVuCAzFdGlGW9zDJC2dnleBkgFfyWzCWjcLxovj_DQVTus Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 04d0664923a148dd8f8420797c1697b3 Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1554072369 Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_04d0664923a148dd8f8420797c1697b3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/04d0664923a148dd8f8420797c1697b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04d0664923a148dd8f8420797c1697b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04d0664923a148dd8f8420797c1697b3"}]}] Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1554072369 Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 04d0664923a148dd8f8420797c1697b3 Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1554072369 Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-SecurityGroupRulesTestJSON-1554072369-project Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 4f8fb468a7e64f628f2aed8618b4b097 Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1554072369-project Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: exception: Security group 8d4aa7b3-f603-4034-9157-4568543b5b45 does not exist Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-7ee8888c-1925-4833-af77-c51cd419c1aa'] Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '8d4aa7b3-f603-4034-9157-4568543b5b45'} Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:49:34.712446 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8d4aa7b3-f603-4034-9157-4568543b5b45 does not exist Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ee8888c-1925-4833-af77-c51cd419c1aa'] Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8d4aa7b3-f603-4034-9157-4568543b5b45 does not exist Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ee8888c-1925-4833-af77-c51cd419c1aa'] Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8d4aa7b3-f603-4034-9157-4568543b5b45 does not exist Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ee8888c-1925-4833-af77-c51cd419c1aa'] Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8d4aa7b3-f603-4034-9157-4568543b5b45 does not exist Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ee8888c-1925-4833-af77-c51cd419c1aa'] Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bb4f6681-f2b2-4a12-b25e-d0047118f304 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Returning 404 to user: Security group 8d4aa7b3-f603-4034-9157-4568543b5b45 does not exist Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-7ee8888c-1925-4833-af77-c51cd419c1aa'] {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bb4f6681-f2b2-4a12-b25e-d0047118f304 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/8d4aa7b3-f603-4034-9157-4568543b5b45" status: 404 len: 194 microversion: 2.1 time: 0.109085 Jul 25 12:49:34.718356 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1363/2631] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:49:34 2022] DELETE /compute/v2.1/os-security-groups/8d4aa7b3-f603-4034-9157-4568543b5b45 => generated 194 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:49:34.729198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4ae1a80a-7f3c-46ba-b8d7-790c5e9a8b88 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:34.774842 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4ae1a80a-7f3c-46ba-b8d7-790c5e9a8b88 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.055963 Jul 25 12:49:34.775515 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1364/2632] 10.222.0.49 () {58 vars in 1169 bytes} [Mon Jul 25 12:49:34 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:34.783798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-2cdfa9d9-46aa-47d8-83bd-fc78e13ce151 req-23451ee4-d568-468d-81ab-9e49e2abaf59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c7a7e2b-9643-44dc-91b8-d753b1d90944", "tag": "90dd5757-925f-4846-8df1-a75d5939d05f"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:34.795231 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-2cdfa9d9-46aa-47d8-83bd-fc78e13ce151 req-23451ee4-d568-468d-81ab-9e49e2abaf59 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:34.795688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-2cdfa9d9-46aa-47d8-83bd-fc78e13ce151 req-23451ee4-d568-468d-81ab-9e49e2abaf59 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:34.817293 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-2cdfa9d9-46aa-47d8-83bd-fc78e13ce151 req-23451ee4-d568-468d-81ab-9e49e2abaf59 service nova] Creating event network-changed:90dd5757-925f-4846-8df1-a75d5939d05f for instance 3c7a7e2b-9643-44dc-91b8-d753b1d90944 on n-h2-848886-15 Jul 25 12:49:34.833431 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-2cdfa9d9-46aa-47d8-83bd-fc78e13ce151 req-23451ee4-d568-468d-81ab-9e49e2abaf59 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056580 Jul 25 12:49:34.834954 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1365/2633] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:34.840987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5114ff3f-4414-44ce-aa43-2d352d289790 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Calling method '.version_select at 0x7efcfa1e7e50>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:35.658802 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5114ff3f-4414-44ce-aa43-2d352d289790 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/b68413e9-a990-4d9f-a0cf-efe1fcbdd9d5" status: 202 len: 0 microversion: 2.1 time: 0.821735 Jul 25 12:49:35.663229 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1366/2634] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:49:34 2022] DELETE /compute/v2.1/os-security-groups/b68413e9-a990-4d9f-a0cf-efe1fcbdd9d5 => generated 0 bytes in 827 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:49:35.670263 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-272b74a2-524d-48e1-856e-6d95686f9f61 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:35.714030 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-272b74a2-524d-48e1-856e-6d95686f9f61 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.043694 Jul 25 12:49:35.714895 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1367/2635] 10.222.0.49 () {58 vars in 1161 bytes} [Mon Jul 25 12:49:35 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:35.742970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b979f7dc-cb04-456d-9aca-2ab61c6955e5 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:35.744380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b979f7dc-cb04-456d-9aca-2ab61c6955e5 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] [instance: 75942dad-aafa-4c5e-a8fc-daf088be1015] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:35.760863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b979f7dc-cb04-456d-9aca-2ab61c6955e5 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:35.761794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b979f7dc-cb04-456d-9aca-2ab61c6955e5 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:35.765232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b979f7dc-cb04-456d-9aca-2ab61c6955e5 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:35.766432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b979f7dc-cb04-456d-9aca-2ab61c6955e5 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:35.918982 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-0b1a99c2-2e30-495a-9555-51bb51e96390 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] Updating instance_info_cache with network_info: [{"id": "90dd5757-925f-4846-8df1-a75d5939d05f", "address": "fa:16:3e:a2:8e:ee", "network": {"id": "7d1be83b-0749-4f29-a888-d00c9f337335", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1624626287-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "777390f07e0c4d398c2a5916bc558ed2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap90dd5757-92", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125883) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 12:49:35.939816 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0b1a99c2-2e30-495a-9555-51bb51e96390 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Releasing lock "refresh_cache-3c7a7e2b-9643-44dc-91b8-d753b1d90944" {{(pid=125883) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 12:49:35.940875 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0b1a99c2-2e30-495a-9555-51bb51e96390 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "POST /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944/action" status: 202 len: 0 microversion: 2.1 time: 9.128807 Jul 25 12:49:35.942604 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1269/2636] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:49:26 2022] POST /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944/action => generated 0 bytes in 9131 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 12:49:35.960483 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-27a10d7b-b272-4fe9-b45b-372656ea5c7d tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Calling method '.version_select at 0x7efcfecbaca0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:36.242282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b979f7dc-cb04-456d-9aca-2ab61c6955e5 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557df3df55844c1588203a9319158934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6ebc431b4d48fabc48c7efb261aeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:36.256035 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b979f7dc-cb04-456d-9aca-2ab61c6955e5 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015" status: 200 len: 1311 microversion: 2.1 time: 0.535194 Jul 25 12:49:36.262898 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1368/2637] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:35 2022] GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015 => generated 1311 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:36.269118 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bb5a6005-8683-4706-952a-554781681b60 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:36.291841 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bb5a6005-8683-4706-952a-554781681b60 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027265 Jul 25 12:49:36.294263 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1369/2638] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:49:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:36.309070 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5daea1e1-d11a-4ab5-9dbf-eca2bf277657 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.181"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:36.669308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5daea1e1-d11a-4ab5-9dbf-eca2bf277657 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:36.679132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5daea1e1-d11a-4ab5-9dbf-eca2bf277657 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:36.679967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5daea1e1-d11a-4ab5-9dbf-eca2bf277657 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:36.681140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5daea1e1-d11a-4ab5-9dbf-eca2bf277657 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:36.681751 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5daea1e1-d11a-4ab5-9dbf-eca2bf277657 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:36.801530 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-27a10d7b-b272-4fe9-b45b-372656ea5c7d tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/7e3f461a-bf37-42f7-bd13-d4f8c90774be" status: 202 len: 0 microversion: 2.1 time: 0.853221 Jul 25 12:49:36.805786 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1270/2639] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:49:35 2022] DELETE /compute/v2.1/os-security-groups/7e3f461a-bf37-42f7-bd13-d4f8c90774be => generated 0 bytes in 859 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:49:36.805786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=16 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:36.809419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0a0d6824-e37d-4b93-ada6-4623346727ce tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:36.852727 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0a0d6824-e37d-4b93-ada6-4623346727ce tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.048920 Jul 25 12:49:36.853672 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1271/2640] 10.222.0.49 () {58 vars in 1167 bytes} [Mon Jul 25 12:49:36 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:36.858602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-40784a5a-7a94-4de8-a375-2807a6844be7 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Calling method '.version_select at 0x7efcf96d2d30>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:37.113632 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-5daea1e1-d11a-4ab5-9dbf-eca2bf277657 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] HTTP exception thrown: Floating IP 172.25.7.181 is not associated with instance d3c4f646-aa62-4629-9c15-e57a9058a04c. Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5daea1e1-d11a-4ab5-9dbf-eca2bf277657 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Request method failure captured: Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c/action HTTP/1.1 Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 49 Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pEdPxLidVhBnd_LOUsOJoc4JrCV846K-9JWCECDvLZlmuOtyZlf7TST2jJcxRJd7hH2Q1bjeXfYThvuP1XszDnp3e8YmokdWUeIfsBjHvZPCL31qWxu6liL7TI3jFv9RKwAuRx21c0KIicv58xWMWsOLhNK8IKy5Ton-idxSsG-mQo Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 777390f07e0c4d398c2a5916bc558ed2 Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1038886839 Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_777390f07e0c4d398c2a5916bc558ed2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/777390f07e0c4d398c2a5916bc558ed2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/777390f07e0c4d398c2a5916bc558ed2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/777390f07e0c4d398c2a5916bc558ed2"}]}] Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1038886839 Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 777390f07e0c4d398c2a5916bc558ed2 Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1038886839 Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-FloatingIPsAssociationTestJSON-1038886839-project Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 8245528326d34330ae7f790ef6b0b62b Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1038886839-project Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: {"removeFloatingIp": {"address": "172.25.7.181"}} Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: exception: Floating IP 172.25.7.181 is not associated with instance d3c4f646-aa62-4629-9c15-e57a9058a04c. Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'd3c4f646-aa62-4629-9c15-e57a9058a04c', 'body': {'removeFloatingIp': {'address': '172.25.7.181'}}} Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.7.181 is not associated with instance d3c4f646-aa62-4629-9c15-e57a9058a04c. Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.7.181 is not associated with instance d3c4f646-aa62-4629-9c15-e57a9058a04c. Jul 25 12:49:37.115958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:37.120979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5daea1e1-d11a-4ab5-9dbf-eca2bf277657 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Returning 409 to user: Floating IP 172.25.7.181 is not associated with instance d3c4f646-aa62-4629-9c15-e57a9058a04c. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:49:37.122223 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5daea1e1-d11a-4ab5-9dbf-eca2bf277657 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "POST /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c/action" status: 409 len: 146 microversion: 2.1 time: 0.822916 Jul 25 12:49:37.127657 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1370/2641] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:49:36 2022] POST /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c/action => generated 146 bytes in 833 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:49:37.136503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-25e6ef4f-6e9d-41b8-9275-46b6ef2dbe4a tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:37.143035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=6,nova_api:INSERT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:37.163926 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-25e6ef4f-6e9d-41b8-9275-46b6ef2dbe4a tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034776 Jul 25 12:49:37.165290 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1371/2642] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:49:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:37.173570 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-a658821d-7780-4eab-9930-a963a4a56af9 req-8e25c7ab-9a11-4473-aec5-8b9dc4e039ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75942dad-aafa-4c5e-a8fc-daf088be1015", "tag": "0d4e04b2-e8e5-4992-8430-71e37ead3af5"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:37.196841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a658821d-7780-4eab-9930-a963a4a56af9 req-8e25c7ab-9a11-4473-aec5-8b9dc4e039ed service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:37.207946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a658821d-7780-4eab-9930-a963a4a56af9 req-8e25c7ab-9a11-4473-aec5-8b9dc4e039ed service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:37.243304 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-a658821d-7780-4eab-9930-a963a4a56af9 req-8e25c7ab-9a11-4473-aec5-8b9dc4e039ed service nova] Creating event network-changed:0d4e04b2-e8e5-4992-8430-71e37ead3af5 for instance 75942dad-aafa-4c5e-a8fc-daf088be1015 on n-h1-848886-15 Jul 25 12:49:37.255327 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-a658821d-7780-4eab-9930-a963a4a56af9 req-8e25c7ab-9a11-4473-aec5-8b9dc4e039ed service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088346 Jul 25 12:49:37.256407 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1372/2643] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:37.266137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8bb9e9ea-c445-4ab3-98a8-2fa7555f736a tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.181"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:37.695734 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8bb9e9ea-c445-4ab3-98a8-2fa7555f736a tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:37.703939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8bb9e9ea-c445-4ab3-98a8-2fa7555f736a tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:37.704641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8bb9e9ea-c445-4ab3-98a8-2fa7555f736a tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:37.706177 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8bb9e9ea-c445-4ab3-98a8-2fa7555f736a tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:37.708622 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8bb9e9ea-c445-4ab3-98a8-2fa7555f736a tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:37.726711 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-40784a5a-7a94-4de8-a375-2807a6844be7 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/40d23536-c70f-4234-979b-b17f49b93494" status: 202 len: 0 microversion: 2.1 time: 0.871819 Jul 25 12:49:37.727770 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1272/2644] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:49:36 2022] DELETE /compute/v2.1/os-security-groups/40d23536-c70f-4234-979b-b17f49b93494 => generated 0 bytes in 873 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:49:37.738291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-65a85135-5fe8-4f4e-a182-8c1e296a2d91 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:37.829955 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-65a85135-5fe8-4f4e-a182-8c1e296a2d91 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] 10.222.0.49 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.099874 Jul 25 12:49:37.830789 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1273/2645] 10.222.0.49 () {58 vars in 1144 bytes} [Mon Jul 25 12:49:37 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:37.838271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-de365006-f0a6-4b7f-b62d-1b08371bbb30 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:37.839348 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-de365006-f0a6-4b7f-b62d-1b08371bbb30 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] [instance: 75942dad-aafa-4c5e-a8fc-daf088be1015] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:37.844152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=7,nova_api:INSERT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:37.850213 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de365006-f0a6-4b7f-b62d-1b08371bbb30 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:37.851721 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de365006-f0a6-4b7f-b62d-1b08371bbb30 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:37.853861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de365006-f0a6-4b7f-b62d-1b08371bbb30 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:37.856942 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de365006-f0a6-4b7f-b62d-1b08371bbb30 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:38.256471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8bb9e9ea-c445-4ab3-98a8-2fa7555f736a tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Acquired lock "refresh_cache-3c7a7e2b-9643-44dc-91b8-d753b1d90944" {{(pid=125884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 12:49:38.368727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-de365006-f0a6-4b7f-b62d-1b08371bbb30 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557df3df55844c1588203a9319158934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6ebc431b4d48fabc48c7efb261aeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:38.382347 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-de365006-f0a6-4b7f-b62d-1b08371bbb30 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015" status: 200 len: 1311 microversion: 2.1 time: 0.548357 Jul 25 12:49:38.384736 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1274/2646] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:37 2022] GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015 => generated 1311 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:38.404396 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-062a09c4-a32e-4cc2-871b-bfcef5a0aaf5 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Calling method '.version_select at 0x7efcf9014280>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:39.603457 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:39.909537 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=38 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:39.969245 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-062a09c4-a32e-4cc2-871b-bfcef5a0aaf5 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/242ecab3-ff29-4c41-81d5-be58df580312" status: 202 len: 0 microversion: 2.1 time: 1.582067 Jul 25 12:49:39.969866 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1275/2647] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:49:38 2022] DELETE /compute/v2.1/os-security-groups/242ecab3-ff29-4c41-81d5-be58df580312 => generated 0 bytes in 1585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:49:39.975687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-390ff920-78b2-4895-9b07-b581dfa80a45 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:39.989324 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-390ff920-78b2-4895-9b07-b581dfa80a45 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018345 Jul 25 12:49:39.996186 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1276/2648] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:49:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:40.005391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-110a3b38-6ad9-492d-a8dc-5944bebe02ff tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:40.006040 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-110a3b38-6ad9-492d-a8dc-5944bebe02ff tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] [instance: 75942dad-aafa-4c5e-a8fc-daf088be1015] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:40.031606 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-110a3b38-6ad9-492d-a8dc-5944bebe02ff tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:40.036512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-110a3b38-6ad9-492d-a8dc-5944bebe02ff tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:40.037979 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-110a3b38-6ad9-492d-a8dc-5944bebe02ff tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:40.046723 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-110a3b38-6ad9-492d-a8dc-5944bebe02ff tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:40.551326 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-8bb9e9ea-c445-4ab3-98a8-2fa7555f736a tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] Building network info cache for instance {{(pid=125884) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 12:49:40.585464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-110a3b38-6ad9-492d-a8dc-5944bebe02ff tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557df3df55844c1588203a9319158934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6ebc431b4d48fabc48c7efb261aeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:40.595347 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-110a3b38-6ad9-492d-a8dc-5944bebe02ff tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015" status: 200 len: 1311 microversion: 2.1 time: 0.593765 Jul 25 12:49:40.596609 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1277/2649] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:39 2022] GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015 => generated 1311 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:40.603223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-19e91142-d8f0-4c7a-88ff-d7a5bbe963f0 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] Calling method '.version_select at 0x7efcf96d2550>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:41.108506 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-19e91142-d8f0-4c7a-88ff-d7a5bbe963f0 tempest-SecurityGroupRulesTestJSON-1554072369 tempest-SecurityGroupRulesTestJSON-1554072369-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/b405d876-049f-4ac8-ad04-6b778615e359" status: 202 len: 0 microversion: 2.1 time: 0.510421 Jul 25 12:49:41.109157 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1278/2650] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:49:40 2022] DELETE /compute/v2.1/os-security-groups/b405d876-049f-4ac8-ad04-6b778615e359 => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:49:41.118606 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-454fc1f5-f8f0-4fee-aa4f-43dc7a71424e tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:41.187061 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-454fc1f5-f8f0-4fee-aa4f-43dc7a71424e tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] 10.222.0.49 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.071156 Jul 25 12:49:41.188330 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1279/2651] 10.222.0.49 () {58 vars in 1148 bytes} [Mon Jul 25 12:49:41 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:41.198810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-a93f66d2-f192-40d3-abfb-58d6ab13954d req-98ef8378-d8cb-4ba2-9703-0078f4aedf2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c7a7e2b-9643-44dc-91b8-d753b1d90944", "tag": "90dd5757-925f-4846-8df1-a75d5939d05f"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:41.232262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a93f66d2-f192-40d3-abfb-58d6ab13954d req-98ef8378-d8cb-4ba2-9703-0078f4aedf2f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:41.237104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a93f66d2-f192-40d3-abfb-58d6ab13954d req-98ef8378-d8cb-4ba2-9703-0078f4aedf2f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:41.269764 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-a93f66d2-f192-40d3-abfb-58d6ab13954d req-98ef8378-d8cb-4ba2-9703-0078f4aedf2f service nova] Creating event network-changed:90dd5757-925f-4846-8df1-a75d5939d05f for instance 3c7a7e2b-9643-44dc-91b8-d753b1d90944 on n-h2-848886-15 Jul 25 12:49:41.282925 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-a93f66d2-f192-40d3-abfb-58d6ab13954d req-98ef8378-d8cb-4ba2-9703-0078f4aedf2f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093001 Jul 25 12:49:41.285933 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1280/2652] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:41.299808 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-96c87927-f043-4b3f-815f-9dcf0de900ab tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:41.335263 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-96c87927-f043-4b3f-815f-9dcf0de900ab tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] 10.222.0.49 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.047067 Jul 25 12:49:41.336415 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1281/2653] 10.222.0.49 () {58 vars in 1140 bytes} [Mon Jul 25 12:49:41 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:41.349190 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-060c6877-116c-4bf0-ba2e-cb9187079081 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:41.381538 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-060c6877-116c-4bf0-ba2e-cb9187079081 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035438 Jul 25 12:49:41.390933 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1282/2654] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:49:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:41.407631 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-caaa3842-b0aa-4a6e-b61f-570cdc594176 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:41.465659 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-caaa3842-b0aa-4a6e-b61f-570cdc594176 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] 10.222.0.49 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.068907 Jul 25 12:49:41.476235 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1283/2655] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:49:41 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:41.481636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b39e8fe2-9114-4a81-91b3-b8820d7d462e tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:41.519546 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b39e8fe2-9114-4a81-91b3-b8820d7d462e tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041867 Jul 25 12:49:41.520174 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1284/2656] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:49:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:49:41.540503 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5a7d2090-817a-4434-a10c-939d495dd498 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:41.551673 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5a7d2090-817a-4434-a10c-939d495dd498 tempest-FlavorsV2TestJSON-76022694 tempest-FlavorsV2TestJSON-76022694-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016306 Jul 25 12:49:41.553938 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1285/2657] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:49:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:41.624150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ca48c759-289b-4094-a440-c678d767ce06 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:41.625092 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ca48c759-289b-4094-a440-c678d767ce06 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] [instance: 75942dad-aafa-4c5e-a8fc-daf088be1015] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:41.638858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca48c759-289b-4094-a440-c678d767ce06 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:41.642406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca48c759-289b-4094-a440-c678d767ce06 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:41.643340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca48c759-289b-4094-a440-c678d767ce06 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:41.645038 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca48c759-289b-4094-a440-c678d767ce06 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:41.650643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-8bb9e9ea-c445-4ab3-98a8-2fa7555f736a tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] Updating instance_info_cache with network_info: [{"id": "90dd5757-925f-4846-8df1-a75d5939d05f", "address": "fa:16:3e:a2:8e:ee", "network": {"id": "7d1be83b-0749-4f29-a888-d00c9f337335", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1624626287-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "777390f07e0c4d398c2a5916bc558ed2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap90dd5757-92", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125884) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 12:49:41.676548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8bb9e9ea-c445-4ab3-98a8-2fa7555f736a tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Releasing lock "refresh_cache-3c7a7e2b-9643-44dc-91b8-d753b1d90944" {{(pid=125884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 12:49:41.678182 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8bb9e9ea-c445-4ab3-98a8-2fa7555f736a tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "POST /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944/action" status: 202 len: 0 microversion: 2.1 time: 4.417894 Jul 25 12:49:41.684349 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1373/2658] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:49:37 2022] POST /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944/action => generated 0 bytes in 4426 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 12:49:41.696965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2dd78121-0174-414f-9b46-b3e05328c8d1 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:41.698579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2dd78121-0174-414f-9b46-b3e05328c8d1 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:41.717803 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2dd78121-0174-414f-9b46-b3e05328c8d1 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:41.725219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2dd78121-0174-414f-9b46-b3e05328c8d1 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:41.728579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2dd78121-0174-414f-9b46-b3e05328c8d1 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:41.730255 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2dd78121-0174-414f-9b46-b3e05328c8d1 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:41.839486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2dd78121-0174-414f-9b46-b3e05328c8d1 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:49:42.064403 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2dd78121-0174-414f-9b46-b3e05328c8d1 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944" status: 204 len: 0 microversion: 2.1 time: 0.378083 Jul 25 12:49:42.065143 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1374/2659] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:49:41 2022] DELETE /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:49:42.078403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ca48c759-289b-4094-a440-c678d767ce06 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557df3df55844c1588203a9319158934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6ebc431b4d48fabc48c7efb261aeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:42.079447 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e9e66646-99cc-4cf0-8181-6da53f191b9a tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.181"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:42.084115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e9e66646-99cc-4cf0-8181-6da53f191b9a tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:42.094680 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9e66646-99cc-4cf0-8181-6da53f191b9a tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:42.095286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9e66646-99cc-4cf0-8181-6da53f191b9a tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:42.096389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9e66646-99cc-4cf0-8181-6da53f191b9a tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:42.097107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9e66646-99cc-4cf0-8181-6da53f191b9a tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:42.116352 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ca48c759-289b-4094-a440-c678d767ce06 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015" status: 200 len: 1311 microversion: 2.1 time: 0.494355 Jul 25 12:49:42.116352 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1286/2660] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:41 2022] GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015 => generated 1311 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:42.181849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9e66646-99cc-4cf0-8181-6da53f191b9a tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Acquired lock "refresh_cache-d3c4f646-aa62-4629-9c15-e57a9058a04c" {{(pid=125884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 12:49:43.137331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6959cec7-3428-4256-a371-bf2d02063453 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:43.138458 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6959cec7-3428-4256-a371-bf2d02063453 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] [instance: 75942dad-aafa-4c5e-a8fc-daf088be1015] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:43.146307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6959cec7-3428-4256-a371-bf2d02063453 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:43.146865 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6959cec7-3428-4256-a371-bf2d02063453 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:43.147877 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6959cec7-3428-4256-a371-bf2d02063453 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:43.148499 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6959cec7-3428-4256-a371-bf2d02063453 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:43.688562 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6959cec7-3428-4256-a371-bf2d02063453 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557df3df55844c1588203a9319158934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6ebc431b4d48fabc48c7efb261aeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:43.696430 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6959cec7-3428-4256-a371-bf2d02063453 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015" status: 200 len: 1311 microversion: 2.1 time: 0.562963 Jul 25 12:49:43.711806 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1287/2661] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:43 2022] GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015 => generated 1311 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:44.720102 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4ca0cd8e-7020-4d27-8d0b-904c4eecf540 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:44.720761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4ca0cd8e-7020-4d27-8d0b-904c4eecf540 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] [instance: 75942dad-aafa-4c5e-a8fc-daf088be1015] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:44.735046 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ca0cd8e-7020-4d27-8d0b-904c4eecf540 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:44.737979 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ca0cd8e-7020-4d27-8d0b-904c4eecf540 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:44.742191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ca0cd8e-7020-4d27-8d0b-904c4eecf540 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:44.742976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ca0cd8e-7020-4d27-8d0b-904c4eecf540 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:45.843661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4ca0cd8e-7020-4d27-8d0b-904c4eecf540 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557df3df55844c1588203a9319158934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6ebc431b4d48fabc48c7efb261aeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:45.856798 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4ca0cd8e-7020-4d27-8d0b-904c4eecf540 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015" status: 200 len: 1311 microversion: 2.1 time: 1.140548 Jul 25 12:49:45.860061 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1288/2662] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:44 2022] GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015 => generated 1311 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:49:46.063066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f915d0b4-d9d8-4491-95b2-523082f521ee tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-2007187905", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:46.144973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-f915d0b4-d9d8-4491-95b2-523082f521ee tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] validate_networks() for None {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:49:46.226248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-e9e66646-99cc-4cf0-8181-6da53f191b9a tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Building network info cache for instance {{(pid=125884) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 12:49:47.346524 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-f915d0b4-d9d8-4491-95b2-523082f521ee tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:49:47.349393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-f915d0b4-d9d8-4491-95b2-523082f521ee tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:49:47.352114 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-f915d0b4-d9d8-4491-95b2-523082f521ee tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:49:47.352566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-f915d0b4-d9d8-4491-95b2-523082f521ee tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:49:47.355717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-f915d0b4-d9d8-4491-95b2-523082f521ee tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:49:47.396067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f915d0b4-d9d8-4491-95b2-523082f521ee tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:47.396530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f915d0b4-d9d8-4491-95b2-523082f521ee tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:47.397506 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f915d0b4-d9d8-4491-95b2-523082f521ee tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:47.398280 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f915d0b4-d9d8-4491-95b2-523082f521ee tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:47.429698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-f915d0b4-d9d8-4491-95b2-523082f521ee tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Getting quotas for project 8a7cbbf76c3f4848b4a558de341ec19d. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:49:47.437495 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-f915d0b4-d9d8-4491-95b2-523082f521ee tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Getting quotas for user a17c9f43612c483ba96eb09787b4dd47 and project 8a7cbbf76c3f4848b4a558de341ec19d. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:49:47.464271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f915d0b4-d9d8-4491-95b2-523082f521ee tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:49:47.472345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f915d0b4-d9d8-4491-95b2-523082f521ee tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:49:47.571961 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f915d0b4-d9d8-4491-95b2-523082f521ee tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.710515 Jul 25 12:49:47.573145 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1289/2663] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:49:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:49:47.583545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-b929c649-8c23-4e87-9be0-cbd49939c82e req-d89a2af6-536e-490e-bdef-7435f9b8474f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3c4f646-aa62-4629-9c15-e57a9058a04c", "tag": "14a08691-36d3-4ae2-aa10-f18a2799fbb3"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:47.612487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b929c649-8c23-4e87-9be0-cbd49939c82e req-d89a2af6-536e-490e-bdef-7435f9b8474f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:47.613219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b929c649-8c23-4e87-9be0-cbd49939c82e req-d89a2af6-536e-490e-bdef-7435f9b8474f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:47.645036 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-b929c649-8c23-4e87-9be0-cbd49939c82e req-d89a2af6-536e-490e-bdef-7435f9b8474f service nova] Creating event network-changed:14a08691-36d3-4ae2-aa10-f18a2799fbb3 for instance d3c4f646-aa62-4629-9c15-e57a9058a04c on n-h1-848886-15 Jul 25 12:49:47.665210 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-b929c649-8c23-4e87-9be0-cbd49939c82e req-d89a2af6-536e-490e-bdef-7435f9b8474f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090691 Jul 25 12:49:47.669002 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1290/2664] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:47.698251 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-8fa51cc5-8e7e-424f-915f-3f52b8ad3313 req-1308c43d-9be8-404a-a335-96b1c1a51d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75942dad-aafa-4c5e-a8fc-daf088be1015", "name": "network-vif-plugged", "status": "completed", "tag": "0d4e04b2-e8e5-4992-8430-71e37ead3af5"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:47.740628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-8fa51cc5-8e7e-424f-915f-3f52b8ad3313 req-1308c43d-9be8-404a-a335-96b1c1a51d9c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:47.741445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-8fa51cc5-8e7e-424f-915f-3f52b8ad3313 req-1308c43d-9be8-404a-a335-96b1c1a51d9c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:47.786996 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-8fa51cc5-8e7e-424f-915f-3f52b8ad3313 req-1308c43d-9be8-404a-a335-96b1c1a51d9c service nova] Creating event network-vif-plugged:0d4e04b2-e8e5-4992-8430-71e37ead3af5 for instance 75942dad-aafa-4c5e-a8fc-daf088be1015 on n-h1-848886-15 Jul 25 12:49:47.816977 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-8fa51cc5-8e7e-424f-915f-3f52b8ad3313 req-1308c43d-9be8-404a-a335-96b1c1a51d9c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143506 Jul 25 12:49:47.818536 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1291/2665] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:47.836908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0e111332-3308-4c88-b7df-b876d491735a tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:47.838959 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0e111332-3308-4c88-b7df-b876d491735a tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] [instance: 75942dad-aafa-4c5e-a8fc-daf088be1015] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:47.850191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e111332-3308-4c88-b7df-b876d491735a tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:47.850951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e111332-3308-4c88-b7df-b876d491735a tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:47.852667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e111332-3308-4c88-b7df-b876d491735a tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:47.856569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e111332-3308-4c88-b7df-b876d491735a tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:48.759025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0e111332-3308-4c88-b7df-b876d491735a tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557df3df55844c1588203a9319158934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6ebc431b4d48fabc48c7efb261aeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:48.776796 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0e111332-3308-4c88-b7df-b876d491735a tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015" status: 200 len: 1311 microversion: 2.1 time: 0.956870 Jul 25 12:49:48.777736 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1292/2666] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:47 2022] GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015 => generated 1311 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:48.783382 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-62db3762-47d5-49a6-98cf-ce5c65fa230b tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:48.788453 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-62db3762-47d5-49a6-98cf-ce5c65fa230b tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:48.807462 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62db3762-47d5-49a6-98cf-ce5c65fa230b tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:48.807969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62db3762-47d5-49a6-98cf-ce5c65fa230b tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:48.810430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62db3762-47d5-49a6-98cf-ce5c65fa230b tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:48.810949 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62db3762-47d5-49a6-98cf-ce5c65fa230b tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:48.925640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-62db3762-47d5-49a6-98cf-ce5c65fa230b tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17c9f43612c483ba96eb09787b4dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cbbf76c3f4848b4a558de341ec19d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:48.947465 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-62db3762-47d5-49a6-98cf-ce5c65fa230b tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715" status: 200 len: 1213 microversion: 2.1 time: 0.167878 Jul 25 12:49:48.948635 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1293/2667] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:48 2022] GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715 => generated 1213 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:49.000772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-e9e66646-99cc-4cf0-8181-6da53f191b9a tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Updating instance_info_cache with network_info: [{"id": "14a08691-36d3-4ae2-aa10-f18a2799fbb3", "address": "fa:16:3e:56:54:b3", "network": {"id": "7d1be83b-0749-4f29-a888-d00c9f337335", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1624626287-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "777390f07e0c4d398c2a5916bc558ed2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap14a08691-36", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125884) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 12:49:49.034131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9e66646-99cc-4cf0-8181-6da53f191b9a tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Releasing lock "refresh_cache-d3c4f646-aa62-4629-9c15-e57a9058a04c" {{(pid=125884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 12:49:49.050846 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e9e66646-99cc-4cf0-8181-6da53f191b9a tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "POST /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c/action" status: 202 len: 0 microversion: 2.1 time: 6.965385 Jul 25 12:49:49.053075 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1375/2668] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:49:42 2022] POST /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c/action => generated 0 bytes in 6981 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 12:49:49.064107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6b77f259-8380-4959-afba-be784408f68d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '.version_select at 0x7efcf8cf4ca0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:49.800802 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7954245f-ea43-4d6c-af6d-735ff47f5d01 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:49.806008 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7954245f-ea43-4d6c-af6d-735ff47f5d01 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] [instance: 75942dad-aafa-4c5e-a8fc-daf088be1015] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:49.819836 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7954245f-ea43-4d6c-af6d-735ff47f5d01 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:49.823559 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7954245f-ea43-4d6c-af6d-735ff47f5d01 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:49.824792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7954245f-ea43-4d6c-af6d-735ff47f5d01 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:49.825468 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7954245f-ea43-4d6c-af6d-735ff47f5d01 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:50.008916 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6b77f259-8380-4959-afba-be784408f68d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips/b498a9d0-4a9d-46f5-81a4-2b9716b6ae0f" status: 200 len: 184 microversion: 2.1 time: 0.949775 Jul 25 12:49:50.010857 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1294/2669] 10.222.0.49 () {58 vars in 1260 bytes} [Mon Jul 25 12:49:49 2022] GET /compute/v2.1/os-floating-ips/b498a9d0-4a9d-46f5-81a4-2b9716b6ae0f => generated 184 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:50.020540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-a712cb53-6949-4e7f-a82c-af61a58ad1fb req-081e3373-82c0-4071-9331-cdc3d3048047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c7a7e2b-9643-44dc-91b8-d753b1d90944", "name": "network-vif-deleted", "tag": "90dd5757-925f-4846-8df1-a75d5939d05f"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:50.039762 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a712cb53-6949-4e7f-a82c-af61a58ad1fb req-081e3373-82c0-4071-9331-cdc3d3048047 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:50.041805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a712cb53-6949-4e7f-a82c-af61a58ad1fb req-081e3373-82c0-4071-9331-cdc3d3048047 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:50.062433 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-a712cb53-6949-4e7f-a82c-af61a58ad1fb req-081e3373-82c0-4071-9331-cdc3d3048047 service nova] Creating event network-vif-deleted:90dd5757-925f-4846-8df1-a75d5939d05f for instance 3c7a7e2b-9643-44dc-91b8-d753b1d90944 on n-h2-848886-15 Jul 25 12:49:50.071446 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-a712cb53-6949-4e7f-a82c-af61a58ad1fb req-081e3373-82c0-4071-9331-cdc3d3048047 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058139 Jul 25 12:49:50.072529 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1295/2670] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:50.081769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3e3df61e-115a-436d-af6e-0764ebe9c7a9 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:50.084019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3e3df61e-115a-436d-af6e-0764ebe9c7a9 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:50.095634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3e3df61e-115a-436d-af6e-0764ebe9c7a9 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:50.096471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3e3df61e-115a-436d-af6e-0764ebe9c7a9 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:50.097596 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3e3df61e-115a-436d-af6e-0764ebe9c7a9 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:50.098935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3e3df61e-115a-436d-af6e-0764ebe9c7a9 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:50.363725 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3e3df61e-115a-436d-af6e-0764ebe9c7a9 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17c9f43612c483ba96eb09787b4dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cbbf76c3f4848b4a558de341ec19d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:50.379239 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3e3df61e-115a-436d-af6e-0764ebe9c7a9 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715" status: 200 len: 1275 microversion: 2.1 time: 0.304099 Jul 25 12:49:50.381125 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1296/2671] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:50 2022] GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715 => generated 1275 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:50.391602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cbf9df23-ee1f-4c2d-a1e5-2660c88fabc2 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.181"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:50.744330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7954245f-ea43-4d6c-af6d-735ff47f5d01 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557df3df55844c1588203a9319158934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6ebc431b4d48fabc48c7efb261aeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:50.756692 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7954245f-ea43-4d6c-af6d-735ff47f5d01 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015" status: 200 len: 1497 microversion: 2.1 time: 0.958246 Jul 25 12:49:50.770890 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1376/2672] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:49 2022] GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015 => generated 1497 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:50.797054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-939f24bd-19ba-4a50-9200-35e4c481fc8f tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:50.827649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.compute.server_groups [None req-939f24bd-19ba-4a50-9200-35e4c481fc8f tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Querying cell 44375b4d-91c4-48bf-9056-56d6e14223f5(cell1) for 1 instances {{(pid=125884) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 25 12:49:50.829284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-939f24bd-19ba-4a50-9200-35e4c481fc8f tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:50.830256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-939f24bd-19ba-4a50-9200-35e4c481fc8f tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:50.866836 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-939f24bd-19ba-4a50-9200-35e4c481fc8f tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups/85dc53dd-42e2-41de-be66-a3ff9c3fca0a" status: 200 len: 221 microversion: 2.1 time: 0.081994 Jul 25 12:49:50.868381 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1377/2673] 10.222.0.49 () {58 vars in 1263 bytes} [Mon Jul 25 12:49:50 2022] GET /compute/v2.1/os-server-groups/85dc53dd-42e2-41de-be66-a3ff9c3fca0a => generated 221 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:50.883987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-009de929-7a0e-4fd3-a632-c90ce84863c8 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:50.885010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-009de929-7a0e-4fd3-a632-c90ce84863c8 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] [instance: 75942dad-aafa-4c5e-a8fc-daf088be1015] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:50.896162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-009de929-7a0e-4fd3-a632-c90ce84863c8 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:50.896970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-009de929-7a0e-4fd3-a632-c90ce84863c8 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:50.898489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-009de929-7a0e-4fd3-a632-c90ce84863c8 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:50.899123 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-009de929-7a0e-4fd3-a632-c90ce84863c8 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:50.929921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-009de929-7a0e-4fd3-a632-c90ce84863c8 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] [instance: 75942dad-aafa-4c5e-a8fc-daf088be1015] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:49:50.947052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cbf9df23-ee1f-4c2d-a1e5-2660c88fabc2 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:50.956569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cbf9df23-ee1f-4c2d-a1e5-2660c88fabc2 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:50.957732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cbf9df23-ee1f-4c2d-a1e5-2660c88fabc2 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:50.958933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cbf9df23-ee1f-4c2d-a1e5-2660c88fabc2 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:50.959876 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cbf9df23-ee1f-4c2d-a1e5-2660c88fabc2 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:51.050304 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-009de929-7a0e-4fd3-a632-c90ce84863c8 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "DELETE /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015" status: 204 len: 0 microversion: 2.1 time: 0.171476 Jul 25 12:49:51.052696 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1378/2674] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:49:50 2022] DELETE /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:49:51.066747 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fa90c9c8-e7e2-4d12-8d68-f94e34f66bf1 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:51.067555 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fa90c9c8-e7e2-4d12-8d68-f94e34f66bf1 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] [instance: 75942dad-aafa-4c5e-a8fc-daf088be1015] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:51.073886 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa90c9c8-e7e2-4d12-8d68-f94e34f66bf1 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:51.074350 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa90c9c8-e7e2-4d12-8d68-f94e34f66bf1 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:51.075133 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa90c9c8-e7e2-4d12-8d68-f94e34f66bf1 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:51.075571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa90c9c8-e7e2-4d12-8d68-f94e34f66bf1 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:51.092566 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=4,nova_cell1:RELEASE=2,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:51.637187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fa90c9c8-e7e2-4d12-8d68-f94e34f66bf1 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557df3df55844c1588203a9319158934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6ebc431b4d48fabc48c7efb261aeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:51.661804 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fa90c9c8-e7e2-4d12-8d68-f94e34f66bf1 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015" status: 200 len: 1503 microversion: 2.1 time: 0.601890 Jul 25 12:49:51.662458 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1379/2675] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:51 2022] GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015 => generated 1503 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:51.682882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-58139ef8-8fec-4884-aef2-8fdbe8b4eed4 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:51.686594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-58139ef8-8fec-4884-aef2-8fdbe8b4eed4 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:51.696802 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58139ef8-8fec-4884-aef2-8fdbe8b4eed4 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:51.698327 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58139ef8-8fec-4884-aef2-8fdbe8b4eed4 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:51.699588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58139ef8-8fec-4884-aef2-8fdbe8b4eed4 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:51.700254 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58139ef8-8fec-4884-aef2-8fdbe8b4eed4 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:51.723072 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cbf9df23-ee1f-4c2d-a1e5-2660c88fabc2 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Acquired lock "refresh_cache-d3c4f646-aa62-4629-9c15-e57a9058a04c" {{(pid=125883) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 12:49:51.884683 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-58139ef8-8fec-4884-aef2-8fdbe8b4eed4 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17c9f43612c483ba96eb09787b4dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cbbf76c3f4848b4a558de341ec19d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:51.899724 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-58139ef8-8fec-4884-aef2-8fdbe8b4eed4 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715" status: 200 len: 1275 microversion: 2.1 time: 0.233501 Jul 25 12:49:51.900345 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1380/2676] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:51 2022] GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715 => generated 1275 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:52.695047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-eb56b03f-c9a0-41c2-8666-3b786e3b07b2 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:52.695668 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eb56b03f-c9a0-41c2-8666-3b786e3b07b2 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] [instance: 75942dad-aafa-4c5e-a8fc-daf088be1015] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:52.707378 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb56b03f-c9a0-41c2-8666-3b786e3b07b2 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:52.710484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb56b03f-c9a0-41c2-8666-3b786e3b07b2 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:52.711322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb56b03f-c9a0-41c2-8666-3b786e3b07b2 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:52.711971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb56b03f-c9a0-41c2-8666-3b786e3b07b2 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:53.556505 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-eb56b03f-c9a0-41c2-8666-3b786e3b07b2 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557df3df55844c1588203a9319158934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6ebc431b4d48fabc48c7efb261aeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:53.572571 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-eb56b03f-c9a0-41c2-8666-3b786e3b07b2 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015" status: 200 len: 1503 microversion: 2.1 time: 0.881129 Jul 25 12:49:53.574347 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1381/2677] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:52 2022] GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015 => generated 1503 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:53.587504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-de5a4370-e712-4741-b1a5-f52e2be595cf tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:53.588125 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-de5a4370-e712-4741-b1a5-f52e2be595cf tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:53.607782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de5a4370-e712-4741-b1a5-f52e2be595cf tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:53.609133 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de5a4370-e712-4741-b1a5-f52e2be595cf tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:53.614091 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de5a4370-e712-4741-b1a5-f52e2be595cf tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:53.614732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de5a4370-e712-4741-b1a5-f52e2be595cf tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:53.816601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-de5a4370-e712-4741-b1a5-f52e2be595cf tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17c9f43612c483ba96eb09787b4dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cbbf76c3f4848b4a558de341ec19d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:53.834022 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-de5a4370-e712-4741-b1a5-f52e2be595cf tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715" status: 200 len: 1275 microversion: 2.1 time: 0.254873 Jul 25 12:49:53.853264 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1382/2678] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:53 2022] GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715 => generated 1275 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:54.391764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-c00dd5e7-a07f-422d-b5ed-7fd04e29d044 req-3da70d59-fe09-4364-9219-613dea27eeaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75942dad-aafa-4c5e-a8fc-daf088be1015", "name": "network-vif-deleted", "tag": "0d4e04b2-e8e5-4992-8430-71e37ead3af5"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:54.444914 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c00dd5e7-a07f-422d-b5ed-7fd04e29d044 req-3da70d59-fe09-4364-9219-613dea27eeaa service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:54.448146 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c00dd5e7-a07f-422d-b5ed-7fd04e29d044 req-3da70d59-fe09-4364-9219-613dea27eeaa service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:54.487638 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-c00dd5e7-a07f-422d-b5ed-7fd04e29d044 req-3da70d59-fe09-4364-9219-613dea27eeaa service nova] Creating event network-vif-deleted:0d4e04b2-e8e5-4992-8430-71e37ead3af5 for instance 75942dad-aafa-4c5e-a8fc-daf088be1015 on n-h1-848886-15 Jul 25 12:49:54.500507 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-c00dd5e7-a07f-422d-b5ed-7fd04e29d044 req-3da70d59-fe09-4364-9219-613dea27eeaa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114366 Jul 25 12:49:54.504255 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1383/2679] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:49:54.611124 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-332a568c-1224-4240-b9d4-b4bc0e86e076 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:54.613695 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-332a568c-1224-4240-b9d4-b4bc0e86e076 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] [instance: 75942dad-aafa-4c5e-a8fc-daf088be1015] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:54.666940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-332a568c-1224-4240-b9d4-b4bc0e86e076 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:54.672987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-332a568c-1224-4240-b9d4-b4bc0e86e076 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:54.676903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-332a568c-1224-4240-b9d4-b4bc0e86e076 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:54.679502 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-332a568c-1224-4240-b9d4-b4bc0e86e076 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:54.730406 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-332a568c-1224-4240-b9d4-b4bc0e86e076 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:54.730752 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-332a568c-1224-4240-b9d4-b4bc0e86e076 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:54.731267 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-332a568c-1224-4240-b9d4-b4bc0e86e076 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lazy-loading 'fault' on Instance uuid 75942dad-aafa-4c5e-a8fc-daf088be1015 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:49:55.035791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-332a568c-1224-4240-b9d4-b4bc0e86e076 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557df3df55844c1588203a9319158934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6ebc431b4d48fabc48c7efb261aeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:55.051242 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-332a568c-1224-4240-b9d4-b4bc0e86e076 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015" status: 200 len: 1301 microversion: 2.1 time: 0.452986 Jul 25 12:49:55.052565 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1384/2680] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:54 2022] GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015 => generated 1301 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:49:55.074210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5fffa548-5552-4630-b08a-dba0ca385f34 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:55.075330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5fffa548-5552-4630-b08a-dba0ca385f34 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:55.162152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5fffa548-5552-4630-b08a-dba0ca385f34 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.052s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:55.164019 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5fffa548-5552-4630-b08a-dba0ca385f34 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:55.169276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5fffa548-5552-4630-b08a-dba0ca385f34 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:55.173050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5fffa548-5552-4630-b08a-dba0ca385f34 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:55.863172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-cbf9df23-ee1f-4c2d-a1e5-2660c88fabc2 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Building network info cache for instance {{(pid=125883) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 12:49:56.317692 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5fffa548-5552-4630-b08a-dba0ca385f34 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17c9f43612c483ba96eb09787b4dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cbbf76c3f4848b4a558de341ec19d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:56.325743 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5fffa548-5552-4630-b08a-dba0ca385f34 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715" status: 200 len: 1317 microversion: 2.1 time: 1.271602 Jul 25 12:49:56.326391 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1385/2681] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:55 2022] GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715 => generated 1317 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:56.339284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e0fe14b1-9885-4c64-b745-6cf361ddd129 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:56.360574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e0fe14b1-9885-4c64-b745-6cf361ddd129 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:56.362278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e0fe14b1-9885-4c64-b745-6cf361ddd129 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Searching by: {'deleted': False, 'project_id': 'f088db318e364b5caf92d51ea9e5b562'} {{(pid=125884) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 12:49:56.375911 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0fe14b1-9885-4c64-b745-6cf361ddd129 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:56.375911 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0fe14b1-9885-4c64-b745-6cf361ddd129 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:56.376563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0fe14b1-9885-4c64-b745-6cf361ddd129 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:56.377005 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0fe14b1-9885-4c64-b745-6cf361ddd129 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:56.516332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.multi_cell_list [None req-e0fe14b1-9885-4c64-b745-6cf361ddd129 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 12:49:56.683850 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e0fe14b1-9885-4c64-b745-6cf361ddd129 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.348461 Jul 25 12:49:56.687289 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1386/2682] 10.222.0.49 () {58 vars in 1125 bytes} [Mon Jul 25 12:49:56 2022] GET /compute/v2.1/servers => generated 343 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:56.702979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-f12c2df5-a098-40b8-8327-a6ad4f601a9f req-9d0aef84-3c4d-4b53-9ea2-17d6ac4574a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3c4f646-aa62-4629-9c15-e57a9058a04c", "tag": "14a08691-36d3-4ae2-aa10-f18a2799fbb3"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:56.717619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f12c2df5-a098-40b8-8327-a6ad4f601a9f req-9d0aef84-3c4d-4b53-9ea2-17d6ac4574a1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:56.718369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f12c2df5-a098-40b8-8327-a6ad4f601a9f req-9d0aef84-3c4d-4b53-9ea2-17d6ac4574a1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:56.736014 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-f12c2df5-a098-40b8-8327-a6ad4f601a9f req-9d0aef84-3c4d-4b53-9ea2-17d6ac4574a1 service nova] Creating event network-changed:14a08691-36d3-4ae2-aa10-f18a2799fbb3 for instance d3c4f646-aa62-4629-9c15-e57a9058a04c on n-h1-848886-15 Jul 25 12:49:56.747470 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-f12c2df5-a098-40b8-8327-a6ad4f601a9f req-9d0aef84-3c4d-4b53-9ea2-17d6ac4574a1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058521 Jul 25 12:49:56.749450 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1387/2683] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:56.757696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-58c1f917-0e81-48d9-a63b-ac2550d0ecc6 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:56.759033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-58c1f917-0e81-48d9-a63b-ac2550d0ecc6 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] [instance: 75942dad-aafa-4c5e-a8fc-daf088be1015] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:56.768908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58c1f917-0e81-48d9-a63b-ac2550d0ecc6 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:56.785260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58c1f917-0e81-48d9-a63b-ac2550d0ecc6 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:56.786641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58c1f917-0e81-48d9-a63b-ac2550d0ecc6 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:56.787709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58c1f917-0e81-48d9-a63b-ac2550d0ecc6 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:56.807900 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-58c1f917-0e81-48d9-a63b-ac2550d0ecc6 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] HTTP exception thrown: Instance 75942dad-aafa-4c5e-a8fc-daf088be1015 could not be found. Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-58c1f917-0e81-48d9-a63b-ac2550d0ecc6 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Request method failure captured: Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015 HTTP/1.1 Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pFOusPYIUPpBLBtpacF7uBm_c7pqPfv9EvwVCg5jSkOCbsPp1GWt0Z7c-aVkUyG6PIJWR9T5SuOrlBB1Gtd9dgLsGR1fKK8U7J4VPgXWt8zfexb8_9vzaFEzUShaB-_aLTtb6pid6lvU-TpaYnw2EOw2qmMnbj1M7cwFaItj5INW9Y Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5b6ebc431b4d48fabc48c7efb261aeda Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerGroupTestJSON-861620959 Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5b6ebc431b4d48fabc48c7efb261aeda", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5b6ebc431b4d48fabc48c7efb261aeda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b6ebc431b4d48fabc48c7efb261aeda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b6ebc431b4d48fabc48c7efb261aeda"}]}] Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerGroupTestJSON-861620959 Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5b6ebc431b4d48fabc48c7efb261aeda Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerGroupTestJSON-861620959 Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerGroupTestJSON-861620959-project Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 557df3df55844c1588203a9319158934 Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerGroupTestJSON-861620959-project Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 75942dad-aafa-4c5e-a8fc-daf088be1015 could not be found. Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '75942dad-aafa-4c5e-a8fc-daf088be1015'} Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75942dad-aafa-4c5e-a8fc-daf088be1015 could not be found. Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75942dad-aafa-4c5e-a8fc-daf088be1015 could not be found. Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:56.810634 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:56.815797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:56.815797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:56.815797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:56.815797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:49:56.815797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:49:56.815797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75942dad-aafa-4c5e-a8fc-daf088be1015 could not be found. Jul 25 12:49:56.815797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:56.818732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-58c1f917-0e81-48d9-a63b-ac2550d0ecc6 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Returning 404 to user: Instance 75942dad-aafa-4c5e-a8fc-daf088be1015 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:49:56.819887 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-58c1f917-0e81-48d9-a63b-ac2550d0ecc6 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015" status: 404 len: 111 microversion: 2.1 time: 0.068925 Jul 25 12:49:56.822451 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1388/2684] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:56 2022] GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:49:56.847533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-feacc7b2-c48a-4eb9-aa1a-7a55b391bfef tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:56.856344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-feacc7b2-c48a-4eb9-aa1a-7a55b391bfef tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:56.858849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-feacc7b2-c48a-4eb9-aa1a-7a55b391bfef tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Searching by: {'deleted': False, 'project_id': 'f088db318e364b5caf92d51ea9e5b562'} {{(pid=125884) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 12:49:56.868065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-feacc7b2-c48a-4eb9-aa1a-7a55b391bfef tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:56.868952 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-feacc7b2-c48a-4eb9-aa1a-7a55b391bfef tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:56.870021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-feacc7b2-c48a-4eb9-aa1a-7a55b391bfef tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:56.871592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-feacc7b2-c48a-4eb9-aa1a-7a55b391bfef tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:56.910785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.multi_cell_list [None req-feacc7b2-c48a-4eb9-aa1a-7a55b391bfef tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 12:49:57.032389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-feacc7b2-c48a-4eb9-aa1a-7a55b391bfef tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:57.047648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-feacc7b2-c48a-4eb9-aa1a-7a55b391bfef tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:57.051897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-feacc7b2-c48a-4eb9-aa1a-7a55b391bfef tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:57.415293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:57.448630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:58.431501 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-feacc7b2-c48a-4eb9-aa1a-7a55b391bfef tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 1607 microversion: 2.1 time: 1.607578 Jul 25 12:49:58.432296 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1389/2685] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:49:56 2022] GET /compute/v2.1/servers/detail => generated 1607 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:58.437333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-68d2112a-d582-4f27-8973-430679cc79e4 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:58.469209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.compute.server_groups [None req-68d2112a-d582-4f27-8973-430679cc79e4 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Querying cell 44375b4d-91c4-48bf-9056-56d6e14223f5(cell1) for 1 instances {{(pid=125884) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 25 12:49:58.470299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68d2112a-d582-4f27-8973-430679cc79e4 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:58.471542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68d2112a-d582-4f27-8973-430679cc79e4 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:58.486974 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-68d2112a-d582-4f27-8973-430679cc79e4 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.053319 Jul 25 12:49:58.498097 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1390/2686] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 12:49:58 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:58.510252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-36c2ea4a-d355-41b0-82a8-e1a5c5744ae9 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:58.514023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-36c2ea4a-d355-41b0-82a8-e1a5c5744ae9 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:58.536050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36c2ea4a-d355-41b0-82a8-e1a5c5744ae9 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:58.536507 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36c2ea4a-d355-41b0-82a8-e1a5c5744ae9 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:58.537613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36c2ea4a-d355-41b0-82a8-e1a5c5744ae9 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:58.539130 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36c2ea4a-d355-41b0-82a8-e1a5c5744ae9 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:59.163489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-36c2ea4a-d355-41b0-82a8-e1a5c5744ae9 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17c9f43612c483ba96eb09787b4dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cbbf76c3f4848b4a558de341ec19d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:59.192242 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-36c2ea4a-d355-41b0-82a8-e1a5c5744ae9 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715" status: 200 len: 1317 microversion: 2.1 time: 0.690216 Jul 25 12:49:59.192821 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1391/2687] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:58 2022] GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715 => generated 1317 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:59.522695 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ec3b3b85-2c30-4b71-bc56-475c6d93f8e2 tempest-PortsAdminExtendedAttrsTestJSON-804744451 tempest-PortsAdminExtendedAttrsTestJSON-804744451-project-admin] Calling method '.version_select at 0x7efcf90778b0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:59.525049 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:49:59.525049 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 12:49:59.526547 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ec3b3b85-2c30-4b71-bc56-475c6d93f8e2 tempest-PortsAdminExtendedAttrsTestJSON-804744451 tempest-PortsAdminExtendedAttrsTestJSON-804744451-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:59.527271 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ec3b3b85-2c30-4b71-bc56-475c6d93f8e2 tempest-PortsAdminExtendedAttrsTestJSON-804744451 tempest-PortsAdminExtendedAttrsTestJSON-804744451-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:59.567410 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ec3b3b85-2c30-4b71-bc56-475c6d93f8e2 tempest-PortsAdminExtendedAttrsTestJSON-804744451 tempest-PortsAdminExtendedAttrsTestJSON-804744451-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:59.568906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ec3b3b85-2c30-4b71-bc56-475c6d93f8e2 tempest-PortsAdminExtendedAttrsTestJSON-804744451 tempest-PortsAdminExtendedAttrsTestJSON-804744451-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:59.581130 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ec3b3b85-2c30-4b71-bc56-475c6d93f8e2 tempest-PortsAdminExtendedAttrsTestJSON-804744451 tempest-PortsAdminExtendedAttrsTestJSON-804744451-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:59.582032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ec3b3b85-2c30-4b71-bc56-475c6d93f8e2 tempest-PortsAdminExtendedAttrsTestJSON-804744451 tempest-PortsAdminExtendedAttrsTestJSON-804744451-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:59.591106 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ec3b3b85-2c30-4b71-bc56-475c6d93f8e2 tempest-PortsAdminExtendedAttrsTestJSON-804744451 tempest-PortsAdminExtendedAttrsTestJSON-804744451-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.396988 Jul 25 12:49:59.592447 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1392/2688] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 12:49:59 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:59.597172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dfef5cb6-9550-4516-ad36-76f3f619b850 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:59.608851 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dfef5cb6-9550-4516-ad36-76f3f619b850 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015089 Jul 25 12:49:59.617346 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1393/2689] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:49:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:59.624861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-eebe28e3-4f46-4a8b-b464-372867314295 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:59.643070 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.compute.server_groups [None req-eebe28e3-4f46-4a8b-b464-372867314295 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Querying cell 44375b4d-91c4-48bf-9056-56d6e14223f5(cell1) for 1 instances {{(pid=125884) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 25 12:49:59.644217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eebe28e3-4f46-4a8b-b464-372867314295 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:59.645032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eebe28e3-4f46-4a8b-b464-372867314295 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:59.661546 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-cbf9df23-ee1f-4c2d-a1e5-2660c88fabc2 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Updating instance_info_cache with network_info: [{"id": "14a08691-36d3-4ae2-aa10-f18a2799fbb3", "address": "fa:16:3e:56:54:b3", "network": {"id": "7d1be83b-0749-4f29-a888-d00c9f337335", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1624626287-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "777390f07e0c4d398c2a5916bc558ed2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap14a08691-36", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125883) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 12:49:59.676678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cbf9df23-ee1f-4c2d-a1e5-2660c88fabc2 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Releasing lock "refresh_cache-d3c4f646-aa62-4629-9c15-e57a9058a04c" {{(pid=125883) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 12:49:59.683723 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cbf9df23-ee1f-4c2d-a1e5-2660c88fabc2 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "POST /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c/action" status: 202 len: 0 microversion: 2.1 time: 9.297615 Jul 25 12:49:59.686215 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1297/2690] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:49:50 2022] POST /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c/action => generated 0 bytes in 9304 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 12:49:59.700860 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-eebe28e3-4f46-4a8b-b464-372867314295 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups/85dc53dd-42e2-41de-be66-a3ff9c3fca0a" status: 200 len: 183 microversion: 2.1 time: 0.067691 Jul 25 12:49:59.705725 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1394/2691] 10.222.0.49 () {58 vars in 1263 bytes} [Mon Jul 25 12:49:59 2022] GET /compute/v2.1/os-server-groups/85dc53dd-42e2-41de-be66-a3ff9c3fca0a => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:59.709186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-de172345-2caa-4eb5-94c7-146f8accd5cc tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:59.710390 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-de172345-2caa-4eb5-94c7-146f8accd5cc tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:59.724016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ed14fb0e-b1a9-4030-a040-b2a53f263cbf tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:59.730701 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ed14fb0e-b1a9-4030-a040-b2a53f263cbf tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] [instance: 75942dad-aafa-4c5e-a8fc-daf088be1015] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:59.742677 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de172345-2caa-4eb5-94c7-146f8accd5cc tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:59.743558 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de172345-2caa-4eb5-94c7-146f8accd5cc tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:59.745405 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de172345-2caa-4eb5-94c7-146f8accd5cc tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:59.746196 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed14fb0e-b1a9-4030-a040-b2a53f263cbf tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:59.747163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed14fb0e-b1a9-4030-a040-b2a53f263cbf tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:59.747868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de172345-2caa-4eb5-94c7-146f8accd5cc tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:59.749538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed14fb0e-b1a9-4030-a040-b2a53f263cbf tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:59.753137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed14fb0e-b1a9-4030-a040-b2a53f263cbf tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:59.784191 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-de172345-2caa-4eb5-94c7-146f8accd5cc tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] HTTP exception thrown: Instance 3c7a7e2b-9643-44dc-91b8-d753b1d90944 could not be found. Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-de172345-2caa-4eb5-94c7-146f8accd5cc tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Request method failure captured: Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944 HTTP/1.1 Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pEdPxLidVhBnd_LOUsOJoc4JrCV846K-9JWCECDvLZlmuOtyZlf7TST2jJcxRJd7hH2Q1bjeXfYThvuP1XszDnp3e8YmokdWUeIfsBjHvZPCL31qWxu6liL7TI3jFv9RKwAuRx21c0KIicv58xWMWsOLhNK8IKy5Ton-idxSsG-mQo Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 777390f07e0c4d398c2a5916bc558ed2 Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1038886839 Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_777390f07e0c4d398c2a5916bc558ed2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/777390f07e0c4d398c2a5916bc558ed2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/777390f07e0c4d398c2a5916bc558ed2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/777390f07e0c4d398c2a5916bc558ed2"}]}] Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1038886839 Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 777390f07e0c4d398c2a5916bc558ed2 Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1038886839 Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-FloatingIPsAssociationTestJSON-1038886839-project Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8245528326d34330ae7f790ef6b0b62b Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1038886839-project Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 3c7a7e2b-9643-44dc-91b8-d753b1d90944 could not be found. Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '3c7a7e2b-9643-44dc-91b8-d753b1d90944'} Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c7a7e2b-9643-44dc-91b8-d753b1d90944 could not be found. Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:49:59.785905 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:49:59.789708 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c7a7e2b-9643-44dc-91b8-d753b1d90944 could not be found. Jul 25 12:49:59.789708 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.789708 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:59.789708 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.789708 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:59.789708 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:59.789708 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:59.789708 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:49:59.789708 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:49:59.789708 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c7a7e2b-9643-44dc-91b8-d753b1d90944 could not be found. Jul 25 12:49:59.789708 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.804252 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-ed14fb0e-b1a9-4030-a040-b2a53f263cbf tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] HTTP exception thrown: Instance 75942dad-aafa-4c5e-a8fc-daf088be1015 could not be found. Jul 25 12:49:59.805871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-de172345-2caa-4eb5-94c7-146f8accd5cc tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Returning 404 to user: Instance 3c7a7e2b-9643-44dc-91b8-d753b1d90944 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:49:59.807080 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-de172345-2caa-4eb5-94c7-146f8accd5cc tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944" status: 404 len: 111 microversion: 2.1 time: 0.106410 Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ed14fb0e-b1a9-4030-a040-b2a53f263cbf tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Request method failure captured: Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015 HTTP/1.1 Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pFOusPYIUPpBLBtpacF7uBm_c7pqPfv9EvwVCg5jSkOCbsPp1GWt0Z7c-aVkUyG6PIJWR9T5SuOrlBB1Gtd9dgLsGR1fKK8U7J4VPgXWt8zfexb8_9vzaFEzUShaB-_aLTtb6pid6lvU-TpaYnw2EOw2qmMnbj1M7cwFaItj5INW9Y Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5b6ebc431b4d48fabc48c7efb261aeda Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerGroupTestJSON-861620959 Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5b6ebc431b4d48fabc48c7efb261aeda", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5b6ebc431b4d48fabc48c7efb261aeda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b6ebc431b4d48fabc48c7efb261aeda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b6ebc431b4d48fabc48c7efb261aeda"}]}] Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerGroupTestJSON-861620959 Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5b6ebc431b4d48fabc48c7efb261aeda Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerGroupTestJSON-861620959 Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerGroupTestJSON-861620959-project Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 557df3df55844c1588203a9319158934 Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerGroupTestJSON-861620959-project Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 75942dad-aafa-4c5e-a8fc-daf088be1015 could not be found. Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '75942dad-aafa-4c5e-a8fc-daf088be1015'} Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75942dad-aafa-4c5e-a8fc-daf088be1015 could not be found. Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:49:59.807650 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75942dad-aafa-4c5e-a8fc-daf088be1015 could not be found. Jul 25 12:49:59.811391 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.811391 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:59.811391 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.811391 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:59.811391 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:59.811391 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:59.811391 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:49:59.811391 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:49:59.811391 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75942dad-aafa-4c5e-a8fc-daf088be1015 could not be found. Jul 25 12:49:59.811391 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.811391 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ed14fb0e-b1a9-4030-a040-b2a53f263cbf tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Returning 404 to user: Instance 75942dad-aafa-4c5e-a8fc-daf088be1015 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:49:59.811391 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ed14fb0e-b1a9-4030-a040-b2a53f263cbf tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "DELETE /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015" status: 404 len: 111 microversion: 2.1 time: 0.095140 Jul 25 12:49:59.814343 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1298/2692] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:49:59 2022] DELETE /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:49:59.815935 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1395/2693] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:49:59 2022] DELETE /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 12:49:59.823581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-251abaa6-2ff4-4d03-afa6-51eb5909fc8f tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:59.824327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-251abaa6-2ff4-4d03-afa6-51eb5909fc8f tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: 3c7a7e2b-9643-44dc-91b8-d753b1d90944] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:59.827111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-323c95bb-c9d9-43b6-a15d-38251afd8047 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:59.827730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-323c95bb-c9d9-43b6-a15d-38251afd8047 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] [instance: 75942dad-aafa-4c5e-a8fc-daf088be1015] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:59.831541 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-251abaa6-2ff4-4d03-afa6-51eb5909fc8f tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:59.832087 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-251abaa6-2ff4-4d03-afa6-51eb5909fc8f tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:59.832953 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-251abaa6-2ff4-4d03-afa6-51eb5909fc8f tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:59.833676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-251abaa6-2ff4-4d03-afa6-51eb5909fc8f tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:59.847718 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-323c95bb-c9d9-43b6-a15d-38251afd8047 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:59.848175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-323c95bb-c9d9-43b6-a15d-38251afd8047 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:59.848965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-323c95bb-c9d9-43b6-a15d-38251afd8047 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:59.849411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-323c95bb-c9d9-43b6-a15d-38251afd8047 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:59.857039 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-251abaa6-2ff4-4d03-afa6-51eb5909fc8f tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] HTTP exception thrown: Instance 3c7a7e2b-9643-44dc-91b8-d753b1d90944 could not be found. Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-251abaa6-2ff4-4d03-afa6-51eb5909fc8f tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Request method failure captured: Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944 HTTP/1.1 Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pEdPxLidVhBnd_LOUsOJoc4JrCV846K-9JWCECDvLZlmuOtyZlf7TST2jJcxRJd7hH2Q1bjeXfYThvuP1XszDnp3e8YmokdWUeIfsBjHvZPCL31qWxu6liL7TI3jFv9RKwAuRx21c0KIicv58xWMWsOLhNK8IKy5Ton-idxSsG-mQo Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 777390f07e0c4d398c2a5916bc558ed2 Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1038886839 Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_777390f07e0c4d398c2a5916bc558ed2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/777390f07e0c4d398c2a5916bc558ed2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/777390f07e0c4d398c2a5916bc558ed2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/777390f07e0c4d398c2a5916bc558ed2"}]}] Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1038886839 Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 777390f07e0c4d398c2a5916bc558ed2 Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1038886839 Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-FloatingIPsAssociationTestJSON-1038886839-project Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8245528326d34330ae7f790ef6b0b62b Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1038886839-project Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 3c7a7e2b-9643-44dc-91b8-d753b1d90944 could not be found. Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '3c7a7e2b-9643-44dc-91b8-d753b1d90944'} Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c7a7e2b-9643-44dc-91b8-d753b1d90944 could not be found. Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c7a7e2b-9643-44dc-91b8-d753b1d90944 could not be found. Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.859499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:59.863358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.863358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:59.863358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:59.863358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:59.863358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:49:59.863358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:49:59.863358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c7a7e2b-9643-44dc-91b8-d753b1d90944 could not be found. Jul 25 12:49:59.863358 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.866520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-251abaa6-2ff4-4d03-afa6-51eb5909fc8f tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Returning 404 to user: Instance 3c7a7e2b-9643-44dc-91b8-d753b1d90944 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:49:59.868248 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-251abaa6-2ff4-4d03-afa6-51eb5909fc8f tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944" status: 404 len: 111 microversion: 2.1 time: 0.048063 Jul 25 12:49:59.869017 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1299/2694] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:59 2022] GET /compute/v2.1/servers/3c7a7e2b-9643-44dc-91b8-d753b1d90944 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:49:59.887253 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-323c95bb-c9d9-43b6-a15d-38251afd8047 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] HTTP exception thrown: Instance 75942dad-aafa-4c5e-a8fc-daf088be1015 could not be found. Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-323c95bb-c9d9-43b6-a15d-38251afd8047 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Request method failure captured: Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015 HTTP/1.1 Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pFOusPYIUPpBLBtpacF7uBm_c7pqPfv9EvwVCg5jSkOCbsPp1GWt0Z7c-aVkUyG6PIJWR9T5SuOrlBB1Gtd9dgLsGR1fKK8U7J4VPgXWt8zfexb8_9vzaFEzUShaB-_aLTtb6pid6lvU-TpaYnw2EOw2qmMnbj1M7cwFaItj5INW9Y Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5b6ebc431b4d48fabc48c7efb261aeda Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerGroupTestJSON-861620959 Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5b6ebc431b4d48fabc48c7efb261aeda", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5b6ebc431b4d48fabc48c7efb261aeda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b6ebc431b4d48fabc48c7efb261aeda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b6ebc431b4d48fabc48c7efb261aeda"}]}] Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerGroupTestJSON-861620959 Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5b6ebc431b4d48fabc48c7efb261aeda Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerGroupTestJSON-861620959 Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerGroupTestJSON-861620959-project Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 557df3df55844c1588203a9319158934 Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerGroupTestJSON-861620959-project Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 75942dad-aafa-4c5e-a8fc-daf088be1015 could not be found. Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '75942dad-aafa-4c5e-a8fc-daf088be1015'} Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75942dad-aafa-4c5e-a8fc-daf088be1015 could not be found. Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75942dad-aafa-4c5e-a8fc-daf088be1015 could not be found. Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:59.888834 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.893756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:59.893756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:59.893756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:59.893756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:49:59.893756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:49:59.893756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75942dad-aafa-4c5e-a8fc-daf088be1015 could not be found. Jul 25 12:49:59.893756 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.893756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-323c95bb-c9d9-43b6-a15d-38251afd8047 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Returning 404 to user: Instance 75942dad-aafa-4c5e-a8fc-daf088be1015 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:49:59.895644 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4b0f37c3-eaed-4c87-8f04-cd4f70499f39 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '.version_select at 0x7efcf8f77dc0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:59.900595 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-323c95bb-c9d9-43b6-a15d-38251afd8047 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015" status: 404 len: 111 microversion: 2.1 time: 0.080875 Jul 25 12:49:59.901812 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1396/2695] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:59 2022] GET /compute/v2.1/servers/75942dad-aafa-4c5e-a8fc-daf088be1015 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:49:59.917706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4d7e87c6-485e-4ae8-bb83-c5417d77da97 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:59.924742 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-4d7e87c6-485e-4ae8-bb83-c5417d77da97 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] HTTP exception thrown: Instance group 1c072a45-8905-4041-85fa-c80769e5e145 could not be found. Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4d7e87c6-485e-4ae8-bb83-c5417d77da97 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Request method failure captured: Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/os-server-groups/1c072a45-8905-4041-85fa-c80769e5e145 HTTP/1.1 Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pFOusPYIUPpBLBtpacF7uBm_c7pqPfv9EvwVCg5jSkOCbsPp1GWt0Z7c-aVkUyG6PIJWR9T5SuOrlBB1Gtd9dgLsGR1fKK8U7J4VPgXWt8zfexb8_9vzaFEzUShaB-_aLTtb6pid6lvU-TpaYnw2EOw2qmMnbj1M7cwFaItj5INW9Y Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5b6ebc431b4d48fabc48c7efb261aeda Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerGroupTestJSON-861620959 Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5b6ebc431b4d48fabc48c7efb261aeda", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5b6ebc431b4d48fabc48c7efb261aeda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b6ebc431b4d48fabc48c7efb261aeda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b6ebc431b4d48fabc48c7efb261aeda"}]}] Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerGroupTestJSON-861620959 Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5b6ebc431b4d48fabc48c7efb261aeda Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerGroupTestJSON-861620959 Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerGroupTestJSON-861620959-project Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 557df3df55844c1588203a9319158934 Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerGroupTestJSON-861620959-project Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance group 1c072a45-8905-4041-85fa-c80769e5e145 could not be found. Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '1c072a45-8905-4041-85fa-c80769e5e145'} Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1c072a45-8905-4041-85fa-c80769e5e145 could not be found. Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1c072a45-8905-4041-85fa-c80769e5e145 could not be found. Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.943493 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:49:59.948031 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:49:59.948031 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:49:59.948031 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:49:59.948031 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:49:59.948031 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1c072a45-8905-4041-85fa-c80769e5e145 could not be found. Jul 25 12:49:59.948031 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:49:59.950668 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4d7e87c6-485e-4ae8-bb83-c5417d77da97 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Returning 404 to user: Instance group 1c072a45-8905-4041-85fa-c80769e5e145 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:49:59.953344 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4d7e87c6-485e-4ae8-bb83-c5417d77da97 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/1c072a45-8905-4041-85fa-c80769e5e145" status: 404 len: 117 microversion: 2.1 time: 0.046250 Jul 25 12:49:59.955261 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1397/2696] 10.222.0.49 () {58 vars in 1266 bytes} [Mon Jul 25 12:49:59 2022] DELETE /compute/v2.1/os-server-groups/1c072a45-8905-4041-85fa-c80769e5e145 => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:49:59.967577 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1bacd558-845e-4c8c-9339-f63d49f0aba3 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:59.968388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1bacd558-845e-4c8c-9339-f63d49f0aba3 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:59.978871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1bacd558-845e-4c8c-9339-f63d49f0aba3 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:59.979967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1bacd558-845e-4c8c-9339-f63d49f0aba3 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:59.981270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1bacd558-845e-4c8c-9339-f63d49f0aba3 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:59.982016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1bacd558-845e-4c8c-9339-f63d49f0aba3 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:00.012108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1bacd558-845e-4c8c-9339-f63d49f0aba3 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:50:00.183981 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1bacd558-845e-4c8c-9339-f63d49f0aba3 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 204 len: 0 microversion: 2.1 time: 0.224367 Jul 25 12:50:00.185048 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1398/2697] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:49:59 2022] DELETE /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:50:00.191184 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9ba63c39-2282-43a6-8ed7-11314383b645 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:00.201189 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-9ba63c39-2282-43a6-8ed7-11314383b645 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] HTTP exception thrown: Instance group 2309a287-2df1-4959-8ce8-f76d658be2ba could not be found. Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9ba63c39-2282-43a6-8ed7-11314383b645 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Request method failure captured: Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/os-server-groups/2309a287-2df1-4959-8ce8-f76d658be2ba HTTP/1.1 Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pFOusPYIUPpBLBtpacF7uBm_c7pqPfv9EvwVCg5jSkOCbsPp1GWt0Z7c-aVkUyG6PIJWR9T5SuOrlBB1Gtd9dgLsGR1fKK8U7J4VPgXWt8zfexb8_9vzaFEzUShaB-_aLTtb6pid6lvU-TpaYnw2EOw2qmMnbj1M7cwFaItj5INW9Y Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5b6ebc431b4d48fabc48c7efb261aeda Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerGroupTestJSON-861620959 Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5b6ebc431b4d48fabc48c7efb261aeda", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5b6ebc431b4d48fabc48c7efb261aeda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b6ebc431b4d48fabc48c7efb261aeda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b6ebc431b4d48fabc48c7efb261aeda"}]}] Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerGroupTestJSON-861620959 Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5b6ebc431b4d48fabc48c7efb261aeda Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerGroupTestJSON-861620959 Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerGroupTestJSON-861620959-project Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 557df3df55844c1588203a9319158934 Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerGroupTestJSON-861620959-project Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance group 2309a287-2df1-4959-8ce8-f76d658be2ba could not be found. Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '2309a287-2df1-4959-8ce8-f76d658be2ba'} Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2309a287-2df1-4959-8ce8-f76d658be2ba could not be found. Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2309a287-2df1-4959-8ce8-f76d658be2ba could not be found. Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:50:00.203537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:00.207380 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:00.207380 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:00.207380 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:50:00.207380 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:50:00.207380 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2309a287-2df1-4959-8ce8-f76d658be2ba could not be found. Jul 25 12:50:00.207380 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:50:00.208716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9ba63c39-2282-43a6-8ed7-11314383b645 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Returning 404 to user: Instance group 2309a287-2df1-4959-8ce8-f76d658be2ba could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:50:00.209918 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9ba63c39-2282-43a6-8ed7-11314383b645 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/2309a287-2df1-4959-8ce8-f76d658be2ba" status: 404 len: 117 microversion: 2.1 time: 0.023549 Jul 25 12:50:00.213990 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1399/2698] 10.222.0.49 () {58 vars in 1266 bytes} [Mon Jul 25 12:50:00 2022] DELETE /compute/v2.1/os-server-groups/2309a287-2df1-4959-8ce8-f76d658be2ba => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:50:00.220216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-96c5ff54-4add-480d-ac06-24cd945ad4ea tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:00.221336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-96c5ff54-4add-480d-ac06-24cd945ad4ea tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:00.229149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-96c5ff54-4add-480d-ac06-24cd945ad4ea tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:00.229862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-96c5ff54-4add-480d-ac06-24cd945ad4ea tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:00.230847 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-96c5ff54-4add-480d-ac06-24cd945ad4ea tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:00.231428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-96c5ff54-4add-480d-ac06-24cd945ad4ea tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:00.975693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-96c5ff54-4add-480d-ac06-24cd945ad4ea tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:00.977063 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:00.984627 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-96c5ff54-4add-480d-ac06-24cd945ad4ea tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1610 microversion: 2.1 time: 0.768830 Jul 25 12:50:00.998238 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1400/2699] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:00 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1610 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:01.005059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bf47ee33-5477-4235-9a7e-396993ba9fe5 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:01.005941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bf47ee33-5477-4235-9a7e-396993ba9fe5 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:01.014446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf47ee33-5477-4235-9a7e-396993ba9fe5 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:01.015528 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf47ee33-5477-4235-9a7e-396993ba9fe5 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:01.016719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf47ee33-5477-4235-9a7e-396993ba9fe5 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:01.017628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf47ee33-5477-4235-9a7e-396993ba9fe5 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:02.106549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bf47ee33-5477-4235-9a7e-396993ba9fe5 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17c9f43612c483ba96eb09787b4dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cbbf76c3f4848b4a558de341ec19d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:02.124583 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bf47ee33-5477-4235-9a7e-396993ba9fe5 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715" status: 200 len: 1317 microversion: 2.1 time: 1.124219 Jul 25 12:50:02.125185 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1401/2700] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:00 2022] GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715 => generated 1317 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:02.133916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1291fa08-9363-4917-af3e-140d2143c13a tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:02.141124 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-1291fa08-9363-4917-af3e-140d2143c13a tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] HTTP exception thrown: Instance group 1366d1f5-93f9-4228-ace9-9e37f7fb4600 could not be found. Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1291fa08-9363-4917-af3e-140d2143c13a tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Request method failure captured: Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/os-server-groups/1366d1f5-93f9-4228-ace9-9e37f7fb4600 HTTP/1.1 Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pFOusPYIUPpBLBtpacF7uBm_c7pqPfv9EvwVCg5jSkOCbsPp1GWt0Z7c-aVkUyG6PIJWR9T5SuOrlBB1Gtd9dgLsGR1fKK8U7J4VPgXWt8zfexb8_9vzaFEzUShaB-_aLTtb6pid6lvU-TpaYnw2EOw2qmMnbj1M7cwFaItj5INW9Y Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5b6ebc431b4d48fabc48c7efb261aeda Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerGroupTestJSON-861620959 Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5b6ebc431b4d48fabc48c7efb261aeda", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5b6ebc431b4d48fabc48c7efb261aeda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b6ebc431b4d48fabc48c7efb261aeda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b6ebc431b4d48fabc48c7efb261aeda"}]}] Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerGroupTestJSON-861620959 Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5b6ebc431b4d48fabc48c7efb261aeda Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerGroupTestJSON-861620959 Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerGroupTestJSON-861620959-project Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 557df3df55844c1588203a9319158934 Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerGroupTestJSON-861620959-project Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance group 1366d1f5-93f9-4228-ace9-9e37f7fb4600 could not be found. Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '1366d1f5-93f9-4228-ace9-9e37f7fb4600'} Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1366d1f5-93f9-4228-ace9-9e37f7fb4600 could not be found. Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1366d1f5-93f9-4228-ace9-9e37f7fb4600 could not be found. Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:50:02.142683 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:02.152710 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:02.152710 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:02.152710 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:50:02.152710 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:50:02.152710 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1366d1f5-93f9-4228-ace9-9e37f7fb4600 could not be found. Jul 25 12:50:02.152710 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:50:02.152710 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1291fa08-9363-4917-af3e-140d2143c13a tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Returning 404 to user: Instance group 1366d1f5-93f9-4228-ace9-9e37f7fb4600 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:50:02.152710 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1291fa08-9363-4917-af3e-140d2143c13a tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/1366d1f5-93f9-4228-ace9-9e37f7fb4600" status: 404 len: 117 microversion: 2.1 time: 0.017958 Jul 25 12:50:02.152710 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1402/2701] 10.222.0.49 () {58 vars in 1266 bytes} [Mon Jul 25 12:50:02 2022] DELETE /compute/v2.1/os-server-groups/1366d1f5-93f9-4228-ace9-9e37f7fb4600 => generated 117 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:50:02.157342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-cb1e0195-50e1-412d-b2d4-2f2b8623c7e0 req-fe8276d8-fccf-4477-93f1-cdd4663b7fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdebd9ec-1b71-49bd-8c36-5fcef5559715", "tag": "52dec511-bbb4-43dc-98fe-0397c1c41e5d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:50:02.170472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-cb1e0195-50e1-412d-b2d4-2f2b8623c7e0 req-fe8276d8-fccf-4477-93f1-cdd4663b7fc2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:02.171173 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-cb1e0195-50e1-412d-b2d4-2f2b8623c7e0 req-fe8276d8-fccf-4477-93f1-cdd4663b7fc2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:02.184492 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-cb1e0195-50e1-412d-b2d4-2f2b8623c7e0 req-fe8276d8-fccf-4477-93f1-cdd4663b7fc2 service nova] Creating event network-changed:52dec511-bbb4-43dc-98fe-0397c1c41e5d for instance fdebd9ec-1b71-49bd-8c36-5fcef5559715 on n-h2-848886-15 Jul 25 12:50:02.197157 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-cb1e0195-50e1-412d-b2d4-2f2b8623c7e0 req-fe8276d8-fccf-4477-93f1-cdd4663b7fc2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047871 Jul 25 12:50:02.198492 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1403/2702] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:50:02.203897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-55e81918-108f-46d7-8bce-60cd0e1cf4e0 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:02.204827 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-55e81918-108f-46d7-8bce-60cd0e1cf4e0 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:02.213341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-55e81918-108f-46d7-8bce-60cd0e1cf4e0 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:02.214223 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-55e81918-108f-46d7-8bce-60cd0e1cf4e0 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:02.215442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-55e81918-108f-46d7-8bce-60cd0e1cf4e0 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:02.216317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-55e81918-108f-46d7-8bce-60cd0e1cf4e0 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:02.749678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-55e81918-108f-46d7-8bce-60cd0e1cf4e0 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:02.758288 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-55e81918-108f-46d7-8bce-60cd0e1cf4e0 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1610 microversion: 2.1 time: 0.558309 Jul 25 12:50:02.773938 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1404/2703] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:02 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1610 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:02.779925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-063f07e7-a672-41c1-88b0-95993b9edbd6 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:02.787872 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-063f07e7-a672-41c1-88b0-95993b9edbd6 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] HTTP exception thrown: Instance group da4a73b1-f8ef-4a4e-8439-997fcdd45ffb could not be found. Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-063f07e7-a672-41c1-88b0-95993b9edbd6 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Request method failure captured: Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/os-server-groups/da4a73b1-f8ef-4a4e-8439-997fcdd45ffb HTTP/1.1 Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pFOusPYIUPpBLBtpacF7uBm_c7pqPfv9EvwVCg5jSkOCbsPp1GWt0Z7c-aVkUyG6PIJWR9T5SuOrlBB1Gtd9dgLsGR1fKK8U7J4VPgXWt8zfexb8_9vzaFEzUShaB-_aLTtb6pid6lvU-TpaYnw2EOw2qmMnbj1M7cwFaItj5INW9Y Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5b6ebc431b4d48fabc48c7efb261aeda Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerGroupTestJSON-861620959 Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5b6ebc431b4d48fabc48c7efb261aeda", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5b6ebc431b4d48fabc48c7efb261aeda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b6ebc431b4d48fabc48c7efb261aeda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b6ebc431b4d48fabc48c7efb261aeda"}]}] Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerGroupTestJSON-861620959 Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5b6ebc431b4d48fabc48c7efb261aeda Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerGroupTestJSON-861620959 Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerGroupTestJSON-861620959-project Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 557df3df55844c1588203a9319158934 Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerGroupTestJSON-861620959-project Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance group da4a73b1-f8ef-4a4e-8439-997fcdd45ffb could not be found. Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'da4a73b1-f8ef-4a4e-8439-997fcdd45ffb'} Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group da4a73b1-f8ef-4a4e-8439-997fcdd45ffb could not be found. Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group da4a73b1-f8ef-4a4e-8439-997fcdd45ffb could not be found. Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:50:02.790424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:02.795264 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:02.795264 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:02.795264 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:50:02.795264 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:50:02.795264 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group da4a73b1-f8ef-4a4e-8439-997fcdd45ffb could not be found. Jul 25 12:50:02.795264 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:50:02.797160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-063f07e7-a672-41c1-88b0-95993b9edbd6 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Returning 404 to user: Instance group da4a73b1-f8ef-4a4e-8439-997fcdd45ffb could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:50:02.798630 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-063f07e7-a672-41c1-88b0-95993b9edbd6 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/da4a73b1-f8ef-4a4e-8439-997fcdd45ffb" status: 404 len: 117 microversion: 2.1 time: 0.023299 Jul 25 12:50:02.800048 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1405/2704] 10.222.0.49 () {58 vars in 1266 bytes} [Mon Jul 25 12:50:02 2022] DELETE /compute/v2.1/os-server-groups/da4a73b1-f8ef-4a4e-8439-997fcdd45ffb => generated 117 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:50:02.810117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d802d3ae-faf4-4528-a3ff-21601534a986 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:02.814444 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:02.850182 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d802d3ae-faf4-4528-a3ff-21601534a986 tempest-ServerGroupTestJSON-861620959 tempest-ServerGroupTestJSON-861620959-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/85dc53dd-42e2-41de-be66-a3ff9c3fca0a" status: 204 len: 0 microversion: 2.1 time: 0.044509 Jul 25 12:50:02.851514 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1406/2705] 10.222.0.49 () {58 vars in 1266 bytes} [Mon Jul 25 12:50:02 2022] DELETE /compute/v2.1/os-server-groups/85dc53dd-42e2-41de-be66-a3ff9c3fca0a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:50:03.145273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a82667bc-3ed9-40b5-bf9a-40e7b95606ca tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:03.146947 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a82667bc-3ed9-40b5-bf9a-40e7b95606ca tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:03.163915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a82667bc-3ed9-40b5-bf9a-40e7b95606ca tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:03.169087 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a82667bc-3ed9-40b5-bf9a-40e7b95606ca tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:03.172941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a82667bc-3ed9-40b5-bf9a-40e7b95606ca tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:03.174375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a82667bc-3ed9-40b5-bf9a-40e7b95606ca tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:03.211344 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4b0f37c3-eaed-4c87-8f04-cd4f70499f39 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/b498a9d0-4a9d-46f5-81a4-2b9716b6ae0f" status: 202 len: 0 microversion: 2.1 time: 3.337868 Jul 25 12:50:03.212462 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1300/2706] 10.222.0.49 () {58 vars in 1263 bytes} [Mon Jul 25 12:49:59 2022] DELETE /compute/v2.1/os-floating-ips/b498a9d0-4a9d-46f5-81a4-2b9716b6ae0f => generated 0 bytes in 3340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:50:03.221904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d0077963-28a0-4260-832a-3e71702c6ced tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:03.222807 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d0077963-28a0-4260-832a-3e71702c6ced tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:03.247064 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d0077963-28a0-4260-832a-3e71702c6ced tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:03.247526 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d0077963-28a0-4260-832a-3e71702c6ced tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:03.248338 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d0077963-28a0-4260-832a-3e71702c6ced tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:03.248781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d0077963-28a0-4260-832a-3e71702c6ced tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:03.304828 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=80,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=2,nova_cell1:RELEASE=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:03.310832 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d0077963-28a0-4260-832a-3e71702c6ced tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:50:03.479907 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d0077963-28a0-4260-832a-3e71702c6ced tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c" status: 204 len: 0 microversion: 2.1 time: 0.261690 Jul 25 12:50:03.480539 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1301/2707] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:50:03 2022] DELETE /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 12:50:03.497976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ef84f19c-0815-4f45-82b5-1391c18f9d5d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:03.498705 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ef84f19c-0815-4f45-82b5-1391c18f9d5d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:03.513745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef84f19c-0815-4f45-82b5-1391c18f9d5d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:03.519906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef84f19c-0815-4f45-82b5-1391c18f9d5d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:03.521161 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef84f19c-0815-4f45-82b5-1391c18f9d5d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:03.521798 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef84f19c-0815-4f45-82b5-1391c18f9d5d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:03.595497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a82667bc-3ed9-40b5-bf9a-40e7b95606ca tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17c9f43612c483ba96eb09787b4dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cbbf76c3f4848b4a558de341ec19d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:03.613124 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a82667bc-3ed9-40b5-bf9a-40e7b95606ca tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715" status: 200 len: 1317 microversion: 2.1 time: 0.470264 Jul 25 12:50:03.624004 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1407/2708] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:03 2022] GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715 => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:03.782042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-53a464e4-2925-4cb1-b6b1-e234c6907781 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:03.782877 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-53a464e4-2925-4cb1-b6b1-e234c6907781 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:03.795476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53a464e4-2925-4cb1-b6b1-e234c6907781 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:03.800728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53a464e4-2925-4cb1-b6b1-e234c6907781 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:03.801690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53a464e4-2925-4cb1-b6b1-e234c6907781 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:03.811152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ef84f19c-0815-4f45-82b5-1391c18f9d5d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:03.819846 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ef84f19c-0815-4f45-82b5-1391c18f9d5d tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c" status: 200 len: 1525 microversion: 2.1 time: 0.333208 Jul 25 12:50:03.820985 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-53a464e4-2925-4cb1-b6b1-e234c6907781 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:03.825740 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1302/2709] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:03 2022] GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c => generated 1525 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:04.076194 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-53a464e4-2925-4cb1-b6b1-e234c6907781 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:04.089773 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-53a464e4-2925-4cb1-b6b1-e234c6907781 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1542 microversion: 2.1 time: 0.312950 Jul 25 12:50:04.092561 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1408/2710] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:03 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1542 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:04.640018 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a6f9666b-9dd0-482f-b26e-44265ba9194a tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:04.641072 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a6f9666b-9dd0-482f-b26e-44265ba9194a tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:04.672597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a6f9666b-9dd0-482f-b26e-44265ba9194a tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:04.673290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a6f9666b-9dd0-482f-b26e-44265ba9194a tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:04.678862 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a6f9666b-9dd0-482f-b26e-44265ba9194a tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:04.682737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a6f9666b-9dd0-482f-b26e-44265ba9194a tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:04.850945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-836b338e-a222-48db-9dba-1dfce18570b1 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:04.852044 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-836b338e-a222-48db-9dba-1dfce18570b1 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:04.869647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-836b338e-a222-48db-9dba-1dfce18570b1 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:04.871372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-836b338e-a222-48db-9dba-1dfce18570b1 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:04.874807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-836b338e-a222-48db-9dba-1dfce18570b1 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:04.875647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-836b338e-a222-48db-9dba-1dfce18570b1 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:05.172518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a6f9666b-9dd0-482f-b26e-44265ba9194a tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17c9f43612c483ba96eb09787b4dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cbbf76c3f4848b4a558de341ec19d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:05.180843 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a6f9666b-9dd0-482f-b26e-44265ba9194a tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715" status: 200 len: 1317 microversion: 2.1 time: 0.546619 Jul 25 12:50:05.190893 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1303/2711] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:04 2022] GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715 => generated 1317 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:05.198479 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-87306afc-51e7-4eba-980b-bf455eaff24b tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:05.199116 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-87306afc-51e7-4eba-980b-bf455eaff24b tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:05.218539 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87306afc-51e7-4eba-980b-bf455eaff24b tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:05.219006 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87306afc-51e7-4eba-980b-bf455eaff24b tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:05.219804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87306afc-51e7-4eba-980b-bf455eaff24b tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:05.220251 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87306afc-51e7-4eba-980b-bf455eaff24b tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:05.457851 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-87306afc-51e7-4eba-980b-bf455eaff24b tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:05.473386 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-87306afc-51e7-4eba-980b-bf455eaff24b tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1542 microversion: 2.1 time: 0.281122 Jul 25 12:50:05.486712 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1304/2712] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:05 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1542 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:05.776078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-836b338e-a222-48db-9dba-1dfce18570b1 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:05.796818 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-836b338e-a222-48db-9dba-1dfce18570b1 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c" status: 200 len: 1525 microversion: 2.1 time: 0.948101 Jul 25 12:50:05.798938 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1409/2713] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:04 2022] GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c => generated 1525 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:06.207796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-722dac78-5f93-4941-b763-a0aa87b2e11d tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:06.208893 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-722dac78-5f93-4941-b763-a0aa87b2e11d tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:06.231354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-722dac78-5f93-4941-b763-a0aa87b2e11d tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:06.232056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-722dac78-5f93-4941-b763-a0aa87b2e11d tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:06.233316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-722dac78-5f93-4941-b763-a0aa87b2e11d tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:06.234003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-722dac78-5f93-4941-b763-a0aa87b2e11d tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:06.301641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-748c8d73-5937-4b79-a349-0f272076060e req-487233e4-1a5d-498a-a58d-2ff02d58cba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a467b47-ccc6-4656-aefe-48797aab42b4", "name": "network-vif-deleted", "tag": "a717f19c-082c-42c4-9467-fd733519794a"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:50:06.326548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-748c8d73-5937-4b79-a349-0f272076060e req-487233e4-1a5d-498a-a58d-2ff02d58cba4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:06.327313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-748c8d73-5937-4b79-a349-0f272076060e req-487233e4-1a5d-498a-a58d-2ff02d58cba4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:06.349823 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-748c8d73-5937-4b79-a349-0f272076060e req-487233e4-1a5d-498a-a58d-2ff02d58cba4 service nova] Creating event network-vif-deleted:a717f19c-082c-42c4-9467-fd733519794a for instance 3a467b47-ccc6-4656-aefe-48797aab42b4 on n-h2-848886-15 Jul 25 12:50:06.356861 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-748c8d73-5937-4b79-a349-0f272076060e req-487233e4-1a5d-498a-a58d-2ff02d58cba4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058801 Jul 25 12:50:06.357812 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1410/2714] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:50:06.510077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6d921a0d-6d8f-46d0-b92e-61e73ee9bdbd tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:06.510973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6d921a0d-6d8f-46d0-b92e-61e73ee9bdbd tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:06.525941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6d921a0d-6d8f-46d0-b92e-61e73ee9bdbd tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:06.526395 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6d921a0d-6d8f-46d0-b92e-61e73ee9bdbd tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:06.527619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6d921a0d-6d8f-46d0-b92e-61e73ee9bdbd tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:06.528080 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6d921a0d-6d8f-46d0-b92e-61e73ee9bdbd tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:06.890981 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:06.984536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6d921a0d-6d8f-46d0-b92e-61e73ee9bdbd tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:07.005686 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6d921a0d-6d8f-46d0-b92e-61e73ee9bdbd tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1252 microversion: 2.1 time: 0.500297 Jul 25 12:50:07.007466 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1411/2715] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:06 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1252 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:07.022082 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:07.036231 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7a0abbc1-1b25-449b-80ee-f9d9fbe2fd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:07.038164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7a0abbc1-1b25-449b-80ee-f9d9fbe2fd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:07.069627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a0abbc1-1b25-449b-80ee-f9d9fbe2fd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:07.070965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a0abbc1-1b25-449b-80ee-f9d9fbe2fd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:07.077466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a0abbc1-1b25-449b-80ee-f9d9fbe2fd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:07.078108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a0abbc1-1b25-449b-80ee-f9d9fbe2fd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:07.804161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7a0abbc1-1b25-449b-80ee-f9d9fbe2fd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8245528326d34330ae7f790ef6b0b62b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777390f07e0c4d398c2a5916bc558ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:07.831443 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7a0abbc1-1b25-449b-80ee-f9d9fbe2fd8e tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c" status: 200 len: 1483 microversion: 2.1 time: 0.822674 Jul 25 12:50:07.862107 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1412/2716] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:07 2022] GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c => generated 1483 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:08.029949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-30fbf218-2c1c-4a34-95a0-1a8a0290785f tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:08.031076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-30fbf218-2c1c-4a34-95a0-1a8a0290785f tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:08.039683 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-30fbf218-2c1c-4a34-95a0-1a8a0290785f tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:08.060440 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-30fbf218-2c1c-4a34-95a0-1a8a0290785f tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:08.062833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-30fbf218-2c1c-4a34-95a0-1a8a0290785f tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:08.066303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-30fbf218-2c1c-4a34-95a0-1a8a0290785f tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:08.324315 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-722dac78-5f93-4941-b763-a0aa87b2e11d tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17c9f43612c483ba96eb09787b4dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cbbf76c3f4848b4a558de341ec19d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:08.338599 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-722dac78-5f93-4941-b763-a0aa87b2e11d tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715" status: 200 len: 1317 microversion: 2.1 time: 2.131293 Jul 25 12:50:08.346458 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1305/2717] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:06 2022] GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715 => generated 1317 bytes in 2145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:50:08.387889 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-30fbf218-2c1c-4a34-95a0-1a8a0290785f tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:08.402061 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-30fbf218-2c1c-4a34-95a0-1a8a0290785f tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1252 microversion: 2.1 time: 0.376616 Jul 25 12:50:08.404656 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1413/2718] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:08 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1252 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:50:08.877356 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-78762a65-83f3-4bb6-bc58-29315e064953 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:08.878367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-78762a65-83f3-4bb6-bc58-29315e064953 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] [instance: d3c4f646-aa62-4629-9c15-e57a9058a04c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:08.895913 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:08.898108 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78762a65-83f3-4bb6-bc58-29315e064953 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:08.898805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78762a65-83f3-4bb6-bc58-29315e064953 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:08.900186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78762a65-83f3-4bb6-bc58-29315e064953 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:08.902429 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78762a65-83f3-4bb6-bc58-29315e064953 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:08.953016 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-78762a65-83f3-4bb6-bc58-29315e064953 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] HTTP exception thrown: Instance d3c4f646-aa62-4629-9c15-e57a9058a04c could not be found. Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-78762a65-83f3-4bb6-bc58-29315e064953 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Request method failure captured: Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c HTTP/1.1 Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pEdPxLidVhBnd_LOUsOJoc4JrCV846K-9JWCECDvLZlmuOtyZlf7TST2jJcxRJd7hH2Q1bjeXfYThvuP1XszDnp3e8YmokdWUeIfsBjHvZPCL31qWxu6liL7TI3jFv9RKwAuRx21c0KIicv58xWMWsOLhNK8IKy5Ton-idxSsG-mQo Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 777390f07e0c4d398c2a5916bc558ed2 Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1038886839 Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_777390f07e0c4d398c2a5916bc558ed2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/777390f07e0c4d398c2a5916bc558ed2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/777390f07e0c4d398c2a5916bc558ed2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/777390f07e0c4d398c2a5916bc558ed2"}]}] Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1038886839 Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 777390f07e0c4d398c2a5916bc558ed2 Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1038886839 Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-FloatingIPsAssociationTestJSON-1038886839-project Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8245528326d34330ae7f790ef6b0b62b Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1038886839-project Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance d3c4f646-aa62-4629-9c15-e57a9058a04c could not be found. Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'd3c4f646-aa62-4629-9c15-e57a9058a04c'} Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3c4f646-aa62-4629-9c15-e57a9058a04c could not be found. Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3c4f646-aa62-4629-9c15-e57a9058a04c could not be found. Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:50:08.972606 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:08.976537 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:50:08.976537 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:08.976537 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:08.976537 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:08.976537 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:50:08.976537 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:50:08.976537 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3c4f646-aa62-4629-9c15-e57a9058a04c could not be found. Jul 25 12:50:08.976537 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:50:08.981001 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-78762a65-83f3-4bb6-bc58-29315e064953 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] Returning 404 to user: Instance d3c4f646-aa62-4629-9c15-e57a9058a04c could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:50:08.982290 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-78762a65-83f3-4bb6-bc58-29315e064953 tempest-FloatingIPsAssociationTestJSON-1038886839 tempest-FloatingIPsAssociationTestJSON-1038886839-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c" status: 404 len: 111 microversion: 2.1 time: 0.117417 Jul 25 12:50:08.991516 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1306/2719] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:08 2022] GET /compute/v2.1/servers/d3c4f646-aa62-4629-9c15-e57a9058a04c => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:50:09.001363 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-93d0ba0a-bc26-4344-94c9-6612b430a9d1 req-197022cc-af83-4e72-b74e-6db67f06bc7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c4f646-aa62-4629-9c15-e57a9058a04c", "name": "network-vif-deleted", "tag": "14a08691-36d3-4ae2-aa10-f18a2799fbb3"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:50:09.051888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-93d0ba0a-bc26-4344-94c9-6612b430a9d1 req-197022cc-af83-4e72-b74e-6db67f06bc7b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:09.052252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-93d0ba0a-bc26-4344-94c9-6612b430a9d1 req-197022cc-af83-4e72-b74e-6db67f06bc7b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:09.096820 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-93d0ba0a-bc26-4344-94c9-6612b430a9d1 req-197022cc-af83-4e72-b74e-6db67f06bc7b service nova] Creating event network-vif-deleted:14a08691-36d3-4ae2-aa10-f18a2799fbb3 for instance d3c4f646-aa62-4629-9c15-e57a9058a04c on n-h1-848886-15 Jul 25 12:50:09.113667 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-93d0ba0a-bc26-4344-94c9-6612b430a9d1 req-197022cc-af83-4e72-b74e-6db67f06bc7b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116932 Jul 25 12:50:09.114624 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1414/2720] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:50:09.372020 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5d6ab273-9b2a-48e5-92fe-176ed87304ab tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:09.373400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5d6ab273-9b2a-48e5-92fe-176ed87304ab tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:09.385251 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d6ab273-9b2a-48e5-92fe-176ed87304ab tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:09.397595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d6ab273-9b2a-48e5-92fe-176ed87304ab tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:09.398825 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d6ab273-9b2a-48e5-92fe-176ed87304ab tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:09.399521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d6ab273-9b2a-48e5-92fe-176ed87304ab tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:09.440317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-128310d0-44d2-4bc0-a6ce-40162c5d22db tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:09.448260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-128310d0-44d2-4bc0-a6ce-40162c5d22db tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:09.509672 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-128310d0-44d2-4bc0-a6ce-40162c5d22db tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:09.510321 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-128310d0-44d2-4bc0-a6ce-40162c5d22db tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:09.511257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-128310d0-44d2-4bc0-a6ce-40162c5d22db tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:09.520248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-128310d0-44d2-4bc0-a6ce-40162c5d22db tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:10.077171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-128310d0-44d2-4bc0-a6ce-40162c5d22db tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:10.093741 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-128310d0-44d2-4bc0-a6ce-40162c5d22db tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1252 microversion: 2.1 time: 0.669686 Jul 25 12:50:10.097660 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1415/2721] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:09 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1252 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:10.325003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5d6ab273-9b2a-48e5-92fe-176ed87304ab tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17c9f43612c483ba96eb09787b4dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cbbf76c3f4848b4a558de341ec19d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:10.336764 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5d6ab273-9b2a-48e5-92fe-176ed87304ab tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715" status: 200 len: 1317 microversion: 2.1 time: 0.969647 Jul 25 12:50:10.337363 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1307/2722] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:09 2022] GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715 => generated 1317 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:11.126908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8a70f9f7-795e-4a38-9bda-08aa7fb55098 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:11.134990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8a70f9f7-795e-4a38-9bda-08aa7fb55098 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:11.145630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a70f9f7-795e-4a38-9bda-08aa7fb55098 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:11.146549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a70f9f7-795e-4a38-9bda-08aa7fb55098 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:11.147588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a70f9f7-795e-4a38-9bda-08aa7fb55098 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:11.148348 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a70f9f7-795e-4a38-9bda-08aa7fb55098 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:11.310729 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8a70f9f7-795e-4a38-9bda-08aa7fb55098 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:11.321929 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8a70f9f7-795e-4a38-9bda-08aa7fb55098 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1252 microversion: 2.1 time: 0.206465 Jul 25 12:50:11.324367 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1416/2723] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:11 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1252 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:11.361674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-04ca3001-2273-4c25-a288-593483069dc5 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:11.362581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-04ca3001-2273-4c25-a288-593483069dc5 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:11.377377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-04ca3001-2273-4c25-a288-593483069dc5 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:11.378952 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-04ca3001-2273-4c25-a288-593483069dc5 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:11.379968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-04ca3001-2273-4c25-a288-593483069dc5 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:11.380430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-04ca3001-2273-4c25-a288-593483069dc5 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:11.989772 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-04ca3001-2273-4c25-a288-593483069dc5 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17c9f43612c483ba96eb09787b4dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cbbf76c3f4848b4a558de341ec19d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:12.012115 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-04ca3001-2273-4c25-a288-593483069dc5 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715" status: 200 len: 1317 microversion: 2.1 time: 0.654920 Jul 25 12:50:12.013168 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1308/2724] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:11 2022] GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715 => generated 1317 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:12.345011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f08bb641-fbef-4f6d-ba3f-62274d1b5a33 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:12.346660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f08bb641-fbef-4f6d-ba3f-62274d1b5a33 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:12.364944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f08bb641-fbef-4f6d-ba3f-62274d1b5a33 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:12.366724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f08bb641-fbef-4f6d-ba3f-62274d1b5a33 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:12.368173 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f08bb641-fbef-4f6d-ba3f-62274d1b5a33 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:12.376779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f08bb641-fbef-4f6d-ba3f-62274d1b5a33 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:12.628901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f08bb641-fbef-4f6d-ba3f-62274d1b5a33 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:12.645021 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f08bb641-fbef-4f6d-ba3f-62274d1b5a33 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1252 microversion: 2.1 time: 0.300645 Jul 25 12:50:12.648804 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1417/2725] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:12 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1252 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:13.044662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6b06b84e-c190-4f51-b4ec-4342be863bb1 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:13.045783 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6b06b84e-c190-4f51-b4ec-4342be863bb1 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:13.102520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b06b84e-c190-4f51-b4ec-4342be863bb1 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:13.106538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b06b84e-c190-4f51-b4ec-4342be863bb1 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:13.108053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b06b84e-c190-4f51-b4ec-4342be863bb1 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:13.108827 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b06b84e-c190-4f51-b4ec-4342be863bb1 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:13.436165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6b06b84e-c190-4f51-b4ec-4342be863bb1 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17c9f43612c483ba96eb09787b4dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cbbf76c3f4848b4a558de341ec19d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:13.447086 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6b06b84e-c190-4f51-b4ec-4342be863bb1 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715" status: 200 len: 1317 microversion: 2.1 time: 0.411856 Jul 25 12:50:13.465366 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1309/2726] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:13 2022] GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715 => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:13.667739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-09506834-57a0-4877-9796-38085b10e4f7 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:13.669229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-09506834-57a0-4877-9796-38085b10e4f7 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:13.685491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09506834-57a0-4877-9796-38085b10e4f7 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:13.696762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09506834-57a0-4877-9796-38085b10e4f7 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:13.702956 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09506834-57a0-4877-9796-38085b10e4f7 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:13.709013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09506834-57a0-4877-9796-38085b10e4f7 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:13.841513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-09506834-57a0-4877-9796-38085b10e4f7 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:13.865639 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-09506834-57a0-4877-9796-38085b10e4f7 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1252 microversion: 2.1 time: 0.199399 Jul 25 12:50:13.883285 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1418/2727] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:13 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1252 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:14.474167 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7cf59a64-b07c-491a-9235-1ae0af52eef2 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:14.475641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7cf59a64-b07c-491a-9235-1ae0af52eef2 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:14.499922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7cf59a64-b07c-491a-9235-1ae0af52eef2 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:14.503466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7cf59a64-b07c-491a-9235-1ae0af52eef2 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:14.507389 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7cf59a64-b07c-491a-9235-1ae0af52eef2 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:14.510580 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7cf59a64-b07c-491a-9235-1ae0af52eef2 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:14.892437 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b8efa533-d3eb-44dc-ada0-0b7ebea52211 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:14.893107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b8efa533-d3eb-44dc-ada0-0b7ebea52211 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:14.909275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7cf59a64-b07c-491a-9235-1ae0af52eef2 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17c9f43612c483ba96eb09787b4dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cbbf76c3f4848b4a558de341ec19d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:14.909917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8efa533-d3eb-44dc-ada0-0b7ebea52211 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:14.911159 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8efa533-d3eb-44dc-ada0-0b7ebea52211 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:14.914822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8efa533-d3eb-44dc-ada0-0b7ebea52211 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:14.916755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8efa533-d3eb-44dc-ada0-0b7ebea52211 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:14.919391 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7cf59a64-b07c-491a-9235-1ae0af52eef2 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715" status: 200 len: 1317 microversion: 2.1 time: 0.450744 Jul 25 12:50:14.923602 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1310/2728] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:14 2022] GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715 => generated 1317 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:15.132989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b8efa533-d3eb-44dc-ada0-0b7ebea52211 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:15.153010 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b8efa533-d3eb-44dc-ada0-0b7ebea52211 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1252 microversion: 2.1 time: 0.265219 Jul 25 12:50:15.180316 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1419/2729] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:14 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1252 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:15.947721 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d4806e04-e950-4893-9a88-f486ce8f3906 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:15.948462 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d4806e04-e950-4893-9a88-f486ce8f3906 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:15.964263 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4806e04-e950-4893-9a88-f486ce8f3906 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:15.965498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4806e04-e950-4893-9a88-f486ce8f3906 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:15.966473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4806e04-e950-4893-9a88-f486ce8f3906 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:15.967783 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4806e04-e950-4893-9a88-f486ce8f3906 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:16.178556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f655b2ad-f4d9-44a8-823a-f73f2966601b tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:16.179348 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f655b2ad-f4d9-44a8-823a-f73f2966601b tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:16.210602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f655b2ad-f4d9-44a8-823a-f73f2966601b tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:16.211056 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f655b2ad-f4d9-44a8-823a-f73f2966601b tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:16.213360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f655b2ad-f4d9-44a8-823a-f73f2966601b tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:16.219049 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f655b2ad-f4d9-44a8-823a-f73f2966601b tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:16.405674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f655b2ad-f4d9-44a8-823a-f73f2966601b tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcae4341ba9e4cc0b93e00998c653d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f088db318e364b5caf92d51ea9e5b562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:16.419432 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f655b2ad-f4d9-44a8-823a-f73f2966601b tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 200 len: 1252 microversion: 2.1 time: 0.246133 Jul 25 12:50:16.434541 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1420/2730] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:16 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 1252 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:16.606610 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d4806e04-e950-4893-9a88-f486ce8f3906 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17c9f43612c483ba96eb09787b4dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cbbf76c3f4848b4a558de341ec19d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:16.620935 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d4806e04-e950-4893-9a88-f486ce8f3906 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715" status: 200 len: 1317 microversion: 2.1 time: 0.672828 Jul 25 12:50:16.622647 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1311/2731] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:15 2022] GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715 => generated 1317 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:16.675355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-a7fef91d-de7c-48d7-b5ac-cbc899c2c9c6 req-0a4545aa-d46b-4ac4-90c6-22af34309351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdebd9ec-1b71-49bd-8c36-5fcef5559715", "name": "network-vif-plugged", "status": "completed", "tag": "52dec511-bbb4-43dc-98fe-0397c1c41e5d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:50:16.709153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a7fef91d-de7c-48d7-b5ac-cbc899c2c9c6 req-0a4545aa-d46b-4ac4-90c6-22af34309351 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:16.713035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a7fef91d-de7c-48d7-b5ac-cbc899c2c9c6 req-0a4545aa-d46b-4ac4-90c6-22af34309351 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:16.750690 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-a7fef91d-de7c-48d7-b5ac-cbc899c2c9c6 req-0a4545aa-d46b-4ac4-90c6-22af34309351 service nova] Creating event network-vif-plugged:52dec511-bbb4-43dc-98fe-0397c1c41e5d for instance fdebd9ec-1b71-49bd-8c36-5fcef5559715 on n-h2-848886-15 Jul 25 12:50:16.771196 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-a7fef91d-de7c-48d7-b5ac-cbc899c2c9c6 req-0a4545aa-d46b-4ac4-90c6-22af34309351 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098978 Jul 25 12:50:16.772244 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1421/2732] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:50:17.440963 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0182760d-2b45-469c-92f2-4aefc5384735 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:17.441556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0182760d-2b45-469c-92f2-4aefc5384735 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] [instance: 3a467b47-ccc6-4656-aefe-48797aab42b4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:17.451953 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0182760d-2b45-469c-92f2-4aefc5384735 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:17.452674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0182760d-2b45-469c-92f2-4aefc5384735 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:17.453770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0182760d-2b45-469c-92f2-4aefc5384735 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:17.458521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0182760d-2b45-469c-92f2-4aefc5384735 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:17.492806 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-0182760d-2b45-469c-92f2-4aefc5384735 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] HTTP exception thrown: Instance 3a467b47-ccc6-4656-aefe-48797aab42b4 could not be found. Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0182760d-2b45-469c-92f2-4aefc5384735 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Request method failure captured: Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 HTTP/1.1 Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pD6XUG7NiQCW9y3OQvt66Wa_owr8YDU8f-_sqUhCMEL9lcwta_2xq__PYRpFG1AmXUYo2rw63k4PwxEwSDtPKSL_hoOvpwDbdcPtzyHb1zqXSIo6KgCKYDWPZxZOh_HvkzZhwSZRwU9-ew_V1Zsy2SdUogAu2HHDEyg5-NyOX4vvdI Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: f088db318e364b5caf92d51ea9e5b562 Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersTestBootFromVolume-456198368 Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f088db318e364b5caf92d51ea9e5b562", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f088db318e364b5caf92d51ea9e5b562"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f088db318e364b5caf92d51ea9e5b562"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f088db318e364b5caf92d51ea9e5b562"}]}] Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersTestBootFromVolume-456198368 Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: f088db318e364b5caf92d51ea9e5b562 Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersTestBootFromVolume-456198368 Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersTestBootFromVolume-456198368-project Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: dcae4341ba9e4cc0b93e00998c653d53 Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersTestBootFromVolume-456198368-project Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 3a467b47-ccc6-4656-aefe-48797aab42b4 could not be found. Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '3a467b47-ccc6-4656-aefe-48797aab42b4'} Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a467b47-ccc6-4656-aefe-48797aab42b4 could not be found. Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a467b47-ccc6-4656-aefe-48797aab42b4 could not be found. Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:17.494782 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:50:17.499456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:17.499456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:17.499456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:17.499456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:50:17.499456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:50:17.499456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a467b47-ccc6-4656-aefe-48797aab42b4 could not be found. Jul 25 12:50:17.499456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:50:17.500850 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0182760d-2b45-469c-92f2-4aefc5384735 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Returning 404 to user: Instance 3a467b47-ccc6-4656-aefe-48797aab42b4 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:50:17.501940 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0182760d-2b45-469c-92f2-4aefc5384735 tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4" status: 404 len: 111 microversion: 2.1 time: 0.065104 Jul 25 12:50:17.503052 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1312/2733] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:17 2022] GET /compute/v2.1/servers/3a467b47-ccc6-4656-aefe-48797aab42b4 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:50:17.512607 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-00282538-2f3c-4df0-a64d-b91d9f296ecb tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] Calling method '.version_select at 0x7efcf8fc58b0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:17.568500 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-00282538-2f3c-4df0-a64d-b91d9f296ecb tempest-ServersTestBootFromVolume-456198368 tempest-ServersTestBootFromVolume-456198368-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1414037427" status: 202 len: 0 microversion: 2.1 time: 0.060393 Jul 25 12:50:17.569866 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1422/2734] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Jul 25 12:50:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1414037427 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:50:17.651269 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-73fe45c1-6d6a-49b6-87f1-265005281a08 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:17.652809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-73fe45c1-6d6a-49b6-87f1-265005281a08 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:17.686282 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73fe45c1-6d6a-49b6-87f1-265005281a08 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:17.686962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73fe45c1-6d6a-49b6-87f1-265005281a08 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:17.687964 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73fe45c1-6d6a-49b6-87f1-265005281a08 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:17.691051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73fe45c1-6d6a-49b6-87f1-265005281a08 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:19.011989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-73fe45c1-6d6a-49b6-87f1-265005281a08 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17c9f43612c483ba96eb09787b4dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cbbf76c3f4848b4a558de341ec19d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:19.055704 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-73fe45c1-6d6a-49b6-87f1-265005281a08 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715" status: 200 len: 1317 microversion: 2.1 time: 1.408963 Jul 25 12:50:19.057513 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1313/2735] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:17 2022] GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715 => generated 1317 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:20.081820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-61ca27a5-674c-403d-99df-bae55f27d8c7 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:20.095078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-61ca27a5-674c-403d-99df-bae55f27d8c7 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:20.116185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-61ca27a5-674c-403d-99df-bae55f27d8c7 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:20.118339 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-61ca27a5-674c-403d-99df-bae55f27d8c7 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:20.120025 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-61ca27a5-674c-403d-99df-bae55f27d8c7 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:20.124244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-61ca27a5-674c-403d-99df-bae55f27d8c7 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:21.472192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-61ca27a5-674c-403d-99df-bae55f27d8c7 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17c9f43612c483ba96eb09787b4dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cbbf76c3f4848b4a558de341ec19d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:21.484297 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-61ca27a5-674c-403d-99df-bae55f27d8c7 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715" status: 200 len: 1467 microversion: 2.1 time: 1.409303 Jul 25 12:50:21.485083 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1423/2736] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:20 2022] GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715 => generated 1467 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:21.510780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3b01a84c-3376-4977-8206-a0bdf1518529 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1065806410", "metadata": {"image_type": "test"}}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:50:21.513669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3b01a84c-3376-4977-8206-a0bdf1518529 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:21.537747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b01a84c-3376-4977-8206-a0bdf1518529 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:21.538471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b01a84c-3376-4977-8206-a0bdf1518529 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:21.539594 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b01a84c-3376-4977-8206-a0bdf1518529 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:21.540259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b01a84c-3376-4977-8206-a0bdf1518529 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:21.693053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-3b01a84c-3376-4977-8206-a0bdf1518529 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Getting quotas for project 8a7cbbf76c3f4848b4a558de341ec19d. Resources: dict_keys(['metadata_items']) {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:50:21.721640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-3b01a84c-3376-4977-8206-a0bdf1518529 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Getting quotas for user a17c9f43612c483ba96eb09787b4dd47 and project 8a7cbbf76c3f4848b4a558de341ec19d. Resources: dict_keys(['metadata_items']) {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:50:22.152632 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3b01a84c-3376-4977-8206-a0bdf1518529 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "POST /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715/action" status: 202 len: 0 microversion: 2.1 time: 0.646356 Jul 25 12:50:22.160188 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1314/2737] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:50:21 2022] POST /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715/action => generated 0 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 12:50:22.168685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dade5a2d-a20f-478d-8604-5edfd8ebcf01 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8fc5b80>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:22.271215 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dade5a2d-a20f-478d-8604-5edfd8ebcf01 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854" status: 200 len: 1424 microversion: 2.1 time: 0.105819 Jul 25 12:50:22.272520 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1424/2738] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:22 2022] GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854 => generated 1424 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:50:23.288344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-71c14383-afdc-4ae5-b378-f391d1dcdc6f tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8d28f70>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:23.404840 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-71c14383-afdc-4ae5-b378-f391d1dcdc6f tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854" status: 200 len: 1424 microversion: 2.1 time: 0.120800 Jul 25 12:50:23.411790 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1315/2739] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:23 2022] GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854 => generated 1424 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:23.435345 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7de0fc11-eb89-48b0-9acd-623f43521d0d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1708876357", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "622b85e9-22d3-4989-8758-6b16816bc927"}, {"uuid": "8c363f39-649f-41b0-9b7a-763c8e548a76"}, {"uuid": "622b85e9-22d3-4989-8758-6b16816bc927"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:50:23.550267 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-7de0fc11-eb89-48b0-9acd-623f43521d0d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] validate_networks() for [('622b85e9-22d3-4989-8758-6b16816bc927', None, None, None, None, None), ('8c363f39-649f-41b0-9b7a-763c8e548a76', None, None, None, None, None), ('622b85e9-22d3-4989-8758-6b16816bc927', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:50:24.433273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9a868851-4009-4a51-a27c-dba4f2b9afe0 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8e164c0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:24.534563 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9a868851-4009-4a51-a27c-dba4f2b9afe0 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854" status: 200 len: 1424 microversion: 2.1 time: 0.111018 Jul 25 12:50:24.536902 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1316/2740] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:24 2022] GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854 => generated 1424 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:25.550276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-638d977f-006e-4379-b6b4-d9d791e4df0a tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8dccb80>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:25.662431 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-638d977f-006e-4379-b6b4-d9d791e4df0a tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854" status: 200 len: 1424 microversion: 2.1 time: 0.116149 Jul 25 12:50:25.663895 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1317/2741] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:25 2022] GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854 => generated 1424 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:26.679614 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b971a74a-506a-4237-abb8-2040997d63b9 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8e16940>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:26.788507 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b971a74a-506a-4237-abb8-2040997d63b9 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854" status: 200 len: 1424 microversion: 2.1 time: 0.112963 Jul 25 12:50:26.789155 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1318/2742] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:26 2022] GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854 => generated 1424 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:27.806722 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f4b83d7f-7446-44a7-91aa-f7aeb8f020ff tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf9cfe430>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:27.886535 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f4b83d7f-7446-44a7-91aa-f7aeb8f020ff tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854" status: 200 len: 1424 microversion: 2.1 time: 0.086754 Jul 25 12:50:27.887778 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1319/2743] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:27 2022] GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854 => generated 1424 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:28.506703 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-7de0fc11-eb89-48b0-9acd-623f43521d0d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:50:28.507403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-7de0fc11-eb89-48b0-9acd-623f43521d0d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:50:28.507949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-7de0fc11-eb89-48b0-9acd-623f43521d0d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:50:28.508104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-7de0fc11-eb89-48b0-9acd-623f43521d0d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:50:28.508418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-7de0fc11-eb89-48b0-9acd-623f43521d0d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:50:28.526157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7de0fc11-eb89-48b0-9acd-623f43521d0d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:28.526578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7de0fc11-eb89-48b0-9acd-623f43521d0d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:28.527322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7de0fc11-eb89-48b0-9acd-623f43521d0d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:28.527764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7de0fc11-eb89-48b0-9acd-623f43521d0d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:28.553893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:28.573251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-7de0fc11-eb89-48b0-9acd-623f43521d0d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Getting quotas for project af716a8b586d45b2aa95b8c73683ff0d. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:50:28.587944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-7de0fc11-eb89-48b0-9acd-623f43521d0d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Getting quotas for user f912ac6820e44b40977a2913a80c7bec and project af716a8b586d45b2aa95b8c73683ff0d. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:50:28.628211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7de0fc11-eb89-48b0-9acd-623f43521d0d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:50:28.630682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7de0fc11-eb89-48b0-9acd-623f43521d0d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:50:28.768714 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7de0fc11-eb89-48b0-9acd-623f43521d0d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.341598 Jul 25 12:50:28.770040 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1425/2744] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:50:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 5344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:50:28.787084 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2a74f437-a865-4630-8c21-b8a6e705641e tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:28.788264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2a74f437-a865-4630-8c21-b8a6e705641e tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:28.906106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-640a76f0-7f06-4963-9d0c-8af2dbc9e440 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf908ef70>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:29.023409 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-640a76f0-7f06-4963-9d0c-8af2dbc9e440 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854" status: 200 len: 1424 microversion: 2.1 time: 0.124485 Jul 25 12:50:29.024027 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1426/2745] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:28 2022] GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854 => generated 1424 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:29.136099 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2a74f437-a865-4630-8c21-b8a6e705641e tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:29.154024 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2a74f437-a865-4630-8c21-b8a6e705641e tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1213 microversion: 2.1 time: 0.371547 Jul 25 12:50:29.156596 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1320/2746] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:28 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1213 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:30.040702 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5dd4a1e5-9a0a-4b1f-b531-a50ba7ab36c7 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8fd41f0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:30.148141 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5dd4a1e5-9a0a-4b1f-b531-a50ba7ab36c7 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854" status: 200 len: 1424 microversion: 2.1 time: 0.113423 Jul 25 12:50:30.151885 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1427/2747] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:30 2022] GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854 => generated 1424 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:30.189009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0d318618-5ea5-4466-9aa5-d05b2dd47fe7 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:30.196446 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0d318618-5ea5-4466-9aa5-d05b2dd47fe7 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:30.251314 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d318618-5ea5-4466-9aa5-d05b2dd47fe7 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:30.252903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d318618-5ea5-4466-9aa5-d05b2dd47fe7 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:30.259722 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d318618-5ea5-4466-9aa5-d05b2dd47fe7 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:30.262863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d318618-5ea5-4466-9aa5-d05b2dd47fe7 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:30.373309 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:30.474595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0d318618-5ea5-4466-9aa5-d05b2dd47fe7 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:30.486065 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0d318618-5ea5-4466-9aa5-d05b2dd47fe7 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1217 microversion: 2.1 time: 0.309451 Jul 25 12:50:30.486683 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1321/2748] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:30 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1217 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:31.164764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a7a69004-b940-4454-8678-cba66cb7704e tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8fc5b80>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:31.271649 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a7a69004-b940-4454-8678-cba66cb7704e tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854" status: 200 len: 1424 microversion: 2.1 time: 0.111576 Jul 25 12:50:31.272467 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1428/2749] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:31 2022] GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854 => generated 1424 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:31.515768 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0fffdb0e-f3c7-47ff-ab13-ec2eaf31260e tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:31.515768 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0fffdb0e-f3c7-47ff-ab13-ec2eaf31260e tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:31.534794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0fffdb0e-f3c7-47ff-ab13-ec2eaf31260e tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:31.535260 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0fffdb0e-f3c7-47ff-ab13-ec2eaf31260e tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:31.536137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0fffdb0e-f3c7-47ff-ab13-ec2eaf31260e tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:31.536584 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0fffdb0e-f3c7-47ff-ab13-ec2eaf31260e tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:31.870242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0fffdb0e-f3c7-47ff-ab13-ec2eaf31260e tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:31.903730 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0fffdb0e-f3c7-47ff-ab13-ec2eaf31260e tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1273 microversion: 2.1 time: 0.398690 Jul 25 12:50:31.913710 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1322/2750] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:31 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1273 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:32.290011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0943e21b-8bcf-43a2-a3bf-88b07afc8a8a tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8fe0310>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:32.421287 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0943e21b-8bcf-43a2-a3bf-88b07afc8a8a tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854" status: 200 len: 1424 microversion: 2.1 time: 0.136974 Jul 25 12:50:32.424013 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1429/2751] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:32 2022] GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854 => generated 1424 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:32.939463 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8285a99d-bb78-4eb9-8066-742ef2031a23 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:32.946625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8285a99d-bb78-4eb9-8066-742ef2031a23 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:33.039330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8285a99d-bb78-4eb9-8066-742ef2031a23 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:33.043931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8285a99d-bb78-4eb9-8066-742ef2031a23 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:33.046961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8285a99d-bb78-4eb9-8066-742ef2031a23 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:33.050990 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8285a99d-bb78-4eb9-8066-742ef2031a23 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:33.441322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4b6c2a33-18a4-470b-9509-e92ceab29072 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8fe0280>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:33.616505 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4b6c2a33-18a4-470b-9509-e92ceab29072 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854" status: 200 len: 1424 microversion: 2.1 time: 0.182241 Jul 25 12:50:33.617462 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1430/2752] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:33 2022] GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854 => generated 1424 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:33.639724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-05667678-59dc-4c36-9a25-7fddc59c95a7 req-dcacceb8-2031-4a99-bf79-9adfa390c0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdebd9ec-1b71-49bd-8c36-5fcef5559715", "name": "network-vif-plugged", "status": "completed", "tag": "52dec511-bbb4-43dc-98fe-0397c1c41e5d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:50:33.674489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:33.690240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8285a99d-bb78-4eb9-8066-742ef2031a23 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:33.702140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-05667678-59dc-4c36-9a25-7fddc59c95a7 req-dcacceb8-2031-4a99-bf79-9adfa390c0f6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:33.706486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-05667678-59dc-4c36-9a25-7fddc59c95a7 req-dcacceb8-2031-4a99-bf79-9adfa390c0f6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:33.714611 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8285a99d-bb78-4eb9-8066-742ef2031a23 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1271 microversion: 2.1 time: 0.782418 Jul 25 12:50:33.727007 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1323/2753] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:32 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1271 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:33.789153 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-05667678-59dc-4c36-9a25-7fddc59c95a7 req-dcacceb8-2031-4a99-bf79-9adfa390c0f6 service nova] Creating event network-vif-plugged:52dec511-bbb4-43dc-98fe-0397c1c41e5d for instance fdebd9ec-1b71-49bd-8c36-5fcef5559715 on n-h2-848886-15 Jul 25 12:50:33.814843 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-05667678-59dc-4c36-9a25-7fddc59c95a7 req-dcacceb8-2031-4a99-bf79-9adfa390c0f6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190542 Jul 25 12:50:33.816428 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1431/2754] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:50:34.636397 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-36fcc17a-6f63-4ecd-bcee-4bd66cee160b tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8dcc040>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:34.762960 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-345fbcce-8a72-46b0-b0e0-fae14c016bb6 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:34.768971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-345fbcce-8a72-46b0-b0e0-fae14c016bb6 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:34.794549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-345fbcce-8a72-46b0-b0e0-fae14c016bb6 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:34.799525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-345fbcce-8a72-46b0-b0e0-fae14c016bb6 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:34.801203 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-345fbcce-8a72-46b0-b0e0-fae14c016bb6 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:34.807827 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-345fbcce-8a72-46b0-b0e0-fae14c016bb6 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:35.574388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-345fbcce-8a72-46b0-b0e0-fae14c016bb6 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:35.620927 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-345fbcce-8a72-46b0-b0e0-fae14c016bb6 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1271 microversion: 2.1 time: 0.867407 Jul 25 12:50:35.634512 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1432/2755] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:34 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1271 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:36.302954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ea16ef92-5e66-43cf-8a7c-84946fd0d66c tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Calling method '.version_select at 0x7efcf8f82dc0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:36.443912 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-36fcc17a-6f63-4ecd-bcee-4bd66cee160b tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854" status: 200 len: 1424 microversion: 2.1 time: 1.814842 Jul 25 12:50:36.444639 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1324/2756] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:34 2022] GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854 => generated 1424 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:36.550327 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ea16ef92-5e66-43cf-8a7c-84946fd0d66c tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] 10.222.0.49 "GET /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677" status: 200 len: 636 microversion: 2.1 time: 0.251270 Jul 25 12:50:36.553482 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1433/2757] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:36 2022] GET /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677 => generated 636 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:50:36.581610 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5970a030-bd90-466f-bace-48a6a419b41e tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Action: 'update_all', calling method: .version_select at 0x7efcf99169d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:50:36.670451 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-10802319-afb0-4b24-9e1b-5714dc7b1e60 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:36.672852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-10802319-afb0-4b24-9e1b-5714dc7b1e60 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:36.729009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10802319-afb0-4b24-9e1b-5714dc7b1e60 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:36.732877 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10802319-afb0-4b24-9e1b-5714dc7b1e60 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:36.735553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10802319-afb0-4b24-9e1b-5714dc7b1e60 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:36.740455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10802319-afb0-4b24-9e1b-5714dc7b1e60 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:36.778184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-5970a030-bd90-466f-bace-48a6a419b41e tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Getting quotas for project cf015a1892844925836d37d6808e235b. Resources: dict_keys(['metadata_items']) {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:50:36.817512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-5970a030-bd90-466f-bace-48a6a419b41e tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Getting quotas for user 03409002ebed4e33b77686062a2aecda and project cf015a1892844925836d37d6808e235b. Resources: dict_keys(['metadata_items']) {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:50:37.908355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-10802319-afb0-4b24-9e1b-5714dc7b1e60 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:37.983589 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-10802319-afb0-4b24-9e1b-5714dc7b1e60 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1313 microversion: 2.1 time: 1.313208 Jul 25 12:50:37.985409 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1434/2758] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:36 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1313 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:38.017312 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b24e0f57-d87d-4d2f-900e-5adae7918d30 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf90c90d0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:38.551561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:38.617174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:43.695510 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=15 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:46.726642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=5 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:46.860333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:46.902734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=43 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:47.970444 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=15 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:01.617195 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b24e0f57-d87d-4d2f-900e-5adae7918d30 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854" status: 200 len: 1433 microversion: 2.1 time: 23.629631 Jul 25 12:51:01.620446 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1435/2759] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:37 2022] GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854 => generated 1433 bytes in 23634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:01.635369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1dac483f-4368-43cb-82cc-b3cc9d0daac5 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:01.636630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1dac483f-4368-43cb-82cc-b3cc9d0daac5 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:01.689453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dac483f-4368-43cb-82cc-b3cc9d0daac5 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:01.689950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dac483f-4368-43cb-82cc-b3cc9d0daac5 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:01.697482 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dac483f-4368-43cb-82cc-b3cc9d0daac5 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:01.701102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dac483f-4368-43cb-82cc-b3cc9d0daac5 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:02.434384 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5970a030-bd90-466f-bace-48a6a419b41e tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] 10.222.0.49 "PUT /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata" status: 200 len: 61 microversion: 2.1 time: 25.860515 Jul 25 12:51:02.435150 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1325/2760] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 12:50:36 2022] PUT /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata => generated 61 bytes in 25863 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:51:02.442489 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-0996ee72-bebb-4556-ac86-b22989e979c4 req-c1bfccbb-9d1d-4b10-a2e7-018eac9adca2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd68f842-1690-4f88-8dc3-f0e72bae78a3", "tag": "db7fc6b2-e698-4a2f-9230-3a4a5d9678fc"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:02.470336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0996ee72-bebb-4556-ac86-b22989e979c4 req-c1bfccbb-9d1d-4b10-a2e7-018eac9adca2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:02.471568 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0996ee72-bebb-4556-ac86-b22989e979c4 req-c1bfccbb-9d1d-4b10-a2e7-018eac9adca2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:02.500325 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-0996ee72-bebb-4556-ac86-b22989e979c4 req-c1bfccbb-9d1d-4b10-a2e7-018eac9adca2 service nova] Creating event network-changed:db7fc6b2-e698-4a2f-9230-3a4a5d9678fc for instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 on n-h1-848886-15 Jul 25 12:51:02.514339 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-0996ee72-bebb-4556-ac86-b22989e979c4 req-c1bfccbb-9d1d-4b10-a2e7-018eac9adca2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076652 Jul 25 12:51:02.516998 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1326/2761] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:51:02.528542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2109eb20-b8c0-42b6-961c-75c084fcb8b3 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8d5a040>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:02.643126 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2109eb20-b8c0-42b6-961c-75c084fcb8b3 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854" status: 200 len: 1433 microversion: 2.1 time: 0.122095 Jul 25 12:51:02.644499 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1327/2762] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:02 2022] GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854 => generated 1433 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:02.649632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c51b694b-9f75-4508-b87b-8b9c614b58ee tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Calling method '.version_select at 0x7efcf97f1c10>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:03.570295 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c51b694b-9f75-4508-b87b-8b9c614b58ee tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] 10.222.0.49 "DELETE /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.924012 Jul 25 12:51:03.571375 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1328/2763] 10.222.0.49 () {58 vars in 1296 bytes} [Mon Jul 25 12:51:02 2022] DELETE /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata/os_version => generated 0 bytes in 926 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:51:03.601929 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bddc25b9-c16f-45a6-b659-0d8aa38d9cb1 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:03.606730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bddc25b9-c16f-45a6-b659-0d8aa38d9cb1 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:03.642348 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bddc25b9-c16f-45a6-b659-0d8aa38d9cb1 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:03.643197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bddc25b9-c16f-45a6-b659-0d8aa38d9cb1 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:03.650589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bddc25b9-c16f-45a6-b659-0d8aa38d9cb1 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:03.651120 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bddc25b9-c16f-45a6-b659-0d8aa38d9cb1 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:03.788411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1dac483f-4368-43cb-82cc-b3cc9d0daac5 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:03.796528 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1dac483f-4368-43cb-82cc-b3cc9d0daac5 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1355 microversion: 2.1 time: 2.174688 Jul 25 12:51:03.802279 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1436/2764] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:01 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1355 bytes in 2181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:03.815929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f7f3c55d-8bcc-46f7-bf0a-1c1ca93641f9 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Calling method '.version_select at 0x7efcf9b40310>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:03.932296 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f7f3c55d-8bcc-46f7-bf0a-1c1ca93641f9 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] 10.222.0.49 "GET /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata" status: 200 len: 37 microversion: 2.1 time: 0.128103 Jul 25 12:51:03.940564 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1437/2765] 10.222.0.49 () {58 vars in 1260 bytes} [Mon Jul 25 12:51:03 2022] GET /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata => generated 37 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:51:03.949819 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a1776b8e-8a5f-475e-8747-6480c9a1cae5 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Action: 'update_all', calling method: .version_select at 0x7efcf8fd40d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:04.190852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-a1776b8e-8a5f-475e-8747-6480c9a1cae5 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Getting quotas for project cf015a1892844925836d37d6808e235b. Resources: dict_keys(['metadata_items']) {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:51:04.241525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-a1776b8e-8a5f-475e-8747-6480c9a1cae5 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Getting quotas for user 03409002ebed4e33b77686062a2aecda and project cf015a1892844925836d37d6808e235b. Resources: dict_keys(['metadata_items']) {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:51:05.155440 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a1776b8e-8a5f-475e-8747-6480c9a1cae5 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] 10.222.0.49 "PUT /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata" status: 200 len: 61 microversion: 2.1 time: 1.213336 Jul 25 12:51:05.157564 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1438/2766] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 12:51:03 2022] PUT /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata => generated 61 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:51:05.163025 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-e5a127a5-48d2-4920-97a3-f63a68dcb9c7 req-c491d1c0-0726-48b5-a5d0-c28e09c116fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd68f842-1690-4f88-8dc3-f0e72bae78a3", "tag": "9d510304-8914-4721-bcd3-3a751a8ee457"}, {"name": "network-changed", "server_uuid": "bd68f842-1690-4f88-8dc3-f0e72bae78a3", "tag": "0d74ea81-13e8-4d64-a0aa-58cfd4296d1f"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:05.174810 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e5a127a5-48d2-4920-97a3-f63a68dcb9c7 req-c491d1c0-0726-48b5-a5d0-c28e09c116fd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:05.175782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e5a127a5-48d2-4920-97a3-f63a68dcb9c7 req-c491d1c0-0726-48b5-a5d0-c28e09c116fd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:05.193455 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-e5a127a5-48d2-4920-97a3-f63a68dcb9c7 req-c491d1c0-0726-48b5-a5d0-c28e09c116fd service nova] Creating event network-changed:9d510304-8914-4721-bcd3-3a751a8ee457 for instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 on n-h1-848886-15 Jul 25 12:51:05.194357 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-e5a127a5-48d2-4920-97a3-f63a68dcb9c7 req-c491d1c0-0726-48b5-a5d0-c28e09c116fd service nova] Creating event network-changed:0d74ea81-13e8-4d64-a0aa-58cfd4296d1f for instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 on n-h1-848886-15 Jul 25 12:51:05.201045 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-e5a127a5-48d2-4920-97a3-f63a68dcb9c7 req-c491d1c0-0726-48b5-a5d0-c28e09c116fd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041852 Jul 25 12:51:05.202346 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1439/2767] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:51:05.208982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0b32a383-dc9e-4002-9e4c-5b29edc96f46 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:05.210599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0b32a383-dc9e-4002-9e4c-5b29edc96f46 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:05.225166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bddc25b9-c16f-45a6-b659-0d8aa38d9cb1 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17c9f43612c483ba96eb09787b4dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cbbf76c3f4848b4a558de341ec19d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:05.228723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b32a383-dc9e-4002-9e4c-5b29edc96f46 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:05.230656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b32a383-dc9e-4002-9e4c-5b29edc96f46 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:05.232150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b32a383-dc9e-4002-9e4c-5b29edc96f46 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:05.232986 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b32a383-dc9e-4002-9e4c-5b29edc96f46 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:05.242540 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bddc25b9-c16f-45a6-b659-0d8aa38d9cb1 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715" status: 200 len: 1467 microversion: 2.1 time: 1.669601 Jul 25 12:51:05.243453 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1329/2768] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:03 2022] GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715 => generated 1467 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:05.258871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-52a09c44-236b-45f7-8d6f-438eb92da9cd tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Calling method '.version_select at 0x7efcf8d5a0d0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:05.395357 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-52a09c44-236b-45f7-8d6f-438eb92da9cd tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] 10.222.0.49 "GET /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.145080 Jul 25 12:51:05.396387 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1330/2769] 10.222.0.49 () {58 vars in 1290 bytes} [Mon Jul 25 12:51:05 2022] GET /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata/os_distro => generated 33 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:51:05.407656 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-20bba2e3-4825-4b7e-b79f-3383a9720692 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8cd5430>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:05.532032 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-20bba2e3-4825-4b7e-b79f-3383a9720692 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/97beeed7-7564-4203-abda-feef7e93cd98" status: 200 len: 784 microversion: 2.1 time: 0.127466 Jul 25 12:51:05.537199 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1331/2770] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:05 2022] GET /compute/v2.1/images/97beeed7-7564-4203-abda-feef7e93cd98 => generated 784 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:51:05.545758 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-491ded8a-18fd-4cc1-a0a1-93d9d3bcee0b tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Action: 'update_all', calling method: .version_select at 0x7efcf8d5a040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:05.655210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-491ded8a-18fd-4cc1-a0a1-93d9d3bcee0b tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Getting quotas for project cf015a1892844925836d37d6808e235b. Resources: dict_keys(['metadata_items']) {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:51:05.662110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-491ded8a-18fd-4cc1-a0a1-93d9d3bcee0b tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Getting quotas for user 03409002ebed4e33b77686062a2aecda and project cf015a1892844925836d37d6808e235b. Resources: dict_keys(['metadata_items']) {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:51:06.022445 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-491ded8a-18fd-4cc1-a0a1-93d9d3bcee0b tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] 10.222.0.49 "PUT /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata" status: 200 len: 61 microversion: 2.1 time: 0.483619 Jul 25 12:51:06.023076 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1332/2771] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 12:51:05 2022] PUT /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata => generated 61 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:51:06.029921 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-36e80988-92b9-41e1-965b-2beeab81a850 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:06.060945 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-36e80988-92b9-41e1-965b-2beeab81a850 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031461 Jul 25 12:51:06.062140 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1333/2772] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:51:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:51:06.116420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-61f2c854-19f5-4844-bbdc-d52e64da4929 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Calling method '.version_select at 0x7efcf8d538b0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:06.216306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0b32a383-dc9e-4002-9e4c-5b29edc96f46 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:06.232710 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0b32a383-dc9e-4002-9e4c-5b29edc96f46 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1355 microversion: 2.1 time: 1.028608 Jul 25 12:51:06.246197 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-61f2c854-19f5-4844-bbdc-d52e64da4929 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] 10.222.0.49 "GET /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata" status: 200 len: 61 microversion: 2.1 time: 0.149741 Jul 25 12:51:06.247565 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1440/2773] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:05 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1355 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:06.251466 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1334/2774] 10.222.0.49 () {58 vars in 1260 bytes} [Mon Jul 25 12:51:06 2022] GET /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata => generated 61 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:51:06.262487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-21aa2b7c-79ed-4290-93d1-061cd1330a20 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8f790d0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:06.275092 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d373d44f-b9a1-4473-9f48-bb5fb64d3d44 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Action: 'update_all', calling method: .version_select at 0x7efcf8cdc3a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:06.408670 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-d373d44f-b9a1-4473-9f48-bb5fb64d3d44 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Getting quotas for project cf015a1892844925836d37d6808e235b. Resources: dict_keys(['metadata_items']) {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:51:06.438784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-d373d44f-b9a1-4473-9f48-bb5fb64d3d44 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Getting quotas for user 03409002ebed4e33b77686062a2aecda and project cf015a1892844925836d37d6808e235b. Resources: dict_keys(['metadata_items']) {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:51:06.894143 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d373d44f-b9a1-4473-9f48-bb5fb64d3d44 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] 10.222.0.49 "PUT /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata" status: 200 len: 61 microversion: 2.1 time: 0.634086 Jul 25 12:51:06.896023 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1335/2775] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 12:51:06 2022] PUT /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata => generated 61 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:51:06.913086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6d988291-4b66-439e-8a4c-01acf5c14aef tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Action: 'update_all', calling method: .version_select at 0x7efcf8dccdc0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:07.116688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-6d988291-4b66-439e-8a4c-01acf5c14aef tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Getting quotas for project cf015a1892844925836d37d6808e235b. Resources: dict_keys(['metadata_items']) {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:51:07.135581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-6d988291-4b66-439e-8a4c-01acf5c14aef tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Getting quotas for user 03409002ebed4e33b77686062a2aecda and project cf015a1892844925836d37d6808e235b. Resources: dict_keys(['metadata_items']) {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:51:07.939937 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-21aa2b7c-79ed-4290-93d1-061cd1330a20 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "DELETE /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854" status: 204 len: 0 microversion: 2.1 time: 1.689806 Jul 25 12:51:07.941271 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1441/2776] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:06 2022] DELETE /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854 => generated 0 bytes in 1693 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:51:07.973632 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-48c181fc-f644-4929-a1d2-b208ea29c6e3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:07.986095 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-48c181fc-f644-4929-a1d2-b208ea29c6e3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:08.014817 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6d988291-4b66-439e-8a4c-01acf5c14aef tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] 10.222.0.49 "PUT /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata" status: 200 len: 64 microversion: 2.1 time: 1.108326 Jul 25 12:51:08.022458 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1336/2777] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 12:51:06 2022] PUT /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata => generated 64 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:51:08.030015 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3a17c53d-b88c-4af6-add2-50d2549df8d6 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8cdcf70>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:08.034536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48c181fc-f644-4929-a1d2-b208ea29c6e3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:08.036066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48c181fc-f644-4929-a1d2-b208ea29c6e3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:08.037658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48c181fc-f644-4929-a1d2-b208ea29c6e3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:08.043760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48c181fc-f644-4929-a1d2-b208ea29c6e3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:08.082545 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-3a17c53d-b88c-4af6-add2-50d2549df8d6 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] HTTP exception thrown: Image not found. Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3a17c53d-b88c-4af6-add2-50d2549df8d6 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Request method failure captured: Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854 HTTP/1.1 Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pFoPbCXr3A75kkKcKJD1bwz5CTq4jH_RHLFXsEBbPn3NQghOoxdZQhZOyW4jDGfUSnDKELbd3tG88UR1f3VBuRU2wagLUQDACZjWqacdUUG8M5wlmdz09wo4ZszopOnIO9fm-cP1IGClLUhHyMxq3981XsJtmqjOTQxYMZcxlVPdfc Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 8a7cbbf76c3f4848b4a558de341ec19d Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ImagesOneServerTestJSON-1354646116 Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8a7cbbf76c3f4848b4a558de341ec19d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8a7cbbf76c3f4848b4a558de341ec19d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8a7cbbf76c3f4848b4a558de341ec19d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8a7cbbf76c3f4848b4a558de341ec19d"}]}] Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ImagesOneServerTestJSON-1354646116 Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 8a7cbbf76c3f4848b4a558de341ec19d Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1354646116 Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ImagesOneServerTestJSON-1354646116-project Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: a17c9f43612c483ba96eb09787b4dd47 Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ImagesOneServerTestJSON-1354646116-project Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: exception: Image not found. Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'a24134cd-3f6b-4a06-974c-8a01f8725854'} Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a24134cd-3f6b-4a06-974c-8a01f8725854 Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 12:51:08.086266 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a24134cd-3f6b-4a06-974c-8a01f8725854 could not be found. Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 12:51:08.094367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:51:08.101664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3a17c53d-b88c-4af6-add2-50d2549df8d6 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Returning 404 to user: Image not found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:51:08.102279 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3a17c53d-b88c-4af6-add2-50d2549df8d6 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854" status: 404 len: 62 microversion: 2.1 time: 0.077664 Jul 25 12:51:08.103414 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1337/2778] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:08 2022] GET /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854 => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:51:08.127705 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-81f9d953-02dc-4ffb-942a-07d4667f469f tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Calling method '.version_select at 0x7efcfecba550>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:08.207825 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-81f9d953-02dc-4ffb-942a-07d4667f469f tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] 10.222.0.49 "GET /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata" status: 200 len: 64 microversion: 2.1 time: 0.102095 Jul 25 12:51:08.210713 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1338/2779] 10.222.0.49 () {58 vars in 1260 bytes} [Mon Jul 25 12:51:08 2022] GET /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata => generated 64 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:51:08.225997 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-52789903-3d08-4a98-8a1d-d13ba8b18f0f tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1388473860"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:08.229002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-52789903-3d08-4a98-8a1d-d13ba8b18f0f tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:08.252998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-52789903-3d08-4a98-8a1d-d13ba8b18f0f tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:08.253994 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-52789903-3d08-4a98-8a1d-d13ba8b18f0f tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:08.255667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-52789903-3d08-4a98-8a1d-d13ba8b18f0f tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:08.256472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-52789903-3d08-4a98-8a1d-d13ba8b18f0f tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:08.612937 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-52789903-3d08-4a98-8a1d-d13ba8b18f0f tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "POST /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715/action" status: 202 len: 0 microversion: 2.1 time: 0.392600 Jul 25 12:51:08.613993 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1339/2780] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:51:08 2022] POST /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 12:51:08.623177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-56b6f844-16d0-4da0-967a-73e95e6d7644 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Action: 'update_all', calling method: .version_select at 0x7efcf8cd5430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:08.699767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-48c181fc-f644-4929-a1d2-b208ea29c6e3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:08.716764 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-48c181fc-f644-4929-a1d2-b208ea29c6e3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1355 microversion: 2.1 time: 0.769085 Jul 25 12:51:08.725306 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1442/2781] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:07 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1355 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:08.754969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-80d3cb5c-2970-4ed3-a7c1-05984f7ac275 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8f79280>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:08.760742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-56b6f844-16d0-4da0-967a-73e95e6d7644 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Getting quotas for project cf015a1892844925836d37d6808e235b. Resources: dict_keys(['metadata_items']) {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:51:08.787601 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-56b6f844-16d0-4da0-967a-73e95e6d7644 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Getting quotas for user 03409002ebed4e33b77686062a2aecda and project cf015a1892844925836d37d6808e235b. Resources: dict_keys(['metadata_items']) {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:51:08.893908 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-80d3cb5c-2970-4ed3-a7c1-05984f7ac275 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.154101 Jul 25 12:51:08.894593 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1443/2782] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:08 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:09.165417 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-6f57173a-cc72-42b5-8c69-169e5c49ad79 req-dbcdce1f-fabd-4b85-82a0-61278fc4a267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdebd9ec-1b71-49bd-8c36-5fcef5559715", "name": "network-vif-unplugged", "status": "completed", "tag": "52dec511-bbb4-43dc-98fe-0397c1c41e5d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:09.203643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6f57173a-cc72-42b5-8c69-169e5c49ad79 req-dbcdce1f-fabd-4b85-82a0-61278fc4a267 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:09.204354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6f57173a-cc72-42b5-8c69-169e5c49ad79 req-dbcdce1f-fabd-4b85-82a0-61278fc4a267 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:09.267767 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-6f57173a-cc72-42b5-8c69-169e5c49ad79 req-dbcdce1f-fabd-4b85-82a0-61278fc4a267 service nova] Creating event network-vif-unplugged:52dec511-bbb4-43dc-98fe-0397c1c41e5d for instance fdebd9ec-1b71-49bd-8c36-5fcef5559715 on n-h2-848886-15 Jul 25 12:51:09.287988 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-6f57173a-cc72-42b5-8c69-169e5c49ad79 req-dbcdce1f-fabd-4b85-82a0-61278fc4a267 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128840 Jul 25 12:51:09.290896 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1444/2783] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:51:09.734727 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-56b6f844-16d0-4da0-967a-73e95e6d7644 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] 10.222.0.49 "PUT /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata" status: 200 len: 61 microversion: 2.1 time: 1.118837 Jul 25 12:51:09.761075 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1340/2784] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 12:51:08 2022] PUT /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata => generated 61 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:51:09.773220 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0369a542-022b-42f1-9507-b519f7ecf82a tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Action: 'update', calling method: .version_select at 0x7efcf902d670>, body: {"meta": {"os_version": "alt"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:09.814234 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-06e7c590-794b-4e04-b696-1e3d0f685dfa tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:09.827414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-06e7c590-794b-4e04-b696-1e3d0f685dfa tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:09.859845 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06e7c590-794b-4e04-b696-1e3d0f685dfa tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:09.860942 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06e7c590-794b-4e04-b696-1e3d0f685dfa tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:09.864224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06e7c590-794b-4e04-b696-1e3d0f685dfa tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:09.866331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06e7c590-794b-4e04-b696-1e3d0f685dfa tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:09.964139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-0369a542-022b-42f1-9507-b519f7ecf82a tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Getting quotas for project cf015a1892844925836d37d6808e235b. Resources: dict_keys(['metadata_items']) {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:51:09.972881 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-0369a542-022b-42f1-9507-b519f7ecf82a tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Getting quotas for user 03409002ebed4e33b77686062a2aecda and project cf015a1892844925836d37d6808e235b. Resources: dict_keys(['metadata_items']) {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:51:10.594977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-06e7c590-794b-4e04-b696-1e3d0f685dfa tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:10.636279 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-06e7c590-794b-4e04-b696-1e3d0f685dfa tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1355 microversion: 2.1 time: 0.867980 Jul 25 12:51:10.661885 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1341/2785] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:09 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1355 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:10.715855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-72594e3a-4fd8-41e1-ac1b-017f8f6b1ac2 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8cf4820>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:10.764935 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0369a542-022b-42f1-9507-b519f7ecf82a tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] 10.222.0.49 "PUT /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 1.014869 Jul 25 12:51:10.766367 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1445/2786] 10.222.0.49 () {60 vars in 1313 bytes} [Mon Jul 25 12:51:09 2022] PUT /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata/os_version => generated 31 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:51:10.808603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d974ff14-929b-458a-80de-397148b835f4 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Calling method '.version_select at 0x7efcf90f1d30>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:10.833469 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-72594e3a-4fd8-41e1-ac1b-017f8f6b1ac2 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.146365 Jul 25 12:51:10.850847 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1342/2787] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:10 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:10.911380 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d974ff14-929b-458a-80de-397148b835f4 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] 10.222.0.49 "GET /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata" status: 200 len: 58 microversion: 2.1 time: 0.135209 Jul 25 12:51:10.934210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4035f7cb-d187-4145-906f-398e47d15835 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Action: 'update_all', calling method: .version_select at 0x7efcf8fe3310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:10.943102 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1446/2788] 10.222.0.49 () {58 vars in 1260 bytes} [Mon Jul 25 12:51:10 2022] GET /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata => generated 58 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:51:11.141333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-4035f7cb-d187-4145-906f-398e47d15835 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Getting quotas for project cf015a1892844925836d37d6808e235b. Resources: dict_keys(['metadata_items']) {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:51:11.171003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-4035f7cb-d187-4145-906f-398e47d15835 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Getting quotas for user 03409002ebed4e33b77686062a2aecda and project cf015a1892844925836d37d6808e235b. Resources: dict_keys(['metadata_items']) {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:51:11.698266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-49709dc7-2249-4aa9-a7f1-605a5f03b52a tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:11.698266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-49709dc7-2249-4aa9-a7f1-605a5f03b52a tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:11.712001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49709dc7-2249-4aa9-a7f1-605a5f03b52a tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:11.713905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49709dc7-2249-4aa9-a7f1-605a5f03b52a tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:11.714876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49709dc7-2249-4aa9-a7f1-605a5f03b52a tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:11.717473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49709dc7-2249-4aa9-a7f1-605a5f03b52a tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:11.885014 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4035f7cb-d187-4145-906f-398e47d15835 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] 10.222.0.49 "PUT /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata" status: 200 len: 61 microversion: 2.1 time: 0.961197 Jul 25 12:51:11.886015 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1343/2789] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 12:51:10 2022] PUT /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata => generated 61 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:51:11.893314 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-efc92ae0-0d0e-4df3-8abd-f645a462aba6 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8d289d0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:11.978787 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-efc92ae0-0d0e-4df3-8abd-f645a462aba6 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.090697 Jul 25 12:51:11.980905 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1344/2790] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:11 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:11.988013 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9e6f5845-da48-4a7f-a874-9ce9889dcac3 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Action: 'create', calling method: .version_select at 0x7efcf8cff1f0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:12.124904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-9e6f5845-da48-4a7f-a874-9ce9889dcac3 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Getting quotas for project cf015a1892844925836d37d6808e235b. Resources: dict_keys(['metadata_items']) {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:51:12.131947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-9e6f5845-da48-4a7f-a874-9ce9889dcac3 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Getting quotas for user 03409002ebed4e33b77686062a2aecda and project cf015a1892844925836d37d6808e235b. Resources: dict_keys(['metadata_items']) {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:51:13.123036 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9e6f5845-da48-4a7f-a874-9ce9889dcac3 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] 10.222.0.49 "POST /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata" status: 200 len: 85 microversion: 2.1 time: 1.139740 Jul 25 12:51:13.129980 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1345/2791] 10.222.0.49 () {60 vars in 1281 bytes} [Mon Jul 25 12:51:11 2022] POST /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata => generated 85 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:51:13.138537 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-11cdd1b6-1a5e-4b93-b044-1a17b687c11b tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8d64dc0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:13.257883 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-11cdd1b6-1a5e-4b93-b044-1a17b687c11b tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.126010 Jul 25 12:51:13.259211 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1346/2792] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:13 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:13.271660 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-852913d1-3491-4772-acdc-6ffc09212ac7 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] Calling method '.version_select at 0x7efcf8d2fc10>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:13.345498 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-852913d1-3491-4772-acdc-6ffc09212ac7 tempest-ImagesMetadataTestJSON-761240683 tempest-ImagesMetadataTestJSON-761240683-project] 10.222.0.49 "GET /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata" status: 200 len: 85 microversion: 2.1 time: 0.083174 Jul 25 12:51:13.346127 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1347/2793] 10.222.0.49 () {58 vars in 1260 bytes} [Mon Jul 25 12:51:13 2022] GET /compute/v2.1/images/5856a17a-e5fc-49ae-98a7-7555ecc63677/metadata => generated 85 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:51:14.005351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-49709dc7-2249-4aa9-a7f1-605a5f03b52a tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:14.020173 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-49709dc7-2249-4aa9-a7f1-605a5f03b52a tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1355 microversion: 2.1 time: 2.332841 Jul 25 12:51:14.035761 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1447/2794] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:11 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1355 bytes in 2336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:51:14.286582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9ab266c9-1233-4d6f-8df1-adf5dc00e29b tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf9916c10>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:14.421981 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9ab266c9-1233-4d6f-8df1-adf5dc00e29b tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.142058 Jul 25 12:51:14.422738 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1348/2795] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:14 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:15.066929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-90b7bbbe-97f5-4e01-b56d-afb7b2105ff3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:15.079684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-90b7bbbe-97f5-4e01-b56d-afb7b2105ff3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:15.114699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90b7bbbe-97f5-4e01-b56d-afb7b2105ff3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:15.115184 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90b7bbbe-97f5-4e01-b56d-afb7b2105ff3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:15.118353 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90b7bbbe-97f5-4e01-b56d-afb7b2105ff3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:15.124508 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90b7bbbe-97f5-4e01-b56d-afb7b2105ff3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:15.442664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3f285622-a34b-4f1d-a366-ea85f5df3fcd tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8d5a0d0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:15.583609 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3f285622-a34b-4f1d-a366-ea85f5df3fcd tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.149538 Jul 25 12:51:15.585860 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1349/2796] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:15 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:16.606769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fcdbc62c-9b33-46cf-b5d1-3a14947e876d tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8cbe4c0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:16.727551 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fcdbc62c-9b33-46cf-b5d1-3a14947e876d tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.126096 Jul 25 12:51:16.728752 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1350/2797] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:16 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:16.821618 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-90b7bbbe-97f5-4e01-b56d-afb7b2105ff3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:16.854749 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-90b7bbbe-97f5-4e01-b56d-afb7b2105ff3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1355 microversion: 2.1 time: 1.785696 Jul 25 12:51:16.870873 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1448/2798] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:15 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1355 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:17.747250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-22ecdd70-9abb-4cd3-97cd-1a0e6213db8b tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf9916c10>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:17.889589 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-22ecdd70-9abb-4cd3-97cd-1a0e6213db8b tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.149020 Jul 25 12:51:17.893270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-48cd879a-75eb-46b8-8ff5-c65d67c72757 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:17.894235 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1351/2799] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:17 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:17.895647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-48cd879a-75eb-46b8-8ff5-c65d67c72757 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:17.957260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48cd879a-75eb-46b8-8ff5-c65d67c72757 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:17.958500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48cd879a-75eb-46b8-8ff5-c65d67c72757 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:17.963532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48cd879a-75eb-46b8-8ff5-c65d67c72757 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:17.967954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48cd879a-75eb-46b8-8ff5-c65d67c72757 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:18.442836 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4c3af6ff-b80b-496a-807e-88fd67203d48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1668382839", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "b6926756-00b4-4271-8538-f2e94168b61a"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:18.555285 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-4c3af6ff-b80b-496a-807e-88fd67203d48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] validate_networks() for [('b6926756-00b4-4271-8538-f2e94168b61a', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:51:19.987062 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=8 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:20.610588 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:21.348237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-48cd879a-75eb-46b8-8ff5-c65d67c72757 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:21.358358 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-48cd879a-75eb-46b8-8ff5-c65d67c72757 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1355 microversion: 2.1 time: 3.474406 Jul 25 12:51:21.364979 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1449/2800] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:17 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1355 bytes in 3482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:21.384762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9c3ff746-5c11-482f-80c9-0e28b6e8cb45 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf902d430>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:21.478783 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9c3ff746-5c11-482f-80c9-0e28b6e8cb45 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.110457 Jul 25 12:51:21.484323 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1450/2801] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:21 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:22.150803 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=24 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:22.407698 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9e04af24-88ba-4674-a11a-c07db05cd7ab tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:22.408316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9e04af24-88ba-4674-a11a-c07db05cd7ab tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:22.434859 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e04af24-88ba-4674-a11a-c07db05cd7ab tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:22.439930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e04af24-88ba-4674-a11a-c07db05cd7ab tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:22.440910 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e04af24-88ba-4674-a11a-c07db05cd7ab tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:22.441373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e04af24-88ba-4674-a11a-c07db05cd7ab tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:23.481634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9e04af24-88ba-4674-a11a-c07db05cd7ab tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:23.491092 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9e04af24-88ba-4674-a11a-c07db05cd7ab tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1355 microversion: 2.1 time: 1.089043 Jul 25 12:51:23.496311 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1451/2802] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:22 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1355 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:23.511016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8bb3aab0-fe9e-40ad-9d6d-6b19b2491e87 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8fc58b0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:23.610386 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8bb3aab0-fe9e-40ad-9d6d-6b19b2491e87 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.112357 Jul 25 12:51:23.611321 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1452/2803] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:23 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:24.538904 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ef900760-6c25-4b33-b8fe-6d2c142ec1fa tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:24.539756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ef900760-6c25-4b33-b8fe-6d2c142ec1fa tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:24.554580 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef900760-6c25-4b33-b8fe-6d2c142ec1fa tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:24.559305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef900760-6c25-4b33-b8fe-6d2c142ec1fa tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:24.561766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef900760-6c25-4b33-b8fe-6d2c142ec1fa tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:24.566180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef900760-6c25-4b33-b8fe-6d2c142ec1fa tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:24.882735 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4c3af6ff-b80b-496a-807e-88fd67203d48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:51:24.883344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4c3af6ff-b80b-496a-807e-88fd67203d48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:51:24.884229 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4c3af6ff-b80b-496a-807e-88fd67203d48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:51:24.884871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4c3af6ff-b80b-496a-807e-88fd67203d48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:51:24.886077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4c3af6ff-b80b-496a-807e-88fd67203d48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:51:24.925421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c3af6ff-b80b-496a-807e-88fd67203d48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:24.968508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c3af6ff-b80b-496a-807e-88fd67203d48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.043s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:24.970037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c3af6ff-b80b-496a-807e-88fd67203d48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:24.973632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c3af6ff-b80b-496a-807e-88fd67203d48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:25.103277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-4c3af6ff-b80b-496a-807e-88fd67203d48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Getting quotas for project f07680a55b3f41408d3a284d1330503d. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:51:25.125912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-4c3af6ff-b80b-496a-807e-88fd67203d48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Getting quotas for user d28f966411004a158377c689fd5b05eb and project f07680a55b3f41408d3a284d1330503d. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:51:25.173016 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4c3af6ff-b80b-496a-807e-88fd67203d48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:51:25.175858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4c3af6ff-b80b-496a-807e-88fd67203d48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 7bbd0058-28f5-4b75-832b-f4828cc292c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:51:25.395343 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4c3af6ff-b80b-496a-807e-88fd67203d48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.293880 Jul 25 12:51:25.399080 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1352/2804] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:51:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 7299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:51:25.422535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a08ed43b-ec93-4c35-b65f-5f64d559f330 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8d28b80>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:25.573764 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a08ed43b-ec93-4c35-b65f-5f64d559f330 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.173220 Jul 25 12:51:25.583163 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1353/2805] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:25 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:25.592214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a5555b61-8159-4e50-bd28-e06bdbe3e374 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:25.592853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a5555b61-8159-4e50-bd28-e06bdbe3e374 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 7bbd0058-28f5-4b75-832b-f4828cc292c2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:26.124883 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a5555b61-8159-4e50-bd28-e06bdbe3e374 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:26.164750 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a5555b61-8159-4e50-bd28-e06bdbe3e374 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2" status: 200 len: 1215 microversion: 2.1 time: 0.585798 Jul 25 12:51:26.170939 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1354/2806] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:25 2022] GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2 => generated 1215 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:26.577604 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ef900760-6c25-4b33-b8fe-6d2c142ec1fa tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:26.593726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-23c0f281-acc1-4653-a418-b30c37d34c92 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8cc8160>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:26.634101 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ef900760-6c25-4b33-b8fe-6d2c142ec1fa tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1355 microversion: 2.1 time: 2.086204 Jul 25 12:51:26.634101 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1453/2807] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:24 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1355 bytes in 2089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:26.806252 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-23c0f281-acc1-4653-a418-b30c37d34c92 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.217815 Jul 25 12:51:26.806922 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1355/2808] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:26 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:27.171311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-a5a36355-fd1a-402b-aa70-9b96de289174 req-27c88389-e079-42a5-a1a7-86450745bd22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdebd9ec-1b71-49bd-8c36-5fcef5559715", "name": "network-vif-plugged", "status": "completed", "tag": "52dec511-bbb4-43dc-98fe-0397c1c41e5d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:27.184205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=37 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:27.194634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9c349084-28d5-416c-a433-3f7d87a4671e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:27.195677 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9c349084-28d5-416c-a433-3f7d87a4671e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 7bbd0058-28f5-4b75-832b-f4828cc292c2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:27.198265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:27.245267 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a5a36355-fd1a-402b-aa70-9b96de289174 req-27c88389-e079-42a5-a1a7-86450745bd22 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:27.252640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c349084-28d5-416c-a433-3f7d87a4671e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:27.253440 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a5a36355-fd1a-402b-aa70-9b96de289174 req-27c88389-e079-42a5-a1a7-86450745bd22 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:27.259820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c349084-28d5-416c-a433-3f7d87a4671e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:27.260832 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c349084-28d5-416c-a433-3f7d87a4671e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:27.263667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c349084-28d5-416c-a433-3f7d87a4671e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:27.317453 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-a5a36355-fd1a-402b-aa70-9b96de289174 req-27c88389-e079-42a5-a1a7-86450745bd22 service nova] Creating event network-vif-plugged:52dec511-bbb4-43dc-98fe-0397c1c41e5d for instance fdebd9ec-1b71-49bd-8c36-5fcef5559715 on n-h2-848886-15 Jul 25 12:51:27.362950 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-a5a36355-fd1a-402b-aa70-9b96de289174 req-27c88389-e079-42a5-a1a7-86450745bd22 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192565 Jul 25 12:51:27.374744 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1454/2809] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:51:27.658682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ad2e3b43-5c79-4fdc-beb2-d1aa25ac3d88 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:27.661407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ad2e3b43-5c79-4fdc-beb2-d1aa25ac3d88 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:27.711358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ad2e3b43-5c79-4fdc-beb2-d1aa25ac3d88 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:27.720107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ad2e3b43-5c79-4fdc-beb2-d1aa25ac3d88 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:27.722227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ad2e3b43-5c79-4fdc-beb2-d1aa25ac3d88 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:27.729316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ad2e3b43-5c79-4fdc-beb2-d1aa25ac3d88 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:28.311780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9c349084-28d5-416c-a433-3f7d87a4671e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:28.322559 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9c349084-28d5-416c-a433-3f7d87a4671e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2" status: 200 len: 1211 microversion: 2.1 time: 1.134024 Jul 25 12:51:28.323176 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1356/2810] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:27 2022] GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2 => generated 1211 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:28.345170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7dec9f78-2e1d-421a-a15b-e0d0957f79fc tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8dc61f0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:28.496206 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7dec9f78-2e1d-421a-a15b-e0d0957f79fc tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.155152 Jul 25 12:51:28.497006 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1357/2811] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:28 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:28.553378 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ad2e3b43-5c79-4fdc-beb2-d1aa25ac3d88 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:28.561745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=59 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:28.585731 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ad2e3b43-5c79-4fdc-beb2-d1aa25ac3d88 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1355 microversion: 2.1 time: 0.936717 Jul 25 12:51:28.589139 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1455/2812] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:27 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1355 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:51:29.352324 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b5dd5371-7daf-4abf-aefb-30bdf1c73c42 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:29.354945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b5dd5371-7daf-4abf-aefb-30bdf1c73c42 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 7bbd0058-28f5-4b75-832b-f4828cc292c2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:29.395673 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b5dd5371-7daf-4abf-aefb-30bdf1c73c42 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:29.396468 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b5dd5371-7daf-4abf-aefb-30bdf1c73c42 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:29.397887 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b5dd5371-7daf-4abf-aefb-30bdf1c73c42 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:29.398787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b5dd5371-7daf-4abf-aefb-30bdf1c73c42 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:29.522337 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ac047846-8470-4d69-a4d8-ffe367cc81c7 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf90f1430>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:29.684932 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ac047846-8470-4d69-a4d8-ffe367cc81c7 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.174062 Jul 25 12:51:29.691005 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1456/2813] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:29 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:29.727917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6efcab05-0f1c-49e9-9cf2-5129c0dd60a0 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:29.733473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6efcab05-0f1c-49e9-9cf2-5129c0dd60a0 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:29.775044 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6efcab05-0f1c-49e9-9cf2-5129c0dd60a0 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:29.776293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6efcab05-0f1c-49e9-9cf2-5129c0dd60a0 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:29.787303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6efcab05-0f1c-49e9-9cf2-5129c0dd60a0 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:29.789719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6efcab05-0f1c-49e9-9cf2-5129c0dd60a0 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:30.977103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6efcab05-0f1c-49e9-9cf2-5129c0dd60a0 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:31.001627 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6efcab05-0f1c-49e9-9cf2-5129c0dd60a0 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1355 microversion: 2.1 time: 1.307322 Jul 25 12:51:31.022502 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1457/2814] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:29 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1355 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:31.044306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-72bad07c-ae30-43c2-bb2a-27bf37277581 req-422b6e4c-85bf-4b55-bc99-86c72f45add6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd68f842-1690-4f88-8dc3-f0e72bae78a3", "name": "network-vif-plugged", "status": "completed", "tag": "9d510304-8914-4721-bcd3-3a751a8ee457"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:31.092843 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-72bad07c-ae30-43c2-bb2a-27bf37277581 req-422b6e4c-85bf-4b55-bc99-86c72f45add6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:31.099890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-72bad07c-ae30-43c2-bb2a-27bf37277581 req-422b6e4c-85bf-4b55-bc99-86c72f45add6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:31.127681 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-72bad07c-ae30-43c2-bb2a-27bf37277581 req-422b6e4c-85bf-4b55-bc99-86c72f45add6 service nova] Creating event network-vif-plugged:9d510304-8914-4721-bcd3-3a751a8ee457 for instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 on n-h1-848886-15 Jul 25 12:51:31.150673 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-72bad07c-ae30-43c2-bb2a-27bf37277581 req-422b6e4c-85bf-4b55-bc99-86c72f45add6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125916 Jul 25 12:51:31.151699 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1458/2815] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:51:31.165665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ac965793-bbab-41d9-a1a9-dd75671504c3 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8fd4ca0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:31.292980 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ac965793-bbab-41d9-a1a9-dd75671504c3 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.139392 Jul 25 12:51:31.297911 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1459/2816] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:31 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:31.647779 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b5dd5371-7daf-4abf-aefb-30bdf1c73c42 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:31.664735 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b5dd5371-7daf-4abf-aefb-30bdf1c73c42 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2" status: 200 len: 1315 microversion: 2.1 time: 2.319928 Jul 25 12:51:31.669587 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1358/2817] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:29 2022] GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2 => generated 1315 bytes in 2326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:32.040471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8d9af5df-ab66-45d5-8790-6633a4c5330d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:32.044092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8d9af5df-ab66-45d5-8790-6633a4c5330d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:32.062227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d9af5df-ab66-45d5-8790-6633a4c5330d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:32.063119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d9af5df-ab66-45d5-8790-6633a4c5330d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:32.064264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d9af5df-ab66-45d5-8790-6633a4c5330d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:32.064892 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d9af5df-ab66-45d5-8790-6633a4c5330d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:32.322184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-78101b7a-aa40-42e8-b852-9a28c701fd1a tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8cdc430>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:32.440245 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-78101b7a-aa40-42e8-b852-9a28c701fd1a tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.124834 Jul 25 12:51:32.441602 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1359/2818] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:32 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:32.695950 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5a95fbd9-1fed-4456-b983-d14b45d5e380 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:32.698276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5a95fbd9-1fed-4456-b983-d14b45d5e380 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 7bbd0058-28f5-4b75-832b-f4828cc292c2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:32.723466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a95fbd9-1fed-4456-b983-d14b45d5e380 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:32.724702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a95fbd9-1fed-4456-b983-d14b45d5e380 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:32.728565 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a95fbd9-1fed-4456-b983-d14b45d5e380 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:32.742749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a95fbd9-1fed-4456-b983-d14b45d5e380 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:33.516195 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8d9af5df-ab66-45d5-8790-6633a4c5330d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:33.530560 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8d9af5df-ab66-45d5-8790-6633a4c5330d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1355 microversion: 2.1 time: 1.495242 Jul 25 12:51:33.531493 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1460/2819] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:32 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1355 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:33.536330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-91fba22f-6b4c-4736-8bc4-bf167f97c600 req-f9180110-7864-4c17-a013-d76d234542ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bbd0058-28f5-4b75-832b-f4828cc292c2", "tag": "8b2eddc3-774b-42fe-a843-0085cba47ff0"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:33.569124 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-91fba22f-6b4c-4736-8bc4-bf167f97c600 req-f9180110-7864-4c17-a013-d76d234542ef service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:33.569569 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-91fba22f-6b4c-4736-8bc4-bf167f97c600 req-f9180110-7864-4c17-a013-d76d234542ef service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:33.595396 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-91fba22f-6b4c-4736-8bc4-bf167f97c600 req-f9180110-7864-4c17-a013-d76d234542ef service nova] Creating event network-changed:8b2eddc3-774b-42fe-a843-0085cba47ff0 for instance 7bbd0058-28f5-4b75-832b-f4828cc292c2 on n-h2-848886-15 Jul 25 12:51:33.603750 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-91fba22f-6b4c-4736-8bc4-bf167f97c600 req-f9180110-7864-4c17-a013-d76d234542ef service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070960 Jul 25 12:51:33.614226 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1461/2820] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:51:33.783363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5a95fbd9-1fed-4456-b983-d14b45d5e380 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:33.791678 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5a95fbd9-1fed-4456-b983-d14b45d5e380 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2" status: 200 len: 1315 microversion: 2.1 time: 1.101085 Jul 25 12:51:33.792299 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1360/2821] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:32 2022] GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2 => generated 1315 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:33.817589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-214e4187-5848-4d4d-b896-938c4f05702f tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8d5a0d0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:33.940742 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-214e4187-5848-4d4d-b896-938c4f05702f tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.147249 Jul 25 12:51:33.949679 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1361/2822] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:33 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:33.955470 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-b0eaf094-2b22-48fe-910c-2d8c9336be00 req-bdd68deb-7805-4067-a1cc-b2de41737f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd68f842-1690-4f88-8dc3-f0e72bae78a3", "name": "network-vif-plugged", "status": "completed", "tag": "0d74ea81-13e8-4d64-a0aa-58cfd4296d1f"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:33.969067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b0eaf094-2b22-48fe-910c-2d8c9336be00 req-bdd68deb-7805-4067-a1cc-b2de41737f84 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:33.970053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b0eaf094-2b22-48fe-910c-2d8c9336be00 req-bdd68deb-7805-4067-a1cc-b2de41737f84 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:33.983207 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-b0eaf094-2b22-48fe-910c-2d8c9336be00 req-bdd68deb-7805-4067-a1cc-b2de41737f84 service nova] Creating event network-vif-plugged:0d74ea81-13e8-4d64-a0aa-58cfd4296d1f for instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 on n-h1-848886-15 Jul 25 12:51:33.991759 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-b0eaf094-2b22-48fe-910c-2d8c9336be00 req-bdd68deb-7805-4067-a1cc-b2de41737f84 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039958 Jul 25 12:51:34.006310 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1362/2823] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:51:34.143080 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-df0ae672-f447-4c85-8b81-5777075bed3f tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-910974508", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "5e91ca3d-c09c-43f5-be99-7153af13fccb"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:34.338592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-df0ae672-f447-4c85-8b81-5777075bed3f tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] validate_networks() for [('5e91ca3d-c09c-43f5-be99-7153af13fccb', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:51:34.566867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5873e2e5-c2a5-496b-9cba-6a893783d382 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:34.567866 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5873e2e5-c2a5-496b-9cba-6a893783d382 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:34.582207 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5873e2e5-c2a5-496b-9cba-6a893783d382 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:34.589137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5873e2e5-c2a5-496b-9cba-6a893783d382 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:34.591477 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5873e2e5-c2a5-496b-9cba-6a893783d382 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:34.594463 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5873e2e5-c2a5-496b-9cba-6a893783d382 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:35.015096 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:36.161571 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=8 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:37.437567 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5873e2e5-c2a5-496b-9cba-6a893783d382 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:37.477572 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5873e2e5-c2a5-496b-9cba-6a893783d382 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1355 microversion: 2.1 time: 2.914112 Jul 25 12:51:37.482001 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1363/2824] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:34 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1355 bytes in 2920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:37.505791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ffe04b09-11d4-44e4-ad78-bdbcfe329e23 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:37.507523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ffe04b09-11d4-44e4-ad78-bdbcfe329e23 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 7bbd0058-28f5-4b75-832b-f4828cc292c2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:37.527855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ffe04b09-11d4-44e4-ad78-bdbcfe329e23 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:37.532373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ffe04b09-11d4-44e4-ad78-bdbcfe329e23 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:37.536610 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ffe04b09-11d4-44e4-ad78-bdbcfe329e23 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:37.539048 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ffe04b09-11d4-44e4-ad78-bdbcfe329e23 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:38.985081 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-df0ae672-f447-4c85-8b81-5777075bed3f tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:51:38.985811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-df0ae672-f447-4c85-8b81-5777075bed3f tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:51:38.986269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-df0ae672-f447-4c85-8b81-5777075bed3f tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:51:38.986854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-df0ae672-f447-4c85-8b81-5777075bed3f tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:51:38.987458 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-df0ae672-f447-4c85-8b81-5777075bed3f tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:51:39.013351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-df0ae672-f447-4c85-8b81-5777075bed3f tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:39.018745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-df0ae672-f447-4c85-8b81-5777075bed3f tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:39.022319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-df0ae672-f447-4c85-8b81-5777075bed3f tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:39.026323 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-df0ae672-f447-4c85-8b81-5777075bed3f tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:39.099614 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-df0ae672-f447-4c85-8b81-5777075bed3f tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Getting quotas for project 136ce2bd463341d1b3e61041ee323c86. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:51:39.135361 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-df0ae672-f447-4c85-8b81-5777075bed3f tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Getting quotas for user 41b5083b87804399a8bf17a6644710b0 and project 136ce2bd463341d1b3e61041ee323c86. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:51:39.209620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-df0ae672-f447-4c85-8b81-5777075bed3f tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:51:39.218167 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ffe04b09-11d4-44e4-ad78-bdbcfe329e23 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:39.226226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-df0ae672-f447-4c85-8b81-5777075bed3f tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] [instance: 243f03fb-acc7-4897-8c84-3bfc55b7d4d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:51:39.239151 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ffe04b09-11d4-44e4-ad78-bdbcfe329e23 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2" status: 200 len: 1315 microversion: 2.1 time: 1.753101 Jul 25 12:51:39.241116 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1364/2825] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:37 2022] GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2 => generated 1315 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:39.270307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-521f88b9-6a13-436d-92a0-c20d44cffc2a tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8cbe670>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:39.425470 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-521f88b9-6a13-436d-92a0-c20d44cffc2a tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.181561 Jul 25 12:51:39.428969 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1365/2826] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:39 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:39.430138 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-df0ae672-f447-4c85-8b81-5777075bed3f tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.813016 Jul 25 12:51:39.447624 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1462/2827] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:51:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 5832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:51:39.453478 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-450a2468-0af5-444c-9c40-80e9b8ddd1a7 req-aa9d4caa-3c96-4517-9bc3-afa31aeaae72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd68f842-1690-4f88-8dc3-f0e72bae78a3", "name": "network-vif-plugged", "status": "completed", "tag": "db7fc6b2-e698-4a2f-9230-3a4a5d9678fc"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:39.473649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8e624f6b-c470-4146-8699-d48996a4ab03 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:39.475943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8e624f6b-c470-4146-8699-d48996a4ab03 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:39.519325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e624f6b-c470-4146-8699-d48996a4ab03 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:39.520224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e624f6b-c470-4146-8699-d48996a4ab03 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:39.524207 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-450a2468-0af5-444c-9c40-80e9b8ddd1a7 req-aa9d4caa-3c96-4517-9bc3-afa31aeaae72 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:39.525024 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-450a2468-0af5-444c-9c40-80e9b8ddd1a7 req-aa9d4caa-3c96-4517-9bc3-afa31aeaae72 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:39.525743 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e624f6b-c470-4146-8699-d48996a4ab03 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:39.531913 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e624f6b-c470-4146-8699-d48996a4ab03 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:39.584695 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-450a2468-0af5-444c-9c40-80e9b8ddd1a7 req-aa9d4caa-3c96-4517-9bc3-afa31aeaae72 service nova] Creating event network-vif-plugged:db7fc6b2-e698-4a2f-9230-3a4a5d9678fc for instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 on n-h1-848886-15 Jul 25 12:51:39.630226 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-450a2468-0af5-444c-9c40-80e9b8ddd1a7 req-aa9d4caa-3c96-4517-9bc3-afa31aeaae72 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196821 Jul 25 12:51:39.651195 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1366/2828] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:51:39.668472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5ce31350-e46f-4086-b3aa-26c8bfa38142 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:39.675962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5ce31350-e46f-4086-b3aa-26c8bfa38142 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] [instance: 243f03fb-acc7-4897-8c84-3bfc55b7d4d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:40.367770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5ce31350-e46f-4086-b3aa-26c8bfa38142 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5083b87804399a8bf17a6644710b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ce2bd463341d1b3e61041ee323c86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:40.378275 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5ce31350-e46f-4086-b3aa-26c8bfa38142 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] 10.222.0.49 "GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5" status: 200 len: 1227 microversion: 2.1 time: 0.723228 Jul 25 12:51:40.383984 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1367/2829] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:39 2022] GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5 => generated 1227 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:40.398087 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c100c119-0045-4cdf-9761-6744a67c892d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:40.399071 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c100c119-0045-4cdf-9761-6744a67c892d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 7bbd0058-28f5-4b75-832b-f4828cc292c2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:40.417033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c100c119-0045-4cdf-9761-6744a67c892d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:40.420427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c100c119-0045-4cdf-9761-6744a67c892d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:40.422069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c100c119-0045-4cdf-9761-6744a67c892d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:40.422742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c100c119-0045-4cdf-9761-6744a67c892d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:41.211137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8e624f6b-c470-4146-8699-d48996a4ab03 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:41.273268 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8e624f6b-c470-4146-8699-d48996a4ab03 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1355 microversion: 2.1 time: 1.823239 Jul 25 12:51:41.275394 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1463/2830] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:39 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1355 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:41.304031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f5fbc29f-28ad-4a6b-968d-0d632c1d7225 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8fe2ca0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:41.423657 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c100c119-0045-4cdf-9761-6744a67c892d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:41.430684 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f5fbc29f-28ad-4a6b-968d-0d632c1d7225 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.149710 Jul 25 12:51:41.435092 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1464/2831] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:41 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:41.445944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-83b23d52-f45c-4a6c-9e10-cd249b2c7a18 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:41.447658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-83b23d52-f45c-4a6c-9e10-cd249b2c7a18 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] [instance: 243f03fb-acc7-4897-8c84-3bfc55b7d4d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:41.464933 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-83b23d52-f45c-4a6c-9e10-cd249b2c7a18 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:41.467083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-83b23d52-f45c-4a6c-9e10-cd249b2c7a18 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:41.471505 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-83b23d52-f45c-4a6c-9e10-cd249b2c7a18 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:41.472634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-83b23d52-f45c-4a6c-9e10-cd249b2c7a18 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:41.472986 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c100c119-0045-4cdf-9761-6744a67c892d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2" status: 200 len: 1315 microversion: 2.1 time: 1.087122 Jul 25 12:51:41.474071 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1368/2832] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:40 2022] GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2 => generated 1315 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:41.732744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-83b23d52-f45c-4a6c-9e10-cd249b2c7a18 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5083b87804399a8bf17a6644710b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ce2bd463341d1b3e61041ee323c86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:41.753482 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-83b23d52-f45c-4a6c-9e10-cd249b2c7a18 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] 10.222.0.49 "GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5" status: 200 len: 1223 microversion: 2.1 time: 0.315987 Jul 25 12:51:41.754907 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1465/2833] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:41 2022] GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5 => generated 1223 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:42.297726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2fdc0e2f-5a7b-4210-bc72-d5824a845b8b tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:42.298694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2fdc0e2f-5a7b-4210-bc72-d5824a845b8b tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:42.328030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fdc0e2f-5a7b-4210-bc72-d5824a845b8b tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:42.328619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fdc0e2f-5a7b-4210-bc72-d5824a845b8b tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:42.333480 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fdc0e2f-5a7b-4210-bc72-d5824a845b8b tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:42.340581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fdc0e2f-5a7b-4210-bc72-d5824a845b8b tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:42.455320 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-816c196c-305a-4f97-9a0d-2d782f913ff7 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf902e430>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:42.642680 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-816c196c-305a-4f97-9a0d-2d782f913ff7 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.193763 Jul 25 12:51:42.643865 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1466/2834] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:42 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:51:42.664210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-700f5c8b-8a69-4203-bf9e-b4e9f45bfb2b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:42.668365 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-700f5c8b-8a69-4203-bf9e-b4e9f45bfb2b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 7bbd0058-28f5-4b75-832b-f4828cc292c2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:42.698503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-700f5c8b-8a69-4203-bf9e-b4e9f45bfb2b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:42.701050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-700f5c8b-8a69-4203-bf9e-b4e9f45bfb2b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:42.703608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-700f5c8b-8a69-4203-bf9e-b4e9f45bfb2b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:42.710754 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-700f5c8b-8a69-4203-bf9e-b4e9f45bfb2b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:43.854365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2fdc0e2f-5a7b-4210-bc72-d5824a845b8b tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:43.876402 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2fdc0e2f-5a7b-4210-bc72-d5824a845b8b tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1355 microversion: 2.1 time: 1.583106 Jul 25 12:51:43.877482 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1369/2835] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:42 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1355 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:51:43.918552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-31b5b1d4-4485-4d07-9ce4-b2151ad1ca66 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:43.922878 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-31b5b1d4-4485-4d07-9ce4-b2151ad1ca66 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] [instance: 243f03fb-acc7-4897-8c84-3bfc55b7d4d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:43.937643 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31b5b1d4-4485-4d07-9ce4-b2151ad1ca66 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:43.938429 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-700f5c8b-8a69-4203-bf9e-b4e9f45bfb2b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:43.938917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31b5b1d4-4485-4d07-9ce4-b2151ad1ca66 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:43.940668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31b5b1d4-4485-4d07-9ce4-b2151ad1ca66 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:43.941469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31b5b1d4-4485-4d07-9ce4-b2151ad1ca66 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:43.959650 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-700f5c8b-8a69-4203-bf9e-b4e9f45bfb2b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2" status: 200 len: 1315 microversion: 2.1 time: 1.313067 Jul 25 12:51:43.960623 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1467/2836] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:42 2022] GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2 => generated 1315 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:44.001780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-172cedcb-8baf-4df3-a831-b18f5934e760 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8f91700>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:44.159938 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-172cedcb-8baf-4df3-a831-b18f5934e760 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.197306 Jul 25 12:51:44.164554 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1468/2837] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:43 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:44.403727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-31b5b1d4-4485-4d07-9ce4-b2151ad1ca66 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5083b87804399a8bf17a6644710b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ce2bd463341d1b3e61041ee323c86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:44.418384 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-31b5b1d4-4485-4d07-9ce4-b2151ad1ca66 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] 10.222.0.49 "GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5" status: 200 len: 1285 microversion: 2.1 time: 0.533941 Jul 25 12:51:44.434457 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1370/2838] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:43 2022] GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5 => generated 1285 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:44.725214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-f1a244f9-b579-4cc4-ad9a-8377e1f99a6c req-484c8b1e-88d0-4706-89e2-d70f95146c07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bbd0058-28f5-4b75-832b-f4828cc292c2", "name": "network-vif-plugged", "status": "completed", "tag": "8b2eddc3-774b-42fe-a843-0085cba47ff0"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:44.801211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f1a244f9-b579-4cc4-ad9a-8377e1f99a6c req-484c8b1e-88d0-4706-89e2-d70f95146c07 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:44.802157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f1a244f9-b579-4cc4-ad9a-8377e1f99a6c req-484c8b1e-88d0-4706-89e2-d70f95146c07 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:44.845442 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-f1a244f9-b579-4cc4-ad9a-8377e1f99a6c req-484c8b1e-88d0-4706-89e2-d70f95146c07 service nova] Creating event network-vif-plugged:8b2eddc3-774b-42fe-a843-0085cba47ff0 for instance 7bbd0058-28f5-4b75-832b-f4828cc292c2 on n-h2-848886-15 Jul 25 12:51:44.868893 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-f1a244f9-b579-4cc4-ad9a-8377e1f99a6c req-484c8b1e-88d0-4706-89e2-d70f95146c07 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150492 Jul 25 12:51:44.870828 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1469/2839] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:51:44.920834 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-eee461d4-6b64-4424-b096-3a00c9508446 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:44.922973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-eee461d4-6b64-4424-b096-3a00c9508446 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:44.954402 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eee461d4-6b64-4424-b096-3a00c9508446 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:44.956303 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eee461d4-6b64-4424-b096-3a00c9508446 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:44.957357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eee461d4-6b64-4424-b096-3a00c9508446 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:44.958893 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eee461d4-6b64-4424-b096-3a00c9508446 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:44.997317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-905bd56b-fe45-4c02-aee5-83fb9d803c10 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:45.006920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-905bd56b-fe45-4c02-aee5-83fb9d803c10 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 7bbd0058-28f5-4b75-832b-f4828cc292c2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:45.036201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-905bd56b-fe45-4c02-aee5-83fb9d803c10 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:45.037559 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-905bd56b-fe45-4c02-aee5-83fb9d803c10 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:45.041365 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-905bd56b-fe45-4c02-aee5-83fb9d803c10 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:45.047097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-905bd56b-fe45-4c02-aee5-83fb9d803c10 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:46.269340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-eee461d4-6b64-4424-b096-3a00c9508446 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:46.292744 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-eee461d4-6b64-4424-b096-3a00c9508446 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1805 microversion: 2.1 time: 1.371741 Jul 25 12:51:46.299665 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1371/2840] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:44 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1805 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:46.326466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-420b554f-a675-431f-afb1-23bdbbdcd7bf tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf991e160>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:46.495907 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-420b554f-a675-431f-afb1-23bdbbdcd7bf tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.194973 Jul 25 12:51:46.499663 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1372/2841] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:46 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:46.519294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aecd9cf2-e38c-4ae9-b14b-67db4304dfb4 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:46.520851 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-aecd9cf2-e38c-4ae9-b14b-67db4304dfb4 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] [instance: 243f03fb-acc7-4897-8c84-3bfc55b7d4d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:46.551563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aecd9cf2-e38c-4ae9-b14b-67db4304dfb4 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:46.552669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aecd9cf2-e38c-4ae9-b14b-67db4304dfb4 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:46.553796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aecd9cf2-e38c-4ae9-b14b-67db4304dfb4 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:46.554794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aecd9cf2-e38c-4ae9-b14b-67db4304dfb4 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:46.593709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-905bd56b-fe45-4c02-aee5-83fb9d803c10 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:46.629745 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-905bd56b-fe45-4c02-aee5-83fb9d803c10 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2" status: 200 len: 1315 microversion: 2.1 time: 1.641037 Jul 25 12:51:46.646537 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1470/2842] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:44 2022] GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2 => generated 1315 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:46.663954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-26a79a9c-df07-473f-86e3-d3dd06869683 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:46.684553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-26a79a9c-df07-473f-86e3-d3dd06869683 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:46.717223 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-26a79a9c-df07-473f-86e3-d3dd06869683 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:46.740038 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-26a79a9c-df07-473f-86e3-d3dd06869683 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:46.741451 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-26a79a9c-df07-473f-86e3-d3dd06869683 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:46.747639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-26a79a9c-df07-473f-86e3-d3dd06869683 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:47.722344 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-26a79a9c-df07-473f-86e3-d3dd06869683 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3/ips" status: 200 len: 218 microversion: 2.1 time: 1.056974 Jul 25 12:51:47.728199 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1471/2843] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Jul 25 12:51:46 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3/ips => generated 218 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:51:47.731711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aa66f4d9-d1b2-4570-91fe-5aadb919e46f tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8f95ee0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:47.812635 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-aa66f4d9-d1b2-4570-91fe-5aadb919e46f tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.087750 Jul 25 12:51:47.813891 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1472/2844] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:47 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:47.819706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f4aae6f4-11e1-486b-96b8-70f04b6518e1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:47.820661 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f4aae6f4-11e1-486b-96b8-70f04b6518e1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 7bbd0058-28f5-4b75-832b-f4828cc292c2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:47.832603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4aae6f4-11e1-486b-96b8-70f04b6518e1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:47.833067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4aae6f4-11e1-486b-96b8-70f04b6518e1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:47.833933 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4aae6f4-11e1-486b-96b8-70f04b6518e1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:47.834406 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4aae6f4-11e1-486b-96b8-70f04b6518e1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:48.873765 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-aecd9cf2-e38c-4ae9-b14b-67db4304dfb4 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5083b87804399a8bf17a6644710b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ce2bd463341d1b3e61041ee323c86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:48.908675 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aecd9cf2-e38c-4ae9-b14b-67db4304dfb4 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] 10.222.0.49 "GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5" status: 200 len: 1327 microversion: 2.1 time: 2.405914 Jul 25 12:51:48.913645 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1373/2845] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:46 2022] GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5 => generated 1327 bytes in 2411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:48.930845 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1b3553d9-ce06-4456-b86b-193e8fd2278f tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:48.933132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1b3553d9-ce06-4456-b86b-193e8fd2278f tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:48.952898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b3553d9-ce06-4456-b86b-193e8fd2278f tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:48.953886 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b3553d9-ce06-4456-b86b-193e8fd2278f tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:48.954962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b3553d9-ce06-4456-b86b-193e8fd2278f tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:48.958137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b3553d9-ce06-4456-b86b-193e8fd2278f tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:49.015799 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1b3553d9-ce06-4456-b86b-193e8fd2278f tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:51:49.053116 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:49.184283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:49.312704 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1b3553d9-ce06-4456-b86b-193e8fd2278f tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 204 len: 0 microversion: 2.1 time: 0.395139 Jul 25 12:51:49.315449 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1374/2846] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:51:48 2022] DELETE /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:51:49.329576 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-28039529-dd92-4bed-b8b5-c54580ee19b4 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8dccb80>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:49.480216 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-28039529-dd92-4bed-b8b5-c54580ee19b4 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1429 microversion: 2.1 time: 0.159415 Jul 25 12:51:49.482180 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1375/2847] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:49 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1429 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:49.503809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f9146dda-412f-4426-9778-01366941a765 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:49.505742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f9146dda-412f-4426-9778-01366941a765 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:49.524354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9146dda-412f-4426-9778-01366941a765 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:49.527619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9146dda-412f-4426-9778-01366941a765 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:49.531865 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9146dda-412f-4426-9778-01366941a765 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:49.532684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9146dda-412f-4426-9778-01366941a765 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:50.378500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:50.420781 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f4aae6f4-11e1-486b-96b8-70f04b6518e1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:50.439197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f9146dda-412f-4426-9778-01366941a765 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:50.442461 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f4aae6f4-11e1-486b-96b8-70f04b6518e1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2" status: 200 len: 1502 microversion: 2.1 time: 2.627209 Jul 25 12:51:50.443071 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1473/2848] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:47 2022] GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2 => generated 1502 bytes in 2628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:50.485039 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f9146dda-412f-4426-9778-01366941a765 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1811 microversion: 2.1 time: 0.997001 Jul 25 12:51:50.492923 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1376/2849] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:49 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1811 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:50.514117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7b028ee0-ad22-46be-8073-a26a5a5a485a tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:50.515118 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7b028ee0-ad22-46be-8073-a26a5a5a485a tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] [instance: 243f03fb-acc7-4897-8c84-3bfc55b7d4d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:50.535512 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7b028ee0-ad22-46be-8073-a26a5a5a485a tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:50.537449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-4d9e48be-4450-4bdd-ba48-37c6e3456627 req-c2da3c79-c298-4bba-9534-ea7a399c3eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "243f03fb-acc7-4897-8c84-3bfc55b7d4d5", "tag": "e591ad0b-41d3-4e5e-b17c-97acbe4598c3"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:50.538542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7b028ee0-ad22-46be-8073-a26a5a5a485a tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:50.545555 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7b028ee0-ad22-46be-8073-a26a5a5a485a tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:50.546320 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7b028ee0-ad22-46be-8073-a26a5a5a485a tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:50.619232 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4d9e48be-4450-4bdd-ba48-37c6e3456627 req-c2da3c79-c298-4bba-9534-ea7a399c3eb1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:50.620436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4d9e48be-4450-4bdd-ba48-37c6e3456627 req-c2da3c79-c298-4bba-9534-ea7a399c3eb1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:50.700182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:50.706746 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-4d9e48be-4450-4bdd-ba48-37c6e3456627 req-c2da3c79-c298-4bba-9534-ea7a399c3eb1 service nova] Creating event network-changed:e591ad0b-41d3-4e5e-b17c-97acbe4598c3 for instance 243f03fb-acc7-4897-8c84-3bfc55b7d4d5 on n-h1-848886-15 Jul 25 12:51:50.729940 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-4d9e48be-4450-4bdd-ba48-37c6e3456627 req-c2da3c79-c298-4bba-9534-ea7a399c3eb1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226936 Jul 25 12:51:50.732916 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1377/2850] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:51:50.750713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cd45e64d-2c8d-475e-b1f7-9678510ca9a2 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:50.758299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cd45e64d-2c8d-475e-b1f7-9678510ca9a2 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 7bbd0058-28f5-4b75-832b-f4828cc292c2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:50.784325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd45e64d-2c8d-475e-b1f7-9678510ca9a2 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:50.787398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd45e64d-2c8d-475e-b1f7-9678510ca9a2 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:50.788966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd45e64d-2c8d-475e-b1f7-9678510ca9a2 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:50.789748 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd45e64d-2c8d-475e-b1f7-9678510ca9a2 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:50.867100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cd45e64d-2c8d-475e-b1f7-9678510ca9a2 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 7bbd0058-28f5-4b75-832b-f4828cc292c2] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:51:51.113993 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cd45e64d-2c8d-475e-b1f7-9678510ca9a2 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2" status: 204 len: 0 microversion: 2.1 time: 0.370049 Jul 25 12:51:51.115743 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1378/2851] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:51:50 2022] DELETE /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:51:51.156906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-23fc3fd4-e76f-4f42-af72-d5919335177f tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8dcc820>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:51.313902 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-23fc3fd4-e76f-4f42-af72-d5919335177f tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1438 microversion: 2.1 time: 0.170217 Jul 25 12:51:51.318410 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1379/2852] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:51 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1438 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:51.343193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9161a679-7751-403c-91d3-c0a7654efd3c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:51.345176 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9161a679-7751-403c-91d3-c0a7654efd3c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 7bbd0058-28f5-4b75-832b-f4828cc292c2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:51.417132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9161a679-7751-403c-91d3-c0a7654efd3c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:51.418038 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9161a679-7751-403c-91d3-c0a7654efd3c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:51.428291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9161a679-7751-403c-91d3-c0a7654efd3c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:51.428845 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9161a679-7751-403c-91d3-c0a7654efd3c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:51.508464 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7b028ee0-ad22-46be-8073-a26a5a5a485a tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5083b87804399a8bf17a6644710b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ce2bd463341d1b3e61041ee323c86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:51.522639 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7b028ee0-ad22-46be-8073-a26a5a5a485a tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] 10.222.0.49 "GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5" status: 200 len: 1327 microversion: 2.1 time: 1.068550 Jul 25 12:51:51.541729 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1474/2853] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:50 2022] GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5 => generated 1327 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:51.547382 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0cfccff8-e4c0-4c59-afe4-495ec8f40c78 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf908ee50>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:51.683054 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0cfccff8-e4c0-4c59-afe4-495ec8f40c78 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 200 len: 1438 microversion: 2.1 time: 0.139409 Jul 25 12:51:51.686363 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1475/2854] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:51 2022] GET /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 1438 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:51.695736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5fb318fe-b9af-4a6f-a495-0af06130546d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:51.698022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5fb318fe-b9af-4a6f-a495-0af06130546d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:51.761399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5fb318fe-b9af-4a6f-a495-0af06130546d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:51.762941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5fb318fe-b9af-4a6f-a495-0af06130546d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:51.764556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5fb318fe-b9af-4a6f-a495-0af06130546d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:51.767681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5fb318fe-b9af-4a6f-a495-0af06130546d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:53.594748 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9161a679-7751-403c-91d3-c0a7654efd3c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:53.608334 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9161a679-7751-403c-91d3-c0a7654efd3c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2" status: 200 len: 1508 microversion: 2.1 time: 2.286868 Jul 25 12:51:53.610961 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1380/2855] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:51 2022] GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2 => generated 1508 bytes in 2290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:53.618579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-26a68bad-02a2-4f6b-8832-bfe795f4f436 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:53.624986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-26a68bad-02a2-4f6b-8832-bfe795f4f436 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:53.643415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26a68bad-02a2-4f6b-8832-bfe795f4f436 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:53.662030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26a68bad-02a2-4f6b-8832-bfe795f4f436 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:53.663748 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26a68bad-02a2-4f6b-8832-bfe795f4f436 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:53.665104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26a68bad-02a2-4f6b-8832-bfe795f4f436 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:54.210883 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5fb318fe-b9af-4a6f-a495-0af06130546d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:54.238959 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5fb318fe-b9af-4a6f-a495-0af06130546d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1811 microversion: 2.1 time: 2.550886 Jul 25 12:51:54.247424 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1476/2856] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:51 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1811 bytes in 2560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:54.266556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-576cef36-323e-424a-9902-bffb34178cb3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Action: 'create', calling method: .version_select at 0x7efcf91415e0>, body: {"keypair": {"name": "tempest-keypair-1199865113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1NpG/oeQffi0lNh3b4CsIZV47CrdFVf733MF83pF0ef+BCYMNblpJco3y/8B28fya+VUvZRepfqto1WQbvA6pS9FTANAxQWYSXcNC18eGAWs3S7JhJcD5NoO8ns8G3Sw=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:54.308721 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-576cef36-323e-424a-9902-bffb34178cb3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Getting quotas for project f951d0b219924bb1aa408d3e22bcafc3. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:51:54.325504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-576cef36-323e-424a-9902-bffb34178cb3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Getting quotas for user 2f958f28464144e89e63b7e7dbcfb0b5 and project f951d0b219924bb1aa408d3e22bcafc3. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:51:54.392094 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-576cef36-323e-424a-9902-bffb34178cb3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.136291 Jul 25 12:51:54.399829 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1477/2857] 10.222.0.49 () {62 vars in 1200 bytes} [Mon Jul 25 12:51:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 144 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 12:51:54.411089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9fd5513f-f0ea-498d-aa3f-99d91283e3e2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:54.414354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9fd5513f-f0ea-498d-aa3f-99d91283e3e2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] [instance: 243f03fb-acc7-4897-8c84-3bfc55b7d4d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:54.432929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9fd5513f-f0ea-498d-aa3f-99d91283e3e2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:54.435857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9fd5513f-f0ea-498d-aa3f-99d91283e3e2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:54.437106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9fd5513f-f0ea-498d-aa3f-99d91283e3e2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:54.437775 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9fd5513f-f0ea-498d-aa3f-99d91283e3e2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:54.824598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-26a68bad-02a2-4f6b-8832-bfe795f4f436 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17c9f43612c483ba96eb09787b4dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cbbf76c3f4848b4a558de341ec19d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:54.837188 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-26a68bad-02a2-4f6b-8832-bfe795f4f436 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715" status: 200 len: 1467 microversion: 2.1 time: 1.222669 Jul 25 12:51:54.842668 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1381/2858] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:53 2022] GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715 => generated 1467 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:54.863966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-4a1934f8-e8bc-4750-a386-584bf6b0d2a1 req-e09675fa-f63e-4363-8f5d-ddd823c7f9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bbd0058-28f5-4b75-832b-f4828cc292c2", "name": "network-vif-deleted", "tag": "8b2eddc3-774b-42fe-a843-0085cba47ff0"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:54.910407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4a1934f8-e8bc-4750-a386-584bf6b0d2a1 req-e09675fa-f63e-4363-8f5d-ddd823c7f9d0 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:54.911575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4a1934f8-e8bc-4750-a386-584bf6b0d2a1 req-e09675fa-f63e-4363-8f5d-ddd823c7f9d0 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:54.954331 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-4a1934f8-e8bc-4750-a386-584bf6b0d2a1 req-e09675fa-f63e-4363-8f5d-ddd823c7f9d0 service nova] Creating event network-vif-deleted:8b2eddc3-774b-42fe-a843-0085cba47ff0 for instance 7bbd0058-28f5-4b75-832b-f4828cc292c2 on n-h2-848886-15 Jul 25 12:51:54.968405 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-4a1934f8-e8bc-4750-a386-584bf6b0d2a1 req-e09675fa-f63e-4363-8f5d-ddd823c7f9d0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123966 Jul 25 12:51:54.969356 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1382/2859] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:51:54.975337 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f637c968-de1d-49ec-914c-e0461d1d2d39 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:54.976517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f637c968-de1d-49ec-914c-e0461d1d2d39 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 7bbd0058-28f5-4b75-832b-f4828cc292c2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:55.002819 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f637c968-de1d-49ec-914c-e0461d1d2d39 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:55.003901 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f637c968-de1d-49ec-914c-e0461d1d2d39 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:55.005321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f637c968-de1d-49ec-914c-e0461d1d2d39 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:55.008525 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f637c968-de1d-49ec-914c-e0461d1d2d39 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:55.108535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f637c968-de1d-49ec-914c-e0461d1d2d39 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:55.108535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f637c968-de1d-49ec-914c-e0461d1d2d39 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:55.109026 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-f637c968-de1d-49ec-914c-e0461d1d2d39 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lazy-loading 'fault' on Instance uuid 7bbd0058-28f5-4b75-832b-f4828cc292c2 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:51:55.280402 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f637c968-de1d-49ec-914c-e0461d1d2d39 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:55.302673 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f637c968-de1d-49ec-914c-e0461d1d2d39 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2" status: 200 len: 1305 microversion: 2.1 time: 0.331346 Jul 25 12:51:55.318921 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1383/2860] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:54 2022] GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2 => generated 1305 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:55.327325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dad32a65-1f78-4542-afc3-51a5a482ec30 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcf8cbe8b0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:55.888474 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9fd5513f-f0ea-498d-aa3f-99d91283e3e2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5083b87804399a8bf17a6644710b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ce2bd463341d1b3e61041ee323c86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:55.904951 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9fd5513f-f0ea-498d-aa3f-99d91283e3e2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] 10.222.0.49 "GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5" status: 200 len: 1327 microversion: 2.1 time: 1.502439 Jul 25 12:51:55.919683 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1478/2861] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:54 2022] GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5 => generated 1327 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:55.926847 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8f1ccc8e-4d9d-4af2-b8fe-1f5d41f3612c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:55.937238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8f1ccc8e-4d9d-4af2-b8fe-1f5d41f3612c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:55.959550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8f1ccc8e-4d9d-4af2-b8fe-1f5d41f3612c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:55.961739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8f1ccc8e-4d9d-4af2-b8fe-1f5d41f3612c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:55.963044 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8f1ccc8e-4d9d-4af2-b8fe-1f5d41f3612c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:55.963873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8f1ccc8e-4d9d-4af2-b8fe-1f5d41f3612c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:56.498920 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dad32a65-1f78-4542-afc3-51a5a482ec30 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "DELETE /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377" status: 204 len: 0 microversion: 2.1 time: 1.193232 Jul 25 12:51:56.503144 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1384/2862] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:55 2022] DELETE /compute/v2.1/images/5852d982-f433-4db8-9400-7906f0cfd377 => generated 0 bytes in 1195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:51:56.509902 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-f96a499b-cdd9-4a43-b92f-3e8a144a8c27 req-0db0cdee-9033-448f-838f-08f99dbe40d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd68f842-1690-4f88-8dc3-f0e72bae78a3", "name": "network-vif-unplugged", "status": "completed", "tag": "0d74ea81-13e8-4d64-a0aa-58cfd4296d1f"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:56.525992 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-f96a499b-cdd9-4a43-b92f-3e8a144a8c27 req-0db0cdee-9033-448f-838f-08f99dbe40d5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:56.526459 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-f96a499b-cdd9-4a43-b92f-3e8a144a8c27 req-0db0cdee-9033-448f-838f-08f99dbe40d5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:56.550965 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-f96a499b-cdd9-4a43-b92f-3e8a144a8c27 req-0db0cdee-9033-448f-838f-08f99dbe40d5 service nova] Creating event network-vif-unplugged:0d74ea81-13e8-4d64-a0aa-58cfd4296d1f for instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 on n-h1-848886-15 Jul 25 12:51:56.562534 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-f96a499b-cdd9-4a43-b92f-3e8a144a8c27 req-0db0cdee-9033-448f-838f-08f99dbe40d5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061180 Jul 25 12:51:56.563968 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1385/2863] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:51:56.572394 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-22bd172d-5f2a-4232-9dac-14422ab6ddb4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:56.573413 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-22bd172d-5f2a-4232-9dac-14422ab6ddb4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 7bbd0058-28f5-4b75-832b-f4828cc292c2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:56.582984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22bd172d-5f2a-4232-9dac-14422ab6ddb4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:56.586304 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22bd172d-5f2a-4232-9dac-14422ab6ddb4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:56.587073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22bd172d-5f2a-4232-9dac-14422ab6ddb4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:56.588059 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22bd172d-5f2a-4232-9dac-14422ab6ddb4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:56.616865 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-22bd172d-5f2a-4232-9dac-14422ab6ddb4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] HTTP exception thrown: Instance 7bbd0058-28f5-4b75-832b-f4828cc292c2 could not be found. Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-22bd172d-5f2a-4232-9dac-14422ab6ddb4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Request method failure captured: Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2 HTTP/1.1 Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pHF7UCaF8gOsr4izIJsQMgDEa0djLGcj88wHujy3LL3KrSKed1jp5p2g1uyl0B7FckQX0z38dpjtGtJDzQMYAlTS7LRfENWczpgFqPzdGM6KYoCp6qrqJdc7QEkc58SEBAWEj2A4h5-asWJS2CIcfkxwvHFTYem8sDn2kkqArMxtZA Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f07680a55b3f41408d3a284d1330503d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}] Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: d28f966411004a158377c689fd5b05eb Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 7bbd0058-28f5-4b75-832b-f4828cc292c2 could not be found. Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '7bbd0058-28f5-4b75-832b-f4828cc292c2'} Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bbd0058-28f5-4b75-832b-f4828cc292c2 could not be found. Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bbd0058-28f5-4b75-832b-f4828cc292c2 could not be found. Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:51:56.621129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:51:56.628875 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:51:56.628875 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:51:56.628875 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:51:56.628875 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:51:56.628875 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:51:56.628875 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bbd0058-28f5-4b75-832b-f4828cc292c2 could not be found. Jul 25 12:51:56.628875 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:51:56.628875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-22bd172d-5f2a-4232-9dac-14422ab6ddb4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Returning 404 to user: Instance 7bbd0058-28f5-4b75-832b-f4828cc292c2 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:51:56.628875 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-22bd172d-5f2a-4232-9dac-14422ab6ddb4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2" status: 404 len: 111 microversion: 2.1 time: 0.062609 Jul 25 12:51:56.628875 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1386/2864] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:56 2022] GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:51:56.641115 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-cc7e4c44-99d0-42c6-ad53-20667f647802 req-e1031f44-c17d-418e-8ad3-0e68f5d295fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd68f842-1690-4f88-8dc3-f0e72bae78a3", "name": "network-vif-deleted", "tag": "9d510304-8914-4721-bcd3-3a751a8ee457"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:56.685390 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-cc7e4c44-99d0-42c6-ad53-20667f647802 req-e1031f44-c17d-418e-8ad3-0e68f5d295fe service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:56.696069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-cc7e4c44-99d0-42c6-ad53-20667f647802 req-e1031f44-c17d-418e-8ad3-0e68f5d295fe service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:56.741558 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-cc7e4c44-99d0-42c6-ad53-20667f647802 req-e1031f44-c17d-418e-8ad3-0e68f5d295fe service nova] Creating event network-vif-deleted:9d510304-8914-4721-bcd3-3a751a8ee457 for instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 on n-h1-848886-15 Jul 25 12:51:56.756650 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-cc7e4c44-99d0-42c6-ad53-20667f647802 req-e1031f44-c17d-418e-8ad3-0e68f5d295fe service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126225 Jul 25 12:51:56.758136 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1387/2865] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:51:56.777051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dfc653a3-b193-44ff-9cf1-8ea7547c3abd tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '.version_select at 0x7efcfecb7700>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:56.906490 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-dfc653a3-b193-44ff-9cf1-8ea7547c3abd tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] HTTP exception thrown: Image not found. Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dfc653a3-b193-44ff-9cf1-8ea7547c3abd tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Request method failure captured: Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854 HTTP/1.1 Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pFoPbCXr3A75kkKcKJD1bwz5CTq4jH_RHLFXsEBbPn3NQghOoxdZQhZOyW4jDGfUSnDKELbd3tG88UR1f3VBuRU2wagLUQDACZjWqacdUUG8M5wlmdz09wo4ZszopOnIO9fm-cP1IGClLUhHyMxq3981XsJtmqjOTQxYMZcxlVPdfc Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 8a7cbbf76c3f4848b4a558de341ec19d Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ImagesOneServerTestJSON-1354646116 Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8a7cbbf76c3f4848b4a558de341ec19d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8a7cbbf76c3f4848b4a558de341ec19d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8a7cbbf76c3f4848b4a558de341ec19d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8a7cbbf76c3f4848b4a558de341ec19d"}]}] Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ImagesOneServerTestJSON-1354646116 Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 8a7cbbf76c3f4848b4a558de341ec19d Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1354646116 Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ImagesOneServerTestJSON-1354646116-project Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: a17c9f43612c483ba96eb09787b4dd47 Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ImagesOneServerTestJSON-1354646116-project Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: exception: Image not found. Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'a24134cd-3f6b-4a06-974c-8a01f8725854'} Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a24134cd-3f6b-4a06-974c-8a01f8725854 to delete Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a24134cd-3f6b-4a06-974c-8a01f8725854 could not be found. Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:51:56.908385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dfc653a3-b193-44ff-9cf1-8ea7547c3abd tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Returning 404 to user: Image not found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dfc653a3-b193-44ff-9cf1-8ea7547c3abd tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "DELETE /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854" status: 404 len: 62 microversion: 2.1 time: 0.139960 Jul 25 12:51:56.921958 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1388/2866] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:56 2022] DELETE /compute/v2.1/images/a24134cd-3f6b-4a06-974c-8a01f8725854 => generated 62 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:51:56.944827 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2e4d8886-bf6a-4b02-8cce-e614bd682b97 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-406251824", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "b6926756-00b4-4271-8538-f2e94168b61a"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:57.087747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-2e4d8886-bf6a-4b02-8cce-e614bd682b97 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] validate_networks() for [('b6926756-00b4-4271-8538-f2e94168b61a', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:51:58.495863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8f1ccc8e-4d9d-4af2-b8fe-1f5d41f3612c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:58.521887 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8f1ccc8e-4d9d-4af2-b8fe-1f5d41f3612c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1790 microversion: 2.1 time: 2.600423 Jul 25 12:51:58.522508 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1479/2867] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:55 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1790 bytes in 2602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:58.527934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3475478f-9c96-43d7-840d-ac27bbb8b649 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:58.534679 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3475478f-9c96-43d7-840d-ac27bbb8b649 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:58.543050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:58.556156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3475478f-9c96-43d7-840d-ac27bbb8b649 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:58.557553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3475478f-9c96-43d7-840d-ac27bbb8b649 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:58.558867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3475478f-9c96-43d7-840d-ac27bbb8b649 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:58.560039 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3475478f-9c96-43d7-840d-ac27bbb8b649 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:58.596268 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3475478f-9c96-43d7-840d-ac27bbb8b649 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:51:58.747570 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3475478f-9c96-43d7-840d-ac27bbb8b649 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715" status: 204 len: 0 microversion: 2.1 time: 0.220807 Jul 25 12:51:58.749078 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1480/2868] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:51:58 2022] DELETE /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:51:58.756656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9d8b32a0-d391-46f7-8610-7e6c9116d9b3 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:58.757716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9d8b32a0-d391-46f7-8610-7e6c9116d9b3 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] [instance: 243f03fb-acc7-4897-8c84-3bfc55b7d4d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:58.767249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d8b32a0-d391-46f7-8610-7e6c9116d9b3 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:58.768235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d8b32a0-d391-46f7-8610-7e6c9116d9b3 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:58.769401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d8b32a0-d391-46f7-8610-7e6c9116d9b3 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:58.770115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d8b32a0-d391-46f7-8610-7e6c9116d9b3 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:59.200251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9d8b32a0-d391-46f7-8610-7e6c9116d9b3 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5083b87804399a8bf17a6644710b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ce2bd463341d1b3e61041ee323c86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:59.204543 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:59.218144 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9d8b32a0-d391-46f7-8610-7e6c9116d9b3 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] 10.222.0.49 "GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5" status: 200 len: 1327 microversion: 2.1 time: 0.466733 Jul 25 12:51:59.233872 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1481/2869] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:58 2022] GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5 => generated 1327 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:59.344910 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-672ff135-7444-4094-9088-2ec4da9ad137 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'create', calling method: .version_select at 0x7efcf91ab790>, body: {"keypair": {"name": "tempest-keypair-1353753151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCC0xg4dmoKgM9UH9FOhWraW4c/qP6TxDg0f6JN3yZBfGwhUTdMofXR3ga6IsLbv4PALveP16IpokcEacuAP29jLP31Rtcf+ofWVc/+mgjs5sVjHYekKmOjbmtZtt3bxg=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:59.385709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-672ff135-7444-4094-9088-2ec4da9ad137 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Getting quotas for project b5abf45c9ba0419c8dec07847f3ff3c5. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:51:59.396686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-672ff135-7444-4094-9088-2ec4da9ad137 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Getting quotas for user 4d492d20a4864908a81902f86468d437 and project b5abf45c9ba0419c8dec07847f3ff3c5. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:51:59.437219 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-672ff135-7444-4094-9088-2ec4da9ad137 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.208229 Jul 25 12:51:59.439912 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1482/2870] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:51:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:51:59.477463 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-31f7f9d9-a951-49b4-8890-f7de4ddbdba4 req-b3859ee3-6b5f-415d-a759-f5ec33b7aeb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdebd9ec-1b71-49bd-8c36-5fcef5559715", "name": "network-vif-unplugged", "status": "completed", "tag": "52dec511-bbb4-43dc-98fe-0397c1c41e5d"}, {"server_uuid": "bd68f842-1690-4f88-8dc3-f0e72bae78a3", "name": "network-vif-unplugged", "status": "completed", "tag": "db7fc6b2-e698-4a2f-9230-3a4a5d9678fc"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:59.547459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-31f7f9d9-a951-49b4-8890-f7de4ddbdba4 req-b3859ee3-6b5f-415d-a759-f5ec33b7aeb4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:59.549357 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-31f7f9d9-a951-49b4-8890-f7de4ddbdba4 req-b3859ee3-6b5f-415d-a759-f5ec33b7aeb4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:59.592340 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-31f7f9d9-a951-49b4-8890-f7de4ddbdba4 req-b3859ee3-6b5f-415d-a759-f5ec33b7aeb4 service nova] Creating event network-vif-unplugged:52dec511-bbb4-43dc-98fe-0397c1c41e5d for instance fdebd9ec-1b71-49bd-8c36-5fcef5559715 on n-h2-848886-15 Jul 25 12:51:59.593684 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-31f7f9d9-a951-49b4-8890-f7de4ddbdba4 req-b3859ee3-6b5f-415d-a759-f5ec33b7aeb4 service nova] Creating event network-vif-unplugged:db7fc6b2-e698-4a2f-9230-3a4a5d9678fc for instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 on n-h1-848886-15 Jul 25 12:51:59.616786 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-31f7f9d9-a951-49b4-8890-f7de4ddbdba4 req-b3859ee3-6b5f-415d-a759-f5ec33b7aeb4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.174738 Jul 25 12:51:59.618704 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1483/2871] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:51:59.628767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-70af1b5b-50fd-43ef-89e9-1ca483a69920 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:59.630840 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-70af1b5b-50fd-43ef-89e9-1ca483a69920 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:59.643414 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70af1b5b-50fd-43ef-89e9-1ca483a69920 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:59.647655 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70af1b5b-50fd-43ef-89e9-1ca483a69920 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:59.650735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70af1b5b-50fd-43ef-89e9-1ca483a69920 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:59.651810 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70af1b5b-50fd-43ef-89e9-1ca483a69920 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:00.296665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2e4d8886-bf6a-4b02-8cce-e614bd682b97 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:52:00.298928 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2e4d8886-bf6a-4b02-8cce-e614bd682b97 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:52:00.300135 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2e4d8886-bf6a-4b02-8cce-e614bd682b97 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:52:00.304019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2e4d8886-bf6a-4b02-8cce-e614bd682b97 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:52:00.304740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2e4d8886-bf6a-4b02-8cce-e614bd682b97 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:52:00.315093 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:00.340804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e4d8886-bf6a-4b02-8cce-e614bd682b97 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:00.342876 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e4d8886-bf6a-4b02-8cce-e614bd682b97 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:00.344915 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e4d8886-bf6a-4b02-8cce-e614bd682b97 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:00.346520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e4d8886-bf6a-4b02-8cce-e614bd682b97 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:00.431478 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-2e4d8886-bf6a-4b02-8cce-e614bd682b97 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Getting quotas for project f07680a55b3f41408d3a284d1330503d. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:52:00.443757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-70af1b5b-50fd-43ef-89e9-1ca483a69920 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17c9f43612c483ba96eb09787b4dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cbbf76c3f4848b4a558de341ec19d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:00.449863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-2e4d8886-bf6a-4b02-8cce-e614bd682b97 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Getting quotas for user d28f966411004a158377c689fd5b05eb and project f07680a55b3f41408d3a284d1330503d. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:52:00.467547 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-70af1b5b-50fd-43ef-89e9-1ca483a69920 tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715" status: 200 len: 1473 microversion: 2.1 time: 0.836813 Jul 25 12:52:00.467547 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1484/2872] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:59 2022] GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715 => generated 1473 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:00.483627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-32ef812c-1e53-44d6-8178-1f228485bf38 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-746742079", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ee2e8a01-82ea-413d-8adb-fc55a7e6bf5e"}, {"port": "67565573-06d3-4bd8-a854-6237f54f8350", "tag": "port-1"}, {"port": "b1c8f2ac-436f-43bd-80a5-4182aa87ee56", "tag": "port-2"}, {"uuid": "6a08a90f-02a7-4464-9679-a4b93a45683f", "tag": "net-1"}, {"uuid": "6a08a90f-02a7-4464-9679-a4b93a45683f"}, {"uuid": "79205adc-474a-4142-9e4a-18f594b10574", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "79205adc-474a-4142-9e4a-18f594b10574", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "3dd201f3-ef06-49a5-a08e-7e4faf49a83b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "07e89749-4b5e-471e-abfa-73e7ac0e9c4b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "fe3db02a-8d27-4596-94ec-d8c720502dfa", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--627929823"}], "key_name": "tempest-keypair-1199865113", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:00.531620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2e4d8886-bf6a-4b02-8cce-e614bd682b97 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:52:00.541387 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2e4d8886-bf6a-4b02-8cce-e614bd682b97 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 5d1a7907-1bc8-4e80-899e-996371552930] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:52:00.707008 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2e4d8886-bf6a-4b02-8cce-e614bd682b97 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.788733 Jul 25 12:52:00.720410 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1389/2873] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:51:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:52:00.729821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e56872e1-311a-4748-9ae6-c0fae5594cc6 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:00.732114 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e56872e1-311a-4748-9ae6-c0fae5594cc6 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:00.743659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e56872e1-311a-4748-9ae6-c0fae5594cc6 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:00.744899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e56872e1-311a-4748-9ae6-c0fae5594cc6 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:00.746616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e56872e1-311a-4748-9ae6-c0fae5594cc6 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:00.747299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e56872e1-311a-4748-9ae6-c0fae5594cc6 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:01.288673 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e56872e1-311a-4748-9ae6-c0fae5594cc6 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:01.300715 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e56872e1-311a-4748-9ae6-c0fae5594cc6 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 200 len: 1569 microversion: 2.1 time: 0.577077 Jul 25 12:52:01.315525 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1390/2874] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:00 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 1569 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:01.331940 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-39dce48c-63f4-453e-8a38-01a8496b730c req-12748694-8bf9-46c2-a454-edc12985a899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd68f842-1690-4f88-8dc3-f0e72bae78a3", "name": "network-vif-deleted", "tag": "db7fc6b2-e698-4a2f-9230-3a4a5d9678fc"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:01.352173 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-39dce48c-63f4-453e-8a38-01a8496b730c req-12748694-8bf9-46c2-a454-edc12985a899 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:01.353198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-39dce48c-63f4-453e-8a38-01a8496b730c req-12748694-8bf9-46c2-a454-edc12985a899 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:01.395347 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-39dce48c-63f4-453e-8a38-01a8496b730c req-12748694-8bf9-46c2-a454-edc12985a899 service nova] Creating event network-vif-deleted:db7fc6b2-e698-4a2f-9230-3a4a5d9678fc for instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 on n-h1-848886-15 Jul 25 12:52:01.419643 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-39dce48c-63f4-453e-8a38-01a8496b730c req-12748694-8bf9-46c2-a454-edc12985a899 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101958 Jul 25 12:52:01.421057 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1391/2875] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:01.431829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5712a846-1dba-40fe-96b6-d1606201f4a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:01.433981 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5712a846-1dba-40fe-96b6-d1606201f4a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] [instance: 243f03fb-acc7-4897-8c84-3bfc55b7d4d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:01.454143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5712a846-1dba-40fe-96b6-d1606201f4a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:01.455089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5712a846-1dba-40fe-96b6-d1606201f4a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:01.459089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5712a846-1dba-40fe-96b6-d1606201f4a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:01.459819 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5712a846-1dba-40fe-96b6-d1606201f4a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:02.093651 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-32ef812c-1e53-44d6-8178-1f228485bf38 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] validate_networks() for [('ee2e8a01-82ea-413d-8adb-fc55a7e6bf5e', None, None, None, None, None), (None, None, '67565573-06d3-4bd8-a854-6237f54f8350', None, None, None), (None, None, 'b1c8f2ac-436f-43bd-80a5-4182aa87ee56', None, None, None), ('6a08a90f-02a7-4464-9679-a4b93a45683f', None, None, None, None, None), ('6a08a90f-02a7-4464-9679-a4b93a45683f', None, None, None, None, None), ('79205adc-474a-4142-9e4a-18f594b10574', '10.2.2.100', None, None, None, None), ('79205adc-474a-4142-9e4a-18f594b10574', '10.2.2.200', None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:52:03.040070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5712a846-1dba-40fe-96b6-d1606201f4a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5083b87804399a8bf17a6644710b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ce2bd463341d1b3e61041ee323c86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:03.062281 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5712a846-1dba-40fe-96b6-d1606201f4a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] 10.222.0.49 "GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5" status: 200 len: 1327 microversion: 2.1 time: 1.638966 Jul 25 12:52:03.071359 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1392/2876] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:01 2022] GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5 => generated 1327 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:03.088487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f921aae3-4ac4-4978-8eac-1ccdb3ea2c2f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:03.110710 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f921aae3-4ac4-4978-8eac-1ccdb3ea2c2f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 5d1a7907-1bc8-4e80-899e-996371552930] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:03.146260 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f921aae3-4ac4-4978-8eac-1ccdb3ea2c2f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:03.150442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f921aae3-4ac4-4978-8eac-1ccdb3ea2c2f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:03.154014 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f921aae3-4ac4-4978-8eac-1ccdb3ea2c2f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:03.154666 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f921aae3-4ac4-4978-8eac-1ccdb3ea2c2f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:03.403332 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f921aae3-4ac4-4978-8eac-1ccdb3ea2c2f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:03.416768 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f921aae3-4ac4-4978-8eac-1ccdb3ea2c2f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930" status: 200 len: 1274 microversion: 2.1 time: 0.343535 Jul 25 12:52:03.423236 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1393/2877] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:03 2022] GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930 => generated 1274 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:03.457444 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9c67a46a-4fe0-4c4c-9b01-1fb008f26d6c tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:03.462481 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9c67a46a-4fe0-4c4c-9b01-1fb008f26d6c tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] [instance: fdebd9ec-1b71-49bd-8c36-5fcef5559715] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:03.498567 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c67a46a-4fe0-4c4c-9b01-1fb008f26d6c tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:03.500289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c67a46a-4fe0-4c4c-9b01-1fb008f26d6c tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:03.502724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c67a46a-4fe0-4c4c-9b01-1fb008f26d6c tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:03.503630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c67a46a-4fe0-4c4c-9b01-1fb008f26d6c tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:03.525338 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-9c67a46a-4fe0-4c4c-9b01-1fb008f26d6c tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] HTTP exception thrown: Instance fdebd9ec-1b71-49bd-8c36-5fcef5559715 could not be found. Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9c67a46a-4fe0-4c4c-9b01-1fb008f26d6c tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Request method failure captured: Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715 HTTP/1.1 Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pFoPbCXr3A75kkKcKJD1bwz5CTq4jH_RHLFXsEBbPn3NQghOoxdZQhZOyW4jDGfUSnDKELbd3tG88UR1f3VBuRU2wagLUQDACZjWqacdUUG8M5wlmdz09wo4ZszopOnIO9fm-cP1IGClLUhHyMxq3981XsJtmqjOTQxYMZcxlVPdfc Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 8a7cbbf76c3f4848b4a558de341ec19d Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ImagesOneServerTestJSON-1354646116 Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8a7cbbf76c3f4848b4a558de341ec19d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8a7cbbf76c3f4848b4a558de341ec19d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8a7cbbf76c3f4848b4a558de341ec19d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8a7cbbf76c3f4848b4a558de341ec19d"}]}] Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ImagesOneServerTestJSON-1354646116 Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 8a7cbbf76c3f4848b4a558de341ec19d Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1354646116 Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ImagesOneServerTestJSON-1354646116-project Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: a17c9f43612c483ba96eb09787b4dd47 Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ImagesOneServerTestJSON-1354646116-project Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance fdebd9ec-1b71-49bd-8c36-5fcef5559715 could not be found. Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'fdebd9ec-1b71-49bd-8c36-5fcef5559715'} Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdebd9ec-1b71-49bd-8c36-5fcef5559715 could not be found. Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdebd9ec-1b71-49bd-8c36-5fcef5559715 could not be found. Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:03.529229 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:03.536061 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:03.536061 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:03.536061 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:03.536061 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:52:03.536061 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:52:03.536061 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdebd9ec-1b71-49bd-8c36-5fcef5559715 could not be found. Jul 25 12:52:03.536061 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:03.536061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9c67a46a-4fe0-4c4c-9b01-1fb008f26d6c tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] Returning 404 to user: Instance fdebd9ec-1b71-49bd-8c36-5fcef5559715 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:52:03.536061 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9c67a46a-4fe0-4c4c-9b01-1fb008f26d6c tempest-ImagesOneServerTestJSON-1354646116 tempest-ImagesOneServerTestJSON-1354646116-project] 10.222.0.49 "GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715" status: 404 len: 111 microversion: 2.1 time: 0.105539 Jul 25 12:52:03.536061 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1394/2878] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:03 2022] GET /compute/v2.1/servers/fdebd9ec-1b71-49bd-8c36-5fcef5559715 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:52:03.539554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-d76f9f65-b874-4a29-a3a1-358b9dcce682 req-0b7776c5-378a-4ce2-9594-743be1d9b015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243f03fb-acc7-4897-8c84-3bfc55b7d4d5", "name": "network-vif-plugged", "status": "completed", "tag": "e591ad0b-41d3-4e5e-b17c-97acbe4598c3"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:03.575024 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d76f9f65-b874-4a29-a3a1-358b9dcce682 req-0b7776c5-378a-4ce2-9594-743be1d9b015 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:03.576111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d76f9f65-b874-4a29-a3a1-358b9dcce682 req-0b7776c5-378a-4ce2-9594-743be1d9b015 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:03.619721 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-d76f9f65-b874-4a29-a3a1-358b9dcce682 req-0b7776c5-378a-4ce2-9594-743be1d9b015 service nova] Creating event network-vif-plugged:e591ad0b-41d3-4e5e-b17c-97acbe4598c3 for instance 243f03fb-acc7-4897-8c84-3bfc55b7d4d5 on n-h1-848886-15 Jul 25 12:52:03.653045 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-d76f9f65-b874-4a29-a3a1-358b9dcce682 req-0b7776c5-378a-4ce2-9594-743be1d9b015 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112325 Jul 25 12:52:03.657442 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1395/2879] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:03.671341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-7972a73a-8dbd-425c-842e-24e27a2528a9 req-df1dc96d-37e2-489b-ba68-72b269a867cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdebd9ec-1b71-49bd-8c36-5fcef5559715", "name": "network-vif-deleted", "tag": "52dec511-bbb4-43dc-98fe-0397c1c41e5d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:03.702767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-7972a73a-8dbd-425c-842e-24e27a2528a9 req-df1dc96d-37e2-489b-ba68-72b269a867cb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:03.702767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-7972a73a-8dbd-425c-842e-24e27a2528a9 req-df1dc96d-37e2-489b-ba68-72b269a867cb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:03.729498 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-7972a73a-8dbd-425c-842e-24e27a2528a9 req-df1dc96d-37e2-489b-ba68-72b269a867cb service nova] Creating event network-vif-deleted:52dec511-bbb4-43dc-98fe-0397c1c41e5d for instance fdebd9ec-1b71-49bd-8c36-5fcef5559715 on n-h2-848886-15 Jul 25 12:52:03.741532 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-7972a73a-8dbd-425c-842e-24e27a2528a9 req-df1dc96d-37e2-489b-ba68-72b269a867cb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082011 Jul 25 12:52:03.742313 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1396/2880] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:03.752349 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-15c3856f-8dbc-4548-8f61-e48e9a181355 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:03.753072 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-15c3856f-8dbc-4548-8f61-e48e9a181355 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:03.780408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15c3856f-8dbc-4548-8f61-e48e9a181355 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:03.781025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15c3856f-8dbc-4548-8f61-e48e9a181355 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:03.782078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15c3856f-8dbc-4548-8f61-e48e9a181355 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:03.782708 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15c3856f-8dbc-4548-8f61-e48e9a181355 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:03.819173 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-15c3856f-8dbc-4548-8f61-e48e9a181355 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] HTTP exception thrown: Instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 could not be found. Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-15c3856f-8dbc-4548-8f61-e48e9a181355 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Request method failure captured: Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 HTTP/1.1 Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pGEBcV00oIrXsYqjQvCG7NrnsUISLUBF1k-iSw8gGnoEJDVl97b6WpvepCB8T-oiRzFC7uWhgFi5JyoGjLeSbgNtevsSUK0SSWDbTSyITDPEbOWycP5Qp71XC2IXqVJyO0Koq1GQfr6-jG4POENX6p10DmdyDclGjGytodI3zSX5s0 Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: af716a8b586d45b2aa95b8c73683ff0d Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersTestMultiNic-996157873 Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_af716a8b586d45b2aa95b8c73683ff0d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/af716a8b586d45b2aa95b8c73683ff0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af716a8b586d45b2aa95b8c73683ff0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af716a8b586d45b2aa95b8c73683ff0d"}]}] Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersTestMultiNic-996157873 Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: af716a8b586d45b2aa95b8c73683ff0d Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersTestMultiNic-996157873 Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersTestMultiNic-996157873-project Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: f912ac6820e44b40977a2913a80c7bec Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersTestMultiNic-996157873-project Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 could not be found. Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'bd68f842-1690-4f88-8dc3-f0e72bae78a3'} Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 could not be found. Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 could not be found. Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:03.823297 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:03.831671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:03.831671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:03.831671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:03.831671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:52:03.831671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:52:03.831671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 could not be found. Jul 25 12:52:03.831671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:03.831671 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-15c3856f-8dbc-4548-8f61-e48e9a181355 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Returning 404 to user: Instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:52:03.831671 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-15c3856f-8dbc-4548-8f61-e48e9a181355 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 404 len: 111 microversion: 2.1 time: 0.085455 Jul 25 12:52:03.837300 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1397/2881] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:03 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:52:03.852297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-2cdaf256-c5b1-4aab-a904-daa244e1a91a req-81a67087-7964-4e01-82e7-e81ec29faae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd68f842-1690-4f88-8dc3-f0e72bae78a3", "name": "network-vif-deleted", "tag": "0d74ea81-13e8-4d64-a0aa-58cfd4296d1f"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:03.898607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2cdaf256-c5b1-4aab-a904-daa244e1a91a req-81a67087-7964-4e01-82e7-e81ec29faae3 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:03.899318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2cdaf256-c5b1-4aab-a904-daa244e1a91a req-81a67087-7964-4e01-82e7-e81ec29faae3 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:03.945348 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-2cdaf256-c5b1-4aab-a904-daa244e1a91a req-81a67087-7964-4e01-82e7-e81ec29faae3 service nova] Creating event network-vif-deleted:0d74ea81-13e8-4d64-a0aa-58cfd4296d1f for instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 on n-h1-848886-15 Jul 25 12:52:03.971916 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-2cdaf256-c5b1-4aab-a904-daa244e1a91a req-81a67087-7964-4e01-82e7-e81ec29faae3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135077 Jul 25 12:52:03.980334 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1398/2882] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:03.992957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4a5779f4-c021-4fce-888d-ed2bce68fa10 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-723499958", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9bdc019-d9ba-4dd9-9e23-b909e49f2c93"}], "security_groups": [{"name": "tempest-securitygroup--198131961"}], "key_name": "tempest-keypair-1353753151", "user_data": "}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:04.550467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-4a5779f4-c021-4fce-888d-ed2bce68fa10 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] validate_networks() for [('f9bdc019-d9ba-4dd9-9e23-b909e49f2c93', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:52:08.048378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4a5779f4-c021-4fce-888d-ed2bce68fa10 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:52:08.049089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4a5779f4-c021-4fce-888d-ed2bce68fa10 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:52:08.049491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4a5779f4-c021-4fce-888d-ed2bce68fa10 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:52:08.050022 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4a5779f4-c021-4fce-888d-ed2bce68fa10 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:52:08.050837 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4a5779f4-c021-4fce-888d-ed2bce68fa10 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:52:08.061970 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a5779f4-c021-4fce-888d-ed2bce68fa10 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:08.062532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a5779f4-c021-4fce-888d-ed2bce68fa10 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:08.063689 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a5779f4-c021-4fce-888d-ed2bce68fa10 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:08.064138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a5779f4-c021-4fce-888d-ed2bce68fa10 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:08.097089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-4a5779f4-c021-4fce-888d-ed2bce68fa10 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Getting quotas for project b5abf45c9ba0419c8dec07847f3ff3c5. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:52:08.107398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-4a5779f4-c021-4fce-888d-ed2bce68fa10 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Getting quotas for user 4d492d20a4864908a81902f86468d437 and project b5abf45c9ba0419c8dec07847f3ff3c5. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:52:08.127871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4a5779f4-c021-4fce-888d-ed2bce68fa10 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:52:08.135552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4a5779f4-c021-4fce-888d-ed2bce68fa10 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:52:08.221233 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4a5779f4-c021-4fce-888d-ed2bce68fa10 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 4.238916 Jul 25 12:52:08.222121 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1399/2883] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:52:03 2022] POST /compute/v2.1/servers => generated 408 bytes in 4241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:52:08.227660 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4662997c-7fb1-46b2-8637-21e3f891e623 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:08.228869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4662997c-7fb1-46b2-8637-21e3f891e623 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] [instance: 243f03fb-acc7-4897-8c84-3bfc55b7d4d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:08.242457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4662997c-7fb1-46b2-8637-21e3f891e623 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:08.243323 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4662997c-7fb1-46b2-8637-21e3f891e623 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:08.244443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4662997c-7fb1-46b2-8637-21e3f891e623 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:08.245165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4662997c-7fb1-46b2-8637-21e3f891e623 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:09.169621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4662997c-7fb1-46b2-8637-21e3f891e623 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5083b87804399a8bf17a6644710b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ce2bd463341d1b3e61041ee323c86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:09.192503 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4662997c-7fb1-46b2-8637-21e3f891e623 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] 10.222.0.49 "GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5" status: 200 len: 1526 microversion: 2.1 time: 0.963798 Jul 25 12:52:09.204066 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1400/2884] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:08 2022] GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5 => generated 1526 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:09.221083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-03e12707-74ac-4253-ac08-52484d5f679b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:09.224045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-03e12707-74ac-4253-ac08-52484d5f679b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 5d1a7907-1bc8-4e80-899e-996371552930] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:09.239852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-03e12707-74ac-4253-ac08-52484d5f679b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:09.243296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-03e12707-74ac-4253-ac08-52484d5f679b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:09.246215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-03e12707-74ac-4253-ac08-52484d5f679b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:09.247622 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-03e12707-74ac-4253-ac08-52484d5f679b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:09.410697 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=8 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:09.961188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-03e12707-74ac-4253-ac08-52484d5f679b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:09.985040 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-03e12707-74ac-4253-ac08-52484d5f679b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930" status: 200 len: 1314 microversion: 2.1 time: 0.778754 Jul 25 12:52:10.000574 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1401/2885] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:09 2022] GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930 => generated 1314 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:10.251843 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-011b5205-7f79-41e4-b66a-7d48bc38c094 tempest-AbsoluteLimitsTestJSON-1737298504 tempest-AbsoluteLimitsTestJSON-1737298504-project] Calling method '.version_select at 0x7efcf8cedd30>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:10.268896 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-011b5205-7f79-41e4-b66a-7d48bc38c094 tempest-AbsoluteLimitsTestJSON-1737298504 tempest-AbsoluteLimitsTestJSON-1737298504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:10.270126 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-011b5205-7f79-41e4-b66a-7d48bc38c094 tempest-AbsoluteLimitsTestJSON-1737298504 tempest-AbsoluteLimitsTestJSON-1737298504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:10.271308 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-011b5205-7f79-41e4-b66a-7d48bc38c094 tempest-AbsoluteLimitsTestJSON-1737298504 tempest-AbsoluteLimitsTestJSON-1737298504-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:10.271888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-011b5205-7f79-41e4-b66a-7d48bc38c094 tempest-AbsoluteLimitsTestJSON-1737298504 tempest-AbsoluteLimitsTestJSON-1737298504-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:10.297901 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-011b5205-7f79-41e4-b66a-7d48bc38c094 tempest-AbsoluteLimitsTestJSON-1737298504 tempest-AbsoluteLimitsTestJSON-1737298504-project] 10.222.0.49 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.295531 Jul 25 12:52:10.299287 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1402/2886] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Jul 25 12:52:10 2022] GET /compute/v2.1/limits => generated 511 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:10.304866 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-46e86103-e08d-420c-b8ae-af25b82c33c0 req-7bdbc7b7-791d-46c0-9801-29a74c1ebfb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d1a7907-1bc8-4e80-899e-996371552930", "tag": "3bf5c082-0de4-4092-9175-c9abca2ebe5d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:10.320350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-46e86103-e08d-420c-b8ae-af25b82c33c0 req-7bdbc7b7-791d-46c0-9801-29a74c1ebfb1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:10.321344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-46e86103-e08d-420c-b8ae-af25b82c33c0 req-7bdbc7b7-791d-46c0-9801-29a74c1ebfb1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:10.336757 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-46e86103-e08d-420c-b8ae-af25b82c33c0 req-7bdbc7b7-791d-46c0-9801-29a74c1ebfb1 service nova] Creating event network-changed:3bf5c082-0de4-4092-9175-c9abca2ebe5d for instance 5d1a7907-1bc8-4e80-899e-996371552930 on n-h2-848886-15 Jul 25 12:52:10.345914 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-46e86103-e08d-420c-b8ae-af25b82c33c0 req-7bdbc7b7-791d-46c0-9801-29a74c1ebfb1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044786 Jul 25 12:52:10.347445 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1403/2887] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:10.362454 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-38477f8d-c687-421d-869d-2ace3182159a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:10.364523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-38477f8d-c687-421d-869d-2ace3182159a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:10.377725 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-38477f8d-c687-421d-869d-2ace3182159a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:10.379264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-38477f8d-c687-421d-869d-2ace3182159a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:10.381609 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-38477f8d-c687-421d-869d-2ace3182159a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:10.382784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-38477f8d-c687-421d-869d-2ace3182159a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:10.448867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=9 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:10.652265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-38477f8d-c687-421d-869d-2ace3182159a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:10.673245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:10.678999 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-38477f8d-c687-421d-869d-2ace3182159a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1296 microversion: 2.1 time: 0.329566 Jul 25 12:52:10.696976 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1404/2888] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:10 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1296 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:10.719100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a451a060-92b2-4230-9394-e6ae0182baa5 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:10.720221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a451a060-92b2-4230-9394-e6ae0182baa5 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] [instance: 243f03fb-acc7-4897-8c84-3bfc55b7d4d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:10.738215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a451a060-92b2-4230-9394-e6ae0182baa5 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:10.738706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a451a060-92b2-4230-9394-e6ae0182baa5 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:10.739494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a451a060-92b2-4230-9394-e6ae0182baa5 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:10.739952 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a451a060-92b2-4230-9394-e6ae0182baa5 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:11.597287 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a451a060-92b2-4230-9394-e6ae0182baa5 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5083b87804399a8bf17a6644710b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ce2bd463341d1b3e61041ee323c86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:11.615401 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a451a060-92b2-4230-9394-e6ae0182baa5 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] 10.222.0.49 "GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5" status: 200 len: 1526 microversion: 2.1 time: 0.916846 Jul 25 12:52:11.616060 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1405/2889] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:10 2022] GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5 => generated 1526 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:11.624648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7335beb8-430b-492c-a271-49826409896e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:11.625274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7335beb8-430b-492c-a271-49826409896e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 5d1a7907-1bc8-4e80-899e-996371552930] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:11.643548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7335beb8-430b-492c-a271-49826409896e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:11.645785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7335beb8-430b-492c-a271-49826409896e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:11.646749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7335beb8-430b-492c-a271-49826409896e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:11.647196 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7335beb8-430b-492c-a271-49826409896e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:12.275604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7335beb8-430b-492c-a271-49826409896e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:12.306725 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7335beb8-430b-492c-a271-49826409896e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930" status: 200 len: 1314 microversion: 2.1 time: 0.688412 Jul 25 12:52:12.309549 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1406/2890] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:11 2022] GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930 => generated 1314 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:12.668684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2fd0c417-8ff2-46c9-8604-db5e80d38a5b tempest-ServersNegativeTestMultiTenantJSON-997675145 tempest-ServersNegativeTestMultiTenantJSON-997675145-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:12.669785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2fd0c417-8ff2-46c9-8604-db5e80d38a5b tempest-ServersNegativeTestMultiTenantJSON-997675145 tempest-ServersNegativeTestMultiTenantJSON-997675145-project] [instance: 243f03fb-acc7-4897-8c84-3bfc55b7d4d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:12.692968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fd0c417-8ff2-46c9-8604-db5e80d38a5b tempest-ServersNegativeTestMultiTenantJSON-997675145 tempest-ServersNegativeTestMultiTenantJSON-997675145-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:12.692968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fd0c417-8ff2-46c9-8604-db5e80d38a5b tempest-ServersNegativeTestMultiTenantJSON-997675145 tempest-ServersNegativeTestMultiTenantJSON-997675145-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:12.699073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fd0c417-8ff2-46c9-8604-db5e80d38a5b tempest-ServersNegativeTestMultiTenantJSON-997675145 tempest-ServersNegativeTestMultiTenantJSON-997675145-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:12.702418 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fd0c417-8ff2-46c9-8604-db5e80d38a5b tempest-ServersNegativeTestMultiTenantJSON-997675145 tempest-ServersNegativeTestMultiTenantJSON-997675145-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:12.741576 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-2fd0c417-8ff2-46c9-8604-db5e80d38a5b tempest-ServersNegativeTestMultiTenantJSON-997675145 tempest-ServersNegativeTestMultiTenantJSON-997675145-project] HTTP exception thrown: Instance 243f03fb-acc7-4897-8c84-3bfc55b7d4d5 could not be found. Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2fd0c417-8ff2-46c9-8604-db5e80d38a5b tempest-ServersNegativeTestMultiTenantJSON-997675145 tempest-ServersNegativeTestMultiTenantJSON-997675145-project] Request method failure captured: Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5 HTTP/1.1 Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pHUbPXTZVxy84RxGITnn6qwsaOQ74DBWCC2YdtLxUFkcTaWATC8veFVbFQoX1rJ2nzAtz6mSIWgf52ptNubLRh1izuQNfDvvONap7k2ORZLbrV__yptlm3QslU2RYIi4XQx1e5q6R6RxSFJEDSh6b0hELgsm2oaznCGc6DkJshqFQ0 Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 20e54a71f40c4a35b08c5683b2ea13f1 Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-997675145 Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_20e54a71f40c4a35b08c5683b2ea13f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/20e54a71f40c4a35b08c5683b2ea13f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/20e54a71f40c4a35b08c5683b2ea13f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/20e54a71f40c4a35b08c5683b2ea13f1"}]}] Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-997675145 Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 20e54a71f40c4a35b08c5683b2ea13f1 Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-997675145 Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestMultiTenantJSON-997675145-project Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: d2d8cec116314ba3aa64be044274c372 Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-997675145-project Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 243f03fb-acc7-4897-8c84-3bfc55b7d4d5 could not be found. Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '243f03fb-acc7-4897-8c84-3bfc55b7d4d5'} Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 243f03fb-acc7-4897-8c84-3bfc55b7d4d5 could not be found. Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:52:12.759135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:52:12.769211 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 243f03fb-acc7-4897-8c84-3bfc55b7d4d5 could not be found. Jul 25 12:52:12.769211 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:12.769211 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:12.769211 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:12.769211 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:12.769211 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:12.769211 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:12.769211 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:52:12.769211 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:52:12.769211 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 243f03fb-acc7-4897-8c84-3bfc55b7d4d5 could not be found. Jul 25 12:52:12.769211 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:12.780217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2fd0c417-8ff2-46c9-8604-db5e80d38a5b tempest-ServersNegativeTestMultiTenantJSON-997675145 tempest-ServersNegativeTestMultiTenantJSON-997675145-project] Returning 404 to user: Instance 243f03fb-acc7-4897-8c84-3bfc55b7d4d5 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:52:12.781470 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2fd0c417-8ff2-46c9-8604-db5e80d38a5b tempest-ServersNegativeTestMultiTenantJSON-997675145 tempest-ServersNegativeTestMultiTenantJSON-997675145-project] 10.222.0.49 "DELETE /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5" status: 404 len: 111 microversion: 2.1 time: 0.469606 Jul 25 12:52:12.782125 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1407/2891] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:52:12 2022] DELETE /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5 => generated 111 bytes in 472 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:52:12.799919 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cfb92b68-5cd7-440b-8831-3b0b3981830a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:12.800680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cfb92b68-5cd7-440b-8831-3b0b3981830a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:12.822252 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cfb92b68-5cd7-440b-8831-3b0b3981830a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:12.822709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cfb92b68-5cd7-440b-8831-3b0b3981830a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:12.823520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cfb92b68-5cd7-440b-8831-3b0b3981830a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:12.823964 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cfb92b68-5cd7-440b-8831-3b0b3981830a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:13.360266 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cfb92b68-5cd7-440b-8831-3b0b3981830a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:13.378534 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cfb92b68-5cd7-440b-8831-3b0b3981830a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1296 microversion: 2.1 time: 0.593313 Jul 25 12:52:13.397492 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1408/2892] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:12 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1296 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:13.434051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-43b499b8-374e-48b4-ae9a-bd53cab785a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:13.434561 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-43b499b8-374e-48b4-ae9a-bd53cab785a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] [instance: 243f03fb-acc7-4897-8c84-3bfc55b7d4d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:13.451182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43b499b8-374e-48b4-ae9a-bd53cab785a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:13.451182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43b499b8-374e-48b4-ae9a-bd53cab785a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:13.462494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43b499b8-374e-48b4-ae9a-bd53cab785a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:13.463219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43b499b8-374e-48b4-ae9a-bd53cab785a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:14.043083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-43b499b8-374e-48b4-ae9a-bd53cab785a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5083b87804399a8bf17a6644710b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ce2bd463341d1b3e61041ee323c86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:14.071076 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-43b499b8-374e-48b4-ae9a-bd53cab785a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] 10.222.0.49 "GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5" status: 200 len: 1526 microversion: 2.1 time: 0.660908 Jul 25 12:52:14.072876 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1409/2893] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:13 2022] GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5 => generated 1526 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:14.092793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-50718d58-bd8f-4936-a428-b40c39357382 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:14.094613 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-50718d58-bd8f-4936-a428-b40c39357382 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 5d1a7907-1bc8-4e80-899e-996371552930] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:14.116739 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50718d58-bd8f-4936-a428-b40c39357382 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:14.118108 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50718d58-bd8f-4936-a428-b40c39357382 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:14.122200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50718d58-bd8f-4936-a428-b40c39357382 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:14.123639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50718d58-bd8f-4936-a428-b40c39357382 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:14.445129 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:14.937100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-50718d58-bd8f-4936-a428-b40c39357382 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:14.947162 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-50718d58-bd8f-4936-a428-b40c39357382 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930" status: 200 len: 1314 microversion: 2.1 time: 0.868218 Jul 25 12:52:14.958109 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1410/2894] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:14 2022] GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930 => generated 1314 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:14.963564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-a259d43d-6ada-42c0-b78d-41dc515c3700 req-3096d72c-185f-4f0a-9778-255c9a1e71e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d1a7907-1bc8-4e80-899e-996371552930", "name": "network-vif-plugged", "status": "completed", "tag": "3bf5c082-0de4-4092-9175-c9abca2ebe5d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:15.006159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a259d43d-6ada-42c0-b78d-41dc515c3700 req-3096d72c-185f-4f0a-9778-255c9a1e71e1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:15.006942 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a259d43d-6ada-42c0-b78d-41dc515c3700 req-3096d72c-185f-4f0a-9778-255c9a1e71e1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:15.029023 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-a259d43d-6ada-42c0-b78d-41dc515c3700 req-3096d72c-185f-4f0a-9778-255c9a1e71e1 service nova] Creating event network-vif-plugged:3bf5c082-0de4-4092-9175-c9abca2ebe5d for instance 5d1a7907-1bc8-4e80-899e-996371552930 on n-h2-848886-15 Jul 25 12:52:15.040414 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-a259d43d-6ada-42c0-b78d-41dc515c3700 req-3096d72c-185f-4f0a-9778-255c9a1e71e1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080334 Jul 25 12:52:15.041937 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1411/2895] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:15.073247 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-af1756fc-aa1c-4417-b72b-8e91985b8ea4 tempest-ServersNegativeTestMultiTenantJSON-997675145 tempest-ServersNegativeTestMultiTenantJSON-997675145-project] Action: 'update', calling method: >, body: {"server": {"name": "243f03fb-acc7-4897-8c84-3bfc55b7d4d5_new"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:15.102886 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-af1756fc-aa1c-4417-b72b-8e91985b8ea4 tempest-ServersNegativeTestMultiTenantJSON-997675145 tempest-ServersNegativeTestMultiTenantJSON-997675145-project] [instance: 243f03fb-acc7-4897-8c84-3bfc55b7d4d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:15.103477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-32ef812c-1e53-44d6-8178-1f228485bf38 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:52:15.105527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-32ef812c-1e53-44d6-8178-1f228485bf38 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:52:15.106688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-32ef812c-1e53-44d6-8178-1f228485bf38 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:52:15.107732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-32ef812c-1e53-44d6-8178-1f228485bf38 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:52:15.108707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-32ef812c-1e53-44d6-8178-1f228485bf38 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:52:15.128431 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af1756fc-aa1c-4417-b72b-8e91985b8ea4 tempest-ServersNegativeTestMultiTenantJSON-997675145 tempest-ServersNegativeTestMultiTenantJSON-997675145-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:15.128968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af1756fc-aa1c-4417-b72b-8e91985b8ea4 tempest-ServersNegativeTestMultiTenantJSON-997675145 tempest-ServersNegativeTestMultiTenantJSON-997675145-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:15.130015 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af1756fc-aa1c-4417-b72b-8e91985b8ea4 tempest-ServersNegativeTestMultiTenantJSON-997675145 tempest-ServersNegativeTestMultiTenantJSON-997675145-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:15.130621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af1756fc-aa1c-4417-b72b-8e91985b8ea4 tempest-ServersNegativeTestMultiTenantJSON-997675145 tempest-ServersNegativeTestMultiTenantJSON-997675145-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:15.151002 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-af1756fc-aa1c-4417-b72b-8e91985b8ea4 tempest-ServersNegativeTestMultiTenantJSON-997675145 tempest-ServersNegativeTestMultiTenantJSON-997675145-project] HTTP exception thrown: Instance 243f03fb-acc7-4897-8c84-3bfc55b7d4d5 could not be found. Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-af1756fc-aa1c-4417-b72b-8e91985b8ea4 tempest-ServersNegativeTestMultiTenantJSON-997675145 tempest-ServersNegativeTestMultiTenantJSON-997675145-project] Request method failure captured: Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: request: PUT /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5 HTTP/1.1 Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 64 Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pHUbPXTZVxy84RxGITnn6qwsaOQ74DBWCC2YdtLxUFkcTaWATC8veFVbFQoX1rJ2nzAtz6mSIWgf52ptNubLRh1izuQNfDvvONap7k2ORZLbrV__yptlm3QslU2RYIi4XQx1e5q6R6RxSFJEDSh6b0hELgsm2oaznCGc6DkJshqFQ0 Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 20e54a71f40c4a35b08c5683b2ea13f1 Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-997675145 Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_20e54a71f40c4a35b08c5683b2ea13f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/20e54a71f40c4a35b08c5683b2ea13f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/20e54a71f40c4a35b08c5683b2ea13f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/20e54a71f40c4a35b08c5683b2ea13f1"}]}] Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-997675145 Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 20e54a71f40c4a35b08c5683b2ea13f1 Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-997675145 Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestMultiTenantJSON-997675145-project Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: d2d8cec116314ba3aa64be044274c372 Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-997675145-project Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: {"server": {"name": "243f03fb-acc7-4897-8c84-3bfc55b7d4d5_new"}} Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 243f03fb-acc7-4897-8c84-3bfc55b7d4d5 could not be found. Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '243f03fb-acc7-4897-8c84-3bfc55b7d4d5', 'body': {'server': {'name': '243f03fb-acc7-4897-8c84-3bfc55b7d4d5_new'}}} Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 243f03fb-acc7-4897-8c84-3bfc55b7d4d5 could not be found. Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 12:52:15.153103 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 25 12:52:15.157322 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 25 12:52:15.157322 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:52:15.157322 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:52:15.157322 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:52:15.157322 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:52:15.157322 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 243f03fb-acc7-4897-8c84-3bfc55b7d4d5 could not be found. Jul 25 12:52:15.157322 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:15.157322 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:15.157322 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:15.157322 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:15.157322 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:15.157322 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:15.157322 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:52:15.157322 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:52:15.157322 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 243f03fb-acc7-4897-8c84-3bfc55b7d4d5 could not be found. Jul 25 12:52:15.157322 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:15.159707 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-af1756fc-aa1c-4417-b72b-8e91985b8ea4 tempest-ServersNegativeTestMultiTenantJSON-997675145 tempest-ServersNegativeTestMultiTenantJSON-997675145-project] Returning 404 to user: Instance 243f03fb-acc7-4897-8c84-3bfc55b7d4d5 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:52:15.161160 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-af1756fc-aa1c-4417-b72b-8e91985b8ea4 tempest-ServersNegativeTestMultiTenantJSON-997675145 tempest-ServersNegativeTestMultiTenantJSON-997675145-project] 10.222.0.49 "PUT /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5" status: 404 len: 111 microversion: 2.1 time: 0.117279 Jul 25 12:52:15.162094 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1412/2896] 10.222.0.49 () {60 vars in 1256 bytes} [Mon Jul 25 12:52:15 2022] PUT /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:52:15.168295 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e07c22a2-479f-4319-b1fa-dccfd0102a73 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:15.169186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e07c22a2-479f-4319-b1fa-dccfd0102a73 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:15.177647 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e07c22a2-479f-4319-b1fa-dccfd0102a73 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:15.178199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e07c22a2-479f-4319-b1fa-dccfd0102a73 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:15.179142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e07c22a2-479f-4319-b1fa-dccfd0102a73 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:15.179538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e07c22a2-479f-4319-b1fa-dccfd0102a73 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:15.186982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32ef812c-1e53-44d6-8178-1f228485bf38 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:15.202497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32ef812c-1e53-44d6-8178-1f228485bf38 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:15.204470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32ef812c-1e53-44d6-8178-1f228485bf38 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:15.205240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32ef812c-1e53-44d6-8178-1f228485bf38 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:15.247800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-32ef812c-1e53-44d6-8178-1f228485bf38 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Getting quotas for project f951d0b219924bb1aa408d3e22bcafc3. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:52:15.268546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-32ef812c-1e53-44d6-8178-1f228485bf38 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Getting quotas for user 2f958f28464144e89e63b7e7dbcfb0b5 and project f951d0b219924bb1aa408d3e22bcafc3. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:52:15.614931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-32ef812c-1e53-44d6-8178-1f228485bf38 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:52:15.618646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-32ef812c-1e53-44d6-8178-1f228485bf38 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='3dd201f3-ef06-49a5-a08e-7e4faf49a83b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='07e89749-4b5e-471e-abfa-73e7ac0e9c4b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fe3db02a-8d27-4596-94ec-d8c720502dfa',volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:52:15.731137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e07c22a2-479f-4319-b1fa-dccfd0102a73 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:15.749918 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e07c22a2-479f-4319-b1fa-dccfd0102a73 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1363 microversion: 2.1 time: 0.586030 Jul 25 12:52:15.751172 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1413/2897] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:15 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1363 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:15.777899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-847a2f87-089f-40de-abec-bcd13edd5d06 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:15.779344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-847a2f87-089f-40de-abec-bcd13edd5d06 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] [instance: 243f03fb-acc7-4897-8c84-3bfc55b7d4d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:15.803336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-847a2f87-089f-40de-abec-bcd13edd5d06 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:15.805035 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-847a2f87-089f-40de-abec-bcd13edd5d06 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:15.806479 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-847a2f87-089f-40de-abec-bcd13edd5d06 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:15.808083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-847a2f87-089f-40de-abec-bcd13edd5d06 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:15.892693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-847a2f87-089f-40de-abec-bcd13edd5d06 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] [instance: 243f03fb-acc7-4897-8c84-3bfc55b7d4d5] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:52:16.089910 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-847a2f87-089f-40de-abec-bcd13edd5d06 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] 10.222.0.49 "DELETE /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5" status: 204 len: 0 microversion: 2.1 time: 0.336564 Jul 25 12:52:16.097481 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1414/2898] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:52:15 2022] DELETE /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:52:16.107138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e427870f-87ae-486b-85d2-c2c2e877cd28 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:16.108856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e427870f-87ae-486b-85d2-c2c2e877cd28 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 5d1a7907-1bc8-4e80-899e-996371552930] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:16.122464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e427870f-87ae-486b-85d2-c2c2e877cd28 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:16.123512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e427870f-87ae-486b-85d2-c2c2e877cd28 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:16.124921 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e427870f-87ae-486b-85d2-c2c2e877cd28 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:16.125763 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e427870f-87ae-486b-85d2-c2c2e877cd28 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:16.347117 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-32ef812c-1e53-44d6-8178-1f228485bf38 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 15.887560 Jul 25 12:52:16.348239 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1485/2899] 10.222.0.49 () {62 vars in 1189 bytes} [Mon Jul 25 12:52:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 15889 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 12:52:16.372688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0ecdad52-6f4c-43cc-8a0c-f3e551b3c3d9 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:16.375031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0ecdad52-6f4c-43cc-8a0c-f3e551b3c3d9 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] [instance: 243f03fb-acc7-4897-8c84-3bfc55b7d4d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:16.395548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ecdad52-6f4c-43cc-8a0c-f3e551b3c3d9 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:16.396335 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ecdad52-6f4c-43cc-8a0c-f3e551b3c3d9 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:16.399799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ecdad52-6f4c-43cc-8a0c-f3e551b3c3d9 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:16.401476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ecdad52-6f4c-43cc-8a0c-f3e551b3c3d9 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:16.995969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e427870f-87ae-486b-85d2-c2c2e877cd28 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:17.019906 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e427870f-87ae-486b-85d2-c2c2e877cd28 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930" status: 200 len: 1314 microversion: 2.1 time: 0.918129 Jul 25 12:52:17.039536 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1415/2900] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:16 2022] GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930 => generated 1314 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:17.056670 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0d0543dc-c32d-4b10-a93a-0f4381054042 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:17.057695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0d0543dc-c32d-4b10-a93a-0f4381054042 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:17.311633 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0d0543dc-c32d-4b10-a93a-0f4381054042 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:17.335010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0d0543dc-c32d-4b10-a93a-0f4381054042 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:17.337443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0d0543dc-c32d-4b10-a93a-0f4381054042 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:17.340313 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0d0543dc-c32d-4b10-a93a-0f4381054042 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1285 microversion: 2.32 time: 0.298054 Jul 25 12:52:17.341571 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1416/2901] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:52:17 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1285 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:52:17.349988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d999aebb-3671-4b02-80bc-2ce0c4f77c5f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:17.350863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d999aebb-3671-4b02-80bc-2ce0c4f77c5f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:17.362152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d999aebb-3671-4b02-80bc-2ce0c4f77c5f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:17.363745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d999aebb-3671-4b02-80bc-2ce0c4f77c5f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:17.364944 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d999aebb-3671-4b02-80bc-2ce0c4f77c5f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:17.365662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d999aebb-3671-4b02-80bc-2ce0c4f77c5f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:17.377167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0ecdad52-6f4c-43cc-8a0c-f3e551b3c3d9 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5083b87804399a8bf17a6644710b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ce2bd463341d1b3e61041ee323c86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:17.400499 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0ecdad52-6f4c-43cc-8a0c-f3e551b3c3d9 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] 10.222.0.49 "GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5" status: 200 len: 1532 microversion: 2.1 time: 1.048965 Jul 25 12:52:17.422766 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1486/2902] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:16 2022] GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5 => generated 1532 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:17.779609 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d999aebb-3671-4b02-80bc-2ce0c4f77c5f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:17.812108 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d999aebb-3671-4b02-80bc-2ce0c4f77c5f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1363 microversion: 2.1 time: 0.467201 Jul 25 12:52:17.819578 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1417/2903] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:17 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1363 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:18.060634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5e79c5fe-1745-4439-92d8-1236a15596c9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:18.083521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5e79c5fe-1745-4439-92d8-1236a15596c9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 5d1a7907-1bc8-4e80-899e-996371552930] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:18.101576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e79c5fe-1745-4439-92d8-1236a15596c9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:18.111797 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e79c5fe-1745-4439-92d8-1236a15596c9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:18.113506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e79c5fe-1745-4439-92d8-1236a15596c9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:18.146477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e79c5fe-1745-4439-92d8-1236a15596c9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:18.367562 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-87bad870-bd99-4f53-8284-573e51f26853 req-88ab3c8d-7cb7-4ada-a524-337ace77aa19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b730aecb-2c1f-46ef-b457-8a3717655518", "tag": "45191120-4204-4de7-9ef8-5d5c4ba83f89"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:18.423274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-87bad870-bd99-4f53-8284-573e51f26853 req-88ab3c8d-7cb7-4ada-a524-337ace77aa19 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:18.424131 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-87bad870-bd99-4f53-8284-573e51f26853 req-88ab3c8d-7cb7-4ada-a524-337ace77aa19 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:18.475568 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-87bad870-bd99-4f53-8284-573e51f26853 req-88ab3c8d-7cb7-4ada-a524-337ace77aa19 service nova] Creating event network-changed:45191120-4204-4de7-9ef8-5d5c4ba83f89 for instance b730aecb-2c1f-46ef-b457-8a3717655518 on n-h1-848886-15 Jul 25 12:52:18.496819 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-87bad870-bd99-4f53-8284-573e51f26853 req-88ab3c8d-7cb7-4ada-a524-337ace77aa19 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137470 Jul 25 12:52:18.506310 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1418/2904] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:52:18.520741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cbbcd97b-c863-43ca-a157-0f113a9ac328 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:18.521862 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cbbcd97b-c863-43ca-a157-0f113a9ac328 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:18.541085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:18.564119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cbbcd97b-c863-43ca-a157-0f113a9ac328 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:18.570700 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cbbcd97b-c863-43ca-a157-0f113a9ac328 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:18.573358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cbbcd97b-c863-43ca-a157-0f113a9ac328 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:18.578838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cbbcd97b-c863-43ca-a157-0f113a9ac328 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:18.912418 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cbbcd97b-c863-43ca-a157-0f113a9ac328 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:18.932546 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cbbcd97b-c863-43ca-a157-0f113a9ac328 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:18.935010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cbbcd97b-c863-43ca-a157-0f113a9ac328 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:18.937145 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cbbcd97b-c863-43ca-a157-0f113a9ac328 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1519 microversion: 2.32 time: 0.428686 Jul 25 12:52:18.946737 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1419/2905] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:52:18 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1519 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:52:18.962526 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f246ef16-76d5-4e40-a22d-271d817968a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:18.962526 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f246ef16-76d5-4e40-a22d-271d817968a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] [instance: 243f03fb-acc7-4897-8c84-3bfc55b7d4d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:18.981970 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f246ef16-76d5-4e40-a22d-271d817968a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:18.985863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f246ef16-76d5-4e40-a22d-271d817968a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:18.993752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f246ef16-76d5-4e40-a22d-271d817968a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:18.995126 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f246ef16-76d5-4e40-a22d-271d817968a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:19.108186 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5e79c5fe-1745-4439-92d8-1236a15596c9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:19.137100 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5e79c5fe-1745-4439-92d8-1236a15596c9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930" status: 200 len: 1501 microversion: 2.1 time: 1.083894 Jul 25 12:52:19.141313 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1487/2906] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:18 2022] GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930 => generated 1501 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:19.153443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-37e9d52e-9b81-45aa-965a-50578931b9e5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:19.154896 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-37e9d52e-9b81-45aa-965a-50578931b9e5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:19.201140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-37e9d52e-9b81-45aa-965a-50578931b9e5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:19.202566 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-37e9d52e-9b81-45aa-965a-50578931b9e5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:19.208077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-37e9d52e-9b81-45aa-965a-50578931b9e5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:19.233254 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-37e9d52e-9b81-45aa-965a-50578931b9e5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:20.283457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:20.284719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-37e9d52e-9b81-45aa-965a-50578931b9e5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:20.312116 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-37e9d52e-9b81-45aa-965a-50578931b9e5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1363 microversion: 2.1 time: 1.167327 Jul 25 12:52:20.317304 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1488/2907] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:19 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1363 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:20.349736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7949237e-a8f3-4e08-9bd5-9fe2bdf1c78e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:20.352370 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7949237e-a8f3-4e08-9bd5-9fe2bdf1c78e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:20.375227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7949237e-a8f3-4e08-9bd5-9fe2bdf1c78e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:20.375937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7949237e-a8f3-4e08-9bd5-9fe2bdf1c78e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:20.377611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7949237e-a8f3-4e08-9bd5-9fe2bdf1c78e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:20.382535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7949237e-a8f3-4e08-9bd5-9fe2bdf1c78e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:20.675194 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7949237e-a8f3-4e08-9bd5-9fe2bdf1c78e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:20.697432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f246ef16-76d5-4e40-a22d-271d817968a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5083b87804399a8bf17a6644710b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ce2bd463341d1b3e61041ee323c86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:20.754322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7949237e-a8f3-4e08-9bd5-9fe2bdf1c78e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:20.766139 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f246ef16-76d5-4e40-a22d-271d817968a2 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] 10.222.0.49 "GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5" status: 200 len: 1532 microversion: 2.1 time: 1.814610 Jul 25 12:52:20.767641 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1420/2908] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:18 2022] GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5 => generated 1532 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:20.772688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7949237e-a8f3-4e08-9bd5-9fe2bdf1c78e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:20.777239 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7949237e-a8f3-4e08-9bd5-9fe2bdf1c78e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1593 microversion: 2.32 time: 0.454245 Jul 25 12:52:20.792905 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1489/2909] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:52:20 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1593 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:52:21.367150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3768e8d1-15ae-4021-a880-3015e268737e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:21.372092 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3768e8d1-15ae-4021-a880-3015e268737e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:21.426407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3768e8d1-15ae-4021-a880-3015e268737e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:21.427323 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3768e8d1-15ae-4021-a880-3015e268737e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:21.438038 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3768e8d1-15ae-4021-a880-3015e268737e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:21.440477 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3768e8d1-15ae-4021-a880-3015e268737e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:21.809609 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-117e970d-cf36-4609-b6bf-271371cab90b tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:21.810501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-117e970d-cf36-4609-b6bf-271371cab90b tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] [instance: 243f03fb-acc7-4897-8c84-3bfc55b7d4d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:21.833272 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-117e970d-cf36-4609-b6bf-271371cab90b tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:21.833731 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-117e970d-cf36-4609-b6bf-271371cab90b tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:21.834574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-117e970d-cf36-4609-b6bf-271371cab90b tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:21.835018 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-117e970d-cf36-4609-b6bf-271371cab90b tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:22.133213 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-117e970d-cf36-4609-b6bf-271371cab90b tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5083b87804399a8bf17a6644710b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ce2bd463341d1b3e61041ee323c86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:22.154049 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-117e970d-cf36-4609-b6bf-271371cab90b tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] 10.222.0.49 "GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5" status: 200 len: 1490 microversion: 2.1 time: 0.343189 Jul 25 12:52:22.155885 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1490/2910] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:21 2022] GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5 => generated 1490 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:52:22.169412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3768e8d1-15ae-4021-a880-3015e268737e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:22.172157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ed9a020a-1100-43aa-982a-8330c73561da tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:22.178650 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ed9a020a-1100-43aa-982a-8330c73561da tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:22.188836 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3768e8d1-15ae-4021-a880-3015e268737e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1363 microversion: 2.1 time: 0.835671 Jul 25 12:52:22.189928 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1421/2911] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:21 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1363 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:22.200060 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-a149ca95-86fe-46e0-9d6d-5370128f2ca6 req-fd196f01-9bf5-42f1-a682-3eb05d209020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243f03fb-acc7-4897-8c84-3bfc55b7d4d5", "name": "network-vif-deleted", "tag": "e591ad0b-41d3-4e5e-b17c-97acbe4598c3"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:22.228721 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed9a020a-1100-43aa-982a-8330c73561da tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:22.229541 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed9a020a-1100-43aa-982a-8330c73561da tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:22.230997 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed9a020a-1100-43aa-982a-8330c73561da tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:22.231799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed9a020a-1100-43aa-982a-8330c73561da tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:22.232948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a149ca95-86fe-46e0-9d6d-5370128f2ca6 req-fd196f01-9bf5-42f1-a682-3eb05d209020 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:22.235490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a149ca95-86fe-46e0-9d6d-5370128f2ca6 req-fd196f01-9bf5-42f1-a682-3eb05d209020 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:22.519533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ed9a020a-1100-43aa-982a-8330c73561da tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:22.533725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ed9a020a-1100-43aa-982a-8330c73561da tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:22.542402 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ed9a020a-1100-43aa-982a-8330c73561da tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:22.547934 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ed9a020a-1100-43aa-982a-8330c73561da tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1593 microversion: 2.32 time: 0.387246 Jul 25 12:52:22.550836 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1491/2912] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:52:22 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1593 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:52:22.708269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6ee92704-655a-4c80-8dcb-d82457e0a693 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-506970958", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "0170cf46-54ce-4285-9d1e-0ac2ceffd980"}, {"uuid": "6498d466-bd28-412e-bd03-aef122e6887f"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:22.842422 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-a149ca95-86fe-46e0-9d6d-5370128f2ca6 req-fd196f01-9bf5-42f1-a682-3eb05d209020 service nova] Creating event network-vif-deleted:e591ad0b-41d3-4e5e-b17c-97acbe4598c3 for instance 243f03fb-acc7-4897-8c84-3bfc55b7d4d5 on n-h1-848886-15 Jul 25 12:52:22.849721 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-a149ca95-86fe-46e0-9d6d-5370128f2ca6 req-fd196f01-9bf5-42f1-a682-3eb05d209020 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.658132 Jul 25 12:52:22.854667 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1422/2913] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:22.887810 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-6ee92704-655a-4c80-8dcb-d82457e0a693 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] validate_networks() for [('0170cf46-54ce-4285-9d1e-0ac2ceffd980', None, None, None, None, None), ('6498d466-bd28-412e-bd03-aef122e6887f', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:52:23.197056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5adce73e-00f1-4016-9b1c-1eab072fd6a4 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:23.200751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5adce73e-00f1-4016-9b1c-1eab072fd6a4 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] [instance: 243f03fb-acc7-4897-8c84-3bfc55b7d4d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:23.228361 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5adce73e-00f1-4016-9b1c-1eab072fd6a4 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:23.229276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5adce73e-00f1-4016-9b1c-1eab072fd6a4 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:23.230862 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5adce73e-00f1-4016-9b1c-1eab072fd6a4 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:23.235974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5adce73e-00f1-4016-9b1c-1eab072fd6a4 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:23.375563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5adce73e-00f1-4016-9b1c-1eab072fd6a4 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:23.377305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5adce73e-00f1-4016-9b1c-1eab072fd6a4 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:23.378420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-5adce73e-00f1-4016-9b1c-1eab072fd6a4 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lazy-loading 'fault' on Instance uuid 243f03fb-acc7-4897-8c84-3bfc55b7d4d5 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:52:23.520417 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5adce73e-00f1-4016-9b1c-1eab072fd6a4 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5083b87804399a8bf17a6644710b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ce2bd463341d1b3e61041ee323c86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:23.526656 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:23.546953 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5adce73e-00f1-4016-9b1c-1eab072fd6a4 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] 10.222.0.49 "GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5" status: 200 len: 1317 microversion: 2.1 time: 0.363635 Jul 25 12:52:23.547581 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1423/2914] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:23 2022] GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5 => generated 1317 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:23.567804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0f0149af-ceaf-41fc-a1bb-e69e6d297ef1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:23.568727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0f0149af-ceaf-41fc-a1bb-e69e6d297ef1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:23.577011 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f0149af-ceaf-41fc-a1bb-e69e6d297ef1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:23.577739 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f0149af-ceaf-41fc-a1bb-e69e6d297ef1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:23.579217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f0149af-ceaf-41fc-a1bb-e69e6d297ef1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:23.580056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f0149af-ceaf-41fc-a1bb-e69e6d297ef1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:24.293382 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0f0149af-ceaf-41fc-a1bb-e69e6d297ef1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:24.307087 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0f0149af-ceaf-41fc-a1bb-e69e6d297ef1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1363 microversion: 2.1 time: 0.747860 Jul 25 12:52:24.328589 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1424/2915] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:23 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1363 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:24.338603 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-14203b51-5807-4da7-b15e-a2ee3849cdca tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a41a0c3f-5d73-480d-b2e8-a22a4c36d38f"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:24.343763 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-14203b51-5807-4da7-b15e-a2ee3849cdca tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 5d1a7907-1bc8-4e80-899e-996371552930] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:24.366158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14203b51-5807-4da7-b15e-a2ee3849cdca tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:24.366968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14203b51-5807-4da7-b15e-a2ee3849cdca tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:24.368904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14203b51-5807-4da7-b15e-a2ee3849cdca tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:24.369653 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14203b51-5807-4da7-b15e-a2ee3849cdca tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:24.980346 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-14203b51-5807-4da7-b15e-a2ee3849cdca tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "POST /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.652545 Jul 25 12:52:24.989579 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1425/2916] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Jul 25 12:52:24 2022] POST /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930/os-volume_attachments => generated 194 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:24.996400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3178c10a-1344-4015-84de-cfc5ebf645e7 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:24.997109 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3178c10a-1344-4015-84de-cfc5ebf645e7 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:25.015887 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3178c10a-1344-4015-84de-cfc5ebf645e7 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:25.017303 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3178c10a-1344-4015-84de-cfc5ebf645e7 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:25.018554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3178c10a-1344-4015-84de-cfc5ebf645e7 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:25.025640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3178c10a-1344-4015-84de-cfc5ebf645e7 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:25.227675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:25.282249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:25.582989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3178c10a-1344-4015-84de-cfc5ebf645e7 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:25.601447 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3178c10a-1344-4015-84de-cfc5ebf645e7 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:25.603312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3178c10a-1344-4015-84de-cfc5ebf645e7 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:25.606711 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3178c10a-1344-4015-84de-cfc5ebf645e7 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1660 microversion: 2.32 time: 0.623692 Jul 25 12:52:25.612268 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1426/2917] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:52:24 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1660 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:52:25.631608 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b371e11b-24b1-4b8c-922a-2b4eb03d57d7 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:25.632322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b371e11b-24b1-4b8c-922a-2b4eb03d57d7 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] [instance: 243f03fb-acc7-4897-8c84-3bfc55b7d4d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:25.641988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b371e11b-24b1-4b8c-922a-2b4eb03d57d7 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:25.642451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b371e11b-24b1-4b8c-922a-2b4eb03d57d7 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:25.643241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b371e11b-24b1-4b8c-922a-2b4eb03d57d7 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:25.643675 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b371e11b-24b1-4b8c-922a-2b4eb03d57d7 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:25.679052 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-b371e11b-24b1-4b8c-922a-2b4eb03d57d7 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] HTTP exception thrown: Instance 243f03fb-acc7-4897-8c84-3bfc55b7d4d5 could not be found. Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b371e11b-24b1-4b8c-922a-2b4eb03d57d7 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Request method failure captured: Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5 HTTP/1.1 Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pGytH6DiJMlAoHDMxwhtNgBnwO-C7C-hRmgJeglHW6GwOmzj0J80CNAHW-7cuW2LSf28avaROfNPL5LHp0D-u9EfQt1_hZ1lBTD6PlYvlKxTG-ZJVB1Sa_JqBbC5Pqz272KACYO1qidPNjS1QiyJ9WE8X3zQs-saeUeo_cGCGrsxVo Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 136ce2bd463341d1b3e61041ee323c86 Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1100671945 Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_136ce2bd463341d1b3e61041ee323c86", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/136ce2bd463341d1b3e61041ee323c86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/136ce2bd463341d1b3e61041ee323c86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/136ce2bd463341d1b3e61041ee323c86"}]}] Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1100671945 Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 136ce2bd463341d1b3e61041ee323c86 Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1100671945 Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1100671945-project Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 41b5083b87804399a8bf17a6644710b0 Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1100671945-project Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 243f03fb-acc7-4897-8c84-3bfc55b7d4d5 could not be found. Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '243f03fb-acc7-4897-8c84-3bfc55b7d4d5'} Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 243f03fb-acc7-4897-8c84-3bfc55b7d4d5 could not be found. Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 243f03fb-acc7-4897-8c84-3bfc55b7d4d5 could not be found. Jul 25 12:52:25.680784 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:25.687696 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:25.687696 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:25.687696 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:25.687696 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:25.687696 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:25.687696 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:52:25.687696 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:52:25.687696 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 243f03fb-acc7-4897-8c84-3bfc55b7d4d5 could not be found. Jul 25 12:52:25.687696 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:25.687696 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b371e11b-24b1-4b8c-922a-2b4eb03d57d7 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] Returning 404 to user: Instance 243f03fb-acc7-4897-8c84-3bfc55b7d4d5 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:52:25.688754 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b371e11b-24b1-4b8c-922a-2b4eb03d57d7 tempest-ServersNegativeTestMultiTenantJSON-1100671945 tempest-ServersNegativeTestMultiTenantJSON-1100671945-project] 10.222.0.49 "GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5" status: 404 len: 111 microversion: 2.1 time: 0.073861 Jul 25 12:52:25.693239 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1427/2918] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:25 2022] GET /compute/v2.1/servers/243f03fb-acc7-4897-8c84-3bfc55b7d4d5 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:52:25.706793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-15c9d0be-f85a-4d32-9002-0d4dc211c69d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:25.707688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-15c9d0be-f85a-4d32-9002-0d4dc211c69d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:25.737612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15c9d0be-f85a-4d32-9002-0d4dc211c69d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:25.738879 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15c9d0be-f85a-4d32-9002-0d4dc211c69d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:25.740255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15c9d0be-f85a-4d32-9002-0d4dc211c69d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:25.740650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15c9d0be-f85a-4d32-9002-0d4dc211c69d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:26.863134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-15c9d0be-f85a-4d32-9002-0d4dc211c69d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:26.875193 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-15c9d0be-f85a-4d32-9002-0d4dc211c69d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1363 microversion: 2.1 time: 1.184980 Jul 25 12:52:26.878753 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1428/2919] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:25 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1363 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:26.895256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-25bdcbc2-12d9-4d60-a9cc-23dca16e72cd tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:26.896452 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-25bdcbc2-12d9-4d60-a9cc-23dca16e72cd tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:26.906351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-25bdcbc2-12d9-4d60-a9cc-23dca16e72cd tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:26.909803 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-25bdcbc2-12d9-4d60-a9cc-23dca16e72cd tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:26.912048 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-25bdcbc2-12d9-4d60-a9cc-23dca16e72cd tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:26.914407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-25bdcbc2-12d9-4d60-a9cc-23dca16e72cd tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:27.330737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=16 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:27.665695 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-6ee92704-655a-4c80-8dcb-d82457e0a693 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:52:27.667013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-6ee92704-655a-4c80-8dcb-d82457e0a693 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:52:27.668153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-6ee92704-655a-4c80-8dcb-d82457e0a693 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:52:27.668977 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-6ee92704-655a-4c80-8dcb-d82457e0a693 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:52:27.670309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-6ee92704-655a-4c80-8dcb-d82457e0a693 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:52:27.707124 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ee92704-655a-4c80-8dcb-d82457e0a693 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:27.709013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ee92704-655a-4c80-8dcb-d82457e0a693 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:27.711160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ee92704-655a-4c80-8dcb-d82457e0a693 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:27.716424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ee92704-655a-4c80-8dcb-d82457e0a693 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:27.788613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-6ee92704-655a-4c80-8dcb-d82457e0a693 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Getting quotas for project af716a8b586d45b2aa95b8c73683ff0d. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:52:27.804591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-6ee92704-655a-4c80-8dcb-d82457e0a693 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Getting quotas for user f912ac6820e44b40977a2913a80c7bec and project af716a8b586d45b2aa95b8c73683ff0d. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:52:27.856823 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6ee92704-655a-4c80-8dcb-d82457e0a693 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:52:27.866396 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6ee92704-655a-4c80-8dcb-d82457e0a693 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:52:28.063505 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6ee92704-655a-4c80-8dcb-d82457e0a693 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.364160 Jul 25 12:52:28.065940 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1492/2920] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:52:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 5371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 12:52:28.088691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-4c1b924b-ea39-4f6a-83eb-bf49bae0f2a1 req-d196a7dd-be6f-47e7-9f59-9166b814e1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b730aecb-2c1f-46ef-b457-8a3717655518", "name": "network-vif-plugged", "status": "completed", "tag": "45191120-4204-4de7-9ef8-5d5c4ba83f89"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:28.119026 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4c1b924b-ea39-4f6a-83eb-bf49bae0f2a1 req-d196a7dd-be6f-47e7-9f59-9166b814e1e2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:28.119877 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4c1b924b-ea39-4f6a-83eb-bf49bae0f2a1 req-d196a7dd-be6f-47e7-9f59-9166b814e1e2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:28.190674 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-4c1b924b-ea39-4f6a-83eb-bf49bae0f2a1 req-d196a7dd-be6f-47e7-9f59-9166b814e1e2 service nova] Creating event network-vif-plugged:45191120-4204-4de7-9ef8-5d5c4ba83f89 for instance b730aecb-2c1f-46ef-b457-8a3717655518 on n-h1-848886-15 Jul 25 12:52:28.240778 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-4c1b924b-ea39-4f6a-83eb-bf49bae0f2a1 req-d196a7dd-be6f-47e7-9f59-9166b814e1e2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168081 Jul 25 12:52:28.243492 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1493/2921] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:28.244274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-25bdcbc2-12d9-4d60-a9cc-23dca16e72cd tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:28.267386 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1fb7a0ec-80bc-4112-a8c6-a0763902d710 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:28.277247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1fb7a0ec-80bc-4112-a8c6-a0763902d710 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:28.282946 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-25bdcbc2-12d9-4d60-a9cc-23dca16e72cd tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:28.284724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-25bdcbc2-12d9-4d60-a9cc-23dca16e72cd tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:28.286624 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-25bdcbc2-12d9-4d60-a9cc-23dca16e72cd tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1660 microversion: 2.32 time: 1.406165 Jul 25 12:52:28.287310 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1429/2922] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:52:26 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1660 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:52:28.305944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1fb7a0ec-80bc-4112-a8c6-a0763902d710 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:28.307374 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1fb7a0ec-80bc-4112-a8c6-a0763902d710 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:28.311234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1fb7a0ec-80bc-4112-a8c6-a0763902d710 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:28.313706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1fb7a0ec-80bc-4112-a8c6-a0763902d710 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:28.319090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2d2139db-e83f-4db3-8085-4ad0a89fdbba tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:28.320018 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2d2139db-e83f-4db3-8085-4ad0a89fdbba tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:28.823875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2d2139db-e83f-4db3-8085-4ad0a89fdbba tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:28.831903 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2d2139db-e83f-4db3-8085-4ad0a89fdbba tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1212 microversion: 2.1 time: 0.543263 Jul 25 12:52:28.838318 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1430/2923] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:28 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1212 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:29.312437 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c2f87902-6775-491d-94c5-c65c6ae6b0ac tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:29.313464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c2f87902-6775-491d-94c5-c65c6ae6b0ac tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:29.328243 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2f87902-6775-491d-94c5-c65c6ae6b0ac tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:29.328970 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2f87902-6775-491d-94c5-c65c6ae6b0ac tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:29.331111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2f87902-6775-491d-94c5-c65c6ae6b0ac tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:29.333492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2f87902-6775-491d-94c5-c65c6ae6b0ac tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:30.252689 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1fb7a0ec-80bc-4112-a8c6-a0763902d710 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:30.274841 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1fb7a0ec-80bc-4112-a8c6-a0763902d710 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1363 microversion: 2.1 time: 2.018548 Jul 25 12:52:30.275993 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1494/2924] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:28 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1363 bytes in 2030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:30.292135 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f166ac23-1999-4b91-9183-9ca400ff9276 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:30.293866 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f166ac23-1999-4b91-9183-9ca400ff9276 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:30.312294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f166ac23-1999-4b91-9183-9ca400ff9276 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:30.313558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f166ac23-1999-4b91-9183-9ca400ff9276 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:30.317976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f166ac23-1999-4b91-9183-9ca400ff9276 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:30.319116 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f166ac23-1999-4b91-9183-9ca400ff9276 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:30.569372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f166ac23-1999-4b91-9183-9ca400ff9276 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:30.592920 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f166ac23-1999-4b91-9183-9ca400ff9276 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1264 microversion: 2.1 time: 0.314733 Jul 25 12:52:30.593574 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1495/2925] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:30 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1264 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:30.631606 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c2f87902-6775-491d-94c5-c65c6ae6b0ac tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:30.657244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c2f87902-6775-491d-94c5-c65c6ae6b0ac tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:30.666676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c2f87902-6775-491d-94c5-c65c6ae6b0ac tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:30.675388 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c2f87902-6775-491d-94c5-c65c6ae6b0ac tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1706 microversion: 2.32 time: 1.365734 Jul 25 12:52:30.676131 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1431/2926] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:52:29 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1706 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:52:31.305460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-913b37bc-5224-47a3-841e-9204f06d2b95 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:31.307233 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-913b37bc-5224-47a3-841e-9204f06d2b95 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:31.326226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-913b37bc-5224-47a3-841e-9204f06d2b95 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:31.330020 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-913b37bc-5224-47a3-841e-9204f06d2b95 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:31.332641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-913b37bc-5224-47a3-841e-9204f06d2b95 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:31.334514 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-913b37bc-5224-47a3-841e-9204f06d2b95 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:31.625165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5cff4a5e-1779-4b4c-b76a-b8b5d7e14e2d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:31.633460 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5cff4a5e-1779-4b4c-b76a-b8b5d7e14e2d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:31.663517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cff4a5e-1779-4b4c-b76a-b8b5d7e14e2d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:31.665731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cff4a5e-1779-4b4c-b76a-b8b5d7e14e2d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:31.666969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cff4a5e-1779-4b4c-b76a-b8b5d7e14e2d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:31.671750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cff4a5e-1779-4b4c-b76a-b8b5d7e14e2d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:32.018863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5cff4a5e-1779-4b4c-b76a-b8b5d7e14e2d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:32.036438 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5cff4a5e-1779-4b4c-b76a-b8b5d7e14e2d tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1270 microversion: 2.1 time: 0.418611 Jul 25 12:52:32.041012 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1432/2927] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:31 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1270 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:32.059276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5827d1f1-11c5-4a6f-b89c-e76f00aa347e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:32.060652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5827d1f1-11c5-4a6f-b89c-e76f00aa347e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:32.077543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5827d1f1-11c5-4a6f-b89c-e76f00aa347e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:32.078654 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5827d1f1-11c5-4a6f-b89c-e76f00aa347e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:32.081451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5827d1f1-11c5-4a6f-b89c-e76f00aa347e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:32.088291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5827d1f1-11c5-4a6f-b89c-e76f00aa347e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:32.884090 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-913b37bc-5224-47a3-841e-9204f06d2b95 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:32.901289 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-913b37bc-5224-47a3-841e-9204f06d2b95 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1550 microversion: 2.1 time: 1.603921 Jul 25 12:52:32.901819 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1496/2928] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:31 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1550 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:32.944926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c58c1a66-cfea-4d10-b8e2-118710f74dcd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:32.945443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c58c1a66-cfea-4d10-b8e2-118710f74dcd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:32.979854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c58c1a66-cfea-4d10-b8e2-118710f74dcd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:32.980868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c58c1a66-cfea-4d10-b8e2-118710f74dcd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:32.981728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c58c1a66-cfea-4d10-b8e2-118710f74dcd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:32.982218 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c58c1a66-cfea-4d10-b8e2-118710f74dcd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:33.400744 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c58c1a66-cfea-4d10-b8e2-118710f74dcd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.460844 Jul 25 12:52:33.401550 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1497/2929] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 12:52:32 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/os-interface => generated 284 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:33.419965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ff4861e1-239b-4f07-a10f-3a810a5e4943 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:33.422249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ff4861e1-239b-4f07-a10f-3a810a5e4943 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:33.459520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff4861e1-239b-4f07-a10f-3a810a5e4943 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:33.460384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff4861e1-239b-4f07-a10f-3a810a5e4943 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:33.461420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff4861e1-239b-4f07-a10f-3a810a5e4943 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:33.463474 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff4861e1-239b-4f07-a10f-3a810a5e4943 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:33.635224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5827d1f1-11c5-4a6f-b89c-e76f00aa347e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:33.652568 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5827d1f1-11c5-4a6f-b89c-e76f00aa347e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:33.658888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5827d1f1-11c5-4a6f-b89c-e76f00aa347e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:33.662095 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5827d1f1-11c5-4a6f-b89c-e76f00aa347e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1706 microversion: 2.32 time: 1.618939 Jul 25 12:52:33.665505 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1433/2930] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:52:32 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1706 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:52:33.694061 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ff4861e1-239b-4f07-a10f-3a810a5e4943 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:33.705567 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ff4861e1-239b-4f07-a10f-3a810a5e4943 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1270 microversion: 2.1 time: 0.292286 Jul 25 12:52:33.715866 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1498/2931] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:33 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1270 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:34.715090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-01cc7ccc-b1b3-41da-86c7-214c536f226a tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:34.718922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-01cc7ccc-b1b3-41da-86c7-214c536f226a tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:34.739084 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01cc7ccc-b1b3-41da-86c7-214c536f226a tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:34.741276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01cc7ccc-b1b3-41da-86c7-214c536f226a tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:34.743057 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01cc7ccc-b1b3-41da-86c7-214c536f226a tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:34.744982 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01cc7ccc-b1b3-41da-86c7-214c536f226a tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:34.759802 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d6656e51-7685-4663-9d80-d21b10666d41 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:34.763580 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d6656e51-7685-4663-9d80-d21b10666d41 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:34.794342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d6656e51-7685-4663-9d80-d21b10666d41 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:34.795489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d6656e51-7685-4663-9d80-d21b10666d41 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:34.797320 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d6656e51-7685-4663-9d80-d21b10666d41 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:34.798441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d6656e51-7685-4663-9d80-d21b10666d41 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:35.052277 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d6656e51-7685-4663-9d80-d21b10666d41 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:35.069884 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d6656e51-7685-4663-9d80-d21b10666d41 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1270 microversion: 2.1 time: 0.321085 Jul 25 12:52:35.071391 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1499/2932] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:34 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1270 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:35.321256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-01cc7ccc-b1b3-41da-86c7-214c536f226a tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:35.347023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-01cc7ccc-b1b3-41da-86c7-214c536f226a tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:35.354662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-01cc7ccc-b1b3-41da-86c7-214c536f226a tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:35.360644 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-01cc7ccc-b1b3-41da-86c7-214c536f226a tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1706 microversion: 2.32 time: 0.652646 Jul 25 12:52:35.362397 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1434/2933] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:52:34 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1706 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:52:36.094841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5ec2fc67-2f8a-4ff5-b1dd-9317f7de65d4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:36.095955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5ec2fc67-2f8a-4ff5-b1dd-9317f7de65d4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:36.118873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5ec2fc67-2f8a-4ff5-b1dd-9317f7de65d4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:36.131099 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5ec2fc67-2f8a-4ff5-b1dd-9317f7de65d4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:36.132920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5ec2fc67-2f8a-4ff5-b1dd-9317f7de65d4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:36.139746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5ec2fc67-2f8a-4ff5-b1dd-9317f7de65d4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:36.424143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-329a291a-5b11-4524-a72d-de54907668b4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:36.431413 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-329a291a-5b11-4524-a72d-de54907668b4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:36.462075 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-329a291a-5b11-4524-a72d-de54907668b4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:36.462563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-329a291a-5b11-4524-a72d-de54907668b4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:36.463829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-329a291a-5b11-4524-a72d-de54907668b4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:36.464684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-329a291a-5b11-4524-a72d-de54907668b4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:36.854418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5ec2fc67-2f8a-4ff5-b1dd-9317f7de65d4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:36.883522 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5ec2fc67-2f8a-4ff5-b1dd-9317f7de65d4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1312 microversion: 2.1 time: 0.789839 Jul 25 12:52:36.900838 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1500/2934] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:36 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1312 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:37.019558 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-329a291a-5b11-4524-a72d-de54907668b4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:37.022441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cb8a4eb8-4ea5-453b-8110-4a183f5ad754 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] Calling method '.version_select at 0x7efcfed481f0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:37.057473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-329a291a-5b11-4524-a72d-de54907668b4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:37.067815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-329a291a-5b11-4524-a72d-de54907668b4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:37.073802 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-329a291a-5b11-4524-a72d-de54907668b4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1752 microversion: 2.32 time: 0.671136 Jul 25 12:52:37.078751 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1435/2935] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:52:36 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1752 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:52:37.220263 n-d-848886-15 devstack@n-api.service[125884]: DEBUG neutronclient.v2_0.client [None req-cb8a4eb8-4ea5-453b-8110-4a183f5ad754 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7e960f0b-a38d-45d7-a7b7-1b85f8fc16f0 does not exist", "detail": ""}} {{(pid=125884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:52:37.222290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.security_group_api [None req-cb8a4eb8-4ea5-453b-8110-4a183f5ad754 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] Neutron security group 7e960f0b-a38d-45d7-a7b7-1b85f8fc16f0 not found {{(pid=125884) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 12:52:37.223205 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-cb8a4eb8-4ea5-453b-8110-4a183f5ad754 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] HTTP exception thrown: Security group 7e960f0b-a38d-45d7-a7b7-1b85f8fc16f0 does not exist Jul 25 12:52:37.223205 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-a0dde2b5-4f79-4dc9-89ed-8c616e34b68c'] Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cb8a4eb8-4ea5-453b-8110-4a183f5ad754 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] Request method failure captured: Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/os-security-groups/7e960f0b-a38d-45d7-a7b7-1b85f8fc16f0 HTTP/1.1 Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pIUrVrNUOHFgL9JC4Qzsese_E_YErHvonwMyR1yzN85lyyosnnBLsAdkcbLKGXEt4juFJhBx0xLtDwQbaQ3LFHeq7CN3_c9qr3zl1UIxt_zclUpR6yY-jJBd0yA4v_bFBVNsUWvuoAS1NUcS-iRzuDJQ2kABZn0ko1zV_ughBiHBU0 Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: aebf3e11d8e3478eb03e0dab1aa4b932 Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-853692853 Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aebf3e11d8e3478eb03e0dab1aa4b932", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aebf3e11d8e3478eb03e0dab1aa4b932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aebf3e11d8e3478eb03e0dab1aa4b932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aebf3e11d8e3478eb03e0dab1aa4b932"}]}] Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-853692853 Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: aebf3e11d8e3478eb03e0dab1aa4b932 Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-853692853 Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-SecurityGroupsNegativeTestJSON-853692853-project Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: f71b54a40f534b11b7cae817351f83fb Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-853692853-project Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: exception: Security group 7e960f0b-a38d-45d7-a7b7-1b85f8fc16f0 does not exist Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-a0dde2b5-4f79-4dc9-89ed-8c616e34b68c'] Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '7e960f0b-a38d-45d7-a7b7-1b85f8fc16f0'} Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:52:37.227211 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7e960f0b-a38d-45d7-a7b7-1b85f8fc16f0 does not exist Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0dde2b5-4f79-4dc9-89ed-8c616e34b68c'] Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7e960f0b-a38d-45d7-a7b7-1b85f8fc16f0 does not exist Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0dde2b5-4f79-4dc9-89ed-8c616e34b68c'] Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7e960f0b-a38d-45d7-a7b7-1b85f8fc16f0 does not exist Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0dde2b5-4f79-4dc9-89ed-8c616e34b68c'] Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7e960f0b-a38d-45d7-a7b7-1b85f8fc16f0 does not exist Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0dde2b5-4f79-4dc9-89ed-8c616e34b68c'] Jul 25 12:52:37.233797 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:52:37.241076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cb8a4eb8-4ea5-453b-8110-4a183f5ad754 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] Returning 404 to user: Security group 7e960f0b-a38d-45d7-a7b7-1b85f8fc16f0 does not exist Jul 25 12:52:37.241076 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-a0dde2b5-4f79-4dc9-89ed-8c616e34b68c'] {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:52:37.242586 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cb8a4eb8-4ea5-453b-8110-4a183f5ad754 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/7e960f0b-a38d-45d7-a7b7-1b85f8fc16f0" status: 404 len: 194 microversion: 2.1 time: 0.329942 Jul 25 12:52:37.244119 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1501/2936] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:52:36 2022] DELETE /compute/v2.1/os-security-groups/7e960f0b-a38d-45d7-a7b7-1b85f8fc16f0 => generated 194 bytes in 343 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:52:37.256027 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f42d0a8a-cfe4-4a65-aa6e-d44771abdec7 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.006732 Jul 25 12:52:37.257193 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1436/2937] 10.222.0.49 () {58 vars in 1164 bytes} [Mon Jul 25 12:52:37 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 12:52:37.268603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9d75becf-6297-41b4-8b05-8d19ccbae170 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] Calling method '.version_select at 0x7efcf91364c0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:37.747549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:37.832784 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:37.927466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-25be8193-d0cf-4faa-95b1-2fee9832da57 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:37.932868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-25be8193-d0cf-4faa-95b1-2fee9832da57 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:37.979388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-25be8193-d0cf-4faa-95b1-2fee9832da57 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:37.991412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-25be8193-d0cf-4faa-95b1-2fee9832da57 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:37.999044 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-25be8193-d0cf-4faa-95b1-2fee9832da57 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:38.002294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-25be8193-d0cf-4faa-95b1-2fee9832da57 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:38.832178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:39.301357 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9d75becf-6297-41b4-8b05-8d19ccbae170 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 2.038467 Jul 25 12:52:39.302432 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1502/2938] 10.222.0.49 () {58 vars in 1158 bytes} [Mon Jul 25 12:52:37 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:39.307819 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a41f2899-51e6-4b72-a5c7-76ce589c83f6 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:39.308689 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a41f2899-51e6-4b72-a5c7-76ce589c83f6 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:39.327618 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a41f2899-51e6-4b72-a5c7-76ce589c83f6 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:39.328755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a41f2899-51e6-4b72-a5c7-76ce589c83f6 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:39.331797 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a41f2899-51e6-4b72-a5c7-76ce589c83f6 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:39.334412 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a41f2899-51e6-4b72-a5c7-76ce589c83f6 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:39.973815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a41f2899-51e6-4b72-a5c7-76ce589c83f6 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:40.013162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a41f2899-51e6-4b72-a5c7-76ce589c83f6 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:40.021974 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a41f2899-51e6-4b72-a5c7-76ce589c83f6 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:40.025270 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a41f2899-51e6-4b72-a5c7-76ce589c83f6 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1752 microversion: 2.32 time: 0.720956 Jul 25 12:52:40.031628 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1503/2939] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:52:39 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1752 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:52:40.041080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-25be8193-d0cf-4faa-95b1-2fee9832da57 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:40.067566 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-25be8193-d0cf-4faa-95b1-2fee9832da57 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1312 microversion: 2.1 time: 2.153285 Jul 25 12:52:40.076372 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1437/2940] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:37 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1312 bytes in 2164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:40.106960 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-35b3e509-5d41-448b-b965-556c25725136 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] Calling method '.version_select at 0x7efcfed48670>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:40.820166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG neutronclient.v2_0.client [None req-35b3e509-5d41-448b-b965-556c25725136 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=125884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:52:40.822803 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-35b3e509-5d41-448b-b965-556c25725136 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 25 12:52:40.822803 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-c393a029-f0e7-4983-8351-5a004a668191'] Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-35b3e509-5d41-448b-b965-556c25725136 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] Request method failure captured: Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/os-security-groups/7275a91e-7ce8-46a5-b962-9819ae5a2b3f HTTP/1.1 Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pIUrVrNUOHFgL9JC4Qzsese_E_YErHvonwMyR1yzN85lyyosnnBLsAdkcbLKGXEt4juFJhBx0xLtDwQbaQ3LFHeq7CN3_c9qr3zl1UIxt_zclUpR6yY-jJBd0yA4v_bFBVNsUWvuoAS1NUcS-iRzuDJQ2kABZn0ko1zV_ughBiHBU0 Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: aebf3e11d8e3478eb03e0dab1aa4b932 Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-853692853 Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aebf3e11d8e3478eb03e0dab1aa4b932", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aebf3e11d8e3478eb03e0dab1aa4b932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aebf3e11d8e3478eb03e0dab1aa4b932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aebf3e11d8e3478eb03e0dab1aa4b932"}]}] Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-853692853 Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: aebf3e11d8e3478eb03e0dab1aa4b932 Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-853692853 Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-SecurityGroupsNegativeTestJSON-853692853-project Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: f71b54a40f534b11b7cae817351f83fb Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-853692853-project Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: exception: Insufficient rights for removing default security group. Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-c393a029-f0e7-4983-8351-5a004a668191'] Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '7275a91e-7ce8-46a5-b962-9819ae5a2b3f'} Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:52:40.825691 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c393a029-f0e7-4983-8351-5a004a668191'] Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c393a029-f0e7-4983-8351-5a004a668191'] Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c393a029-f0e7-4983-8351-5a004a668191'] Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c393a029-f0e7-4983-8351-5a004a668191'] Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-35b3e509-5d41-448b-b965-556c25725136 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: Neutron server returns request_ids: ['req-c393a029-f0e7-4983-8351-5a004a668191'] {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-35b3e509-5d41-448b-b965-556c25725136 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/7275a91e-7ce8-46a5-b962-9819ae5a2b3f" status: 400 len: 182 microversion: 2.1 time: 0.779773 Jul 25 12:52:40.832699 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1504/2941] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:52:40 2022] DELETE /compute/v2.1/os-security-groups/7275a91e-7ce8-46a5-b962-9819ae5a2b3f => generated 182 bytes in 796 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:52:40.864697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9ad57dc3-09ed-45e7-bf7f-d75c8a4c53f3 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] Calling method '.version_select at 0x7efcf8f771f0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:41.062777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG neutronclient.v2_0.client [None req-9ad57dc3-09ed-45e7-bf7f-d75c8a4c53f3 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1b77aa85-4d96-43b5-ba83-a44e664ee365 does not exist", "detail": ""}} {{(pid=125883) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:52:41.065690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.security_group_api [None req-9ad57dc3-09ed-45e7-bf7f-d75c8a4c53f3 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] Neutron security group 1b77aa85-4d96-43b5-ba83-a44e664ee365 not found {{(pid=125883) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 12:52:41.066665 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-9ad57dc3-09ed-45e7-bf7f-d75c8a4c53f3 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] HTTP exception thrown: Security group 1b77aa85-4d96-43b5-ba83-a44e664ee365 does not exist Jul 25 12:52:41.066665 n-d-848886-15 devstack@n-api.service[125883]: Neutron server returns request_ids: ['req-cd93ad0e-b4b4-473d-869d-55bde17899d1'] Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9ad57dc3-09ed-45e7-bf7f-d75c8a4c53f3 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] Request method failure captured: Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-security-groups/1b77aa85-4d96-43b5-ba83-a44e664ee365 HTTP/1.1 Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pIUrVrNUOHFgL9JC4Qzsese_E_YErHvonwMyR1yzN85lyyosnnBLsAdkcbLKGXEt4juFJhBx0xLtDwQbaQ3LFHeq7CN3_c9qr3zl1UIxt_zclUpR6yY-jJBd0yA4v_bFBVNsUWvuoAS1NUcS-iRzuDJQ2kABZn0ko1zV_ughBiHBU0 Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: aebf3e11d8e3478eb03e0dab1aa4b932 Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-853692853 Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aebf3e11d8e3478eb03e0dab1aa4b932", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aebf3e11d8e3478eb03e0dab1aa4b932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aebf3e11d8e3478eb03e0dab1aa4b932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aebf3e11d8e3478eb03e0dab1aa4b932"}]}] Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-853692853 Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: aebf3e11d8e3478eb03e0dab1aa4b932 Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-853692853 Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-SecurityGroupsNegativeTestJSON-853692853-project Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: f71b54a40f534b11b7cae817351f83fb Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-853692853-project Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: exception: Security group 1b77aa85-4d96-43b5-ba83-a44e664ee365 does not exist Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: Neutron server returns request_ids: ['req-cd93ad0e-b4b4-473d-869d-55bde17899d1'] Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '1b77aa85-4d96-43b5-ba83-a44e664ee365'} Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:52:41.070401 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1b77aa85-4d96-43b5-ba83-a44e664ee365 does not exist Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd93ad0e-b4b4-473d-869d-55bde17899d1'] Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1b77aa85-4d96-43b5-ba83-a44e664ee365 does not exist Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd93ad0e-b4b4-473d-869d-55bde17899d1'] Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1b77aa85-4d96-43b5-ba83-a44e664ee365 does not exist Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd93ad0e-b4b4-473d-869d-55bde17899d1'] Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1b77aa85-4d96-43b5-ba83-a44e664ee365 does not exist Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd93ad0e-b4b4-473d-869d-55bde17899d1'] Jul 25 12:52:41.076464 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:41.085665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9ecfb3c0-ebf1-43eb-8409-28d54a455c47 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:41.085665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9ecfb3c0-ebf1-43eb-8409-28d54a455c47 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:41.087896 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9ad57dc3-09ed-45e7-bf7f-d75c8a4c53f3 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] Returning 404 to user: Security group 1b77aa85-4d96-43b5-ba83-a44e664ee365 does not exist Jul 25 12:52:41.087896 n-d-848886-15 devstack@n-api.service[125883]: Neutron server returns request_ids: ['req-cd93ad0e-b4b4-473d-869d-55bde17899d1'] {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:52:41.093302 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9ad57dc3-09ed-45e7-bf7f-d75c8a4c53f3 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/1b77aa85-4d96-43b5-ba83-a44e664ee365" status: 404 len: 194 microversion: 2.1 time: 0.231086 Jul 25 12:52:41.094408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ecfb3c0-ebf1-43eb-8409-28d54a455c47 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:41.094890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ecfb3c0-ebf1-43eb-8409-28d54a455c47 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:41.095458 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1438/2942] 10.222.0.49 () {58 vars in 1269 bytes} [Mon Jul 25 12:52:40 2022] GET /compute/v2.1/os-security-groups/1b77aa85-4d96-43b5-ba83-a44e664ee365 => generated 194 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:52:41.096411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ecfb3c0-ebf1-43eb-8409-28d54a455c47 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:41.100504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ecfb3c0-ebf1-43eb-8409-28d54a455c47 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:41.158015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=89 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:41.158978 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4d8deed8-7fec-469f-97e3-d8233f105051 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] Action: 'update', calling method: .version_select at 0x7efcf8c86ee0>, body: {"security_group": {"name": "tempest-sg-681557140", "description": "tempest-description-147136629"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:41.573298 n-d-848886-15 devstack@n-api.service[125883]: DEBUG neutronclient.v2_0.client [None req-4d8deed8-7fec-469f-97e3-d8233f105051 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8cc03c14-249c-4863-9c40-41252db36f36 does not exist", "detail": ""}} {{(pid=125883) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 12:52:41.574761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.security_group_api [None req-4d8deed8-7fec-469f-97e3-d8233f105051 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] Neutron security group 8cc03c14-249c-4863-9c40-41252db36f36 not found {{(pid=125883) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 12:52:41.575617 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-4d8deed8-7fec-469f-97e3-d8233f105051 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] HTTP exception thrown: Security group 8cc03c14-249c-4863-9c40-41252db36f36 does not exist Jul 25 12:52:41.575617 n-d-848886-15 devstack@n-api.service[125883]: Neutron server returns request_ids: ['req-f04a72c5-1f98-44a4-9a02-c6b00e1385a9'] Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4d8deed8-7fec-469f-97e3-d8233f105051 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] Request method failure captured: Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: request: PUT /compute/v2.1/os-security-groups/8cc03c14-249c-4863-9c40-41252db36f36 HTTP/1.1 Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 100 Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pIUrVrNUOHFgL9JC4Qzsese_E_YErHvonwMyR1yzN85lyyosnnBLsAdkcbLKGXEt4juFJhBx0xLtDwQbaQ3LFHeq7CN3_c9qr3zl1UIxt_zclUpR6yY-jJBd0yA4v_bFBVNsUWvuoAS1NUcS-iRzuDJQ2kABZn0ko1zV_ughBiHBU0 Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: aebf3e11d8e3478eb03e0dab1aa4b932 Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-853692853 Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aebf3e11d8e3478eb03e0dab1aa4b932", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aebf3e11d8e3478eb03e0dab1aa4b932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aebf3e11d8e3478eb03e0dab1aa4b932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aebf3e11d8e3478eb03e0dab1aa4b932"}]}] Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-853692853 Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: aebf3e11d8e3478eb03e0dab1aa4b932 Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-853692853 Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-SecurityGroupsNegativeTestJSON-853692853-project Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: f71b54a40f534b11b7cae817351f83fb Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-853692853-project Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: {"security_group": {"name": "tempest-sg-681557140", "description": "tempest-description-147136629"}} Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: exception: Security group 8cc03c14-249c-4863-9c40-41252db36f36 does not exist Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: Neutron server returns request_ids: ['req-f04a72c5-1f98-44a4-9a02-c6b00e1385a9'] Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '8cc03c14-249c-4863-9c40-41252db36f36', 'body': {'security_group': {'name': 'tempest-sg-681557140', 'description': 'tempest-description-147136629'}}} Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 12:52:41.579100 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8cc03c14-249c-4863-9c40-41252db36f36 does not exist Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f04a72c5-1f98-44a4-9a02-c6b00e1385a9'] Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8cc03c14-249c-4863-9c40-41252db36f36 does not exist Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f04a72c5-1f98-44a4-9a02-c6b00e1385a9'] Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8cc03c14-249c-4863-9c40-41252db36f36 does not exist Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f04a72c5-1f98-44a4-9a02-c6b00e1385a9'] Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8cc03c14-249c-4863-9c40-41252db36f36 does not exist Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f04a72c5-1f98-44a4-9a02-c6b00e1385a9'] Jul 25 12:52:41.585227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:52:41.596973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4d8deed8-7fec-469f-97e3-d8233f105051 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] Returning 404 to user: Security group 8cc03c14-249c-4863-9c40-41252db36f36 does not exist Jul 25 12:52:41.596973 n-d-848886-15 devstack@n-api.service[125883]: Neutron server returns request_ids: ['req-f04a72c5-1f98-44a4-9a02-c6b00e1385a9'] {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:52:41.596973 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4d8deed8-7fec-469f-97e3-d8233f105051 tempest-SecurityGroupsNegativeTestJSON-853692853 tempest-SecurityGroupsNegativeTestJSON-853692853-project] 10.222.0.49 "PUT /compute/v2.1/os-security-groups/8cc03c14-249c-4863-9c40-41252db36f36" status: 404 len: 194 microversion: 2.1 time: 0.487101 Jul 25 12:52:41.602719 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1439/2943] 10.222.0.49 () {60 vars in 1290 bytes} [Mon Jul 25 12:52:41 2022] PUT /compute/v2.1/os-security-groups/8cc03c14-249c-4863-9c40-41252db36f36 => generated 194 bytes in 498 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:52:41.621788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-30022ddf-25df-4e43-b1ba-a7fd0cdfde65 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:41.623177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-30022ddf-25df-4e43-b1ba-a7fd0cdfde65 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:41.646421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30022ddf-25df-4e43-b1ba-a7fd0cdfde65 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:41.647618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30022ddf-25df-4e43-b1ba-a7fd0cdfde65 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:41.651240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30022ddf-25df-4e43-b1ba-a7fd0cdfde65 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:41.655117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30022ddf-25df-4e43-b1ba-a7fd0cdfde65 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:41.829886 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9ecfb3c0-ebf1-43eb-8409-28d54a455c47 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:41.845203 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9ecfb3c0-ebf1-43eb-8409-28d54a455c47 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:41.854069 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9ecfb3c0-ebf1-43eb-8409-28d54a455c47 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:41.859255 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9ecfb3c0-ebf1-43eb-8409-28d54a455c47 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1752 microversion: 2.32 time: 0.786159 Jul 25 12:52:41.874459 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1505/2944] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:52:41 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1752 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:52:42.577628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-30022ddf-25df-4e43-b1ba-a7fd0cdfde65 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:42.602784 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-30022ddf-25df-4e43-b1ba-a7fd0cdfde65 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1333 microversion: 2.1 time: 0.997602 Jul 25 12:52:42.603883 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1440/2945] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:41 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1333 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:42.886281 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cb81db6d-78f1-4c86-a106-559c2ca7710b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:42.887093 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cb81db6d-78f1-4c86-a106-559c2ca7710b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:42.903847 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb81db6d-78f1-4c86-a106-559c2ca7710b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:42.905318 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb81db6d-78f1-4c86-a106-559c2ca7710b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:42.906853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb81db6d-78f1-4c86-a106-559c2ca7710b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:42.910249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb81db6d-78f1-4c86-a106-559c2ca7710b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:43.244083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cb81db6d-78f1-4c86-a106-559c2ca7710b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:43.277642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cb81db6d-78f1-4c86-a106-559c2ca7710b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:43.282141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cb81db6d-78f1-4c86-a106-559c2ca7710b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:43.286135 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cb81db6d-78f1-4c86-a106-559c2ca7710b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1798 microversion: 2.32 time: 0.403913 Jul 25 12:52:43.288258 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1506/2946] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:52:42 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1798 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:52:43.652733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d32b092e-7076-49ee-8e1a-86f901e65e73 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:43.656729 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d32b092e-7076-49ee-8e1a-86f901e65e73 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:43.686607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d32b092e-7076-49ee-8e1a-86f901e65e73 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:43.690120 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d32b092e-7076-49ee-8e1a-86f901e65e73 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:43.695193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d32b092e-7076-49ee-8e1a-86f901e65e73 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:43.696490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d32b092e-7076-49ee-8e1a-86f901e65e73 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:43.788112 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-73d08a39-d1d3-42e9-84c7-013c43f4c14a req-c641e2f3-3eae-493f-a70a-1299a3040f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b730aecb-2c1f-46ef-b457-8a3717655518", "tag": "45191120-4204-4de7-9ef8-5d5c4ba83f89"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:43.831561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-73d08a39-d1d3-42e9-84c7-013c43f4c14a req-c641e2f3-3eae-493f-a70a-1299a3040f36 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:43.834891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-73d08a39-d1d3-42e9-84c7-013c43f4c14a req-c641e2f3-3eae-493f-a70a-1299a3040f36 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:43.900968 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-73d08a39-d1d3-42e9-84c7-013c43f4c14a req-c641e2f3-3eae-493f-a70a-1299a3040f36 service nova] Creating event network-changed:45191120-4204-4de7-9ef8-5d5c4ba83f89 for instance b730aecb-2c1f-46ef-b457-8a3717655518 on n-h1-848886-15 Jul 25 12:52:43.922346 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-73d08a39-d1d3-42e9-84c7-013c43f4c14a req-c641e2f3-3eae-493f-a70a-1299a3040f36 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140049 Jul 25 12:52:43.924075 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1507/2947] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:44.315056 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-17b8ba45-cc25-4c41-84b1-dbbfa47d76cc tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:44.315922 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-17b8ba45-cc25-4c41-84b1-dbbfa47d76cc tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:44.349042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-17b8ba45-cc25-4c41-84b1-dbbfa47d76cc tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:44.350104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-17b8ba45-cc25-4c41-84b1-dbbfa47d76cc tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:44.354526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-17b8ba45-cc25-4c41-84b1-dbbfa47d76cc tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:44.358724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-17b8ba45-cc25-4c41-84b1-dbbfa47d76cc tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:44.438994 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d32b092e-7076-49ee-8e1a-86f901e65e73 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:44.453288 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d32b092e-7076-49ee-8e1a-86f901e65e73 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1333 microversion: 2.1 time: 0.811848 Jul 25 12:52:44.458289 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1441/2948] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:43 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1333 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:45.497426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c8bda341-cc13-4691-bb00-5cdac9693c6c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:45.502667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c8bda341-cc13-4691-bb00-5cdac9693c6c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:45.527581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8bda341-cc13-4691-bb00-5cdac9693c6c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:45.528276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8bda341-cc13-4691-bb00-5cdac9693c6c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:45.529384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8bda341-cc13-4691-bb00-5cdac9693c6c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:45.532117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8bda341-cc13-4691-bb00-5cdac9693c6c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:45.863488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-17b8ba45-cc25-4c41-84b1-dbbfa47d76cc tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:45.883519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-17b8ba45-cc25-4c41-84b1-dbbfa47d76cc tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:45.884843 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-17b8ba45-cc25-4c41-84b1-dbbfa47d76cc tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:45.886544 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-17b8ba45-cc25-4c41-84b1-dbbfa47d76cc tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1798 microversion: 2.32 time: 1.577810 Jul 25 12:52:45.887798 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1508/2949] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:52:44 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1798 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:52:46.479930 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c8bda341-cc13-4691-bb00-5cdac9693c6c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:46.492705 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c8bda341-cc13-4691-bb00-5cdac9693c6c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1333 microversion: 2.1 time: 1.007169 Jul 25 12:52:46.498272 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1442/2950] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:45 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1333 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:46.925806 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-051adc6a-a741-4095-8201-66e909fe084d tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:46.926591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-051adc6a-a741-4095-8201-66e909fe084d tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:46.929395 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:46.948738 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-051adc6a-a741-4095-8201-66e909fe084d tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:46.949823 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-051adc6a-a741-4095-8201-66e909fe084d tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:46.950999 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-051adc6a-a741-4095-8201-66e909fe084d tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:46.951661 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-051adc6a-a741-4095-8201-66e909fe084d tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:47.536264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9506202f-c365-4c41-a56b-9f785b9d8c25 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:47.538375 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9506202f-c365-4c41-a56b-9f785b9d8c25 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:47.551407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9506202f-c365-4c41-a56b-9f785b9d8c25 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:47.558901 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9506202f-c365-4c41-a56b-9f785b9d8c25 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:47.561857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9506202f-c365-4c41-a56b-9f785b9d8c25 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:47.562530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9506202f-c365-4c41-a56b-9f785b9d8c25 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:47.653079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-051adc6a-a741-4095-8201-66e909fe084d tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:47.677929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-051adc6a-a741-4095-8201-66e909fe084d tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:47.680048 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-051adc6a-a741-4095-8201-66e909fe084d tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:47.692552 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-051adc6a-a741-4095-8201-66e909fe084d tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1798 microversion: 2.32 time: 0.770719 Jul 25 12:52:47.704828 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1509/2951] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:52:46 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1798 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:52:47.710143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-8b084d99-5474-4382-b33f-ef3cae0f211d req-8f7ccbba-a05a-49c9-9bad-0e6d0569c8bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b36eb09-434c-4516-8ea0-7d92019b492f", "tag": "53ae9464-640c-4f36-8331-4b91de240827"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:47.739032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-8b084d99-5474-4382-b33f-ef3cae0f211d req-8f7ccbba-a05a-49c9-9bad-0e6d0569c8bc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:47.744579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-8b084d99-5474-4382-b33f-ef3cae0f211d req-8f7ccbba-a05a-49c9-9bad-0e6d0569c8bc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:47.799154 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-8b084d99-5474-4382-b33f-ef3cae0f211d req-8f7ccbba-a05a-49c9-9bad-0e6d0569c8bc service nova] Creating event network-changed:53ae9464-640c-4f36-8331-4b91de240827 for instance 4b36eb09-434c-4516-8ea0-7d92019b492f on n-h1-848886-15 Jul 25 12:52:47.817785 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-8b084d99-5474-4382-b33f-ef3cae0f211d req-8f7ccbba-a05a-49c9-9bad-0e6d0569c8bc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110889 Jul 25 12:52:47.819974 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1510/2952] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:48.388711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8513fb51-796c-42b5-bdcf-18c0d7b7dd25 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:48.389819 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8513fb51-796c-42b5-bdcf-18c0d7b7dd25 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 5d1a7907-1bc8-4e80-899e-996371552930] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:48.412643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8513fb51-796c-42b5-bdcf-18c0d7b7dd25 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:48.429194 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8513fb51-796c-42b5-bdcf-18c0d7b7dd25 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:48.430865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8513fb51-796c-42b5-bdcf-18c0d7b7dd25 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:48.431698 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8513fb51-796c-42b5-bdcf-18c0d7b7dd25 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:48.544937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8513fb51-796c-42b5-bdcf-18c0d7b7dd25 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 5d1a7907-1bc8-4e80-899e-996371552930] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:52:48.787566 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8513fb51-796c-42b5-bdcf-18c0d7b7dd25 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930" status: 204 len: 0 microversion: 2.1 time: 0.408690 Jul 25 12:52:48.789085 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1511/2953] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:52:48 2022] DELETE /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:52:48.797050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a460c440-fd73-404f-b08a-9f4053f4193c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:48.799122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a460c440-fd73-404f-b08a-9f4053f4193c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:48.810261 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a460c440-fd73-404f-b08a-9f4053f4193c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:48.811330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a460c440-fd73-404f-b08a-9f4053f4193c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:48.812937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a460c440-fd73-404f-b08a-9f4053f4193c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:48.814183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a460c440-fd73-404f-b08a-9f4053f4193c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:49.959608 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9506202f-c365-4c41-a56b-9f785b9d8c25 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:49.962694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:49.971972 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9506202f-c365-4c41-a56b-9f785b9d8c25 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1333 microversion: 2.1 time: 2.439721 Jul 25 12:52:49.982356 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1443/2954] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:47 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1333 bytes in 2451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:49.996200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-77950311-a5b9-4542-a42d-fd8fafe63400 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:49.998398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-77950311-a5b9-4542-a42d-fd8fafe63400 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 5d1a7907-1bc8-4e80-899e-996371552930] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:50.026283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=48 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:50.028454 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77950311-a5b9-4542-a42d-fd8fafe63400 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:50.029220 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77950311-a5b9-4542-a42d-fd8fafe63400 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:50.030378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77950311-a5b9-4542-a42d-fd8fafe63400 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:50.030986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77950311-a5b9-4542-a42d-fd8fafe63400 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:50.612527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a460c440-fd73-404f-b08a-9f4053f4193c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:50.647811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a460c440-fd73-404f-b08a-9f4053f4193c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:50.651961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a460c440-fd73-404f-b08a-9f4053f4193c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:50.654120 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a460c440-fd73-404f-b08a-9f4053f4193c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1844 microversion: 2.32 time: 1.862604 Jul 25 12:52:50.655848 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1512/2955] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:52:48 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1844 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:52:50.666366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-e4090c89-f648-4ffb-bdbb-20eccd933396 req-3e991cd6-1a28-4527-a31d-40e5d8a95710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b36eb09-434c-4516-8ea0-7d92019b492f", "tag": "5d2ec979-cc43-4d59-a048-c56ae1ccf36e"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:50.688229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e4090c89-f648-4ffb-bdbb-20eccd933396 req-3e991cd6-1a28-4527-a31d-40e5d8a95710 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:50.689105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e4090c89-f648-4ffb-bdbb-20eccd933396 req-3e991cd6-1a28-4527-a31d-40e5d8a95710 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:50.708775 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-e4090c89-f648-4ffb-bdbb-20eccd933396 req-3e991cd6-1a28-4527-a31d-40e5d8a95710 service nova] Creating event network-changed:5d2ec979-cc43-4d59-a048-c56ae1ccf36e for instance 4b36eb09-434c-4516-8ea0-7d92019b492f on n-h1-848886-15 Jul 25 12:52:50.716539 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-e4090c89-f648-4ffb-bdbb-20eccd933396 req-3e991cd6-1a28-4527-a31d-40e5d8a95710 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057233 Jul 25 12:52:50.717582 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1513/2956] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:51.016437 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-57d770db-8460-44f8-9510-1d1150202eec tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:51.018633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-57d770db-8460-44f8-9510-1d1150202eec tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:51.032933 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57d770db-8460-44f8-9510-1d1150202eec tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:51.055184 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57d770db-8460-44f8-9510-1d1150202eec tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:51.059144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57d770db-8460-44f8-9510-1d1150202eec tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:51.061259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57d770db-8460-44f8-9510-1d1150202eec tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:51.296986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-77950311-a5b9-4542-a42d-fd8fafe63400 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:51.326486 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-77950311-a5b9-4542-a42d-fd8fafe63400 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930" status: 200 len: 1553 microversion: 2.1 time: 1.342229 Jul 25 12:52:51.331813 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1444/2957] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:49 2022] GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930 => generated 1553 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:51.700854 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-43d042fb-1b4f-434a-8281-040d1cd034e7 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:51.702507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-43d042fb-1b4f-434a-8281-040d1cd034e7 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:51.726385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43d042fb-1b4f-434a-8281-040d1cd034e7 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:51.731202 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43d042fb-1b4f-434a-8281-040d1cd034e7 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:51.732564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43d042fb-1b4f-434a-8281-040d1cd034e7 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:51.739685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43d042fb-1b4f-434a-8281-040d1cd034e7 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:52.616116 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-57d770db-8460-44f8-9510-1d1150202eec tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:52.625300 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-57d770db-8460-44f8-9510-1d1150202eec tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1333 microversion: 2.1 time: 1.620425 Jul 25 12:52:52.631460 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1514/2958] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:51 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1333 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:52:52.649331 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-69c8cedb-5ed6-4d6d-b34e-a9642c2439ed tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:52.650417 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-69c8cedb-5ed6-4d6d-b34e-a9642c2439ed tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 5d1a7907-1bc8-4e80-899e-996371552930] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:52.667999 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-69c8cedb-5ed6-4d6d-b34e-a9642c2439ed tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:52.668871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-69c8cedb-5ed6-4d6d-b34e-a9642c2439ed tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:52.670051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-69c8cedb-5ed6-4d6d-b34e-a9642c2439ed tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:52.670747 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-69c8cedb-5ed6-4d6d-b34e-a9642c2439ed tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:53.515183 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-43d042fb-1b4f-434a-8281-040d1cd034e7 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:53.558504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-43d042fb-1b4f-434a-8281-040d1cd034e7 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:53.560538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-43d042fb-1b4f-434a-8281-040d1cd034e7 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:53.566521 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-43d042fb-1b4f-434a-8281-040d1cd034e7 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1844 microversion: 2.32 time: 1.874083 Jul 25 12:52:53.567160 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1445/2959] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:52:51 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1844 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:52:53.681190 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1f39465a-1304-4487-bb0b-46a0c61885ca tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:53.682250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1f39465a-1304-4487-bb0b-46a0c61885ca tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:53.704520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1f39465a-1304-4487-bb0b-46a0c61885ca tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:53.706477 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1f39465a-1304-4487-bb0b-46a0c61885ca tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:53.710188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1f39465a-1304-4487-bb0b-46a0c61885ca tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:53.711014 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1f39465a-1304-4487-bb0b-46a0c61885ca tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:54.133053 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-69c8cedb-5ed6-4d6d-b34e-a9642c2439ed tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:54.153438 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-69c8cedb-5ed6-4d6d-b34e-a9642c2439ed tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930" status: 200 len: 1553 microversion: 2.1 time: 1.519116 Jul 25 12:52:54.154455 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1515/2960] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:52 2022] GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930 => generated 1553 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:54.620054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1f39465a-1304-4487-bb0b-46a0c61885ca tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:54.625185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7433933c-5934-4078-a921-1a229a8109a8 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:54.628318 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7433933c-5934-4078-a921-1a229a8109a8 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:54.644764 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1f39465a-1304-4487-bb0b-46a0c61885ca tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1333 microversion: 2.1 time: 0.976831 Jul 25 12:52:54.652435 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7433933c-5934-4078-a921-1a229a8109a8 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:54.654157 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1446/2961] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:53 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1333 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:54.660732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7433933c-5934-4078-a921-1a229a8109a8 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:54.661863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7433933c-5934-4078-a921-1a229a8109a8 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:54.662351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7433933c-5934-4078-a921-1a229a8109a8 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:55.148406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-e72b668f-bccf-4eed-973c-379753d198c3 req-3ab12b45-16b8-400b-be62-c0cd0b0d1b38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "tag": "0cd19a7b-cc4c-4db9-a5bb-5479206d7d43"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:55.201677 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e72b668f-bccf-4eed-973c-379753d198c3 req-3ab12b45-16b8-400b-be62-c0cd0b0d1b38 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:55.203897 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e72b668f-bccf-4eed-973c-379753d198c3 req-3ab12b45-16b8-400b-be62-c0cd0b0d1b38 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:55.223913 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-e72b668f-bccf-4eed-973c-379753d198c3 req-3ab12b45-16b8-400b-be62-c0cd0b0d1b38 service nova] Creating event network-changed:0cd19a7b-cc4c-4db9-a5bb-5479206d7d43 for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:52:55.244229 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-e72b668f-bccf-4eed-973c-379753d198c3 req-3ab12b45-16b8-400b-be62-c0cd0b0d1b38 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102795 Jul 25 12:52:55.245658 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1447/2962] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:55.300170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-18d206a9-2844-44df-9c2b-807804bcd39e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:55.301148 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-18d206a9-2844-44df-9c2b-807804bcd39e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 5d1a7907-1bc8-4e80-899e-996371552930] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:55.339560 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18d206a9-2844-44df-9c2b-807804bcd39e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:55.340095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18d206a9-2844-44df-9c2b-807804bcd39e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:55.341185 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18d206a9-2844-44df-9c2b-807804bcd39e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:55.341680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18d206a9-2844-44df-9c2b-807804bcd39e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:55.796255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-18d206a9-2844-44df-9c2b-807804bcd39e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:55.809378 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-18d206a9-2844-44df-9c2b-807804bcd39e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930" status: 200 len: 1511 microversion: 2.1 time: 0.536202 Jul 25 12:52:55.810034 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1448/2963] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:55 2022] GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930 => generated 1511 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:55.836987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-88bed82d-5db2-4283-820a-595a62b8db1a req-be8a24a8-3d1f-498f-a76c-9406cff44d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d1a7907-1bc8-4e80-899e-996371552930", "name": "network-vif-deleted", "tag": "3bf5c082-0de4-4092-9175-c9abca2ebe5d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:55.859132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-88bed82d-5db2-4283-820a-595a62b8db1a req-be8a24a8-3d1f-498f-a76c-9406cff44d25 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:55.862397 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-88bed82d-5db2-4283-820a-595a62b8db1a req-be8a24a8-3d1f-498f-a76c-9406cff44d25 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:55.877250 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-88bed82d-5db2-4283-820a-595a62b8db1a req-be8a24a8-3d1f-498f-a76c-9406cff44d25 service nova] Creating event network-vif-deleted:3bf5c082-0de4-4092-9175-c9abca2ebe5d for instance 5d1a7907-1bc8-4e80-899e-996371552930 on n-h2-848886-15 Jul 25 12:52:55.886465 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-88bed82d-5db2-4283-820a-595a62b8db1a req-be8a24a8-3d1f-498f-a76c-9406cff44d25 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058050 Jul 25 12:52:55.888295 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1449/2964] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:55.898810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fc1fc500-5b36-4782-8437-c21cf1991b1c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:55.900269 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fc1fc500-5b36-4782-8437-c21cf1991b1c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:55.921288 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fc1fc500-5b36-4782-8437-c21cf1991b1c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:55.921764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fc1fc500-5b36-4782-8437-c21cf1991b1c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:55.922680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fc1fc500-5b36-4782-8437-c21cf1991b1c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:55.923135 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fc1fc500-5b36-4782-8437-c21cf1991b1c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:56.144449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7433933c-5934-4078-a921-1a229a8109a8 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:56.166794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7433933c-5934-4078-a921-1a229a8109a8 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:56.171136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7433933c-5934-4078-a921-1a229a8109a8 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:56.173489 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7433933c-5934-4078-a921-1a229a8109a8 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1844 microversion: 2.32 time: 1.560225 Jul 25 12:52:56.175327 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1516/2965] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:52:54 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1844 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:52:56.587652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fc1fc500-5b36-4782-8437-c21cf1991b1c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:56.602347 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fc1fc500-5b36-4782-8437-c21cf1991b1c tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1333 microversion: 2.1 time: 0.709306 Jul 25 12:52:56.603327 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1450/2966] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:55 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1333 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:56.832883 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f91e0b45-bc29-4d28-bfe1-a1365959f957 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:56.833525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f91e0b45-bc29-4d28-bfe1-a1365959f957 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 5d1a7907-1bc8-4e80-899e-996371552930] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:56.849870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f91e0b45-bc29-4d28-bfe1-a1365959f957 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:56.855198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f91e0b45-bc29-4d28-bfe1-a1365959f957 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:56.857435 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f91e0b45-bc29-4d28-bfe1-a1365959f957 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:56.863528 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f91e0b45-bc29-4d28-bfe1-a1365959f957 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:57.137693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f91e0b45-bc29-4d28-bfe1-a1365959f957 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:57.152665 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f91e0b45-bc29-4d28-bfe1-a1365959f957 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930" status: 200 len: 1345 microversion: 2.1 time: 0.324371 Jul 25 12:52:57.154318 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1517/2967] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:56 2022] GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930 => generated 1345 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:57.207028 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-31eb9fb8-1e30-459a-a8d8-2f19e5d7229b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:57.209136 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-31eb9fb8-1e30-459a-a8d8-2f19e5d7229b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:57.226274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31eb9fb8-1e30-459a-a8d8-2f19e5d7229b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:57.226835 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31eb9fb8-1e30-459a-a8d8-2f19e5d7229b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:57.228100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31eb9fb8-1e30-459a-a8d8-2f19e5d7229b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:57.228611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31eb9fb8-1e30-459a-a8d8-2f19e5d7229b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:57.631663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e81860ab-d454-4366-a78a-fe173375c136 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:57.632578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e81860ab-d454-4366-a78a-fe173375c136 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:57.656811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e81860ab-d454-4366-a78a-fe173375c136 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:57.658305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e81860ab-d454-4366-a78a-fe173375c136 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:57.659374 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e81860ab-d454-4366-a78a-fe173375c136 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:57.662247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e81860ab-d454-4366-a78a-fe173375c136 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:58.857480 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e81860ab-d454-4366-a78a-fe173375c136 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:58.874312 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e81860ab-d454-4366-a78a-fe173375c136 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1333 microversion: 2.1 time: 1.251564 Jul 25 12:52:58.875743 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1518/2968] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:57 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1333 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:58.886747 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-647345e6-da08-4397-8f5f-90cefdb0c711 req-fb973a23-4495-4ec5-be45-1820ac6f5e5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "tag": "67565573-06d3-4bd8-a854-6237f54f8350"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:58.921185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-647345e6-da08-4397-8f5f-90cefdb0c711 req-fb973a23-4495-4ec5-be45-1820ac6f5e5e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:58.921963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-647345e6-da08-4397-8f5f-90cefdb0c711 req-fb973a23-4495-4ec5-be45-1820ac6f5e5e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:58.943617 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-647345e6-da08-4397-8f5f-90cefdb0c711 req-fb973a23-4495-4ec5-be45-1820ac6f5e5e service nova] Creating event network-changed:67565573-06d3-4bd8-a854-6237f54f8350 for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:52:58.955976 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-647345e6-da08-4397-8f5f-90cefdb0c711 req-fb973a23-4495-4ec5-be45-1820ac6f5e5e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078608 Jul 25 12:52:58.960697 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1519/2969] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:58.971847 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2f9e74bf-4315-4299-a421-5f82e855c15c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:58.974590 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2f9e74bf-4315-4299-a421-5f82e855c15c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 5d1a7907-1bc8-4e80-899e-996371552930] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:58.994511 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2f9e74bf-4315-4299-a421-5f82e855c15c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:58.995309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2f9e74bf-4315-4299-a421-5f82e855c15c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:58.997212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2f9e74bf-4315-4299-a421-5f82e855c15c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:58.998019 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2f9e74bf-4315-4299-a421-5f82e855c15c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:59.105351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-31eb9fb8-1e30-459a-a8d8-2f19e5d7229b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:59.137511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-31eb9fb8-1e30-459a-a8d8-2f19e5d7229b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:59.139939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-31eb9fb8-1e30-459a-a8d8-2f19e5d7229b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:59.153157 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-31eb9fb8-1e30-459a-a8d8-2f19e5d7229b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1865 microversion: 2.32 time: 1.939177 Jul 25 12:52:59.155217 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1451/2970] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:52:57 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1865 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:52:59.365297 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2f9e74bf-4315-4299-a421-5f82e855c15c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:59.382577 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2f9e74bf-4315-4299-a421-5f82e855c15c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930" status: 200 len: 1345 microversion: 2.1 time: 0.415193 Jul 25 12:52:59.393971 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1520/2971] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:58 2022] GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930 => generated 1345 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:59.905581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c0c6cadc-b430-45c8-869c-4879d512cadd tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:59.906418 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c0c6cadc-b430-45c8-869c-4879d512cadd tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:59.919302 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0c6cadc-b430-45c8-869c-4879d512cadd tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:59.920560 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0c6cadc-b430-45c8-869c-4879d512cadd tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:59.921618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0c6cadc-b430-45c8-869c-4879d512cadd tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:59.922367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0c6cadc-b430-45c8-869c-4879d512cadd tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:00.184718 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-99b84c81-1db0-40e7-b864-246a3677be69 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:00.186271 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-99b84c81-1db0-40e7-b864-246a3677be69 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:00.200106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-99b84c81-1db0-40e7-b864-246a3677be69 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:00.202261 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-99b84c81-1db0-40e7-b864-246a3677be69 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:00.204556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-99b84c81-1db0-40e7-b864-246a3677be69 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:00.205619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-99b84c81-1db0-40e7-b864-246a3677be69 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:01.991423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c0c6cadc-b430-45c8-869c-4879d512cadd tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:02.028386 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c0c6cadc-b430-45c8-869c-4879d512cadd tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1333 microversion: 2.1 time: 2.130547 Jul 25 12:53:02.035278 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1452/2972] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:59 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1333 bytes in 2139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:02.058853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f42d7ade-bb37-45fd-9cb3-4d1abb7671d6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:02.059216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-99b84c81-1db0-40e7-b864-246a3677be69 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:02.063783 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f42d7ade-bb37-45fd-9cb3-4d1abb7671d6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 5d1a7907-1bc8-4e80-899e-996371552930] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:02.076316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f42d7ade-bb37-45fd-9cb3-4d1abb7671d6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:02.079402 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f42d7ade-bb37-45fd-9cb3-4d1abb7671d6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:02.080431 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-99b84c81-1db0-40e7-b864-246a3677be69 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:02.081433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f42d7ade-bb37-45fd-9cb3-4d1abb7671d6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:02.082578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f42d7ade-bb37-45fd-9cb3-4d1abb7671d6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:02.083934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-99b84c81-1db0-40e7-b864-246a3677be69 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:02.086689 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-99b84c81-1db0-40e7-b864-246a3677be69 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1865 microversion: 2.32 time: 1.908968 Jul 25 12:53:02.089281 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1521/2973] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:53:00 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1865 bytes in 1912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:53:02.103317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-402c51d8-0d6a-40fd-8357-504370bb03c9 req-b6924be6-9280-43e0-86e0-849fc0c53bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b36eb09-434c-4516-8ea0-7d92019b492f", "name": "network-vif-plugged", "status": "completed", "tag": "53ae9464-640c-4f36-8331-4b91de240827"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:02.150035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-402c51d8-0d6a-40fd-8357-504370bb03c9 req-b6924be6-9280-43e0-86e0-849fc0c53bc2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:02.152527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-402c51d8-0d6a-40fd-8357-504370bb03c9 req-b6924be6-9280-43e0-86e0-849fc0c53bc2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:02.197012 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-402c51d8-0d6a-40fd-8357-504370bb03c9 req-b6924be6-9280-43e0-86e0-849fc0c53bc2 service nova] Creating event network-vif-plugged:53ae9464-640c-4f36-8331-4b91de240827 for instance 4b36eb09-434c-4516-8ea0-7d92019b492f on n-h1-848886-15 Jul 25 12:53:02.204578 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-402c51d8-0d6a-40fd-8357-504370bb03c9 req-b6924be6-9280-43e0-86e0-849fc0c53bc2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112998 Jul 25 12:53:02.208931 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1522/2974] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:02.220267 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-9e41e60f-b5d2-4183-ae3e-60b0433e319c req-28bcbd62-e10a-4f0c-848e-fa444f285648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "tag": "b1c8f2ac-436f-43bd-80a5-4182aa87ee56"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:02.236610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9e41e60f-b5d2-4183-ae3e-60b0433e319c req-28bcbd62-e10a-4f0c-848e-fa444f285648 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:02.237068 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9e41e60f-b5d2-4183-ae3e-60b0433e319c req-28bcbd62-e10a-4f0c-848e-fa444f285648 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:02.257810 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-9e41e60f-b5d2-4183-ae3e-60b0433e319c req-28bcbd62-e10a-4f0c-848e-fa444f285648 service nova] Creating event network-changed:b1c8f2ac-436f-43bd-80a5-4182aa87ee56 for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:53:02.274722 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-9e41e60f-b5d2-4183-ae3e-60b0433e319c req-28bcbd62-e10a-4f0c-848e-fa444f285648 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063473 Jul 25 12:53:02.275811 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1523/2975] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:02.551038 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f42d7ade-bb37-45fd-9cb3-4d1abb7671d6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:02.567938 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f42d7ade-bb37-45fd-9cb3-4d1abb7671d6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930" status: 200 len: 1345 microversion: 2.1 time: 0.530854 Jul 25 12:53:02.568543 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1453/2976] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:02 2022] GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930 => generated 1345 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:03.057417 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b92c87fb-56c4-4194-956f-1de28326bad3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:03.058506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b92c87fb-56c4-4194-956f-1de28326bad3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:03.078724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b92c87fb-56c4-4194-956f-1de28326bad3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:03.079506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b92c87fb-56c4-4194-956f-1de28326bad3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:03.083543 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b92c87fb-56c4-4194-956f-1de28326bad3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:03.086552 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b92c87fb-56c4-4194-956f-1de28326bad3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:03.115982 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4411f3be-e360-4b9e-908c-9b2758a2d7a6 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:03.117049 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4411f3be-e360-4b9e-908c-9b2758a2d7a6 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:03.142492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4411f3be-e360-4b9e-908c-9b2758a2d7a6 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:03.150084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:03.152119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4411f3be-e360-4b9e-908c-9b2758a2d7a6 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:03.153446 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4411f3be-e360-4b9e-908c-9b2758a2d7a6 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:03.154292 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4411f3be-e360-4b9e-908c-9b2758a2d7a6 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:03.811144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b92c87fb-56c4-4194-956f-1de28326bad3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:03.829741 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b92c87fb-56c4-4194-956f-1de28326bad3 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1333 microversion: 2.1 time: 0.777115 Jul 25 12:53:03.846766 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1524/2977] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:03 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1333 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:53:03.858034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-07d074b3-aa37-449d-b703-44fc9ec72d35 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:03.859544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-07d074b3-aa37-449d-b703-44fc9ec72d35 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 5d1a7907-1bc8-4e80-899e-996371552930] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:03.867585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07d074b3-aa37-449d-b703-44fc9ec72d35 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:03.868388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07d074b3-aa37-449d-b703-44fc9ec72d35 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:03.869957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07d074b3-aa37-449d-b703-44fc9ec72d35 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:03.870678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07d074b3-aa37-449d-b703-44fc9ec72d35 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:04.025257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-07d074b3-aa37-449d-b703-44fc9ec72d35 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:04.042846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4411f3be-e360-4b9e-908c-9b2758a2d7a6 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:04.054320 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-07d074b3-aa37-449d-b703-44fc9ec72d35 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930" status: 200 len: 1345 microversion: 2.1 time: 0.201776 Jul 25 12:53:04.057953 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1525/2978] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:03 2022] GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930 => generated 1345 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:04.072093 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4411f3be-e360-4b9e-908c-9b2758a2d7a6 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:04.073802 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4411f3be-e360-4b9e-908c-9b2758a2d7a6 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:04.077536 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4411f3be-e360-4b9e-908c-9b2758a2d7a6 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1886 microversion: 2.32 time: 0.965969 Jul 25 12:53:04.087159 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1454/2979] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:53:03 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1886 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:53:04.240248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-fdd01ee3-5087-407e-a5fa-0c0fe63e71c1 req-b90f4577-b5b9-4877-a7b2-f79d2db735ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b36eb09-434c-4516-8ea0-7d92019b492f", "name": "network-vif-plugged", "status": "completed", "tag": "5d2ec979-cc43-4d59-a048-c56ae1ccf36e"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:04.277648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fdd01ee3-5087-407e-a5fa-0c0fe63e71c1 req-b90f4577-b5b9-4877-a7b2-f79d2db735ad service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:04.283017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fdd01ee3-5087-407e-a5fa-0c0fe63e71c1 req-b90f4577-b5b9-4877-a7b2-f79d2db735ad service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:04.307442 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-fdd01ee3-5087-407e-a5fa-0c0fe63e71c1 req-b90f4577-b5b9-4877-a7b2-f79d2db735ad service nova] Creating event network-vif-plugged:5d2ec979-cc43-4d59-a048-c56ae1ccf36e for instance 4b36eb09-434c-4516-8ea0-7d92019b492f on n-h1-848886-15 Jul 25 12:53:04.314286 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-fdd01ee3-5087-407e-a5fa-0c0fe63e71c1 req-b90f4577-b5b9-4877-a7b2-f79d2db735ad service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084712 Jul 25 12:53:04.315394 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1526/2980] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:04.335996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-c9c4fa74-1af1-412d-a353-bb732e31788a req-92ac6de8-f3d8-4fb3-a7a3-29d7118348d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "tag": "02849233-f60e-4c53-a1d0-6d7d5c7326af"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:04.356491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c9c4fa74-1af1-412d-a353-bb732e31788a req-92ac6de8-f3d8-4fb3-a7a3-29d7118348d0 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:04.356955 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c9c4fa74-1af1-412d-a353-bb732e31788a req-92ac6de8-f3d8-4fb3-a7a3-29d7118348d0 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:04.385266 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-c9c4fa74-1af1-412d-a353-bb732e31788a req-92ac6de8-f3d8-4fb3-a7a3-29d7118348d0 service nova] Creating event network-changed:02849233-f60e-4c53-a1d0-6d7d5c7326af for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:53:04.399986 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-c9c4fa74-1af1-412d-a353-bb732e31788a req-92ac6de8-f3d8-4fb3-a7a3-29d7118348d0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068201 Jul 25 12:53:04.400884 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1455/2981] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:04.876950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c66bc7bd-19fa-417b-a31b-8bd6b6f2e7f8 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:04.883428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c66bc7bd-19fa-417b-a31b-8bd6b6f2e7f8 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:04.908244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c66bc7bd-19fa-417b-a31b-8bd6b6f2e7f8 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:04.908975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c66bc7bd-19fa-417b-a31b-8bd6b6f2e7f8 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:04.910456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c66bc7bd-19fa-417b-a31b-8bd6b6f2e7f8 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:04.911110 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c66bc7bd-19fa-417b-a31b-8bd6b6f2e7f8 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:05.091920 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7cdeec53-613f-4090-a983-5d2998bbfe9b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:05.093324 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7cdeec53-613f-4090-a983-5d2998bbfe9b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 5d1a7907-1bc8-4e80-899e-996371552930] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:05.116938 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7cdeec53-613f-4090-a983-5d2998bbfe9b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:05.116938 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7cdeec53-613f-4090-a983-5d2998bbfe9b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:05.117272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7cdeec53-613f-4090-a983-5d2998bbfe9b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:05.117875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7cdeec53-613f-4090-a983-5d2998bbfe9b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:05.463571 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7cdeec53-613f-4090-a983-5d2998bbfe9b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:05.499404 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7cdeec53-613f-4090-a983-5d2998bbfe9b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930" status: 200 len: 1345 microversion: 2.1 time: 0.412402 Jul 25 12:53:05.500699 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1456/2982] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:05 2022] GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930 => generated 1345 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:05.524721 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-737419c2-55f5-437f-9a03-179f0bde77ad tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:05.541435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-737419c2-55f5-437f-9a03-179f0bde77ad tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:05.550959 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-737419c2-55f5-437f-9a03-179f0bde77ad tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:05.551842 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-737419c2-55f5-437f-9a03-179f0bde77ad tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:05.553113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-737419c2-55f5-437f-9a03-179f0bde77ad tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:05.554126 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-737419c2-55f5-437f-9a03-179f0bde77ad tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:06.938381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c66bc7bd-19fa-417b-a31b-8bd6b6f2e7f8 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:06.956080 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c66bc7bd-19fa-417b-a31b-8bd6b6f2e7f8 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1333 microversion: 2.1 time: 2.094082 Jul 25 12:53:06.966410 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1527/2983] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:04 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1333 bytes in 2098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:06.966410 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2618470c-8623-46c7-a4dd-7e5b7ea24179 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:06.967379 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2618470c-8623-46c7-a4dd-7e5b7ea24179 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:06.974958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2618470c-8623-46c7-a4dd-7e5b7ea24179 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:06.975684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2618470c-8623-46c7-a4dd-7e5b7ea24179 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:06.976688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2618470c-8623-46c7-a4dd-7e5b7ea24179 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:06.977487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2618470c-8623-46c7-a4dd-7e5b7ea24179 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:07.060320 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-737419c2-55f5-437f-9a03-179f0bde77ad tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:07.101730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-737419c2-55f5-437f-9a03-179f0bde77ad tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:07.108331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-737419c2-55f5-437f-9a03-179f0bde77ad tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:07.144658 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-737419c2-55f5-437f-9a03-179f0bde77ad tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1886 microversion: 2.32 time: 1.633494 Jul 25 12:53:07.153304 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1457/2984] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:53:05 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1886 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:53:07.162411 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-e9bd60af-c4bb-471e-a958-3b862bc14a44 req-89b4e290-1fc1-498f-9456-2a5a18f478e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "tag": "be480615-b9ea-4aa4-9399-1e7eabe09a0b"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:07.172917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e9bd60af-c4bb-471e-a958-3b862bc14a44 req-89b4e290-1fc1-498f-9456-2a5a18f478e0 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:07.173345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e9bd60af-c4bb-471e-a958-3b862bc14a44 req-89b4e290-1fc1-498f-9456-2a5a18f478e0 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:07.189417 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-e9bd60af-c4bb-471e-a958-3b862bc14a44 req-89b4e290-1fc1-498f-9456-2a5a18f478e0 service nova] Creating event network-changed:be480615-b9ea-4aa4-9399-1e7eabe09a0b for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:53:07.195496 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-e9bd60af-c4bb-471e-a958-3b862bc14a44 req-89b4e290-1fc1-498f-9456-2a5a18f478e0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040553 Jul 25 12:53:07.197242 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1458/2985] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:07.216788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ae9b4376-c99e-4653-b308-ca1976582edf tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:07.221496 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ae9b4376-c99e-4653-b308-ca1976582edf tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 5d1a7907-1bc8-4e80-899e-996371552930] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:07.229728 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ae9b4376-c99e-4653-b308-ca1976582edf tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:07.231532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ae9b4376-c99e-4653-b308-ca1976582edf tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:07.232500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ae9b4376-c99e-4653-b308-ca1976582edf tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:07.233100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ae9b4376-c99e-4653-b308-ca1976582edf tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:07.736081 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ae9b4376-c99e-4653-b308-ca1976582edf tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:07.770650 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ae9b4376-c99e-4653-b308-ca1976582edf tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930" status: 200 len: 1345 microversion: 2.1 time: 0.571208 Jul 25 12:53:07.801573 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1459/2986] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:07 2022] GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930 => generated 1345 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:07.995390 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e2228aa4-1317-44d0-ba00-be5251be9982 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:07.996431 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e2228aa4-1317-44d0-ba00-be5251be9982 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:08.018778 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2228aa4-1317-44d0-ba00-be5251be9982 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:08.019931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2228aa4-1317-44d0-ba00-be5251be9982 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:08.023205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2228aa4-1317-44d0-ba00-be5251be9982 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:08.026412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2228aa4-1317-44d0-ba00-be5251be9982 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:08.067266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2618470c-8623-46c7-a4dd-7e5b7ea24179 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:08.103471 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2618470c-8623-46c7-a4dd-7e5b7ea24179 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 1.144201 Jul 25 12:53:08.123050 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1528/2987] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:06 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:08.128733 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1177388d-1c83-40e4-a0ea-812c138ff613 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:08.137639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1177388d-1c83-40e4-a0ea-812c138ff613 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:08.150073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1177388d-1c83-40e4-a0ea-812c138ff613 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:08.154799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1177388d-1c83-40e4-a0ea-812c138ff613 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:08.158830 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1177388d-1c83-40e4-a0ea-812c138ff613 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:08.165095 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1177388d-1c83-40e4-a0ea-812c138ff613 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:08.731961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1177388d-1c83-40e4-a0ea-812c138ff613 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:08.753875 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1177388d-1c83-40e4-a0ea-812c138ff613 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.628982 Jul 25 12:53:08.766826 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1529/2988] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:08 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:08.782203 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d8971ffb-2be4-40c7-a950-46db59af5e34 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:08.787851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d8971ffb-2be4-40c7-a950-46db59af5e34 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:08.808829 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8971ffb-2be4-40c7-a950-46db59af5e34 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:08.817252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8971ffb-2be4-40c7-a950-46db59af5e34 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:08.818538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8971ffb-2be4-40c7-a950-46db59af5e34 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:08.819527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8971ffb-2be4-40c7-a950-46db59af5e34 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:08.865141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e2228aa4-1317-44d0-ba00-be5251be9982 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:08.878849 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e2228aa4-1317-44d0-ba00-be5251be9982 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1669 microversion: 2.1 time: 0.889597 Jul 25 12:53:08.879466 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1460/2989] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:07 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1669 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:08.909984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2fee17c2-ecaf-4c36-80e1-79763860f934 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:08.914916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2fee17c2-ecaf-4c36-80e1-79763860f934 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:08.929419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fee17c2-ecaf-4c36-80e1-79763860f934 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:08.931993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fee17c2-ecaf-4c36-80e1-79763860f934 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:08.933557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fee17c2-ecaf-4c36-80e1-79763860f934 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:08.947023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fee17c2-ecaf-4c36-80e1-79763860f934 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:09.536762 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2fee17c2-ecaf-4c36-80e1-79763860f934 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:09.550043 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2fee17c2-ecaf-4c36-80e1-79763860f934 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.669423 Jul 25 12:53:09.551377 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1461/2990] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:08 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:09.561821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-97f0478b-7b4f-4544-b2a6-6a893a2cf4ea tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:09.568339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-97f0478b-7b4f-4544-b2a6-6a893a2cf4ea tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 5d1a7907-1bc8-4e80-899e-996371552930] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:09.579313 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97f0478b-7b4f-4544-b2a6-6a893a2cf4ea tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:09.583329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97f0478b-7b4f-4544-b2a6-6a893a2cf4ea tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:09.584774 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97f0478b-7b4f-4544-b2a6-6a893a2cf4ea tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:09.587875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97f0478b-7b4f-4544-b2a6-6a893a2cf4ea tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:09.623070 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-97f0478b-7b4f-4544-b2a6-6a893a2cf4ea tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] HTTP exception thrown: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-97f0478b-7b4f-4544-b2a6-6a893a2cf4ea tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Request method failure captured: Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930 HTTP/1.1 Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pHF7UCaF8gOsr4izIJsQMgDEa0djLGcj88wHujy3LL3KrSKed1jp5p2g1uyl0B7FckQX0z38dpjtGtJDzQMYAlTS7LRfENWczpgFqPzdGM6KYoCp6qrqJdc7QEkc58SEBAWEj2A4h5-asWJS2CIcfkxwvHFTYem8sDn2kkqArMxtZA Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f07680a55b3f41408d3a284d1330503d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}] Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: d28f966411004a158377c689fd5b05eb Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '5d1a7907-1bc8-4e80-899e-996371552930'} Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:53:09.625320 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:53:09.629682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:09.629682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:53:09.629682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:53:09.629682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:53:09.629682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:53:09.629682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. Jul 25 12:53:09.629682 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:53:09.632305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-97f0478b-7b4f-4544-b2a6-6a893a2cf4ea tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Returning 404 to user: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:53:09.633516 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-97f0478b-7b4f-4544-b2a6-6a893a2cf4ea tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930" status: 404 len: 111 microversion: 2.1 time: 0.075701 Jul 25 12:53:09.640280 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1462/2991] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:09 2022] GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:53:09.646870 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-85f833b2-b88d-4508-ab65-81ac45eaffbc tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:09.648359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-85f833b2-b88d-4508-ab65-81ac45eaffbc tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:09.656215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-85f833b2-b88d-4508-ab65-81ac45eaffbc tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:09.657110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-85f833b2-b88d-4508-ab65-81ac45eaffbc tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:09.658233 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-85f833b2-b88d-4508-ab65-81ac45eaffbc tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:09.658889 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-85f833b2-b88d-4508-ab65-81ac45eaffbc tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:09.719841 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-85f833b2-b88d-4508-ab65-81ac45eaffbc tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f/ips" status: 200 len: 180 microversion: 2.1 time: 0.078056 Jul 25 12:53:09.722629 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1463/2992] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Jul 25 12:53:09 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f/ips => generated 180 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:09.737318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-70dbf1ba-8449-4689-91e5-2a7dd689e6d1 req-7a86286b-b336-4d3d-9d23-ec0d9ce787ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "tag": "39297266-b022-4131-809f-29475f17809c"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:09.764021 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-70dbf1ba-8449-4689-91e5-2a7dd689e6d1 req-7a86286b-b336-4d3d-9d23-ec0d9ce787ce service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:09.766357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-70dbf1ba-8449-4689-91e5-2a7dd689e6d1 req-7a86286b-b336-4d3d-9d23-ec0d9ce787ce service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:09.780219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:09.810010 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-70dbf1ba-8449-4689-91e5-2a7dd689e6d1 req-7a86286b-b336-4d3d-9d23-ec0d9ce787ce service nova] Creating event network-changed:39297266-b022-4131-809f-29475f17809c for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:53:09.825424 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-70dbf1ba-8449-4689-91e5-2a7dd689e6d1 req-7a86286b-b336-4d3d-9d23-ec0d9ce787ce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099853 Jul 25 12:53:09.826788 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1464/2993] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:09.849694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b4c23a29-1289-403c-bae9-f2c3748a7f1f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-877791394"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:09.858136 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b4c23a29-1289-403c-bae9-f2c3748a7f1f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:09.862060 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d8971ffb-2be4-40c7-a950-46db59af5e34 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:09.874345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4c23a29-1289-403c-bae9-f2c3748a7f1f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:09.877282 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4c23a29-1289-403c-bae9-f2c3748a7f1f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:09.878960 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4c23a29-1289-403c-bae9-f2c3748a7f1f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:09.879413 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4c23a29-1289-403c-bae9-f2c3748a7f1f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:09.884662 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d8971ffb-2be4-40c7-a950-46db59af5e34 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:09.897386 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d8971ffb-2be4-40c7-a950-46db59af5e34 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:09.903637 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d8971ffb-2be4-40c7-a950-46db59af5e34 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1886 microversion: 2.32 time: 1.133698 Jul 25 12:53:09.906733 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1530/2994] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:53:08 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1886 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:53:09.928992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bc18e6a7-3ab3-47d5-9283-cb88b2e8755e tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:09.930141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bc18e6a7-3ab3-47d5-9283-cb88b2e8755e tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:09.956475 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc18e6a7-3ab3-47d5-9283-cb88b2e8755e tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:09.957311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc18e6a7-3ab3-47d5-9283-cb88b2e8755e tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:09.958551 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc18e6a7-3ab3-47d5-9283-cb88b2e8755e tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:09.963634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc18e6a7-3ab3-47d5-9283-cb88b2e8755e tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:10.058414 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bc18e6a7-3ab3-47d5-9283-cb88b2e8755e tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:53:10.340256 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bc18e6a7-3ab3-47d5-9283-cb88b2e8755e tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 204 len: 0 microversion: 2.1 time: 0.426550 Jul 25 12:53:10.350711 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1531/2995] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:53:09 2022] DELETE /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:53:10.363424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7065b79c-9fd1-4949-8f5e-5e6c865f6176 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:10.373546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7065b79c-9fd1-4949-8f5e-5e6c865f6176 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 5d1a7907-1bc8-4e80-899e-996371552930] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:10.386286 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b4c23a29-1289-403c-bae9-f2c3748a7f1f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action" status: 202 len: 0 microversion: 2.1 time: 0.553497 Jul 25 12:53:10.392367 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1465/2996] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:53:09 2022] POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 25 12:53:10.405277 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7065b79c-9fd1-4949-8f5e-5e6c865f6176 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:10.405997 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7065b79c-9fd1-4949-8f5e-5e6c865f6176 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:10.407648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7065b79c-9fd1-4949-8f5e-5e6c865f6176 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:10.410717 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7065b79c-9fd1-4949-8f5e-5e6c865f6176 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:10.414943 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4865ff25-a92e-4a26-b4e3-5060e08463f7 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:10.415821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4865ff25-a92e-4a26-b4e3-5060e08463f7 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:10.434085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4865ff25-a92e-4a26-b4e3-5060e08463f7 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:10.436456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4865ff25-a92e-4a26-b4e3-5060e08463f7 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:10.442294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4865ff25-a92e-4a26-b4e3-5060e08463f7 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:10.446191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4865ff25-a92e-4a26-b4e3-5060e08463f7 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:10.451745 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-7065b79c-9fd1-4949-8f5e-5e6c865f6176 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] HTTP exception thrown: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7065b79c-9fd1-4949-8f5e-5e6c865f6176 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Request method failure captured: Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930/os-volume_attachments HTTP/1.1 Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pHF7UCaF8gOsr4izIJsQMgDEa0djLGcj88wHujy3LL3KrSKed1jp5p2g1uyl0B7FckQX0z38dpjtGtJDzQMYAlTS7LRfENWczpgFqPzdGM6KYoCp6qrqJdc7QEkc58SEBAWEj2A4h5-asWJS2CIcfkxwvHFTYem8sDn2kkqArMxtZA Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f07680a55b3f41408d3a284d1330503d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}] Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: d28f966411004a158377c689fd5b05eb Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'server_id': '5d1a7907-1bc8-4e80-899e-996371552930'} Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:53:10.453633 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:53:10.457481 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. Jul 25 12:53:10.457481 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:10.457481 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:53:10.457481 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:10.457481 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:10.457481 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:53:10.457481 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:53:10.457481 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:53:10.457481 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:53:10.457481 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. Jul 25 12:53:10.457481 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:10.457481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7065b79c-9fd1-4949-8f5e-5e6c865f6176 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Returning 404 to user: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:53:10.458336 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7065b79c-9fd1-4949-8f5e-5e6c865f6176 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.106620 Jul 25 12:53:10.459084 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1532/2997] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 12:53:10 2022] GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930/os-volume_attachments => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:53:10.817591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-50746b08-4e50-4585-a4f2-65b28a21d20b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1291743329", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "b6926756-00b4-4271-8538-f2e94168b61a"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:10.943443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-50746b08-4e50-4585-a4f2-65b28a21d20b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] validate_networks() for [('b6926756-00b4-4271-8538-f2e94168b61a', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:53:11.351770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4865ff25-a92e-4a26-b4e3-5060e08463f7 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:11.370911 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4865ff25-a92e-4a26-b4e3-5060e08463f7 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1675 microversion: 2.1 time: 0.973197 Jul 25 12:53:11.372994 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1466/2998] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:10 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1675 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:11.389799 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2ae7bb6c-0a62-4c3f-b375-3a964ead1021 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:11.398669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2ae7bb6c-0a62-4c3f-b375-3a964ead1021 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:11.406582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2ae7bb6c-0a62-4c3f-b375-3a964ead1021 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:11.407355 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2ae7bb6c-0a62-4c3f-b375-3a964ead1021 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:11.413879 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2ae7bb6c-0a62-4c3f-b375-3a964ead1021 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:11.414676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2ae7bb6c-0a62-4c3f-b375-3a964ead1021 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:12.586281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2ae7bb6c-0a62-4c3f-b375-3a964ead1021 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:12.612908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2ae7bb6c-0a62-4c3f-b375-3a964ead1021 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:12.617215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2ae7bb6c-0a62-4c3f-b375-3a964ead1021 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:12.620127 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2ae7bb6c-0a62-4c3f-b375-3a964ead1021 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1886 microversion: 2.32 time: 1.243007 Jul 25 12:53:12.621204 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1467/2999] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:53:11 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1886 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:53:12.652254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8e7bb248-c841-4b06-a992-d51448e4b385 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:12.654784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8e7bb248-c841-4b06-a992-d51448e4b385 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:12.668423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8e7bb248-c841-4b06-a992-d51448e4b385 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:12.669142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8e7bb248-c841-4b06-a992-d51448e4b385 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:12.670371 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8e7bb248-c841-4b06-a992-d51448e4b385 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:12.671071 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8e7bb248-c841-4b06-a992-d51448e4b385 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:12.751388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-50746b08-4e50-4585-a4f2-65b28a21d20b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:53:12.752575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-50746b08-4e50-4585-a4f2-65b28a21d20b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:53:12.754685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-50746b08-4e50-4585-a4f2-65b28a21d20b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:53:12.755597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-50746b08-4e50-4585-a4f2-65b28a21d20b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:53:12.756208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-50746b08-4e50-4585-a4f2-65b28a21d20b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:53:12.770898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50746b08-4e50-4585-a4f2-65b28a21d20b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:12.771964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50746b08-4e50-4585-a4f2-65b28a21d20b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:12.773023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50746b08-4e50-4585-a4f2-65b28a21d20b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:12.775205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50746b08-4e50-4585-a4f2-65b28a21d20b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:12.816041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-50746b08-4e50-4585-a4f2-65b28a21d20b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Getting quotas for project f07680a55b3f41408d3a284d1330503d. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:53:12.827252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-50746b08-4e50-4585-a4f2-65b28a21d20b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Getting quotas for user d28f966411004a158377c689fd5b05eb and project f07680a55b3f41408d3a284d1330503d. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:53:12.864980 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-50746b08-4e50-4585-a4f2-65b28a21d20b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:53:12.872247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-50746b08-4e50-4585-a4f2-65b28a21d20b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 50db5351-ca41-4692-ac73-f520a126ee46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:53:13.003717 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-50746b08-4e50-4585-a4f2-65b28a21d20b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.190591 Jul 25 12:53:13.006973 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1533/3000] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:53:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:53:13.031696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ce3e237b-48d9-4fe3-aa72-a183f18aa762 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:13.035631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ce3e237b-48d9-4fe3-aa72-a183f18aa762 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 50db5351-ca41-4692-ac73-f520a126ee46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:13.258472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ce3e237b-48d9-4fe3-aa72-a183f18aa762 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:13.303792 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ce3e237b-48d9-4fe3-aa72-a183f18aa762 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/50db5351-ca41-4692-ac73-f520a126ee46" status: 200 len: 1215 microversion: 2.1 time: 0.283217 Jul 25 12:53:13.308845 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8e7bb248-c841-4b06-a992-d51448e4b385 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:13.313911 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1534/3001] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:13 2022] GET /compute/v2.1/servers/50db5351-ca41-4692-ac73-f520a126ee46 => generated 1215 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:53:13.349176 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8e7bb248-c841-4b06-a992-d51448e4b385 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1675 microversion: 2.1 time: 0.720697 Jul 25 12:53:13.353013 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1468/3002] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:12 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1675 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:13.355421 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d20a8dcb-7524-4320-a132-f205f52793ef tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:13.356247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d20a8dcb-7524-4320-a132-f205f52793ef tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 50db5351-ca41-4692-ac73-f520a126ee46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:13.464180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d20a8dcb-7524-4320-a132-f205f52793ef tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 50db5351-ca41-4692-ac73-f520a126ee46] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:53:13.675406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a9a0ca60-fc65-465f-a794-d1c9e30155b3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:13.678673 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a9a0ca60-fc65-465f-a794-d1c9e30155b3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:13.725875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9a0ca60-fc65-465f-a794-d1c9e30155b3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:13.725875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9a0ca60-fc65-465f-a794-d1c9e30155b3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:13.725875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9a0ca60-fc65-465f-a794-d1c9e30155b3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:13.725875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9a0ca60-fc65-465f-a794-d1c9e30155b3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:14.084701 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a9a0ca60-fc65-465f-a794-d1c9e30155b3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:14.097206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a9a0ca60-fc65-465f-a794-d1c9e30155b3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:14.105680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a9a0ca60-fc65-465f-a794-d1c9e30155b3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:14.109025 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d20a8dcb-7524-4320-a132-f205f52793ef tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/50db5351-ca41-4692-ac73-f520a126ee46" status: 204 len: 0 microversion: 2.1 time: 0.762498 Jul 25 12:53:14.110849 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a9a0ca60-fc65-465f-a794-d1c9e30155b3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 0.446594 Jul 25 12:53:14.111845 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1535/3003] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:53:13 2022] DELETE /compute/v2.1/servers/50db5351-ca41-4692-ac73-f520a126ee46 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 12:53:14.132960 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1469/3004] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:53:13 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:53:14.136564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-71ef0a41-2773-4f5e-bb64-f2a0a445e782 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:14.137493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-71ef0a41-2773-4f5e-bb64-f2a0a445e782 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 50db5351-ca41-4692-ac73-f520a126ee46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:14.162221 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:14.164128 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-71ef0a41-2773-4f5e-bb64-f2a0a445e782 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] HTTP exception thrown: Instance 50db5351-ca41-4692-ac73-f520a126ee46 could not be found. Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-71ef0a41-2773-4f5e-bb64-f2a0a445e782 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Request method failure captured: Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/50db5351-ca41-4692-ac73-f520a126ee46 HTTP/1.1 Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pHF7UCaF8gOsr4izIJsQMgDEa0djLGcj88wHujy3LL3KrSKed1jp5p2g1uyl0B7FckQX0z38dpjtGtJDzQMYAlTS7LRfENWczpgFqPzdGM6KYoCp6qrqJdc7QEkc58SEBAWEj2A4h5-asWJS2CIcfkxwvHFTYem8sDn2kkqArMxtZA Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f07680a55b3f41408d3a284d1330503d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}] Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: d28f966411004a158377c689fd5b05eb Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 50db5351-ca41-4692-ac73-f520a126ee46 could not be found. Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '50db5351-ca41-4692-ac73-f520a126ee46'} Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2877, in _get_instance Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 50db5351-ca41-4692-ac73-f520a126ee46 Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2889, in _get_instance Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50db5351-ca41-4692-ac73-f520a126ee46 could not be found. Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:53:14.171244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:53:14.179009 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:53:14.179009 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:53:14.179009 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:53:14.179009 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:53:14.179009 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:53:14.179009 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:53:14.179009 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:53:14.179009 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:53:14.179009 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:53:14.179009 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:53:14.179009 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50db5351-ca41-4692-ac73-f520a126ee46 could not be found. Jul 25 12:53:14.179009 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:14.179009 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:53:14.179009 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:14.179009 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:14.179009 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:53:14.179009 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:53:14.179009 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:53:14.179009 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:53:14.179009 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50db5351-ca41-4692-ac73-f520a126ee46 could not be found. Jul 25 12:53:14.179009 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:14.183888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-71ef0a41-2773-4f5e-bb64-f2a0a445e782 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Returning 404 to user: Instance 50db5351-ca41-4692-ac73-f520a126ee46 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:53:14.187432 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-71ef0a41-2773-4f5e-bb64-f2a0a445e782 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/50db5351-ca41-4692-ac73-f520a126ee46" status: 404 len: 111 microversion: 2.1 time: 0.058234 Jul 25 12:53:14.191841 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1536/3005] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:14 2022] GET /compute/v2.1/servers/50db5351-ca41-4692-ac73-f520a126ee46 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:53:14.320989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6842e6ca-bf4a-449b-8839-3c9c6a8b6f1a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1373993968", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "b6926756-00b4-4271-8538-f2e94168b61a"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:14.393588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e38641a3-a358-490b-93b5-98a803a580b5 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:14.397356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e38641a3-a358-490b-93b5-98a803a580b5 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:14.430969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e38641a3-a358-490b-93b5-98a803a580b5 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:14.432518 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e38641a3-a358-490b-93b5-98a803a580b5 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:14.439105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e38641a3-a358-490b-93b5-98a803a580b5 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:14.440158 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e38641a3-a358-490b-93b5-98a803a580b5 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:14.497724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-6842e6ca-bf4a-449b-8839-3c9c6a8b6f1a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] validate_networks() for [('b6926756-00b4-4271-8538-f2e94168b61a', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:53:15.313744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e38641a3-a358-490b-93b5-98a803a580b5 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:15.330589 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e38641a3-a358-490b-93b5-98a803a580b5 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1654 microversion: 2.1 time: 0.945077 Jul 25 12:53:15.331230 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1537/3006] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:14 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1654 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:53:15.367878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-639f78cd-92d4-41b3-95d4-8995c5c8f3b0 req-b8a97f17-6fec-40d9-ba0f-d2354ce9926d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b36eb09-434c-4516-8ea0-7d92019b492f", "name": "network-vif-deleted", "tag": "5d2ec979-cc43-4d59-a048-c56ae1ccf36e"}, {"name": "network-changed", "server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "tag": "cb401cbd-e19d-4978-86c4-7928b236e3b9"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:15.463534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-639f78cd-92d4-41b3-95d4-8995c5c8f3b0 req-b8a97f17-6fec-40d9-ba0f-d2354ce9926d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:15.475136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-639f78cd-92d4-41b3-95d4-8995c5c8f3b0 req-b8a97f17-6fec-40d9-ba0f-d2354ce9926d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:15.517588 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-639f78cd-92d4-41b3-95d4-8995c5c8f3b0 req-b8a97f17-6fec-40d9-ba0f-d2354ce9926d service nova] Creating event network-vif-deleted:5d2ec979-cc43-4d59-a048-c56ae1ccf36e for instance 4b36eb09-434c-4516-8ea0-7d92019b492f on n-h1-848886-15 Jul 25 12:53:15.518240 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-639f78cd-92d4-41b3-95d4-8995c5c8f3b0 req-b8a97f17-6fec-40d9-ba0f-d2354ce9926d service nova] Creating event network-changed:cb401cbd-e19d-4978-86c4-7928b236e3b9 for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:53:15.548594 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-639f78cd-92d4-41b3-95d4-8995c5c8f3b0 req-b8a97f17-6fec-40d9-ba0f-d2354ce9926d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.215334 Jul 25 12:53:15.549538 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1538/3007] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:15.560885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c05febeb-9a48-4cf6-9e98-79be0dcda8cb tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:15.562621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c05febeb-9a48-4cf6-9e98-79be0dcda8cb tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:15.588028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c05febeb-9a48-4cf6-9e98-79be0dcda8cb tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:15.588565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c05febeb-9a48-4cf6-9e98-79be0dcda8cb tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:15.589383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c05febeb-9a48-4cf6-9e98-79be0dcda8cb tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:15.590074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c05febeb-9a48-4cf6-9e98-79be0dcda8cb tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:16.524344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c05febeb-9a48-4cf6-9e98-79be0dcda8cb tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:16.553391 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c05febeb-9a48-4cf6-9e98-79be0dcda8cb tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:16.556761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c05febeb-9a48-4cf6-9e98-79be0dcda8cb tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:16.559133 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c05febeb-9a48-4cf6-9e98-79be0dcda8cb tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 1.005811 Jul 25 12:53:16.560043 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1539/3008] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:53:15 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:53:16.567217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-79eb0486-d0be-4323-b301-4216a922df42 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:16.568383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-79eb0486-d0be-4323-b301-4216a922df42 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:16.577453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-79eb0486-d0be-4323-b301-4216a922df42 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:16.578544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-79eb0486-d0be-4323-b301-4216a922df42 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:16.579731 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-79eb0486-d0be-4323-b301-4216a922df42 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:16.580400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-79eb0486-d0be-4323-b301-4216a922df42 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:17.398675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-79eb0486-d0be-4323-b301-4216a922df42 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:17.421506 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-79eb0486-d0be-4323-b301-4216a922df42 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1496 microversion: 2.1 time: 0.857083 Jul 25 12:53:17.438077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-6842e6ca-bf4a-449b-8839-3c9c6a8b6f1a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:53:17.438077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-6842e6ca-bf4a-449b-8839-3c9c6a8b6f1a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:53:17.438077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-6842e6ca-bf4a-449b-8839-3c9c6a8b6f1a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:53:17.438077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-6842e6ca-bf4a-449b-8839-3c9c6a8b6f1a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:53:17.438077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-6842e6ca-bf4a-449b-8839-3c9c6a8b6f1a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:53:17.440151 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1540/3009] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:16 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1496 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:17.449700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-31f2006b-88e8-4884-99df-362b60ddcff2 req-4b2cfcc7-f9aa-43e7-af02-1cf4c030443d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b36eb09-434c-4516-8ea0-7d92019b492f", "name": "network-vif-unplugged", "status": "completed", "tag": "53ae9464-640c-4f36-8331-4b91de240827"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:17.474965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6842e6ca-bf4a-449b-8839-3c9c6a8b6f1a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:17.475654 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6842e6ca-bf4a-449b-8839-3c9c6a8b6f1a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:17.478785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6842e6ca-bf4a-449b-8839-3c9c6a8b6f1a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:17.479475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6842e6ca-bf4a-449b-8839-3c9c6a8b6f1a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:17.480419 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-31f2006b-88e8-4884-99df-362b60ddcff2 req-4b2cfcc7-f9aa-43e7-af02-1cf4c030443d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:17.481170 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-31f2006b-88e8-4884-99df-362b60ddcff2 req-4b2cfcc7-f9aa-43e7-af02-1cf4c030443d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:17.509091 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-31f2006b-88e8-4884-99df-362b60ddcff2 req-4b2cfcc7-f9aa-43e7-af02-1cf4c030443d service nova] Creating event network-vif-unplugged:53ae9464-640c-4f36-8331-4b91de240827 for instance 4b36eb09-434c-4516-8ea0-7d92019b492f on n-h1-848886-15 Jul 25 12:53:17.520938 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-31f2006b-88e8-4884-99df-362b60ddcff2 req-4b2cfcc7-f9aa-43e7-af02-1cf4c030443d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079194 Jul 25 12:53:17.525511 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1541/3010] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:17.571318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-6842e6ca-bf4a-449b-8839-3c9c6a8b6f1a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Getting quotas for project f07680a55b3f41408d3a284d1330503d. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:53:17.586753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-6842e6ca-bf4a-449b-8839-3c9c6a8b6f1a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Getting quotas for user d28f966411004a158377c689fd5b05eb and project f07680a55b3f41408d3a284d1330503d. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:53:17.608591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-20c72e9a-4431-4423-b968-c1875108fa41 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:17.609743 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-20c72e9a-4431-4423-b968-c1875108fa41 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:17.628722 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6842e6ca-bf4a-449b-8839-3c9c6a8b6f1a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:53:17.637187 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6842e6ca-bf4a-449b-8839-3c9c6a8b6f1a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:53:17.654339 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20c72e9a-4431-4423-b968-c1875108fa41 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:17.656613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20c72e9a-4431-4423-b968-c1875108fa41 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:17.660936 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20c72e9a-4431-4423-b968-c1875108fa41 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:17.661755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20c72e9a-4431-4423-b968-c1875108fa41 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:17.784765 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6842e6ca-bf4a-449b-8839-3c9c6a8b6f1a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.468151 Jul 25 12:53:17.800858 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1470/3011] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:53:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:53:17.823309 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e7ac17fb-5d82-4b4e-98d3-e045a4af0d9b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:17.823985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e7ac17fb-5d82-4b4e-98d3-e045a4af0d9b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:18.310615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-20c72e9a-4431-4423-b968-c1875108fa41 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:18.353408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-20c72e9a-4431-4423-b968-c1875108fa41 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:18.360167 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e7ac17fb-5d82-4b4e-98d3-e045a4af0d9b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:18.375480 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-20c72e9a-4431-4423-b968-c1875108fa41 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:18.379454 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-20c72e9a-4431-4423-b968-c1875108fa41 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 0.775426 Jul 25 12:53:18.390094 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1542/3012] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:53:17 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:53:18.397879 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e7ac17fb-5d82-4b4e-98d3-e045a4af0d9b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e" status: 200 len: 1215 microversion: 2.1 time: 0.585703 Jul 25 12:53:18.397879 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1471/3013] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:17 2022] GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e => generated 1215 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:18.447270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-95cad9e1-243f-4a2e-a53e-2371621d3fd4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:18.447802 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-95cad9e1-243f-4a2e-a53e-2371621d3fd4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:18.458914 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95cad9e1-243f-4a2e-a53e-2371621d3fd4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:18.463882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95cad9e1-243f-4a2e-a53e-2371621d3fd4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:18.465073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95cad9e1-243f-4a2e-a53e-2371621d3fd4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:18.466111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95cad9e1-243f-4a2e-a53e-2371621d3fd4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:18.796576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-95cad9e1-243f-4a2e-a53e-2371621d3fd4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:18.831165 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-95cad9e1-243f-4a2e-a53e-2371621d3fd4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1454 microversion: 2.1 time: 0.388437 Jul 25 12:53:18.842182 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1543/3014] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:18 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1454 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:19.421028 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-29da96a9-7b36-4d91-9902-9771936b4621 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:19.426179 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-29da96a9-7b36-4d91-9902-9771936b4621 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:19.436997 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-5376cd5c-ad96-49ec-ade3-2537569f086b req-ac901ee7-7c37-408d-a7ad-4acaa3d6bc6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b36eb09-434c-4516-8ea0-7d92019b492f", "name": "network-vif-deleted", "tag": "53ae9464-640c-4f36-8331-4b91de240827"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:19.461475 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5376cd5c-ad96-49ec-ade3-2537569f086b req-ac901ee7-7c37-408d-a7ad-4acaa3d6bc6b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:19.462140 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29da96a9-7b36-4d91-9902-9771936b4621 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:19.462975 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29da96a9-7b36-4d91-9902-9771936b4621 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:19.469910 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5376cd5c-ad96-49ec-ade3-2537569f086b req-ac901ee7-7c37-408d-a7ad-4acaa3d6bc6b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:19.477141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29da96a9-7b36-4d91-9902-9771936b4621 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:19.480443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29da96a9-7b36-4d91-9902-9771936b4621 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:19.495917 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-5376cd5c-ad96-49ec-ade3-2537569f086b req-ac901ee7-7c37-408d-a7ad-4acaa3d6bc6b service nova] Creating event network-vif-deleted:53ae9464-640c-4f36-8331-4b91de240827 for instance 4b36eb09-434c-4516-8ea0-7d92019b492f on n-h1-848886-15 Jul 25 12:53:19.511733 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-5376cd5c-ad96-49ec-ade3-2537569f086b req-ac901ee7-7c37-408d-a7ad-4acaa3d6bc6b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084695 Jul 25 12:53:19.520380 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1544/3015] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:19.540595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bdde2a8a-ea52-4a52-aede-d5e3b8b8d713 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:19.543491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bdde2a8a-ea52-4a52-aede-d5e3b8b8d713 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:19.557068 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bdde2a8a-ea52-4a52-aede-d5e3b8b8d713 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:19.558281 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bdde2a8a-ea52-4a52-aede-d5e3b8b8d713 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:19.559918 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bdde2a8a-ea52-4a52-aede-d5e3b8b8d713 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:19.560852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bdde2a8a-ea52-4a52-aede-d5e3b8b8d713 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:19.808018 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bdde2a8a-ea52-4a52-aede-d5e3b8b8d713 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:19.827512 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bdde2a8a-ea52-4a52-aede-d5e3b8b8d713 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e" status: 200 len: 1211 microversion: 2.1 time: 0.305149 Jul 25 12:53:19.832713 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1545/3016] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:19 2022] GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e => generated 1211 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:19.859962 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-79bd3eec-2d3d-481b-ba50-59433c251c3c req-b6cc6796-147d-467f-869b-ddb3e98cea3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b730aecb-2c1f-46ef-b457-8a3717655518", "name": "network-vif-plugged", "status": "completed", "tag": "45191120-4204-4de7-9ef8-5d5c4ba83f89"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:19.897293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-79bd3eec-2d3d-481b-ba50-59433c251c3c req-b6cc6796-147d-467f-869b-ddb3e98cea3a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:19.899860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-79bd3eec-2d3d-481b-ba50-59433c251c3c req-b6cc6796-147d-467f-869b-ddb3e98cea3a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:19.923958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:19.928865 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-79bd3eec-2d3d-481b-ba50-59433c251c3c req-b6cc6796-147d-467f-869b-ddb3e98cea3a service nova] Creating event network-vif-plugged:45191120-4204-4de7-9ef8-5d5c4ba83f89 for instance b730aecb-2c1f-46ef-b457-8a3717655518 on n-h1-848886-15 Jul 25 12:53:19.946991 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-79bd3eec-2d3d-481b-ba50-59433c251c3c req-b6cc6796-147d-467f-869b-ddb3e98cea3a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110104 Jul 25 12:53:19.947929 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1546/3017] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:19.964274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5e87939c-72f3-4df3-9921-06264b4c5bcb tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:19.964996 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5e87939c-72f3-4df3-9921-06264b4c5bcb tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:19.972892 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e87939c-72f3-4df3-9921-06264b4c5bcb tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:19.978992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e87939c-72f3-4df3-9921-06264b4c5bcb tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:19.980217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e87939c-72f3-4df3-9921-06264b4c5bcb tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:19.980852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e87939c-72f3-4df3-9921-06264b4c5bcb tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:20.070865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e87939c-72f3-4df3-9921-06264b4c5bcb tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:20.071656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e87939c-72f3-4df3-9921-06264b4c5bcb tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:20.072310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-5e87939c-72f3-4df3-9921-06264b4c5bcb tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lazy-loading 'fault' on Instance uuid 4b36eb09-434c-4516-8ea0-7d92019b492f {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:53:20.207705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5e87939c-72f3-4df3-9921-06264b4c5bcb tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f912ac6820e44b40977a2913a80c7bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af716a8b586d45b2aa95b8c73683ff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:20.225053 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5e87939c-72f3-4df3-9921-06264b4c5bcb tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 200 len: 1302 microversion: 2.1 time: 0.275358 Jul 25 12:53:20.226974 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1547/3018] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:19 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 1302 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:20.505910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-29da96a9-7b36-4d91-9902-9771936b4621 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:20.561155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-29da96a9-7b36-4d91-9902-9771936b4621 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:20.565004 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-29da96a9-7b36-4d91-9902-9771936b4621 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:20.567409 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-29da96a9-7b36-4d91-9902-9771936b4621 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 1.154853 Jul 25 12:53:20.573174 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1472/3019] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:53:19 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:53:20.864776 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0c0da433-369c-4854-8f1a-a71cdafd45fc tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:20.867815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0c0da433-369c-4854-8f1a-a71cdafd45fc tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:20.901312 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0c0da433-369c-4854-8f1a-a71cdafd45fc tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:20.912375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0c0da433-369c-4854-8f1a-a71cdafd45fc tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:20.916498 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0c0da433-369c-4854-8f1a-a71cdafd45fc tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:20.923075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0c0da433-369c-4854-8f1a-a71cdafd45fc tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:21.130455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0c0da433-369c-4854-8f1a-a71cdafd45fc tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:21.151147 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0c0da433-369c-4854-8f1a-a71cdafd45fc tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e" status: 200 len: 1285 microversion: 2.1 time: 0.297756 Jul 25 12:53:21.152450 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1548/3020] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:20 2022] GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e => generated 1285 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:53:21.269775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7862e2ff-25cb-4a04-9049-579e16f0abc0 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:21.270891 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7862e2ff-25cb-4a04-9049-579e16f0abc0 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:21.285002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:21.286966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7862e2ff-25cb-4a04-9049-579e16f0abc0 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:21.287680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7862e2ff-25cb-4a04-9049-579e16f0abc0 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:21.288654 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7862e2ff-25cb-4a04-9049-579e16f0abc0 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:21.289264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7862e2ff-25cb-4a04-9049-579e16f0abc0 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:21.324529 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-7862e2ff-25cb-4a04-9049-579e16f0abc0 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] HTTP exception thrown: Instance 4b36eb09-434c-4516-8ea0-7d92019b492f could not be found. Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7862e2ff-25cb-4a04-9049-579e16f0abc0 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Request method failure captured: Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f HTTP/1.1 Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pGEBcV00oIrXsYqjQvCG7NrnsUISLUBF1k-iSw8gGnoEJDVl97b6WpvepCB8T-oiRzFC7uWhgFi5JyoGjLeSbgNtevsSUK0SSWDbTSyITDPEbOWycP5Qp71XC2IXqVJyO0Koq1GQfr6-jG4POENX6p10DmdyDclGjGytodI3zSX5s0 Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: af716a8b586d45b2aa95b8c73683ff0d Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersTestMultiNic-996157873 Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_af716a8b586d45b2aa95b8c73683ff0d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/af716a8b586d45b2aa95b8c73683ff0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af716a8b586d45b2aa95b8c73683ff0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af716a8b586d45b2aa95b8c73683ff0d"}]}] Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersTestMultiNic-996157873 Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: af716a8b586d45b2aa95b8c73683ff0d Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersTestMultiNic-996157873 Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersTestMultiNic-996157873-project Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: f912ac6820e44b40977a2913a80c7bec Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersTestMultiNic-996157873-project Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 4b36eb09-434c-4516-8ea0-7d92019b492f could not be found. Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '4b36eb09-434c-4516-8ea0-7d92019b492f'} Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b36eb09-434c-4516-8ea0-7d92019b492f could not be found. Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b36eb09-434c-4516-8ea0-7d92019b492f could not be found. Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:53:21.327212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:53:21.337246 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:21.337246 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:53:21.337246 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:53:21.337246 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:53:21.337246 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:53:21.337246 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b36eb09-434c-4516-8ea0-7d92019b492f could not be found. Jul 25 12:53:21.337246 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:53:21.337246 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7862e2ff-25cb-4a04-9049-579e16f0abc0 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Returning 404 to user: Instance 4b36eb09-434c-4516-8ea0-7d92019b492f could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:53:21.337246 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7862e2ff-25cb-4a04-9049-579e16f0abc0 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 404 len: 111 microversion: 2.1 time: 0.063101 Jul 25 12:53:21.337246 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1473/3021] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:21 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:53:21.611099 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-864d21fd-df46-4b4c-b56e-097023e0fd2d tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:21.612978 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-864d21fd-df46-4b4c-b56e-097023e0fd2d tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:21.643991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-864d21fd-df46-4b4c-b56e-097023e0fd2d tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:21.645418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-864d21fd-df46-4b4c-b56e-097023e0fd2d tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:21.651975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-864d21fd-df46-4b4c-b56e-097023e0fd2d tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:21.654395 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-864d21fd-df46-4b4c-b56e-097023e0fd2d tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:22.206292 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cff02989-a8a8-4ca7-b0c5-0a701e17497a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:22.207193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cff02989-a8a8-4ca7-b0c5-0a701e17497a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:22.240690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cff02989-a8a8-4ca7-b0c5-0a701e17497a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:22.241533 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cff02989-a8a8-4ca7-b0c5-0a701e17497a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:22.245299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cff02989-a8a8-4ca7-b0c5-0a701e17497a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:22.246120 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cff02989-a8a8-4ca7-b0c5-0a701e17497a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:22.671052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cff02989-a8a8-4ca7-b0c5-0a701e17497a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:22.703831 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cff02989-a8a8-4ca7-b0c5-0a701e17497a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e" status: 200 len: 1273 microversion: 2.1 time: 0.504733 Jul 25 12:53:22.733005 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1474/3022] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:22 2022] GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e => generated 1273 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:53:22.796521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:22.893098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cff02989-a8a8-4ca7-b0c5-0a701e17497a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:22.895121 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cff02989-a8a8-4ca7-b0c5-0a701e17497a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002542 Jul 25 12:53:22.902745 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1475/3023] 10.222.0.49 () {56 vars in 886 bytes} [Mon Jul 25 12:53:22 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jul 25 12:53:23.657030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=10 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:23.745680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0dd7499f-0703-4e87-9f74-7c0e8461a94e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:23.746847 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0dd7499f-0703-4e87-9f74-7c0e8461a94e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:23.798271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0dd7499f-0703-4e87-9f74-7c0e8461a94e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:23.799104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0dd7499f-0703-4e87-9f74-7c0e8461a94e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:23.813212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0dd7499f-0703-4e87-9f74-7c0e8461a94e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:23.824732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0dd7499f-0703-4e87-9f74-7c0e8461a94e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:23.825087 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-864d21fd-df46-4b4c-b56e-097023e0fd2d tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:23.842136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-864d21fd-df46-4b4c-b56e-097023e0fd2d tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:23.846777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-864d21fd-df46-4b4c-b56e-097023e0fd2d tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:23.852725 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-864d21fd-df46-4b4c-b56e-097023e0fd2d tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 2.247124 Jul 25 12:53:23.861730 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1549/3024] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:53:21 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 2257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:53:24.258161 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0dd7499f-0703-4e87-9f74-7c0e8461a94e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:24.278789 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0dd7499f-0703-4e87-9f74-7c0e8461a94e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e" status: 200 len: 1273 microversion: 2.1 time: 0.540609 Jul 25 12:53:24.280036 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1476/3025] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:23 2022] GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e => generated 1273 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:24.908242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e36d89d1-c390-4e0a-b4ca-acd12db72be8 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:24.910785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e36d89d1-c390-4e0a-b4ca-acd12db72be8 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:24.943155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e36d89d1-c390-4e0a-b4ca-acd12db72be8 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:24.944840 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e36d89d1-c390-4e0a-b4ca-acd12db72be8 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:24.951138 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e36d89d1-c390-4e0a-b4ca-acd12db72be8 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:24.955142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e36d89d1-c390-4e0a-b4ca-acd12db72be8 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:25.330312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2d8253c0-6e90-4e90-924a-6dda0402e533 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:25.340749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2d8253c0-6e90-4e90-924a-6dda0402e533 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:25.381500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d8253c0-6e90-4e90-924a-6dda0402e533 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:25.383083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d8253c0-6e90-4e90-924a-6dda0402e533 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:25.386885 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d8253c0-6e90-4e90-924a-6dda0402e533 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:25.388154 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d8253c0-6e90-4e90-924a-6dda0402e533 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:25.952715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e36d89d1-c390-4e0a-b4ca-acd12db72be8 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:25.963269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e36d89d1-c390-4e0a-b4ca-acd12db72be8 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:25.964896 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e36d89d1-c390-4e0a-b4ca-acd12db72be8 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:25.979021 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e36d89d1-c390-4e0a-b4ca-acd12db72be8 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 1.064617 Jul 25 12:53:25.979733 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1550/3026] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:53:24 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:53:26.950483 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2d8253c0-6e90-4e90-924a-6dda0402e533 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:26.961252 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2d8253c0-6e90-4e90-924a-6dda0402e533 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e" status: 200 len: 1315 microversion: 2.1 time: 1.646662 Jul 25 12:53:26.973988 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1477/3027] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:25 2022] GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e => generated 1315 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:27.018251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-66efc257-d2b4-470d-9ee4-3d69927420ee tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:27.024673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-66efc257-d2b4-470d-9ee4-3d69927420ee tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:27.043310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-66efc257-d2b4-470d-9ee4-3d69927420ee tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:27.043750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-66efc257-d2b4-470d-9ee4-3d69927420ee tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:27.049916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-66efc257-d2b4-470d-9ee4-3d69927420ee tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:27.050995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-66efc257-d2b4-470d-9ee4-3d69927420ee tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:27.999106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-594fc5a5-b0c6-4905-b374-d6a8c351afe8 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:28.002137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-594fc5a5-b0c6-4905-b374-d6a8c351afe8 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:28.021247 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:28.074054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-594fc5a5-b0c6-4905-b374-d6a8c351afe8 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:28.081147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-594fc5a5-b0c6-4905-b374-d6a8c351afe8 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:28.084481 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-594fc5a5-b0c6-4905-b374-d6a8c351afe8 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:28.091445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-594fc5a5-b0c6-4905-b374-d6a8c351afe8 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:28.391900 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=8 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:29.453492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-66efc257-d2b4-470d-9ee4-3d69927420ee tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:29.483932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-66efc257-d2b4-470d-9ee4-3d69927420ee tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:29.487389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-66efc257-d2b4-470d-9ee4-3d69927420ee tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:29.492403 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-66efc257-d2b4-470d-9ee4-3d69927420ee tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 2.484089 Jul 25 12:53:29.493706 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1551/3028] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:53:27 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 2486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:53:30.066324 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-594fc5a5-b0c6-4905-b374-d6a8c351afe8 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:30.093545 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-594fc5a5-b0c6-4905-b374-d6a8c351afe8 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e" status: 200 len: 1315 microversion: 2.1 time: 2.102327 Jul 25 12:53:30.095555 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1478/3029] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:27 2022] GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e => generated 1315 bytes in 2106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:30.548992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-da6ef18a-a30b-43b4-b3cf-85c190412934 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:30.554723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-da6ef18a-a30b-43b4-b3cf-85c190412934 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:30.594734 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da6ef18a-a30b-43b4-b3cf-85c190412934 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:30.595631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da6ef18a-a30b-43b4-b3cf-85c190412934 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:30.610940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da6ef18a-a30b-43b4-b3cf-85c190412934 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:30.611717 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da6ef18a-a30b-43b4-b3cf-85c190412934 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:31.062575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2aa6d161-3803-4bd4-a8c7-5519e5cbe293 tempest-QuotasTestJSON-357708094 tempest-QuotasTestJSON-357708094-project] Calling method '.version_select at 0x7efcf98b5700>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:31.179742 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2aa6d161-3803-4bd4-a8c7-5519e5cbe293 tempest-QuotasTestJSON-357708094 tempest-QuotasTestJSON-357708094-project] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/6c35502478084f25816f205388ef4bd0/defaults" status: 200 len: 371 microversion: 2.1 time: 0.530267 Jul 25 12:53:31.181115 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1479/3030] 10.222.0.49 () {58 vars in 1269 bytes} [Mon Jul 25 12:53:30 2022] GET /compute/v2.1/os-quota-sets/6c35502478084f25816f205388ef4bd0/defaults => generated 371 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:31.203360 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-43a89f55-7d62-4bbe-bd54-c8b676543827 req-9d2300a7-0b70-4dea-982f-75640752e78e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "047c2e76-4cae-4e74-b17b-3dfa337dd56e", "tag": "2c4bc31d-7d15-4fd5-8ca3-94f091fb0f58"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:31.217020 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-43a89f55-7d62-4bbe-bd54-c8b676543827 req-9d2300a7-0b70-4dea-982f-75640752e78e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:31.218197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-43a89f55-7d62-4bbe-bd54-c8b676543827 req-9d2300a7-0b70-4dea-982f-75640752e78e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:31.245375 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-43a89f55-7d62-4bbe-bd54-c8b676543827 req-9d2300a7-0b70-4dea-982f-75640752e78e service nova] Creating event network-changed:2c4bc31d-7d15-4fd5-8ca3-94f091fb0f58 for instance 047c2e76-4cae-4e74-b17b-3dfa337dd56e on n-h2-848886-15 Jul 25 12:53:31.273238 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-43a89f55-7d62-4bbe-bd54-c8b676543827 req-9d2300a7-0b70-4dea-982f-75640752e78e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090780 Jul 25 12:53:31.279058 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1480/3031] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:31.307465 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-43b5701d-8111-47b9-9fbb-a8c5ef249bdd tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:31.311591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-43b5701d-8111-47b9-9fbb-a8c5ef249bdd tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:31.345082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43b5701d-8111-47b9-9fbb-a8c5ef249bdd tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:31.348231 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43b5701d-8111-47b9-9fbb-a8c5ef249bdd tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:31.354183 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43b5701d-8111-47b9-9fbb-a8c5ef249bdd tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:31.355312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43b5701d-8111-47b9-9fbb-a8c5ef249bdd tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:32.371954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-da6ef18a-a30b-43b4-b3cf-85c190412934 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:32.412483 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-da6ef18a-a30b-43b4-b3cf-85c190412934 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:32.417158 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-da6ef18a-a30b-43b4-b3cf-85c190412934 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:32.419545 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-da6ef18a-a30b-43b4-b3cf-85c190412934 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 1.881293 Jul 25 12:53:32.421196 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1552/3032] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:53:30 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:53:32.426804 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4e50e2ce-86bf-48ae-94fb-cacb9710087f tempest-QuotasTestJSON-357708094 tempest-QuotasTestJSON-357708094-project] Calling method '.version_select at 0x7efcf917b280>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:32.556776 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4e50e2ce-86bf-48ae-94fb-cacb9710087f tempest-QuotasTestJSON-357708094 tempest-QuotasTestJSON-357708094-project] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/6c35502478084f25816f205388ef4bd0" status: 200 len: 371 microversion: 2.1 time: 0.133858 Jul 25 12:53:32.571857 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1553/3033] 10.222.0.49 () {58 vars in 1242 bytes} [Mon Jul 25 12:53:32 2022] GET /compute/v2.1/os-quota-sets/6c35502478084f25816f205388ef4bd0 => generated 371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:32.579419 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ec2abbc0-fce8-4b40-b4fd-47f813eb59a4 tempest-QuotasTestJSON-357708094 tempest-QuotasTestJSON-357708094-project] Calling method '.version_select at 0x7efcf91211f0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:32.598856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-43b5701d-8111-47b9-9fbb-a8c5ef249bdd tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:32.607626 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-43b5701d-8111-47b9-9fbb-a8c5ef249bdd tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e" status: 200 len: 1315 microversion: 2.1 time: 1.325940 Jul 25 12:53:32.608230 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1481/3034] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:31 2022] GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e => generated 1315 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:32.710967 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ec2abbc0-fce8-4b40-b4fd-47f813eb59a4 tempest-QuotasTestJSON-357708094 tempest-QuotasTestJSON-357708094-project] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/6c35502478084f25816f205388ef4bd0/defaults" status: 200 len: 371 microversion: 2.1 time: 0.137087 Jul 25 12:53:32.713334 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1554/3035] 10.222.0.49 () {58 vars in 1269 bytes} [Mon Jul 25 12:53:32 2022] GET /compute/v2.1/os-quota-sets/6c35502478084f25816f205388ef4bd0/defaults => generated 371 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:32.737962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8719dc41-de01-4d1c-b42c-b193a69661cd tempest-QuotasTestJSON-357708094 tempest-QuotasTestJSON-357708094-project] Calling method '.version_select at 0x7efcf970e9d0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:32.899347 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8719dc41-de01-4d1c-b42c-b193a69661cd tempest-QuotasTestJSON-357708094 tempest-QuotasTestJSON-357708094-project] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/6c35502478084f25816f205388ef4bd0" status: 200 len: 371 microversion: 2.1 time: 0.169273 Jul 25 12:53:32.911277 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1482/3036] 10.222.0.49 () {58 vars in 1242 bytes} [Mon Jul 25 12:53:32 2022] GET /compute/v2.1/os-quota-sets/6c35502478084f25816f205388ef4bd0 => generated 371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:32.927023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-33c66008-de28-4c84-99bb-c1fce2db11cf tempest-QuotasTestJSON-357708094 tempest-QuotasTestJSON-357708094-project] Calling method '.version_select at 0x7efcf9d34d30>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:33.077629 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-33c66008-de28-4c84-99bb-c1fce2db11cf tempest-QuotasTestJSON-357708094 tempest-QuotasTestJSON-357708094-project] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/6c35502478084f25816f205388ef4bd0?user_id=43d7f6b3f3d34f709214f9cb17f26c4e" status: 200 len: 371 microversion: 2.1 time: 0.162045 Jul 25 12:53:33.087936 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1555/3037] 10.222.0.49 () {58 vars in 1323 bytes} [Mon Jul 25 12:53:32 2022] GET /compute/v2.1/os-quota-sets/6c35502478084f25816f205388ef4bd0?user_id=43d7f6b3f3d34f709214f9cb17f26c4e => generated 371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:33.475870 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cf8c70d6-0bce-433d-8d4e-eb1abf4e7cc1 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:33.478331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cf8c70d6-0bce-433d-8d4e-eb1abf4e7cc1 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:33.519690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf8c70d6-0bce-433d-8d4e-eb1abf4e7cc1 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:33.520869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf8c70d6-0bce-433d-8d4e-eb1abf4e7cc1 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:33.522905 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf8c70d6-0bce-433d-8d4e-eb1abf4e7cc1 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:33.523892 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf8c70d6-0bce-433d-8d4e-eb1abf4e7cc1 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:33.647209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c373d470-04bc-4c53-9ff0-7b9807b64a52 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:33.647785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c373d470-04bc-4c53-9ff0-7b9807b64a52 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:33.666607 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c373d470-04bc-4c53-9ff0-7b9807b64a52 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:33.667111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c373d470-04bc-4c53-9ff0-7b9807b64a52 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:33.667953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c373d470-04bc-4c53-9ff0-7b9807b64a52 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:33.668389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c373d470-04bc-4c53-9ff0-7b9807b64a52 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:35.085336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c373d470-04bc-4c53-9ff0-7b9807b64a52 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:35.105662 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c373d470-04bc-4c53-9ff0-7b9807b64a52 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e" status: 200 len: 1315 microversion: 2.1 time: 1.463524 Jul 25 12:53:35.109322 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1556/3038] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:33 2022] GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e => generated 1315 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:35.125592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b3268474-89db-4e12-b29c-ef21fe0395ed tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:35.126468 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b3268474-89db-4e12-b29c-ef21fe0395ed tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:35.139936 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b3268474-89db-4e12-b29c-ef21fe0395ed tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:35.145463 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b3268474-89db-4e12-b29c-ef21fe0395ed tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:35.146657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b3268474-89db-4e12-b29c-ef21fe0395ed tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:35.147271 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b3268474-89db-4e12-b29c-ef21fe0395ed tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:35.199370 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-b3268474-89db-4e12-b29c-ef21fe0395ed tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] HTTP exception thrown: Instance 4b36eb09-434c-4516-8ea0-7d92019b492f could not be found. Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b3268474-89db-4e12-b29c-ef21fe0395ed tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Request method failure captured: Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f HTTP/1.1 Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pGEBcV00oIrXsYqjQvCG7NrnsUISLUBF1k-iSw8gGnoEJDVl97b6WpvepCB8T-oiRzFC7uWhgFi5JyoGjLeSbgNtevsSUK0SSWDbTSyITDPEbOWycP5Qp71XC2IXqVJyO0Koq1GQfr6-jG4POENX6p10DmdyDclGjGytodI3zSX5s0 Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: af716a8b586d45b2aa95b8c73683ff0d Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersTestMultiNic-996157873 Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_af716a8b586d45b2aa95b8c73683ff0d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/af716a8b586d45b2aa95b8c73683ff0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af716a8b586d45b2aa95b8c73683ff0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af716a8b586d45b2aa95b8c73683ff0d"}]}] Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersTestMultiNic-996157873 Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: af716a8b586d45b2aa95b8c73683ff0d Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersTestMultiNic-996157873 Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersTestMultiNic-996157873-project Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: f912ac6820e44b40977a2913a80c7bec Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersTestMultiNic-996157873-project Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 4b36eb09-434c-4516-8ea0-7d92019b492f could not be found. Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '4b36eb09-434c-4516-8ea0-7d92019b492f'} Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b36eb09-434c-4516-8ea0-7d92019b492f could not be found. Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:53:35.202366 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b36eb09-434c-4516-8ea0-7d92019b492f could not be found. Jul 25 12:53:35.207245 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:35.207245 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:53:35.207245 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:35.207245 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:35.207245 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:53:35.207245 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:53:35.207245 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:53:35.207245 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:53:35.207245 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b36eb09-434c-4516-8ea0-7d92019b492f could not be found. Jul 25 12:53:35.207245 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:35.209579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b3268474-89db-4e12-b29c-ef21fe0395ed tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Returning 404 to user: Instance 4b36eb09-434c-4516-8ea0-7d92019b492f could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:53:35.210513 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b3268474-89db-4e12-b29c-ef21fe0395ed tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 404 len: 111 microversion: 2.1 time: 0.099693 Jul 25 12:53:35.211099 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1557/3039] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:53:35 2022] DELETE /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:53:35.221310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-433cad14-53bf-452b-8982-e044a008e304 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:35.222357 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-433cad14-53bf-452b-8982-e044a008e304 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: 4b36eb09-434c-4516-8ea0-7d92019b492f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:35.231880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-433cad14-53bf-452b-8982-e044a008e304 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:35.232609 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-433cad14-53bf-452b-8982-e044a008e304 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:35.233645 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-433cad14-53bf-452b-8982-e044a008e304 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:35.234449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-433cad14-53bf-452b-8982-e044a008e304 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:35.254095 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-433cad14-53bf-452b-8982-e044a008e304 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] HTTP exception thrown: Instance 4b36eb09-434c-4516-8ea0-7d92019b492f could not be found. Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-433cad14-53bf-452b-8982-e044a008e304 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Request method failure captured: Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f HTTP/1.1 Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pGEBcV00oIrXsYqjQvCG7NrnsUISLUBF1k-iSw8gGnoEJDVl97b6WpvepCB8T-oiRzFC7uWhgFi5JyoGjLeSbgNtevsSUK0SSWDbTSyITDPEbOWycP5Qp71XC2IXqVJyO0Koq1GQfr6-jG4POENX6p10DmdyDclGjGytodI3zSX5s0 Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: af716a8b586d45b2aa95b8c73683ff0d Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersTestMultiNic-996157873 Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_af716a8b586d45b2aa95b8c73683ff0d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/af716a8b586d45b2aa95b8c73683ff0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af716a8b586d45b2aa95b8c73683ff0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af716a8b586d45b2aa95b8c73683ff0d"}]}] Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersTestMultiNic-996157873 Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: af716a8b586d45b2aa95b8c73683ff0d Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersTestMultiNic-996157873 Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersTestMultiNic-996157873-project Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: f912ac6820e44b40977a2913a80c7bec Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersTestMultiNic-996157873-project Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 4b36eb09-434c-4516-8ea0-7d92019b492f could not be found. Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '4b36eb09-434c-4516-8ea0-7d92019b492f'} Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b36eb09-434c-4516-8ea0-7d92019b492f could not be found. Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b36eb09-434c-4516-8ea0-7d92019b492f could not be found. Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:53:35.256319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:35.261039 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:35.261039 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:53:35.261039 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:53:35.261039 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:53:35.261039 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:53:35.261039 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b36eb09-434c-4516-8ea0-7d92019b492f could not be found. Jul 25 12:53:35.261039 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:35.267000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cf8c70d6-0bce-433d-8d4e-eb1abf4e7cc1 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:35.272673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-433cad14-53bf-452b-8982-e044a008e304 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Returning 404 to user: Instance 4b36eb09-434c-4516-8ea0-7d92019b492f could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:53:35.274450 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-433cad14-53bf-452b-8982-e044a008e304 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f" status: 404 len: 111 microversion: 2.1 time: 0.057384 Jul 25 12:53:35.275715 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1558/3040] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:35 2022] GET /compute/v2.1/servers/4b36eb09-434c-4516-8ea0-7d92019b492f => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:53:35.292722 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cf8c70d6-0bce-433d-8d4e-eb1abf4e7cc1 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:35.295575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cf8c70d6-0bce-433d-8d4e-eb1abf4e7cc1 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:35.296389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3bf10234-dc43-45bf-a5e0-e60d4d06a41a tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:35.297139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3bf10234-dc43-45bf-a5e0-e60d4d06a41a tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:35.297719 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cf8c70d6-0bce-433d-8d4e-eb1abf4e7cc1 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 1.838504 Jul 25 12:53:35.304833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3bf10234-dc43-45bf-a5e0-e60d4d06a41a tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:35.305922 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3bf10234-dc43-45bf-a5e0-e60d4d06a41a tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:35.307262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3bf10234-dc43-45bf-a5e0-e60d4d06a41a tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:35.308060 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3bf10234-dc43-45bf-a5e0-e60d4d06a41a tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:35.331029 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1483/3041] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:53:33 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 1873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:53:35.347852 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-3bf10234-dc43-45bf-a5e0-e60d4d06a41a tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] HTTP exception thrown: Instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 could not be found. Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3bf10234-dc43-45bf-a5e0-e60d4d06a41a tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Request method failure captured: Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 HTTP/1.1 Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pGEBcV00oIrXsYqjQvCG7NrnsUISLUBF1k-iSw8gGnoEJDVl97b6WpvepCB8T-oiRzFC7uWhgFi5JyoGjLeSbgNtevsSUK0SSWDbTSyITDPEbOWycP5Qp71XC2IXqVJyO0Koq1GQfr6-jG4POENX6p10DmdyDclGjGytodI3zSX5s0 Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: af716a8b586d45b2aa95b8c73683ff0d Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersTestMultiNic-996157873 Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_af716a8b586d45b2aa95b8c73683ff0d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/af716a8b586d45b2aa95b8c73683ff0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af716a8b586d45b2aa95b8c73683ff0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af716a8b586d45b2aa95b8c73683ff0d"}]}] Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersTestMultiNic-996157873 Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: af716a8b586d45b2aa95b8c73683ff0d Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersTestMultiNic-996157873 Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersTestMultiNic-996157873-project Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: f912ac6820e44b40977a2913a80c7bec Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersTestMultiNic-996157873-project Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 could not be found. Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'bd68f842-1690-4f88-8dc3-f0e72bae78a3'} Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 could not be found. Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:53:35.350262 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 could not be found. Jul 25 12:53:35.356244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:35.356244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:53:35.356244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:35.356244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:35.356244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:53:35.356244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:53:35.356244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:53:35.356244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:53:35.356244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 could not be found. Jul 25 12:53:35.356244 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:53:35.356244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3bf10234-dc43-45bf-a5e0-e60d4d06a41a tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Returning 404 to user: Instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:53:35.356244 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3bf10234-dc43-45bf-a5e0-e60d4d06a41a tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 404 len: 111 microversion: 2.1 time: 0.069465 Jul 25 12:53:35.358614 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1559/3042] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:53:35 2022] DELETE /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:53:35.370711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c1daadb9-92b9-4253-8088-c6211ab669b4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:35.371769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c1daadb9-92b9-4253-8088-c6211ab669b4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] [instance: bd68f842-1690-4f88-8dc3-f0e72bae78a3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:35.404289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c1daadb9-92b9-4253-8088-c6211ab669b4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:35.405164 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c1daadb9-92b9-4253-8088-c6211ab669b4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:35.409967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c1daadb9-92b9-4253-8088-c6211ab669b4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:35.410772 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c1daadb9-92b9-4253-8088-c6211ab669b4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:35.450690 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-c1daadb9-92b9-4253-8088-c6211ab669b4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] HTTP exception thrown: Instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 could not be found. Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c1daadb9-92b9-4253-8088-c6211ab669b4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Request method failure captured: Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 HTTP/1.1 Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pGEBcV00oIrXsYqjQvCG7NrnsUISLUBF1k-iSw8gGnoEJDVl97b6WpvepCB8T-oiRzFC7uWhgFi5JyoGjLeSbgNtevsSUK0SSWDbTSyITDPEbOWycP5Qp71XC2IXqVJyO0Koq1GQfr6-jG4POENX6p10DmdyDclGjGytodI3zSX5s0 Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: af716a8b586d45b2aa95b8c73683ff0d Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersTestMultiNic-996157873 Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_af716a8b586d45b2aa95b8c73683ff0d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/af716a8b586d45b2aa95b8c73683ff0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af716a8b586d45b2aa95b8c73683ff0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af716a8b586d45b2aa95b8c73683ff0d"}]}] Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersTestMultiNic-996157873 Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: af716a8b586d45b2aa95b8c73683ff0d Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersTestMultiNic-996157873 Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersTestMultiNic-996157873-project Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: f912ac6820e44b40977a2913a80c7bec Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersTestMultiNic-996157873-project Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 could not be found. Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'bd68f842-1690-4f88-8dc3-f0e72bae78a3'} Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 could not be found. Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 could not be found. Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:53:35.454767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:53:35.458962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:35.458962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:53:35.458962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:53:35.458962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:53:35.458962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:53:35.458962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 could not be found. Jul 25 12:53:35.458962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:53:35.458962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c1daadb9-92b9-4253-8088-c6211ab669b4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] Returning 404 to user: Instance bd68f842-1690-4f88-8dc3-f0e72bae78a3 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:53:35.458962 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c1daadb9-92b9-4253-8088-c6211ab669b4 tempest-ServersTestMultiNic-996157873 tempest-ServersTestMultiNic-996157873-project] 10.222.0.49 "GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3" status: 404 len: 111 microversion: 2.1 time: 0.094529 Jul 25 12:53:35.466234 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1484/3043] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:35 2022] GET /compute/v2.1/servers/bd68f842-1690-4f88-8dc3-f0e72bae78a3 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:53:36.154219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-49be3595-b526-4a21-996c-ff0cf3bfc1a3 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:36.155321 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-49be3595-b526-4a21-996c-ff0cf3bfc1a3 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:36.205462 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49be3595-b526-4a21-996c-ff0cf3bfc1a3 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:36.209358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49be3595-b526-4a21-996c-ff0cf3bfc1a3 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:36.211144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49be3595-b526-4a21-996c-ff0cf3bfc1a3 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:36.217351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49be3595-b526-4a21-996c-ff0cf3bfc1a3 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:36.340827 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-79c78590-5fbc-4418-bc93-8cb699dbf57c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:36.342289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-79c78590-5fbc-4418-bc93-8cb699dbf57c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:36.350973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79c78590-5fbc-4418-bc93-8cb699dbf57c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:36.351846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79c78590-5fbc-4418-bc93-8cb699dbf57c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:36.356689 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79c78590-5fbc-4418-bc93-8cb699dbf57c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:36.357497 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79c78590-5fbc-4418-bc93-8cb699dbf57c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:37.209651 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-49be3595-b526-4a21-996c-ff0cf3bfc1a3 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:37.222790 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-49be3595-b526-4a21-996c-ff0cf3bfc1a3 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e" status: 200 len: 1315 microversion: 2.1 time: 1.075373 Jul 25 12:53:37.238973 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1560/3044] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:36 2022] GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e => generated 1315 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:38.095402 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-79c78590-5fbc-4418-bc93-8cb699dbf57c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:38.159359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-79c78590-5fbc-4418-bc93-8cb699dbf57c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:38.164724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-79c78590-5fbc-4418-bc93-8cb699dbf57c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:38.169286 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-79c78590-5fbc-4418-bc93-8cb699dbf57c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 1.832804 Jul 25 12:53:38.180140 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1485/3045] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:53:36 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 1836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:53:38.247647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-02c9581f-09b9-4902-bd70-fa83e3405f24 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:38.248700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-02c9581f-09b9-4902-bd70-fa83e3405f24 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:38.282981 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02c9581f-09b9-4902-bd70-fa83e3405f24 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:38.283810 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02c9581f-09b9-4902-bd70-fa83e3405f24 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:38.285243 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02c9581f-09b9-4902-bd70-fa83e3405f24 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:38.312189 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02c9581f-09b9-4902-bd70-fa83e3405f24 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:39.083106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-02c9581f-09b9-4902-bd70-fa83e3405f24 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:39.131946 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-02c9581f-09b9-4902-bd70-fa83e3405f24 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e" status: 200 len: 1315 microversion: 2.1 time: 0.886051 Jul 25 12:53:39.144953 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1561/3046] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:38 2022] GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e => generated 1315 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:39.227722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1c746216-85ff-43e7-822b-8cd01cff63e2 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:39.229409 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1c746216-85ff-43e7-822b-8cd01cff63e2 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:39.246710 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1c746216-85ff-43e7-822b-8cd01cff63e2 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:39.247191 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1c746216-85ff-43e7-822b-8cd01cff63e2 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:39.248451 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1c746216-85ff-43e7-822b-8cd01cff63e2 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:39.249371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1c746216-85ff-43e7-822b-8cd01cff63e2 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:39.268538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-935564e4-3b79-4f42-8cc0-a6366c9255a3 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Action: 'create', calling method: .version_select at 0x7efcf8c98280>, body: {"keypair": {"name": "tempest-keypair-1099618283", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMyA5ibNdjzrtr7y1q16Z1a1tisTq0VgzlLZ3fGAQaVtUBOZWjDwXYezJ5mxOVhmbJIgZl7Qx39OQVyRhaX7MX3PK+XvYIkD3XH3tlGwiGD7L5mn0e1D049tzXIP5qRWhg=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:39.331840 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-935564e4-3b79-4f42-8cc0-a6366c9255a3 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Getting quotas for project 1be80e52f433464e8a9e6b017fcb0753. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:53:39.341151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-935564e4-3b79-4f42-8cc0-a6366c9255a3 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Getting quotas for user 89c5483c74264690afd6467b62c73725 and project 1be80e52f433464e8a9e6b017fcb0753. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:53:39.359068 n-d-848886-15 devstack@n-api.service[125883]: ERROR oslo.messaging._drivers.impl_rabbit [None req-935564e4-3b79-4f42-8cc0-a6366c9255a3 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [89d26934-5c76-41fd-a21c-3bc08c3f5e0b] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 12:53:40.374021 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [None req-935564e4-3b79-4f42-8cc0-a6366c9255a3 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [89d26934-5c76-41fd-a21c-3bc08c3f5e0b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 58882. Jul 25 12:53:40.390535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1c746216-85ff-43e7-822b-8cd01cff63e2 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:40.411325 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-935564e4-3b79-4f42-8cc0-a6366c9255a3 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.624441 Jul 25 12:53:40.425234 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1486/3047] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:53:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:53:40.456987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ee462c0f-5247-4139-b64a-f6d7e3f74146 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:40.459001 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ee462c0f-5247-4139-b64a-f6d7e3f74146 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:40.487274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee462c0f-5247-4139-b64a-f6d7e3f74146 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:40.490834 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee462c0f-5247-4139-b64a-f6d7e3f74146 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:40.503420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee462c0f-5247-4139-b64a-f6d7e3f74146 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:40.504631 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee462c0f-5247-4139-b64a-f6d7e3f74146 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:40.576814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1c746216-85ff-43e7-822b-8cd01cff63e2 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:40.612996 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1c746216-85ff-43e7-822b-8cd01cff63e2 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:40.630803 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1c746216-85ff-43e7-822b-8cd01cff63e2 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 1.413684 Jul 25 12:53:40.632101 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:40.637966 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1562/3048] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:53:39 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:53:41.336155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-863c9109-5403-4df8-a057-9369d76d2f1d req-01819da9-719d-4661-bbd1-bdb52d83ad4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "047c2e76-4cae-4e74-b17b-3dfa337dd56e", "name": "network-vif-plugged", "status": "completed", "tag": "2c4bc31d-7d15-4fd5-8ca3-94f091fb0f58"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:41.427921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-863c9109-5403-4df8-a057-9369d76d2f1d req-01819da9-719d-4661-bbd1-bdb52d83ad4c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:41.429784 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-863c9109-5403-4df8-a057-9369d76d2f1d req-01819da9-719d-4661-bbd1-bdb52d83ad4c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:41.509785 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-863c9109-5403-4df8-a057-9369d76d2f1d req-01819da9-719d-4661-bbd1-bdb52d83ad4c service nova] Creating event network-vif-plugged:2c4bc31d-7d15-4fd5-8ca3-94f091fb0f58 for instance 047c2e76-4cae-4e74-b17b-3dfa337dd56e on n-h2-848886-15 Jul 25 12:53:41.530903 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-863c9109-5403-4df8-a057-9369d76d2f1d req-01819da9-719d-4661-bbd1-bdb52d83ad4c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.884716 Jul 25 12:53:41.538495 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1563/3049] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:41.668173 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b72f0e04-f80d-4a51-9f9b-d75e8f5851de tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:41.668952 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b72f0e04-f80d-4a51-9f9b-d75e8f5851de tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:41.691880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b72f0e04-f80d-4a51-9f9b-d75e8f5851de tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:41.692677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b72f0e04-f80d-4a51-9f9b-d75e8f5851de tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:41.693565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b72f0e04-f80d-4a51-9f9b-d75e8f5851de tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:41.697890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b72f0e04-f80d-4a51-9f9b-d75e8f5851de tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:42.349166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ee462c0f-5247-4139-b64a-f6d7e3f74146 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:42.361124 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ee462c0f-5247-4139-b64a-f6d7e3f74146 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e" status: 200 len: 1315 microversion: 2.1 time: 1.923666 Jul 25 12:53:42.382571 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1487/3050] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:40 2022] GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e => generated 1315 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:43.069378 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:43.391885 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d9f8c44f-796e-464c-97e2-18bedc2e5cfe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:43.395802 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d9f8c44f-796e-464c-97e2-18bedc2e5cfe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:43.427970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b72f0e04-f80d-4a51-9f9b-d75e8f5851de tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:43.443475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9f8c44f-796e-464c-97e2-18bedc2e5cfe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:43.451333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9f8c44f-796e-464c-97e2-18bedc2e5cfe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:43.456093 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b72f0e04-f80d-4a51-9f9b-d75e8f5851de tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:43.456451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9f8c44f-796e-464c-97e2-18bedc2e5cfe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:43.457370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9f8c44f-796e-464c-97e2-18bedc2e5cfe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:43.459190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b72f0e04-f80d-4a51-9f9b-d75e8f5851de tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:43.460835 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b72f0e04-f80d-4a51-9f9b-d75e8f5851de tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 1.800319 Jul 25 12:53:43.485805 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1564/3051] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:53:41 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:53:44.504986 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a66fdca1-1de4-49e5-9bd3-92c475a795ab tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:44.506857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a66fdca1-1de4-49e5-9bd3-92c475a795ab tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:44.522148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a66fdca1-1de4-49e5-9bd3-92c475a795ab tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:44.523690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a66fdca1-1de4-49e5-9bd3-92c475a795ab tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:44.527296 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a66fdca1-1de4-49e5-9bd3-92c475a795ab tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:44.529001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a66fdca1-1de4-49e5-9bd3-92c475a795ab tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:44.598036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d9f8c44f-796e-464c-97e2-18bedc2e5cfe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:44.629350 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d9f8c44f-796e-464c-97e2-18bedc2e5cfe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e" status: 200 len: 1315 microversion: 2.1 time: 1.244105 Jul 25 12:53:44.640047 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1488/3052] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:43 2022] GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e => generated 1315 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:53:45.180655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3730a512-32f1-46f4-b124-d6c02e6a2117 tempest-VolumesTestJSON-448644103 tempest-VolumesTestJSON-448644103-project] Calling method '.version_select at 0x7efcf8c860d0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:45.396365 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3730a512-32f1-46f4-b124-d6c02e6a2117 tempest-VolumesTestJSON-448644103 tempest-VolumesTestJSON-448644103-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/422a37f8-ca12-4b22-9ce6-22d21d5c4bc5" status: 200 len: 351 microversion: 2.1 time: 0.220375 Jul 25 12:53:45.397038 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1489/3053] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Jul 25 12:53:45 2022] GET /compute/v2.1/os-volumes/422a37f8-ca12-4b22-9ce6-22d21d5c4bc5 => generated 351 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:53:45.667425 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-92f480e1-9b8d-4d57-af16-376af3b9fc41 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:45.670016 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-92f480e1-9b8d-4d57-af16-376af3b9fc41 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:45.696312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92f480e1-9b8d-4d57-af16-376af3b9fc41 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:45.700529 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92f480e1-9b8d-4d57-af16-376af3b9fc41 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:45.701885 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92f480e1-9b8d-4d57-af16-376af3b9fc41 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:45.702614 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92f480e1-9b8d-4d57-af16-376af3b9fc41 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:46.086875 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a66fdca1-1de4-49e5-9bd3-92c475a795ab tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:46.171912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a66fdca1-1de4-49e5-9bd3-92c475a795ab tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:46.178147 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a66fdca1-1de4-49e5-9bd3-92c475a795ab tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:46.189615 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a66fdca1-1de4-49e5-9bd3-92c475a795ab tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 1.690870 Jul 25 12:53:46.206210 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1565/3054] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:53:44 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:53:46.895753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-92f480e1-9b8d-4d57-af16-376af3b9fc41 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:46.919811 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-92f480e1-9b8d-4d57-af16-376af3b9fc41 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e" status: 200 len: 1502 microversion: 2.1 time: 1.259338 Jul 25 12:53:46.934390 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1490/3055] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:45 2022] GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e => generated 1502 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:46.962486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cbec34ff-cce0-4b68-aad7-0f52f24e8c43 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:46.963724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cbec34ff-cce0-4b68-aad7-0f52f24e8c43 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:46.977951 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=67 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:46.982557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cbec34ff-cce0-4b68-aad7-0f52f24e8c43 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:46.984441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cbec34ff-cce0-4b68-aad7-0f52f24e8c43 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:46.986566 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cbec34ff-cce0-4b68-aad7-0f52f24e8c43 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:46.990940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cbec34ff-cce0-4b68-aad7-0f52f24e8c43 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:47.136752 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cbec34ff-cce0-4b68-aad7-0f52f24e8c43 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "POST /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e/action" status: 202 len: 0 microversion: 2.1 time: 0.182893 Jul 25 12:53:47.142800 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1566/3056] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:53:46 2022] POST /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:53:47.162797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-27336d5a-330a-47b3-9d85-d8799f5721ff tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:47.164546 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-27336d5a-330a-47b3-9d85-d8799f5721ff tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:47.186880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27336d5a-330a-47b3-9d85-d8799f5721ff tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:47.189873 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27336d5a-330a-47b3-9d85-d8799f5721ff tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:47.191062 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27336d5a-330a-47b3-9d85-d8799f5721ff tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:47.191857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27336d5a-330a-47b3-9d85-d8799f5721ff tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:47.245310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-16e1d990-4867-4e18-ad14-2d117de992fd tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:47.255655 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-16e1d990-4867-4e18-ad14-2d117de992fd tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:47.289113 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16e1d990-4867-4e18-ad14-2d117de992fd tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:47.308001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16e1d990-4867-4e18-ad14-2d117de992fd tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:47.311706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16e1d990-4867-4e18-ad14-2d117de992fd tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:47.316526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16e1d990-4867-4e18-ad14-2d117de992fd tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:47.896023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-27336d5a-330a-47b3-9d85-d8799f5721ff tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:47.929823 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-27336d5a-330a-47b3-9d85-d8799f5721ff tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e" status: 200 len: 1507 microversion: 2.1 time: 0.782861 Jul 25 12:53:47.986031 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1491/3057] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:47 2022] GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e => generated 1507 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:48.010689 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-323969d3-8d10-4900-810b-90acd6a61ab3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:48.013314 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-323969d3-8d10-4900-810b-90acd6a61ab3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:48.037094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-323969d3-8d10-4900-810b-90acd6a61ab3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:48.040941 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-323969d3-8d10-4900-810b-90acd6a61ab3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:48.044377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-323969d3-8d10-4900-810b-90acd6a61ab3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:48.045687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-323969d3-8d10-4900-810b-90acd6a61ab3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:49.180850 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-16e1d990-4867-4e18-ad14-2d117de992fd tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:49.183447 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:49.199378 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-16e1d990-4867-4e18-ad14-2d117de992fd tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:49.200037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-323969d3-8d10-4900-810b-90acd6a61ab3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:49.203666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-16e1d990-4867-4e18-ad14-2d117de992fd tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:49.204900 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-16e1d990-4867-4e18-ad14-2d117de992fd tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 1.976063 Jul 25 12:53:49.205552 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1567/3058] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:53:47 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:53:49.232806 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b93499bc-718d-4d40-8b56-03c654e3923e tempest-VolumesTestJSON-448644103 tempest-VolumesTestJSON-448644103-project] Calling method '.version_select at 0x7efcf9b4c430>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:49.239097 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-323969d3-8d10-4900-810b-90acd6a61ab3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 1.250762 Jul 25 12:53:49.252005 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1492/3059] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:47 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:49.280037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-959f2622-bd5f-40f5-8304-ac75e8533557 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:49.281505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-959f2622-bd5f-40f5-8304-ac75e8533557 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:49.290616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-959f2622-bd5f-40f5-8304-ac75e8533557 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:49.291991 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-959f2622-bd5f-40f5-8304-ac75e8533557 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:49.293764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-959f2622-bd5f-40f5-8304-ac75e8533557 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:49.295270 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-959f2622-bd5f-40f5-8304-ac75e8533557 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:49.325540 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b93499bc-718d-4d40-8b56-03c654e3923e tempest-VolumesTestJSON-448644103 tempest-VolumesTestJSON-448644103-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/1a41f4f5-7e91-46ba-a3bd-0d4a53dec187" status: 200 len: 351 microversion: 2.1 time: 0.098917 Jul 25 12:53:49.327176 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1568/3060] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Jul 25 12:53:49 2022] GET /compute/v2.1/os-volumes/1a41f4f5-7e91-46ba-a3bd-0d4a53dec187 => generated 351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:49.344626 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-96f054d6-50b3-4320-96db-9928b650fe1e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1917915081"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:49.352688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-96f054d6-50b3-4320-96db-9928b650fe1e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:49.358731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:49.361598 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-96f054d6-50b3-4320-96db-9928b650fe1e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:49.362066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-96f054d6-50b3-4320-96db-9928b650fe1e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:49.363446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-96f054d6-50b3-4320-96db-9928b650fe1e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:49.364042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-96f054d6-50b3-4320-96db-9928b650fe1e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:49.770217 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-96f054d6-50b3-4320-96db-9928b650fe1e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action" status: 202 len: 0 microversion: 2.1 time: 0.440801 Jul 25 12:53:49.788584 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1569/3061] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:53:49 2022] POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 25 12:53:49.915991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2946996c-0673-404a-9d85-c38a8365272d tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "866e064d-653d-4645-a61a-8455976e2200"}], "security_groups": [{"name": "tempest-securitygroup--1159545848"}], "key_name": "tempest-keypair-1099618283", "user_data": "}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:49.937073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-959f2622-bd5f-40f5-8304-ac75e8533557 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:49.957721 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-959f2622-bd5f-40f5-8304-ac75e8533557 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e" status: 200 len: 1487 microversion: 2.1 time: 0.703848 Jul 25 12:53:49.972288 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1493/3062] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:49 2022] GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e => generated 1487 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:49.996646 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f2689a6b-8220-4228-b823-4bd5d5f6744d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:49.997648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f2689a6b-8220-4228-b823-4bd5d5f6744d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:50.041571 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f2689a6b-8220-4228-b823-4bd5d5f6744d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:50.045502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f2689a6b-8220-4228-b823-4bd5d5f6744d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:50.048813 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f2689a6b-8220-4228-b823-4bd5d5f6744d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:50.075619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f2689a6b-8220-4228-b823-4bd5d5f6744d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:50.224243 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f2689a6b-8220-4228-b823-4bd5d5f6744d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:53:50.305989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-2946996c-0673-404a-9d85-c38a8365272d tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] validate_networks() for [('866e064d-653d-4645-a61a-8455976e2200', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:53:50.507574 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f2689a6b-8220-4228-b823-4bd5d5f6744d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e" status: 204 len: 0 microversion: 2.1 time: 0.514684 Jul 25 12:53:50.511112 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1494/3063] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:53:49 2022] DELETE /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:53:50.544310 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0e31ee02-ba15-4029-98e2-f6dc36d477ec tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:50.555880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0e31ee02-ba15-4029-98e2-f6dc36d477ec tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:50.572507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e31ee02-ba15-4029-98e2-f6dc36d477ec tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:50.574065 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e31ee02-ba15-4029-98e2-f6dc36d477ec tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:50.576533 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e31ee02-ba15-4029-98e2-f6dc36d477ec tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:50.577685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e31ee02-ba15-4029-98e2-f6dc36d477ec tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:51.473768 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0e31ee02-ba15-4029-98e2-f6dc36d477ec tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:51.492257 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0e31ee02-ba15-4029-98e2-f6dc36d477ec tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:51.494024 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0e31ee02-ba15-4029-98e2-f6dc36d477ec tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:51.496297 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0e31ee02-ba15-4029-98e2-f6dc36d477ec tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 0.981360 Jul 25 12:53:51.497919 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1495/3064] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:53:50 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:53:51.503615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a2638d91-e05b-41a4-9a46-5fc9de44863e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:51.504589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a2638d91-e05b-41a4-9a46-5fc9de44863e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:51.512411 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2638d91-e05b-41a4-9a46-5fc9de44863e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:51.513972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2638d91-e05b-41a4-9a46-5fc9de44863e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:51.515175 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2638d91-e05b-41a4-9a46-5fc9de44863e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:51.515959 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2638d91-e05b-41a4-9a46-5fc9de44863e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:51.905989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-2946996c-0673-404a-9d85-c38a8365272d tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:53:51.907172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-2946996c-0673-404a-9d85-c38a8365272d tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:53:51.907901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-2946996c-0673-404a-9d85-c38a8365272d tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:53:51.908490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-2946996c-0673-404a-9d85-c38a8365272d tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:53:51.909543 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-2946996c-0673-404a-9d85-c38a8365272d tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:53:51.931937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2946996c-0673-404a-9d85-c38a8365272d tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:51.932651 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2946996c-0673-404a-9d85-c38a8365272d tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:51.933752 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2946996c-0673-404a-9d85-c38a8365272d tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:51.934439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2946996c-0673-404a-9d85-c38a8365272d tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:51.937868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a2638d91-e05b-41a4-9a46-5fc9de44863e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:51.958616 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a2638d91-e05b-41a4-9a46-5fc9de44863e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e" status: 200 len: 1493 microversion: 2.1 time: 0.453329 Jul 25 12:53:51.960517 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1496/3065] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:51 2022] GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e => generated 1493 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:51.970442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-69598787-87b5-4314-8d6f-b0cdc9d8cc0a req-0a53120b-e8c7-438d-9717-36e419a00cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b730aecb-2c1f-46ef-b457-8a3717655518", "name": "network-vif-unplugged", "status": "completed", "tag": "45191120-4204-4de7-9ef8-5d5c4ba83f89"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:51.980711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-2946996c-0673-404a-9d85-c38a8365272d tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Getting quotas for project 1be80e52f433464e8a9e6b017fcb0753. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:53:51.986887 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-69598787-87b5-4314-8d6f-b0cdc9d8cc0a req-0a53120b-e8c7-438d-9717-36e419a00cf9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:51.987959 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-69598787-87b5-4314-8d6f-b0cdc9d8cc0a req-0a53120b-e8c7-438d-9717-36e419a00cf9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:51.992020 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-2946996c-0673-404a-9d85-c38a8365272d tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Getting quotas for user 89c5483c74264690afd6467b62c73725 and project 1be80e52f433464e8a9e6b017fcb0753. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:53:52.013684 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-69598787-87b5-4314-8d6f-b0cdc9d8cc0a req-0a53120b-e8c7-438d-9717-36e419a00cf9 service nova] Creating event network-vif-unplugged:45191120-4204-4de7-9ef8-5d5c4ba83f89 for instance b730aecb-2c1f-46ef-b457-8a3717655518 on n-h1-848886-15 Jul 25 12:53:52.020638 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-69598787-87b5-4314-8d6f-b0cdc9d8cc0a req-0a53120b-e8c7-438d-9717-36e419a00cf9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057993 Jul 25 12:53:52.022258 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1497/3066] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:52.022727 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2946996c-0673-404a-9d85-c38a8365272d tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:53:52.025505 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2946996c-0673-404a-9d85-c38a8365272d tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [instance: dbe0a495-7647-4b23-96c1-e46073e497eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:53:52.116504 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2946996c-0673-404a-9d85-c38a8365272d tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.207705 Jul 25 12:53:52.120770 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1570/3067] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:53:49 2022] POST /compute/v2.1/servers => generated 409 bytes in 2213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:53:52.129467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-62b609c0-22b4-4887-b14e-ae04db0ab1de tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:52.135056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-62b609c0-22b4-4887-b14e-ae04db0ab1de tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [instance: dbe0a495-7647-4b23-96c1-e46073e497eb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:52.281519 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-62b609c0-22b4-4887-b14e-ae04db0ab1de tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c5483c74264690afd6467b62c73725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be80e52f433464e8a9e6b017fcb0753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:52.297677 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-62b609c0-22b4-4887-b14e-ae04db0ab1de tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb" status: 200 len: 1226 microversion: 2.1 time: 0.167111 Jul 25 12:53:52.299255 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1498/3068] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:52 2022] GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb => generated 1226 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:53:52.385464 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9a7aed32-8a0d-44c4-b121-1f0044c6b963 tempest-VolumesTestJSON-448644103 tempest-VolumesTestJSON-448644103-project] Calling method '.version_select at 0x7efcf9bace50>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:52.527867 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9a7aed32-8a0d-44c4-b121-1f0044c6b963 tempest-VolumesTestJSON-448644103 tempest-VolumesTestJSON-448644103-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/0b5019e5-0cc3-4efa-a7e6-91d24e5276da" status: 200 len: 350 microversion: 2.1 time: 0.148599 Jul 25 12:53:52.531920 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-830998e1-200a-40fd-8014-c0aa7546ec8f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:52.532660 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-830998e1-200a-40fd-8014-c0aa7546ec8f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:52.541373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:52.543382 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1571/3069] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Jul 25 12:53:52 2022] GET /compute/v2.1/os-volumes/0b5019e5-0cc3-4efa-a7e6-91d24e5276da => generated 350 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:52.557159 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3e628808-dbaf-40f6-95f0-688e2e87a8de tempest-VolumesTestJSON-448644103 tempest-VolumesTestJSON-448644103-project] Calling method '.version_select at 0x7efcf91b1040>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:52.562042 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-830998e1-200a-40fd-8014-c0aa7546ec8f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:52.562534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-830998e1-200a-40fd-8014-c0aa7546ec8f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:52.563663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-830998e1-200a-40fd-8014-c0aa7546ec8f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:52.564292 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-830998e1-200a-40fd-8014-c0aa7546ec8f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:52.773380 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3e628808-dbaf-40f6-95f0-688e2e87a8de tempest-VolumesTestJSON-448644103 tempest-VolumesTestJSON-448644103-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.227081 Jul 25 12:53:52.774520 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1572/3070] 10.222.0.49 () {58 vars in 1134 bytes} [Mon Jul 25 12:53:52 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:52.792849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-62fc458e-21df-4489-9c3b-d458d1f57cdd tempest-VolumesTestJSON-448644103 tempest-VolumesTestJSON-448644103-project] Calling method '.version_select at 0x7efcfedff0d0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:53.089928 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-62fc458e-21df-4489-9c3b-d458d1f57cdd tempest-VolumesTestJSON-448644103 tempest-VolumesTestJSON-448644103-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.298942 Jul 25 12:53:53.090862 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1573/3071] 10.222.0.49 () {58 vars in 1149 bytes} [Mon Jul 25 12:53:52 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:53.108014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-33a760ee-49ae-40eb-aa85-55cc57295925 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:53.118402 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-33a760ee-49ae-40eb-aa85-55cc57295925 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:53.150811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-33a760ee-49ae-40eb-aa85-55cc57295925 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:53.151269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-33a760ee-49ae-40eb-aa85-55cc57295925 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:53.152073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-33a760ee-49ae-40eb-aa85-55cc57295925 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:53.152513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-33a760ee-49ae-40eb-aa85-55cc57295925 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:53.556773 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-830998e1-200a-40fd-8014-c0aa7546ec8f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:53.572976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-830998e1-200a-40fd-8014-c0aa7546ec8f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:53.577706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-830998e1-200a-40fd-8014-c0aa7546ec8f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:53.579338 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-830998e1-200a-40fd-8014-c0aa7546ec8f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 1.054913 Jul 25 12:53:53.583557 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1499/3072] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:53:52 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:53:53.588973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8dc08124-d23b-44c5-bbc9-1b148e53f2e8 tempest-VolumesTestJSON-448644103 tempest-VolumesTestJSON-448644103-project] Calling method '.version_select at 0x7efcf8dcc1f0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:53.729807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-33a760ee-49ae-40eb-aa85-55cc57295925 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:53.748639 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-33a760ee-49ae-40eb-aa85-55cc57295925 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e" status: 200 len: 1493 microversion: 2.1 time: 0.654142 Jul 25 12:53:53.775856 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1574/3073] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:53 2022] GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e => generated 1493 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:53.789904 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8dc08124-d23b-44c5-bbc9-1b148e53f2e8 tempest-VolumesTestJSON-448644103 tempest-VolumesTestJSON-448644103-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.197438 Jul 25 12:53:53.789904 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1500/3074] 10.222.0.49 () {58 vars in 1134 bytes} [Mon Jul 25 12:53:53 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:53.799172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8d40c29c-4b3d-4b44-b332-ca2b35ad71f3 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:53.801430 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8d40c29c-4b3d-4b44-b332-ca2b35ad71f3 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [instance: dbe0a495-7647-4b23-96c1-e46073e497eb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:53.810090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3d06082e-4c61-4176-a596-f90eb3d2a44d tempest-VolumesTestJSON-448644103 tempest-VolumesTestJSON-448644103-project] Calling method '.version_select at 0x7efcf8c98700>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:53.817008 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d40c29c-4b3d-4b44-b332-ca2b35ad71f3 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:53.818078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d40c29c-4b3d-4b44-b332-ca2b35ad71f3 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:53.819837 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d40c29c-4b3d-4b44-b332-ca2b35ad71f3 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:53.820971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d40c29c-4b3d-4b44-b332-ca2b35ad71f3 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:54.042123 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3d06082e-4c61-4176-a596-f90eb3d2a44d tempest-VolumesTestJSON-448644103 tempest-VolumesTestJSON-448644103-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.240049 Jul 25 12:53:54.055133 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1501/3075] 10.222.0.49 () {58 vars in 1167 bytes} [Mon Jul 25 12:53:53 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:54.061196 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f245f2f1-4669-474b-a6b5-e0e2d3528e39 tempest-VolumesTestJSON-448644103 tempest-VolumesTestJSON-448644103-project] Calling method '.version_select at 0x7efcf8c981f0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:54.087535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8d40c29c-4b3d-4b44-b332-ca2b35ad71f3 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c5483c74264690afd6467b62c73725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be80e52f433464e8a9e6b017fcb0753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:54.109208 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8d40c29c-4b3d-4b44-b332-ca2b35ad71f3 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb" status: 200 len: 1278 microversion: 2.1 time: 0.330920 Jul 25 12:53:54.135641 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1575/3076] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:53 2022] GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb => generated 1278 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:54.424504 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f245f2f1-4669-474b-a6b5-e0e2d3528e39 tempest-VolumesTestJSON-448644103 tempest-VolumesTestJSON-448644103-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.367684 Jul 25 12:53:54.425113 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1502/3077] 10.222.0.49 () {58 vars in 1170 bytes} [Mon Jul 25 12:53:54 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:54.431974 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-676e69a7-cc77-4be3-b620-bc1ae6e1f141 req-44531f94-0900-4bf1-8e2d-d60e5575fa31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b730aecb-2c1f-46ef-b457-8a3717655518", "name": "network-vif-plugged", "status": "completed", "tag": "45191120-4204-4de7-9ef8-5d5c4ba83f89"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:54.451084 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e7bf308b-750a-4115-b256-9c7cd4412e35 tempest-VolumesTestJSON-448644103 tempest-VolumesTestJSON-448644103-project] Calling method '.version_select at 0x7efcf8dcc1f0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:54.477508 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-676e69a7-cc77-4be3-b620-bc1ae6e1f141 req-44531f94-0900-4bf1-8e2d-d60e5575fa31 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:54.483304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-676e69a7-cc77-4be3-b620-bc1ae6e1f141 req-44531f94-0900-4bf1-8e2d-d60e5575fa31 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:54.542379 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-676e69a7-cc77-4be3-b620-bc1ae6e1f141 req-44531f94-0900-4bf1-8e2d-d60e5575fa31 service nova] Creating event network-vif-plugged:45191120-4204-4de7-9ef8-5d5c4ba83f89 for instance b730aecb-2c1f-46ef-b457-8a3717655518 on n-h1-848886-15 Jul 25 12:53:54.561893 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-676e69a7-cc77-4be3-b620-bc1ae6e1f141 req-44531f94-0900-4bf1-8e2d-d60e5575fa31 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138180 Jul 25 12:53:54.565153 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1576/3078] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:53:54.639932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-41a38590-9a7f-48fc-b758-94e6a9facec0 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:54.644643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-41a38590-9a7f-48fc-b758-94e6a9facec0 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:54.689016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-41a38590-9a7f-48fc-b758-94e6a9facec0 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:54.695367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-41a38590-9a7f-48fc-b758-94e6a9facec0 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:54.699261 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-41a38590-9a7f-48fc-b758-94e6a9facec0 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:54.705598 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-41a38590-9a7f-48fc-b758-94e6a9facec0 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:54.775583 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e7bf308b-750a-4115-b256-9c7cd4412e35 tempest-VolumesTestJSON-448644103 tempest-VolumesTestJSON-448644103-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.325321 Jul 25 12:53:54.779190 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1503/3079] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Jul 25 12:53:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:54.798873 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-1cb0cc0a-315a-4261-bcd9-bd4688824337 req-349c3c66-e7a2-485c-8491-59f886a714cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "047c2e76-4cae-4e74-b17b-3dfa337dd56e", "name": "network-vif-deleted", "tag": "2c4bc31d-7d15-4fd5-8ca3-94f091fb0f58"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:54.829403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-1cb0cc0a-315a-4261-bcd9-bd4688824337 req-349c3c66-e7a2-485c-8491-59f886a714cf service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:54.830155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-1cb0cc0a-315a-4261-bcd9-bd4688824337 req-349c3c66-e7a2-485c-8491-59f886a714cf service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:54.847930 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-1cb0cc0a-315a-4261-bcd9-bd4688824337 req-349c3c66-e7a2-485c-8491-59f886a714cf service nova] Creating event network-vif-deleted:2c4bc31d-7d15-4fd5-8ca3-94f091fb0f58 for instance 047c2e76-4cae-4e74-b17b-3dfa337dd56e on n-h2-848886-15 Jul 25 12:53:54.878925 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-1cb0cc0a-315a-4261-bcd9-bd4688824337 req-349c3c66-e7a2-485c-8491-59f886a714cf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095788 Jul 25 12:53:54.891664 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1504/3080] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:54.931762 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6e225b36-8e99-427e-bd5f-06637d8c08b3 tempest-VolumesTestJSON-448644103 tempest-VolumesTestJSON-448644103-project] Calling method '.version_select at 0x7efcf9df7040>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:55.228823 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6e225b36-8e99-427e-bd5f-06637d8c08b3 tempest-VolumesTestJSON-448644103 tempest-VolumesTestJSON-448644103-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.335340 Jul 25 12:53:55.229411 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1505/3081] 10.222.0.49 () {58 vars in 1188 bytes} [Mon Jul 25 12:53:54 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:55.235538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e1b76c05-5808-40c9-81ba-62e5a542d846 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:55.238932 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e1b76c05-5808-40c9-81ba-62e5a542d846 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:55.260850 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1b76c05-5808-40c9-81ba-62e5a542d846 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:55.262223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1b76c05-5808-40c9-81ba-62e5a542d846 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:55.264228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1b76c05-5808-40c9-81ba-62e5a542d846 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:55.265545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1b76c05-5808-40c9-81ba-62e5a542d846 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:55.302934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-41a38590-9a7f-48fc-b758-94e6a9facec0 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:55.339224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-41a38590-9a7f-48fc-b758-94e6a9facec0 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:55.343764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-41a38590-9a7f-48fc-b758-94e6a9facec0 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:55.347457 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-41a38590-9a7f-48fc-b758-94e6a9facec0 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 0.735257 Jul 25 12:53:55.349055 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1577/3082] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:53:54 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:53:55.376258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-02d7e544-5906-4c5a-af36-9b6f6150e33e tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:55.384696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-02d7e544-5906-4c5a-af36-9b6f6150e33e tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [instance: dbe0a495-7647-4b23-96c1-e46073e497eb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:55.392255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1b76c05-5808-40c9-81ba-62e5a542d846 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:55.393707 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1b76c05-5808-40c9-81ba-62e5a542d846 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:55.394858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-e1b76c05-5808-40c9-81ba-62e5a542d846 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lazy-loading 'fault' on Instance uuid 047c2e76-4cae-4e74-b17b-3dfa337dd56e {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:53:55.431342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02d7e544-5906-4c5a-af36-9b6f6150e33e tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:55.435688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02d7e544-5906-4c5a-af36-9b6f6150e33e tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:55.437602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02d7e544-5906-4c5a-af36-9b6f6150e33e tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:55.441121 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02d7e544-5906-4c5a-af36-9b6f6150e33e tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:55.539133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e1b76c05-5808-40c9-81ba-62e5a542d846 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:55.590690 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e1b76c05-5808-40c9-81ba-62e5a542d846 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e" status: 200 len: 1305 microversion: 2.1 time: 0.360051 Jul 25 12:53:55.598959 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1506/3083] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:55 2022] GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e => generated 1305 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:55.604328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b0b31267-ed8e-4d5f-8b6d-bdef3330ee2d tempest-VolumesTestJSON-448644103 tempest-VolumesTestJSON-448644103-project] Calling method '.version_select at 0x7efcf9df74c0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:55.716559 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-02d7e544-5906-4c5a-af36-9b6f6150e33e tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c5483c74264690afd6467b62c73725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be80e52f433464e8a9e6b017fcb0753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:55.733488 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-02d7e544-5906-4c5a-af36-9b6f6150e33e tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb" status: 200 len: 1284 microversion: 2.1 time: 0.382661 Jul 25 12:53:55.735464 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1578/3084] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:55 2022] GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb => generated 1284 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:55.867165 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b0b31267-ed8e-4d5f-8b6d-bdef3330ee2d tempest-VolumesTestJSON-448644103 tempest-VolumesTestJSON-448644103-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.266677 Jul 25 12:53:55.877921 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1507/3085] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Jul 25 12:53:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:56.379978 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-829e30c8-6bc1-4a96-a6c4-6739843e99e2 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:56.380828 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-829e30c8-6bc1-4a96-a6c4-6739843e99e2 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:56.396171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-829e30c8-6bc1-4a96-a6c4-6739843e99e2 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:56.398556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-829e30c8-6bc1-4a96-a6c4-6739843e99e2 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:56.399477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-829e30c8-6bc1-4a96-a6c4-6739843e99e2 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:56.399925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-829e30c8-6bc1-4a96-a6c4-6739843e99e2 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:56.649449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a16354bc-f82a-4dea-a605-f1baf891a8c3 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:56.650578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a16354bc-f82a-4dea-a605-f1baf891a8c3 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:56.676331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a16354bc-f82a-4dea-a605-f1baf891a8c3 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:56.679741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a16354bc-f82a-4dea-a605-f1baf891a8c3 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:56.682645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a16354bc-f82a-4dea-a605-f1baf891a8c3 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:56.687820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a16354bc-f82a-4dea-a605-f1baf891a8c3 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:56.727773 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-a16354bc-f82a-4dea-a605-f1baf891a8c3 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] HTTP exception thrown: Instance 047c2e76-4cae-4e74-b17b-3dfa337dd56e could not be found. Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a16354bc-f82a-4dea-a605-f1baf891a8c3 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Request method failure captured: Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e HTTP/1.1 Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pHF7UCaF8gOsr4izIJsQMgDEa0djLGcj88wHujy3LL3KrSKed1jp5p2g1uyl0B7FckQX0z38dpjtGtJDzQMYAlTS7LRfENWczpgFqPzdGM6KYoCp6qrqJdc7QEkc58SEBAWEj2A4h5-asWJS2CIcfkxwvHFTYem8sDn2kkqArMxtZA Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f07680a55b3f41408d3a284d1330503d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}] Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: d28f966411004a158377c689fd5b05eb Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 047c2e76-4cae-4e74-b17b-3dfa337dd56e could not be found. Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '047c2e76-4cae-4e74-b17b-3dfa337dd56e'} Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 047c2e76-4cae-4e74-b17b-3dfa337dd56e could not be found. Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 047c2e76-4cae-4e74-b17b-3dfa337dd56e could not be found. Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:53:56.729980 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:53:56.734552 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:53:56.734552 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:53:56.734552 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:53:56.734552 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:53:56.734552 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:53:56.734552 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 047c2e76-4cae-4e74-b17b-3dfa337dd56e could not be found. Jul 25 12:53:56.734552 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:53:56.737534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a16354bc-f82a-4dea-a605-f1baf891a8c3 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Returning 404 to user: Instance 047c2e76-4cae-4e74-b17b-3dfa337dd56e could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:53:56.738723 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a16354bc-f82a-4dea-a605-f1baf891a8c3 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e" status: 404 len: 111 microversion: 2.1 time: 0.108907 Jul 25 12:53:56.744101 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1508/3086] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:56 2022] GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:53:56.763996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1caa01e5-78fb-41c3-9b3d-a8f8f4666cdc tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:56.764956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1caa01e5-78fb-41c3-9b3d-a8f8f4666cdc tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [instance: dbe0a495-7647-4b23-96c1-e46073e497eb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:56.778211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1caa01e5-78fb-41c3-9b3d-a8f8f4666cdc tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:56.779059 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1caa01e5-78fb-41c3-9b3d-a8f8f4666cdc tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:56.783545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1caa01e5-78fb-41c3-9b3d-a8f8f4666cdc tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:56.784600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1caa01e5-78fb-41c3-9b3d-a8f8f4666cdc tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:57.384532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1caa01e5-78fb-41c3-9b3d-a8f8f4666cdc tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c5483c74264690afd6467b62c73725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be80e52f433464e8a9e6b017fcb0753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:57.407656 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1caa01e5-78fb-41c3-9b3d-a8f8f4666cdc tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb" status: 200 len: 1284 microversion: 2.1 time: 0.648396 Jul 25 12:53:57.418825 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1509/3087] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:56 2022] GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb => generated 1284 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:53:57.438039 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d5625443-3dbd-4ba0-a41d-101a04da5ede tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-785238869", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "b6926756-00b4-4271-8538-f2e94168b61a"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:57.608832 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-d5625443-3dbd-4ba0-a41d-101a04da5ede tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] validate_networks() for [('b6926756-00b4-4271-8538-f2e94168b61a', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:53:59.026433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-829e30c8-6bc1-4a96-a6c4-6739843e99e2 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:59.047205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-829e30c8-6bc1-4a96-a6c4-6739843e99e2 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:59.052312 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-829e30c8-6bc1-4a96-a6c4-6739843e99e2 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:59.068598 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-829e30c8-6bc1-4a96-a6c4-6739843e99e2 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 2.690713 Jul 25 12:53:59.073783 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1579/3088] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:53:56 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 2698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:53:59.112111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0c348053-1cbc-433f-85ea-e0f8f7d582a1 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:59.118726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0c348053-1cbc-433f-85ea-e0f8f7d582a1 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [instance: dbe0a495-7647-4b23-96c1-e46073e497eb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:59.154821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0c348053-1cbc-433f-85ea-e0f8f7d582a1 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:59.160533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0c348053-1cbc-433f-85ea-e0f8f7d582a1 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:59.173251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0c348053-1cbc-433f-85ea-e0f8f7d582a1 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:59.174762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0c348053-1cbc-433f-85ea-e0f8f7d582a1 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:59.605192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0c348053-1cbc-433f-85ea-e0f8f7d582a1 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c5483c74264690afd6467b62c73725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be80e52f433464e8a9e6b017fcb0753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:59.637762 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0c348053-1cbc-433f-85ea-e0f8f7d582a1 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb" status: 200 len: 1284 microversion: 2.1 time: 0.553333 Jul 25 12:53:59.639823 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1580/3089] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:59 2022] GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb => generated 1284 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:00.101560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-30dce210-eb5a-4e9c-ae32-03b7ca8d25ee tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:00.103320 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-30dce210-eb5a-4e9c-ae32-03b7ca8d25ee tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:00.120012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-30dce210-eb5a-4e9c-ae32-03b7ca8d25ee tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:00.120691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-30dce210-eb5a-4e9c-ae32-03b7ca8d25ee tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:00.123073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-30dce210-eb5a-4e9c-ae32-03b7ca8d25ee tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:00.123664 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-30dce210-eb5a-4e9c-ae32-03b7ca8d25ee tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:00.449812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-d5625443-3dbd-4ba0-a41d-101a04da5ede tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:54:00.450420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-d5625443-3dbd-4ba0-a41d-101a04da5ede tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:54:00.451092 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-d5625443-3dbd-4ba0-a41d-101a04da5ede tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:54:00.451785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-d5625443-3dbd-4ba0-a41d-101a04da5ede tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:54:00.453212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-d5625443-3dbd-4ba0-a41d-101a04da5ede tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:54:00.490796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d5625443-3dbd-4ba0-a41d-101a04da5ede tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:00.491256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d5625443-3dbd-4ba0-a41d-101a04da5ede tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:00.492073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d5625443-3dbd-4ba0-a41d-101a04da5ede tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:00.492522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d5625443-3dbd-4ba0-a41d-101a04da5ede tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:00.584732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-d5625443-3dbd-4ba0-a41d-101a04da5ede tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Getting quotas for project f07680a55b3f41408d3a284d1330503d. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:54:00.593859 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-d5625443-3dbd-4ba0-a41d-101a04da5ede tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Getting quotas for user d28f966411004a158377c689fd5b05eb and project f07680a55b3f41408d3a284d1330503d. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:54:00.639908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d5625443-3dbd-4ba0-a41d-101a04da5ede tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:54:00.664069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d5625443-3dbd-4ba0-a41d-101a04da5ede tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:54:00.839249 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d5625443-3dbd-4ba0-a41d-101a04da5ede tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.417492 Jul 25 12:54:00.855949 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1510/3090] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:53:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 3432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:54:00.868094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-325ad92d-0be4-4771-8ec9-80b3569bcda5 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:00.870542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-325ad92d-0be4-4771-8ec9-80b3569bcda5 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [instance: dbe0a495-7647-4b23-96c1-e46073e497eb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:00.887862 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-325ad92d-0be4-4771-8ec9-80b3569bcda5 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:00.891172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-325ad92d-0be4-4771-8ec9-80b3569bcda5 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:00.892703 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-325ad92d-0be4-4771-8ec9-80b3569bcda5 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:00.895325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-325ad92d-0be4-4771-8ec9-80b3569bcda5 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:01.950001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:02.001012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:02.033487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-325ad92d-0be4-4771-8ec9-80b3569bcda5 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c5483c74264690afd6467b62c73725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be80e52f433464e8a9e6b017fcb0753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:02.095512 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-325ad92d-0be4-4771-8ec9-80b3569bcda5 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb" status: 200 len: 1352 microversion: 2.1 time: 1.237731 Jul 25 12:54:02.096334 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1511/3091] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:00 2022] GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb => generated 1352 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:02.188557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7aef30f6-0b65-49ac-8dd7-5bb69c974e26 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:02.196379 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7aef30f6-0b65-49ac-8dd7-5bb69c974e26 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:02.355940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-30dce210-eb5a-4e9c-ae32-03b7ca8d25ee tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:02.404621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-30dce210-eb5a-4e9c-ae32-03b7ca8d25ee tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:02.406238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-30dce210-eb5a-4e9c-ae32-03b7ca8d25ee tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:02.425516 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-30dce210-eb5a-4e9c-ae32-03b7ca8d25ee tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 2.325184 Jul 25 12:54:02.449650 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1581/3092] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:54:00 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 2348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:54:02.586621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7aef30f6-0b65-49ac-8dd7-5bb69c974e26 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:02.618364 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7aef30f6-0b65-49ac-8dd7-5bb69c974e26 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1214 microversion: 2.1 time: 0.469976 Jul 25 12:54:02.620536 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1512/3093] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:02 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1214 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:03.127865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-081ba7c3-3de1-4754-b609-abd4383c0330 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:03.128908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-081ba7c3-3de1-4754-b609-abd4383c0330 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [instance: dbe0a495-7647-4b23-96c1-e46073e497eb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:03.186154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-081ba7c3-3de1-4754-b609-abd4383c0330 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:03.187049 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-081ba7c3-3de1-4754-b609-abd4383c0330 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:03.200695 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-081ba7c3-3de1-4754-b609-abd4383c0330 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:03.201506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-081ba7c3-3de1-4754-b609-abd4383c0330 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:03.459192 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-59f283ca-c6d0-49f6-bcab-1f27907f096f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:03.460302 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-59f283ca-c6d0-49f6-bcab-1f27907f096f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:03.505083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59f283ca-c6d0-49f6-bcab-1f27907f096f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:03.505535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59f283ca-c6d0-49f6-bcab-1f27907f096f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:03.506605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59f283ca-c6d0-49f6-bcab-1f27907f096f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:03.508339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59f283ca-c6d0-49f6-bcab-1f27907f096f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:03.626896 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:04.396388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-081ba7c3-3de1-4754-b609-abd4383c0330 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c5483c74264690afd6467b62c73725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be80e52f433464e8a9e6b017fcb0753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:04.425376 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-081ba7c3-3de1-4754-b609-abd4383c0330 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb" status: 200 len: 1352 microversion: 2.1 time: 1.304353 Jul 25 12:54:04.426181 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1582/3094] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:03 2022] GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb => generated 1352 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:54:04.502977 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f2d54ad9-cecb-484f-8c42-1333bae80a53 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:04.503758 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f2d54ad9-cecb-484f-8c42-1333bae80a53 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:04.547954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f2d54ad9-cecb-484f-8c42-1333bae80a53 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:04.548650 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f2d54ad9-cecb-484f-8c42-1333bae80a53 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:04.549948 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f2d54ad9-cecb-484f-8c42-1333bae80a53 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:04.550728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f2d54ad9-cecb-484f-8c42-1333bae80a53 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:06.066461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f2d54ad9-cecb-484f-8c42-1333bae80a53 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:06.071137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-59f283ca-c6d0-49f6-bcab-1f27907f096f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:06.088879 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f2d54ad9-cecb-484f-8c42-1333bae80a53 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1274 microversion: 2.1 time: 1.661407 Jul 25 12:54:06.102151 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1583/3095] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:04 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1274 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:06.121050 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-59f283ca-c6d0-49f6-bcab-1f27907f096f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:06.151605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-59f283ca-c6d0-49f6-bcab-1f27907f096f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:06.162235 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-59f283ca-c6d0-49f6-bcab-1f27907f096f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 2.700233 Jul 25 12:54:06.171475 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1513/3096] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:54:03 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 2719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:54:06.210960 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-28c5e2b6-dfd9-40d9-ad8b-d1beacee5828 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:06.219998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-28c5e2b6-dfd9-40d9-ad8b-d1beacee5828 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [instance: dbe0a495-7647-4b23-96c1-e46073e497eb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:06.269880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-28c5e2b6-dfd9-40d9-ad8b-d1beacee5828 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:06.298431 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-28c5e2b6-dfd9-40d9-ad8b-d1beacee5828 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:06.299920 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-28c5e2b6-dfd9-40d9-ad8b-d1beacee5828 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:06.300717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-28c5e2b6-dfd9-40d9-ad8b-d1beacee5828 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:06.876442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-e6d12ef3-e10b-40bf-a00b-42662e0631ce req-0dfb928d-d771-4e59-8de6-8f077048d62c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbe0a495-7647-4b23-96c1-e46073e497eb", "tag": "7459768f-16a0-4c7b-9576-3d4672522591"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:54:06.894280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e6d12ef3-e10b-40bf-a00b-42662e0631ce req-0dfb928d-d771-4e59-8de6-8f077048d62c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:06.898574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e6d12ef3-e10b-40bf-a00b-42662e0631ce req-0dfb928d-d771-4e59-8de6-8f077048d62c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:06.966886 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-e6d12ef3-e10b-40bf-a00b-42662e0631ce req-0dfb928d-d771-4e59-8de6-8f077048d62c service nova] Creating event network-changed:7459768f-16a0-4c7b-9576-3d4672522591 for instance dbe0a495-7647-4b23-96c1-e46073e497eb on n-h1-848886-15 Jul 25 12:54:06.989968 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-e6d12ef3-e10b-40bf-a00b-42662e0631ce req-0dfb928d-d771-4e59-8de6-8f077048d62c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.881221 Jul 25 12:54:07.002045 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1584/3097] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:54:07.125608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-111c3ef8-1130-40dd-81f2-f667e5a385ec tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:07.126503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-111c3ef8-1130-40dd-81f2-f667e5a385ec tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:07.174628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-111c3ef8-1130-40dd-81f2-f667e5a385ec tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:07.175925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-111c3ef8-1130-40dd-81f2-f667e5a385ec tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:07.177388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-111c3ef8-1130-40dd-81f2-f667e5a385ec tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:07.180165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-111c3ef8-1130-40dd-81f2-f667e5a385ec tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:07.640138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-28c5e2b6-dfd9-40d9-ad8b-d1beacee5828 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c5483c74264690afd6467b62c73725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be80e52f433464e8a9e6b017fcb0753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:07.649747 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-111c3ef8-1130-40dd-81f2-f667e5a385ec tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:07.682528 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-111c3ef8-1130-40dd-81f2-f667e5a385ec tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1272 microversion: 2.1 time: 0.560727 Jul 25 12:54:07.698145 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1585/3098] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:07 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1272 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:07.699112 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-28c5e2b6-dfd9-40d9-ad8b-d1beacee5828 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb" status: 200 len: 1352 microversion: 2.1 time: 1.506961 Jul 25 12:54:07.700114 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1514/3099] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:06 2022] GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb => generated 1352 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:07.722653 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c05d97ca-2adc-4e85-9397-ebbe4089f582 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:07.725126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c05d97ca-2adc-4e85-9397-ebbe4089f582 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:07.748420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c05d97ca-2adc-4e85-9397-ebbe4089f582 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:07.752522 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c05d97ca-2adc-4e85-9397-ebbe4089f582 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:07.755683 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c05d97ca-2adc-4e85-9397-ebbe4089f582 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:07.760250 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c05d97ca-2adc-4e85-9397-ebbe4089f582 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:08.714021 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fa068071-6b8f-4074-9d24-882740330b6c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:08.714749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fa068071-6b8f-4074-9d24-882740330b6c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:08.761398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c05d97ca-2adc-4e85-9397-ebbe4089f582 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:08.770461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fa068071-6b8f-4074-9d24-882740330b6c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:08.773802 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fa068071-6b8f-4074-9d24-882740330b6c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:08.777481 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fa068071-6b8f-4074-9d24-882740330b6c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:08.778007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fa068071-6b8f-4074-9d24-882740330b6c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:08.798894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c05d97ca-2adc-4e85-9397-ebbe4089f582 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:08.815608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c05d97ca-2adc-4e85-9397-ebbe4089f582 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:08.828858 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c05d97ca-2adc-4e85-9397-ebbe4089f582 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 1.141352 Jul 25 12:54:08.832351 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1586/3100] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:54:07 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:54:08.881993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3af8a93b-303d-4e8a-a476-8eb859ac24c6 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:08.889575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3af8a93b-303d-4e8a-a476-8eb859ac24c6 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [instance: dbe0a495-7647-4b23-96c1-e46073e497eb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:08.907557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3af8a93b-303d-4e8a-a476-8eb859ac24c6 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:08.915635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3af8a93b-303d-4e8a-a476-8eb859ac24c6 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:08.917189 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3af8a93b-303d-4e8a-a476-8eb859ac24c6 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:08.917895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3af8a93b-303d-4e8a-a476-8eb859ac24c6 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:09.382319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fa068071-6b8f-4074-9d24-882740330b6c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:09.407996 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fa068071-6b8f-4074-9d24-882740330b6c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1272 microversion: 2.1 time: 0.692658 Jul 25 12:54:09.408711 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1515/3101] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:08 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1272 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:09.887409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3201b413-a508-498b-b42d-edadc879e1f4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:09.888503 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3201b413-a508-498b-b42d-edadc879e1f4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:09.907458 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3201b413-a508-498b-b42d-edadc879e1f4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:09.911910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3201b413-a508-498b-b42d-edadc879e1f4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:09.921463 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3201b413-a508-498b-b42d-edadc879e1f4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:09.922749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3201b413-a508-498b-b42d-edadc879e1f4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:10.532299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:11.279204 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3201b413-a508-498b-b42d-edadc879e1f4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:11.311616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3201b413-a508-498b-b42d-edadc879e1f4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:11.320848 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3201b413-a508-498b-b42d-edadc879e1f4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:11.329293 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3201b413-a508-498b-b42d-edadc879e1f4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 1.441678 Jul 25 12:54:11.337315 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1516/3102] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:54:09 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:54:11.371230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c75fd9da-b2e3-4795-97d8-355600e265ac tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:11.380985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c75fd9da-b2e3-4795-97d8-355600e265ac tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:11.421014 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c75fd9da-b2e3-4795-97d8-355600e265ac tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:11.424675 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c75fd9da-b2e3-4795-97d8-355600e265ac tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:11.430794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c75fd9da-b2e3-4795-97d8-355600e265ac tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:11.431938 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c75fd9da-b2e3-4795-97d8-355600e265ac tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:12.076918 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3af8a93b-303d-4e8a-a476-8eb859ac24c6 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c5483c74264690afd6467b62c73725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be80e52f433464e8a9e6b017fcb0753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:12.103345 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3af8a93b-303d-4e8a-a476-8eb859ac24c6 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb" status: 200 len: 1352 microversion: 2.1 time: 3.252916 Jul 25 12:54:12.110422 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1587/3103] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:08 2022] GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb => generated 1352 bytes in 3261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:12.122221 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-768ed3b2-32eb-47ff-89ac-914897d64614 req-5c139845-0504-4d24-864a-cd21bc053126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "name": "network-vif-plugged", "status": "completed", "tag": "cb401cbd-e19d-4978-86c4-7928b236e3b9"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:54:12.160470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-768ed3b2-32eb-47ff-89ac-914897d64614 req-5c139845-0504-4d24-864a-cd21bc053126 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:12.161139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-768ed3b2-32eb-47ff-89ac-914897d64614 req-5c139845-0504-4d24-864a-cd21bc053126 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:12.212323 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-768ed3b2-32eb-47ff-89ac-914897d64614 req-5c139845-0504-4d24-864a-cd21bc053126 service nova] Creating event network-vif-plugged:cb401cbd-e19d-4978-86c4-7928b236e3b9 for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:54:12.243344 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-768ed3b2-32eb-47ff-89ac-914897d64614 req-5c139845-0504-4d24-864a-cd21bc053126 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130776 Jul 25 12:54:12.251801 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1588/3104] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:54:12.378861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5d7ef91b-4d6f-43e5-a15b-d0869e0ccb66 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:12.379935 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5d7ef91b-4d6f-43e5-a15b-d0869e0ccb66 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:12.396963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d7ef91b-4d6f-43e5-a15b-d0869e0ccb66 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:12.398052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d7ef91b-4d6f-43e5-a15b-d0869e0ccb66 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:12.399346 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d7ef91b-4d6f-43e5-a15b-d0869e0ccb66 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:12.399998 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d7ef91b-4d6f-43e5-a15b-d0869e0ccb66 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:12.401655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c75fd9da-b2e3-4795-97d8-355600e265ac tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:12.423965 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c75fd9da-b2e3-4795-97d8-355600e265ac tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1314 microversion: 2.1 time: 1.075903 Jul 25 12:54:12.424670 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1517/3105] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:11 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1314 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:13.135975 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-982627f6-4a4e-46da-939b-ad221f633041 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:13.136615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-982627f6-4a4e-46da-939b-ad221f633041 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [instance: dbe0a495-7647-4b23-96c1-e46073e497eb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:13.138948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=10 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:13.157158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-982627f6-4a4e-46da-939b-ad221f633041 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:13.157666 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-982627f6-4a4e-46da-939b-ad221f633041 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:13.160786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-982627f6-4a4e-46da-939b-ad221f633041 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:13.161508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-982627f6-4a4e-46da-939b-ad221f633041 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:14.166017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5d7ef91b-4d6f-43e5-a15b-d0869e0ccb66 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:14.196128 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:14.225148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5d7ef91b-4d6f-43e5-a15b-d0869e0ccb66 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:14.242529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5d7ef91b-4d6f-43e5-a15b-d0869e0ccb66 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:14.256360 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5d7ef91b-4d6f-43e5-a15b-d0869e0ccb66 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 1.874105 Jul 25 12:54:14.262875 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1589/3106] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:54:12 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:54:14.293491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bb111d36-199a-4f82-aa1c-f6311f116d10 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:14.297730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bb111d36-199a-4f82-aa1c-f6311f116d10 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:14.312409 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bb111d36-199a-4f82-aa1c-f6311f116d10 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:14.313774 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bb111d36-199a-4f82-aa1c-f6311f116d10 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:14.315686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bb111d36-199a-4f82-aa1c-f6311f116d10 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:14.318880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bb111d36-199a-4f82-aa1c-f6311f116d10 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:14.783630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-982627f6-4a4e-46da-939b-ad221f633041 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c5483c74264690afd6467b62c73725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be80e52f433464e8a9e6b017fcb0753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:14.816168 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-982627f6-4a4e-46da-939b-ad221f633041 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb" status: 200 len: 1352 microversion: 2.1 time: 1.678097 Jul 25 12:54:14.841966 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1518/3107] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:13 2022] GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb => generated 1352 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:54:14.878131 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-b51bbe51-eafb-4bc8-9641-1795d795d9fd req-a6eabb7e-e3d6-48be-9c53-6262f48922b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "name": "network-vif-plugged", "status": "completed", "tag": "02849233-f60e-4c53-a1d0-6d7d5c7326af"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:54:14.935037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b51bbe51-eafb-4bc8-9641-1795d795d9fd req-a6eabb7e-e3d6-48be-9c53-6262f48922b1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:14.940239 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b51bbe51-eafb-4bc8-9641-1795d795d9fd req-a6eabb7e-e3d6-48be-9c53-6262f48922b1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:15.015521 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-b51bbe51-eafb-4bc8-9641-1795d795d9fd req-a6eabb7e-e3d6-48be-9c53-6262f48922b1 service nova] Creating event network-vif-plugged:02849233-f60e-4c53-a1d0-6d7d5c7326af for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:54:15.046092 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-b51bbe51-eafb-4bc8-9641-1795d795d9fd req-a6eabb7e-e3d6-48be-9c53-6262f48922b1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202381 Jul 25 12:54:15.048900 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1519/3108] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:54:15.306296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8844eea5-2f78-40f6-97c4-7df7a097f03b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:15.307106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8844eea5-2f78-40f6-97c4-7df7a097f03b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:15.318985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8844eea5-2f78-40f6-97c4-7df7a097f03b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:15.319433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8844eea5-2f78-40f6-97c4-7df7a097f03b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:15.324168 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8844eea5-2f78-40f6-97c4-7df7a097f03b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:15.329164 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8844eea5-2f78-40f6-97c4-7df7a097f03b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:15.857914 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bb111d36-199a-4f82-aa1c-f6311f116d10 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:15.870941 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bb111d36-199a-4f82-aa1c-f6311f116d10 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1314 microversion: 2.1 time: 1.605680 Jul 25 12:54:15.887618 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1590/3109] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:14 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1314 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:15.905372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-973b2958-70fa-4643-9c58-ecd6dc70a5ca tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:15.908720 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-973b2958-70fa-4643-9c58-ecd6dc70a5ca tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [instance: dbe0a495-7647-4b23-96c1-e46073e497eb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:15.928879 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-973b2958-70fa-4643-9c58-ecd6dc70a5ca tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:15.929691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-973b2958-70fa-4643-9c58-ecd6dc70a5ca tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:15.930656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-973b2958-70fa-4643-9c58-ecd6dc70a5ca tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:15.933328 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-973b2958-70fa-4643-9c58-ecd6dc70a5ca tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:17.381334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8844eea5-2f78-40f6-97c4-7df7a097f03b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:17.434231 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8844eea5-2f78-40f6-97c4-7df7a097f03b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:17.460003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8844eea5-2f78-40f6-97c4-7df7a097f03b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:17.469549 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8844eea5-2f78-40f6-97c4-7df7a097f03b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 2.161027 Jul 25 12:54:17.470362 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1520/3110] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:54:15 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 2170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:54:17.518492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-82493f71-f9f1-4a26-8cb3-5adda6041967 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:17.519267 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-82493f71-f9f1-4a26-8cb3-5adda6041967 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:17.570656 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82493f71-f9f1-4a26-8cb3-5adda6041967 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:17.570931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-973b2958-70fa-4643-9c58-ecd6dc70a5ca tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c5483c74264690afd6467b62c73725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be80e52f433464e8a9e6b017fcb0753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:17.575704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82493f71-f9f1-4a26-8cb3-5adda6041967 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:17.579657 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82493f71-f9f1-4a26-8cb3-5adda6041967 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:17.581485 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82493f71-f9f1-4a26-8cb3-5adda6041967 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:17.599676 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-973b2958-70fa-4643-9c58-ecd6dc70a5ca tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb" status: 200 len: 1352 microversion: 2.1 time: 1.707790 Jul 25 12:54:17.604343 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1591/3111] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:15 2022] GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb => generated 1352 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:17.627410 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-4f2da4cc-7541-4853-8798-632e2cbb03ac req-9aa7af0b-7b21-4ef0-8ea2-549fd6030302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "name": "network-vif-plugged", "status": "completed", "tag": "be480615-b9ea-4aa4-9399-1e7eabe09a0b"}, {"server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "name": "network-vif-plugged", "status": "completed", "tag": "67565573-06d3-4bd8-a854-6237f54f8350"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:54:17.682962 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:17.693528 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4f2da4cc-7541-4853-8798-632e2cbb03ac req-9aa7af0b-7b21-4ef0-8ea2-549fd6030302 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:17.694458 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4f2da4cc-7541-4853-8798-632e2cbb03ac req-9aa7af0b-7b21-4ef0-8ea2-549fd6030302 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:17.749700 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-4f2da4cc-7541-4853-8798-632e2cbb03ac req-9aa7af0b-7b21-4ef0-8ea2-549fd6030302 service nova] Creating event network-vif-plugged:be480615-b9ea-4aa4-9399-1e7eabe09a0b for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:54:17.761900 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-4f2da4cc-7541-4853-8798-632e2cbb03ac req-9aa7af0b-7b21-4ef0-8ea2-549fd6030302 service nova] Creating event network-vif-plugged:67565573-06d3-4bd8-a854-6237f54f8350 for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:54:17.820653 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-4f2da4cc-7541-4853-8798-632e2cbb03ac req-9aa7af0b-7b21-4ef0-8ea2-549fd6030302 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.205281 Jul 25 12:54:17.821411 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1592/3112] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:54:18.307107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-82493f71-f9f1-4a26-8cb3-5adda6041967 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:18.358141 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-82493f71-f9f1-4a26-8cb3-5adda6041967 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1314 microversion: 2.1 time: 0.869699 Jul 25 12:54:18.359852 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1521/3113] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:17 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1314 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:18.514395 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2d9a3747-1f8e-429a-9106-e4a16db73fec tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:18.516178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2d9a3747-1f8e-429a-9106-e4a16db73fec tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:18.542786 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d9a3747-1f8e-429a-9106-e4a16db73fec tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:18.544380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d9a3747-1f8e-429a-9106-e4a16db73fec tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:18.547174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d9a3747-1f8e-429a-9106-e4a16db73fec tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:18.550382 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d9a3747-1f8e-429a-9106-e4a16db73fec tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:18.641628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bc3b79da-11ef-4586-81c4-b012cc5ef8e4 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:18.643450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bc3b79da-11ef-4586-81c4-b012cc5ef8e4 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [instance: dbe0a495-7647-4b23-96c1-e46073e497eb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:18.675570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc3b79da-11ef-4586-81c4-b012cc5ef8e4 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:18.681039 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc3b79da-11ef-4586-81c4-b012cc5ef8e4 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:18.684805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc3b79da-11ef-4586-81c4-b012cc5ef8e4 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:18.691222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc3b79da-11ef-4586-81c4-b012cc5ef8e4 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:20.143582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2d9a3747-1f8e-429a-9106-e4a16db73fec tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:20.171854 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bc3b79da-11ef-4586-81c4-b012cc5ef8e4 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c5483c74264690afd6467b62c73725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be80e52f433464e8a9e6b017fcb0753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:20.180379 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2d9a3747-1f8e-429a-9106-e4a16db73fec tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:20.182201 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bc3b79da-11ef-4586-81c4-b012cc5ef8e4 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb" status: 200 len: 1352 microversion: 2.1 time: 1.548431 Jul 25 12:54:20.187164 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1522/3114] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:18 2022] GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb => generated 1352 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:20.189173 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2d9a3747-1f8e-429a-9106-e4a16db73fec tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:20.195221 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2d9a3747-1f8e-429a-9106-e4a16db73fec tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 1.699544 Jul 25 12:54:20.198718 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1593/3115] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:54:18 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:54:20.233392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-56a5ddb6-9ce0-4704-ae8b-5d1d14763977 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:20.234592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-56a5ddb6-9ce0-4704-ae8b-5d1d14763977 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:20.262769 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56a5ddb6-9ce0-4704-ae8b-5d1d14763977 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:20.264992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56a5ddb6-9ce0-4704-ae8b-5d1d14763977 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:20.271110 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56a5ddb6-9ce0-4704-ae8b-5d1d14763977 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:20.273080 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56a5ddb6-9ce0-4704-ae8b-5d1d14763977 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:20.637164 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-c87f9132-bdec-4a98-a1a7-2061a7955594 req-6a41ecdb-0288-4a83-81b4-9ba54c223562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9cc21b1-7442-4031-b701-b534f237749f", "tag": "86c86fd3-b1f7-405c-92a4-239039e1570a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:54:20.671933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c87f9132-bdec-4a98-a1a7-2061a7955594 req-6a41ecdb-0288-4a83-81b4-9ba54c223562 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:20.672651 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c87f9132-bdec-4a98-a1a7-2061a7955594 req-6a41ecdb-0288-4a83-81b4-9ba54c223562 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:20.703068 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-c87f9132-bdec-4a98-a1a7-2061a7955594 req-6a41ecdb-0288-4a83-81b4-9ba54c223562 service nova] Creating event network-changed:86c86fd3-b1f7-405c-92a4-239039e1570a for instance c9cc21b1-7442-4031-b701-b534f237749f on n-h2-848886-15 Jul 25 12:54:20.713585 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-c87f9132-bdec-4a98-a1a7-2061a7955594 req-6a41ecdb-0288-4a83-81b4-9ba54c223562 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.522848 Jul 25 12:54:20.720978 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1523/3116] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:54:20.730777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-f2c4020a-231a-4626-bfa2-29ac2c26adbd req-b5f06cd9-7cba-4867-aeb2-6075b1bd4b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe0a495-7647-4b23-96c1-e46073e497eb", "name": "network-vif-plugged", "status": "completed", "tag": "7459768f-16a0-4c7b-9576-3d4672522591"}, {"server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "name": "network-vif-plugged", "status": "completed", "tag": "0cd19a7b-cc4c-4db9-a5bb-5479206d7d43"}, {"server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "name": "network-vif-plugged", "status": "completed", "tag": "39297266-b022-4131-809f-29475f17809c"}, {"server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "name": "network-vif-plugged", "status": "completed", "tag": "b1c8f2ac-436f-43bd-80a5-4182aa87ee56"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:54:20.754114 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-f2c4020a-231a-4626-bfa2-29ac2c26adbd req-b5f06cd9-7cba-4867-aeb2-6075b1bd4b13 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:20.756253 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-f2c4020a-231a-4626-bfa2-29ac2c26adbd req-b5f06cd9-7cba-4867-aeb2-6075b1bd4b13 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:20.787719 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-f2c4020a-231a-4626-bfa2-29ac2c26adbd req-b5f06cd9-7cba-4867-aeb2-6075b1bd4b13 service nova] Creating event network-vif-plugged:7459768f-16a0-4c7b-9576-3d4672522591 for instance dbe0a495-7647-4b23-96c1-e46073e497eb on n-h1-848886-15 Jul 25 12:54:20.792582 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-f2c4020a-231a-4626-bfa2-29ac2c26adbd req-b5f06cd9-7cba-4867-aeb2-6075b1bd4b13 service nova] Creating event network-vif-plugged:0cd19a7b-cc4c-4db9-a5bb-5479206d7d43 for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:54:20.793422 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-f2c4020a-231a-4626-bfa2-29ac2c26adbd req-b5f06cd9-7cba-4867-aeb2-6075b1bd4b13 service nova] Creating event network-vif-plugged:39297266-b022-4131-809f-29475f17809c for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:54:20.794283 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-f2c4020a-231a-4626-bfa2-29ac2c26adbd req-b5f06cd9-7cba-4867-aeb2-6075b1bd4b13 service nova] Creating event network-vif-plugged:b1c8f2ac-436f-43bd-80a5-4182aa87ee56 for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:54:20.831040 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-f2c4020a-231a-4626-bfa2-29ac2c26adbd req-b5f06cd9-7cba-4867-aeb2-6075b1bd4b13 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.108068 Jul 25 12:54:20.842533 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1524/3117] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:54:20.894345 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-56a5ddb6-9ce0-4704-ae8b-5d1d14763977 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:20.934160 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-56a5ddb6-9ce0-4704-ae8b-5d1d14763977 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1314 microversion: 2.1 time: 0.729699 Jul 25 12:54:20.939855 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1594/3118] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:20 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1314 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:21.223562 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e560160d-7083-4f13-84ba-25f9e72527b3 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:21.224929 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e560160d-7083-4f13-84ba-25f9e72527b3 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [instance: dbe0a495-7647-4b23-96c1-e46073e497eb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:21.225051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f5b5d974-5d23-4c52-98f5-30a92daa5771 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:21.225666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f5b5d974-5d23-4c52-98f5-30a92daa5771 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:21.244809 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5b5d974-5d23-4c52-98f5-30a92daa5771 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:21.245303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5b5d974-5d23-4c52-98f5-30a92daa5771 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:21.246166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5b5d974-5d23-4c52-98f5-30a92daa5771 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:21.246609 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5b5d974-5d23-4c52-98f5-30a92daa5771 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:21.248454 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e560160d-7083-4f13-84ba-25f9e72527b3 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:21.248914 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e560160d-7083-4f13-84ba-25f9e72527b3 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:21.249714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e560160d-7083-4f13-84ba-25f9e72527b3 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:21.250184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e560160d-7083-4f13-84ba-25f9e72527b3 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:22.332328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e560160d-7083-4f13-84ba-25f9e72527b3 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c5483c74264690afd6467b62c73725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be80e52f433464e8a9e6b017fcb0753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:22.342320 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e560160d-7083-4f13-84ba-25f9e72527b3 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb" status: 200 len: 1352 microversion: 2.1 time: 1.125911 Jul 25 12:54:22.342935 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1525/3119] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:21 2022] GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb => generated 1352 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:54:22.361145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-333321e8-6751-4d24-9a47-b8618ae79a19 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:22.361793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-333321e8-6751-4d24-9a47-b8618ae79a19 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:22.395992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f5b5d974-5d23-4c52-98f5-30a92daa5771 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:22.411252 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-333321e8-6751-4d24-9a47-b8618ae79a19 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:22.411608 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-333321e8-6751-4d24-9a47-b8618ae79a19 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:22.412417 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-333321e8-6751-4d24-9a47-b8618ae79a19 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:22.412957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-333321e8-6751-4d24-9a47-b8618ae79a19 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:22.449712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f5b5d974-5d23-4c52-98f5-30a92daa5771 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:22.462758 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f5b5d974-5d23-4c52-98f5-30a92daa5771 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:22.467818 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f5b5d974-5d23-4c52-98f5-30a92daa5771 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 1.246494 Jul 25 12:54:22.474821 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1595/3120] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:54:21 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:54:23.254231 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-333321e8-6751-4d24-9a47-b8618ae79a19 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:23.267542 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-333321e8-6751-4d24-9a47-b8618ae79a19 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1314 microversion: 2.1 time: 0.923458 Jul 25 12:54:23.275365 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1526/3121] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:22 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1314 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:23.375627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c5599df6-f510-476a-9531-cddd70271668 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:23.376255 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c5599df6-f510-476a-9531-cddd70271668 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [instance: dbe0a495-7647-4b23-96c1-e46073e497eb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:23.396504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5599df6-f510-476a-9531-cddd70271668 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:23.397506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5599df6-f510-476a-9531-cddd70271668 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:23.397767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5599df6-f510-476a-9531-cddd70271668 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:23.398259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5599df6-f510-476a-9531-cddd70271668 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:23.506931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-31bc7f2d-2cf6-4574-8468-841144e6d66b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:23.509227 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-31bc7f2d-2cf6-4574-8468-841144e6d66b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:23.565311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:23.585985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31bc7f2d-2cf6-4574-8468-841144e6d66b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:23.587333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31bc7f2d-2cf6-4574-8468-841144e6d66b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:23.592053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31bc7f2d-2cf6-4574-8468-841144e6d66b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:23.597253 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31bc7f2d-2cf6-4574-8468-841144e6d66b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:24.102939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c5599df6-f510-476a-9531-cddd70271668 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c5483c74264690afd6467b62c73725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be80e52f433464e8a9e6b017fcb0753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:24.113786 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c5599df6-f510-476a-9531-cddd70271668 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb" status: 200 len: 1542 microversion: 2.1 time: 0.742743 Jul 25 12:54:24.136531 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1596/3122] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:23 2022] GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb => generated 1542 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:24.146839 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0d06c95c-8342-4ab7-a6a8-46bdeced7bb5 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:24.150742 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0d06c95c-8342-4ab7-a6a8-46bdeced7bb5 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [instance: dbe0a495-7647-4b23-96c1-e46073e497eb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:24.169713 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d06c95c-8342-4ab7-a6a8-46bdeced7bb5 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:24.170837 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d06c95c-8342-4ab7-a6a8-46bdeced7bb5 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:24.171925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d06c95c-8342-4ab7-a6a8-46bdeced7bb5 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:24.174294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d06c95c-8342-4ab7-a6a8-46bdeced7bb5 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:24.629220 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-31bc7f2d-2cf6-4574-8468-841144e6d66b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:24.654101 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-31bc7f2d-2cf6-4574-8468-841144e6d66b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:24.654680 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0d06c95c-8342-4ab7-a6a8-46bdeced7bb5 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.512196 Jul 25 12:54:24.655808 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1597/3123] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 12:54:24 2022] GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb/os-interface => generated 284 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:54:24.658277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-31bc7f2d-2cf6-4574-8468-841144e6d66b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:24.665190 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-31bc7f2d-2cf6-4574-8468-841144e6d66b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1874 microversion: 2.32 time: 1.169418 Jul 25 12:54:24.671708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-76e529e2-2372-4a3d-8236-ff297b48c847 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:24.673264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-76e529e2-2372-4a3d-8236-ff297b48c847 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:24.679325 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1527/3124] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:54:23 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1874 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:54:24.703725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76e529e2-2372-4a3d-8236-ff297b48c847 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:24.715034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76e529e2-2372-4a3d-8236-ff297b48c847 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:24.717098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76e529e2-2372-4a3d-8236-ff297b48c847 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:24.718094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76e529e2-2372-4a3d-8236-ff297b48c847 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:25.278260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-76e529e2-2372-4a3d-8236-ff297b48c847 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:25.321317 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-76e529e2-2372-4a3d-8236-ff297b48c847 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1314 microversion: 2.1 time: 0.658144 Jul 25 12:54:25.346392 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1598/3125] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:24 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1314 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:25.699680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8f4cc648-a4bd-4906-b851-6f1a551513c0 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:25.700233 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8f4cc648-a4bd-4906-b851-6f1a551513c0 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:25.725935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f4cc648-a4bd-4906-b851-6f1a551513c0 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:25.726408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f4cc648-a4bd-4906-b851-6f1a551513c0 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:25.727947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f4cc648-a4bd-4906-b851-6f1a551513c0 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:25.730628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f4cc648-a4bd-4906-b851-6f1a551513c0 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:26.356489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1532910c-e442-41b3-822a-08029da4400a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:26.357748 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1532910c-e442-41b3-822a-08029da4400a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:26.392055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1532910c-e442-41b3-822a-08029da4400a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:26.392941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1532910c-e442-41b3-822a-08029da4400a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:26.398666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1532910c-e442-41b3-822a-08029da4400a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:26.399968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1532910c-e442-41b3-822a-08029da4400a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:26.438803 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8f4cc648-a4bd-4906-b851-6f1a551513c0 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:26.464336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8f4cc648-a4bd-4906-b851-6f1a551513c0 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:26.475119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8f4cc648-a4bd-4906-b851-6f1a551513c0 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:26.504556 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8f4cc648-a4bd-4906-b851-6f1a551513c0 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 2828 microversion: 2.32 time: 0.804444 Jul 25 12:54:26.505688 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1528/3126] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:54:25 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 2828 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:54:26.565697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d9e3a6e8-8b47-46f9-8794-fe69b31fd0d4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:26.567494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d9e3a6e8-8b47-46f9-8794-fe69b31fd0d4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:26.583217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9e3a6e8-8b47-46f9-8794-fe69b31fd0d4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:26.584731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9e3a6e8-8b47-46f9-8794-fe69b31fd0d4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:26.586868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9e3a6e8-8b47-46f9-8794-fe69b31fd0d4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:26.587673 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9e3a6e8-8b47-46f9-8794-fe69b31fd0d4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:26.816047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1532910c-e442-41b3-822a-08029da4400a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:26.840807 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1532910c-e442-41b3-822a-08029da4400a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1314 microversion: 2.1 time: 0.492958 Jul 25 12:54:26.841619 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1599/3127] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:26 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:26.909878 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d9e3a6e8-8b47-46f9-8794-fe69b31fd0d4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.360883 Jul 25 12:54:26.911563 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1529/3128] 10.222.0.49 () {60 vars in 1316 bytes} [Mon Jul 25 12:54:26 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88/os-interface => generated 1832 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:54:27.871713 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a4493b75-ad49-46a6-a5c3-1ba42b056251 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:27.874250 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a4493b75-ad49-46a6-a5c3-1ba42b056251 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:27.887959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4493b75-ad49-46a6-a5c3-1ba42b056251 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:27.891074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4493b75-ad49-46a6-a5c3-1ba42b056251 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:27.892991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4493b75-ad49-46a6-a5c3-1ba42b056251 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:27.897620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4493b75-ad49-46a6-a5c3-1ba42b056251 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:28.031584 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-77a4b599-15fe-4c25-bfec-9b93954f5293 req-e1652fe3-431a-4079-9732-5f5edda2a7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9cc21b1-7442-4031-b701-b534f237749f", "name": "network-vif-plugged", "status": "completed", "tag": "86c86fd3-b1f7-405c-92a4-239039e1570a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:54:28.064711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-77a4b599-15fe-4c25-bfec-9b93954f5293 req-e1652fe3-431a-4079-9732-5f5edda2a7d7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:28.072970 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-77a4b599-15fe-4c25-bfec-9b93954f5293 req-e1652fe3-431a-4079-9732-5f5edda2a7d7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:28.115356 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-77a4b599-15fe-4c25-bfec-9b93954f5293 req-e1652fe3-431a-4079-9732-5f5edda2a7d7 service nova] Creating event network-vif-plugged:86c86fd3-b1f7-405c-92a4-239039e1570a for instance c9cc21b1-7442-4031-b701-b534f237749f on n-h2-848886-15 Jul 25 12:54:28.129565 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-77a4b599-15fe-4c25-bfec-9b93954f5293 req-e1652fe3-431a-4079-9732-5f5edda2a7d7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104157 Jul 25 12:54:28.135805 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1530/3129] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:54:28.660996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5c700de7-bda9-4aae-890f-f347eba3a55b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1527483301", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "2c55ca58-f6b3-49a6-8224-93d49e500ffc"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:54:28.783888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-5c700de7-bda9-4aae-890f-f347eba3a55b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] validate_networks() for [('2c55ca58-f6b3-49a6-8224-93d49e500ffc', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:54:30.507061 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a4493b75-ad49-46a6-a5c3-1ba42b056251 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:30.524591 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a4493b75-ad49-46a6-a5c3-1ba42b056251 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1314 microversion: 2.1 time: 2.659517 Jul 25 12:54:30.545523 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1600/3130] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:27 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1314 bytes in 2681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:30.557716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-446a4107-fcee-4b11-93ac-ef31e4e56ec2 req-dad33ba9-b638-4575-9efc-967115d8f3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbe0a495-7647-4b23-96c1-e46073e497eb", "tag": "7459768f-16a0-4c7b-9576-3d4672522591"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:54:30.569398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-446a4107-fcee-4b11-93ac-ef31e4e56ec2 req-dad33ba9-b638-4575-9efc-967115d8f3b3 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:30.570440 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-446a4107-fcee-4b11-93ac-ef31e4e56ec2 req-dad33ba9-b638-4575-9efc-967115d8f3b3 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:30.602282 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-446a4107-fcee-4b11-93ac-ef31e4e56ec2 req-dad33ba9-b638-4575-9efc-967115d8f3b3 service nova] Creating event network-changed:7459768f-16a0-4c7b-9576-3d4672522591 for instance dbe0a495-7647-4b23-96c1-e46073e497eb on n-h1-848886-15 Jul 25 12:54:30.611633 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-446a4107-fcee-4b11-93ac-ef31e4e56ec2 req-dad33ba9-b638-4575-9efc-967115d8f3b3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064173 Jul 25 12:54:30.613083 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1601/3131] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:54:31.072111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5c700de7-bda9-4aae-890f-f347eba3a55b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:54:31.073008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5c700de7-bda9-4aae-890f-f347eba3a55b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:54:31.073445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5c700de7-bda9-4aae-890f-f347eba3a55b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:54:31.074218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5c700de7-bda9-4aae-890f-f347eba3a55b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:54:31.075095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5c700de7-bda9-4aae-890f-f347eba3a55b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:54:31.093975 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c700de7-bda9-4aae-890f-f347eba3a55b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:31.096115 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c700de7-bda9-4aae-890f-f347eba3a55b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:31.107117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c700de7-bda9-4aae-890f-f347eba3a55b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:31.108354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c700de7-bda9-4aae-890f-f347eba3a55b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:31.162132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-5c700de7-bda9-4aae-890f-f347eba3a55b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Getting quotas for project 91cbcc6833214e07840dc9beaf9bea78. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:54:31.185277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-5c700de7-bda9-4aae-890f-f347eba3a55b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Getting quotas for user 6f8b20388de843f2a2aa0cf53dc80f75 and project 91cbcc6833214e07840dc9beaf9bea78. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:54:31.240473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5c700de7-bda9-4aae-890f-f347eba3a55b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:54:31.243935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5c700de7-bda9-4aae-890f-f347eba3a55b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:54:31.380675 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5c700de7-bda9-4aae-890f-f347eba3a55b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.986403 Jul 25 12:54:31.382658 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1531/3132] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:54:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 12:54:31.399618 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4f114cdd-0fa3-4e1a-9644-c2b752030e18 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:31.401564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4f114cdd-0fa3-4e1a-9644-c2b752030e18 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:31.563084 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5041dcd4-6ed3-4bf0-9a65-ddc6ce19838a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:31.564147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5041dcd4-6ed3-4bf0-9a65-ddc6ce19838a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:31.589467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5041dcd4-6ed3-4bf0-9a65-ddc6ce19838a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:31.591054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5041dcd4-6ed3-4bf0-9a65-ddc6ce19838a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:31.592000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5041dcd4-6ed3-4bf0-9a65-ddc6ce19838a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:31.592449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5041dcd4-6ed3-4bf0-9a65-ddc6ce19838a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:31.771088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4f114cdd-0fa3-4e1a-9644-c2b752030e18 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:31.808854 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4f114cdd-0fa3-4e1a-9644-c2b752030e18 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1218 microversion: 2.1 time: 0.416278 Jul 25 12:54:31.824843 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1602/3133] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:31 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1218 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:32.854721 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c815dfe0-d069-4d78-bf97-588cdf308f2e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:32.855366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c815dfe0-d069-4d78-bf97-588cdf308f2e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:32.887446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c815dfe0-d069-4d78-bf97-588cdf308f2e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:32.889109 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c815dfe0-d069-4d78-bf97-588cdf308f2e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:32.892361 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c815dfe0-d069-4d78-bf97-588cdf308f2e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:32.896380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c815dfe0-d069-4d78-bf97-588cdf308f2e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:33.137556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c815dfe0-d069-4d78-bf97-588cdf308f2e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:33.173232 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c815dfe0-d069-4d78-bf97-588cdf308f2e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1222 microversion: 2.1 time: 0.342225 Jul 25 12:54:33.174070 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1603/3134] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:32 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1222 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:33.211377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b2836992-5a28-4f45-bec0-c165f9bda9c6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:33.212445 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b2836992-5a28-4f45-bec0-c165f9bda9c6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:33.245460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b2836992-5a28-4f45-bec0-c165f9bda9c6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:33.246224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b2836992-5a28-4f45-bec0-c165f9bda9c6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:33.247201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b2836992-5a28-4f45-bec0-c165f9bda9c6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:33.252790 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b2836992-5a28-4f45-bec0-c165f9bda9c6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:34.055592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5041dcd4-6ed3-4bf0-9a65-ddc6ce19838a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:34.059450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=94 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:34.086528 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5041dcd4-6ed3-4bf0-9a65-ddc6ce19838a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1501 microversion: 2.1 time: 2.537007 Jul 25 12:54:34.087443 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1532/3135] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:31 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1501 bytes in 2539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:34.117890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-874b7df2-3087-45cd-ad89-04399c8d2e3d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:54:34.118455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-874b7df2-3087-45cd-ad89-04399c8d2e3d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:34.138894 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-874b7df2-3087-45cd-ad89-04399c8d2e3d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:34.139219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-874b7df2-3087-45cd-ad89-04399c8d2e3d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:34.140008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-874b7df2-3087-45cd-ad89-04399c8d2e3d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:34.140636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-874b7df2-3087-45cd-ad89-04399c8d2e3d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:34.206051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-874b7df2-3087-45cd-ad89-04399c8d2e3d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lazy-loading 'flavor' on Instance uuid c9cc21b1-7442-4031-b701-b534f237749f {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:54:34.738272 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-874b7df2-3087-45cd-ad89-04399c8d2e3d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "POST /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f/action" status: 202 len: 0 microversion: 2.1 time: 0.618732 Jul 25 12:54:34.739827 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1533/3136] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:54:34 2022] POST /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f/action => generated 0 bytes in 627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:54:34.761947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-494b6d7d-e378-4981-bf1d-72b8bd4ec23e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:34.765042 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-494b6d7d-e378-4981-bf1d-72b8bd4ec23e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:34.794812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-494b6d7d-e378-4981-bf1d-72b8bd4ec23e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:34.797662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-494b6d7d-e378-4981-bf1d-72b8bd4ec23e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:34.801131 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-494b6d7d-e378-4981-bf1d-72b8bd4ec23e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:34.803518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-494b6d7d-e378-4981-bf1d-72b8bd4ec23e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:34.914362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b2836992-5a28-4f45-bec0-c165f9bda9c6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:34.944060 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b2836992-5a28-4f45-bec0-c165f9bda9c6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1682 microversion: 2.1 time: 1.730511 Jul 25 12:54:34.945314 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1604/3137] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:33 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1682 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:54:34.959752 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0812836d-ccb9-481c-bd16-2db545a4194a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:34.961290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0812836d-ccb9-481c-bd16-2db545a4194a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:34.999067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0812836d-ccb9-481c-bd16-2db545a4194a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:34.999878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0812836d-ccb9-481c-bd16-2db545a4194a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:35.000915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0812836d-ccb9-481c-bd16-2db545a4194a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:35.001532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0812836d-ccb9-481c-bd16-2db545a4194a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:35.081806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-494b6d7d-e378-4981-bf1d-72b8bd4ec23e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:35.100693 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-494b6d7d-e378-4981-bf1d-72b8bd4ec23e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1276 microversion: 2.1 time: 0.357945 Jul 25 12:54:35.111844 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1534/3138] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:34 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1276 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:35.129540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-806e8cc6-af41-40cc-a900-b0678166fba6 req-886cdb36-bddc-4d23-b1a5-aa2d85945d26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "tag": "0cd19a7b-cc4c-4db9-a5bb-5479206d7d43"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:54:35.177062 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-806e8cc6-af41-40cc-a900-b0678166fba6 req-886cdb36-bddc-4d23-b1a5-aa2d85945d26 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:35.180100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-806e8cc6-af41-40cc-a900-b0678166fba6 req-886cdb36-bddc-4d23-b1a5-aa2d85945d26 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:35.223998 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-806e8cc6-af41-40cc-a900-b0678166fba6 req-886cdb36-bddc-4d23-b1a5-aa2d85945d26 service nova] Creating event network-changed:0cd19a7b-cc4c-4db9-a5bb-5479206d7d43 for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:54:35.238619 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-806e8cc6-af41-40cc-a900-b0678166fba6 req-886cdb36-bddc-4d23-b1a5-aa2d85945d26 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127920 Jul 25 12:54:35.240304 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1535/3139] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:54:35.667433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0812836d-ccb9-481c-bd16-2db545a4194a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:35.691352 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0812836d-ccb9-481c-bd16-2db545a4194a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1507 microversion: 2.1 time: 0.742906 Jul 25 12:54:35.695228 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1605/3140] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:34 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1507 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:35.991612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-51c69c95-5384-41ef-a588-1f7e6131434f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:35.993730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-51c69c95-5384-41ef-a588-1f7e6131434f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:36.015655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-51c69c95-5384-41ef-a588-1f7e6131434f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:36.018696 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-51c69c95-5384-41ef-a588-1f7e6131434f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:36.019906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-51c69c95-5384-41ef-a588-1f7e6131434f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:36.022290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-51c69c95-5384-41ef-a588-1f7e6131434f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:36.139600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-da749dde-bbda-4563-8f2b-5cfb10399cad tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:36.140535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-da749dde-bbda-4563-8f2b-5cfb10399cad tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:36.172058 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da749dde-bbda-4563-8f2b-5cfb10399cad tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:36.174050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da749dde-bbda-4563-8f2b-5cfb10399cad tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:36.178521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da749dde-bbda-4563-8f2b-5cfb10399cad tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:36.179086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da749dde-bbda-4563-8f2b-5cfb10399cad tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:37.281678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-da749dde-bbda-4563-8f2b-5cfb10399cad tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:37.312231 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-da749dde-bbda-4563-8f2b-5cfb10399cad tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1318 microversion: 2.1 time: 1.176555 Jul 25 12:54:37.325421 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1606/3141] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:36 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1318 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:37.339105 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-51c69c95-5384-41ef-a588-1f7e6131434f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:37.384340 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-91e34184-b978-4cf8-9066-78cc02f111a5 req-37bd2540-593b-4680-bf27-4260d31a1a33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b730aecb-2c1f-46ef-b457-8a3717655518", "name": "network-vif-unplugged", "status": "completed", "tag": "45191120-4204-4de7-9ef8-5d5c4ba83f89"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:54:37.398009 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-51c69c95-5384-41ef-a588-1f7e6131434f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 1.389104 Jul 25 12:54:37.402437 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1536/3142] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:35 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:37.441932 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e33bcccd-b9c2-4207-b4d6-b51e55338902 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:37.449046 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-91e34184-b978-4cf8-9066-78cc02f111a5 req-37bd2540-593b-4680-bf27-4260d31a1a33 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:37.455956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e33bcccd-b9c2-4207-b4d6-b51e55338902 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:37.470214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-91e34184-b978-4cf8-9066-78cc02f111a5 req-37bd2540-593b-4680-bf27-4260d31a1a33 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:37.488449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e33bcccd-b9c2-4207-b4d6-b51e55338902 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:37.489243 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e33bcccd-b9c2-4207-b4d6-b51e55338902 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:37.510676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e33bcccd-b9c2-4207-b4d6-b51e55338902 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:37.511506 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e33bcccd-b9c2-4207-b4d6-b51e55338902 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:37.563019 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-91e34184-b978-4cf8-9066-78cc02f111a5 req-37bd2540-593b-4680-bf27-4260d31a1a33 service nova] Creating event network-vif-unplugged:45191120-4204-4de7-9ef8-5d5c4ba83f89 for instance b730aecb-2c1f-46ef-b457-8a3717655518 on n-h1-848886-15 Jul 25 12:54:37.587261 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-91e34184-b978-4cf8-9066-78cc02f111a5 req-37bd2540-593b-4680-bf27-4260d31a1a33 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.259111 Jul 25 12:54:37.593571 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1607/3143] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:54:37.633641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ccac4a6b-dc0b-408d-ac0f-bf01b24b8f51 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1314662986"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:54:37.644604 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ccac4a6b-dc0b-408d-ac0f-bf01b24b8f51 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:37.675759 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccac4a6b-dc0b-408d-ac0f-bf01b24b8f51 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:37.676598 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccac4a6b-dc0b-408d-ac0f-bf01b24b8f51 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:37.677622 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccac4a6b-dc0b-408d-ac0f-bf01b24b8f51 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:37.678330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccac4a6b-dc0b-408d-ac0f-bf01b24b8f51 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:38.258327 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:38.379453 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ccac4a6b-dc0b-408d-ac0f-bf01b24b8f51 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action" status: 202 len: 0 microversion: 2.1 time: 0.781870 Jul 25 12:54:38.385102 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1608/3144] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:54:37 2022] POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action => generated 0 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 25 12:54:38.396312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e33bcccd-b9c2-4207-b4d6-b51e55338902 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:38.412002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-083ce77f-8b73-4eaf-acde-03a2ecab6726 req-22584b05-0ea7-434b-8da2-9e2b9e7019aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0e5b678-c54d-4505-8391-787e74886dce", "tag": "ccd4ab2a-3511-4970-8003-0627319e9a8b"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:54:38.436012 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e33bcccd-b9c2-4207-b4d6-b51e55338902 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1507 microversion: 2.1 time: 1.022422 Jul 25 12:54:38.436948 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-083ce77f-8b73-4eaf-acde-03a2ecab6726 req-22584b05-0ea7-434b-8da2-9e2b9e7019aa service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:38.437608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-083ce77f-8b73-4eaf-acde-03a2ecab6726 req-22584b05-0ea7-434b-8da2-9e2b9e7019aa service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:38.442984 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1537/3145] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:37 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1507 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:38.468590 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-083ce77f-8b73-4eaf-acde-03a2ecab6726 req-22584b05-0ea7-434b-8da2-9e2b9e7019aa service nova] Creating event network-changed:ccd4ab2a-3511-4970-8003-0627319e9a8b for instance b0e5b678-c54d-4505-8391-787e74886dce on n-h1-848886-15 Jul 25 12:54:38.478278 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-083ce77f-8b73-4eaf-acde-03a2ecab6726 req-22584b05-0ea7-434b-8da2-9e2b9e7019aa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088827 Jul 25 12:54:38.481230 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1609/3146] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:54:38.485042 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7f88a1e5-1a62-44de-a857-b764a393a5b3 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:38.486124 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7f88a1e5-1a62-44de-a857-b764a393a5b3 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:38.490366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d6276829-1008-43d1-92f7-69ceccf91504 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:38.491084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d6276829-1008-43d1-92f7-69ceccf91504 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:38.501949 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7f88a1e5-1a62-44de-a857-b764a393a5b3 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:38.507807 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7f88a1e5-1a62-44de-a857-b764a393a5b3 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:38.508594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d6276829-1008-43d1-92f7-69ceccf91504 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:38.509259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d6276829-1008-43d1-92f7-69ceccf91504 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:38.510391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7f88a1e5-1a62-44de-a857-b764a393a5b3 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:38.511738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7f88a1e5-1a62-44de-a857-b764a393a5b3 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:38.512691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d6276829-1008-43d1-92f7-69ceccf91504 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:38.513538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d6276829-1008-43d1-92f7-69ceccf91504 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:38.959947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7f88a1e5-1a62-44de-a857-b764a393a5b3 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:38.990316 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7f88a1e5-1a62-44de-a857-b764a393a5b3 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1318 microversion: 2.1 time: 0.531134 Jul 25 12:54:38.995011 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1538/3147] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:38 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1318 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:39.048049 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d6276829-1008-43d1-92f7-69ceccf91504 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:39.063513 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d6276829-1008-43d1-92f7-69ceccf91504 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1679 microversion: 2.1 time: 0.580389 Jul 25 12:54:39.064841 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1610/3148] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:38 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1679 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:39.493967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-696af616-9b69-4790-aa4d-af4ab6b80a5a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:39.495043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-696af616-9b69-4790-aa4d-af4ab6b80a5a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:39.507742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-696af616-9b69-4790-aa4d-af4ab6b80a5a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:39.508691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-696af616-9b69-4790-aa4d-af4ab6b80a5a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:39.510363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-696af616-9b69-4790-aa4d-af4ab6b80a5a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:39.511076 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-696af616-9b69-4790-aa4d-af4ab6b80a5a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:39.752096 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-696af616-9b69-4790-aa4d-af4ab6b80a5a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:39.766850 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-696af616-9b69-4790-aa4d-af4ab6b80a5a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1507 microversion: 2.1 time: 0.282190 Jul 25 12:54:39.775575 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1539/3149] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:39 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1507 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:40.040039 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-141e377d-ecf8-4fad-a033-735639666fad tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:40.041405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-141e377d-ecf8-4fad-a033-735639666fad tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:40.079043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-141e377d-ecf8-4fad-a033-735639666fad tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:40.079662 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-141e377d-ecf8-4fad-a033-735639666fad tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:40.080626 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-141e377d-ecf8-4fad-a033-735639666fad tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:40.081422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-141e377d-ecf8-4fad-a033-735639666fad tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:40.101229 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b4df9888-f20e-4081-8cfb-56defe690cb1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:40.101916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b4df9888-f20e-4081-8cfb-56defe690cb1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:40.110872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4df9888-f20e-4081-8cfb-56defe690cb1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:40.111331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4df9888-f20e-4081-8cfb-56defe690cb1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:40.112134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4df9888-f20e-4081-8cfb-56defe690cb1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:40.112569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4df9888-f20e-4081-8cfb-56defe690cb1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:40.479378 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-141e377d-ecf8-4fad-a033-735639666fad tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:40.493303 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b4df9888-f20e-4081-8cfb-56defe690cb1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:40.504015 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b4df9888-f20e-4081-8cfb-56defe690cb1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1679 microversion: 2.1 time: 0.407644 Jul 25 12:54:40.505851 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1540/3150] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:40 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1679 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:54:40.509461 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-141e377d-ecf8-4fad-a033-735639666fad tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1318 microversion: 2.1 time: 0.486159 Jul 25 12:54:40.511911 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1611/3151] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:40 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1318 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:40.793543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1a862f24-a701-43ef-ac57-6bbbf4fb9521 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:40.807949 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1a862f24-a701-43ef-ac57-6bbbf4fb9521 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:40.838643 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a862f24-a701-43ef-ac57-6bbbf4fb9521 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:40.839440 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a862f24-a701-43ef-ac57-6bbbf4fb9521 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:40.840875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a862f24-a701-43ef-ac57-6bbbf4fb9521 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:40.841815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a862f24-a701-43ef-ac57-6bbbf4fb9521 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:41.101494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1a862f24-a701-43ef-ac57-6bbbf4fb9521 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:41.117159 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1a862f24-a701-43ef-ac57-6bbbf4fb9521 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1507 microversion: 2.1 time: 0.331301 Jul 25 12:54:41.141161 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1541/3152] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:40 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1507 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:41.536568 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e57031c2-913c-46e3-8a11-c762e496a0df tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:41.538843 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e57031c2-913c-46e3-8a11-c762e496a0df tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:41.542254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5d79583e-f137-42bf-aa6c-84ed767afa89 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:41.543434 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5d79583e-f137-42bf-aa6c-84ed767afa89 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:41.547929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e57031c2-913c-46e3-8a11-c762e496a0df tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:41.548521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e57031c2-913c-46e3-8a11-c762e496a0df tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:41.550301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e57031c2-913c-46e3-8a11-c762e496a0df tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:41.551055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e57031c2-913c-46e3-8a11-c762e496a0df tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:41.561574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:41.562286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:41.565488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d79583e-f137-42bf-aa6c-84ed767afa89 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:41.566025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d79583e-f137-42bf-aa6c-84ed767afa89 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:41.566905 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d79583e-f137-42bf-aa6c-84ed767afa89 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:41.567345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d79583e-f137-42bf-aa6c-84ed767afa89 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:41.784991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:41.901594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e57031c2-913c-46e3-8a11-c762e496a0df tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:41.918574 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e57031c2-913c-46e3-8a11-c762e496a0df tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1687 microversion: 2.1 time: 0.391491 Jul 25 12:54:41.919904 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1612/3153] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:41 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1687 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:54:41.937400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5d79583e-f137-42bf-aa6c-84ed767afa89 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:41.959075 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5d79583e-f137-42bf-aa6c-84ed767afa89 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1318 microversion: 2.1 time: 0.421569 Jul 25 12:54:41.963913 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1542/3154] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:41 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1318 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:42.149900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2450f673-cc9a-4c87-a97d-404b6ed0bf59 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:42.150446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2450f673-cc9a-4c87-a97d-404b6ed0bf59 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:42.164045 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2450f673-cc9a-4c87-a97d-404b6ed0bf59 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:42.164612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2450f673-cc9a-4c87-a97d-404b6ed0bf59 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:42.165291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2450f673-cc9a-4c87-a97d-404b6ed0bf59 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:42.165712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2450f673-cc9a-4c87-a97d-404b6ed0bf59 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:42.461103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2450f673-cc9a-4c87-a97d-404b6ed0bf59 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:42.502988 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2450f673-cc9a-4c87-a97d-404b6ed0bf59 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1507 microversion: 2.1 time: 0.357384 Jul 25 12:54:42.505136 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1613/3155] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:42 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1507 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:42.952380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c2762e3e-5caf-4547-b85e-4c937ddac4b5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:42.953337 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c2762e3e-5caf-4547-b85e-4c937ddac4b5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:42.965891 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2762e3e-5caf-4547-b85e-4c937ddac4b5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:42.966794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2762e3e-5caf-4547-b85e-4c937ddac4b5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:42.967977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2762e3e-5caf-4547-b85e-4c937ddac4b5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:42.968877 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2762e3e-5caf-4547-b85e-4c937ddac4b5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:43.020639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-648c021e-fbfb-410f-acf3-7e5541250058 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:43.022893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-648c021e-fbfb-410f-acf3-7e5541250058 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:43.068553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-648c021e-fbfb-410f-acf3-7e5541250058 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:43.069925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-648c021e-fbfb-410f-acf3-7e5541250058 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:43.074959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-648c021e-fbfb-410f-acf3-7e5541250058 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:43.077452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-648c021e-fbfb-410f-acf3-7e5541250058 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:43.547399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-648c021e-fbfb-410f-acf3-7e5541250058 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:43.570210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c2762e3e-5caf-4547-b85e-4c937ddac4b5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:43.579916 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-648c021e-fbfb-410f-acf3-7e5541250058 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1318 microversion: 2.1 time: 0.578545 Jul 25 12:54:43.597424 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1614/3156] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:42 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1318 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:43.597702 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c2762e3e-5caf-4547-b85e-4c937ddac4b5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1682 microversion: 2.1 time: 0.643650 Jul 25 12:54:43.597702 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1543/3157] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:42 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1682 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:54:43.598151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2bb8b2e0-0832-4519-8193-fd576e72693e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:43.598151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2bb8b2e0-0832-4519-8193-fd576e72693e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:43.608080 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2bb8b2e0-0832-4519-8193-fd576e72693e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:43.610106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2bb8b2e0-0832-4519-8193-fd576e72693e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:43.613749 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2bb8b2e0-0832-4519-8193-fd576e72693e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:43.616443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2bb8b2e0-0832-4519-8193-fd576e72693e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:43.987150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2bb8b2e0-0832-4519-8193-fd576e72693e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:44.000153 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2bb8b2e0-0832-4519-8193-fd576e72693e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1507 microversion: 2.1 time: 0.412526 Jul 25 12:54:44.002839 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1615/3158] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:43 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1507 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:44.610471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d4e8d2ba-a724-4329-9216-51ced01df054 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:44.612036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d4e8d2ba-a724-4329-9216-51ced01df054 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:44.627191 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5d6608f2-cdc9-42b4-a3b4-fe3912384f54 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:44.630188 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5d6608f2-cdc9-42b4-a3b4-fe3912384f54 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:44.658270 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4e8d2ba-a724-4329-9216-51ced01df054 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:44.673857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4e8d2ba-a724-4329-9216-51ced01df054 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:44.677021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d6608f2-cdc9-42b4-a3b4-fe3912384f54 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:44.679230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4e8d2ba-a724-4329-9216-51ced01df054 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:44.680467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d6608f2-cdc9-42b4-a3b4-fe3912384f54 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:44.683366 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4e8d2ba-a724-4329-9216-51ced01df054 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:44.691230 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d6608f2-cdc9-42b4-a3b4-fe3912384f54 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:44.697032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d6608f2-cdc9-42b4-a3b4-fe3912384f54 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:45.406359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d4e8d2ba-a724-4329-9216-51ced01df054 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:45.422557 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d4e8d2ba-a724-4329-9216-51ced01df054 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1318 microversion: 2.1 time: 0.817994 Jul 25 12:54:45.424913 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1544/3159] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:44 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1318 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:54:45.454470 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8b7278b6-ee03-41a8-bfee-77e936c0c71b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:45.455484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8b7278b6-ee03-41a8-bfee-77e936c0c71b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:45.468725 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b7278b6-ee03-41a8-bfee-77e936c0c71b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:45.474065 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b7278b6-ee03-41a8-bfee-77e936c0c71b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:45.475716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b7278b6-ee03-41a8-bfee-77e936c0c71b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:45.476349 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b7278b6-ee03-41a8-bfee-77e936c0c71b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:45.508807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5d6608f2-cdc9-42b4-a3b4-fe3912384f54 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:45.522721 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5d6608f2-cdc9-42b4-a3b4-fe3912384f54 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1682 microversion: 2.1 time: 0.908268 Jul 25 12:54:45.533408 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1616/3160] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:44 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1682 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:54:45.885787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8b7278b6-ee03-41a8-bfee-77e936c0c71b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:45.921634 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8b7278b6-ee03-41a8-bfee-77e936c0c71b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1507 microversion: 2.1 time: 0.476875 Jul 25 12:54:45.923912 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1545/3161] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:45 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1507 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:46.459874 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ae6d7ac6-f6e0-4071-9d05-da5ac1033ae3 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:46.460750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ae6d7ac6-f6e0-4071-9d05-da5ac1033ae3 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:46.480467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae6d7ac6-f6e0-4071-9d05-da5ac1033ae3 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:46.485095 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae6d7ac6-f6e0-4071-9d05-da5ac1033ae3 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:46.486333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae6d7ac6-f6e0-4071-9d05-da5ac1033ae3 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:46.489869 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae6d7ac6-f6e0-4071-9d05-da5ac1033ae3 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:46.552816 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4d5db152-2865-4d19-8377-e735e5a16beb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:46.558636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4d5db152-2865-4d19-8377-e735e5a16beb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:46.625272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4d5db152-2865-4d19-8377-e735e5a16beb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:46.635386 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4d5db152-2865-4d19-8377-e735e5a16beb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:46.650310 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4d5db152-2865-4d19-8377-e735e5a16beb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:46.661129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4d5db152-2865-4d19-8377-e735e5a16beb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:47.218019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4d5db152-2865-4d19-8377-e735e5a16beb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:47.240102 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4d5db152-2865-4d19-8377-e735e5a16beb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1682 microversion: 2.1 time: 0.690639 Jul 25 12:54:47.255369 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1546/3162] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:46 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1682 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:47.272775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d3a922ed-8348-4092-b415-1e20e287c0af tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:47.277045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d3a922ed-8348-4092-b415-1e20e287c0af tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:47.290356 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d3a922ed-8348-4092-b415-1e20e287c0af tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:47.291133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d3a922ed-8348-4092-b415-1e20e287c0af tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:47.292184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d3a922ed-8348-4092-b415-1e20e287c0af tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:47.293045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d3a922ed-8348-4092-b415-1e20e287c0af tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:47.348272 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ae6d7ac6-f6e0-4071-9d05-da5ac1033ae3 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:47.361492 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ae6d7ac6-f6e0-4071-9d05-da5ac1033ae3 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1318 microversion: 2.1 time: 0.913042 Jul 25 12:54:47.366849 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1617/3163] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:46 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1318 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:47.378421 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-9190fffb-40b8-43fc-b4c9-126d6de03325 req-0042a1fb-2264-4f29-b91b-ffc6a26cd2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b730aecb-2c1f-46ef-b457-8a3717655518", "name": "network-vif-plugged", "status": "completed", "tag": "45191120-4204-4de7-9ef8-5d5c4ba83f89"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:54:47.417778 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9190fffb-40b8-43fc-b4c9-126d6de03325 req-0042a1fb-2264-4f29-b91b-ffc6a26cd2a6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:47.418814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9190fffb-40b8-43fc-b4c9-126d6de03325 req-0042a1fb-2264-4f29-b91b-ffc6a26cd2a6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:47.434341 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-9190fffb-40b8-43fc-b4c9-126d6de03325 req-0042a1fb-2264-4f29-b91b-ffc6a26cd2a6 service nova] Creating event network-vif-plugged:45191120-4204-4de7-9ef8-5d5c4ba83f89 for instance b730aecb-2c1f-46ef-b457-8a3717655518 on n-h1-848886-15 Jul 25 12:54:47.444173 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-9190fffb-40b8-43fc-b4c9-126d6de03325 req-0042a1fb-2264-4f29-b91b-ffc6a26cd2a6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074977 Jul 25 12:54:47.445559 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1618/3164] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:54:47.678692 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d3a922ed-8348-4092-b415-1e20e287c0af tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:47.690704 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d3a922ed-8348-4092-b415-1e20e287c0af tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1507 microversion: 2.1 time: 0.428364 Jul 25 12:54:47.692324 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1547/3165] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:47 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1507 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:48.276292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-618d4d18-16bf-49c2-b25b-f36d758183c6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:48.280015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-618d4d18-16bf-49c2-b25b-f36d758183c6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:48.291865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-618d4d18-16bf-49c2-b25b-f36d758183c6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:48.292667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-618d4d18-16bf-49c2-b25b-f36d758183c6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:48.293760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-618d4d18-16bf-49c2-b25b-f36d758183c6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:48.296753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-618d4d18-16bf-49c2-b25b-f36d758183c6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:48.390366 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e458734c-65bd-4049-8017-6ceed42dbe3a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:48.390993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e458734c-65bd-4049-8017-6ceed42dbe3a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:48.411088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e458734c-65bd-4049-8017-6ceed42dbe3a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:48.412801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e458734c-65bd-4049-8017-6ceed42dbe3a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:48.415538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e458734c-65bd-4049-8017-6ceed42dbe3a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:48.416195 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e458734c-65bd-4049-8017-6ceed42dbe3a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:48.472144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:48.846808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-618d4d18-16bf-49c2-b25b-f36d758183c6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:48.861990 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-618d4d18-16bf-49c2-b25b-f36d758183c6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1682 microversion: 2.1 time: 0.597168 Jul 25 12:54:48.871478 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1619/3166] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:48 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1682 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:54:48.879643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f0bcdbea-9d04-45a5-bfe9-564f8fd1bf24 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:48.884996 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f0bcdbea-9d04-45a5-bfe9-564f8fd1bf24 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:48.897324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=58 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:48.900954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f0bcdbea-9d04-45a5-bfe9-564f8fd1bf24 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:48.906332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f0bcdbea-9d04-45a5-bfe9-564f8fd1bf24 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:48.908530 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f0bcdbea-9d04-45a5-bfe9-564f8fd1bf24 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:48.911030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f0bcdbea-9d04-45a5-bfe9-564f8fd1bf24 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:48.939313 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e458734c-65bd-4049-8017-6ceed42dbe3a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:48.955904 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e458734c-65bd-4049-8017-6ceed42dbe3a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1318 microversion: 2.1 time: 0.569444 Jul 25 12:54:48.970729 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1548/3167] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:48 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1318 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:49.304208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f0bcdbea-9d04-45a5-bfe9-564f8fd1bf24 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:49.321452 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f0bcdbea-9d04-45a5-bfe9-564f8fd1bf24 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1507 microversion: 2.1 time: 0.448187 Jul 25 12:54:49.327787 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1620/3168] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:48 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1507 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:49.487285 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-0e26380d-c72c-4f8e-a114-d51f442d446b req-83e57c97-ae69-4d6a-9214-4caf02e771be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0e5b678-c54d-4505-8391-787e74886dce", "name": "network-vif-plugged", "status": "completed", "tag": "ccd4ab2a-3511-4970-8003-0627319e9a8b"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:54:49.532409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0e26380d-c72c-4f8e-a114-d51f442d446b req-83e57c97-ae69-4d6a-9214-4caf02e771be service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:49.532409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0e26380d-c72c-4f8e-a114-d51f442d446b req-83e57c97-ae69-4d6a-9214-4caf02e771be service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:49.559180 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-0e26380d-c72c-4f8e-a114-d51f442d446b req-83e57c97-ae69-4d6a-9214-4caf02e771be service nova] Creating event network-vif-plugged:ccd4ab2a-3511-4970-8003-0627319e9a8b for instance b0e5b678-c54d-4505-8391-787e74886dce on n-h1-848886-15 Jul 25 12:54:49.581137 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-0e26380d-c72c-4f8e-a114-d51f442d446b req-83e57c97-ae69-4d6a-9214-4caf02e771be service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101633 Jul 25 12:54:49.583521 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1549/3169] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 25 12:54:49.914806 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-26dc4cbb-319b-4a4d-9bc3-fefdecd94d88 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:49.916410 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-26dc4cbb-319b-4a4d-9bc3-fefdecd94d88 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:49.930703 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-26dc4cbb-319b-4a4d-9bc3-fefdecd94d88 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:49.931984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-26dc4cbb-319b-4a4d-9bc3-fefdecd94d88 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:49.934191 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-26dc4cbb-319b-4a4d-9bc3-fefdecd94d88 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:49.935469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-26dc4cbb-319b-4a4d-9bc3-fefdecd94d88 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:50.009262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3659c9a2-0f30-4634-b273-4def33b41ef0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:50.017031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3659c9a2-0f30-4634-b273-4def33b41ef0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:50.079625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3659c9a2-0f30-4634-b273-4def33b41ef0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:50.080289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3659c9a2-0f30-4634-b273-4def33b41ef0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:50.081704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3659c9a2-0f30-4634-b273-4def33b41ef0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:50.085176 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3659c9a2-0f30-4634-b273-4def33b41ef0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:50.789227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-26dc4cbb-319b-4a4d-9bc3-fefdecd94d88 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:50.803241 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-26dc4cbb-319b-4a4d-9bc3-fefdecd94d88 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1682 microversion: 2.1 time: 0.908874 Jul 25 12:54:50.804514 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1621/3170] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:49 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1682 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:50.823484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3659c9a2-0f30-4634-b273-4def33b41ef0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:50.830187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-abf90907-46da-44e8-b780-df3bfd156912 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:50.831893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-abf90907-46da-44e8-b780-df3bfd156912 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:50.856493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-abf90907-46da-44e8-b780-df3bfd156912 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:50.857021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-abf90907-46da-44e8-b780-df3bfd156912 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:50.858191 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-abf90907-46da-44e8-b780-df3bfd156912 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:50.859095 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-abf90907-46da-44e8-b780-df3bfd156912 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:50.867261 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3659c9a2-0f30-4634-b273-4def33b41ef0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1318 microversion: 2.1 time: 0.879602 Jul 25 12:54:50.885355 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1550/3171] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:49 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1318 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:51.456373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-abf90907-46da-44e8-b780-df3bfd156912 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:51.481478 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-abf90907-46da-44e8-b780-df3bfd156912 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1507 microversion: 2.1 time: 0.674453 Jul 25 12:54:51.500488 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1622/3172] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:50 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1507 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:51.853928 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6647e58c-8d6e-41b9-9d0d-7e364a735b59 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:51.889401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6647e58c-8d6e-41b9-9d0d-7e364a735b59 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:51.909089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7028e4f9-a46b-444c-b136-0b1587f17922 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:51.909990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7028e4f9-a46b-444c-b136-0b1587f17922 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:51.912343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6647e58c-8d6e-41b9-9d0d-7e364a735b59 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:51.913773 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6647e58c-8d6e-41b9-9d0d-7e364a735b59 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:51.917995 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6647e58c-8d6e-41b9-9d0d-7e364a735b59 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:51.919471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6647e58c-8d6e-41b9-9d0d-7e364a735b59 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:51.934117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7028e4f9-a46b-444c-b136-0b1587f17922 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:51.934492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7028e4f9-a46b-444c-b136-0b1587f17922 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:51.936443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7028e4f9-a46b-444c-b136-0b1587f17922 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:51.937534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7028e4f9-a46b-444c-b136-0b1587f17922 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:52.211264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7028e4f9-a46b-444c-b136-0b1587f17922 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:52.225133 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7028e4f9-a46b-444c-b136-0b1587f17922 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1507 microversion: 2.1 time: 0.320312 Jul 25 12:54:52.240763 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1623/3173] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:51 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1507 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:52.256199 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d3942fff-fd1e-4b46-ad1e-94bd2a9ad77b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:52.259756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d3942fff-fd1e-4b46-ad1e-94bd2a9ad77b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:52.277392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3942fff-fd1e-4b46-ad1e-94bd2a9ad77b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:52.279043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3942fff-fd1e-4b46-ad1e-94bd2a9ad77b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:52.280750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3942fff-fd1e-4b46-ad1e-94bd2a9ad77b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:52.282416 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3942fff-fd1e-4b46-ad1e-94bd2a9ad77b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:52.794860 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6647e58c-8d6e-41b9-9d0d-7e364a735b59 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:52.813507 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6647e58c-8d6e-41b9-9d0d-7e364a735b59 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1682 microversion: 2.1 time: 0.978845 Jul 25 12:54:52.814821 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1551/3174] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:51 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1682 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:52.849617 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-98191042-13e3-4bc3-bd68-92d2703581e4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:52.852061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-98191042-13e3-4bc3-bd68-92d2703581e4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:52.910527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98191042-13e3-4bc3-bd68-92d2703581e4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:52.913696 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98191042-13e3-4bc3-bd68-92d2703581e4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:52.919512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98191042-13e3-4bc3-bd68-92d2703581e4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:52.920589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98191042-13e3-4bc3-bd68-92d2703581e4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:53.088370 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d3942fff-fd1e-4b46-ad1e-94bd2a9ad77b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:53.179249 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d3942fff-fd1e-4b46-ad1e-94bd2a9ad77b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1507 microversion: 2.1 time: 0.928248 Jul 25 12:54:53.186575 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1624/3175] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:52 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1507 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:53.215048 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6362fc0a-89eb-4cdb-a000-5c8fe3a92baa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "OS-DCF:diskConfig": "AUTO"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:54:53.239304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6362fc0a-89eb-4cdb-a000-5c8fe3a92baa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:53.273173 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6362fc0a-89eb-4cdb-a000-5c8fe3a92baa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:53.273947 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6362fc0a-89eb-4cdb-a000-5c8fe3a92baa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:53.275314 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6362fc0a-89eb-4cdb-a000-5c8fe3a92baa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:53.276025 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6362fc0a-89eb-4cdb-a000-5c8fe3a92baa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:53.335160 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-98191042-13e3-4bc3-bd68-92d2703581e4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:53.350063 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-98191042-13e3-4bc3-bd68-92d2703581e4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1507 microversion: 2.1 time: 0.531017 Jul 25 12:54:53.351779 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1552/3176] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:52 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1507 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:53.613503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-6362fc0a-89eb-4cdb-a000-5c8fe3a92baa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:54:53.616605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-6362fc0a-89eb-4cdb-a000-5c8fe3a92baa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:54:53.617661 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-6362fc0a-89eb-4cdb-a000-5c8fe3a92baa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:54:53.618854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-6362fc0a-89eb-4cdb-a000-5c8fe3a92baa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:54:53.620899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-6362fc0a-89eb-4cdb-a000-5c8fe3a92baa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:54:53.678724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:53.804931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6362fc0a-89eb-4cdb-a000-5c8fe3a92baa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:53.818063 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6362fc0a-89eb-4cdb-a000-5c8fe3a92baa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:53.818526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6362fc0a-89eb-4cdb-a000-5c8fe3a92baa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:53.819354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6362fc0a-89eb-4cdb-a000-5c8fe3a92baa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:53.819802 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6362fc0a-89eb-4cdb-a000-5c8fe3a92baa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:53.856017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-67fb067e-c769-4543-b64b-ec912d423060 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:53.857668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-67fb067e-c769-4543-b64b-ec912d423060 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:53.874339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:53.892681 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6362fc0a-89eb-4cdb-a000-5c8fe3a92baa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "POST /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce/action" status: 202 len: 1109 microversion: 2.1 time: 0.683707 Jul 25 12:54:53.893445 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1625/3177] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:54:53 2022] POST /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce/action => generated 1109 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 12:54:53.913602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4c8dfa02-a86c-4db3-9dae-5d73f5f9e012 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:53.917650 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4c8dfa02-a86c-4db3-9dae-5d73f5f9e012 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:53.918946 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-67fb067e-c769-4543-b64b-ec912d423060 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:53.920082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-67fb067e-c769-4543-b64b-ec912d423060 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:53.924267 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-67fb067e-c769-4543-b64b-ec912d423060 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:53.925061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-67fb067e-c769-4543-b64b-ec912d423060 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:53.944011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c8dfa02-a86c-4db3-9dae-5d73f5f9e012 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:53.944927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c8dfa02-a86c-4db3-9dae-5d73f5f9e012 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:53.948415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c8dfa02-a86c-4db3-9dae-5d73f5f9e012 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:53.951852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c8dfa02-a86c-4db3-9dae-5d73f5f9e012 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:54.541350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-67fb067e-c769-4543-b64b-ec912d423060 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:54.550819 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-67fb067e-c769-4543-b64b-ec912d423060 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1682 microversion: 2.1 time: 0.702138 Jul 25 12:54:54.556155 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1553/3178] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:53 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1682 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:54.570132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4c8dfa02-a86c-4db3-9dae-5d73f5f9e012 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:54.579162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d31641b6-6199-4370-a926-142bb6a3b461 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:54.580283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d31641b6-6199-4370-a926-142bb6a3b461 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:54.590131 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d31641b6-6199-4370-a926-142bb6a3b461 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:54.591532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d31641b6-6199-4370-a926-142bb6a3b461 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:54.594124 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d31641b6-6199-4370-a926-142bb6a3b461 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:54.596277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d31641b6-6199-4370-a926-142bb6a3b461 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:54.599298 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4c8dfa02-a86c-4db3-9dae-5d73f5f9e012 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1514 microversion: 2.1 time: 0.687316 Jul 25 12:54:54.600364 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1626/3179] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:53 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1514 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:54.867382 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d31641b6-6199-4370-a926-142bb6a3b461 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:54.876386 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d31641b6-6199-4370-a926-142bb6a3b461 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1507 microversion: 2.1 time: 0.303725 Jul 25 12:54:54.880434 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1554/3180] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:54 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1507 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:55.587401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-56d2330b-5994-4c9e-bcef-d0f58e202e0b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:55.599850 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-56d2330b-5994-4c9e-bcef-d0f58e202e0b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:55.610488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56d2330b-5994-4c9e-bcef-d0f58e202e0b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:55.611182 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56d2330b-5994-4c9e-bcef-d0f58e202e0b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:55.612404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56d2330b-5994-4c9e-bcef-d0f58e202e0b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:55.613092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56d2330b-5994-4c9e-bcef-d0f58e202e0b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:55.635376 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-17da9fe0-b017-4ea3-a3df-baa8b0310166 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:55.637022 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-17da9fe0-b017-4ea3-a3df-baa8b0310166 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:55.666799 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-17da9fe0-b017-4ea3-a3df-baa8b0310166 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:55.668803 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-17da9fe0-b017-4ea3-a3df-baa8b0310166 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:55.673531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-17da9fe0-b017-4ea3-a3df-baa8b0310166 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:55.676166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-17da9fe0-b017-4ea3-a3df-baa8b0310166 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:56.421046 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-17da9fe0-b017-4ea3-a3df-baa8b0310166 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:56.439556 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-17da9fe0-b017-4ea3-a3df-baa8b0310166 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1514 microversion: 2.1 time: 0.819484 Jul 25 12:54:56.454372 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1555/3181] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:55 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1514 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:54:56.469743 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-05fe77c2-8376-4c6e-8f02-ba86f5aef668 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:56.470427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-05fe77c2-8376-4c6e-8f02-ba86f5aef668 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:56.508385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05fe77c2-8376-4c6e-8f02-ba86f5aef668 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:56.511152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05fe77c2-8376-4c6e-8f02-ba86f5aef668 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:56.513663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05fe77c2-8376-4c6e-8f02-ba86f5aef668 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:56.516979 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05fe77c2-8376-4c6e-8f02-ba86f5aef668 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:56.532043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-56d2330b-5994-4c9e-bcef-d0f58e202e0b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:56.551397 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-56d2330b-5994-4c9e-bcef-d0f58e202e0b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1682 microversion: 2.1 time: 0.975016 Jul 25 12:54:56.554327 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1627/3182] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:55 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1682 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:57.421621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-05fe77c2-8376-4c6e-8f02-ba86f5aef668 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:57.437818 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-05fe77c2-8376-4c6e-8f02-ba86f5aef668 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1507 microversion: 2.1 time: 0.996557 Jul 25 12:54:57.458572 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1556/3183] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:56 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1507 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:57.475935 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1416a9bc-7579-45e0-9d26-3bf9e70f3083 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:57.476962 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1416a9bc-7579-45e0-9d26-3bf9e70f3083 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:57.489501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1416a9bc-7579-45e0-9d26-3bf9e70f3083 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:57.490376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1416a9bc-7579-45e0-9d26-3bf9e70f3083 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:57.491423 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1416a9bc-7579-45e0-9d26-3bf9e70f3083 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:57.492844 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1416a9bc-7579-45e0-9d26-3bf9e70f3083 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:57.594608 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6012eadc-56a2-45e6-b2f2-6f2e8a47fc49 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:57.595543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6012eadc-56a2-45e6-b2f2-6f2e8a47fc49 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:57.612716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6012eadc-56a2-45e6-b2f2-6f2e8a47fc49 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:57.619781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6012eadc-56a2-45e6-b2f2-6f2e8a47fc49 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:57.633457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6012eadc-56a2-45e6-b2f2-6f2e8a47fc49 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:57.636463 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6012eadc-56a2-45e6-b2f2-6f2e8a47fc49 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:58.376689 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1416a9bc-7579-45e0-9d26-3bf9e70f3083 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:58.392373 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1416a9bc-7579-45e0-9d26-3bf9e70f3083 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1514 microversion: 2.1 time: 0.920931 Jul 25 12:54:58.394485 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1628/3184] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:57 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1514 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:58.472067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1db133ba-8b78-4655-b346-a7443d2ac471 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:58.473247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1db133ba-8b78-4655-b346-a7443d2ac471 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:58.489626 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1db133ba-8b78-4655-b346-a7443d2ac471 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:58.491040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1db133ba-8b78-4655-b346-a7443d2ac471 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:58.493023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1db133ba-8b78-4655-b346-a7443d2ac471 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:58.493638 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1db133ba-8b78-4655-b346-a7443d2ac471 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:59.539469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1db133ba-8b78-4655-b346-a7443d2ac471 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:59.552426 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1db133ba-8b78-4655-b346-a7443d2ac471 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1507 microversion: 2.1 time: 1.085369 Jul 25 12:54:59.559676 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1629/3185] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:58 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1507 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:59.570385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-75c18b7a-b932-4f6a-bf8f-96fd27063194 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:59.571643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-75c18b7a-b932-4f6a-bf8f-96fd27063194 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:59.582926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75c18b7a-b932-4f6a-bf8f-96fd27063194 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:59.586520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75c18b7a-b932-4f6a-bf8f-96fd27063194 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:59.587811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75c18b7a-b932-4f6a-bf8f-96fd27063194 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:59.590072 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75c18b7a-b932-4f6a-bf8f-96fd27063194 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:59.649016 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6012eadc-56a2-45e6-b2f2-6f2e8a47fc49 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:59.664429 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6012eadc-56a2-45e6-b2f2-6f2e8a47fc49 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1682 microversion: 2.1 time: 2.075204 Jul 25 12:54:59.671761 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1557/3186] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:57 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1682 bytes in 2084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:59.949090 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-75c18b7a-b932-4f6a-bf8f-96fd27063194 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:59.976955 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-75c18b7a-b932-4f6a-bf8f-96fd27063194 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1514 microversion: 2.1 time: 0.415482 Jul 25 12:54:59.978166 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1630/3187] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:59 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1514 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:00.591269 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f4aee951-45b3-4e3d-bbda-45f9c1eacb86 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:00.608235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f4aee951-45b3-4e3d-bbda-45f9c1eacb86 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:00.648419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4aee951-45b3-4e3d-bbda-45f9c1eacb86 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:00.654787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4aee951-45b3-4e3d-bbda-45f9c1eacb86 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:00.660733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4aee951-45b3-4e3d-bbda-45f9c1eacb86 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:00.667001 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4aee951-45b3-4e3d-bbda-45f9c1eacb86 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:00.735625 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cdb03d00-79bb-4796-92f2-e9ed875106cc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:00.739647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cdb03d00-79bb-4796-92f2-e9ed875106cc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:00.801259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cdb03d00-79bb-4796-92f2-e9ed875106cc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:00.804986 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cdb03d00-79bb-4796-92f2-e9ed875106cc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:00.810921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cdb03d00-79bb-4796-92f2-e9ed875106cc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:00.820814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cdb03d00-79bb-4796-92f2-e9ed875106cc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:00.992300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f4aee951-45b3-4e3d-bbda-45f9c1eacb86 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:01.004955 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f4aee951-45b3-4e3d-bbda-45f9c1eacb86 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1528 microversion: 2.1 time: 0.420539 Jul 25 12:55:01.016581 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1558/3188] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:00 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1528 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:01.025117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4bf0bde5-6509-40e6-be87-0ff70e78343c tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:01.032343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4bf0bde5-6509-40e6-be87-0ff70e78343c tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [instance: dbe0a495-7647-4b23-96c1-e46073e497eb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:01.056252 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4bf0bde5-6509-40e6-be87-0ff70e78343c tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:01.057138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4bf0bde5-6509-40e6-be87-0ff70e78343c tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:01.058417 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4bf0bde5-6509-40e6-be87-0ff70e78343c tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:01.058897 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4bf0bde5-6509-40e6-be87-0ff70e78343c tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:01.211678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4bf0bde5-6509-40e6-be87-0ff70e78343c tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [instance: dbe0a495-7647-4b23-96c1-e46073e497eb] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:55:01.464422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cdb03d00-79bb-4796-92f2-e9ed875106cc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:01.494525 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cdb03d00-79bb-4796-92f2-e9ed875106cc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1682 microversion: 2.1 time: 0.774976 Jul 25 12:55:01.498827 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1631/3189] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:00 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1682 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:01.507476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-31716d3e-a5df-4b37-8e66-2a0353a23079 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:01.511527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-31716d3e-a5df-4b37-8e66-2a0353a23079 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:01.528533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-31716d3e-a5df-4b37-8e66-2a0353a23079 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:01.529306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-31716d3e-a5df-4b37-8e66-2a0353a23079 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:01.530370 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-31716d3e-a5df-4b37-8e66-2a0353a23079 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:01.532161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-31716d3e-a5df-4b37-8e66-2a0353a23079 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:01.544233 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4bf0bde5-6509-40e6-be87-0ff70e78343c tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb" status: 204 len: 0 microversion: 2.1 time: 0.523184 Jul 25 12:55:01.545072 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1559/3190] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:55:01 2022] DELETE /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:55:01.559484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-caed3a47-30d6-4f5e-b8b4-5c5f5c6647ec tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:01.560853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-caed3a47-30d6-4f5e-b8b4-5c5f5c6647ec tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [instance: dbe0a495-7647-4b23-96c1-e46073e497eb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:01.576543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-caed3a47-30d6-4f5e-b8b4-5c5f5c6647ec tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:01.577403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-caed3a47-30d6-4f5e-b8b4-5c5f5c6647ec tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:01.581519 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-caed3a47-30d6-4f5e-b8b4-5c5f5c6647ec tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:01.582445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-caed3a47-30d6-4f5e-b8b4-5c5f5c6647ec tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:02.136060 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-31716d3e-a5df-4b37-8e66-2a0353a23079 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:02.187916 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-31716d3e-a5df-4b37-8e66-2a0353a23079 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1514 microversion: 2.1 time: 0.680379 Jul 25 12:55:02.192301 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1632/3191] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:01 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1514 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:02.217795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b9a52674-752c-4ea3-bec7-1c0c04ea1a14 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:02.220383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b9a52674-752c-4ea3-bec7-1c0c04ea1a14 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:02.263310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b9a52674-752c-4ea3-bec7-1c0c04ea1a14 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:02.266162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b9a52674-752c-4ea3-bec7-1c0c04ea1a14 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:02.271783 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b9a52674-752c-4ea3-bec7-1c0c04ea1a14 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:02.276373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b9a52674-752c-4ea3-bec7-1c0c04ea1a14 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:02.369238 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-caed3a47-30d6-4f5e-b8b4-5c5f5c6647ec tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c5483c74264690afd6467b62c73725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be80e52f433464e8a9e6b017fcb0753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:02.399197 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-caed3a47-30d6-4f5e-b8b4-5c5f5c6647ec tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb" status: 200 len: 1667 microversion: 2.1 time: 0.840206 Jul 25 12:55:02.400956 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1560/3192] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:01 2022] GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb => generated 1667 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:55:02.528262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-47745e2a-6a39-434a-bca8-e9e629798746 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:02.529803 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-47745e2a-6a39-434a-bca8-e9e629798746 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:02.558663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47745e2a-6a39-434a-bca8-e9e629798746 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:02.563033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47745e2a-6a39-434a-bca8-e9e629798746 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:02.566193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47745e2a-6a39-434a-bca8-e9e629798746 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:02.572419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47745e2a-6a39-434a-bca8-e9e629798746 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:03.202862 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-47745e2a-6a39-434a-bca8-e9e629798746 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:03.212687 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-47745e2a-6a39-434a-bca8-e9e629798746 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1682 microversion: 2.1 time: 0.692617 Jul 25 12:55:03.229224 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1561/3193] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:02 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1682 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:03.235209 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-88079b02-be52-4e3b-9e84-83a163367dbb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:03.275268 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-88079b02-be52-4e3b-9e84-83a163367dbb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:03.285607 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b9a52674-752c-4ea3-bec7-1c0c04ea1a14 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:03.309008 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b9a52674-752c-4ea3-bec7-1c0c04ea1a14 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1523 microversion: 2.1 time: 1.107500 Jul 25 12:55:03.329721 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-88079b02-be52-4e3b-9e84-83a163367dbb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:03.330385 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1633/3194] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:02 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1523 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:03.351529 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-88079b02-be52-4e3b-9e84-83a163367dbb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:03.352638 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-88079b02-be52-4e3b-9e84-83a163367dbb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:03.354188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-88079b02-be52-4e3b-9e84-83a163367dbb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:03.430188 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-66e83cfa-7c5a-4478-9a87-1074221c6985 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:03.431273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-66e83cfa-7c5a-4478-9a87-1074221c6985 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [instance: dbe0a495-7647-4b23-96c1-e46073e497eb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:03.471094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-66e83cfa-7c5a-4478-9a87-1074221c6985 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:03.471561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-66e83cfa-7c5a-4478-9a87-1074221c6985 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:03.472363 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-66e83cfa-7c5a-4478-9a87-1074221c6985 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:03.485446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-66e83cfa-7c5a-4478-9a87-1074221c6985 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:04.480540 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-66e83cfa-7c5a-4478-9a87-1074221c6985 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c5483c74264690afd6467b62c73725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be80e52f433464e8a9e6b017fcb0753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:04.501044 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-66e83cfa-7c5a-4478-9a87-1074221c6985 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb" status: 200 len: 1667 microversion: 2.1 time: 1.079265 Jul 25 12:55:04.525395 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1634/3195] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:03 2022] GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb => generated 1667 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:04.539468 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-48b5ba62-452f-4fff-ab6f-59fdb45cb270 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:04.540181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-48b5ba62-452f-4fff-ab6f-59fdb45cb270 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:04.566166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48b5ba62-452f-4fff-ab6f-59fdb45cb270 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:04.574544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48b5ba62-452f-4fff-ab6f-59fdb45cb270 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:04.585472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48b5ba62-452f-4fff-ab6f-59fdb45cb270 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:04.585968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48b5ba62-452f-4fff-ab6f-59fdb45cb270 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:04.633640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-88079b02-be52-4e3b-9e84-83a163367dbb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:04.651962 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-88079b02-be52-4e3b-9e84-83a163367dbb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1514 microversion: 2.1 time: 1.420971 Jul 25 12:55:04.667756 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1562/3196] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:03 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1514 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:04.684486 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1ae94eff-a4cb-4906-b5a7-5c158291cf5f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:04.707120 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1ae94eff-a4cb-4906-b5a7-5c158291cf5f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:04.736520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ae94eff-a4cb-4906-b5a7-5c158291cf5f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:04.762988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ae94eff-a4cb-4906-b5a7-5c158291cf5f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:04.763958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ae94eff-a4cb-4906-b5a7-5c158291cf5f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:04.764426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ae94eff-a4cb-4906-b5a7-5c158291cf5f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:05.827193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1ae94eff-a4cb-4906-b5a7-5c158291cf5f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:05.836090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:55:05.898202 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1ae94eff-a4cb-4906-b5a7-5c158291cf5f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1523 microversion: 2.1 time: 1.226477 Jul 25 12:55:05.906443 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1563/3197] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:04 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1523 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:05.970468 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-04bfa744-801d-4b7c-af0a-eff4955fb93b req-4f0e3c9e-2d7b-4c31-b51b-2b205c623c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9cc21b1-7442-4031-b701-b534f237749f", "name": "network-vif-plugged", "status": "completed", "tag": "86c86fd3-b1f7-405c-92a4-239039e1570a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:55:06.023979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-48b5ba62-452f-4fff-ab6f-59fdb45cb270 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:06.044904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-04bfa744-801d-4b7c-af0a-eff4955fb93b req-4f0e3c9e-2d7b-4c31-b51b-2b205c623c00 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:06.051018 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-04bfa744-801d-4b7c-af0a-eff4955fb93b req-4f0e3c9e-2d7b-4c31-b51b-2b205c623c00 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:06.080379 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-48b5ba62-452f-4fff-ab6f-59fdb45cb270 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1682 microversion: 2.1 time: 1.551596 Jul 25 12:55:06.084627 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1635/3198] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:04 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1682 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:06.137688 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-04bfa744-801d-4b7c-af0a-eff4955fb93b req-4f0e3c9e-2d7b-4c31-b51b-2b205c623c00 service nova] Creating event network-vif-plugged:86c86fd3-b1f7-405c-92a4-239039e1570a for instance c9cc21b1-7442-4031-b701-b534f237749f on n-h2-848886-15 Jul 25 12:55:06.155103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e68b15f2-6976-46a5-bf6c-4c1a1429ec08 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:06.157346 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-04bfa744-801d-4b7c-af0a-eff4955fb93b req-4f0e3c9e-2d7b-4c31-b51b-2b205c623c00 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.243628 Jul 25 12:55:06.159868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e68b15f2-6976-46a5-bf6c-4c1a1429ec08 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [instance: dbe0a495-7647-4b23-96c1-e46073e497eb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:06.169435 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1564/3199] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:55:06.183102 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c2e64a9f-1f08-4a55-a51e-f50c4684c24b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:06.183860 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c2e64a9f-1f08-4a55-a51e-f50c4684c24b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:06.209932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e68b15f2-6976-46a5-bf6c-4c1a1429ec08 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:06.214454 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e68b15f2-6976-46a5-bf6c-4c1a1429ec08 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:06.217302 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e68b15f2-6976-46a5-bf6c-4c1a1429ec08 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:06.217757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2e64a9f-1f08-4a55-a51e-f50c4684c24b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:06.217992 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2e64a9f-1f08-4a55-a51e-f50c4684c24b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:06.218979 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2e64a9f-1f08-4a55-a51e-f50c4684c24b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:06.222315 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e68b15f2-6976-46a5-bf6c-4c1a1429ec08 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:06.230614 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2e64a9f-1f08-4a55-a51e-f50c4684c24b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:06.733099 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e68b15f2-6976-46a5-bf6c-4c1a1429ec08 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c5483c74264690afd6467b62c73725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be80e52f433464e8a9e6b017fcb0753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:06.770211 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e68b15f2-6976-46a5-bf6c-4c1a1429ec08 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb" status: 200 len: 1599 microversion: 2.1 time: 0.652219 Jul 25 12:55:06.774667 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1636/3200] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:06 2022] GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb => generated 1599 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:06.984951 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-505e2450-8990-4aa3-9e62-9f276952b802 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:07.000234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-505e2450-8990-4aa3-9e62-9f276952b802 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:07.034886 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c2e64a9f-1f08-4a55-a51e-f50c4684c24b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:07.065715 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c2e64a9f-1f08-4a55-a51e-f50c4684c24b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1514 microversion: 2.1 time: 0.894353 Jul 25 12:55:07.067371 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1565/3201] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:06 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1514 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:07.109154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-505e2450-8990-4aa3-9e62-9f276952b802 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:07.110040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-505e2450-8990-4aa3-9e62-9f276952b802 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:07.130795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-505e2450-8990-4aa3-9e62-9f276952b802 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:07.132881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f99f625e-edce-4278-977e-3eee82a76af2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:07.134041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-505e2450-8990-4aa3-9e62-9f276952b802 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:07.134305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f99f625e-edce-4278-977e-3eee82a76af2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:07.152541 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f99f625e-edce-4278-977e-3eee82a76af2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:07.159598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f99f625e-edce-4278-977e-3eee82a76af2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:07.163111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f99f625e-edce-4278-977e-3eee82a76af2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:07.163794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f99f625e-edce-4278-977e-3eee82a76af2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:07.919715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-505e2450-8990-4aa3-9e62-9f276952b802 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:07.929845 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-505e2450-8990-4aa3-9e62-9f276952b802 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1523 microversion: 2.1 time: 1.001440 Jul 25 12:55:07.957113 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1637/3202] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:06 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1523 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:07.962586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-86d11e0c-7f79-48fa-945b-8960aa81bdc9 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:07.978092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-86d11e0c-7f79-48fa-945b-8960aa81bdc9 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [instance: dbe0a495-7647-4b23-96c1-e46073e497eb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:07.994137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-86d11e0c-7f79-48fa-945b-8960aa81bdc9 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:07.998066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-86d11e0c-7f79-48fa-945b-8960aa81bdc9 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:08.014120 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-86d11e0c-7f79-48fa-945b-8960aa81bdc9 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:08.015204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-86d11e0c-7f79-48fa-945b-8960aa81bdc9 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:08.068121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f99f625e-edce-4278-977e-3eee82a76af2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:08.085629 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f99f625e-edce-4278-977e-3eee82a76af2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1682 microversion: 2.1 time: 0.960589 Jul 25 12:55:08.086307 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1566/3203] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:07 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1682 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:08.120996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d156710b-9ad2-471f-9129-91721750aa45 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:08.123492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d156710b-9ad2-471f-9129-91721750aa45 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:08.164542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d156710b-9ad2-471f-9129-91721750aa45 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:08.165449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d156710b-9ad2-471f-9129-91721750aa45 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:08.170318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d156710b-9ad2-471f-9129-91721750aa45 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:08.177224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d156710b-9ad2-471f-9129-91721750aa45 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:08.191776 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-86d11e0c-7f79-48fa-945b-8960aa81bdc9 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c5483c74264690afd6467b62c73725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be80e52f433464e8a9e6b017fcb0753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:08.208480 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-86d11e0c-7f79-48fa-945b-8960aa81bdc9 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb" status: 200 len: 1599 microversion: 2.1 time: 0.249675 Jul 25 12:55:08.228963 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1638/3204] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:07 2022] GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb => generated 1599 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:08.888950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-6b7f6f6b-0477-4573-83fd-e1701bd3bac3 req-54171eea-4c86-4e8c-be3e-598724db93e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe0a495-7647-4b23-96c1-e46073e497eb", "name": "network-vif-deleted", "tag": "7459768f-16a0-4c7b-9576-3d4672522591"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:55:08.953048 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6b7f6f6b-0477-4573-83fd-e1701bd3bac3 req-54171eea-4c86-4e8c-be3e-598724db93e4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:08.962419 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6b7f6f6b-0477-4573-83fd-e1701bd3bac3 req-54171eea-4c86-4e8c-be3e-598724db93e4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:09.031943 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-6b7f6f6b-0477-4573-83fd-e1701bd3bac3 req-54171eea-4c86-4e8c-be3e-598724db93e4 service nova] Creating event network-vif-deleted:7459768f-16a0-4c7b-9576-3d4672522591 for instance dbe0a495-7647-4b23-96c1-e46073e497eb on n-h1-848886-15 Jul 25 12:55:09.047776 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-6b7f6f6b-0477-4573-83fd-e1701bd3bac3 req-54171eea-4c86-4e8c-be3e-598724db93e4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163980 Jul 25 12:55:09.064363 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1639/3205] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:55:09.103283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b34daa71-c6fa-40d3-8335-4c262fb24725 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:09.105905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b34daa71-c6fa-40d3-8335-4c262fb24725 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:09.144967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b34daa71-c6fa-40d3-8335-4c262fb24725 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:09.145814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b34daa71-c6fa-40d3-8335-4c262fb24725 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:09.148854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b34daa71-c6fa-40d3-8335-4c262fb24725 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:09.150079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b34daa71-c6fa-40d3-8335-4c262fb24725 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:09.245971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d156710b-9ad2-471f-9129-91721750aa45 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:09.284258 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d156710b-9ad2-471f-9129-91721750aa45 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1514 microversion: 2.1 time: 1.191697 Jul 25 12:55:09.284911 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1567/3206] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:08 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1514 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:09.324925 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f197c03c-3776-4f3e-bba6-913f3d4a07f8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:09.327182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f197c03c-3776-4f3e-bba6-913f3d4a07f8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:09.351992 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f197c03c-3776-4f3e-bba6-913f3d4a07f8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:09.352925 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f197c03c-3776-4f3e-bba6-913f3d4a07f8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:09.354367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f197c03c-3776-4f3e-bba6-913f3d4a07f8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:09.358239 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f197c03c-3776-4f3e-bba6-913f3d4a07f8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:11.082152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f197c03c-3776-4f3e-bba6-913f3d4a07f8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:11.095418 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f197c03c-3776-4f3e-bba6-913f3d4a07f8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1682 microversion: 2.1 time: 1.799330 Jul 25 12:55:11.107811 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1568/3207] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:09 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1682 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:11.145608 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e00301a4-6782-428a-8747-f544757a327b tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:11.150019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e00301a4-6782-428a-8747-f544757a327b tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] [instance: dbe0a495-7647-4b23-96c1-e46073e497eb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:11.166739 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e00301a4-6782-428a-8747-f544757a327b tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:11.168442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e00301a4-6782-428a-8747-f544757a327b tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:11.174984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e00301a4-6782-428a-8747-f544757a327b tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:11.175838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e00301a4-6782-428a-8747-f544757a327b tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:11.212163 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-e00301a4-6782-428a-8747-f544757a327b tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] HTTP exception thrown: Instance dbe0a495-7647-4b23-96c1-e46073e497eb could not be found. Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e00301a4-6782-428a-8747-f544757a327b tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Request method failure captured: Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb HTTP/1.1 Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pJSurrPM8MEWyY1ypi_4n7ixxtVwkM2KsTmfefqZ-XDJkrV3y6KTb-s8tZwaxqRYPzfIetqCM8nxeUIz9sIuw6CCUFkI-BYHJrqEVMVTPodBvlmXSzcv7ZQ_JlnvRTilXUKg3TWxe2hHeI_LzdNMO88Exa-cSu78lHur39tDaI-5qY Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 1be80e52f433464e8a9e6b017fcb0753 Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersTestFqdnHostnames-397791217 Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1be80e52f433464e8a9e6b017fcb0753", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1be80e52f433464e8a9e6b017fcb0753"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1be80e52f433464e8a9e6b017fcb0753"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1be80e52f433464e8a9e6b017fcb0753"}]}] Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersTestFqdnHostnames-397791217 Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 1be80e52f433464e8a9e6b017fcb0753 Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-397791217 Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersTestFqdnHostnames-397791217-project Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 89c5483c74264690afd6467b62c73725 Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersTestFqdnHostnames-397791217-project Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance dbe0a495-7647-4b23-96c1-e46073e497eb could not be found. Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'dbe0a495-7647-4b23-96c1-e46073e497eb'} Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbe0a495-7647-4b23-96c1-e46073e497eb could not be found. Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbe0a495-7647-4b23-96c1-e46073e497eb could not be found. Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:55:11.215805 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:55:11.239311 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:55:11.239311 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:55:11.239311 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:55:11.239311 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:55:11.239311 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:55:11.239311 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbe0a495-7647-4b23-96c1-e46073e497eb could not be found. Jul 25 12:55:11.239311 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:55:11.273859 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b34daa71-c6fa-40d3-8335-4c262fb24725 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:11.290014 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e00301a4-6782-428a-8747-f544757a327b tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Returning 404 to user: Instance dbe0a495-7647-4b23-96c1-e46073e497eb could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:55:11.298962 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e00301a4-6782-428a-8747-f544757a327b tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb" status: 404 len: 111 microversion: 2.1 time: 0.183221 Jul 25 12:55:11.308501 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1569/3208] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:11 2022] GET /compute/v2.1/servers/dbe0a495-7647-4b23-96c1-e46073e497eb => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:55:11.321111 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b34daa71-c6fa-40d3-8335-4c262fb24725 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1523 microversion: 2.1 time: 2.250002 Jul 25 12:55:11.337054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-79350d04-4904-4cf0-9f18-dd4217888121 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:11.337713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-79350d04-4904-4cf0-9f18-dd4217888121 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:11.354309 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1640/3209] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:09 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1523 bytes in 2289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:11.357404 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79350d04-4904-4cf0-9f18-dd4217888121 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:11.369053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79350d04-4904-4cf0-9f18-dd4217888121 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:11.374443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79350d04-4904-4cf0-9f18-dd4217888121 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:11.375266 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79350d04-4904-4cf0-9f18-dd4217888121 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:11.379393 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9551bee1-d0e7-4852-8c37-df4dfb977e57 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] Calling method '.version_select at 0x7efcf9daeee0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:11.471670 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9551bee1-d0e7-4852-8c37-df4dfb977e57 tempest-ServersTestFqdnHostnames-397791217 tempest-ServersTestFqdnHostnames-397791217-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1099618283" status: 202 len: 0 microversion: 2.1 time: 0.114951 Jul 25 12:55:11.488799 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1641/3210] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Jul 25 12:55:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1099618283 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:55:11.879351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-79350d04-4904-4cf0-9f18-dd4217888121 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:11.895731 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-79350d04-4904-4cf0-9f18-dd4217888121 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1514 microversion: 2.1 time: 0.579632 Jul 25 12:55:11.912940 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1570/3211] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:11 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1514 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:12.124035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-67123360-ff7b-4ed6-84bb-b2412fd54a3d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:12.124035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-67123360-ff7b-4ed6-84bb-b2412fd54a3d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:12.172176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-67123360-ff7b-4ed6-84bb-b2412fd54a3d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:12.175354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-67123360-ff7b-4ed6-84bb-b2412fd54a3d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:12.177227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-67123360-ff7b-4ed6-84bb-b2412fd54a3d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:12.178030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-67123360-ff7b-4ed6-84bb-b2412fd54a3d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:12.366424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-83c8d065-ec6f-4599-bd63-8690c6379f01 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:12.368670 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-83c8d065-ec6f-4599-bd63-8690c6379f01 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:12.395323 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-83c8d065-ec6f-4599-bd63-8690c6379f01 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:12.405184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-83c8d065-ec6f-4599-bd63-8690c6379f01 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:12.414682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-83c8d065-ec6f-4599-bd63-8690c6379f01 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:12.421428 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-83c8d065-ec6f-4599-bd63-8690c6379f01 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:13.047911 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-67123360-ff7b-4ed6-84bb-b2412fd54a3d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:13.051315 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:55:13.088186 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-67123360-ff7b-4ed6-84bb-b2412fd54a3d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1682 microversion: 2.1 time: 0.968111 Jul 25 12:55:13.092459 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1642/3212] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:12 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1682 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:13.109208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fb73d307-2f3d-4069-a0a5-86a81bb213cc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:13.116107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fb73d307-2f3d-4069-a0a5-86a81bb213cc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:13.136981 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb73d307-2f3d-4069-a0a5-86a81bb213cc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:13.137451 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb73d307-2f3d-4069-a0a5-86a81bb213cc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:13.144239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb73d307-2f3d-4069-a0a5-86a81bb213cc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:13.145343 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb73d307-2f3d-4069-a0a5-86a81bb213cc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:13.611532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-83c8d065-ec6f-4599-bd63-8690c6379f01 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:13.631648 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-83c8d065-ec6f-4599-bd63-8690c6379f01 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1523 microversion: 2.1 time: 1.265753 Jul 25 12:55:13.632833 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1571/3213] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:12 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1523 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:14.120084 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0d4490ac-6014-440f-85db-051a85db845d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:14.121661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0d4490ac-6014-440f-85db-051a85db845d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:14.183789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d4490ac-6014-440f-85db-051a85db845d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:14.184270 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d4490ac-6014-440f-85db-051a85db845d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:14.187936 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d4490ac-6014-440f-85db-051a85db845d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:14.190485 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d4490ac-6014-440f-85db-051a85db845d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:14.221518 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fb73d307-2f3d-4069-a0a5-86a81bb213cc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:14.264323 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fb73d307-2f3d-4069-a0a5-86a81bb213cc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1514 microversion: 2.1 time: 1.170025 Jul 25 12:55:14.265772 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1643/3214] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:13 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1514 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:14.658635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-70ecc97d-2b85-4c3b-afe9-67037fe49da4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:14.659341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-70ecc97d-2b85-4c3b-afe9-67037fe49da4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:14.682782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70ecc97d-2b85-4c3b-afe9-67037fe49da4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:14.689372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70ecc97d-2b85-4c3b-afe9-67037fe49da4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:14.696039 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70ecc97d-2b85-4c3b-afe9-67037fe49da4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:14.702384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70ecc97d-2b85-4c3b-afe9-67037fe49da4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:15.365917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0d4490ac-6014-440f-85db-051a85db845d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:15.424826 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-70ecc97d-2b85-4c3b-afe9-67037fe49da4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:15.433079 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0d4490ac-6014-440f-85db-051a85db845d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 1.313384 Jul 25 12:55:15.435225 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1572/3215] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:14 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:15.440843 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-66b26230-35c9-464a-b287-32311f879426 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:15.441739 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-66b26230-35c9-464a-b287-32311f879426 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:15.449077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66b26230-35c9-464a-b287-32311f879426 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:15.449897 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66b26230-35c9-464a-b287-32311f879426 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:15.451398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66b26230-35c9-464a-b287-32311f879426 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:15.452265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66b26230-35c9-464a-b287-32311f879426 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:15.463301 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-70ecc97d-2b85-4c3b-afe9-67037fe49da4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1523 microversion: 2.1 time: 0.795435 Jul 25 12:55:15.464018 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1644/3216] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:14 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1523 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:15.509185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-374009bb-259f-40d3-a263-d31b6243d771 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:15.509931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-374009bb-259f-40d3-a263-d31b6243d771 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:15.534930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-374009bb-259f-40d3-a263-d31b6243d771 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:15.535532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-374009bb-259f-40d3-a263-d31b6243d771 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:15.536447 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-374009bb-259f-40d3-a263-d31b6243d771 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:15.538780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-374009bb-259f-40d3-a263-d31b6243d771 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:16.716084 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-66b26230-35c9-464a-b287-32311f879426 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:16.731302 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-66b26230-35c9-464a-b287-32311f879426 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:16.734241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-66b26230-35c9-464a-b287-32311f879426 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:16.736277 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-66b26230-35c9-464a-b287-32311f879426 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 2946 microversion: 2.32 time: 1.299618 Jul 25 12:55:16.737491 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1573/3217] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:55:15 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 2946 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:55:16.747644 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1a2f6da8-0dbf-46ab-aedf-33bd2474ef14 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:16.749275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1a2f6da8-0dbf-46ab-aedf-33bd2474ef14 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:16.761981 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a2f6da8-0dbf-46ab-aedf-33bd2474ef14 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:16.763230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a2f6da8-0dbf-46ab-aedf-33bd2474ef14 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:16.764347 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a2f6da8-0dbf-46ab-aedf-33bd2474ef14 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:16.765241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a2f6da8-0dbf-46ab-aedf-33bd2474ef14 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:16.984062 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-374009bb-259f-40d3-a263-d31b6243d771 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:17.015499 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-374009bb-259f-40d3-a263-d31b6243d771 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1514 microversion: 2.1 time: 1.532254 Jul 25 12:55:17.024373 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1645/3218] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:15 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1514 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:17.042307 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-15ad4478-0237-42c9-b949-55116d9bd5d7 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:17.051098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-15ad4478-0237-42c9-b949-55116d9bd5d7 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:17.075279 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-15ad4478-0237-42c9-b949-55116d9bd5d7 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:17.076916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-15ad4478-0237-42c9-b949-55116d9bd5d7 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:17.078663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-15ad4478-0237-42c9-b949-55116d9bd5d7 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:17.081444 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-15ad4478-0237-42c9-b949-55116d9bd5d7 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:18.151652 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-15ad4478-0237-42c9-b949-55116d9bd5d7 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:18.181739 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-15ad4478-0237-42c9-b949-55116d9bd5d7 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1523 microversion: 2.1 time: 1.143507 Jul 25 12:55:18.184904 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1646/3219] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:17 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1523 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:18.211736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d296efa6-5eb0-46e1-99b0-18f325cad3c5 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:18.218665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d296efa6-5eb0-46e1-99b0-18f325cad3c5 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:18.220985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1a2f6da8-0dbf-46ab-aedf-33bd2474ef14 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:18.258970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d296efa6-5eb0-46e1-99b0-18f325cad3c5 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:18.259630 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1a2f6da8-0dbf-46ab-aedf-33bd2474ef14 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 1.519835 Jul 25 12:55:18.260285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d296efa6-5eb0-46e1-99b0-18f325cad3c5 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:18.261400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d296efa6-5eb0-46e1-99b0-18f325cad3c5 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:18.262750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d296efa6-5eb0-46e1-99b0-18f325cad3c5 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:18.279647 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1574/3220] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:16 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:18.305552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-fe282bab-bfb7-483a-85f9-1c5d46bd1a2f req-42b6d177-ec06-48c4-9104-a0b9469f7436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b730aecb-2c1f-46ef-b457-8a3717655518", "name": "network-vif-unplugged", "status": "completed", "tag": "45191120-4204-4de7-9ef8-5d5c4ba83f89"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:55:18.343983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fe282bab-bfb7-483a-85f9-1c5d46bd1a2f req-42b6d177-ec06-48c4-9104-a0b9469f7436 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:18.351036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fe282bab-bfb7-483a-85f9-1c5d46bd1a2f req-42b6d177-ec06-48c4-9104-a0b9469f7436 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:18.389478 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-fe282bab-bfb7-483a-85f9-1c5d46bd1a2f req-42b6d177-ec06-48c4-9104-a0b9469f7436 service nova] Creating event network-vif-unplugged:45191120-4204-4de7-9ef8-5d5c4ba83f89 for instance b730aecb-2c1f-46ef-b457-8a3717655518 on n-h1-848886-15 Jul 25 12:55:18.396055 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-fe282bab-bfb7-483a-85f9-1c5d46bd1a2f req-42b6d177-ec06-48c4-9104-a0b9469f7436 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114289 Jul 25 12:55:18.397035 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1575/3221] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:55:18.406510 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4bc1d1ff-c58d-4270-9b57-09277a84ae56 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:18.408026 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4bc1d1ff-c58d-4270-9b57-09277a84ae56 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:18.418308 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4bc1d1ff-c58d-4270-9b57-09277a84ae56 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:18.419177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4bc1d1ff-c58d-4270-9b57-09277a84ae56 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:18.420133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4bc1d1ff-c58d-4270-9b57-09277a84ae56 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:18.420731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4bc1d1ff-c58d-4270-9b57-09277a84ae56 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:18.661945 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d296efa6-5eb0-46e1-99b0-18f325cad3c5 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.475542 Jul 25 12:55:18.663199 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1647/3222] 10.222.0.49 () {60 vars in 1316 bytes} [Mon Jul 25 12:55:18 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88/os-interface => generated 1832 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:55:19.210125 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3e59c338-3d22-4a9e-a7ae-30c41e1942b6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:19.214610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3e59c338-3d22-4a9e-a7ae-30c41e1942b6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:19.235697 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:55:19.269003 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e59c338-3d22-4a9e-a7ae-30c41e1942b6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:19.270267 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e59c338-3d22-4a9e-a7ae-30c41e1942b6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:19.272200 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e59c338-3d22-4a9e-a7ae-30c41e1942b6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:19.273364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e59c338-3d22-4a9e-a7ae-30c41e1942b6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:20.338601 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4bc1d1ff-c58d-4270-9b57-09277a84ae56 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:20.351865 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4bc1d1ff-c58d-4270-9b57-09277a84ae56 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1514 microversion: 2.1 time: 1.953361 Jul 25 12:55:20.356351 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1576/3223] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:18 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1514 bytes in 1958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:21.434701 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e2af246c-c9a2-45d8-9952-1d0576b64b10 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:21.447612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e2af246c-c9a2-45d8-9952-1d0576b64b10 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:21.518171 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2af246c-c9a2-45d8-9952-1d0576b64b10 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:21.518993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2af246c-c9a2-45d8-9952-1d0576b64b10 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:21.520486 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2af246c-c9a2-45d8-9952-1d0576b64b10 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:21.539850 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2af246c-c9a2-45d8-9952-1d0576b64b10 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:21.608382 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3e59c338-3d22-4a9e-a7ae-30c41e1942b6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:21.674440 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3e59c338-3d22-4a9e-a7ae-30c41e1942b6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1523 microversion: 2.1 time: 2.469907 Jul 25 12:55:21.676573 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1648/3224] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:19 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1523 bytes in 2476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:21.712657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-33884133-1c7c-491a-ba10-38be786f2baf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:21.715796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-33884133-1c7c-491a-ba10-38be786f2baf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:21.739354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-33884133-1c7c-491a-ba10-38be786f2baf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:21.745324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-33884133-1c7c-491a-ba10-38be786f2baf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:21.748087 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-33884133-1c7c-491a-ba10-38be786f2baf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:21.750490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-33884133-1c7c-491a-ba10-38be786f2baf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:22.535946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-33884133-1c7c-491a-ba10-38be786f2baf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:22.546237 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-33884133-1c7c-491a-ba10-38be786f2baf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.865122 Jul 25 12:55:22.550266 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1649/3225] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:21 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:22.577938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e1358bca-7c0b-4a4b-87fa-fb187a4ee0bb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:22.581264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e1358bca-7c0b-4a4b-87fa-fb187a4ee0bb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:22.611277 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1358bca-7c0b-4a4b-87fa-fb187a4ee0bb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:22.616544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1358bca-7c0b-4a4b-87fa-fb187a4ee0bb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:22.620436 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1358bca-7c0b-4a4b-87fa-fb187a4ee0bb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:22.621284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1358bca-7c0b-4a4b-87fa-fb187a4ee0bb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:23.264807 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e2af246c-c9a2-45d8-9952-1d0576b64b10 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:23.283584 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e2af246c-c9a2-45d8-9952-1d0576b64b10 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1520 microversion: 2.1 time: 1.882137 Jul 25 12:55:23.284305 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1577/3226] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:21 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1520 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:55:23.344535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4e972098-d9cb-4707-a1f9-414b6a4391bc tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:23.347086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4e972098-d9cb-4707-a1f9-414b6a4391bc tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:23.368158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e972098-d9cb-4707-a1f9-414b6a4391bc tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:23.368983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e972098-d9cb-4707-a1f9-414b6a4391bc tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:23.370030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e972098-d9cb-4707-a1f9-414b6a4391bc tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:23.373733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e972098-d9cb-4707-a1f9-414b6a4391bc tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:24.123372 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4e972098-d9cb-4707-a1f9-414b6a4391bc tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:24.158136 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4e972098-d9cb-4707-a1f9-414b6a4391bc tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1523 microversion: 2.1 time: 0.866458 Jul 25 12:55:24.159871 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1578/3227] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:23 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1523 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:24.326762 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-14e5055c-70af-49a7-b023-ec30babeb25b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:24.332670 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-14e5055c-70af-49a7-b023-ec30babeb25b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:24.384467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:55:24.396835 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14e5055c-70af-49a7-b023-ec30babeb25b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:24.400658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14e5055c-70af-49a7-b023-ec30babeb25b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:24.406634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14e5055c-70af-49a7-b023-ec30babeb25b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:24.407450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14e5055c-70af-49a7-b023-ec30babeb25b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:24.483492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e1358bca-7c0b-4a4b-87fa-fb187a4ee0bb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:24.528045 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e1358bca-7c0b-4a4b-87fa-fb187a4ee0bb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 1.953180 Jul 25 12:55:24.535130 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1650/3228] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:22 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 1966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:24.572852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5905b85a-3e76-41ca-acc4-b22cd78bf7b5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:24.577146 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5905b85a-3e76-41ca-acc4-b22cd78bf7b5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:24.602022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5905b85a-3e76-41ca-acc4-b22cd78bf7b5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:24.604368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5905b85a-3e76-41ca-acc4-b22cd78bf7b5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:24.609328 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5905b85a-3e76-41ca-acc4-b22cd78bf7b5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:24.628092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5905b85a-3e76-41ca-acc4-b22cd78bf7b5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:25.793072 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5905b85a-3e76-41ca-acc4-b22cd78bf7b5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:25.800003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-14e5055c-70af-49a7-b023-ec30babeb25b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:25.836036 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5905b85a-3e76-41ca-acc4-b22cd78bf7b5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 1.270284 Jul 25 12:55:25.837900 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1651/3229] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:24 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:55:25.857149 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-14e5055c-70af-49a7-b023-ec30babeb25b tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1520 microversion: 2.1 time: 1.548505 Jul 25 12:55:25.861529 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1579/3230] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:24 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1520 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:25.867865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ddda9eef-3956-407a-be3c-fdfc9baed1df tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:25.877804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b72c279c-91ea-48b4-aed2-a15aa651e44c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:55:25.880237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ddda9eef-3956-407a-be3c-fdfc9baed1df tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:25.892420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b72c279c-91ea-48b4-aed2-a15aa651e44c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:25.921090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b72c279c-91ea-48b4-aed2-a15aa651e44c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:25.922465 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ddda9eef-3956-407a-be3c-fdfc9baed1df tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:25.928171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ddda9eef-3956-407a-be3c-fdfc9baed1df tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:25.928430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b72c279c-91ea-48b4-aed2-a15aa651e44c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:25.930634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b72c279c-91ea-48b4-aed2-a15aa651e44c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:25.931643 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b72c279c-91ea-48b4-aed2-a15aa651e44c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:25.935368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ddda9eef-3956-407a-be3c-fdfc9baed1df tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:25.936152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ddda9eef-3956-407a-be3c-fdfc9baed1df tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:26.212714 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b72c279c-91ea-48b4-aed2-a15aa651e44c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action" status: 202 len: 0 microversion: 2.1 time: 0.348397 Jul 25 12:55:26.236967 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1580/3231] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:55:25 2022] POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:55:26.273530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c2b632c0-136a-4b1b-8047-65dcd7aca75c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:26.274925 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c2b632c0-136a-4b1b-8047-65dcd7aca75c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:26.318755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2b632c0-136a-4b1b-8047-65dcd7aca75c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:26.319233 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2b632c0-136a-4b1b-8047-65dcd7aca75c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:26.320564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2b632c0-136a-4b1b-8047-65dcd7aca75c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:26.324265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2b632c0-136a-4b1b-8047-65dcd7aca75c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:26.446831 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:55:26.676474 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ddda9eef-3956-407a-be3c-fdfc9baed1df tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:26.690287 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ddda9eef-3956-407a-be3c-fdfc9baed1df tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1523 microversion: 2.1 time: 0.846663 Jul 25 12:55:26.696028 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1652/3232] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:25 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1523 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:26.896896 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e1f03afa-5e3c-46b7-8984-ac0845a4c763 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:26.898064 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e1f03afa-5e3c-46b7-8984-ac0845a4c763 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:26.913730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c2b632c0-136a-4b1b-8047-65dcd7aca75c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:26.916691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1f03afa-5e3c-46b7-8984-ac0845a4c763 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:26.922623 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1f03afa-5e3c-46b7-8984-ac0845a4c763 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:26.925851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1f03afa-5e3c-46b7-8984-ac0845a4c763 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:26.935617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1f03afa-5e3c-46b7-8984-ac0845a4c763 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:26.936008 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c2b632c0-136a-4b1b-8047-65dcd7aca75c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1671 microversion: 2.1 time: 0.695300 Jul 25 12:55:26.952550 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1581/3233] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:26 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1671 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:27.500459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e1f03afa-5e3c-46b7-8984-ac0845a4c763 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:27.561663 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e1f03afa-5e3c-46b7-8984-ac0845a4c763 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1520 microversion: 2.1 time: 0.671192 Jul 25 12:55:27.562664 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1653/3234] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:26 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1520 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:55:27.717402 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f4be0831-2e46-4c7d-8d6e-0d71711c2a90 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:27.717667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f4be0831-2e46-4c7d-8d6e-0d71711c2a90 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:27.741290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4be0831-2e46-4c7d-8d6e-0d71711c2a90 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:27.741771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4be0831-2e46-4c7d-8d6e-0d71711c2a90 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:27.742618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4be0831-2e46-4c7d-8d6e-0d71711c2a90 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:27.748271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4be0831-2e46-4c7d-8d6e-0d71711c2a90 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:27.972154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6a7c3cdd-0eb3-4b9b-b196-dce6d54eef3e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:27.973274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6a7c3cdd-0eb3-4b9b-b196-dce6d54eef3e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:28.033405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a7c3cdd-0eb3-4b9b-b196-dce6d54eef3e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:28.037038 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a7c3cdd-0eb3-4b9b-b196-dce6d54eef3e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:28.043941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a7c3cdd-0eb3-4b9b-b196-dce6d54eef3e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:28.052622 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a7c3cdd-0eb3-4b9b-b196-dce6d54eef3e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:28.594410 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f4be0831-2e46-4c7d-8d6e-0d71711c2a90 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:28.612732 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f4be0831-2e46-4c7d-8d6e-0d71711c2a90 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1523 microversion: 2.1 time: 0.899599 Jul 25 12:55:28.630826 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1582/3235] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:27 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1523 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:55:28.661824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6bce8f7a-d3c0-43cb-ae9d-ebe3c23e4051 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:28.670836 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6bce8f7a-d3c0-43cb-ae9d-ebe3c23e4051 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:28.689199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6bce8f7a-d3c0-43cb-ae9d-ebe3c23e4051 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:28.703517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6bce8f7a-d3c0-43cb-ae9d-ebe3c23e4051 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:28.705195 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6bce8f7a-d3c0-43cb-ae9d-ebe3c23e4051 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:28.710628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6bce8f7a-d3c0-43cb-ae9d-ebe3c23e4051 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:28.950265 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6a7c3cdd-0eb3-4b9b-b196-dce6d54eef3e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:28.964399 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6a7c3cdd-0eb3-4b9b-b196-dce6d54eef3e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1671 microversion: 2.1 time: 1.004090 Jul 25 12:55:28.983963 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1654/3236] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:27 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1671 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:29.557380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6bce8f7a-d3c0-43cb-ae9d-ebe3c23e4051 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:29.575266 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6bce8f7a-d3c0-43cb-ae9d-ebe3c23e4051 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1520 microversion: 2.1 time: 0.942568 Jul 25 12:55:29.576064 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1583/3237] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:28 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1520 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:29.640750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-adbc6706-614a-4a2c-9c49-711ef932a448 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:29.641549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-adbc6706-614a-4a2c-9c49-711ef932a448 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:29.667325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-adbc6706-614a-4a2c-9c49-711ef932a448 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:29.673402 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-adbc6706-614a-4a2c-9c49-711ef932a448 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:29.674579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-adbc6706-614a-4a2c-9c49-711ef932a448 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:29.675092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-adbc6706-614a-4a2c-9c49-711ef932a448 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:29.991697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3c365c5f-8566-46b2-8301-563ac428839a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:29.993077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3c365c5f-8566-46b2-8301-563ac428839a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:30.004103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c365c5f-8566-46b2-8301-563ac428839a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:30.023801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c365c5f-8566-46b2-8301-563ac428839a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:30.024974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c365c5f-8566-46b2-8301-563ac428839a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:30.025435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c365c5f-8566-46b2-8301-563ac428839a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:30.932526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-adbc6706-614a-4a2c-9c49-711ef932a448 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:30.948586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3c365c5f-8566-46b2-8301-563ac428839a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:30.959930 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3c365c5f-8566-46b2-8301-563ac428839a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1676 microversion: 2.1 time: 0.972330 Jul 25 12:55:30.962111 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1584/3238] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:29 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1676 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:30.967307 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-adbc6706-614a-4a2c-9c49-711ef932a448 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1523 microversion: 2.1 time: 1.323766 Jul 25 12:55:30.972351 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1655/3239] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:29 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1523 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:30.988823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3bbd3430-2f54-46a2-8b2e-481daea501dd tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:30.995871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3bbd3430-2f54-46a2-8b2e-481daea501dd tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:31.007862 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3bbd3430-2f54-46a2-8b2e-481daea501dd tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:31.008846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-daf782b9-3752-450a-8b8f-ce888f8d73b1 req-8e5f4db1-5d27-4551-be95-1647ada1839b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0e5b678-c54d-4505-8391-787e74886dce", "name": "network-vif-plugged", "status": "completed", "tag": "ccd4ab2a-3511-4970-8003-0627319e9a8b"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:55:31.014494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3bbd3430-2f54-46a2-8b2e-481daea501dd tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:31.015598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3bbd3430-2f54-46a2-8b2e-481daea501dd tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:31.016197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3bbd3430-2f54-46a2-8b2e-481daea501dd tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:31.035754 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-daf782b9-3752-450a-8b8f-ce888f8d73b1 req-8e5f4db1-5d27-4551-be95-1647ada1839b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:31.036706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-daf782b9-3752-450a-8b8f-ce888f8d73b1 req-8e5f4db1-5d27-4551-be95-1647ada1839b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:31.074394 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-daf782b9-3752-450a-8b8f-ce888f8d73b1 req-8e5f4db1-5d27-4551-be95-1647ada1839b service nova] Creating event network-vif-plugged:ccd4ab2a-3511-4970-8003-0627319e9a8b for instance b0e5b678-c54d-4505-8391-787e74886dce on n-h1-848886-15 Jul 25 12:55:31.087016 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-daf782b9-3752-450a-8b8f-ce888f8d73b1 req-8e5f4db1-5d27-4551-be95-1647ada1839b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110306 Jul 25 12:55:31.092533 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1656/3240] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:55:31.697699 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3bbd3430-2f54-46a2-8b2e-481daea501dd tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:31.713333 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3bbd3430-2f54-46a2-8b2e-481daea501dd tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1520 microversion: 2.1 time: 0.728601 Jul 25 12:55:31.715141 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1585/3241] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:30 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1520 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:31.986140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7b8b6df0-7acc-41bf-bec8-3cbce20517d3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:31.986907 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7b8b6df0-7acc-41bf-bec8-3cbce20517d3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:31.994242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-06935929-56aa-4f6b-b524-f9f6179d5281 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:31.995255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-06935929-56aa-4f6b-b524-f9f6179d5281 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:32.002188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06935929-56aa-4f6b-b524-f9f6179d5281 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:32.003362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06935929-56aa-4f6b-b524-f9f6179d5281 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:32.004582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7b8b6df0-7acc-41bf-bec8-3cbce20517d3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:32.009633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7b8b6df0-7acc-41bf-bec8-3cbce20517d3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:32.012072 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7b8b6df0-7acc-41bf-bec8-3cbce20517d3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:32.014438 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06935929-56aa-4f6b-b524-f9f6179d5281 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:32.016850 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06935929-56aa-4f6b-b524-f9f6179d5281 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:32.017230 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7b8b6df0-7acc-41bf-bec8-3cbce20517d3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:32.377488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-06935929-56aa-4f6b-b524-f9f6179d5281 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:32.390655 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-06935929-56aa-4f6b-b524-f9f6179d5281 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1523 microversion: 2.1 time: 0.402364 Jul 25 12:55:32.393529 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1586/3242] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:31 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1523 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:32.492042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7b8b6df0-7acc-41bf-bec8-3cbce20517d3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:32.518554 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7b8b6df0-7acc-41bf-bec8-3cbce20517d3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.536935 Jul 25 12:55:32.523078 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1657/3243] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:31 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:32.546766 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-11e64380-4039-4918-b7e1-1430f2177983 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:55:32.549955 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-11e64380-4039-4918-b7e1-1430f2177983 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:32.565645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-11e64380-4039-4918-b7e1-1430f2177983 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:32.566443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-11e64380-4039-4918-b7e1-1430f2177983 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:32.569243 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-11e64380-4039-4918-b7e1-1430f2177983 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:32.570105 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-11e64380-4039-4918-b7e1-1430f2177983 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:32.651798 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-11e64380-4039-4918-b7e1-1430f2177983 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action" status: 200 len: 322 microversion: 2.1 time: 0.110095 Jul 25 12:55:32.653066 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1587/3244] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:55:32 2022] POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action => generated 322 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:55:32.665073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2daf1ff5-375e-4e18-a1a2-5e471151a66a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:32.665881 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2daf1ff5-375e-4e18-a1a2-5e471151a66a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:32.689971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2daf1ff5-375e-4e18-a1a2-5e471151a66a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:32.691901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2daf1ff5-375e-4e18-a1a2-5e471151a66a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:32.699693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2daf1ff5-375e-4e18-a1a2-5e471151a66a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:32.703231 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2daf1ff5-375e-4e18-a1a2-5e471151a66a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:32.746256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-78de380e-3fcd-4447-93e8-9a224d9797b4 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:32.747411 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-78de380e-3fcd-4447-93e8-9a224d9797b4 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:32.763111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78de380e-3fcd-4447-93e8-9a224d9797b4 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:32.772604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78de380e-3fcd-4447-93e8-9a224d9797b4 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:32.796451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78de380e-3fcd-4447-93e8-9a224d9797b4 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:32.801520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78de380e-3fcd-4447-93e8-9a224d9797b4 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:33.524819 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-78de380e-3fcd-4447-93e8-9a224d9797b4 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:33.537688 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-78de380e-3fcd-4447-93e8-9a224d9797b4 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1520 microversion: 2.1 time: 0.797033 Jul 25 12:55:33.541292 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1588/3245] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:32 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1520 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:33.553548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-55383daa-778e-449d-a995-db24fecfe32b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:33.554436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-55383daa-778e-449d-a995-db24fecfe32b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:33.570323 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55383daa-778e-449d-a995-db24fecfe32b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:33.573241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55383daa-778e-449d-a995-db24fecfe32b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:33.574673 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55383daa-778e-449d-a995-db24fecfe32b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:33.575309 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55383daa-778e-449d-a995-db24fecfe32b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:33.893353 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2daf1ff5-375e-4e18-a1a2-5e471151a66a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:33.910730 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2daf1ff5-375e-4e18-a1a2-5e471151a66a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 1.249647 Jul 25 12:55:33.914100 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1658/3246] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:32 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:33.937818 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bf32db92-5a50-4187-b193-cda25cc0af2a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:33.938901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bf32db92-5a50-4187-b193-cda25cc0af2a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:33.946565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf32db92-5a50-4187-b193-cda25cc0af2a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:33.947765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf32db92-5a50-4187-b193-cda25cc0af2a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:33.949083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf32db92-5a50-4187-b193-cda25cc0af2a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:33.950079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf32db92-5a50-4187-b193-cda25cc0af2a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:35.249168 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-55383daa-778e-449d-a995-db24fecfe32b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:35.259175 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-55383daa-778e-449d-a995-db24fecfe32b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1523 microversion: 2.1 time: 1.716502 Jul 25 12:55:35.259820 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1589/3247] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:33 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1523 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:35.278589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ba6d092c-9caf-4d91-b3b6-c2ef5e3630aa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:35.303304 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ba6d092c-9caf-4d91-b3b6-c2ef5e3630aa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:35.317602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba6d092c-9caf-4d91-b3b6-c2ef5e3630aa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:35.322392 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba6d092c-9caf-4d91-b3b6-c2ef5e3630aa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:35.323879 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba6d092c-9caf-4d91-b3b6-c2ef5e3630aa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:35.324891 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba6d092c-9caf-4d91-b3b6-c2ef5e3630aa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:35.431684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bf32db92-5a50-4187-b193-cda25cc0af2a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:35.440534 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bf32db92-5a50-4187-b193-cda25cc0af2a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 1.508636 Jul 25 12:55:35.458879 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1659/3248] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:33 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:35.465890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6b427a6a-d70d-4a85-a170-18a1bfadbeff tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:35.465890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6b427a6a-d70d-4a85-a170-18a1bfadbeff tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:35.493712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b427a6a-d70d-4a85-a170-18a1bfadbeff tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:35.494225 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b427a6a-d70d-4a85-a170-18a1bfadbeff tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:35.495142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b427a6a-d70d-4a85-a170-18a1bfadbeff tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:35.495459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b427a6a-d70d-4a85-a170-18a1bfadbeff tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:35.525786 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:55:35.877958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ba6d092c-9caf-4d91-b3b6-c2ef5e3630aa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:35.896554 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ba6d092c-9caf-4d91-b3b6-c2ef5e3630aa tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1505 microversion: 2.1 time: 0.635114 Jul 25 12:55:35.910714 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1590/3249] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:35 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1505 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:35.935774 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-66cc54b0-5b23-4351-9ad7-25bac1efc2f8 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:35.936543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-66cc54b0-5b23-4351-9ad7-25bac1efc2f8 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:35.950938 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66cc54b0-5b23-4351-9ad7-25bac1efc2f8 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:35.951626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66cc54b0-5b23-4351-9ad7-25bac1efc2f8 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:35.952458 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66cc54b0-5b23-4351-9ad7-25bac1efc2f8 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:35.953334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66cc54b0-5b23-4351-9ad7-25bac1efc2f8 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:36.417854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6b427a6a-d70d-4a85-a170-18a1bfadbeff tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:36.435654 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6b427a6a-d70d-4a85-a170-18a1bfadbeff tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.974524 Jul 25 12:55:36.439921 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1660/3250] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:35 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:36.439921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-179e7aa8-58c6-4838-9b8a-27fe84ed31b4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:36.454700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-179e7aa8-58c6-4838-9b8a-27fe84ed31b4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:36.471154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-179e7aa8-58c6-4838-9b8a-27fe84ed31b4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:36.472614 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-179e7aa8-58c6-4838-9b8a-27fe84ed31b4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:36.474285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-179e7aa8-58c6-4838-9b8a-27fe84ed31b4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:36.475799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-179e7aa8-58c6-4838-9b8a-27fe84ed31b4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:36.624730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-66cc54b0-5b23-4351-9ad7-25bac1efc2f8 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:36.641901 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-66cc54b0-5b23-4351-9ad7-25bac1efc2f8 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 200 len: 1505 microversion: 2.1 time: 0.714159 Jul 25 12:55:36.643780 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1591/3251] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:35 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 1505 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:36.664136 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-811eec34-0a12-46dd-8449-5f10d2903579 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:36.666783 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-811eec34-0a12-46dd-8449-5f10d2903579 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:36.700680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-811eec34-0a12-46dd-8449-5f10d2903579 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:36.701223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-811eec34-0a12-46dd-8449-5f10d2903579 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:36.702102 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-811eec34-0a12-46dd-8449-5f10d2903579 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:36.702734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-811eec34-0a12-46dd-8449-5f10d2903579 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:37.163586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-179e7aa8-58c6-4838-9b8a-27fe84ed31b4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:37.175543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-811eec34-0a12-46dd-8449-5f10d2903579 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:37.175962 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-179e7aa8-58c6-4838-9b8a-27fe84ed31b4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1505 microversion: 2.1 time: 0.732675 Jul 25 12:55:37.190405 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1661/3252] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:36 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1505 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:37.190405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-36b2e862-e917-4411-a1e7-c68668ea3d4a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:37.190405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-36b2e862-e917-4411-a1e7-c68668ea3d4a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:37.191302 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36b2e862-e917-4411-a1e7-c68668ea3d4a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:37.191476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36b2e862-e917-4411-a1e7-c68668ea3d4a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:37.192563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36b2e862-e917-4411-a1e7-c68668ea3d4a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:37.194360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36b2e862-e917-4411-a1e7-c68668ea3d4a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:37.200665 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-811eec34-0a12-46dd-8449-5f10d2903579 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.555100 Jul 25 12:55:37.201272 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1592/3253] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:36 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:37.241602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-36b2e862-e917-4411-a1e7-c68668ea3d4a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:55:37.396330 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-36b2e862-e917-4411-a1e7-c68668ea3d4a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 204 len: 0 microversion: 2.1 time: 0.217348 Jul 25 12:55:37.396757 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1662/3254] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:55:37 2022] DELETE /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:55:37.417564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5921f8c5-8248-44f2-8b8d-443c81e5425b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1165760422", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "f9bdc019-d9ba-4dd9-9e23-b909e49f2c93"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:55:37.504408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-5921f8c5-8248-44f2-8b8d-443c81e5425b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] validate_networks() for [('f9bdc019-d9ba-4dd9-9e23-b909e49f2c93', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:55:37.681017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e244615e-e299-4a22-8365-39e06f4a49eb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-325060281", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "2c55ca58-f6b3-49a6-8224-93d49e500ffc"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:55:37.809100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-e244615e-e299-4a22-8365-39e06f4a49eb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] validate_networks() for [('2c55ca58-f6b3-49a6-8224-93d49e500ffc', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:55:38.679124 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5921f8c5-8248-44f2-8b8d-443c81e5425b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:55:38.679584 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5921f8c5-8248-44f2-8b8d-443c81e5425b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:55:38.680031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5921f8c5-8248-44f2-8b8d-443c81e5425b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:55:38.680961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5921f8c5-8248-44f2-8b8d-443c81e5425b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:55:38.682145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5921f8c5-8248-44f2-8b8d-443c81e5425b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:55:38.702804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5921f8c5-8248-44f2-8b8d-443c81e5425b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:38.702804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5921f8c5-8248-44f2-8b8d-443c81e5425b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:38.702804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5921f8c5-8248-44f2-8b8d-443c81e5425b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:38.702804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5921f8c5-8248-44f2-8b8d-443c81e5425b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:38.769223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-5921f8c5-8248-44f2-8b8d-443c81e5425b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Getting quotas for project b5abf45c9ba0419c8dec07847f3ff3c5. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:55:38.781144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-5921f8c5-8248-44f2-8b8d-443c81e5425b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Getting quotas for user 4d492d20a4864908a81902f86468d437 and project b5abf45c9ba0419c8dec07847f3ff3c5. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:55:38.821669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5921f8c5-8248-44f2-8b8d-443c81e5425b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:55:38.824659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5921f8c5-8248-44f2-8b8d-443c81e5425b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:55:38.991491 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5921f8c5-8248-44f2-8b8d-443c81e5425b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.577332 Jul 25 12:55:38.996695 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1593/3255] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:55:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:55:39.015290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-022bf550-d9bf-4f35-abb4-10f5174c5631 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:39.023287 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-022bf550-d9bf-4f35-abb4-10f5174c5631 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:39.069420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-022bf550-d9bf-4f35-abb4-10f5174c5631 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:39.073282 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-022bf550-d9bf-4f35-abb4-10f5174c5631 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:39.074926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-022bf550-d9bf-4f35-abb4-10f5174c5631 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:39.077153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-022bf550-d9bf-4f35-abb4-10f5174c5631 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:39.316288 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e244615e-e299-4a22-8365-39e06f4a49eb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:55:39.316903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e244615e-e299-4a22-8365-39e06f4a49eb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:55:39.317462 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e244615e-e299-4a22-8365-39e06f4a49eb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:55:39.318131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e244615e-e299-4a22-8365-39e06f4a49eb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:55:39.318659 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e244615e-e299-4a22-8365-39e06f4a49eb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:55:39.334495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e244615e-e299-4a22-8365-39e06f4a49eb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:39.335734 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e244615e-e299-4a22-8365-39e06f4a49eb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:39.338537 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e244615e-e299-4a22-8365-39e06f4a49eb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:39.339109 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e244615e-e299-4a22-8365-39e06f4a49eb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:39.412111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-e244615e-e299-4a22-8365-39e06f4a49eb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Getting quotas for project 91cbcc6833214e07840dc9beaf9bea78. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:55:39.455128 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-e244615e-e299-4a22-8365-39e06f4a49eb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Getting quotas for user 6f8b20388de843f2a2aa0cf53dc80f75 and project 91cbcc6833214e07840dc9beaf9bea78. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:55:39.487477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e244615e-e299-4a22-8365-39e06f4a49eb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:55:39.490081 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e244615e-e299-4a22-8365-39e06f4a49eb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:55:39.667753 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e244615e-e299-4a22-8365-39e06f4a49eb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.993678 Jul 25 12:55:39.669359 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1663/3256] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:55:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:55:39.681751 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-337fd102-2ed1-409f-898b-2559da0f2c33 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:39.683355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-337fd102-2ed1-409f-898b-2559da0f2c33 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:40.574651 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-337fd102-2ed1-409f-898b-2559da0f2c33 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:40.610925 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-337fd102-2ed1-409f-898b-2559da0f2c33 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1215 microversion: 2.1 time: 0.934141 Jul 25 12:55:40.616058 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1664/3257] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:39 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1215 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:40.638406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-022bf550-d9bf-4f35-abb4-10f5174c5631 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:40.640788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-55755b27-4015-4e22-935a-d5f2cc4a1a40 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:40.643001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-55755b27-4015-4e22-935a-d5f2cc4a1a40 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:40.651452 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-022bf550-d9bf-4f35-abb4-10f5174c5631 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1505 microversion: 2.1 time: 1.650017 Jul 25 12:55:40.652075 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1594/3258] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:38 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1505 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:40.784526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-55755b27-4015-4e22-935a-d5f2cc4a1a40 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:40.809602 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-55755b27-4015-4e22-935a-d5f2cc4a1a40 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1217 microversion: 2.1 time: 0.181456 Jul 25 12:55:40.813995 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1665/3259] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:40 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1217 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:40.829904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-a323acff-7e1b-499e-b77e-ba71da66c28b req-9db4dcef-032b-41e1-a05e-b2184fe4ad70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9cc21b1-7442-4031-b701-b534f237749f", "name": "network-vif-unplugged", "status": "completed", "tag": "86c86fd3-b1f7-405c-92a4-239039e1570a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:55:40.858782 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a323acff-7e1b-499e-b77e-ba71da66c28b req-9db4dcef-032b-41e1-a05e-b2184fe4ad70 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:40.859770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a323acff-7e1b-499e-b77e-ba71da66c28b req-9db4dcef-032b-41e1-a05e-b2184fe4ad70 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:40.903238 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.compute.server_external_events [req-a323acff-7e1b-499e-b77e-ba71da66c28b req-9db4dcef-032b-41e1-a05e-b2184fe4ad70 service nova] Unable to find a host for instance c9cc21b1-7442-4031-b701-b534f237749f. Dropping event network-vif-unplugged {{(pid=125883) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 12:55:40.904664 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-a323acff-7e1b-499e-b77e-ba71da66c28b req-9db4dcef-032b-41e1-a05e-b2184fe4ad70 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.078960 Jul 25 12:55:40.911320 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1595/3260] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 86 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 25 12:55:41.659250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-cb11c029-3be6-47a5-ba73-3316171bc19f req-78910ddb-1a39-44f0-8bfa-603b16f124c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0e5b678-c54d-4505-8391-787e74886dce", "name": "network-vif-deleted", "tag": "ccd4ab2a-3511-4970-8003-0627319e9a8b"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:55:41.665893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b7d746e2-0ef8-4e56-91d4-fce5b621e3e0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:41.671316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b7d746e2-0ef8-4e56-91d4-fce5b621e3e0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:41.701326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-cb11c029-3be6-47a5-ba73-3316171bc19f req-78910ddb-1a39-44f0-8bfa-603b16f124c5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:41.701784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-cb11c029-3be6-47a5-ba73-3316171bc19f req-78910ddb-1a39-44f0-8bfa-603b16f124c5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:41.719634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7d746e2-0ef8-4e56-91d4-fce5b621e3e0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:41.725609 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7d746e2-0ef8-4e56-91d4-fce5b621e3e0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:41.726520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7d746e2-0ef8-4e56-91d4-fce5b621e3e0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:41.726973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7d746e2-0ef8-4e56-91d4-fce5b621e3e0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:41.771617 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-cb11c029-3be6-47a5-ba73-3316171bc19f req-78910ddb-1a39-44f0-8bfa-603b16f124c5 service nova] Creating event network-vif-deleted:ccd4ab2a-3511-4970-8003-0627319e9a8b for instance b0e5b678-c54d-4505-8391-787e74886dce on n-h1-848886-15 Jul 25 12:55:41.812682 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-cb11c029-3be6-47a5-ba73-3316171bc19f req-78910ddb-1a39-44f0-8bfa-603b16f124c5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145240 Jul 25 12:55:41.819650 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1596/3261] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:55:41.850956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e3b8deb2-b794-4b56-b74b-e3aa35432bd4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:41.851935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e3b8deb2-b794-4b56-b74b-e3aa35432bd4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:41.870635 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3b8deb2-b794-4b56-b74b-e3aa35432bd4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:41.872282 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3b8deb2-b794-4b56-b74b-e3aa35432bd4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:41.875076 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3b8deb2-b794-4b56-b74b-e3aa35432bd4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:41.877715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3b8deb2-b794-4b56-b74b-e3aa35432bd4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:41.983746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b7d746e2-0ef8-4e56-91d4-fce5b621e3e0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:41.996482 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b7d746e2-0ef8-4e56-91d4-fce5b621e3e0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1273 microversion: 2.1 time: 0.362405 Jul 25 12:55:41.998891 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1666/3262] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:41 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1273 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:42.014065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dc93b212-1f7f-42f6-b1ae-5eefa0f3b632 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:42.014065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dc93b212-1f7f-42f6-b1ae-5eefa0f3b632 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:42.026001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc93b212-1f7f-42f6-b1ae-5eefa0f3b632 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:42.029888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc93b212-1f7f-42f6-b1ae-5eefa0f3b632 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:42.030753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc93b212-1f7f-42f6-b1ae-5eefa0f3b632 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:42.031201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc93b212-1f7f-42f6-b1ae-5eefa0f3b632 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:42.371700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dc93b212-1f7f-42f6-b1ae-5eefa0f3b632 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:42.397930 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dc93b212-1f7f-42f6-b1ae-5eefa0f3b632 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1277 microversion: 2.1 time: 0.388919 Jul 25 12:55:42.401182 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1667/3263] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:41 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1277 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:42.772493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e3b8deb2-b794-4b56-b74b-e3aa35432bd4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:42.795830 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e3b8deb2-b794-4b56-b74b-e3aa35432bd4 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 200 len: 1448 microversion: 2.1 time: 0.967574 Jul 25 12:55:42.796506 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1597/3264] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:41 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 1448 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:42.836139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1724d976-6317-4dfd-a376-cd4e4a56f13e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:42.837021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1724d976-6317-4dfd-a376-cd4e4a56f13e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:42.857129 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1724d976-6317-4dfd-a376-cd4e4a56f13e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:42.857612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1724d976-6317-4dfd-a376-cd4e4a56f13e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:42.858481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1724d976-6317-4dfd-a376-cd4e4a56f13e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:42.858947 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1724d976-6317-4dfd-a376-cd4e4a56f13e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:42.938714 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1724d976-6317-4dfd-a376-cd4e4a56f13e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:55:42.961354 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.compute.api [None req-1724d976-6317-4dfd-a376-cd4e4a56f13e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Working on deleting snapshot f6aaa6fe-919e-464b-995f-45c5facf02d8 from shelved instance... Jul 25 12:55:43.032877 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-567487b9-16e9-408d-bf07-e3439031e577 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:43.034228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-567487b9-16e9-408d-bf07-e3439031e577 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:43.050538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-567487b9-16e9-408d-bf07-e3439031e577 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:43.077274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-567487b9-16e9-408d-bf07-e3439031e577 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:43.081281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-567487b9-16e9-408d-bf07-e3439031e577 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:43.082646 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-567487b9-16e9-408d-bf07-e3439031e577 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:43.318115 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-567487b9-16e9-408d-bf07-e3439031e577 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:43.327411 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-567487b9-16e9-408d-bf07-e3439031e577 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1273 microversion: 2.1 time: 0.302349 Jul 25 12:55:43.328225 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1598/3265] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:43 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1273 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:43.447611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-65a586d5-67ab-4672-9fb2-238e867de5d1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:43.448412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-65a586d5-67ab-4672-9fb2-238e867de5d1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:43.526128 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65a586d5-67ab-4672-9fb2-238e867de5d1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:43.533491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65a586d5-67ab-4672-9fb2-238e867de5d1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:43.541374 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65a586d5-67ab-4672-9fb2-238e867de5d1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:43.568190 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65a586d5-67ab-4672-9fb2-238e867de5d1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:44.208185 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-65a586d5-67ab-4672-9fb2-238e867de5d1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:44.240080 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-65a586d5-67ab-4672-9fb2-238e867de5d1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1275 microversion: 2.1 time: 0.796720 Jul 25 12:55:44.245933 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1599/3266] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:43 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1275 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:55:44.349764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6a3a09cd-b9fb-4e21-afde-ec5ad12ab355 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:44.351488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6a3a09cd-b9fb-4e21-afde-ec5ad12ab355 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:44.379379 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a3a09cd-b9fb-4e21-afde-ec5ad12ab355 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:44.380013 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a3a09cd-b9fb-4e21-afde-ec5ad12ab355 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:44.381519 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a3a09cd-b9fb-4e21-afde-ec5ad12ab355 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:44.382131 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a3a09cd-b9fb-4e21-afde-ec5ad12ab355 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:44.494701 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:55:44.725418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1724d976-6317-4dfd-a376-cd4e4a56f13e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Doing local delete in cell 44375b4d-91c4-48bf-9056-56d6e14223f5(cell1) {{(pid=125884) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 25 12:55:44.727236 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1724d976-6317-4dfd-a376-cd4e4a56f13e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:44.728382 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1724d976-6317-4dfd-a376-cd4e4a56f13e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:44.729530 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.compute.api [None req-1724d976-6317-4dfd-a376-cd4e4a56f13e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 25 12:55:44.743360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-1724d976-6317-4dfd-a376-cd4e4a56f13e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] deallocate_for_instance() {{(pid=125884) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 25 12:55:44.764333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6a3a09cd-b9fb-4e21-afde-ec5ad12ab355 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:44.782089 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6a3a09cd-b9fb-4e21-afde-ec5ad12ab355 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1273 microversion: 2.1 time: 0.433923 Jul 25 12:55:44.786228 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1600/3267] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:44 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1273 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:55:45.270596 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bc3ad621-5295-42fd-89fc-4f567a491ba8 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:45.272249 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bc3ad621-5295-42fd-89fc-4f567a491ba8 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:45.286879 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc3ad621-5295-42fd-89fc-4f567a491ba8 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:45.287913 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc3ad621-5295-42fd-89fc-4f567a491ba8 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:45.289448 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc3ad621-5295-42fd-89fc-4f567a491ba8 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:45.292560 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc3ad621-5295-42fd-89fc-4f567a491ba8 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:45.945556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bc3ad621-5295-42fd-89fc-4f567a491ba8 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:45.959875 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bc3ad621-5295-42fd-89fc-4f567a491ba8 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1317 microversion: 2.1 time: 0.692816 Jul 25 12:55:45.961024 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1601/3268] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:45 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1317 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:45.986668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-069efeff-19bd-485f-8343-7a530fcea82b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:45.988611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-069efeff-19bd-485f-8343-7a530fcea82b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:46.013095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-069efeff-19bd-485f-8343-7a530fcea82b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:46.014795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-069efeff-19bd-485f-8343-7a530fcea82b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:46.017786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-069efeff-19bd-485f-8343-7a530fcea82b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:46.018981 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-069efeff-19bd-485f-8343-7a530fcea82b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:46.781333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-069efeff-19bd-485f-8343-7a530fcea82b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:46.831629 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-069efeff-19bd-485f-8343-7a530fcea82b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1315 microversion: 2.1 time: 0.867894 Jul 25 12:55:46.834370 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1602/3269] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:45 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1315 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:46.996510 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-81b85bab-6ea8-41aa-9fed-5f9155f90a26 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:46.998293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-81b85bab-6ea8-41aa-9fed-5f9155f90a26 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:47.012946 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-81b85bab-6ea8-41aa-9fed-5f9155f90a26 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:47.014336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-81b85bab-6ea8-41aa-9fed-5f9155f90a26 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:47.015728 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-81b85bab-6ea8-41aa-9fed-5f9155f90a26 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:47.020834 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-81b85bab-6ea8-41aa-9fed-5f9155f90a26 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:47.226931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-1724d976-6317-4dfd-a376-cd4e4a56f13e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Updating instance_info_cache with network_info: [] {{(pid=125884) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 12:55:47.715994 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1724d976-6317-4dfd-a376-cd4e4a56f13e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 204 len: 0 microversion: 2.1 time: 4.885654 Jul 25 12:55:47.727961 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1668/3270] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:55:42 2022] DELETE /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 0 bytes in 4895 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:55:47.734242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-7e472017-760e-4a70-8123-a3421cbd1a5d req-5714cb38-ea35-4d4b-be41-9f6e105669dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9cc21b1-7442-4031-b701-b534f237749f", "name": "network-vif-deleted", "tag": "86c86fd3-b1f7-405c-92a4-239039e1570a"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:55:47.763328 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-7e472017-760e-4a70-8123-a3421cbd1a5d req-5714cb38-ea35-4d4b-be41-9f6e105669dc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:47.763849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-7e472017-760e-4a70-8123-a3421cbd1a5d req-5714cb38-ea35-4d4b-be41-9f6e105669dc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:47.796667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.compute.server_external_events [req-7e472017-760e-4a70-8123-a3421cbd1a5d req-5714cb38-ea35-4d4b-be41-9f6e105669dc service nova] Unable to find a host for instance c9cc21b1-7442-4031-b701-b534f237749f. Dropping event network-vif-deleted {{(pid=125884) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 12:55:47.798463 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-7e472017-760e-4a70-8123-a3421cbd1a5d req-5714cb38-ea35-4d4b-be41-9f6e105669dc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.068882 Jul 25 12:55:47.801184 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1669/3271] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 72 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 25 12:55:47.817186 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a815bc1f-db0d-4ffd-a86c-c5e98b5cdcef tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:47.819102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a815bc1f-db0d-4ffd-a86c-c5e98b5cdcef tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:47.838100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a815bc1f-db0d-4ffd-a86c-c5e98b5cdcef tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:47.839591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a815bc1f-db0d-4ffd-a86c-c5e98b5cdcef tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:47.841968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a815bc1f-db0d-4ffd-a86c-c5e98b5cdcef tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:47.843146 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a815bc1f-db0d-4ffd-a86c-c5e98b5cdcef tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:47.846037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-81b85bab-6ea8-41aa-9fed-5f9155f90a26 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:47.880110 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-81b85bab-6ea8-41aa-9fed-5f9155f90a26 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1317 microversion: 2.1 time: 0.887927 Jul 25 12:55:47.883532 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-a815bc1f-db0d-4ffd-a86c-c5e98b5cdcef tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] HTTP exception thrown: Instance c9cc21b1-7442-4031-b701-b534f237749f could not be found. Jul 25 12:55:47.884544 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1603/3272] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:46 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1317 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a815bc1f-db0d-4ffd-a86c-c5e98b5cdcef tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Request method failure captured: Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f HTTP/1.1 Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pHF7UCaF8gOsr4izIJsQMgDEa0djLGcj88wHujy3LL3KrSKed1jp5p2g1uyl0B7FckQX0z38dpjtGtJDzQMYAlTS7LRfENWczpgFqPzdGM6KYoCp6qrqJdc7QEkc58SEBAWEj2A4h5-asWJS2CIcfkxwvHFTYem8sDn2kkqArMxtZA Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f07680a55b3f41408d3a284d1330503d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}] Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: d28f966411004a158377c689fd5b05eb Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance c9cc21b1-7442-4031-b701-b534f237749f could not be found. Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'c9cc21b1-7442-4031-b701-b534f237749f'} Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9cc21b1-7442-4031-b701-b534f237749f could not be found. Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9cc21b1-7442-4031-b701-b534f237749f could not be found. Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:55:47.887844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:55:47.899527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:55:47.899527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:55:47.899527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:55:47.899527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:55:47.899527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:55:47.899527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9cc21b1-7442-4031-b701-b534f237749f could not be found. Jul 25 12:55:47.899527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:55:47.903770 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a815bc1f-db0d-4ffd-a86c-c5e98b5cdcef tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Returning 404 to user: Instance c9cc21b1-7442-4031-b701-b534f237749f could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:55:47.905074 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-62af917f-c548-4237-8afe-46bf27d19d75 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:47.906732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-62af917f-c548-4237-8afe-46bf27d19d75 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:47.907236 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a815bc1f-db0d-4ffd-a86c-c5e98b5cdcef tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 404 len: 111 microversion: 2.1 time: 0.102226 Jul 25 12:55:47.908852 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1670/3273] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:47 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:55:47.935109 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62af917f-c548-4237-8afe-46bf27d19d75 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:47.936421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62af917f-c548-4237-8afe-46bf27d19d75 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:47.938176 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62af917f-c548-4237-8afe-46bf27d19d75 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:47.939648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62af917f-c548-4237-8afe-46bf27d19d75 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:48.252433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1c28279e-8046-4ef2-bff1-90b96c201b29 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-728894508", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "b6926756-00b4-4271-8538-f2e94168b61a"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:55:48.361346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-62af917f-c548-4237-8afe-46bf27d19d75 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:48.376436 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-62af917f-c548-4237-8afe-46bf27d19d75 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1315 microversion: 2.1 time: 0.490384 Jul 25 12:55:48.381182 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1604/3274] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:47 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:48.478546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-1c28279e-8046-4ef2-bff1-90b96c201b29 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] validate_networks() for [('b6926756-00b4-4271-8538-f2e94168b61a', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:55:48.920694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-76c358d1-c030-4ae9-95c5-ffbd846c2fd1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:48.921804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-76c358d1-c030-4ae9-95c5-ffbd846c2fd1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:48.976789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:55:48.983554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:55:48.993907 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-76c358d1-c030-4ae9-95c5-ffbd846c2fd1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:49.001013 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-76c358d1-c030-4ae9-95c5-ffbd846c2fd1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:49.015771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-76c358d1-c030-4ae9-95c5-ffbd846c2fd1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:49.018052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-76c358d1-c030-4ae9-95c5-ffbd846c2fd1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:49.366313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:55:50.178453 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-76c358d1-c030-4ae9-95c5-ffbd846c2fd1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:50.187261 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-76c358d1-c030-4ae9-95c5-ffbd846c2fd1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1317 microversion: 2.1 time: 1.281377 Jul 25 12:55:50.193176 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1605/3275] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:48 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1317 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:50.198512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-e43a9dbb-9e4e-486b-b0b9-56f6104d330d req-0489040a-d3a8-494b-91a3-7c5620ab7a57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5749241b-2503-460b-b1e6-71983c40d397", "tag": "987e2ba7-cfd0-4292-97a8-2d00db7417e7"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:55:50.220178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e43a9dbb-9e4e-486b-b0b9-56f6104d330d req-0489040a-d3a8-494b-91a3-7c5620ab7a57 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:50.230747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e43a9dbb-9e4e-486b-b0b9-56f6104d330d req-0489040a-d3a8-494b-91a3-7c5620ab7a57 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:50.256618 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-e43a9dbb-9e4e-486b-b0b9-56f6104d330d req-0489040a-d3a8-494b-91a3-7c5620ab7a57 service nova] Creating event network-changed:987e2ba7-cfd0-4292-97a8-2d00db7417e7 for instance 5749241b-2503-460b-b1e6-71983c40d397 on n-h2-848886-15 Jul 25 12:55:50.265267 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-e43a9dbb-9e4e-486b-b0b9-56f6104d330d req-0489040a-d3a8-494b-91a3-7c5620ab7a57 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070312 Jul 25 12:55:50.266301 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1606/3276] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:55:50.271813 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bde7ddee-1094-4c70-a0a0-8142a8774bbd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:50.284423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bde7ddee-1094-4c70-a0a0-8142a8774bbd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:50.304214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bde7ddee-1094-4c70-a0a0-8142a8774bbd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:50.311435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bde7ddee-1094-4c70-a0a0-8142a8774bbd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:50.313373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bde7ddee-1094-4c70-a0a0-8142a8774bbd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:50.314552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bde7ddee-1094-4c70-a0a0-8142a8774bbd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:50.805258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=10 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:55:51.082706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bde7ddee-1094-4c70-a0a0-8142a8774bbd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:51.083513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-1c28279e-8046-4ef2-bff1-90b96c201b29 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:55:51.083908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-1c28279e-8046-4ef2-bff1-90b96c201b29 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:55:51.084563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-1c28279e-8046-4ef2-bff1-90b96c201b29 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:55:51.086213 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-1c28279e-8046-4ef2-bff1-90b96c201b29 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:55:51.086684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-1c28279e-8046-4ef2-bff1-90b96c201b29 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:55:51.089420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:55:51.138483 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1c28279e-8046-4ef2-bff1-90b96c201b29 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:51.140278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1c28279e-8046-4ef2-bff1-90b96c201b29 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:51.142630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1c28279e-8046-4ef2-bff1-90b96c201b29 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:51.147132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1c28279e-8046-4ef2-bff1-90b96c201b29 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:51.154396 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bde7ddee-1094-4c70-a0a0-8142a8774bbd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1315 microversion: 2.1 time: 0.884808 Jul 25 12:55:51.161060 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1607/3277] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:50 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1315 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:51.170690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-abbf7a2d-070f-4e2e-9795-6825c79e5c90 req-c637a05e-affe-4e7a-93df-3e4c33e508f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bf29727-b5cc-4bb2-bbcc-74686ddd22a2", "tag": "38b4c3eb-5cea-4889-accc-076c98a9feed"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:55:51.191568 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-abbf7a2d-070f-4e2e-9795-6825c79e5c90 req-c637a05e-affe-4e7a-93df-3e4c33e508f5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:51.195234 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-abbf7a2d-070f-4e2e-9795-6825c79e5c90 req-c637a05e-affe-4e7a-93df-3e4c33e508f5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:51.226097 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-abbf7a2d-070f-4e2e-9795-6825c79e5c90 req-c637a05e-affe-4e7a-93df-3e4c33e508f5 service nova] Creating event network-changed:38b4c3eb-5cea-4889-accc-076c98a9feed for instance 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 on n-h2-848886-15 Jul 25 12:55:51.234006 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-abbf7a2d-070f-4e2e-9795-6825c79e5c90 req-c637a05e-affe-4e7a-93df-3e4c33e508f5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070949 Jul 25 12:55:51.235174 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1608/3278] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:55:51.237369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-1c28279e-8046-4ef2-bff1-90b96c201b29 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Getting quotas for project f07680a55b3f41408d3a284d1330503d. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:55:51.244083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e9db9f7f-96f1-4956-8a81-3d455aed320e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:51.245419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e9db9f7f-96f1-4956-8a81-3d455aed320e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:51.256585 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e9db9f7f-96f1-4956-8a81-3d455aed320e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:51.258225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e9db9f7f-96f1-4956-8a81-3d455aed320e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:51.259524 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-1c28279e-8046-4ef2-bff1-90b96c201b29 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Getting quotas for user d28f966411004a158377c689fd5b05eb and project f07680a55b3f41408d3a284d1330503d. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:55:51.260349 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e9db9f7f-96f1-4956-8a81-3d455aed320e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:51.261001 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e9db9f7f-96f1-4956-8a81-3d455aed320e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:51.319797 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1c28279e-8046-4ef2-bff1-90b96c201b29 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:55:51.334125 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1c28279e-8046-4ef2-bff1-90b96c201b29 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:55:51.491705 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1c28279e-8046-4ef2-bff1-90b96c201b29 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.248224 Jul 25 12:55:51.495554 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1671/3279] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:55:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 12:55:51.512068 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d6ba1951-ded2-4a4a-b785-1404825e1198 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:51.513518 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d6ba1951-ded2-4a4a-b785-1404825e1198 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:51.782209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d6ba1951-ded2-4a4a-b785-1404825e1198 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:51.798197 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d6ba1951-ded2-4a4a-b785-1404825e1198 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1214 microversion: 2.1 time: 0.288146 Jul 25 12:55:51.802086 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1672/3280] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:51 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1214 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:55:51.977233 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e9db9f7f-96f1-4956-8a81-3d455aed320e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:51.995441 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e9db9f7f-96f1-4956-8a81-3d455aed320e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1317 microversion: 2.1 time: 0.758642 Jul 25 12:55:52.001259 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1609/3281] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:51 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1317 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:52.212319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2064136b-bdcf-41ec-9a1e-483610078078 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:52.213021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2064136b-bdcf-41ec-9a1e-483610078078 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:52.241851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2064136b-bdcf-41ec-9a1e-483610078078 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:52.242312 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2064136b-bdcf-41ec-9a1e-483610078078 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:52.255063 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2064136b-bdcf-41ec-9a1e-483610078078 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:52.255882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2064136b-bdcf-41ec-9a1e-483610078078 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:52.831937 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7dba1a32-1ddc-4b8f-9ca7-8856e79ca09a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:52.834400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7dba1a32-1ddc-4b8f-9ca7-8856e79ca09a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:52.871082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7dba1a32-1ddc-4b8f-9ca7-8856e79ca09a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:52.876049 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7dba1a32-1ddc-4b8f-9ca7-8856e79ca09a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:52.883618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7dba1a32-1ddc-4b8f-9ca7-8856e79ca09a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:52.885155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7dba1a32-1ddc-4b8f-9ca7-8856e79ca09a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:53.181447 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7dba1a32-1ddc-4b8f-9ca7-8856e79ca09a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:53.200931 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7dba1a32-1ddc-4b8f-9ca7-8856e79ca09a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1218 microversion: 2.1 time: 0.374540 Jul 25 12:55:53.202523 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1610/3282] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:52 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1218 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:53.215603 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d2ce1529-3359-41e4-821a-011c2c6af194 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:53.219604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d2ce1529-3359-41e4-821a-011c2c6af194 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:53.242178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2ce1529-3359-41e4-821a-011c2c6af194 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:53.243106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2ce1529-3359-41e4-821a-011c2c6af194 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:53.244053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2ce1529-3359-41e4-821a-011c2c6af194 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:53.244855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2ce1529-3359-41e4-821a-011c2c6af194 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:53.285913 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2064136b-bdcf-41ec-9a1e-483610078078 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:53.317898 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2064136b-bdcf-41ec-9a1e-483610078078 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1315 microversion: 2.1 time: 1.114537 Jul 25 12:55:53.322440 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1673/3283] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:52 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1315 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:55:54.228842 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3010a139-55e3-4cd6-bb5a-5d5ecd436172 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:54.229455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3010a139-55e3-4cd6-bb5a-5d5ecd436172 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:54.250352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3010a139-55e3-4cd6-bb5a-5d5ecd436172 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:54.255150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3010a139-55e3-4cd6-bb5a-5d5ecd436172 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:54.257466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3010a139-55e3-4cd6-bb5a-5d5ecd436172 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:54.258559 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3010a139-55e3-4cd6-bb5a-5d5ecd436172 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:54.911540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d2ce1529-3359-41e4-821a-011c2c6af194 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:54.932088 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d2ce1529-3359-41e4-821a-011c2c6af194 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1317 microversion: 2.1 time: 1.727499 Jul 25 12:55:54.932733 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1611/3284] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:53 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1317 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:54.941524 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3fb6ecbe-44b4-4f9b-9487-b9cf54c8b2a8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:54.942539 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3fb6ecbe-44b4-4f9b-9487-b9cf54c8b2a8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:54.946089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:55:54.964107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3fb6ecbe-44b4-4f9b-9487-b9cf54c8b2a8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:54.965219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3fb6ecbe-44b4-4f9b-9487-b9cf54c8b2a8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:54.967301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3fb6ecbe-44b4-4f9b-9487-b9cf54c8b2a8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:54.967936 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3fb6ecbe-44b4-4f9b-9487-b9cf54c8b2a8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:55.031461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3010a139-55e3-4cd6-bb5a-5d5ecd436172 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:55.035309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:55:55.059657 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3010a139-55e3-4cd6-bb5a-5d5ecd436172 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1266 microversion: 2.1 time: 0.832727 Jul 25 12:55:55.062121 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1674/3285] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:54 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1266 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:55.538642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3fb6ecbe-44b4-4f9b-9487-b9cf54c8b2a8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:55.565734 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3fb6ecbe-44b4-4f9b-9487-b9cf54c8b2a8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1315 microversion: 2.1 time: 0.628975 Jul 25 12:55:55.567610 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1612/3286] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:54 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1315 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:55.963486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2d5e8e31-787b-4dba-b977-baa9e36ac988 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:55.963826 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2d5e8e31-787b-4dba-b977-baa9e36ac988 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:55.977429 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d5e8e31-787b-4dba-b977-baa9e36ac988 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:55.979985 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d5e8e31-787b-4dba-b977-baa9e36ac988 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:55.983237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d5e8e31-787b-4dba-b977-baa9e36ac988 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:55.983946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d5e8e31-787b-4dba-b977-baa9e36ac988 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:56.085603 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ef432c88-9c24-4aab-a235-71c3a71df8a0 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:56.086934 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ef432c88-9c24-4aab-a235-71c3a71df8a0 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:56.107974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef432c88-9c24-4aab-a235-71c3a71df8a0 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:56.110431 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef432c88-9c24-4aab-a235-71c3a71df8a0 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:56.112236 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef432c88-9c24-4aab-a235-71c3a71df8a0 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:56.114029 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef432c88-9c24-4aab-a235-71c3a71df8a0 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:56.360120 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ef432c88-9c24-4aab-a235-71c3a71df8a0 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:56.382825 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ef432c88-9c24-4aab-a235-71c3a71df8a0 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1272 microversion: 2.1 time: 0.302719 Jul 25 12:55:56.392586 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1613/3287] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:56 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1272 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:56.589015 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-180224ce-1ce2-46bf-a2e3-71c6435bd44d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:56.589695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-180224ce-1ce2-46bf-a2e3-71c6435bd44d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:56.606079 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-180224ce-1ce2-46bf-a2e3-71c6435bd44d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:56.608333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-180224ce-1ce2-46bf-a2e3-71c6435bd44d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:56.609273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-180224ce-1ce2-46bf-a2e3-71c6435bd44d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:56.623421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-180224ce-1ce2-46bf-a2e3-71c6435bd44d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:57.143520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2d5e8e31-787b-4dba-b977-baa9e36ac988 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:57.168075 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2d5e8e31-787b-4dba-b977-baa9e36ac988 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1317 microversion: 2.1 time: 1.205989 Jul 25 12:55:57.169566 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1675/3288] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:55 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1317 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:57.419513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7829c5fc-6bbb-4708-b72a-0cb3084ee89d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:57.419513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7829c5fc-6bbb-4708-b72a-0cb3084ee89d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:57.448839 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7829c5fc-6bbb-4708-b72a-0cb3084ee89d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:57.448839 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7829c5fc-6bbb-4708-b72a-0cb3084ee89d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:57.448839 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7829c5fc-6bbb-4708-b72a-0cb3084ee89d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:57.449767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7829c5fc-6bbb-4708-b72a-0cb3084ee89d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:57.594717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-180224ce-1ce2-46bf-a2e3-71c6435bd44d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:57.634974 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-180224ce-1ce2-46bf-a2e3-71c6435bd44d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1315 microversion: 2.1 time: 1.047585 Jul 25 12:55:57.636146 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1614/3289] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:56 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1315 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:55:58.195500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b6865ff2-7493-411c-93f2-7ada8f4eda95 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:58.197403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b6865ff2-7493-411c-93f2-7ada8f4eda95 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:58.209957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b6865ff2-7493-411c-93f2-7ada8f4eda95 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:58.210506 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b6865ff2-7493-411c-93f2-7ada8f4eda95 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:58.214865 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b6865ff2-7493-411c-93f2-7ada8f4eda95 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:58.215441 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b6865ff2-7493-411c-93f2-7ada8f4eda95 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:58.302607 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7829c5fc-6bbb-4708-b72a-0cb3084ee89d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:58.330302 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7829c5fc-6bbb-4708-b72a-0cb3084ee89d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1314 microversion: 2.1 time: 0.921419 Jul 25 12:55:58.333515 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1676/3290] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:57 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1314 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:55:58.666220 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-94b3ad94-a4ce-4b40-b3a1-bb115b70134b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:58.667605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-94b3ad94-a4ce-4b40-b3a1-bb115b70134b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:58.721695 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94b3ad94-a4ce-4b40-b3a1-bb115b70134b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:58.730832 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94b3ad94-a4ce-4b40-b3a1-bb115b70134b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:58.733552 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94b3ad94-a4ce-4b40-b3a1-bb115b70134b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:58.736949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94b3ad94-a4ce-4b40-b3a1-bb115b70134b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:59.372545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b6865ff2-7493-411c-93f2-7ada8f4eda95 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:59.394706 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b6865ff2-7493-411c-93f2-7ada8f4eda95 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1317 microversion: 2.1 time: 1.202862 Jul 25 12:55:59.395847 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1615/3291] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:58 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1317 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:55:59.418644 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-10594fac-6f20-4040-9ea5-992e2057e93c req-37ca280c-2dee-4425-8d95-0efb4062a063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5749241b-2503-460b-b1e6-71983c40d397", "name": "network-vif-plugged", "status": "completed", "tag": "987e2ba7-cfd0-4292-97a8-2d00db7417e7"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:55:59.478006 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-10594fac-6f20-4040-9ea5-992e2057e93c req-37ca280c-2dee-4425-8d95-0efb4062a063 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:59.479716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-10594fac-6f20-4040-9ea5-992e2057e93c req-37ca280c-2dee-4425-8d95-0efb4062a063 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:59.533309 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-10594fac-6f20-4040-9ea5-992e2057e93c req-37ca280c-2dee-4425-8d95-0efb4062a063 service nova] Creating event network-vif-plugged:987e2ba7-cfd0-4292-97a8-2d00db7417e7 for instance 5749241b-2503-460b-b1e6-71983c40d397 on n-h2-848886-15 Jul 25 12:55:59.559842 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-10594fac-6f20-4040-9ea5-992e2057e93c req-37ca280c-2dee-4425-8d95-0efb4062a063 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162497 Jul 25 12:55:59.572411 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1616/3292] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:55:59.584647 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-08d12cbe-8abc-4e09-a62d-462c2a0ee094 req-558a51a1-04d0-4373-999f-ad46b129d3c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "975ed5ee-8529-4421-b5ad-531e0caa8c16", "tag": "b6fb21e2-fc5b-4338-a202-037d4855ca52"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:55:59.615738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-08d12cbe-8abc-4e09-a62d-462c2a0ee094 req-558a51a1-04d0-4373-999f-ad46b129d3c3 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:59.616729 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-08d12cbe-8abc-4e09-a62d-462c2a0ee094 req-558a51a1-04d0-4373-999f-ad46b129d3c3 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:59.637193 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-08d12cbe-8abc-4e09-a62d-462c2a0ee094 req-558a51a1-04d0-4373-999f-ad46b129d3c3 service nova] Creating event network-changed:b6fb21e2-fc5b-4338-a202-037d4855ca52 for instance 975ed5ee-8529-4421-b5ad-531e0caa8c16 on n-h1-848886-15 Jul 25 12:55:59.650920 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-08d12cbe-8abc-4e09-a62d-462c2a0ee094 req-558a51a1-04d0-4373-999f-ad46b129d3c3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076987 Jul 25 12:55:59.652392 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1617/3293] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:55:59.684329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-04903bc3-2d59-4a46-a1a3-6f3a7859ef2e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:59.695045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-04903bc3-2d59-4a46-a1a3-6f3a7859ef2e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:59.737662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-04903bc3-2d59-4a46-a1a3-6f3a7859ef2e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:59.740285 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-04903bc3-2d59-4a46-a1a3-6f3a7859ef2e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:59.741968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-04903bc3-2d59-4a46-a1a3-6f3a7859ef2e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:59.743665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-04903bc3-2d59-4a46-a1a3-6f3a7859ef2e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:00.247869 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-94b3ad94-a4ce-4b40-b3a1-bb115b70134b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:00.256037 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-94b3ad94-a4ce-4b40-b3a1-bb115b70134b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1315 microversion: 2.1 time: 1.600540 Jul 25 12:56:00.266222 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1677/3294] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:58 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1315 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:00.422950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a5931e0f-514f-4fae-95c7-7e8a9eed5e33 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:00.424363 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a5931e0f-514f-4fae-95c7-7e8a9eed5e33 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:00.434341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5931e0f-514f-4fae-95c7-7e8a9eed5e33 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:00.435640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5931e0f-514f-4fae-95c7-7e8a9eed5e33 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:00.436698 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5931e0f-514f-4fae-95c7-7e8a9eed5e33 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:00.437341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5931e0f-514f-4fae-95c7-7e8a9eed5e33 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:00.695404 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-04903bc3-2d59-4a46-a1a3-6f3a7859ef2e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:00.734491 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-04903bc3-2d59-4a46-a1a3-6f3a7859ef2e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1314 microversion: 2.1 time: 1.079823 Jul 25 12:56:00.755050 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1618/3295] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:59 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1314 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:01.038114 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a5931e0f-514f-4fae-95c7-7e8a9eed5e33 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:01.080923 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a5931e0f-514f-4fae-95c7-7e8a9eed5e33 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1317 microversion: 2.1 time: 0.666079 Jul 25 12:56:01.082534 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1678/3296] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:00 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1317 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:56:01.292725 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5798b155-cda6-4707-b023-8e3f14ae3e1d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:01.293680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5798b155-cda6-4707-b023-8e3f14ae3e1d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:01.316681 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5798b155-cda6-4707-b023-8e3f14ae3e1d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:01.317475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5798b155-cda6-4707-b023-8e3f14ae3e1d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:01.321450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5798b155-cda6-4707-b023-8e3f14ae3e1d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:01.323450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5798b155-cda6-4707-b023-8e3f14ae3e1d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:01.640188 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-18d688f4-b709-4ffc-8cfe-581fb30851cb req-f64edb15-953f-49af-8033-895fe89f764c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf29727-b5cc-4bb2-bbcc-74686ddd22a2", "name": "network-vif-plugged", "status": "completed", "tag": "38b4c3eb-5cea-4889-accc-076c98a9feed"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:01.651457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5798b155-cda6-4707-b023-8e3f14ae3e1d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:01.658195 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:01.659707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:01.678563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-18d688f4-b709-4ffc-8cfe-581fb30851cb req-f64edb15-953f-49af-8033-895fe89f764c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:01.681108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-18d688f4-b709-4ffc-8cfe-581fb30851cb req-f64edb15-953f-49af-8033-895fe89f764c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:01.720924 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-18d688f4-b709-4ffc-8cfe-581fb30851cb req-f64edb15-953f-49af-8033-895fe89f764c service nova] Creating event network-vif-plugged:38b4c3eb-5cea-4889-accc-076c98a9feed for instance 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 on n-h2-848886-15 Jul 25 12:56:01.721536 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5798b155-cda6-4707-b023-8e3f14ae3e1d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1315 microversion: 2.1 time: 0.434515 Jul 25 12:56:01.724217 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1619/3297] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:01 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:56:01.747361 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-18d688f4-b709-4ffc-8cfe-581fb30851cb req-f64edb15-953f-49af-8033-895fe89f764c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112957 Jul 25 12:56:01.749580 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1679/3298] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:56:01.759806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3c9dfa93-b982-4dd7-a5c8-3e39520d9cbe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:01.761076 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3c9dfa93-b982-4dd7-a5c8-3e39520d9cbe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:01.789082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c9dfa93-b982-4dd7-a5c8-3e39520d9cbe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:01.795661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c9dfa93-b982-4dd7-a5c8-3e39520d9cbe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:01.796589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c9dfa93-b982-4dd7-a5c8-3e39520d9cbe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:01.797139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c9dfa93-b982-4dd7-a5c8-3e39520d9cbe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:02.113018 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5837409c-6ead-4211-8b56-f0f90cd28b08 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:02.114124 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5837409c-6ead-4211-8b56-f0f90cd28b08 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:02.119067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=8 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:02.149116 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5837409c-6ead-4211-8b56-f0f90cd28b08 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:02.159079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5837409c-6ead-4211-8b56-f0f90cd28b08 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:02.164862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5837409c-6ead-4211-8b56-f0f90cd28b08 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:02.170637 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5837409c-6ead-4211-8b56-f0f90cd28b08 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:02.872530 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5837409c-6ead-4211-8b56-f0f90cd28b08 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:02.890355 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5837409c-6ead-4211-8b56-f0f90cd28b08 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1506 microversion: 2.1 time: 0.782352 Jul 25 12:56:02.895169 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1680/3299] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:02 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1506 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:56:02.905811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-be832d8f-7322-4e85-9a4f-8f453b3db86b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:02.907375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-be832d8f-7322-4e85-9a4f-8f453b3db86b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:02.922362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be832d8f-7322-4e85-9a4f-8f453b3db86b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:02.923653 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be832d8f-7322-4e85-9a4f-8f453b3db86b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:02.925931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be832d8f-7322-4e85-9a4f-8f453b3db86b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:02.927140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be832d8f-7322-4e85-9a4f-8f453b3db86b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:03.001433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3c9dfa93-b982-4dd7-a5c8-3e39520d9cbe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:03.022257 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3c9dfa93-b982-4dd7-a5c8-3e39520d9cbe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1314 microversion: 2.1 time: 1.268455 Jul 25 12:56:03.024672 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1620/3300] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:01 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1314 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:03.045684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c4dfdf43-a448-4b8f-8a8b-e6bd0decdb01 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:03.049057 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c4dfdf43-a448-4b8f-8a8b-e6bd0decdb01 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:03.073082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4dfdf43-a448-4b8f-8a8b-e6bd0decdb01 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:03.074066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4dfdf43-a448-4b8f-8a8b-e6bd0decdb01 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:03.075279 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4dfdf43-a448-4b8f-8a8b-e6bd0decdb01 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:03.076713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4dfdf43-a448-4b8f-8a8b-e6bd0decdb01 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:03.611158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c4dfdf43-a448-4b8f-8a8b-e6bd0decdb01 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:03.637953 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c4dfdf43-a448-4b8f-8a8b-e6bd0decdb01 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1506 microversion: 2.1 time: 0.610917 Jul 25 12:56:03.639037 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1621/3301] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:03 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1506 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:03.665217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-be832d8f-7322-4e85-9a4f-8f453b3db86b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:03.679434 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-be832d8f-7322-4e85-9a4f-8f453b3db86b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1315 microversion: 2.1 time: 0.780890 Jul 25 12:56:03.681479 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1681/3302] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:02 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1315 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:03.701144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e8161537-1a97-4f62-a003-43acf26d3a34 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:03.703762 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e8161537-1a97-4f62-a003-43acf26d3a34 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:03.724274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e8161537-1a97-4f62-a003-43acf26d3a34 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:03.724888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e8161537-1a97-4f62-a003-43acf26d3a34 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:03.726043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e8161537-1a97-4f62-a003-43acf26d3a34 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:03.727350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e8161537-1a97-4f62-a003-43acf26d3a34 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:03.882047 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e8161537-1a97-4f62-a003-43acf26d3a34 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "PUT /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1078 microversion: 2.1 time: 0.198027 Jul 25 12:56:03.885248 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1622/3303] 10.222.0.49 () {60 vars in 1256 bytes} [Mon Jul 25 12:56:03 2022] PUT /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1078 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:03.910992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f320cf70-c590-49b0-9e2f-c2c41e2e4548 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:03.912482 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f320cf70-c590-49b0-9e2f-c2c41e2e4548 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:03.929386 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f320cf70-c590-49b0-9e2f-c2c41e2e4548 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:03.931124 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f320cf70-c590-49b0-9e2f-c2c41e2e4548 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:03.935847 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f320cf70-c590-49b0-9e2f-c2c41e2e4548 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:03.937428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f320cf70-c590-49b0-9e2f-c2c41e2e4548 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:04.047550 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0e954598-e6b7-4a8a-b11a-91fea4bea88f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:04.048373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0e954598-e6b7-4a8a-b11a-91fea4bea88f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:04.068981 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e954598-e6b7-4a8a-b11a-91fea4bea88f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:04.069439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e954598-e6b7-4a8a-b11a-91fea4bea88f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:04.071389 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e954598-e6b7-4a8a-b11a-91fea4bea88f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:04.075269 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e954598-e6b7-4a8a-b11a-91fea4bea88f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:04.518759 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f320cf70-c590-49b0-9e2f-c2c41e2e4548 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:04.530284 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f320cf70-c590-49b0-9e2f-c2c41e2e4548 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1504 microversion: 2.1 time: 0.622275 Jul 25 12:56:04.534000 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1682/3304] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:03 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1504 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:04.567384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ef0e2da8-cbcd-44eb-a497-fa677a81cb86 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:04.569228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ef0e2da8-cbcd-44eb-a497-fa677a81cb86 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:04.589599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef0e2da8-cbcd-44eb-a497-fa677a81cb86 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:04.590084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef0e2da8-cbcd-44eb-a497-fa677a81cb86 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:04.590953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef0e2da8-cbcd-44eb-a497-fa677a81cb86 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:04.591391 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef0e2da8-cbcd-44eb-a497-fa677a81cb86 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:04.597863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0e954598-e6b7-4a8a-b11a-91fea4bea88f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:04.609734 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0e954598-e6b7-4a8a-b11a-91fea4bea88f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1314 microversion: 2.1 time: 0.568100 Jul 25 12:56:04.615113 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1623/3305] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:04 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:56:04.707606 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f4693ab6-146e-48b4-aef4-3a4dadbcb836 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:04.708713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f4693ab6-146e-48b4-aef4-3a4dadbcb836 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:04.742948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4693ab6-146e-48b4-aef4-3a4dadbcb836 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:04.751486 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4693ab6-146e-48b4-aef4-3a4dadbcb836 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:04.753127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4693ab6-146e-48b4-aef4-3a4dadbcb836 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:04.754309 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4693ab6-146e-48b4-aef4-3a4dadbcb836 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:05.289749 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ef0e2da8-cbcd-44eb-a497-fa677a81cb86 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:05.323526 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ef0e2da8-cbcd-44eb-a497-fa677a81cb86 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1504 microversion: 2.1 time: 0.762589 Jul 25 12:56:05.333740 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1683/3306] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:04 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1504 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:05.367967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f4693ab6-146e-48b4-aef4-3a4dadbcb836 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:05.376837 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a79f95ec-807d-49fe-82b9-38a005ed5b12 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:05.385570 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a79f95ec-807d-49fe-82b9-38a005ed5b12 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:05.400652 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f4693ab6-146e-48b4-aef4-3a4dadbcb836 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1502 microversion: 2.1 time: 0.699449 Jul 25 12:56:05.401441 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1624/3307] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:04 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1502 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:56:05.410152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a79f95ec-807d-49fe-82b9-38a005ed5b12 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:05.411074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a79f95ec-807d-49fe-82b9-38a005ed5b12 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:05.412563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a79f95ec-807d-49fe-82b9-38a005ed5b12 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:05.413313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a79f95ec-807d-49fe-82b9-38a005ed5b12 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:05.424420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1c71bde0-1d0f-478f-9377-247b4b2b7b2b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:05.436917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1c71bde0-1d0f-478f-9377-247b4b2b7b2b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:05.437736 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1c71bde0-1d0f-478f-9377-247b4b2b7b2b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:05.499741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1c71bde0-1d0f-478f-9377-247b4b2b7b2b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Going to try to stop instance {{(pid=125883) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 12:56:05.598088 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1c71bde0-1d0f-478f-9377-247b4b2b7b2b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2/action" status: 202 len: 0 microversion: 2.1 time: 0.178452 Jul 25 12:56:05.602748 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1625/3308] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:56:05 2022] POST /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 12:56:05.631424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-31a60b2a-d184-4ae3-810e-a7d0a3f03357 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:05.633903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-31a60b2a-d184-4ae3-810e-a7d0a3f03357 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:05.651850 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31a60b2a-d184-4ae3-810e-a7d0a3f03357 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:05.654466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31a60b2a-d184-4ae3-810e-a7d0a3f03357 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:05.657618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31a60b2a-d184-4ae3-810e-a7d0a3f03357 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:05.658277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31a60b2a-d184-4ae3-810e-a7d0a3f03357 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:05.687754 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-a79f95ec-807d-49fe-82b9-38a005ed5b12 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:56:05.697049 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-a79f95ec-807d-49fe-82b9-38a005ed5b12 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:56:05.698138 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-a79f95ec-807d-49fe-82b9-38a005ed5b12 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:56:05.699056 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-a79f95ec-807d-49fe-82b9-38a005ed5b12 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:56:05.699738 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-a79f95ec-807d-49fe-82b9-38a005ed5b12 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:56:05.879059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a79f95ec-807d-49fe-82b9-38a005ed5b12 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:05.892824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a79f95ec-807d-49fe-82b9-38a005ed5b12 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:05.898442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a79f95ec-807d-49fe-82b9-38a005ed5b12 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:05.899451 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a79f95ec-807d-49fe-82b9-38a005ed5b12 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:05.899912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a79f95ec-807d-49fe-82b9-38a005ed5b12 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:05.958841 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a79f95ec-807d-49fe-82b9-38a005ed5b12 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "POST /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397/action" status: 202 len: 1110 microversion: 2.1 time: 0.598596 Jul 25 12:56:05.971098 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1684/3309] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:56:05 2022] POST /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397/action => generated 1110 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 12:56:06.002763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ae71b55d-0036-4b4f-ae13-6d5a2044c878 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:06.003627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ae71b55d-0036-4b4f-ae13-6d5a2044c878 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:06.033064 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae71b55d-0036-4b4f-ae13-6d5a2044c878 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:06.036369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae71b55d-0036-4b4f-ae13-6d5a2044c878 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:06.041747 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae71b55d-0036-4b4f-ae13-6d5a2044c878 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:06.042587 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae71b55d-0036-4b4f-ae13-6d5a2044c878 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:06.256038 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-31a60b2a-d184-4ae3-810e-a7d0a3f03357 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:06.288012 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-31a60b2a-d184-4ae3-810e-a7d0a3f03357 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1512 microversion: 2.1 time: 0.672441 Jul 25 12:56:06.303027 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1626/3310] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:05 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1512 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:06.330575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-30a62825-e04a-412f-a210-084333e940d0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:06.334799 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-30a62825-e04a-412f-a210-084333e940d0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:06.364655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30a62825-e04a-412f-a210-084333e940d0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:06.366230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30a62825-e04a-412f-a210-084333e940d0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:06.367953 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30a62825-e04a-412f-a210-084333e940d0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:06.368726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30a62825-e04a-412f-a210-084333e940d0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:06.969961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-30a62825-e04a-412f-a210-084333e940d0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:06.986601 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-30a62825-e04a-412f-a210-084333e940d0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1515 microversion: 2.1 time: 0.677584 Jul 25 12:56:06.989189 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1627/3311] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:06 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1515 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:07.062873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ae71b55d-0036-4b4f-ae13-6d5a2044c878 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:07.087272 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ae71b55d-0036-4b4f-ae13-6d5a2044c878 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1314 microversion: 2.1 time: 1.114924 Jul 25 12:56:07.090706 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1685/3312] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:05 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1314 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:07.332628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6b639f34-3187-4925-a4eb-345eda863726 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:07.333293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6b639f34-3187-4925-a4eb-345eda863726 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:07.343359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b639f34-3187-4925-a4eb-345eda863726 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:07.345002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b639f34-3187-4925-a4eb-345eda863726 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:07.347043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b639f34-3187-4925-a4eb-345eda863726 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:07.347581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b639f34-3187-4925-a4eb-345eda863726 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:07.832334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6b639f34-3187-4925-a4eb-345eda863726 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:07.846936 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6b639f34-3187-4925-a4eb-345eda863726 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1512 microversion: 2.1 time: 0.525813 Jul 25 12:56:07.867659 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1628/3313] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:07 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1512 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:08.019137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5c21b07d-29c7-491e-99dc-d86cc436a76e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:08.019771 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5c21b07d-29c7-491e-99dc-d86cc436a76e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:08.028142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c21b07d-29c7-491e-99dc-d86cc436a76e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:08.028890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c21b07d-29c7-491e-99dc-d86cc436a76e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:08.029908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c21b07d-29c7-491e-99dc-d86cc436a76e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:08.030535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c21b07d-29c7-491e-99dc-d86cc436a76e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:08.113791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ed50d62a-ffaf-4807-baff-2979844f9589 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:08.115361 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ed50d62a-ffaf-4807-baff-2979844f9589 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:08.139154 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ed50d62a-ffaf-4807-baff-2979844f9589 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:08.149393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ed50d62a-ffaf-4807-baff-2979844f9589 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:08.155203 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ed50d62a-ffaf-4807-baff-2979844f9589 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:08.156090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ed50d62a-ffaf-4807-baff-2979844f9589 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:08.702389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5c21b07d-29c7-491e-99dc-d86cc436a76e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:08.712198 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5c21b07d-29c7-491e-99dc-d86cc436a76e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1515 microversion: 2.1 time: 0.697076 Jul 25 12:56:08.717279 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1686/3314] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:08 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1515 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:08.891611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1ce4a7b1-efde-4c14-95ea-dabf1b0d320d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:08.901042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1ce4a7b1-efde-4c14-95ea-dabf1b0d320d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:08.928536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ce4a7b1-efde-4c14-95ea-dabf1b0d320d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:08.932244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ce4a7b1-efde-4c14-95ea-dabf1b0d320d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:08.941270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ce4a7b1-efde-4c14-95ea-dabf1b0d320d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:08.945542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ce4a7b1-efde-4c14-95ea-dabf1b0d320d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:09.029417 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ed50d62a-ffaf-4807-baff-2979844f9589 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:09.062417 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ed50d62a-ffaf-4807-baff-2979844f9589 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1314 microversion: 2.1 time: 0.939983 Jul 25 12:56:09.062417 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1629/3315] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:08 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1314 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:56:09.427857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1ce4a7b1-efde-4c14-95ea-dabf1b0d320d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:09.437280 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1ce4a7b1-efde-4c14-95ea-dabf1b0d320d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1512 microversion: 2.1 time: 0.550294 Jul 25 12:56:09.461204 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1687/3316] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:08 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1512 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:56:09.504294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-d43dc50e-cc2e-4d34-be51-41cfca9da044 req-d979f8b4-22b7-4b01-ae56-3900da3d382d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "975ed5ee-8529-4421-b5ad-531e0caa8c16", "name": "network-vif-plugged", "status": "completed", "tag": "b6fb21e2-fc5b-4338-a202-037d4855ca52"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:09.556992 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d43dc50e-cc2e-4d34-be51-41cfca9da044 req-d979f8b4-22b7-4b01-ae56-3900da3d382d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:09.557546 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d43dc50e-cc2e-4d34-be51-41cfca9da044 req-d979f8b4-22b7-4b01-ae56-3900da3d382d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:09.633041 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-d43dc50e-cc2e-4d34-be51-41cfca9da044 req-d979f8b4-22b7-4b01-ae56-3900da3d382d service nova] Creating event network-vif-plugged:b6fb21e2-fc5b-4338-a202-037d4855ca52 for instance 975ed5ee-8529-4421-b5ad-531e0caa8c16 on n-h1-848886-15 Jul 25 12:56:09.683547 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-d43dc50e-cc2e-4d34-be51-41cfca9da044 req-d979f8b4-22b7-4b01-ae56-3900da3d382d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160610 Jul 25 12:56:09.684341 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1630/3317] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:56:09.754126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bfd69dd4-ecf1-4e44-bf2f-3506690b42df tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:09.759782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bfd69dd4-ecf1-4e44-bf2f-3506690b42df tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:09.786239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bfd69dd4-ecf1-4e44-bf2f-3506690b42df tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:09.793474 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bfd69dd4-ecf1-4e44-bf2f-3506690b42df tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:09.795161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bfd69dd4-ecf1-4e44-bf2f-3506690b42df tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:09.796067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bfd69dd4-ecf1-4e44-bf2f-3506690b42df tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:10.082523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6dad2377-6fd3-42fe-98d2-66ae8ee84a0c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:10.084536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6dad2377-6fd3-42fe-98d2-66ae8ee84a0c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:10.102397 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6dad2377-6fd3-42fe-98d2-66ae8ee84a0c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:10.103297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6dad2377-6fd3-42fe-98d2-66ae8ee84a0c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:10.104964 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6dad2377-6fd3-42fe-98d2-66ae8ee84a0c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:10.105637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6dad2377-6fd3-42fe-98d2-66ae8ee84a0c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:10.518937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bfd69dd4-ecf1-4e44-bf2f-3506690b42df tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:10.530956 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bfd69dd4-ecf1-4e44-bf2f-3506690b42df tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1515 microversion: 2.1 time: 0.789957 Jul 25 12:56:10.532388 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1688/3318] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:09 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1515 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:10.540839 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6c5c6029-d344-4a33-b2b7-0683caa4a24c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:10.542146 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6c5c6029-d344-4a33-b2b7-0683caa4a24c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:10.552163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c5c6029-d344-4a33-b2b7-0683caa4a24c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:10.553066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c5c6029-d344-4a33-b2b7-0683caa4a24c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:10.554367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c5c6029-d344-4a33-b2b7-0683caa4a24c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:10.555191 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c5c6029-d344-4a33-b2b7-0683caa4a24c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:11.015648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6dad2377-6fd3-42fe-98d2-66ae8ee84a0c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:11.031297 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6dad2377-6fd3-42fe-98d2-66ae8ee84a0c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1314 microversion: 2.1 time: 0.953397 Jul 25 12:56:11.038898 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1631/3319] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:10 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1314 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:11.148484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6c5c6029-d344-4a33-b2b7-0683caa4a24c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:11.192474 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6c5c6029-d344-4a33-b2b7-0683caa4a24c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1512 microversion: 2.1 time: 0.657520 Jul 25 12:56:11.208541 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1689/3320] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:10 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1512 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:11.565278 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4e9eb02c-acfc-499a-b779-a24947d73e44 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:11.566727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4e9eb02c-acfc-499a-b779-a24947d73e44 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:11.585595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e9eb02c-acfc-499a-b779-a24947d73e44 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:11.586411 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e9eb02c-acfc-499a-b779-a24947d73e44 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:11.587983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e9eb02c-acfc-499a-b779-a24947d73e44 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:11.588878 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e9eb02c-acfc-499a-b779-a24947d73e44 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:11.906309 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4e9eb02c-acfc-499a-b779-a24947d73e44 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:11.940316 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4e9eb02c-acfc-499a-b779-a24947d73e44 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1515 microversion: 2.1 time: 0.379117 Jul 25 12:56:11.941372 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1632/3321] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:11 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1515 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:12.057276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8339fa53-7ea0-4629-aa94-6359652caf48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:12.058379 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8339fa53-7ea0-4629-aa94-6359652caf48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:12.105930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8339fa53-7ea0-4629-aa94-6359652caf48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:12.106997 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8339fa53-7ea0-4629-aa94-6359652caf48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:12.111264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8339fa53-7ea0-4629-aa94-6359652caf48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:12.117811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8339fa53-7ea0-4629-aa94-6359652caf48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:12.173260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:12.215533 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a1c1a61d-6cad-42b2-b349-20639d221722 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:12.217149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a1c1a61d-6cad-42b2-b349-20639d221722 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:12.234127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a1c1a61d-6cad-42b2-b349-20639d221722 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:12.234593 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a1c1a61d-6cad-42b2-b349-20639d221722 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:12.235517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a1c1a61d-6cad-42b2-b349-20639d221722 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:12.235815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a1c1a61d-6cad-42b2-b349-20639d221722 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:12.567497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8339fa53-7ea0-4629-aa94-6359652caf48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:12.599786 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8339fa53-7ea0-4629-aa94-6359652caf48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1501 microversion: 2.1 time: 0.545508 Jul 25 12:56:12.631959 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1690/3322] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:12 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1501 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:12.642258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f464d150-0189-40cb-bf3c-f366b582cb97 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:12.650891 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a1c1a61d-6cad-42b2-b349-20639d221722 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:12.663306 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a1c1a61d-6cad-42b2-b349-20639d221722 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1512 microversion: 2.1 time: 0.452526 Jul 25 12:56:12.665024 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f464d150-0189-40cb-bf3c-f366b582cb97 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:12.671489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f464d150-0189-40cb-bf3c-f366b582cb97 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:12.677823 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1633/3323] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:12 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1512 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:12.859140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f464d150-0189-40cb-bf3c-f366b582cb97 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Going to try to stop instance {{(pid=125884) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 12:56:12.949242 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f464d150-0189-40cb-bf3c-f366b582cb97 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "POST /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16/action" status: 202 len: 0 microversion: 2.1 time: 0.315101 Jul 25 12:56:12.950386 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1691/3324] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:56:12 2022] POST /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:56:12.969532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-47dadbfe-8e09-4dd9-8c5b-6671703d1013 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:12.971710 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-47dadbfe-8e09-4dd9-8c5b-6671703d1013 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:12.982302 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bb846a8b-23ed-4178-93f6-35a67efb0204 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:12.983107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bb846a8b-23ed-4178-93f6-35a67efb0204 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:12.995127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bb846a8b-23ed-4178-93f6-35a67efb0204 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:12.995127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bb846a8b-23ed-4178-93f6-35a67efb0204 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:13.007307 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bb846a8b-23ed-4178-93f6-35a67efb0204 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:13.007878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bb846a8b-23ed-4178-93f6-35a67efb0204 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:13.020794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47dadbfe-8e09-4dd9-8c5b-6671703d1013 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:13.026209 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47dadbfe-8e09-4dd9-8c5b-6671703d1013 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:13.034273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47dadbfe-8e09-4dd9-8c5b-6671703d1013 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:13.038705 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47dadbfe-8e09-4dd9-8c5b-6671703d1013 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:13.640918 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bb846a8b-23ed-4178-93f6-35a67efb0204 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:13.651367 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bb846a8b-23ed-4178-93f6-35a67efb0204 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1515 microversion: 2.1 time: 0.674546 Jul 25 12:56:13.657431 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1692/3325] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:12 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1515 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:56:13.700256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e786db41-38f8-49f8-a353-e317972bec4b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:13.701484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e786db41-38f8-49f8-a353-e317972bec4b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:13.715265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-47dadbfe-8e09-4dd9-8c5b-6671703d1013 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:13.728106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e786db41-38f8-49f8-a353-e317972bec4b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:13.728885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e786db41-38f8-49f8-a353-e317972bec4b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:13.732608 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-47dadbfe-8e09-4dd9-8c5b-6671703d1013 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1511 microversion: 2.1 time: 0.777349 Jul 25 12:56:13.734536 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1634/3326] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:12 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1511 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:13.739955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e786db41-38f8-49f8-a353-e317972bec4b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:13.740810 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e786db41-38f8-49f8-a353-e317972bec4b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:14.176157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e786db41-38f8-49f8-a353-e317972bec4b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:14.184503 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e786db41-38f8-49f8-a353-e317972bec4b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1512 microversion: 2.1 time: 0.488110 Jul 25 12:56:14.185600 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1693/3327] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:13 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1512 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:14.687191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-326cbd5f-b70e-4258-ae9f-f2f1955e414c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:14.688476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-326cbd5f-b70e-4258-ae9f-f2f1955e414c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:14.712800 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-326cbd5f-b70e-4258-ae9f-f2f1955e414c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:14.716211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-326cbd5f-b70e-4258-ae9f-f2f1955e414c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:14.719543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-326cbd5f-b70e-4258-ae9f-f2f1955e414c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:14.720603 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-326cbd5f-b70e-4258-ae9f-f2f1955e414c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:14.761414 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4b6f8961-f489-41ae-898c-65e2adff07ba tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:14.762937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4b6f8961-f489-41ae-898c-65e2adff07ba tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:14.780708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4b6f8961-f489-41ae-898c-65e2adff07ba tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:14.784537 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4b6f8961-f489-41ae-898c-65e2adff07ba tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:14.787984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4b6f8961-f489-41ae-898c-65e2adff07ba tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:14.790190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4b6f8961-f489-41ae-898c-65e2adff07ba tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:14.809097 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:15.251303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4b6f8961-f489-41ae-898c-65e2adff07ba tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:15.271583 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4b6f8961-f489-41ae-898c-65e2adff07ba tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1511 microversion: 2.1 time: 0.514459 Jul 25 12:56:15.273265 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1694/3328] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:14 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1511 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:15.287714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-326cbd5f-b70e-4258-ae9f-f2f1955e414c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:15.291841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-379d8787-d3b4-4192-b265-9273988d0f11 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:15.292906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-379d8787-d3b4-4192-b265-9273988d0f11 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:15.301424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-379d8787-d3b4-4192-b265-9273988d0f11 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:15.302324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-379d8787-d3b4-4192-b265-9273988d0f11 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:15.303561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-379d8787-d3b4-4192-b265-9273988d0f11 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:15.304207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-379d8787-d3b4-4192-b265-9273988d0f11 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:15.311715 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-326cbd5f-b70e-4258-ae9f-f2f1955e414c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1515 microversion: 2.1 time: 0.627675 Jul 25 12:56:15.313208 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1635/3329] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:14 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1515 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:15.589191 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-379d8787-d3b4-4192-b265-9273988d0f11 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:15.602242 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-379d8787-d3b4-4192-b265-9273988d0f11 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1512 microversion: 2.1 time: 0.325235 Jul 25 12:56:15.604814 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1695/3330] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:15 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1512 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:16.310555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2636fb33-52ca-4bc7-bed5-8cbc1353f505 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:16.312434 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2636fb33-52ca-4bc7-bed5-8cbc1353f505 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:16.337911 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-590fcd9b-223c-481f-81ae-e30f3d80e2d0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:16.338648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-590fcd9b-223c-481f-81ae-e30f3d80e2d0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:16.357422 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2636fb33-52ca-4bc7-bed5-8cbc1353f505 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:16.358549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2636fb33-52ca-4bc7-bed5-8cbc1353f505 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:16.360096 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-590fcd9b-223c-481f-81ae-e30f3d80e2d0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:16.361405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-590fcd9b-223c-481f-81ae-e30f3d80e2d0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:16.365511 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-590fcd9b-223c-481f-81ae-e30f3d80e2d0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:16.366994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-590fcd9b-223c-481f-81ae-e30f3d80e2d0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:16.367137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2636fb33-52ca-4bc7-bed5-8cbc1353f505 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:16.367869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2636fb33-52ca-4bc7-bed5-8cbc1353f505 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:16.716152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2636fb33-52ca-4bc7-bed5-8cbc1353f505 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:16.725641 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2636fb33-52ca-4bc7-bed5-8cbc1353f505 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1511 microversion: 2.1 time: 0.430775 Jul 25 12:56:16.731659 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1636/3331] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:16 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1511 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:16.737448 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-429068b4-1f08-4f23-81b9-b35e1882137e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:16.741046 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-429068b4-1f08-4f23-81b9-b35e1882137e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:16.758471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-429068b4-1f08-4f23-81b9-b35e1882137e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:16.758776 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-590fcd9b-223c-481f-81ae-e30f3d80e2d0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:16.759044 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-429068b4-1f08-4f23-81b9-b35e1882137e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:16.760744 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-429068b4-1f08-4f23-81b9-b35e1882137e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:16.761296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-429068b4-1f08-4f23-81b9-b35e1882137e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:16.774412 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-590fcd9b-223c-481f-81ae-e30f3d80e2d0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1515 microversion: 2.1 time: 0.441451 Jul 25 12:56:16.778055 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1696/3332] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:16 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1515 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:17.000520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-429068b4-1f08-4f23-81b9-b35e1882137e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:17.016313 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-429068b4-1f08-4f23-81b9-b35e1882137e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1512 microversion: 2.1 time: 0.282798 Jul 25 12:56:17.018662 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1637/3333] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:16 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1512 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:17.752409 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cc36c899-decf-4b61-93cd-3734b6338576 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:17.753085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cc36c899-decf-4b61-93cd-3734b6338576 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:17.768255 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc36c899-decf-4b61-93cd-3734b6338576 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:17.768732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc36c899-decf-4b61-93cd-3734b6338576 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:17.769569 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc36c899-decf-4b61-93cd-3734b6338576 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:17.770492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc36c899-decf-4b61-93cd-3734b6338576 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:17.800788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a9a20f4c-ffff-4d02-ab74-94c99b994cc6 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:17.802989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a9a20f4c-ffff-4d02-ab74-94c99b994cc6 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:17.819274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9a20f4c-ffff-4d02-ab74-94c99b994cc6 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:17.819736 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9a20f4c-ffff-4d02-ab74-94c99b994cc6 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:17.820568 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9a20f4c-ffff-4d02-ab74-94c99b994cc6 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:17.820950 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9a20f4c-ffff-4d02-ab74-94c99b994cc6 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:18.127928 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a9a20f4c-ffff-4d02-ab74-94c99b994cc6 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:18.154588 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a9a20f4c-ffff-4d02-ab74-94c99b994cc6 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1515 microversion: 2.1 time: 0.358154 Jul 25 12:56:18.164140 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1638/3334] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:17 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1515 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:18.182980 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e3aa7505-e3ca-4c9c-a1be-8c8a426e87b2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:18.184620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e3aa7505-e3ca-4c9c-a1be-8c8a426e87b2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:18.194641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3aa7505-e3ca-4c9c-a1be-8c8a426e87b2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:18.195099 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3aa7505-e3ca-4c9c-a1be-8c8a426e87b2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:18.196114 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3aa7505-e3ca-4c9c-a1be-8c8a426e87b2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:18.196781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3aa7505-e3ca-4c9c-a1be-8c8a426e87b2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:18.555223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e3aa7505-e3ca-4c9c-a1be-8c8a426e87b2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:18.577746 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e3aa7505-e3ca-4c9c-a1be-8c8a426e87b2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1512 microversion: 2.1 time: 0.409639 Jul 25 12:56:18.584524 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1639/3335] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:18 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1512 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:18.679852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cc36c899-decf-4b61-93cd-3734b6338576 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:18.695242 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cc36c899-decf-4b61-93cd-3734b6338576 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1511 microversion: 2.1 time: 0.947860 Jul 25 12:56:18.697433 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1697/3336] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:17 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1511 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:19.190592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-64190c39-83b8-462c-a0f0-19bd07ec54ed tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:19.191472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-64190c39-83b8-462c-a0f0-19bd07ec54ed tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:19.207536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-64190c39-83b8-462c-a0f0-19bd07ec54ed tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:19.208187 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-64190c39-83b8-462c-a0f0-19bd07ec54ed tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:19.210246 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-64190c39-83b8-462c-a0f0-19bd07ec54ed tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:19.215822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-64190c39-83b8-462c-a0f0-19bd07ec54ed tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:19.481362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-64190c39-83b8-462c-a0f0-19bd07ec54ed tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:19.491337 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-64190c39-83b8-462c-a0f0-19bd07ec54ed tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1515 microversion: 2.1 time: 0.305924 Jul 25 12:56:19.492579 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1640/3337] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:19 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1515 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:19.620940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4b07f622-7b52-4cbc-b8d6-63930faa1751 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:19.622268 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4b07f622-7b52-4cbc-b8d6-63930faa1751 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:19.639673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4b07f622-7b52-4cbc-b8d6-63930faa1751 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:19.640124 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4b07f622-7b52-4cbc-b8d6-63930faa1751 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:19.643344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4b07f622-7b52-4cbc-b8d6-63930faa1751 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:19.643789 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4b07f622-7b52-4cbc-b8d6-63930faa1751 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:19.720791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d4a6656d-e93a-4d84-8373-6167f4d719fe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:19.725369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d4a6656d-e93a-4d84-8373-6167f4d719fe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:19.737684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4a6656d-e93a-4d84-8373-6167f4d719fe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:19.738166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4a6656d-e93a-4d84-8373-6167f4d719fe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:19.738986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4a6656d-e93a-4d84-8373-6167f4d719fe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:19.739421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4a6656d-e93a-4d84-8373-6167f4d719fe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:20.002006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4b07f622-7b52-4cbc-b8d6-63930faa1751 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:20.015776 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4b07f622-7b52-4cbc-b8d6-63930faa1751 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1512 microversion: 2.1 time: 0.402806 Jul 25 12:56:20.029587 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d4a6656d-e93a-4d84-8373-6167f4d719fe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:20.031501 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1698/3338] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:19 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1512 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:20.040187 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d4a6656d-e93a-4d84-8373-6167f4d719fe tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1511 microversion: 2.1 time: 0.323790 Jul 25 12:56:20.041635 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1641/3339] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:19 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1511 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:56:20.513337 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-50b349f2-cfd4-4a1c-a602-bbc378dc3f48 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:20.514434 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-50b349f2-cfd4-4a1c-a602-bbc378dc3f48 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:20.523288 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50b349f2-cfd4-4a1c-a602-bbc378dc3f48 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:20.523891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50b349f2-cfd4-4a1c-a602-bbc378dc3f48 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:20.525029 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50b349f2-cfd4-4a1c-a602-bbc378dc3f48 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:20.525701 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50b349f2-cfd4-4a1c-a602-bbc378dc3f48 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:20.756259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-50b349f2-cfd4-4a1c-a602-bbc378dc3f48 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:20.767998 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-50b349f2-cfd4-4a1c-a602-bbc378dc3f48 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1515 microversion: 2.1 time: 0.259361 Jul 25 12:56:20.777895 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1699/3340] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:20 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1515 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:21.041238 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ce979a71-a925-411c-bcd0-c4ab41ae8468 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:21.042046 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ce979a71-a925-411c-bcd0-c4ab41ae8468 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:21.051116 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ce979a71-a925-411c-bcd0-c4ab41ae8468 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:21.053443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ce979a71-a925-411c-bcd0-c4ab41ae8468 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:21.054341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ce979a71-a925-411c-bcd0-c4ab41ae8468 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:21.055296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ce979a71-a925-411c-bcd0-c4ab41ae8468 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:21.069514 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1b42d14b-019c-47b8-8717-8337206f03c7 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:21.070809 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1b42d14b-019c-47b8-8717-8337206f03c7 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:21.081742 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b42d14b-019c-47b8-8717-8337206f03c7 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:21.083206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b42d14b-019c-47b8-8717-8337206f03c7 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:21.085980 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b42d14b-019c-47b8-8717-8337206f03c7 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:21.087507 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b42d14b-019c-47b8-8717-8337206f03c7 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:21.299394 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ce979a71-a925-411c-bcd0-c4ab41ae8468 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:21.310526 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ce979a71-a925-411c-bcd0-c4ab41ae8468 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1512 microversion: 2.1 time: 0.273594 Jul 25 12:56:21.311148 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1642/3341] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:21 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1512 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:21.403945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1b42d14b-019c-47b8-8717-8337206f03c7 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:21.415602 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1b42d14b-019c-47b8-8717-8337206f03c7 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1511 microversion: 2.1 time: 0.351781 Jul 25 12:56:21.416569 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1700/3342] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:21 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1511 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:21.809016 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0be02c9a-0096-46e7-8d23-17e7c28fbbbe tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:21.809709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0be02c9a-0096-46e7-8d23-17e7c28fbbbe tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:21.822403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0be02c9a-0096-46e7-8d23-17e7c28fbbbe tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:21.822971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0be02c9a-0096-46e7-8d23-17e7c28fbbbe tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:21.825235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0be02c9a-0096-46e7-8d23-17e7c28fbbbe tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:21.825598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0be02c9a-0096-46e7-8d23-17e7c28fbbbe tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:22.082401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0be02c9a-0096-46e7-8d23-17e7c28fbbbe tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:22.097575 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0be02c9a-0096-46e7-8d23-17e7c28fbbbe tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1515 microversion: 2.1 time: 0.292871 Jul 25 12:56:22.098794 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1643/3343] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:21 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1515 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:22.334788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f062d9f4-0d80-4c56-b197-7a53643eb5c5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:22.334788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f062d9f4-0d80-4c56-b197-7a53643eb5c5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:22.340773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:22.342898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f062d9f4-0d80-4c56-b197-7a53643eb5c5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:22.343561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f062d9f4-0d80-4c56-b197-7a53643eb5c5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:22.344348 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f062d9f4-0d80-4c56-b197-7a53643eb5c5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:22.345072 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f062d9f4-0d80-4c56-b197-7a53643eb5c5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:22.447384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-771e13e1-6706-4658-b837-b929d67cf72c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:22.448039 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-771e13e1-6706-4658-b837-b929d67cf72c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:22.455446 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-771e13e1-6706-4658-b837-b929d67cf72c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:22.456159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-771e13e1-6706-4658-b837-b929d67cf72c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:22.456954 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-771e13e1-6706-4658-b837-b929d67cf72c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:22.457398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-771e13e1-6706-4658-b837-b929d67cf72c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:22.561453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f062d9f4-0d80-4c56-b197-7a53643eb5c5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:22.573960 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f062d9f4-0d80-4c56-b197-7a53643eb5c5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1512 microversion: 2.1 time: 0.245800 Jul 25 12:56:22.589958 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1701/3344] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:22 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1512 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:22.683031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-771e13e1-6706-4658-b837-b929d67cf72c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:22.691627 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-771e13e1-6706-4658-b837-b929d67cf72c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1511 microversion: 2.1 time: 0.256369 Jul 25 12:56:22.692240 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1644/3345] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:22 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1511 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:56:23.132773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d4587207-eaff-4b75-a7e4-2ddd1e2a7fe5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:23.133977 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d4587207-eaff-4b75-a7e4-2ddd1e2a7fe5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:23.143824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d4587207-eaff-4b75-a7e4-2ddd1e2a7fe5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:23.144690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d4587207-eaff-4b75-a7e4-2ddd1e2a7fe5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:23.145763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d4587207-eaff-4b75-a7e4-2ddd1e2a7fe5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:23.146462 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d4587207-eaff-4b75-a7e4-2ddd1e2a7fe5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:23.349689 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d4587207-eaff-4b75-a7e4-2ddd1e2a7fe5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:23.360846 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d4587207-eaff-4b75-a7e4-2ddd1e2a7fe5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1515 microversion: 2.1 time: 0.240388 Jul 25 12:56:23.378737 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1702/3346] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:23 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1515 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:23.598093 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2a1ac1d2-b247-416f-94a0-2db64da5da40 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:23.600610 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2a1ac1d2-b247-416f-94a0-2db64da5da40 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:23.612436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2a1ac1d2-b247-416f-94a0-2db64da5da40 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:23.613284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2a1ac1d2-b247-416f-94a0-2db64da5da40 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:23.614782 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2a1ac1d2-b247-416f-94a0-2db64da5da40 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:23.615644 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2a1ac1d2-b247-416f-94a0-2db64da5da40 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:23.718392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-87f922c5-f2ee-4768-babf-125b128e6612 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:23.719032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-87f922c5-f2ee-4768-babf-125b128e6612 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:23.736370 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87f922c5-f2ee-4768-babf-125b128e6612 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:23.736658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87f922c5-f2ee-4768-babf-125b128e6612 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:23.737500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87f922c5-f2ee-4768-babf-125b128e6612 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:23.743246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87f922c5-f2ee-4768-babf-125b128e6612 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:23.943875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2a1ac1d2-b247-416f-94a0-2db64da5da40 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:23.954240 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2a1ac1d2-b247-416f-94a0-2db64da5da40 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1512 microversion: 2.1 time: 0.361849 Jul 25 12:56:23.970700 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1645/3347] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:23 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1512 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:24.052208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-87f922c5-f2ee-4768-babf-125b128e6612 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:24.064965 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-87f922c5-f2ee-4768-babf-125b128e6612 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1511 microversion: 2.1 time: 0.350552 Jul 25 12:56:24.065650 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1703/3348] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:23 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1511 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:24.386367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-531979b3-7ff5-4722-9fa5-c5241c2a7949 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:24.389365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-531979b3-7ff5-4722-9fa5-c5241c2a7949 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:24.399603 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-531979b3-7ff5-4722-9fa5-c5241c2a7949 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:24.400067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-531979b3-7ff5-4722-9fa5-c5241c2a7949 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:24.401215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-531979b3-7ff5-4722-9fa5-c5241c2a7949 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:24.401710 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-531979b3-7ff5-4722-9fa5-c5241c2a7949 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:24.628958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-531979b3-7ff5-4722-9fa5-c5241c2a7949 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:24.638713 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-531979b3-7ff5-4722-9fa5-c5241c2a7949 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1515 microversion: 2.1 time: 0.256770 Jul 25 12:56:24.643219 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1646/3349] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:24 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1515 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:24.976939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4e27b3ba-b374-47db-a4f2-73ef4d76cceb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:24.977560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4e27b3ba-b374-47db-a4f2-73ef4d76cceb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:24.991393 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e27b3ba-b374-47db-a4f2-73ef4d76cceb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:24.991959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e27b3ba-b374-47db-a4f2-73ef4d76cceb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:24.992916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e27b3ba-b374-47db-a4f2-73ef4d76cceb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:24.994840 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e27b3ba-b374-47db-a4f2-73ef4d76cceb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:25.088662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-74d62347-b6bd-43bd-87d6-81a1e2fdb116 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:25.089651 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-74d62347-b6bd-43bd-87d6-81a1e2fdb116 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:25.092041 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=70 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:25.098103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74d62347-b6bd-43bd-87d6-81a1e2fdb116 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:25.098791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74d62347-b6bd-43bd-87d6-81a1e2fdb116 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:25.099823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74d62347-b6bd-43bd-87d6-81a1e2fdb116 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:25.100429 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74d62347-b6bd-43bd-87d6-81a1e2fdb116 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:25.460019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-74d62347-b6bd-43bd-87d6-81a1e2fdb116 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:25.471390 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-74d62347-b6bd-43bd-87d6-81a1e2fdb116 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1511 microversion: 2.1 time: 0.387788 Jul 25 12:56:25.476538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4e27b3ba-b374-47db-a4f2-73ef4d76cceb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:25.477052 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1647/3350] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:25 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1511 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:25.521595 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4e27b3ba-b374-47db-a4f2-73ef4d76cceb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1512 microversion: 2.1 time: 0.548348 Jul 25 12:56:25.523607 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1704/3351] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:24 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1512 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:25.662373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f6191044-ad57-4769-bf3c-3f70c56b85cd tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:25.663224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f6191044-ad57-4769-bf3c-3f70c56b85cd tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:25.676948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f6191044-ad57-4769-bf3c-3f70c56b85cd tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:25.677405 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f6191044-ad57-4769-bf3c-3f70c56b85cd tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:25.678224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f6191044-ad57-4769-bf3c-3f70c56b85cd tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:25.678664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f6191044-ad57-4769-bf3c-3f70c56b85cd tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:26.013235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f6191044-ad57-4769-bf3c-3f70c56b85cd tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:26.025707 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f6191044-ad57-4769-bf3c-3f70c56b85cd tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1515 microversion: 2.1 time: 0.367672 Jul 25 12:56:26.026603 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1648/3352] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:25 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1515 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:26.506528 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e4fb5edd-abd3-4593-b893-6d3d73299bc1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:26.508996 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e4fb5edd-abd3-4593-b893-6d3d73299bc1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:26.545988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-62e5f4e7-a3e5-4b12-8ec7-3af3cd5aa3ac tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:26.546747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-62e5f4e7-a3e5-4b12-8ec7-3af3cd5aa3ac tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:26.559467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4fb5edd-abd3-4593-b893-6d3d73299bc1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:26.560278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4fb5edd-abd3-4593-b893-6d3d73299bc1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:26.561542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4fb5edd-abd3-4593-b893-6d3d73299bc1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:26.561957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62e5f4e7-a3e5-4b12-8ec7-3af3cd5aa3ac tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:26.562196 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4fb5edd-abd3-4593-b893-6d3d73299bc1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:26.563354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62e5f4e7-a3e5-4b12-8ec7-3af3cd5aa3ac tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:26.564198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62e5f4e7-a3e5-4b12-8ec7-3af3cd5aa3ac tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:26.564637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62e5f4e7-a3e5-4b12-8ec7-3af3cd5aa3ac tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:26.908700 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-62e5f4e7-a3e5-4b12-8ec7-3af3cd5aa3ac tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:26.929070 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e4fb5edd-abd3-4593-b893-6d3d73299bc1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:26.932278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:26.953170 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-62e5f4e7-a3e5-4b12-8ec7-3af3cd5aa3ac tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1512 microversion: 2.1 time: 0.409146 Jul 25 12:56:26.955312 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1649/3353] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:26 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1512 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:26.967458 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e4fb5edd-abd3-4593-b893-6d3d73299bc1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1511 microversion: 2.1 time: 0.468521 Jul 25 12:56:26.967458 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1705/3354] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:26 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1511 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:27.069392 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-77ac12ca-d720-4243-b151-c12a96962fa9 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:27.070694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-77ac12ca-d720-4243-b151-c12a96962fa9 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:27.078447 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77ac12ca-d720-4243-b151-c12a96962fa9 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:27.078912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77ac12ca-d720-4243-b151-c12a96962fa9 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:27.080261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77ac12ca-d720-4243-b151-c12a96962fa9 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:27.080891 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77ac12ca-d720-4243-b151-c12a96962fa9 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:27.329663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-77ac12ca-d720-4243-b151-c12a96962fa9 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:27.339525 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-77ac12ca-d720-4243-b151-c12a96962fa9 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1515 microversion: 2.1 time: 0.274078 Jul 25 12:56:27.340130 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1650/3355] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:27 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1515 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:27.987696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7adcb366-d027-4cd5-a577-765c330f7c6c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:27.990258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7adcb366-d027-4cd5-a577-765c330f7c6c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:27.991172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3fd2bcc2-f85b-4e5b-87eb-d7a50a627298 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:27.992181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3fd2bcc2-f85b-4e5b-87eb-d7a50a627298 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:28.003214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7adcb366-d027-4cd5-a577-765c330f7c6c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:28.007823 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7adcb366-d027-4cd5-a577-765c330f7c6c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:28.009115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7adcb366-d027-4cd5-a577-765c330f7c6c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:28.010176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7adcb366-d027-4cd5-a577-765c330f7c6c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:28.012442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3fd2bcc2-f85b-4e5b-87eb-d7a50a627298 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:28.013041 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3fd2bcc2-f85b-4e5b-87eb-d7a50a627298 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:28.017296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3fd2bcc2-f85b-4e5b-87eb-d7a50a627298 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:28.018206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3fd2bcc2-f85b-4e5b-87eb-d7a50a627298 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:28.381256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7adcb366-d027-4cd5-a577-765c330f7c6c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:28.394433 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7adcb366-d027-4cd5-a577-765c330f7c6c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1512 microversion: 2.1 time: 0.412195 Jul 25 12:56:28.397429 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1706/3356] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:27 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1512 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:28.402720 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-92274be2-24f9-4508-8033-faa55d62a046 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:28.418914 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-92274be2-24f9-4508-8033-faa55d62a046 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:28.439584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-92274be2-24f9-4508-8033-faa55d62a046 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:28.440558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-92274be2-24f9-4508-8033-faa55d62a046 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:28.445394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-92274be2-24f9-4508-8033-faa55d62a046 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:28.446131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-92274be2-24f9-4508-8033-faa55d62a046 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:28.604717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3fd2bcc2-f85b-4e5b-87eb-d7a50a627298 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:28.629260 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3fd2bcc2-f85b-4e5b-87eb-d7a50a627298 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1511 microversion: 2.1 time: 0.643293 Jul 25 12:56:28.631287 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1651/3357] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:27 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1511 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:28.824245 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-92274be2-24f9-4508-8033-faa55d62a046 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:28.837697 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-92274be2-24f9-4508-8033-faa55d62a046 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1515 microversion: 2.1 time: 0.437275 Jul 25 12:56:28.838384 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1707/3358] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:28 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1515 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:29.424755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2d2454a1-f5e4-4ed2-9218-9d66e1bebafa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:29.426437 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2d2454a1-f5e4-4ed2-9218-9d66e1bebafa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:29.435710 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d2454a1-f5e4-4ed2-9218-9d66e1bebafa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:29.436769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d2454a1-f5e4-4ed2-9218-9d66e1bebafa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:29.437810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d2454a1-f5e4-4ed2-9218-9d66e1bebafa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:29.438506 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d2454a1-f5e4-4ed2-9218-9d66e1bebafa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:29.442278 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:29.655947 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3aa3528a-5d76-4658-846d-ac897b31db28 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:29.657626 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3aa3528a-5d76-4658-846d-ac897b31db28 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:29.672574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3aa3528a-5d76-4658-846d-ac897b31db28 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:29.674361 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3aa3528a-5d76-4658-846d-ac897b31db28 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:29.676526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3aa3528a-5d76-4658-846d-ac897b31db28 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:29.677399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3aa3528a-5d76-4658-846d-ac897b31db28 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:29.708864 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2d2454a1-f5e4-4ed2-9218-9d66e1bebafa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:29.729874 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2d2454a1-f5e4-4ed2-9218-9d66e1bebafa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1512 microversion: 2.1 time: 0.312877 Jul 25 12:56:29.731902 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1652/3359] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:29 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1512 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:29.860915 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-12ab2c96-f724-4de3-b9c9-53f1a1b34833 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:29.861589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-12ab2c96-f724-4de3-b9c9-53f1a1b34833 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:29.873250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12ab2c96-f724-4de3-b9c9-53f1a1b34833 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:29.873732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12ab2c96-f724-4de3-b9c9-53f1a1b34833 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:29.874581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12ab2c96-f724-4de3-b9c9-53f1a1b34833 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:29.878221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12ab2c96-f724-4de3-b9c9-53f1a1b34833 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:29.933486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3aa3528a-5d76-4658-846d-ac897b31db28 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:29.943072 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3aa3528a-5d76-4658-846d-ac897b31db28 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1511 microversion: 2.1 time: 0.291425 Jul 25 12:56:29.944679 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1708/3360] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:29 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1511 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:30.129985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-12ab2c96-f724-4de3-b9c9-53f1a1b34833 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:30.147985 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-12ab2c96-f724-4de3-b9c9-53f1a1b34833 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1515 microversion: 2.1 time: 0.291013 Jul 25 12:56:30.148923 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1653/3361] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:29 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1515 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:30.757779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cb299af5-d502-46ba-a347-a0228dde0ef9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:30.758713 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cb299af5-d502-46ba-a347-a0228dde0ef9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:30.767640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb299af5-d502-46ba-a347-a0228dde0ef9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:30.768372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb299af5-d502-46ba-a347-a0228dde0ef9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:30.769608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb299af5-d502-46ba-a347-a0228dde0ef9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:30.770269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb299af5-d502-46ba-a347-a0228dde0ef9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:30.950428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cb299af5-d502-46ba-a347-a0228dde0ef9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:30.950428 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cb299af5-d502-46ba-a347-a0228dde0ef9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1512 microversion: 2.1 time: 0.198144 Jul 25 12:56:30.950428 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1709/3362] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:30 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1512 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:30.971672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-47f4508f-2e22-42c7-a406-b8bee57a5d31 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:30.972286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-47f4508f-2e22-42c7-a406-b8bee57a5d31 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:30.980371 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47f4508f-2e22-42c7-a406-b8bee57a5d31 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:30.980832 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47f4508f-2e22-42c7-a406-b8bee57a5d31 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:30.981621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47f4508f-2e22-42c7-a406-b8bee57a5d31 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:30.982081 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47f4508f-2e22-42c7-a406-b8bee57a5d31 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:31.166952 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-47f4508f-2e22-42c7-a406-b8bee57a5d31 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:31.172565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8d4ab5a3-d17a-42f4-93e0-0ac8c44bd29c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:31.173619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8d4ab5a3-d17a-42f4-93e0-0ac8c44bd29c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:31.178177 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-47f4508f-2e22-42c7-a406-b8bee57a5d31 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1511 microversion: 2.1 time: 0.210715 Jul 25 12:56:31.189855 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1654/3363] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:30 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1511 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:56:31.190310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d4ab5a3-d17a-42f4-93e0-0ac8c44bd29c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:31.190310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d4ab5a3-d17a-42f4-93e0-0ac8c44bd29c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:31.190310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d4ab5a3-d17a-42f4-93e0-0ac8c44bd29c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:31.190310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d4ab5a3-d17a-42f4-93e0-0ac8c44bd29c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:31.354017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8d4ab5a3-d17a-42f4-93e0-0ac8c44bd29c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:31.364740 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8d4ab5a3-d17a-42f4-93e0-0ac8c44bd29c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1515 microversion: 2.1 time: 0.198706 Jul 25 12:56:31.365273 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1710/3364] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:31 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1515 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:31.976568 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-45fce082-5c9c-431a-97c9-1c4ef32d9cf2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:31.980007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-45fce082-5c9c-431a-97c9-1c4ef32d9cf2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:31.992604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-45fce082-5c9c-431a-97c9-1c4ef32d9cf2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:31.993847 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-45fce082-5c9c-431a-97c9-1c4ef32d9cf2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:31.996053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-45fce082-5c9c-431a-97c9-1c4ef32d9cf2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:31.996783 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-45fce082-5c9c-431a-97c9-1c4ef32d9cf2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:32.202094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6c7819e6-5012-4dbb-bb56-a63fe6d630fb tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:32.202845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6c7819e6-5012-4dbb-bb56-a63fe6d630fb tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:32.219152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c7819e6-5012-4dbb-bb56-a63fe6d630fb tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:32.219615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c7819e6-5012-4dbb-bb56-a63fe6d630fb tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:32.220583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c7819e6-5012-4dbb-bb56-a63fe6d630fb tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:32.221019 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c7819e6-5012-4dbb-bb56-a63fe6d630fb tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:32.301350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-45fce082-5c9c-431a-97c9-1c4ef32d9cf2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:32.311046 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-45fce082-5c9c-431a-97c9-1c4ef32d9cf2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1489 microversion: 2.1 time: 0.342529 Jul 25 12:56:32.312424 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1655/3365] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:31 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1489 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:56:32.337083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b4b14b97-747e-4f22-99c1-d8caaa31dc77 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:32.340315 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b4b14b97-747e-4f22-99c1-d8caaa31dc77 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:32.350257 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4b14b97-747e-4f22-99c1-d8caaa31dc77 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:32.351138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4b14b97-747e-4f22-99c1-d8caaa31dc77 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:32.352185 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4b14b97-747e-4f22-99c1-d8caaa31dc77 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:32.352842 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4b14b97-747e-4f22-99c1-d8caaa31dc77 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:32.415059 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b4b14b97-747e-4f22-99c1-d8caaa31dc77 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action" status: 200 len: 148 microversion: 2.1 time: 0.082412 Jul 25 12:56:32.420936 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1656/3366] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:56:32 2022] POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action => generated 148 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:56:32.436021 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-01f9649c-6477-41f3-ad2f-2e6e724daaf0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:32.436756 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-01f9649c-6477-41f3-ad2f-2e6e724daaf0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:32.451438 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01f9649c-6477-41f3-ad2f-2e6e724daaf0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:32.452863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01f9649c-6477-41f3-ad2f-2e6e724daaf0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:32.455484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01f9649c-6477-41f3-ad2f-2e6e724daaf0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:32.456893 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01f9649c-6477-41f3-ad2f-2e6e724daaf0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:33.284709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-01f9649c-6477-41f3-ad2f-2e6e724daaf0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:33.297879 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-01f9649c-6477-41f3-ad2f-2e6e724daaf0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1515 microversion: 2.1 time: 0.874753 Jul 25 12:56:33.298484 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1657/3367] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:32 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1515 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:33.309561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6c7819e6-5012-4dbb-bb56-a63fe6d630fb tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:33.318142 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6c7819e6-5012-4dbb-bb56-a63fe6d630fb tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1511 microversion: 2.1 time: 1.120466 Jul 25 12:56:33.331901 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1711/3368] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:32 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1511 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:56:33.332475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dcc2f642-0ba0-404e-8f17-03b803ae1d71 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:33.332475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dcc2f642-0ba0-404e-8f17-03b803ae1d71 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:33.339942 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dcc2f642-0ba0-404e-8f17-03b803ae1d71 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:33.340482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dcc2f642-0ba0-404e-8f17-03b803ae1d71 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:33.341327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dcc2f642-0ba0-404e-8f17-03b803ae1d71 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:33.341327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dcc2f642-0ba0-404e-8f17-03b803ae1d71 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:33.682694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dcc2f642-0ba0-404e-8f17-03b803ae1d71 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:33.695800 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dcc2f642-0ba0-404e-8f17-03b803ae1d71 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.395999 Jul 25 12:56:33.717821 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1658/3369] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:33 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:33.734534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9ca9a19a-741a-40ed-9eb3-597d3bc54c43 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:33.735154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9ca9a19a-741a-40ed-9eb3-597d3bc54c43 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:33.743320 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ca9a19a-741a-40ed-9eb3-597d3bc54c43 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:33.743772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ca9a19a-741a-40ed-9eb3-597d3bc54c43 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:33.744602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ca9a19a-741a-40ed-9eb3-597d3bc54c43 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:33.745102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ca9a19a-741a-40ed-9eb3-597d3bc54c43 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:33.972898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9ca9a19a-741a-40ed-9eb3-597d3bc54c43 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:33.983252 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9ca9a19a-741a-40ed-9eb3-597d3bc54c43 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.253111 Jul 25 12:56:33.985474 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1712/3370] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:33 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:56:34.022758 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-789f69bd-d83b-4c8d-920d-0ea666b32fcb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:34.023587 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-789f69bd-d83b-4c8d-920d-0ea666b32fcb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:34.039470 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-789f69bd-d83b-4c8d-920d-0ea666b32fcb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:34.039929 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-789f69bd-d83b-4c8d-920d-0ea666b32fcb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:34.040712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-789f69bd-d83b-4c8d-920d-0ea666b32fcb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:34.041364 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-789f69bd-d83b-4c8d-920d-0ea666b32fcb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:34.321867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-371d7d70-0e89-43d1-b00b-1b419fb05f60 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:34.322616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-371d7d70-0e89-43d1-b00b-1b419fb05f60 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:34.346027 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-371d7d70-0e89-43d1-b00b-1b419fb05f60 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:34.346569 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-371d7d70-0e89-43d1-b00b-1b419fb05f60 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:34.347371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-371d7d70-0e89-43d1-b00b-1b419fb05f60 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:34.347799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-371d7d70-0e89-43d1-b00b-1b419fb05f60 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:34.382022 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-789f69bd-d83b-4c8d-920d-0ea666b32fcb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:34.391771 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-789f69bd-d83b-4c8d-920d-0ea666b32fcb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.374558 Jul 25 12:56:34.397887 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1659/3371] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:34 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:34.408812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c8d1363b-450b-4b35-9c3f-e5393991f02a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:34.418211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c8d1363b-450b-4b35-9c3f-e5393991f02a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:34.445600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8d1363b-450b-4b35-9c3f-e5393991f02a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:34.446748 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8d1363b-450b-4b35-9c3f-e5393991f02a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:34.448466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8d1363b-450b-4b35-9c3f-e5393991f02a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:34.449484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8d1363b-450b-4b35-9c3f-e5393991f02a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:34.730520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-371d7d70-0e89-43d1-b00b-1b419fb05f60 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:34.740391 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-371d7d70-0e89-43d1-b00b-1b419fb05f60 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1515 microversion: 2.1 time: 0.423128 Jul 25 12:56:34.740997 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1713/3372] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:34 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1515 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:34.767743 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fdb62527-9557-4cd1-b74f-91b2197c09a7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:34.771355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fdb62527-9557-4cd1-b74f-91b2197c09a7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:34.789287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fdb62527-9557-4cd1-b74f-91b2197c09a7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:34.790126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fdb62527-9557-4cd1-b74f-91b2197c09a7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:34.791141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fdb62527-9557-4cd1-b74f-91b2197c09a7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:34.794085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fdb62527-9557-4cd1-b74f-91b2197c09a7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:34.816898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c8d1363b-450b-4b35-9c3f-e5393991f02a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:34.840967 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c8d1363b-450b-4b35-9c3f-e5393991f02a tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1511 microversion: 2.1 time: 0.441497 Jul 25 12:56:34.842098 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1660/3373] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:34 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1511 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:35.182695 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fdb62527-9557-4cd1-b74f-91b2197c09a7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:35.208132 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fdb62527-9557-4cd1-b74f-91b2197c09a7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.461789 Jul 25 12:56:35.210978 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1714/3374] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:34 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:35.417614 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a14dab68-8243-4745-b472-44d6e9f8021f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-413517461", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "f9bdc019-d9ba-4dd9-9e23-b909e49f2c93"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:35.551897 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-a14dab68-8243-4745-b472-44d6e9f8021f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] validate_networks() for [('f9bdc019-d9ba-4dd9-9e23-b909e49f2c93', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:56:35.772915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-efa44f3d-be0e-4bba-bdc1-c2bbcde6b04a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:35.774192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-efa44f3d-be0e-4bba-bdc1-c2bbcde6b04a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:35.793949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-efa44f3d-be0e-4bba-bdc1-c2bbcde6b04a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:35.794734 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-efa44f3d-be0e-4bba-bdc1-c2bbcde6b04a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:35.795897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-efa44f3d-be0e-4bba-bdc1-c2bbcde6b04a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:35.797395 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-efa44f3d-be0e-4bba-bdc1-c2bbcde6b04a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:36.185929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-efa44f3d-be0e-4bba-bdc1-c2bbcde6b04a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:36.194021 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-efa44f3d-be0e-4bba-bdc1-c2bbcde6b04a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1515 microversion: 2.1 time: 0.428823 Jul 25 12:56:36.197751 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1715/3375] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:35 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1515 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:36.203054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a322aafa-d1c8-47e8-b5fb-f1f579993983 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:36.204691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a322aafa-d1c8-47e8-b5fb-f1f579993983 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:36.215139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a322aafa-d1c8-47e8-b5fb-f1f579993983 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:36.216099 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a322aafa-d1c8-47e8-b5fb-f1f579993983 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:36.217551 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a322aafa-d1c8-47e8-b5fb-f1f579993983 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:36.218851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a322aafa-d1c8-47e8-b5fb-f1f579993983 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:36.453855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a322aafa-d1c8-47e8-b5fb-f1f579993983 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:36.464026 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a322aafa-d1c8-47e8-b5fb-f1f579993983 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1511 microversion: 2.1 time: 0.264730 Jul 25 12:56:36.467033 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1716/3376] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:36 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1511 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:36.476067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-a14dab68-8243-4745-b472-44d6e9f8021f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:56:36.476810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-a14dab68-8243-4745-b472-44d6e9f8021f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:56:36.477296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-a14dab68-8243-4745-b472-44d6e9f8021f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:56:36.477707 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-a14dab68-8243-4745-b472-44d6e9f8021f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:56:36.478155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-a14dab68-8243-4745-b472-44d6e9f8021f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:56:36.488200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a14dab68-8243-4745-b472-44d6e9f8021f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:36.488652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a14dab68-8243-4745-b472-44d6e9f8021f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:36.489450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a14dab68-8243-4745-b472-44d6e9f8021f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:36.489912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a14dab68-8243-4745-b472-44d6e9f8021f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:36.510767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-a14dab68-8243-4745-b472-44d6e9f8021f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Getting quotas for project b5abf45c9ba0419c8dec07847f3ff3c5. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:56:36.516759 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-a14dab68-8243-4745-b472-44d6e9f8021f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Getting quotas for user 4d492d20a4864908a81902f86468d437 and project b5abf45c9ba0419c8dec07847f3ff3c5. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:56:36.543218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a14dab68-8243-4745-b472-44d6e9f8021f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:56:36.545534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a14dab68-8243-4745-b472-44d6e9f8021f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:56:36.655293 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a14dab68-8243-4745-b472-44d6e9f8021f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.241899 Jul 25 12:56:36.655990 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1661/3377] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:56:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:56:36.667631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-24181f5d-c30c-4f98-b29a-969ddf1f7d4b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:36.668671 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-24181f5d-c30c-4f98-b29a-969ddf1f7d4b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:36.787946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-24181f5d-c30c-4f98-b29a-969ddf1f7d4b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:36.810709 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-24181f5d-c30c-4f98-b29a-969ddf1f7d4b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a" status: 200 len: 1214 microversion: 2.1 time: 0.146742 Jul 25 12:56:36.812666 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1717/3378] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:36 2022] GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a => generated 1214 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:37.232709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-735f69b9-a62d-4371-a10d-8869db03adfb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:37.233762 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-735f69b9-a62d-4371-a10d-8869db03adfb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:37.272515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-735f69b9-a62d-4371-a10d-8869db03adfb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:37.276592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-735f69b9-a62d-4371-a10d-8869db03adfb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:37.281077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-735f69b9-a62d-4371-a10d-8869db03adfb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:37.282899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-735f69b9-a62d-4371-a10d-8869db03adfb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:37.497918 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-adfa0604-a357-4ebe-bf53-0d3820f92c93 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:37.506646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-adfa0604-a357-4ebe-bf53-0d3820f92c93 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:37.547838 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-adfa0604-a357-4ebe-bf53-0d3820f92c93 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:37.549581 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-adfa0604-a357-4ebe-bf53-0d3820f92c93 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:37.552417 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-adfa0604-a357-4ebe-bf53-0d3820f92c93 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:37.554906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-adfa0604-a357-4ebe-bf53-0d3820f92c93 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:37.580656 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-735f69b9-a62d-4371-a10d-8869db03adfb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:37.598927 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-735f69b9-a62d-4371-a10d-8869db03adfb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1515 microversion: 2.1 time: 0.386282 Jul 25 12:56:37.599946 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1662/3379] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:37 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1515 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:37.844383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d3bad430-efda-4da8-b189-18545d2edad6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:37.848516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d3bad430-efda-4da8-b189-18545d2edad6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:37.874031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d3bad430-efda-4da8-b189-18545d2edad6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:37.875430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d3bad430-efda-4da8-b189-18545d2edad6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:37.877447 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d3bad430-efda-4da8-b189-18545d2edad6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:37.878558 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d3bad430-efda-4da8-b189-18545d2edad6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:38.026370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d3bad430-efda-4da8-b189-18545d2edad6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:38.041422 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d3bad430-efda-4da8-b189-18545d2edad6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a" status: 200 len: 1218 microversion: 2.1 time: 0.212048 Jul 25 12:56:38.044256 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1663/3380] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:37 2022] GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a => generated 1218 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:38.056407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-adfa0604-a357-4ebe-bf53-0d3820f92c93 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:38.076390 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-adfa0604-a357-4ebe-bf53-0d3820f92c93 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1511 microversion: 2.1 time: 0.587120 Jul 25 12:56:38.077469 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1718/3381] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:37 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1511 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:56:38.633546 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f074b123-f7c7-4c86-8049-0d65d92aa6ac tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:38.634239 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f074b123-f7c7-4c86-8049-0d65d92aa6ac tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:38.645812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f074b123-f7c7-4c86-8049-0d65d92aa6ac tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:38.650010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f074b123-f7c7-4c86-8049-0d65d92aa6ac tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:38.651144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f074b123-f7c7-4c86-8049-0d65d92aa6ac tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:38.651969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f074b123-f7c7-4c86-8049-0d65d92aa6ac tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:38.918829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f074b123-f7c7-4c86-8049-0d65d92aa6ac tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:38.929594 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f074b123-f7c7-4c86-8049-0d65d92aa6ac tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1515 microversion: 2.1 time: 0.300559 Jul 25 12:56:38.930976 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1664/3382] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:38 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1515 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:39.063930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4045bcdf-d8ef-4b0f-8bce-269b7b4c966b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:39.064727 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4045bcdf-d8ef-4b0f-8bce-269b7b4c966b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:39.077272 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4045bcdf-d8ef-4b0f-8bce-269b7b4c966b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:39.079463 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4045bcdf-d8ef-4b0f-8bce-269b7b4c966b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:39.081644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4045bcdf-d8ef-4b0f-8bce-269b7b4c966b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:39.083496 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4045bcdf-d8ef-4b0f-8bce-269b7b4c966b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:39.098192 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2db90a09-4413-416c-a2fa-8860aeab37d2 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:39.099213 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2db90a09-4413-416c-a2fa-8860aeab37d2 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:39.106752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2db90a09-4413-416c-a2fa-8860aeab37d2 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:39.107470 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2db90a09-4413-416c-a2fa-8860aeab37d2 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:39.108682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2db90a09-4413-416c-a2fa-8860aeab37d2 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:39.109741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2db90a09-4413-416c-a2fa-8860aeab37d2 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:39.238303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4045bcdf-d8ef-4b0f-8bce-269b7b4c966b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:39.250956 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4045bcdf-d8ef-4b0f-8bce-269b7b4c966b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a" status: 200 len: 1272 microversion: 2.1 time: 0.191057 Jul 25 12:56:39.255063 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1719/3383] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:39 2022] GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:39.418408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2db90a09-4413-416c-a2fa-8860aeab37d2 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:39.431951 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2db90a09-4413-416c-a2fa-8860aeab37d2 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1488 microversion: 2.1 time: 0.337421 Jul 25 12:56:39.437794 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1665/3384] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:39 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1488 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:56:39.462131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-141dc56a-6dc8-43b2-9c8e-8ec967f13701 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:39.463515 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-141dc56a-6dc8-43b2-9c8e-8ec967f13701 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:39.479692 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-141dc56a-6dc8-43b2-9c8e-8ec967f13701 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:39.480482 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-141dc56a-6dc8-43b2-9c8e-8ec967f13701 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:39.481922 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-141dc56a-6dc8-43b2-9c8e-8ec967f13701 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:39.482546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-141dc56a-6dc8-43b2-9c8e-8ec967f13701 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:39.523033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-141dc56a-6dc8-43b2-9c8e-8ec967f13701 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:56:39.694584 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-141dc56a-6dc8-43b2-9c8e-8ec967f13701 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 204 len: 0 microversion: 2.1 time: 0.240310 Jul 25 12:56:39.700173 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1720/3385] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:56:39 2022] DELETE /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:56:39.707550 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-daedf01c-85fe-404b-919b-fb80c4270107 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:39.709437 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-daedf01c-85fe-404b-919b-fb80c4270107 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:39.726218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-daedf01c-85fe-404b-919b-fb80c4270107 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:39.728069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-daedf01c-85fe-404b-919b-fb80c4270107 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:39.729121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-daedf01c-85fe-404b-919b-fb80c4270107 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:39.740666 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-daedf01c-85fe-404b-919b-fb80c4270107 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:39.952989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-45ae5941-14a0-4c40-a498-5c69e84edfa0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:39.953674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-45ae5941-14a0-4c40-a498-5c69e84edfa0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:39.968153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45ae5941-14a0-4c40-a498-5c69e84edfa0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:39.968611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45ae5941-14a0-4c40-a498-5c69e84edfa0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:39.974877 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45ae5941-14a0-4c40-a498-5c69e84edfa0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:39.975345 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45ae5941-14a0-4c40-a498-5c69e84edfa0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:40.058539 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-daedf01c-85fe-404b-919b-fb80c4270107 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:40.068814 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-daedf01c-85fe-404b-919b-fb80c4270107 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1494 microversion: 2.1 time: 0.366550 Jul 25 12:56:40.078774 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1666/3386] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:39 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1494 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:40.275575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-16c99d55-8c5c-4111-8fc5-43a2a61d78e5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:40.276274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-16c99d55-8c5c-4111-8fc5-43a2a61d78e5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:40.291025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16c99d55-8c5c-4111-8fc5-43a2a61d78e5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:40.291518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16c99d55-8c5c-4111-8fc5-43a2a61d78e5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:40.292321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16c99d55-8c5c-4111-8fc5-43a2a61d78e5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:40.292767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16c99d55-8c5c-4111-8fc5-43a2a61d78e5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:40.354859 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-45ae5941-14a0-4c40-a498-5c69e84edfa0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:40.361744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:40.364482 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-45ae5941-14a0-4c40-a498-5c69e84edfa0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1521 microversion: 2.1 time: 0.415934 Jul 25 12:56:40.365080 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1721/3387] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:39 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:56:40.531741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-16c99d55-8c5c-4111-8fc5-43a2a61d78e5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:40.544102 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-16c99d55-8c5c-4111-8fc5-43a2a61d78e5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a" status: 200 len: 1314 microversion: 2.1 time: 0.272938 Jul 25 12:56:40.549065 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1667/3388] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:40 2022] GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:41.094513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-381c7d91-ffd3-4f73-8954-90e328243b9c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:41.095250 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-381c7d91-ffd3-4f73-8954-90e328243b9c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:41.122198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-381c7d91-ffd3-4f73-8954-90e328243b9c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:41.125102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-381c7d91-ffd3-4f73-8954-90e328243b9c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:41.127929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-381c7d91-ffd3-4f73-8954-90e328243b9c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:41.130770 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-381c7d91-ffd3-4f73-8954-90e328243b9c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:41.389879 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-db532c78-d025-4f59-bc86-30a9349ad8bc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:41.391995 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-db532c78-d025-4f59-bc86-30a9349ad8bc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:41.402081 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-db532c78-d025-4f59-bc86-30a9349ad8bc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:41.403014 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-db532c78-d025-4f59-bc86-30a9349ad8bc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:41.404188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-db532c78-d025-4f59-bc86-30a9349ad8bc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:41.404930 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-db532c78-d025-4f59-bc86-30a9349ad8bc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:41.552513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-381c7d91-ffd3-4f73-8954-90e328243b9c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:41.561582 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-381c7d91-ffd3-4f73-8954-90e328243b9c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1494 microversion: 2.1 time: 0.472045 Jul 25 12:56:41.570752 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1722/3389] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:41 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1494 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:41.587143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b48dc0de-09b6-47e3-9987-15220c291a56 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:41.587834 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b48dc0de-09b6-47e3-9987-15220c291a56 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:41.595060 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b48dc0de-09b6-47e3-9987-15220c291a56 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:41.597980 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b48dc0de-09b6-47e3-9987-15220c291a56 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:41.598966 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b48dc0de-09b6-47e3-9987-15220c291a56 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:41.599762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b48dc0de-09b6-47e3-9987-15220c291a56 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:41.989370 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b48dc0de-09b6-47e3-9987-15220c291a56 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:42.004899 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b48dc0de-09b6-47e3-9987-15220c291a56 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a" status: 200 len: 1314 microversion: 2.1 time: 0.429803 Jul 25 12:56:42.008228 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1723/3390] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:41 2022] GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:42.023069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-db532c78-d025-4f59-bc86-30a9349ad8bc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:42.044097 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-db532c78-d025-4f59-bc86-30a9349ad8bc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1521 microversion: 2.1 time: 0.659342 Jul 25 12:56:42.045705 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1668/3391] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:41 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1521 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:42.177959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-4f03cba0-5c31-4192-a92c-9c66b7ceddf8 req-283af06e-3278-49cc-b29e-54ec8a8053fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b4983b6-4749-4747-9a74-b4405b42a22a", "tag": "f6b6dbe2-98c3-4a98-b177-0dfb4116b9d2"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:42.238663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4f03cba0-5c31-4192-a92c-9c66b7ceddf8 req-283af06e-3278-49cc-b29e-54ec8a8053fa service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:42.241855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4f03cba0-5c31-4192-a92c-9c66b7ceddf8 req-283af06e-3278-49cc-b29e-54ec8a8053fa service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:42.305382 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-4f03cba0-5c31-4192-a92c-9c66b7ceddf8 req-283af06e-3278-49cc-b29e-54ec8a8053fa service nova] Creating event network-changed:f6b6dbe2-98c3-4a98-b177-0dfb4116b9d2 for instance 1b4983b6-4749-4747-9a74-b4405b42a22a on n-h1-848886-15 Jul 25 12:56:42.327999 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-4f03cba0-5c31-4192-a92c-9c66b7ceddf8 req-283af06e-3278-49cc-b29e-54ec8a8053fa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155253 Jul 25 12:56:42.328628 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1724/3392] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:56:42.589431 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d277d837-e649-4d22-93b1-5c3709456739 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:42.590885 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d277d837-e649-4d22-93b1-5c3709456739 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:42.603707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-a83b853b-ce86-476d-80ec-558db4eb2c2c req-5d47b9ac-7f87-4be1-9eaf-12dd5e4ba4ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "975ed5ee-8529-4421-b5ad-531e0caa8c16", "name": "network-vif-deleted", "tag": "b6fb21e2-fc5b-4338-a202-037d4855ca52"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:42.624746 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d277d837-e649-4d22-93b1-5c3709456739 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:42.632019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d277d837-e649-4d22-93b1-5c3709456739 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:42.636523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d277d837-e649-4d22-93b1-5c3709456739 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:42.636999 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d277d837-e649-4d22-93b1-5c3709456739 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:42.639392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a83b853b-ce86-476d-80ec-558db4eb2c2c req-5d47b9ac-7f87-4be1-9eaf-12dd5e4ba4ec service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:42.651029 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a83b853b-ce86-476d-80ec-558db4eb2c2c req-5d47b9ac-7f87-4be1-9eaf-12dd5e4ba4ec service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:42.769280 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-a83b853b-ce86-476d-80ec-558db4eb2c2c req-5d47b9ac-7f87-4be1-9eaf-12dd5e4ba4ec service nova] Creating event network-vif-deleted:b6fb21e2-fc5b-4338-a202-037d4855ca52 for instance 975ed5ee-8529-4421-b5ad-531e0caa8c16 on n-h1-848886-15 Jul 25 12:56:42.790408 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-a83b853b-ce86-476d-80ec-558db4eb2c2c req-5d47b9ac-7f87-4be1-9eaf-12dd5e4ba4ec service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190304 Jul 25 12:56:42.792133 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1725/3393] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:56:42.932842 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d277d837-e649-4d22-93b1-5c3709456739 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:42.935512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:42.951588 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d277d837-e649-4d22-93b1-5c3709456739 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 200 len: 1286 microversion: 2.1 time: 0.358860 Jul 25 12:56:42.956751 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1669/3394] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:42 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 1286 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:43.035123 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d164fa68-135d-48c9-8d62-5fa8dca96a3b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:43.036931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d164fa68-135d-48c9-8d62-5fa8dca96a3b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:43.060002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d164fa68-135d-48c9-8d62-5fa8dca96a3b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:43.062810 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d164fa68-135d-48c9-8d62-5fa8dca96a3b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:43.067002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d164fa68-135d-48c9-8d62-5fa8dca96a3b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:43.067464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f25a9d27-a3ff-4642-91cb-78c2caff2027 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:43.068295 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f25a9d27-a3ff-4642-91cb-78c2caff2027 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:43.070735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d164fa68-135d-48c9-8d62-5fa8dca96a3b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:43.083607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f25a9d27-a3ff-4642-91cb-78c2caff2027 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:43.084955 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f25a9d27-a3ff-4642-91cb-78c2caff2027 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:43.087406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f25a9d27-a3ff-4642-91cb-78c2caff2027 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:43.088103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f25a9d27-a3ff-4642-91cb-78c2caff2027 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:43.674780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d164fa68-135d-48c9-8d62-5fa8dca96a3b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:43.684797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f25a9d27-a3ff-4642-91cb-78c2caff2027 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:43.693041 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d164fa68-135d-48c9-8d62-5fa8dca96a3b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a" status: 200 len: 1314 microversion: 2.1 time: 0.668261 Jul 25 12:56:43.694478 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1726/3395] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:43 2022] GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a => generated 1314 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:43.701955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-44dc1a77-c708-4545-b614-74935665e58e req-75c61ecc-6240-41c8-ac07-bc5378fff303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5749241b-2503-460b-b1e6-71983c40d397", "name": "network-vif-unplugged", "status": "completed", "tag": "987e2ba7-cfd0-4292-97a8-2d00db7417e7"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:43.710058 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f25a9d27-a3ff-4642-91cb-78c2caff2027 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1521 microversion: 2.1 time: 0.647698 Jul 25 12:56:43.710659 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1670/3396] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:43 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1521 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:56:43.738310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-44dc1a77-c708-4545-b614-74935665e58e req-75c61ecc-6240-41c8-ac07-bc5378fff303 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:43.741400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-44dc1a77-c708-4545-b614-74935665e58e req-75c61ecc-6240-41c8-ac07-bc5378fff303 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:43.767934 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-44dc1a77-c708-4545-b614-74935665e58e req-75c61ecc-6240-41c8-ac07-bc5378fff303 service nova] Creating event network-vif-unplugged:987e2ba7-cfd0-4292-97a8-2d00db7417e7 for instance 5749241b-2503-460b-b1e6-71983c40d397 on n-h2-848886-15 Jul 25 12:56:43.774969 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-44dc1a77-c708-4545-b614-74935665e58e req-75c61ecc-6240-41c8-ac07-bc5378fff303 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078682 Jul 25 12:56:43.780680 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1727/3397] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:56:43.976911 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4aaec181-a199-4d1f-946f-ac81e99ebbce tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:43.977683 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4aaec181-a199-4d1f-946f-ac81e99ebbce tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:43.984992 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4aaec181-a199-4d1f-946f-ac81e99ebbce tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:43.987227 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4aaec181-a199-4d1f-946f-ac81e99ebbce tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:43.990740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4aaec181-a199-4d1f-946f-ac81e99ebbce tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:43.994855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4aaec181-a199-4d1f-946f-ac81e99ebbce tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:44.029121 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-4aaec181-a199-4d1f-946f-ac81e99ebbce tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] HTTP exception thrown: Instance 975ed5ee-8529-4421-b5ad-531e0caa8c16 could not be found. Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4aaec181-a199-4d1f-946f-ac81e99ebbce tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Request method failure captured: Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 HTTP/1.1 Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pHF7UCaF8gOsr4izIJsQMgDEa0djLGcj88wHujy3LL3KrSKed1jp5p2g1uyl0B7FckQX0z38dpjtGtJDzQMYAlTS7LRfENWczpgFqPzdGM6KYoCp6qrqJdc7QEkc58SEBAWEj2A4h5-asWJS2CIcfkxwvHFTYem8sDn2kkqArMxtZA Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f07680a55b3f41408d3a284d1330503d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}] Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: d28f966411004a158377c689fd5b05eb Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 975ed5ee-8529-4421-b5ad-531e0caa8c16 could not be found. Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '975ed5ee-8529-4421-b5ad-531e0caa8c16'} Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 975ed5ee-8529-4421-b5ad-531e0caa8c16 could not be found. Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 975ed5ee-8529-4421-b5ad-531e0caa8c16 could not be found. Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:56:44.033326 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:56:44.040958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:56:44.040958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:56:44.040958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:56:44.040958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:56:44.040958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:56:44.040958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 975ed5ee-8529-4421-b5ad-531e0caa8c16 could not be found. Jul 25 12:56:44.040958 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:56:44.040958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4aaec181-a199-4d1f-946f-ac81e99ebbce tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Returning 404 to user: Instance 975ed5ee-8529-4421-b5ad-531e0caa8c16 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:56:44.044312 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4aaec181-a199-4d1f-946f-ac81e99ebbce tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 404 len: 111 microversion: 2.1 time: 0.067881 Jul 25 12:56:44.044312 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1671/3398] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:43 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:56:44.223780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-255a0b96-7192-4517-bf20-be2f8fa4ee0e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1858352546", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "b6926756-00b4-4271-8538-f2e94168b61a"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:44.299311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-255a0b96-7192-4517-bf20-be2f8fa4ee0e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] validate_networks() for [('b6926756-00b4-4271-8538-f2e94168b61a', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:56:44.715385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f91415bf-15b3-423f-a7ed-8b13391b265d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:44.717065 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f91415bf-15b3-423f-a7ed-8b13391b265d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:44.732000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f91415bf-15b3-423f-a7ed-8b13391b265d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:44.733100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f91415bf-15b3-423f-a7ed-8b13391b265d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:44.735224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f91415bf-15b3-423f-a7ed-8b13391b265d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:44.737648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f91415bf-15b3-423f-a7ed-8b13391b265d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:45.011178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-255a0b96-7192-4517-bf20-be2f8fa4ee0e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:56:45.012061 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-255a0b96-7192-4517-bf20-be2f8fa4ee0e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:56:45.018561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-255a0b96-7192-4517-bf20-be2f8fa4ee0e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:56:45.019140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-255a0b96-7192-4517-bf20-be2f8fa4ee0e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:56:45.019582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-255a0b96-7192-4517-bf20-be2f8fa4ee0e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:56:45.053164 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f91415bf-15b3-423f-a7ed-8b13391b265d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:45.060613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-255a0b96-7192-4517-bf20-be2f8fa4ee0e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:45.061334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-255a0b96-7192-4517-bf20-be2f8fa4ee0e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:45.061628 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f91415bf-15b3-423f-a7ed-8b13391b265d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a" status: 200 len: 1314 microversion: 2.1 time: 0.350412 Jul 25 12:56:45.063203 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1672/3399] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:44 2022] GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:45.068915 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-12f93e0b-f76b-46e7-b297-92509cb68552 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:45.069766 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-12f93e0b-f76b-46e7-b297-92509cb68552 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:45.078591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12f93e0b-f76b-46e7-b297-92509cb68552 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:45.079096 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-255a0b96-7192-4517-bf20-be2f8fa4ee0e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:45.079916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-255a0b96-7192-4517-bf20-be2f8fa4ee0e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:45.080069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12f93e0b-f76b-46e7-b297-92509cb68552 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:45.080889 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12f93e0b-f76b-46e7-b297-92509cb68552 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:45.081480 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12f93e0b-f76b-46e7-b297-92509cb68552 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:45.111098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-255a0b96-7192-4517-bf20-be2f8fa4ee0e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Getting quotas for project f07680a55b3f41408d3a284d1330503d. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:56:45.119050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-255a0b96-7192-4517-bf20-be2f8fa4ee0e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Getting quotas for user d28f966411004a158377c689fd5b05eb and project f07680a55b3f41408d3a284d1330503d. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:56:45.145620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-255a0b96-7192-4517-bf20-be2f8fa4ee0e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:56:45.149483 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-255a0b96-7192-4517-bf20-be2f8fa4ee0e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:56:45.227209 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-255a0b96-7192-4517-bf20-be2f8fa4ee0e tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.007899 Jul 25 12:56:45.228143 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1728/3400] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:56:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:56:45.246213 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a50a497d-2e11-4135-8b29-ca275f56115f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:45.247205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a50a497d-2e11-4135-8b29-ca275f56115f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:45.372174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a50a497d-2e11-4135-8b29-ca275f56115f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:45.378602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-12f93e0b-f76b-46e7-b297-92509cb68552 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:45.384639 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a50a497d-2e11-4135-8b29-ca275f56115f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9" status: 200 len: 1215 microversion: 2.1 time: 0.149268 Jul 25 12:56:45.385903 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1729/3401] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:45 2022] GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 => generated 1215 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:56:45.404007 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-12f93e0b-f76b-46e7-b297-92509cb68552 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1521 microversion: 2.1 time: 0.338924 Jul 25 12:56:45.404634 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1673/3402] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:45 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:46.083697 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e690e34c-029e-4446-aa6f-4892ae604fdf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:46.085071 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e690e34c-029e-4446-aa6f-4892ae604fdf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:46.101594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e690e34c-029e-4446-aa6f-4892ae604fdf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:46.102470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e690e34c-029e-4446-aa6f-4892ae604fdf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:46.103640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e690e34c-029e-4446-aa6f-4892ae604fdf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:46.104399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e690e34c-029e-4446-aa6f-4892ae604fdf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:46.365620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e690e34c-029e-4446-aa6f-4892ae604fdf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:46.376005 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e690e34c-029e-4446-aa6f-4892ae604fdf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a" status: 200 len: 1314 microversion: 2.1 time: 0.296743 Jul 25 12:56:46.381280 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1730/3403] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:46 2022] GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:46.409748 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7c871383-6810-47c2-bbb9-b9bc2d3f152f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:46.410424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7c871383-6810-47c2-bbb9-b9bc2d3f152f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:46.425793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dbb40dba-eb7b-48bf-a25e-40b85b23eba0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:46.426840 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dbb40dba-eb7b-48bf-a25e-40b85b23eba0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:46.442800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dbb40dba-eb7b-48bf-a25e-40b85b23eba0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:46.446953 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c871383-6810-47c2-bbb9-b9bc2d3f152f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:46.447401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c871383-6810-47c2-bbb9-b9bc2d3f152f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:46.448204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dbb40dba-eb7b-48bf-a25e-40b85b23eba0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:46.449216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dbb40dba-eb7b-48bf-a25e-40b85b23eba0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:46.456875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c871383-6810-47c2-bbb9-b9bc2d3f152f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:46.457340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c871383-6810-47c2-bbb9-b9bc2d3f152f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:46.458066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dbb40dba-eb7b-48bf-a25e-40b85b23eba0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:46.532314 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:46.534837 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:46.698553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7c871383-6810-47c2-bbb9-b9bc2d3f152f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:46.714181 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7c871383-6810-47c2-bbb9-b9bc2d3f152f tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9" status: 200 len: 1275 microversion: 2.1 time: 0.307874 Jul 25 12:56:46.717276 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1674/3404] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:46 2022] GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 => generated 1275 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:46.950246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dbb40dba-eb7b-48bf-a25e-40b85b23eba0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:46.959292 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dbb40dba-eb7b-48bf-a25e-40b85b23eba0 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1521 microversion: 2.1 time: 0.538410 Jul 25 12:56:46.970773 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1731/3405] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:46 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1521 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:47.165967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-ddc8e94e-07e0-47d4-8192-5dff1390ccfe req-3e0b960b-6c96-4e8b-87a6-daf44f4a4141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5749241b-2503-460b-b1e6-71983c40d397", "name": "network-vif-plugged", "status": "completed", "tag": "987e2ba7-cfd0-4292-97a8-2d00db7417e7"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:47.186108 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ddc8e94e-07e0-47d4-8192-5dff1390ccfe req-3e0b960b-6c96-4e8b-87a6-daf44f4a4141 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:47.187722 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ddc8e94e-07e0-47d4-8192-5dff1390ccfe req-3e0b960b-6c96-4e8b-87a6-daf44f4a4141 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:47.208213 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-ddc8e94e-07e0-47d4-8192-5dff1390ccfe req-3e0b960b-6c96-4e8b-87a6-daf44f4a4141 service nova] Creating event network-vif-plugged:987e2ba7-cfd0-4292-97a8-2d00db7417e7 for instance 5749241b-2503-460b-b1e6-71983c40d397 on n-h2-848886-15 Jul 25 12:56:47.214677 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-ddc8e94e-07e0-47d4-8192-5dff1390ccfe req-3e0b960b-6c96-4e8b-87a6-daf44f4a4141 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054740 Jul 25 12:56:47.215777 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1675/3406] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:56:47.396992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6a227367-a071-412f-8c0d-54c0f299a2fa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:47.397552 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6a227367-a071-412f-8c0d-54c0f299a2fa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:47.409493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a227367-a071-412f-8c0d-54c0f299a2fa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:47.409980 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a227367-a071-412f-8c0d-54c0f299a2fa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:47.411827 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a227367-a071-412f-8c0d-54c0f299a2fa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:47.412901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a227367-a071-412f-8c0d-54c0f299a2fa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:47.740332 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-99321788-cbf1-4650-b2fb-d4bc4f15aca5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:47.741040 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-99321788-cbf1-4650-b2fb-d4bc4f15aca5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:47.759777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-99321788-cbf1-4650-b2fb-d4bc4f15aca5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:47.760283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-99321788-cbf1-4650-b2fb-d4bc4f15aca5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:47.762597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-99321788-cbf1-4650-b2fb-d4bc4f15aca5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:47.779571 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-99321788-cbf1-4650-b2fb-d4bc4f15aca5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:47.789670 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6a227367-a071-412f-8c0d-54c0f299a2fa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:47.800846 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6a227367-a071-412f-8c0d-54c0f299a2fa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a" status: 200 len: 1314 microversion: 2.1 time: 0.407814 Jul 25 12:56:47.815937 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1732/3407] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:47 2022] GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:47.999183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e4863632-554a-4494-9468-1cc08a7e0e0e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:48.000159 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e4863632-554a-4494-9468-1cc08a7e0e0e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:48.020274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4863632-554a-4494-9468-1cc08a7e0e0e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:48.022408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4863632-554a-4494-9468-1cc08a7e0e0e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:48.026711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4863632-554a-4494-9468-1cc08a7e0e0e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:48.029866 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4863632-554a-4494-9468-1cc08a7e0e0e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:48.093142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-99321788-cbf1-4650-b2fb-d4bc4f15aca5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:48.108717 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-99321788-cbf1-4650-b2fb-d4bc4f15aca5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9" status: 200 len: 1315 microversion: 2.1 time: 0.374541 Jul 25 12:56:48.126452 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1676/3408] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:47 2022] GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:56:48.307194 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e4863632-554a-4494-9468-1cc08a7e0e0e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:48.338947 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e4863632-554a-4494-9468-1cc08a7e0e0e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1521 microversion: 2.1 time: 0.357225 Jul 25 12:56:48.339547 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1733/3409] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:47 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:48.824565 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8fb6e6dd-b49f-4e2a-bffb-1180031407aa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:48.825341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8fb6e6dd-b49f-4e2a-bffb-1180031407aa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:48.855263 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8fb6e6dd-b49f-4e2a-bffb-1180031407aa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:48.858060 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8fb6e6dd-b49f-4e2a-bffb-1180031407aa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:48.860012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8fb6e6dd-b49f-4e2a-bffb-1180031407aa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:48.861560 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8fb6e6dd-b49f-4e2a-bffb-1180031407aa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:49.133044 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9fb21d72-141b-44cb-a74b-5dcbedbb4d9b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:49.134481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9fb21d72-141b-44cb-a74b-5dcbedbb4d9b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:49.151726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9fb21d72-141b-44cb-a74b-5dcbedbb4d9b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:49.152965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9fb21d72-141b-44cb-a74b-5dcbedbb4d9b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:49.154387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9fb21d72-141b-44cb-a74b-5dcbedbb4d9b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:49.155052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9fb21d72-141b-44cb-a74b-5dcbedbb4d9b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:49.212995 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8fb6e6dd-b49f-4e2a-bffb-1180031407aa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:49.223247 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8fb6e6dd-b49f-4e2a-bffb-1180031407aa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a" status: 200 len: 1314 microversion: 2.1 time: 0.403291 Jul 25 12:56:49.226478 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1677/3410] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:48 2022] GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:49.290365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-dcf6e2e0-6f4e-4e49-ab51-3f2ec964fec6 req-75780236-403d-4977-bfdf-76df9ee82335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4983b6-4749-4747-9a74-b4405b42a22a", "name": "network-vif-plugged", "status": "completed", "tag": "f6b6dbe2-98c3-4a98-b177-0dfb4116b9d2"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:49.327781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-dcf6e2e0-6f4e-4e49-ab51-3f2ec964fec6 req-75780236-403d-4977-bfdf-76df9ee82335 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:49.333979 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-dcf6e2e0-6f4e-4e49-ab51-3f2ec964fec6 req-75780236-403d-4977-bfdf-76df9ee82335 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:49.360418 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-dcf6e2e0-6f4e-4e49-ab51-3f2ec964fec6 req-75780236-403d-4977-bfdf-76df9ee82335 service nova] Creating event network-vif-plugged:f6b6dbe2-98c3-4a98-b177-0dfb4116b9d2 for instance 1b4983b6-4749-4747-9a74-b4405b42a22a on n-h1-848886-15 Jul 25 12:56:49.377499 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-dcf6e2e0-6f4e-4e49-ab51-3f2ec964fec6 req-75780236-403d-4977-bfdf-76df9ee82335 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091109 Jul 25 12:56:49.378866 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1678/3411] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:56:49.394876 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-07155fa8-8553-4f8b-8206-c275ce960eeb req-4e0a4a08-d656-4e68-9784-d10bcf65c33f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4550c3f-cb00-410c-ad78-9f348258ece9", "tag": "36e85a01-7719-4297-a8af-f959b76d2931"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:49.409397 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-07155fa8-8553-4f8b-8206-c275ce960eeb req-4e0a4a08-d656-4e68-9784-d10bcf65c33f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:49.410322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-07155fa8-8553-4f8b-8206-c275ce960eeb req-4e0a4a08-d656-4e68-9784-d10bcf65c33f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:49.423769 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-07155fa8-8553-4f8b-8206-c275ce960eeb req-4e0a4a08-d656-4e68-9784-d10bcf65c33f service nova] Creating event network-changed:36e85a01-7719-4297-a8af-f959b76d2931 for instance e4550c3f-cb00-410c-ad78-9f348258ece9 on n-h1-848886-15 Jul 25 12:56:49.432609 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-07155fa8-8553-4f8b-8206-c275ce960eeb req-4e0a4a08-d656-4e68-9784-d10bcf65c33f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043126 Jul 25 12:56:49.435741 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1679/3412] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:56:49.444507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ead2f1c4-8860-4a61-a298-667fe2fd23b5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:49.445671 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ead2f1c4-8860-4a61-a298-667fe2fd23b5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:49.460511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ead2f1c4-8860-4a61-a298-667fe2fd23b5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:49.461273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ead2f1c4-8860-4a61-a298-667fe2fd23b5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:49.462959 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ead2f1c4-8860-4a61-a298-667fe2fd23b5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:49.463692 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ead2f1c4-8860-4a61-a298-667fe2fd23b5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:49.542281 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9fb21d72-141b-44cb-a74b-5dcbedbb4d9b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:49.548971 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9fb21d72-141b-44cb-a74b-5dcbedbb4d9b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9" status: 200 len: 1315 microversion: 2.1 time: 0.420204 Jul 25 12:56:49.581556 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1734/3413] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:49 2022] GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:49.934637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ead2f1c4-8860-4a61-a298-667fe2fd23b5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:49.944183 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ead2f1c4-8860-4a61-a298-667fe2fd23b5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1506 microversion: 2.1 time: 0.507006 Jul 25 12:56:49.949880 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1680/3414] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:49 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1506 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:49.973724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5f96a824-bf01-4b2a-b877-ae7678c73a44 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:49.974400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5f96a824-bf01-4b2a-b877-ae7678c73a44 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:49.985389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5f96a824-bf01-4b2a-b877-ae7678c73a44 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:49.986163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5f96a824-bf01-4b2a-b877-ae7678c73a44 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:49.994343 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5f96a824-bf01-4b2a-b877-ae7678c73a44 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:49.995066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5f96a824-bf01-4b2a-b877-ae7678c73a44 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:50.248866 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f0b4b218-5d88-4990-b901-fca54d3e8760 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:50.252184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f0b4b218-5d88-4990-b901-fca54d3e8760 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:50.263167 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0b4b218-5d88-4990-b901-fca54d3e8760 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:50.263816 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0b4b218-5d88-4990-b901-fca54d3e8760 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:50.264789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0b4b218-5d88-4990-b901-fca54d3e8760 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:50.265385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0b4b218-5d88-4990-b901-fca54d3e8760 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:50.392182 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5f96a824-bf01-4b2a-b877-ae7678c73a44 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:50.402454 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5f96a824-bf01-4b2a-b877-ae7678c73a44 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 200 len: 1506 microversion: 2.1 time: 0.432563 Jul 25 12:56:50.403058 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1735/3415] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:49 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:50.424933 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c327f0ae-3a6d-4ad6-8775-83e02c95001d tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:50.425657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c327f0ae-3a6d-4ad6-8775-83e02c95001d tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:50.433674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c327f0ae-3a6d-4ad6-8775-83e02c95001d tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:50.434400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c327f0ae-3a6d-4ad6-8775-83e02c95001d tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:50.435373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c327f0ae-3a6d-4ad6-8775-83e02c95001d tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:50.435963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c327f0ae-3a6d-4ad6-8775-83e02c95001d tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:50.464839 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c327f0ae-3a6d-4ad6-8775-83e02c95001d tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:56:50.490023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f0b4b218-5d88-4990-b901-fca54d3e8760 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:50.500445 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f0b4b218-5d88-4990-b901-fca54d3e8760 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a" status: 200 len: 1314 microversion: 2.1 time: 0.256068 Jul 25 12:56:50.516292 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1681/3416] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:50 2022] GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:56:50.590037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ccd1ade2-c47b-4015-8689-006802639d7d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:50.590929 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ccd1ade2-c47b-4015-8689-006802639d7d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:50.600834 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:50.603449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ccd1ade2-c47b-4015-8689-006802639d7d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:50.604470 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ccd1ade2-c47b-4015-8689-006802639d7d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:50.607018 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ccd1ade2-c47b-4015-8689-006802639d7d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:50.609442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ccd1ade2-c47b-4015-8689-006802639d7d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:50.619268 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c327f0ae-3a6d-4ad6-8775-83e02c95001d tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 204 len: 0 microversion: 2.1 time: 0.198645 Jul 25 12:56:50.626126 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1736/3417] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:56:50 2022] DELETE /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:56:50.818663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ccd1ade2-c47b-4015-8689-006802639d7d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:50.830154 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ccd1ade2-c47b-4015-8689-006802639d7d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9" status: 200 len: 1315 microversion: 2.1 time: 0.245345 Jul 25 12:56:50.831134 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1682/3418] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:50 2022] GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:50.889498 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9ab3ad3a-993b-4f30-9d32-78af9c105fbc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-386086293", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "2c55ca58-f6b3-49a6-8224-93d49e500ffc"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:51.015197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-9ab3ad3a-993b-4f30-9d32-78af9c105fbc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] validate_networks() for [('2c55ca58-f6b3-49a6-8224-93d49e500ffc', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:56:51.524113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1d0dc743-8b76-4e6e-bcaa-c2cfbd74f741 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:51.525625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1d0dc743-8b76-4e6e-bcaa-c2cfbd74f741 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:51.535309 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d0dc743-8b76-4e6e-bcaa-c2cfbd74f741 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:51.535988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d0dc743-8b76-4e6e-bcaa-c2cfbd74f741 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:51.537023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d0dc743-8b76-4e6e-bcaa-c2cfbd74f741 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:51.537809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d0dc743-8b76-4e6e-bcaa-c2cfbd74f741 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:52.584352 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1d0dc743-8b76-4e6e-bcaa-c2cfbd74f741 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:52.593388 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1d0dc743-8b76-4e6e-bcaa-c2cfbd74f741 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a" status: 200 len: 1314 microversion: 2.1 time: 1.074662 Jul 25 12:56:52.598601 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1683/3419] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:51 2022] GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a => generated 1314 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:52.610971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-14bbca1a-76ac-4c5c-b940-27a3f51df87b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:52.611795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-14bbca1a-76ac-4c5c-b940-27a3f51df87b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:52.624352 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14bbca1a-76ac-4c5c-b940-27a3f51df87b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:52.632888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14bbca1a-76ac-4c5c-b940-27a3f51df87b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:52.633763 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14bbca1a-76ac-4c5c-b940-27a3f51df87b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:52.634308 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14bbca1a-76ac-4c5c-b940-27a3f51df87b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:52.992824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-9ab3ad3a-993b-4f30-9d32-78af9c105fbc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:56:52.993949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-9ab3ad3a-993b-4f30-9d32-78af9c105fbc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:56:52.995001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-9ab3ad3a-993b-4f30-9d32-78af9c105fbc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:56:52.995826 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-9ab3ad3a-993b-4f30-9d32-78af9c105fbc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:56:52.996486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-9ab3ad3a-993b-4f30-9d32-78af9c105fbc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:56:53.019409 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ab3ad3a-993b-4f30-9d32-78af9c105fbc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:53.020781 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ab3ad3a-993b-4f30-9d32-78af9c105fbc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:53.023945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ab3ad3a-993b-4f30-9d32-78af9c105fbc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:53.024811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ab3ad3a-993b-4f30-9d32-78af9c105fbc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:53.076745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-9ab3ad3a-993b-4f30-9d32-78af9c105fbc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Getting quotas for project 91cbcc6833214e07840dc9beaf9bea78. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:56:53.091850 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-9ab3ad3a-993b-4f30-9d32-78af9c105fbc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Getting quotas for user 6f8b20388de843f2a2aa0cf53dc80f75 and project 91cbcc6833214e07840dc9beaf9bea78. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:56:53.112030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9ab3ad3a-993b-4f30-9d32-78af9c105fbc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:56:53.115033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9ab3ad3a-993b-4f30-9d32-78af9c105fbc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:56:53.140853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-14bbca1a-76ac-4c5c-b940-27a3f51df87b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:53.152425 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-14bbca1a-76ac-4c5c-b940-27a3f51df87b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9" status: 200 len: 1315 microversion: 2.1 time: 0.551234 Jul 25 12:56:53.163032 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1684/3420] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:52 2022] GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:53.242890 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9ab3ad3a-993b-4f30-9d32-78af9c105fbc tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.360123 Jul 25 12:56:53.245791 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1737/3421] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:56:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:56:53.257260 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e8e73a32-327c-4234-b792-6a0133e80daf tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:53.257976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e8e73a32-327c-4234-b792-6a0133e80daf tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:53.418279 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e8e73a32-327c-4234-b792-6a0133e80daf tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:53.447251 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e8e73a32-327c-4234-b792-6a0133e80daf tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 200 len: 1217 microversion: 2.1 time: 0.192883 Jul 25 12:56:53.449236 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1685/3422] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:53 2022] GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 1217 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:53.620280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f4c48880-8143-41da-8651-5f228bd72eae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:53.621868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f4c48880-8143-41da-8651-5f228bd72eae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:53.641550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4c48880-8143-41da-8651-5f228bd72eae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:53.642110 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4c48880-8143-41da-8651-5f228bd72eae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:53.643364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4c48880-8143-41da-8651-5f228bd72eae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:53.646063 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4c48880-8143-41da-8651-5f228bd72eae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:53.929307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-6455f2b1-ac2a-4e2b-a38b-c0bf35229d0d req-1d9d3a09-d804-4a1b-a80f-2ef15d54e915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5749241b-2503-460b-b1e6-71983c40d397", "name": "network-vif-deleted", "tag": "987e2ba7-cfd0-4292-97a8-2d00db7417e7"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:53.954191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-6455f2b1-ac2a-4e2b-a38b-c0bf35229d0d req-1d9d3a09-d804-4a1b-a80f-2ef15d54e915 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:53.954895 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-6455f2b1-ac2a-4e2b-a38b-c0bf35229d0d req-1d9d3a09-d804-4a1b-a80f-2ef15d54e915 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:54.003245 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-6455f2b1-ac2a-4e2b-a38b-c0bf35229d0d req-1d9d3a09-d804-4a1b-a80f-2ef15d54e915 service nova] Creating event network-vif-deleted:987e2ba7-cfd0-4292-97a8-2d00db7417e7 for instance 5749241b-2503-460b-b1e6-71983c40d397 on n-h2-848886-15 Jul 25 12:56:54.017618 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-6455f2b1-ac2a-4e2b-a38b-c0bf35229d0d req-1d9d3a09-d804-4a1b-a80f-2ef15d54e915 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088039 Jul 25 12:56:54.021137 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1686/3423] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:56:54.184826 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f4c48880-8143-41da-8651-5f228bd72eae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:54.184826 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f4c48880-8143-41da-8651-5f228bd72eae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a" status: 200 len: 1502 microversion: 2.1 time: 0.542634 Jul 25 12:56:54.184826 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1738/3424] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:53 2022] GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a => generated 1502 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:54.201103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6f69078a-e884-4529-a10e-8c5dbfb243b9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:54.201741 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-207d49fd-c8ea-496f-82b8-af333f3e3b63 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:54.202404 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6f69078a-e884-4529-a10e-8c5dbfb243b9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:54.204544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-207d49fd-c8ea-496f-82b8-af333f3e3b63 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:54.209794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f69078a-e884-4529-a10e-8c5dbfb243b9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:54.211239 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f69078a-e884-4529-a10e-8c5dbfb243b9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:54.212475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f69078a-e884-4529-a10e-8c5dbfb243b9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:54.213064 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f69078a-e884-4529-a10e-8c5dbfb243b9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:54.232917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-207d49fd-c8ea-496f-82b8-af333f3e3b63 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:54.233967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-207d49fd-c8ea-496f-82b8-af333f3e3b63 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:54.235475 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-207d49fd-c8ea-496f-82b8-af333f3e3b63 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:54.239754 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-207d49fd-c8ea-496f-82b8-af333f3e3b63 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:54.340063 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-207d49fd-c8ea-496f-82b8-af333f3e3b63 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a/action" status: 200 len: 14 microversion: 2.1 time: 0.143170 Jul 25 12:56:54.341352 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1739/3425] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:56:54 2022] POST /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 12:56:54.474663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dd750f57-845a-471d-98fc-2b990fa86881 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:54.475527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dd750f57-845a-471d-98fc-2b990fa86881 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:54.504487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd750f57-845a-471d-98fc-2b990fa86881 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:54.508151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd750f57-845a-471d-98fc-2b990fa86881 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:54.513391 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd750f57-845a-471d-98fc-2b990fa86881 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:54.514332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd750f57-845a-471d-98fc-2b990fa86881 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:54.528394 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6f69078a-e884-4529-a10e-8c5dbfb243b9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:54.547266 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6f69078a-e884-4529-a10e-8c5dbfb243b9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9" status: 200 len: 1315 microversion: 2.1 time: 0.355838 Jul 25 12:56:54.550886 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1687/3426] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:54 2022] GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:54.642223 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dd750f57-845a-471d-98fc-2b990fa86881 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:54.653948 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dd750f57-845a-471d-98fc-2b990fa86881 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 200 len: 1213 microversion: 2.1 time: 0.185368 Jul 25 12:56:54.654951 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1740/3427] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:54 2022] GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 1213 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:55.355319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a3800f16-5183-48c6-8914-9825cd3884f4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:55.360399 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a3800f16-5183-48c6-8914-9825cd3884f4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:55.378159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:55.383718 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a3800f16-5183-48c6-8914-9825cd3884f4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:55.384685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a3800f16-5183-48c6-8914-9825cd3884f4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:55.387649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a3800f16-5183-48c6-8914-9825cd3884f4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:55.388450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a3800f16-5183-48c6-8914-9825cd3884f4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:55.519339 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a3800f16-5183-48c6-8914-9825cd3884f4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a/action" status: 200 len: 14 microversion: 2.1 time: 0.168483 Jul 25 12:56:55.524895 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1688/3428] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:56:55 2022] POST /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:56:55.570791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a542c6c7-4a34-426e-ba4c-c1c78bdf3bd1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:55.571408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a542c6c7-4a34-426e-ba4c-c1c78bdf3bd1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:55.582322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a542c6c7-4a34-426e-ba4c-c1c78bdf3bd1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:55.588748 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a542c6c7-4a34-426e-ba4c-c1c78bdf3bd1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:55.590038 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a542c6c7-4a34-426e-ba4c-c1c78bdf3bd1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:55.590489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a542c6c7-4a34-426e-ba4c-c1c78bdf3bd1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:55.668659 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:55.686439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d8dddf06-5072-4565-b1f1-1c84e3b83f01 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:55.687643 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d8dddf06-5072-4565-b1f1-1c84e3b83f01 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:55.701464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d8dddf06-5072-4565-b1f1-1c84e3b83f01 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:55.704219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d8dddf06-5072-4565-b1f1-1c84e3b83f01 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:55.705935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d8dddf06-5072-4565-b1f1-1c84e3b83f01 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:55.706590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d8dddf06-5072-4565-b1f1-1c84e3b83f01 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:55.892418 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d8dddf06-5072-4565-b1f1-1c84e3b83f01 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:55.911416 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d8dddf06-5072-4565-b1f1-1c84e3b83f01 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 200 len: 1275 microversion: 2.1 time: 0.235429 Jul 25 12:56:55.916924 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1689/3429] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:55 2022] GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 1275 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:56.214993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a542c6c7-4a34-426e-ba4c-c1c78bdf3bd1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:56.232403 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a542c6c7-4a34-426e-ba4c-c1c78bdf3bd1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9" status: 200 len: 1315 microversion: 2.1 time: 0.663908 Jul 25 12:56:56.249160 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1741/3430] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:55 2022] GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 => generated 1315 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:56.535325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-18703cc5-7760-4906-a1dd-08c2b28633e1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:56.537748 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-18703cc5-7760-4906-a1dd-08c2b28633e1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:56.563348 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18703cc5-7760-4906-a1dd-08c2b28633e1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:56.563808 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18703cc5-7760-4906-a1dd-08c2b28633e1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:56.564636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18703cc5-7760-4906-a1dd-08c2b28633e1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:56.565040 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18703cc5-7760-4906-a1dd-08c2b28633e1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:56.649024 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-18703cc5-7760-4906-a1dd-08c2b28633e1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a/action" status: 200 len: 14 microversion: 2.1 time: 0.117323 Jul 25 12:56:56.649997 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1690/3431] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:56:56 2022] POST /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:56:56.938747 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d5585098-33ba-46e4-bffb-de3bf87861e4 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:56.939375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d5585098-33ba-46e4-bffb-de3bf87861e4 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:56.952670 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5585098-33ba-46e4-bffb-de3bf87861e4 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:56.953125 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5585098-33ba-46e4-bffb-de3bf87861e4 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:56.959019 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5585098-33ba-46e4-bffb-de3bf87861e4 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:56.962456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5585098-33ba-46e4-bffb-de3bf87861e4 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:57.277000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5d9c7714-2255-4fc8-a87e-53d4b0e69e42 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:57.282222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5d9c7714-2255-4fc8-a87e-53d4b0e69e42 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:57.308343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d9c7714-2255-4fc8-a87e-53d4b0e69e42 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:57.309159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d9c7714-2255-4fc8-a87e-53d4b0e69e42 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:57.311897 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d9c7714-2255-4fc8-a87e-53d4b0e69e42 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:57.313323 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d9c7714-2255-4fc8-a87e-53d4b0e69e42 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:57.385178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:57.583088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d5585098-33ba-46e4-bffb-de3bf87861e4 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:57.592513 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d5585098-33ba-46e4-bffb-de3bf87861e4 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 200 len: 1317 microversion: 2.1 time: 0.661283 Jul 25 12:56:57.605685 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1742/3432] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:56 2022] GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 1317 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:57.662546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-234b4296-940b-481b-9d36-86487b67d669 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:57.665612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-234b4296-940b-481b-9d36-86487b67d669 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:57.686359 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-234b4296-940b-481b-9d36-86487b67d669 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:57.687027 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-234b4296-940b-481b-9d36-86487b67d669 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:57.689555 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-234b4296-940b-481b-9d36-86487b67d669 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:57.690299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-234b4296-940b-481b-9d36-86487b67d669 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:58.005565 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-234b4296-940b-481b-9d36-86487b67d669 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a/action" status: 200 len: 14 microversion: 2.1 time: 0.345814 Jul 25 12:56:58.006678 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1743/3433] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:56:57 2022] POST /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a/action => generated 14 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:56:58.218724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5d9c7714-2255-4fc8-a87e-53d4b0e69e42 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:58.232209 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5d9c7714-2255-4fc8-a87e-53d4b0e69e42 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9" status: 200 len: 1315 microversion: 2.1 time: 0.980707 Jul 25 12:56:58.254723 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1691/3434] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:57 2022] GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 => generated 1315 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:56:58.622326 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a0e81acc-d2ab-4767-8091-38aa069f4563 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:58.623611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a0e81acc-d2ab-4767-8091-38aa069f4563 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:58.669554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0e81acc-d2ab-4767-8091-38aa069f4563 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:58.673425 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0e81acc-d2ab-4767-8091-38aa069f4563 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:58.675979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0e81acc-d2ab-4767-8091-38aa069f4563 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:58.676903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0e81acc-d2ab-4767-8091-38aa069f4563 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:58.879509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-1f7b0a9a-9ecf-4b3e-8d45-af58f72691d1 req-f70b37af-f383-4c53-951a-87288812e782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4550c3f-cb00-410c-ad78-9f348258ece9", "name": "network-vif-plugged", "status": "completed", "tag": "36e85a01-7719-4297-a8af-f959b76d2931"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:58.915121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-1f7b0a9a-9ecf-4b3e-8d45-af58f72691d1 req-f70b37af-f383-4c53-951a-87288812e782 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:58.915569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-1f7b0a9a-9ecf-4b3e-8d45-af58f72691d1 req-f70b37af-f383-4c53-951a-87288812e782 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:58.949372 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-1f7b0a9a-9ecf-4b3e-8d45-af58f72691d1 req-f70b37af-f383-4c53-951a-87288812e782 service nova] Creating event network-vif-plugged:36e85a01-7719-4297-a8af-f959b76d2931 for instance e4550c3f-cb00-410c-ad78-9f348258ece9 on n-h1-848886-15 Jul 25 12:56:58.967810 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-1f7b0a9a-9ecf-4b3e-8d45-af58f72691d1 req-f70b37af-f383-4c53-951a-87288812e782 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093364 Jul 25 12:56:58.971568 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1692/3435] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:56:59.515686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b5a06c68-f573-4ce1-97b1-971d7ef35b0e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:59.518314 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b5a06c68-f573-4ce1-97b1-971d7ef35b0e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:59.542532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b5a06c68-f573-4ce1-97b1-971d7ef35b0e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:59.542909 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b5a06c68-f573-4ce1-97b1-971d7ef35b0e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:59.543710 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b5a06c68-f573-4ce1-97b1-971d7ef35b0e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:59.544151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b5a06c68-f573-4ce1-97b1-971d7ef35b0e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:59.643564 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b5a06c68-f573-4ce1-97b1-971d7ef35b0e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a/action" status: 200 len: 14 microversion: 2.1 time: 0.629423 Jul 25 12:56:59.649970 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1693/3436] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:56:59 2022] POST /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a/action => generated 14 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 12:56:59.655752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dbe0070a-830e-4742-953d-5f44fd4668e6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:59.656572 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dbe0070a-830e-4742-953d-5f44fd4668e6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:59.686701 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbe0070a-830e-4742-953d-5f44fd4668e6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:59.687511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbe0070a-830e-4742-953d-5f44fd4668e6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:59.688522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbe0070a-830e-4742-953d-5f44fd4668e6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:59.689149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbe0070a-830e-4742-953d-5f44fd4668e6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:00.066372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a0e81acc-d2ab-4767-8091-38aa069f4563 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:00.085075 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a0e81acc-d2ab-4767-8091-38aa069f4563 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 200 len: 1317 microversion: 2.1 time: 1.468238 Jul 25 12:57:00.088629 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1744/3437] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:58 2022] GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 1317 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:00.339267 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-27321630-e26c-4205-8a85-fe5544b75290 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Action: 'create', calling method: .version_select at 0x7efcf92f4b80>, body: {"keypair": {"name": "tempest-keypair-1128830064", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACXTB9oXbDX6m3SwhPqX8S91jkPM67Cc8MY7021E/fAwhKTyQ29ssvKwlNXpUcddI1mk9uNxf3gPrbqysVzqWynzjqNGtR0TYjpG86LyJNt0/25zM0AbT/CcAAiufdtiQ=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:00.374575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-27321630-e26c-4205-8a85-fe5544b75290 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Getting quotas for project cd52d102917f4b968a0f06c93f37994a. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:57:00.391192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-27321630-e26c-4205-8a85-fe5544b75290 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Getting quotas for user 30345ec1766e4f29a7393616070201bd and project cd52d102917f4b968a0f06c93f37994a. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:57:00.434592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dbe0070a-830e-4742-953d-5f44fd4668e6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:00.450168 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dbe0070a-830e-4742-953d-5f44fd4668e6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9" status: 200 len: 1315 microversion: 2.1 time: 0.798496 Jul 25 12:57:00.451492 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1694/3438] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:59 2022] GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 => generated 1315 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:00.487400 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-27321630-e26c-4205-8a85-fe5544b75290 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.152452 Jul 25 12:57:00.492319 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1745/3439] 10.222.0.49 () {62 vars in 1200 bytes} [Mon Jul 25 12:57:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 158 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 25 12:57:00.655721 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0f5a58e4-71ac-4ab8-988d-17036a39627d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:00.658169 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0f5a58e4-71ac-4ab8-988d-17036a39627d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:00.676890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f5a58e4-71ac-4ab8-988d-17036a39627d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:00.678444 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f5a58e4-71ac-4ab8-988d-17036a39627d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:00.680118 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f5a58e4-71ac-4ab8-988d-17036a39627d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:00.682842 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f5a58e4-71ac-4ab8-988d-17036a39627d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:00.812303 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0f5a58e4-71ac-4ab8-988d-17036a39627d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a/action" status: 200 len: 14 microversion: 2.1 time: 0.161255 Jul 25 12:57:00.816113 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1695/3440] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:57:00 2022] POST /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:57:00.987367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-631f94cd-b244-4a54-85a2-d57bac2554de req-a10aa75f-5f64-4440-9576-d78eebb1707a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "036dbd81-2019-4c7c-84c8-553bdd8729d5", "tag": "ec36eb88-2201-46ff-892c-bef82b5e893e"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:01.021640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-631f94cd-b244-4a54-85a2-d57bac2554de req-a10aa75f-5f64-4440-9576-d78eebb1707a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:01.027657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-631f94cd-b244-4a54-85a2-d57bac2554de req-a10aa75f-5f64-4440-9576-d78eebb1707a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:01.076137 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-631f94cd-b244-4a54-85a2-d57bac2554de req-a10aa75f-5f64-4440-9576-d78eebb1707a service nova] Creating event network-changed:ec36eb88-2201-46ff-892c-bef82b5e893e for instance 036dbd81-2019-4c7c-84c8-553bdd8729d5 on n-h2-848886-15 Jul 25 12:57:01.092352 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-631f94cd-b244-4a54-85a2-d57bac2554de req-a10aa75f-5f64-4440-9576-d78eebb1707a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114738 Jul 25 12:57:01.100733 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1746/3441] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:57:01.110231 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b68c7414-a0b8-4131-a411-18dc2e96f56a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:01.110852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b68c7414-a0b8-4131-a411-18dc2e96f56a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:01.151175 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b68c7414-a0b8-4131-a411-18dc2e96f56a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:01.152092 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b68c7414-a0b8-4131-a411-18dc2e96f56a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:01.157014 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b68c7414-a0b8-4131-a411-18dc2e96f56a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:01.157982 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b68c7414-a0b8-4131-a411-18dc2e96f56a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:01.474028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6e921b46-56ba-4020-9859-605e26252068 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:01.475164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6e921b46-56ba-4020-9859-605e26252068 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:01.500285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e921b46-56ba-4020-9859-605e26252068 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:01.503501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e921b46-56ba-4020-9859-605e26252068 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:01.506422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e921b46-56ba-4020-9859-605e26252068 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:01.507627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e921b46-56ba-4020-9859-605e26252068 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:01.990511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b68c7414-a0b8-4131-a411-18dc2e96f56a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:02.001065 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b68c7414-a0b8-4131-a411-18dc2e96f56a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 200 len: 1317 microversion: 2.1 time: 0.895470 Jul 25 12:57:02.011374 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1696/3442] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:01 2022] GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 1317 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:57:02.016625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-74b320ff-8ac4-4121-9ff2-ffd28d6a10d5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:02.019473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-74b320ff-8ac4-4121-9ff2-ffd28d6a10d5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:02.038296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74b320ff-8ac4-4121-9ff2-ffd28d6a10d5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:02.041145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74b320ff-8ac4-4121-9ff2-ffd28d6a10d5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:02.042614 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74b320ff-8ac4-4121-9ff2-ffd28d6a10d5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:02.044858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74b320ff-8ac4-4121-9ff2-ffd28d6a10d5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:02.092403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6e921b46-56ba-4020-9859-605e26252068 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:02.100909 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6e921b46-56ba-4020-9859-605e26252068 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9" status: 200 len: 1315 microversion: 2.1 time: 0.632032 Jul 25 12:57:02.130033 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-74b320ff-8ac4-4121-9ff2-ffd28d6a10d5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a/action" status: 200 len: 14 microversion: 2.1 time: 0.116995 Jul 25 12:57:02.131055 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1697/3443] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:57:02 2022] POST /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:57:02.145050 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1747/3444] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:01 2022] GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 => generated 1315 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:03.034097 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f574ec67-6a7e-46de-bbe2-3794eac0b927 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:03.035419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f574ec67-6a7e-46de-bbe2-3794eac0b927 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:03.043230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f574ec67-6a7e-46de-bbe2-3794eac0b927 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:03.044098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f574ec67-6a7e-46de-bbe2-3794eac0b927 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:03.045021 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f574ec67-6a7e-46de-bbe2-3794eac0b927 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:03.045594 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f574ec67-6a7e-46de-bbe2-3794eac0b927 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:03.127964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-14ff9258-5d0e-4274-99d2-7ff2d3254250 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:03.129088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-14ff9258-5d0e-4274-99d2-7ff2d3254250 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:03.144649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:03.147222 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14ff9258-5d0e-4274-99d2-7ff2d3254250 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:03.150889 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14ff9258-5d0e-4274-99d2-7ff2d3254250 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:03.152848 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14ff9258-5d0e-4274-99d2-7ff2d3254250 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:03.153609 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14ff9258-5d0e-4274-99d2-7ff2d3254250 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:03.381618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f574ec67-6a7e-46de-bbe2-3794eac0b927 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:03.398473 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f574ec67-6a7e-46de-bbe2-3794eac0b927 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 200 len: 1317 microversion: 2.1 time: 0.368366 Jul 25 12:57:03.416946 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1698/3445] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:03 2022] GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:03.422548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-05068c4c-3dd2-47bb-9737-13f51c74dbd6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:03.424727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-05068c4c-3dd2-47bb-9737-13f51c74dbd6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:03.433570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05068c4c-3dd2-47bb-9737-13f51c74dbd6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:03.434275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05068c4c-3dd2-47bb-9737-13f51c74dbd6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:03.436279 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05068c4c-3dd2-47bb-9737-13f51c74dbd6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:03.436887 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05068c4c-3dd2-47bb-9737-13f51c74dbd6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:03.437942 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-14ff9258-5d0e-4274-99d2-7ff2d3254250 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:03.446553 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-14ff9258-5d0e-4274-99d2-7ff2d3254250 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9" status: 200 len: 1503 microversion: 2.1 time: 0.322697 Jul 25 12:57:03.456887 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1748/3446] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:03 2022] GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 => generated 1503 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:03.469428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-95913d9a-2a18-48e1-b8e4-e19b15e01260 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:03.470001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-95913d9a-2a18-48e1-b8e4-e19b15e01260 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:03.480737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:03.485577 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95913d9a-2a18-48e1-b8e4-e19b15e01260 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:03.486040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95913d9a-2a18-48e1-b8e4-e19b15e01260 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:03.486756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95913d9a-2a18-48e1-b8e4-e19b15e01260 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:03.487195 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95913d9a-2a18-48e1-b8e4-e19b15e01260 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:03.516059 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-05068c4c-3dd2-47bb-9737-13f51c74dbd6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a/action" status: 200 len: 8204 microversion: 2.1 time: 0.095802 Jul 25 12:57:03.517181 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1699/3447] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:57:03 2022] POST /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a/action => generated 8204 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:03.517506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-95913d9a-2a18-48e1-b8e4-e19b15e01260 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lazy-loading 'flavor' on Instance uuid e4550c3f-cb00-410c-ad78-9f348258ece9 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:57:03.528026 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-538a784c-aba4-4b6f-93f9-7edc900f00fb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:03.528870 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-538a784c-aba4-4b6f-93f9-7edc900f00fb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:03.553967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-538a784c-aba4-4b6f-93f9-7edc900f00fb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:03.554422 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-538a784c-aba4-4b6f-93f9-7edc900f00fb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:03.559479 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-538a784c-aba4-4b6f-93f9-7edc900f00fb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:03.560734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-538a784c-aba4-4b6f-93f9-7edc900f00fb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:03.684459 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-95913d9a-2a18-48e1-b8e4-e19b15e01260 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "POST /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9/action" status: 202 len: 0 microversion: 2.1 time: 0.218184 Jul 25 12:57:03.687029 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1749/3448] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:57:03 2022] POST /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 12:57:03.706950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6197ff36-7f9b-4fbe-9842-a15e3c0a06d5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:03.708150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6197ff36-7f9b-4fbe-9842-a15e3c0a06d5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:03.726930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6197ff36-7f9b-4fbe-9842-a15e3c0a06d5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:03.727766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6197ff36-7f9b-4fbe-9842-a15e3c0a06d5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:03.729784 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6197ff36-7f9b-4fbe-9842-a15e3c0a06d5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:03.731835 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6197ff36-7f9b-4fbe-9842-a15e3c0a06d5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:03.800895 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-538a784c-aba4-4b6f-93f9-7edc900f00fb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:03.812516 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-538a784c-aba4-4b6f-93f9-7edc900f00fb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.289284 Jul 25 12:57:03.837570 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1700/3449] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:03 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:57:03.854242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-708d355d-17de-4f15-8107-bceae2ece0d5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:03.855129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-708d355d-17de-4f15-8107-bceae2ece0d5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:03.866186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-708d355d-17de-4f15-8107-bceae2ece0d5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:03.866966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-708d355d-17de-4f15-8107-bceae2ece0d5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:03.868814 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-708d355d-17de-4f15-8107-bceae2ece0d5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:03.869509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-708d355d-17de-4f15-8107-bceae2ece0d5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:04.292281 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6197ff36-7f9b-4fbe-9842-a15e3c0a06d5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:04.301343 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6197ff36-7f9b-4fbe-9842-a15e3c0a06d5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9" status: 200 len: 1511 microversion: 2.1 time: 0.608618 Jul 25 12:57:04.316222 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1750/3450] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:03 2022] GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 => generated 1511 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:57:04.423134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5e20f34b-a55c-46be-bf31-f7dcdec4ec87 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:04.424465 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5e20f34b-a55c-46be-bf31-f7dcdec4ec87 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:04.435486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e20f34b-a55c-46be-bf31-f7dcdec4ec87 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:04.436007 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e20f34b-a55c-46be-bf31-f7dcdec4ec87 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:04.437208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e20f34b-a55c-46be-bf31-f7dcdec4ec87 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:04.439135 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e20f34b-a55c-46be-bf31-f7dcdec4ec87 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:04.663176 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-708d355d-17de-4f15-8107-bceae2ece0d5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:04.679596 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-708d355d-17de-4f15-8107-bceae2ece0d5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.838653 Jul 25 12:57:04.696436 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1701/3451] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:03 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:04.716604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ed8caf74-e89c-4db9-adb4-ad3ee05109cf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:04.717276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ed8caf74-e89c-4db9-adb4-ad3ee05109cf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:04.730650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ed8caf74-e89c-4db9-adb4-ad3ee05109cf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:04.731389 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ed8caf74-e89c-4db9-adb4-ad3ee05109cf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:04.733276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ed8caf74-e89c-4db9-adb4-ad3ee05109cf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:04.734774 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ed8caf74-e89c-4db9-adb4-ad3ee05109cf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:05.109552 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5e20f34b-a55c-46be-bf31-f7dcdec4ec87 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:05.118564 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5e20f34b-a55c-46be-bf31-f7dcdec4ec87 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 200 len: 1317 microversion: 2.1 time: 0.701342 Jul 25 12:57:05.119241 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1751/3452] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:04 2022] GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 1317 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:05.323831 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1b2fa95e-ff1d-46d5-a619-24e06aec8bd5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:05.324485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1b2fa95e-ff1d-46d5-a619-24e06aec8bd5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:05.335149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b2fa95e-ff1d-46d5-a619-24e06aec8bd5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:05.335601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b2fa95e-ff1d-46d5-a619-24e06aec8bd5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:05.336385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b2fa95e-ff1d-46d5-a619-24e06aec8bd5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:05.336824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b2fa95e-ff1d-46d5-a619-24e06aec8bd5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:05.570283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ed8caf74-e89c-4db9-adb4-ad3ee05109cf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:05.581413 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ed8caf74-e89c-4db9-adb4-ad3ee05109cf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.869456 Jul 25 12:57:05.582033 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1702/3453] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:04 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:57:05.606635 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-afb33178-94a1-475f-9572-bb2af324c8f6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:05.607271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-afb33178-94a1-475f-9572-bb2af324c8f6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:05.620640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afb33178-94a1-475f-9572-bb2af324c8f6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:05.621104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afb33178-94a1-475f-9572-bb2af324c8f6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:05.629934 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afb33178-94a1-475f-9572-bb2af324c8f6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:05.630507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afb33178-94a1-475f-9572-bb2af324c8f6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:06.468654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1b2fa95e-ff1d-46d5-a619-24e06aec8bd5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:06.486318 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1b2fa95e-ff1d-46d5-a619-24e06aec8bd5 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9" status: 200 len: 1494 microversion: 2.1 time: 1.166560 Jul 25 12:57:06.487958 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1752/3454] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:05 2022] GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 => generated 1494 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:57:06.496277 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-340e4c04-3835-432f-8696-9fe95315cca1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:06.497892 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-340e4c04-3835-432f-8696-9fe95315cca1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:06.507086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-340e4c04-3835-432f-8696-9fe95315cca1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:06.508570 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-340e4c04-3835-432f-8696-9fe95315cca1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:06.510084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-340e4c04-3835-432f-8696-9fe95315cca1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:06.510837 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-340e4c04-3835-432f-8696-9fe95315cca1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:06.675429 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-afb33178-94a1-475f-9572-bb2af324c8f6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:06.697927 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-afb33178-94a1-475f-9572-bb2af324c8f6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 1.095628 Jul 25 12:57:06.699938 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1703/3455] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:05 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:06.712832 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e2013d6b-b29e-4936-b038-b1cce65f53f6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:06.714487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e2013d6b-b29e-4936-b038-b1cce65f53f6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:06.728499 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2013d6b-b29e-4936-b038-b1cce65f53f6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:06.734606 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2013d6b-b29e-4936-b038-b1cce65f53f6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:06.736037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2013d6b-b29e-4936-b038-b1cce65f53f6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:06.740647 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2013d6b-b29e-4936-b038-b1cce65f53f6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:06.828767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e2013d6b-b29e-4936-b038-b1cce65f53f6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:57:06.975159 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-340e4c04-3835-432f-8696-9fe95315cca1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:06.984862 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-340e4c04-3835-432f-8696-9fe95315cca1 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 200 len: 1317 microversion: 2.1 time: 0.494370 Jul 25 12:57:06.995754 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1753/3456] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:06 2022] GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 1317 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:07.006447 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7f6d95d2-2063-4495-9c13-01d23d415d65 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:07.012427 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7f6d95d2-2063-4495-9c13-01d23d415d65 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:07.029808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7f6d95d2-2063-4495-9c13-01d23d415d65 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:07.030582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7f6d95d2-2063-4495-9c13-01d23d415d65 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:07.031555 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7f6d95d2-2063-4495-9c13-01d23d415d65 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:07.032163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7f6d95d2-2063-4495-9c13-01d23d415d65 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:07.066184 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e2013d6b-b29e-4936-b038-b1cce65f53f6 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9" status: 204 len: 0 microversion: 2.1 time: 0.363928 Jul 25 12:57:07.070691 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1704/3457] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:57:06 2022] DELETE /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:57:07.087072 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-35e60f12-d065-4f6c-9b9a-560a1850c23d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:07.090432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-35e60f12-d065-4f6c-9b9a-560a1850c23d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:07.119227 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-35e60f12-d065-4f6c-9b9a-560a1850c23d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:07.139211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-35e60f12-d065-4f6c-9b9a-560a1850c23d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:07.144342 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-35e60f12-d065-4f6c-9b9a-560a1850c23d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:07.146611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-35e60f12-d065-4f6c-9b9a-560a1850c23d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:07.192979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7f6d95d2-2063-4495-9c13-01d23d415d65 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Locking {{(pid=125884) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 25 12:57:07.337303 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7f6d95d2-2063-4495-9c13-01d23d415d65 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action" status: 202 len: 0 microversion: 2.1 time: 0.339805 Jul 25 12:57:07.338678 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1754/3458] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:57:06 2022] POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:57:07.350011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6cc485f0-01ef-461b-b393-c0e7012ae10c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:07.350991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6cc485f0-01ef-461b-b393-c0e7012ae10c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:07.360948 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cc485f0-01ef-461b-b393-c0e7012ae10c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:07.361567 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cc485f0-01ef-461b-b393-c0e7012ae10c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:07.362858 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cc485f0-01ef-461b-b393-c0e7012ae10c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:07.363430 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cc485f0-01ef-461b-b393-c0e7012ae10c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:07.701235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-35e60f12-d065-4f6c-9b9a-560a1850c23d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:07.710569 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-35e60f12-d065-4f6c-9b9a-560a1850c23d tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9" status: 200 len: 1500 microversion: 2.1 time: 0.635379 Jul 25 12:57:07.711686 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1705/3459] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:07 2022] GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 => generated 1500 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:57:07.730955 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4540fd25-8a2a-4857-bfa8-0117fd9b08c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2112868257", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "dc410446-95e0-4607-b26a-01ef07459e76"}, {"port": "656db462-23e9-4625-a2e7-588155cc7f69", "tag": "port-1"}, {"port": "619e5821-f34d-4084-bf18-5b7e99804fef", "tag": "port-2"}, {"uuid": "792857f6-8128-491d-bf10-e0bcb5b9c7b3", "tag": "net-1"}, {"uuid": "792857f6-8128-491d-bf10-e0bcb5b9c7b3"}, {"uuid": "83baefc8-bd60-4b18-908e-9fda864290e3", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "83baefc8-bd60-4b18-908e-9fda864290e3", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "107996da-45ea-4ef0-a252-f8451a5bd709", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c9969b68-02e1-4453-bb6b-246631efd94b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "74cbe7da-4fb9-4d8a-8582-da8acc123f19", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--153112692"}], "key_name": "tempest-keypair-1128830064", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:07.944270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6cc485f0-01ef-461b-b393-c0e7012ae10c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:07.949248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:07.966515 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6cc485f0-01ef-461b-b393-c0e7012ae10c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.623137 Jul 25 12:57:07.968365 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1755/3460] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:07 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:07.993271 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-54e71ca8-064a-44b9-8546-ca784d645287 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:08.012663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-54e71ca8-064a-44b9-8546-ca784d645287 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:08.018621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-54e71ca8-064a-44b9-8546-ca784d645287 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:08.055800 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-54e71ca8-064a-44b9-8546-ca784d645287 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] HTTP exception thrown: Instance b730aecb-2c1f-46ef-b457-8a3717655518 is locked Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-54e71ca8-064a-44b9-8546-ca784d645287 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Request method failure captured: Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action HTTP/1.1 Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 15 Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pHthUWL3emuzsBs4xsDYWyXYBkhJFaBBK9FQhgh1copL5lDP9Ma5bkE_HJxjDmond706Gp-3Rif1J8B87ZUnZtsSIpcsBH62MydK_2R5OL-M6p6aAVtQ-nWL1wmPtLFtWDAiH4ULAKYIyK232aQLG-PdxvIg00u9QiVZERdPXLac10 Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: b5abf45c9ba0419c8dec07847f3ff3c5 Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerActionsTestJSON-645693881 Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b5abf45c9ba0419c8dec07847f3ff3c5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b5abf45c9ba0419c8dec07847f3ff3c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5abf45c9ba0419c8dec07847f3ff3c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5abf45c9ba0419c8dec07847f3ff3c5"}]}] Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerActionsTestJSON-645693881 Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: b5abf45c9ba0419c8dec07847f3ff3c5 Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerActionsTestJSON-645693881 Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerActionsTestJSON-645693881-project Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 4d492d20a4864908a81902f86468d437 Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerActionsTestJSON-645693881-project Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: {"os-stop": {}} Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance b730aecb-2c1f-46ef-b457-8a3717655518 is locked Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'b730aecb-2c1f-46ef-b457-8a3717655518', 'body': {'os-stop': {}}} Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance b730aecb-2c1f-46ef-b457-8a3717655518 is locked Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance b730aecb-2c1f-46ef-b457-8a3717655518 is locked Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b730aecb-2c1f-46ef-b457-8a3717655518 is locked Jul 25 12:57:08.057519 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:08.061518 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-54e71ca8-064a-44b9-8546-ca784d645287 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Returning 409 to user: Instance b730aecb-2c1f-46ef-b457-8a3717655518 is locked {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:57:08.061518 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-54e71ca8-064a-44b9-8546-ca784d645287 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action" status: 409 len: 107 microversion: 2.1 time: 0.073821 Jul 25 12:57:08.061518 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1756/3461] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:57:07 2022] POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action => generated 107 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 25 12:57:08.067232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a797e059-3d02-42c8-8e99-c0136497778e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:08.068030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a797e059-3d02-42c8-8e99-c0136497778e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:08.078346 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a797e059-3d02-42c8-8e99-c0136497778e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:08.079420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a797e059-3d02-42c8-8e99-c0136497778e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:08.080106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a797e059-3d02-42c8-8e99-c0136497778e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:08.081294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a797e059-3d02-42c8-8e99-c0136497778e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:08.137983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-4540fd25-8a2a-4857-bfa8-0117fd9b08c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] validate_networks() for [('dc410446-95e0-4607-b26a-01ef07459e76', None, None, None, None, None), (None, None, '656db462-23e9-4625-a2e7-588155cc7f69', None, None, None), (None, None, '619e5821-f34d-4084-bf18-5b7e99804fef', None, None, None), ('792857f6-8128-491d-bf10-e0bcb5b9c7b3', None, None, None, None, None), ('792857f6-8128-491d-bf10-e0bcb5b9c7b3', None, None, None, None, None), ('83baefc8-bd60-4b18-908e-9fda864290e3', '10.2.2.100', None, None, None, None), ('83baefc8-bd60-4b18-908e-9fda864290e3', '10.2.2.200', None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:57:08.637750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a797e059-3d02-42c8-8e99-c0136497778e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:08.652457 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a797e059-3d02-42c8-8e99-c0136497778e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 200 len: 1317 microversion: 2.1 time: 0.589740 Jul 25 12:57:08.653773 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1757/3462] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:08 2022] GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 1317 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:08.664834 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3f27164f-a415-4c7a-8fcf-0ba0b0629db0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:08.666901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3f27164f-a415-4c7a-8fcf-0ba0b0629db0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:08.676441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f27164f-a415-4c7a-8fcf-0ba0b0629db0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:08.677043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f27164f-a415-4c7a-8fcf-0ba0b0629db0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:08.678099 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f27164f-a415-4c7a-8fcf-0ba0b0629db0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:08.678526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f27164f-a415-4c7a-8fcf-0ba0b0629db0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:08.765273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3f27164f-a415-4c7a-8fcf-0ba0b0629db0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Unlocking {{(pid=125884) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 25 12:57:08.872636 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3f27164f-a415-4c7a-8fcf-0ba0b0629db0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action" status: 202 len: 0 microversion: 2.1 time: 0.216974 Jul 25 12:57:08.873336 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1758/3463] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:57:08 2022] POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:57:08.880085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a274f6bc-fcfa-4881-9eb0-47a97e32901c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:08.880723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a274f6bc-fcfa-4881-9eb0-47a97e32901c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:08.891041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a274f6bc-fcfa-4881-9eb0-47a97e32901c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:08.891812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a274f6bc-fcfa-4881-9eb0-47a97e32901c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:08.892752 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a274f6bc-fcfa-4881-9eb0-47a97e32901c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:08.893387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a274f6bc-fcfa-4881-9eb0-47a97e32901c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:09.392296 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a274f6bc-fcfa-4881-9eb0-47a97e32901c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:09.407735 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a274f6bc-fcfa-4881-9eb0-47a97e32901c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9" status: 200 len: 1500 microversion: 2.1 time: 0.532907 Jul 25 12:57:09.424108 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1759/3464] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:08 2022] GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 => generated 1500 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:09.439068 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4cb716f3-f1ec-4d93-9c2a-961b5c1b543e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:09.449149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4cb716f3-f1ec-4d93-9c2a-961b5c1b543e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:09.449893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4cb716f3-f1ec-4d93-9c2a-961b5c1b543e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:09.495302 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4cb716f3-f1ec-4d93-9c2a-961b5c1b543e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Going to try to stop instance {{(pid=125884) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 12:57:09.559632 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4cb716f3-f1ec-4d93-9c2a-961b5c1b543e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action" status: 202 len: 0 microversion: 2.1 time: 0.133175 Jul 25 12:57:09.564048 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1760/3465] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:57:09 2022] POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:57:09.569571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-1c957498-77ab-4848-b463-5a0fac64704e req-ac74f4c6-1253-4df2-995a-83487a781997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "036dbd81-2019-4c7c-84c8-553bdd8729d5", "name": "network-vif-plugged", "status": "completed", "tag": "ec36eb88-2201-46ff-892c-bef82b5e893e"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:09.599283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-1c957498-77ab-4848-b463-5a0fac64704e req-ac74f4c6-1253-4df2-995a-83487a781997 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:09.599942 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-1c957498-77ab-4848-b463-5a0fac64704e req-ac74f4c6-1253-4df2-995a-83487a781997 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:09.622858 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-1c957498-77ab-4848-b463-5a0fac64704e req-ac74f4c6-1253-4df2-995a-83487a781997 service nova] Creating event network-vif-plugged:ec36eb88-2201-46ff-892c-bef82b5e893e for instance 036dbd81-2019-4c7c-84c8-553bdd8729d5 on n-h2-848886-15 Jul 25 12:57:09.636710 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-1c957498-77ab-4848-b463-5a0fac64704e req-ac74f4c6-1253-4df2-995a-83487a781997 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071107 Jul 25 12:57:09.640638 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1761/3466] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:57:09.656038 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-65fe44d5-13c3-46a9-9a7b-f1848bf4d3d9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:09.657172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-65fe44d5-13c3-46a9-9a7b-f1848bf4d3d9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:09.675392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65fe44d5-13c3-46a9-9a7b-f1848bf4d3d9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:09.676517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65fe44d5-13c3-46a9-9a7b-f1848bf4d3d9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:09.678469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65fe44d5-13c3-46a9-9a7b-f1848bf4d3d9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:09.682540 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65fe44d5-13c3-46a9-9a7b-f1848bf4d3d9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:10.429970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=20 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:10.594762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-65fe44d5-13c3-46a9-9a7b-f1848bf4d3d9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:10.603022 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-65fe44d5-13c3-46a9-9a7b-f1848bf4d3d9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1679 microversion: 2.1 time: 0.960897 Jul 25 12:57:10.603700 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1762/3467] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:09 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1679 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:10.609398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-538c6f5d-f613-43f8-b094-69f1329bde9c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:10.610207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-538c6f5d-f613-43f8-b094-69f1329bde9c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:10.616660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-538c6f5d-f613-43f8-b094-69f1329bde9c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:10.617476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-538c6f5d-f613-43f8-b094-69f1329bde9c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:10.618314 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-538c6f5d-f613-43f8-b094-69f1329bde9c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:10.618752 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-538c6f5d-f613-43f8-b094-69f1329bde9c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:10.954405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-538c6f5d-f613-43f8-b094-69f1329bde9c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:10.970460 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-538c6f5d-f613-43f8-b094-69f1329bde9c tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 200 len: 1317 microversion: 2.1 time: 0.364844 Jul 25 12:57:10.971377 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1763/3468] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:10 2022] GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:10.988433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-73578299-02f8-4b18-a9dc-7ab1be6fd309 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:10.989066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-73578299-02f8-4b18-a9dc-7ab1be6fd309 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:11.007832 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-73578299-02f8-4b18-a9dc-7ab1be6fd309 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:11.008564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-73578299-02f8-4b18-a9dc-7ab1be6fd309 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:11.009535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-73578299-02f8-4b18-a9dc-7ab1be6fd309 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:11.010144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-73578299-02f8-4b18-a9dc-7ab1be6fd309 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:11.083418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-73578299-02f8-4b18-a9dc-7ab1be6fd309 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:11.085713 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-73578299-02f8-4b18-a9dc-7ab1be6fd309 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:11.091549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-73578299-02f8-4b18-a9dc-7ab1be6fd309 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lazy-loading 'fault' on Instance uuid e4550c3f-cb00-410c-ad78-9f348258ece9 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:57:11.177101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-73578299-02f8-4b18-a9dc-7ab1be6fd309 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28f966411004a158377c689fd5b05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07680a55b3f41408d3a284d1330503d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:11.200749 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-73578299-02f8-4b18-a9dc-7ab1be6fd309 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9" status: 200 len: 1305 microversion: 2.1 time: 0.228085 Jul 25 12:57:11.202666 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1764/3469] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:10 2022] GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 => generated 1305 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:11.207952 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-f224e5c9-e1a6-448b-80c2-f3ce8da5326f req-7bd83b58-c89c-48d8-9db7-12352efb1dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4550c3f-cb00-410c-ad78-9f348258ece9", "name": "network-vif-deleted", "tag": "36e85a01-7719-4297-a8af-f959b76d2931"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:11.235821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f224e5c9-e1a6-448b-80c2-f3ce8da5326f req-7bd83b58-c89c-48d8-9db7-12352efb1dee service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:11.239542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f224e5c9-e1a6-448b-80c2-f3ce8da5326f req-7bd83b58-c89c-48d8-9db7-12352efb1dee service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:11.260193 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-f224e5c9-e1a6-448b-80c2-f3ce8da5326f req-7bd83b58-c89c-48d8-9db7-12352efb1dee service nova] Creating event network-vif-deleted:36e85a01-7719-4297-a8af-f959b76d2931 for instance e4550c3f-cb00-410c-ad78-9f348258ece9 on n-h1-848886-15 Jul 25 12:57:11.266071 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-f224e5c9-e1a6-448b-80c2-f3ce8da5326f req-7bd83b58-c89c-48d8-9db7-12352efb1dee service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061136 Jul 25 12:57:11.267372 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1765/3470] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:57:11.626911 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9dcc5de8-970d-40db-933b-5663a73256d7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:11.629360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9dcc5de8-970d-40db-933b-5663a73256d7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:11.638561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9dcc5de8-970d-40db-933b-5663a73256d7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:11.639791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9dcc5de8-970d-40db-933b-5663a73256d7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:11.640892 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9dcc5de8-970d-40db-933b-5663a73256d7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:11.642868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9dcc5de8-970d-40db-933b-5663a73256d7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:12.000660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9dcc5de8-970d-40db-933b-5663a73256d7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:12.011622 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9dcc5de8-970d-40db-933b-5663a73256d7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1679 microversion: 2.1 time: 0.387068 Jul 25 12:57:12.014193 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1766/3471] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:11 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1679 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:57:12.025775 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-11334290-65dc-4cab-bc9c-b25cbf259d7f tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:12.026885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-11334290-65dc-4cab-bc9c-b25cbf259d7f tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:12.042928 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11334290-65dc-4cab-bc9c-b25cbf259d7f tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:12.043364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11334290-65dc-4cab-bc9c-b25cbf259d7f tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:12.044142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11334290-65dc-4cab-bc9c-b25cbf259d7f tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:12.044653 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11334290-65dc-4cab-bc9c-b25cbf259d7f tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:12.422362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-11334290-65dc-4cab-bc9c-b25cbf259d7f tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:12.434996 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-11334290-65dc-4cab-bc9c-b25cbf259d7f tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 200 len: 1506 microversion: 2.1 time: 0.419382 Jul 25 12:57:12.436532 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1767/3472] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:12 2022] GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 1506 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:12.457761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6e9faee6-c932-479a-b893-bacfb05ffd3c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:12.459493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6e9faee6-c932-479a-b893-bacfb05ffd3c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:12.475362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e9faee6-c932-479a-b893-bacfb05ffd3c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:12.476564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e9faee6-c932-479a-b893-bacfb05ffd3c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:12.479198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e9faee6-c932-479a-b893-bacfb05ffd3c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:12.479879 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e9faee6-c932-479a-b893-bacfb05ffd3c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:12.515351 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-6e9faee6-c932-479a-b893-bacfb05ffd3c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] HTTP exception thrown: Instance e4550c3f-cb00-410c-ad78-9f348258ece9 could not be found. Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6e9faee6-c932-479a-b893-bacfb05ffd3c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Request method failure captured: Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 HTTP/1.1 Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pHF7UCaF8gOsr4izIJsQMgDEa0djLGcj88wHujy3LL3KrSKed1jp5p2g1uyl0B7FckQX0z38dpjtGtJDzQMYAlTS7LRfENWczpgFqPzdGM6KYoCp6qrqJdc7QEkc58SEBAWEj2A4h5-asWJS2CIcfkxwvHFTYem8sDn2kkqArMxtZA Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f07680a55b3f41408d3a284d1330503d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}] Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: d28f966411004a158377c689fd5b05eb Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance e4550c3f-cb00-410c-ad78-9f348258ece9 could not be found. Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'e4550c3f-cb00-410c-ad78-9f348258ece9'} Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4550c3f-cb00-410c-ad78-9f348258ece9 could not be found. Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4550c3f-cb00-410c-ad78-9f348258ece9 could not be found. Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:12.517175 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:12.523411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:12.523411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:12.523411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:12.523411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:57:12.523411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:57:12.523411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4550c3f-cb00-410c-ad78-9f348258ece9 could not be found. Jul 25 12:57:12.523411 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:12.523411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6e9faee6-c932-479a-b893-bacfb05ffd3c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Returning 404 to user: Instance e4550c3f-cb00-410c-ad78-9f348258ece9 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:57:12.523411 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6e9faee6-c932-479a-b893-bacfb05ffd3c tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9" status: 404 len: 111 microversion: 2.1 time: 0.080951 Jul 25 12:57:12.523411 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1768/3473] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:12 2022] GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:57:12.539052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4cd589fb-5ded-4bb0-becb-85571aaf5265 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:12.539665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4cd589fb-5ded-4bb0-becb-85571aaf5265 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:12.556185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4cd589fb-5ded-4bb0-becb-85571aaf5265 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:12.557033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4cd589fb-5ded-4bb0-becb-85571aaf5265 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:12.557841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4cd589fb-5ded-4bb0-becb-85571aaf5265 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:12.558368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4cd589fb-5ded-4bb0-becb-85571aaf5265 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:12.816119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4cd589fb-5ded-4bb0-becb-85571aaf5265 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:12.822281 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4cd589fb-5ded-4bb0-becb-85571aaf5265 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 200 len: 1506 microversion: 2.1 time: 0.301933 Jul 25 12:57:12.822870 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1769/3474] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:12 2022] GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 1506 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:12.833600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7c70a5b0-47d3-4240-a37b-0c9922b54947 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:12.833600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7c70a5b0-47d3-4240-a37b-0c9922b54947 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:12.851896 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c70a5b0-47d3-4240-a37b-0c9922b54947 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:12.852357 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c70a5b0-47d3-4240-a37b-0c9922b54947 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:12.854362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c70a5b0-47d3-4240-a37b-0c9922b54947 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:12.856504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c70a5b0-47d3-4240-a37b-0c9922b54947 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:12.894762 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-7c70a5b0-47d3-4240-a37b-0c9922b54947 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] HTTP exception thrown: Instance e4550c3f-cb00-410c-ad78-9f348258ece9 could not be found. Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7c70a5b0-47d3-4240-a37b-0c9922b54947 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Request method failure captured: Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 HTTP/1.1 Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pHF7UCaF8gOsr4izIJsQMgDEa0djLGcj88wHujy3LL3KrSKed1jp5p2g1uyl0B7FckQX0z38dpjtGtJDzQMYAlTS7LRfENWczpgFqPzdGM6KYoCp6qrqJdc7QEkc58SEBAWEj2A4h5-asWJS2CIcfkxwvHFTYem8sDn2kkqArMxtZA Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f07680a55b3f41408d3a284d1330503d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}] Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: d28f966411004a158377c689fd5b05eb Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance e4550c3f-cb00-410c-ad78-9f348258ece9 could not be found. Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'e4550c3f-cb00-410c-ad78-9f348258ece9'} Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4550c3f-cb00-410c-ad78-9f348258ece9 could not be found. Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:57:12.897399 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:57:12.900406 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4550c3f-cb00-410c-ad78-9f348258ece9 could not be found. Jul 25 12:57:12.900406 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:12.900406 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:12.900406 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:12.900406 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:12.900406 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:12.900406 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:12.900406 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:57:12.900406 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:57:12.900406 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4550c3f-cb00-410c-ad78-9f348258ece9 could not be found. Jul 25 12:57:12.900406 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:12.902472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7c70a5b0-47d3-4240-a37b-0c9922b54947 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Returning 404 to user: Instance e4550c3f-cb00-410c-ad78-9f348258ece9 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:57:12.903755 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7c70a5b0-47d3-4240-a37b-0c9922b54947 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9" status: 404 len: 111 microversion: 2.1 time: 0.079960 Jul 25 12:57:12.904820 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1770/3475] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:57:12 2022] DELETE /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:57:12.910077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-881abcae-ad05-4453-bf72-6735bdef5e49 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:12.912775 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-881abcae-ad05-4453-bf72-6735bdef5e49 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:12.919585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-881abcae-ad05-4453-bf72-6735bdef5e49 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:12.920305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-881abcae-ad05-4453-bf72-6735bdef5e49 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:12.921360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-881abcae-ad05-4453-bf72-6735bdef5e49 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:12.922352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-881abcae-ad05-4453-bf72-6735bdef5e49 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:12.962752 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:13.026193 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-881abcae-ad05-4453-bf72-6735bdef5e49 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "PUT /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 200 len: 1078 microversion: 2.1 time: 0.120003 Jul 25 12:57:13.027177 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1771/3476] 10.222.0.49 () {60 vars in 1256 bytes} [Mon Jul 25 12:57:12 2022] PUT /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 1078 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:13.032485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c426337c-b90b-4334-b8d6-43b72c16e5eb tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:13.033101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c426337c-b90b-4334-b8d6-43b72c16e5eb tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: e4550c3f-cb00-410c-ad78-9f348258ece9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:13.049958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c426337c-b90b-4334-b8d6-43b72c16e5eb tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:13.050706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c426337c-b90b-4334-b8d6-43b72c16e5eb tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:13.052287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c426337c-b90b-4334-b8d6-43b72c16e5eb tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:13.054970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c426337c-b90b-4334-b8d6-43b72c16e5eb tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:13.089285 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-c426337c-b90b-4334-b8d6-43b72c16e5eb tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] HTTP exception thrown: Instance e4550c3f-cb00-410c-ad78-9f348258ece9 could not be found. Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c426337c-b90b-4334-b8d6-43b72c16e5eb tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Request method failure captured: Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 HTTP/1.1 Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pHF7UCaF8gOsr4izIJsQMgDEa0djLGcj88wHujy3LL3KrSKed1jp5p2g1uyl0B7FckQX0z38dpjtGtJDzQMYAlTS7LRfENWczpgFqPzdGM6KYoCp6qrqJdc7QEkc58SEBAWEj2A4h5-asWJS2CIcfkxwvHFTYem8sDn2kkqArMxtZA Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f07680a55b3f41408d3a284d1330503d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}] Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: d28f966411004a158377c689fd5b05eb Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance e4550c3f-cb00-410c-ad78-9f348258ece9 could not be found. Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'e4550c3f-cb00-410c-ad78-9f348258ece9'} Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4550c3f-cb00-410c-ad78-9f348258ece9 could not be found. Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4550c3f-cb00-410c-ad78-9f348258ece9 could not be found. Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:13.090860 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:13.094687 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:13.094687 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:13.094687 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:13.094687 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:57:13.094687 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:57:13.094687 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4550c3f-cb00-410c-ad78-9f348258ece9 could not be found. Jul 25 12:57:13.094687 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:13.094687 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c426337c-b90b-4334-b8d6-43b72c16e5eb tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Returning 404 to user: Instance e4550c3f-cb00-410c-ad78-9f348258ece9 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:57:13.094687 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c426337c-b90b-4334-b8d6-43b72c16e5eb tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9" status: 404 len: 111 microversion: 2.1 time: 0.064199 Jul 25 12:57:13.094687 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1772/3477] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:13 2022] GET /compute/v2.1/servers/e4550c3f-cb00-410c-ad78-9f348258ece9 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:57:13.098207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d91830c7-4889-4b3e-923b-91b5845da958 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:13.098823 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d91830c7-4889-4b3e-923b-91b5845da958 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:13.100750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:13.111020 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d91830c7-4889-4b3e-923b-91b5845da958 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:13.118096 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d91830c7-4889-4b3e-923b-91b5845da958 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:13.119221 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d91830c7-4889-4b3e-923b-91b5845da958 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:13.119712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d91830c7-4889-4b3e-923b-91b5845da958 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:13.275548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4540fd25-8a2a-4857-bfa8-0117fd9b08c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:57:13.276510 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4540fd25-8a2a-4857-bfa8-0117fd9b08c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:57:13.277151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4540fd25-8a2a-4857-bfa8-0117fd9b08c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:57:13.277924 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4540fd25-8a2a-4857-bfa8-0117fd9b08c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:57:13.278027 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4540fd25-8a2a-4857-bfa8-0117fd9b08c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:57:13.295955 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4540fd25-8a2a-4857-bfa8-0117fd9b08c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:13.296658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4540fd25-8a2a-4857-bfa8-0117fd9b08c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:13.297655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4540fd25-8a2a-4857-bfa8-0117fd9b08c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:13.300020 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4540fd25-8a2a-4857-bfa8-0117fd9b08c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:13.383411 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-4540fd25-8a2a-4857-bfa8-0117fd9b08c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Getting quotas for project cd52d102917f4b968a0f06c93f37994a. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:57:13.414852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-4540fd25-8a2a-4857-bfa8-0117fd9b08c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Getting quotas for user 30345ec1766e4f29a7393616070201bd and project cd52d102917f4b968a0f06c93f37994a. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:57:13.462544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d91830c7-4889-4b3e-923b-91b5845da958 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:13.478628 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d91830c7-4889-4b3e-923b-91b5845da958 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1679 microversion: 2.1 time: 0.384068 Jul 25 12:57:13.479712 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1773/3478] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:13 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1679 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:13.489364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b69dd871-5dab-482c-a860-764c54a0f172 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:13.490400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b69dd871-5dab-482c-a860-764c54a0f172 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:13.497017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b69dd871-5dab-482c-a860-764c54a0f172 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:13.497610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b69dd871-5dab-482c-a860-764c54a0f172 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:13.498489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b69dd871-5dab-482c-a860-764c54a0f172 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:13.498990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b69dd871-5dab-482c-a860-764c54a0f172 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:13.700733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4540fd25-8a2a-4857-bfa8-0117fd9b08c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:57:13.703858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4540fd25-8a2a-4857-bfa8-0117fd9b08c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='107996da-45ea-4ef0-a252-f8451a5bd709',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c9969b68-02e1-4453-bb6b-246631efd94b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='74cbe7da-4fb9-4d8a-8582-da8acc123f19',volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:57:13.760440 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b69dd871-5dab-482c-a860-764c54a0f172 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:13.769056 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b69dd871-5dab-482c-a860-764c54a0f172 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 200 len: 1504 microversion: 2.1 time: 0.286332 Jul 25 12:57:13.777599 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1774/3479] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:13 2022] GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 1504 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:13.794985 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dc1895b7-5740-4aba-a71c-2fe1df91f922 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:13.795720 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dc1895b7-5740-4aba-a71c-2fe1df91f922 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:13.809118 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc1895b7-5740-4aba-a71c-2fe1df91f922 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:13.810385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc1895b7-5740-4aba-a71c-2fe1df91f922 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:13.811383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc1895b7-5740-4aba-a71c-2fe1df91f922 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:13.812533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc1895b7-5740-4aba-a71c-2fe1df91f922 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:13.862366 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-dc1895b7-5740-4aba-a71c-2fe1df91f922 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] HTTP exception thrown: Instance 975ed5ee-8529-4421-b5ad-531e0caa8c16 could not be found. Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dc1895b7-5740-4aba-a71c-2fe1df91f922 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Request method failure captured: Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 HTTP/1.1 Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pHF7UCaF8gOsr4izIJsQMgDEa0djLGcj88wHujy3LL3KrSKed1jp5p2g1uyl0B7FckQX0z38dpjtGtJDzQMYAlTS7LRfENWczpgFqPzdGM6KYoCp6qrqJdc7QEkc58SEBAWEj2A4h5-asWJS2CIcfkxwvHFTYem8sDn2kkqArMxtZA Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f07680a55b3f41408d3a284d1330503d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}] Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: d28f966411004a158377c689fd5b05eb Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 975ed5ee-8529-4421-b5ad-531e0caa8c16 could not be found. Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '975ed5ee-8529-4421-b5ad-531e0caa8c16'} Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 975ed5ee-8529-4421-b5ad-531e0caa8c16 could not be found. Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:57:13.869508 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:57:13.873532 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 975ed5ee-8529-4421-b5ad-531e0caa8c16 could not be found. Jul 25 12:57:13.873532 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:13.873532 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:13.873532 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:13.873532 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:13.873532 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:13.873532 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:13.873532 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:57:13.873532 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:57:13.873532 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 975ed5ee-8529-4421-b5ad-531e0caa8c16 could not be found. Jul 25 12:57:13.873532 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:13.873532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dc1895b7-5740-4aba-a71c-2fe1df91f922 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Returning 404 to user: Instance 975ed5ee-8529-4421-b5ad-531e0caa8c16 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:57:13.873532 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dc1895b7-5740-4aba-a71c-2fe1df91f922 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 404 len: 111 microversion: 2.1 time: 0.092166 Jul 25 12:57:13.873532 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1775/3480] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:57:13 2022] DELETE /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:57:13.876722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bf2b3a64-587e-4363-9252-f20b9665984a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:13.877317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bf2b3a64-587e-4363-9252-f20b9665984a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:13.894423 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf2b3a64-587e-4363-9252-f20b9665984a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:13.895279 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf2b3a64-587e-4363-9252-f20b9665984a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:13.896687 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf2b3a64-587e-4363-9252-f20b9665984a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:13.898830 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf2b3a64-587e-4363-9252-f20b9665984a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:14.174310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bf2b3a64-587e-4363-9252-f20b9665984a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:14.187573 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bf2b3a64-587e-4363-9252-f20b9665984a tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 200 len: 1504 microversion: 2.1 time: 0.314430 Jul 25 12:57:14.189050 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1776/3481] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:13 2022] GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 1504 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:14.195745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-166c6e94-1b50-4426-85dc-7effd8aee052 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:14.196375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-166c6e94-1b50-4426-85dc-7effd8aee052 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 975ed5ee-8529-4421-b5ad-531e0caa8c16] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:14.208157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-166c6e94-1b50-4426-85dc-7effd8aee052 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:14.208616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-166c6e94-1b50-4426-85dc-7effd8aee052 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:14.209399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-166c6e94-1b50-4426-85dc-7effd8aee052 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:14.209883 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-166c6e94-1b50-4426-85dc-7effd8aee052 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:14.224826 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-166c6e94-1b50-4426-85dc-7effd8aee052 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] HTTP exception thrown: Instance 975ed5ee-8529-4421-b5ad-531e0caa8c16 could not be found. Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-166c6e94-1b50-4426-85dc-7effd8aee052 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Request method failure captured: Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 HTTP/1.1 Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pHF7UCaF8gOsr4izIJsQMgDEa0djLGcj88wHujy3LL3KrSKed1jp5p2g1uyl0B7FckQX0z38dpjtGtJDzQMYAlTS7LRfENWczpgFqPzdGM6KYoCp6qrqJdc7QEkc58SEBAWEj2A4h5-asWJS2CIcfkxwvHFTYem8sDn2kkqArMxtZA Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f07680a55b3f41408d3a284d1330503d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}] Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: d28f966411004a158377c689fd5b05eb Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 975ed5ee-8529-4421-b5ad-531e0caa8c16 could not be found. Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '975ed5ee-8529-4421-b5ad-531e0caa8c16'} Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 975ed5ee-8529-4421-b5ad-531e0caa8c16 could not be found. Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 975ed5ee-8529-4421-b5ad-531e0caa8c16 could not be found. Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:14.226415 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.230537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:14.230537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:14.230537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:14.230537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:57:14.230537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:57:14.230537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 975ed5ee-8529-4421-b5ad-531e0caa8c16 could not be found. Jul 25 12:57:14.230537 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.230537 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-166c6e94-1b50-4426-85dc-7effd8aee052 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Returning 404 to user: Instance 975ed5ee-8529-4421-b5ad-531e0caa8c16 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:57:14.230537 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-166c6e94-1b50-4426-85dc-7effd8aee052 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16" status: 404 len: 111 microversion: 2.1 time: 0.037229 Jul 25 12:57:14.232413 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1777/3482] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:14 2022] GET /compute/v2.1/servers/975ed5ee-8529-4421-b5ad-531e0caa8c16 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:57:14.237657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9b398630-cde5-4a41-896c-a29b2de68f0d tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:14.240472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9b398630-cde5-4a41-896c-a29b2de68f0d tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:14.247142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b398630-cde5-4a41-896c-a29b2de68f0d tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:14.247602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b398630-cde5-4a41-896c-a29b2de68f0d tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:14.248433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b398630-cde5-4a41-896c-a29b2de68f0d tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:14.248872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b398630-cde5-4a41-896c-a29b2de68f0d tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:14.274066 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4540fd25-8a2a-4857-bfa8-0117fd9b08c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 6.561646 Jul 25 12:57:14.275142 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1706/3483] 10.222.0.49 () {62 vars in 1189 bytes} [Mon Jul 25 12:57:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 6563 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 12:57:14.280617 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f98b2c85-1a88-4689-90bb-d8f44c8fda85 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:14.281895 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f98b2c85-1a88-4689-90bb-d8f44c8fda85 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:14.288909 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f98b2c85-1a88-4689-90bb-d8f44c8fda85 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:14.289871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f98b2c85-1a88-4689-90bb-d8f44c8fda85 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:14.290958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f98b2c85-1a88-4689-90bb-d8f44c8fda85 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:14.291646 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f98b2c85-1a88-4689-90bb-d8f44c8fda85 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:14.309704 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-f98b2c85-1a88-4689-90bb-d8f44c8fda85 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] HTTP exception thrown: Instance c9cc21b1-7442-4031-b701-b534f237749f could not be found. Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f98b2c85-1a88-4689-90bb-d8f44c8fda85 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Request method failure captured: Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f HTTP/1.1 Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pHF7UCaF8gOsr4izIJsQMgDEa0djLGcj88wHujy3LL3KrSKed1jp5p2g1uyl0B7FckQX0z38dpjtGtJDzQMYAlTS7LRfENWczpgFqPzdGM6KYoCp6qrqJdc7QEkc58SEBAWEj2A4h5-asWJS2CIcfkxwvHFTYem8sDn2kkqArMxtZA Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f07680a55b3f41408d3a284d1330503d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}] Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: d28f966411004a158377c689fd5b05eb Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance c9cc21b1-7442-4031-b701-b534f237749f could not be found. Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'c9cc21b1-7442-4031-b701-b534f237749f'} Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9cc21b1-7442-4031-b701-b534f237749f could not be found. Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:57:14.311957 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:57:14.315226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9cc21b1-7442-4031-b701-b534f237749f could not be found. Jul 25 12:57:14.315226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.315226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:14.315226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.315226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:14.315226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:14.315226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:14.315226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:57:14.315226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:57:14.315226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9cc21b1-7442-4031-b701-b534f237749f could not be found. Jul 25 12:57:14.315226 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.315226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f98b2c85-1a88-4689-90bb-d8f44c8fda85 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Returning 404 to user: Instance c9cc21b1-7442-4031-b701-b534f237749f could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:57:14.315226 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f98b2c85-1a88-4689-90bb-d8f44c8fda85 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 404 len: 111 microversion: 2.1 time: 0.037080 Jul 25 12:57:14.315226 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1707/3484] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:57:14 2022] DELETE /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:57:14.319214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b9370b6c-61ba-4eec-9f36-d2e1c4b1c58a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:14.319833 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b9370b6c-61ba-4eec-9f36-d2e1c4b1c58a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:14.334195 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9b398630-cde5-4a41-896c-a29b2de68f0d tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "PUT /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 200 len: 1080 microversion: 2.1 time: 0.100468 Jul 25 12:57:14.334842 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1778/3485] 10.222.0.49 () {60 vars in 1256 bytes} [Mon Jul 25 12:57:14 2022] PUT /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 1080 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:14.339806 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c0707803-1197-4216-a63b-d0a9e3b469cd tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:14.340480 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c0707803-1197-4216-a63b-d0a9e3b469cd tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: c9cc21b1-7442-4031-b701-b534f237749f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:14.347255 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c0707803-1197-4216-a63b-d0a9e3b469cd tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:14.348292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c0707803-1197-4216-a63b-d0a9e3b469cd tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:14.349295 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c0707803-1197-4216-a63b-d0a9e3b469cd tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:14.350077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c0707803-1197-4216-a63b-d0a9e3b469cd tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:14.365515 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-c0707803-1197-4216-a63b-d0a9e3b469cd tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] HTTP exception thrown: Instance c9cc21b1-7442-4031-b701-b534f237749f could not be found. Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c0707803-1197-4216-a63b-d0a9e3b469cd tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Request method failure captured: Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f HTTP/1.1 Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pHF7UCaF8gOsr4izIJsQMgDEa0djLGcj88wHujy3LL3KrSKed1jp5p2g1uyl0B7FckQX0z38dpjtGtJDzQMYAlTS7LRfENWczpgFqPzdGM6KYoCp6qrqJdc7QEkc58SEBAWEj2A4h5-asWJS2CIcfkxwvHFTYem8sDn2kkqArMxtZA Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f07680a55b3f41408d3a284d1330503d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}] Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: d28f966411004a158377c689fd5b05eb Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance c9cc21b1-7442-4031-b701-b534f237749f could not be found. Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'c9cc21b1-7442-4031-b701-b534f237749f'} Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9cc21b1-7442-4031-b701-b534f237749f could not be found. Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9cc21b1-7442-4031-b701-b534f237749f could not be found. Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:14.367221 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.371539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:14.371539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:14.371539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:14.371539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:57:14.371539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:57:14.371539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9cc21b1-7442-4031-b701-b534f237749f could not be found. Jul 25 12:57:14.371539 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.371539 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c0707803-1197-4216-a63b-d0a9e3b469cd tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Returning 404 to user: Instance c9cc21b1-7442-4031-b701-b534f237749f could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:57:14.371539 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c0707803-1197-4216-a63b-d0a9e3b469cd tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f" status: 404 len: 111 microversion: 2.1 time: 0.032939 Jul 25 12:57:14.371539 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1779/3486] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:14 2022] GET /compute/v2.1/servers/c9cc21b1-7442-4031-b701-b534f237749f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:57:14.374468 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-88029794-6c84-4b0f-99fa-346b92df1508 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:14.375202 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-88029794-6c84-4b0f-99fa-346b92df1508 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:14.382203 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88029794-6c84-4b0f-99fa-346b92df1508 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:14.382706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88029794-6c84-4b0f-99fa-346b92df1508 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:14.383782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88029794-6c84-4b0f-99fa-346b92df1508 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:14.384424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88029794-6c84-4b0f-99fa-346b92df1508 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:14.415312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b9370b6c-61ba-4eec-9f36-d2e1c4b1c58a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:14.423248 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b9370b6c-61ba-4eec-9f36-d2e1c4b1c58a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:14.424874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b9370b6c-61ba-4eec-9f36-d2e1c4b1c58a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:14.426419 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b9370b6c-61ba-4eec-9f36-d2e1c4b1c58a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1286 microversion: 2.42 time: 0.111134 Jul 25 12:57:14.427185 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1708/3487] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:14 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1286 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:14.432253 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6957a718-b9b5-44da-afef-447714c778f9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:14.433037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6957a718-b9b5-44da-afef-447714c778f9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:14.439941 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6957a718-b9b5-44da-afef-447714c778f9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:14.440794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6957a718-b9b5-44da-afef-447714c778f9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:14.442045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6957a718-b9b5-44da-afef-447714c778f9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:14.442709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6957a718-b9b5-44da-afef-447714c778f9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:14.461547 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-6957a718-b9b5-44da-afef-447714c778f9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] HTTP exception thrown: Instance 047c2e76-4cae-4e74-b17b-3dfa337dd56e could not be found. Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6957a718-b9b5-44da-afef-447714c778f9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Request method failure captured: Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e HTTP/1.1 Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pHF7UCaF8gOsr4izIJsQMgDEa0djLGcj88wHujy3LL3KrSKed1jp5p2g1uyl0B7FckQX0z38dpjtGtJDzQMYAlTS7LRfENWczpgFqPzdGM6KYoCp6qrqJdc7QEkc58SEBAWEj2A4h5-asWJS2CIcfkxwvHFTYem8sDn2kkqArMxtZA Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f07680a55b3f41408d3a284d1330503d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}] Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: d28f966411004a158377c689fd5b05eb Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 047c2e76-4cae-4e74-b17b-3dfa337dd56e could not be found. Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '047c2e76-4cae-4e74-b17b-3dfa337dd56e'} Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 047c2e76-4cae-4e74-b17b-3dfa337dd56e could not be found. Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:57:14.463559 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:57:14.468033 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 047c2e76-4cae-4e74-b17b-3dfa337dd56e could not be found. Jul 25 12:57:14.468033 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.468033 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:14.468033 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.468033 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:14.468033 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:14.468033 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:14.468033 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:57:14.468033 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:57:14.468033 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 047c2e76-4cae-4e74-b17b-3dfa337dd56e could not be found. Jul 25 12:57:14.468033 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.468033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6957a718-b9b5-44da-afef-447714c778f9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Returning 404 to user: Instance 047c2e76-4cae-4e74-b17b-3dfa337dd56e could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:57:14.468033 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6957a718-b9b5-44da-afef-447714c778f9 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e" status: 404 len: 111 microversion: 2.1 time: 0.037188 Jul 25 12:57:14.468033 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1709/3488] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:57:14 2022] DELETE /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:57:14.479144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6bab2d36-97e4-4587-8a6a-58b9c9ac2b49 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:14.482352 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6bab2d36-97e4-4587-8a6a-58b9c9ac2b49 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 047c2e76-4cae-4e74-b17b-3dfa337dd56e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:14.515741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6bab2d36-97e4-4587-8a6a-58b9c9ac2b49 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:14.516198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6bab2d36-97e4-4587-8a6a-58b9c9ac2b49 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:14.517001 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6bab2d36-97e4-4587-8a6a-58b9c9ac2b49 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:14.517436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6bab2d36-97e4-4587-8a6a-58b9c9ac2b49 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:14.539095 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-6bab2d36-97e4-4587-8a6a-58b9c9ac2b49 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] HTTP exception thrown: Instance 047c2e76-4cae-4e74-b17b-3dfa337dd56e could not be found. Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6bab2d36-97e4-4587-8a6a-58b9c9ac2b49 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Request method failure captured: Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e HTTP/1.1 Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pHF7UCaF8gOsr4izIJsQMgDEa0djLGcj88wHujy3LL3KrSKed1jp5p2g1uyl0B7FckQX0z38dpjtGtJDzQMYAlTS7LRfENWczpgFqPzdGM6KYoCp6qrqJdc7QEkc58SEBAWEj2A4h5-asWJS2CIcfkxwvHFTYem8sDn2kkqArMxtZA Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f07680a55b3f41408d3a284d1330503d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}] Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: d28f966411004a158377c689fd5b05eb Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 047c2e76-4cae-4e74-b17b-3dfa337dd56e could not be found. Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '047c2e76-4cae-4e74-b17b-3dfa337dd56e'} Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 047c2e76-4cae-4e74-b17b-3dfa337dd56e could not be found. Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 047c2e76-4cae-4e74-b17b-3dfa337dd56e could not be found. Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:14.543526 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.549105 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:14.549105 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:14.549105 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:14.549105 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:57:14.549105 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:57:14.549105 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 047c2e76-4cae-4e74-b17b-3dfa337dd56e could not be found. Jul 25 12:57:14.549105 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.549105 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6bab2d36-97e4-4587-8a6a-58b9c9ac2b49 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Returning 404 to user: Instance 047c2e76-4cae-4e74-b17b-3dfa337dd56e could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:57:14.549105 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6bab2d36-97e4-4587-8a6a-58b9c9ac2b49 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e" status: 404 len: 111 microversion: 2.1 time: 0.076907 Jul 25 12:57:14.550298 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1710/3489] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:14 2022] GET /compute/v2.1/servers/047c2e76-4cae-4e74-b17b-3dfa337dd56e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:57:14.560130 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-241f970c-aa94-4430-bef1-4eed01483386 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:14.561686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-241f970c-aa94-4430-bef1-4eed01483386 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:14.573333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-241f970c-aa94-4430-bef1-4eed01483386 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:14.573784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-241f970c-aa94-4430-bef1-4eed01483386 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:14.574828 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-241f970c-aa94-4430-bef1-4eed01483386 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:14.575262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-241f970c-aa94-4430-bef1-4eed01483386 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:14.614261 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-88029794-6c84-4b0f-99fa-346b92df1508 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:14.624167 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-88029794-6c84-4b0f-99fa-346b92df1508 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 200 len: 1506 microversion: 2.1 time: 0.253747 Jul 25 12:57:14.627191 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1780/3490] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:14 2022] GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 1506 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:14.632353 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-00f9b31a-d7cf-4475-a974-9eccacb3c9e1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:14.633097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-00f9b31a-d7cf-4475-a974-9eccacb3c9e1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 50db5351-ca41-4692-ac73-f520a126ee46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:14.639707 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-00f9b31a-d7cf-4475-a974-9eccacb3c9e1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] HTTP exception thrown: Instance 50db5351-ca41-4692-ac73-f520a126ee46 could not be found. Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-00f9b31a-d7cf-4475-a974-9eccacb3c9e1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Request method failure captured: Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/50db5351-ca41-4692-ac73-f520a126ee46 HTTP/1.1 Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pHF7UCaF8gOsr4izIJsQMgDEa0djLGcj88wHujy3LL3KrSKed1jp5p2g1uyl0B7FckQX0z38dpjtGtJDzQMYAlTS7LRfENWczpgFqPzdGM6KYoCp6qrqJdc7QEkc58SEBAWEj2A4h5-asWJS2CIcfkxwvHFTYem8sDn2kkqArMxtZA Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f07680a55b3f41408d3a284d1330503d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}] Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: d28f966411004a158377c689fd5b05eb Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 50db5351-ca41-4692-ac73-f520a126ee46 could not be found. Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '50db5351-ca41-4692-ac73-f520a126ee46'} Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50db5351-ca41-4692-ac73-f520a126ee46 could not be found. Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50db5351-ca41-4692-ac73-f520a126ee46 could not be found. Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:14.641821 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.649015 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:14.649015 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:14.649015 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:14.649015 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:57:14.649015 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:57:14.649015 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50db5351-ca41-4692-ac73-f520a126ee46 could not be found. Jul 25 12:57:14.649015 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:14.649015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-00f9b31a-d7cf-4475-a974-9eccacb3c9e1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Returning 404 to user: Instance 50db5351-ca41-4692-ac73-f520a126ee46 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:57:14.649015 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-00f9b31a-d7cf-4475-a974-9eccacb3c9e1 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/50db5351-ca41-4692-ac73-f520a126ee46" status: 404 len: 111 microversion: 2.1 time: 0.017570 Jul 25 12:57:14.649015 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1781/3491] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:57:14 2022] DELETE /compute/v2.1/servers/50db5351-ca41-4692-ac73-f520a126ee46 => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:57:14.653197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-184c2ba5-10f2-47b6-ae00-49aaed437ae5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:14.653880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-184c2ba5-10f2-47b6-ae00-49aaed437ae5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:14.663237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-184c2ba5-10f2-47b6-ae00-49aaed437ae5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:14.663482 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-184c2ba5-10f2-47b6-ae00-49aaed437ae5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:14.664174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-184c2ba5-10f2-47b6-ae00-49aaed437ae5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:14.664776 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-184c2ba5-10f2-47b6-ae00-49aaed437ae5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:14.955706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-184c2ba5-10f2-47b6-ae00-49aaed437ae5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:14.964300 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-184c2ba5-10f2-47b6-ae00-49aaed437ae5 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 200 len: 1506 microversion: 2.1 time: 0.318311 Jul 25 12:57:14.979474 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1782/3492] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:14 2022] GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 1506 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:14.991207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-043c3ba4-b36c-4f4f-9634-17d6fb07975b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:14.991565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-043c3ba4-b36c-4f4f-9634-17d6fb07975b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 50db5351-ca41-4692-ac73-f520a126ee46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:15.012161 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-043c3ba4-b36c-4f4f-9634-17d6fb07975b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] HTTP exception thrown: Instance 50db5351-ca41-4692-ac73-f520a126ee46 could not be found. Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-043c3ba4-b36c-4f4f-9634-17d6fb07975b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Request method failure captured: Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/50db5351-ca41-4692-ac73-f520a126ee46 HTTP/1.1 Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pHF7UCaF8gOsr4izIJsQMgDEa0djLGcj88wHujy3LL3KrSKed1jp5p2g1uyl0B7FckQX0z38dpjtGtJDzQMYAlTS7LRfENWczpgFqPzdGM6KYoCp6qrqJdc7QEkc58SEBAWEj2A4h5-asWJS2CIcfkxwvHFTYem8sDn2kkqArMxtZA Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f07680a55b3f41408d3a284d1330503d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}] Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: d28f966411004a158377c689fd5b05eb Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 50db5351-ca41-4692-ac73-f520a126ee46 could not be found. Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '50db5351-ca41-4692-ac73-f520a126ee46'} Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50db5351-ca41-4692-ac73-f520a126ee46 could not be found. Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50db5351-ca41-4692-ac73-f520a126ee46 could not be found. Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:15.013720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:15.023085 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:15.023085 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:57:15.023085 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:57:15.023085 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50db5351-ca41-4692-ac73-f520a126ee46 could not be found. Jul 25 12:57:15.023085 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:15.023085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-043c3ba4-b36c-4f4f-9634-17d6fb07975b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Returning 404 to user: Instance 50db5351-ca41-4692-ac73-f520a126ee46 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:57:15.023085 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-043c3ba4-b36c-4f4f-9634-17d6fb07975b tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/50db5351-ca41-4692-ac73-f520a126ee46" status: 404 len: 111 microversion: 2.1 time: 0.045681 Jul 25 12:57:15.023085 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1783/3493] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:14 2022] GET /compute/v2.1/servers/50db5351-ca41-4692-ac73-f520a126ee46 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:57:15.041040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7c763e87-654f-435b-8e2f-245542472705 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:15.043130 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7c763e87-654f-435b-8e2f-245542472705 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:15.056006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c763e87-654f-435b-8e2f-245542472705 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:15.056505 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c763e87-654f-435b-8e2f-245542472705 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:15.057295 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c763e87-654f-435b-8e2f-245542472705 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:15.057743 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c763e87-654f-435b-8e2f-245542472705 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:15.085077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-241f970c-aa94-4430-bef1-4eed01483386 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:15.101349 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-241f970c-aa94-4430-bef1-4eed01483386 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1679 microversion: 2.1 time: 0.547545 Jul 25 12:57:15.103362 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1711/3494] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:14 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1679 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:15.114589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7c763e87-654f-435b-8e2f-245542472705 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:57:15.289823 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7c763e87-654f-435b-8e2f-245542472705 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "DELETE /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 204 len: 0 microversion: 2.1 time: 0.272310 Jul 25 12:57:15.290849 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1784/3495] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:57:15 2022] DELETE /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:57:15.303317 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-684ff2fe-9d3d-4edf-b4de-3cf22ab048bb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:15.303831 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-684ff2fe-9d3d-4edf-b4de-3cf22ab048bb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:15.325973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-684ff2fe-9d3d-4edf-b4de-3cf22ab048bb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:15.326665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-684ff2fe-9d3d-4edf-b4de-3cf22ab048bb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:15.329307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-684ff2fe-9d3d-4edf-b4de-3cf22ab048bb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:15.331389 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-684ff2fe-9d3d-4edf-b4de-3cf22ab048bb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:15.366058 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:15.377977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-684ff2fe-9d3d-4edf-b4de-3cf22ab048bb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:57:15.451072 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f2196801-489a-4af2-8c9e-17423fd7152b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:15.452074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f2196801-489a-4af2-8c9e-17423fd7152b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:15.573153 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.compute.api [None req-684ff2fe-9d3d-4edf-b4de-3cf22ab048bb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Instance is already in deleting state, ignoring this request Jul 25 12:57:15.574032 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-684ff2fe-9d3d-4edf-b4de-3cf22ab048bb tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "DELETE /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 204 len: 0 microversion: 2.1 time: 0.275996 Jul 25 12:57:15.594178 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1712/3496] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:57:15 2022] DELETE /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:57:15.625193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d6d30f69-2fb6-44a7-a7b3-4c4de5d765ff tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:15.626490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d6d30f69-2fb6-44a7-a7b3-4c4de5d765ff tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:15.642420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d6d30f69-2fb6-44a7-a7b3-4c4de5d765ff tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:15.642872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d6d30f69-2fb6-44a7-a7b3-4c4de5d765ff tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:15.644743 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d6d30f69-2fb6-44a7-a7b3-4c4de5d765ff tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:15.645190 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d6d30f69-2fb6-44a7-a7b3-4c4de5d765ff tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:15.659036 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f2196801-489a-4af2-8c9e-17423fd7152b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:15.671387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f2196801-489a-4af2-8c9e-17423fd7152b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:15.679921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f2196801-489a-4af2-8c9e-17423fd7152b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:15.681107 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f2196801-489a-4af2-8c9e-17423fd7152b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1286 microversion: 2.42 time: 0.236286 Jul 25 12:57:15.693925 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1785/3497] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:15 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1286 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:57:15.908308 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d6d30f69-2fb6-44a7-a7b3-4c4de5d765ff tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:15.916902 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d6d30f69-2fb6-44a7-a7b3-4c4de5d765ff tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 200 len: 1512 microversion: 2.1 time: 0.320661 Jul 25 12:57:15.930645 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1713/3498] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:15 2022] GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 1512 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:16.140691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d9c3079f-c10f-4f8b-8c4b-d990de2d78ac tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:16.141506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d9c3079f-c10f-4f8b-8c4b-d990de2d78ac tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:16.169245 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9c3079f-c10f-4f8b-8c4b-d990de2d78ac tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:16.169720 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9c3079f-c10f-4f8b-8c4b-d990de2d78ac tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:16.170583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9c3079f-c10f-4f8b-8c4b-d990de2d78ac tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:16.171019 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9c3079f-c10f-4f8b-8c4b-d990de2d78ac tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:16.436121 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d9c3079f-c10f-4f8b-8c4b-d990de2d78ac tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:16.460929 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d9c3079f-c10f-4f8b-8c4b-d990de2d78ac tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1679 microversion: 2.1 time: 0.336779 Jul 25 12:57:16.474660 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1786/3499] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:16 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1679 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:16.707615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4a4e7d1b-f971-4983-86f5-8f20f94a8c16 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:16.709976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4a4e7d1b-f971-4983-86f5-8f20f94a8c16 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:16.725815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a4e7d1b-f971-4983-86f5-8f20f94a8c16 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:16.726401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a4e7d1b-f971-4983-86f5-8f20f94a8c16 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:16.730334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a4e7d1b-f971-4983-86f5-8f20f94a8c16 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:16.730825 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a4e7d1b-f971-4983-86f5-8f20f94a8c16 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:16.937738 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c5ed48b0-12d7-432e-b7e2-748245a74f19 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:16.938961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c5ed48b0-12d7-432e-b7e2-748245a74f19 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:16.952888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5ed48b0-12d7-432e-b7e2-748245a74f19 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:16.953747 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5ed48b0-12d7-432e-b7e2-748245a74f19 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:16.954897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5ed48b0-12d7-432e-b7e2-748245a74f19 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:16.955441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5ed48b0-12d7-432e-b7e2-748245a74f19 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:16.988682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4a4e7d1b-f971-4983-86f5-8f20f94a8c16 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:17.005962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4a4e7d1b-f971-4983-86f5-8f20f94a8c16 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:17.015076 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4a4e7d1b-f971-4983-86f5-8f20f94a8c16 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:17.023937 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4a4e7d1b-f971-4983-86f5-8f20f94a8c16 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1584 microversion: 2.42 time: 0.321416 Jul 25 12:57:17.027490 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1714/3500] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:16 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1584 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:17.366459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c5ed48b0-12d7-432e-b7e2-748245a74f19 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:17.376682 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c5ed48b0-12d7-432e-b7e2-748245a74f19 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 200 len: 1512 microversion: 2.1 time: 0.442735 Jul 25 12:57:17.385660 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1787/3501] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:16 2022] GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 1512 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:17.483438 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8eaabe72-c4e3-450c-9937-14282d8cf4ae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:17.484279 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8eaabe72-c4e3-450c-9937-14282d8cf4ae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:17.494664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8eaabe72-c4e3-450c-9937-14282d8cf4ae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:17.497724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8eaabe72-c4e3-450c-9937-14282d8cf4ae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:17.498908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8eaabe72-c4e3-450c-9937-14282d8cf4ae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:17.499596 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8eaabe72-c4e3-450c-9937-14282d8cf4ae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:18.061098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6003e159-5b5b-416b-85c5-2feedbca44c1 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:18.061738 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6003e159-5b5b-416b-85c5-2feedbca44c1 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:18.075224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6003e159-5b5b-416b-85c5-2feedbca44c1 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:18.076263 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6003e159-5b5b-416b-85c5-2feedbca44c1 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:18.078287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6003e159-5b5b-416b-85c5-2feedbca44c1 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:18.080137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6003e159-5b5b-416b-85c5-2feedbca44c1 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:18.237002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8eaabe72-c4e3-450c-9937-14282d8cf4ae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:18.249415 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8eaabe72-c4e3-450c-9937-14282d8cf4ae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1679 microversion: 2.1 time: 0.770473 Jul 25 12:57:18.275448 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1715/3502] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:17 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1679 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:18.288430 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6003e159-5b5b-416b-85c5-2feedbca44c1 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:18.299639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6003e159-5b5b-416b-85c5-2feedbca44c1 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:18.301507 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6003e159-5b5b-416b-85c5-2feedbca44c1 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:18.302890 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6003e159-5b5b-416b-85c5-2feedbca44c1 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1594 microversion: 2.42 time: 0.246864 Jul 25 12:57:18.318853 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1788/3503] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:18 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1594 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:18.411043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2cd0b313-b2ab-405f-92d1-d9895f90ce78 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:18.411838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2cd0b313-b2ab-405f-92d1-d9895f90ce78 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:18.422246 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2cd0b313-b2ab-405f-92d1-d9895f90ce78 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:18.424747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2cd0b313-b2ab-405f-92d1-d9895f90ce78 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:18.429886 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2cd0b313-b2ab-405f-92d1-d9895f90ce78 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:18.430680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2cd0b313-b2ab-405f-92d1-d9895f90ce78 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:18.608668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2cd0b313-b2ab-405f-92d1-d9895f90ce78 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8b20388de843f2a2aa0cf53dc80f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cbcc6833214e07840dc9beaf9bea78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:18.625139 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2cd0b313-b2ab-405f-92d1-d9895f90ce78 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 200 len: 1470 microversion: 2.1 time: 0.218230 Jul 25 12:57:18.625751 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1716/3504] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:18 2022] GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 1470 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:18.850281 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-d008e3b4-ea4e-4f66-a341-c85609021ef0 req-ff533da4-dd8a-48ba-be8c-e063bea310b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "036dbd81-2019-4c7c-84c8-553bdd8729d5", "name": "network-vif-deleted", "tag": "ec36eb88-2201-46ff-892c-bef82b5e893e"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:18.872991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d008e3b4-ea4e-4f66-a341-c85609021ef0 req-ff533da4-dd8a-48ba-be8c-e063bea310b9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:18.879588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d008e3b4-ea4e-4f66-a341-c85609021ef0 req-ff533da4-dd8a-48ba-be8c-e063bea310b9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:18.940702 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-d008e3b4-ea4e-4f66-a341-c85609021ef0 req-ff533da4-dd8a-48ba-be8c-e063bea310b9 service nova] Creating event network-vif-deleted:ec36eb88-2201-46ff-892c-bef82b5e893e for instance 036dbd81-2019-4c7c-84c8-553bdd8729d5 on n-h2-848886-15 Jul 25 12:57:18.961699 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-d008e3b4-ea4e-4f66-a341-c85609021ef0 req-ff533da4-dd8a-48ba-be8c-e063bea310b9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115518 Jul 25 12:57:18.963735 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1789/3505] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:57:19.290304 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a83f840c-0570-4d71-8c85-4824bd49c2ce tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:19.291056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a83f840c-0570-4d71-8c85-4824bd49c2ce tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:19.315363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a83f840c-0570-4d71-8c85-4824bd49c2ce tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:19.315830 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a83f840c-0570-4d71-8c85-4824bd49c2ce tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:19.318118 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a83f840c-0570-4d71-8c85-4824bd49c2ce tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:19.323994 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a83f840c-0570-4d71-8c85-4824bd49c2ce tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:19.332167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6b970a17-32a8-4135-9884-e9fdf1cc6da2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:19.333175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6b970a17-32a8-4135-9884-e9fdf1cc6da2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:19.363144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b970a17-32a8-4135-9884-e9fdf1cc6da2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:19.364932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b970a17-32a8-4135-9884-e9fdf1cc6da2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:19.366228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b970a17-32a8-4135-9884-e9fdf1cc6da2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:19.370419 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b970a17-32a8-4135-9884-e9fdf1cc6da2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:21.059395 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a83f840c-0570-4d71-8c85-4824bd49c2ce tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:21.070244 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a83f840c-0570-4d71-8c85-4824bd49c2ce tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1679 microversion: 2.1 time: 1.783507 Jul 25 12:57:21.085243 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1717/3506] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:19 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1679 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:21.094809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-98ea2ec8-71d5-4b40-a17d-36d5a56ebbe7 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:21.095593 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-98ea2ec8-71d5-4b40-a17d-36d5a56ebbe7 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 036dbd81-2019-4c7c-84c8-553bdd8729d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:21.103540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98ea2ec8-71d5-4b40-a17d-36d5a56ebbe7 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:21.103780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98ea2ec8-71d5-4b40-a17d-36d5a56ebbe7 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:21.106732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98ea2ec8-71d5-4b40-a17d-36d5a56ebbe7 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:21.107006 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98ea2ec8-71d5-4b40-a17d-36d5a56ebbe7 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:21.138091 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-98ea2ec8-71d5-4b40-a17d-36d5a56ebbe7 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] HTTP exception thrown: Instance 036dbd81-2019-4c7c-84c8-553bdd8729d5 could not be found. Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-98ea2ec8-71d5-4b40-a17d-36d5a56ebbe7 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Request method failure captured: Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 HTTP/1.1 Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pKEQG00GBA6ItDCMf3re_tvSDXndoZJGVl6CPdiExN-9E5VCnUwqIicppodPfGN5aWHEg9GFczqti9Stx8Iqd6eABbaBLNR_005SJJzU3yoXO21QT27v2wT4JxE-7JUcqV5ucO2GcwZkvnrpmIB-i4pRP9kdDNv6xkVuMBqHgYSDy0 Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 91cbcc6833214e07840dc9beaf9bea78 Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerDiskConfigTestJSON-657188473 Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_91cbcc6833214e07840dc9beaf9bea78", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/91cbcc6833214e07840dc9beaf9bea78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/91cbcc6833214e07840dc9beaf9bea78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/91cbcc6833214e07840dc9beaf9bea78"}]}] Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerDiskConfigTestJSON-657188473 Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 91cbcc6833214e07840dc9beaf9bea78 Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-657188473 Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerDiskConfigTestJSON-657188473-project Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 6f8b20388de843f2a2aa0cf53dc80f75 Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerDiskConfigTestJSON-657188473-project Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 036dbd81-2019-4c7c-84c8-553bdd8729d5 could not be found. Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '036dbd81-2019-4c7c-84c8-553bdd8729d5'} Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 036dbd81-2019-4c7c-84c8-553bdd8729d5 could not be found. Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 036dbd81-2019-4c7c-84c8-553bdd8729d5 could not be found. Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:21.139962 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.143345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.143345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:21.143345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:21.143345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:57:21.143345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:57:21.143345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 036dbd81-2019-4c7c-84c8-553bdd8729d5 could not be found. Jul 25 12:57:21.143345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.143345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-98ea2ec8-71d5-4b40-a17d-36d5a56ebbe7 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Returning 404 to user: Instance 036dbd81-2019-4c7c-84c8-553bdd8729d5 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:57:21.143345 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-98ea2ec8-71d5-4b40-a17d-36d5a56ebbe7 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5" status: 404 len: 111 microversion: 2.1 time: 0.069552 Jul 25 12:57:21.147021 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1718/3507] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:21 2022] GET /compute/v2.1/servers/036dbd81-2019-4c7c-84c8-553bdd8729d5 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:57:21.152893 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f83f883e-d829-429d-8ead-5af5915d1f48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:21.155475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f83f883e-d829-429d-8ead-5af5915d1f48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 5d1a7907-1bc8-4e80-899e-996371552930] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:21.176182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f83f883e-d829-429d-8ead-5af5915d1f48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:21.177919 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f83f883e-d829-429d-8ead-5af5915d1f48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:21.179412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f83f883e-d829-429d-8ead-5af5915d1f48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:21.187780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f83f883e-d829-429d-8ead-5af5915d1f48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:21.220538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6b970a17-32a8-4135-9884-e9fdf1cc6da2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:21.233629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6b970a17-32a8-4135-9884-e9fdf1cc6da2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:21.236320 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-f83f883e-d829-429d-8ead-5af5915d1f48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] HTTP exception thrown: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f83f883e-d829-429d-8ead-5af5915d1f48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Request method failure captured: Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930 HTTP/1.1 Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pHF7UCaF8gOsr4izIJsQMgDEa0djLGcj88wHujy3LL3KrSKed1jp5p2g1uyl0B7FckQX0z38dpjtGtJDzQMYAlTS7LRfENWczpgFqPzdGM6KYoCp6qrqJdc7QEkc58SEBAWEj2A4h5-asWJS2CIcfkxwvHFTYem8sDn2kkqArMxtZA Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f07680a55b3f41408d3a284d1330503d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}] Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: d28f966411004a158377c689fd5b05eb Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '5d1a7907-1bc8-4e80-899e-996371552930'} Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:57:21.239113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:57:21.242943 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. Jul 25 12:57:21.242943 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.242943 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:21.242943 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.242943 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.242943 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:21.242943 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:21.242943 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:57:21.242943 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:57:21.242943 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. Jul 25 12:57:21.242943 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.244037 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6b970a17-32a8-4135-9884-e9fdf1cc6da2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:21.244037 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6b970a17-32a8-4135-9884-e9fdf1cc6da2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1661 microversion: 2.42 time: 1.917185 Jul 25 12:57:21.247833 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f83f883e-d829-429d-8ead-5af5915d1f48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Returning 404 to user: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:57:21.250045 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f83f883e-d829-429d-8ead-5af5915d1f48 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930" status: 404 len: 111 microversion: 2.1 time: 0.101706 Jul 25 12:57:21.252896 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1790/3508] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:19 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1661 bytes in 1930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:21.261763 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1719/3509] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:57:21 2022] DELETE /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:57:21.277291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bc5ea153-e94e-4e98-b434-c0363bd98138 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:21.279709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bc5ea153-e94e-4e98-b434-c0363bd98138 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 5d1a7907-1bc8-4e80-899e-996371552930] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:21.292670 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-57950da7-b4f1-4583-aaf0-7f021cbc514f tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:21.296640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-57950da7-b4f1-4583-aaf0-7f021cbc514f tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:21.299830 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc5ea153-e94e-4e98-b434-c0363bd98138 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:21.306197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc5ea153-e94e-4e98-b434-c0363bd98138 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:21.310255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc5ea153-e94e-4e98-b434-c0363bd98138 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:21.310878 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc5ea153-e94e-4e98-b434-c0363bd98138 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:21.330725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57950da7-b4f1-4583-aaf0-7f021cbc514f tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:21.331787 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57950da7-b4f1-4583-aaf0-7f021cbc514f tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:21.333978 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57950da7-b4f1-4583-aaf0-7f021cbc514f tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:21.334615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57950da7-b4f1-4583-aaf0-7f021cbc514f tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:21.376821 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-57950da7-b4f1-4583-aaf0-7f021cbc514f tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] HTTP exception thrown: Instance 5749241b-2503-460b-b1e6-71983c40d397 could not be found. Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-57950da7-b4f1-4583-aaf0-7f021cbc514f tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Request method failure captured: Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 HTTP/1.1 Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pKEQG00GBA6ItDCMf3re_tvSDXndoZJGVl6CPdiExN-9E5VCnUwqIicppodPfGN5aWHEg9GFczqti9Stx8Iqd6eABbaBLNR_005SJJzU3yoXO21QT27v2wT4JxE-7JUcqV5ucO2GcwZkvnrpmIB-i4pRP9kdDNv6xkVuMBqHgYSDy0 Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 91cbcc6833214e07840dc9beaf9bea78 Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerDiskConfigTestJSON-657188473 Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_91cbcc6833214e07840dc9beaf9bea78", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/91cbcc6833214e07840dc9beaf9bea78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/91cbcc6833214e07840dc9beaf9bea78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/91cbcc6833214e07840dc9beaf9bea78"}]}] Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerDiskConfigTestJSON-657188473 Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 91cbcc6833214e07840dc9beaf9bea78 Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-657188473 Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerDiskConfigTestJSON-657188473-project Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 6f8b20388de843f2a2aa0cf53dc80f75 Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerDiskConfigTestJSON-657188473-project Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 5749241b-2503-460b-b1e6-71983c40d397 could not be found. Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '5749241b-2503-460b-b1e6-71983c40d397'} Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5749241b-2503-460b-b1e6-71983c40d397 could not be found. Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:57:21.379347 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:57:21.383375 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5749241b-2503-460b-b1e6-71983c40d397 could not be found. Jul 25 12:57:21.383375 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.383375 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:21.383375 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.383375 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.383375 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:21.383375 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:21.383375 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:57:21.383375 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:57:21.383375 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5749241b-2503-460b-b1e6-71983c40d397 could not be found. Jul 25 12:57:21.383375 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.385743 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-57950da7-b4f1-4583-aaf0-7f021cbc514f tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Returning 404 to user: Instance 5749241b-2503-460b-b1e6-71983c40d397 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:57:21.389634 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-bc5ea153-e94e-4e98-b434-c0363bd98138 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] HTTP exception thrown: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. Jul 25 12:57:21.390771 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-57950da7-b4f1-4583-aaf0-7f021cbc514f tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 404 len: 111 microversion: 2.1 time: 0.125640 Jul 25 12:57:21.391861 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1791/3510] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:57:21 2022] DELETE /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bc5ea153-e94e-4e98-b434-c0363bd98138 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Request method failure captured: Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930 HTTP/1.1 Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pHF7UCaF8gOsr4izIJsQMgDEa0djLGcj88wHujy3LL3KrSKed1jp5p2g1uyl0B7FckQX0z38dpjtGtJDzQMYAlTS7LRfENWczpgFqPzdGM6KYoCp6qrqJdc7QEkc58SEBAWEj2A4h5-asWJS2CIcfkxwvHFTYem8sDn2kkqArMxtZA Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f07680a55b3f41408d3a284d1330503d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}] Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: d28f966411004a158377c689fd5b05eb Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '5d1a7907-1bc8-4e80-899e-996371552930'} Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:21.400028 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.403488 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.403488 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:21.403488 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:21.403488 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:57:21.403488 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:57:21.403488 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. Jul 25 12:57:21.403488 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.403488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bc5ea153-e94e-4e98-b434-c0363bd98138 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Returning 404 to user: Instance 5d1a7907-1bc8-4e80-899e-996371552930 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:57:21.403488 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bc5ea153-e94e-4e98-b434-c0363bd98138 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930" status: 404 len: 111 microversion: 2.1 time: 0.137494 Jul 25 12:57:21.407279 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1720/3511] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:21 2022] GET /compute/v2.1/servers/5d1a7907-1bc8-4e80-899e-996371552930 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:57:21.407888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1683a1ea-4a4c-47d0-bd51-34e8c6bd19c2 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:21.408839 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1683a1ea-4a4c-47d0-bd51-34e8c6bd19c2 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: 5749241b-2503-460b-b1e6-71983c40d397] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:21.423625 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1683a1ea-4a4c-47d0-bd51-34e8c6bd19c2 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:21.424458 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1683a1ea-4a4c-47d0-bd51-34e8c6bd19c2 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:21.425460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1683a1ea-4a4c-47d0-bd51-34e8c6bd19c2 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:21.427741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5940431e-4a87-4acf-ac2e-d963db4814c0 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:21.428637 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1683a1ea-4a4c-47d0-bd51-34e8c6bd19c2 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:21.433514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5940431e-4a87-4acf-ac2e-d963db4814c0 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 7bbd0058-28f5-4b75-832b-f4828cc292c2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:21.452274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5940431e-4a87-4acf-ac2e-d963db4814c0 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:21.457267 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5940431e-4a87-4acf-ac2e-d963db4814c0 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:21.459204 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-1683a1ea-4a4c-47d0-bd51-34e8c6bd19c2 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] HTTP exception thrown: Instance 5749241b-2503-460b-b1e6-71983c40d397 could not be found. Jul 25 12:57:21.460574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5940431e-4a87-4acf-ac2e-d963db4814c0 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:21.461864 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5940431e-4a87-4acf-ac2e-d963db4814c0 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1683a1ea-4a4c-47d0-bd51-34e8c6bd19c2 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Request method failure captured: Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 HTTP/1.1 Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pKEQG00GBA6ItDCMf3re_tvSDXndoZJGVl6CPdiExN-9E5VCnUwqIicppodPfGN5aWHEg9GFczqti9Stx8Iqd6eABbaBLNR_005SJJzU3yoXO21QT27v2wT4JxE-7JUcqV5ucO2GcwZkvnrpmIB-i4pRP9kdDNv6xkVuMBqHgYSDy0 Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 91cbcc6833214e07840dc9beaf9bea78 Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerDiskConfigTestJSON-657188473 Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_91cbcc6833214e07840dc9beaf9bea78", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/91cbcc6833214e07840dc9beaf9bea78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/91cbcc6833214e07840dc9beaf9bea78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/91cbcc6833214e07840dc9beaf9bea78"}]}] Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerDiskConfigTestJSON-657188473 Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 91cbcc6833214e07840dc9beaf9bea78 Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-657188473 Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerDiskConfigTestJSON-657188473-project Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 6f8b20388de843f2a2aa0cf53dc80f75 Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerDiskConfigTestJSON-657188473-project Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 5749241b-2503-460b-b1e6-71983c40d397 could not be found. Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '5749241b-2503-460b-b1e6-71983c40d397'} Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5749241b-2503-460b-b1e6-71983c40d397 could not be found. Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5749241b-2503-460b-b1e6-71983c40d397 could not be found. Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:21.462641 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.465915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.465915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:21.465915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:21.465915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:57:21.465915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:57:21.465915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5749241b-2503-460b-b1e6-71983c40d397 could not be found. Jul 25 12:57:21.465915 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.470460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1683a1ea-4a4c-47d0-bd51-34e8c6bd19c2 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Returning 404 to user: Instance 5749241b-2503-460b-b1e6-71983c40d397 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:57:21.474136 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1683a1ea-4a4c-47d0-bd51-34e8c6bd19c2 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397" status: 404 len: 111 microversion: 2.1 time: 0.077150 Jul 25 12:57:21.486310 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1792/3512] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:21 2022] GET /compute/v2.1/servers/5749241b-2503-460b-b1e6-71983c40d397 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:57:21.493488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-27756b2d-9877-4439-a051-bd8a41334777 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:21.495822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-27756b2d-9877-4439-a051-bd8a41334777 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:21.511761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27756b2d-9877-4439-a051-bd8a41334777 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:21.512652 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27756b2d-9877-4439-a051-bd8a41334777 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:21.513944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27756b2d-9877-4439-a051-bd8a41334777 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:21.514955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27756b2d-9877-4439-a051-bd8a41334777 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:21.522753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:21.537673 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-5940431e-4a87-4acf-ac2e-d963db4814c0 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] HTTP exception thrown: Instance 7bbd0058-28f5-4b75-832b-f4828cc292c2 could not be found. Jul 25 12:57:21.540144 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-27756b2d-9877-4439-a051-bd8a41334777 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] HTTP exception thrown: Instance b0e5b678-c54d-4505-8391-787e74886dce could not be found. Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-27756b2d-9877-4439-a051-bd8a41334777 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Request method failure captured: Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce HTTP/1.1 Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pKEQG00GBA6ItDCMf3re_tvSDXndoZJGVl6CPdiExN-9E5VCnUwqIicppodPfGN5aWHEg9GFczqti9Stx8Iqd6eABbaBLNR_005SJJzU3yoXO21QT27v2wT4JxE-7JUcqV5ucO2GcwZkvnrpmIB-i4pRP9kdDNv6xkVuMBqHgYSDy0 Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 91cbcc6833214e07840dc9beaf9bea78 Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerDiskConfigTestJSON-657188473 Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_91cbcc6833214e07840dc9beaf9bea78", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/91cbcc6833214e07840dc9beaf9bea78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/91cbcc6833214e07840dc9beaf9bea78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/91cbcc6833214e07840dc9beaf9bea78"}]}] Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerDiskConfigTestJSON-657188473 Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 91cbcc6833214e07840dc9beaf9bea78 Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-657188473 Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerDiskConfigTestJSON-657188473-project Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 6f8b20388de843f2a2aa0cf53dc80f75 Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerDiskConfigTestJSON-657188473-project Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance b0e5b678-c54d-4505-8391-787e74886dce could not be found. Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'b0e5b678-c54d-4505-8391-787e74886dce'} Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0e5b678-c54d-4505-8391-787e74886dce could not be found. Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:57:21.542831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:57:21.546120 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0e5b678-c54d-4505-8391-787e74886dce could not be found. Jul 25 12:57:21.546120 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.546120 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:21.546120 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.546120 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.546120 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:21.546120 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:21.546120 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:57:21.546120 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:57:21.546120 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0e5b678-c54d-4505-8391-787e74886dce could not be found. Jul 25 12:57:21.546120 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5940431e-4a87-4acf-ac2e-d963db4814c0 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Request method failure captured: Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2 HTTP/1.1 Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pHF7UCaF8gOsr4izIJsQMgDEa0djLGcj88wHujy3LL3KrSKed1jp5p2g1uyl0B7FckQX0z38dpjtGtJDzQMYAlTS7LRfENWczpgFqPzdGM6KYoCp6qrqJdc7QEkc58SEBAWEj2A4h5-asWJS2CIcfkxwvHFTYem8sDn2kkqArMxtZA Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f07680a55b3f41408d3a284d1330503d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}] Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: d28f966411004a158377c689fd5b05eb Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 7bbd0058-28f5-4b75-832b-f4828cc292c2 could not be found. Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '7bbd0058-28f5-4b75-832b-f4828cc292c2'} Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bbd0058-28f5-4b75-832b-f4828cc292c2 could not be found. Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:57:21.547049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:57:21.559492 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bbd0058-28f5-4b75-832b-f4828cc292c2 could not be found. Jul 25 12:57:21.559492 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.559492 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:21.559492 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.559492 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.559492 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:21.559492 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:21.559492 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:57:21.559492 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:57:21.559492 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bbd0058-28f5-4b75-832b-f4828cc292c2 could not be found. Jul 25 12:57:21.559492 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.559492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5940431e-4a87-4acf-ac2e-d963db4814c0 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Returning 404 to user: Instance 7bbd0058-28f5-4b75-832b-f4828cc292c2 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:57:21.559492 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5940431e-4a87-4acf-ac2e-d963db4814c0 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2" status: 404 len: 111 microversion: 2.1 time: 0.136960 Jul 25 12:57:21.560912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-27756b2d-9877-4439-a051-bd8a41334777 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Returning 404 to user: Instance b0e5b678-c54d-4505-8391-787e74886dce could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:57:21.560912 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-27756b2d-9877-4439-a051-bd8a41334777 tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 404 len: 111 microversion: 2.1 time: 0.068424 Jul 25 12:57:21.560912 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1793/3513] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:57:21 2022] DELETE /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:57:21.561504 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1721/3514] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:57:21 2022] DELETE /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:57:21.566428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-11be2de3-adfa-40f8-8a66-568e7e8b9626 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:21.567504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-11be2de3-adfa-40f8-8a66-568e7e8b9626 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] [instance: 7bbd0058-28f5-4b75-832b-f4828cc292c2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:21.576782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11be2de3-adfa-40f8-8a66-568e7e8b9626 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:21.577539 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11be2de3-adfa-40f8-8a66-568e7e8b9626 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:21.578626 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11be2de3-adfa-40f8-8a66-568e7e8b9626 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:21.581495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11be2de3-adfa-40f8-8a66-568e7e8b9626 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:21.595639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9ca092af-f011-44c7-b334-5e079944660e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:21.601117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9ca092af-f011-44c7-b334-5e079944660e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] [instance: b0e5b678-c54d-4505-8391-787e74886dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:21.617024 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-11be2de3-adfa-40f8-8a66-568e7e8b9626 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] HTTP exception thrown: Instance 7bbd0058-28f5-4b75-832b-f4828cc292c2 could not be found. Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-11be2de3-adfa-40f8-8a66-568e7e8b9626 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Request method failure captured: Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2 HTTP/1.1 Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pHF7UCaF8gOsr4izIJsQMgDEa0djLGcj88wHujy3LL3KrSKed1jp5p2g1uyl0B7FckQX0z38dpjtGtJDzQMYAlTS7LRfENWczpgFqPzdGM6KYoCp6qrqJdc7QEkc58SEBAWEj2A4h5-asWJS2CIcfkxwvHFTYem8sDn2kkqArMxtZA Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f07680a55b3f41408d3a284d1330503d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f07680a55b3f41408d3a284d1330503d"}]}] Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: f07680a55b3f41408d3a284d1330503d Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134320785 Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: d28f966411004a158377c689fd5b05eb Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-DeleteServersTestJSON-2134320785-project Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 7bbd0058-28f5-4b75-832b-f4828cc292c2 could not be found. Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '7bbd0058-28f5-4b75-832b-f4828cc292c2'} Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bbd0058-28f5-4b75-832b-f4828cc292c2 could not be found. Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bbd0058-28f5-4b75-832b-f4828cc292c2 could not be found. Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:21.621219 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.624522 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.624522 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:21.624522 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:21.624522 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:57:21.624522 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:57:21.624522 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bbd0058-28f5-4b75-832b-f4828cc292c2 could not be found. Jul 25 12:57:21.624522 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.628580 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-11be2de3-adfa-40f8-8a66-568e7e8b9626 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] Returning 404 to user: Instance 7bbd0058-28f5-4b75-832b-f4828cc292c2 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:57:21.630468 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-11be2de3-adfa-40f8-8a66-568e7e8b9626 tempest-DeleteServersTestJSON-2134320785 tempest-DeleteServersTestJSON-2134320785-project] 10.222.0.49 "GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2" status: 404 len: 111 microversion: 2.1 time: 0.072351 Jul 25 12:57:21.633418 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1794/3515] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:21 2022] GET /compute/v2.1/servers/7bbd0058-28f5-4b75-832b-f4828cc292c2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:57:21.639542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ca092af-f011-44c7-b334-5e079944660e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:21.640104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ca092af-f011-44c7-b334-5e079944660e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:21.647466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ca092af-f011-44c7-b334-5e079944660e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:21.648146 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ca092af-f011-44c7-b334-5e079944660e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:21.741326 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-9ca092af-f011-44c7-b334-5e079944660e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] HTTP exception thrown: Instance b0e5b678-c54d-4505-8391-787e74886dce could not be found. Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9ca092af-f011-44c7-b334-5e079944660e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Request method failure captured: Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce HTTP/1.1 Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pKEQG00GBA6ItDCMf3re_tvSDXndoZJGVl6CPdiExN-9E5VCnUwqIicppodPfGN5aWHEg9GFczqti9Stx8Iqd6eABbaBLNR_005SJJzU3yoXO21QT27v2wT4JxE-7JUcqV5ucO2GcwZkvnrpmIB-i4pRP9kdDNv6xkVuMBqHgYSDy0 Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 91cbcc6833214e07840dc9beaf9bea78 Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerDiskConfigTestJSON-657188473 Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_91cbcc6833214e07840dc9beaf9bea78", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/91cbcc6833214e07840dc9beaf9bea78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/91cbcc6833214e07840dc9beaf9bea78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/91cbcc6833214e07840dc9beaf9bea78"}]}] Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerDiskConfigTestJSON-657188473 Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 91cbcc6833214e07840dc9beaf9bea78 Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-657188473 Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerDiskConfigTestJSON-657188473-project Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 6f8b20388de843f2a2aa0cf53dc80f75 Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerDiskConfigTestJSON-657188473-project Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance b0e5b678-c54d-4505-8391-787e74886dce could not be found. Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'b0e5b678-c54d-4505-8391-787e74886dce'} Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0e5b678-c54d-4505-8391-787e74886dce could not be found. Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0e5b678-c54d-4505-8391-787e74886dce could not be found. Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:57:21.752323 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.756742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:57:21.756742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:57:21.756742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:57:21.756742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:57:21.756742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:57:21.756742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0e5b678-c54d-4505-8391-787e74886dce could not be found. Jul 25 12:57:21.756742 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:57:21.756742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9ca092af-f011-44c7-b334-5e079944660e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] Returning 404 to user: Instance b0e5b678-c54d-4505-8391-787e74886dce could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:57:21.760527 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9ca092af-f011-44c7-b334-5e079944660e tempest-ServerDiskConfigTestJSON-657188473 tempest-ServerDiskConfigTestJSON-657188473-project] 10.222.0.49 "GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce" status: 404 len: 111 microversion: 2.1 time: 0.197219 Jul 25 12:57:21.780767 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1722/3516] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:21 2022] GET /compute/v2.1/servers/b0e5b678-c54d-4505-8391-787e74886dce => generated 111 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:57:22.097690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-466e4da7-fb90-4b5d-8303-084e7ba3d7e4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:22.098653 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-466e4da7-fb90-4b5d-8303-084e7ba3d7e4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:22.129763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-466e4da7-fb90-4b5d-8303-084e7ba3d7e4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:22.135200 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-466e4da7-fb90-4b5d-8303-084e7ba3d7e4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:22.144923 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-466e4da7-fb90-4b5d-8303-084e7ba3d7e4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:22.145448 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-466e4da7-fb90-4b5d-8303-084e7ba3d7e4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:22.270993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9eca284a-7269-41fd-9de4-0dc2ef49107c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:22.271706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9eca284a-7269-41fd-9de4-0dc2ef49107c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:22.283536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9eca284a-7269-41fd-9de4-0dc2ef49107c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:22.283996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9eca284a-7269-41fd-9de4-0dc2ef49107c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:22.284791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9eca284a-7269-41fd-9de4-0dc2ef49107c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:22.288218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9eca284a-7269-41fd-9de4-0dc2ef49107c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:23.195093 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-466e4da7-fb90-4b5d-8303-084e7ba3d7e4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:23.211041 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-466e4da7-fb90-4b5d-8303-084e7ba3d7e4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1656 microversion: 2.1 time: 1.121771 Jul 25 12:57:23.211645 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1795/3517] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:22 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1656 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:23.236237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-95ad8084-ecd4-48ea-8123-ee51a6f00662 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:23.248386 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95ad8084-ecd4-48ea-8123-ee51a6f00662 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:23.248849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95ad8084-ecd4-48ea-8123-ee51a6f00662 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:23.306304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-95ad8084-ecd4-48ea-8123-ee51a6f00662 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Going to try to start instance {{(pid=125884) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 12:57:23.360037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:23.394773 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-95ad8084-ecd4-48ea-8123-ee51a6f00662 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action" status: 202 len: 0 microversion: 2.1 time: 0.166417 Jul 25 12:57:23.396614 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1796/3518] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:57:23 2022] POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:57:23.428809 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e78ad6ee-b9c2-4e07-9452-8be36898441d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:23.429901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e78ad6ee-b9c2-4e07-9452-8be36898441d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:23.440411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e78ad6ee-b9c2-4e07-9452-8be36898441d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:23.441406 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e78ad6ee-b9c2-4e07-9452-8be36898441d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:23.443360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e78ad6ee-b9c2-4e07-9452-8be36898441d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:23.444405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e78ad6ee-b9c2-4e07-9452-8be36898441d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:23.477327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9eca284a-7269-41fd-9de4-0dc2ef49107c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:23.493952 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9eca284a-7269-41fd-9de4-0dc2ef49107c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:23.500876 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9eca284a-7269-41fd-9de4-0dc2ef49107c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:23.504751 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9eca284a-7269-41fd-9de4-0dc2ef49107c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1707 microversion: 2.42 time: 1.237681 Jul 25 12:57:23.527988 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1723/3519] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:22 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1707 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:23.996143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e78ad6ee-b9c2-4e07-9452-8be36898441d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:24.018454 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e78ad6ee-b9c2-4e07-9452-8be36898441d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1665 microversion: 2.1 time: 0.602928 Jul 25 12:57:24.019458 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1797/3520] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:23 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1665 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:24.536548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c4a8974e-09aa-4ede-abd4-5526396242cd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:24.537478 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c4a8974e-09aa-4ede-abd4-5526396242cd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:24.540138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=8 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:24.550366 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4a8974e-09aa-4ede-abd4-5526396242cd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:24.555489 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4a8974e-09aa-4ede-abd4-5526396242cd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:24.558912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4a8974e-09aa-4ede-abd4-5526396242cd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:24.559721 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4a8974e-09aa-4ede-abd4-5526396242cd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:25.041887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4e50a672-b170-49e4-a7f0-bcd34258a931 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:25.042590 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4e50a672-b170-49e4-a7f0-bcd34258a931 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:25.063737 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e50a672-b170-49e4-a7f0-bcd34258a931 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:25.064596 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e50a672-b170-49e4-a7f0-bcd34258a931 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:25.066099 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e50a672-b170-49e4-a7f0-bcd34258a931 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:25.066908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e50a672-b170-49e4-a7f0-bcd34258a931 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:25.664880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:26.203796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4e50a672-b170-49e4-a7f0-bcd34258a931 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:26.218488 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4e50a672-b170-49e4-a7f0-bcd34258a931 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1665 microversion: 2.1 time: 1.182191 Jul 25 12:57:26.220562 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1798/3521] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:25 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1665 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:57:26.352157 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c4a8974e-09aa-4ede-abd4-5526396242cd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:26.366560 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c4a8974e-09aa-4ede-abd4-5526396242cd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:26.368067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c4a8974e-09aa-4ede-abd4-5526396242cd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:26.369301 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c4a8974e-09aa-4ede-abd4-5526396242cd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1753 microversion: 2.42 time: 1.836788 Jul 25 12:57:26.370105 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1724/3522] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:24 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1753 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:26.472077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-48d7ddea-0396-41d1-bb84-dd8807142d25 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:26.472077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-48d7ddea-0396-41d1-bb84-dd8807142d25 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:26.488820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48d7ddea-0396-41d1-bb84-dd8807142d25 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:26.489669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48d7ddea-0396-41d1-bb84-dd8807142d25 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:26.493250 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48d7ddea-0396-41d1-bb84-dd8807142d25 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:26.494399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48d7ddea-0396-41d1-bb84-dd8807142d25 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:26.559298 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-48d7ddea-0396-41d1-bb84-dd8807142d25 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:57:26.761996 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-48d7ddea-0396-41d1-bb84-dd8807142d25 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "DELETE /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 204 len: 0 microversion: 2.32 time: 0.539425 Jul 25 12:57:26.764567 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1799/3523] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 12:57:26 2022] DELETE /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 12:57:26.779201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3171552a-6d5c-413a-ba16-37f414558cff tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:26.780009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3171552a-6d5c-413a-ba16-37f414558cff tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:26.790990 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:26.805061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3171552a-6d5c-413a-ba16-37f414558cff tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:26.806253 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3171552a-6d5c-413a-ba16-37f414558cff tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:26.807284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3171552a-6d5c-413a-ba16-37f414558cff tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:26.807878 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3171552a-6d5c-413a-ba16-37f414558cff tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:27.242538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e49113e4-4df2-4a81-994a-fd263d47c9ea tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:27.243955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e49113e4-4df2-4a81-994a-fd263d47c9ea tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:27.267924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e49113e4-4df2-4a81-994a-fd263d47c9ea tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:27.269613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e49113e4-4df2-4a81-994a-fd263d47c9ea tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:27.273975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e49113e4-4df2-4a81-994a-fd263d47c9ea tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:27.275182 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e49113e4-4df2-4a81-994a-fd263d47c9ea tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:28.020398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3171552a-6d5c-413a-ba16-37f414558cff tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:28.049880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3171552a-6d5c-413a-ba16-37f414558cff tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:28.072051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3171552a-6d5c-413a-ba16-37f414558cff tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:28.082117 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3171552a-6d5c-413a-ba16-37f414558cff tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 2952 microversion: 2.32 time: 1.301508 Jul 25 12:57:28.082868 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1725/3524] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:26 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 2952 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:28.097976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b15c2645-2298-4c89-b627-5bd11afe6bab tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:28.100853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b15c2645-2298-4c89-b627-5bd11afe6bab tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:28.130365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b15c2645-2298-4c89-b627-5bd11afe6bab tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:28.130835 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b15c2645-2298-4c89-b627-5bd11afe6bab tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:28.131690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b15c2645-2298-4c89-b627-5bd11afe6bab tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:28.132139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b15c2645-2298-4c89-b627-5bd11afe6bab tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:28.256470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e49113e4-4df2-4a81-994a-fd263d47c9ea tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:28.265464 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e49113e4-4df2-4a81-994a-fd263d47c9ea tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 1.028418 Jul 25 12:57:28.274018 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1800/3525] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:27 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:57:28.289364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-16952fe7-933a-404d-b79c-aec1d3020699 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:28.291552 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-16952fe7-933a-404d-b79c-aec1d3020699 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:28.311685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16952fe7-933a-404d-b79c-aec1d3020699 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:28.315480 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16952fe7-933a-404d-b79c-aec1d3020699 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:28.318608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16952fe7-933a-404d-b79c-aec1d3020699 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:28.322162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16952fe7-933a-404d-b79c-aec1d3020699 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:29.284924 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b15c2645-2298-4c89-b627-5bd11afe6bab tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:29.298851 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b15c2645-2298-4c89-b627-5bd11afe6bab tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:29.308665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b15c2645-2298-4c89-b627-5bd11afe6bab tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:29.315991 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b15c2645-2298-4c89-b627-5bd11afe6bab tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1753 microversion: 2.42 time: 1.231879 Jul 25 12:57:29.318034 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1726/3526] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:28 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1753 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:29.328079 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-922474e1-fa84-437e-9cce-c98d1b5ad2f3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:29.332780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-922474e1-fa84-437e-9cce-c98d1b5ad2f3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:29.352716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-922474e1-fa84-437e-9cce-c98d1b5ad2f3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:29.353389 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-922474e1-fa84-437e-9cce-c98d1b5ad2f3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:29.354221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-922474e1-fa84-437e-9cce-c98d1b5ad2f3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:29.354832 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-922474e1-fa84-437e-9cce-c98d1b5ad2f3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:29.638352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-16952fe7-933a-404d-b79c-aec1d3020699 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:29.657508 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-16952fe7-933a-404d-b79c-aec1d3020699 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 1.374734 Jul 25 12:57:29.666888 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1801/3527] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:28 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:29.690799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f97eb8a5-6983-4c07-9c56-d32bd931e61e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:29.691345 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f97eb8a5-6983-4c07-9c56-d32bd931e61e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:29.719141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f97eb8a5-6983-4c07-9c56-d32bd931e61e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:29.719602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f97eb8a5-6983-4c07-9c56-d32bd931e61e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:29.724755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f97eb8a5-6983-4c07-9c56-d32bd931e61e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:29.725424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f97eb8a5-6983-4c07-9c56-d32bd931e61e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:29.868451 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f97eb8a5-6983-4c07-9c56-d32bd931e61e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Unlocking {{(pid=125884) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 25 12:57:29.950687 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f97eb8a5-6983-4c07-9c56-d32bd931e61e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action" status: 202 len: 0 microversion: 2.1 time: 0.263646 Jul 25 12:57:29.951270 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1802/3528] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:57:29 2022] POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:57:29.962675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-805103b4-a207-44c3-80ea-e569dfba7ae5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:29.963310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-805103b4-a207-44c3-80ea-e569dfba7ae5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:29.981499 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-805103b4-a207-44c3-80ea-e569dfba7ae5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:29.982008 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-805103b4-a207-44c3-80ea-e569dfba7ae5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:29.982805 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-805103b4-a207-44c3-80ea-e569dfba7ae5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:29.983551 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-805103b4-a207-44c3-80ea-e569dfba7ae5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:31.277955 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-922474e1-fa84-437e-9cce-c98d1b5ad2f3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:31.288350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-922474e1-fa84-437e-9cce-c98d1b5ad2f3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:31.297291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-922474e1-fa84-437e-9cce-c98d1b5ad2f3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:31.298663 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-922474e1-fa84-437e-9cce-c98d1b5ad2f3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 2952 microversion: 2.32 time: 1.979367 Jul 25 12:57:31.310234 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1727/3529] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:29 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 2952 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:31.316393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d3ed0a58-909b-4009-b263-f58cb3b18257 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:31.317362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d3ed0a58-909b-4009-b263-f58cb3b18257 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:31.334189 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d3ed0a58-909b-4009-b263-f58cb3b18257 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:31.335045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d3ed0a58-909b-4009-b263-f58cb3b18257 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:31.341313 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d3ed0a58-909b-4009-b263-f58cb3b18257 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:31.342116 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d3ed0a58-909b-4009-b263-f58cb3b18257 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:31.440246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-805103b4-a207-44c3-80ea-e569dfba7ae5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:31.455165 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-805103b4-a207-44c3-80ea-e569dfba7ae5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 1.497519 Jul 25 12:57:31.457579 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1803/3530] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:29 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:57:31.481460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-84609a6a-966c-4c15-8b47-a62ca0b7742b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:31.482432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-84609a6a-966c-4c15-8b47-a62ca0b7742b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:31.489154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84609a6a-966c-4c15-8b47-a62ca0b7742b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:31.489816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84609a6a-966c-4c15-8b47-a62ca0b7742b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:31.490786 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84609a6a-966c-4c15-8b47-a62ca0b7742b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:31.491385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84609a6a-966c-4c15-8b47-a62ca0b7742b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:32.273193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d3ed0a58-909b-4009-b263-f58cb3b18257 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:32.292668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d3ed0a58-909b-4009-b263-f58cb3b18257 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:32.294836 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d3ed0a58-909b-4009-b263-f58cb3b18257 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:32.299647 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d3ed0a58-909b-4009-b263-f58cb3b18257 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1799 microversion: 2.42 time: 0.987645 Jul 25 12:57:32.314997 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1728/3531] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:31 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1799 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:32.336056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-87e44ea8-8d2f-43da-ad4c-49f15ac94e94 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:32.338049 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-87e44ea8-8d2f-43da-ad4c-49f15ac94e94 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:32.352989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87e44ea8-8d2f-43da-ad4c-49f15ac94e94 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:32.358345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87e44ea8-8d2f-43da-ad4c-49f15ac94e94 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:32.359515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87e44ea8-8d2f-43da-ad4c-49f15ac94e94 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:32.360182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87e44ea8-8d2f-43da-ad4c-49f15ac94e94 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:32.569742 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-84609a6a-966c-4c15-8b47-a62ca0b7742b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:32.589581 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-84609a6a-966c-4c15-8b47-a62ca0b7742b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 1.112319 Jul 25 12:57:32.591142 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1804/3532] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:31 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:57:32.622873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-871152b0-ec8d-4cb2-b9a6-6a6a4a11fa3b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:32.624807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-871152b0-ec8d-4cb2-b9a6-6a6a4a11fa3b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:32.636139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-871152b0-ec8d-4cb2-b9a6-6a6a4a11fa3b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:32.636954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-871152b0-ec8d-4cb2-b9a6-6a6a4a11fa3b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:32.642983 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-871152b0-ec8d-4cb2-b9a6-6a6a4a11fa3b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:32.643855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-871152b0-ec8d-4cb2-b9a6-6a6a4a11fa3b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:33.925814 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-87e44ea8-8d2f-43da-ad4c-49f15ac94e94 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:33.938860 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-87e44ea8-8d2f-43da-ad4c-49f15ac94e94 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:33.948829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-87e44ea8-8d2f-43da-ad4c-49f15ac94e94 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:33.950530 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-87e44ea8-8d2f-43da-ad4c-49f15ac94e94 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 2952 microversion: 2.32 time: 1.619413 Jul 25 12:57:33.952640 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1729/3533] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:32 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 2952 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:33.962828 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-27a50ec1-09d8-4c88-9a2e-d473f879b3eb tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:33.968228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-27a50ec1-09d8-4c88-9a2e-d473f879b3eb tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:33.991897 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27a50ec1-09d8-4c88-9a2e-d473f879b3eb tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:33.992621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27a50ec1-09d8-4c88-9a2e-d473f879b3eb tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:33.995516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27a50ec1-09d8-4c88-9a2e-d473f879b3eb tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:33.996314 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27a50ec1-09d8-4c88-9a2e-d473f879b3eb tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:34.059857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-871152b0-ec8d-4cb2-b9a6-6a6a4a11fa3b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:34.063550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:34.069334 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-871152b0-ec8d-4cb2-b9a6-6a6a4a11fa3b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 1.450499 Jul 25 12:57:34.075938 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1805/3534] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:32 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:57:34.086934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-59b0e6ce-bfd0-403b-9162-1382a20d8b06 req-cd9522b8-11de-401c-a19b-3e530bada4a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "name": "network-vif-unplugged", "status": "completed", "tag": "0cd19a7b-cc4c-4db9-a5bb-5479206d7d43"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:34.099341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-59b0e6ce-bfd0-403b-9162-1382a20d8b06 req-cd9522b8-11de-401c-a19b-3e530bada4a7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:34.100046 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-59b0e6ce-bfd0-403b-9162-1382a20d8b06 req-cd9522b8-11de-401c-a19b-3e530bada4a7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:34.114616 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-59b0e6ce-bfd0-403b-9162-1382a20d8b06 req-cd9522b8-11de-401c-a19b-3e530bada4a7 service nova] Creating event network-vif-unplugged:0cd19a7b-cc4c-4db9-a5bb-5479206d7d43 for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:57:34.134647 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-59b0e6ce-bfd0-403b-9162-1382a20d8b06 req-cd9522b8-11de-401c-a19b-3e530bada4a7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057029 Jul 25 12:57:34.135264 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1806/3535] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:57:34.148159 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5aedc4bc-6f26-4b2c-8ce5-86dfda935a65 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:34.148812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5aedc4bc-6f26-4b2c-8ce5-86dfda935a65 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:34.176078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5aedc4bc-6f26-4b2c-8ce5-86dfda935a65 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:34.182136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5aedc4bc-6f26-4b2c-8ce5-86dfda935a65 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:34.183620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5aedc4bc-6f26-4b2c-8ce5-86dfda935a65 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:34.184419 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5aedc4bc-6f26-4b2c-8ce5-86dfda935a65 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:34.401007 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5aedc4bc-6f26-4b2c-8ce5-86dfda935a65 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action" status: 202 len: 0 microversion: 2.1 time: 0.262604 Jul 25 12:57:34.404880 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1807/3536] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:57:34 2022] POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:57:34.424288 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ea3973cb-0e77-42b9-8c73-3de4e26f9ceb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:34.435742 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ea3973cb-0e77-42b9-8c73-3de4e26f9ceb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:34.473164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea3973cb-0e77-42b9-8c73-3de4e26f9ceb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:34.474456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea3973cb-0e77-42b9-8c73-3de4e26f9ceb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:34.475364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea3973cb-0e77-42b9-8c73-3de4e26f9ceb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:34.475750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea3973cb-0e77-42b9-8c73-3de4e26f9ceb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:35.709785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-27a50ec1-09d8-4c88-9a2e-d473f879b3eb tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:35.721999 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:35.734836 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-27a50ec1-09d8-4c88-9a2e-d473f879b3eb tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:35.743807 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-27a50ec1-09d8-4c88-9a2e-d473f879b3eb tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:35.749881 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-27a50ec1-09d8-4c88-9a2e-d473f879b3eb tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1799 microversion: 2.42 time: 1.794805 Jul 25 12:57:35.752095 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1730/3537] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:33 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1799 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:35.765788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9bc69ef1-b5a4-4724-8a25-6c1d48333f57 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:35.767400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9bc69ef1-b5a4-4724-8a25-6c1d48333f57 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:35.789899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9bc69ef1-b5a4-4724-8a25-6c1d48333f57 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:35.790670 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9bc69ef1-b5a4-4724-8a25-6c1d48333f57 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:35.792166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9bc69ef1-b5a4-4724-8a25-6c1d48333f57 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:35.794092 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9bc69ef1-b5a4-4724-8a25-6c1d48333f57 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:36.696313 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9bc69ef1-b5a4-4724-8a25-6c1d48333f57 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:36.714508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9bc69ef1-b5a4-4724-8a25-6c1d48333f57 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:36.719388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9bc69ef1-b5a4-4724-8a25-6c1d48333f57 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:36.720782 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9bc69ef1-b5a4-4724-8a25-6c1d48333f57 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 2931 microversion: 2.32 time: 0.966552 Jul 25 12:57:36.722758 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1731/3538] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:35 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 2931 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:36.737138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-1908e1b1-ba88-4f3c-9308-5d8df8de6511 req-58edd90d-4454-4259-975a-b05706713a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "name": "network-vif-unplugged", "status": "completed", "tag": "cb401cbd-e19d-4978-86c4-7928b236e3b9"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:36.764037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-1908e1b1-ba88-4f3c-9308-5d8df8de6511 req-58edd90d-4454-4259-975a-b05706713a88 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:36.764858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-1908e1b1-ba88-4f3c-9308-5d8df8de6511 req-58edd90d-4454-4259-975a-b05706713a88 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:36.807275 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-1908e1b1-ba88-4f3c-9308-5d8df8de6511 req-58edd90d-4454-4259-975a-b05706713a88 service nova] Creating event network-vif-unplugged:cb401cbd-e19d-4978-86c4-7928b236e3b9 for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:57:36.825913 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-1908e1b1-ba88-4f3c-9308-5d8df8de6511 req-58edd90d-4454-4259-975a-b05706713a88 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094201 Jul 25 12:57:36.826713 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1732/3539] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:57:36.843642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5d4db0a8-9e02-4ec7-84b4-80b8ac247330 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:36.844550 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5d4db0a8-9e02-4ec7-84b4-80b8ac247330 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:36.857969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d4db0a8-9e02-4ec7-84b4-80b8ac247330 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:36.865410 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d4db0a8-9e02-4ec7-84b4-80b8ac247330 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:36.866639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d4db0a8-9e02-4ec7-84b4-80b8ac247330 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:36.867237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d4db0a8-9e02-4ec7-84b4-80b8ac247330 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:36.949155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ea3973cb-0e77-42b9-8c73-3de4e26f9ceb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:36.975816 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ea3973cb-0e77-42b9-8c73-3de4e26f9ceb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1674 microversion: 2.1 time: 2.556785 Jul 25 12:57:36.992453 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1808/3540] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:34 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1674 bytes in 2586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:37.751713 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e841eb60-1d98-4ec0-9471-7f2d0dead7a4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:37.753939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e841eb60-1d98-4ec0-9471-7f2d0dead7a4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:37.777938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e841eb60-1d98-4ec0-9471-7f2d0dead7a4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:37.788877 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e841eb60-1d98-4ec0-9471-7f2d0dead7a4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:37.789913 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e841eb60-1d98-4ec0-9471-7f2d0dead7a4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:37.803323 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e841eb60-1d98-4ec0-9471-7f2d0dead7a4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:37.941326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5d4db0a8-9e02-4ec7-84b4-80b8ac247330 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:37.962627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5d4db0a8-9e02-4ec7-84b4-80b8ac247330 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:37.964696 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5d4db0a8-9e02-4ec7-84b4-80b8ac247330 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:37.966169 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5d4db0a8-9e02-4ec7-84b4-80b8ac247330 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1799 microversion: 2.42 time: 1.137980 Jul 25 12:57:37.966884 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1733/3541] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:36 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1799 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:38.014257 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-00a0eb5d-fe6e-4537-97ed-0d9f528d261b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:38.015536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-00a0eb5d-fe6e-4537-97ed-0d9f528d261b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:38.036959 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00a0eb5d-fe6e-4537-97ed-0d9f528d261b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:38.050817 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00a0eb5d-fe6e-4537-97ed-0d9f528d261b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:38.051879 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00a0eb5d-fe6e-4537-97ed-0d9f528d261b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:38.052339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00a0eb5d-fe6e-4537-97ed-0d9f528d261b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:40.791492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e841eb60-1d98-4ec0-9471-7f2d0dead7a4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:40.797682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-00a0eb5d-fe6e-4537-97ed-0d9f528d261b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:40.811256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e841eb60-1d98-4ec0-9471-7f2d0dead7a4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:40.812908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e841eb60-1d98-4ec0-9471-7f2d0dead7a4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:40.814411 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e841eb60-1d98-4ec0-9471-7f2d0dead7a4 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 2910 microversion: 2.32 time: 3.067334 Jul 25 12:57:40.821808 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1809/3542] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:37 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 2910 bytes in 3075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:40.827079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-19a55bee-57d5-4114-b016-ce12e41a191c req-e852c863-3187-4066-b4aa-6cec7abb0b4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "name": "network-vif-unplugged", "status": "completed", "tag": "02849233-f60e-4c53-a1d0-6d7d5c7326af"}, {"server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "name": "network-vif-unplugged", "status": "completed", "tag": "be480615-b9ea-4aa4-9399-1e7eabe09a0b"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:40.841950 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-00a0eb5d-fe6e-4537-97ed-0d9f528d261b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1654 microversion: 2.1 time: 2.843423 Jul 25 12:57:40.851992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-19a55bee-57d5-4114-b016-ce12e41a191c req-e852c863-3187-4066-b4aa-6cec7abb0b4a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:40.857201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-19a55bee-57d5-4114-b016-ce12e41a191c req-e852c863-3187-4066-b4aa-6cec7abb0b4a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:40.870428 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1734/3543] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:37 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1654 bytes in 2872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:40.880085 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-19a55bee-57d5-4114-b016-ce12e41a191c req-e852c863-3187-4066-b4aa-6cec7abb0b4a service nova] Creating event network-vif-unplugged:02849233-f60e-4c53-a1d0-6d7d5c7326af for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:57:40.880843 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-19a55bee-57d5-4114-b016-ce12e41a191c req-e852c863-3187-4066-b4aa-6cec7abb0b4a service nova] Creating event network-vif-unplugged:be480615-b9ea-4aa4-9399-1e7eabe09a0b for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:57:40.884284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-31737eac-d7aa-431e-acc8-f8f04957d373 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:40.887274 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-19a55bee-57d5-4114-b016-ce12e41a191c req-e852c863-3187-4066-b4aa-6cec7abb0b4a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.063856 Jul 25 12:57:40.888420 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1810/3544] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:57:40.895326 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5729a442-9ef7-4ab8-ac98-be403a5f1838 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:40.896148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5729a442-9ef7-4ab8-ac98-be403a5f1838 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:40.899717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-31737eac-d7aa-431e-acc8-f8f04957d373 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:40.903994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5729a442-9ef7-4ab8-ac98-be403a5f1838 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:40.904615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5729a442-9ef7-4ab8-ac98-be403a5f1838 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:40.905571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5729a442-9ef7-4ab8-ac98-be403a5f1838 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:40.906410 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5729a442-9ef7-4ab8-ac98-be403a5f1838 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:40.916828 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31737eac-d7aa-431e-acc8-f8f04957d373 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:40.917406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31737eac-d7aa-431e-acc8-f8f04957d373 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:40.933012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31737eac-d7aa-431e-acc8-f8f04957d373 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:40.933203 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31737eac-d7aa-431e-acc8-f8f04957d373 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:41.032716 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5729a442-9ef7-4ab8-ac98-be403a5f1838 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action" status: 202 len: 0 microversion: 2.1 time: 0.142631 Jul 25 12:57:41.033870 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1811/3545] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:57:40 2022] POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:57:41.055217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3db0fd94-c28a-4fdd-90fc-d7bf4dca9181 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:41.056225 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3db0fd94-c28a-4fdd-90fc-d7bf4dca9181 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:41.063995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3db0fd94-c28a-4fdd-90fc-d7bf4dca9181 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:41.064708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3db0fd94-c28a-4fdd-90fc-d7bf4dca9181 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:41.065646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3db0fd94-c28a-4fdd-90fc-d7bf4dca9181 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:41.066294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3db0fd94-c28a-4fdd-90fc-d7bf4dca9181 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:42.726488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-31737eac-d7aa-431e-acc8-f8f04957d373 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:42.754185 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-31737eac-d7aa-431e-acc8-f8f04957d373 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:42.758823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-31737eac-d7aa-431e-acc8-f8f04957d373 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:42.765146 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-31737eac-d7aa-431e-acc8-f8f04957d373 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1845 microversion: 2.42 time: 1.892117 Jul 25 12:57:42.768193 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1735/3546] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:40 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1845 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:42.789665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ccafe160-8cc7-46ca-83ba-2cd2ed4c5538 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:42.793164 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ccafe160-8cc7-46ca-83ba-2cd2ed4c5538 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:42.817529 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ccafe160-8cc7-46ca-83ba-2cd2ed4c5538 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:42.821303 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ccafe160-8cc7-46ca-83ba-2cd2ed4c5538 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:42.823444 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ccafe160-8cc7-46ca-83ba-2cd2ed4c5538 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:42.826725 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ccafe160-8cc7-46ca-83ba-2cd2ed4c5538 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:42.911450 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3db0fd94-c28a-4fdd-90fc-d7bf4dca9181 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:42.920178 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3db0fd94-c28a-4fdd-90fc-d7bf4dca9181 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1661 microversion: 2.1 time: 1.881088 Jul 25 12:57:42.925782 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1812/3547] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:41 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1661 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:42.938553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-a628b2a8-4d31-4ded-b705-6ebd3847961a req-5cafcc48-5edf-450e-b0cc-77c421d4a25a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "name": "network-vif-unplugged", "status": "completed", "tag": "39297266-b022-4131-809f-29475f17809c"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:42.960685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a628b2a8-4d31-4ded-b705-6ebd3847961a req-5cafcc48-5edf-450e-b0cc-77c421d4a25a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:42.961165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a628b2a8-4d31-4ded-b705-6ebd3847961a req-5cafcc48-5edf-450e-b0cc-77c421d4a25a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:42.987791 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-a628b2a8-4d31-4ded-b705-6ebd3847961a req-5cafcc48-5edf-450e-b0cc-77c421d4a25a service nova] Creating event network-vif-unplugged:39297266-b022-4131-809f-29475f17809c for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:57:43.008625 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-a628b2a8-4d31-4ded-b705-6ebd3847961a req-5cafcc48-5edf-450e-b0cc-77c421d4a25a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081356 Jul 25 12:57:43.009678 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1813/3548] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:57:43.794539 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9661787c-1dd9-4e49-9b6b-2f1219010179 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:43.795167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9661787c-1dd9-4e49-9b6b-2f1219010179 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:43.805783 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:43.815767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9661787c-1dd9-4e49-9b6b-2f1219010179 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:43.816202 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9661787c-1dd9-4e49-9b6b-2f1219010179 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:43.817016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9661787c-1dd9-4e49-9b6b-2f1219010179 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:43.817525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9661787c-1dd9-4e49-9b6b-2f1219010179 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:43.931297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ccafe160-8cc7-46ca-83ba-2cd2ed4c5538 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:43.957334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ccafe160-8cc7-46ca-83ba-2cd2ed4c5538 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:43.967327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ccafe160-8cc7-46ca-83ba-2cd2ed4c5538 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:43.968625 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ccafe160-8cc7-46ca-83ba-2cd2ed4c5538 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 2910 microversion: 2.32 time: 1.199045 Jul 25 12:57:43.979414 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1736/3549] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:42 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 2910 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:44.004390 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ebeeb345-58ca-4e20-992e-7199665ae433 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:44.007579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ebeeb345-58ca-4e20-992e-7199665ae433 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:44.042775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ebeeb345-58ca-4e20-992e-7199665ae433 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:44.043754 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ebeeb345-58ca-4e20-992e-7199665ae433 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:44.046870 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ebeeb345-58ca-4e20-992e-7199665ae433 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:44.050145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ebeeb345-58ca-4e20-992e-7199665ae433 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:45.557407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ebeeb345-58ca-4e20-992e-7199665ae433 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:45.577477 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ebeeb345-58ca-4e20-992e-7199665ae433 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 1.595463 Jul 25 12:57:45.580765 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1737/3550] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:43 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:45.601038 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-9e28a917-216c-4ca4-9d89-28d58a04c4bc req-1a50134b-5b05-4242-8dda-91979bf41a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "name": "network-vif-deleted", "tag": "02849233-f60e-4c53-a1d0-6d7d5c7326af"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:45.631630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-9e28a917-216c-4ca4-9d89-28d58a04c4bc req-1a50134b-5b05-4242-8dda-91979bf41a70 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:45.633042 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-9e28a917-216c-4ca4-9d89-28d58a04c4bc req-1a50134b-5b05-4242-8dda-91979bf41a70 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:45.683378 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-9e28a917-216c-4ca4-9d89-28d58a04c4bc req-1a50134b-5b05-4242-8dda-91979bf41a70 service nova] Creating event network-vif-deleted:02849233-f60e-4c53-a1d0-6d7d5c7326af for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:57:45.701528 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-9e28a917-216c-4ca4-9d89-28d58a04c4bc req-1a50134b-5b05-4242-8dda-91979bf41a70 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117367 Jul 25 12:57:45.702593 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1738/3551] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:57:45.708446 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ddb19e92-1ab9-4572-941a-0ade19687c81 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:45.709396 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ddb19e92-1ab9-4572-941a-0ade19687c81 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:45.717230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ddb19e92-1ab9-4572-941a-0ade19687c81 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:45.717907 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ddb19e92-1ab9-4572-941a-0ade19687c81 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:45.718849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ddb19e92-1ab9-4572-941a-0ade19687c81 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:45.719520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ddb19e92-1ab9-4572-941a-0ade19687c81 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:46.428753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9661787c-1dd9-4e49-9b6b-2f1219010179 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:46.444030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9661787c-1dd9-4e49-9b6b-2f1219010179 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:46.447965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9661787c-1dd9-4e49-9b6b-2f1219010179 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:46.453460 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9661787c-1dd9-4e49-9b6b-2f1219010179 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1845 microversion: 2.42 time: 2.663345 Jul 25 12:57:46.454424 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1814/3552] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:43 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1845 bytes in 2666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:57:46.463428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6e1286b5-896a-41e2-a374-77cea0d30756 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:46.467564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6e1286b5-896a-41e2-a374-77cea0d30756 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:46.484413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e1286b5-896a-41e2-a374-77cea0d30756 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:46.485792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e1286b5-896a-41e2-a374-77cea0d30756 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:46.487963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e1286b5-896a-41e2-a374-77cea0d30756 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:46.489544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e1286b5-896a-41e2-a374-77cea0d30756 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:47.425539 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6e1286b5-896a-41e2-a374-77cea0d30756 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:47.435329 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6e1286b5-896a-41e2-a374-77cea0d30756 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.977605 Jul 25 12:57:47.435938 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1815/3553] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:46 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:47.443934 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ddb19e92-1ab9-4572-941a-0ade19687c81 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:47.458377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ddb19e92-1ab9-4572-941a-0ade19687c81 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:47.466734 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6ec06bc6-7ad0-409d-a80e-7b3b09607727 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:47.467574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6ec06bc6-7ad0-409d-a80e-7b3b09607727 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:47.471405 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ddb19e92-1ab9-4572-941a-0ade19687c81 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:47.483330 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ddb19e92-1ab9-4572-941a-0ade19687c81 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 2818 microversion: 2.32 time: 1.770128 Jul 25 12:57:47.486591 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1739/3554] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:45 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 2818 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:47.491853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ec06bc6-7ad0-409d-a80e-7b3b09607727 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:47.497249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ec06bc6-7ad0-409d-a80e-7b3b09607727 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:47.501422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ec06bc6-7ad0-409d-a80e-7b3b09607727 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:47.502127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ec06bc6-7ad0-409d-a80e-7b3b09607727 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:47.505477 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6ef36edb-1d09-46d0-8e2e-9013a9a14b89 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:47.508287 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6ef36edb-1d09-46d0-8e2e-9013a9a14b89 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:47.531006 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6ef36edb-1d09-46d0-8e2e-9013a9a14b89 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:47.536636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6ef36edb-1d09-46d0-8e2e-9013a9a14b89 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:47.537765 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6ef36edb-1d09-46d0-8e2e-9013a9a14b89 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:47.541017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6ef36edb-1d09-46d0-8e2e-9013a9a14b89 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:48.298311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6ec06bc6-7ad0-409d-a80e-7b3b09607727 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:48.306155 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6ec06bc6-7ad0-409d-a80e-7b3b09607727 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.845580 Jul 25 12:57:48.306757 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1816/3555] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:47 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:57:48.330643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-edd6f531-6577-4bc2-b3e9-50e2798296bb req-a0e284a9-a8c1-48b9-b02e-d99e03444453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "tag": "cf0e5a93-6e29-451d-9c37-4cea02b17b40"}, {"server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "name": "network-vif-deleted", "tag": "39297266-b022-4131-809f-29475f17809c"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:48.353513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-edd6f531-6577-4bc2-b3e9-50e2798296bb req-a0e284a9-a8c1-48b9-b02e-d99e03444453 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:48.354336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-edd6f531-6577-4bc2-b3e9-50e2798296bb req-a0e284a9-a8c1-48b9-b02e-d99e03444453 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:48.382531 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-edd6f531-6577-4bc2-b3e9-50e2798296bb req-a0e284a9-a8c1-48b9-b02e-d99e03444453 service nova] Creating event network-changed:cf0e5a93-6e29-451d-9c37-4cea02b17b40 for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 12:57:48.383054 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-edd6f531-6577-4bc2-b3e9-50e2798296bb req-a0e284a9-a8c1-48b9-b02e-d99e03444453 service nova] Creating event network-vif-deleted:39297266-b022-4131-809f-29475f17809c for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:57:48.397493 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-edd6f531-6577-4bc2-b3e9-50e2798296bb req-a0e284a9-a8c1-48b9-b02e-d99e03444453 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.088849 Jul 25 12:57:48.399778 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1817/3556] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:57:48.406348 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-023f52be-c318-4c1c-b6d6-ac5c32f613de tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:48.407193 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-023f52be-c318-4c1c-b6d6-ac5c32f613de tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:48.417265 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-023f52be-c318-4c1c-b6d6-ac5c32f613de tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:48.417724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-023f52be-c318-4c1c-b6d6-ac5c32f613de tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:48.418606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-023f52be-c318-4c1c-b6d6-ac5c32f613de tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:48.419387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-023f52be-c318-4c1c-b6d6-ac5c32f613de tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:48.791072 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6ef36edb-1d09-46d0-8e2e-9013a9a14b89 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:48.810209 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6ef36edb-1d09-46d0-8e2e-9013a9a14b89 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:48.823939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6ef36edb-1d09-46d0-8e2e-9013a9a14b89 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:48.825504 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6ef36edb-1d09-46d0-8e2e-9013a9a14b89 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1845 microversion: 2.42 time: 1.336936 Jul 25 12:57:48.826550 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1740/3557] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:47 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1845 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:48.846923 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e58d5f3e-5cad-457d-944a-3a322330b607 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:48.847871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e58d5f3e-5cad-457d-944a-3a322330b607 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:48.861291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e58d5f3e-5cad-457d-944a-3a322330b607 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:48.862078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e58d5f3e-5cad-457d-944a-3a322330b607 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:48.863622 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e58d5f3e-5cad-457d-944a-3a322330b607 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:48.864418 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e58d5f3e-5cad-457d-944a-3a322330b607 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:49.821318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e58d5f3e-5cad-457d-944a-3a322330b607 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:49.839974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e58d5f3e-5cad-457d-944a-3a322330b607 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:49.854535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-023f52be-c318-4c1c-b6d6-ac5c32f613de tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:49.859386 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e58d5f3e-5cad-457d-944a-3a322330b607 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:49.869726 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e58d5f3e-5cad-457d-944a-3a322330b607 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 2545 microversion: 2.32 time: 1.041866 Jul 25 12:57:49.869877 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-023f52be-c318-4c1c-b6d6-ac5c32f613de tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 1.468675 Jul 25 12:57:49.872745 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1741/3558] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:48 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 2545 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:49.875779 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1818/3559] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:48 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:49.886100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8c639b8d-4e4a-4209-8171-16dfe4bea0bf tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:49.886932 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8c639b8d-4e4a-4209-8171-16dfe4bea0bf tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:49.905785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c639b8d-4e4a-4209-8171-16dfe4bea0bf tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:49.909172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c639b8d-4e4a-4209-8171-16dfe4bea0bf tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:49.910540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c639b8d-4e4a-4209-8171-16dfe4bea0bf tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:49.911220 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c639b8d-4e4a-4209-8171-16dfe4bea0bf tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:49.916315 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-07c76d8d-40a6-45b4-852d-03e56d65a014 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:49.917845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-07c76d8d-40a6-45b4-852d-03e56d65a014 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:49.932481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07c76d8d-40a6-45b4-852d-03e56d65a014 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:49.934102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07c76d8d-40a6-45b4-852d-03e56d65a014 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:49.935223 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07c76d8d-40a6-45b4-852d-03e56d65a014 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:49.936611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07c76d8d-40a6-45b4-852d-03e56d65a014 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:52.101198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8c639b8d-4e4a-4209-8171-16dfe4bea0bf tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:52.130450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8c639b8d-4e4a-4209-8171-16dfe4bea0bf tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:52.132149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8c639b8d-4e4a-4209-8171-16dfe4bea0bf tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:52.137916 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8c639b8d-4e4a-4209-8171-16dfe4bea0bf tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1866 microversion: 2.42 time: 2.259451 Jul 25 12:57:52.138568 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1742/3560] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:49 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1866 bytes in 2265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:52.149388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-4678dfc8-5308-4d81-ac6b-d0fe39458cb6 req-dc30087a-0db5-4793-9294-75736940a0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "name": "network-vif-deleted", "tag": "cb401cbd-e19d-4978-86c4-7928b236e3b9"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:52.163257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-07c76d8d-40a6-45b4-852d-03e56d65a014 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:52.172673 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4678dfc8-5308-4d81-ac6b-d0fe39458cb6 req-dc30087a-0db5-4793-9294-75736940a0d8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:52.173119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4678dfc8-5308-4d81-ac6b-d0fe39458cb6 req-dc30087a-0db5-4793-9294-75736940a0d8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:52.180700 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-07c76d8d-40a6-45b4-852d-03e56d65a014 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 2.270005 Jul 25 12:57:52.197865 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1819/3561] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:49 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 2288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:52.203199 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2bc36f90-2d49-41e0-a104-4d431d20e05c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:52.205626 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-4678dfc8-5308-4d81-ac6b-d0fe39458cb6 req-dc30087a-0db5-4793-9294-75736940a0d8 service nova] Creating event network-vif-deleted:cb401cbd-e19d-4978-86c4-7928b236e3b9 for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:57:52.207019 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2bc36f90-2d49-41e0-a104-4d431d20e05c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:52.218150 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-4678dfc8-5308-4d81-ac6b-d0fe39458cb6 req-dc30087a-0db5-4793-9294-75736940a0d8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072572 Jul 25 12:57:52.218780 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1743/3562] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:57:52.221462 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2bc36f90-2d49-41e0-a104-4d431d20e05c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:52.224108 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-72db1e07-3c68-4361-bad5-26055619f9e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:52.224820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2bc36f90-2d49-41e0-a104-4d431d20e05c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:52.225800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2bc36f90-2d49-41e0-a104-4d431d20e05c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:52.227647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2bc36f90-2d49-41e0-a104-4d431d20e05c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:52.234289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-72db1e07-3c68-4361-bad5-26055619f9e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:52.248403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-72db1e07-3c68-4361-bad5-26055619f9e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:52.248961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-72db1e07-3c68-4361-bad5-26055619f9e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:52.251531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-72db1e07-3c68-4361-bad5-26055619f9e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:52.252007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-72db1e07-3c68-4361-bad5-26055619f9e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:53.679615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-72db1e07-3c68-4361-bad5-26055619f9e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:53.720856 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-72db1e07-3c68-4361-bad5-26055619f9e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 1.500645 Jul 25 12:57:53.723824 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1744/3563] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:52 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:53.742737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1064b773-6948-44dd-a1ea-31a4ea3df5fc tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:53.749203 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1064b773-6948-44dd-a1ea-31a4ea3df5fc tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:53.764293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1064b773-6948-44dd-a1ea-31a4ea3df5fc tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:53.766301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1064b773-6948-44dd-a1ea-31a4ea3df5fc tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:53.768281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1064b773-6948-44dd-a1ea-31a4ea3df5fc tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:53.769811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1064b773-6948-44dd-a1ea-31a4ea3df5fc tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:53.846443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2bc36f90-2d49-41e0-a104-4d431d20e05c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:53.877286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2bc36f90-2d49-41e0-a104-4d431d20e05c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:53.879668 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2bc36f90-2d49-41e0-a104-4d431d20e05c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:53.897272 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2bc36f90-2d49-41e0-a104-4d431d20e05c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 2499 microversion: 2.32 time: 1.697897 Jul 25 12:57:53.910537 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1820/3564] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:52 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 2499 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:54.320197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-9e85ef74-93a0-4147-9e03-1a51336fb56b req-6afb4860-0529-4e3e-a267-074225d6f853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "name": "network-vif-deleted", "tag": "be480615-b9ea-4aa4-9399-1e7eabe09a0b"}, {"name": "network-changed", "server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "tag": "656db462-23e9-4625-a2e7-588155cc7f69"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:54.345127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9e85ef74-93a0-4147-9e03-1a51336fb56b req-6afb4860-0529-4e3e-a267-074225d6f853 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:54.345577 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9e85ef74-93a0-4147-9e03-1a51336fb56b req-6afb4860-0529-4e3e-a267-074225d6f853 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:54.380713 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-9e85ef74-93a0-4147-9e03-1a51336fb56b req-6afb4860-0529-4e3e-a267-074225d6f853 service nova] Creating event network-vif-deleted:be480615-b9ea-4aa4-9399-1e7eabe09a0b for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:57:54.381246 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-9e85ef74-93a0-4147-9e03-1a51336fb56b req-6afb4860-0529-4e3e-a267-074225d6f853 service nova] Creating event network-changed:656db462-23e9-4625-a2e7-588155cc7f69 for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 12:57:54.404249 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-9e85ef74-93a0-4147-9e03-1a51336fb56b req-6afb4860-0529-4e3e-a267-074225d6f853 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.091088 Jul 25 12:57:54.406730 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1821/3565] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:57:54.931210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b77bdf95-74f4-4f03-93bc-f12ad217ac58 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:54.931918 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b77bdf95-74f4-4f03-93bc-f12ad217ac58 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:54.948376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b77bdf95-74f4-4f03-93bc-f12ad217ac58 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:54.948887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b77bdf95-74f4-4f03-93bc-f12ad217ac58 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:54.950024 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b77bdf95-74f4-4f03-93bc-f12ad217ac58 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:54.950477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b77bdf95-74f4-4f03-93bc-f12ad217ac58 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:55.198777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b77bdf95-74f4-4f03-93bc-f12ad217ac58 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:55.216948 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b77bdf95-74f4-4f03-93bc-f12ad217ac58 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:55.225219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b77bdf95-74f4-4f03-93bc-f12ad217ac58 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:55.229650 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b77bdf95-74f4-4f03-93bc-f12ad217ac58 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 2160 microversion: 2.32 time: 0.304526 Jul 25 12:57:55.232798 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1822/3566] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:54 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 2160 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:55.273746 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1064b773-6948-44dd-a1ea-31a4ea3df5fc tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:55.320788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1064b773-6948-44dd-a1ea-31a4ea3df5fc tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:55.323658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1064b773-6948-44dd-a1ea-31a4ea3df5fc tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:55.326058 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1064b773-6948-44dd-a1ea-31a4ea3df5fc tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1854 microversion: 2.42 time: 1.599308 Jul 25 12:57:55.342669 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1745/3567] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:53 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1854 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:56.282016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-85070838-ef9b-4c4c-87d1-4d8329e3a67f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:56.283135 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-85070838-ef9b-4c4c-87d1-4d8329e3a67f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:56.341330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85070838-ef9b-4c4c-87d1-4d8329e3a67f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:56.342108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85070838-ef9b-4c4c-87d1-4d8329e3a67f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:56.343377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85070838-ef9b-4c4c-87d1-4d8329e3a67f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:56.344083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85070838-ef9b-4c4c-87d1-4d8329e3a67f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:56.359757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a852888d-fd16-4f87-943d-eabd7d78dd89 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:56.363905 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a852888d-fd16-4f87-943d-eabd7d78dd89 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:56.408248 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a852888d-fd16-4f87-943d-eabd7d78dd89 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:56.417350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a852888d-fd16-4f87-943d-eabd7d78dd89 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:56.423573 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a852888d-fd16-4f87-943d-eabd7d78dd89 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:56.426261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a852888d-fd16-4f87-943d-eabd7d78dd89 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:57.211317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-85070838-ef9b-4c4c-87d1-4d8329e3a67f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:57.220918 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:57.240908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-85070838-ef9b-4c4c-87d1-4d8329e3a67f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:57.247318 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-85070838-ef9b-4c4c-87d1-4d8329e3a67f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:57.248733 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-85070838-ef9b-4c4c-87d1-4d8329e3a67f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1604 microversion: 2.32 time: 0.984942 Jul 25 12:57:57.255664 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1823/3568] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:56 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1604 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:57.268168 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-02ae17cc-25bb-424f-90a1-0e2439b26da8 req-99d2d6d7-09ac-4f0c-8cb0-dcf37c3068a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75735e91-1a4c-435e-b3d5-53abb8bfae88", "name": "network-vif-deleted", "tag": "0cd19a7b-cc4c-4db9-a5bb-5479206d7d43"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:57.338801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-02ae17cc-25bb-424f-90a1-0e2439b26da8 req-99d2d6d7-09ac-4f0c-8cb0-dcf37c3068a2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:57.339483 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-02ae17cc-25bb-424f-90a1-0e2439b26da8 req-99d2d6d7-09ac-4f0c-8cb0-dcf37c3068a2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:57.436620 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-02ae17cc-25bb-424f-90a1-0e2439b26da8 req-99d2d6d7-09ac-4f0c-8cb0-dcf37c3068a2 service nova] Creating event network-vif-deleted:0cd19a7b-cc4c-4db9-a5bb-5479206d7d43 for instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 on n-h2-848886-15 Jul 25 12:57:57.459785 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-02ae17cc-25bb-424f-90a1-0e2439b26da8 req-99d2d6d7-09ac-4f0c-8cb0-dcf37c3068a2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202483 Jul 25 12:57:57.466938 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1824/3569] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:57:57.641084 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a852888d-fd16-4f87-943d-eabd7d78dd89 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:57.661262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a852888d-fd16-4f87-943d-eabd7d78dd89 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:57.676612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a852888d-fd16-4f87-943d-eabd7d78dd89 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:57.683020 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a852888d-fd16-4f87-943d-eabd7d78dd89 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 1.326749 Jul 25 12:57:57.704860 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1746/3570] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:56 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:58.285054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5e1a4411-983c-440f-ada1-d7bd4117eaeb tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:58.286298 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5e1a4411-983c-440f-ada1-d7bd4117eaeb tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:58.300893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e1a4411-983c-440f-ada1-d7bd4117eaeb tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:58.309311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e1a4411-983c-440f-ada1-d7bd4117eaeb tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:58.312085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e1a4411-983c-440f-ada1-d7bd4117eaeb tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:58.315457 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e1a4411-983c-440f-ada1-d7bd4117eaeb tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:58.713610 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cf77e1ae-632b-4e4a-a5e1-a2712c5a1400 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:58.715190 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cf77e1ae-632b-4e4a-a5e1-a2712c5a1400 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:58.730201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=44 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:58.758488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf77e1ae-632b-4e4a-a5e1-a2712c5a1400 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:58.759830 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf77e1ae-632b-4e4a-a5e1-a2712c5a1400 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:58.761022 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf77e1ae-632b-4e4a-a5e1-a2712c5a1400 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:58.761698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf77e1ae-632b-4e4a-a5e1-a2712c5a1400 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:59.203936 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5e1a4411-983c-440f-ada1-d7bd4117eaeb tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:59.233649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5e1a4411-983c-440f-ada1-d7bd4117eaeb tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:59.237649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5e1a4411-983c-440f-ada1-d7bd4117eaeb tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:59.247103 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5e1a4411-983c-440f-ada1-d7bd4117eaeb tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1604 microversion: 2.32 time: 0.965378 Jul 25 12:57:59.253506 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1825/3571] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:58 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1604 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:57:59.822002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-fe81b95d-926d-45ee-ac09-76dc18829685 req-ff0686e6-f1cc-4c40-aca7-886b1d93a35d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "tag": "619e5821-f34d-4084-bf18-5b7e99804fef"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:59.850571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fe81b95d-926d-45ee-ac09-76dc18829685 req-ff0686e6-f1cc-4c40-aca7-886b1d93a35d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:59.859573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fe81b95d-926d-45ee-ac09-76dc18829685 req-ff0686e6-f1cc-4c40-aca7-886b1d93a35d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:59.906461 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-fe81b95d-926d-45ee-ac09-76dc18829685 req-ff0686e6-f1cc-4c40-aca7-886b1d93a35d service nova] Creating event network-changed:619e5821-f34d-4084-bf18-5b7e99804fef for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 12:57:59.921448 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-fe81b95d-926d-45ee-ac09-76dc18829685 req-ff0686e6-f1cc-4c40-aca7-886b1d93a35d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103236 Jul 25 12:57:59.927269 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1826/3572] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:58:00.280140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5e7dc9c5-e895-413f-ba61-c819b7e2219e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:00.281011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5e7dc9c5-e895-413f-ba61-c819b7e2219e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:00.302728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e7dc9c5-e895-413f-ba61-c819b7e2219e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:00.303988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e7dc9c5-e895-413f-ba61-c819b7e2219e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:00.305789 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e7dc9c5-e895-413f-ba61-c819b7e2219e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:00.307932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e7dc9c5-e895-413f-ba61-c819b7e2219e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:00.591644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5e7dc9c5-e895-413f-ba61-c819b7e2219e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:00.606027 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5e7dc9c5-e895-413f-ba61-c819b7e2219e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:00.607871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5e7dc9c5-e895-413f-ba61-c819b7e2219e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:00.612713 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5e7dc9c5-e895-413f-ba61-c819b7e2219e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1604 microversion: 2.32 time: 0.336769 Jul 25 12:58:00.617732 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1827/3573] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:00 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1604 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:58:00.632683 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cf77e1ae-632b-4e4a-a5e1-a2712c5a1400 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:00.644882 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cf77e1ae-632b-4e4a-a5e1-a2712c5a1400 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:00.653504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cf77e1ae-632b-4e4a-a5e1-a2712c5a1400 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:00.666066 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cf77e1ae-632b-4e4a-a5e1-a2712c5a1400 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 1.958201 Jul 25 12:58:00.668301 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1747/3574] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:57:58 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 1961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:01.643768 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9fcc9d7f-cfaf-4de1-920b-4090849a7447 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:01.644691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9fcc9d7f-cfaf-4de1-920b-4090849a7447 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:01.659468 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9fcc9d7f-cfaf-4de1-920b-4090849a7447 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:01.667558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9fcc9d7f-cfaf-4de1-920b-4090849a7447 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:01.668629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9fcc9d7f-cfaf-4de1-920b-4090849a7447 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:01.670721 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9fcc9d7f-cfaf-4de1-920b-4090849a7447 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:01.693133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b295f2c3-aeb2-48da-9e7d-2b09ec9b83a0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:01.693939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b295f2c3-aeb2-48da-9e7d-2b09ec9b83a0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:01.714725 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b295f2c3-aeb2-48da-9e7d-2b09ec9b83a0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:01.716082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b295f2c3-aeb2-48da-9e7d-2b09ec9b83a0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:01.718819 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b295f2c3-aeb2-48da-9e7d-2b09ec9b83a0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:01.719429 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b295f2c3-aeb2-48da-9e7d-2b09ec9b83a0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:02.507194 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9fcc9d7f-cfaf-4de1-920b-4090849a7447 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:02.545667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9fcc9d7f-cfaf-4de1-920b-4090849a7447 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:02.556104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9fcc9d7f-cfaf-4de1-920b-4090849a7447 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:02.558931 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9fcc9d7f-cfaf-4de1-920b-4090849a7447 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1604 microversion: 2.32 time: 0.918134 Jul 25 12:58:02.565463 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1828/3575] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:01 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1604 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:02.979713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b295f2c3-aeb2-48da-9e7d-2b09ec9b83a0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:02.998134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b295f2c3-aeb2-48da-9e7d-2b09ec9b83a0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:03.005704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b295f2c3-aeb2-48da-9e7d-2b09ec9b83a0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:03.009470 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b295f2c3-aeb2-48da-9e7d-2b09ec9b83a0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 1.320357 Jul 25 12:58:03.016011 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1748/3576] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:01 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:58:03.599062 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cd3c67b5-a7a2-40ca-89dd-afcadb189eaa tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:03.600884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cd3c67b5-a7a2-40ca-89dd-afcadb189eaa tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:03.617163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd3c67b5-a7a2-40ca-89dd-afcadb189eaa tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:03.623914 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd3c67b5-a7a2-40ca-89dd-afcadb189eaa tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:03.630626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd3c67b5-a7a2-40ca-89dd-afcadb189eaa tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:03.632474 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd3c67b5-a7a2-40ca-89dd-afcadb189eaa tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:03.794719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:03.826296 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c6b020e1-7d71-428a-b488-d3cc1867522d tempest-ServerGroup264TestJSON-450171498 tempest-ServerGroup264TestJSON-450171498-project] Action: 'create', calling method: .version_select at 0x7efcf9d0a280>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:58:03.880215 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-c6b020e1-7d71-428a-b488-d3cc1867522d tempest-ServerGroup264TestJSON-450171498 tempest-ServerGroup264TestJSON-450171498-project] Getting quotas for project e2171dc4239c4711a8beaaa67ad88d2e. Resources: {'server_groups'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:58:03.902655 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-c6b020e1-7d71-428a-b488-d3cc1867522d tempest-ServerGroup264TestJSON-450171498 tempest-ServerGroup264TestJSON-450171498-project] Getting quotas for user 9c5917ff6e5b44e19ac63e453138cf5e and project e2171dc4239c4711a8beaaa67ad88d2e. Resources: {'server_groups'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:58:04.168089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-c6b020e1-7d71-428a-b488-d3cc1867522d tempest-ServerGroup264TestJSON-450171498 tempest-ServerGroup264TestJSON-450171498-project] Getting quotas for project e2171dc4239c4711a8beaaa67ad88d2e. Resources: {'server_groups'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:58:04.185382 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-c6b020e1-7d71-428a-b488-d3cc1867522d tempest-ServerGroup264TestJSON-450171498 tempest-ServerGroup264TestJSON-450171498-project] Getting quotas for user 9c5917ff6e5b44e19ac63e453138cf5e and project e2171dc4239c4711a8beaaa67ad88d2e. Resources: {'server_groups'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:58:04.322004 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c6b020e1-7d71-428a-b488-d3cc1867522d tempest-ServerGroup264TestJSON-450171498 tempest-ServerGroup264TestJSON-450171498-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.921139 Jul 25 12:58:04.324130 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1829/3577] 10.222.0.49 () {62 vars in 1214 bytes} [Mon Jul 25 12:58:03 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:58:04.337436 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-19685748-2d76-43e1-ba81-d0acc930ae76 req-e1900b26-6105-4a59-a92d-1aa4c2ffc899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "tag": "b2ed9ff7-f05b-47ef-83cb-258951d51489"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:58:04.359654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-19685748-2d76-43e1-ba81-d0acc930ae76 req-e1900b26-6105-4a59-a92d-1aa4c2ffc899 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:04.360416 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-19685748-2d76-43e1-ba81-d0acc930ae76 req-e1900b26-6105-4a59-a92d-1aa4c2ffc899 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:04.409856 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-19685748-2d76-43e1-ba81-d0acc930ae76 req-e1900b26-6105-4a59-a92d-1aa4c2ffc899 service nova] Creating event network-changed:b2ed9ff7-f05b-47ef-83cb-258951d51489 for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 12:58:04.437333 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-19685748-2d76-43e1-ba81-d0acc930ae76 req-e1900b26-6105-4a59-a92d-1aa4c2ffc899 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111476 Jul 25 12:58:04.438374 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1830/3578] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:58:04.447301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d6dc1242-b4b4-4031-be67-41161f098f9d tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:04.454447 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d6dc1242-b4b4-4031-be67-41161f098f9d tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:04.471674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d6dc1242-b4b4-4031-be67-41161f098f9d tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:04.478634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d6dc1242-b4b4-4031-be67-41161f098f9d tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:04.479831 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d6dc1242-b4b4-4031-be67-41161f098f9d tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:04.480495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d6dc1242-b4b4-4031-be67-41161f098f9d tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:04.688191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cd3c67b5-a7a2-40ca-89dd-afcadb189eaa tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:04.711104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cd3c67b5-a7a2-40ca-89dd-afcadb189eaa tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:04.725336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cd3c67b5-a7a2-40ca-89dd-afcadb189eaa tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:04.730115 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cd3c67b5-a7a2-40ca-89dd-afcadb189eaa tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1604 microversion: 2.32 time: 1.137933 Jul 25 12:58:04.741856 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1749/3579] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:03 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1604 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:04.765915 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b2f6d83d-2e3e-4758-81b6-1410e4f3fcaf tempest-ServerGroup264TestJSON-450171498 tempest-ServerGroup264TestJSON-450171498-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:04.817818 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b2f6d83d-2e3e-4758-81b6-1410e4f3fcaf tempest-ServerGroup264TestJSON-450171498 tempest-ServerGroup264TestJSON-450171498-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.074588 Jul 25 12:58:04.821405 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1750/3580] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Jul 25 12:58:04 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:58:04.842431 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-75a33a35-273f-4e21-84de-9e23ee951141 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:58:04.846727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-75a33a35-273f-4e21-84de-9e23ee951141 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:04.884064 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-75a33a35-273f-4e21-84de-9e23ee951141 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:04.888750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-75a33a35-273f-4e21-84de-9e23ee951141 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:04.893959 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-75a33a35-273f-4e21-84de-9e23ee951141 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:04.895957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-75a33a35-273f-4e21-84de-9e23ee951141 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:05.152212 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-75a33a35-273f-4e21-84de-9e23ee951141 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action" status: 202 len: 0 microversion: 2.1 time: 0.328187 Jul 25 12:58:05.153189 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1751/3581] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:58:04 2022] POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:58:05.168776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-14398ca7-a000-432d-ad88-d5ba8985c815 tempest-ServerGroup264TestJSON-450171498 tempest-ServerGroup264TestJSON-450171498-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:05.190825 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-14398ca7-a000-432d-ad88-d5ba8985c815 tempest-ServerGroup264TestJSON-450171498 tempest-ServerGroup264TestJSON-450171498-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups/d5687491-f494-40e4-ba0c-8dfd81e6234a" status: 200 len: 235 microversion: 2.64 time: 0.036023 Jul 25 12:58:05.192837 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1752/3582] 10.222.0.49 () {60 vars in 1304 bytes} [Mon Jul 25 12:58:05 2022] GET /compute/v2.1/os-server-groups/d5687491-f494-40e4-ba0c-8dfd81e6234a => generated 235 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:58:05.202805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-50631ce8-730b-4a35-9586-7c455d21260c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:05.210241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-50631ce8-730b-4a35-9586-7c455d21260c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:05.231559 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50631ce8-730b-4a35-9586-7c455d21260c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:05.236867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50631ce8-730b-4a35-9586-7c455d21260c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:05.239431 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50631ce8-730b-4a35-9586-7c455d21260c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:05.246497 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50631ce8-730b-4a35-9586-7c455d21260c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:06.247429 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d6dc1242-b4b4-4031-be67-41161f098f9d tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:06.271138 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d6dc1242-b4b4-4031-be67-41161f098f9d tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:06.280306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d6dc1242-b4b4-4031-be67-41161f098f9d tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:06.306384 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d6dc1242-b4b4-4031-be67-41161f098f9d tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 1.862707 Jul 25 12:58:06.307905 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1831/3583] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:04 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:06.333530 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-00123c3e-4e86-4ca2-9304-13a53df7a8e3 tempest-ServerGroup264TestJSON-450171498 tempest-ServerGroup264TestJSON-450171498-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:06.452520 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-00123c3e-4e86-4ca2-9304-13a53df7a8e3 tempest-ServerGroup264TestJSON-450171498 tempest-ServerGroup264TestJSON-450171498-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/d5687491-f494-40e4-ba0c-8dfd81e6234a" status: 204 len: 0 microversion: 2.64 time: 0.141447 Jul 25 12:58:06.454953 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1832/3584] 10.222.0.49 () {60 vars in 1307 bytes} [Mon Jul 25 12:58:06 2022] DELETE /compute/v2.1/os-server-groups/d5687491-f494-40e4-ba0c-8dfd81e6234a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 12:58:06.473647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4fa2855b-d9fd-44d9-99b1-32f6d9fb4285 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:06.480014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4fa2855b-d9fd-44d9-99b1-32f6d9fb4285 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:06.500969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4fa2855b-d9fd-44d9-99b1-32f6d9fb4285 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:06.502093 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4fa2855b-d9fd-44d9-99b1-32f6d9fb4285 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:06.504266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4fa2855b-d9fd-44d9-99b1-32f6d9fb4285 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:06.504806 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4fa2855b-d9fd-44d9-99b1-32f6d9fb4285 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:07.016152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-50631ce8-730b-4a35-9586-7c455d21260c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:07.035151 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-50631ce8-730b-4a35-9586-7c455d21260c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1671 microversion: 2.1 time: 1.838053 Jul 25 12:58:07.038588 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1753/3585] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:05 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1671 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:07.056568 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ca14e0ae-29e8-48ea-888f-35d3e5dc731f tempest-ServerGroup264TestJSON-450171498 tempest-ServerGroup264TestJSON-450171498-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:07.083878 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-ca14e0ae-29e8-48ea-888f-35d3e5dc731f tempest-ServerGroup264TestJSON-450171498 tempest-ServerGroup264TestJSON-450171498-project] HTTP exception thrown: Instance group d5687491-f494-40e4-ba0c-8dfd81e6234a could not be found. Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ca14e0ae-29e8-48ea-888f-35d3e5dc731f tempest-ServerGroup264TestJSON-450171498 tempest-ServerGroup264TestJSON-450171498-project] Request method failure captured: Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/os-server-groups/d5687491-f494-40e4-ba0c-8dfd81e6234a HTTP/1.1 Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pNbt99NB65hV1KzabSmYXWACQAZhieD-j2_dVQEsgF6qdp5Ht2HghvP4Ixy6b6KlDVPgqFCIgKGYUBRey0y0bjMQ2rSbeiduYJk0lLz6TKlLYZP1cdSxGBdOkR1oqjz1z7eieIejdCF38zW248au1GGmSmeWoKsVpwFb_q7kxwDT4Y Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: X-Openstack-Nova-Api-Version: 2.64 Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: e2171dc4239c4711a8beaaa67ad88d2e Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerGroup264TestJSON-450171498 Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e2171dc4239c4711a8beaaa67ad88d2e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e2171dc4239c4711a8beaaa67ad88d2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2171dc4239c4711a8beaaa67ad88d2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2171dc4239c4711a8beaaa67ad88d2e"}]}] Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerGroup264TestJSON-450171498 Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: e2171dc4239c4711a8beaaa67ad88d2e Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerGroup264TestJSON-450171498 Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerGroup264TestJSON-450171498-project Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 9c5917ff6e5b44e19ac63e453138cf5e Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerGroup264TestJSON-450171498-project Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance group d5687491-f494-40e4-ba0c-8dfd81e6234a could not be found. Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'd5687491-f494-40e4-ba0c-8dfd81e6234a'} Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d5687491-f494-40e4-ba0c-8dfd81e6234a could not be found. Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d5687491-f494-40e4-ba0c-8dfd81e6234a could not be found. Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:58:07.086393 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:07.090050 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:58:07.090050 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:58:07.090050 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:58:07.090050 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:58:07.090050 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d5687491-f494-40e4-ba0c-8dfd81e6234a could not be found. Jul 25 12:58:07.090050 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:58:07.090050 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ca14e0ae-29e8-48ea-888f-35d3e5dc731f tempest-ServerGroup264TestJSON-450171498 tempest-ServerGroup264TestJSON-450171498-project] Returning 404 to user: Instance group d5687491-f494-40e4-ba0c-8dfd81e6234a could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:58:07.102372 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ca14e0ae-29e8-48ea-888f-35d3e5dc731f tempest-ServerGroup264TestJSON-450171498 tempest-ServerGroup264TestJSON-450171498-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/d5687491-f494-40e4-ba0c-8dfd81e6234a" status: 404 len: 117 microversion: 2.64 time: 0.046791 Jul 25 12:58:07.103038 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1754/3586] 10.222.0.49 () {60 vars in 1307 bytes} [Mon Jul 25 12:58:07 2022] DELETE /compute/v2.1/os-server-groups/d5687491-f494-40e4-ba0c-8dfd81e6234a => generated 117 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:58:07.336539 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1a4b504c-5a3c-4f1d-83f8-f2c5319a3d7e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:07.337904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1a4b504c-5a3c-4f1d-83f8-f2c5319a3d7e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:07.356710 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a4b504c-5a3c-4f1d-83f8-f2c5319a3d7e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:07.360220 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a4b504c-5a3c-4f1d-83f8-f2c5319a3d7e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:07.361630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a4b504c-5a3c-4f1d-83f8-f2c5319a3d7e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:07.362993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a4b504c-5a3c-4f1d-83f8-f2c5319a3d7e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:07.460893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4fa2855b-d9fd-44d9-99b1-32f6d9fb4285 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:07.480993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4fa2855b-d9fd-44d9-99b1-32f6d9fb4285 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:07.486780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4fa2855b-d9fd-44d9-99b1-32f6d9fb4285 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:07.488048 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4fa2855b-d9fd-44d9-99b1-32f6d9fb4285 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1604 microversion: 2.32 time: 1.031166 Jul 25 12:58:07.496008 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1833/3587] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:06 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1604 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:08.057117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-63885335-9a7c-4b57-96d2-be3e68d32de7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:08.057668 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-63885335-9a7c-4b57-96d2-be3e68d32de7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:08.071660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-63885335-9a7c-4b57-96d2-be3e68d32de7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:08.079452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-63885335-9a7c-4b57-96d2-be3e68d32de7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:08.081301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-63885335-9a7c-4b57-96d2-be3e68d32de7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:08.087229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-63885335-9a7c-4b57-96d2-be3e68d32de7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:08.748493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1a4b504c-5a3c-4f1d-83f8-f2c5319a3d7e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:08.770287 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1a4b504c-5a3c-4f1d-83f8-f2c5319a3d7e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:08.771889 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1a4b504c-5a3c-4f1d-83f8-f2c5319a3d7e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:08.786468 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1a4b504c-5a3c-4f1d-83f8-f2c5319a3d7e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 1.441861 Jul 25 12:58:08.787176 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1755/3588] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:07 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:58:08.840765 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c69420bc-055f-47e9-9178-497416acd7a5 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:08.841566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c69420bc-055f-47e9-9178-497416acd7a5 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:08.884340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c69420bc-055f-47e9-9178-497416acd7a5 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:08.884790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c69420bc-055f-47e9-9178-497416acd7a5 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:08.885714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c69420bc-055f-47e9-9178-497416acd7a5 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:08.898230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c69420bc-055f-47e9-9178-497416acd7a5 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:09.256923 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c69420bc-055f-47e9-9178-497416acd7a5 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:09.281427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c69420bc-055f-47e9-9178-497416acd7a5 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:09.288032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c69420bc-055f-47e9-9178-497416acd7a5 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:09.313645 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c69420bc-055f-47e9-9178-497416acd7a5 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1604 microversion: 2.32 time: 0.492900 Jul 25 12:58:09.316749 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1756/3589] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:08 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1604 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:09.814659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c37ceb99-7bdb-4267-a9af-07d81f1afbb6 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:09.815991 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c37ceb99-7bdb-4267-a9af-07d81f1afbb6 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:09.830639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c37ceb99-7bdb-4267-a9af-07d81f1afbb6 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:09.831125 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c37ceb99-7bdb-4267-a9af-07d81f1afbb6 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:09.831956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c37ceb99-7bdb-4267-a9af-07d81f1afbb6 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:09.832394 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c37ceb99-7bdb-4267-a9af-07d81f1afbb6 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:10.534548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-63885335-9a7c-4b57-96d2-be3e68d32de7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:10.544473 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-63885335-9a7c-4b57-96d2-be3e68d32de7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1671 microversion: 2.1 time: 2.491799 Jul 25 12:58:10.566671 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1834/3590] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:08 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1671 bytes in 2515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:58:10.579028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d156c15a-4b11-4088-94da-c11a528cf5f3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:10.579655 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d156c15a-4b11-4088-94da-c11a528cf5f3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:10.605637 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d156c15a-4b11-4088-94da-c11a528cf5f3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:10.606185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d156c15a-4b11-4088-94da-c11a528cf5f3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:10.609244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d156c15a-4b11-4088-94da-c11a528cf5f3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:10.609759 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d156c15a-4b11-4088-94da-c11a528cf5f3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:10.930782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d156c15a-4b11-4088-94da-c11a528cf5f3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:10.949331 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d156c15a-4b11-4088-94da-c11a528cf5f3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:10.959329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d156c15a-4b11-4088-94da-c11a528cf5f3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:10.969179 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d156c15a-4b11-4088-94da-c11a528cf5f3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1604 microversion: 2.32 time: 0.400805 Jul 25 12:58:10.972345 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1835/3591] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:10 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1604 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:11.036755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-64793e9d-5228-455b-9255-6675957d572f req-6b7a119a-78e7-4b6e-a360-24761fcb7031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "tag": "688cd2c2-4671-443a-89b1-550dc60cd0ee"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:58:11.087735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-64793e9d-5228-455b-9255-6675957d572f req-6b7a119a-78e7-4b6e-a360-24761fcb7031 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:11.088201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-64793e9d-5228-455b-9255-6675957d572f req-6b7a119a-78e7-4b6e-a360-24761fcb7031 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:11.156150 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-64793e9d-5228-455b-9255-6675957d572f req-6b7a119a-78e7-4b6e-a360-24761fcb7031 service nova] Creating event network-changed:688cd2c2-4671-443a-89b1-550dc60cd0ee for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 12:58:11.178502 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-64793e9d-5228-455b-9255-6675957d572f req-6b7a119a-78e7-4b6e-a360-24761fcb7031 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146340 Jul 25 12:58:11.179122 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1836/3592] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:58:11.580748 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e1f25121-eb60-42b9-b9fd-487def5781e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:11.581546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e1f25121-eb60-42b9-b9fd-487def5781e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:11.603323 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1f25121-eb60-42b9-b9fd-487def5781e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:11.603785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1f25121-eb60-42b9-b9fd-487def5781e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:11.604621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1f25121-eb60-42b9-b9fd-487def5781e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:11.615341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1f25121-eb60-42b9-b9fd-487def5781e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:12.269305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c37ceb99-7bdb-4267-a9af-07d81f1afbb6 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:12.285442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c37ceb99-7bdb-4267-a9af-07d81f1afbb6 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:12.287235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c37ceb99-7bdb-4267-a9af-07d81f1afbb6 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:12.290918 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c37ceb99-7bdb-4267-a9af-07d81f1afbb6 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 2.481757 Jul 25 12:58:12.303003 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1757/3593] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:09 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 2495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:12.309586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-70338b1f-dd50-46cd-add0-023372d31322 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:12.311420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-70338b1f-dd50-46cd-add0-023372d31322 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:12.333738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-70338b1f-dd50-46cd-add0-023372d31322 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:12.335098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-70338b1f-dd50-46cd-add0-023372d31322 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:12.336160 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-70338b1f-dd50-46cd-add0-023372d31322 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:12.336965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-70338b1f-dd50-46cd-add0-023372d31322 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:12.704126 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-70338b1f-dd50-46cd-add0-023372d31322 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:12.708578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e1f25121-eb60-42b9-b9fd-487def5781e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:12.715295 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-70338b1f-dd50-46cd-add0-023372d31322 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:12.725200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-70338b1f-dd50-46cd-add0-023372d31322 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:12.726963 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e1f25121-eb60-42b9-b9fd-487def5781e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1671 microversion: 2.1 time: 1.150501 Jul 25 12:58:12.728132 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1837/3594] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:11 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1671 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:58:12.736202 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-70338b1f-dd50-46cd-add0-023372d31322 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1604 microversion: 2.32 time: 0.423151 Jul 25 12:58:12.742092 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1758/3595] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:12 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1604 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:13.336352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-95981951-8e34-42bc-a69a-e220cd92eeaf tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:13.337574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-95981951-8e34-42bc-a69a-e220cd92eeaf tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:13.351323 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95981951-8e34-42bc-a69a-e220cd92eeaf tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:13.354920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95981951-8e34-42bc-a69a-e220cd92eeaf tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:13.358448 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95981951-8e34-42bc-a69a-e220cd92eeaf tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:13.359527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95981951-8e34-42bc-a69a-e220cd92eeaf tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:13.750672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7c2eac95-efd2-49ba-8da4-5f4c97acf1a6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:13.752062 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7c2eac95-efd2-49ba-8da4-5f4c97acf1a6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:13.760688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c2eac95-efd2-49ba-8da4-5f4c97acf1a6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:13.761332 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c2eac95-efd2-49ba-8da4-5f4c97acf1a6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:13.762276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c2eac95-efd2-49ba-8da4-5f4c97acf1a6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:13.763016 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c2eac95-efd2-49ba-8da4-5f4c97acf1a6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:14.248023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=8 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:14.267525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-95981951-8e34-42bc-a69a-e220cd92eeaf tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:14.277275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-95981951-8e34-42bc-a69a-e220cd92eeaf tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:14.284034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-95981951-8e34-42bc-a69a-e220cd92eeaf tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:14.291731 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-95981951-8e34-42bc-a69a-e220cd92eeaf tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 0.959956 Jul 25 12:58:14.292582 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1838/3596] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:13 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:14.301634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-90653fd0-dd08-411e-ac85-e79efa894e28 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:14.302591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-90653fd0-dd08-411e-ac85-e79efa894e28 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:14.314822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:14.320119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90653fd0-dd08-411e-ac85-e79efa894e28 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:14.322273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90653fd0-dd08-411e-ac85-e79efa894e28 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:14.326217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90653fd0-dd08-411e-ac85-e79efa894e28 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:14.327076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90653fd0-dd08-411e-ac85-e79efa894e28 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:14.380240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7c2eac95-efd2-49ba-8da4-5f4c97acf1a6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:14.388869 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7c2eac95-efd2-49ba-8da4-5f4c97acf1a6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.642676 Jul 25 12:58:14.403304 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1759/3597] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:13 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:14.566032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-90653fd0-dd08-411e-ac85-e79efa894e28 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:14.586478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-90653fd0-dd08-411e-ac85-e79efa894e28 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:14.591212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-90653fd0-dd08-411e-ac85-e79efa894e28 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:14.593814 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-90653fd0-dd08-411e-ac85-e79efa894e28 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1604 microversion: 2.32 time: 0.299382 Jul 25 12:58:14.594884 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1839/3598] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:14 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1604 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:14.862814 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-29b5cbbc-ffd4-4f0e-92e0-932527664f89 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1533258136", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:58:14.940503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-cfb7813c-7ce9-41be-afec-d57e8db1b7c9 req-4257b26e-1e3c-4887-bdcd-d7c1bbaf25cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "tag": "f6d2cc3f-fab3-4780-857c-9ee48589fd5f"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:58:14.966923 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-cfb7813c-7ce9-41be-afec-d57e8db1b7c9 req-4257b26e-1e3c-4887-bdcd-d7c1bbaf25cc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:14.974625 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-cfb7813c-7ce9-41be-afec-d57e8db1b7c9 req-4257b26e-1e3c-4887-bdcd-d7c1bbaf25cc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:14.983075 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-29b5cbbc-ffd4-4f0e-92e0-932527664f89 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] validate_networks() for None {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:58:15.000488 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-cfb7813c-7ce9-41be-afec-d57e8db1b7c9 req-4257b26e-1e3c-4887-bdcd-d7c1bbaf25cc service nova] Creating event network-changed:f6d2cc3f-fab3-4780-857c-9ee48589fd5f for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 12:58:15.014815 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-cfb7813c-7ce9-41be-afec-d57e8db1b7c9 req-4257b26e-1e3c-4887-bdcd-d7c1bbaf25cc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078994 Jul 25 12:58:15.016150 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1840/3599] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:58:15.320736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4c99c0fe-7fc8-4884-bfcf-20fb8e47c218 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:15.322593 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4c99c0fe-7fc8-4884-bfcf-20fb8e47c218 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:15.341285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c99c0fe-7fc8-4884-bfcf-20fb8e47c218 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:15.342147 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c99c0fe-7fc8-4884-bfcf-20fb8e47c218 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:15.343267 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c99c0fe-7fc8-4884-bfcf-20fb8e47c218 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:15.343861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c99c0fe-7fc8-4884-bfcf-20fb8e47c218 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:16.576352 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-29b5cbbc-ffd4-4f0e-92e0-932527664f89 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:58:16.577377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-29b5cbbc-ffd4-4f0e-92e0-932527664f89 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:58:16.578052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-29b5cbbc-ffd4-4f0e-92e0-932527664f89 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:58:16.578623 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-29b5cbbc-ffd4-4f0e-92e0-932527664f89 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:58:16.579214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-29b5cbbc-ffd4-4f0e-92e0-932527664f89 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:58:16.592107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29b5cbbc-ffd4-4f0e-92e0-932527664f89 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:16.593245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29b5cbbc-ffd4-4f0e-92e0-932527664f89 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:16.595551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29b5cbbc-ffd4-4f0e-92e0-932527664f89 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:16.599158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29b5cbbc-ffd4-4f0e-92e0-932527664f89 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:16.616436 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4c99c0fe-7fc8-4884-bfcf-20fb8e47c218 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:16.636295 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-29b5cbbc-ffd4-4f0e-92e0-932527664f89 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Getting quotas for project 64738d1d5d274ff0860307868c10b5d8. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:58:16.647068 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4c99c0fe-7fc8-4884-bfcf-20fb8e47c218 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:16.648908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4c99c0fe-7fc8-4884-bfcf-20fb8e47c218 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:16.659921 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-29b5cbbc-ffd4-4f0e-92e0-932527664f89 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Getting quotas for user 5d6839f6502c4eeabf516265d3b00a79 and project 64738d1d5d274ff0860307868c10b5d8. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:58:16.676518 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4c99c0fe-7fc8-4884-bfcf-20fb8e47c218 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 1.334289 Jul 25 12:58:16.677523 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1841/3600] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:15 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:16.682471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-99b42822-2f3f-49e4-a5d8-72ff9d41fc7f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:16.683108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-99b42822-2f3f-49e4-a5d8-72ff9d41fc7f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:16.690763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-99b42822-2f3f-49e4-a5d8-72ff9d41fc7f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:16.691088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-99b42822-2f3f-49e4-a5d8-72ff9d41fc7f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:16.692057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-99b42822-2f3f-49e4-a5d8-72ff9d41fc7f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:16.692640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-99b42822-2f3f-49e4-a5d8-72ff9d41fc7f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:16.713925 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-29b5cbbc-ffd4-4f0e-92e0-932527664f89 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:58:16.717146 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-29b5cbbc-ffd4-4f0e-92e0-932527664f89 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] [instance: ce6d7273-d1e3-400b-87f6-2e4625e78272] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:58:16.788808 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-29b5cbbc-ffd4-4f0e-92e0-932527664f89 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.933916 Jul 25 12:58:16.790292 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1760/3601] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:58:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:58:16.805646 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-61cac0c3-3e6a-4c69-a5bf-b9b4ac9a5524 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:16.810254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-61cac0c3-3e6a-4c69-a5bf-b9b4ac9a5524 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] [instance: ce6d7273-d1e3-400b-87f6-2e4625e78272] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:17.049511 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-99b42822-2f3f-49e4-a5d8-72ff9d41fc7f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:17.051222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-61cac0c3-3e6a-4c69-a5bf-b9b4ac9a5524 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6839f6502c4eeabf516265d3b00a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64738d1d5d274ff0860307868c10b5d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:17.077930 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-61cac0c3-3e6a-4c69-a5bf-b9b4ac9a5524 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] 10.222.0.49 "GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272" status: 200 len: 1215 microversion: 2.1 time: 0.270002 Jul 25 12:58:17.095374 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1761/3602] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:16 2022] GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272 => generated 1215 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:58:17.095520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-99b42822-2f3f-49e4-a5d8-72ff9d41fc7f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:17.095520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-99b42822-2f3f-49e4-a5d8-72ff9d41fc7f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:17.095520 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-99b42822-2f3f-49e4-a5d8-72ff9d41fc7f tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1604 microversion: 2.32 time: 0.416719 Jul 25 12:58:17.109920 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1842/3603] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:16 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1604 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:17.732742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bea0fc40-2909-4145-b84e-78dbdb633c2f tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:17.734441 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bea0fc40-2909-4145-b84e-78dbdb633c2f tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:17.768693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bea0fc40-2909-4145-b84e-78dbdb633c2f tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:17.771992 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bea0fc40-2909-4145-b84e-78dbdb633c2f tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:17.773736 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bea0fc40-2909-4145-b84e-78dbdb633c2f tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:17.777621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bea0fc40-2909-4145-b84e-78dbdb633c2f tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:18.104176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6dbb5a81-efe8-4d2a-ae1f-6e0c3e7c2f7e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:18.104853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6dbb5a81-efe8-4d2a-ae1f-6e0c3e7c2f7e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] [instance: ce6d7273-d1e3-400b-87f6-2e4625e78272] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:18.121645 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6dbb5a81-efe8-4d2a-ae1f-6e0c3e7c2f7e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:18.122431 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6dbb5a81-efe8-4d2a-ae1f-6e0c3e7c2f7e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:18.126751 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6dbb5a81-efe8-4d2a-ae1f-6e0c3e7c2f7e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:18.127837 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6dbb5a81-efe8-4d2a-ae1f-6e0c3e7c2f7e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:18.382150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6dbb5a81-efe8-4d2a-ae1f-6e0c3e7c2f7e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6839f6502c4eeabf516265d3b00a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64738d1d5d274ff0860307868c10b5d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:18.393406 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6dbb5a81-efe8-4d2a-ae1f-6e0c3e7c2f7e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] 10.222.0.49 "GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272" status: 200 len: 1211 microversion: 2.1 time: 0.294487 Jul 25 12:58:18.396362 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1843/3604] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:18 2022] GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272 => generated 1211 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:58:18.431109 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bea0fc40-2909-4145-b84e-78dbdb633c2f tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:18.438896 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-32bf40f5-bea7-42bf-a242-e45dc360b42e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:18.439757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-32bf40f5-bea7-42bf-a242-e45dc360b42e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:18.447629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bea0fc40-2909-4145-b84e-78dbdb633c2f tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:18.454616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bea0fc40-2909-4145-b84e-78dbdb633c2f tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:18.457235 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bea0fc40-2909-4145-b84e-78dbdb633c2f tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 0.750562 Jul 25 12:58:18.460312 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1762/3605] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:17 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:18.467707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32bf40f5-bea7-42bf-a242-e45dc360b42e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:18.468479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32bf40f5-bea7-42bf-a242-e45dc360b42e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:18.469432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32bf40f5-bea7-42bf-a242-e45dc360b42e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:18.472466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32bf40f5-bea7-42bf-a242-e45dc360b42e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:18.677969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-32bf40f5-bea7-42bf-a242-e45dc360b42e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:18.695883 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-32bf40f5-bea7-42bf-a242-e45dc360b42e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:18.697379 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-32bf40f5-bea7-42bf-a242-e45dc360b42e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:18.705627 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-32bf40f5-bea7-42bf-a242-e45dc360b42e tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1604 microversion: 2.32 time: 0.291481 Jul 25 12:58:18.708982 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1844/3606] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:18 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1604 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:18.732979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-08ca698c-1b36-4705-9c6d-cd9377e4a4e5 req-a6637122-e07c-4c1a-bfd1-18e1d1d30196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "tag": "26bcc0bb-2e9b-4db5-8b7d-981c3d3a8e62"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:58:18.771752 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-08ca698c-1b36-4705-9c6d-cd9377e4a4e5 req-a6637122-e07c-4c1a-bfd1-18e1d1d30196 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:18.777129 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-08ca698c-1b36-4705-9c6d-cd9377e4a4e5 req-a6637122-e07c-4c1a-bfd1-18e1d1d30196 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:18.841784 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-08ca698c-1b36-4705-9c6d-cd9377e4a4e5 req-a6637122-e07c-4c1a-bfd1-18e1d1d30196 service nova] Creating event network-changed:26bcc0bb-2e9b-4db5-8b7d-981c3d3a8e62 for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 12:58:18.858788 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-08ca698c-1b36-4705-9c6d-cd9377e4a4e5 req-a6637122-e07c-4c1a-bfd1-18e1d1d30196 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142242 Jul 25 12:58:18.859756 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1845/3607] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:58:19.146409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9ea9899e-0511-4881-a713-2a63ebede421 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-898443235", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "72e155e9-6b3d-4a63-a657-e3d3db8c31c2"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:58:19.223589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-9ea9899e-0511-4881-a713-2a63ebede421 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] validate_networks() for [('72e155e9-6b3d-4a63-a657-e3d3db8c31c2', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:58:19.425760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-efefef7f-cd72-484b-a83d-7ca8848f8e7e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:19.427377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-efefef7f-cd72-484b-a83d-7ca8848f8e7e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] [instance: ce6d7273-d1e3-400b-87f6-2e4625e78272] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:19.443951 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-efefef7f-cd72-484b-a83d-7ca8848f8e7e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:19.446530 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-efefef7f-cd72-484b-a83d-7ca8848f8e7e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:19.449266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-efefef7f-cd72-484b-a83d-7ca8848f8e7e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:19.450858 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-efefef7f-cd72-484b-a83d-7ca8848f8e7e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:19.527287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:19.671188 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-efefef7f-cd72-484b-a83d-7ca8848f8e7e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6839f6502c4eeabf516265d3b00a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64738d1d5d274ff0860307868c10b5d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:19.688936 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-efefef7f-cd72-484b-a83d-7ca8848f8e7e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] 10.222.0.49 "GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272" status: 200 len: 1273 microversion: 2.1 time: 0.271203 Jul 25 12:58:19.689651 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1846/3608] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:19 2022] GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272 => generated 1273 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:19.719605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-68b460b8-7dd1-4670-bbf1-3d5a0516b0bd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:19.722156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-68b460b8-7dd1-4670-bbf1-3d5a0516b0bd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:19.741343 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68b460b8-7dd1-4670-bbf1-3d5a0516b0bd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:19.741936 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68b460b8-7dd1-4670-bbf1-3d5a0516b0bd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:19.744583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68b460b8-7dd1-4670-bbf1-3d5a0516b0bd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:19.745301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68b460b8-7dd1-4670-bbf1-3d5a0516b0bd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:20.821156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-68b460b8-7dd1-4670-bbf1-3d5a0516b0bd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:20.839931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-68b460b8-7dd1-4670-bbf1-3d5a0516b0bd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:20.855689 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-68b460b8-7dd1-4670-bbf1-3d5a0516b0bd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:20.857050 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-68b460b8-7dd1-4670-bbf1-3d5a0516b0bd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 1.148276 Jul 25 12:58:20.857654 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1847/3609] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:19 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:20.863016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b5378258-1a0d-48fd-a582-5eb32deca1c1 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:20.863272 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b5378258-1a0d-48fd-a582-5eb32deca1c1 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:20.887690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5378258-1a0d-48fd-a582-5eb32deca1c1 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:20.889875 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5378258-1a0d-48fd-a582-5eb32deca1c1 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:20.894862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5378258-1a0d-48fd-a582-5eb32deca1c1 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:20.895600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5378258-1a0d-48fd-a582-5eb32deca1c1 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:21.237328 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b5378258-1a0d-48fd-a582-5eb32deca1c1 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:21.256332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b5378258-1a0d-48fd-a582-5eb32deca1c1 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:21.258929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b5378258-1a0d-48fd-a582-5eb32deca1c1 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:21.260379 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b5378258-1a0d-48fd-a582-5eb32deca1c1 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1604 microversion: 2.32 time: 0.401425 Jul 25 12:58:21.265883 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1848/3610] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:20 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1604 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:21.284878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-83b64a21-0d46-44e9-8895-f141d6bb9870 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:21.285780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-83b64a21-0d46-44e9-8895-f141d6bb9870 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] [instance: ce6d7273-d1e3-400b-87f6-2e4625e78272] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:21.300302 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-83b64a21-0d46-44e9-8895-f141d6bb9870 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:21.300939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-83b64a21-0d46-44e9-8895-f141d6bb9870 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:21.301746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-83b64a21-0d46-44e9-8895-f141d6bb9870 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:21.302222 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-83b64a21-0d46-44e9-8895-f141d6bb9870 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:21.961004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-83b64a21-0d46-44e9-8895-f141d6bb9870 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6839f6502c4eeabf516265d3b00a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64738d1d5d274ff0860307868c10b5d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:21.978513 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-83b64a21-0d46-44e9-8895-f141d6bb9870 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] 10.222.0.49 "GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272" status: 200 len: 1273 microversion: 2.1 time: 0.709287 Jul 25 12:58:21.998137 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1849/3611] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:21 2022] GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272 => generated 1273 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:22.004511 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a319b2d6-30ac-4923-ac38-1de4f9cddd4c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:22.005141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a319b2d6-30ac-4923-ac38-1de4f9cddd4c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:22.017648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a319b2d6-30ac-4923-ac38-1de4f9cddd4c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:22.018163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a319b2d6-30ac-4923-ac38-1de4f9cddd4c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:22.018975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a319b2d6-30ac-4923-ac38-1de4f9cddd4c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:22.019419 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a319b2d6-30ac-4923-ac38-1de4f9cddd4c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:22.048616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-9ea9899e-0511-4881-a713-2a63ebede421 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:58:22.050971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-9ea9899e-0511-4881-a713-2a63ebede421 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:58:22.051968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-9ea9899e-0511-4881-a713-2a63ebede421 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:58:22.052592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-9ea9899e-0511-4881-a713-2a63ebede421 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:58:22.053857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-9ea9899e-0511-4881-a713-2a63ebede421 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:58:22.083230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ea9899e-0511-4881-a713-2a63ebede421 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:22.083696 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ea9899e-0511-4881-a713-2a63ebede421 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:22.089544 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ea9899e-0511-4881-a713-2a63ebede421 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:22.090228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ea9899e-0511-4881-a713-2a63ebede421 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:22.156958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-9ea9899e-0511-4881-a713-2a63ebede421 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Getting quotas for project 7fe1b73b34c541eeb94dc2983f5811f7. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:58:22.163676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-9ea9899e-0511-4881-a713-2a63ebede421 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Getting quotas for user 71a3c046b1ab4175853fde002fe96a4b and project 7fe1b73b34c541eeb94dc2983f5811f7. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:58:22.185662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9ea9899e-0511-4881-a713-2a63ebede421 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:58:22.189050 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9ea9899e-0511-4881-a713-2a63ebede421 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] [instance: 94985532-461d-4773-bdab-3daaf5df0219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:58:22.266643 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9ea9899e-0511-4881-a713-2a63ebede421 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.804329 Jul 25 12:58:22.267900 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1763/3612] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:58:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:58:22.293307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7ab5afb0-2377-4a2f-b10c-095e9e14cea9 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:22.303205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7ab5afb0-2377-4a2f-b10c-095e9e14cea9 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] [instance: 94985532-461d-4773-bdab-3daaf5df0219] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:22.441430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7ab5afb0-2377-4a2f-b10c-095e9e14cea9 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a3c046b1ab4175853fde002fe96a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe1b73b34c541eeb94dc2983f5811f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:22.459030 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7ab5afb0-2377-4a2f-b10c-095e9e14cea9 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] 10.222.0.49 "GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219" status: 200 len: 1224 microversion: 2.1 time: 0.174546 Jul 25 12:58:22.461917 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1764/3613] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:22 2022] GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219 => generated 1224 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:22.479908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ede41d28-6658-4fa5-95d5-9a87975a64c3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:22.480860 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ede41d28-6658-4fa5-95d5-9a87975a64c3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:22.490281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ede41d28-6658-4fa5-95d5-9a87975a64c3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:22.496880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ede41d28-6658-4fa5-95d5-9a87975a64c3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:22.497347 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ede41d28-6658-4fa5-95d5-9a87975a64c3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:22.497805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ede41d28-6658-4fa5-95d5-9a87975a64c3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:22.668858 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a319b2d6-30ac-4923-ac38-1de4f9cddd4c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:22.670359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ede41d28-6658-4fa5-95d5-9a87975a64c3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:22.688993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a319b2d6-30ac-4923-ac38-1de4f9cddd4c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:22.689349 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ede41d28-6658-4fa5-95d5-9a87975a64c3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:22.691836 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a319b2d6-30ac-4923-ac38-1de4f9cddd4c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:22.693617 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a319b2d6-30ac-4923-ac38-1de4f9cddd4c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 0.699059 Jul 25 12:58:22.694017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ede41d28-6658-4fa5-95d5-9a87975a64c3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:22.697128 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ede41d28-6658-4fa5-95d5-9a87975a64c3 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1604 microversion: 2.32 time: 0.233633 Jul 25 12:58:22.698021 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1850/3614] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:21 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:22.699877 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1765/3615] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:22 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1604 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:23.006677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6e239625-5c31-4fa2-a966-82c3216abd2c tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:23.007294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6e239625-5c31-4fa2-a966-82c3216abd2c tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] [instance: ce6d7273-d1e3-400b-87f6-2e4625e78272] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:23.015520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e239625-5c31-4fa2-a966-82c3216abd2c tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:23.016007 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e239625-5c31-4fa2-a966-82c3216abd2c tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:23.016962 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e239625-5c31-4fa2-a966-82c3216abd2c tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:23.017440 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e239625-5c31-4fa2-a966-82c3216abd2c tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:23.308493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6e239625-5c31-4fa2-a966-82c3216abd2c tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6839f6502c4eeabf516265d3b00a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64738d1d5d274ff0860307868c10b5d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:23.321637 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6e239625-5c31-4fa2-a966-82c3216abd2c tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] 10.222.0.49 "GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272" status: 200 len: 1273 microversion: 2.1 time: 0.318605 Jul 25 12:58:23.336621 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1851/3616] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:23 2022] GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272 => generated 1273 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:23.483251 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aca4e9a8-ffc2-40a1-ae79-db05a892f347 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:23.483869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-aca4e9a8-ffc2-40a1-ae79-db05a892f347 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] [instance: 94985532-461d-4773-bdab-3daaf5df0219] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:23.517800 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aca4e9a8-ffc2-40a1-ae79-db05a892f347 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:23.518288 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aca4e9a8-ffc2-40a1-ae79-db05a892f347 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:23.519093 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aca4e9a8-ffc2-40a1-ae79-db05a892f347 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:23.519531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aca4e9a8-ffc2-40a1-ae79-db05a892f347 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:23.670941 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-aca4e9a8-ffc2-40a1-ae79-db05a892f347 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a3c046b1ab4175853fde002fe96a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe1b73b34c541eeb94dc2983f5811f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:23.706284 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aca4e9a8-ffc2-40a1-ae79-db05a892f347 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] 10.222.0.49 "GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219" status: 200 len: 1276 microversion: 2.1 time: 0.227861 Jul 25 12:58:23.707362 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1766/3617] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:23 2022] GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219 => generated 1276 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:23.722381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-44260e8b-cc2a-4e24-a592-aac067919419 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:23.722999 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-44260e8b-cc2a-4e24-a592-aac067919419 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:23.723433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-65522d01-8b82-4b91-9b3b-745c9bc57031 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:23.724251 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-65522d01-8b82-4b91-9b3b-745c9bc57031 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:23.740288 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44260e8b-cc2a-4e24-a592-aac067919419 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:23.740756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44260e8b-cc2a-4e24-a592-aac067919419 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:23.741498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65522d01-8b82-4b91-9b3b-745c9bc57031 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:23.742367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65522d01-8b82-4b91-9b3b-745c9bc57031 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:23.743531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65522d01-8b82-4b91-9b3b-745c9bc57031 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:23.744379 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65522d01-8b82-4b91-9b3b-745c9bc57031 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:23.744503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44260e8b-cc2a-4e24-a592-aac067919419 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:23.744902 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44260e8b-cc2a-4e24-a592-aac067919419 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:24.029935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-65522d01-8b82-4b91-9b3b-745c9bc57031 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:24.045102 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-65522d01-8b82-4b91-9b3b-745c9bc57031 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:24.057681 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-65522d01-8b82-4b91-9b3b-745c9bc57031 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:24.058594 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-65522d01-8b82-4b91-9b3b-745c9bc57031 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1604 microversion: 2.32 time: 0.339942 Jul 25 12:58:24.069625 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1767/3618] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:23 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1604 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:58:24.358155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2feed95f-73ba-4519-aa5e-aa3f5c0f3194 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:24.358779 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2feed95f-73ba-4519-aa5e-aa3f5c0f3194 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] [instance: ce6d7273-d1e3-400b-87f6-2e4625e78272] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:24.377820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2feed95f-73ba-4519-aa5e-aa3f5c0f3194 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:24.378212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2feed95f-73ba-4519-aa5e-aa3f5c0f3194 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:24.379172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2feed95f-73ba-4519-aa5e-aa3f5c0f3194 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:24.379781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2feed95f-73ba-4519-aa5e-aa3f5c0f3194 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:24.509565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-44260e8b-cc2a-4e24-a592-aac067919419 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:24.519407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-44260e8b-cc2a-4e24-a592-aac067919419 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:24.532031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-44260e8b-cc2a-4e24-a592-aac067919419 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:24.533541 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-44260e8b-cc2a-4e24-a592-aac067919419 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 0.815123 Jul 25 12:58:24.539571 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1852/3619] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:23 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:24.730608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fade2103-d2eb-4a51-a427-eea3e01b2570 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:24.731463 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fade2103-d2eb-4a51-a427-eea3e01b2570 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] [instance: 94985532-461d-4773-bdab-3daaf5df0219] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:24.746415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fade2103-d2eb-4a51-a427-eea3e01b2570 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:24.747578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fade2103-d2eb-4a51-a427-eea3e01b2570 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:24.751152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fade2103-d2eb-4a51-a427-eea3e01b2570 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:24.752917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fade2103-d2eb-4a51-a427-eea3e01b2570 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:24.961475 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fade2103-d2eb-4a51-a427-eea3e01b2570 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a3c046b1ab4175853fde002fe96a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe1b73b34c541eeb94dc2983f5811f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:24.985468 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fade2103-d2eb-4a51-a427-eea3e01b2570 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] 10.222.0.49 "GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219" status: 200 len: 1282 microversion: 2.1 time: 0.258004 Jul 25 12:58:24.989291 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1853/3620] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:24 2022] GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219 => generated 1282 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:58:25.086138 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e32919af-4d97-4742-959b-4b59fb9d6e60 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:25.087301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e32919af-4d97-4742-959b-4b59fb9d6e60 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:25.108199 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e32919af-4d97-4742-959b-4b59fb9d6e60 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:25.111585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e32919af-4d97-4742-959b-4b59fb9d6e60 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:25.113081 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e32919af-4d97-4742-959b-4b59fb9d6e60 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:25.113793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e32919af-4d97-4742-959b-4b59fb9d6e60 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:25.184883 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2feed95f-73ba-4519-aa5e-aa3f5c0f3194 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6839f6502c4eeabf516265d3b00a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64738d1d5d274ff0860307868c10b5d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:25.201334 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2feed95f-73ba-4519-aa5e-aa3f5c0f3194 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] 10.222.0.49 "GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272" status: 200 len: 1315 microversion: 2.1 time: 0.847027 Jul 25 12:58:25.202564 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1768/3621] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:24 2022] GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272 => generated 1315 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:25.330519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e32919af-4d97-4742-959b-4b59fb9d6e60 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:25.348209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e32919af-4d97-4742-959b-4b59fb9d6e60 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:25.350533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e32919af-4d97-4742-959b-4b59fb9d6e60 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:25.351997 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e32919af-4d97-4742-959b-4b59fb9d6e60 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1604 microversion: 2.32 time: 0.270508 Jul 25 12:58:25.353092 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1854/3622] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:25 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1604 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:58:25.580900 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-62a186b7-3da5-420c-9322-2950953b3f0e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:25.581514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-62a186b7-3da5-420c-9322-2950953b3f0e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:25.605517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62a186b7-3da5-420c-9322-2950953b3f0e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:25.606021 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62a186b7-3da5-420c-9322-2950953b3f0e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:25.607968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62a186b7-3da5-420c-9322-2950953b3f0e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:25.610506 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62a186b7-3da5-420c-9322-2950953b3f0e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:26.008473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-979a7a51-8ac9-4953-99b1-3e70a262df22 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:26.009807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-979a7a51-8ac9-4953-99b1-3e70a262df22 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] [instance: 94985532-461d-4773-bdab-3daaf5df0219] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:26.020963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-979a7a51-8ac9-4953-99b1-3e70a262df22 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:26.030771 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-979a7a51-8ac9-4953-99b1-3e70a262df22 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:26.032420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-979a7a51-8ac9-4953-99b1-3e70a262df22 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:26.034743 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-979a7a51-8ac9-4953-99b1-3e70a262df22 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:26.346391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-62a186b7-3da5-420c-9322-2950953b3f0e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:26.362489 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-62a186b7-3da5-420c-9322-2950953b3f0e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:26.363987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-62a186b7-3da5-420c-9322-2950953b3f0e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:26.365278 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-62a186b7-3da5-420c-9322-2950953b3f0e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 0.802090 Jul 25 12:58:26.373130 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1769/3623] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:25 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:26.384271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-54320aca-545f-4d31-82e8-ea7a59531e2c tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:26.385230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-54320aca-545f-4d31-82e8-ea7a59531e2c tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] [instance: ce6d7273-d1e3-400b-87f6-2e4625e78272] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:26.419651 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54320aca-545f-4d31-82e8-ea7a59531e2c tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:26.423340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54320aca-545f-4d31-82e8-ea7a59531e2c tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:26.424460 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54320aca-545f-4d31-82e8-ea7a59531e2c tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:26.426372 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54320aca-545f-4d31-82e8-ea7a59531e2c tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:26.872214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-979a7a51-8ac9-4953-99b1-3e70a262df22 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a3c046b1ab4175853fde002fe96a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe1b73b34c541eeb94dc2983f5811f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:26.891016 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-979a7a51-8ac9-4953-99b1-3e70a262df22 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] 10.222.0.49 "GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219" status: 200 len: 1324 microversion: 2.1 time: 0.886297 Jul 25 12:58:26.906245 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1855/3624] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:26 2022] GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219 => generated 1324 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:26.915347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-925a1b61-784b-4b50-a504-da662e2466ba tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:26.915976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-925a1b61-784b-4b50-a504-da662e2466ba tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:26.931728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-925a1b61-784b-4b50-a504-da662e2466ba tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:26.932196 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-925a1b61-784b-4b50-a504-da662e2466ba tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:26.932990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-925a1b61-784b-4b50-a504-da662e2466ba tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:26.933430 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-925a1b61-784b-4b50-a504-da662e2466ba tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:27.052613 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-54320aca-545f-4d31-82e8-ea7a59531e2c tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6839f6502c4eeabf516265d3b00a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64738d1d5d274ff0860307868c10b5d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:27.074016 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-54320aca-545f-4d31-82e8-ea7a59531e2c tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] 10.222.0.49 "GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272" status: 200 len: 1315 microversion: 2.1 time: 0.689047 Jul 25 12:58:27.075824 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1770/3625] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:26 2022] GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272 => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:27.113339 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-925a1b61-784b-4b50-a504-da662e2466ba tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:27.130035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-925a1b61-784b-4b50-a504-da662e2466ba tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:27.132696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-925a1b61-784b-4b50-a504-da662e2466ba tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:27.137115 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-925a1b61-784b-4b50-a504-da662e2466ba tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1604 microversion: 2.32 time: 0.229588 Jul 25 12:58:27.141039 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1856/3626] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:26 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:27.398642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bc0f6ca6-8f00-42a8-aafd-893bdd709ab8 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:27.399268 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bc0f6ca6-8f00-42a8-aafd-893bdd709ab8 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:27.410930 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc0f6ca6-8f00-42a8-aafd-893bdd709ab8 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:27.411710 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc0f6ca6-8f00-42a8-aafd-893bdd709ab8 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:27.412649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc0f6ca6-8f00-42a8-aafd-893bdd709ab8 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:27.418214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc0f6ca6-8f00-42a8-aafd-893bdd709ab8 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:27.478283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:27.503742 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-230102ec-91be-4235-9af1-8c07e345cc7d req-05a809a5-90d3-4713-9927-a324ab10aabd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce6d7273-d1e3-400b-87f6-2e4625e78272", "tag": "8b439b91-7394-43b9-b157-b121617e3f64"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:58:27.522552 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-230102ec-91be-4235-9af1-8c07e345cc7d req-05a809a5-90d3-4713-9927-a324ab10aabd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:27.528326 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-230102ec-91be-4235-9af1-8c07e345cc7d req-05a809a5-90d3-4713-9927-a324ab10aabd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:27.560404 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-230102ec-91be-4235-9af1-8c07e345cc7d req-05a809a5-90d3-4713-9927-a324ab10aabd service nova] Creating event network-changed:8b439b91-7394-43b9-b157-b121617e3f64 for instance ce6d7273-d1e3-400b-87f6-2e4625e78272 on n-h2-848886-15 Jul 25 12:58:27.575424 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-230102ec-91be-4235-9af1-8c07e345cc7d req-05a809a5-90d3-4713-9927-a324ab10aabd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076027 Jul 25 12:58:27.578727 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1857/3627] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:58:27.923887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-42ec8c0a-5830-4809-9593-37e4668f6af2 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:27.923887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-42ec8c0a-5830-4809-9593-37e4668f6af2 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] [instance: 94985532-461d-4773-bdab-3daaf5df0219] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:27.940145 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-42ec8c0a-5830-4809-9593-37e4668f6af2 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:27.940606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-42ec8c0a-5830-4809-9593-37e4668f6af2 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:27.941404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-42ec8c0a-5830-4809-9593-37e4668f6af2 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:27.942756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-42ec8c0a-5830-4809-9593-37e4668f6af2 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:28.799502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bc0f6ca6-8f00-42a8-aafd-893bdd709ab8 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:28.812628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bc0f6ca6-8f00-42a8-aafd-893bdd709ab8 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:28.814199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bc0f6ca6-8f00-42a8-aafd-893bdd709ab8 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:28.815422 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bc0f6ca6-8f00-42a8-aafd-893bdd709ab8 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 1.421063 Jul 25 12:58:28.824186 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1771/3628] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:27 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:28.829620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0fdc75c1-2fe1-4356-8736-245bc219e434 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:28.831906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0fdc75c1-2fe1-4356-8736-245bc219e434 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] [instance: ce6d7273-d1e3-400b-87f6-2e4625e78272] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:28.837535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:28.839333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0fdc75c1-2fe1-4356-8736-245bc219e434 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:28.840011 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0fdc75c1-2fe1-4356-8736-245bc219e434 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:28.841112 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0fdc75c1-2fe1-4356-8736-245bc219e434 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:28.841851 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0fdc75c1-2fe1-4356-8736-245bc219e434 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:29.118380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-42ec8c0a-5830-4809-9593-37e4668f6af2 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a3c046b1ab4175853fde002fe96a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe1b73b34c541eeb94dc2983f5811f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:29.134587 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-42ec8c0a-5830-4809-9593-37e4668f6af2 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] 10.222.0.49 "GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219" status: 200 len: 1324 microversion: 2.1 time: 1.218641 Jul 25 12:58:29.135474 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1858/3629] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:27 2022] GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219 => generated 1324 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:29.147411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8dc417b3-1c2a-47b2-b28a-82928c6d904c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:29.149930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8dc417b3-1c2a-47b2-b28a-82928c6d904c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:29.173883 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8dc417b3-1c2a-47b2-b28a-82928c6d904c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:29.174739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8dc417b3-1c2a-47b2-b28a-82928c6d904c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:29.175757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8dc417b3-1c2a-47b2-b28a-82928c6d904c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:29.176534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8dc417b3-1c2a-47b2-b28a-82928c6d904c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:29.345548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8dc417b3-1c2a-47b2-b28a-82928c6d904c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:29.362203 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8dc417b3-1c2a-47b2-b28a-82928c6d904c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:29.367002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8dc417b3-1c2a-47b2-b28a-82928c6d904c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f958f28464144e89e63b7e7dbcfb0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f951d0b219924bb1aa408d3e22bcafc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:29.372029 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8dc417b3-1c2a-47b2-b28a-82928c6d904c tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 200 len: 1604 microversion: 2.32 time: 0.232945 Jul 25 12:58:29.372957 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1859/3630] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:29 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 1604 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:29.382754 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-c99429b0-924e-42e9-be8d-d1a007a59014 req-dd554758-bb38-4433-88ce-ccd95f933c98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94985532-461d-4773-bdab-3daaf5df0219", "tag": "1f08159b-9656-4b2b-a32e-fc8ff5db28a8"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:58:29.401114 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c99429b0-924e-42e9-be8d-d1a007a59014 req-dd554758-bb38-4433-88ce-ccd95f933c98 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:29.402028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c99429b0-924e-42e9-be8d-d1a007a59014 req-dd554758-bb38-4433-88ce-ccd95f933c98 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:29.415182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0fdc75c1-2fe1-4356-8736-245bc219e434 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6839f6502c4eeabf516265d3b00a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64738d1d5d274ff0860307868c10b5d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:29.423303 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0fdc75c1-2fe1-4356-8736-245bc219e434 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] 10.222.0.49 "GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272" status: 200 len: 1315 microversion: 2.1 time: 0.597659 Jul 25 12:58:29.424271 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1772/3631] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:28 2022] GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272 => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:29.439875 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-c99429b0-924e-42e9-be8d-d1a007a59014 req-dd554758-bb38-4433-88ce-ccd95f933c98 service nova] Creating event network-changed:1f08159b-9656-4b2b-a32e-fc8ff5db28a8 for instance 94985532-461d-4773-bdab-3daaf5df0219 on n-h2-848886-15 Jul 25 12:58:29.447682 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-c99429b0-924e-42e9-be8d-d1a007a59014 req-dd554758-bb38-4433-88ce-ccd95f933c98 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073069 Jul 25 12:58:29.454188 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1860/3632] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:58:29.842825 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4a5b7c07-62ba-4095-ba7a-da65507170e9 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:29.843602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4a5b7c07-62ba-4095-ba7a-da65507170e9 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:29.877253 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a5b7c07-62ba-4095-ba7a-da65507170e9 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:29.879985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a5b7c07-62ba-4095-ba7a-da65507170e9 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:29.885237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a5b7c07-62ba-4095-ba7a-da65507170e9 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:29.888181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a5b7c07-62ba-4095-ba7a-da65507170e9 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:30.157352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1fef1994-9041-4ad4-ae44-e75e4f1dd946 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:30.158800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1fef1994-9041-4ad4-ae44-e75e4f1dd946 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] [instance: 94985532-461d-4773-bdab-3daaf5df0219] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:30.189034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1fef1994-9041-4ad4-ae44-e75e4f1dd946 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:30.189495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1fef1994-9041-4ad4-ae44-e75e4f1dd946 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:30.192520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1fef1994-9041-4ad4-ae44-e75e4f1dd946 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:30.193172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1fef1994-9041-4ad4-ae44-e75e4f1dd946 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:30.293251 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4a5b7c07-62ba-4095-ba7a-da65507170e9 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:30.303929 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4a5b7c07-62ba-4095-ba7a-da65507170e9 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:30.321108 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4a5b7c07-62ba-4095-ba7a-da65507170e9 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:30.329204 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4a5b7c07-62ba-4095-ba7a-da65507170e9 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 0.490488 Jul 25 12:58:30.332125 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1773/3633] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:29 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:30.456665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1fef1994-9041-4ad4-ae44-e75e4f1dd946 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a3c046b1ab4175853fde002fe96a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe1b73b34c541eeb94dc2983f5811f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:30.477070 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1fef1994-9041-4ad4-ae44-e75e4f1dd946 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] 10.222.0.49 "GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219" status: 200 len: 1324 microversion: 2.1 time: 0.325427 Jul 25 12:58:30.478526 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1861/3634] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:30 2022] GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219 => generated 1324 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:58:30.484300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9bc78e6a-8320-4643-9348-f6b59e4a875b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:30.485102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9bc78e6a-8320-4643-9348-f6b59e4a875b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:30.492483 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9bc78e6a-8320-4643-9348-f6b59e4a875b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:30.492941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9bc78e6a-8320-4643-9348-f6b59e4a875b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:30.493732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9bc78e6a-8320-4643-9348-f6b59e4a875b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:30.494403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9bc78e6a-8320-4643-9348-f6b59e4a875b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:30.513696 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-9bc78e6a-8320-4643-9348-f6b59e4a875b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] HTTP exception thrown: Instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 could not be found. Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9bc78e6a-8320-4643-9348-f6b59e4a875b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Request method failure captured: Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 HTTP/1.1 Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pF74i10wLQH0K_jnv8tTrfqhB-9m0e9ZyrG-0q-A0XwV-RV1ZQ5qMHLI6ijZdsM5ujKJLXpzwrsgYDt7PvOkBMZA11aLpX3kxlvavoNSxX-iaCjxAEbktyDG0xjD25ok1vQvqd_hl3GlP9kJCPXdEisKb0QhW5E2iutF06bUX6nFz0 Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: X-Openstack-Nova-Api-Version: 2.32 Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: f951d0b219924bb1aa408d3e22bcafc3 Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TaggedBootDevicesTest-860576825 Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f951d0b219924bb1aa408d3e22bcafc3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f951d0b219924bb1aa408d3e22bcafc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f951d0b219924bb1aa408d3e22bcafc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f951d0b219924bb1aa408d3e22bcafc3"}]}] Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TaggedBootDevicesTest-860576825 Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: f951d0b219924bb1aa408d3e22bcafc3 Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TaggedBootDevicesTest-860576825 Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TaggedBootDevicesTest-860576825-project Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 2f958f28464144e89e63b7e7dbcfb0b5 Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TaggedBootDevicesTest-860576825-project Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 could not be found. Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '75735e91-1a4c-435e-b3d5-53abb8bfae88'} Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 could not be found. Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 could not be found. Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:58:30.515678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:58:30.519978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:30.519978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:58:30.519978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:58:30.519978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:58:30.519978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:58:30.519978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 could not be found. Jul 25 12:58:30.519978 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:58:30.522726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9bc78e6a-8320-4643-9348-f6b59e4a875b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Returning 404 to user: Instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:58:30.524165 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9bc78e6a-8320-4643-9348-f6b59e4a875b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 404 len: 111 microversion: 2.32 time: 0.044194 Jul 25 12:58:30.525613 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1862/3635] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:30 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:58:30.533081 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-67d11c20-940f-4fc1-b250-2fc57ac9d7e8 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:30.534040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-67d11c20-940f-4fc1-b250-2fc57ac9d7e8 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] [instance: ce6d7273-d1e3-400b-87f6-2e4625e78272] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:30.544512 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-67d11c20-940f-4fc1-b250-2fc57ac9d7e8 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:30.546992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-67d11c20-940f-4fc1-b250-2fc57ac9d7e8 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:30.547882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-67d11c20-940f-4fc1-b250-2fc57ac9d7e8 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:30.549745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-67d11c20-940f-4fc1-b250-2fc57ac9d7e8 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:30.566052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-57313d46-a823-4a61-83cc-43385795ca78 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-572383725", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:58:30.648871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-57313d46-a823-4a61-83cc-43385795ca78 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] validate_networks() for [('dc975d58-9818-4c8b-8bcd-8b1a23df5609', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:58:31.176299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-67d11c20-940f-4fc1-b250-2fc57ac9d7e8 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6839f6502c4eeabf516265d3b00a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64738d1d5d274ff0860307868c10b5d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:31.194482 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-67d11c20-940f-4fc1-b250-2fc57ac9d7e8 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] 10.222.0.49 "GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272" status: 200 len: 1315 microversion: 2.1 time: 0.666888 Jul 25 12:58:31.195442 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1863/3636] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:30 2022] GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272 => generated 1315 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:31.200288 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-43d61749-60e9-4aef-8ca1-3be12108378b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '.version_select at 0x7efcf8e75430>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:31.246023 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-43d61749-60e9-4aef-8ca1-3be12108378b tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199865113" status: 204 len: 0 microversion: 2.32 time: 0.049014 Jul 25 12:58:31.248624 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1864/3637] 10.222.0.49 () {60 vars in 1262 bytes} [Mon Jul 25 12:58:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199865113 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 12:58:31.365637 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-10c6622f-1634-45cf-ae58-a73cab2c1280 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:31.367210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-10c6622f-1634-45cf-ae58-a73cab2c1280 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:31.377551 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10c6622f-1634-45cf-ae58-a73cab2c1280 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:31.379242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10c6622f-1634-45cf-ae58-a73cab2c1280 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:31.383285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10c6622f-1634-45cf-ae58-a73cab2c1280 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:31.384012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10c6622f-1634-45cf-ae58-a73cab2c1280 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:32.021802 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-10c6622f-1634-45cf-ae58-a73cab2c1280 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:32.038337 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-10c6622f-1634-45cf-ae58-a73cab2c1280 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:32.040215 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-10c6622f-1634-45cf-ae58-a73cab2c1280 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:32.045679 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-10c6622f-1634-45cf-ae58-a73cab2c1280 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 0.688207 Jul 25 12:58:32.061492 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1865/3638] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:31 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:32.061492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-eb229099-8bf6-4445-9bf6-88bca026a5a4 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:32.061492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eb229099-8bf6-4445-9bf6-88bca026a5a4 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] [instance: 94985532-461d-4773-bdab-3daaf5df0219] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:32.075088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb229099-8bf6-4445-9bf6-88bca026a5a4 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:32.076795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb229099-8bf6-4445-9bf6-88bca026a5a4 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:32.079017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb229099-8bf6-4445-9bf6-88bca026a5a4 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:32.080364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb229099-8bf6-4445-9bf6-88bca026a5a4 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:32.092136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:32.145089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:32.455300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=16 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:32.751655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-57313d46-a823-4a61-83cc-43385795ca78 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:58:32.752773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-eb229099-8bf6-4445-9bf6-88bca026a5a4 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a3c046b1ab4175853fde002fe96a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe1b73b34c541eeb94dc2983f5811f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:32.754267 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-57313d46-a823-4a61-83cc-43385795ca78 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:58:32.759906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-57313d46-a823-4a61-83cc-43385795ca78 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:58:32.760930 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-57313d46-a823-4a61-83cc-43385795ca78 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:58:32.763155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-57313d46-a823-4a61-83cc-43385795ca78 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:58:32.787129 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-eb229099-8bf6-4445-9bf6-88bca026a5a4 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] 10.222.0.49 "GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219" status: 200 len: 1324 microversion: 2.1 time: 0.738189 Jul 25 12:58:32.791818 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1866/3639] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:32 2022] GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219 => generated 1324 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:32.814207 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-57313d46-a823-4a61-83cc-43385795ca78 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:32.814674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-57313d46-a823-4a61-83cc-43385795ca78 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:32.815686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a963607f-18e6-4ecf-9789-3e263f4eb89e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:32.824128 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-57313d46-a823-4a61-83cc-43385795ca78 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:32.824667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-57313d46-a823-4a61-83cc-43385795ca78 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:32.825456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a963607f-18e6-4ecf-9789-3e263f4eb89e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] [instance: ce6d7273-d1e3-400b-87f6-2e4625e78272] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:32.841576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a963607f-18e6-4ecf-9789-3e263f4eb89e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:32.842053 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a963607f-18e6-4ecf-9789-3e263f4eb89e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:32.847660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a963607f-18e6-4ecf-9789-3e263f4eb89e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:32.850054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a963607f-18e6-4ecf-9789-3e263f4eb89e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:32.887490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-57313d46-a823-4a61-83cc-43385795ca78 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Getting quotas for project d603ed2eec0344f1b95246394be424f1. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:58:32.914493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-57313d46-a823-4a61-83cc-43385795ca78 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Getting quotas for user 036ffb5ac9fb47ba9e1314560898530a and project d603ed2eec0344f1b95246394be424f1. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:58:32.949822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-57313d46-a823-4a61-83cc-43385795ca78 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:58:32.954587 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-57313d46-a823-4a61-83cc-43385795ca78 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:58:33.061956 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-57313d46-a823-4a61-83cc-43385795ca78 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.727671 Jul 25 12:58:33.062632 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1774/3640] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:58:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:58:33.079722 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2057b3b0-41e3-4206-9c23-51cda879efc7 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:33.080356 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2057b3b0-41e3-4206-9c23-51cda879efc7 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:33.095884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2057b3b0-41e3-4206-9c23-51cda879efc7 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:33.096350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2057b3b0-41e3-4206-9c23-51cda879efc7 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:33.097158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2057b3b0-41e3-4206-9c23-51cda879efc7 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:33.099927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2057b3b0-41e3-4206-9c23-51cda879efc7 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:34.157882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a963607f-18e6-4ecf-9789-3e263f4eb89e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6839f6502c4eeabf516265d3b00a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64738d1d5d274ff0860307868c10b5d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:34.169601 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a963607f-18e6-4ecf-9789-3e263f4eb89e tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] 10.222.0.49 "GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272" status: 200 len: 1315 microversion: 2.1 time: 1.376384 Jul 25 12:58:34.189847 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1867/3641] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:32 2022] GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272 => generated 1315 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:34.195146 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e0b7eb55-9545-4bac-ade7-60f95bbe013d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:34.201029 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e0b7eb55-9545-4bac-ade7-60f95bbe013d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:34.210565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0b7eb55-9545-4bac-ade7-60f95bbe013d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:34.211675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0b7eb55-9545-4bac-ade7-60f95bbe013d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:34.212716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0b7eb55-9545-4bac-ade7-60f95bbe013d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:34.213310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0b7eb55-9545-4bac-ade7-60f95bbe013d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:34.355149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2057b3b0-41e3-4206-9c23-51cda879efc7 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:34.374961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2057b3b0-41e3-4206-9c23-51cda879efc7 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:34.379113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2057b3b0-41e3-4206-9c23-51cda879efc7 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:34.380821 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2057b3b0-41e3-4206-9c23-51cda879efc7 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 1.314178 Jul 25 12:58:34.381867 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1775/3642] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:33 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:34.406585 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-44d95b64-cf32-45d2-b7d4-38e6d3891f16 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:34.407801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-44d95b64-cf32-45d2-b7d4-38e6d3891f16 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] [instance: 94985532-461d-4773-bdab-3daaf5df0219] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:34.421672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-44d95b64-cf32-45d2-b7d4-38e6d3891f16 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:34.422364 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-44d95b64-cf32-45d2-b7d4-38e6d3891f16 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:34.423377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-44d95b64-cf32-45d2-b7d4-38e6d3891f16 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:34.423958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-44d95b64-cf32-45d2-b7d4-38e6d3891f16 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:34.602529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e0b7eb55-9545-4bac-ade7-60f95bbe013d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:34.615872 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e0b7eb55-9545-4bac-ade7-60f95bbe013d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1268 microversion: 2.1 time: 0.421519 Jul 25 12:58:34.618095 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1868/3643] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:34 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1268 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:35.020047 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-44d95b64-cf32-45d2-b7d4-38e6d3891f16 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a3c046b1ab4175853fde002fe96a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe1b73b34c541eeb94dc2983f5811f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:35.034094 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-44d95b64-cf32-45d2-b7d4-38e6d3891f16 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] 10.222.0.49 "GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219" status: 200 len: 1324 microversion: 2.1 time: 0.640495 Jul 25 12:58:35.043373 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1776/3644] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:34 2022] GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219 => generated 1324 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:35.195655 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ecd5f591-ed33-4d4b-889a-7a19e4933d3b tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:35.197508 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ecd5f591-ed33-4d4b-889a-7a19e4933d3b tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] [instance: ce6d7273-d1e3-400b-87f6-2e4625e78272] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:35.205225 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ecd5f591-ed33-4d4b-889a-7a19e4933d3b tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:35.206013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ecd5f591-ed33-4d4b-889a-7a19e4933d3b tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:35.206990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ecd5f591-ed33-4d4b-889a-7a19e4933d3b tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:35.207647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ecd5f591-ed33-4d4b-889a-7a19e4933d3b tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:35.405058 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4b4276b7-291d-497a-bba1-b3e248d8983e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:35.405797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4b4276b7-291d-497a-bba1-b3e248d8983e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:35.420533 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b4276b7-291d-497a-bba1-b3e248d8983e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:35.421119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b4276b7-291d-497a-bba1-b3e248d8983e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:35.422155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b4276b7-291d-497a-bba1-b3e248d8983e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:35.424043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b4276b7-291d-497a-bba1-b3e248d8983e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:35.552909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ecd5f591-ed33-4d4b-889a-7a19e4933d3b tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6839f6502c4eeabf516265d3b00a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64738d1d5d274ff0860307868c10b5d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:35.564114 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ecd5f591-ed33-4d4b-889a-7a19e4933d3b tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] 10.222.0.49 "GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272" status: 200 len: 1315 microversion: 2.1 time: 0.372283 Jul 25 12:58:35.570261 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1869/3645] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:35 2022] GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:35.639760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d611a985-0407-4c1a-9c2e-b08641bcd0dd tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:35.640360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d611a985-0407-4c1a-9c2e-b08641bcd0dd tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:35.660985 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d611a985-0407-4c1a-9c2e-b08641bcd0dd tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:35.663649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d611a985-0407-4c1a-9c2e-b08641bcd0dd tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:35.664703 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d611a985-0407-4c1a-9c2e-b08641bcd0dd tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:35.669730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d611a985-0407-4c1a-9c2e-b08641bcd0dd tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:35.801960 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d611a985-0407-4c1a-9c2e-b08641bcd0dd tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:35.818169 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d611a985-0407-4c1a-9c2e-b08641bcd0dd tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1274 microversion: 2.1 time: 0.182546 Jul 25 12:58:35.834875 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1870/3646] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:35 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1274 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:58:36.011514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4b4276b7-291d-497a-bba1-b3e248d8983e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:36.027129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4b4276b7-291d-497a-bba1-b3e248d8983e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:36.028883 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4b4276b7-291d-497a-bba1-b3e248d8983e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:36.030337 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4b4276b7-291d-497a-bba1-b3e248d8983e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 0.629462 Jul 25 12:58:36.031380 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1777/3647] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:35 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:58:36.054920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3c779b3a-eab8-4fc2-a3fd-6282a8580dfb tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:36.055728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3c779b3a-eab8-4fc2-a3fd-6282a8580dfb tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] [instance: 94985532-461d-4773-bdab-3daaf5df0219] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:36.073297 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3c779b3a-eab8-4fc2-a3fd-6282a8580dfb tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:36.073941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3c779b3a-eab8-4fc2-a3fd-6282a8580dfb tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:36.074866 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3c779b3a-eab8-4fc2-a3fd-6282a8580dfb tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:36.075466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3c779b3a-eab8-4fc2-a3fd-6282a8580dfb tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:36.500831 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3c779b3a-eab8-4fc2-a3fd-6282a8580dfb tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a3c046b1ab4175853fde002fe96a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe1b73b34c541eeb94dc2983f5811f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:36.516339 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3c779b3a-eab8-4fc2-a3fd-6282a8580dfb tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] 10.222.0.49 "GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219" status: 200 len: 1324 microversion: 2.1 time: 0.465389 Jul 25 12:58:36.517355 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1871/3648] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:36 2022] GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219 => generated 1324 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:36.590312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e721d2ac-807e-4916-817e-ee7be6b7c7f9 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:36.590913 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e721d2ac-807e-4916-817e-ee7be6b7c7f9 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] [instance: ce6d7273-d1e3-400b-87f6-2e4625e78272] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:36.601142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e721d2ac-807e-4916-817e-ee7be6b7c7f9 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:36.601625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e721d2ac-807e-4916-817e-ee7be6b7c7f9 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:36.602429 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e721d2ac-807e-4916-817e-ee7be6b7c7f9 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:36.603630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e721d2ac-807e-4916-817e-ee7be6b7c7f9 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:36.845014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9f6bca3a-a4f1-4e91-96af-f3802c130527 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:36.846695 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9f6bca3a-a4f1-4e91-96af-f3802c130527 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:36.868822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f6bca3a-a4f1-4e91-96af-f3802c130527 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:36.869322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f6bca3a-a4f1-4e91-96af-f3802c130527 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:36.870342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f6bca3a-a4f1-4e91-96af-f3802c130527 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:36.870787 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f6bca3a-a4f1-4e91-96af-f3802c130527 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:36.974931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e721d2ac-807e-4916-817e-ee7be6b7c7f9 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6839f6502c4eeabf516265d3b00a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64738d1d5d274ff0860307868c10b5d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:36.987501 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e721d2ac-807e-4916-817e-ee7be6b7c7f9 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] 10.222.0.49 "GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272" status: 200 len: 1315 microversion: 2.1 time: 0.399623 Jul 25 12:58:36.992173 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1778/3649] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:36 2022] GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:37.058755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-74e9d8f1-c99c-41c0-8a9b-b00fd2a8aa4b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:37.059727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-74e9d8f1-c99c-41c0-8a9b-b00fd2a8aa4b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:37.068016 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74e9d8f1-c99c-41c0-8a9b-b00fd2a8aa4b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:37.068796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74e9d8f1-c99c-41c0-8a9b-b00fd2a8aa4b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:37.069860 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74e9d8f1-c99c-41c0-8a9b-b00fd2a8aa4b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:37.070668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74e9d8f1-c99c-41c0-8a9b-b00fd2a8aa4b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:37.370123 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9f6bca3a-a4f1-4e91-96af-f3802c130527 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:37.384193 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9f6bca3a-a4f1-4e91-96af-f3802c130527 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1316 microversion: 2.1 time: 0.542278 Jul 25 12:58:37.400465 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1872/3650] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:36 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1316 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:37.441662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-74e9d8f1-c99c-41c0-8a9b-b00fd2a8aa4b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:37.452055 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-74e9d8f1-c99c-41c0-8a9b-b00fd2a8aa4b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:37.453718 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-74e9d8f1-c99c-41c0-8a9b-b00fd2a8aa4b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:37.462797 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-74e9d8f1-c99c-41c0-8a9b-b00fd2a8aa4b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 0.408503 Jul 25 12:58:37.482745 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1779/3651] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:37 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:58:37.537897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8b02052e-a467-4b61-8a24-da381dcbd3a8 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:37.538686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8b02052e-a467-4b61-8a24-da381dcbd3a8 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] [instance: 94985532-461d-4773-bdab-3daaf5df0219] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:37.561844 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b02052e-a467-4b61-8a24-da381dcbd3a8 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:37.562565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b02052e-a467-4b61-8a24-da381dcbd3a8 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:37.569192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b02052e-a467-4b61-8a24-da381dcbd3a8 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:37.569583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b02052e-a467-4b61-8a24-da381dcbd3a8 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:37.713524 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-4ed612ca-51ca-442e-91f7-0d60a9b923b3 req-c6e3a530-f233-4c06-ba6d-d43e8dac7ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce6d7273-d1e3-400b-87f6-2e4625e78272", "name": "network-vif-plugged", "status": "completed", "tag": "8b439b91-7394-43b9-b157-b121617e3f64"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:58:37.739410 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4ed612ca-51ca-442e-91f7-0d60a9b923b3 req-c6e3a530-f233-4c06-ba6d-d43e8dac7ca5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:37.740998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4ed612ca-51ca-442e-91f7-0d60a9b923b3 req-c6e3a530-f233-4c06-ba6d-d43e8dac7ca5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:37.763530 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-4ed612ca-51ca-442e-91f7-0d60a9b923b3 req-c6e3a530-f233-4c06-ba6d-d43e8dac7ca5 service nova] Creating event network-vif-plugged:8b439b91-7394-43b9-b157-b121617e3f64 for instance ce6d7273-d1e3-400b-87f6-2e4625e78272 on n-h2-848886-15 Jul 25 12:58:37.776647 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-4ed612ca-51ca-442e-91f7-0d60a9b923b3 req-c6e3a530-f233-4c06-ba6d-d43e8dac7ca5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069144 Jul 25 12:58:37.780392 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1780/3652] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:58:38.012894 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7a9c7d7c-692a-4f0f-9977-bc01533d6dc2 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:38.013603 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7a9c7d7c-692a-4f0f-9977-bc01533d6dc2 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] [instance: ce6d7273-d1e3-400b-87f6-2e4625e78272] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:38.028599 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a9c7d7c-692a-4f0f-9977-bc01533d6dc2 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:38.030511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a9c7d7c-692a-4f0f-9977-bc01533d6dc2 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:38.033654 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a9c7d7c-692a-4f0f-9977-bc01533d6dc2 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:38.034552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a9c7d7c-692a-4f0f-9977-bc01533d6dc2 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:38.101376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8b02052e-a467-4b61-8a24-da381dcbd3a8 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a3c046b1ab4175853fde002fe96a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe1b73b34c541eeb94dc2983f5811f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:38.111632 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8b02052e-a467-4b61-8a24-da381dcbd3a8 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] 10.222.0.49 "GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219" status: 200 len: 1324 microversion: 2.1 time: 0.577630 Jul 25 12:58:38.120095 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1873/3653] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:37 2022] GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219 => generated 1324 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:38.405128 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-91fea50e-b36a-4c84-a2ab-1790ffe94361 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:38.406039 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-91fea50e-b36a-4c84-a2ab-1790ffe94361 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:38.423476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91fea50e-b36a-4c84-a2ab-1790ffe94361 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:38.423934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91fea50e-b36a-4c84-a2ab-1790ffe94361 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:38.424715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91fea50e-b36a-4c84-a2ab-1790ffe94361 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:38.425149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91fea50e-b36a-4c84-a2ab-1790ffe94361 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:38.449640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7a9c7d7c-692a-4f0f-9977-bc01533d6dc2 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6839f6502c4eeabf516265d3b00a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64738d1d5d274ff0860307868c10b5d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:38.480160 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7a9c7d7c-692a-4f0f-9977-bc01533d6dc2 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] 10.222.0.49 "GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272" status: 200 len: 1315 microversion: 2.1 time: 0.467223 Jul 25 12:58:38.495891 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1781/3654] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:38 2022] GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272 => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:38.514180 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-d68d2ab6-4331-4159-8c73-a7c4d39c688e req-c161a32b-593f-47b8-8451-4da6eda91134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2", "tag": "a2ca9e31-6d49-4fae-9ff5-c3c32be13ff6"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:58:38.547862 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d68d2ab6-4331-4159-8c73-a7c4d39c688e req-c161a32b-593f-47b8-8451-4da6eda91134 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:38.548311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d68d2ab6-4331-4159-8c73-a7c4d39c688e req-c161a32b-593f-47b8-8451-4da6eda91134 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:38.606850 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-d68d2ab6-4331-4159-8c73-a7c4d39c688e req-c161a32b-593f-47b8-8451-4da6eda91134 service nova] Creating event network-changed:a2ca9e31-6d49-4fae-9ff5-c3c32be13ff6 for instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 on n-h1-848886-15 Jul 25 12:58:38.627749 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-d68d2ab6-4331-4159-8c73-a7c4d39c688e req-c161a32b-593f-47b8-8451-4da6eda91134 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126195 Jul 25 12:58:38.636598 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1782/3655] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:58:38.642446 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3bcdfba7-1a70-462d-bc85-5f6754d613c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:38.643160 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3bcdfba7-1a70-462d-bc85-5f6754d613c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:38.671245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3bcdfba7-1a70-462d-bc85-5f6754d613c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:38.671697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3bcdfba7-1a70-462d-bc85-5f6754d613c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:38.672484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3bcdfba7-1a70-462d-bc85-5f6754d613c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:38.672921 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3bcdfba7-1a70-462d-bc85-5f6754d613c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:39.085498 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-91fea50e-b36a-4c84-a2ab-1790ffe94361 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:39.100993 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-91fea50e-b36a-4c84-a2ab-1790ffe94361 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1316 microversion: 2.1 time: 0.699899 Jul 25 12:58:39.105320 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1874/3656] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:38 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1316 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:58:39.137586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8b1d0b14-5abf-4589-ac1c-3caab55b8fec tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:39.140344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8b1d0b14-5abf-4589-ac1c-3caab55b8fec tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] [instance: 94985532-461d-4773-bdab-3daaf5df0219] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:39.150743 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b1d0b14-5abf-4589-ac1c-3caab55b8fec tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:39.151393 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b1d0b14-5abf-4589-ac1c-3caab55b8fec tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:39.152398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b1d0b14-5abf-4589-ac1c-3caab55b8fec tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:39.153190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b1d0b14-5abf-4589-ac1c-3caab55b8fec tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:39.260170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3bcdfba7-1a70-462d-bc85-5f6754d613c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:39.275576 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3bcdfba7-1a70-462d-bc85-5f6754d613c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:39.277227 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3bcdfba7-1a70-462d-bc85-5f6754d613c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:39.282283 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3bcdfba7-1a70-462d-bc85-5f6754d613c4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 0.640623 Jul 25 12:58:39.285801 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1783/3657] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:38 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:39.485282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8b1d0b14-5abf-4589-ac1c-3caab55b8fec tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a3c046b1ab4175853fde002fe96a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe1b73b34c541eeb94dc2983f5811f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:39.496795 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8b1d0b14-5abf-4589-ac1c-3caab55b8fec tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] 10.222.0.49 "GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219" status: 200 len: 1324 microversion: 2.1 time: 0.364408 Jul 25 12:58:39.497704 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1875/3658] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:39 2022] GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219 => generated 1324 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:58:39.508753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b39f424d-a089-46e4-be4e-ebf3f6c580b3 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:39.509871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b39f424d-a089-46e4-be4e-ebf3f6c580b3 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] [instance: ce6d7273-d1e3-400b-87f6-2e4625e78272] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:39.520562 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b39f424d-a089-46e4-be4e-ebf3f6c580b3 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:39.523414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b39f424d-a089-46e4-be4e-ebf3f6c580b3 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:39.524513 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b39f424d-a089-46e4-be4e-ebf3f6c580b3 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:39.526196 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b39f424d-a089-46e4-be4e-ebf3f6c580b3 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:39.860651 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-56306df8-9d43-4c8e-8c68-12ffeca48911 req-e4f572ba-9880-4bd2-b37e-75d7fb3ae711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94985532-461d-4773-bdab-3daaf5df0219", "name": "network-vif-plugged", "status": "completed", "tag": "1f08159b-9656-4b2b-a32e-fc8ff5db28a8"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:58:39.883477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-56306df8-9d43-4c8e-8c68-12ffeca48911 req-e4f572ba-9880-4bd2-b37e-75d7fb3ae711 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:39.884179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-56306df8-9d43-4c8e-8c68-12ffeca48911 req-e4f572ba-9880-4bd2-b37e-75d7fb3ae711 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:39.886541 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b39f424d-a089-46e4-be4e-ebf3f6c580b3 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6839f6502c4eeabf516265d3b00a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64738d1d5d274ff0860307868c10b5d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:39.895333 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b39f424d-a089-46e4-be4e-ebf3f6c580b3 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] 10.222.0.49 "GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272" status: 200 len: 1315 microversion: 2.1 time: 0.391605 Jul 25 12:58:39.908693 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1784/3659] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:39 2022] GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:39.908885 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-56306df8-9d43-4c8e-8c68-12ffeca48911 req-e4f572ba-9880-4bd2-b37e-75d7fb3ae711 service nova] Creating event network-vif-plugged:1f08159b-9656-4b2b-a32e-fc8ff5db28a8 for instance 94985532-461d-4773-bdab-3daaf5df0219 on n-h2-848886-15 Jul 25 12:58:39.908885 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-56306df8-9d43-4c8e-8c68-12ffeca48911 req-e4f572ba-9880-4bd2-b37e-75d7fb3ae711 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048144 Jul 25 12:58:39.908885 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1876/3660] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:58:40.126513 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d34134c4-94d5-4f88-9d6f-1e159cf0fde8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:40.128882 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d34134c4-94d5-4f88-9d6f-1e159cf0fde8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:40.138439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d34134c4-94d5-4f88-9d6f-1e159cf0fde8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:40.139145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d34134c4-94d5-4f88-9d6f-1e159cf0fde8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:40.139939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d34134c4-94d5-4f88-9d6f-1e159cf0fde8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:40.140365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d34134c4-94d5-4f88-9d6f-1e159cf0fde8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:40.309596 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ab29eff7-791b-4771-b173-e252908ce3b3 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:40.310436 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ab29eff7-791b-4771-b173-e252908ce3b3 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:40.320788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ab29eff7-791b-4771-b173-e252908ce3b3 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:40.321440 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ab29eff7-791b-4771-b173-e252908ce3b3 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:40.322272 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ab29eff7-791b-4771-b173-e252908ce3b3 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:40.322712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ab29eff7-791b-4771-b173-e252908ce3b3 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:40.890213 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d34134c4-94d5-4f88-9d6f-1e159cf0fde8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:40.904126 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d34134c4-94d5-4f88-9d6f-1e159cf0fde8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1316 microversion: 2.1 time: 0.781888 Jul 25 12:58:40.909103 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1785/3661] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:40 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1316 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:40.919272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4627339a-d2be-4e43-a4c5-4718f4cd76fb tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:40.922871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4627339a-d2be-4e43-a4c5-4718f4cd76fb tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] [instance: 94985532-461d-4773-bdab-3daaf5df0219] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:40.933520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4627339a-d2be-4e43-a4c5-4718f4cd76fb tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:40.934341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4627339a-d2be-4e43-a4c5-4718f4cd76fb tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:40.936106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4627339a-d2be-4e43-a4c5-4718f4cd76fb tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:40.937154 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4627339a-d2be-4e43-a4c5-4718f4cd76fb tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:41.265769 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ab29eff7-791b-4771-b173-e252908ce3b3 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:41.284822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ab29eff7-791b-4771-b173-e252908ce3b3 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:41.288350 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ab29eff7-791b-4771-b173-e252908ce3b3 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:41.294718 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ab29eff7-791b-4771-b173-e252908ce3b3 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 0.988737 Jul 25 12:58:41.305813 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1877/3662] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:40 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:58:41.321977 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-79d7295e-9451-41a6-a9d9-54bf009cbad9 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:41.322615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-79d7295e-9451-41a6-a9d9-54bf009cbad9 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] [instance: ce6d7273-d1e3-400b-87f6-2e4625e78272] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:41.331223 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-79d7295e-9451-41a6-a9d9-54bf009cbad9 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:41.331975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-79d7295e-9451-41a6-a9d9-54bf009cbad9 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:41.333007 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-79d7295e-9451-41a6-a9d9-54bf009cbad9 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:41.336829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4627339a-d2be-4e43-a4c5-4718f4cd76fb tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a3c046b1ab4175853fde002fe96a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe1b73b34c541eeb94dc2983f5811f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:41.340860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-79d7295e-9451-41a6-a9d9-54bf009cbad9 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:41.345380 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4627339a-d2be-4e43-a4c5-4718f4cd76fb tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] 10.222.0.49 "GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219" status: 200 len: 1324 microversion: 2.1 time: 0.434503 Jul 25 12:58:41.350494 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1786/3663] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:40 2022] GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219 => generated 1324 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:41.355670 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7c6be6ed-d176-457d-b3d3-4fb3bac02b62 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:41.365325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7c6be6ed-d176-457d-b3d3-4fb3bac02b62 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:41.373360 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c6be6ed-d176-457d-b3d3-4fb3bac02b62 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:41.374123 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c6be6ed-d176-457d-b3d3-4fb3bac02b62 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:41.375112 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c6be6ed-d176-457d-b3d3-4fb3bac02b62 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:41.375727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c6be6ed-d176-457d-b3d3-4fb3bac02b62 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:41.392016 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-7c6be6ed-d176-457d-b3d3-4fb3bac02b62 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] HTTP exception thrown: Instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 could not be found. Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7c6be6ed-d176-457d-b3d3-4fb3bac02b62 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Request method failure captured: Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 HTTP/1.1 Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pF74i10wLQH0K_jnv8tTrfqhB-9m0e9ZyrG-0q-A0XwV-RV1ZQ5qMHLI6ijZdsM5ujKJLXpzwrsgYDt7PvOkBMZA11aLpX3kxlvavoNSxX-iaCjxAEbktyDG0xjD25ok1vQvqd_hl3GlP9kJCPXdEisKb0QhW5E2iutF06bUX6nFz0 Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: X-Openstack-Nova-Api-Version: 2.32 Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: f951d0b219924bb1aa408d3e22bcafc3 Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-TaggedBootDevicesTest-860576825 Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f951d0b219924bb1aa408d3e22bcafc3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f951d0b219924bb1aa408d3e22bcafc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f951d0b219924bb1aa408d3e22bcafc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f951d0b219924bb1aa408d3e22bcafc3"}]}] Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-TaggedBootDevicesTest-860576825 Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: f951d0b219924bb1aa408d3e22bcafc3 Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-TaggedBootDevicesTest-860576825 Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-TaggedBootDevicesTest-860576825-project Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 2f958f28464144e89e63b7e7dbcfb0b5 Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-TaggedBootDevicesTest-860576825-project Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 could not be found. Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '75735e91-1a4c-435e-b3d5-53abb8bfae88'} Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 could not be found. Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:58:41.394330 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:58:41.397796 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 could not be found. Jul 25 12:58:41.397796 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:58:41.397796 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:58:41.397796 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:58:41.397796 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:41.397796 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:58:41.397796 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:58:41.397796 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:58:41.397796 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:58:41.397796 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 could not be found. Jul 25 12:58:41.397796 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:58:41.400030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7c6be6ed-d176-457d-b3d3-4fb3bac02b62 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Returning 404 to user: Instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:58:41.401224 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7c6be6ed-d176-457d-b3d3-4fb3bac02b62 tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "DELETE /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 404 len: 111 microversion: 2.32 time: 0.049620 Jul 25 12:58:41.402033 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1787/3664] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 12:58:41 2022] DELETE /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:58:41.416165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7ab2e695-f88f-4180-8b2c-5b6f6f9a522a tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:41.417436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7ab2e695-f88f-4180-8b2c-5b6f6f9a522a tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] [instance: 75735e91-1a4c-435e-b3d5-53abb8bfae88] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:41.427658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ab2e695-f88f-4180-8b2c-5b6f6f9a522a tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:41.430148 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ab2e695-f88f-4180-8b2c-5b6f6f9a522a tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:41.431246 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ab2e695-f88f-4180-8b2c-5b6f6f9a522a tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:41.433096 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ab2e695-f88f-4180-8b2c-5b6f6f9a522a tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:41.454011 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-7ab2e695-f88f-4180-8b2c-5b6f6f9a522a tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] HTTP exception thrown: Instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 could not be found. Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7ab2e695-f88f-4180-8b2c-5b6f6f9a522a tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Request method failure captured: Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 HTTP/1.1 Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pF74i10wLQH0K_jnv8tTrfqhB-9m0e9ZyrG-0q-A0XwV-RV1ZQ5qMHLI6ijZdsM5ujKJLXpzwrsgYDt7PvOkBMZA11aLpX3kxlvavoNSxX-iaCjxAEbktyDG0xjD25ok1vQvqd_hl3GlP9kJCPXdEisKb0QhW5E2iutF06bUX6nFz0 Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: X-Openstack-Nova-Api-Version: 2.32 Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: f951d0b219924bb1aa408d3e22bcafc3 Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-TaggedBootDevicesTest-860576825 Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f951d0b219924bb1aa408d3e22bcafc3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f951d0b219924bb1aa408d3e22bcafc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f951d0b219924bb1aa408d3e22bcafc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f951d0b219924bb1aa408d3e22bcafc3"}]}] Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-TaggedBootDevicesTest-860576825 Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: f951d0b219924bb1aa408d3e22bcafc3 Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-TaggedBootDevicesTest-860576825 Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-TaggedBootDevicesTest-860576825-project Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 2f958f28464144e89e63b7e7dbcfb0b5 Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-TaggedBootDevicesTest-860576825-project Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 could not be found. Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '75735e91-1a4c-435e-b3d5-53abb8bfae88'} Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 could not be found. Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 could not be found. Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:58:41.455873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:58:41.459506 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:41.459506 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:58:41.459506 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:58:41.459506 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:58:41.459506 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:58:41.459506 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 could not be found. Jul 25 12:58:41.459506 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:58:41.459506 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7ab2e695-f88f-4180-8b2c-5b6f6f9a522a tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] Returning 404 to user: Instance 75735e91-1a4c-435e-b3d5-53abb8bfae88 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:58:41.459506 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7ab2e695-f88f-4180-8b2c-5b6f6f9a522a tempest-TaggedBootDevicesTest-860576825 tempest-TaggedBootDevicesTest-860576825-project] 10.222.0.49 "GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88" status: 404 len: 111 microversion: 2.32 time: 0.050426 Jul 25 12:58:41.462009 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1788/3665] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:41 2022] GET /compute/v2.1/servers/75735e91-1a4c-435e-b3d5-53abb8bfae88 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:58:41.526846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-79d7295e-9451-41a6-a9d9-54bf009cbad9 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6839f6502c4eeabf516265d3b00a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64738d1d5d274ff0860307868c10b5d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:41.535654 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-79d7295e-9451-41a6-a9d9-54bf009cbad9 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] 10.222.0.49 "GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272" status: 200 len: 1465 microversion: 2.1 time: 0.222604 Jul 25 12:58:41.537412 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1878/3666] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:41 2022] GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272 => generated 1465 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:41.620659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4af6fd67-0bb1-4ad4-8f33-877a98cfd62b tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:41.621525 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4af6fd67-0bb1-4ad4-8f33-877a98cfd62b tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] [instance: ce6d7273-d1e3-400b-87f6-2e4625e78272] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:41.635170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4af6fd67-0bb1-4ad4-8f33-877a98cfd62b tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:41.635645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4af6fd67-0bb1-4ad4-8f33-877a98cfd62b tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:41.637030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4af6fd67-0bb1-4ad4-8f33-877a98cfd62b tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:41.637482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4af6fd67-0bb1-4ad4-8f33-877a98cfd62b tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:41.697899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4af6fd67-0bb1-4ad4-8f33-877a98cfd62b tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] [instance: ce6d7273-d1e3-400b-87f6-2e4625e78272] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:58:41.764715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:41.813459 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4af6fd67-0bb1-4ad4-8f33-877a98cfd62b tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272" status: 204 len: 0 microversion: 2.1 time: 0.197769 Jul 25 12:58:41.816828 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1789/3667] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:58:41 2022] DELETE /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:58:41.828871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8f3edad8-de27-4447-bf23-ab405c4bcb85 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:41.829635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8f3edad8-de27-4447-bf23-ab405c4bcb85 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] [instance: ce6d7273-d1e3-400b-87f6-2e4625e78272] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:41.843090 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8f3edad8-de27-4447-bf23-ab405c4bcb85 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:41.843957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8f3edad8-de27-4447-bf23-ab405c4bcb85 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:41.845781 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8f3edad8-de27-4447-bf23-ab405c4bcb85 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:41.846457 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8f3edad8-de27-4447-bf23-ab405c4bcb85 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:41.932717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9deddaea-8910-45c4-b880-5aa929172fa1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:41.934635 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9deddaea-8910-45c4-b880-5aa929172fa1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:41.944575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9deddaea-8910-45c4-b880-5aa929172fa1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:41.945259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9deddaea-8910-45c4-b880-5aa929172fa1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:41.946449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9deddaea-8910-45c4-b880-5aa929172fa1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:41.947177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9deddaea-8910-45c4-b880-5aa929172fa1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:42.325524 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9deddaea-8910-45c4-b880-5aa929172fa1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:42.333261 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9deddaea-8910-45c4-b880-5aa929172fa1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1316 microversion: 2.1 time: 0.405589 Jul 25 12:58:42.333870 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1790/3668] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:41 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1316 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:42.356000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cf46d9d0-64ae-4009-a8d6-7b343fe01957 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:42.361987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8f3edad8-de27-4447-bf23-ab405c4bcb85 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6839f6502c4eeabf516265d3b00a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64738d1d5d274ff0860307868c10b5d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:42.363297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cf46d9d0-64ae-4009-a8d6-7b343fe01957 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:42.370547 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8f3edad8-de27-4447-bf23-ab405c4bcb85 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] 10.222.0.49 "GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272" status: 200 len: 1471 microversion: 2.1 time: 0.548722 Jul 25 12:58:42.378451 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1879/3669] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:41 2022] GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272 => generated 1471 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:58:42.385813 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bf99a57b-ac9c-4359-abda-7f5034e2ae06 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:42.386460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bf99a57b-ac9c-4359-abda-7f5034e2ae06 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] [instance: 94985532-461d-4773-bdab-3daaf5df0219] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:42.388459 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf46d9d0-64ae-4009-a8d6-7b343fe01957 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:42.388916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf46d9d0-64ae-4009-a8d6-7b343fe01957 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:42.389692 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf46d9d0-64ae-4009-a8d6-7b343fe01957 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:42.393410 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf46d9d0-64ae-4009-a8d6-7b343fe01957 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:42.402121 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf99a57b-ac9c-4359-abda-7f5034e2ae06 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:42.403061 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf99a57b-ac9c-4359-abda-7f5034e2ae06 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:42.404223 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf99a57b-ac9c-4359-abda-7f5034e2ae06 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:42.404838 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf99a57b-ac9c-4359-abda-7f5034e2ae06 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:42.757061 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bf99a57b-ac9c-4359-abda-7f5034e2ae06 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a3c046b1ab4175853fde002fe96a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe1b73b34c541eeb94dc2983f5811f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:42.768131 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bf99a57b-ac9c-4359-abda-7f5034e2ae06 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] 10.222.0.49 "GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219" status: 200 len: 1522 microversion: 2.1 time: 0.388444 Jul 25 12:58:42.768729 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1880/3670] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:42 2022] GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:42.792700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-94c83212-843d-4411-8ef3-d40a2f9b962b tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:42.793242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-94c83212-843d-4411-8ef3-d40a2f9b962b tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] [instance: 94985532-461d-4773-bdab-3daaf5df0219] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:42.802244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94c83212-843d-4411-8ef3-d40a2f9b962b tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:42.802707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94c83212-843d-4411-8ef3-d40a2f9b962b tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:42.814207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94c83212-843d-4411-8ef3-d40a2f9b962b tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:42.814890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94c83212-843d-4411-8ef3-d40a2f9b962b tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:42.827373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cf46d9d0-64ae-4009-a8d6-7b343fe01957 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:42.846420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cf46d9d0-64ae-4009-a8d6-7b343fe01957 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:42.850227 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cf46d9d0-64ae-4009-a8d6-7b343fe01957 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:42.853040 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cf46d9d0-64ae-4009-a8d6-7b343fe01957 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 0.500951 Jul 25 12:58:42.853989 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1791/3671] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:42 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:42.889586 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-94c83212-843d-4411-8ef3-d40a2f9b962b tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] HTTP exception thrown: Instance is not a member of specified network Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-94c83212-843d-4411-8ef3-d40a2f9b962b tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Request method failure captured: Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219/ips/invalid HTTP/1.1 Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pNp8DMY1RbEUI9dzLUyxbk3ULXV3OEsBFDtBLMxKy6NZlBufNbkU0AuD2LG81gedvIkO_VIhc_VyoDCnfFgPq6jx79kkNKjoABinQ8uSEZwdGTWwY_PNKvoPEqfXrui0bhqY4iHp8Zra9YcRT3_Jt37LGldD0_GqEtggCse5XuXPgM Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 7fe1b73b34c541eeb94dc2983f5811f7 Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-397836900 Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7fe1b73b34c541eeb94dc2983f5811f7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7fe1b73b34c541eeb94dc2983f5811f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7fe1b73b34c541eeb94dc2983f5811f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7fe1b73b34c541eeb94dc2983f5811f7"}]}] Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-397836900 Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 7fe1b73b34c541eeb94dc2983f5811f7 Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-397836900 Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerAddressesNegativeTestJSON-397836900-project Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 71a3c046b1ab4175853fde002fe96a4b Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-397836900-project Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance is not a member of specified network Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'server_id': '94985532-461d-4773-bdab-3daaf5df0219', 'id': 'invalid'} Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 25 12:58:42.908862 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:58:42.914129 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-94c83212-843d-4411-8ef3-d40a2f9b962b tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Returning 404 to user: Instance is not a member of specified network {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:58:42.915205 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-94c83212-843d-4411-8ef3-d40a2f9b962b tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] 10.222.0.49 "GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.126700 Jul 25 12:58:42.915880 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1881/3672] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 12:58:42 2022] GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219/ips/invalid => generated 91 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 25 12:58:42.939472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-90c744de-93ca-4315-897e-b2e84612f9c1 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:42.940335 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-90c744de-93ca-4315-897e-b2e84612f9c1 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Failed to fetch instance by id 999 {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 12:58:42.940869 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-90c744de-93ca-4315-897e-b2e84612f9c1 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] HTTP exception thrown: Instance 999 could not be found. Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-90c744de-93ca-4315-897e-b2e84612f9c1 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Request method failure captured: Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pNp8DMY1RbEUI9dzLUyxbk3ULXV3OEsBFDtBLMxKy6NZlBufNbkU0AuD2LG81gedvIkO_VIhc_VyoDCnfFgPq6jx79kkNKjoABinQ8uSEZwdGTWwY_PNKvoPEqfXrui0bhqY4iHp8Zra9YcRT3_Jt37LGldD0_GqEtggCse5XuXPgM Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 7fe1b73b34c541eeb94dc2983f5811f7 Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-397836900 Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7fe1b73b34c541eeb94dc2983f5811f7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7fe1b73b34c541eeb94dc2983f5811f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7fe1b73b34c541eeb94dc2983f5811f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7fe1b73b34c541eeb94dc2983f5811f7"}]}] Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-397836900 Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 7fe1b73b34c541eeb94dc2983f5811f7 Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-397836900 Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerAddressesNegativeTestJSON-397836900-project Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 71a3c046b1ab4175853fde002fe96a4b Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-397836900-project Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 999 could not be found. Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'server_id': '999'} Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 25 12:58:42.947472 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:58:42.951734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-90c744de-93ca-4315-897e-b2e84612f9c1 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Returning 404 to user: Instance 999 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:58:42.952270 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-90c744de-93ca-4315-897e-b2e84612f9c1 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] 10.222.0.49 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.029189 Jul 25 12:58:42.957742 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1792/3673] 10.222.0.49 () {58 vars in 1149 bytes} [Mon Jul 25 12:58:42 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:58:42.968499 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fb15ceb7-4338-4a33-9334-e5966ff12226 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:42.969355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fb15ceb7-4338-4a33-9334-e5966ff12226 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] [instance: 94985532-461d-4773-bdab-3daaf5df0219] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:42.981191 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb15ceb7-4338-4a33-9334-e5966ff12226 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:42.983026 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb15ceb7-4338-4a33-9334-e5966ff12226 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:42.985151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb15ceb7-4338-4a33-9334-e5966ff12226 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:42.985601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb15ceb7-4338-4a33-9334-e5966ff12226 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:43.026507 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fb15ceb7-4338-4a33-9334-e5966ff12226 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] [instance: 94985532-461d-4773-bdab-3daaf5df0219] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:58:43.093464 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:43.231212 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fb15ceb7-4338-4a33-9334-e5966ff12226 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] 10.222.0.49 "DELETE /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219" status: 204 len: 0 microversion: 2.1 time: 0.266790 Jul 25 12:58:43.234911 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1882/3674] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:58:42 2022] DELETE /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:58:43.240778 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-16a37475-bd2e-4d39-b979-9b7cf7d0dd88 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:43.241556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-16a37475-bd2e-4d39-b979-9b7cf7d0dd88 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] [instance: 94985532-461d-4773-bdab-3daaf5df0219] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:43.244184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:43.245054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:43.280552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16a37475-bd2e-4d39-b979-9b7cf7d0dd88 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:43.281013 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16a37475-bd2e-4d39-b979-9b7cf7d0dd88 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:43.283577 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16a37475-bd2e-4d39-b979-9b7cf7d0dd88 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:43.286023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16a37475-bd2e-4d39-b979-9b7cf7d0dd88 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:43.363225 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4fd9c6cb-6c57-4ddf-a616-202de4f764c3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:43.363992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4fd9c6cb-6c57-4ddf-a616-202de4f764c3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:43.382827 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4fd9c6cb-6c57-4ddf-a616-202de4f764c3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:43.383290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4fd9c6cb-6c57-4ddf-a616-202de4f764c3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:43.384086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4fd9c6cb-6c57-4ddf-a616-202de4f764c3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:43.384530 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4fd9c6cb-6c57-4ddf-a616-202de4f764c3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:43.697560 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-16a37475-bd2e-4d39-b979-9b7cf7d0dd88 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a3c046b1ab4175853fde002fe96a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe1b73b34c541eeb94dc2983f5811f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:43.707781 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-16a37475-bd2e-4d39-b979-9b7cf7d0dd88 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] 10.222.0.49 "GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219" status: 200 len: 1528 microversion: 2.1 time: 0.471250 Jul 25 12:58:43.708400 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1793/3675] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:43 2022] GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219 => generated 1528 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:43.725556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-08b40e01-d235-4702-b93f-270b2ff5e861 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:43.726622 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-08b40e01-d235-4702-b93f-270b2ff5e861 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] [instance: ce6d7273-d1e3-400b-87f6-2e4625e78272] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:43.735841 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-08b40e01-d235-4702-b93f-270b2ff5e861 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:43.736908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-08b40e01-d235-4702-b93f-270b2ff5e861 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:43.738079 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-08b40e01-d235-4702-b93f-270b2ff5e861 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:43.739638 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-08b40e01-d235-4702-b93f-270b2ff5e861 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:43.751919 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4fd9c6cb-6c57-4ddf-a616-202de4f764c3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:43.763749 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4fd9c6cb-6c57-4ddf-a616-202de4f764c3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1316 microversion: 2.1 time: 0.408407 Jul 25 12:58:43.774350 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1883/3676] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:43 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1316 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:43.880984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bafad8b9-bc01-4889-8917-450ad455aab2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:43.881645 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bafad8b9-bc01-4889-8917-450ad455aab2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:43.893984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bafad8b9-bc01-4889-8917-450ad455aab2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:43.894447 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bafad8b9-bc01-4889-8917-450ad455aab2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:43.895242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bafad8b9-bc01-4889-8917-450ad455aab2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:43.897578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bafad8b9-bc01-4889-8917-450ad455aab2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:44.268069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-08b40e01-d235-4702-b93f-270b2ff5e861 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6839f6502c4eeabf516265d3b00a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64738d1d5d274ff0860307868c10b5d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:44.278719 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-08b40e01-d235-4702-b93f-270b2ff5e861 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] 10.222.0.49 "GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272" status: 200 len: 1471 microversion: 2.1 time: 0.569191 Jul 25 12:58:44.279588 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1794/3677] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:43 2022] GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272 => generated 1471 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:44.419662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-1751a7fd-5498-4127-846d-9dab8859c724 req-d6f21526-2c69-4ca5-8a81-190c04170bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce6d7273-d1e3-400b-87f6-2e4625e78272", "name": "network-vif-deleted", "tag": "8b439b91-7394-43b9-b157-b121617e3f64"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:58:44.434387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bafad8b9-bc01-4889-8917-450ad455aab2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:44.437019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-1751a7fd-5498-4127-846d-9dab8859c724 req-d6f21526-2c69-4ca5-8a81-190c04170bf7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:44.437505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-1751a7fd-5498-4127-846d-9dab8859c724 req-d6f21526-2c69-4ca5-8a81-190c04170bf7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:44.461771 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bafad8b9-bc01-4889-8917-450ad455aab2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:44.467219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bafad8b9-bc01-4889-8917-450ad455aab2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:44.471117 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bafad8b9-bc01-4889-8917-450ad455aab2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 0.594802 Jul 25 12:58:44.482401 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-1751a7fd-5498-4127-846d-9dab8859c724 req-d6f21526-2c69-4ca5-8a81-190c04170bf7 service nova] Creating event network-vif-deleted:8b439b91-7394-43b9-b157-b121617e3f64 for instance ce6d7273-d1e3-400b-87f6-2e4625e78272 on n-h2-848886-15 Jul 25 12:58:44.483516 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1884/3678] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:43 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:58:44.497705 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-1751a7fd-5498-4127-846d-9dab8859c724 req-d6f21526-2c69-4ca5-8a81-190c04170bf7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081841 Jul 25 12:58:44.503119 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1795/3679] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:58:44.731368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dbe01cbc-89e3-4899-8120-645cb1aea140 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:44.732118 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dbe01cbc-89e3-4899-8120-645cb1aea140 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] [instance: 94985532-461d-4773-bdab-3daaf5df0219] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:44.740943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:44.745214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dbe01cbc-89e3-4899-8120-645cb1aea140 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:44.745693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dbe01cbc-89e3-4899-8120-645cb1aea140 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:44.750948 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dbe01cbc-89e3-4899-8120-645cb1aea140 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:44.753019 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dbe01cbc-89e3-4899-8120-645cb1aea140 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:44.788771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0a68f60f-b6f8-4d40-bcc5-8a097d8c5d13 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:44.789486 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0a68f60f-b6f8-4d40-bcc5-8a097d8c5d13 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:44.801063 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a68f60f-b6f8-4d40-bcc5-8a097d8c5d13 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:44.801511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a68f60f-b6f8-4d40-bcc5-8a097d8c5d13 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:44.815435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a68f60f-b6f8-4d40-bcc5-8a097d8c5d13 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:44.816327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a68f60f-b6f8-4d40-bcc5-8a097d8c5d13 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:45.320284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dbe01cbc-89e3-4899-8120-645cb1aea140 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a3c046b1ab4175853fde002fe96a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe1b73b34c541eeb94dc2983f5811f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:45.334998 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dbe01cbc-89e3-4899-8120-645cb1aea140 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] 10.222.0.49 "GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219" status: 200 len: 1528 microversion: 2.1 time: 0.607562 Jul 25 12:58:45.339140 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1885/3680] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:44 2022] GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219 => generated 1528 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:45.351530 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8a3b7dbe-14e0-45d0-8600-3b972f1a5083 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:45.365609 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8a3b7dbe-14e0-45d0-8600-3b972f1a5083 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] [instance: ce6d7273-d1e3-400b-87f6-2e4625e78272] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:45.384833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a3b7dbe-14e0-45d0-8600-3b972f1a5083 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:45.388154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a3b7dbe-14e0-45d0-8600-3b972f1a5083 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:45.390257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a3b7dbe-14e0-45d0-8600-3b972f1a5083 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:45.391542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a3b7dbe-14e0-45d0-8600-3b972f1a5083 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:45.421164 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0a68f60f-b6f8-4d40-bcc5-8a097d8c5d13 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:45.441992 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-8a3b7dbe-14e0-45d0-8600-3b972f1a5083 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] HTTP exception thrown: Instance ce6d7273-d1e3-400b-87f6-2e4625e78272 could not be found. Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8a3b7dbe-14e0-45d0-8600-3b972f1a5083 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Request method failure captured: Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272 HTTP/1.1 Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pNjwEw31gEW_r7moeoizQa_3AixKgxMyhE1XFvUb0H5KRQj8xKSwwgr59FuZqyIVq1MeFWJCp-I__NqQr41TbjQMMWy_IjsLDH1dESxKtG125_UXOKU_hdQmJ4khTeKcENgHDAu5zjuTYw6raGvYWHPMqWgNLwjKuHoXHc97U4VXsk Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 64738d1d5d274ff0860307868c10b5d8 Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-VolumesNegativeTest-1545454019 Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_64738d1d5d274ff0860307868c10b5d8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/64738d1d5d274ff0860307868c10b5d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/64738d1d5d274ff0860307868c10b5d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/64738d1d5d274ff0860307868c10b5d8"}]}] Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-VolumesNegativeTest-1545454019 Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 64738d1d5d274ff0860307868c10b5d8 Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-VolumesNegativeTest-1545454019 Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-VolumesNegativeTest-1545454019-project Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 5d6839f6502c4eeabf516265d3b00a79 Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-VolumesNegativeTest-1545454019-project Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance ce6d7273-d1e3-400b-87f6-2e4625e78272 could not be found. Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'ce6d7273-d1e3-400b-87f6-2e4625e78272'} Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce6d7273-d1e3-400b-87f6-2e4625e78272 could not be found. Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce6d7273-d1e3-400b-87f6-2e4625e78272 could not be found. Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:58:45.443755 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:58:45.455230 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:45.455230 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:58:45.455230 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:58:45.455230 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:58:45.455230 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:58:45.455230 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce6d7273-d1e3-400b-87f6-2e4625e78272 could not be found. Jul 25 12:58:45.455230 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:58:45.455230 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8a3b7dbe-14e0-45d0-8600-3b972f1a5083 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] Returning 404 to user: Instance ce6d7273-d1e3-400b-87f6-2e4625e78272 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:58:45.455230 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8a3b7dbe-14e0-45d0-8600-3b972f1a5083 tempest-VolumesNegativeTest-1545454019 tempest-VolumesNegativeTest-1545454019-project] 10.222.0.49 "GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272" status: 404 len: 111 microversion: 2.1 time: 0.104853 Jul 25 12:58:45.455230 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1886/3681] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:45 2022] GET /compute/v2.1/servers/ce6d7273-d1e3-400b-87f6-2e4625e78272 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:58:45.471273 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0a68f60f-b6f8-4d40-bcc5-8a097d8c5d13 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1316 microversion: 2.1 time: 0.648903 Jul 25 12:58:45.479329 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1796/3682] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:44 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1316 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:58:45.504854 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dc951815-6753-48a4-843c-4f13d80b5b91 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:45.506967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dc951815-6753-48a4-843c-4f13d80b5b91 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:45.519360 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dc951815-6753-48a4-843c-4f13d80b5b91 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:45.520291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dc951815-6753-48a4-843c-4f13d80b5b91 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:45.521501 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dc951815-6753-48a4-843c-4f13d80b5b91 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:45.522216 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dc951815-6753-48a4-843c-4f13d80b5b91 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:45.785298 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-03a3b9b3-08a2-4088-bf75-c3519f7c0984 req-8b5f9636-5b13-4fe7-9f68-6aecd7984d18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2", "name": "network-vif-plugged", "status": "completed", "tag": "a2ca9e31-6d49-4fae-9ff5-c3c32be13ff6"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:58:45.815656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-03a3b9b3-08a2-4088-bf75-c3519f7c0984 req-8b5f9636-5b13-4fe7-9f68-6aecd7984d18 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:45.816117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-03a3b9b3-08a2-4088-bf75-c3519f7c0984 req-8b5f9636-5b13-4fe7-9f68-6aecd7984d18 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:45.870213 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-03a3b9b3-08a2-4088-bf75-c3519f7c0984 req-8b5f9636-5b13-4fe7-9f68-6aecd7984d18 service nova] Creating event network-vif-plugged:a2ca9e31-6d49-4fae-9ff5-c3c32be13ff6 for instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 on n-h1-848886-15 Jul 25 12:58:45.897545 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-03a3b9b3-08a2-4088-bf75-c3519f7c0984 req-8b5f9636-5b13-4fe7-9f68-6aecd7984d18 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.450390 Jul 25 12:58:45.905033 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1887/3683] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:58:46.236868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dc951815-6753-48a4-843c-4f13d80b5b91 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:46.282940 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dc951815-6753-48a4-843c-4f13d80b5b91 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:46.284573 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dc951815-6753-48a4-843c-4f13d80b5b91 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:46.285786 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dc951815-6753-48a4-843c-4f13d80b5b91 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 0.787972 Jul 25 12:58:46.290303 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1797/3684] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:45 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:58:46.360190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6cab19e2-e8e8-47bd-8fc5-24ebcc4cb293 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:46.360902 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6cab19e2-e8e8-47bd-8fc5-24ebcc4cb293 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] [instance: 94985532-461d-4773-bdab-3daaf5df0219] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:46.373610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cab19e2-e8e8-47bd-8fc5-24ebcc4cb293 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:46.374588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cab19e2-e8e8-47bd-8fc5-24ebcc4cb293 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:46.379885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cab19e2-e8e8-47bd-8fc5-24ebcc4cb293 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:46.380871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cab19e2-e8e8-47bd-8fc5-24ebcc4cb293 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:46.438766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cab19e2-e8e8-47bd-8fc5-24ebcc4cb293 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:46.439309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cab19e2-e8e8-47bd-8fc5-24ebcc4cb293 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:46.439772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-6cab19e2-e8e8-47bd-8fc5-24ebcc4cb293 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lazy-loading 'fault' on Instance uuid 94985532-461d-4773-bdab-3daaf5df0219 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:58:46.511108 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d1728876-ab0b-477c-a3cd-f2f5b39828a3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:46.512650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d1728876-ab0b-477c-a3cd-f2f5b39828a3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:46.520160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6cab19e2-e8e8-47bd-8fc5-24ebcc4cb293 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a3c046b1ab4175853fde002fe96a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe1b73b34c541eeb94dc2983f5811f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:46.521872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1728876-ab0b-477c-a3cd-f2f5b39828a3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:46.523374 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1728876-ab0b-477c-a3cd-f2f5b39828a3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:46.526835 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1728876-ab0b-477c-a3cd-f2f5b39828a3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:46.527706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1728876-ab0b-477c-a3cd-f2f5b39828a3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:46.529508 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6cab19e2-e8e8-47bd-8fc5-24ebcc4cb293 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] 10.222.0.49 "GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219" status: 200 len: 1314 microversion: 2.1 time: 0.174861 Jul 25 12:58:46.541860 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1888/3685] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:46 2022] GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:46.561467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-47c22c13-f626-4608-8f3a-d767eeecb2f0 req-34a423de-f3f5-48c5-b032-732826deb18d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94985532-461d-4773-bdab-3daaf5df0219", "name": "network-vif-deleted", "tag": "1f08159b-9656-4b2b-a32e-fc8ff5db28a8"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:58:46.579132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-47c22c13-f626-4608-8f3a-d767eeecb2f0 req-34a423de-f3f5-48c5-b032-732826deb18d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:46.579755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-47c22c13-f626-4608-8f3a-d767eeecb2f0 req-34a423de-f3f5-48c5-b032-732826deb18d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:46.597407 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-47c22c13-f626-4608-8f3a-d767eeecb2f0 req-34a423de-f3f5-48c5-b032-732826deb18d service nova] Creating event network-vif-deleted:1f08159b-9656-4b2b-a32e-fc8ff5db28a8 for instance 94985532-461d-4773-bdab-3daaf5df0219 on n-h2-848886-15 Jul 25 12:58:46.605276 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-47c22c13-f626-4608-8f3a-d767eeecb2f0 req-34a423de-f3f5-48c5-b032-732826deb18d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050281 Jul 25 12:58:46.606795 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1889/3686] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:58:46.687075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aaecf662-d99a-4a13-aea3-a666f32173c9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:46.687812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-aaecf662-d99a-4a13-aea3-a666f32173c9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:46.703767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aaecf662-d99a-4a13-aea3-a666f32173c9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:46.705441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aaecf662-d99a-4a13-aea3-a666f32173c9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:46.706326 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aaecf662-d99a-4a13-aea3-a666f32173c9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:46.706779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aaecf662-d99a-4a13-aea3-a666f32173c9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:46.772524 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d1728876-ab0b-477c-a3cd-f2f5b39828a3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:46.782537 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d1728876-ab0b-477c-a3cd-f2f5b39828a3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1316 microversion: 2.1 time: 0.277359 Jul 25 12:58:46.785953 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1798/3687] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:46 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1316 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:46.907706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-aaecf662-d99a-4a13-aea3-a666f32173c9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:46.924043 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-aaecf662-d99a-4a13-aea3-a666f32173c9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.242140 Jul 25 12:58:46.938577 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1890/3688] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:46 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:58:46.951604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-34ab092b-3f8b-47e2-86ac-282ecca28e2f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:46.952232 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-34ab092b-3f8b-47e2-86ac-282ecca28e2f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:46.974170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-34ab092b-3f8b-47e2-86ac-282ecca28e2f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:46.975570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-34ab092b-3f8b-47e2-86ac-282ecca28e2f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:46.977669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-34ab092b-3f8b-47e2-86ac-282ecca28e2f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:46.978722 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-34ab092b-3f8b-47e2-86ac-282ecca28e2f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:47.244256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-34ab092b-3f8b-47e2-86ac-282ecca28e2f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:47.261134 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-34ab092b-3f8b-47e2-86ac-282ecca28e2f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.314118 Jul 25 12:58:47.264900 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1799/3689] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:46 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:47.288176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b8ce0591-3fc5-44b4-905b-ccb1e4d7b60f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:47.289034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b8ce0591-3fc5-44b4-905b-ccb1e4d7b60f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:47.310914 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8ce0591-3fc5-44b4-905b-ccb1e4d7b60f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:47.311677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8ce0591-3fc5-44b4-905b-ccb1e4d7b60f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:47.312658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8ce0591-3fc5-44b4-905b-ccb1e4d7b60f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:47.313117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8ce0591-3fc5-44b4-905b-ccb1e4d7b60f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:47.314811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bbf4a1bf-e257-456b-80f5-9758da0ab8cd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:47.315761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bbf4a1bf-e257-456b-80f5-9758da0ab8cd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:47.327933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbf4a1bf-e257-456b-80f5-9758da0ab8cd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:47.329488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbf4a1bf-e257-456b-80f5-9758da0ab8cd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:47.330456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbf4a1bf-e257-456b-80f5-9758da0ab8cd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:47.330964 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbf4a1bf-e257-456b-80f5-9758da0ab8cd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:47.820213 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b8ce0591-3fc5-44b4-905b-ccb1e4d7b60f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:47.834004 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b8ce0591-3fc5-44b4-905b-ccb1e4d7b60f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.549736 Jul 25 12:58:47.835496 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1891/3690] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:47 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:47.856451 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cea6c445-c602-4c09-9348-16cd5386dcb9 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:47.857077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cea6c445-c602-4c09-9348-16cd5386dcb9 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] [instance: 94985532-461d-4773-bdab-3daaf5df0219] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:47.874907 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cea6c445-c602-4c09-9348-16cd5386dcb9 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:47.875366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cea6c445-c602-4c09-9348-16cd5386dcb9 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:47.876167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cea6c445-c602-4c09-9348-16cd5386dcb9 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:47.876952 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cea6c445-c602-4c09-9348-16cd5386dcb9 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:47.932803 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-cea6c445-c602-4c09-9348-16cd5386dcb9 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] HTTP exception thrown: Instance 94985532-461d-4773-bdab-3daaf5df0219 could not be found. Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cea6c445-c602-4c09-9348-16cd5386dcb9 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Request method failure captured: Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219 HTTP/1.1 Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pNp8DMY1RbEUI9dzLUyxbk3ULXV3OEsBFDtBLMxKy6NZlBufNbkU0AuD2LG81gedvIkO_VIhc_VyoDCnfFgPq6jx79kkNKjoABinQ8uSEZwdGTWwY_PNKvoPEqfXrui0bhqY4iHp8Zra9YcRT3_Jt37LGldD0_GqEtggCse5XuXPgM Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 7fe1b73b34c541eeb94dc2983f5811f7 Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-397836900 Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7fe1b73b34c541eeb94dc2983f5811f7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7fe1b73b34c541eeb94dc2983f5811f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7fe1b73b34c541eeb94dc2983f5811f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7fe1b73b34c541eeb94dc2983f5811f7"}]}] Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-397836900 Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 7fe1b73b34c541eeb94dc2983f5811f7 Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-397836900 Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerAddressesNegativeTestJSON-397836900-project Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 71a3c046b1ab4175853fde002fe96a4b Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-397836900-project Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 94985532-461d-4773-bdab-3daaf5df0219 could not be found. Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '94985532-461d-4773-bdab-3daaf5df0219'} Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94985532-461d-4773-bdab-3daaf5df0219 could not be found. Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94985532-461d-4773-bdab-3daaf5df0219 could not be found. Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:58:47.944048 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:58:47.948363 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:58:47.948363 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:47.948363 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:58:47.948363 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:58:47.948363 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:58:47.948363 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:58:47.948363 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94985532-461d-4773-bdab-3daaf5df0219 could not be found. Jul 25 12:58:47.948363 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:58:47.948363 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cea6c445-c602-4c09-9348-16cd5386dcb9 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] Returning 404 to user: Instance 94985532-461d-4773-bdab-3daaf5df0219 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:58:47.948363 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cea6c445-c602-4c09-9348-16cd5386dcb9 tempest-ServerAddressesNegativeTestJSON-397836900 tempest-ServerAddressesNegativeTestJSON-397836900-project] 10.222.0.49 "GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219" status: 404 len: 111 microversion: 2.1 time: 0.104650 Jul 25 12:58:47.950425 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1892/3691] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:47 2022] GET /compute/v2.1/servers/94985532-461d-4773-bdab-3daaf5df0219 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:58:47.984032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8c109675-3410-49d8-897e-8f230cbe4b69 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:47.990057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8c109675-3410-49d8-897e-8f230cbe4b69 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:48.016335 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c109675-3410-49d8-897e-8f230cbe4b69 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:48.016883 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c109675-3410-49d8-897e-8f230cbe4b69 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:48.017575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c109675-3410-49d8-897e-8f230cbe4b69 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:48.018041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c109675-3410-49d8-897e-8f230cbe4b69 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:48.035337 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bbf4a1bf-e257-456b-80f5-9758da0ab8cd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:48.057306 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bbf4a1bf-e257-456b-80f5-9758da0ab8cd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:48.059377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bbf4a1bf-e257-456b-80f5-9758da0ab8cd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:48.065080 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bbf4a1bf-e257-456b-80f5-9758da0ab8cd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 0.755635 Jul 25 12:58:48.070943 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1800/3692] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:47 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:48.083616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6077c16d-8445-4f1b-80e4-614ebdca94c0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:48.085327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6077c16d-8445-4f1b-80e4-614ebdca94c0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:48.103443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6077c16d-8445-4f1b-80e4-614ebdca94c0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:48.107557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6077c16d-8445-4f1b-80e4-614ebdca94c0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:48.111391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6077c16d-8445-4f1b-80e4-614ebdca94c0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:48.112183 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6077c16d-8445-4f1b-80e4-614ebdca94c0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:48.504671 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8c109675-3410-49d8-897e-8f230cbe4b69 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:48.513400 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8c109675-3410-49d8-897e-8f230cbe4b69 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1316 microversion: 2.1 time: 0.542653 Jul 25 12:58:48.517554 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1893/3693] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:47 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1316 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:48.581236 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6077c16d-8445-4f1b-80e4-614ebdca94c0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:48.592115 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6077c16d-8445-4f1b-80e4-614ebdca94c0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.517263 Jul 25 12:58:48.592741 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1801/3694] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:48 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:48.870397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-664fdaba-89c9-4279-b4e4-e78200e02a74 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1307045002", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "f9bdc019-d9ba-4dd9-9e23-b909e49f2c93"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:58:48.953755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-664fdaba-89c9-4279-b4e4-e78200e02a74 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] validate_networks() for [('f9bdc019-d9ba-4dd9-9e23-b909e49f2c93', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:58:49.096790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ea375657-db66-45ae-8469-440046b3242c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:49.097419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ea375657-db66-45ae-8469-440046b3242c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:49.115986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea375657-db66-45ae-8469-440046b3242c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:49.116965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea375657-db66-45ae-8469-440046b3242c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:49.118036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea375657-db66-45ae-8469-440046b3242c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:49.125515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea375657-db66-45ae-8469-440046b3242c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:49.827686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ea375657-db66-45ae-8469-440046b3242c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:49.848484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ea375657-db66-45ae-8469-440046b3242c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:49.850197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ea375657-db66-45ae-8469-440046b3242c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:49.853628 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ea375657-db66-45ae-8469-440046b3242c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 0.760919 Jul 25 12:58:49.861020 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1802/3695] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:49 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:58:49.871014 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b869378f-5849-43ca-8668-11665ee267dc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:49.872196 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b869378f-5849-43ca-8668-11665ee267dc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:49.895550 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b869378f-5849-43ca-8668-11665ee267dc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:49.896019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b869378f-5849-43ca-8668-11665ee267dc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:49.896828 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b869378f-5849-43ca-8668-11665ee267dc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:49.897261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b869378f-5849-43ca-8668-11665ee267dc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:50.376836 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-664fdaba-89c9-4279-b4e4-e78200e02a74 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:58:50.377270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-664fdaba-89c9-4279-b4e4-e78200e02a74 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:58:50.377750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-664fdaba-89c9-4279-b4e4-e78200e02a74 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:58:50.378542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-664fdaba-89c9-4279-b4e4-e78200e02a74 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:58:50.378897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-664fdaba-89c9-4279-b4e4-e78200e02a74 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:58:50.380773 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b869378f-5849-43ca-8668-11665ee267dc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:50.389378 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b869378f-5849-43ca-8668-11665ee267dc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.527151 Jul 25 12:58:50.407870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-664fdaba-89c9-4279-b4e4-e78200e02a74 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:50.408323 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-664fdaba-89c9-4279-b4e4-e78200e02a74 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:50.413962 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1803/3696] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:49 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:50.415571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-664fdaba-89c9-4279-b4e4-e78200e02a74 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:50.416847 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-664fdaba-89c9-4279-b4e4-e78200e02a74 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:50.511971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-664fdaba-89c9-4279-b4e4-e78200e02a74 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Getting quotas for project b5abf45c9ba0419c8dec07847f3ff3c5. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:58:50.528004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-664fdaba-89c9-4279-b4e4-e78200e02a74 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Getting quotas for user 4d492d20a4864908a81902f86468d437 and project b5abf45c9ba0419c8dec07847f3ff3c5. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:58:50.567442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-664fdaba-89c9-4279-b4e4-e78200e02a74 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:58:50.570454 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-664fdaba-89c9-4279-b4e4-e78200e02a74 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:58:50.669475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-168b62b5-de7e-4310-9d9c-493992fd9344 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-481683131", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:58:50.680975 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-664fdaba-89c9-4279-b4e4-e78200e02a74 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.816496 Jul 25 12:58:50.690367 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1894/3697] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:58:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:58:50.706946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b160839a-8696-4d69-bfb9-dcf32cc2a00c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:50.707585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b160839a-8696-4d69-bfb9-dcf32cc2a00c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:50.806650 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b160839a-8696-4d69-bfb9-dcf32cc2a00c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:50.819611 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b160839a-8696-4d69-bfb9-dcf32cc2a00c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f" status: 200 len: 1215 microversion: 2.1 time: 0.127373 Jul 25 12:58:50.822274 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1895/3698] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:50 2022] GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f => generated 1215 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:50.838797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-168b62b5-de7e-4310-9d9c-493992fd9344 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] validate_networks() for [('dc975d58-9818-4c8b-8bcd-8b1a23df5609', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:58:50.884693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0f759013-c79a-439c-a826-9e6884efe6a4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:50.885855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0f759013-c79a-439c-a826-9e6884efe6a4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:50.895988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0f759013-c79a-439c-a826-9e6884efe6a4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:50.896466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0f759013-c79a-439c-a826-9e6884efe6a4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:50.897438 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0f759013-c79a-439c-a826-9e6884efe6a4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:50.897986 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0f759013-c79a-439c-a826-9e6884efe6a4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:52.766271 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0f759013-c79a-439c-a826-9e6884efe6a4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:52.791658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0f759013-c79a-439c-a826-9e6884efe6a4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:52.833744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0f759013-c79a-439c-a826-9e6884efe6a4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:52.849300 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0f759013-c79a-439c-a826-9e6884efe6a4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 1.965964 Jul 25 12:58:52.855357 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1896/3699] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:50 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:52.874472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a80ccdb0-4d80-4849-bfa1-4cada15ec1a4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:52.880723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a80ccdb0-4d80-4849-bfa1-4cada15ec1a4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:52.917371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a80ccdb0-4d80-4849-bfa1-4cada15ec1a4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:52.921520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a80ccdb0-4d80-4849-bfa1-4cada15ec1a4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:52.924474 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a80ccdb0-4d80-4849-bfa1-4cada15ec1a4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:52.926923 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a80ccdb0-4d80-4849-bfa1-4cada15ec1a4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:53.247955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a80ccdb0-4d80-4849-bfa1-4cada15ec1a4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:53.262645 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a80ccdb0-4d80-4849-bfa1-4cada15ec1a4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f" status: 200 len: 1273 microversion: 2.1 time: 0.405026 Jul 25 12:58:53.274305 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1897/3700] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:52 2022] GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f => generated 1273 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:53.884397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-156425b3-3e9e-475c-be64-1d31671c31df tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:53.885708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-156425b3-3e9e-475c-be64-1d31671c31df tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:53.902182 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-156425b3-3e9e-475c-be64-1d31671c31df tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:53.903133 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-156425b3-3e9e-475c-be64-1d31671c31df tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:53.904182 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-156425b3-3e9e-475c-be64-1d31671c31df tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:53.906032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-156425b3-3e9e-475c-be64-1d31671c31df tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:54.213385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-168b62b5-de7e-4310-9d9c-493992fd9344 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:58:54.214450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-168b62b5-de7e-4310-9d9c-493992fd9344 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:58:54.215115 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-168b62b5-de7e-4310-9d9c-493992fd9344 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:58:54.215686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-168b62b5-de7e-4310-9d9c-493992fd9344 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:58:54.216282 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-168b62b5-de7e-4310-9d9c-493992fd9344 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:58:54.233418 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-168b62b5-de7e-4310-9d9c-493992fd9344 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:54.234482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-168b62b5-de7e-4310-9d9c-493992fd9344 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:54.237663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-168b62b5-de7e-4310-9d9c-493992fd9344 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:54.238415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-168b62b5-de7e-4310-9d9c-493992fd9344 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:54.288201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-168b62b5-de7e-4310-9d9c-493992fd9344 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Getting quotas for project d603ed2eec0344f1b95246394be424f1. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:58:54.308359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-168b62b5-de7e-4310-9d9c-493992fd9344 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Getting quotas for user 036ffb5ac9fb47ba9e1314560898530a and project d603ed2eec0344f1b95246394be424f1. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:58:54.341735 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-168b62b5-de7e-4310-9d9c-493992fd9344 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:58:54.348020 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-168b62b5-de7e-4310-9d9c-493992fd9344 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 10b1244b-a55e-40c5-a394-e1be83ed505b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:58:54.481124 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-168b62b5-de7e-4310-9d9c-493992fd9344 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.818321 Jul 25 12:58:54.485711 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1804/3701] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:58:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:58:54.522850 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-42cd1b84-08cf-44d9-beba-6f65302074cd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:54.527283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-42cd1b84-08cf-44d9-beba-6f65302074cd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:54.553613 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-42cd1b84-08cf-44d9-beba-6f65302074cd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:54.555092 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-42cd1b84-08cf-44d9-beba-6f65302074cd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:54.556747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-42cd1b84-08cf-44d9-beba-6f65302074cd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:54.560585 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-42cd1b84-08cf-44d9-beba-6f65302074cd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:54.664765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-156425b3-3e9e-475c-be64-1d31671c31df tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:54.684396 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-156425b3-3e9e-475c-be64-1d31671c31df tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:54.686524 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-156425b3-3e9e-475c-be64-1d31671c31df tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:54.688249 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-156425b3-3e9e-475c-be64-1d31671c31df tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 0.808079 Jul 25 12:58:54.689437 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1898/3702] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:53 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:58:54.701674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b04e96f5-28fc-427a-bf10-abdadbcdfdd2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:54.702746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b04e96f5-28fc-427a-bf10-abdadbcdfdd2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 10b1244b-a55e-40c5-a394-e1be83ed505b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:55.102172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b04e96f5-28fc-427a-bf10-abdadbcdfdd2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:55.142079 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b04e96f5-28fc-427a-bf10-abdadbcdfdd2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b" status: 200 len: 1216 microversion: 2.1 time: 0.450161 Jul 25 12:58:55.160523 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1899/3703] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:54 2022] GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b => generated 1216 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:55.713093 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a7817d02-727a-45f1-b391-475dccf2858c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:55.713618 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a7817d02-727a-45f1-b391-475dccf2858c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:55.748210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7817d02-727a-45f1-b391-475dccf2858c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:55.753513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7817d02-727a-45f1-b391-475dccf2858c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:55.757012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7817d02-727a-45f1-b391-475dccf2858c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:55.758457 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7817d02-727a-45f1-b391-475dccf2858c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:56.059806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-42cd1b84-08cf-44d9-beba-6f65302074cd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:56.080149 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-42cd1b84-08cf-44d9-beba-6f65302074cd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f" status: 200 len: 1315 microversion: 2.1 time: 1.591841 Jul 25 12:58:56.086668 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1805/3704] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:54 2022] GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f => generated 1315 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:56.182387 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bc53153d-a5b2-48c5-9770-daf42071f2a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:56.184517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bc53153d-a5b2-48c5-9770-daf42071f2a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 10b1244b-a55e-40c5-a394-e1be83ed505b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:56.189716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:56.210020 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc53153d-a5b2-48c5-9770-daf42071f2a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:56.210987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc53153d-a5b2-48c5-9770-daf42071f2a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:56.212107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc53153d-a5b2-48c5-9770-daf42071f2a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:56.212775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc53153d-a5b2-48c5-9770-daf42071f2a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:56.579336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bc53153d-a5b2-48c5-9770-daf42071f2a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:56.592368 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bc53153d-a5b2-48c5-9770-daf42071f2a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b" status: 200 len: 1268 microversion: 2.1 time: 0.417705 Jul 25 12:58:56.593256 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1806/3705] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:56 2022] GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b => generated 1268 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:58:57.112719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ae5f3283-7fe1-4f96-bd19-b146d0309ffc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:57.113793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ae5f3283-7fe1-4f96-bd19-b146d0309ffc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:57.142147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ae5f3283-7fe1-4f96-bd19-b146d0309ffc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:57.148210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ae5f3283-7fe1-4f96-bd19-b146d0309ffc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:57.153547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ae5f3283-7fe1-4f96-bd19-b146d0309ffc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:57.156917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ae5f3283-7fe1-4f96-bd19-b146d0309ffc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:57.179332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a7817d02-727a-45f1-b391-475dccf2858c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:57.207551 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a7817d02-727a-45f1-b391-475dccf2858c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:57.222369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a7817d02-727a-45f1-b391-475dccf2858c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:57.223702 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a7817d02-727a-45f1-b391-475dccf2858c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 1.514863 Jul 25 12:58:57.245087 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1900/3706] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:55 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:58:57.623003 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7dd15859-f59f-4c9b-97d3-594e70687a34 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:57.624652 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7dd15859-f59f-4c9b-97d3-594e70687a34 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 10b1244b-a55e-40c5-a394-e1be83ed505b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:57.645723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7dd15859-f59f-4c9b-97d3-594e70687a34 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:57.648062 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7dd15859-f59f-4c9b-97d3-594e70687a34 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:57.648929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7dd15859-f59f-4c9b-97d3-594e70687a34 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:57.652797 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7dd15859-f59f-4c9b-97d3-594e70687a34 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:57.855884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ae5f3283-7fe1-4f96-bd19-b146d0309ffc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:57.872945 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ae5f3283-7fe1-4f96-bd19-b146d0309ffc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f" status: 200 len: 1315 microversion: 2.1 time: 0.765911 Jul 25 12:58:57.873889 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1807/3707] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:57 2022] GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f => generated 1315 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:58:58.283916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ba8622e6-ed0b-44b2-8210-389182261f69 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:58.284614 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ba8622e6-ed0b-44b2-8210-389182261f69 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:58.310981 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba8622e6-ed0b-44b2-8210-389182261f69 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:58.316613 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba8622e6-ed0b-44b2-8210-389182261f69 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:58.318704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba8622e6-ed0b-44b2-8210-389182261f69 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:58.327414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba8622e6-ed0b-44b2-8210-389182261f69 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:58.388268 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7dd15859-f59f-4c9b-97d3-594e70687a34 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:58.410101 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7dd15859-f59f-4c9b-97d3-594e70687a34 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b" status: 200 len: 1274 microversion: 2.1 time: 0.781837 Jul 25 12:58:58.418261 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1901/3708] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:57 2022] GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b => generated 1274 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:58:58.899402 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-60358552-5610-4106-8c18-39d0da3263a5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:58.900270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-60358552-5610-4106-8c18-39d0da3263a5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:58.928301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-60358552-5610-4106-8c18-39d0da3263a5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:58.929065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-60358552-5610-4106-8c18-39d0da3263a5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:58.930260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-60358552-5610-4106-8c18-39d0da3263a5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:58.930860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-60358552-5610-4106-8c18-39d0da3263a5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:00.450334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:00.536210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-60358552-5610-4106-8c18-39d0da3263a5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:00.551807 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-60358552-5610-4106-8c18-39d0da3263a5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f" status: 200 len: 1315 microversion: 2.1 time: 1.656355 Jul 25 12:59:00.555097 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1902/3709] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:58 2022] GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f => generated 1315 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:59:00.571681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6108a4be-92c0-4216-9684-f97d8ba593f1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:00.576772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6108a4be-92c0-4216-9684-f97d8ba593f1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 10b1244b-a55e-40c5-a394-e1be83ed505b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:00.605329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6108a4be-92c0-4216-9684-f97d8ba593f1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:00.607274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6108a4be-92c0-4216-9684-f97d8ba593f1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:00.608312 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6108a4be-92c0-4216-9684-f97d8ba593f1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:00.613463 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6108a4be-92c0-4216-9684-f97d8ba593f1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:01.397034 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ba8622e6-ed0b-44b2-8210-389182261f69 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:01.400028 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:01.412228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ba8622e6-ed0b-44b2-8210-389182261f69 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:01.420725 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ba8622e6-ed0b-44b2-8210-389182261f69 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:01.424706 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ba8622e6-ed0b-44b2-8210-389182261f69 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 3.146187 Jul 25 12:59:01.429883 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1808/3710] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:58:58 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 3151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:59:01.457745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-ccd437f9-c565-48f9-b656-013d4a9e96ed req-677139dc-dd21-4bbd-85d3-9ff3acafe4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10b1244b-a55e-40c5-a394-e1be83ed505b", "tag": "fd50d531-89e7-4530-9940-6e3b3a6da812"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:01.495928 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ccd437f9-c565-48f9-b656-013d4a9e96ed req-677139dc-dd21-4bbd-85d3-9ff3acafe4d2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:01.496849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ccd437f9-c565-48f9-b656-013d4a9e96ed req-677139dc-dd21-4bbd-85d3-9ff3acafe4d2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:01.528010 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-ccd437f9-c565-48f9-b656-013d4a9e96ed req-677139dc-dd21-4bbd-85d3-9ff3acafe4d2 service nova] Creating event network-changed:fd50d531-89e7-4530-9940-6e3b3a6da812 for instance 10b1244b-a55e-40c5-a394-e1be83ed505b on n-h2-848886-15 Jul 25 12:59:01.546774 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-ccd437f9-c565-48f9-b656-013d4a9e96ed req-677139dc-dd21-4bbd-85d3-9ff3acafe4d2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105360 Jul 25 12:59:01.549433 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1809/3711] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:59:01.580086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-412b55e0-2319-472b-b46f-827b4122036b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:01.581266 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-412b55e0-2319-472b-b46f-827b4122036b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:01.606533 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-412b55e0-2319-472b-b46f-827b4122036b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:01.607004 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-412b55e0-2319-472b-b46f-827b4122036b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:01.619340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-412b55e0-2319-472b-b46f-827b4122036b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:01.619808 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-412b55e0-2319-472b-b46f-827b4122036b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:02.272943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6108a4be-92c0-4216-9684-f97d8ba593f1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:02.281592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:02.290393 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6108a4be-92c0-4216-9684-f97d8ba593f1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b" status: 200 len: 1316 microversion: 2.1 time: 1.729481 Jul 25 12:59:02.295337 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1903/3712] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:00 2022] GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b => generated 1316 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:02.456708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3de9985c-c8ab-42bb-adfc-a1af88494414 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:02.460495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3de9985c-c8ab-42bb-adfc-a1af88494414 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:02.485119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3de9985c-c8ab-42bb-adfc-a1af88494414 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:02.486373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3de9985c-c8ab-42bb-adfc-a1af88494414 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:02.490961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3de9985c-c8ab-42bb-adfc-a1af88494414 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:02.493110 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3de9985c-c8ab-42bb-adfc-a1af88494414 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:02.530662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-412b55e0-2319-472b-b46f-827b4122036b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:02.539016 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-412b55e0-2319-472b-b46f-827b4122036b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f" status: 200 len: 1315 microversion: 2.1 time: 0.963673 Jul 25 12:59:02.559367 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1810/3713] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:01 2022] GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f => generated 1315 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:59:03.195971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3de9985c-c8ab-42bb-adfc-a1af88494414 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:03.212006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3de9985c-c8ab-42bb-adfc-a1af88494414 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:03.219110 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3de9985c-c8ab-42bb-adfc-a1af88494414 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:03.222760 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3de9985c-c8ab-42bb-adfc-a1af88494414 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 0.770077 Jul 25 12:59:03.223848 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1904/3714] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:02 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:03.313377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7e383e00-8285-4b2c-a1ef-488f3630ce1f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:03.314452 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7e383e00-8285-4b2c-a1ef-488f3630ce1f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 10b1244b-a55e-40c5-a394-e1be83ed505b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:03.330271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e383e00-8285-4b2c-a1ef-488f3630ce1f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:03.331861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e383e00-8285-4b2c-a1ef-488f3630ce1f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:03.334052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e383e00-8285-4b2c-a1ef-488f3630ce1f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:03.335799 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e383e00-8285-4b2c-a1ef-488f3630ce1f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:03.570799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8e3a78d0-ae06-46f0-84f5-f7027de8ca62 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:03.571965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8e3a78d0-ae06-46f0-84f5-f7027de8ca62 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:03.608554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e3a78d0-ae06-46f0-84f5-f7027de8ca62 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:03.609931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e3a78d0-ae06-46f0-84f5-f7027de8ca62 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:03.612931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e3a78d0-ae06-46f0-84f5-f7027de8ca62 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:03.618582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e3a78d0-ae06-46f0-84f5-f7027de8ca62 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:04.023205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7e383e00-8285-4b2c-a1ef-488f3630ce1f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:04.033196 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7e383e00-8285-4b2c-a1ef-488f3630ce1f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b" status: 200 len: 1316 microversion: 2.1 time: 0.724552 Jul 25 12:59:04.049465 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1811/3715] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:03 2022] GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b => generated 1316 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:04.057216 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-7f202bf3-5c52-444a-b240-fd1324f838dc req-10de6c8e-4c63-4068-b63c-4e521acc75c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5335837-15f6-4365-b5e0-baa45e59dc5f", "tag": "933af734-9f5f-4958-934d-c40605fd0b13"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:04.086749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-7f202bf3-5c52-444a-b240-fd1324f838dc req-10de6c8e-4c63-4068-b63c-4e521acc75c7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:04.088834 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-7f202bf3-5c52-444a-b240-fd1324f838dc req-10de6c8e-4c63-4068-b63c-4e521acc75c7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:04.117592 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-7f202bf3-5c52-444a-b240-fd1324f838dc req-10de6c8e-4c63-4068-b63c-4e521acc75c7 service nova] Creating event network-changed:933af734-9f5f-4958-934d-c40605fd0b13 for instance f5335837-15f6-4365-b5e0-baa45e59dc5f on n-h2-848886-15 Jul 25 12:59:04.124767 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-7f202bf3-5c52-444a-b240-fd1324f838dc req-10de6c8e-4c63-4068-b63c-4e521acc75c7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072328 Jul 25 12:59:04.126807 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1812/3716] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:59:04.147071 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-ea30764e-d574-428c-b117-70e3029cae4b req-cf92b276-6201-461a-98c7-864f4f80cc9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "name": "network-vif-plugged", "status": "completed", "tag": "688cd2c2-4671-443a-89b1-550dc60cd0ee"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:04.179636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ea30764e-d574-428c-b117-70e3029cae4b req-cf92b276-6201-461a-98c7-864f4f80cc9e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:04.181861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ea30764e-d574-428c-b117-70e3029cae4b req-cf92b276-6201-461a-98c7-864f4f80cc9e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:04.215641 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-ea30764e-d574-428c-b117-70e3029cae4b req-cf92b276-6201-461a-98c7-864f4f80cc9e service nova] Creating event network-vif-plugged:688cd2c2-4671-443a-89b1-550dc60cd0ee for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 12:59:04.233774 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-ea30764e-d574-428c-b117-70e3029cae4b req-cf92b276-6201-461a-98c7-864f4f80cc9e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102091 Jul 25 12:59:04.235093 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1813/3717] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:59:04.247398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8f754080-b57b-480d-a064-6ceacc25d2be tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:04.253135 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8f754080-b57b-480d-a064-6ceacc25d2be tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:04.264326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:04.271873 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f754080-b57b-480d-a064-6ceacc25d2be tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:04.274348 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f754080-b57b-480d-a064-6ceacc25d2be tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:04.277764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f754080-b57b-480d-a064-6ceacc25d2be tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:04.278523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f754080-b57b-480d-a064-6ceacc25d2be tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:04.349733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:04.486681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8e3a78d0-ae06-46f0-84f5-f7027de8ca62 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:04.498041 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8e3a78d0-ae06-46f0-84f5-f7027de8ca62 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f" status: 200 len: 1315 microversion: 2.1 time: 0.933212 Jul 25 12:59:04.513912 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1905/3718] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:03 2022] GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f => generated 1315 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:04.811362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8f754080-b57b-480d-a064-6ceacc25d2be tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:04.821157 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8f754080-b57b-480d-a064-6ceacc25d2be tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:04.836597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8f754080-b57b-480d-a064-6ceacc25d2be tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:04.840457 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8f754080-b57b-480d-a064-6ceacc25d2be tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 0.597502 Jul 25 12:59:04.843406 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1814/3719] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:04 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:05.062989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bc1e2fb7-4e6f-4f43-91cc-5614ca0168ef tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:05.064291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bc1e2fb7-4e6f-4f43-91cc-5614ca0168ef tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 10b1244b-a55e-40c5-a394-e1be83ed505b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:05.079506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc1e2fb7-4e6f-4f43-91cc-5614ca0168ef tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:05.080665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc1e2fb7-4e6f-4f43-91cc-5614ca0168ef tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:05.081700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc1e2fb7-4e6f-4f43-91cc-5614ca0168ef tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:05.085416 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc1e2fb7-4e6f-4f43-91cc-5614ca0168ef tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:05.174314 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=10 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:05.519769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9c864c3d-fbaa-40da-9880-19f3c6a6c05f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:05.520997 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9c864c3d-fbaa-40da-9880-19f3c6a6c05f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:05.542588 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c864c3d-fbaa-40da-9880-19f3c6a6c05f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:05.543234 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c864c3d-fbaa-40da-9880-19f3c6a6c05f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:05.550986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c864c3d-fbaa-40da-9880-19f3c6a6c05f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:05.551805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c864c3d-fbaa-40da-9880-19f3c6a6c05f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:05.773018 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bc1e2fb7-4e6f-4f43-91cc-5614ca0168ef tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:05.783869 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bc1e2fb7-4e6f-4f43-91cc-5614ca0168ef tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b" status: 200 len: 1316 microversion: 2.1 time: 0.726529 Jul 25 12:59:05.785737 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1906/3720] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:05 2022] GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b => generated 1316 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:05.868835 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c72353eb-fc54-470b-a9b0-bca6ee78cef2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:05.870218 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c72353eb-fc54-470b-a9b0-bca6ee78cef2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:05.887705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c72353eb-fc54-470b-a9b0-bca6ee78cef2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:05.890720 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c72353eb-fc54-470b-a9b0-bca6ee78cef2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:05.893404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c72353eb-fc54-470b-a9b0-bca6ee78cef2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:05.897561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c72353eb-fc54-470b-a9b0-bca6ee78cef2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:05.927569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9c864c3d-fbaa-40da-9880-19f3c6a6c05f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:05.940896 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9c864c3d-fbaa-40da-9880-19f3c6a6c05f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f" status: 200 len: 1315 microversion: 2.1 time: 0.424811 Jul 25 12:59:05.944634 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1815/3721] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:05 2022] GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:06.294427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-f1170e2f-0bb5-45ce-9b9c-1e25accfc470 req-d6695435-1747-4da6-8545-244cb6a0d0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "name": "network-vif-plugged", "status": "completed", "tag": "26bcc0bb-2e9b-4db5-8b7d-981c3d3a8e62"}, {"server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "name": "network-vif-plugged", "status": "completed", "tag": "b2ed9ff7-f05b-47ef-83cb-258951d51489"}, {"server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "name": "network-vif-plugged", "status": "completed", "tag": "656db462-23e9-4625-a2e7-588155cc7f69"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:06.311752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-f1170e2f-0bb5-45ce-9b9c-1e25accfc470 req-d6695435-1747-4da6-8545-244cb6a0d0d3 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:06.312404 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-f1170e2f-0bb5-45ce-9b9c-1e25accfc470 req-d6695435-1747-4da6-8545-244cb6a0d0d3 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:06.338355 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-f1170e2f-0bb5-45ce-9b9c-1e25accfc470 req-d6695435-1747-4da6-8545-244cb6a0d0d3 service nova] Creating event network-vif-plugged:26bcc0bb-2e9b-4db5-8b7d-981c3d3a8e62 for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 12:59:06.347744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c72353eb-fc54-470b-a9b0-bca6ee78cef2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:06.349955 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-f1170e2f-0bb5-45ce-9b9c-1e25accfc470 req-d6695435-1747-4da6-8545-244cb6a0d0d3 service nova] Creating event network-vif-plugged:b2ed9ff7-f05b-47ef-83cb-258951d51489 for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 12:59:06.350968 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-f1170e2f-0bb5-45ce-9b9c-1e25accfc470 req-d6695435-1747-4da6-8545-244cb6a0d0d3 service nova] Creating event network-vif-plugged:656db462-23e9-4625-a2e7-588155cc7f69 for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 12:59:06.364076 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-f1170e2f-0bb5-45ce-9b9c-1e25accfc470 req-d6695435-1747-4da6-8545-244cb6a0d0d3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.072787 Jul 25 12:59:06.370272 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1816/3722] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:59:06.372894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c72353eb-fc54-470b-a9b0-bca6ee78cef2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:06.377667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c72353eb-fc54-470b-a9b0-bca6ee78cef2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:06.383154 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c72353eb-fc54-470b-a9b0-bca6ee78cef2 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 0.519838 Jul 25 12:59:06.385636 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1907/3723] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:05 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:06.821571 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9755d062-bfb7-4103-a81d-12c0847a9d63 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:06.822983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9755d062-bfb7-4103-a81d-12c0847a9d63 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 10b1244b-a55e-40c5-a394-e1be83ed505b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:06.846305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9755d062-bfb7-4103-a81d-12c0847a9d63 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:06.848313 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9755d062-bfb7-4103-a81d-12c0847a9d63 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:06.851156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9755d062-bfb7-4103-a81d-12c0847a9d63 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:06.851603 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9755d062-bfb7-4103-a81d-12c0847a9d63 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:06.970181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e873e585-1179-4768-948b-3cd6f0db13ae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:06.970796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e873e585-1179-4768-948b-3cd6f0db13ae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:06.982518 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e873e585-1179-4768-948b-3cd6f0db13ae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:06.983916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e873e585-1179-4768-948b-3cd6f0db13ae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:06.985950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e873e585-1179-4768-948b-3cd6f0db13ae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:06.987346 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e873e585-1179-4768-948b-3cd6f0db13ae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:07.585749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9755d062-bfb7-4103-a81d-12c0847a9d63 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:07.601630 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9755d062-bfb7-4103-a81d-12c0847a9d63 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b" status: 200 len: 1316 microversion: 2.1 time: 0.795340 Jul 25 12:59:07.606251 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1817/3724] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:06 2022] GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b => generated 1316 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:07.643819 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e873e585-1179-4768-948b-3cd6f0db13ae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:07.657878 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e873e585-1179-4768-948b-3cd6f0db13ae tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f" status: 200 len: 1315 microversion: 2.1 time: 0.690458 Jul 25 12:59:07.660769 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1908/3725] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:06 2022] GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f => generated 1315 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:59:07.673368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b2c63e30-7fdf-4b0c-b58b-2c4879a14bdd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:07.673775 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b2c63e30-7fdf-4b0c-b58b-2c4879a14bdd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:07.692354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b2c63e30-7fdf-4b0c-b58b-2c4879a14bdd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:07.692829 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b2c63e30-7fdf-4b0c-b58b-2c4879a14bdd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:07.695435 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b2c63e30-7fdf-4b0c-b58b-2c4879a14bdd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:07.695959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b2c63e30-7fdf-4b0c-b58b-2c4879a14bdd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:08.047714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5e21de99-0ae9-4188-9adf-d33fe52f3c6e tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1825297749", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": "none"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:08.152691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5e21de99-0ae9-4188-9adf-d33fe52f3c6e tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:59:08.153126 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5e21de99-0ae9-4188-9adf-d33fe52f3c6e tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:59:08.154240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5e21de99-0ae9-4188-9adf-d33fe52f3c6e tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:59:08.154659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5e21de99-0ae9-4188-9adf-d33fe52f3c6e tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:59:08.155647 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5e21de99-0ae9-4188-9adf-d33fe52f3c6e tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:59:08.182950 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5e21de99-0ae9-4188-9adf-d33fe52f3c6e tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:08.184053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5e21de99-0ae9-4188-9adf-d33fe52f3c6e tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:08.185687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5e21de99-0ae9-4188-9adf-d33fe52f3c6e tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:08.186713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5e21de99-0ae9-4188-9adf-d33fe52f3c6e tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:08.217408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-5e21de99-0ae9-4188-9adf-d33fe52f3c6e tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Getting quotas for project e5258c16b1ee4e8ba8961f883fe2f97e. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:59:08.227539 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-5e21de99-0ae9-4188-9adf-d33fe52f3c6e tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Getting quotas for user e79e677f04c04416b3147f70089c571c and project e5258c16b1ee4e8ba8961f883fe2f97e. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:59:08.248705 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5e21de99-0ae9-4188-9adf-d33fe52f3c6e tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:59:08.253649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5e21de99-0ae9-4188-9adf-d33fe52f3c6e tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:59:08.364295 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5e21de99-0ae9-4188-9adf-d33fe52f3c6e tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.753917 Jul 25 12:59:08.367008 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1818/3726] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Jul 25 12:59:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 12:59:08.554254 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b2c63e30-7fdf-4b0c-b58b-2c4879a14bdd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:08.588551 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b2c63e30-7fdf-4b0c-b58b-2c4879a14bdd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:08.597521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b2c63e30-7fdf-4b0c-b58b-2c4879a14bdd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:08.598829 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b2c63e30-7fdf-4b0c-b58b-2c4879a14bdd tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 0.937031 Jul 25 12:59:08.632607 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1909/3727] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:07 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:08.643690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-412b99ad-8d4c-45d2-a855-fe1e3ba34272 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:08.644616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-412b99ad-8d4c-45d2-a855-fe1e3ba34272 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:08.686138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-01635cca-ef32-4aa8-b700-6f23f4bed42b tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Action: 'create', calling method: .version_select at 0x7efcf8c2fdc0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-496810183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/t2HiLjD1AR0any/cUQ+RuaqYRp4E9kfKUdLvy/MPsKIOMUwKzNV7N6fc0KE6WaqzKrF3MnPx+EGwlyrzeWwtClzmepXphg39Ozfmb3+Jr2pJ2gxa8eIaHLkMma6udRA=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:08.725625 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-412b99ad-8d4c-45d2-a855-fe1e3ba34272 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:08.734722 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-01635cca-ef32-4aa8-b700-6f23f4bed42b tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Getting quotas for project bb007c5b5f894bc0a31b2c166b53adac. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:59:08.743191 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-412b99ad-8d4c-45d2-a855-fe1e3ba34272 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:08.746311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-412b99ad-8d4c-45d2-a855-fe1e3ba34272 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:08.749050 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-412b99ad-8d4c-45d2-a855-fe1e3ba34272 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1278 microversion: 2.57 time: 0.114564 Jul 25 12:59:08.749864 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1910/3728] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:08 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1278 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:08.762141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-01635cca-ef32-4aa8-b700-6f23f4bed42b tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Getting quotas for user ad62262b424640728ef148dfaae6e074 and project bb007c5b5f894bc0a31b2c166b53adac. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:59:08.773444 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-26dbef2d-4870-43d7-970b-2320d2245912 req-5812ad01-083c-49f7-8d6e-0e66f8b41ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "name": "network-vif-plugged", "status": "completed", "tag": "619e5821-f34d-4084-bf18-5b7e99804fef"}, {"server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "name": "network-vif-plugged", "status": "completed", "tag": "f6d2cc3f-fab3-4780-857c-9ee48589fd5f"}, {"server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "name": "network-vif-plugged", "status": "completed", "tag": "cf0e5a93-6e29-451d-9c37-4cea02b17b40"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:08.789242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-26dbef2d-4870-43d7-970b-2320d2245912 req-5812ad01-083c-49f7-8d6e-0e66f8b41ca1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:08.790048 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-26dbef2d-4870-43d7-970b-2320d2245912 req-5812ad01-083c-49f7-8d6e-0e66f8b41ca1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:08.797740 n-d-848886-15 devstack@n-api.service[125883]: ERROR oslo.messaging._drivers.impl_rabbit [None req-01635cca-ef32-4aa8-b700-6f23f4bed42b tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [89d26934-5c76-41fd-a21c-3bc08c3f5e0b] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 12:59:08.818071 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-26dbef2d-4870-43d7-970b-2320d2245912 req-5812ad01-083c-49f7-8d6e-0e66f8b41ca1 service nova] Creating event network-vif-plugged:619e5821-f34d-4084-bf18-5b7e99804fef for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 12:59:08.820968 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-26dbef2d-4870-43d7-970b-2320d2245912 req-5812ad01-083c-49f7-8d6e-0e66f8b41ca1 service nova] Creating event network-vif-plugged:f6d2cc3f-fab3-4780-857c-9ee48589fd5f for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 12:59:08.830730 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-26dbef2d-4870-43d7-970b-2320d2245912 req-5812ad01-083c-49f7-8d6e-0e66f8b41ca1 service nova] Creating event network-vif-plugged:cf0e5a93-6e29-451d-9c37-4cea02b17b40 for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 12:59:08.847820 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-26dbef2d-4870-43d7-970b-2320d2245912 req-5812ad01-083c-49f7-8d6e-0e66f8b41ca1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.083844 Jul 25 12:59:08.848834 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1911/3729] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:59:08.858760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f7b07ac8-ee7a-4aa0-89e5-1266e1b0e154 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:08.870446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f7b07ac8-ee7a-4aa0-89e5-1266e1b0e154 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 10b1244b-a55e-40c5-a394-e1be83ed505b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:08.891232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7b07ac8-ee7a-4aa0-89e5-1266e1b0e154 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:08.891950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7b07ac8-ee7a-4aa0-89e5-1266e1b0e154 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:08.892979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7b07ac8-ee7a-4aa0-89e5-1266e1b0e154 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:08.893581 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7b07ac8-ee7a-4aa0-89e5-1266e1b0e154 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:09.365253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f7b07ac8-ee7a-4aa0-89e5-1266e1b0e154 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:09.374140 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f7b07ac8-ee7a-4aa0-89e5-1266e1b0e154 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b" status: 200 len: 1316 microversion: 2.1 time: 0.524097 Jul 25 12:59:09.376945 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1912/3730] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:08 2022] GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b => generated 1316 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:09.393954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2eba5631-86e0-4364-98b2-3cbf7153c17c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:09.395013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2eba5631-86e0-4364-98b2-3cbf7153c17c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:09.406362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2eba5631-86e0-4364-98b2-3cbf7153c17c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:09.410601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2eba5631-86e0-4364-98b2-3cbf7153c17c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:09.411949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2eba5631-86e0-4364-98b2-3cbf7153c17c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:09.412588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2eba5631-86e0-4364-98b2-3cbf7153c17c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:09.691818 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2eba5631-86e0-4364-98b2-3cbf7153c17c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:09.708582 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2eba5631-86e0-4364-98b2-3cbf7153c17c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f" status: 200 len: 1315 microversion: 2.1 time: 0.327363 Jul 25 12:59:09.709731 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1913/3731] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:09 2022] GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:09.727983 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3f98f36b-a05f-41a3-9854-1dab7c41882a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:09.728599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3f98f36b-a05f-41a3-9854-1dab7c41882a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:09.735341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f98f36b-a05f-41a3-9854-1dab7c41882a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:09.736164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f98f36b-a05f-41a3-9854-1dab7c41882a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:09.737115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f98f36b-a05f-41a3-9854-1dab7c41882a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:09.737709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f98f36b-a05f-41a3-9854-1dab7c41882a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:09.824089 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [None req-01635cca-ef32-4aa8-b700-6f23f4bed42b tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [89d26934-5c76-41fd-a21c-3bc08c3f5e0b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 38612. Jul 25 12:59:09.874149 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-01635cca-ef32-4aa8-b700-6f23f4bed42b tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 1.505473 Jul 25 12:59:09.878226 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1819/3732] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:59:08 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:59:09.884109 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4981fb04-891f-44fd-9dc1-6190587b960b tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:09.885693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4981fb04-891f-44fd-9dc1-6190587b960b tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:09.900777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4981fb04-891f-44fd-9dc1-6190587b960b tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:09.901255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4981fb04-891f-44fd-9dc1-6190587b960b tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:09.902329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4981fb04-891f-44fd-9dc1-6190587b960b tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:09.902961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4981fb04-891f-44fd-9dc1-6190587b960b tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:10.009747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4981fb04-891f-44fd-9dc1-6190587b960b tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:10.029180 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4981fb04-891f-44fd-9dc1-6190587b960b tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:10.031138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4981fb04-891f-44fd-9dc1-6190587b960b tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:10.034478 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4981fb04-891f-44fd-9dc1-6190587b960b tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1274 microversion: 2.57 time: 0.158015 Jul 25 12:59:10.035714 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1820/3733] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:09 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1274 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:10.402420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ff096773-7777-45b7-b79e-b9a485cb9349 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:10.403361 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ff096773-7777-45b7-b79e-b9a485cb9349 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 10b1244b-a55e-40c5-a394-e1be83ed505b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:10.412406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff096773-7777-45b7-b79e-b9a485cb9349 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:10.413124 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff096773-7777-45b7-b79e-b9a485cb9349 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:10.414148 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff096773-7777-45b7-b79e-b9a485cb9349 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:10.415466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff096773-7777-45b7-b79e-b9a485cb9349 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:10.665882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3f98f36b-a05f-41a3-9854-1dab7c41882a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:10.694241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3f98f36b-a05f-41a3-9854-1dab7c41882a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:10.700912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3f98f36b-a05f-41a3-9854-1dab7c41882a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:10.705703 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3f98f36b-a05f-41a3-9854-1dab7c41882a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1875 microversion: 2.42 time: 0.993849 Jul 25 12:59:10.706368 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1914/3734] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:09 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1875 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:10.730534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-df67fa6e-634a-4865-aafb-ef275f349762 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:10.731165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-df67fa6e-634a-4865-aafb-ef275f349762 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:10.745917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-df67fa6e-634a-4865-aafb-ef275f349762 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:10.749754 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-df67fa6e-634a-4865-aafb-ef275f349762 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:10.751306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-df67fa6e-634a-4865-aafb-ef275f349762 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:10.751919 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-df67fa6e-634a-4865-aafb-ef275f349762 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:10.915053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ff096773-7777-45b7-b79e-b9a485cb9349 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:10.931475 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ff096773-7777-45b7-b79e-b9a485cb9349 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b" status: 200 len: 1316 microversion: 2.1 time: 0.533439 Jul 25 12:59:10.951031 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1821/3735] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:10 2022] GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b => generated 1316 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:10.968321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-cc756550-e8d7-4f5d-88b6-f0a04b419a36 req-1304f90f-3d63-45a1-9077-32d3600c63f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10b1244b-a55e-40c5-a394-e1be83ed505b", "name": "network-vif-plugged", "status": "completed", "tag": "fd50d531-89e7-4530-9940-6e3b3a6da812"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:11.012627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-cc756550-e8d7-4f5d-88b6-f0a04b419a36 req-1304f90f-3d63-45a1-9077-32d3600c63f9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:11.013256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-cc756550-e8d7-4f5d-88b6-f0a04b419a36 req-1304f90f-3d63-45a1-9077-32d3600c63f9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:11.054232 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-cc756550-e8d7-4f5d-88b6-f0a04b419a36 req-1304f90f-3d63-45a1-9077-32d3600c63f9 service nova] Creating event network-vif-plugged:fd50d531-89e7-4530-9940-6e3b3a6da812 for instance 10b1244b-a55e-40c5-a394-e1be83ed505b on n-h2-848886-15 Jul 25 12:59:11.072790 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-cc756550-e8d7-4f5d-88b6-f0a04b419a36 req-1304f90f-3d63-45a1-9077-32d3600c63f9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119674 Jul 25 12:59:11.073480 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1822/3736] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:59:11.079436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-110963f9-06ce-4e7d-90c0-0a9a458da3c6 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:11.081926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-110963f9-06ce-4e7d-90c0-0a9a458da3c6 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:11.097327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-110963f9-06ce-4e7d-90c0-0a9a458da3c6 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:11.098545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-110963f9-06ce-4e7d-90c0-0a9a458da3c6 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:11.104961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-110963f9-06ce-4e7d-90c0-0a9a458da3c6 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:11.105737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-110963f9-06ce-4e7d-90c0-0a9a458da3c6 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:11.332670 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-df67fa6e-634a-4865-aafb-ef275f349762 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:11.352694 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-df67fa6e-634a-4865-aafb-ef275f349762 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f" status: 200 len: 1315 microversion: 2.1 time: 0.626795 Jul 25 12:59:11.356715 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1915/3737] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:10 2022] GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:59:11.395302 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-110963f9-06ce-4e7d-90c0-0a9a458da3c6 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:11.410386 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-110963f9-06ce-4e7d-90c0-0a9a458da3c6 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:11.418716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-110963f9-06ce-4e7d-90c0-0a9a458da3c6 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:11.420918 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-110963f9-06ce-4e7d-90c0-0a9a458da3c6 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1338 microversion: 2.57 time: 0.345602 Jul 25 12:59:11.422207 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1823/3738] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:11 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1338 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:11.729781 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c45d9b86-7a27-4090-a756-e54486948039 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:11.730955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c45d9b86-7a27-4090-a756-e54486948039 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:11.749664 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c45d9b86-7a27-4090-a756-e54486948039 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:11.750160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c45d9b86-7a27-4090-a756-e54486948039 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:11.751328 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c45d9b86-7a27-4090-a756-e54486948039 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:11.751778 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c45d9b86-7a27-4090-a756-e54486948039 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:11.957435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fde40bcd-dc88-4b15-966a-24f60afa6a31 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:11.959031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fde40bcd-dc88-4b15-966a-24f60afa6a31 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 10b1244b-a55e-40c5-a394-e1be83ed505b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:11.989353 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fde40bcd-dc88-4b15-966a-24f60afa6a31 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:11.990867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fde40bcd-dc88-4b15-966a-24f60afa6a31 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:11.992688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fde40bcd-dc88-4b15-966a-24f60afa6a31 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:11.994701 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fde40bcd-dc88-4b15-966a-24f60afa6a31 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:12.468036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fde40bcd-dc88-4b15-966a-24f60afa6a31 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:12.491173 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fde40bcd-dc88-4b15-966a-24f60afa6a31 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b" status: 200 len: 1316 microversion: 2.1 time: 0.538239 Jul 25 12:59:12.492051 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1824/3739] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:11 2022] GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b => generated 1316 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:12.512903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c240a014-641d-4884-8632-8e56db83f3eb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:12.514355 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c240a014-641d-4884-8632-8e56db83f3eb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:12.535712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c45d9b86-7a27-4090-a756-e54486948039 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:12.540221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c240a014-641d-4884-8632-8e56db83f3eb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:12.541456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c240a014-641d-4884-8632-8e56db83f3eb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:12.542801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c240a014-641d-4884-8632-8e56db83f3eb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:12.543453 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c240a014-641d-4884-8632-8e56db83f3eb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:12.550220 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c45d9b86-7a27-4090-a756-e54486948039 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:12.553725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c45d9b86-7a27-4090-a756-e54486948039 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:12.557931 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c45d9b86-7a27-4090-a756-e54486948039 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 2828 microversion: 2.42 time: 0.832952 Jul 25 12:59:12.566923 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1916/3740] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:11 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 2828 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:12.572568 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f363eb78-2a7c-4fa7-89db-7a8904ad33f1 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:12.573483 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f363eb78-2a7c-4fa7-89db-7a8904ad33f1 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:12.586084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f363eb78-2a7c-4fa7-89db-7a8904ad33f1 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:12.590142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f363eb78-2a7c-4fa7-89db-7a8904ad33f1 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:12.591619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f363eb78-2a7c-4fa7-89db-7a8904ad33f1 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:12.592660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f363eb78-2a7c-4fa7-89db-7a8904ad33f1 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:12.780608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f363eb78-2a7c-4fa7-89db-7a8904ad33f1 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:12.790077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f363eb78-2a7c-4fa7-89db-7a8904ad33f1 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:12.807292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f363eb78-2a7c-4fa7-89db-7a8904ad33f1 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:12.809338 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f363eb78-2a7c-4fa7-89db-7a8904ad33f1 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1336 microversion: 2.57 time: 0.240877 Jul 25 12:59:12.814197 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1917/3741] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:12 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1336 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:12.820215 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a3b9d403-9a40-4103-ad34-64a4a1a7444e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:12.825939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a3b9d403-9a40-4103-ad34-64a4a1a7444e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:12.833736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3b9d403-9a40-4103-ad34-64a4a1a7444e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:12.834506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3b9d403-9a40-4103-ad34-64a4a1a7444e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:12.835577 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3b9d403-9a40-4103-ad34-64a4a1a7444e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:12.836227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3b9d403-9a40-4103-ad34-64a4a1a7444e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:13.054130 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a3b9d403-9a40-4103-ad34-64a4a1a7444e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.238197 Jul 25 12:59:13.054749 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1918/3742] 10.222.0.49 () {60 vars in 1316 bytes} [Mon Jul 25 12:59:12 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4/os-interface => generated 1829 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:13.088628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-5965f2d9-ec67-4033-ab55-af5043628c34 req-3606cf61-2412-4116-90df-580d4a65c8ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5335837-15f6-4365-b5e0-baa45e59dc5f", "name": "network-vif-plugged", "status": "completed", "tag": "933af734-9f5f-4958-934d-c40605fd0b13"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:13.106452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5965f2d9-ec67-4033-ab55-af5043628c34 req-3606cf61-2412-4116-90df-580d4a65c8ca service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:13.112580 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5965f2d9-ec67-4033-ab55-af5043628c34 req-3606cf61-2412-4116-90df-580d4a65c8ca service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:13.159741 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-5965f2d9-ec67-4033-ab55-af5043628c34 req-3606cf61-2412-4116-90df-580d4a65c8ca service nova] Creating event network-vif-plugged:933af734-9f5f-4958-934d-c40605fd0b13 for instance f5335837-15f6-4365-b5e0-baa45e59dc5f on n-h2-848886-15 Jul 25 12:59:13.168723 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-5965f2d9-ec67-4033-ab55-af5043628c34 req-3606cf61-2412-4116-90df-580d4a65c8ca service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083926 Jul 25 12:59:13.174220 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c240a014-641d-4884-8632-8e56db83f3eb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:13.179554 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1919/3743] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:59:13.190628 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c240a014-641d-4884-8632-8e56db83f3eb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f" status: 200 len: 1315 microversion: 2.1 time: 0.695393 Jul 25 12:59:13.191492 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1825/3744] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:12 2022] GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:13.513372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dde493de-57d3-4b92-bdbd-2e27a228e642 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:13.514979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dde493de-57d3-4b92-bdbd-2e27a228e642 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 10b1244b-a55e-40c5-a394-e1be83ed505b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:13.532675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dde493de-57d3-4b92-bdbd-2e27a228e642 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:13.537816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dde493de-57d3-4b92-bdbd-2e27a228e642 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:13.549533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dde493de-57d3-4b92-bdbd-2e27a228e642 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:13.554684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dde493de-57d3-4b92-bdbd-2e27a228e642 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:13.841478 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c8053c6d-e9aa-46dd-9ea4-27c2f13c8172 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:13.849411 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c8053c6d-e9aa-46dd-9ea4-27c2f13c8172 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:13.859586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8053c6d-e9aa-46dd-9ea4-27c2f13c8172 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:13.860827 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8053c6d-e9aa-46dd-9ea4-27c2f13c8172 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:13.861919 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8053c6d-e9aa-46dd-9ea4-27c2f13c8172 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:13.863710 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8053c6d-e9aa-46dd-9ea4-27c2f13c8172 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:14.048602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c8053c6d-e9aa-46dd-9ea4-27c2f13c8172 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:14.058625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c8053c6d-e9aa-46dd-9ea4-27c2f13c8172 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:14.060457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c8053c6d-e9aa-46dd-9ea4-27c2f13c8172 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:14.063566 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c8053c6d-e9aa-46dd-9ea4-27c2f13c8172 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1357 microversion: 2.57 time: 0.228348 Jul 25 12:59:14.065172 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1826/3745] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:13 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:14.088398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-eb4caf35-92f5-48d7-9338-73eaa9ade99c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:14.092145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-eb4caf35-92f5-48d7-9338-73eaa9ade99c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:14.099110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb4caf35-92f5-48d7-9338-73eaa9ade99c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:14.100042 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb4caf35-92f5-48d7-9338-73eaa9ade99c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:14.101297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb4caf35-92f5-48d7-9338-73eaa9ade99c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:14.101803 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb4caf35-92f5-48d7-9338-73eaa9ade99c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:14.110761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dde493de-57d3-4b92-bdbd-2e27a228e642 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:14.119384 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dde493de-57d3-4b92-bdbd-2e27a228e642 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b" status: 200 len: 1505 microversion: 2.1 time: 0.610248 Jul 25 12:59:14.126617 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1920/3746] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:13 2022] GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b => generated 1505 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:14.146255 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e848b459-de4a-4240-a414-b8dffc8067fe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:14.146761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e848b459-de4a-4240-a414-b8dffc8067fe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 10b1244b-a55e-40c5-a394-e1be83ed505b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:14.153687 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e848b459-de4a-4240-a414-b8dffc8067fe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:14.154180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e848b459-de4a-4240-a414-b8dffc8067fe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:14.154965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e848b459-de4a-4240-a414-b8dffc8067fe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:14.155394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e848b459-de4a-4240-a414-b8dffc8067fe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:14.216195 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e848b459-de4a-4240-a414-b8dffc8067fe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 10b1244b-a55e-40c5-a394-e1be83ed505b] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:59:14.222566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-eb4caf35-92f5-48d7-9338-73eaa9ade99c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:59:14.223705 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-eb4caf35-92f5-48d7-9338-73eaa9ade99c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:59:14.224570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-eb4caf35-92f5-48d7-9338-73eaa9ade99c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:59:14.225181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-eb4caf35-92f5-48d7-9338-73eaa9ade99c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:59:14.226221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-eb4caf35-92f5-48d7-9338-73eaa9ade99c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:59:14.300244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:14.335589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-eb4caf35-92f5-48d7-9338-73eaa9ade99c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:14.353720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb4caf35-92f5-48d7-9338-73eaa9ade99c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:14.354952 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb4caf35-92f5-48d7-9338-73eaa9ade99c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:14.356316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb4caf35-92f5-48d7-9338-73eaa9ade99c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:14.356873 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb4caf35-92f5-48d7-9338-73eaa9ade99c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:14.358753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:14.377355 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e848b459-de4a-4240-a414-b8dffc8067fe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "DELETE /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b" status: 204 len: 0 microversion: 2.1 time: 0.236358 Jul 25 12:59:14.378075 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1921/3747] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:59:14 2022] DELETE /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 12:59:14.408571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b8707248-f8d0-4e82-8757-5981e7b16a1e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:14.441564 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-eb4caf35-92f5-48d7-9338-73eaa9ade99c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "POST /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a/action" status: 202 len: 1138 microversion: 2.57 time: 0.355201 Jul 25 12:59:14.443425 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1827/3748] 10.222.0.49 () {62 vars in 1320 bytes} [Mon Jul 25 12:59:14 2022] POST /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a/action => generated 1138 bytes in 359 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jul 25 12:59:14.444278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b8707248-f8d0-4e82-8757-5981e7b16a1e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:14.463078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8707248-f8d0-4e82-8757-5981e7b16a1e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:14.464137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-178f5717-0ae8-4a69-a210-26338ab90298 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:14.465337 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-178f5717-0ae8-4a69-a210-26338ab90298 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 10b1244b-a55e-40c5-a394-e1be83ed505b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:14.466037 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8707248-f8d0-4e82-8757-5981e7b16a1e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:14.467186 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8707248-f8d0-4e82-8757-5981e7b16a1e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:14.468946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8707248-f8d0-4e82-8757-5981e7b16a1e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:14.485890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-178f5717-0ae8-4a69-a210-26338ab90298 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:14.490097 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-178f5717-0ae8-4a69-a210-26338ab90298 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:14.491637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-178f5717-0ae8-4a69-a210-26338ab90298 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:14.492336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-178f5717-0ae8-4a69-a210-26338ab90298 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:14.579675 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:14.899384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b8707248-f8d0-4e82-8757-5981e7b16a1e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:14.914369 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b8707248-f8d0-4e82-8757-5981e7b16a1e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f" status: 200 len: 1315 microversion: 2.1 time: 0.534558 Jul 25 12:59:14.926550 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1922/3749] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:14 2022] GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f => generated 1315 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:14.926550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-405dc41a-5ca6-4068-b989-6129cf519409 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:14.926550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-405dc41a-5ca6-4068-b989-6129cf519409 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:14.938392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-405dc41a-5ca6-4068-b989-6129cf519409 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:14.939188 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-405dc41a-5ca6-4068-b989-6129cf519409 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:14.940186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-178f5717-0ae8-4a69-a210-26338ab90298 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:14.948797 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-178f5717-0ae8-4a69-a210-26338ab90298 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b" status: 200 len: 1511 microversion: 2.1 time: 0.503154 Jul 25 12:59:14.949391 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1828/3750] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:14 2022] GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b => generated 1511 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:14.958041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-405dc41a-5ca6-4068-b989-6129cf519409 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:14.958713 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-405dc41a-5ca6-4068-b989-6129cf519409 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:15.112985 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-405dc41a-5ca6-4068-b989-6129cf519409 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:15.131350 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-405dc41a-5ca6-4068-b989-6129cf519409 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:15.133565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-405dc41a-5ca6-4068-b989-6129cf519409 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:15.135104 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-405dc41a-5ca6-4068-b989-6129cf519409 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1366 microversion: 2.57 time: 0.217658 Jul 25 12:59:15.150839 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1923/3751] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:14 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:15.941755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-839c4f93-6fd6-4ff5-bf4b-6a348a287a01 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:15.942730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-839c4f93-6fd6-4ff5-bf4b-6a348a287a01 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:15.963820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-839c4f93-6fd6-4ff5-bf4b-6a348a287a01 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:15.970638 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-839c4f93-6fd6-4ff5-bf4b-6a348a287a01 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:15.971791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-839c4f93-6fd6-4ff5-bf4b-6a348a287a01 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:15.972399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-839c4f93-6fd6-4ff5-bf4b-6a348a287a01 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:16.081098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-24506591-1343-4518-a34e-979d73d9219e req-8a4b728f-853b-468d-96ff-4f15cd154b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "tag": "cf0e5a93-6e29-451d-9c37-4cea02b17b40"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:16.103211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-24506591-1343-4518-a34e-979d73d9219e req-8a4b728f-853b-468d-96ff-4f15cd154b88 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:16.103663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-24506591-1343-4518-a34e-979d73d9219e req-8a4b728f-853b-468d-96ff-4f15cd154b88 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:16.132557 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-24506591-1343-4518-a34e-979d73d9219e req-8a4b728f-853b-468d-96ff-4f15cd154b88 service nova] Creating event network-changed:cf0e5a93-6e29-451d-9c37-4cea02b17b40 for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 12:59:16.141225 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-24506591-1343-4518-a34e-979d73d9219e req-8a4b728f-853b-468d-96ff-4f15cd154b88 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.252249 Jul 25 12:59:16.142282 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1829/3752] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:59:16.147714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-00702f1b-577e-4edb-8f72-2671d469519f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:16.148469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-00702f1b-577e-4edb-8f72-2671d469519f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 10b1244b-a55e-40c5-a394-e1be83ed505b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:16.168829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00702f1b-577e-4edb-8f72-2671d469519f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:16.177712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00702f1b-577e-4edb-8f72-2671d469519f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:16.179035 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00702f1b-577e-4edb-8f72-2671d469519f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:16.179638 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00702f1b-577e-4edb-8f72-2671d469519f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:17.239630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-839c4f93-6fd6-4ff5-bf4b-6a348a287a01 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:17.250399 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-839c4f93-6fd6-4ff5-bf4b-6a348a287a01 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f" status: 200 len: 1503 microversion: 2.1 time: 1.315252 Jul 25 12:59:17.254494 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1924/3753] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:15 2022] GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f => generated 1503 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:59:17.280567 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ad2162ec-0eb7-4473-a700-8199e585e3ae tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:17.284905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ad2162ec-0eb7-4473-a700-8199e585e3ae tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:17.314568 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ad2162ec-0eb7-4473-a700-8199e585e3ae tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:17.320855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ad2162ec-0eb7-4473-a700-8199e585e3ae tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:17.322079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ad2162ec-0eb7-4473-a700-8199e585e3ae tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:17.324696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ad2162ec-0eb7-4473-a700-8199e585e3ae tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:17.371636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-00702f1b-577e-4edb-8f72-2671d469519f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:17.381656 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-00702f1b-577e-4edb-8f72-2671d469519f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b" status: 200 len: 1511 microversion: 2.1 time: 1.237928 Jul 25 12:59:17.386888 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1830/3754] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:16 2022] GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b => generated 1511 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:17.392045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-62ba6b20-a79c-44ab-a1ad-f71cfd34a943 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:17.402669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-62ba6b20-a79c-44ab-a1ad-f71cfd34a943 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:17.413666 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62ba6b20-a79c-44ab-a1ad-f71cfd34a943 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:17.414516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62ba6b20-a79c-44ab-a1ad-f71cfd34a943 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:17.415535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62ba6b20-a79c-44ab-a1ad-f71cfd34a943 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:17.416179 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62ba6b20-a79c-44ab-a1ad-f71cfd34a943 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:17.582306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ad2162ec-0eb7-4473-a700-8199e585e3ae tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:17.607180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ad2162ec-0eb7-4473-a700-8199e585e3ae tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:17.615904 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ad2162ec-0eb7-4473-a700-8199e585e3ae tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:17.621146 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ad2162ec-0eb7-4473-a700-8199e585e3ae tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1366 microversion: 2.57 time: 0.360172 Jul 25 12:59:17.642739 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1925/3755] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:17 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:18.201812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:18.267640 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.network.security_group_api [None req-62ba6b20-a79c-44ab-a1ad-f71cfd34a943 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Removing security group 86823671-231d-4ffc-8f0e-6634f8eda5c7 from port 933af734-9f5f-4958-934d-c40605fd0b13 Jul 25 12:59:18.419100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a447f53c-65d8-4109-8e75-5dc2b40fa53b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:18.421279 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a447f53c-65d8-4109-8e75-5dc2b40fa53b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 10b1244b-a55e-40c5-a394-e1be83ed505b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:18.442247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a447f53c-65d8-4109-8e75-5dc2b40fa53b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:18.444676 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a447f53c-65d8-4109-8e75-5dc2b40fa53b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:18.449291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a447f53c-65d8-4109-8e75-5dc2b40fa53b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:18.454706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a447f53c-65d8-4109-8e75-5dc2b40fa53b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:18.741383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:18.777180 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=10 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:18.890449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a447f53c-65d8-4109-8e75-5dc2b40fa53b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:18.910474 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a447f53c-65d8-4109-8e75-5dc2b40fa53b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b" status: 200 len: 1469 microversion: 2.1 time: 0.495589 Jul 25 12:59:18.911114 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1926/3756] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:18 2022] GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b => generated 1469 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:18.933596 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ecc8e700-49be-45a7-9f69-0876921f6f65 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:18.938928 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ecc8e700-49be-45a7-9f69-0876921f6f65 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:18.965657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ecc8e700-49be-45a7-9f69-0876921f6f65 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:18.966151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ecc8e700-49be-45a7-9f69-0876921f6f65 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:18.970018 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ecc8e700-49be-45a7-9f69-0876921f6f65 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:18.970593 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ecc8e700-49be-45a7-9f69-0876921f6f65 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:19.887441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ecc8e700-49be-45a7-9f69-0876921f6f65 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:19.927304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ecc8e700-49be-45a7-9f69-0876921f6f65 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:19.930905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ecc8e700-49be-45a7-9f69-0876921f6f65 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:19.938569 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ecc8e700-49be-45a7-9f69-0876921f6f65 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1366 microversion: 2.57 time: 1.023487 Jul 25 12:59:19.945239 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1927/3757] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:18 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1366 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:19.963667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-ba06cf95-2c57-43c8-8f43-0e7589b6db77 req-285ce123-70c4-47fb-a5c7-7abc6ae3b946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10b1244b-a55e-40c5-a394-e1be83ed505b", "name": "network-vif-deleted", "tag": "fd50d531-89e7-4530-9940-6e3b3a6da812"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:20.012167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-ba06cf95-2c57-43c8-8f43-0e7589b6db77 req-285ce123-70c4-47fb-a5c7-7abc6ae3b946 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:20.020040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-ba06cf95-2c57-43c8-8f43-0e7589b6db77 req-285ce123-70c4-47fb-a5c7-7abc6ae3b946 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:20.085361 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-ba06cf95-2c57-43c8-8f43-0e7589b6db77 req-285ce123-70c4-47fb-a5c7-7abc6ae3b946 service nova] Creating event network-vif-deleted:fd50d531-89e7-4530-9940-6e3b3a6da812 for instance 10b1244b-a55e-40c5-a394-e1be83ed505b on n-h2-848886-15 Jul 25 12:59:20.090021 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-62ba6b20-a79c-44ab-a1ad-f71cfd34a943 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f/action" status: 202 len: 0 microversion: 2.1 time: 2.701734 Jul 25 12:59:20.090938 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1831/3758] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:59:17 2022] POST /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f/action => generated 0 bytes in 2703 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:59:20.099315 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-671e94bb-358f-4936-863e-0e04e0c7637e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:20.100084 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-671e94bb-358f-4936-863e-0e04e0c7637e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 10b1244b-a55e-40c5-a394-e1be83ed505b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:20.135361 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-ba06cf95-2c57-43c8-8f43-0e7589b6db77 req-285ce123-70c4-47fb-a5c7-7abc6ae3b946 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169475 Jul 25 12:59:20.137244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-671e94bb-358f-4936-863e-0e04e0c7637e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:20.139521 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1928/3759] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:59:20.142326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-671e94bb-358f-4936-863e-0e04e0c7637e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:20.147352 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-671e94bb-358f-4936-863e-0e04e0c7637e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:20.151615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-671e94bb-358f-4936-863e-0e04e0c7637e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:20.160477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-64d137c6-d415-4b39-9a42-4475ce4e7f7c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:20.174915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-64d137c6-d415-4b39-9a42-4475ce4e7f7c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:20.197129 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64d137c6-d415-4b39-9a42-4475ce4e7f7c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:20.205057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64d137c6-d415-4b39-9a42-4475ce4e7f7c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:20.206513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64d137c6-d415-4b39-9a42-4475ce4e7f7c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:20.207595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64d137c6-d415-4b39-9a42-4475ce4e7f7c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:20.289867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-671e94bb-358f-4936-863e-0e04e0c7637e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:20.294383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-671e94bb-358f-4936-863e-0e04e0c7637e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:20.295025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-671e94bb-358f-4936-863e-0e04e0c7637e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lazy-loading 'fault' on Instance uuid 10b1244b-a55e-40c5-a394-e1be83ed505b {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:59:20.867055 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-671e94bb-358f-4936-863e-0e04e0c7637e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:20.889418 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-671e94bb-358f-4936-863e-0e04e0c7637e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b" status: 200 len: 1306 microversion: 2.1 time: 0.793916 Jul 25 12:59:20.894978 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1832/3760] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:20 2022] GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b => generated 1306 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:20.970017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2bff0e40-34d7-47fa-b895-fdad9e45a350 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:20.970996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2bff0e40-34d7-47fa-b895-fdad9e45a350 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:21.031380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2bff0e40-34d7-47fa-b895-fdad9e45a350 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:21.035039 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2bff0e40-34d7-47fa-b895-fdad9e45a350 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:21.036123 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2bff0e40-34d7-47fa-b895-fdad9e45a350 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:21.037861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2bff0e40-34d7-47fa-b895-fdad9e45a350 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:21.043764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-64d137c6-d415-4b39-9a42-4475ce4e7f7c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:21.062578 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-64d137c6-d415-4b39-9a42-4475ce4e7f7c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f" status: 200 len: 1461 microversion: 2.1 time: 0.921124 Jul 25 12:59:21.074328 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1929/3761] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:20 2022] GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f => generated 1461 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:21.098595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-54f48e13-e46b-4255-a01d-3b682e941d86 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:21.099484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-54f48e13-e46b-4255-a01d-3b682e941d86 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:21.135405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-54f48e13-e46b-4255-a01d-3b682e941d86 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:21.143561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-54f48e13-e46b-4255-a01d-3b682e941d86 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:21.145434 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-54f48e13-e46b-4255-a01d-3b682e941d86 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:21.149269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-54f48e13-e46b-4255-a01d-3b682e941d86 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:21.177573 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2bff0e40-34d7-47fa-b895-fdad9e45a350 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:21.186413 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2bff0e40-34d7-47fa-b895-fdad9e45a350 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:21.187942 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2bff0e40-34d7-47fa-b895-fdad9e45a350 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:21.189179 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2bff0e40-34d7-47fa-b895-fdad9e45a350 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1366 microversion: 2.57 time: 0.224296 Jul 25 12:59:21.202364 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1833/3762] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:20 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:59:21.609393 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-54f48e13-e46b-4255-a01d-3b682e941d86 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:21.625651 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-54f48e13-e46b-4255-a01d-3b682e941d86 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.531879 Jul 25 12:59:21.626643 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1930/3763] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:21 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:21.654044 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-481eec27-e54c-4f35-9926-58ad2f921cfb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:21.655395 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-481eec27-e54c-4f35-9926-58ad2f921cfb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:21.663780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-481eec27-e54c-4f35-9926-58ad2f921cfb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:21.664232 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-481eec27-e54c-4f35-9926-58ad2f921cfb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:21.665806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-481eec27-e54c-4f35-9926-58ad2f921cfb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:21.666784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-481eec27-e54c-4f35-9926-58ad2f921cfb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:21.924985 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e8087e71-ea0a-48b9-a062-4aea476991ed tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:21.926256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e8087e71-ea0a-48b9-a062-4aea476991ed tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 10b1244b-a55e-40c5-a394-e1be83ed505b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:21.975699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8087e71-ea0a-48b9-a062-4aea476991ed tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:21.979776 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8087e71-ea0a-48b9-a062-4aea476991ed tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:21.991202 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8087e71-ea0a-48b9-a062-4aea476991ed tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:21.992833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8087e71-ea0a-48b9-a062-4aea476991ed tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:22.052895 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-e8087e71-ea0a-48b9-a062-4aea476991ed tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e8087e71-ea0a-48b9-a062-4aea476991ed tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b HTTP/1.1 Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '10b1244b-a55e-40c5-a394-e1be83ed505b'} Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:22.067608 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:22.073074 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:22.073074 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:22.073074 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:22.073074 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:59:22.073074 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:59:22.073074 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 12:59:22.073074 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:22.073074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e8087e71-ea0a-48b9-a062-4aea476991ed tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 404 to user: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:59:22.076273 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e8087e71-ea0a-48b9-a062-4aea476991ed tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b" status: 404 len: 111 microversion: 2.1 time: 0.155775 Jul 25 12:59:22.078265 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1931/3764] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:21 2022] GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 12:59:22.100583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c69e693b-38f3-4d9a-ae57-8ef28e120bab tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:22.101228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c69e693b-38f3-4d9a-ae57-8ef28e120bab tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:22.127869 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c69e693b-38f3-4d9a-ae57-8ef28e120bab tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:22.136217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c69e693b-38f3-4d9a-ae57-8ef28e120bab tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:22.138154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c69e693b-38f3-4d9a-ae57-8ef28e120bab tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:22.142767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c69e693b-38f3-4d9a-ae57-8ef28e120bab tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:22.242322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-481eec27-e54c-4f35-9926-58ad2f921cfb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:22.257576 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-481eec27-e54c-4f35-9926-58ad2f921cfb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.610893 Jul 25 12:59:22.272911 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1834/3765] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:21 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:22.570737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-31130608-70df-4122-b674-b1cc14bffc38 req-f3a73bc2-247e-4f9d-be77-8a3f311941bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5335837-15f6-4365-b5e0-baa45e59dc5f", "tag": "933af734-9f5f-4958-934d-c40605fd0b13"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:22.592988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-31130608-70df-4122-b674-b1cc14bffc38 req-f3a73bc2-247e-4f9d-be77-8a3f311941bf service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:22.594012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-31130608-70df-4122-b674-b1cc14bffc38 req-f3a73bc2-247e-4f9d-be77-8a3f311941bf service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:22.616229 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-31130608-70df-4122-b674-b1cc14bffc38 req-f3a73bc2-247e-4f9d-be77-8a3f311941bf service nova] Creating event network-changed:933af734-9f5f-4958-934d-c40605fd0b13 for instance f5335837-15f6-4365-b5e0-baa45e59dc5f on n-h2-848886-15 Jul 25 12:59:22.622582 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-31130608-70df-4122-b674-b1cc14bffc38 req-f3a73bc2-247e-4f9d-be77-8a3f311941bf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.307600 Jul 25 12:59:22.623810 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1835/3766] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:59:22.632690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ef0943ca-76fe-4df3-891d-044620c7898f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:22.633785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ef0943ca-76fe-4df3-891d-044620c7898f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:22.652117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef0943ca-76fe-4df3-891d-044620c7898f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:22.652781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef0943ca-76fe-4df3-891d-044620c7898f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:22.653771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef0943ca-76fe-4df3-891d-044620c7898f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:22.654445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef0943ca-76fe-4df3-891d-044620c7898f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:22.819152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c69e693b-38f3-4d9a-ae57-8ef28e120bab tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:22.829003 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c69e693b-38f3-4d9a-ae57-8ef28e120bab tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.744689 Jul 25 12:59:22.833309 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1932/3767] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:22 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:22.845647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b7f8be9f-c71c-4d68-9866-c0e920225d3d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:22.846826 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b7f8be9f-c71c-4d68-9866-c0e920225d3d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:22.860312 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7f8be9f-c71c-4d68-9866-c0e920225d3d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:22.871110 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7f8be9f-c71c-4d68-9866-c0e920225d3d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:22.877591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7f8be9f-c71c-4d68-9866-c0e920225d3d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:22.878896 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7f8be9f-c71c-4d68-9866-c0e920225d3d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:23.313376 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ef0943ca-76fe-4df3-891d-044620c7898f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:23.327730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ef0943ca-76fe-4df3-891d-044620c7898f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:23.329517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ef0943ca-76fe-4df3-891d-044620c7898f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:23.331043 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ef0943ca-76fe-4df3-891d-044620c7898f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1366 microversion: 2.57 time: 0.705850 Jul 25 12:59:23.331678 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1836/3768] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:22 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1366 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:23.361169 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-67201007-ea8e-41db-abbc-5fde8adaac8c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-67201007-ea8e-41db-abbc-5fde8adaac8c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 163 Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: {"server": {"name": 12345, "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452', 'networks': [{'uuid': 'dc975d58-9818-4c8b-8bcd-8b1a23df5609'}]}}} Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 12345 Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:59:23.365661 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:59:23.370737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:59:23.370737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 25 12:59:23.370737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:23.370737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:23.370737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:23.370737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:23.370737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:23.370737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:23.370737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:59:23.370737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:59:23.370737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 25 12:59:23.370737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:23.391719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-67201007-ea8e-41db-abbc-5fde8adaac8c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:59:23.392828 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-67201007-ea8e-41db-abbc-5fde8adaac8c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.060035 Jul 25 12:59:23.403340 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1837/3769] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:59:23 2022] POST /compute/v2.1/servers => generated 127 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:59:23.428027 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c2f6e725-515b-46ca-851d-c8348a8bd389 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:23.435809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c2f6e725-515b-46ca-851d-c8348a8bd389 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:23.464476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2f6e725-515b-46ca-851d-c8348a8bd389 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:23.464958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2f6e725-515b-46ca-851d-c8348a8bd389 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:23.479739 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2f6e725-515b-46ca-851d-c8348a8bd389 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:23.485751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2f6e725-515b-46ca-851d-c8348a8bd389 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:24.069739 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c2f6e725-515b-46ca-851d-c8348a8bd389 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:24.086802 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c2f6e725-515b-46ca-851d-c8348a8bd389 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.679892 Jul 25 12:59:24.102516 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1838/3770] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:23 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:24.133968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b8bcce62-9bfe-4d1c-9742-fca4ca3d7b3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:24.136407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b8bcce62-9bfe-4d1c-9742-fca4ca3d7b3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:24.164709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b8bcce62-9bfe-4d1c-9742-fca4ca3d7b3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:24.166740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b8bcce62-9bfe-4d1c-9742-fca4ca3d7b3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:24.169049 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b8bcce62-9bfe-4d1c-9742-fca4ca3d7b3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:24.175021 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b8bcce62-9bfe-4d1c-9742-fca4ca3d7b3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:24.863486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b7f8be9f-c71c-4d68-9866-c0e920225d3d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:24.874209 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b7f8be9f-c71c-4d68-9866-c0e920225d3d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 2.039575 Jul 25 12:59:24.880952 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1933/3771] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:22 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 2047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:24.894833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-94a10e8a-190e-4209-89f8-02d42eb76c6f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:24.895933 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-94a10e8a-190e-4209-89f8-02d42eb76c6f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:24.911366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94a10e8a-190e-4209-89f8-02d42eb76c6f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:24.916631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94a10e8a-190e-4209-89f8-02d42eb76c6f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:24.924263 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94a10e8a-190e-4209-89f8-02d42eb76c6f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:24.925661 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94a10e8a-190e-4209-89f8-02d42eb76c6f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:25.075205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b8bcce62-9bfe-4d1c-9742-fca4ca3d7b3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:25.085670 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b8bcce62-9bfe-4d1c-9742-fca4ca3d7b3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.972324 Jul 25 12:59:25.090428 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1839/3772] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:24 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:25.095573 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6e5b5b42-dc93-4acc-a0cc-de32069ec80c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:25.102923 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6e5b5b42-dc93-4acc-a0cc-de32069ec80c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:25.119110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6e5b5b42-dc93-4acc-a0cc-de32069ec80c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:25.120512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6e5b5b42-dc93-4acc-a0cc-de32069ec80c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:25.127632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6e5b5b42-dc93-4acc-a0cc-de32069ec80c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:25.128334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6e5b5b42-dc93-4acc-a0cc-de32069ec80c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:25.289457 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-94a10e8a-190e-4209-89f8-02d42eb76c6f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:25.308794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-94a10e8a-190e-4209-89f8-02d42eb76c6f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:25.313540 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-94a10e8a-190e-4209-89f8-02d42eb76c6f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:25.317702 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-94a10e8a-190e-4209-89f8-02d42eb76c6f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1366 microversion: 2.57 time: 0.435210 Jul 25 12:59:25.320756 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1934/3773] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:24 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1366 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:25.830233 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6e5b5b42-dc93-4acc-a0cc-de32069ec80c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:25.842928 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6e5b5b42-dc93-4acc-a0cc-de32069ec80c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.751156 Jul 25 12:59:25.843539 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1840/3774] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:25 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:26.160525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-95c3fa03-8b57-4c3b-863e-c5bd9d1407b0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-140630139", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "f9bdc019-d9ba-4dd9-9e23-b909e49f2c93"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:26.243772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-95c3fa03-8b57-4c3b-863e-c5bd9d1407b0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] validate_networks() for [('f9bdc019-d9ba-4dd9-9e23-b909e49f2c93', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:59:26.343184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-17deaa4e-5f8f-473e-81a5-d5f55300c52f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:26.343889 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-17deaa4e-5f8f-473e-81a5-d5f55300c52f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:26.352240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:26.360741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-17deaa4e-5f8f-473e-81a5-d5f55300c52f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:26.361596 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-17deaa4e-5f8f-473e-81a5-d5f55300c52f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:26.366019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-17deaa4e-5f8f-473e-81a5-d5f55300c52f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:26.366849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-17deaa4e-5f8f-473e-81a5-d5f55300c52f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:26.573142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-17deaa4e-5f8f-473e-81a5-d5f55300c52f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:26.588276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-17deaa4e-5f8f-473e-81a5-d5f55300c52f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:26.593362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-17deaa4e-5f8f-473e-81a5-d5f55300c52f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:26.601458 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-17deaa4e-5f8f-473e-81a5-d5f55300c52f tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1366 microversion: 2.57 time: 0.255858 Jul 25 12:59:26.602476 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1841/3775] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:26 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:27.373873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-95c3fa03-8b57-4c3b-863e-c5bd9d1407b0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:59:27.378540 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-95c3fa03-8b57-4c3b-863e-c5bd9d1407b0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:59:27.379408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-95c3fa03-8b57-4c3b-863e-c5bd9d1407b0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:59:27.383821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-95c3fa03-8b57-4c3b-863e-c5bd9d1407b0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:59:27.384568 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-95c3fa03-8b57-4c3b-863e-c5bd9d1407b0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:59:27.419260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95c3fa03-8b57-4c3b-863e-c5bd9d1407b0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:27.420031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95c3fa03-8b57-4c3b-863e-c5bd9d1407b0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:27.422529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95c3fa03-8b57-4c3b-863e-c5bd9d1407b0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:27.423306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95c3fa03-8b57-4c3b-863e-c5bd9d1407b0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:27.523931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-95c3fa03-8b57-4c3b-863e-c5bd9d1407b0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Getting quotas for project b5abf45c9ba0419c8dec07847f3ff3c5. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:59:27.539576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-95c3fa03-8b57-4c3b-863e-c5bd9d1407b0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Getting quotas for user 4d492d20a4864908a81902f86468d437 and project b5abf45c9ba0419c8dec07847f3ff3c5. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:59:27.586692 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-95c3fa03-8b57-4c3b-863e-c5bd9d1407b0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:59:27.592631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-95c3fa03-8b57-4c3b-863e-c5bd9d1407b0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:59:27.630375 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d99236fd-9428-4615-b767-eb0c586aee85 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:27.631432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d99236fd-9428-4615-b767-eb0c586aee85 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:27.670629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d99236fd-9428-4615-b767-eb0c586aee85 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:27.671389 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d99236fd-9428-4615-b767-eb0c586aee85 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:27.672777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d99236fd-9428-4615-b767-eb0c586aee85 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:27.673555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d99236fd-9428-4615-b767-eb0c586aee85 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:27.770716 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-95c3fa03-8b57-4c3b-863e-c5bd9d1407b0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.609787 Jul 25 12:59:27.772913 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1935/3776] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:59:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:59:27.788360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-457725d4-2c1a-4d64-9785-cbec8d2627bd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:27.794989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-457725d4-2c1a-4d64-9785-cbec8d2627bd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:28.063534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d99236fd-9428-4615-b767-eb0c586aee85 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:28.074469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-457725d4-2c1a-4d64-9785-cbec8d2627bd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:28.081626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d99236fd-9428-4615-b767-eb0c586aee85 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:28.093784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d99236fd-9428-4615-b767-eb0c586aee85 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:28.096334 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-457725d4-2c1a-4d64-9785-cbec8d2627bd tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1214 microversion: 2.1 time: 0.314711 Jul 25 12:59:28.102872 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d99236fd-9428-4615-b767-eb0c586aee85 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1366 microversion: 2.57 time: 0.472907 Jul 25 12:59:28.104543 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1842/3777] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:27 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1366 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:28.163806 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1936/3778] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:27 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1214 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:28.543956 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0ac9dc4e-c6b4-4848-bc3b-5e81f4243c85 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1267857853", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "e2314a76-64be-4f77-9bbb-6a63fbd8ad2a", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:28.559057 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dd570262-34d2-4b83-9c46-6399ed0bb1fd tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Action: 'create', calling method: .version_select at 0x7efcf8bccaf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1331126052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLd3C2BthN29Qh+3ia0lYYoLmL5bucFrCCV9ez7jDgMAdZBzWjHD80G4AQZ6nxxo8oMTtxpYPCApn9E+rNUAPiqzpMdOsBxzbQJRrvRcwIYhFLdekt8SD4agvC9J55h1GQ=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:28.580025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-dd570262-34d2-4b83-9c46-6399ed0bb1fd tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Getting quotas for project c0d891a772834e43bdfcbde778a90498. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:59:28.586476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-dd570262-34d2-4b83-9c46-6399ed0bb1fd tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Getting quotas for user 4d6e2ae351744e0ab1f153d629e4f0e7 and project c0d891a772834e43bdfcbde778a90498. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:59:28.630729 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dd570262-34d2-4b83-9c46-6399ed0bb1fd tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.523102 Jul 25 12:59:28.630729 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1843/3779] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 12:59:28 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:59:28.724631 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-0ac9dc4e-c6b4-4848-bc3b-5e81f4243c85 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Block Device e2314a76-64be-4f77-9bbb-6a63fbd8ad2a is not bootable. Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0ac9dc4e-c6b4-4848-bc3b-5e81f4243c85 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 358 Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1267857853", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "e2314a76-64be-4f77-9bbb-6a63fbd8ad2a", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: exception: Block Device e2314a76-64be-4f77-9bbb-6a63fbd8ad2a is not bootable. Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1267857853', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'e2314a76-64be-4f77-9bbb-6a63fbd8ad2a'}], 'networks': [{'uuid': 'dc975d58-9818-4c8b-8bcd-8b1a23df5609'}]}}} Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device e2314a76-64be-4f77-9bbb-6a63fbd8ad2a is not bootable. Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:59:28.737479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:59:28.741260 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:59:28.741260 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:59:28.741260 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:59:28.741260 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 12:59:28.741260 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 25 12:59:28.741260 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 25 12:59:28.741260 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device e2314a76-64be-4f77-9bbb-6a63fbd8ad2a is not bootable. Jul 25 12:59:28.741260 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:28.741260 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:28.741260 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:28.741260 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:28.741260 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:28.741260 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:28.741260 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:59:28.741260 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:59:28.741260 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device e2314a76-64be-4f77-9bbb-6a63fbd8ad2a is not bootable. Jul 25 12:59:28.741260 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:28.743849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0ac9dc4e-c6b4-4848-bc3b-5e81f4243c85 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 400 to user: Block Device e2314a76-64be-4f77-9bbb-6a63fbd8ad2a is not bootable. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:59:28.745142 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0ac9dc4e-c6b4-4848-bc3b-5e81f4243c85 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.205085 Jul 25 12:59:28.746015 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1937/3780] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:59:28 2022] POST /compute/v2.1/servers => generated 110 bytes in 207 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 12:59:28.759254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9e4cdbea-af81-43fc-8af0-98154da16b0f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:28.759891 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9e4cdbea-af81-43fc-8af0-98154da16b0f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:28.775777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e4cdbea-af81-43fc-8af0-98154da16b0f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:28.776242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e4cdbea-af81-43fc-8af0-98154da16b0f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:28.787315 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e4cdbea-af81-43fc-8af0-98154da16b0f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:28.788864 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e4cdbea-af81-43fc-8af0-98154da16b0f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:29.142808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-12388636-2983-4e7d-9a39-b906dd0045aa tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:29.143729 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-12388636-2983-4e7d-9a39-b906dd0045aa tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:29.151654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-12388636-2983-4e7d-9a39-b906dd0045aa tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:29.152479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-12388636-2983-4e7d-9a39-b906dd0045aa tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:29.154575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-12388636-2983-4e7d-9a39-b906dd0045aa tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:29.155494 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-12388636-2983-4e7d-9a39-b906dd0045aa tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:29.320248 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9e4cdbea-af81-43fc-8af0-98154da16b0f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:29.331863 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9e4cdbea-af81-43fc-8af0-98154da16b0f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.577641 Jul 25 12:59:29.336204 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1844/3781] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:28 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:29.355951 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-12388636-2983-4e7d-9a39-b906dd0045aa tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:29.357423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3359e040-f241-4763-b1e3-f4d4c2ce0336 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:29.359747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3359e040-f241-4763-b1e3-f4d4c2ce0336 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:29.378423 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-12388636-2983-4e7d-9a39-b906dd0045aa tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:29.383552 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-12388636-2983-4e7d-9a39-b906dd0045aa tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:29.388102 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-12388636-2983-4e7d-9a39-b906dd0045aa tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1366 microversion: 2.57 time: 0.248466 Jul 25 12:59:29.391196 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1938/3782] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:29 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:29.399287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-846e0d96-9631-4b3c-8107-e2816bd0fda9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:29.401556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-846e0d96-9631-4b3c-8107-e2816bd0fda9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:29.411061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3359e040-f241-4763-b1e3-f4d4c2ce0336 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:29.411899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3359e040-f241-4763-b1e3-f4d4c2ce0336 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:29.412144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-846e0d96-9631-4b3c-8107-e2816bd0fda9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:29.412888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-846e0d96-9631-4b3c-8107-e2816bd0fda9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:29.414166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-846e0d96-9631-4b3c-8107-e2816bd0fda9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:29.414818 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-846e0d96-9631-4b3c-8107-e2816bd0fda9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:29.415466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3359e040-f241-4763-b1e3-f4d4c2ce0336 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:29.415917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3359e040-f241-4763-b1e3-f4d4c2ce0336 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:29.893057 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3359e040-f241-4763-b1e3-f4d4c2ce0336 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:29.906604 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3359e040-f241-4763-b1e3-f4d4c2ce0336 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1266 microversion: 2.1 time: 0.569160 Jul 25 12:59:29.907850 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1845/3783] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:29 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1266 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:29.925250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c5d63590-36bd-4761-94a8-10a3900f20b2 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-749125150-access_point-399180726", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "567b57b4-0ded-48bb-ac0a-8f0e55d99316"}], "key_name": "tempest-TestSecurityGroupsBasicOps-496810183", "security_groups": [{"name": "tempest-secgroup_access--321216418"}, {"name": "tempest-secgroup_general--1478546266"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:30.980381 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-c5d63590-36bd-4761-94a8-10a3900f20b2 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] validate_networks() for [('567b57b4-0ded-48bb-ac0a-8f0e55d99316', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:59:31.094216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-846e0d96-9631-4b3c-8107-e2816bd0fda9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:31.110090 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-846e0d96-9631-4b3c-8107-e2816bd0fda9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 1.717305 Jul 25 12:59:31.110814 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1939/3784] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:29 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:31.135888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f92b03f4-c308-4208-b46f-d64a63d1cd00 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:31.137464 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f92b03f4-c308-4208-b46f-d64a63d1cd00 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:31.154111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f92b03f4-c308-4208-b46f-d64a63d1cd00 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:31.154732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f92b03f4-c308-4208-b46f-d64a63d1cd00 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:31.162102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f92b03f4-c308-4208-b46f-d64a63d1cd00 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:31.162782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f92b03f4-c308-4208-b46f-d64a63d1cd00 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:31.396515 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f92b03f4-c308-4208-b46f-d64a63d1cd00 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:31.411070 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f92b03f4-c308-4208-b46f-d64a63d1cd00 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:31.413039 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f92b03f4-c308-4208-b46f-d64a63d1cd00 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:31.414524 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f92b03f4-c308-4208-b46f-d64a63d1cd00 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1366 microversion: 2.57 time: 0.287328 Jul 25 12:59:31.415354 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1940/3785] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:31 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:31.431286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b76d61af-a430-4b82-b417-f1f884910ebb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:31.437708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b76d61af-a430-4b82-b417-f1f884910ebb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:31.459165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b76d61af-a430-4b82-b417-f1f884910ebb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:31.459877 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b76d61af-a430-4b82-b417-f1f884910ebb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:31.460856 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b76d61af-a430-4b82-b417-f1f884910ebb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:31.461459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b76d61af-a430-4b82-b417-f1f884910ebb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:31.768262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b76d61af-a430-4b82-b417-f1f884910ebb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:31.777482 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b76d61af-a430-4b82-b417-f1f884910ebb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1272 microversion: 2.1 time: 0.360848 Jul 25 12:59:31.782118 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1941/3786] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:31 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1272 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:32.441950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-194c63de-c1a2-4a80-b512-76bbc22b9f25 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:32.442772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-194c63de-c1a2-4a80-b512-76bbc22b9f25 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:32.474255 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-194c63de-c1a2-4a80-b512-76bbc22b9f25 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:32.478287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-194c63de-c1a2-4a80-b512-76bbc22b9f25 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:32.479273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-194c63de-c1a2-4a80-b512-76bbc22b9f25 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:32.479826 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-194c63de-c1a2-4a80-b512-76bbc22b9f25 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:32.556727 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:32.837507 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-194c63de-c1a2-4a80-b512-76bbc22b9f25 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:32.850430 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-194c63de-c1a2-4a80-b512-76bbc22b9f25 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:32.852364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-194c63de-c1a2-4a80-b512-76bbc22b9f25 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:32.857319 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-194c63de-c1a2-4a80-b512-76bbc22b9f25 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1366 microversion: 2.57 time: 0.420095 Jul 25 12:59:32.862429 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1942/3787] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:32 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:59:32.876048 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-030b971f-3377-45fc-ab7d-edc3404d21fc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:32.876692 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-030b971f-3377-45fc-ab7d-edc3404d21fc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:32.889533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-030b971f-3377-45fc-ab7d-edc3404d21fc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:32.890024 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-030b971f-3377-45fc-ab7d-edc3404d21fc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:32.893019 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-030b971f-3377-45fc-ab7d-edc3404d21fc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:32.894532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-030b971f-3377-45fc-ab7d-edc3404d21fc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:33.608075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-030b971f-3377-45fc-ab7d-edc3404d21fc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:33.618490 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-030b971f-3377-45fc-ab7d-edc3404d21fc tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1272 microversion: 2.1 time: 0.754830 Jul 25 12:59:33.619609 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1943/3788] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:32 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1272 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:33.785007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c5d63590-36bd-4761-94a8-10a3900f20b2 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:59:33.787013 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c5d63590-36bd-4761-94a8-10a3900f20b2 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:59:33.787744 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c5d63590-36bd-4761-94a8-10a3900f20b2 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:59:33.788387 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c5d63590-36bd-4761-94a8-10a3900f20b2 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:59:33.789036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c5d63590-36bd-4761-94a8-10a3900f20b2 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:59:33.804365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5d63590-36bd-4761-94a8-10a3900f20b2 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:33.805239 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5d63590-36bd-4761-94a8-10a3900f20b2 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:33.806609 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5d63590-36bd-4761-94a8-10a3900f20b2 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:33.807492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5d63590-36bd-4761-94a8-10a3900f20b2 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:33.842620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-c5d63590-36bd-4761-94a8-10a3900f20b2 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Getting quotas for project bb007c5b5f894bc0a31b2c166b53adac. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:59:33.848904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-c5d63590-36bd-4761-94a8-10a3900f20b2 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Getting quotas for user ad62262b424640728ef148dfaae6e074 and project bb007c5b5f894bc0a31b2c166b53adac. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:59:33.873054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c5d63590-36bd-4761-94a8-10a3900f20b2 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:59:33.891354 n-d-848886-15 devstack@n-api.service[125883]: WARNING nova.utils [None req-c5d63590-36bd-4761-94a8-10a3900f20b2 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-749125150-access_point-399180726 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-749125150-acc Jul 25 12:59:33.891354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c5d63590-36bd-4761-94a8-10a3900f20b2 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 3a938f7a-a9f5-4888-95f3-bde7040a576f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:59:33.894638 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e021ee2d-2522-476a-9e4d-7a149228f3f0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:33.896383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e021ee2d-2522-476a-9e4d-7a149228f3f0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:33.927035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e021ee2d-2522-476a-9e4d-7a149228f3f0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:33.927663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e021ee2d-2522-476a-9e4d-7a149228f3f0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:33.928854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e021ee2d-2522-476a-9e4d-7a149228f3f0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:33.929524 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e021ee2d-2522-476a-9e4d-7a149228f3f0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:33.956836 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c5d63590-36bd-4761-94a8-10a3900f20b2 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 4.047656 Jul 25 12:59:33.964908 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1846/3789] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:59:29 2022] POST /compute/v2.1/servers => generated 457 bytes in 4056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:59:33.971748 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d06bbfb3-6557-4b3d-b48d-74bfeb1cd56a tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:33.973591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d06bbfb3-6557-4b3d-b48d-74bfeb1cd56a tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 3a938f7a-a9f5-4888-95f3-bde7040a576f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:34.251448 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d06bbfb3-6557-4b3d-b48d-74bfeb1cd56a tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:34.284306 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d06bbfb3-6557-4b3d-b48d-74bfeb1cd56a tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f" status: 200 len: 1292 microversion: 2.1 time: 0.313092 Jul 25 12:59:34.289470 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1847/3790] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:33 2022] GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f => generated 1292 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:59:34.302094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-597ae3b1-b0ed-43cf-b292-3df0119806d5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-418334352", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "97beeed7-7564-4203-abda-feef7e93cd98", "destination_type": "local"}, {"source_type": "volume", "uuid": "66ddaf90-e051-4652-8b13-3b780df2f33f", "destination_type": "invalid"}], "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-597ae3b1-b0ed-43cf-b292-3df0119806d5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 494 Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-418334352", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "97beeed7-7564-4203-abda-feef7e93cd98", "destination_type": "local"}, {"source_type": "volume", "uuid": "66ddaf90-e051-4652-8b13-3b780df2f33f", "destination_type": "invalid"}], "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-418334352', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '97beeed7-7564-4203-abda-feef7e93cd98', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '66ddaf90-e051-4652-8b13-3b780df2f33f', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'dc975d58-9818-4c8b-8bcd-8b1a23df5609'}]}}} Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'invalid' Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:59:34.309583 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:59:34.315743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:59:34.315743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:59:34.315743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:59:34.315743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:59:34.315743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:59:34.315743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:59:34.315743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:59:34.315743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:59:34.315743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 25 12:59:34.315743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:34.315743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:34.315743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:34.315743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:34.315743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:34.315743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:34.315743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:59:34.315743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:59:34.315743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 25 12:59:34.315743 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:34.319931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-597ae3b1-b0ed-43cf-b292-3df0119806d5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:59:34.320856 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-597ae3b1-b0ed-43cf-b292-3df0119806d5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.027360 Jul 25 12:59:34.324758 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1848/3791] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:59:34 2022] POST /compute/v2.1/servers => generated 155 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:59:34.338458 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b17f2997-a362-4450-b86d-646d174166d4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:34.340737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b17f2997-a362-4450-b86d-646d174166d4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:34.353676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b17f2997-a362-4450-b86d-646d174166d4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:34.354252 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b17f2997-a362-4450-b86d-646d174166d4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:34.355393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b17f2997-a362-4450-b86d-646d174166d4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:34.356726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b17f2997-a362-4450-b86d-646d174166d4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:34.717122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e021ee2d-2522-476a-9e4d-7a149228f3f0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:34.732589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e021ee2d-2522-476a-9e4d-7a149228f3f0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:34.736812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e021ee2d-2522-476a-9e4d-7a149228f3f0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:34.739500 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e021ee2d-2522-476a-9e4d-7a149228f3f0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1366 microversion: 2.57 time: 0.857245 Jul 25 12:59:34.742032 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1944/3792] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:33 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1366 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:34.749122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4b2efd8e-f689-4111-8210-6ef49408d900 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:34.750356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4b2efd8e-f689-4111-8210-6ef49408d900 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:34.759526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4b2efd8e-f689-4111-8210-6ef49408d900 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:34.760798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4b2efd8e-f689-4111-8210-6ef49408d900 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:34.762074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4b2efd8e-f689-4111-8210-6ef49408d900 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:34.762866 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4b2efd8e-f689-4111-8210-6ef49408d900 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:35.222178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b17f2997-a362-4450-b86d-646d174166d4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:35.238076 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b17f2997-a362-4450-b86d-646d174166d4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.911747 Jul 25 12:59:35.239427 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1849/3793] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:34 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:35.266407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-931478ca-e48c-4bf7-996b-3a0182828dab tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:35.268017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-931478ca-e48c-4bf7-996b-3a0182828dab tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:35.287032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-931478ca-e48c-4bf7-996b-3a0182828dab tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:35.287938 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-931478ca-e48c-4bf7-996b-3a0182828dab tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:35.288898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-931478ca-e48c-4bf7-996b-3a0182828dab tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:35.290753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-931478ca-e48c-4bf7-996b-3a0182828dab tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:35.443781 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4b2efd8e-f689-4111-8210-6ef49408d900 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:35.485219 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4b2efd8e-f689-4111-8210-6ef49408d900 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1314 microversion: 2.1 time: 0.740121 Jul 25 12:59:35.502972 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1945/3794] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:34 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1314 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:35.526622 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fe715432-1c52-4ab0-85b1-5db0ae6db2ad tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:35.527379 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fe715432-1c52-4ab0-85b1-5db0ae6db2ad tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 3a938f7a-a9f5-4888-95f3-bde7040a576f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:35.543098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fe715432-1c52-4ab0-85b1-5db0ae6db2ad tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:35.543928 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fe715432-1c52-4ab0-85b1-5db0ae6db2ad tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:35.545288 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fe715432-1c52-4ab0-85b1-5db0ae6db2ad tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:35.546429 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fe715432-1c52-4ab0-85b1-5db0ae6db2ad tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:35.714169 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fe715432-1c52-4ab0-85b1-5db0ae6db2ad tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:35.727168 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fe715432-1c52-4ab0-85b1-5db0ae6db2ad tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f" status: 200 len: 1362 microversion: 2.1 time: 0.222722 Jul 25 12:59:35.729292 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1946/3795] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:35 2022] GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:35.742201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-931478ca-e48c-4bf7-996b-3a0182828dab tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:35.751730 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-931478ca-e48c-4bf7-996b-3a0182828dab tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.490571 Jul 25 12:59:35.766780 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1850/3796] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:35 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:35.769588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6cf2fa16-282a-4f98-83fd-e258ba54905a tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:35.769588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6cf2fa16-282a-4f98-83fd-e258ba54905a tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:35.779302 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cf2fa16-282a-4f98-83fd-e258ba54905a tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:35.779767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cf2fa16-282a-4f98-83fd-e258ba54905a tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:35.781521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cf2fa16-282a-4f98-83fd-e258ba54905a tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:35.782177 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cf2fa16-282a-4f98-83fd-e258ba54905a tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:35.833781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-23c5d2e8-0e17-4155-9a1b-4d0f0a7df013 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-889652117", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-23c5d2e8-0e17-4155-9a1b-4d0f0a7df013 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 491 Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-889652117", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-889652117', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'dc975d58-9818-4c8b-8bcd-8b1a23df5609'}]}}} Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 25 12:59:35.838808 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 25 12:59:35.843514 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:35.846948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-23c5d2e8-0e17-4155-9a1b-4d0f0a7df013 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:59:35.848100 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-23c5d2e8-0e17-4155-9a1b-4d0f0a7df013 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.018529 Jul 25 12:59:35.849488 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1851/3797] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:59:35 2022] POST /compute/v2.1/servers => generated 624 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:59:35.861723 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ce2cb175-cc8c-4f78-b42e-2e75762a83ec tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:35.862661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ce2cb175-cc8c-4f78-b42e-2e75762a83ec tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:35.878223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ce2cb175-cc8c-4f78-b42e-2e75762a83ec tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:35.879094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ce2cb175-cc8c-4f78-b42e-2e75762a83ec tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:35.880297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ce2cb175-cc8c-4f78-b42e-2e75762a83ec tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:35.880917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ce2cb175-cc8c-4f78-b42e-2e75762a83ec tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:35.885725 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:35.943040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6cf2fa16-282a-4f98-83fd-e258ba54905a tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:35.954830 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6cf2fa16-282a-4f98-83fd-e258ba54905a tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:35.957237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6cf2fa16-282a-4f98-83fd-e258ba54905a tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:35.958724 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6cf2fa16-282a-4f98-83fd-e258ba54905a tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1366 microversion: 2.57 time: 0.199787 Jul 25 12:59:35.962191 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1947/3798] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:35 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:59:36.489535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ce2cb175-cc8c-4f78-b42e-2e75762a83ec tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:36.515232 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ce2cb175-cc8c-4f78-b42e-2e75762a83ec tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.661186 Jul 25 12:59:36.517159 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1852/3799] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:35 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:36.517969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e4f55797-208b-4652-9ff2-e48bf0762118 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:36.519017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e4f55797-208b-4652-9ff2-e48bf0762118 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:36.536059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4f55797-208b-4652-9ff2-e48bf0762118 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:36.538905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4f55797-208b-4652-9ff2-e48bf0762118 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:36.542153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4f55797-208b-4652-9ff2-e48bf0762118 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:36.543628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4f55797-208b-4652-9ff2-e48bf0762118 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:36.548043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ca8d51c7-1577-4b35-8d8d-5542d041f196 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:36.548043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ca8d51c7-1577-4b35-8d8d-5542d041f196 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:36.562938 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca8d51c7-1577-4b35-8d8d-5542d041f196 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:36.563742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca8d51c7-1577-4b35-8d8d-5542d041f196 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:36.564760 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca8d51c7-1577-4b35-8d8d-5542d041f196 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:36.565678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca8d51c7-1577-4b35-8d8d-5542d041f196 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:37.256858 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e4f55797-208b-4652-9ff2-e48bf0762118 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:37.272711 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e4f55797-208b-4652-9ff2-e48bf0762118 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1314 microversion: 2.1 time: 0.767407 Jul 25 12:59:37.273402 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1948/3800] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:36 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1314 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:59:37.291017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-05361d49-e2fa-4a0b-a9f5-10e911fc82f3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:37.291700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-05361d49-e2fa-4a0b-a9f5-10e911fc82f3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 3a938f7a-a9f5-4888-95f3-bde7040a576f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:37.304024 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05361d49-e2fa-4a0b-a9f5-10e911fc82f3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:37.304488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05361d49-e2fa-4a0b-a9f5-10e911fc82f3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:37.307259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05361d49-e2fa-4a0b-a9f5-10e911fc82f3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:37.308209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05361d49-e2fa-4a0b-a9f5-10e911fc82f3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:37.497602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:38.086043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=8 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:38.216586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ca8d51c7-1577-4b35-8d8d-5542d041f196 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:38.225663 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ca8d51c7-1577-4b35-8d8d-5542d041f196 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 1.684616 Jul 25 12:59:38.226938 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1853/3801] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:36 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:38.247667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bb93ff85-01f3-4be2-bb08-1bc83bedfaff tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:38.248581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bb93ff85-01f3-4be2-bb08-1bc83bedfaff tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:38.260570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bb93ff85-01f3-4be2-bb08-1bc83bedfaff tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:38.261059 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bb93ff85-01f3-4be2-bb08-1bc83bedfaff tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:38.261972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bb93ff85-01f3-4be2-bb08-1bc83bedfaff tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:38.262467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bb93ff85-01f3-4be2-bb08-1bc83bedfaff tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:38.501586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bb93ff85-01f3-4be2-bb08-1bc83bedfaff tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:38.516867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bb93ff85-01f3-4be2-bb08-1bc83bedfaff tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:38.524313 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bb93ff85-01f3-4be2-bb08-1bc83bedfaff tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:38.529742 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bb93ff85-01f3-4be2-bb08-1bc83bedfaff tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1366 microversion: 2.57 time: 0.295808 Jul 25 12:59:38.530442 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1854/3802] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:38 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:38.540222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-0cbaa546-2df4-4213-9b1e-a8535e712811 req-b36ead5d-d284-4703-97a9-49745a829458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a938f7a-a9f5-4888-95f3-bde7040a576f", "tag": "f572ee52-4fc3-4d61-b470-92ec430cead6"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:38.552479 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0cbaa546-2df4-4213-9b1e-a8535e712811 req-b36ead5d-d284-4703-97a9-49745a829458 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:38.559697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0cbaa546-2df4-4213-9b1e-a8535e712811 req-b36ead5d-d284-4703-97a9-49745a829458 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:38.583710 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-0cbaa546-2df4-4213-9b1e-a8535e712811 req-b36ead5d-d284-4703-97a9-49745a829458 service nova] Creating event network-changed:f572ee52-4fc3-4d61-b470-92ec430cead6 for instance 3a938f7a-a9f5-4888-95f3-bde7040a576f on n-h2-848886-15 Jul 25 12:59:38.600017 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-0cbaa546-2df4-4213-9b1e-a8535e712811 req-b36ead5d-d284-4703-97a9-49745a829458 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067986 Jul 25 12:59:38.603083 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1855/3803] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:59:38.612556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dd963f43-79c5-4435-9b88-9c0d919383ba tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:38.613686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dd963f43-79c5-4435-9b88-9c0d919383ba tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:38.624439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dd963f43-79c5-4435-9b88-9c0d919383ba tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:38.625660 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dd963f43-79c5-4435-9b88-9c0d919383ba tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:38.627247 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dd963f43-79c5-4435-9b88-9c0d919383ba tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:38.628251 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dd963f43-79c5-4435-9b88-9c0d919383ba tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:38.736124 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-05361d49-e2fa-4a0b-a9f5-10e911fc82f3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:38.755068 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-05361d49-e2fa-4a0b-a9f5-10e911fc82f3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f" status: 200 len: 1469 microversion: 2.1 time: 1.480420 Jul 25 12:59:38.757476 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1949/3804] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:37 2022] GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f => generated 1469 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:38.764835 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fe887f4d-4745-4dc3-8ee5-4f6bf481bfbb tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fe887f4d-4745-4dc3-8ee5-4f6bf481bfbb tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 416 Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452', 'networks': [{'uuid': 'dc975d58-9818-4c8b-8bcd-8b1a23df5609'}]}}} Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:38.778573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 12:59:38.782323 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:38.785666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fe887f4d-4745-4dc3-8ee5-4f6bf481bfbb tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:59:38.786983 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fe887f4d-4745-4dc3-8ee5-4f6bf481bfbb tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.028129 Jul 25 12:59:38.788177 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1950/3805] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:59:38 2022] POST /compute/v2.1/servers => generated 619 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:59:38.798088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ff93a50e-c3e6-4aa6-b74e-596ac51be424 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:38.799390 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ff93a50e-c3e6-4aa6-b74e-596ac51be424 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:38.813342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff93a50e-c3e6-4aa6-b74e-596ac51be424 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:38.813797 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff93a50e-c3e6-4aa6-b74e-596ac51be424 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:38.814899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff93a50e-c3e6-4aa6-b74e-596ac51be424 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:38.816615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff93a50e-c3e6-4aa6-b74e-596ac51be424 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:39.204568 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dd963f43-79c5-4435-9b88-9c0d919383ba tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:39.215618 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dd963f43-79c5-4435-9b88-9c0d919383ba tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1314 microversion: 2.1 time: 0.609111 Jul 25 12:59:39.216225 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1856/3806] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:38 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:39.274566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-ed2a078c-0017-41fe-be3e-e327fdea726f req-182c008f-041f-4810-8da4-9754a2bf5a97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9787fc-a4e1-41f8-be82-3f68c14ad254", "tag": "cce124d7-06ab-47f8-9713-88ca17dcee95"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:39.291548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ff93a50e-c3e6-4aa6-b74e-596ac51be424 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:39.294257 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ed2a078c-0017-41fe-be3e-e327fdea726f req-182c008f-041f-4810-8da4-9754a2bf5a97 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:39.294738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ed2a078c-0017-41fe-be3e-e327fdea726f req-182c008f-041f-4810-8da4-9754a2bf5a97 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:39.300513 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ff93a50e-c3e6-4aa6-b74e-596ac51be424 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.507398 Jul 25 12:59:39.304842 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1951/3807] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:38 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:39.309846 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-ed2a078c-0017-41fe-be3e-e327fdea726f req-182c008f-041f-4810-8da4-9754a2bf5a97 service nova] Creating event network-changed:cce124d7-06ab-47f8-9713-88ca17dcee95 for instance 8d9787fc-a4e1-41f8-be82-3f68c14ad254 on n-h2-848886-15 Jul 25 12:59:39.320902 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-ed2a078c-0017-41fe-be3e-e327fdea726f req-182c008f-041f-4810-8da4-9754a2bf5a97 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052483 Jul 25 12:59:39.322413 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1857/3808] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:59:39.338638 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-519388a5-41a5-4233-a266-d8d68fb0dcf5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:39.339590 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-519388a5-41a5-4233-a266-d8d68fb0dcf5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:39.347235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-519388a5-41a5-4233-a266-d8d68fb0dcf5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:39.347782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-519388a5-41a5-4233-a266-d8d68fb0dcf5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:39.348869 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-519388a5-41a5-4233-a266-d8d68fb0dcf5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:39.349871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-519388a5-41a5-4233-a266-d8d68fb0dcf5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:39.558786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9b91fa55-be7e-4d0d-8ebb-30c6438128d0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:39.559501 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9b91fa55-be7e-4d0d-8ebb-30c6438128d0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:39.576643 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b91fa55-be7e-4d0d-8ebb-30c6438128d0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:39.577587 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b91fa55-be7e-4d0d-8ebb-30c6438128d0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:39.578640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b91fa55-be7e-4d0d-8ebb-30c6438128d0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:39.579070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b91fa55-be7e-4d0d-8ebb-30c6438128d0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:39.802888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9b91fa55-be7e-4d0d-8ebb-30c6438128d0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:39.820785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9b91fa55-be7e-4d0d-8ebb-30c6438128d0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:39.827884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9b91fa55-be7e-4d0d-8ebb-30c6438128d0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:39.830663 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9b91fa55-be7e-4d0d-8ebb-30c6438128d0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1366 microversion: 2.57 time: 0.276823 Jul 25 12:59:39.832729 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1858/3809] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:39 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:59:39.845091 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1b446277-cd91-474e-8818-a77506d10780 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:39.846632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1b446277-cd91-474e-8818-a77506d10780 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 3a938f7a-a9f5-4888-95f3-bde7040a576f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:39.861633 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b446277-cd91-474e-8818-a77506d10780 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:39.863809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b446277-cd91-474e-8818-a77506d10780 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:39.864883 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b446277-cd91-474e-8818-a77506d10780 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:39.865641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b446277-cd91-474e-8818-a77506d10780 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:39.922308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-519388a5-41a5-4233-a266-d8d68fb0dcf5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:39.931459 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-519388a5-41a5-4233-a266-d8d68fb0dcf5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.597392 Jul 25 12:59:39.935548 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1952/3810] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:39 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:40.077549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ba8a7950-4ee7-4b69-90d9-0fc5391df8a4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1368610435", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": -1, "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:40.106528 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-ba8a7950-4ee7-4b69-90d9-0fc5391df8a4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Flavor -1 could not be found. Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ba8a7950-4ee7-4b69-90d9-0fc5391df8a4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 206 Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1368610435", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": -1, "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: exception: Flavor -1 could not be found. Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1368610435', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': -1, 'networks': [{'uuid': 'dc975d58-9818-4c8b-8bcd-8b1a23df5609'}]}}} Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:59:40.111958 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:59:40.118075 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:59:40.118075 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:59:40.118075 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:59:40.118075 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:59:40.118075 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 12:59:40.118075 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 25 12:59:40.118075 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 25 12:59:40.118075 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 25 12:59:40.118075 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:40.118075 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:40.118075 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:40.118075 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:40.118075 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:40.118075 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:40.118075 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:59:40.118075 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:59:40.118075 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 25 12:59:40.118075 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:40.118075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ba8a7950-4ee7-4b69-90d9-0fc5391df8a4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:59:40.118075 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ba8a7950-4ee7-4b69-90d9-0fc5391df8a4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.045294 Jul 25 12:59:40.123861 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1953/3811] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:59:40 2022] POST /compute/v2.1/servers => generated 73 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 25 12:59:40.132844 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f44b17c8-a81d-4dc8-8a61-6bc7a9779f1d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:40.133476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f44b17c8-a81d-4dc8-8a61-6bc7a9779f1d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:40.155822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f44b17c8-a81d-4dc8-8a61-6bc7a9779f1d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:40.159539 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f44b17c8-a81d-4dc8-8a61-6bc7a9779f1d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:40.162459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f44b17c8-a81d-4dc8-8a61-6bc7a9779f1d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:40.163512 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f44b17c8-a81d-4dc8-8a61-6bc7a9779f1d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:40.449595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1b446277-cd91-474e-8818-a77506d10780 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:40.458745 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1b446277-cd91-474e-8818-a77506d10780 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f" status: 200 len: 1469 microversion: 2.1 time: 0.624611 Jul 25 12:59:40.472142 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1859/3812] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:39 2022] GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f => generated 1469 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:40.477317 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a2826218-ae7a-4cfa-9b65-79c9a6ab1d16 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:40.485602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a2826218-ae7a-4cfa-9b65-79c9a6ab1d16 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:40.497916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2826218-ae7a-4cfa-9b65-79c9a6ab1d16 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:40.504541 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2826218-ae7a-4cfa-9b65-79c9a6ab1d16 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:40.505437 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2826218-ae7a-4cfa-9b65-79c9a6ab1d16 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:40.505939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2826218-ae7a-4cfa-9b65-79c9a6ab1d16 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:40.950260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f44b17c8-a81d-4dc8-8a61-6bc7a9779f1d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:40.991221 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f44b17c8-a81d-4dc8-8a61-6bc7a9779f1d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.860615 Jul 25 12:59:40.993101 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1954/3813] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:40 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:41.005801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-eb55a5a9-3bb2-4f8a-9fe9-746bfb4ff57c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:41.006491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eb55a5a9-3bb2-4f8a-9fe9-746bfb4ff57c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:41.029570 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb55a5a9-3bb2-4f8a-9fe9-746bfb4ff57c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:41.030066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb55a5a9-3bb2-4f8a-9fe9-746bfb4ff57c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:41.030892 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb55a5a9-3bb2-4f8a-9fe9-746bfb4ff57c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:41.031338 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb55a5a9-3bb2-4f8a-9fe9-746bfb4ff57c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:41.292709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-eb55a5a9-3bb2-4f8a-9fe9-746bfb4ff57c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:41.312871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-eb55a5a9-3bb2-4f8a-9fe9-746bfb4ff57c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:41.318146 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-eb55a5a9-3bb2-4f8a-9fe9-746bfb4ff57c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:41.322296 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-eb55a5a9-3bb2-4f8a-9fe9-746bfb4ff57c tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1366 microversion: 2.57 time: 0.325891 Jul 25 12:59:41.339809 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1955/3814] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:40 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:41.344629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a2826218-ae7a-4cfa-9b65-79c9a6ab1d16 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:41.357157 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a2826218-ae7a-4cfa-9b65-79c9a6ab1d16 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1314 microversion: 2.1 time: 0.883584 Jul 25 12:59:41.364864 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1860/3815] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:40 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1314 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:41.367094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-973ae10d-c567-49c8-9978-bbb315036f03 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:41.367990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-973ae10d-c567-49c8-9978-bbb315036f03 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:41.377259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-973ae10d-c567-49c8-9978-bbb315036f03 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:41.377991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-973ae10d-c567-49c8-9978-bbb315036f03 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:41.380044 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-973ae10d-c567-49c8-9978-bbb315036f03 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:41.380901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-973ae10d-c567-49c8-9978-bbb315036f03 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:41.502294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4e551837-5300-4f54-9ca7-8e66da0d1461 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:41.505456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4e551837-5300-4f54-9ca7-8e66da0d1461 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 3a938f7a-a9f5-4888-95f3-bde7040a576f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:41.522273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e551837-5300-4f54-9ca7-8e66da0d1461 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:41.524188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e551837-5300-4f54-9ca7-8e66da0d1461 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:41.525682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e551837-5300-4f54-9ca7-8e66da0d1461 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:41.527288 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e551837-5300-4f54-9ca7-8e66da0d1461 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:41.878915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-973ae10d-c567-49c8-9978-bbb315036f03 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:41.888423 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-973ae10d-c567-49c8-9978-bbb315036f03 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.537782 Jul 25 12:59:41.893413 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1956/3816] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:41 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:42.005516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-53d1db68-78cc-4601-9bd2-118d841e38c8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-803753216", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:42.006257 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4e551837-5300-4f54-9ca7-8e66da0d1461 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-53d1db68-78cc-4601-9bd2-118d841e38c8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 172 Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-803753216", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-803753216', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'dc975d58-9818-4c8b-8bcd-8b1a23df5609'}]}}} Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi -1 Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:59:42.012628 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:59:42.031245 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:59:42.031245 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:59:42.031245 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 25 12:59:42.031245 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:42.031245 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:42.031245 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:42.031245 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:42.031245 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:42.031245 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:42.031245 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:59:42.031245 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:59:42.031245 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 25 12:59:42.031245 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:42.034383 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4e551837-5300-4f54-9ca7-8e66da0d1461 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f" status: 200 len: 1469 microversion: 2.1 time: 0.523145 Jul 25 12:59:42.034383 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1861/3817] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:41 2022] GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f => generated 1469 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:42.036114 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-53d1db68-78cc-4601-9bd2-118d841e38c8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:59:42.038158 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-53d1db68-78cc-4601-9bd2-118d841e38c8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.036871 Jul 25 12:59:42.042625 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1957/3818] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:59:41 2022] POST /compute/v2.1/servers => generated 145 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:59:42.047792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-417acba8-028f-4625-9999-202e2558d687 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:42.048994 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-417acba8-028f-4625-9999-202e2558d687 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:42.060678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-417acba8-028f-4625-9999-202e2558d687 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:42.061138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-417acba8-028f-4625-9999-202e2558d687 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:42.064061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-417acba8-028f-4625-9999-202e2558d687 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:42.064536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-417acba8-028f-4625-9999-202e2558d687 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:42.352092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f32b8027-e30e-4799-869b-f4f0956137f0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:42.353153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f32b8027-e30e-4799-869b-f4f0956137f0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:42.376938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f32b8027-e30e-4799-869b-f4f0956137f0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:42.385455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f32b8027-e30e-4799-869b-f4f0956137f0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:42.388392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f32b8027-e30e-4799-869b-f4f0956137f0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:42.389755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f32b8027-e30e-4799-869b-f4f0956137f0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:42.398910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-417acba8-028f-4625-9999-202e2558d687 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:42.416930 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-417acba8-028f-4625-9999-202e2558d687 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.370749 Jul 25 12:59:42.417919 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1862/3819] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:42 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:42.432740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-189c637a-3a80-4e2d-abf5-afdc4ca28438 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:42.433633 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-189c637a-3a80-4e2d-abf5-afdc4ca28438 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:42.450709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-189c637a-3a80-4e2d-abf5-afdc4ca28438 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:42.451426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-189c637a-3a80-4e2d-abf5-afdc4ca28438 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:42.455569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-189c637a-3a80-4e2d-abf5-afdc4ca28438 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:42.456169 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-189c637a-3a80-4e2d-abf5-afdc4ca28438 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:43.183697 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f32b8027-e30e-4799-869b-f4f0956137f0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:43.202545 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f32b8027-e30e-4799-869b-f4f0956137f0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:43.212739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f32b8027-e30e-4799-869b-f4f0956137f0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:43.216037 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f32b8027-e30e-4799-869b-f4f0956137f0 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1366 microversion: 2.57 time: 0.869345 Jul 25 12:59:43.219503 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1958/3820] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:42 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1366 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:43.234320 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cb19179d-e12d-49a2-bc11-e1b328f11094 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:43.236766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cb19179d-e12d-49a2-bc11-e1b328f11094 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:43.254941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb19179d-e12d-49a2-bc11-e1b328f11094 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:43.259607 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb19179d-e12d-49a2-bc11-e1b328f11094 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:43.261269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb19179d-e12d-49a2-bc11-e1b328f11094 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:43.263984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb19179d-e12d-49a2-bc11-e1b328f11094 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:43.319793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-189c637a-3a80-4e2d-abf5-afdc4ca28438 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:43.334976 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-189c637a-3a80-4e2d-abf5-afdc4ca28438 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1314 microversion: 2.1 time: 0.909453 Jul 25 12:59:43.335996 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1863/3821] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:42 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1314 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:43.351430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-37d3ad8e-509e-4e94-b60b-bd5b019219b7 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:43.352087 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-37d3ad8e-509e-4e94-b60b-bd5b019219b7 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 3a938f7a-a9f5-4888-95f3-bde7040a576f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:43.363228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37d3ad8e-509e-4e94-b60b-bd5b019219b7 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:43.368012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37d3ad8e-509e-4e94-b60b-bd5b019219b7 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:43.369065 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37d3ad8e-509e-4e94-b60b-bd5b019219b7 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:43.369669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37d3ad8e-509e-4e94-b60b-bd5b019219b7 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:43.795904 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cb19179d-e12d-49a2-bc11-e1b328f11094 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:43.817214 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cb19179d-e12d-49a2-bc11-e1b328f11094 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.593464 Jul 25 12:59:43.822560 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:43.832383 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1959/3822] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:43 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:43.866164 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-37d3ad8e-509e-4e94-b60b-bd5b019219b7 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:43.883237 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-37d3ad8e-509e-4e94-b60b-bd5b019219b7 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f" status: 200 len: 1469 microversion: 2.1 time: 0.545824 Jul 25 12:59:43.883894 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1864/3823] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:43 2022] GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f => generated 1469 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:43.937156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-17294983-2dfd-47c1-9e81-324441d6e5f5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1755304407", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:43.949459 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-17294983-2dfd-47c1-9e81-324441d6e5f5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-17294983-2dfd-47c1-9e81-324441d6e5f5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 216 Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1755304407", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1755304407', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:43.952530 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:43.956610 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:43.956610 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:43.956610 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:43.956610 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:59:43.956610 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:59:43.956610 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 25 12:59:43.956610 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:43.964097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-17294983-2dfd-47c1-9e81-324441d6e5f5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:59:43.966495 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-17294983-2dfd-47c1-9e81-324441d6e5f5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.033847 Jul 25 12:59:43.979123 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-906bb26d-f4a9-450d-960c-da083e1dcdf2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:43.980275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-906bb26d-f4a9-450d-960c-da083e1dcdf2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:43.988034 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-906bb26d-f4a9-450d-960c-da083e1dcdf2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:43.988458 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1960/3824] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:59:43 2022] POST /compute/v2.1/servers => generated 123 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:59:43.990527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-906bb26d-f4a9-450d-960c-da083e1dcdf2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:43.991691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-906bb26d-f4a9-450d-960c-da083e1dcdf2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:43.998615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-906bb26d-f4a9-450d-960c-da083e1dcdf2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:44.168998 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-334068f5-1604-4a18-b5a6-7d2eaff37084 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1099972097", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "185649f9-4b95-4535-a9cc-e40762d62930"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:44.273065 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=12 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:44.277512 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-334068f5-1604-4a18-b5a6-7d2eaff37084 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] validate_networks() for [('185649f9-4b95-4535-a9cc-e40762d62930', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:59:44.561557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-906bb26d-f4a9-450d-960c-da083e1dcdf2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:44.591970 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-906bb26d-f4a9-450d-960c-da083e1dcdf2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.616713 Jul 25 12:59:44.594704 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1865/3825] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:43 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:44.619087 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-732847c6-eb34-4782-b5ea-b89ed11863ea tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:44.620150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-732847c6-eb34-4782-b5ea-b89ed11863ea tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:44.637066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-732847c6-eb34-4782-b5ea-b89ed11863ea tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:44.638593 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-732847c6-eb34-4782-b5ea-b89ed11863ea tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:44.639722 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-732847c6-eb34-4782-b5ea-b89ed11863ea tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:44.642399 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-732847c6-eb34-4782-b5ea-b89ed11863ea tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:44.825395 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-732847c6-eb34-4782-b5ea-b89ed11863ea tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:44.841700 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-732847c6-eb34-4782-b5ea-b89ed11863ea tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:44.848287 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-732847c6-eb34-4782-b5ea-b89ed11863ea tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:44.849734 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-732847c6-eb34-4782-b5ea-b89ed11863ea tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1366 microversion: 2.57 time: 0.251671 Jul 25 12:59:44.850375 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1866/3826] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:44 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:44.854998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7b40a4d5-b436-47d3-b360-6ea85765e9b2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:44.855619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7b40a4d5-b436-47d3-b360-6ea85765e9b2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:44.874709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b40a4d5-b436-47d3-b360-6ea85765e9b2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:44.875174 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b40a4d5-b436-47d3-b360-6ea85765e9b2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:44.876284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b40a4d5-b436-47d3-b360-6ea85765e9b2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:44.876728 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b40a4d5-b436-47d3-b360-6ea85765e9b2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:45.423261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7b40a4d5-b436-47d3-b360-6ea85765e9b2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:45.434958 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7b40a4d5-b436-47d3-b360-6ea85765e9b2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1314 microversion: 2.1 time: 0.583301 Jul 25 12:59:45.449515 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1867/3827] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:44 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:45.455392 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c79c1022-6064-4471-88fc-7611253f8832 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:45.455846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-334068f5-1604-4a18-b5a6-7d2eaff37084 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:59:45.456325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-334068f5-1604-4a18-b5a6-7d2eaff37084 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:59:45.456742 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-334068f5-1604-4a18-b5a6-7d2eaff37084 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:59:45.457056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c79c1022-6064-4471-88fc-7611253f8832 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:45.457183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-334068f5-1604-4a18-b5a6-7d2eaff37084 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:59:45.457642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-334068f5-1604-4a18-b5a6-7d2eaff37084 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:59:45.459954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:45.465903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c79c1022-6064-4471-88fc-7611253f8832 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:45.467732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c79c1022-6064-4471-88fc-7611253f8832 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:45.468790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c79c1022-6064-4471-88fc-7611253f8832 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:45.469550 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c79c1022-6064-4471-88fc-7611253f8832 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:45.480151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-334068f5-1604-4a18-b5a6-7d2eaff37084 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:45.482889 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-334068f5-1604-4a18-b5a6-7d2eaff37084 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:45.484896 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-334068f5-1604-4a18-b5a6-7d2eaff37084 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:45.485377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-334068f5-1604-4a18-b5a6-7d2eaff37084 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:45.510222 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-334068f5-1604-4a18-b5a6-7d2eaff37084 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Getting quotas for project 1fd8dc38f32c4c03a73af0666752d6a4. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:59:45.535812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-334068f5-1604-4a18-b5a6-7d2eaff37084 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Getting quotas for user 4b66df4d397a40dd8606928b3be2e458 and project 1fd8dc38f32c4c03a73af0666752d6a4. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:59:45.579055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-334068f5-1604-4a18-b5a6-7d2eaff37084 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:59:45.584303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-334068f5-1604-4a18-b5a6-7d2eaff37084 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:59:45.728290 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-334068f5-1604-4a18-b5a6-7d2eaff37084 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.676479 Jul 25 12:59:45.729262 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1961/3828] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:59:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:59:45.745972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2a09aa3c-a04b-4d69-8deb-2e56f0120b47 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:45.752767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2a09aa3c-a04b-4d69-8deb-2e56f0120b47 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 3a938f7a-a9f5-4888-95f3-bde7040a576f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:45.763719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a09aa3c-a04b-4d69-8deb-2e56f0120b47 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:45.767153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a09aa3c-a04b-4d69-8deb-2e56f0120b47 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:45.768424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a09aa3c-a04b-4d69-8deb-2e56f0120b47 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:45.768871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a09aa3c-a04b-4d69-8deb-2e56f0120b47 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:45.777352 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c79c1022-6064-4471-88fc-7611253f8832 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:45.786985 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c79c1022-6064-4471-88fc-7611253f8832 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.335934 Jul 25 12:59:45.794154 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1868/3829] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:45 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:45.807612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ae71cc51-a56b-4179-a25d-89a60524f849 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-840238915", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "8ec6604d-10b2-4d60-83a4-ddcfd9e67fa6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1331126052", "security_groups": [{"name": "tempest-secgroup-smoke-1571170025"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:46.223246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2a09aa3c-a04b-4d69-8deb-2e56f0120b47 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:46.236660 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2a09aa3c-a04b-4d69-8deb-2e56f0120b47 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f" status: 200 len: 1469 microversion: 2.1 time: 0.499706 Jul 25 12:59:46.239162 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1962/3830] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:45 2022] GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f => generated 1469 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:46.248213 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3dfc83f4-3483-4260-b536-8440ae2d0f85 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:46.249365 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3dfc83f4-3483-4260-b536-8440ae2d0f85 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:46.257821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-ae71cc51-a56b-4179-a25d-89a60524f849 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] validate_networks() for [('8ec6604d-10b2-4d60-83a4-ddcfd9e67fa6', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:59:46.490096 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3dfc83f4-3483-4260-b536-8440ae2d0f85 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66df4d397a40dd8606928b3be2e458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd8dc38f32c4c03a73af0666752d6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:46.508605 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3dfc83f4-3483-4260-b536-8440ae2d0f85 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547" status: 200 len: 1217 microversion: 2.1 time: 0.266879 Jul 25 12:59:46.515841 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1963/3831] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:46 2022] GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547 => generated 1217 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:46.541809 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2c00a865-da0c-44bd-b201-906b38eea909 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:46.545342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2c00a865-da0c-44bd-b201-906b38eea909 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:46.570385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c00a865-da0c-44bd-b201-906b38eea909 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:46.574479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c00a865-da0c-44bd-b201-906b38eea909 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:46.584571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c00a865-da0c-44bd-b201-906b38eea909 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:46.585478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c00a865-da0c-44bd-b201-906b38eea909 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:46.685386 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:46.953443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2c00a865-da0c-44bd-b201-906b38eea909 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:46.966249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2c00a865-da0c-44bd-b201-906b38eea909 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:46.972097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2c00a865-da0c-44bd-b201-906b38eea909 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:46.973477 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2c00a865-da0c-44bd-b201-906b38eea909 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1372 microversion: 2.57 time: 0.454609 Jul 25 12:59:46.998080 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1964/3832] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:46 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1372 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:47.020518 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-38ed22f9-b438-471b-ab17-eb3d73b55f8b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-899975948", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "key_name": "tempest-key-1834299213", "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:47.091724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-38ed22f9-b438-471b-ab17-eb3d73b55f8b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] validate_networks() for [('dc975d58-9818-4c8b-8bcd-8b1a23df5609', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:59:47.515861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-ae71cc51-a56b-4179-a25d-89a60524f849 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:59:47.516863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-ae71cc51-a56b-4179-a25d-89a60524f849 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:59:47.519278 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-ae71cc51-a56b-4179-a25d-89a60524f849 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:59:47.520025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-ae71cc51-a56b-4179-a25d-89a60524f849 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:59:47.520799 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-ae71cc51-a56b-4179-a25d-89a60524f849 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:59:47.537227 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ae71cc51-a56b-4179-a25d-89a60524f849 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:47.537735 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ae71cc51-a56b-4179-a25d-89a60524f849 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:47.538656 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ae71cc51-a56b-4179-a25d-89a60524f849 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:47.558695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ae71cc51-a56b-4179-a25d-89a60524f849 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:47.619694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-ae71cc51-a56b-4179-a25d-89a60524f849 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Getting quotas for project c0d891a772834e43bdfcbde778a90498. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:59:47.632780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-ae71cc51-a56b-4179-a25d-89a60524f849 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Getting quotas for user 4d6e2ae351744e0ab1f153d629e4f0e7 and project c0d891a772834e43bdfcbde778a90498. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:59:47.689482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ae71cc51-a56b-4179-a25d-89a60524f849 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:59:47.696716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ae71cc51-a56b-4179-a25d-89a60524f849 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:59:47.703779 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-38ed22f9-b438-471b-ab17-eb3d73b55f8b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Invalid key_name provided. Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-38ed22f9-b438-471b-ab17-eb3d73b55f8b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 246 Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-899975948", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "key_name": "tempest-key-1834299213", "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: exception: Invalid key_name provided. Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-899975948', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452', 'key_name': 'tempest-key-1834299213', 'networks': [{'uuid': 'dc975d58-9818-4c8b-8bcd-8b1a23df5609'}]}}} Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1834299213 not found for user 036ffb5ac9fb47ba9e1314560898530a Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:47.706069 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:47.710155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-38ed22f9-b438-471b-ab17-eb3d73b55f8b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 400 to user: Invalid key_name provided. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:59:47.713310 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-38ed22f9-b438-471b-ab17-eb3d73b55f8b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.713373 Jul 25 12:59:47.714031 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1965/3833] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:59:46 2022] POST /compute/v2.1/servers => generated 70 bytes in 715 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:59:47.736984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-63472e1d-c942-4cf4-94c2-4409d1486077 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:47.738283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-63472e1d-c942-4cf4-94c2-4409d1486077 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:47.751701 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-63472e1d-c942-4cf4-94c2-4409d1486077 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:47.752690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-63472e1d-c942-4cf4-94c2-4409d1486077 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:47.753765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-63472e1d-c942-4cf4-94c2-4409d1486077 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:47.754460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-63472e1d-c942-4cf4-94c2-4409d1486077 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:47.768162 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ae71cc51-a56b-4179-a25d-89a60524f849 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.970732 Jul 25 12:59:47.769079 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1869/3834] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:59:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:59:47.779616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-a22c1544-2b5a-4a43-b614-234cb192327a req-9da43670-f09d-4ccd-a6db-c06d8510e3cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a938f7a-a9f5-4888-95f3-bde7040a576f", "name": "network-vif-plugged", "status": "completed", "tag": "f572ee52-4fc3-4d61-b470-92ec430cead6"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:47.795539 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a22c1544-2b5a-4a43-b614-234cb192327a req-9da43670-f09d-4ccd-a6db-c06d8510e3cd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:47.806591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a22c1544-2b5a-4a43-b614-234cb192327a req-9da43670-f09d-4ccd-a6db-c06d8510e3cd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:47.836618 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-a22c1544-2b5a-4a43-b614-234cb192327a req-9da43670-f09d-4ccd-a6db-c06d8510e3cd service nova] Creating event network-vif-plugged:f572ee52-4fc3-4d61-b470-92ec430cead6 for instance 3a938f7a-a9f5-4888-95f3-bde7040a576f on n-h2-848886-15 Jul 25 12:59:47.848078 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-a22c1544-2b5a-4a43-b614-234cb192327a req-9da43670-f09d-4ccd-a6db-c06d8510e3cd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076808 Jul 25 12:59:47.849014 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1870/3835] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:59:47.867635 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9243b418-ce8f-4b3e-af00-4a3b4248c8f3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:47.869133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9243b418-ce8f-4b3e-af00-4a3b4248c8f3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 3a938f7a-a9f5-4888-95f3-bde7040a576f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:47.878860 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:47.893931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9243b418-ce8f-4b3e-af00-4a3b4248c8f3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:47.894715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9243b418-ce8f-4b3e-af00-4a3b4248c8f3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:47.895764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9243b418-ce8f-4b3e-af00-4a3b4248c8f3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:47.896430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9243b418-ce8f-4b3e-af00-4a3b4248c8f3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:47.933503 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:48.131134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-63472e1d-c942-4cf4-94c2-4409d1486077 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:48.147143 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-63472e1d-c942-4cf4-94c2-4409d1486077 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1314 microversion: 2.1 time: 0.431068 Jul 25 12:59:48.148539 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1966/3836] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:47 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:48.157671 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6999d82b-e4b3-47d2-b89c-2b539bfaa32c tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:48.176972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6999d82b-e4b3-47d2-b89c-2b539bfaa32c tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:48.198006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6999d82b-e4b3-47d2-b89c-2b539bfaa32c tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:48.198553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6999d82b-e4b3-47d2-b89c-2b539bfaa32c tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:48.200346 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6999d82b-e4b3-47d2-b89c-2b539bfaa32c tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:48.202411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6999d82b-e4b3-47d2-b89c-2b539bfaa32c tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:48.329690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6999d82b-e4b3-47d2-b89c-2b539bfaa32c tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66df4d397a40dd8606928b3be2e458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd8dc38f32c4c03a73af0666752d6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:48.341108 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6999d82b-e4b3-47d2-b89c-2b539bfaa32c tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547" status: 200 len: 1269 microversion: 2.1 time: 0.190572 Jul 25 12:59:48.343845 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1967/3837] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:48 2022] GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547 => generated 1269 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:48.356813 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9243b418-ce8f-4b3e-af00-4a3b4248c8f3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:48.365765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-159041d1-4cc0-4a19-b0ef-5c23f3cb24d1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:48.367930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-159041d1-4cc0-4a19-b0ef-5c23f3cb24d1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:48.368540 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9243b418-ce8f-4b3e-af00-4a3b4248c8f3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f" status: 200 len: 1469 microversion: 2.1 time: 0.516659 Jul 25 12:59:48.371750 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1871/3838] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:47 2022] GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f => generated 1469 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:48.383560 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7c42cbe8-80ab-4601-aff8-188dc4c8fa0c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:48.388260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-159041d1-4cc0-4a19-b0ef-5c23f3cb24d1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:48.388260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-159041d1-4cc0-4a19-b0ef-5c23f3cb24d1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:48.388260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-159041d1-4cc0-4a19-b0ef-5c23f3cb24d1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:48.388548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7c42cbe8-80ab-4601-aff8-188dc4c8fa0c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:48.388846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-159041d1-4cc0-4a19-b0ef-5c23f3cb24d1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:48.568362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7c42cbe8-80ab-4601-aff8-188dc4c8fa0c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:48.581896 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7c42cbe8-80ab-4601-aff8-188dc4c8fa0c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1266 microversion: 2.1 time: 0.208715 Jul 25 12:59:48.601265 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1872/3839] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:48 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:48.622524 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0e5dab2c-9b9b-42d4-95c1-3d2a1e810788 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:48.623353 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0e5dab2c-9b9b-42d4-95c1-3d2a1e810788 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:48.638850 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e5dab2c-9b9b-42d4-95c1-3d2a1e810788 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:48.639819 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e5dab2c-9b9b-42d4-95c1-3d2a1e810788 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:48.649234 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e5dab2c-9b9b-42d4-95c1-3d2a1e810788 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:48.650318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e5dab2c-9b9b-42d4-95c1-3d2a1e810788 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:48.724627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-159041d1-4cc0-4a19-b0ef-5c23f3cb24d1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:48.737737 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-159041d1-4cc0-4a19-b0ef-5c23f3cb24d1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.391475 Jul 25 12:59:48.738407 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1968/3840] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:48 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:48.764235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-be13634b-3536-46ee-b2dc-f304fc1d35da tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:48.765676 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-be13634b-3536-46ee-b2dc-f304fc1d35da tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:48.777593 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be13634b-3536-46ee-b2dc-f304fc1d35da tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:48.779101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be13634b-3536-46ee-b2dc-f304fc1d35da tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:48.780903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be13634b-3536-46ee-b2dc-f304fc1d35da tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:48.781725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be13634b-3536-46ee-b2dc-f304fc1d35da tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:49.053242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0e5dab2c-9b9b-42d4-95c1-3d2a1e810788 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:49.098594 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0e5dab2c-9b9b-42d4-95c1-3d2a1e810788 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:49.109198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0e5dab2c-9b9b-42d4-95c1-3d2a1e810788 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:49.112589 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0e5dab2c-9b9b-42d4-95c1-3d2a1e810788 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1372 microversion: 2.57 time: 0.509982 Jul 25 12:59:49.113188 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1873/3841] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:48 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1372 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:49.171863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bed4c6b5-7fda-427a-83d8-5a7c7083dc1a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:49.173078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bed4c6b5-7fda-427a-83d8-5a7c7083dc1a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:49.197993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bed4c6b5-7fda-427a-83d8-5a7c7083dc1a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:49.198579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bed4c6b5-7fda-427a-83d8-5a7c7083dc1a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:49.200060 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bed4c6b5-7fda-427a-83d8-5a7c7083dc1a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:49.200733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bed4c6b5-7fda-427a-83d8-5a7c7083dc1a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:49.368777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-be13634b-3536-46ee-b2dc-f304fc1d35da tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:49.378508 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-be13634b-3536-46ee-b2dc-f304fc1d35da tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.619281 Jul 25 12:59:49.402094 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1969/3842] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:48 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:59:49.415745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-daa00f55-49f5-40e2-bcf6-d7cfb6e59ea6 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:49.417625 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-daa00f55-49f5-40e2-bcf6-d7cfb6e59ea6 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:49.433281 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-daa00f55-49f5-40e2-bcf6-d7cfb6e59ea6 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:49.438878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-daa00f55-49f5-40e2-bcf6-d7cfb6e59ea6 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:49.440155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-daa00f55-49f5-40e2-bcf6-d7cfb6e59ea6 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:49.443240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-daa00f55-49f5-40e2-bcf6-d7cfb6e59ea6 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:49.592885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-daa00f55-49f5-40e2-bcf6-d7cfb6e59ea6 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66df4d397a40dd8606928b3be2e458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd8dc38f32c4c03a73af0666752d6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:49.607727 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-daa00f55-49f5-40e2-bcf6-d7cfb6e59ea6 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547" status: 200 len: 1287 microversion: 2.1 time: 0.202428 Jul 25 12:59:49.608996 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1970/3843] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:49 2022] GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547 => generated 1287 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:49.621266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2701d12e-25e9-453c-ae5b-80d1f93a94d3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:49.622286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2701d12e-25e9-453c-ae5b-80d1f93a94d3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 3a938f7a-a9f5-4888-95f3-bde7040a576f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:49.629804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bed4c6b5-7fda-427a-83d8-5a7c7083dc1a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:49.631993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2701d12e-25e9-453c-ae5b-80d1f93a94d3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:49.632663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2701d12e-25e9-453c-ae5b-80d1f93a94d3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:49.633656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2701d12e-25e9-453c-ae5b-80d1f93a94d3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:49.634461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2701d12e-25e9-453c-ae5b-80d1f93a94d3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:49.641559 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bed4c6b5-7fda-427a-83d8-5a7c7083dc1a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1314 microversion: 2.1 time: 0.476479 Jul 25 12:59:49.642190 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1874/3844] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:49 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:59:49.647029 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3edea73f-96fb-4842-8b79-21bd446cb808 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-33141902", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:49.877654 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.security_group_api [None req-3edea73f-96fb-4842-8b79-21bd446cb808 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Neutron security group does_not_exist not found {{(pid=125883) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 25 12:59:49.878512 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-3edea73f-96fb-4842-8b79-21bd446cb808 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3edea73f-96fb-4842-8b79-21bd446cb808 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 256 Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-33141902", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-33141902', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'dc975d58-9818-4c8b-8bcd-8b1a23df5609'}]}}} Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 25 12:59:49.885756 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 25 12:59:49.890256 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:49.897965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3edea73f-96fb-4842-8b79-21bd446cb808 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:59:49.897965 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3edea73f-96fb-4842-8b79-21bd446cb808 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.253719 Jul 25 12:59:49.897965 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1875/3845] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 12:59:49 2022] POST /compute/v2.1/servers => generated 106 bytes in 255 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:59:49.903642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9c019755-c92f-4e4d-9ee3-657cb247811e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:49.904548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9c019755-c92f-4e4d-9ee3-657cb247811e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:49.913600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c019755-c92f-4e4d-9ee3-657cb247811e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:49.914479 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c019755-c92f-4e4d-9ee3-657cb247811e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:49.915617 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c019755-c92f-4e4d-9ee3-657cb247811e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:49.916319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c019755-c92f-4e4d-9ee3-657cb247811e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:50.109174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2701d12e-25e9-453c-ae5b-80d1f93a94d3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:50.113353 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9c019755-c92f-4e4d-9ee3-657cb247811e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:50.125742 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2701d12e-25e9-453c-ae5b-80d1f93a94d3 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f" status: 200 len: 1640 microversion: 2.1 time: 0.512522 Jul 25 12:59:50.126283 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9c019755-c92f-4e4d-9ee3-657cb247811e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1326 microversion: 2.1 time: 0.225628 Jul 25 12:59:50.128240 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1971/3846] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:49 2022] GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f => generated 1640 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:50.146529 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1876/3847] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:49 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1326 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:50.148721 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f31bfbbc-feca-445c-93bb-8c63c735147c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:50.150951 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f31bfbbc-feca-445c-93bb-8c63c735147c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:50.153604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-97c1cb4e-ea39-4c41-a9ac-f10975b368ec tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:50.154367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-97c1cb4e-ea39-4c41-a9ac-f10975b368ec tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 3a938f7a-a9f5-4888-95f3-bde7040a576f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:50.163950 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97c1cb4e-ea39-4c41-a9ac-f10975b368ec tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:50.164840 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97c1cb4e-ea39-4c41-a9ac-f10975b368ec tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:50.166177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97c1cb4e-ea39-4c41-a9ac-f10975b368ec tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:50.166840 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97c1cb4e-ea39-4c41-a9ac-f10975b368ec tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:50.167325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f31bfbbc-feca-445c-93bb-8c63c735147c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:50.168385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f31bfbbc-feca-445c-93bb-8c63c735147c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:50.169477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f31bfbbc-feca-445c-93bb-8c63c735147c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:50.170186 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f31bfbbc-feca-445c-93bb-8c63c735147c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:50.638378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-97c1cb4e-ea39-4c41-a9ac-f10975b368ec tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:50.643317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f31bfbbc-feca-445c-93bb-8c63c735147c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:50.650797 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-97c1cb4e-ea39-4c41-a9ac-f10975b368ec tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f" status: 200 len: 1640 microversion: 2.1 time: 0.502726 Jul 25 12:59:50.651710 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1877/3848] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:50 2022] GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f => generated 1640 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:50.652282 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f31bfbbc-feca-445c-93bb-8c63c735147c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.522596 Jul 25 12:59:50.652874 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1972/3849] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:50 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:50.657556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-151c5400-059e-4c23-80ab-24a80132c92c tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:50.659782 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7b563260-4898-4864-bbac-0f0786950089 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:50.660714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7b563260-4898-4864-bbac-0f0786950089 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:50.660868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-151c5400-059e-4c23-80ab-24a80132c92c tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:50.677578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-151c5400-059e-4c23-80ab-24a80132c92c tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:50.678219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-151c5400-059e-4c23-80ab-24a80132c92c tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:50.679247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-151c5400-059e-4c23-80ab-24a80132c92c tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:50.679637 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-151c5400-059e-4c23-80ab-24a80132c92c tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:50.695829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b563260-4898-4864-bbac-0f0786950089 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:50.696752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b563260-4898-4864-bbac-0f0786950089 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:50.698993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b563260-4898-4864-bbac-0f0786950089 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:50.700869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b563260-4898-4864-bbac-0f0786950089 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:51.040830 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7b563260-4898-4864-bbac-0f0786950089 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:51.103538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7b563260-4898-4864-bbac-0f0786950089 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:51.112504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7b563260-4898-4864-bbac-0f0786950089 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:51.132232 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7b563260-4898-4864-bbac-0f0786950089 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1357 microversion: 2.57 time: 0.476588 Jul 25 12:59:51.151389 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1878/3850] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:50 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1357 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:51.172636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-05d3ecb3-e9ee-49c0-9c2e-30a15628ced4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:51.186165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-05d3ecb3-e9ee-49c0-9c2e-30a15628ced4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:51.210252 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05d3ecb3-e9ee-49c0-9c2e-30a15628ced4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:51.211038 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05d3ecb3-e9ee-49c0-9c2e-30a15628ced4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:51.222417 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05d3ecb3-e9ee-49c0-9c2e-30a15628ced4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:51.223209 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05d3ecb3-e9ee-49c0-9c2e-30a15628ced4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:51.356407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-151c5400-059e-4c23-80ab-24a80132c92c tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66df4d397a40dd8606928b3be2e458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd8dc38f32c4c03a73af0666752d6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:51.376695 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-151c5400-059e-4c23-80ab-24a80132c92c tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547" status: 200 len: 1317 microversion: 2.1 time: 0.722558 Jul 25 12:59:51.380348 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1973/3851] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:50 2022] GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547 => generated 1317 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:51.393506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b482938c-ebfd-4985-a02d-f03313a63876 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:51.397998 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b482938c-ebfd-4985-a02d-f03313a63876 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:51.411566 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b482938c-ebfd-4985-a02d-f03313a63876 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:51.414366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b482938c-ebfd-4985-a02d-f03313a63876 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:51.418643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b482938c-ebfd-4985-a02d-f03313a63876 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:51.419786 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b482938c-ebfd-4985-a02d-f03313a63876 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:51.873119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b482938c-ebfd-4985-a02d-f03313a63876 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:51.884562 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b482938c-ebfd-4985-a02d-f03313a63876 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.500461 Jul 25 12:59:51.888550 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1974/3852] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:51 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:51.900451 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8cfdd8fc-a1a5-4863-8a6d-64fc6cdfcb63 tempest-TestSecurityGroupsBasicOps-1158354128 tempest-TestSecurityGroupsBasicOps-1158354128-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:51.900451 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8cfdd8fc-a1a5-4863-8a6d-64fc6cdfcb63 tempest-TestSecurityGroupsBasicOps-1158354128 tempest-TestSecurityGroupsBasicOps-1158354128-project-admin] [instance: 3a938f7a-a9f5-4888-95f3-bde7040a576f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:51.927542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8cfdd8fc-a1a5-4863-8a6d-64fc6cdfcb63 tempest-TestSecurityGroupsBasicOps-1158354128 tempest-TestSecurityGroupsBasicOps-1158354128-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:51.930992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8cfdd8fc-a1a5-4863-8a6d-64fc6cdfcb63 tempest-TestSecurityGroupsBasicOps-1158354128 tempest-TestSecurityGroupsBasicOps-1158354128-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:51.931961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8cfdd8fc-a1a5-4863-8a6d-64fc6cdfcb63 tempest-TestSecurityGroupsBasicOps-1158354128 tempest-TestSecurityGroupsBasicOps-1158354128-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:51.932409 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8cfdd8fc-a1a5-4863-8a6d-64fc6cdfcb63 tempest-TestSecurityGroupsBasicOps-1158354128 tempest-TestSecurityGroupsBasicOps-1158354128-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:51.974757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-05d3ecb3-e9ee-49c0-9c2e-30a15628ced4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:51.987874 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-05d3ecb3-e9ee-49c0-9c2e-30a15628ced4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1314 microversion: 2.1 time: 0.835249 Jul 25 12:59:51.988470 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1879/3853] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:51 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1314 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:52.011566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4b4f2375-b618-48a0-9afa-a9bdffc1e45b tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:52.016649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4b4f2375-b618-48a0-9afa-a9bdffc1e45b tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:52.028366 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b4f2375-b618-48a0-9afa-a9bdffc1e45b tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:52.028855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b4f2375-b618-48a0-9afa-a9bdffc1e45b tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:52.029628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b4f2375-b618-48a0-9afa-a9bdffc1e45b tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:52.030184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b4f2375-b618-48a0-9afa-a9bdffc1e45b tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:52.090210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4b4f2375-b618-48a0-9afa-a9bdffc1e45b tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:59:52.390655 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4b4f2375-b618-48a0-9afa-a9bdffc1e45b tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 204 len: 0 microversion: 2.57 time: 0.390580 Jul 25 12:59:52.391573 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1880/3854] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 12:59:51 2022] DELETE /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 12:59:52.397226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b8d352d4-28c7-44b9-a543-cfae77e29124 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:52.398080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b8d352d4-28c7-44b9-a543-cfae77e29124 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:52.419063 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b8d352d4-28c7-44b9-a543-cfae77e29124 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:52.419568 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b8d352d4-28c7-44b9-a543-cfae77e29124 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:52.421542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b8d352d4-28c7-44b9-a543-cfae77e29124 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:52.424937 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b8d352d4-28c7-44b9-a543-cfae77e29124 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:52.900815 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8cfdd8fc-a1a5-4863-8a6d-64fc6cdfcb63 tempest-TestSecurityGroupsBasicOps-1158354128 tempest-TestSecurityGroupsBasicOps-1158354128-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f" status: 200 len: 1793 microversion: 2.1 time: 1.009972 Jul 25 12:59:52.918968 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1975/3855] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:51 2022] GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f => generated 1793 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:52.925350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b8d352d4-28c7-44b9-a543-cfae77e29124 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:52.935115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-b71e55a9-d475-4ad0-a80e-3889b21aaaf8 req-6a37405e-4ef3-45c6-9f5b-e2f967ae1d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9787fc-a4e1-41f8-be82-3f68c14ad254", "name": "network-vif-plugged", "status": "completed", "tag": "cce124d7-06ab-47f8-9713-88ca17dcee95"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:52.936588 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b8d352d4-28c7-44b9-a543-cfae77e29124 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1392 microversion: 2.1 time: 0.543671 Jul 25 12:59:52.937904 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1881/3856] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:52 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1392 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:52.945091 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a9d539c5-d1ff-4fba-ace8-168978bf01b8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:52.945817 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a9d539c5-d1ff-4fba-ace8-168978bf01b8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 156d7d1a-93ec-4c8f-bc30-a9cafcfa5177] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:52.956968 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-a9d539c5-d1ff-4fba-ace8-168978bf01b8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Instance 156d7d1a-93ec-4c8f-bc30-a9cafcfa5177 could not be found. Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a9d539c5-d1ff-4fba-ace8-168978bf01b8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/156d7d1a-93ec-4c8f-bc30-a9cafcfa5177 HTTP/1.1 Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 156d7d1a-93ec-4c8f-bc30-a9cafcfa5177 could not be found. Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '156d7d1a-93ec-4c8f-bc30-a9cafcfa5177'} Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 156d7d1a-93ec-4c8f-bc30-a9cafcfa5177 could not be found. Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 156d7d1a-93ec-4c8f-bc30-a9cafcfa5177 could not be found. Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:52.960910 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:52.968964 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:52.968964 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:52.968964 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:52.968964 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:52.968964 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:59:52.968964 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:59:52.968964 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 156d7d1a-93ec-4c8f-bc30-a9cafcfa5177 could not be found. Jul 25 12:59:52.968964 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:52.973638 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a9d539c5-d1ff-4fba-ace8-168978bf01b8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 404 to user: Instance 156d7d1a-93ec-4c8f-bc30-a9cafcfa5177 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:59:52.975016 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a9d539c5-d1ff-4fba-ace8-168978bf01b8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "DELETE /compute/v2.1/servers/156d7d1a-93ec-4c8f-bc30-a9cafcfa5177" status: 404 len: 111 microversion: 2.1 time: 0.034686 Jul 25 12:59:52.976851 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1882/3857] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 12:59:52 2022] DELETE /compute/v2.1/servers/156d7d1a-93ec-4c8f-bc30-a9cafcfa5177 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:59:52.984350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0eb35697-132c-4ee9-ab48-baa6e771df24 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:52.985981 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0eb35697-132c-4ee9-ab48-baa6e771df24 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:52.996605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0eb35697-132c-4ee9-ab48-baa6e771df24 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:52.997371 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0eb35697-132c-4ee9-ab48-baa6e771df24 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:52.998466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0eb35697-132c-4ee9-ab48-baa6e771df24 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:52.999181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b71e55a9-d475-4ad0-a80e-3889b21aaaf8 req-6a37405e-4ef3-45c6-9f5b-e2f967ae1d73 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:52.999706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b71e55a9-d475-4ad0-a80e-3889b21aaaf8 req-6a37405e-4ef3-45c6-9f5b-e2f967ae1d73 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:53.001085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0eb35697-132c-4ee9-ab48-baa6e771df24 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:53.027729 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-b71e55a9-d475-4ad0-a80e-3889b21aaaf8 req-6a37405e-4ef3-45c6-9f5b-e2f967ae1d73 service nova] Creating event network-vif-plugged:cce124d7-06ab-47f8-9713-88ca17dcee95 for instance 8d9787fc-a4e1-41f8-be82-3f68c14ad254 on n-h2-848886-15 Jul 25 12:59:53.039275 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-b71e55a9-d475-4ad0-a80e-3889b21aaaf8 req-6a37405e-4ef3-45c6-9f5b-e2f967ae1d73 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118115 Jul 25 12:59:53.047081 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1976/3858] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:59:53.061525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4d1787bd-5b8f-42fc-9d96-6d3ebd5f1f52 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:53.062742 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4d1787bd-5b8f-42fc-9d96-6d3ebd5f1f52 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:53.081923 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d1787bd-5b8f-42fc-9d96-6d3ebd5f1f52 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:53.084098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d1787bd-5b8f-42fc-9d96-6d3ebd5f1f52 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:53.095096 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d1787bd-5b8f-42fc-9d96-6d3ebd5f1f52 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:53.096324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d1787bd-5b8f-42fc-9d96-6d3ebd5f1f52 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:53.197752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0eb35697-132c-4ee9-ab48-baa6e771df24 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:53.218017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0eb35697-132c-4ee9-ab48-baa6e771df24 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:53.219826 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0eb35697-132c-4ee9-ab48-baa6e771df24 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:53.221523 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0eb35697-132c-4ee9-ab48-baa6e771df24 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1363 microversion: 2.57 time: 0.243327 Jul 25 12:59:53.222134 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1883/3859] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:52 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:53.228018 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0e85c408-5a5e-4c19-b68a-f11fb2a135ba tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:53.228882 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0e85c408-5a5e-4c19-b68a-f11fb2a135ba tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:53.238159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e85c408-5a5e-4c19-b68a-f11fb2a135ba tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:53.238775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e85c408-5a5e-4c19-b68a-f11fb2a135ba tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:53.239748 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e85c408-5a5e-4c19-b68a-f11fb2a135ba tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:53.240512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e85c408-5a5e-4c19-b68a-f11fb2a135ba tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:53.756341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4d1787bd-5b8f-42fc-9d96-6d3ebd5f1f52 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66df4d397a40dd8606928b3be2e458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd8dc38f32c4c03a73af0666752d6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:53.778581 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4d1787bd-5b8f-42fc-9d96-6d3ebd5f1f52 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547" status: 200 len: 1317 microversion: 2.1 time: 0.719550 Jul 25 12:59:53.781672 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1977/3860] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:53 2022] GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547 => generated 1317 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:53.798895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3e54b410-1d78-401c-a14c-e1d9e5c97caa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:53.799461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3e54b410-1d78-401c-a14c-e1d9e5c97caa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:53.818729 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e54b410-1d78-401c-a14c-e1d9e5c97caa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:53.819211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e54b410-1d78-401c-a14c-e1d9e5c97caa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:53.820047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e54b410-1d78-401c-a14c-e1d9e5c97caa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:53.820688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e54b410-1d78-401c-a14c-e1d9e5c97caa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:53.935410 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0e85c408-5a5e-4c19-b68a-f11fb2a135ba tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:53.948690 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0e85c408-5a5e-4c19-b68a-f11fb2a135ba tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.724740 Jul 25 12:59:53.949283 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1884/3861] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:53 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:53.958343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-00341455-72d6-4786-8854-a1f3cf88a6e9 req-bf3463a8-06f3-4e7f-9548-c778522ecec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7954e97-a6c3-4017-a41d-2e61083c6ab5", "tag": "47fb272d-6ac9-419c-81e1-c632660c9f57"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:54.008501 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-00341455-72d6-4786-8854-a1f3cf88a6e9 req-bf3463a8-06f3-4e7f-9548-c778522ecec4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:54.009145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-00341455-72d6-4786-8854-a1f3cf88a6e9 req-bf3463a8-06f3-4e7f-9548-c778522ecec4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:54.323207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3e54b410-1d78-401c-a14c-e1d9e5c97caa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:54.342778 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3e54b410-1d78-401c-a14c-e1d9e5c97caa tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1314 microversion: 2.1 time: 0.559204 Jul 25 12:59:54.353435 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1978/3862] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:53 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:54.361456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3188f3be-717b-40e4-8c83-828b27703071 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:54.361726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3188f3be-717b-40e4-8c83-828b27703071 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:54.393668 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3188f3be-717b-40e4-8c83-828b27703071 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:54.395468 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3188f3be-717b-40e4-8c83-828b27703071 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:54.399687 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3188f3be-717b-40e4-8c83-828b27703071 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:54.415918 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3188f3be-717b-40e4-8c83-828b27703071 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:54.611723 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-00341455-72d6-4786-8854-a1f3cf88a6e9 req-bf3463a8-06f3-4e7f-9548-c778522ecec4 service nova] Creating event network-changed:47fb272d-6ac9-419c-81e1-c632660c9f57 for instance d7954e97-a6c3-4017-a41d-2e61083c6ab5 on n-h2-848886-15 Jul 25 12:59:54.617073 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-00341455-72d6-4786-8854-a1f3cf88a6e9 req-bf3463a8-06f3-4e7f-9548-c778522ecec4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.666226 Jul 25 12:59:54.618563 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1885/3863] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:59:54.624138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-68052285-0932-445c-b6e4-80de6895755d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:54.625426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-68052285-0932-445c-b6e4-80de6895755d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:54.632861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68052285-0932-445c-b6e4-80de6895755d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:54.633564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68052285-0932-445c-b6e4-80de6895755d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:54.634577 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68052285-0932-445c-b6e4-80de6895755d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:54.635192 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68052285-0932-445c-b6e4-80de6895755d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:55.018682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3188f3be-717b-40e4-8c83-828b27703071 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:55.024464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-68052285-0932-445c-b6e4-80de6895755d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:55.030417 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3188f3be-717b-40e4-8c83-828b27703071 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1392 microversion: 2.1 time: 0.683732 Jul 25 12:59:55.031342 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1979/3864] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:54 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1392 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:55.048722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-628c3c5b-5ca1-4a0d-815c-d823fb1d2f2a req-03bdfff6-5911-4851-a65d-f196efeec57b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73470aab-4487-4be2-9f33-c5704236f547", "tag": "0698b915-741b-4a9c-ad79-4ecef999413c"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:55.055396 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-68052285-0932-445c-b6e4-80de6895755d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.435471 Jul 25 12:59:55.056222 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1886/3865] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:54 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:55.065708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-628c3c5b-5ca1-4a0d-815c-d823fb1d2f2a req-03bdfff6-5911-4851-a65d-f196efeec57b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:55.066413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-628c3c5b-5ca1-4a0d-815c-d823fb1d2f2a req-03bdfff6-5911-4851-a65d-f196efeec57b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:55.074162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5d561679-6f61-466b-a491-ad4f1bb9a419 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:55.076412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5d561679-6f61-466b-a491-ad4f1bb9a419 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:55.096709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d561679-6f61-466b-a491-ad4f1bb9a419 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:55.097065 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-628c3c5b-5ca1-4a0d-815c-d823fb1d2f2a req-03bdfff6-5911-4851-a65d-f196efeec57b service nova] Creating event network-changed:0698b915-741b-4a9c-ad79-4ecef999413c for instance 73470aab-4487-4be2-9f33-c5704236f547 on n-h1-848886-15 Jul 25 12:59:55.097525 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d561679-6f61-466b-a491-ad4f1bb9a419 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:55.098522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d561679-6f61-466b-a491-ad4f1bb9a419 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:55.104347 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d561679-6f61-466b-a491-ad4f1bb9a419 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:55.108989 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-628c3c5b-5ca1-4a0d-815c-d823fb1d2f2a req-03bdfff6-5911-4851-a65d-f196efeec57b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076135 Jul 25 12:59:55.111787 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1980/3866] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:59:55.138188 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-573ddbfc-1242-4759-be33-23e98a5e257a tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:55.138915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-573ddbfc-1242-4759-be33-23e98a5e257a tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:55.147874 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-573ddbfc-1242-4759-be33-23e98a5e257a tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:55.148326 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-573ddbfc-1242-4759-be33-23e98a5e257a tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:55.149306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-573ddbfc-1242-4759-be33-23e98a5e257a tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:55.149736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-573ddbfc-1242-4759-be33-23e98a5e257a tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:55.176091 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d561679-6f61-466b-a491-ad4f1bb9a419 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:55.177184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d561679-6f61-466b-a491-ad4f1bb9a419 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:55.177730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-5d561679-6f61-466b-a491-ad4f1bb9a419 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lazy-loading 'fault' on Instance uuid cc85e482-a7c9-4ca7-b323-e0c37205a95a {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:59:55.259569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5d561679-6f61-466b-a491-ad4f1bb9a419 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:55.271790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5d561679-6f61-466b-a491-ad4f1bb9a419 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:55.273336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5d561679-6f61-466b-a491-ad4f1bb9a419 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e79e677f04c04416b3147f70089c571c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5258c16b1ee4e8ba8961f883fe2f97e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:55.274620 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5d561679-6f61-466b-a491-ad4f1bb9a419 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 200 len: 1368 microversion: 2.57 time: 0.217296 Jul 25 12:59:55.282452 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1887/3867] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:55 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 1368 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:59:55.288250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9a1c3cf3-89aa-4652-8d10-2b9f100a5f85 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:55.288926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9a1c3cf3-89aa-4652-8d10-2b9f100a5f85 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Failed to fetch instance by id 9223372036854775808 {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 12:59:55.289579 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-9a1c3cf3-89aa-4652-8d10-2b9f100a5f85 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9a1c3cf3-89aa-4652-8d10-2b9f100a5f85 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 9223372036854775808 could not be found. Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '9223372036854775808'} Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:55.291390 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:55.295153 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:55.295153 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:59:55.295153 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:59:55.295153 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 25 12:59:55.295153 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 12:59:55.296791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9a1c3cf3-89aa-4652-8d10-2b9f100a5f85 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:59:55.297811 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9a1c3cf3-89aa-4652-8d10-2b9f100a5f85 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.014258 Jul 25 12:59:55.304286 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1888/3868] 10.222.0.49 () {58 vars in 1188 bytes} [Mon Jul 25 12:59:55 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:59:55.317330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ebabda28-6992-446b-96fc-e05d48bca959 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:55.324621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ebabda28-6992-446b-96fc-e05d48bca959 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:55.337714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ebabda28-6992-446b-96fc-e05d48bca959 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:55.338245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ebabda28-6992-446b-96fc-e05d48bca959 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:55.339033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ebabda28-6992-446b-96fc-e05d48bca959 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:55.343514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ebabda28-6992-446b-96fc-e05d48bca959 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:55.497510 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:55.621887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-573ddbfc-1242-4759-be33-23e98a5e257a tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66df4d397a40dd8606928b3be2e458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd8dc38f32c4c03a73af0666752d6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:55.633579 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-573ddbfc-1242-4759-be33-23e98a5e257a tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547" status: 200 len: 1317 microversion: 2.1 time: 0.520350 Jul 25 12:59:55.635075 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1981/3869] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:55 2022] GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547 => generated 1317 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:55.642471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e081c683-a0be-4f66-a237-746666a591f5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:55.643446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e081c683-a0be-4f66-a237-746666a591f5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:55.650628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e081c683-a0be-4f66-a237-746666a591f5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:55.652695 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e081c683-a0be-4f66-a237-746666a591f5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:55.654021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e081c683-a0be-4f66-a237-746666a591f5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:55.655686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e081c683-a0be-4f66-a237-746666a591f5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:55.676375 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ebabda28-6992-446b-96fc-e05d48bca959 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:55.684535 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ebabda28-6992-446b-96fc-e05d48bca959 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.372061 Jul 25 12:59:55.699433 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1889/3870] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:55 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:55.707734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ff8bc2e6-6ec3-4bb8-8e2b-21b238366853 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:55.708543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ff8bc2e6-6ec3-4bb8-8e2b-21b238366853 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:55.715884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff8bc2e6-6ec3-4bb8-8e2b-21b238366853 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:55.716509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff8bc2e6-6ec3-4bb8-8e2b-21b238366853 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:55.717302 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff8bc2e6-6ec3-4bb8-8e2b-21b238366853 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:55.717732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff8bc2e6-6ec3-4bb8-8e2b-21b238366853 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:56.345874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ff8bc2e6-6ec3-4bb8-8e2b-21b238366853 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:56.349568 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:56.361791 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ff8bc2e6-6ec3-4bb8-8e2b-21b238366853 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.657655 Jul 25 12:59:56.362948 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1890/3871] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:55 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:56.365320 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e081c683-a0be-4f66-a237-746666a591f5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:56.370509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-48d6e46a-5dc5-4ef2-a48f-a14c8ee868c7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:56.371602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-48d6e46a-5dc5-4ef2-a48f-a14c8ee868c7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:56.373689 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e081c683-a0be-4f66-a237-746666a591f5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1501 microversion: 2.1 time: 0.737341 Jul 25 12:59:56.384467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48d6e46a-5dc5-4ef2-a48f-a14c8ee868c7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:56.384933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48d6e46a-5dc5-4ef2-a48f-a14c8ee868c7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:56.386054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48d6e46a-5dc5-4ef2-a48f-a14c8ee868c7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:56.386629 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1982/3872] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:55 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1501 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:56.388200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48d6e46a-5dc5-4ef2-a48f-a14c8ee868c7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:56.396773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3525bd52-863c-404d-be4f-9f1a6330bad9 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:56.397430 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3525bd52-863c-404d-be4f-9f1a6330bad9 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] [instance: cc85e482-a7c9-4ca7-b323-e0c37205a95a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:56.404076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3525bd52-863c-404d-be4f-9f1a6330bad9 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:56.404701 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3525bd52-863c-404d-be4f-9f1a6330bad9 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:56.405634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3525bd52-863c-404d-be4f-9f1a6330bad9 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:56.406239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3525bd52-863c-404d-be4f-9f1a6330bad9 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:56.427522 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-3525bd52-863c-404d-be4f-9f1a6330bad9 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] HTTP exception thrown: Instance cc85e482-a7c9-4ca7-b323-e0c37205a95a could not be found. Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3525bd52-863c-404d-be4f-9f1a6330bad9 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Request method failure captured: Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a HTTP/1.1 Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pOauPIkT-H2PbLZcBW7vHvwl8GR__CmNgMWOxQyr-snBXaKQDqz57ldwuzI-r-uJbYTBbGTex01J7bNnBEhO5Hrue-z6oNot2WDuOpRxkVfiFKIymXl_IEOd2AfD5DUlF9wpJ5lNM55-zG86uPR8zeC9ZlqJ6F85pFo7uEObZUVUfc Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: X-Openstack-Nova-Api-Version: 2.57 Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: e5258c16b1ee4e8ba8961f883fe2f97e Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerShowV257Test-1953398818 Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e5258c16b1ee4e8ba8961f883fe2f97e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e5258c16b1ee4e8ba8961f883fe2f97e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e5258c16b1ee4e8ba8961f883fe2f97e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e5258c16b1ee4e8ba8961f883fe2f97e"}]}] Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerShowV257Test-1953398818 Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: e5258c16b1ee4e8ba8961f883fe2f97e Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerShowV257Test-1953398818 Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerShowV257Test-1953398818-project Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: e79e677f04c04416b3147f70089c571c Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerShowV257Test-1953398818-project Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance cc85e482-a7c9-4ca7-b323-e0c37205a95a could not be found. Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'cc85e482-a7c9-4ca7-b323-e0c37205a95a'} Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc85e482-a7c9-4ca7-b323-e0c37205a95a could not be found. Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc85e482-a7c9-4ca7-b323-e0c37205a95a could not be found. Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:56.429316 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:56.436927 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:56.436927 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:56.436927 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:56.436927 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:59:56.436927 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:59:56.436927 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc85e482-a7c9-4ca7-b323-e0c37205a95a could not be found. Jul 25 12:59:56.436927 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:56.436927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3525bd52-863c-404d-be4f-9f1a6330bad9 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] Returning 404 to user: Instance cc85e482-a7c9-4ca7-b323-e0c37205a95a could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:59:56.436927 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3525bd52-863c-404d-be4f-9f1a6330bad9 tempest-ServerShowV257Test-1953398818 tempest-ServerShowV257Test-1953398818-project] 10.222.0.49 "GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a" status: 404 len: 111 microversion: 2.57 time: 0.043170 Jul 25 12:59:56.436927 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1983/3873] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 12:59:56 2022] GET /compute/v2.1/servers/cc85e482-a7c9-4ca7-b323-e0c37205a95a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:59:56.449649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7ed4cdf3-836a-4768-864a-b5f179f44307 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:56.466577 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7ed4cdf3-836a-4768-864a-b5f179f44307 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Failed to fetch instance by id -1 {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 12:59:56.467547 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-7ed4cdf3-836a-4768-864a-b5f179f44307 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Instance -1 could not be found. Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7ed4cdf3-836a-4768-864a-b5f179f44307 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance -1 could not be found. Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '-1'} Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:56.469393 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:56.473142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:59:56.473142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:59:56.473142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 25 12:59:56.473142 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:56.474589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7ed4cdf3-836a-4768-864a-b5f179f44307 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 404 to user: Instance -1 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:59:56.476386 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7ed4cdf3-836a-4768-864a-b5f179f44307 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.042560 Jul 25 12:59:56.477128 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1984/3874] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 12:59:56 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:59:56.482406 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b1910390-2e41-4be7-8bcb-675adb2fa43a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:56.483305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b1910390-2e41-4be7-8bcb-675adb2fa43a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:56.492589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b1910390-2e41-4be7-8bcb-675adb2fa43a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:56.493139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b1910390-2e41-4be7-8bcb-675adb2fa43a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:56.494212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b1910390-2e41-4be7-8bcb-675adb2fa43a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:56.494844 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b1910390-2e41-4be7-8bcb-675adb2fa43a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:56.500993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=8 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:56.532216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:56.573031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-48d6e46a-5dc5-4ef2-a48f-a14c8ee868c7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:56.584171 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-48d6e46a-5dc5-4ef2-a48f-a14c8ee868c7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1392 microversion: 2.1 time: 0.217459 Jul 25 12:59:56.584778 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1891/3875] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:56 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1392 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:56.598279 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-60937a58-27c4-40a8-83c0-afdc9af39c9a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:56.599512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-60937a58-27c4-40a8-83c0-afdc9af39c9a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:56.608630 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b1910390-2e41-4be7-8bcb-675adb2fa43a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254/action" status: 202 len: 0 microversion: 2.1 time: 0.129885 Jul 25 12:59:56.609303 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1985/3876] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:59:56 2022] POST /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:59:56.613240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-60937a58-27c4-40a8-83c0-afdc9af39c9a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:56.614546 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-60937a58-27c4-40a8-83c0-afdc9af39c9a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:56.615915 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-60937a58-27c4-40a8-83c0-afdc9af39c9a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:56.616855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-60937a58-27c4-40a8-83c0-afdc9af39c9a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:56.626883 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-513bcc44-3f39-425e-923d-f3aa34ae24e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:56.628349 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-513bcc44-3f39-425e-923d-f3aa34ae24e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:56.642469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-513bcc44-3f39-425e-923d-f3aa34ae24e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:56.642934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-513bcc44-3f39-425e-923d-f3aa34ae24e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:56.645023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-513bcc44-3f39-425e-923d-f3aa34ae24e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:56.646126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-513bcc44-3f39-425e-923d-f3aa34ae24e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:57.135705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-513bcc44-3f39-425e-923d-f3aa34ae24e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:57.149073 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-513bcc44-3f39-425e-923d-f3aa34ae24e6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1506 microversion: 2.1 time: 0.534381 Jul 25 12:59:57.152070 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1986/3877] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:56 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1506 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:57.164657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ea1b3580-0ff1-4dbf-9430-6ec8f42217ce tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:57.167787 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ea1b3580-0ff1-4dbf-9430-6ec8f42217ce tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:57.179903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea1b3580-0ff1-4dbf-9430-6ec8f42217ce tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:57.180730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea1b3580-0ff1-4dbf-9430-6ec8f42217ce tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:57.182804 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea1b3580-0ff1-4dbf-9430-6ec8f42217ce tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:57.184460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea1b3580-0ff1-4dbf-9430-6ec8f42217ce tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:57.271495 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-60937a58-27c4-40a8-83c0-afdc9af39c9a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:57.284005 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-60937a58-27c4-40a8-83c0-afdc9af39c9a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.695124 Jul 25 12:59:57.289082 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1892/3878] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:56 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:57.295869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-bf8edead-18bd-4555-b66d-9bff55d4e5ca req-08da6768-ea3a-4306-9bc7-71e6c51ca786 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a938f7a-a9f5-4888-95f3-bde7040a576f", "tag": "f572ee52-4fc3-4d61-b470-92ec430cead6"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:57.339987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-bf8edead-18bd-4555-b66d-9bff55d4e5ca req-08da6768-ea3a-4306-9bc7-71e6c51ca786 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:57.342257 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-bf8edead-18bd-4555-b66d-9bff55d4e5ca req-08da6768-ea3a-4306-9bc7-71e6c51ca786 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:57.363496 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-bf8edead-18bd-4555-b66d-9bff55d4e5ca req-08da6768-ea3a-4306-9bc7-71e6c51ca786 service nova] Creating event network-changed:f572ee52-4fc3-4d61-b470-92ec430cead6 for instance 3a938f7a-a9f5-4888-95f3-bde7040a576f on n-h2-848886-15 Jul 25 12:59:57.369861 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-bf8edead-18bd-4555-b66d-9bff55d4e5ca req-08da6768-ea3a-4306-9bc7-71e6c51ca786 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078429 Jul 25 12:59:57.370947 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1893/3879] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 12:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:59:57.377738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-adfb1411-5b4c-4100-94e6-010f6fe5ffd7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:57.378782 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-adfb1411-5b4c-4100-94e6-010f6fe5ffd7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:57.386021 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-adfb1411-5b4c-4100-94e6-010f6fe5ffd7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:57.387224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-adfb1411-5b4c-4100-94e6-010f6fe5ffd7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:57.388208 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-adfb1411-5b4c-4100-94e6-010f6fe5ffd7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:57.388819 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-adfb1411-5b4c-4100-94e6-010f6fe5ffd7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:57.588201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:57.920899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-adfb1411-5b4c-4100-94e6-010f6fe5ffd7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:57.929606 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-adfb1411-5b4c-4100-94e6-010f6fe5ffd7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.557237 Jul 25 12:59:57.937400 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1894/3880] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:57 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:57.948658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-844b40f0-4f2a-4f07-9878-dafd7f522d54 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:57.949750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-844b40f0-4f2a-4f07-9878-dafd7f522d54 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:57.961963 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-844b40f0-4f2a-4f07-9878-dafd7f522d54 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:57.962708 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-844b40f0-4f2a-4f07-9878-dafd7f522d54 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:57.968200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-844b40f0-4f2a-4f07-9878-dafd7f522d54 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:57.968331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-844b40f0-4f2a-4f07-9878-dafd7f522d54 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:58.040144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ea1b3580-0ff1-4dbf-9430-6ec8f42217ce tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66df4d397a40dd8606928b3be2e458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd8dc38f32c4c03a73af0666752d6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:58.058518 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ea1b3580-0ff1-4dbf-9430-6ec8f42217ce tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547" status: 200 len: 1317 microversion: 2.1 time: 0.903583 Jul 25 12:59:58.059914 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1987/3881] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:57 2022] GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547 => generated 1317 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:58.073096 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-afbd35b9-d9c3-43e3-8b0a-b28a116a0356 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:58.074718 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-afbd35b9-d9c3-43e3-8b0a-b28a116a0356 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: e6fb654f-a212-4995-915b-15546fe4a20a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:58.098084 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-afbd35b9-d9c3-43e3-8b0a-b28a116a0356 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Instance e6fb654f-a212-4995-915b-15546fe4a20a could not be found. Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-afbd35b9-d9c3-43e3-8b0a-b28a116a0356 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/e6fb654f-a212-4995-915b-15546fe4a20a/action HTTP/1.1 Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 19 Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: {"forceDelete": {}} Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance e6fb654f-a212-4995-915b-15546fe4a20a could not be found. Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'e6fb654f-a212-4995-915b-15546fe4a20a', 'body': {'forceDelete': {}}} Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6fb654f-a212-4995-915b-15546fe4a20a could not be found. Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6fb654f-a212-4995-915b-15546fe4a20a could not be found. Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:58.107736 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:58.112541 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:59:58.112541 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:59:58.112541 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6fb654f-a212-4995-915b-15546fe4a20a could not be found. Jul 25 12:59:58.112541 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 12:59:58.113617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-afbd35b9-d9c3-43e3-8b0a-b28a116a0356 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 404 to user: Instance e6fb654f-a212-4995-915b-15546fe4a20a could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:59:58.115631 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-afbd35b9-d9c3-43e3-8b0a-b28a116a0356 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/e6fb654f-a212-4995-915b-15546fe4a20a/action" status: 404 len: 111 microversion: 2.1 time: 0.054521 Jul 25 12:59:58.125990 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1988/3882] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:59:58 2022] POST /compute/v2.1/servers/e6fb654f-a212-4995-915b-15546fe4a20a/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:59:58.136771 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fa6e909d-fb08-4db9-a941-8ed370b6a731 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:58.137400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fa6e909d-fb08-4db9-a941-8ed370b6a731 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:58.160395 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa6e909d-fb08-4db9-a941-8ed370b6a731 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:58.160859 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa6e909d-fb08-4db9-a941-8ed370b6a731 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:58.161654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa6e909d-fb08-4db9-a941-8ed370b6a731 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:58.162215 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa6e909d-fb08-4db9-a941-8ed370b6a731 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:58.405261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-844b40f0-4f2a-4f07-9878-dafd7f522d54 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:58.420134 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-844b40f0-4f2a-4f07-9878-dafd7f522d54 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1392 microversion: 2.1 time: 0.481123 Jul 25 12:59:58.420979 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1895/3883] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:57 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1392 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:58.450158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-303d345b-7520-43ef-825b-4cef74ac468f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:58.451045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-303d345b-7520-43ef-825b-4cef74ac468f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:58.467286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-303d345b-7520-43ef-825b-4cef74ac468f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:58.470274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-303d345b-7520-43ef-825b-4cef74ac468f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:58.480686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-303d345b-7520-43ef-825b-4cef74ac468f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:58.481575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-303d345b-7520-43ef-825b-4cef74ac468f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:58.585516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=8 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:58.940514 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fa6e909d-fb08-4db9-a941-8ed370b6a731 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:58.955699 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fa6e909d-fb08-4db9-a941-8ed370b6a731 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.819730 Jul 25 12:59:58.974221 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1989/3884] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:58 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:58.989013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bd406944-bd7e-4036-9308-7636c25d7942 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:58.989795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bd406944-bd7e-4036-9308-7636c25d7942 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:59.001246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd406944-bd7e-4036-9308-7636c25d7942 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:59.005795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd406944-bd7e-4036-9308-7636c25d7942 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:59.011135 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd406944-bd7e-4036-9308-7636c25d7942 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:59.011876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd406944-bd7e-4036-9308-7636c25d7942 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:59.380867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-303d345b-7520-43ef-825b-4cef74ac468f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:59.394418 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-303d345b-7520-43ef-825b-4cef74ac468f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1486 microversion: 2.1 time: 0.972212 Jul 25 12:59:59.395335 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1896/3885] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:58 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1486 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:59.402077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-26c89cff-b79f-44fa-896c-5c453dbdaa8d tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:59.402557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-26c89cff-b79f-44fa-896c-5c453dbdaa8d tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:59.417521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26c89cff-b79f-44fa-896c-5c453dbdaa8d tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:59.419217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26c89cff-b79f-44fa-896c-5c453dbdaa8d tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:59.421020 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26c89cff-b79f-44fa-896c-5c453dbdaa8d tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:59.421653 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26c89cff-b79f-44fa-896c-5c453dbdaa8d tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:59.732923 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bd406944-bd7e-4036-9308-7636c25d7942 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:59.774066 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bd406944-bd7e-4036-9308-7636c25d7942 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.798242 Jul 25 12:59:59.792443 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1990/3886] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:58 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:59.813507 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0581c78c-4074-4b13-926b-8a373ff6ff73 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:59.816190 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-26c89cff-b79f-44fa-896c-5c453dbdaa8d tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66df4d397a40dd8606928b3be2e458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd8dc38f32c4c03a73af0666752d6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:59.817134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0581c78c-4074-4b13-926b-8a373ff6ff73 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:59.829366 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-26c89cff-b79f-44fa-896c-5c453dbdaa8d tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547" status: 200 len: 1317 microversion: 2.1 time: 0.431753 Jul 25 12:59:59.831108 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1897/3887] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:59 2022] GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547 => generated 1317 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:59.839917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0581c78c-4074-4b13-926b-8a373ff6ff73 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:59.840372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0581c78c-4074-4b13-926b-8a373ff6ff73 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:59.841174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0581c78c-4074-4b13-926b-8a373ff6ff73 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:59.842513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0581c78c-4074-4b13-926b-8a373ff6ff73 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:59.853739 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7a9a37c0-be6d-4083-b809-dd67e56b0250 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:59.854922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7a9a37c0-be6d-4083-b809-dd67e56b0250 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:59.864417 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a9a37c0-be6d-4083-b809-dd67e56b0250 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:59.864962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a9a37c0-be6d-4083-b809-dd67e56b0250 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:59.865872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a9a37c0-be6d-4083-b809-dd67e56b0250 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:59.866362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a9a37c0-be6d-4083-b809-dd67e56b0250 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:59.884007 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-0581c78c-4074-4b13-926b-8a373ff6ff73 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lazy-loading 'flavor' on Instance uuid 8d9787fc-a4e1-41f8-be82-3f68c14ad254 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:00:00.140915 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7a9a37c0-be6d-4083-b809-dd67e56b0250 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:00.164504 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7a9a37c0-be6d-4083-b809-dd67e56b0250 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1392 microversion: 2.1 time: 0.331462 Jul 25 13:00:00.165112 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1898/3888] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:59 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1392 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:00.170117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e416125b-0927-490a-86d7-839c3f847b28 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:00.184043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e416125b-0927-490a-86d7-839c3f847b28 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: ba5a5536-d44c-4439-ad04-a0b87ec05e0f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:00.194910 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0581c78c-4074-4b13-926b-8a373ff6ff73 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254/action" status: 202 len: 0 microversion: 2.1 time: 0.400236 Jul 25 13:00:00.197023 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1991/3889] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 12:59:59 2022] POST /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:00:00.202795 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-e416125b-0927-490a-86d7-839c3f847b28 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Instance ba5a5536-d44c-4439-ad04-a0b87ec05e0f could not be found. Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e416125b-0927-490a-86d7-839c3f847b28 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/ba5a5536-d44c-4439-ad04-a0b87ec05e0f/action HTTP/1.1 Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 39 Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: {"os-getConsoleOutput": {"length": 10}} Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance ba5a5536-d44c-4439-ad04-a0b87ec05e0f could not be found. Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'ba5a5536-d44c-4439-ad04-a0b87ec05e0f', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba5a5536-d44c-4439-ad04-a0b87ec05e0f could not be found. Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba5a5536-d44c-4439-ad04-a0b87ec05e0f could not be found. Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:00.210571 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:00.215670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:00.215670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:00.215670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:00:00.215670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:00:00.215670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba5a5536-d44c-4439-ad04-a0b87ec05e0f could not be found. Jul 25 13:00:00.215670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:00.216146 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-06534e6d-fcf2-40ca-af48-3f337be8dcb3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:00.218684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-06534e6d-fcf2-40ca-af48-3f337be8dcb3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:00.218850 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e416125b-0927-490a-86d7-839c3f847b28 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 404 to user: Instance ba5a5536-d44c-4439-ad04-a0b87ec05e0f could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:00:00.218850 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e416125b-0927-490a-86d7-839c3f847b28 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/ba5a5536-d44c-4439-ad04-a0b87ec05e0f/action" status: 404 len: 111 microversion: 2.1 time: 0.051821 Jul 25 13:00:00.218850 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1899/3890] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:00:00 2022] POST /compute/v2.1/servers/ba5a5536-d44c-4439-ad04-a0b87ec05e0f/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:00:00.232244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ccb921a1-6463-492c-88f7-c85371f33549 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:00.233461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ccb921a1-6463-492c-88f7-c85371f33549 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:00.236225 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-06534e6d-fcf2-40ca-af48-3f337be8dcb3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:00.236805 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-06534e6d-fcf2-40ca-af48-3f337be8dcb3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:00.237667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-06534e6d-fcf2-40ca-af48-3f337be8dcb3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:00.238144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-06534e6d-fcf2-40ca-af48-3f337be8dcb3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:00.268108 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ccb921a1-6463-492c-88f7-c85371f33549 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:00.268573 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ccb921a1-6463-492c-88f7-c85371f33549 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:00.269377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ccb921a1-6463-492c-88f7-c85371f33549 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:00.269824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ccb921a1-6463-492c-88f7-c85371f33549 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:00.488370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ccb921a1-6463-492c-88f7-c85371f33549 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:00.500928 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ccb921a1-6463-492c-88f7-c85371f33549 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.276954 Jul 25 13:00:00.504059 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1900/3891] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:00 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:00.528684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6f658d3e-ab96-4c64-860f-ed25c6b0e414 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:00.529231 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6f658d3e-ab96-4c64-860f-ed25c6b0e414 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:00.540969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f658d3e-ab96-4c64-860f-ed25c6b0e414 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:00.541455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f658d3e-ab96-4c64-860f-ed25c6b0e414 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:00.542273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f658d3e-ab96-4c64-860f-ed25c6b0e414 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:00.542634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-06534e6d-fcf2-40ca-af48-3f337be8dcb3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:00.542752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f658d3e-ab96-4c64-860f-ed25c6b0e414 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:00.552373 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-06534e6d-fcf2-40ca-af48-3f337be8dcb3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1492 microversion: 2.1 time: 0.350247 Jul 25 13:00:00.567475 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1992/3892] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:00 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1492 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:00.696292 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6f658d3e-ab96-4c64-860f-ed25c6b0e414 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:00.705660 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6f658d3e-ab96-4c64-860f-ed25c6b0e414 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.185914 Jul 25 13:00:00.706637 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1901/3893] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:00 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:00.737312 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2d26cce4-4ffa-400f-9529-24379e081299 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:00.738051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2d26cce4-4ffa-400f-9529-24379e081299 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 63ef5312-c789-4e79-815f-131f40cee618] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:00.745348 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-2d26cce4-4ffa-400f-9529-24379e081299 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Instance 63ef5312-c789-4e79-815f-131f40cee618 could not be found. Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2d26cce4-4ffa-400f-9529-24379e081299 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/63ef5312-c789-4e79-815f-131f40cee618 HTTP/1.1 Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 63ef5312-c789-4e79-815f-131f40cee618 could not be found. Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '63ef5312-c789-4e79-815f-131f40cee618'} Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63ef5312-c789-4e79-815f-131f40cee618 could not be found. Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63ef5312-c789-4e79-815f-131f40cee618 could not be found. Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:00.747158 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:00.753223 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:00.753223 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:00:00.753223 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:00:00.753223 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63ef5312-c789-4e79-815f-131f40cee618 could not be found. Jul 25 13:00:00.753223 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:00.756172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2d26cce4-4ffa-400f-9529-24379e081299 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 404 to user: Instance 63ef5312-c789-4e79-815f-131f40cee618 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:00:00.758171 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2d26cce4-4ffa-400f-9529-24379e081299 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/63ef5312-c789-4e79-815f-131f40cee618" status: 404 len: 111 microversion: 2.1 time: 0.025379 Jul 25 13:00:00.762434 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1993/3894] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:00 2022] GET /compute/v2.1/servers/63ef5312-c789-4e79-815f-131f40cee618 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:00:00.768199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6b4b0862-92e7-409e-a3dd-9981485534e2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:00.769094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6b4b0862-92e7-409e-a3dd-9981485534e2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:00.779354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b4b0862-92e7-409e-a3dd-9981485534e2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:00.780319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b4b0862-92e7-409e-a3dd-9981485534e2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:00.781206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b4b0862-92e7-409e-a3dd-9981485534e2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:00.781922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b4b0862-92e7-409e-a3dd-9981485534e2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:00.853351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-90e405e7-c379-4857-9732-76fafd71c65f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:00.855252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-90e405e7-c379-4857-9732-76fafd71c65f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:00.870304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90e405e7-c379-4857-9732-76fafd71c65f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:00.870834 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90e405e7-c379-4857-9732-76fafd71c65f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:00.881914 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90e405e7-c379-4857-9732-76fafd71c65f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:00.881914 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90e405e7-c379-4857-9732-76fafd71c65f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:01.070320 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6b4b0862-92e7-409e-a3dd-9981485534e2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:01.082898 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6b4b0862-92e7-409e-a3dd-9981485534e2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.319202 Jul 25 13:00:01.086239 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1902/3895] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:00 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:01.109114 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4fc7b4ce-70e7-4108-9bb2-ed5d75326ed3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:01.110557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4fc7b4ce-70e7-4108-9bb2-ed5d75326ed3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:01.133416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4fc7b4ce-70e7-4108-9bb2-ed5d75326ed3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:01.135012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4fc7b4ce-70e7-4108-9bb2-ed5d75326ed3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:01.137507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4fc7b4ce-70e7-4108-9bb2-ed5d75326ed3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:01.141792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4fc7b4ce-70e7-4108-9bb2-ed5d75326ed3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:01.192600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-90e405e7-c379-4857-9732-76fafd71c65f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66df4d397a40dd8606928b3be2e458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd8dc38f32c4c03a73af0666752d6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:01.204810 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-90e405e7-c379-4857-9732-76fafd71c65f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547" status: 200 len: 1317 microversion: 2.1 time: 0.356562 Jul 25 13:00:01.207418 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1994/3896] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:00 2022] GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547 => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:01.223927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-057ce892-38a6-4fbb-b603-536dec3ed5d5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:01.224794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-057ce892-38a6-4fbb-b603-536dec3ed5d5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:01.239511 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-057ce892-38a6-4fbb-b603-536dec3ed5d5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:01.240994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-057ce892-38a6-4fbb-b603-536dec3ed5d5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:01.259648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-057ce892-38a6-4fbb-b603-536dec3ed5d5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:01.259648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-057ce892-38a6-4fbb-b603-536dec3ed5d5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:01.517162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4fc7b4ce-70e7-4108-9bb2-ed5d75326ed3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:01.528880 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4fc7b4ce-70e7-4108-9bb2-ed5d75326ed3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.423757 Jul 25 13:00:01.532259 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1903/3897] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:01 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:01.574885 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-c3a8bbd8-6a6d-4e67-adb9-35b5c9676638 req-bdc649e1-e94d-4a80-a82d-49ea00aa73ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7954e97-a6c3-4017-a41d-2e61083c6ab5", "name": "network-vif-plugged", "status": "completed", "tag": "47fb272d-6ac9-419c-81e1-c632660c9f57"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:01.591380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-057ce892-38a6-4fbb-b603-536dec3ed5d5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:01.593470 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c3a8bbd8-6a6d-4e67-adb9-35b5c9676638 req-bdc649e1-e94d-4a80-a82d-49ea00aa73ac service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:01.595736 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c3a8bbd8-6a6d-4e67-adb9-35b5c9676638 req-bdc649e1-e94d-4a80-a82d-49ea00aa73ac service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:01.603464 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-057ce892-38a6-4fbb-b603-536dec3ed5d5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1392 microversion: 2.1 time: 0.391956 Jul 25 13:00:01.607329 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1995/3898] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:01 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1392 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:01.615045 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-c3a8bbd8-6a6d-4e67-adb9-35b5c9676638 req-bdc649e1-e94d-4a80-a82d-49ea00aa73ac service nova] Creating event network-vif-plugged:47fb272d-6ac9-419c-81e1-c632660c9f57 for instance d7954e97-a6c3-4017-a41d-2e61083c6ab5 on n-h2-848886-15 Jul 25 13:00:01.623438 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-c3a8bbd8-6a6d-4e67-adb9-35b5c9676638 req-bdc649e1-e94d-4a80-a82d-49ea00aa73ac service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055511 Jul 25 13:00:01.624202 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1904/3899] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:00:01.626769 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6c977990-f999-40b4-a216-367e45d86265 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:01.627404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6c977990-f999-40b4-a216-367e45d86265 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:01.644489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c977990-f999-40b4-a216-367e45d86265 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:01.644949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c977990-f999-40b4-a216-367e45d86265 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:01.645731 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c977990-f999-40b4-a216-367e45d86265 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:01.652015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c977990-f999-40b4-a216-367e45d86265 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:01.771124 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-db924b4f-9ea0-4566-8554-81b5527d8363 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1144765942", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-db924b4f-9ea0-4566-8554-81b5527d8363 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 238 Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1144765942", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1144765942', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'dc975d58-9818-4c8b-8bcd-8b1a23df5609'}]}}} Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:01.795341 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-db924b4f-9ea0-4566-8554-81b5527d8363 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-db924b4f-9ea0-4566-8554-81b5527d8363 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.034991 Jul 25 13:00:01.803745 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1905/3900] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:00:01 2022] POST /compute/v2.1/servers => generated 139 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:00:01.815611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-573a99a6-86d4-4631-9d28-022df6776042 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:01.816524 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-573a99a6-86d4-4631-9d28-022df6776042 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:01.834711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-573a99a6-86d4-4631-9d28-022df6776042 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:01.837540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-573a99a6-86d4-4631-9d28-022df6776042 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:01.838744 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-573a99a6-86d4-4631-9d28-022df6776042 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:01.839346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-573a99a6-86d4-4631-9d28-022df6776042 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:02.046708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6c977990-f999-40b4-a216-367e45d86265 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:02.061623 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6c977990-f999-40b4-a216-367e45d86265 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1513 microversion: 2.1 time: 0.451885 Jul 25 13:00:02.062986 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1996/3901] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:01 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1513 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:02.120692 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-573a99a6-86d4-4631-9d28-022df6776042 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:02.137302 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-573a99a6-86d4-4631-9d28-022df6776042 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.333528 Jul 25 13:00:02.137915 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1906/3902] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:01 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:02.163164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a65b646c-68a3-41fa-b29a-ade0a65c64f1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:02.164081 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a65b646c-68a3-41fa-b29a-ade0a65c64f1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:02.176290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a65b646c-68a3-41fa-b29a-ade0a65c64f1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:02.176955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a65b646c-68a3-41fa-b29a-ade0a65c64f1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:02.178129 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a65b646c-68a3-41fa-b29a-ade0a65c64f1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:02.178735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a65b646c-68a3-41fa-b29a-ade0a65c64f1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:02.234267 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f259fe3d-6d98-4d80-b6ff-9965b535173f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:02.234555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f259fe3d-6d98-4d80-b6ff-9965b535173f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:02.241674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f259fe3d-6d98-4d80-b6ff-9965b535173f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:02.242637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f259fe3d-6d98-4d80-b6ff-9965b535173f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:02.243731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f259fe3d-6d98-4d80-b6ff-9965b535173f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:02.244322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f259fe3d-6d98-4d80-b6ff-9965b535173f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:02.974908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a65b646c-68a3-41fa-b29a-ade0a65c64f1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:02.987734 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a65b646c-68a3-41fa-b29a-ade0a65c64f1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.829866 Jul 25 13:00:02.988660 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1997/3903] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:02 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:02.993349 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a0400e80-a08e-452e-81c1-8d8d8439ec4f tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:03.006174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a0400e80-a08e-452e-81c1-8d8d8439ec4f tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:03.020379 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f259fe3d-6d98-4d80-b6ff-9965b535173f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66df4d397a40dd8606928b3be2e458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd8dc38f32c4c03a73af0666752d6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:03.026270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0400e80-a08e-452e-81c1-8d8d8439ec4f tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:03.026970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0400e80-a08e-452e-81c1-8d8d8439ec4f tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:03.028061 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0400e80-a08e-452e-81c1-8d8d8439ec4f tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:03.028754 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0400e80-a08e-452e-81c1-8d8d8439ec4f tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:03.054151 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f259fe3d-6d98-4d80-b6ff-9965b535173f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547" status: 200 len: 1317 microversion: 2.1 time: 0.824909 Jul 25 13:00:03.065865 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1907/3904] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:02 2022] GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547 => generated 1317 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:03.085239 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0847e861-949e-4081-a11c-5fd4cec88690 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:03.086245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0847e861-949e-4081-a11c-5fd4cec88690 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:03.095203 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0847e861-949e-4081-a11c-5fd4cec88690 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:03.101493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0847e861-949e-4081-a11c-5fd4cec88690 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:03.104546 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0847e861-949e-4081-a11c-5fd4cec88690 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:03.105214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0847e861-949e-4081-a11c-5fd4cec88690 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:03.494533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a0400e80-a08e-452e-81c1-8d8d8439ec4f tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:03.503788 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a0400e80-a08e-452e-81c1-8d8d8439ec4f tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1392 microversion: 2.1 time: 0.514019 Jul 25 13:00:03.507759 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1998/3905] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:02 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1392 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:03.520177 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e52f06f1-852d-412d-abfc-2dcc6e5e1294 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-27559476", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e52f06f1-852d-412d-abfc-2dcc6e5e1294 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 233 Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-27559476", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-27559476', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'dc975d58-9818-4c8b-8bcd-8b1a23df5609'}]}}} Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise error Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:03.535049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e52f06f1-852d-412d-abfc-2dcc6e5e1294 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e52f06f1-852d-412d-abfc-2dcc6e5e1294 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.027877 Jul 25 13:00:03.539498 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 1999/3906] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:00:03 2022] POST /compute/v2.1/servers => generated 133 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:00:03.554024 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aa41baf3-930a-4b4e-a220-3c66eaaf1b6c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:03.554907 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-aa41baf3-930a-4b4e-a220-3c66eaaf1b6c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:03.575677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa41baf3-930a-4b4e-a220-3c66eaaf1b6c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:03.576310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa41baf3-930a-4b4e-a220-3c66eaaf1b6c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:03.585196 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0847e861-949e-4081-a11c-5fd4cec88690 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:03.586594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa41baf3-930a-4b4e-a220-3c66eaaf1b6c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:03.587109 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa41baf3-930a-4b4e-a220-3c66eaaf1b6c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:03.595460 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0847e861-949e-4081-a11c-5fd4cec88690 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1508 microversion: 2.1 time: 0.514611 Jul 25 13:00:03.601526 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1908/3907] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:03 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1508 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:03.711577 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-107a1be4-651c-4d04-814e-a8d7ea6586f9 req-0621db2f-f608-4363-95c9-d286b6ff0ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73470aab-4487-4be2-9f33-c5704236f547", "name": "network-vif-plugged", "status": "completed", "tag": "0698b915-741b-4a9c-ad79-4ecef999413c"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:03.738328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-107a1be4-651c-4d04-814e-a8d7ea6586f9 req-0621db2f-f608-4363-95c9-d286b6ff0ec7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:03.738935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-107a1be4-651c-4d04-814e-a8d7ea6586f9 req-0621db2f-f608-4363-95c9-d286b6ff0ec7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:03.806772 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-107a1be4-651c-4d04-814e-a8d7ea6586f9 req-0621db2f-f608-4363-95c9-d286b6ff0ec7 service nova] Creating event network-vif-plugged:0698b915-741b-4a9c-ad79-4ecef999413c for instance 73470aab-4487-4be2-9f33-c5704236f547 on n-h1-848886-15 Jul 25 13:00:03.817958 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-107a1be4-651c-4d04-814e-a8d7ea6586f9 req-0621db2f-f608-4363-95c9-d286b6ff0ec7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110305 Jul 25 13:00:03.822524 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1909/3908] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:00:04.083116 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-83cd3e2c-2fd0-48e6-b8e8-13fcb0b4fdff tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:04.084041 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-83cd3e2c-2fd0-48e6-b8e8-13fcb0b4fdff tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:04.116252 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-83cd3e2c-2fd0-48e6-b8e8-13fcb0b4fdff tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:04.116971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-83cd3e2c-2fd0-48e6-b8e8-13fcb0b4fdff tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:04.117990 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-83cd3e2c-2fd0-48e6-b8e8-13fcb0b4fdff tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:04.118582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-83cd3e2c-2fd0-48e6-b8e8-13fcb0b4fdff tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:04.231719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-aa41baf3-930a-4b4e-a220-3c66eaaf1b6c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:04.243516 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-aa41baf3-930a-4b4e-a220-3c66eaaf1b6c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.700866 Jul 25 13:00:04.244541 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2000/3909] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:03 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:04.278500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-632681f5-61f0-4ea0-85ed-78cce3751179 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:04.281610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-632681f5-61f0-4ea0-85ed-78cce3751179 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:04.291470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-632681f5-61f0-4ea0-85ed-78cce3751179 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:04.302545 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-632681f5-61f0-4ea0-85ed-78cce3751179 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:04.303458 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-632681f5-61f0-4ea0-85ed-78cce3751179 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:04.303909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-632681f5-61f0-4ea0-85ed-78cce3751179 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:04.644980 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-83cd3e2c-2fd0-48e6-b8e8-13fcb0b4fdff tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66df4d397a40dd8606928b3be2e458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd8dc38f32c4c03a73af0666752d6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:04.672866 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-83cd3e2c-2fd0-48e6-b8e8-13fcb0b4fdff tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547" status: 200 len: 1317 microversion: 2.1 time: 0.579962 Jul 25 13:00:04.672866 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1910/3910] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:04 2022] GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547 => generated 1317 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:04.693823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cee1cf16-dc4e-4a0d-bff0-5452fe7b64ac tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:04.694518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cee1cf16-dc4e-4a0d-bff0-5452fe7b64ac tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:04.718278 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cee1cf16-dc4e-4a0d-bff0-5452fe7b64ac tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:04.718744 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cee1cf16-dc4e-4a0d-bff0-5452fe7b64ac tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:04.719568 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cee1cf16-dc4e-4a0d-bff0-5452fe7b64ac tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:04.720007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cee1cf16-dc4e-4a0d-bff0-5452fe7b64ac tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:04.744945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-632681f5-61f0-4ea0-85ed-78cce3751179 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:04.749334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:00:04.752391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:00:04.771445 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-632681f5-61f0-4ea0-85ed-78cce3751179 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.486779 Jul 25 13:00:04.792578 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2001/3911] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:04 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:04.805660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-efd0be4f-78ea-4fa6-9bbb-d627964a1a40 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:04.807493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-efd0be4f-78ea-4fa6-9bbb-d627964a1a40 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:04.837397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-efd0be4f-78ea-4fa6-9bbb-d627964a1a40 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:04.838309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-efd0be4f-78ea-4fa6-9bbb-d627964a1a40 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:04.839356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-efd0be4f-78ea-4fa6-9bbb-d627964a1a40 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:04.840231 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-efd0be4f-78ea-4fa6-9bbb-d627964a1a40 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:05.564314 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-efd0be4f-78ea-4fa6-9bbb-d627964a1a40 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:05.579602 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-efd0be4f-78ea-4fa6-9bbb-d627964a1a40 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1508 microversion: 2.1 time: 0.784870 Jul 25 13:00:05.591832 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2002/3912] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:04 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1508 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:05.622841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a1f43804-497c-457e-ba6f-b8236c23ecb2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:05.632259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a1f43804-497c-457e-ba6f-b8236c23ecb2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 1b400e8a-5dfb-43fd-a4cf-958aeb9e668a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:05.653975 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-a1f43804-497c-457e-ba6f-b8236c23ecb2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Instance 1b400e8a-5dfb-43fd-a4cf-958aeb9e668a could not be found. Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a1f43804-497c-457e-ba6f-b8236c23ecb2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/1b400e8a-5dfb-43fd-a4cf-958aeb9e668a/action HTTP/1.1 Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 13 Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: {"pause": {}} Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 1b400e8a-5dfb-43fd-a4cf-958aeb9e668a could not be found. Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '1b400e8a-5dfb-43fd-a4cf-958aeb9e668a', 'body': {'pause': {}}} Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b400e8a-5dfb-43fd-a4cf-958aeb9e668a could not be found. Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b400e8a-5dfb-43fd-a4cf-958aeb9e668a could not be found. Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:05.665906 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:05.672168 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:00:05.672168 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:00:05.672168 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b400e8a-5dfb-43fd-a4cf-958aeb9e668a could not be found. Jul 25 13:00:05.672168 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:05.673258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a1f43804-497c-457e-ba6f-b8236c23ecb2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 404 to user: Instance 1b400e8a-5dfb-43fd-a4cf-958aeb9e668a could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:00:05.674150 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a1f43804-497c-457e-ba6f-b8236c23ecb2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/1b400e8a-5dfb-43fd-a4cf-958aeb9e668a/action" status: 404 len: 111 microversion: 2.1 time: 0.080563 Jul 25 13:00:05.674890 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2003/3913] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:00:05 2022] POST /compute/v2.1/servers/1b400e8a-5dfb-43fd-a4cf-958aeb9e668a/action => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:00:05.686336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f340f048-6743-4454-8375-7a3bc125c3d8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:05.687280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f340f048-6743-4454-8375-7a3bc125c3d8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:05.698800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f340f048-6743-4454-8375-7a3bc125c3d8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:05.699462 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f340f048-6743-4454-8375-7a3bc125c3d8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:05.701082 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f340f048-6743-4454-8375-7a3bc125c3d8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:05.702484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f340f048-6743-4454-8375-7a3bc125c3d8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:05.753743 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cee1cf16-dc4e-4a0d-bff0-5452fe7b64ac tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:05.774792 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cee1cf16-dc4e-4a0d-bff0-5452fe7b64ac tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1564 microversion: 2.1 time: 1.111449 Jul 25 13:00:05.790025 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1911/3914] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:04 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1564 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:05.809196 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f0b4f1e0-cc03-424a-9bbb-fd882ce644b9 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:05.809941 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f0b4f1e0-cc03-424a-9bbb-fd882ce644b9 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:05.827888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0b4f1e0-cc03-424a-9bbb-fd882ce644b9 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:05.828645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0b4f1e0-cc03-424a-9bbb-fd882ce644b9 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:05.830564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0b4f1e0-cc03-424a-9bbb-fd882ce644b9 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:05.832523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0b4f1e0-cc03-424a-9bbb-fd882ce644b9 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:06.233030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f340f048-6743-4454-8375-7a3bc125c3d8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:06.256801 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f340f048-6743-4454-8375-7a3bc125c3d8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.575265 Jul 25 13:00:06.257439 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2004/3915] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:05 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:06.262927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b81a9fe8-92ed-403b-ae02-d0e00ffbe5d3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:06.263764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b81a9fe8-92ed-403b-ae02-d0e00ffbe5d3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:06.269653 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:00:06.271567 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b81a9fe8-92ed-403b-ae02-d0e00ffbe5d3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:06.272349 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b81a9fe8-92ed-403b-ae02-d0e00ffbe5d3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:06.273385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b81a9fe8-92ed-403b-ae02-d0e00ffbe5d3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:06.274055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b81a9fe8-92ed-403b-ae02-d0e00ffbe5d3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:06.509354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f0b4f1e0-cc03-424a-9bbb-fd882ce644b9 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66df4d397a40dd8606928b3be2e458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd8dc38f32c4c03a73af0666752d6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:06.522344 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f0b4f1e0-cc03-424a-9bbb-fd882ce644b9 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547" status: 200 len: 1506 microversion: 2.1 time: 0.727712 Jul 25 13:00:06.523392 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1912/3916] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:05 2022] GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547 => generated 1506 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:06.538131 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-17776ecb-d57d-4df8-accc-bd60195e6245 req-587ac2b8-a59f-4451-926c-02114796117e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9787fc-a4e1-41f8-be82-3f68c14ad254", "name": "network-vif-plugged", "status": "completed", "tag": "cce124d7-06ab-47f8-9713-88ca17dcee95"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:06.563456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-17776ecb-d57d-4df8-accc-bd60195e6245 req-587ac2b8-a59f-4451-926c-02114796117e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:06.565067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-17776ecb-d57d-4df8-accc-bd60195e6245 req-587ac2b8-a59f-4451-926c-02114796117e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:06.649158 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-17776ecb-d57d-4df8-accc-bd60195e6245 req-587ac2b8-a59f-4451-926c-02114796117e service nova] Creating event network-vif-plugged:cce124d7-06ab-47f8-9713-88ca17dcee95 for instance 8d9787fc-a4e1-41f8-be82-3f68c14ad254 on n-h2-848886-15 Jul 25 13:00:06.659681 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-17776ecb-d57d-4df8-accc-bd60195e6245 req-587ac2b8-a59f-4451-926c-02114796117e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132908 Jul 25 13:00:06.660641 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1913/3917] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:00:06.666458 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-37abc532-63af-4ba9-b370-a09d6464872f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:06.668405 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-37abc532-63af-4ba9-b370-a09d6464872f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:06.681555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37abc532-63af-4ba9-b370-a09d6464872f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:06.683502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37abc532-63af-4ba9-b370-a09d6464872f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:06.684751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37abc532-63af-4ba9-b370-a09d6464872f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:06.685460 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37abc532-63af-4ba9-b370-a09d6464872f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:06.916884 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b81a9fe8-92ed-403b-ae02-d0e00ffbe5d3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:06.932339 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b81a9fe8-92ed-403b-ae02-d0e00ffbe5d3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1564 microversion: 2.1 time: 0.673256 Jul 25 13:00:06.933306 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2005/3918] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:06 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1564 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:06.944631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d31d331a-b85b-41ef-80a9-dc32d29a009f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:06.963292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d31d331a-b85b-41ef-80a9-dc32d29a009f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:06.985799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d31d331a-b85b-41ef-80a9-dc32d29a009f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:06.986283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d31d331a-b85b-41ef-80a9-dc32d29a009f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:06.987298 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d31d331a-b85b-41ef-80a9-dc32d29a009f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:06.987905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d31d331a-b85b-41ef-80a9-dc32d29a009f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:07.058358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d31d331a-b85b-41ef-80a9-dc32d29a009f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '4b66df4d397a40dd8606928b3be2e458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd8dc38f32c4c03a73af0666752d6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:07.059425 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d31d331a-b85b-41ef-80a9-dc32d29a009f tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547/os-instance-actions/req-334068f5-1604-4a18-b5a6-7d2eaff37084" status: 200 len: 313 microversion: 2.1 time: 0.124804 Jul 25 13:00:07.060309 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2006/3919] 10.222.0.49 () {58 vars in 1419 bytes} [Mon Jul 25 13:00:06 2022] GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547/os-instance-actions/req-334068f5-1604-4a18-b5a6-7d2eaff37084 => generated 313 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:00:07.064794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-13b60cc6-c3d8-473e-bf4e-83a082cd778b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:07.066180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-13b60cc6-c3d8-473e-bf4e-83a082cd778b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:07.083796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-13b60cc6-c3d8-473e-bf4e-83a082cd778b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:07.083796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-13b60cc6-c3d8-473e-bf4e-83a082cd778b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:07.084250 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-13b60cc6-c3d8-473e-bf4e-83a082cd778b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:07.084762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-13b60cc6-c3d8-473e-bf4e-83a082cd778b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:07.351558 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-37abc532-63af-4ba9-b370-a09d6464872f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:07.381305 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-37abc532-63af-4ba9-b370-a09d6464872f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.719055 Jul 25 13:00:07.384613 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1914/3920] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:06 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:07.390082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8eebf9a2-506a-4a42-8ac9-cb0a9f701f35 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:07.399561 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8eebf9a2-506a-4a42-8ac9-cb0a9f701f35 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:07.411993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8eebf9a2-506a-4a42-8ac9-cb0a9f701f35 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:07.415198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8eebf9a2-506a-4a42-8ac9-cb0a9f701f35 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:07.416332 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8eebf9a2-506a-4a42-8ac9-cb0a9f701f35 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:07.417063 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8eebf9a2-506a-4a42-8ac9-cb0a9f701f35 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:08.318867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-13b60cc6-c3d8-473e-bf4e-83a082cd778b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:08.328782 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-13b60cc6-c3d8-473e-bf4e-83a082cd778b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1508 microversion: 2.1 time: 1.267378 Jul 25 13:00:08.329488 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2007/3921] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:07 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1508 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:08.336192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a6438d33-748c-4189-89f7-8ed141743cd1 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:08.339894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a6438d33-748c-4189-89f7-8ed141743cd1 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:08.347980 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a6438d33-748c-4189-89f7-8ed141743cd1 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:08.348838 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a6438d33-748c-4189-89f7-8ed141743cd1 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:08.354255 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a6438d33-748c-4189-89f7-8ed141743cd1 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:08.356453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a6438d33-748c-4189-89f7-8ed141743cd1 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:08.553989 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a6438d33-748c-4189-89f7-8ed141743cd1 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "POST /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547/action" status: 202 len: 0 microversion: 2.1 time: 0.222047 Jul 25 13:00:08.556231 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2008/3922] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:00:08 2022] POST /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:00:08.566199 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-25d4f130-826c-4dcf-98c7-1820df18ca42 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:08.567454 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-25d4f130-826c-4dcf-98c7-1820df18ca42 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:08.581976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25d4f130-826c-4dcf-98c7-1820df18ca42 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:08.582738 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25d4f130-826c-4dcf-98c7-1820df18ca42 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:08.584450 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25d4f130-826c-4dcf-98c7-1820df18ca42 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:08.585502 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25d4f130-826c-4dcf-98c7-1820df18ca42 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:08.736685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8eebf9a2-506a-4a42-8ac9-cb0a9f701f35 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:08.752307 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-25d4f130-826c-4dcf-98c7-1820df18ca42 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action" status: 202 len: 0 microversion: 2.1 time: 0.194040 Jul 25 13:00:08.758018 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8eebf9a2-506a-4a42-8ac9-cb0a9f701f35 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:08.761304 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8eebf9a2-506a-4a42-8ac9-cb0a9f701f35 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:08.763068 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8eebf9a2-506a-4a42-8ac9-cb0a9f701f35 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 2947 microversion: 2.42 time: 1.377157 Jul 25 13:00:08.764742 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1915/3924] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:00:07 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 2947 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:00:08.766039 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2009/3923] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:00:08 2022] POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:00:08.784144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-480365f4-6338-4971-b36a-80e8057687a7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:08.784495 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d6a33012-504a-4caf-b3e8-65c13a7af748 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:08.786681 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d6a33012-504a-4caf-b3e8-65c13a7af748 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:08.787994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-480365f4-6338-4971-b36a-80e8057687a7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:08.812876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-480365f4-6338-4971-b36a-80e8057687a7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:08.813658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-480365f4-6338-4971-b36a-80e8057687a7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:08.814676 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-480365f4-6338-4971-b36a-80e8057687a7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:08.815338 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-480365f4-6338-4971-b36a-80e8057687a7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:08.820177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d6a33012-504a-4caf-b3e8-65c13a7af748 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:08.820995 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d6a33012-504a-4caf-b3e8-65c13a7af748 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:08.822041 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d6a33012-504a-4caf-b3e8-65c13a7af748 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:08.825423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d6a33012-504a-4caf-b3e8-65c13a7af748 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:09.472758 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-480365f4-6338-4971-b36a-80e8057687a7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:09.492990 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-480365f4-6338-4971-b36a-80e8057687a7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1510 microversion: 2.1 time: 0.723376 Jul 25 13:00:09.493919 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2010/3925] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:08 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1510 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:09.498960 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6758d64a-449e-4b9c-93b8-2910cd693331 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:09.499684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6758d64a-449e-4b9c-93b8-2910cd693331 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:09.515987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6758d64a-449e-4b9c-93b8-2910cd693331 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:09.516721 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6758d64a-449e-4b9c-93b8-2910cd693331 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:09.517699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6758d64a-449e-4b9c-93b8-2910cd693331 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:09.518323 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6758d64a-449e-4b9c-93b8-2910cd693331 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:09.639434 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d6a33012-504a-4caf-b3e8-65c13a7af748 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66df4d397a40dd8606928b3be2e458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd8dc38f32c4c03a73af0666752d6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:09.658371 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d6a33012-504a-4caf-b3e8-65c13a7af748 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547" status: 200 len: 1508 microversion: 2.1 time: 0.890046 Jul 25 13:00:09.660425 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1916/3926] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:08 2022] GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547 => generated 1508 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:09.678232 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2b589567-a3bb-4407-9f85-298fc55a9f70 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:09.680132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2b589567-a3bb-4407-9f85-298fc55a9f70 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:09.687420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b589567-a3bb-4407-9f85-298fc55a9f70 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:09.688254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b589567-a3bb-4407-9f85-298fc55a9f70 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:09.689111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b589567-a3bb-4407-9f85-298fc55a9f70 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:09.689614 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b589567-a3bb-4407-9f85-298fc55a9f70 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:10.030612 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6758d64a-449e-4b9c-93b8-2910cd693331 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.534984 Jul 25 13:00:10.032043 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2011/3927] 10.222.0.49 () {60 vars in 1316 bytes} [Mon Jul 25 13:00:09 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4/os-interface => generated 1829 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:00:10.294366 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2b589567-a3bb-4407-9f85-298fc55a9f70 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:10.305229 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2b589567-a3bb-4407-9f85-298fc55a9f70 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1508 microversion: 2.1 time: 0.643422 Jul 25 13:00:10.311551 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1917/3928] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:09 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1508 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:10.516502 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fe88299f-f4ed-460f-a698-8c0a9117a9a7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:10.517201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fe88299f-f4ed-460f-a698-8c0a9117a9a7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:10.530209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fe88299f-f4ed-460f-a698-8c0a9117a9a7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:10.530693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fe88299f-f4ed-460f-a698-8c0a9117a9a7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:10.531538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fe88299f-f4ed-460f-a698-8c0a9117a9a7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:10.531985 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fe88299f-f4ed-460f-a698-8c0a9117a9a7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:10.682773 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-caa316d0-15de-4f26-b4d5-0bff7d57f903 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:10.683752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-caa316d0-15de-4f26-b4d5-0bff7d57f903 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:10.696819 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:00:10.704785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-caa316d0-15de-4f26-b4d5-0bff7d57f903 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:10.708237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-caa316d0-15de-4f26-b4d5-0bff7d57f903 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:10.709913 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-caa316d0-15de-4f26-b4d5-0bff7d57f903 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:10.710565 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-caa316d0-15de-4f26-b4d5-0bff7d57f903 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:11.055818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-caa316d0-15de-4f26-b4d5-0bff7d57f903 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66df4d397a40dd8606928b3be2e458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd8dc38f32c4c03a73af0666752d6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:11.067982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fe88299f-f4ed-460f-a698-8c0a9117a9a7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:11.072548 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-caa316d0-15de-4f26-b4d5-0bff7d57f903 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547" status: 200 len: 1508 microversion: 2.1 time: 0.391607 Jul 25 13:00:11.075693 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1918/3929] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:10 2022] GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547 => generated 1508 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:11.078667 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fe88299f-f4ed-460f-a698-8c0a9117a9a7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1490 microversion: 2.1 time: 0.566670 Jul 25 13:00:11.086834 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8eb1a920-865a-4eb3-a3f1-3cdeb794e851 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:11.087750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8eb1a920-865a-4eb3-a3f1-3cdeb794e851 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:11.094639 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2012/3930] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:10 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1490 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:11.103909 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8eb1a920-865a-4eb3-a3f1-3cdeb794e851 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:11.104654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-0876bf1e-40d9-4492-be3d-5d0c7e71fdb7 req-49d1c56e-37ef-4fd9-b94a-05295c7e8fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7954e97-a6c3-4017-a41d-2e61083c6ab5", "tag": "47fb272d-6ac9-419c-81e1-c632660c9f57"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:11.104858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8eb1a920-865a-4eb3-a3f1-3cdeb794e851 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:11.106798 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8eb1a920-865a-4eb3-a3f1-3cdeb794e851 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:11.110510 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8eb1a920-865a-4eb3-a3f1-3cdeb794e851 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:11.118034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-0876bf1e-40d9-4492-be3d-5d0c7e71fdb7 req-49d1c56e-37ef-4fd9-b94a-05295c7e8fe5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:11.118890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-0876bf1e-40d9-4492-be3d-5d0c7e71fdb7 req-49d1c56e-37ef-4fd9-b94a-05295c7e8fe5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:11.145486 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-0876bf1e-40d9-4492-be3d-5d0c7e71fdb7 req-49d1c56e-37ef-4fd9-b94a-05295c7e8fe5 service nova] Creating event network-changed:47fb272d-6ac9-419c-81e1-c632660c9f57 for instance d7954e97-a6c3-4017-a41d-2e61083c6ab5 on n-h2-848886-15 Jul 25 13:00:11.155714 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-0876bf1e-40d9-4492-be3d-5d0c7e71fdb7 req-49d1c56e-37ef-4fd9-b94a-05295c7e8fe5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058832 Jul 25 13:00:11.157195 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2013/3931] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:00:11.165190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ab38e9f1-a607-4e4d-83a6-18e06cb44c92 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:11.166282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ab38e9f1-a607-4e4d-83a6-18e06cb44c92 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:11.175937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ab38e9f1-a607-4e4d-83a6-18e06cb44c92 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:11.177894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ab38e9f1-a607-4e4d-83a6-18e06cb44c92 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:11.179060 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ab38e9f1-a607-4e4d-83a6-18e06cb44c92 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:11.179730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ab38e9f1-a607-4e4d-83a6-18e06cb44c92 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:11.273522 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-ab38e9f1-a607-4e4d-83a6-18e06cb44c92 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Cannot 'pause' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state paused Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ab38e9f1-a607-4e4d-83a6-18e06cb44c92 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action HTTP/1.1 Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 13 Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: {"pause": {}} Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: exception: Cannot 'pause' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state paused Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2', 'body': {'pause': {}}} Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 in vm_state paused. Cannot pause while the instance is in this state. Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state paused Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:11.283759 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:11.288308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:11.288308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:00:11.288308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:00:11.288308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state paused Jul 25 13:00:11.288308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:11.299427 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ab38e9f1-a607-4e4d-83a6-18e06cb44c92 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 409 to user: Cannot 'pause' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state paused {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:00:11.302660 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ab38e9f1-a607-4e4d-83a6-18e06cb44c92 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action" status: 409 len: 143 microversion: 2.1 time: 0.143887 Jul 25 13:00:11.310886 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2014/3932] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:00:11 2022] POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action => generated 143 bytes in 153 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 13:00:11.323741 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f8a7ff21-b79a-4a53-bc2a-09c1ee5f9319 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:11.326410 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f8a7ff21-b79a-4a53-bc2a-09c1ee5f9319 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:11.351191 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8a7ff21-b79a-4a53-bc2a-09c1ee5f9319 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:11.351898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8a7ff21-b79a-4a53-bc2a-09c1ee5f9319 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:11.353394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8a7ff21-b79a-4a53-bc2a-09c1ee5f9319 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:11.353981 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8a7ff21-b79a-4a53-bc2a-09c1ee5f9319 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:11.562129 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f8a7ff21-b79a-4a53-bc2a-09c1ee5f9319 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action" status: 202 len: 0 microversion: 2.1 time: 0.244553 Jul 25 13:00:11.568043 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2015/3933] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:00:11 2022] POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:00:11.586153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a95d3e89-bcac-44ee-9cfb-02fa6342e6e3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:11.596617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a95d3e89-bcac-44ee-9cfb-02fa6342e6e3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:11.621791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a95d3e89-bcac-44ee-9cfb-02fa6342e6e3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:11.626289 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a95d3e89-bcac-44ee-9cfb-02fa6342e6e3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:11.630915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a95d3e89-bcac-44ee-9cfb-02fa6342e6e3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:11.634543 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a95d3e89-bcac-44ee-9cfb-02fa6342e6e3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:11.742352 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8eb1a920-865a-4eb3-a3f1-3cdeb794e851 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:11.756965 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8eb1a920-865a-4eb3-a3f1-3cdeb794e851 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1564 microversion: 2.1 time: 0.679101 Jul 25 13:00:11.760075 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1919/3934] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:11 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1564 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:11.782015 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e68b2f96-e66c-41e7-9b91-f3d3681c94fd tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:11.787973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e68b2f96-e66c-41e7-9b91-f3d3681c94fd tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:11.811220 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e68b2f96-e66c-41e7-9b91-f3d3681c94fd tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:11.811716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e68b2f96-e66c-41e7-9b91-f3d3681c94fd tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:11.821961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e68b2f96-e66c-41e7-9b91-f3d3681c94fd tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:11.822550 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e68b2f96-e66c-41e7-9b91-f3d3681c94fd tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:12.695682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a95d3e89-bcac-44ee-9cfb-02fa6342e6e3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:12.710606 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a95d3e89-bcac-44ee-9cfb-02fa6342e6e3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1508 microversion: 2.1 time: 1.139232 Jul 25 13:00:12.716353 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2016/3935] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:11 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1508 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:12.725094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-22d5d0ad-7d05-4521-8ab6-28f7e965a48e tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:12.735715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-22d5d0ad-7d05-4521-8ab6-28f7e965a48e tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:12.768528 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-22d5d0ad-7d05-4521-8ab6-28f7e965a48e tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:12.769317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-22d5d0ad-7d05-4521-8ab6-28f7e965a48e tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:12.772595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-22d5d0ad-7d05-4521-8ab6-28f7e965a48e tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:12.773283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-22d5d0ad-7d05-4521-8ab6-28f7e965a48e tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:13.071076 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e68b2f96-e66c-41e7-9b91-f3d3681c94fd tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:13.081816 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e68b2f96-e66c-41e7-9b91-f3d3681c94fd tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1497 microversion: 2.1 time: 1.320383 Jul 25 13:00:13.096220 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1920/3936] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:11 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1497 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:13.470886 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-22d5d0ad-7d05-4521-8ab6-28f7e965a48e tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66df4d397a40dd8606928b3be2e458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd8dc38f32c4c03a73af0666752d6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:13.475064 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:00:13.503806 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-22d5d0ad-7d05-4521-8ab6-28f7e965a48e tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547" status: 200 len: 1506 microversion: 2.1 time: 0.773055 Jul 25 13:00:13.523495 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2017/3937] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:12 2022] GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547 => generated 1506 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:13.529663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ac43f871-e27a-418f-9e3e-a94b68851714 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Calling method '.version_select at 0x7efcf8d05dc0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:13.530356 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ac43f871-e27a-418f-9e3e-a94b68851714 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:13.571136 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ac43f871-e27a-418f-9e3e-a94b68851714 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:13.571623 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ac43f871-e27a-418f-9e3e-a94b68851714 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:13.572449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ac43f871-e27a-418f-9e3e-a94b68851714 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:13.573026 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ac43f871-e27a-418f-9e3e-a94b68851714 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:13.728220 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ac43f871-e27a-418f-9e3e-a94b68851714 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.203571 Jul 25 13:00:13.729446 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1921/3938] 10.222.0.49 () {58 vars in 1296 bytes} [Mon Jul 25 13:00:13 2022] GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547/os-instance-actions => generated 611 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:00:13.744669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-19d32483-a4bd-4ab4-b204-2f5a108b6fe7 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:13.745590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-19d32483-a4bd-4ab4-b204-2f5a108b6fe7 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:13.745732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-69329168-f5f3-4f1f-9cb7-975b081f5b84 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:13.747416 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-69329168-f5f3-4f1f-9cb7-975b081f5b84 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:13.760455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19d32483-a4bd-4ab4-b204-2f5a108b6fe7 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:13.760833 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19d32483-a4bd-4ab4-b204-2f5a108b6fe7 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:13.764450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19d32483-a4bd-4ab4-b204-2f5a108b6fe7 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:13.767676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19d32483-a4bd-4ab4-b204-2f5a108b6fe7 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:13.783069 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-69329168-f5f3-4f1f-9cb7-975b081f5b84 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:13.784131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-69329168-f5f3-4f1f-9cb7-975b081f5b84 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:13.786055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-69329168-f5f3-4f1f-9cb7-975b081f5b84 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:13.788053 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-69329168-f5f3-4f1f-9cb7-975b081f5b84 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:13.890305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-19d32483-a4bd-4ab4-b204-2f5a108b6fe7 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:00:14.164676 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-19d32483-a4bd-4ab4-b204-2f5a108b6fe7 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "DELETE /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547" status: 204 len: 0 microversion: 2.1 time: 0.424211 Jul 25 13:00:14.185011 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1922/3939] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:00:13 2022] DELETE /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 13:00:14.224150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9752863b-f224-4501-86d3-31ed99a4a2b0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:14.227616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9752863b-f224-4501-86d3-31ed99a4a2b0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:14.232682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-69329168-f5f3-4f1f-9cb7-975b081f5b84 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:14.236248 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9752863b-f224-4501-86d3-31ed99a4a2b0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:14.237186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9752863b-f224-4501-86d3-31ed99a4a2b0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:14.239048 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9752863b-f224-4501-86d3-31ed99a4a2b0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:14.240031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9752863b-f224-4501-86d3-31ed99a4a2b0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:14.267824 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-69329168-f5f3-4f1f-9cb7-975b081f5b84 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1508 microversion: 2.1 time: 0.529862 Jul 25 13:00:14.270236 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2018/3940] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:13 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1508 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:14.277615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f3d20548-a773-4814-a2f8-420d2fb438ef tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:14.278615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f3d20548-a773-4814-a2f8-420d2fb438ef tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:14.293300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f3d20548-a773-4814-a2f8-420d2fb438ef tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:14.294299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f3d20548-a773-4814-a2f8-420d2fb438ef tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:14.295531 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f3d20548-a773-4814-a2f8-420d2fb438ef tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:14.296166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f3d20548-a773-4814-a2f8-420d2fb438ef tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:14.861621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9752863b-f224-4501-86d3-31ed99a4a2b0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:14.882493 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9752863b-f224-4501-86d3-31ed99a4a2b0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.685824 Jul 25 13:00:14.886594 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1923/3941] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:14 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:14.913638 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a75e91af-14c6-4912-a95f-1aa309a1b83f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:14.914794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a75e91af-14c6-4912-a95f-1aa309a1b83f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:14.937746 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a75e91af-14c6-4912-a95f-1aa309a1b83f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:14.949008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a75e91af-14c6-4912-a95f-1aa309a1b83f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:14.951319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a75e91af-14c6-4912-a95f-1aa309a1b83f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:14.953109 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a75e91af-14c6-4912-a95f-1aa309a1b83f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:15.039055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f3d20548-a773-4814-a2f8-420d2fb438ef tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66df4d397a40dd8606928b3be2e458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd8dc38f32c4c03a73af0666752d6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:15.064897 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f3d20548-a773-4814-a2f8-420d2fb438ef tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547" status: 200 len: 1512 microversion: 2.1 time: 0.790071 Jul 25 13:00:15.087850 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2019/3942] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:14 2022] GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547 => generated 1512 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:15.297290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1754f0cb-4c63-47d7-986a-7eb75e2e2456 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:15.299223 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1754f0cb-4c63-47d7-986a-7eb75e2e2456 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:15.323478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1754f0cb-4c63-47d7-986a-7eb75e2e2456 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:15.323990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1754f0cb-4c63-47d7-986a-7eb75e2e2456 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:15.326563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1754f0cb-4c63-47d7-986a-7eb75e2e2456 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:15.328303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1754f0cb-4c63-47d7-986a-7eb75e2e2456 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:15.380525 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a75e91af-14c6-4912-a95f-1aa309a1b83f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:15.396265 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a75e91af-14c6-4912-a95f-1aa309a1b83f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.486746 Jul 25 13:00:15.401680 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1924/3943] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:14 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:15.421221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4d4a6d90-98b4-4517-8a1a-e6cabedd357d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:15.431168 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4d4a6d90-98b4-4517-8a1a-e6cabedd357d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 10b1244b-a55e-40c5-a394-e1be83ed505b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:15.473032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4d4a6d90-98b4-4517-8a1a-e6cabedd357d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:15.473619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4d4a6d90-98b4-4517-8a1a-e6cabedd357d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:15.483282 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4d4a6d90-98b4-4517-8a1a-e6cabedd357d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:15.484063 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4d4a6d90-98b4-4517-8a1a-e6cabedd357d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:15.536821 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-4d4a6d90-98b4-4517-8a1a-e6cabedd357d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4d4a6d90-98b4-4517-8a1a-e6cabedd357d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b/action HTTP/1.1 Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 28 Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: {"reboot": {"type": "SOFT"}} Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '10b1244b-a55e-40c5-a394-e1be83ed505b', 'body': {'reboot': {'type': 'SOFT'}}} Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:00:15.544557 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:00:15.549129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 13:00:15.549129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:15.549129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:15.549129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:15.549129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:15.549129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:15.549129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:15.549129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:00:15.549129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:00:15.549129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 13:00:15.549129 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:15.549129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4d4a6d90-98b4-4517-8a1a-e6cabedd357d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 404 to user: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:00:15.549129 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4d4a6d90-98b4-4517-8a1a-e6cabedd357d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b/action" status: 404 len: 111 microversion: 2.1 time: 0.131754 Jul 25 13:00:15.550209 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1925/3944] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:00:15 2022] POST /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b/action => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:00:15.559176 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6aeb1fd7-1cde-4f1b-96bf-92fbf695c678 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:15.563507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6aeb1fd7-1cde-4f1b-96bf-92fbf695c678 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:15.577823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6aeb1fd7-1cde-4f1b-96bf-92fbf695c678 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:15.587320 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6aeb1fd7-1cde-4f1b-96bf-92fbf695c678 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:15.593548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6aeb1fd7-1cde-4f1b-96bf-92fbf695c678 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:15.594295 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6aeb1fd7-1cde-4f1b-96bf-92fbf695c678 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:16.045501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1754f0cb-4c63-47d7-986a-7eb75e2e2456 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:16.055316 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1754f0cb-4c63-47d7-986a-7eb75e2e2456 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1508 microversion: 2.1 time: 0.766187 Jul 25 13:00:16.061557 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2020/3945] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:15 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1508 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:16.088005 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4d391ddd-4aa1-442a-9259-2be3f61b2174 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:16.088633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4d391ddd-4aa1-442a-9259-2be3f61b2174 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:16.104151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d391ddd-4aa1-442a-9259-2be3f61b2174 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:16.104624 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d391ddd-4aa1-442a-9259-2be3f61b2174 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:16.105446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d391ddd-4aa1-442a-9259-2be3f61b2174 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:16.105915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d391ddd-4aa1-442a-9259-2be3f61b2174 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:16.340193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6aeb1fd7-1cde-4f1b-96bf-92fbf695c678 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:16.354019 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6aeb1fd7-1cde-4f1b-96bf-92fbf695c678 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.795768 Jul 25 13:00:16.354756 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1926/3946] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:15 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:16.358650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6aeb1fd7-1cde-4f1b-96bf-92fbf695c678 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:16.359986 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6aeb1fd7-1cde-4f1b-96bf-92fbf695c678 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003423 Jul 25 13:00:16.363312 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1927/3947] 10.222.0.49 () {56 vars in 886 bytes} [Mon Jul 25 13:00:16 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 25 13:00:16.392798 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2e8ca3e0-fe61-48ca-a71b-febb21c85f6c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:16.394179 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2e8ca3e0-fe61-48ca-a71b-febb21c85f6c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:16.417452 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e8ca3e0-fe61-48ca-a71b-febb21c85f6c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:16.428682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e8ca3e0-fe61-48ca-a71b-febb21c85f6c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:16.429767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e8ca3e0-fe61-48ca-a71b-febb21c85f6c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:16.430475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e8ca3e0-fe61-48ca-a71b-febb21c85f6c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:16.690571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4d391ddd-4aa1-442a-9259-2be3f61b2174 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66df4d397a40dd8606928b3be2e458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd8dc38f32c4c03a73af0666752d6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:16.703851 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4d391ddd-4aa1-442a-9259-2be3f61b2174 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547" status: 200 len: 1512 microversion: 2.1 time: 0.619728 Jul 25 13:00:16.723200 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2021/3948] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:16 2022] GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547 => generated 1512 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:17.000526 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2e8ca3e0-fe61-48ca-a71b-febb21c85f6c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:17.003099 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:00:17.024589 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2e8ca3e0-fe61-48ca-a71b-febb21c85f6c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.636121 Jul 25 13:00:17.044375 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1928/3949] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:16 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:17.054089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-08d37968-64f5-4e33-b845-040c80b177ab tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:17.054678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-08d37968-64f5-4e33-b845-040c80b177ab tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 7d346c2d-9a0c-4672-ac38-489dd5a74081] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:17.070041 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-08d37968-64f5-4e33-b845-040c80b177ab tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Instance 7d346c2d-9a0c-4672-ac38-489dd5a74081 could not be found. Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-08d37968-64f5-4e33-b845-040c80b177ab tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/7d346c2d-9a0c-4672-ac38-489dd5a74081/action HTTP/1.1 Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 28 Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: {"reboot": {"type": "SOFT"}} Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 7d346c2d-9a0c-4672-ac38-489dd5a74081 could not be found. Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '7d346c2d-9a0c-4672-ac38-489dd5a74081', 'body': {'reboot': {'type': 'SOFT'}}} Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d346c2d-9a0c-4672-ac38-489dd5a74081 could not be found. Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d346c2d-9a0c-4672-ac38-489dd5a74081 could not be found. Jul 25 13:00:17.071794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:17.076417 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:17.076417 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:17.076417 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:17.076417 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:17.076417 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:17.076417 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:00:17.076417 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:00:17.076417 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d346c2d-9a0c-4672-ac38-489dd5a74081 could not be found. Jul 25 13:00:17.076417 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:17.076417 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-08d37968-64f5-4e33-b845-040c80b177ab tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 404 to user: Instance 7d346c2d-9a0c-4672-ac38-489dd5a74081 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:00:17.078941 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dfc85493-0899-4f92-8874-60c28f71957d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:17.079562 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dfc85493-0899-4f92-8874-60c28f71957d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:17.083830 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-08d37968-64f5-4e33-b845-040c80b177ab tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/7d346c2d-9a0c-4672-ac38-489dd5a74081/action" status: 404 len: 111 microversion: 2.1 time: 0.027346 Jul 25 13:00:17.086314 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2022/3950] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:00:17 2022] POST /compute/v2.1/servers/7d346c2d-9a0c-4672-ac38-489dd5a74081/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:00:17.092420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7ee07222-8ad0-47af-a89c-7db72a629521 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:17.093041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7ee07222-8ad0-47af-a89c-7db72a629521 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:17.095678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dfc85493-0899-4f92-8874-60c28f71957d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:17.096139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dfc85493-0899-4f92-8874-60c28f71957d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:17.101552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dfc85493-0899-4f92-8874-60c28f71957d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:17.102101 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dfc85493-0899-4f92-8874-60c28f71957d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:17.109570 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ee07222-8ad0-47af-a89c-7db72a629521 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:17.109991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ee07222-8ad0-47af-a89c-7db72a629521 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:17.113250 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ee07222-8ad0-47af-a89c-7db72a629521 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:17.116352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ee07222-8ad0-47af-a89c-7db72a629521 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:18.153219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dfc85493-0899-4f92-8874-60c28f71957d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:18.169390 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dfc85493-0899-4f92-8874-60c28f71957d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1508 microversion: 2.1 time: 1.096179 Jul 25 13:00:18.185875 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1929/3951] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:17 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1508 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:18.190976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7ee07222-8ad0-47af-a89c-7db72a629521 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:18.199200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8752f740-5847-41bc-b295-3ddb0ec8eac7 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:18.200943 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8752f740-5847-41bc-b295-3ddb0ec8eac7 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:18.205736 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7ee07222-8ad0-47af-a89c-7db72a629521 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 1.117126 Jul 25 13:00:18.217031 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2023/3952] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:17 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:18.235670 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8752f740-5847-41bc-b295-3ddb0ec8eac7 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:18.236273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8752f740-5847-41bc-b295-3ddb0ec8eac7 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:18.236924 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8752f740-5847-41bc-b295-3ddb0ec8eac7 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:18.242253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cddff356-d6ba-4619-8d04-9ebb2b344093 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:18.243175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cddff356-d6ba-4619-8d04-9ebb2b344093 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:18.245866 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8752f740-5847-41bc-b295-3ddb0ec8eac7 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:18.259969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cddff356-d6ba-4619-8d04-9ebb2b344093 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:18.273316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cddff356-d6ba-4619-8d04-9ebb2b344093 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:18.276103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cddff356-d6ba-4619-8d04-9ebb2b344093 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:18.280752 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cddff356-d6ba-4619-8d04-9ebb2b344093 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:18.602059 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8752f740-5847-41bc-b295-3ddb0ec8eac7 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66df4d397a40dd8606928b3be2e458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd8dc38f32c4c03a73af0666752d6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:18.637371 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8752f740-5847-41bc-b295-3ddb0ec8eac7 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547" status: 200 len: 1470 microversion: 2.1 time: 0.461964 Jul 25 13:00:18.643109 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1930/3953] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:18 2022] GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547 => generated 1470 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:18.743342 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-5338bfa4-0a9e-4990-935c-97d3d06361fb req-fdc22bc8-cd68-4732-ace4-3d36cee15a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73470aab-4487-4be2-9f33-c5704236f547", "name": "network-vif-deleted", "tag": "0698b915-741b-4a9c-ad79-4ecef999413c"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:18.787598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-5338bfa4-0a9e-4990-935c-97d3d06361fb req-fdc22bc8-cd68-4732-ace4-3d36cee15a07 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:18.788075 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-5338bfa4-0a9e-4990-935c-97d3d06361fb req-fdc22bc8-cd68-4732-ace4-3d36cee15a07 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:18.853503 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-5338bfa4-0a9e-4990-935c-97d3d06361fb req-fdc22bc8-cd68-4732-ace4-3d36cee15a07 service nova] Creating event network-vif-deleted:0698b915-741b-4a9c-ad79-4ecef999413c for instance 73470aab-4487-4be2-9f33-c5704236f547 on n-h1-848886-15 Jul 25 13:00:18.862488 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-5338bfa4-0a9e-4990-935c-97d3d06361fb req-fdc22bc8-cd68-4732-ace4-3d36cee15a07 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199399 Jul 25 13:00:18.863114 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cddff356-d6ba-4619-8d04-9ebb2b344093 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:18.866222 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1931/3954] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:00:18.901303 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cddff356-d6ba-4619-8d04-9ebb2b344093 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.663182 Jul 25 13:00:18.904867 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2024/3955] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:18 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:18.926256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9403f68f-d5c9-4fa4-b94b-935d961859ba tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "97beeed7-7564-4203-abda-feef7e93cd98"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:18.929605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9403f68f-d5c9-4fa4-b94b-935d961859ba tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 10b1244b-a55e-40c5-a394-e1be83ed505b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:18.950330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9403f68f-d5c9-4fa4-b94b-935d961859ba tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:18.950842 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9403f68f-d5c9-4fa4-b94b-935d961859ba tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:18.951831 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9403f68f-d5c9-4fa4-b94b-935d961859ba tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:18.952820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9403f68f-d5c9-4fa4-b94b-935d961859ba tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:18.973219 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-9403f68f-d5c9-4fa4-b94b-935d961859ba tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9403f68f-d5c9-4fa4-b94b-935d961859ba tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b/action HTTP/1.1 Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 65 Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: {"rebuild": {"imageRef": "97beeed7-7564-4203-abda-feef7e93cd98"}} Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '10b1244b-a55e-40c5-a394-e1be83ed505b', 'body': {'rebuild': {'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98'}}} Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 25 13:00:18.986004 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 25 13:00:18.992277 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 13:00:18.992277 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:00:18.992277 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:00:18.992277 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:00:18.992277 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:00:18.992277 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 13:00:18.992277 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:18.992277 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:18.992277 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:18.992277 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:18.992277 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:18.992277 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:18.992277 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:00:18.992277 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:00:18.992277 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 13:00:18.992277 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:18.994967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9403f68f-d5c9-4fa4-b94b-935d961859ba tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 404 to user: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:00:19.000621 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9403f68f-d5c9-4fa4-b94b-935d961859ba tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b/action" status: 404 len: 111 microversion: 2.1 time: 0.078856 Jul 25 13:00:19.002056 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1932/3956] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:00:18 2022] POST /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b/action => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:00:19.010943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a411e356-45f2-4dfb-879f-57e987007ac0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:19.012064 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a411e356-45f2-4dfb-879f-57e987007ac0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:19.031585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a411e356-45f2-4dfb-879f-57e987007ac0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:19.032177 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a411e356-45f2-4dfb-879f-57e987007ac0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:19.033066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a411e356-45f2-4dfb-879f-57e987007ac0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:19.033571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a411e356-45f2-4dfb-879f-57e987007ac0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:19.206591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7b0412d7-7fdc-40a3-919e-d219d929fbcb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:19.208330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7b0412d7-7fdc-40a3-919e-d219d929fbcb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:19.227748 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b0412d7-7fdc-40a3-919e-d219d929fbcb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:19.228664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b0412d7-7fdc-40a3-919e-d219d929fbcb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:19.229766 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b0412d7-7fdc-40a3-919e-d219d929fbcb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:19.230503 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b0412d7-7fdc-40a3-919e-d219d929fbcb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:19.531644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a411e356-45f2-4dfb-879f-57e987007ac0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:19.541206 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a411e356-45f2-4dfb-879f-57e987007ac0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.534446 Jul 25 13:00:19.557877 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2025/3957] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:19 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:19.570516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2a8cf937-0cc9-4fc6-9058-bbe83e9ffd91 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:19.571266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2a8cf937-0cc9-4fc6-9058-bbe83e9ffd91 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:19.582930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a8cf937-0cc9-4fc6-9058-bbe83e9ffd91 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:19.588599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a8cf937-0cc9-4fc6-9058-bbe83e9ffd91 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:19.590025 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a8cf937-0cc9-4fc6-9058-bbe83e9ffd91 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:19.590596 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a8cf937-0cc9-4fc6-9058-bbe83e9ffd91 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:19.733244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7b0412d7-7fdc-40a3-919e-d219d929fbcb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:19.749280 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7b0412d7-7fdc-40a3-919e-d219d929fbcb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1508 microversion: 2.1 time: 0.553976 Jul 25 13:00:19.770957 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1933/3958] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:19 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1508 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:19.786356 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f4e130cc-e9bc-4f2b-ad2c-86d53324ca45 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:19.787078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f4e130cc-e9bc-4f2b-ad2c-86d53324ca45 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] [instance: 73470aab-4487-4be2-9f33-c5704236f547] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:19.816173 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4e130cc-e9bc-4f2b-ad2c-86d53324ca45 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:19.816722 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4e130cc-e9bc-4f2b-ad2c-86d53324ca45 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:19.827462 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4e130cc-e9bc-4f2b-ad2c-86d53324ca45 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:19.828124 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4e130cc-e9bc-4f2b-ad2c-86d53324ca45 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:19.868022 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-f4e130cc-e9bc-4f2b-ad2c-86d53324ca45 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] HTTP exception thrown: Instance 73470aab-4487-4be2-9f33-c5704236f547 could not be found. Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f4e130cc-e9bc-4f2b-ad2c-86d53324ca45 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Request method failure captured: Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547 HTTP/1.1 Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pO_2hZdUD-3FWhONIF2JF42IGu7EsBVSw9zDmgY21PGu9GosE0xVLmE2XYGTLJK88WDlEHlqF3AhYZeuveR9TsOCWv3VcBUhL--Uyay2eYoqH0bBHJMC6MTyTwruljdWm7-qpzRKPejTSfJXm8D9V29r2UMApW9OzusqQ4KDYPO8qM Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 1fd8dc38f32c4c03a73af0666752d6a4 Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-InstanceActionsTestJSON-46904173 Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1fd8dc38f32c4c03a73af0666752d6a4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1fd8dc38f32c4c03a73af0666752d6a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1fd8dc38f32c4c03a73af0666752d6a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1fd8dc38f32c4c03a73af0666752d6a4"}]}] Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-InstanceActionsTestJSON-46904173 Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 1fd8dc38f32c4c03a73af0666752d6a4 Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-InstanceActionsTestJSON-46904173 Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-InstanceActionsTestJSON-46904173-project Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 4b66df4d397a40dd8606928b3be2e458 Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-InstanceActionsTestJSON-46904173-project Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 73470aab-4487-4be2-9f33-c5704236f547 could not be found. Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '73470aab-4487-4be2-9f33-c5704236f547'} Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73470aab-4487-4be2-9f33-c5704236f547 could not be found. Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73470aab-4487-4be2-9f33-c5704236f547 could not be found. Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:19.870335 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:19.875555 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:19.875555 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:19.875555 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:19.875555 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:00:19.875555 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:00:19.875555 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73470aab-4487-4be2-9f33-c5704236f547 could not be found. Jul 25 13:00:19.875555 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:19.881429 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f4e130cc-e9bc-4f2b-ad2c-86d53324ca45 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] Returning 404 to user: Instance 73470aab-4487-4be2-9f33-c5704236f547 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:00:19.889545 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f4e130cc-e9bc-4f2b-ad2c-86d53324ca45 tempest-InstanceActionsTestJSON-46904173 tempest-InstanceActionsTestJSON-46904173-project] 10.222.0.49 "GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547" status: 404 len: 111 microversion: 2.1 time: 0.102954 Jul 25 13:00:19.893320 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1934/3959] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:19 2022] GET /compute/v2.1/servers/73470aab-4487-4be2-9f33-c5704236f547 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:00:19.936430 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2a8cf937-0cc9-4fc6-9058-bbe83e9ffd91 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:19.949294 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2a8cf937-0cc9-4fc6-9058-bbe83e9ffd91 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.383241 Jul 25 13:00:19.954202 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2026/3960] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:19 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:19.980726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-37de37ce-1216-4dec-a128-8720e27a73d7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "97beeed7-7564-4203-abda-feef7e93cd98"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:19.983919 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-37de37ce-1216-4dec-a128-8720e27a73d7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: ce59cd6e-62d6-47e3-855b-f0a77d759ba5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:20.009456 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-37de37ce-1216-4dec-a128-8720e27a73d7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Instance ce59cd6e-62d6-47e3-855b-f0a77d759ba5 could not be found. Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-37de37ce-1216-4dec-a128-8720e27a73d7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/ce59cd6e-62d6-47e3-855b-f0a77d759ba5/action HTTP/1.1 Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 65 Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: {"rebuild": {"imageRef": "97beeed7-7564-4203-abda-feef7e93cd98"}} Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance ce59cd6e-62d6-47e3-855b-f0a77d759ba5 could not be found. Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'ce59cd6e-62d6-47e3-855b-f0a77d759ba5', 'body': {'rebuild': {'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98'}}} Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce59cd6e-62d6-47e3-855b-f0a77d759ba5 could not be found. Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 13:00:20.011553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:00:20.016469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:00:20.016469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:00:20.016469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:00:20.016469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce59cd6e-62d6-47e3-855b-f0a77d759ba5 could not be found. Jul 25 13:00:20.016469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:20.016469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:20.016469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:20.016469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:20.016469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:20.016469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:20.016469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:00:20.016469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:00:20.016469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce59cd6e-62d6-47e3-855b-f0a77d759ba5 could not be found. Jul 25 13:00:20.016469 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:20.018718 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-37de37ce-1216-4dec-a128-8720e27a73d7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 404 to user: Instance ce59cd6e-62d6-47e3-855b-f0a77d759ba5 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:00:20.019836 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-37de37ce-1216-4dec-a128-8720e27a73d7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/ce59cd6e-62d6-47e3-855b-f0a77d759ba5/action" status: 404 len: 111 microversion: 2.1 time: 0.045852 Jul 25 13:00:20.025055 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1935/3961] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:00:19 2022] POST /compute/v2.1/servers/ce59cd6e-62d6-47e3-855b-f0a77d759ba5/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:00:20.033082 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0129a462-94f8-460a-a7d1-57667f6da560 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:20.034149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0129a462-94f8-460a-a7d1-57667f6da560 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:20.041623 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0129a462-94f8-460a-a7d1-57667f6da560 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:20.042447 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0129a462-94f8-460a-a7d1-57667f6da560 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:20.043955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0129a462-94f8-460a-a7d1-57667f6da560 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:20.045155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0129a462-94f8-460a-a7d1-57667f6da560 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:20.498912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0129a462-94f8-460a-a7d1-57667f6da560 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:20.516623 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0129a462-94f8-460a-a7d1-57667f6da560 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.490465 Jul 25 13:00:20.520472 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2027/3962] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:20 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:20.544944 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5342fd95-ac43-4bb5-a03f-36e7d93ec884 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:20.545687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5342fd95-ac43-4bb5-a03f-36e7d93ec884 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:20.558762 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5342fd95-ac43-4bb5-a03f-36e7d93ec884 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:20.559667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5342fd95-ac43-4bb5-a03f-36e7d93ec884 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:20.560768 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5342fd95-ac43-4bb5-a03f-36e7d93ec884 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:20.565161 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5342fd95-ac43-4bb5-a03f-36e7d93ec884 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:20.791855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fc6e12f9-98a2-4da0-9bfa-e1328ede9ec4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:20.794329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fc6e12f9-98a2-4da0-9bfa-e1328ede9ec4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:20.816976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc6e12f9-98a2-4da0-9bfa-e1328ede9ec4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:20.820705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc6e12f9-98a2-4da0-9bfa-e1328ede9ec4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:20.824256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc6e12f9-98a2-4da0-9bfa-e1328ede9ec4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:20.824946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc6e12f9-98a2-4da0-9bfa-e1328ede9ec4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:21.116604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5342fd95-ac43-4bb5-a03f-36e7d93ec884 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:21.134165 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5342fd95-ac43-4bb5-a03f-36e7d93ec884 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.594162 Jul 25 13:00:21.138681 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1936/3963] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:20 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:21.155031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7348594c-7398-4ced-8d48-a3543a29457a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:21.155587 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7348594c-7398-4ced-8d48-a3543a29457a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 9aea16f5-05e5-49c2-aae7-2b94b2649ca7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:21.165849 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-7348594c-7398-4ced-8d48-a3543a29457a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Instance 9aea16f5-05e5-49c2-aae7-2b94b2649ca7 could not be found. Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7348594c-7398-4ced-8d48-a3543a29457a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/9aea16f5-05e5-49c2-aae7-2b94b2649ca7/action HTTP/1.1 Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 15 Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: {"restore": {}} Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 9aea16f5-05e5-49c2-aae7-2b94b2649ca7 could not be found. Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '9aea16f5-05e5-49c2-aae7-2b94b2649ca7', 'body': {'restore': {}}} Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aea16f5-05e5-49c2-aae7-2b94b2649ca7 could not be found. Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aea16f5-05e5-49c2-aae7-2b94b2649ca7 could not be found. Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:21.167670 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:21.173156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:00:21.173156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:00:21.173156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aea16f5-05e5-49c2-aae7-2b94b2649ca7 could not be found. Jul 25 13:00:21.173156 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:21.173156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7348594c-7398-4ced-8d48-a3543a29457a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 404 to user: Instance 9aea16f5-05e5-49c2-aae7-2b94b2649ca7 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:00:21.173156 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7348594c-7398-4ced-8d48-a3543a29457a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/9aea16f5-05e5-49c2-aae7-2b94b2649ca7/action" status: 404 len: 111 microversion: 2.1 time: 0.018737 Jul 25 13:00:21.173156 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1937/3964] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:00:21 2022] POST /compute/v2.1/servers/9aea16f5-05e5-49c2-aae7-2b94b2649ca7/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 13:00:21.179181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6ff221c2-146c-4776-8b27-f65c4d4792c3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:21.184956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6ff221c2-146c-4776-8b27-f65c4d4792c3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:21.209008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6ff221c2-146c-4776-8b27-f65c4d4792c3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:21.216867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6ff221c2-146c-4776-8b27-f65c4d4792c3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:21.218469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6ff221c2-146c-4776-8b27-f65c4d4792c3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:21.225722 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6ff221c2-146c-4776-8b27-f65c4d4792c3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:21.355163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fc6e12f9-98a2-4da0-9bfa-e1328ede9ec4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:21.364704 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fc6e12f9-98a2-4da0-9bfa-e1328ede9ec4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1508 microversion: 2.1 time: 0.579964 Jul 25 13:00:21.369075 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2028/3965] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:20 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1508 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:21.710709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6ff221c2-146c-4776-8b27-f65c4d4792c3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:21.725400 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6ff221c2-146c-4776-8b27-f65c4d4792c3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.550026 Jul 25 13:00:21.742402 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1938/3966] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:21 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:21.776244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-24fbd298-76ed-4a2a-a62b-5e3df81232d0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:21.776898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-24fbd298-76ed-4a2a-a62b-5e3df81232d0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:21.795972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24fbd298-76ed-4a2a-a62b-5e3df81232d0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:21.796822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24fbd298-76ed-4a2a-a62b-5e3df81232d0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:21.797228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24fbd298-76ed-4a2a-a62b-5e3df81232d0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:21.797667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24fbd298-76ed-4a2a-a62b-5e3df81232d0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:22.268926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-24fbd298-76ed-4a2a-a62b-5e3df81232d0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:22.281140 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-24fbd298-76ed-4a2a-a62b-5e3df81232d0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.526236 Jul 25 13:00:22.289896 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2029/3967] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:21 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:22.306527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-97341b6c-0d7b-4530-a15a-064703980e58 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:22.308849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-97341b6c-0d7b-4530-a15a-064703980e58 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:22.323433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97341b6c-0d7b-4530-a15a-064703980e58 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:22.324080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97341b6c-0d7b-4530-a15a-064703980e58 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:22.325003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97341b6c-0d7b-4530-a15a-064703980e58 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:22.328363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97341b6c-0d7b-4530-a15a-064703980e58 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:22.383061 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-97341b6c-0d7b-4530-a15a-064703980e58 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Cannot 'restore' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state active Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-97341b6c-0d7b-4530-a15a-064703980e58 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action HTTP/1.1 Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 15 Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: {"restore": {}} Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: exception: Cannot 'restore' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state active Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2', 'body': {'restore': {}}} Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 in vm_state active. Cannot restore while the instance is in this state. Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state active Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:22.384846 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:22.388662 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:22.388662 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:00:22.388662 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:00:22.388662 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state active Jul 25 13:00:22.388662 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:22.391324 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-97341b6c-0d7b-4530-a15a-064703980e58 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 409 to user: Cannot 'restore' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state active {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:00:22.392071 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bbba51df-0f9c-4a70-9732-9d04fe6d93f9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:22.393055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bbba51df-0f9c-4a70-9732-9d04fe6d93f9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:22.400385 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-97341b6c-0d7b-4530-a15a-064703980e58 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action" status: 409 len: 145 microversion: 2.1 time: 0.101181 Jul 25 13:00:22.401875 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1939/3968] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:00:22 2022] POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action => generated 145 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 13:00:22.416577 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bbba51df-0f9c-4a70-9732-9d04fe6d93f9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:22.417035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bbba51df-0f9c-4a70-9732-9d04fe6d93f9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:22.421048 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bbba51df-0f9c-4a70-9732-9d04fe6d93f9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:22.421731 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bbba51df-0f9c-4a70-9732-9d04fe6d93f9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:22.427451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d1600e5e-5214-4402-bdfd-99b22dd309cc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:22.428409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d1600e5e-5214-4402-bdfd-99b22dd309cc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:22.441660 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1600e5e-5214-4402-bdfd-99b22dd309cc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:22.442420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1600e5e-5214-4402-bdfd-99b22dd309cc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:22.445310 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1600e5e-5214-4402-bdfd-99b22dd309cc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:22.446151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1600e5e-5214-4402-bdfd-99b22dd309cc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:23.194623 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bbba51df-0f9c-4a70-9732-9d04fe6d93f9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:23.204899 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bbba51df-0f9c-4a70-9732-9d04fe6d93f9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1508 microversion: 2.1 time: 0.817756 Jul 25 13:00:23.208160 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2030/3969] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:22 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1508 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:23.217334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d1600e5e-5214-4402-bdfd-99b22dd309cc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:23.227422 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d1600e5e-5214-4402-bdfd-99b22dd309cc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.804378 Jul 25 13:00:23.231164 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1940/3970] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:22 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:23.268353 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aa06ee37-32de-4e78-a152-b003ebd44248 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:23.269585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-aa06ee37-32de-4e78-a152-b003ebd44248 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:23.290066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa06ee37-32de-4e78-a152-b003ebd44248 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:23.291006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa06ee37-32de-4e78-a152-b003ebd44248 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:23.292027 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa06ee37-32de-4e78-a152-b003ebd44248 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:23.292816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa06ee37-32de-4e78-a152-b003ebd44248 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:23.755167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-aa06ee37-32de-4e78-a152-b003ebd44248 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:23.780214 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-aa06ee37-32de-4e78-a152-b003ebd44248 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.520523 Jul 25 13:00:23.781436 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2031/3971] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:23 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:23.807730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fb2c7122-4604-4cb8-8e27-e36a4151e84b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:23.808424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fb2c7122-4604-4cb8-8e27-e36a4151e84b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d3fce0-1b8f-481a-9fef-c97332a21cf7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:23.826977 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-fb2c7122-4604-4cb8-8e27-e36a4151e84b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Instance f8d3fce0-1b8f-481a-9fef-c97332a21cf7 could not be found. Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fb2c7122-4604-4cb8-8e27-e36a4151e84b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/f8d3fce0-1b8f-481a-9fef-c97332a21cf7/action HTTP/1.1 Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 14 Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: {"resume": {}} Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance f8d3fce0-1b8f-481a-9fef-c97332a21cf7 could not be found. Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'f8d3fce0-1b8f-481a-9fef-c97332a21cf7', 'body': {'resume': {}}} Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8d3fce0-1b8f-481a-9fef-c97332a21cf7 could not be found. Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8d3fce0-1b8f-481a-9fef-c97332a21cf7 could not be found. Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:23.851604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:23.857357 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:00:23.857357 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:00:23.857357 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8d3fce0-1b8f-481a-9fef-c97332a21cf7 could not be found. Jul 25 13:00:23.857357 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:23.858578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fb2c7122-4604-4cb8-8e27-e36a4151e84b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 404 to user: Instance f8d3fce0-1b8f-481a-9fef-c97332a21cf7 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:00:23.859695 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fb2c7122-4604-4cb8-8e27-e36a4151e84b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/f8d3fce0-1b8f-481a-9fef-c97332a21cf7/action" status: 404 len: 111 microversion: 2.1 time: 0.056499 Jul 25 13:00:23.861083 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1941/3972] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:00:23 2022] POST /compute/v2.1/servers/f8d3fce0-1b8f-481a-9fef-c97332a21cf7/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:00:23.872812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-afe4a7c6-7b3b-4d27-8a72-1a2128698d56 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:23.873460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-afe4a7c6-7b3b-4d27-8a72-1a2128698d56 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:23.883909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-afe4a7c6-7b3b-4d27-8a72-1a2128698d56 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:23.887972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-afe4a7c6-7b3b-4d27-8a72-1a2128698d56 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:23.889060 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-afe4a7c6-7b3b-4d27-8a72-1a2128698d56 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:23.895645 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-afe4a7c6-7b3b-4d27-8a72-1a2128698d56 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:24.263356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-afe4a7c6-7b3b-4d27-8a72-1a2128698d56 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:24.274341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bc239b85-ab7a-44d7-a5ed-6bba838a7024 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:24.276343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bc239b85-ab7a-44d7-a5ed-6bba838a7024 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:24.290384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc239b85-ab7a-44d7-a5ed-6bba838a7024 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:24.290807 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-afe4a7c6-7b3b-4d27-8a72-1a2128698d56 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.421772 Jul 25 13:00:24.302851 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2032/3973] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:23 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:24.313529 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc239b85-ab7a-44d7-a5ed-6bba838a7024 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:24.316904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc239b85-ab7a-44d7-a5ed-6bba838a7024 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:24.318171 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc239b85-ab7a-44d7-a5ed-6bba838a7024 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:24.334984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cf1f3fd3-c3aa-471f-8ddb-8acfbee63a03 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:24.334984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cf1f3fd3-c3aa-471f-8ddb-8acfbee63a03 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:24.336536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf1f3fd3-c3aa-471f-8ddb-8acfbee63a03 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:24.338489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf1f3fd3-c3aa-471f-8ddb-8acfbee63a03 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:24.339557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf1f3fd3-c3aa-471f-8ddb-8acfbee63a03 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:24.340240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf1f3fd3-c3aa-471f-8ddb-8acfbee63a03 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:24.906520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bc239b85-ab7a-44d7-a5ed-6bba838a7024 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:24.922515 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bc239b85-ab7a-44d7-a5ed-6bba838a7024 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1508 microversion: 2.1 time: 0.697110 Jul 25 13:00:24.933607 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1942/3974] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:24 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1508 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:24.985230 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cf1f3fd3-c3aa-471f-8ddb-8acfbee63a03 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:25.000119 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cf1f3fd3-c3aa-471f-8ddb-8acfbee63a03 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.676976 Jul 25 13:00:25.001988 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2033/3975] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:24 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:25.022251 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-88e672a2-10d4-488e-a090-90950536792c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:25.022814 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-88e672a2-10d4-488e-a090-90950536792c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:25.043949 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-88e672a2-10d4-488e-a090-90950536792c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:25.044584 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-88e672a2-10d4-488e-a090-90950536792c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:25.045473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-88e672a2-10d4-488e-a090-90950536792c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:25.046151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-88e672a2-10d4-488e-a090-90950536792c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:25.112703 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-88e672a2-10d4-488e-a090-90950536792c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Cannot 'resume' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state active Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-88e672a2-10d4-488e-a090-90950536792c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action HTTP/1.1 Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 14 Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: {"resume": {}} Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: exception: Cannot 'resume' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state active Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2', 'body': {'resume': {}}} Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 in vm_state active. Cannot resume while the instance is in this state. Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state active Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:25.115737 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:25.119797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:25.119797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:00:25.119797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:00:25.119797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state active Jul 25 13:00:25.119797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:25.123973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-88e672a2-10d4-488e-a090-90950536792c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 409 to user: Cannot 'resume' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state active {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:00:25.125789 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-88e672a2-10d4-488e-a090-90950536792c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action" status: 409 len: 144 microversion: 2.1 time: 0.108160 Jul 25 13:00:25.126943 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1943/3976] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:00:25 2022] POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action => generated 144 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 13:00:25.135697 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-38c20566-3c12-4b4c-8c10-335bc7d4fc0e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:25.137558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-38c20566-3c12-4b4c-8c10-335bc7d4fc0e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:25.152256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38c20566-3c12-4b4c-8c10-335bc7d4fc0e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:25.153094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38c20566-3c12-4b4c-8c10-335bc7d4fc0e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:25.154486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38c20566-3c12-4b4c-8c10-335bc7d4fc0e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:25.155743 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38c20566-3c12-4b4c-8c10-335bc7d4fc0e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:25.494310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-38c20566-3c12-4b4c-8c10-335bc7d4fc0e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:25.512051 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-38c20566-3c12-4b4c-8c10-335bc7d4fc0e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.380163 Jul 25 13:00:25.514103 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2034/3977] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:25 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:25.536082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-79a3d06e-dd2a-47dd-8cf6-1bd1a42aff3c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:25.536831 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-79a3d06e-dd2a-47dd-8cf6-1bd1a42aff3c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:25.547710 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79a3d06e-dd2a-47dd-8cf6-1bd1a42aff3c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:25.548240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79a3d06e-dd2a-47dd-8cf6-1bd1a42aff3c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:25.549056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79a3d06e-dd2a-47dd-8cf6-1bd1a42aff3c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:25.549492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79a3d06e-dd2a-47dd-8cf6-1bd1a42aff3c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:25.950784 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-045b7a8b-071d-4037-a557-bd9b2ca8aaab tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:25.951560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-045b7a8b-071d-4037-a557-bd9b2ca8aaab tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:25.965481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-045b7a8b-071d-4037-a557-bd9b2ca8aaab tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:25.967992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-045b7a8b-071d-4037-a557-bd9b2ca8aaab tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:25.970550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-045b7a8b-071d-4037-a557-bd9b2ca8aaab tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:25.971001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-045b7a8b-071d-4037-a557-bd9b2ca8aaab tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:25.992042 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-79a3d06e-dd2a-47dd-8cf6-1bd1a42aff3c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:26.007669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:00:26.022160 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-79a3d06e-dd2a-47dd-8cf6-1bd1a42aff3c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.488407 Jul 25 13:00:26.022973 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1944/3978] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:25 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:26.236311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3ac1ca18-4c71-4cb6-a53d-32ebfa98368c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3ac1ca18-4c71-4cb6-a53d-32ebfa98368c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 160 Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: {"server": {"name": "", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "dc975d58-9818-4c8b-8bcd-8b1a23df5609"}]}} Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'server': {'name': '', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452', 'networks': [{'uuid': 'dc975d58-9818-4c8b-8bcd-8b1a23df5609'}]}}} Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi '' Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 13:00:26.240468 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 13:00:26.244974 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 13:00:26.244974 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 25 13:00:26.244974 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:26.244974 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:26.244974 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:26.244974 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:26.244974 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:26.244974 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:26.244974 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 13:00:26.244974 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 13:00:26.244974 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 25 13:00:26.244974 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:00:26.244974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3ac1ca18-4c71-4cb6-a53d-32ebfa98368c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:00:26.247274 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3ac1ca18-4c71-4cb6-a53d-32ebfa98368c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.010527 Jul 25 13:00:26.248237 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1945/3979] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:00:26 2022] POST /compute/v2.1/servers => generated 108 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 13:00:26.258105 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cac78e30-7f05-401e-9f61-533b41a8162e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:26.258706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cac78e30-7f05-401e-9f61-533b41a8162e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:26.277586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cac78e30-7f05-401e-9f61-533b41a8162e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:26.280504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cac78e30-7f05-401e-9f61-533b41a8162e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:26.281702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cac78e30-7f05-401e-9f61-533b41a8162e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:26.282494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cac78e30-7f05-401e-9f61-533b41a8162e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:26.383667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-045b7a8b-071d-4037-a557-bd9b2ca8aaab tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:26.396770 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-045b7a8b-071d-4037-a557-bd9b2ca8aaab tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1508 microversion: 2.1 time: 0.450452 Jul 25 13:00:26.404858 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2035/3980] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:25 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1508 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:26.884901 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cac78e30-7f05-401e-9f61-533b41a8162e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:26.910326 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cac78e30-7f05-401e-9f61-533b41a8162e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.656297 Jul 25 13:00:26.911050 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1946/3981] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:26 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:26.949476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-16286a83-b8fb-43d6-a13e-a2fbbebe4af5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:26.951781 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-16286a83-b8fb-43d6-a13e-a2fbbebe4af5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:26.991334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16286a83-b8fb-43d6-a13e-a2fbbebe4af5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:26.992265 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16286a83-b8fb-43d6-a13e-a2fbbebe4af5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:26.995605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16286a83-b8fb-43d6-a13e-a2fbbebe4af5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:26.996235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16286a83-b8fb-43d6-a13e-a2fbbebe4af5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:27.429930 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-38c15984-6eeb-4bd6-8141-3f0f35d84790 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:27.432452 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-38c15984-6eeb-4bd6-8141-3f0f35d84790 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:27.451290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-38c15984-6eeb-4bd6-8141-3f0f35d84790 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:27.451969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-38c15984-6eeb-4bd6-8141-3f0f35d84790 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:27.452093 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-16286a83-b8fb-43d6-a13e-a2fbbebe4af5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:27.465249 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-38c15984-6eeb-4bd6-8141-3f0f35d84790 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:27.466497 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-38c15984-6eeb-4bd6-8141-3f0f35d84790 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:27.474559 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-16286a83-b8fb-43d6-a13e-a2fbbebe4af5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.536364 Jul 25 13:00:27.476024 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2036/3982] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:26 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:27.501692 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8e0848c9-d46a-45b6-88eb-6af4ea976300 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:27.502273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8e0848c9-d46a-45b6-88eb-6af4ea976300 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 633ac95e-7a21-41b9-ad62-a98c09a2f2f5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:27.519581 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-8e0848c9-d46a-45b6-88eb-6af4ea976300 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Instance 633ac95e-7a21-41b9-ad62-a98c09a2f2f5 could not be found. Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8e0848c9-d46a-45b6-88eb-6af4ea976300 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/633ac95e-7a21-41b9-ad62-a98c09a2f2f5/action HTTP/1.1 Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 14 Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: {"shelve": {}} Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 633ac95e-7a21-41b9-ad62-a98c09a2f2f5 could not be found. Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '633ac95e-7a21-41b9-ad62-a98c09a2f2f5', 'body': {'shelve': {}}} Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 633ac95e-7a21-41b9-ad62-a98c09a2f2f5 could not be found. Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 633ac95e-7a21-41b9-ad62-a98c09a2f2f5 could not be found. Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:00:27.529819 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:00:27.536479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:00:27.536479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:00:27.536479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 633ac95e-7a21-41b9-ad62-a98c09a2f2f5 could not be found. Jul 25 13:00:27.536479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:00:27.536479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8e0848c9-d46a-45b6-88eb-6af4ea976300 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 404 to user: Instance 633ac95e-7a21-41b9-ad62-a98c09a2f2f5 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:00:27.548875 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8e0848c9-d46a-45b6-88eb-6af4ea976300 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/633ac95e-7a21-41b9-ad62-a98c09a2f2f5/action" status: 404 len: 111 microversion: 2.1 time: 0.047027 Jul 25 13:00:27.551886 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2037/3983] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:00:27 2022] POST /compute/v2.1/servers/633ac95e-7a21-41b9-ad62-a98c09a2f2f5/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:00:27.566747 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-60dc966a-0d5d-45f2-a8db-8b461e6c5e68 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:27.568388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-60dc966a-0d5d-45f2-a8db-8b461e6c5e68 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:27.593273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-60dc966a-0d5d-45f2-a8db-8b461e6c5e68 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:27.595278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-60dc966a-0d5d-45f2-a8db-8b461e6c5e68 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:27.597925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-60dc966a-0d5d-45f2-a8db-8b461e6c5e68 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:27.600007 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-60dc966a-0d5d-45f2-a8db-8b461e6c5e68 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:28.014388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-60dc966a-0d5d-45f2-a8db-8b461e6c5e68 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:28.032276 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-60dc966a-0d5d-45f2-a8db-8b461e6c5e68 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.477184 Jul 25 13:00:28.032888 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2038/3984] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:27 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:28.076229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c95cbdc1-a099-4833-a96e-16225369b3fa tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:28.077579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c95cbdc1-a099-4833-a96e-16225369b3fa tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:28.094230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-38c15984-6eeb-4bd6-8141-3f0f35d84790 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:28.118383 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-38c15984-6eeb-4bd6-8141-3f0f35d84790 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1505 microversion: 2.1 time: 0.694943 Jul 25 13:00:28.119685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c95cbdc1-a099-4833-a96e-16225369b3fa tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:28.120623 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c95cbdc1-a099-4833-a96e-16225369b3fa tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:28.120780 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1947/3985] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:27 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1505 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:28.121742 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c95cbdc1-a099-4833-a96e-16225369b3fa tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:28.122349 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c95cbdc1-a099-4833-a96e-16225369b3fa tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:28.354701 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c95cbdc1-a099-4833-a96e-16225369b3fa tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:28.366428 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c95cbdc1-a099-4833-a96e-16225369b3fa tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.299582 Jul 25 13:00:28.368894 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2039/3986] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:28 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:28.395908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8c1c98dc-e61e-49ee-81d1-4949b6eaf118 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:28.396091 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8c1c98dc-e61e-49ee-81d1-4949b6eaf118 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:28.403456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c1c98dc-e61e-49ee-81d1-4949b6eaf118 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:28.403763 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c1c98dc-e61e-49ee-81d1-4949b6eaf118 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:28.404715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c1c98dc-e61e-49ee-81d1-4949b6eaf118 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:28.405307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c1c98dc-e61e-49ee-81d1-4949b6eaf118 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:28.442049 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-8c1c98dc-e61e-49ee-81d1-4949b6eaf118 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lazy-loading 'flavor' on Instance uuid f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:00:28.740521 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8c1c98dc-e61e-49ee-81d1-4949b6eaf118 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action" status: 202 len: 0 microversion: 2.1 time: 0.353003 Jul 25 13:00:28.743012 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1948/3987] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:00:28 2022] POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 13:00:28.752391 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6f595fc1-fa3c-47b9-ac8b-e3a1cb873241 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:28.754184 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6f595fc1-fa3c-47b9-ac8b-e3a1cb873241 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:28.765866 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6f595fc1-fa3c-47b9-ac8b-e3a1cb873241 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:28.766591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6f595fc1-fa3c-47b9-ac8b-e3a1cb873241 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:28.768443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6f595fc1-fa3c-47b9-ac8b-e3a1cb873241 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:28.768937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6f595fc1-fa3c-47b9-ac8b-e3a1cb873241 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:29.015933 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6f595fc1-fa3c-47b9-ac8b-e3a1cb873241 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:29.026876 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6f595fc1-fa3c-47b9-ac8b-e3a1cb873241 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1511 microversion: 2.1 time: 0.280194 Jul 25 13:00:29.028828 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2040/3988] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:28 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1511 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:29.153630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1da6315f-18e8-46db-8975-780a53082839 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:29.158256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1da6315f-18e8-46db-8975-780a53082839 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:29.172593 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1da6315f-18e8-46db-8975-780a53082839 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:29.173055 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1da6315f-18e8-46db-8975-780a53082839 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:29.176389 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1da6315f-18e8-46db-8975-780a53082839 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:29.178212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1da6315f-18e8-46db-8975-780a53082839 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:29.437849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-fab71e85-5adf-41b3-a3e3-b6aca14a183f req-4437a026-8b48-4e00-819a-9d2a0b459293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9787fc-a4e1-41f8-be82-3f68c14ad254", "name": "network-vif-unplugged", "status": "completed", "tag": "cce124d7-06ab-47f8-9713-88ca17dcee95"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:29.460636 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fab71e85-5adf-41b3-a3e3-b6aca14a183f req-4437a026-8b48-4e00-819a-9d2a0b459293 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:29.462905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fab71e85-5adf-41b3-a3e3-b6aca14a183f req-4437a026-8b48-4e00-819a-9d2a0b459293 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:29.493064 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-fab71e85-5adf-41b3-a3e3-b6aca14a183f req-4437a026-8b48-4e00-819a-9d2a0b459293 service nova] Creating event network-vif-unplugged:cce124d7-06ab-47f8-9713-88ca17dcee95 for instance 8d9787fc-a4e1-41f8-be82-3f68c14ad254 on n-h2-848886-15 Jul 25 13:00:29.505319 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-fab71e85-5adf-41b3-a3e3-b6aca14a183f req-4437a026-8b48-4e00-819a-9d2a0b459293 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072179 Jul 25 13:00:29.506516 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2041/3989] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:00:29.534806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1da6315f-18e8-46db-8975-780a53082839 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:29.544792 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1da6315f-18e8-46db-8975-780a53082839 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1505 microversion: 2.1 time: 0.401950 Jul 25 13:00:29.545717 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1949/3990] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:29 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1505 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:30.051722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-99df5c4d-0d82-4aef-9c04-4cc2dea8b1c9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:30.053214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-99df5c4d-0d82-4aef-9c04-4cc2dea8b1c9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:30.060395 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-99df5c4d-0d82-4aef-9c04-4cc2dea8b1c9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:30.061123 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-99df5c4d-0d82-4aef-9c04-4cc2dea8b1c9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:30.062134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-99df5c4d-0d82-4aef-9c04-4cc2dea8b1c9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:30.062814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-99df5c4d-0d82-4aef-9c04-4cc2dea8b1c9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:30.262515 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-99df5c4d-0d82-4aef-9c04-4cc2dea8b1c9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:30.271951 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-99df5c4d-0d82-4aef-9c04-4cc2dea8b1c9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1511 microversion: 2.1 time: 0.224478 Jul 25 13:00:30.272636 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2042/3991] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:30 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1511 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:30.571100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-01f6114b-b6db-408a-93ee-33eb59b6793f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:30.573245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-01f6114b-b6db-408a-93ee-33eb59b6793f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:30.582951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01f6114b-b6db-408a-93ee-33eb59b6793f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:30.583633 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01f6114b-b6db-408a-93ee-33eb59b6793f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:30.584899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01f6114b-b6db-408a-93ee-33eb59b6793f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:30.585376 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01f6114b-b6db-408a-93ee-33eb59b6793f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:30.608543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:00:31.165369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-01f6114b-b6db-408a-93ee-33eb59b6793f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:31.174336 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-01f6114b-b6db-408a-93ee-33eb59b6793f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 200 len: 1448 microversion: 2.1 time: 0.611149 Jul 25 13:00:31.174938 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1950/3992] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:30 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 1448 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:31.195267 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-32812a1d-7be5-47a6-82c0-2b6d08de90ed tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:31.196500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-32812a1d-7be5-47a6-82c0-2b6d08de90ed tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:31.204584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32812a1d-7be5-47a6-82c0-2b6d08de90ed tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:31.205434 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32812a1d-7be5-47a6-82c0-2b6d08de90ed tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:31.206463 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32812a1d-7be5-47a6-82c0-2b6d08de90ed tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:31.207052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32812a1d-7be5-47a6-82c0-2b6d08de90ed tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:31.295645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4434e898-668d-4a64-8cf6-3c4ffd5dcea6 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:31.296529 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4434e898-668d-4a64-8cf6-3c4ffd5dcea6 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:31.307684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4434e898-668d-4a64-8cf6-3c4ffd5dcea6 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:31.311347 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4434e898-668d-4a64-8cf6-3c4ffd5dcea6 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:31.312378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4434e898-668d-4a64-8cf6-3c4ffd5dcea6 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:31.312978 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4434e898-668d-4a64-8cf6-3c4ffd5dcea6 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:31.453071 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-32812a1d-7be5-47a6-82c0-2b6d08de90ed tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:31.463895 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-32812a1d-7be5-47a6-82c0-2b6d08de90ed tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.272658 Jul 25 13:00:31.465587 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2043/3993] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:31 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:31.492135 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dfe6beb7-0838-40c5-8250-84b94973e70f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:31.493998 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dfe6beb7-0838-40c5-8250-84b94973e70f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:31.520473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dfe6beb7-0838-40c5-8250-84b94973e70f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:31.523000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dfe6beb7-0838-40c5-8250-84b94973e70f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:31.526889 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dfe6beb7-0838-40c5-8250-84b94973e70f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:31.527545 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dfe6beb7-0838-40c5-8250-84b94973e70f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:31.590910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4434e898-668d-4a64-8cf6-3c4ffd5dcea6 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:31.617919 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4434e898-668d-4a64-8cf6-3c4ffd5dcea6 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1511 microversion: 2.1 time: 0.321305 Jul 25 13:00:31.620570 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1951/3994] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:31 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1511 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:31.740392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dfe6beb7-0838-40c5-8250-84b94973e70f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:31.749994 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dfe6beb7-0838-40c5-8250-84b94973e70f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.261526 Jul 25 13:00:31.750594 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2044/3995] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:31 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:31.774363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e52a7c84-5ccd-4135-81f4-6924e42ede9c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:31.775398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e52a7c84-5ccd-4135-81f4-6924e42ede9c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:31.781200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e52a7c84-5ccd-4135-81f4-6924e42ede9c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:31.781657 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e52a7c84-5ccd-4135-81f4-6924e42ede9c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:31.782491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e52a7c84-5ccd-4135-81f4-6924e42ede9c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:31.783150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e52a7c84-5ccd-4135-81f4-6924e42ede9c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:31.969495 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e52a7c84-5ccd-4135-81f4-6924e42ede9c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:31.978671 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e52a7c84-5ccd-4135-81f4-6924e42ede9c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.208329 Jul 25 13:00:31.982701 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1952/3996] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:31 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:32.009602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2bf46d29-41bf-4af8-90f4-45a68ec91943 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:32.010327 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2bf46d29-41bf-4af8-90f4-45a68ec91943 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:32.019022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2bf46d29-41bf-4af8-90f4-45a68ec91943 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:32.019771 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2bf46d29-41bf-4af8-90f4-45a68ec91943 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:32.020853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2bf46d29-41bf-4af8-90f4-45a68ec91943 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:32.021463 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2bf46d29-41bf-4af8-90f4-45a68ec91943 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:32.245891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2bf46d29-41bf-4af8-90f4-45a68ec91943 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:32.265398 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2bf46d29-41bf-4af8-90f4-45a68ec91943 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.268297 Jul 25 13:00:32.278583 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2045/3997] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:31 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:32.297112 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bc34eaf0-d321-4bfd-8a34-5ee4a1255be5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:32.305779 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc34eaf0-d321-4bfd-8a34-5ee4a1255be5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:32.306811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc34eaf0-d321-4bfd-8a34-5ee4a1255be5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:32.346882 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bc34eaf0-d321-4bfd-8a34-5ee4a1255be5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Going to try to stop instance {{(pid=125883) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 13:00:32.412401 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bc34eaf0-d321-4bfd-8a34-5ee4a1255be5 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action" status: 202 len: 0 microversion: 2.1 time: 0.123957 Jul 25 13:00:32.413489 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1953/3998] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:00:32 2022] POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:00:32.430165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-66beabd0-bbb3-4c28-9672-f9e39c2d1d6e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:32.431218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-66beabd0-bbb3-4c28-9672-f9e39c2d1d6e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:32.449033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66beabd0-bbb3-4c28-9672-f9e39c2d1d6e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:32.449496 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66beabd0-bbb3-4c28-9672-f9e39c2d1d6e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:32.450375 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66beabd0-bbb3-4c28-9672-f9e39c2d1d6e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:32.450820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66beabd0-bbb3-4c28-9672-f9e39c2d1d6e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:32.572308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e4dfa15b-12de-4516-a9b7-691225b71e8b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-743679323", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "de838674-15b8-4dca-b952-fafcc5bd15b0"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:32.682730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-e4dfa15b-12de-4516-a9b7-691225b71e8b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] validate_networks() for [('de838674-15b8-4dca-b952-fafcc5bd15b0', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:00:32.754502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-66beabd0-bbb3-4c28-9672-f9e39c2d1d6e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:32.767005 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-66beabd0-bbb3-4c28-9672-f9e39c2d1d6e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1679 microversion: 2.1 time: 0.346522 Jul 25 13:00:32.770676 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1954/3999] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:32 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1679 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:32.784444 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1341e682-e32e-404f-b28d-1a0ba204c527 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:32.785308 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1341e682-e32e-404f-b28d-1a0ba204c527 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:32.799112 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1341e682-e32e-404f-b28d-1a0ba204c527 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:32.799570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1341e682-e32e-404f-b28d-1a0ba204c527 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:32.800355 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1341e682-e32e-404f-b28d-1a0ba204c527 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:32.800850 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1341e682-e32e-404f-b28d-1a0ba204c527 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:33.178007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1341e682-e32e-404f-b28d-1a0ba204c527 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:33.191180 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1341e682-e32e-404f-b28d-1a0ba204c527 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1511 microversion: 2.1 time: 0.419071 Jul 25 13:00:33.192054 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1955/4000] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:32 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1511 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:33.482186 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e4dfa15b-12de-4516-a9b7-691225b71e8b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:00:33.482810 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e4dfa15b-12de-4516-a9b7-691225b71e8b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:00:33.483116 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e4dfa15b-12de-4516-a9b7-691225b71e8b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:00:33.483666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e4dfa15b-12de-4516-a9b7-691225b71e8b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:00:33.484078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e4dfa15b-12de-4516-a9b7-691225b71e8b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:00:33.499139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4dfa15b-12de-4516-a9b7-691225b71e8b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:33.500148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4dfa15b-12de-4516-a9b7-691225b71e8b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:33.501124 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4dfa15b-12de-4516-a9b7-691225b71e8b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:33.501974 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4dfa15b-12de-4516-a9b7-691225b71e8b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:33.524649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-e4dfa15b-12de-4516-a9b7-691225b71e8b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Getting quotas for project 247832dc5b24483c82cddea22f81d2db. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:00:33.532089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-e4dfa15b-12de-4516-a9b7-691225b71e8b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Getting quotas for user 8ab304e8bfdd454584c3d511c4646e45 and project 247832dc5b24483c82cddea22f81d2db. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:00:33.547389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e4dfa15b-12de-4516-a9b7-691225b71e8b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:00:33.550046 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e4dfa15b-12de-4516-a9b7-691225b71e8b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:00:33.614810 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e4dfa15b-12de-4516-a9b7-691225b71e8b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.292896 Jul 25 13:00:33.615816 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2046/4001] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:00:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 13:00:33.791734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8d886490-8729-425b-ab25-c25d0b52da99 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:33.792350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8d886490-8729-425b-ab25-c25d0b52da99 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:33.792741 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-555d54d8-2841-4db5-9694-53cd1482e788 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-327212676", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "de838674-15b8-4dca-b952-fafcc5bd15b0"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:33.808028 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d886490-8729-425b-ab25-c25d0b52da99 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:33.808491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d886490-8729-425b-ab25-c25d0b52da99 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:33.809277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d886490-8729-425b-ab25-c25d0b52da99 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:33.810086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d886490-8729-425b-ab25-c25d0b52da99 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:33.890079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-555d54d8-2841-4db5-9694-53cd1482e788 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] validate_networks() for [('de838674-15b8-4dca-b952-fafcc5bd15b0', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:00:34.160465 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8d886490-8729-425b-ab25-c25d0b52da99 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:34.168652 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8d886490-8729-425b-ab25-c25d0b52da99 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1679 microversion: 2.1 time: 0.382077 Jul 25 13:00:34.169450 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1956/4002] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:33 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1679 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:34.175036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d0df6546-c412-4445-a939-57aafc31df20 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:34.177579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d0df6546-c412-4445-a939-57aafc31df20 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:34.202880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d0df6546-c412-4445-a939-57aafc31df20 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:34.203327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d0df6546-c412-4445-a939-57aafc31df20 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:34.209851 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d0df6546-c412-4445-a939-57aafc31df20 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:34.210567 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d0df6546-c412-4445-a939-57aafc31df20 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:34.314798 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d0df6546-c412-4445-a939-57aafc31df20 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "POST /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5/action" status: 200 len: 24567 microversion: 2.1 time: 0.143497 Jul 25 13:00:34.315808 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1957/4003] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:00:34 2022] POST /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5/action => generated 24567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:00:34.329882 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c84707cf-38ef-4e18-ab23-88a6d3fcdda3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:34.330702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c84707cf-38ef-4e18-ab23-88a6d3fcdda3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:34.347994 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c84707cf-38ef-4e18-ab23-88a6d3fcdda3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:34.348551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c84707cf-38ef-4e18-ab23-88a6d3fcdda3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:34.351808 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c84707cf-38ef-4e18-ab23-88a6d3fcdda3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:34.352524 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c84707cf-38ef-4e18-ab23-88a6d3fcdda3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:34.870373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c84707cf-38ef-4e18-ab23-88a6d3fcdda3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:34.880352 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c84707cf-38ef-4e18-ab23-88a6d3fcdda3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1511 microversion: 2.1 time: 0.562966 Jul 25 13:00:34.886263 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1958/4004] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:34 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1511 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:35.002851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-555d54d8-2841-4db5-9694-53cd1482e788 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:00:35.003427 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-555d54d8-2841-4db5-9694-53cd1482e788 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:00:35.004941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-555d54d8-2841-4db5-9694-53cd1482e788 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:00:35.006324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-555d54d8-2841-4db5-9694-53cd1482e788 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:00:35.008314 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-555d54d8-2841-4db5-9694-53cd1482e788 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:00:35.012041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:00:35.033334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-555d54d8-2841-4db5-9694-53cd1482e788 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:35.033870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-555d54d8-2841-4db5-9694-53cd1482e788 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:35.038385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-555d54d8-2841-4db5-9694-53cd1482e788 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:35.039100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-555d54d8-2841-4db5-9694-53cd1482e788 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:35.069780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-555d54d8-2841-4db5-9694-53cd1482e788 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Getting quotas for project 247832dc5b24483c82cddea22f81d2db. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:00:35.079875 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-555d54d8-2841-4db5-9694-53cd1482e788 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Getting quotas for user 8ab304e8bfdd454584c3d511c4646e45 and project 247832dc5b24483c82cddea22f81d2db. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:00:35.107565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-555d54d8-2841-4db5-9694-53cd1482e788 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:00:35.111578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-555d54d8-2841-4db5-9694-53cd1482e788 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e8b5f22f-b68b-4533-8bbf-a94da6b3f872] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:00:35.192269 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-74600614-cc99-4103-adc3-9af094a4d2f1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:35.192963 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-74600614-cc99-4103-adc3-9af094a4d2f1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:35.211669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74600614-cc99-4103-adc3-9af094a4d2f1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:35.217733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74600614-cc99-4103-adc3-9af094a4d2f1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:35.220336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74600614-cc99-4103-adc3-9af094a4d2f1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:35.220826 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74600614-cc99-4103-adc3-9af094a4d2f1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:35.230179 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-555d54d8-2841-4db5-9694-53cd1482e788 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.439766 Jul 25 13:00:35.244851 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2047/4005] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:00:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:00:35.491617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4508febf-27f9-463b-ac80-81712f89183c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1481891226", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "451", "networks": [{"uuid": "de838674-15b8-4dca-b952-fafcc5bd15b0"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:35.606679 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-4508febf-27f9-463b-ac80-81712f89183c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] validate_networks() for [('de838674-15b8-4dca-b952-fafcc5bd15b0', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:00:36.040229 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-74600614-cc99-4103-adc3-9af094a4d2f1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:36.045756 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-74600614-cc99-4103-adc3-9af094a4d2f1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1679 microversion: 2.1 time: 0.858225 Jul 25 13:00:36.050449 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1959/4006] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:35 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1679 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:36.071555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-582772dc-0951-4dd8-adca-4a4cbe929702 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:36.075957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-582772dc-0951-4dd8-adca-4a4cbe929702 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:36.092500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-582772dc-0951-4dd8-adca-4a4cbe929702 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:36.105585 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-582772dc-0951-4dd8-adca-4a4cbe929702 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:36.106930 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-582772dc-0951-4dd8-adca-4a4cbe929702 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:36.107582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-582772dc-0951-4dd8-adca-4a4cbe929702 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:36.909183 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-582772dc-0951-4dd8-adca-4a4cbe929702 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:36.927573 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-582772dc-0951-4dd8-adca-4a4cbe929702 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1511 microversion: 2.1 time: 0.860191 Jul 25 13:00:36.937863 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1960/4007] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:36 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1511 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:37.073670 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-485e373b-5740-4d0d-9fb7-5007af1506f7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:37.074988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-485e373b-5740-4d0d-9fb7-5007af1506f7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:37.085744 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-485e373b-5740-4d0d-9fb7-5007af1506f7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:37.086221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-485e373b-5740-4d0d-9fb7-5007af1506f7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:37.098189 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-485e373b-5740-4d0d-9fb7-5007af1506f7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:37.102030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-485e373b-5740-4d0d-9fb7-5007af1506f7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:37.502245 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-4508febf-27f9-463b-ac80-81712f89183c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:00:37.503629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-4508febf-27f9-463b-ac80-81712f89183c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:00:37.504693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-4508febf-27f9-463b-ac80-81712f89183c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:00:37.505386 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-4508febf-27f9-463b-ac80-81712f89183c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:00:37.506290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-4508febf-27f9-463b-ac80-81712f89183c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:00:37.524472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4508febf-27f9-463b-ac80-81712f89183c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:37.526453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4508febf-27f9-463b-ac80-81712f89183c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:37.529628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4508febf-27f9-463b-ac80-81712f89183c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:37.530574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4508febf-27f9-463b-ac80-81712f89183c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:37.582095 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-4508febf-27f9-463b-ac80-81712f89183c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Getting quotas for project 247832dc5b24483c82cddea22f81d2db. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:00:37.597242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-4508febf-27f9-463b-ac80-81712f89183c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Getting quotas for user 8ab304e8bfdd454584c3d511c4646e45 and project 247832dc5b24483c82cddea22f81d2db. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:00:37.651227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4508febf-27f9-463b-ac80-81712f89183c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:00:37.658349 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4508febf-27f9-463b-ac80-81712f89183c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e0726aaf-f183-465c-ac33-313fd7858542] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:00:37.765280 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4508febf-27f9-463b-ac80-81712f89183c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.278040 Jul 25 13:00:37.768334 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2048/4008] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:00:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:00:37.779335 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dbaf6b5e-0e8a-434a-9498-8fb16a3ff13a tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:37.780272 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dbaf6b5e-0e8a-434a-9498-8fb16a3ff13a tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e0726aaf-f183-465c-ac33-313fd7858542] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:37.889657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dbaf6b5e-0e8a-434a-9498-8fb16a3ff13a tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:37.901934 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dbaf6b5e-0e8a-434a-9498-8fb16a3ff13a tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542" status: 200 len: 1221 microversion: 2.1 time: 0.126474 Jul 25 13:00:37.903324 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2049/4009] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:37 2022] GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542 => generated 1221 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:37.928662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-485e373b-5740-4d0d-9fb7-5007af1506f7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:37.938086 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-485e373b-5740-4d0d-9fb7-5007af1506f7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1679 microversion: 2.1 time: 0.869611 Jul 25 13:00:37.951841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d08ccc29-5969-4be3-917f-5abfbb41f987 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:37.952895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d08ccc29-5969-4be3-917f-5abfbb41f987 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:37.959238 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1961/4010] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:37 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1679 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:37.963416 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d08ccc29-5969-4be3-917f-5abfbb41f987 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:37.967871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d08ccc29-5969-4be3-917f-5abfbb41f987 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:37.969092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d08ccc29-5969-4be3-917f-5abfbb41f987 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:37.969749 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d08ccc29-5969-4be3-917f-5abfbb41f987 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:38.641455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d08ccc29-5969-4be3-917f-5abfbb41f987 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:38.650137 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d08ccc29-5969-4be3-917f-5abfbb41f987 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1511 microversion: 2.1 time: 0.702048 Jul 25 13:00:38.667136 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2050/4011] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:37 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1511 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:38.925726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6484b22d-d5b5-46e5-992c-99d70f2047dd tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:38.926493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6484b22d-d5b5-46e5-992c-99d70f2047dd tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e0726aaf-f183-465c-ac33-313fd7858542] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:38.949183 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6484b22d-d5b5-46e5-992c-99d70f2047dd tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:38.952695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6484b22d-d5b5-46e5-992c-99d70f2047dd tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:38.955519 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6484b22d-d5b5-46e5-992c-99d70f2047dd tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:38.963212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6484b22d-d5b5-46e5-992c-99d70f2047dd tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:38.964009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f58469a2-7d24-491c-b6ee-6ea8693924e2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:38.964711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f58469a2-7d24-491c-b6ee-6ea8693924e2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:38.973449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f58469a2-7d24-491c-b6ee-6ea8693924e2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:38.986646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f58469a2-7d24-491c-b6ee-6ea8693924e2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:38.987778 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f58469a2-7d24-491c-b6ee-6ea8693924e2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:38.988241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f58469a2-7d24-491c-b6ee-6ea8693924e2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:39.416326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6484b22d-d5b5-46e5-992c-99d70f2047dd tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:39.427391 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6484b22d-d5b5-46e5-992c-99d70f2047dd tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542" status: 200 len: 1217 microversion: 2.1 time: 0.507830 Jul 25 13:00:39.437647 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1962/4012] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:38 2022] GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542 => generated 1217 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:39.674012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bc988d49-a0d8-4510-b65c-c8b8b9374e93 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:39.675239 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bc988d49-a0d8-4510-b65c-c8b8b9374e93 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:39.690037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc988d49-a0d8-4510-b65c-c8b8b9374e93 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:39.691067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc988d49-a0d8-4510-b65c-c8b8b9374e93 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:39.693224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc988d49-a0d8-4510-b65c-c8b8b9374e93 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:39.694638 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc988d49-a0d8-4510-b65c-c8b8b9374e93 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:40.454978 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f58469a2-7d24-491c-b6ee-6ea8693924e2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:40.464288 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f58469a2-7d24-491c-b6ee-6ea8693924e2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1679 microversion: 2.1 time: 1.504162 Jul 25 13:00:40.470250 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2051/4013] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:38 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1679 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:40.488138 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-45badc64-447a-45ca-aacf-119457792df1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:40.489382 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-45badc64-447a-45ca-aacf-119457792df1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e0726aaf-f183-465c-ac33-313fd7858542] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:40.510576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45badc64-447a-45ca-aacf-119457792df1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:40.511166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45badc64-447a-45ca-aacf-119457792df1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:40.511984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45badc64-447a-45ca-aacf-119457792df1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:40.512423 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45badc64-447a-45ca-aacf-119457792df1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:40.770727 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-45badc64-447a-45ca-aacf-119457792df1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:40.817039 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-45badc64-447a-45ca-aacf-119457792df1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542" status: 200 len: 1279 microversion: 2.1 time: 0.345428 Jul 25 13:00:40.830468 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2052/4014] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:40 2022] GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542 => generated 1279 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:40.835384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bc988d49-a0d8-4510-b65c-c8b8b9374e93 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:40.851200 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bc988d49-a0d8-4510-b65c-c8b8b9374e93 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1532 microversion: 2.1 time: 1.181451 Jul 25 13:00:40.853965 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1963/4015] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:39 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1532 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:41.499810 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4f20b784-4b96-4e24-a57f-d0f3803e5103 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:41.502958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4f20b784-4b96-4e24-a57f-d0f3803e5103 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:41.513734 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f20b784-4b96-4e24-a57f-d0f3803e5103 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:41.518008 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f20b784-4b96-4e24-a57f-d0f3803e5103 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:41.519095 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f20b784-4b96-4e24-a57f-d0f3803e5103 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:41.519709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f20b784-4b96-4e24-a57f-d0f3803e5103 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:41.853782 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-452bc0c4-b2e7-46e5-ba5f-8fa754ba5f80 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:41.855047 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-452bc0c4-b2e7-46e5-ba5f-8fa754ba5f80 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e0726aaf-f183-465c-ac33-313fd7858542] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:41.882634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:00:41.893443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-452bc0c4-b2e7-46e5-ba5f-8fa754ba5f80 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:41.893951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-452bc0c4-b2e7-46e5-ba5f-8fa754ba5f80 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:41.894774 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-452bc0c4-b2e7-46e5-ba5f-8fa754ba5f80 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:41.895221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-452bc0c4-b2e7-46e5-ba5f-8fa754ba5f80 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:42.309589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-452bc0c4-b2e7-46e5-ba5f-8fa754ba5f80 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:42.320819 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-452bc0c4-b2e7-46e5-ba5f-8fa754ba5f80 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542" status: 200 len: 1279 microversion: 2.1 time: 0.471554 Jul 25 13:00:42.344038 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1964/4016] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:41 2022] GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542 => generated 1279 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:42.358450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-342c66e3-8845-42e9-acea-aa4f86f69e37 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:42.361335 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-342c66e3-8845-42e9-acea-aa4f86f69e37 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:42.375787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-342c66e3-8845-42e9-acea-aa4f86f69e37 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:42.378281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-342c66e3-8845-42e9-acea-aa4f86f69e37 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:42.379521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-342c66e3-8845-42e9-acea-aa4f86f69e37 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:42.381519 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-342c66e3-8845-42e9-acea-aa4f86f69e37 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:42.388273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4f20b784-4b96-4e24-a57f-d0f3803e5103 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:42.397727 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4f20b784-4b96-4e24-a57f-d0f3803e5103 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1679 microversion: 2.1 time: 0.909922 Jul 25 13:00:42.404225 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2053/4017] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:41 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1679 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:42.924150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-96a6b5d1-7816-40cd-ac55-db41846a0be7 req-e141f610-0da6-4f90-b3a1-1162942442ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08f06850-1c68-450d-b47c-f5ef17f61002", "tag": "ba60e464-f808-4ed5-832b-a2e66f2e29fd"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:42.975096 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-96a6b5d1-7816-40cd-ac55-db41846a0be7 req-e141f610-0da6-4f90-b3a1-1162942442ca service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:42.975564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-96a6b5d1-7816-40cd-ac55-db41846a0be7 req-e141f610-0da6-4f90-b3a1-1162942442ca service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:43.007473 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-96a6b5d1-7816-40cd-ac55-db41846a0be7 req-e141f610-0da6-4f90-b3a1-1162942442ca service nova] Creating event network-changed:ba60e464-f808-4ed5-832b-a2e66f2e29fd for instance 08f06850-1c68-450d-b47c-f5ef17f61002 on n-h2-848886-15 Jul 25 13:00:43.015021 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-96a6b5d1-7816-40cd-ac55-db41846a0be7 req-e141f610-0da6-4f90-b3a1-1162942442ca service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095162 Jul 25 13:00:43.018591 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2054/4018] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:00:43.059132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-342c66e3-8845-42e9-acea-aa4f86f69e37 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:43.082294 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-342c66e3-8845-42e9-acea-aa4f86f69e37 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1527 microversion: 2.1 time: 0.731999 Jul 25 13:00:43.093579 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1965/4019] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:42 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1527 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:43.368625 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e4e3d4f2-e367-40af-93ac-607f67e942ce tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:43.369663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e4e3d4f2-e367-40af-93ac-607f67e942ce tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e0726aaf-f183-465c-ac33-313fd7858542] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:43.402466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4e3d4f2-e367-40af-93ac-607f67e942ce tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:43.404458 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4e3d4f2-e367-40af-93ac-607f67e942ce tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:43.409141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4e3d4f2-e367-40af-93ac-607f67e942ce tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:43.412239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4e3d4f2-e367-40af-93ac-607f67e942ce tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:43.429627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3f0a52d0-887b-458d-a289-44b12d2cf5e7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:43.430279 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3f0a52d0-887b-458d-a289-44b12d2cf5e7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:43.445348 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3f0a52d0-887b-458d-a289-44b12d2cf5e7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:43.445810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3f0a52d0-887b-458d-a289-44b12d2cf5e7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:43.452574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3f0a52d0-887b-458d-a289-44b12d2cf5e7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:43.455154 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3f0a52d0-887b-458d-a289-44b12d2cf5e7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:43.526846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:00:43.667207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e4e3d4f2-e367-40af-93ac-607f67e942ce tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:43.682836 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e4e3d4f2-e367-40af-93ac-607f67e942ce tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542" status: 200 len: 1279 microversion: 2.1 time: 0.321267 Jul 25 13:00:43.685253 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2055/4020] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:43 2022] GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542 => generated 1279 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:44.069622 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3f0a52d0-887b-458d-a289-44b12d2cf5e7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:44.093916 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3f0a52d0-887b-458d-a289-44b12d2cf5e7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1656 microversion: 2.1 time: 0.668858 Jul 25 13:00:44.115258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1e346c81-7ea1-4801-9c61-90826e976250 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:44.116300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1e346c81-7ea1-4801-9c61-90826e976250 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:44.122755 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1966/4021] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:43 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1656 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:44.138208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1e346c81-7ea1-4801-9c61-90826e976250 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:44.138705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1e346c81-7ea1-4801-9c61-90826e976250 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:44.143947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8f1140c3-815b-4381-9262-79a23616be49 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:44.147095 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1e346c81-7ea1-4801-9c61-90826e976250 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:44.147671 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1e346c81-7ea1-4801-9c61-90826e976250 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:44.157406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f1140c3-815b-4381-9262-79a23616be49 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:44.160047 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f1140c3-815b-4381-9262-79a23616be49 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:44.237660 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8f1140c3-815b-4381-9262-79a23616be49 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Going to try to start instance {{(pid=125883) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 13:00:44.330766 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8f1140c3-815b-4381-9262-79a23616be49 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action" status: 202 len: 0 microversion: 2.1 time: 0.206144 Jul 25 13:00:44.343077 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1967/4022] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:00:44 2022] POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:00:44.362906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f432404a-35ab-4f02-a83e-5c0891bfe9e8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:44.363626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f432404a-35ab-4f02-a83e-5c0891bfe9e8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:44.392443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f432404a-35ab-4f02-a83e-5c0891bfe9e8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:44.393043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f432404a-35ab-4f02-a83e-5c0891bfe9e8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:44.393931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f432404a-35ab-4f02-a83e-5c0891bfe9e8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:44.394387 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f432404a-35ab-4f02-a83e-5c0891bfe9e8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:44.750374 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1e346c81-7ea1-4801-9c61-90826e976250 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:44.767182 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1e346c81-7ea1-4801-9c61-90826e976250 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1527 microversion: 2.1 time: 0.658493 Jul 25 13:00:44.768843 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2056/4023] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:44 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1527 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:44.774213 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-76a79dc9-20a9-4598-bd8f-dd27ce284048 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:44.821715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-76a79dc9-20a9-4598-bd8f-dd27ce284048 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e0726aaf-f183-465c-ac33-313fd7858542] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:44.855434 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76a79dc9-20a9-4598-bd8f-dd27ce284048 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:44.859573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76a79dc9-20a9-4598-bd8f-dd27ce284048 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:44.860449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76a79dc9-20a9-4598-bd8f-dd27ce284048 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:44.866234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76a79dc9-20a9-4598-bd8f-dd27ce284048 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:44.911930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:00:45.171588 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f432404a-35ab-4f02-a83e-5c0891bfe9e8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:45.180377 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f432404a-35ab-4f02-a83e-5c0891bfe9e8 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1665 microversion: 2.1 time: 0.835923 Jul 25 13:00:45.199001 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1968/4024] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:44 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1665 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:45.321778 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-76a79dc9-20a9-4598-bd8f-dd27ce284048 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:45.331611 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-76a79dc9-20a9-4598-bd8f-dd27ce284048 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542" status: 200 len: 1321 microversion: 2.1 time: 0.561501 Jul 25 13:00:45.338083 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2057/4025] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:44 2022] GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542 => generated 1321 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:45.382107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c85684a8-1e46-41c3-a08e-b59534352e57 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:45.382733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c85684a8-1e46-41c3-a08e-b59534352e57 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:45.392817 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c85684a8-1e46-41c3-a08e-b59534352e57 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:45.393279 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c85684a8-1e46-41c3-a08e-b59534352e57 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:45.394112 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c85684a8-1e46-41c3-a08e-b59534352e57 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:45.394556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c85684a8-1e46-41c3-a08e-b59534352e57 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:45.678724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-f42ab1e1-8fcb-4368-b3a0-c5137cf2f077 req-1334116a-6365-45dc-a7a3-1069eeddda02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8b5f22f-b68b-4533-8bbf-a94da6b3f872", "tag": "c2c6e375-3bea-4129-8d43-ce121d323d31"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:45.704131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f42ab1e1-8fcb-4368-b3a0-c5137cf2f077 req-1334116a-6365-45dc-a7a3-1069eeddda02 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:45.710477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f42ab1e1-8fcb-4368-b3a0-c5137cf2f077 req-1334116a-6365-45dc-a7a3-1069eeddda02 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:45.754517 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-f42ab1e1-8fcb-4368-b3a0-c5137cf2f077 req-1334116a-6365-45dc-a7a3-1069eeddda02 service nova] Creating event network-changed:c2c6e375-3bea-4129-8d43-ce121d323d31 for instance e8b5f22f-b68b-4533-8bbf-a94da6b3f872 on n-h1-848886-15 Jul 25 13:00:45.773588 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-f42ab1e1-8fcb-4368-b3a0-c5137cf2f077 req-1334116a-6365-45dc-a7a3-1069eeddda02 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099835 Jul 25 13:00:45.780549 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2058/4026] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:00:45.803022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-902c3ca6-95a5-4cca-86bd-68571fcf408b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:45.808711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-902c3ca6-95a5-4cca-86bd-68571fcf408b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:45.841948 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-902c3ca6-95a5-4cca-86bd-68571fcf408b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:45.858479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-902c3ca6-95a5-4cca-86bd-68571fcf408b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:45.859853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-902c3ca6-95a5-4cca-86bd-68571fcf408b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:45.860524 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-902c3ca6-95a5-4cca-86bd-68571fcf408b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:46.501561 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c85684a8-1e46-41c3-a08e-b59534352e57 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1836 microversion: 2.1 time: 1.123215 Jul 25 13:00:46.505584 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1969/4027] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:45 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1836 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:46.523535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-70d20a5e-d261-4c3a-a70b-656a752ac97d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:46.525632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-70d20a5e-d261-4c3a-a70b-656a752ac97d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:46.558838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-70d20a5e-d261-4c3a-a70b-656a752ac97d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:46.564066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-70d20a5e-d261-4c3a-a70b-656a752ac97d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:46.569136 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-70d20a5e-d261-4c3a-a70b-656a752ac97d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:46.569669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-70d20a5e-d261-4c3a-a70b-656a752ac97d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:47.091299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-902c3ca6-95a5-4cca-86bd-68571fcf408b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:47.099351 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-902c3ca6-95a5-4cca-86bd-68571fcf408b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1527 microversion: 2.1 time: 1.313628 Jul 25 13:00:47.125022 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2059/4028] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:45 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1527 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:47.137461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7c0a4a88-69c4-4d9f-8e5e-bf9cf6f4a557 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:47.138110 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7c0a4a88-69c4-4d9f-8e5e-bf9cf6f4a557 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e0726aaf-f183-465c-ac33-313fd7858542] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:47.156086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c0a4a88-69c4-4d9f-8e5e-bf9cf6f4a557 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:47.156554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c0a4a88-69c4-4d9f-8e5e-bf9cf6f4a557 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:47.157356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c0a4a88-69c4-4d9f-8e5e-bf9cf6f4a557 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:47.157798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c0a4a88-69c4-4d9f-8e5e-bf9cf6f4a557 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:47.336651 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-70d20a5e-d261-4c3a-a70b-656a752ac97d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:47.358524 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-70d20a5e-d261-4c3a-a70b-656a752ac97d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1665 microversion: 2.1 time: 0.839410 Jul 25 13:00:47.373770 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1970/4029] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:46 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1665 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:47.379461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-77966875-e22f-422f-b4d5-87123c03bb20 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:47.380495 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-77966875-e22f-422f-b4d5-87123c03bb20 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:47.394504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77966875-e22f-422f-b4d5-87123c03bb20 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:47.395351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77966875-e22f-422f-b4d5-87123c03bb20 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:47.396360 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77966875-e22f-422f-b4d5-87123c03bb20 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:47.396998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77966875-e22f-422f-b4d5-87123c03bb20 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:47.552824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:00:47.894529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=20 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:00:47.981427 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7c0a4a88-69c4-4d9f-8e5e-bf9cf6f4a557 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:47.997526 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7c0a4a88-69c4-4d9f-8e5e-bf9cf6f4a557 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542" status: 200 len: 1321 microversion: 2.1 time: 0.870794 Jul 25 13:00:47.998454 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2060/4030] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:47 2022] GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542 => generated 1321 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:48.005570 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-6c2a3529-da0d-45f0-88be-b93b48d88c54 req-9f183e40-087e-4fc7-96fa-b798d048e625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2", "name": "network-vif-plugged", "status": "completed", "tag": "a2ca9e31-6d49-4fae-9ff5-c3c32be13ff6"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:48.016300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-77966875-e22f-422f-b4d5-87123c03bb20 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:48.032322 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-77966875-e22f-422f-b4d5-87123c03bb20 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1683 microversion: 2.1 time: 0.651170 Jul 25 13:00:48.046628 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1971/4031] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:47 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1683 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:48.068901 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f9d1a060-1af2-423b-bef2-6ba27fc4c506 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-814732697", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "85e5331f-3ae0-4154-976b-f164beab98f4"}], "key_name": "tempest-TestSecurityGroupsBasicOps-496810183", "security_groups": []}, "os:scheduler_hints": {"different_host": ["3a938f7a-a9f5-4888-95f3-bde7040a576f"]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:48.073408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6c2a3529-da0d-45f0-88be-b93b48d88c54 req-9f183e40-087e-4fc7-96fa-b798d048e625 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:48.073898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6c2a3529-da0d-45f0-88be-b93b48d88c54 req-9f183e40-087e-4fc7-96fa-b798d048e625 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:48.106178 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-6c2a3529-da0d-45f0-88be-b93b48d88c54 req-9f183e40-087e-4fc7-96fa-b798d048e625 service nova] Creating event network-vif-plugged:a2ca9e31-6d49-4fae-9ff5-c3c32be13ff6 for instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 on n-h1-848886-15 Jul 25 13:00:48.120714 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-6c2a3529-da0d-45f0-88be-b93b48d88c54 req-9f183e40-087e-4fc7-96fa-b798d048e625 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117277 Jul 25 13:00:48.121823 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2061/4032] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:00:48.134625 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-486e1665-5b5a-4001-a88d-32b68648e7d9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:48.140608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-486e1665-5b5a-4001-a88d-32b68648e7d9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:48.159296 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-486e1665-5b5a-4001-a88d-32b68648e7d9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:48.171939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-486e1665-5b5a-4001-a88d-32b68648e7d9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:48.174194 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-486e1665-5b5a-4001-a88d-32b68648e7d9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:48.175487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-486e1665-5b5a-4001-a88d-32b68648e7d9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:48.228777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-f9d1a060-1af2-423b-bef2-6ba27fc4c506 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] validate_networks() for [('85e5331f-3ae0-4154-976b-f164beab98f4', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:00:49.551426 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-486e1665-5b5a-4001-a88d-32b68648e7d9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:49.577255 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-486e1665-5b5a-4001-a88d-32b68648e7d9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1527 microversion: 2.1 time: 1.440536 Jul 25 13:00:49.604065 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2062/4033] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:48 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1527 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:49.609700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bf18849b-e721-4ce0-a7ce-affd6570b600 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:49.638243 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bf18849b-e721-4ce0-a7ce-affd6570b600 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:49.687350 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf18849b-e721-4ce0-a7ce-affd6570b600 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:49.688134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf18849b-e721-4ce0-a7ce-affd6570b600 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:49.689195 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf18849b-e721-4ce0-a7ce-affd6570b600 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:49.729136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf18849b-e721-4ce0-a7ce-affd6570b600 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:50.594048 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bf18849b-e721-4ce0-a7ce-affd6570b600 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:50.605713 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bf18849b-e721-4ce0-a7ce-affd6570b600 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 1.000299 Jul 25 13:00:50.608004 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2063/4034] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:49 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:50.619712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ba01d29b-d56b-4502-b8e0-108557c05897 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:50.629772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ba01d29b-d56b-4502-b8e0-108557c05897 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:50.640201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba01d29b-d56b-4502-b8e0-108557c05897 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:50.640941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba01d29b-d56b-4502-b8e0-108557c05897 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:50.642629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba01d29b-d56b-4502-b8e0-108557c05897 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:50.645193 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba01d29b-d56b-4502-b8e0-108557c05897 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:50.734070 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ba01d29b-d56b-4502-b8e0-108557c05897 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "POST /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5/action" status: 200 len: 32644 microversion: 2.1 time: 0.122985 Jul 25 13:00:50.735019 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2064/4035] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:00:50 2022] POST /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5/action => generated 32644 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:00:50.744763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e1e2d973-80a8-425f-8cc0-98e344939164 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:50.745792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e1e2d973-80a8-425f-8cc0-98e344939164 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e0726aaf-f183-465c-ac33-313fd7858542] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:50.764019 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1e2d973-80a8-425f-8cc0-98e344939164 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:50.764788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1e2d973-80a8-425f-8cc0-98e344939164 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:50.765766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1e2d973-80a8-425f-8cc0-98e344939164 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:50.766385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1e2d973-80a8-425f-8cc0-98e344939164 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:51.437346 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e1e2d973-80a8-425f-8cc0-98e344939164 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:51.448716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-f9d1a060-1af2-423b-bef2-6ba27fc4c506 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:00:51.450095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-f9d1a060-1af2-423b-bef2-6ba27fc4c506 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:00:51.450095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-f9d1a060-1af2-423b-bef2-6ba27fc4c506 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:00:51.450095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-f9d1a060-1af2-423b-bef2-6ba27fc4c506 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:00:51.450464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-f9d1a060-1af2-423b-bef2-6ba27fc4c506 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:00:51.458999 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e1e2d973-80a8-425f-8cc0-98e344939164 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542" status: 200 len: 1321 microversion: 2.1 time: 0.717919 Jul 25 13:00:51.464738 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2065/4036] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:50 2022] GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542 => generated 1321 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:51.467740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9d1a060-1af2-423b-bef2-6ba27fc4c506 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:51.468382 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9d1a060-1af2-423b-bef2-6ba27fc4c506 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:51.469363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9d1a060-1af2-423b-bef2-6ba27fc4c506 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:51.470009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9d1a060-1af2-423b-bef2-6ba27fc4c506 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:51.487137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-816fd30f-d248-4180-9605-461ab1b90fe8 req-1e0d8a9d-7ce8-4544-8953-0bc15b4cf572 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0726aaf-f183-465c-ac33-313fd7858542", "tag": "76f58bf7-d942-480a-a6c7-6057d2be96f8"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:51.527976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-f9d1a060-1af2-423b-bef2-6ba27fc4c506 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Getting quotas for project bb007c5b5f894bc0a31b2c166b53adac. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:00:51.532864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-816fd30f-d248-4180-9605-461ab1b90fe8 req-1e0d8a9d-7ce8-4544-8953-0bc15b4cf572 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:51.539580 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-816fd30f-d248-4180-9605-461ab1b90fe8 req-1e0d8a9d-7ce8-4544-8953-0bc15b4cf572 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:51.544284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-f9d1a060-1af2-423b-bef2-6ba27fc4c506 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Getting quotas for user ad62262b424640728ef148dfaae6e074 and project bb007c5b5f894bc0a31b2c166b53adac. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:00:51.565447 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-816fd30f-d248-4180-9605-461ab1b90fe8 req-1e0d8a9d-7ce8-4544-8953-0bc15b4cf572 service nova] Creating event network-changed:76f58bf7-d942-480a-a6c7-6057d2be96f8 for instance e0726aaf-f183-465c-ac33-313fd7858542 on n-h2-848886-15 Jul 25 13:00:51.581334 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-816fd30f-d248-4180-9605-461ab1b90fe8 req-1e0d8a9d-7ce8-4544-8953-0bc15b4cf572 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114959 Jul 25 13:00:51.583416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f9d1a060-1af2-423b-bef2-6ba27fc4c506 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:00:51.586597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f9d1a060-1af2-423b-bef2-6ba27fc4c506 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:00:51.587029 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2066/4037] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:00:51.592472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4470607f-e429-406b-bfc9-bb020413bcd8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:51.598494 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4470607f-e429-406b-bfc9-bb020413bcd8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:51.619528 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4470607f-e429-406b-bfc9-bb020413bcd8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:51.621948 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4470607f-e429-406b-bfc9-bb020413bcd8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:51.623669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4470607f-e429-406b-bfc9-bb020413bcd8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:51.630825 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4470607f-e429-406b-bfc9-bb020413bcd8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:51.774643 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f9d1a060-1af2-423b-bef2-6ba27fc4c506 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 3.693306 Jul 25 13:00:51.774643 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1972/4038] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:00:48 2022] POST /compute/v2.1/servers => generated 361 bytes in 3700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:00:51.806827 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-11d9b259-3c56-4a4a-adbe-874b84cb0ed9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:51.807372 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-11d9b259-3c56-4a4a-adbe-874b84cb0ed9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:51.855290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-11d9b259-3c56-4a4a-adbe-874b84cb0ed9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:51.855856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-11d9b259-3c56-4a4a-adbe-874b84cb0ed9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:51.858901 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-11d9b259-3c56-4a4a-adbe-874b84cb0ed9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:51.872365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-11d9b259-3c56-4a4a-adbe-874b84cb0ed9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:52.055865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4470607f-e429-406b-bfc9-bb020413bcd8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:52.064765 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4470607f-e429-406b-bfc9-bb020413bcd8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1527 microversion: 2.1 time: 0.476363 Jul 25 13:00:52.065395 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2067/4039] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:51 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1527 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:52.094284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-036b959e-29c5-4588-84a5-c2873c67ff8b tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:52.094895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-036b959e-29c5-4588-84a5-c2873c67ff8b tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:52.138175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-036b959e-29c5-4588-84a5-c2873c67ff8b tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:52.142815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-036b959e-29c5-4588-84a5-c2873c67ff8b tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:52.148131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-036b959e-29c5-4588-84a5-c2873c67ff8b tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:52.148616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-036b959e-29c5-4588-84a5-c2873c67ff8b tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:52.264121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-11d9b259-3c56-4a4a-adbe-874b84cb0ed9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:52.276430 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-11d9b259-3c56-4a4a-adbe-874b84cb0ed9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.526109 Jul 25 13:00:52.278000 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1973/4040] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:51 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:52.284155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-3db3edf7-cbdc-461b-ae92-564ac73b5263 req-205bfca1-9ef4-4cb5-98b1-62fa5973f844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08f06850-1c68-450d-b47c-f5ef17f61002", "name": "network-vif-plugged", "status": "completed", "tag": "ba60e464-f808-4ed5-832b-a2e66f2e29fd"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:52.394476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-3db3edf7-cbdc-461b-ae92-564ac73b5263 req-205bfca1-9ef4-4cb5-98b1-62fa5973f844 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:52.395021 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-3db3edf7-cbdc-461b-ae92-564ac73b5263 req-205bfca1-9ef4-4cb5-98b1-62fa5973f844 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:52.442836 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-3db3edf7-cbdc-461b-ae92-564ac73b5263 req-205bfca1-9ef4-4cb5-98b1-62fa5973f844 service nova] Creating event network-vif-plugged:ba60e464-f808-4ed5-832b-a2e66f2e29fd for instance 08f06850-1c68-450d-b47c-f5ef17f61002 on n-h2-848886-15 Jul 25 13:00:52.453880 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-3db3edf7-cbdc-461b-ae92-564ac73b5263 req-205bfca1-9ef4-4cb5-98b1-62fa5973f844 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174141 Jul 25 13:00:52.454571 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1974/4041] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:00:52.469780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4e1b20f8-48f5-4c53-9c77-c85620f8fb33 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:52.485706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4e1b20f8-48f5-4c53-9c77-c85620f8fb33 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:52.808530 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-036b959e-29c5-4588-84a5-c2873c67ff8b tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'cba0ce5d42b344fa9c90d32358917451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b553cd19e4287905a9375d142f990', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:52.809971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-036b959e-29c5-4588-84a5-c2873c67ff8b tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] flavor_id is None. Assuming migration. {{(pid=125884) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 25 13:00:52.810609 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-036b959e-29c5-4588-84a5-c2873c67ff8b tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125884) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 13:00:53.150703 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4e1b20f8-48f5-4c53-9c77-c85620f8fb33 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:53.163048 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4e1b20f8-48f5-4c53-9c77-c85620f8fb33 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb" status: 200 len: 1240 microversion: 2.1 time: 0.707090 Jul 25 13:00:53.164130 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1975/4042] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:52 2022] GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb => generated 1240 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:53.180737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-76a587aa-8fac-4ea9-a7c1-1c9fcffc54b6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:53.181652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-76a587aa-8fac-4ea9-a7c1-1c9fcffc54b6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:53.203786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-76a587aa-8fac-4ea9-a7c1-1c9fcffc54b6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:53.206612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-76a587aa-8fac-4ea9-a7c1-1c9fcffc54b6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:53.212397 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-76a587aa-8fac-4ea9-a7c1-1c9fcffc54b6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:53.212854 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-76a587aa-8fac-4ea9-a7c1-1c9fcffc54b6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:53.732144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-76a587aa-8fac-4ea9-a7c1-1c9fcffc54b6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:53.747567 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-76a587aa-8fac-4ea9-a7c1-1c9fcffc54b6 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.582019 Jul 25 13:00:53.749170 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1976/4043] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:53 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:53.764110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dcfbe851-5444-4f63-84b6-e29e09e43407 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:53.766017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dcfbe851-5444-4f63-84b6-e29e09e43407 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e0726aaf-f183-465c-ac33-313fd7858542] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:53.780916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dcfbe851-5444-4f63-84b6-e29e09e43407 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:53.781682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dcfbe851-5444-4f63-84b6-e29e09e43407 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:53.785233 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dcfbe851-5444-4f63-84b6-e29e09e43407 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:53.788365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dcfbe851-5444-4f63-84b6-e29e09e43407 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:53.917957 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-036b959e-29c5-4588-84a5-c2873c67ff8b tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5/action" status: 202 len: 0 microversion: 2.1 time: 1.835603 Jul 25 13:00:53.922490 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2068/4044] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:00:52 2022] POST /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5/action => generated 0 bytes in 1843 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:00:53.936218 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-24e98063-4080-4f7f-b877-18aff202a6fa tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:53.940840 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-24e98063-4080-4f7f-b877-18aff202a6fa tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:53.957153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24e98063-4080-4f7f-b877-18aff202a6fa tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:53.959467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24e98063-4080-4f7f-b877-18aff202a6fa tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:53.964278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24e98063-4080-4f7f-b877-18aff202a6fa tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:53.965107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24e98063-4080-4f7f-b877-18aff202a6fa tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:54.247084 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dcfbe851-5444-4f63-84b6-e29e09e43407 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:54.256034 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dcfbe851-5444-4f63-84b6-e29e09e43407 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542" status: 200 len: 1321 microversion: 2.1 time: 0.503416 Jul 25 13:00:54.264037 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1977/4045] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:53 2022] GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542 => generated 1321 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:54.284804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0e59a836-bd0f-441c-b00b-4476f94d511e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:54.291951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0e59a836-bd0f-441c-b00b-4476f94d511e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:54.315834 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e59a836-bd0f-441c-b00b-4476f94d511e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:54.316299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e59a836-bd0f-441c-b00b-4476f94d511e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:54.324185 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e59a836-bd0f-441c-b00b-4476f94d511e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:54.324647 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e59a836-bd0f-441c-b00b-4476f94d511e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:54.422572 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-24e98063-4080-4f7f-b877-18aff202a6fa tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:54.446469 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-24e98063-4080-4f7f-b877-18aff202a6fa tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1527 microversion: 2.1 time: 0.521881 Jul 25 13:00:54.452359 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2069/4046] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:53 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1527 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:54.457907 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6fb7251a-6ed7-4a44-a8fa-308cf50aa7a5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:54.477206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6fb7251a-6ed7-4a44-a8fa-308cf50aa7a5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:54.503565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6fb7251a-6ed7-4a44-a8fa-308cf50aa7a5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:54.505688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6fb7251a-6ed7-4a44-a8fa-308cf50aa7a5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:54.506931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6fb7251a-6ed7-4a44-a8fa-308cf50aa7a5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:54.507834 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6fb7251a-6ed7-4a44-a8fa-308cf50aa7a5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:55.290153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6fb7251a-6ed7-4a44-a8fa-308cf50aa7a5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:55.314417 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6fb7251a-6ed7-4a44-a8fa-308cf50aa7a5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1692 microversion: 2.1 time: 0.860462 Jul 25 13:00:55.316204 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2070/4047] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:54 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1692 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:55.327927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9e54bb9b-a1b5-4184-9bee-8dfe3303c731 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:55.328545 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9e54bb9b-a1b5-4184-9bee-8dfe3303c731 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:55.343672 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e54bb9b-a1b5-4184-9bee-8dfe3303c731 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:55.344236 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e54bb9b-a1b5-4184-9bee-8dfe3303c731 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:55.345051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e54bb9b-a1b5-4184-9bee-8dfe3303c731 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:55.358589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e54bb9b-a1b5-4184-9bee-8dfe3303c731 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:55.452958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0e59a836-bd0f-441c-b00b-4476f94d511e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:55.463252 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0e59a836-bd0f-441c-b00b-4476f94d511e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 1.196397 Jul 25 13:00:55.471076 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1978/4048] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:54 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:55.481860 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-14993e45-0155-4214-93de-8220ef727de1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:55.482745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-14993e45-0155-4214-93de-8220ef727de1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e0726aaf-f183-465c-ac33-313fd7858542] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:55.494391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14993e45-0155-4214-93de-8220ef727de1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:55.498321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14993e45-0155-4214-93de-8220ef727de1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:55.499795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14993e45-0155-4214-93de-8220ef727de1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:55.500670 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14993e45-0155-4214-93de-8220ef727de1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:55.547787 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9e54bb9b-a1b5-4184-9bee-8dfe3303c731 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:55.561546 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9e54bb9b-a1b5-4184-9bee-8dfe3303c731 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb" status: 200 len: 1298 microversion: 2.1 time: 0.241277 Jul 25 13:00:55.562395 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2071/4049] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:55 2022] GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb => generated 1298 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:55.580158 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-58555f2d-32d8-49ba-acba-2163e0013e35 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:55.592895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-58555f2d-32d8-49ba-acba-2163e0013e35 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:55.605540 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58555f2d-32d8-49ba-acba-2163e0013e35 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:55.608630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58555f2d-32d8-49ba-acba-2163e0013e35 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:55.609667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58555f2d-32d8-49ba-acba-2163e0013e35 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:55.610557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58555f2d-32d8-49ba-acba-2163e0013e35 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:56.359691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-58555f2d-32d8-49ba-acba-2163e0013e35 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:56.386820 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-58555f2d-32d8-49ba-acba-2163e0013e35 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1527 microversion: 2.1 time: 0.807682 Jul 25 13:00:56.389793 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2072/4050] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:55 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1527 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:56.398319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-14993e45-0155-4214-93de-8220ef727de1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:56.407877 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-14993e45-0155-4214-93de-8220ef727de1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542" status: 200 len: 1321 microversion: 2.1 time: 0.935351 Jul 25 13:00:56.417219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a3794ff0-6c78-4cc3-a89a-91c1c641916d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:56.417977 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a3794ff0-6c78-4cc3-a89a-91c1c641916d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:56.418637 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1979/4051] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:55 2022] GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542 => generated 1321 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:56.424321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-e6137716-4d0a-45e8-8ba7-080de7707e49 req-83da33d7-9e6c-4bf1-abd6-2ff6d1a9ea4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b5f22f-b68b-4533-8bbf-a94da6b3f872", "name": "network-vif-plugged", "status": "completed", "tag": "c2c6e375-3bea-4129-8d43-ce121d323d31"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:56.443442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3794ff0-6c78-4cc3-a89a-91c1c641916d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:56.444375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3794ff0-6c78-4cc3-a89a-91c1c641916d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:56.447941 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e6137716-4d0a-45e8-8ba7-080de7707e49 req-83da33d7-9e6c-4bf1-abd6-2ff6d1a9ea4d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:56.449804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e6137716-4d0a-45e8-8ba7-080de7707e49 req-83da33d7-9e6c-4bf1-abd6-2ff6d1a9ea4d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:56.459393 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3794ff0-6c78-4cc3-a89a-91c1c641916d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:56.481464 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3794ff0-6c78-4cc3-a89a-91c1c641916d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:56.483987 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-e6137716-4d0a-45e8-8ba7-080de7707e49 req-83da33d7-9e6c-4bf1-abd6-2ff6d1a9ea4d service nova] Creating event network-vif-plugged:c2c6e375-3bea-4129-8d43-ce121d323d31 for instance e8b5f22f-b68b-4533-8bbf-a94da6b3f872 on n-h1-848886-15 Jul 25 13:00:56.504178 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-e6137716-4d0a-45e8-8ba7-080de7707e49 req-83da33d7-9e6c-4bf1-abd6-2ff6d1a9ea4d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083806 Jul 25 13:00:56.505263 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1980/4052] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:00:56.517792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-19de9cec-4bcb-400c-8591-76ad529fc936 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:56.521008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-19de9cec-4bcb-400c-8591-76ad529fc936 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:56.532113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19de9cec-4bcb-400c-8591-76ad529fc936 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:56.573061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19de9cec-4bcb-400c-8591-76ad529fc936 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:56.574241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19de9cec-4bcb-400c-8591-76ad529fc936 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:56.574884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19de9cec-4bcb-400c-8591-76ad529fc936 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:57.063081 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-19de9cec-4bcb-400c-8591-76ad529fc936 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:57.079005 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-19de9cec-4bcb-400c-8591-76ad529fc936 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1692 microversion: 2.1 time: 0.566917 Jul 25 13:00:57.095928 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1981/4053] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:56 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1692 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:57.106872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a3794ff0-6c78-4cc3-a89a-91c1c641916d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:57.125179 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a3794ff0-6c78-4cc3-a89a-91c1c641916d tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.730482 Jul 25 13:00:57.126962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c40e1577-b7e6-468a-b0c9-95b624bc8102 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:57.147544 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c40e1577-b7e6-468a-b0c9-95b624bc8102 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:57.148155 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2073/4054] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:56 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:57.171151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6e1bff49-c64a-4e33-8025-676053dd735a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:57.176427 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6e1bff49-c64a-4e33-8025-676053dd735a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:57.178523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c40e1577-b7e6-468a-b0c9-95b624bc8102 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:57.181676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c40e1577-b7e6-468a-b0c9-95b624bc8102 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:57.183939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c40e1577-b7e6-468a-b0c9-95b624bc8102 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:57.188676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c40e1577-b7e6-468a-b0c9-95b624bc8102 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:57.198724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e1bff49-c64a-4e33-8025-676053dd735a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:57.199930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e1bff49-c64a-4e33-8025-676053dd735a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:57.201359 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e1bff49-c64a-4e33-8025-676053dd735a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:57.202373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e1bff49-c64a-4e33-8025-676053dd735a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:57.308766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-6e1bff49-c64a-4e33-8025-676053dd735a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lazy-loading 'flavor' on Instance uuid b730aecb-2c1f-46ef-b457-8a3717655518 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:00:57.315383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:00:57.444808 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c40e1577-b7e6-468a-b0c9-95b624bc8102 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:57.462874 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c40e1577-b7e6-468a-b0c9-95b624bc8102 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb" status: 200 len: 1298 microversion: 2.1 time: 0.362210 Jul 25 13:00:57.465567 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1982/4055] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:57 2022] GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb => generated 1298 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:57.474198 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6e1bff49-c64a-4e33-8025-676053dd735a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action" status: 202 len: 0 microversion: 2.1 time: 0.311636 Jul 25 13:00:57.483876 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2074/4056] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:00:57 2022] POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:00:57.492445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3dd3f20e-5157-4a98-bda0-74e807df8dbe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:57.493993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3dd3f20e-5157-4a98-bda0-74e807df8dbe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:57.512187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-959d0fe5-4f94-40a5-a664-0e50a0e71203 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:57.516281 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-959d0fe5-4f94-40a5-a664-0e50a0e71203 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e0726aaf-f183-465c-ac33-313fd7858542] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:57.526283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3dd3f20e-5157-4a98-bda0-74e807df8dbe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:57.533181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3dd3f20e-5157-4a98-bda0-74e807df8dbe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:57.536717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3dd3f20e-5157-4a98-bda0-74e807df8dbe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:57.538266 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3dd3f20e-5157-4a98-bda0-74e807df8dbe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:57.549611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-959d0fe5-4f94-40a5-a664-0e50a0e71203 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:57.550674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-959d0fe5-4f94-40a5-a664-0e50a0e71203 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:57.560303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-959d0fe5-4f94-40a5-a664-0e50a0e71203 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:57.564304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-959d0fe5-4f94-40a5-a664-0e50a0e71203 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:58.300900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-959d0fe5-4f94-40a5-a664-0e50a0e71203 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:58.316373 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-959d0fe5-4f94-40a5-a664-0e50a0e71203 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542" status: 200 len: 1321 microversion: 2.1 time: 0.830325 Jul 25 13:00:58.330253 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2075/4057] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:57 2022] GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542 => generated 1321 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:58.353271 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-831633db-e490-4ec7-8e4c-e169ab541d81 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:58.370703 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-831633db-e490-4ec7-8e4c-e169ab541d81 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:58.389641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-831633db-e490-4ec7-8e4c-e169ab541d81 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:58.394127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-831633db-e490-4ec7-8e4c-e169ab541d81 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:58.401550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-831633db-e490-4ec7-8e4c-e169ab541d81 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:58.402975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-831633db-e490-4ec7-8e4c-e169ab541d81 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:58.583052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3dd3f20e-5157-4a98-bda0-74e807df8dbe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:58.597189 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3dd3f20e-5157-4a98-bda0-74e807df8dbe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1527 microversion: 2.1 time: 1.128892 Jul 25 13:00:58.613124 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1983/4058] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:57 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1527 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:58.618492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-36104b40-33af-4987-b241-8ceff4e83d96 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:58.619121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-36104b40-33af-4987-b241-8ceff4e83d96 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:58.651838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36104b40-33af-4987-b241-8ceff4e83d96 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:58.657674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36104b40-33af-4987-b241-8ceff4e83d96 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:58.658860 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36104b40-33af-4987-b241-8ceff4e83d96 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:58.659551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36104b40-33af-4987-b241-8ceff4e83d96 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:58.957544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-831633db-e490-4ec7-8e4c-e169ab541d81 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:58.972605 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-831633db-e490-4ec7-8e4c-e169ab541d81 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1677 microversion: 2.1 time: 0.640832 Jul 25 13:00:58.973563 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2076/4059] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:58 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1677 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:58.990003 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c1da1ac7-fbe6-40b6-9f4f-c35974b73554 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:58.991031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c1da1ac7-fbe6-40b6-9f4f-c35974b73554 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:59.000556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1da1ac7-fbe6-40b6-9f4f-c35974b73554 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:59.005411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1da1ac7-fbe6-40b6-9f4f-c35974b73554 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:59.010156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1da1ac7-fbe6-40b6-9f4f-c35974b73554 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:59.011491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1da1ac7-fbe6-40b6-9f4f-c35974b73554 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:59.049567 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-36104b40-33af-4987-b241-8ceff4e83d96 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:59.051860 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:00:59.093714 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-36104b40-33af-4987-b241-8ceff4e83d96 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1692 microversion: 2.1 time: 0.479131 Jul 25 13:00:59.099393 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1984/4060] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:58 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1692 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:59.121539 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-fcaaf75f-f91a-4458-b28d-1e4da526a609 req-80aee09f-723e-4b5a-82e4-fc18544435d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0726aaf-f183-465c-ac33-313fd7858542", "name": "network-vif-plugged", "status": "completed", "tag": "76f58bf7-d942-480a-a6c7-6057d2be96f8"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:59.170527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fcaaf75f-f91a-4458-b28d-1e4da526a609 req-80aee09f-723e-4b5a-82e4-fc18544435d5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:59.170527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fcaaf75f-f91a-4458-b28d-1e4da526a609 req-80aee09f-723e-4b5a-82e4-fc18544435d5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:59.236280 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-fcaaf75f-f91a-4458-b28d-1e4da526a609 req-80aee09f-723e-4b5a-82e4-fc18544435d5 service nova] Creating event network-vif-plugged:76f58bf7-d942-480a-a6c7-6057d2be96f8 for instance e0726aaf-f183-465c-ac33-313fd7858542 on n-h2-848886-15 Jul 25 13:00:59.267069 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-fcaaf75f-f91a-4458-b28d-1e4da526a609 req-80aee09f-723e-4b5a-82e4-fc18544435d5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156403 Jul 25 13:00:59.268193 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1985/4061] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:00:59.302502 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c1da1ac7-fbe6-40b6-9f4f-c35974b73554 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:59.316460 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c1da1ac7-fbe6-40b6-9f4f-c35974b73554 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb" status: 200 len: 1298 microversion: 2.1 time: 0.341630 Jul 25 13:00:59.342185 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2077/4062] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:58 2022] GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb => generated 1298 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:59.343570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bf86c146-598d-40a4-8dbc-cec2e69287d5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:59.344288 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bf86c146-598d-40a4-8dbc-cec2e69287d5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e0726aaf-f183-465c-ac33-313fd7858542] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:59.370580 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf86c146-598d-40a4-8dbc-cec2e69287d5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:59.371065 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf86c146-598d-40a4-8dbc-cec2e69287d5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:59.371991 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf86c146-598d-40a4-8dbc-cec2e69287d5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:59.372380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf86c146-598d-40a4-8dbc-cec2e69287d5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:59.622175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6ae00745-9696-4094-9402-201f8349cee7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:59.622711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6ae00745-9696-4094-9402-201f8349cee7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:59.636842 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ae00745-9696-4094-9402-201f8349cee7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:59.637278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ae00745-9696-4094-9402-201f8349cee7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:59.638097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ae00745-9696-4094-9402-201f8349cee7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:59.641183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ae00745-9696-4094-9402-201f8349cee7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:00.586817 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bf86c146-598d-40a4-8dbc-cec2e69287d5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:00.600459 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bf86c146-598d-40a4-8dbc-cec2e69287d5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542" status: 200 len: 1321 microversion: 2.1 time: 1.261411 Jul 25 13:01:00.601072 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1986/4063] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:59 2022] GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542 => generated 1321 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:00.619796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-13309717-c3dd-4901-af08-64fdf4d69020 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:00.621265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-13309717-c3dd-4901-af08-64fdf4d69020 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:00.638876 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13309717-c3dd-4901-af08-64fdf4d69020 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:00.639357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13309717-c3dd-4901-af08-64fdf4d69020 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:00.641114 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13309717-c3dd-4901-af08-64fdf4d69020 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:00.642575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13309717-c3dd-4901-af08-64fdf4d69020 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:00.675195 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6ae00745-9696-4094-9402-201f8349cee7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:00.683340 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6ae00745-9696-4094-9402-201f8349cee7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1527 microversion: 2.1 time: 1.065678 Jul 25 13:01:00.694111 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2078/4064] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:59 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1527 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:00.694111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-63257263-41ac-4d19-9fd6-a36df3fe3bac tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:00.694111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-63257263-41ac-4d19-9fd6-a36df3fe3bac tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:00.710731 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-63257263-41ac-4d19-9fd6-a36df3fe3bac tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:00.711188 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-63257263-41ac-4d19-9fd6-a36df3fe3bac tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:00.718989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-63257263-41ac-4d19-9fd6-a36df3fe3bac tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:00.719558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-63257263-41ac-4d19-9fd6-a36df3fe3bac tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:00.967627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-13309717-c3dd-4901-af08-64fdf4d69020 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:00.978252 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-13309717-c3dd-4901-af08-64fdf4d69020 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1660 microversion: 2.1 time: 0.376092 Jul 25 13:01:00.994374 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1987/4065] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:00 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1660 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:01.003518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-addd4a02-e3c4-486f-b8bb-e1d88d7bbe71 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:01.004597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-addd4a02-e3c4-486f-b8bb-e1d88d7bbe71 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:01.012068 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-addd4a02-e3c4-486f-b8bb-e1d88d7bbe71 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:01.012861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-addd4a02-e3c4-486f-b8bb-e1d88d7bbe71 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:01.014614 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-addd4a02-e3c4-486f-b8bb-e1d88d7bbe71 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:01.015265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-addd4a02-e3c4-486f-b8bb-e1d88d7bbe71 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:01.308434 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-63257263-41ac-4d19-9fd6-a36df3fe3bac tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:01.321047 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-63257263-41ac-4d19-9fd6-a36df3fe3bac tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1697 microversion: 2.1 time: 0.631591 Jul 25 13:01:01.322332 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2079/4066] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:00 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1697 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:01.331444 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-133f5c80-283b-48fc-8a64-28ec5b6122a1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:01.334665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-133f5c80-283b-48fc-8a64-28ec5b6122a1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:01.351758 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-133f5c80-283b-48fc-8a64-28ec5b6122a1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:01.352681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-133f5c80-283b-48fc-8a64-28ec5b6122a1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:01.362342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-133f5c80-283b-48fc-8a64-28ec5b6122a1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:01.366029 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-133f5c80-283b-48fc-8a64-28ec5b6122a1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:01.390592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-addd4a02-e3c4-486f-b8bb-e1d88d7bbe71 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:01.400308 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-addd4a02-e3c4-486f-b8bb-e1d88d7bbe71 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb" status: 200 len: 1298 microversion: 2.1 time: 0.404387 Jul 25 13:01:01.404451 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1988/4067] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:00 2022] GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb => generated 1298 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:01.411664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-7b2ee878-23fc-4fac-954d-8055821efd16 req-55e31a5f-85b8-4303-9c2a-7e84e1f23399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb", "tag": "f8f71024-db00-4bd6-a3d5-51d3d0ef25a1"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:01.438933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-7b2ee878-23fc-4fac-954d-8055821efd16 req-55e31a5f-85b8-4303-9c2a-7e84e1f23399 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:01.439399 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-7b2ee878-23fc-4fac-954d-8055821efd16 req-55e31a5f-85b8-4303-9c2a-7e84e1f23399 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:01.482970 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-7b2ee878-23fc-4fac-954d-8055821efd16 req-55e31a5f-85b8-4303-9c2a-7e84e1f23399 service nova] Creating event network-changed:f8f71024-db00-4bd6-a3d5-51d3d0ef25a1 for instance 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb on n-h1-848886-15 Jul 25 13:01:01.519276 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-7b2ee878-23fc-4fac-954d-8055821efd16 req-55e31a5f-85b8-4303-9c2a-7e84e1f23399 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111710 Jul 25 13:01:01.522347 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1989/4068] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:01:01.525035 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-133f5c80-283b-48fc-8a64-28ec5b6122a1 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action" status: 202 len: 0 microversion: 2.1 time: 0.199697 Jul 25 13:01:01.525698 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2080/4069] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:01:01 2022] POST /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:01:01.532845 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:01.545880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e1681ca1-1104-4568-9a87-c62d565eba4a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:01.550565 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e1681ca1-1104-4568-9a87-c62d565eba4a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:01.582200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1681ca1-1104-4568-9a87-c62d565eba4a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:01.597143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1681ca1-1104-4568-9a87-c62d565eba4a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:01.600472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1681ca1-1104-4568-9a87-c62d565eba4a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:01.606692 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1681ca1-1104-4568-9a87-c62d565eba4a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:01.626188 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ccdd0436-b3a4-4b65-84e9-a3f97d5c870c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:01.628068 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ccdd0436-b3a4-4b65-84e9-a3f97d5c870c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e0726aaf-f183-465c-ac33-313fd7858542] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:01.665681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccdd0436-b3a4-4b65-84e9-a3f97d5c870c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:01.666513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccdd0436-b3a4-4b65-84e9-a3f97d5c870c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:01.670801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccdd0436-b3a4-4b65-84e9-a3f97d5c870c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:01.670801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccdd0436-b3a4-4b65-84e9-a3f97d5c870c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:02.260971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e1681ca1-1104-4568-9a87-c62d565eba4a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:02.293397 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e1681ca1-1104-4568-9a87-c62d565eba4a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1666 microversion: 2.1 time: 0.760864 Jul 25 13:01:02.295886 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1990/4070] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:01 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1666 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:02.303861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aa2881f9-941e-4e40-9ac4-98082c4d9945 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:02.304822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-aa2881f9-941e-4e40-9ac4-98082c4d9945 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:02.311510 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa2881f9-941e-4e40-9ac4-98082c4d9945 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:02.312253 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa2881f9-941e-4e40-9ac4-98082c4d9945 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:02.313163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa2881f9-941e-4e40-9ac4-98082c4d9945 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:02.313490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa2881f9-941e-4e40-9ac4-98082c4d9945 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:02.329580 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ccdd0436-b3a4-4b65-84e9-a3f97d5c870c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:02.340554 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ccdd0436-b3a4-4b65-84e9-a3f97d5c870c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542" status: 200 len: 1511 microversion: 2.1 time: 0.719513 Jul 25 13:01:02.349876 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2081/4071] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:01 2022] GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542 => generated 1511 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:02.349876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a7d7d608-8fd0-42c1-b472-5d93094be4cd tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:02.349876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a7d7d608-8fd0-42c1-b472-5d93094be4cd tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:02.353342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:02.355877 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7d7d608-8fd0-42c1-b472-5d93094be4cd tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:02.356556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7d7d608-8fd0-42c1-b472-5d93094be4cd tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:02.357554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7d7d608-8fd0-42c1-b472-5d93094be4cd tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:02.358408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7d7d608-8fd0-42c1-b472-5d93094be4cd tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:02.709696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a7d7d608-8fd0-42c1-b472-5d93094be4cd tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:02.727620 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a7d7d608-8fd0-42c1-b472-5d93094be4cd tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1697 microversion: 2.1 time: 0.381942 Jul 25 13:01:02.734569 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2082/4072] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:02 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1697 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:02.739843 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-30973118-6d8f-49ce-b40a-a74a10ed2b97 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:02.742635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-30973118-6d8f-49ce-b40a-a74a10ed2b97 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:02.752925 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-aa2881f9-941e-4e40-9ac4-98082c4d9945 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:02.764581 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-30973118-6d8f-49ce-b40a-a74a10ed2b97 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:02.768574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-30973118-6d8f-49ce-b40a-a74a10ed2b97 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:02.769976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-30973118-6d8f-49ce-b40a-a74a10ed2b97 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:02.770657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-30973118-6d8f-49ce-b40a-a74a10ed2b97 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:02.770802 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aa2881f9-941e-4e40-9ac4-98082c4d9945 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1527 microversion: 2.1 time: 0.471308 Jul 25 13:01:02.771322 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1991/4073] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:02 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1527 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:02.784987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b2d43db8-eba2-4fd6-9af0-550f5c2c50d1 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:02.785690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b2d43db8-eba2-4fd6-9af0-550f5c2c50d1 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:02.809267 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b2d43db8-eba2-4fd6-9af0-550f5c2c50d1 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:02.809728 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b2d43db8-eba2-4fd6-9af0-550f5c2c50d1 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:02.811696 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b2d43db8-eba2-4fd6-9af0-550f5c2c50d1 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:02.812153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b2d43db8-eba2-4fd6-9af0-550f5c2c50d1 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:03.039640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b2d43db8-eba2-4fd6-9af0-550f5c2c50d1 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:03.052196 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b2d43db8-eba2-4fd6-9af0-550f5c2c50d1 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb" status: 200 len: 1298 microversion: 2.1 time: 0.276435 Jul 25 13:01:03.053878 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1992/4074] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:02 2022] GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb => generated 1298 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:03.113814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-30973118-6d8f-49ce-b40a-a74a10ed2b97 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:03.124263 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-30973118-6d8f-49ce-b40a-a74a10ed2b97 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002" status: 200 len: 1510 microversion: 2.1 time: 0.387831 Jul 25 13:01:03.128002 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2083/4075] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:02 2022] GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002 => generated 1510 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:03.148346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9add7967-bf68-49b3-89f0-26a5430729c0 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:03.149001 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9add7967-bf68-49b3-89f0-26a5430729c0 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e8b5f22f-b68b-4533-8bbf-a94da6b3f872] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:03.156327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9add7967-bf68-49b3-89f0-26a5430729c0 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:03.158086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9add7967-bf68-49b3-89f0-26a5430729c0 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:03.159176 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9add7967-bf68-49b3-89f0-26a5430729c0 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:03.159877 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9add7967-bf68-49b3-89f0-26a5430729c0 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:03.160665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=8 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:03.316491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-05a0d86b-3f46-4a61-88f7-e36cdd9f3c7e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:03.317407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-05a0d86b-3f46-4a61-88f7-e36cdd9f3c7e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:03.325310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05a0d86b-3f46-4a61-88f7-e36cdd9f3c7e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:03.326172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05a0d86b-3f46-4a61-88f7-e36cdd9f3c7e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:03.327356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05a0d86b-3f46-4a61-88f7-e36cdd9f3c7e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:03.328010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05a0d86b-3f46-4a61-88f7-e36cdd9f3c7e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:03.386482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9add7967-bf68-49b3-89f0-26a5430729c0 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:03.405460 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9add7967-bf68-49b3-89f0-26a5430729c0 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e8b5f22f-b68b-4533-8bbf-a94da6b3f872" status: 200 len: 1510 microversion: 2.1 time: 0.258771 Jul 25 13:01:03.407033 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1993/4076] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:03 2022] GET /compute/v2.1/servers/e8b5f22f-b68b-4533-8bbf-a94da6b3f872 => generated 1510 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:03.427334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6a6abf3a-1d33-4fd4-9c3e-51db0953f9e9 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:03.436293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6a6abf3a-1d33-4fd4-9c3e-51db0953f9e9 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:03.439445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6a6abf3a-1d33-4fd4-9c3e-51db0953f9e9 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '247832dc5b24483c82cddea22f81d2db'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:01:03.474783 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a6abf3a-1d33-4fd4-9c3e-51db0953f9e9 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:03.475750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a6abf3a-1d33-4fd4-9c3e-51db0953f9e9 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:03.477001 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a6abf3a-1d33-4fd4-9c3e-51db0953f9e9 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:03.477670 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a6abf3a-1d33-4fd4-9c3e-51db0953f9e9 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:03.625554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-05a0d86b-3f46-4a61-88f7-e36cdd9f3c7e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:03.640555 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-05a0d86b-3f46-4a61-88f7-e36cdd9f3c7e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1666 microversion: 2.1 time: 0.327733 Jul 25 13:01:03.649882 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2084/4077] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:03 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1666 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:03.707449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-6a6abf3a-1d33-4fd4-9c3e-51db0953f9e9 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:01:03.755668 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8b9f916c-7931-4d9d-8ebc-29ad8a41d7a2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:03.757141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8b9f916c-7931-4d9d-8ebc-29ad8a41d7a2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:03.767643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b9f916c-7931-4d9d-8ebc-29ad8a41d7a2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:03.770563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b9f916c-7931-4d9d-8ebc-29ad8a41d7a2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:03.772325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b9f916c-7931-4d9d-8ebc-29ad8a41d7a2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:03.773034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b9f916c-7931-4d9d-8ebc-29ad8a41d7a2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:03.831380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6a6abf3a-1d33-4fd4-9c3e-51db0953f9e9 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:03.838624 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a6abf3a-1d33-4fd4-9c3e-51db0953f9e9 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:03.839086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a6abf3a-1d33-4fd4-9c3e-51db0953f9e9 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:04.225699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8b9f916c-7931-4d9d-8ebc-29ad8a41d7a2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:04.246424 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8b9f916c-7931-4d9d-8ebc-29ad8a41d7a2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1697 microversion: 2.1 time: 0.482290 Jul 25 13:01:04.247693 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2085/4078] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:03 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1697 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:04.252991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2bbb9e6e-22ad-4450-90af-5265b8020a79 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:04.254769 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2bbb9e6e-22ad-4450-90af-5265b8020a79 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:04.275136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2bbb9e6e-22ad-4450-90af-5265b8020a79 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:04.277104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2bbb9e6e-22ad-4450-90af-5265b8020a79 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:04.281242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2bbb9e6e-22ad-4450-90af-5265b8020a79 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:04.281728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2bbb9e6e-22ad-4450-90af-5265b8020a79 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:04.325340 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6a6abf3a-1d33-4fd4-9c3e-51db0953f9e9 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.901904 Jul 25 13:01:04.341521 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1994/4079] 10.222.0.49 () {58 vars in 1167 bytes} [Mon Jul 25 13:01:03 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:04.350185 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7cb1e2c6-70ae-45b3-91e4-379ad98aa28e tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:04.351818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7cb1e2c6-70ae-45b3-91e4-379ad98aa28e tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:04.360210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7cb1e2c6-70ae-45b3-91e4-379ad98aa28e tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:04.361044 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7cb1e2c6-70ae-45b3-91e4-379ad98aa28e tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:04.362151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7cb1e2c6-70ae-45b3-91e4-379ad98aa28e tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:04.362844 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7cb1e2c6-70ae-45b3-91e4-379ad98aa28e tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:04.737624 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7cb1e2c6-70ae-45b3-91e4-379ad98aa28e tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:04.754953 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7cb1e2c6-70ae-45b3-91e4-379ad98aa28e tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb" status: 200 len: 1298 microversion: 2.1 time: 0.409786 Jul 25 13:01:04.756092 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1995/4080] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:04 2022] GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb => generated 1298 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:04.779451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f7142fd7-d17a-48a5-ab5d-4d1b8f041aa5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:04.786927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f7142fd7-d17a-48a5-ab5d-4d1b8f041aa5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:04.787958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f7142fd7-d17a-48a5-ab5d-4d1b8f041aa5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-743679323', 'deleted': False, 'project_id': '247832dc5b24483c82cddea22f81d2db'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:01:04.794428 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7142fd7-d17a-48a5-ab5d-4d1b8f041aa5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:04.795117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7142fd7-d17a-48a5-ab5d-4d1b8f041aa5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:04.796157 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7142fd7-d17a-48a5-ab5d-4d1b8f041aa5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:04.798501 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7142fd7-d17a-48a5-ab5d-4d1b8f041aa5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:04.803424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2bbb9e6e-22ad-4450-90af-5265b8020a79 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:04.823159 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2bbb9e6e-22ad-4450-90af-5265b8020a79 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1527 microversion: 2.1 time: 0.574189 Jul 25 13:01:04.845443 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2086/4081] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:04 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1527 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:04.853638 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3554659b-382a-44a4-8120-db9d8dd51903 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:04.861527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3554659b-382a-44a4-8120-db9d8dd51903 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:04.875847 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3554659b-382a-44a4-8120-db9d8dd51903 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:04.886914 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3554659b-382a-44a4-8120-db9d8dd51903 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:04.888603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3554659b-382a-44a4-8120-db9d8dd51903 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:04.889556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3554659b-382a-44a4-8120-db9d8dd51903 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:05.042807 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-f7142fd7-d17a-48a5-ab5d-4d1b8f041aa5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:01:05.194419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f7142fd7-d17a-48a5-ab5d-4d1b8f041aa5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:05.202007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7142fd7-d17a-48a5-ab5d-4d1b8f041aa5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:05.202466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7142fd7-d17a-48a5-ab5d-4d1b8f041aa5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:05.421301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3554659b-382a-44a4-8120-db9d8dd51903 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:05.447075 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3554659b-382a-44a4-8120-db9d8dd51903 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1666 microversion: 2.1 time: 0.598495 Jul 25 13:01:05.452876 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2087/4082] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:04 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1666 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:05.473610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5ff5bbcb-66ec-4da2-81b3-d290d045c9b9 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:05.477915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5ff5bbcb-66ec-4da2-81b3-d290d045c9b9 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:05.496927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5ff5bbcb-66ec-4da2-81b3-d290d045c9b9 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:05.498342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5ff5bbcb-66ec-4da2-81b3-d290d045c9b9 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:05.499460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5ff5bbcb-66ec-4da2-81b3-d290d045c9b9 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:05.508666 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f7142fd7-d17a-48a5-ab5d-4d1b8f041aa5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-743679323" status: 200 len: 1513 microversion: 2.1 time: 0.736434 Jul 25 13:01:05.509279 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1996/4083] 10.222.0.49 () {58 vars in 1261 bytes} [Mon Jul 25 13:01:04 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-743679323 => generated 1513 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:05.515981 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5ff5bbcb-66ec-4da2-81b3-d290d045c9b9 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:05.543308 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3d47385b-f9b3-4e3b-be90-2a4271e30057 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:05.548648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3d47385b-f9b3-4e3b-be90-2a4271e30057 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:05.550712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3d47385b-f9b3-4e3b-be90-2a4271e30057 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '247832dc5b24483c82cddea22f81d2db'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:01:05.574559 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3d47385b-f9b3-4e3b-be90-2a4271e30057 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:05.580626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3d47385b-f9b3-4e3b-be90-2a4271e30057 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:05.583151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3d47385b-f9b3-4e3b-be90-2a4271e30057 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:05.586832 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3d47385b-f9b3-4e3b-be90-2a4271e30057 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:05.868056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-3d47385b-f9b3-4e3b-be90-2a4271e30057 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:01:06.063799 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3d47385b-f9b3-4e3b-be90-2a4271e30057 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:06.098987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3d47385b-f9b3-4e3b-be90-2a4271e30057 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:06.099534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3d47385b-f9b3-4e3b-be90-2a4271e30057 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:06.204351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5ff5bbcb-66ec-4da2-81b3-d290d045c9b9 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:06.212377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:06.220955 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5ff5bbcb-66ec-4da2-81b3-d290d045c9b9 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1697 microversion: 2.1 time: 0.760122 Jul 25 13:01:06.222688 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2088/4084] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:05 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1697 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:06.235039 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-41fabec5-f456-4cd8-a475-023d44e79302 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:06.237284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-41fabec5-f456-4cd8-a475-023d44e79302 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:06.252311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-41fabec5-f456-4cd8-a475-023d44e79302 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:06.252777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-41fabec5-f456-4cd8-a475-023d44e79302 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:06.255442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-41fabec5-f456-4cd8-a475-023d44e79302 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:06.255907 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-41fabec5-f456-4cd8-a475-023d44e79302 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:06.533302 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-41fabec5-f456-4cd8-a475-023d44e79302 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:06.569390 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-41fabec5-f456-4cd8-a475-023d44e79302 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb" status: 200 len: 1298 microversion: 2.1 time: 0.336320 Jul 25 13:01:06.572243 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2089/4085] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:06 2022] GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb => generated 1298 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:06.598533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d26ec0d4-4766-4527-a0c1-b1fad1a5698f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:06.599524 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d26ec0d4-4766-4527-a0c1-b1fad1a5698f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:06.611719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d26ec0d4-4766-4527-a0c1-b1fad1a5698f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:06.612613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d26ec0d4-4766-4527-a0c1-b1fad1a5698f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:06.614179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d26ec0d4-4766-4527-a0c1-b1fad1a5698f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:06.614658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d26ec0d4-4766-4527-a0c1-b1fad1a5698f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:06.619691 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3d47385b-f9b3-4e3b-be90-2a4271e30057 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4514 microversion: 2.1 time: 1.086849 Jul 25 13:01:06.621982 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1997/4086] 10.222.0.49 () {58 vars in 1173 bytes} [Mon Jul 25 13:01:05 2022] GET /compute/v2.1/servers/detail?status=active => generated 4514 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:06.627421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-50a0f583-b1e1-4b39-b660-6f04701f6f31 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:06.629804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-50a0f583-b1e1-4b39-b660-6f04701f6f31 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:06.661866 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50a0f583-b1e1-4b39-b660-6f04701f6f31 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:06.662330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50a0f583-b1e1-4b39-b660-6f04701f6f31 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:06.664630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50a0f583-b1e1-4b39-b660-6f04701f6f31 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:06.670628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50a0f583-b1e1-4b39-b660-6f04701f6f31 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:07.006790 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d26ec0d4-4766-4527-a0c1-b1fad1a5698f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:07.019944 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d26ec0d4-4766-4527-a0c1-b1fad1a5698f tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1527 microversion: 2.1 time: 0.445190 Jul 25 13:01:07.033263 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2090/4087] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:06 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1527 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:07.034226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-50a0f583-b1e1-4b39-b660-6f04701f6f31 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:07.037201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-32e82aea-0ac0-4531-b885-409dab435c5b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:07.046484 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-50a0f583-b1e1-4b39-b660-6f04701f6f31 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.422827 Jul 25 13:01:07.048330 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1998/4088] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:06 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:07.051721 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-32e82aea-0ac0-4531-b885-409dab435c5b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:07.052194 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.compute.servers [None req-32e82aea-0ac0-4531-b885-409dab435c5b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Removing options 'limit' from query {{(pid=125884) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 25 13:01:07.053094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-32e82aea-0ac0-4531-b885-409dab435c5b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Searching by: {'deleted': False, 'project_id': '247832dc5b24483c82cddea22f81d2db'} {{(pid=125884) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:01:07.061449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32e82aea-0ac0-4531-b885-409dab435c5b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:07.061936 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32e82aea-0ac0-4531-b885-409dab435c5b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:07.062792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32e82aea-0ac0-4531-b885-409dab435c5b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:07.063235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32e82aea-0ac0-4531-b885-409dab435c5b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:07.090974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6fa166aa-5ba8-4c35-b7af-24d9459edc64 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:07.091668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6fa166aa-5ba8-4c35-b7af-24d9459edc64 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:07.098749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6fa166aa-5ba8-4c35-b7af-24d9459edc64 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:07.099380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6fa166aa-5ba8-4c35-b7af-24d9459edc64 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:07.100188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6fa166aa-5ba8-4c35-b7af-24d9459edc64 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:07.100632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6fa166aa-5ba8-4c35-b7af-24d9459edc64 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:07.208811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-32e82aea-0ac0-4531-b885-409dab435c5b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:07.217001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32e82aea-0ac0-4531-b885-409dab435c5b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:07.217739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32e82aea-0ac0-4531-b885-409dab435c5b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:07.452388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6fa166aa-5ba8-4c35-b7af-24d9459edc64 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:07.467608 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6fa166aa-5ba8-4c35-b7af-24d9459edc64 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1669 microversion: 2.1 time: 0.382910 Jul 25 13:01:07.488861 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 1999/4089] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:07 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1669 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:07.503106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b9960e10-b4c6-4e77-846f-095c3066fdb7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:07.506738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b9960e10-b4c6-4e77-846f-095c3066fdb7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:07.525009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b9960e10-b4c6-4e77-846f-095c3066fdb7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:07.525469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b9960e10-b4c6-4e77-846f-095c3066fdb7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:07.526345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b9960e10-b4c6-4e77-846f-095c3066fdb7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:07.526790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b9960e10-b4c6-4e77-846f-095c3066fdb7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:07.557759 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-32e82aea-0ac0-4531-b885-409dab435c5b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.534793 Jul 25 13:01:07.558813 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2091/4090] 10.222.0.49 () {58 vars in 1161 bytes} [Mon Jul 25 13:01:07 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:07.564476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-40218409-d17a-4154-8b7c-7dd529ac818b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:07.564985 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-40218409-d17a-4154-8b7c-7dd529ac818b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:07.583379 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40218409-d17a-4154-8b7c-7dd529ac818b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:07.583957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40218409-d17a-4154-8b7c-7dd529ac818b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:07.584815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40218409-d17a-4154-8b7c-7dd529ac818b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:07.585257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40218409-d17a-4154-8b7c-7dd529ac818b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:07.706246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-40218409-d17a-4154-8b7c-7dd529ac818b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:01:07.723098 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.compute.api [None req-40218409-d17a-4154-8b7c-7dd529ac818b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Working on deleting snapshot 530faa00-a4eb-467f-b7ad-87ff78b7f825 from shelved instance... Jul 25 13:01:07.793107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b9960e10-b4c6-4e77-846f-095c3066fdb7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:07.796695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:07.815142 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b9960e10-b4c6-4e77-846f-095c3066fdb7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1697 microversion: 2.1 time: 0.318134 Jul 25 13:01:07.830732 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2000/4091] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:07 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1697 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:07.838309 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9c1d0c46-9001-4e78-9265-4d66e788c806 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:07.861687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9c1d0c46-9001-4e78-9265-4d66e788c806 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:07.862734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9c1d0c46-9001-4e78-9265-4d66e788c806 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '247832dc5b24483c82cddea22f81d2db'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:01:07.883251 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:07.885051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c1d0c46-9001-4e78-9265-4d66e788c806 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:07.885511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c1d0c46-9001-4e78-9265-4d66e788c806 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:07.888096 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c1d0c46-9001-4e78-9265-4d66e788c806 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:07.888553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c1d0c46-9001-4e78-9265-4d66e788c806 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:08.143275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-9c1d0c46-9001-4e78-9265-4d66e788c806 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:01:08.225458 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9c1d0c46-9001-4e78-9265-4d66e788c806 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.391222 Jul 25 13:01:08.226564 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2001/4092] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 13:01:07 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:08.233574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-903f4447-9ac5-41c5-be2d-e995d3a72ade tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:08.233574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-903f4447-9ac5-41c5-be2d-e995d3a72ade tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:08.240616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-903f4447-9ac5-41c5-be2d-e995d3a72ade tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:08.241185 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-903f4447-9ac5-41c5-be2d-e995d3a72ade tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:08.242222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-903f4447-9ac5-41c5-be2d-e995d3a72ade tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:08.243386 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-903f4447-9ac5-41c5-be2d-e995d3a72ade tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:08.468164 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-903f4447-9ac5-41c5-be2d-e995d3a72ade tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:08.483651 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-903f4447-9ac5-41c5-be2d-e995d3a72ade tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb" status: 200 len: 1298 microversion: 2.1 time: 0.250900 Jul 25 13:01:08.484483 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2002/4093] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:08 2022] GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb => generated 1298 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:08.492359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fd26524a-2b7a-459b-90de-a885d89f9507 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:08.493911 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fd26524a-2b7a-459b-90de-a885d89f9507 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:08.516101 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd26524a-2b7a-459b-90de-a885d89f9507 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:08.518876 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd26524a-2b7a-459b-90de-a885d89f9507 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:08.520283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd26524a-2b7a-459b-90de-a885d89f9507 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:08.521052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd26524a-2b7a-459b-90de-a885d89f9507 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:08.906420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fd26524a-2b7a-459b-90de-a885d89f9507 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:08.919751 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fd26524a-2b7a-459b-90de-a885d89f9507 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1527 microversion: 2.1 time: 0.433210 Jul 25 13:01:08.919889 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2003/4094] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:08 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1527 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:08.941290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8de2d3a0-b6eb-43ba-aa6f-d1648c4179db tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:08.948035 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8de2d3a0-b6eb-43ba-aa6f-d1648c4179db tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:08.960535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.compute.servers [None req-8de2d3a0-b6eb-43ba-aa6f-d1648c4179db tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Removing options 'limit' from query {{(pid=125883) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 25 13:01:08.965314 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8de2d3a0-b6eb-43ba-aa6f-d1648c4179db tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Searching by: {'deleted': False, 'project_id': '247832dc5b24483c82cddea22f81d2db'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:01:08.973454 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8de2d3a0-b6eb-43ba-aa6f-d1648c4179db tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:08.974055 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8de2d3a0-b6eb-43ba-aa6f-d1648c4179db tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:08.976034 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8de2d3a0-b6eb-43ba-aa6f-d1648c4179db tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:08.976629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8de2d3a0-b6eb-43ba-aa6f-d1648c4179db tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:09.053515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-8de2d3a0-b6eb-43ba-aa6f-d1648c4179db tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:01:09.124385 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8de2d3a0-b6eb-43ba-aa6f-d1648c4179db tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.194824 Jul 25 13:01:09.132211 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2004/4095] 10.222.0.49 () {58 vars in 1150 bytes} [Mon Jul 25 13:01:08 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:09.141421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-9bd074d5-83fc-40cd-84dc-0dd64011748e req-848f31f1-5b0f-4e55-af73-4d466b36f828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb", "name": "network-vif-plugged", "status": "completed", "tag": "f8f71024-db00-4bd6-a3d5-51d3d0ef25a1"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:09.169331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-9bd074d5-83fc-40cd-84dc-0dd64011748e req-848f31f1-5b0f-4e55-af73-4d466b36f828 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:09.170640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-9bd074d5-83fc-40cd-84dc-0dd64011748e req-848f31f1-5b0f-4e55-af73-4d466b36f828 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:09.196292 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-9bd074d5-83fc-40cd-84dc-0dd64011748e req-848f31f1-5b0f-4e55-af73-4d466b36f828 service nova] Creating event network-vif-plugged:f8f71024-db00-4bd6-a3d5-51d3d0ef25a1 for instance 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb on n-h1-848886-15 Jul 25 13:01:09.203844 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-9bd074d5-83fc-40cd-84dc-0dd64011748e req-848f31f1-5b0f-4e55-af73-4d466b36f828 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069916 Jul 25 13:01:09.206461 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2005/4096] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:01:09.213966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-65e7dc31-3302-4029-86e1-634bf7aa9d4e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:09.214761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-65e7dc31-3302-4029-86e1-634bf7aa9d4e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:09.224255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65e7dc31-3302-4029-86e1-634bf7aa9d4e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:09.224888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65e7dc31-3302-4029-86e1-634bf7aa9d4e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:09.225957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65e7dc31-3302-4029-86e1-634bf7aa9d4e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:09.226804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65e7dc31-3302-4029-86e1-634bf7aa9d4e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:09.259615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-40218409-d17a-4154-8b7c-7dd529ac818b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Doing local delete in cell 44375b4d-91c4-48bf-9056-56d6e14223f5(cell1) {{(pid=125884) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 25 13:01:09.261872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40218409-d17a-4154-8b7c-7dd529ac818b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:09.262621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40218409-d17a-4154-8b7c-7dd529ac818b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:09.263278 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.compute.api [None req-40218409-d17a-4154-8b7c-7dd529ac818b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 25 13:01:09.270126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-40218409-d17a-4154-8b7c-7dd529ac818b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] deallocate_for_instance() {{(pid=125884) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 25 13:01:10.195032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-65e7dc31-3302-4029-86e1-634bf7aa9d4e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:10.204033 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-65e7dc31-3302-4029-86e1-634bf7aa9d4e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1697 microversion: 2.1 time: 0.995440 Jul 25 13:01:10.217872 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2006/4097] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:09 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1697 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:10.217872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4967b4ed-e902-4fbb-b3f1-1a0ee6bf982a tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:10.217872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4967b4ed-e902-4fbb-b3f1-1a0ee6bf982a tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:10.217872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4967b4ed-e902-4fbb-b3f1-1a0ee6bf982a tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Searching by: {'deleted': False, 'project_id': '247832dc5b24483c82cddea22f81d2db'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:01:10.222094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4967b4ed-e902-4fbb-b3f1-1a0ee6bf982a tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:10.222736 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4967b4ed-e902-4fbb-b3f1-1a0ee6bf982a tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:10.223743 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4967b4ed-e902-4fbb-b3f1-1a0ee6bf982a tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:10.224330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4967b4ed-e902-4fbb-b3f1-1a0ee6bf982a tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:10.254257 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-4967b4ed-e902-4fbb-b3f1-1a0ee6bf982a tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:01:10.284832 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4967b4ed-e902-4fbb-b3f1-1a0ee6bf982a tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.078147 Jul 25 13:01:10.285934 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2007/4098] 10.222.0.49 () {58 vars in 1125 bytes} [Mon Jul 25 13:01:10 2022] GET /compute/v2.1/servers => generated 1010 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:10.291099 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-96277dac-a16c-422b-a8ca-9c1a300a0a44 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:10.291978 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-96277dac-a16c-422b-a8ca-9c1a300a0a44 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:10.298681 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-96277dac-a16c-422b-a8ca-9c1a300a0a44 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:10.299217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-96277dac-a16c-422b-a8ca-9c1a300a0a44 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:10.300050 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-96277dac-a16c-422b-a8ca-9c1a300a0a44 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:10.300692 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-96277dac-a16c-422b-a8ca-9c1a300a0a44 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:10.482185 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-96277dac-a16c-422b-a8ca-9c1a300a0a44 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:10.491922 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-96277dac-a16c-422b-a8ca-9c1a300a0a44 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb" status: 200 len: 1298 microversion: 2.1 time: 0.204511 Jul 25 13:01:10.493553 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2008/4099] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:10 2022] GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb => generated 1298 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:10.504869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bb99105e-c41d-4c4c-8656-81d96099149d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:10.506274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bb99105e-c41d-4c4c-8656-81d96099149d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:10.524817 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bb99105e-c41d-4c4c-8656-81d96099149d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:10.525363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bb99105e-c41d-4c4c-8656-81d96099149d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:10.526211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bb99105e-c41d-4c4c-8656-81d96099149d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:10.526650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bb99105e-c41d-4c4c-8656-81d96099149d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:10.756574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bb99105e-c41d-4c4c-8656-81d96099149d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:10.767468 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bb99105e-c41d-4c4c-8656-81d96099149d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1509 microversion: 2.1 time: 0.272563 Jul 25 13:01:10.768049 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2009/4100] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:10 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1509 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:10.785933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6a1a5dc6-7223-4098-8519-d3a050041024 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:10.791081 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6a1a5dc6-7223-4098-8519-d3a050041024 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:10.791931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6a1a5dc6-7223-4098-8519-d3a050041024 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '247832dc5b24483c82cddea22f81d2db'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:01:10.807988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a1a5dc6-7223-4098-8519-d3a050041024 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:10.808806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a1a5dc6-7223-4098-8519-d3a050041024 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:10.810962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a1a5dc6-7223-4098-8519-d3a050041024 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:10.811739 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a1a5dc6-7223-4098-8519-d3a050041024 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:11.017458 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-40218409-d17a-4154-8b7c-7dd529ac818b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Updating instance_info_cache with network_info: [] {{(pid=125884) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 13:01:11.033686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-6a1a5dc6-7223-4098-8519-d3a050041024 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:01:11.216511 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6a1a5dc6-7223-4098-8519-d3a050041024 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.434241 Jul 25 13:01:11.223230 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2010/4101] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 13:01:10 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:01:11.233227 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-cb495e54-03a3-491f-8a11-bf1fcfb356cb req-67f9c51c-c211-40fa-9f5b-d9164be68ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9787fc-a4e1-41f8-be82-3f68c14ad254", "name": "network-vif-deleted", "tag": "cce124d7-06ab-47f8-9713-88ca17dcee95"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:11.245107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-cb495e54-03a3-491f-8a11-bf1fcfb356cb req-67f9c51c-c211-40fa-9f5b-d9164be68ddd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:11.245604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-cb495e54-03a3-491f-8a11-bf1fcfb356cb req-67f9c51c-c211-40fa-9f5b-d9164be68ddd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:11.258382 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.compute.server_external_events [req-cb495e54-03a3-491f-8a11-bf1fcfb356cb req-67f9c51c-c211-40fa-9f5b-d9164be68ddd service nova] Unable to find a host for instance 8d9787fc-a4e1-41f8-be82-3f68c14ad254. Dropping event network-vif-deleted {{(pid=125883) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 13:01:11.259391 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-cb495e54-03a3-491f-8a11-bf1fcfb356cb req-67f9c51c-c211-40fa-9f5b-d9164be68ddd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.034832 Jul 25 13:01:11.260459 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2011/4102] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 25 13:01:11.266427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ade17577-21cb-4c2a-aeb1-a941086063c5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:11.267585 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ade17577-21cb-4c2a-aeb1-a941086063c5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:11.275250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ade17577-21cb-4c2a-aeb1-a941086063c5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:11.275717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ade17577-21cb-4c2a-aeb1-a941086063c5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:11.276671 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ade17577-21cb-4c2a-aeb1-a941086063c5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:11.277173 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ade17577-21cb-4c2a-aeb1-a941086063c5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:11.591588 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ade17577-21cb-4c2a-aeb1-a941086063c5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:11.601080 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ade17577-21cb-4c2a-aeb1-a941086063c5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1697 microversion: 2.1 time: 0.338490 Jul 25 13:01:11.601883 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2012/4103] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:11 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1697 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:11.607304 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aa8ba5c7-34cc-4eb7-b9bc-1fd4ad2ab27e tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:11.616697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-aa8ba5c7-34cc-4eb7-b9bc-1fd4ad2ab27e tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:11.617497 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.compute.servers [None req-aa8ba5c7-34cc-4eb7-b9bc-1fd4ad2ab27e tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Removing options 'limit' from query {{(pid=125883) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 25 13:01:11.618363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-aa8ba5c7-34cc-4eb7-b9bc-1fd4ad2ab27e tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Searching by: {'deleted': False, 'project_id': '247832dc5b24483c82cddea22f81d2db'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:01:11.624308 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa8ba5c7-34cc-4eb7-b9bc-1fd4ad2ab27e tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:11.624984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa8ba5c7-34cc-4eb7-b9bc-1fd4ad2ab27e tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:11.625983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa8ba5c7-34cc-4eb7-b9bc-1fd4ad2ab27e tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:11.626598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa8ba5c7-34cc-4eb7-b9bc-1fd4ad2ab27e tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:11.654737 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aa8ba5c7-34cc-4eb7-b9bc-1fd4ad2ab27e tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.051474 Jul 25 13:01:11.655899 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2013/4104] 10.222.0.49 () {58 vars in 1140 bytes} [Mon Jul 25 13:01:11 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:01:11.669821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0164a5b1-5c57-4f69-89b8-9c1312434b4f tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:11.671481 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0164a5b1-5c57-4f69-89b8-9c1312434b4f tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:11.683286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0164a5b1-5c57-4f69-89b8-9c1312434b4f tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:11.684547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0164a5b1-5c57-4f69-89b8-9c1312434b4f tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:11.685927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0164a5b1-5c57-4f69-89b8-9c1312434b4f tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:11.686558 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0164a5b1-5c57-4f69-89b8-9c1312434b4f tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:11.726813 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-40218409-d17a-4154-8b7c-7dd529ac818b tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 204 len: 0 microversion: 2.1 time: 4.166753 Jul 25 13:01:11.735461 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2092/4105] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:01:07 2022] DELETE /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 0 bytes in 4176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:01:11.754619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-18dd0a77-73f9-48bc-9684-d33af892b94d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:11.765249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-18dd0a77-73f9-48bc-9684-d33af892b94d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:11.766624 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-18dd0a77-73f9-48bc-9684-d33af892b94d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-743679323', 'deleted': False, 'project_id': '247832dc5b24483c82cddea22f81d2db'} {{(pid=125884) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:01:11.772780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-18dd0a77-73f9-48bc-9684-d33af892b94d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:11.773450 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-18dd0a77-73f9-48bc-9684-d33af892b94d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:11.774461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-18dd0a77-73f9-48bc-9684-d33af892b94d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:11.774907 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-18dd0a77-73f9-48bc-9684-d33af892b94d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:11.803073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0164a5b1-5c57-4f69-89b8-9c1312434b4f tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:11.817623 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0164a5b1-5c57-4f69-89b8-9c1312434b4f tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb" status: 200 len: 1470 microversion: 2.1 time: 0.159648 Jul 25 13:01:11.818708 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2014/4106] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:11 2022] GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:11.825216 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8ec73ae2-6dc2-4bb8-8e71-52605552d1a2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:11.826039 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8ec73ae2-6dc2-4bb8-8e71-52605552d1a2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 8d9787fc-a4e1-41f8-be82-3f68c14ad254] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:11.833964 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ec73ae2-6dc2-4bb8-8e71-52605552d1a2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:11.834780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ec73ae2-6dc2-4bb8-8e71-52605552d1a2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:11.835629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ec73ae2-6dc2-4bb8-8e71-52605552d1a2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:11.836150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ec73ae2-6dc2-4bb8-8e71-52605552d1a2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:11.857760 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-8ec73ae2-6dc2-4bb8-8e71-52605552d1a2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] HTTP exception thrown: Instance 8d9787fc-a4e1-41f8-be82-3f68c14ad254 could not be found. Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8ec73ae2-6dc2-4bb8-8e71-52605552d1a2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Request method failure captured: Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 HTTP/1.1 Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pHthUWL3emuzsBs4xsDYWyXYBkhJFaBBK9FQhgh1copL5lDP9Ma5bkE_HJxjDmond706Gp-3Rif1J8B87ZUnZtsSIpcsBH62MydK_2R5OL-M6p6aAVtQ-nWL1wmPtLFtWDAiH4ULAKYIyK232aQLG-PdxvIg00u9QiVZERdPXLac10 Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: b5abf45c9ba0419c8dec07847f3ff3c5 Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerActionsTestJSON-645693881 Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b5abf45c9ba0419c8dec07847f3ff3c5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b5abf45c9ba0419c8dec07847f3ff3c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5abf45c9ba0419c8dec07847f3ff3c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5abf45c9ba0419c8dec07847f3ff3c5"}]}] Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerActionsTestJSON-645693881 Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: b5abf45c9ba0419c8dec07847f3ff3c5 Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerActionsTestJSON-645693881 Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerActionsTestJSON-645693881-project Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 4d492d20a4864908a81902f86468d437 Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerActionsTestJSON-645693881-project Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 8d9787fc-a4e1-41f8-be82-3f68c14ad254 could not be found. Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '8d9787fc-a4e1-41f8-be82-3f68c14ad254'} Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9787fc-a4e1-41f8-be82-3f68c14ad254 could not be found. Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9787fc-a4e1-41f8-be82-3f68c14ad254 could not be found. Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:11.860200 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:11.865215 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:11.865215 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:11.865215 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:11.865215 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:01:11.865215 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:01:11.865215 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9787fc-a4e1-41f8-be82-3f68c14ad254 could not be found. Jul 25 13:01:11.865215 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:11.865215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8ec73ae2-6dc2-4bb8-8e71-52605552d1a2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Returning 404 to user: Instance 8d9787fc-a4e1-41f8-be82-3f68c14ad254 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:01:11.865215 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8ec73ae2-6dc2-4bb8-8e71-52605552d1a2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254" status: 404 len: 111 microversion: 2.1 time: 0.043864 Jul 25 13:01:11.865917 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2015/4107] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:11 2022] GET /compute/v2.1/servers/8d9787fc-a4e1-41f8-be82-3f68c14ad254 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:01:11.874536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c1c99371-edaf-4076-a33d-e7b1ae4f5cf0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:11.875446 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c1c99371-edaf-4076-a33d-e7b1ae4f5cf0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:11.882836 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c1c99371-edaf-4076-a33d-e7b1ae4f5cf0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:11.883282 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c1c99371-edaf-4076-a33d-e7b1ae4f5cf0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:11.884253 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c1c99371-edaf-4076-a33d-e7b1ae4f5cf0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:11.885981 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c1c99371-edaf-4076-a33d-e7b1ae4f5cf0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:11.916718 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.multi_cell_list [None req-18dd0a77-73f9-48bc-9684-d33af892b94d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:01:11.990667 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-18dd0a77-73f9-48bc-9684-d33af892b94d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-743679323" status: 200 len: 345 microversion: 2.1 time: 0.247197 Jul 25 13:01:11.991519 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2093/4108] 10.222.0.49 () {58 vars in 1240 bytes} [Mon Jul 25 13:01:11 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-743679323 => generated 345 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:01:11.996422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-26c268ba-9811-4cc1-aa8b-c01e0b3bed1b tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:11.998056 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-26c268ba-9811-4cc1-aa8b-c01e0b3bed1b tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:12.005268 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-26c268ba-9811-4cc1-aa8b-c01e0b3bed1b tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:12.005731 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-26c268ba-9811-4cc1-aa8b-c01e0b3bed1b tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:12.006553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-26c268ba-9811-4cc1-aa8b-c01e0b3bed1b tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:12.006989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-26c268ba-9811-4cc1-aa8b-c01e0b3bed1b tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:12.061777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c1c99371-edaf-4076-a33d-e7b1ae4f5cf0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:12.071792 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c1c99371-edaf-4076-a33d-e7b1ae4f5cf0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1509 microversion: 2.1 time: 0.203955 Jul 25 13:01:12.075564 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2016/4109] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:11 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1509 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:12.082605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a35b9d7e-dbe4-43b4-a820-767b91fe365e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:12.083254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a35b9d7e-dbe4-43b4-a820-767b91fe365e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:12.091379 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a35b9d7e-dbe4-43b4-a820-767b91fe365e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:12.092249 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a35b9d7e-dbe4-43b4-a820-767b91fe365e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:12.093156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a35b9d7e-dbe4-43b4-a820-767b91fe365e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:12.093863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a35b9d7e-dbe4-43b4-a820-767b91fe365e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:12.116747 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-26c268ba-9811-4cc1-aa8b-c01e0b3bed1b tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:12.124736 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-26c268ba-9811-4cc1-aa8b-c01e0b3bed1b tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb" status: 200 len: 1470 microversion: 2.1 time: 0.132421 Jul 25 13:01:12.125779 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2094/4110] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:11 2022] GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb => generated 1470 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:12.142017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-63e3a70f-6fcb-4bbe-b80e-6ebda9c3e284 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:12.149405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-63e3a70f-6fcb-4bbe-b80e-6ebda9c3e284 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:12.150120 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-63e3a70f-6fcb-4bbe-b80e-6ebda9c3e284 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:12.162911 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a35b9d7e-dbe4-43b4-a820-767b91fe365e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:01:12.176082 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-63e3a70f-6fcb-4bbe-b80e-6ebda9c3e284 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] Going to try to stop instance {{(pid=125884) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 13:01:12.206136 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:12.245858 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-63e3a70f-6fcb-4bbe-b80e-6ebda9c3e284 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "POST /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002/action" status: 202 len: 0 microversion: 2.1 time: 0.113999 Jul 25 13:01:12.246475 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2095/4111] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:01:12 2022] POST /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:01:12.252740 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1dc677cb-d1e8-4ee8-ac71-c75d01bda858 tempest-TestSecurityGroupsBasicOps-1158354128 tempest-TestSecurityGroupsBasicOps-1158354128-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:12.253806 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1dc677cb-d1e8-4ee8-ac71-c75d01bda858 tempest-TestSecurityGroupsBasicOps-1158354128 tempest-TestSecurityGroupsBasicOps-1158354128-project-admin] [instance: 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:12.262175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dc677cb-d1e8-4ee8-ac71-c75d01bda858 tempest-TestSecurityGroupsBasicOps-1158354128 tempest-TestSecurityGroupsBasicOps-1158354128-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:12.263240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dc677cb-d1e8-4ee8-ac71-c75d01bda858 tempest-TestSecurityGroupsBasicOps-1158354128 tempest-TestSecurityGroupsBasicOps-1158354128-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:12.264185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dc677cb-d1e8-4ee8-ac71-c75d01bda858 tempest-TestSecurityGroupsBasicOps-1158354128 tempest-TestSecurityGroupsBasicOps-1158354128-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:12.264951 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dc677cb-d1e8-4ee8-ac71-c75d01bda858 tempest-TestSecurityGroupsBasicOps-1158354128 tempest-TestSecurityGroupsBasicOps-1158354128-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:12.280437 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a35b9d7e-dbe4-43b4-a820-767b91fe365e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f" status: 204 len: 0 microversion: 2.1 time: 0.200169 Jul 25 13:01:12.283203 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2017/4112] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:01:12 2022] DELETE /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:01:12.299051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-749cb993-d7aa-4652-a711-f32d0784e33f tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:12.299763 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-749cb993-d7aa-4652-a711-f32d0784e33f tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:12.307900 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-749cb993-d7aa-4652-a711-f32d0784e33f tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:12.308351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-749cb993-d7aa-4652-a711-f32d0784e33f tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:12.309136 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-749cb993-d7aa-4652-a711-f32d0784e33f tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:12.309597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-749cb993-d7aa-4652-a711-f32d0784e33f tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:12.378207 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1dc677cb-d1e8-4ee8-ac71-c75d01bda858 tempest-TestSecurityGroupsBasicOps-1158354128 tempest-TestSecurityGroupsBasicOps-1158354128-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb" status: 200 len: 1623 microversion: 2.1 time: 0.130335 Jul 25 13:01:12.392807 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2096/4113] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:12 2022] GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb => generated 1623 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:12.397975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-40425528-e95b-49b5-ae6c-b4556ef637fb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:12.398628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-40425528-e95b-49b5-ae6c-b4556ef637fb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:12.405136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40425528-e95b-49b5-ae6c-b4556ef637fb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:12.405776 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40425528-e95b-49b5-ae6c-b4556ef637fb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:12.406833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40425528-e95b-49b5-ae6c-b4556ef637fb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:12.407417 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40425528-e95b-49b5-ae6c-b4556ef637fb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:12.531246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-40425528-e95b-49b5-ae6c-b4556ef637fb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:12.542297 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-40425528-e95b-49b5-ae6c-b4556ef637fb tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f" status: 200 len: 1467 microversion: 2.1 time: 0.148157 Jul 25 13:01:12.543476 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2097/4114] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:12 2022] GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f => generated 1467 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:12.549746 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-749cb993-d7aa-4652-a711-f32d0784e33f tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:12.551494 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cc243df4-78c7-402c-b8dc-a7ebcf13ae31 tempest-TestSecurityGroupsBasicOps-1158354128 tempest-TestSecurityGroupsBasicOps-1158354128-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:12.552356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cc243df4-78c7-402c-b8dc-a7ebcf13ae31 tempest-TestSecurityGroupsBasicOps-1158354128 tempest-TestSecurityGroupsBasicOps-1158354128-project-admin] [instance: 3a938f7a-a9f5-4888-95f3-bde7040a576f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:12.557942 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-749cb993-d7aa-4652-a711-f32d0784e33f tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002" status: 200 len: 1520 microversion: 2.1 time: 0.269442 Jul 25 13:01:12.558538 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2018/4115] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:12 2022] GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002 => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:12.562258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc243df4-78c7-402c-b8dc-a7ebcf13ae31 tempest-TestSecurityGroupsBasicOps-1158354128 tempest-TestSecurityGroupsBasicOps-1158354128-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:12.563058 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc243df4-78c7-402c-b8dc-a7ebcf13ae31 tempest-TestSecurityGroupsBasicOps-1158354128 tempest-TestSecurityGroupsBasicOps-1158354128-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:12.563850 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc243df4-78c7-402c-b8dc-a7ebcf13ae31 tempest-TestSecurityGroupsBasicOps-1158354128 tempest-TestSecurityGroupsBasicOps-1158354128-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:12.564298 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc243df4-78c7-402c-b8dc-a7ebcf13ae31 tempest-TestSecurityGroupsBasicOps-1158354128 tempest-TestSecurityGroupsBasicOps-1158354128-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:12.581701 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:12.629570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4a055720-469e-4438-9284-ea0af17739b7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:12.630612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4a055720-469e-4438-9284-ea0af17739b7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:12.636958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a055720-469e-4438-9284-ea0af17739b7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:12.637697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a055720-469e-4438-9284-ea0af17739b7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:12.638768 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a055720-469e-4438-9284-ea0af17739b7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:12.639403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a055720-469e-4438-9284-ea0af17739b7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:12.809590 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cc243df4-78c7-402c-b8dc-a7ebcf13ae31 tempest-TestSecurityGroupsBasicOps-1158354128 tempest-TestSecurityGroupsBasicOps-1158354128-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f" status: 200 len: 1911 microversion: 2.1 time: 0.262339 Jul 25 13:01:12.811526 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2098/4116] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:12 2022] GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f => generated 1911 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:12.881604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4a055720-469e-4438-9284-ea0af17739b7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:12.892414 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-89e8fd69-262b-4eee-97a5-774937c47527 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:12.894030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-89e8fd69-262b-4eee-97a5-774937c47527 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:12.896586 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4a055720-469e-4438-9284-ea0af17739b7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1697 microversion: 2.1 time: 0.270900 Jul 25 13:01:12.897532 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2019/4117] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:12 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1697 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:12.902434 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-89e8fd69-262b-4eee-97a5-774937c47527 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:12.903233 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-89e8fd69-262b-4eee-97a5-774937c47527 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:12.904441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-89e8fd69-262b-4eee-97a5-774937c47527 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:12.905314 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-89e8fd69-262b-4eee-97a5-774937c47527 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:12.938636 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-89e8fd69-262b-4eee-97a5-774937c47527 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:01:13.047948 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-89e8fd69-262b-4eee-97a5-774937c47527 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb" status: 204 len: 0 microversion: 2.1 time: 0.159479 Jul 25 13:01:13.048911 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2099/4118] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:01:12 2022] DELETE /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:01:13.057274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ca52a30c-f446-4eda-8835-1fc5de174060 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:13.058286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ca52a30c-f446-4eda-8835-1fc5de174060 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:13.064830 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca52a30c-f446-4eda-8835-1fc5de174060 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:13.077659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca52a30c-f446-4eda-8835-1fc5de174060 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:13.078628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca52a30c-f446-4eda-8835-1fc5de174060 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:13.079367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca52a30c-f446-4eda-8835-1fc5de174060 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:13.094371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-84a26826-4747-4332-b979-89a47ab8c1e3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:13.095076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-84a26826-4747-4332-b979-89a47ab8c1e3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:13.101646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84a26826-4747-4332-b979-89a47ab8c1e3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:13.102153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84a26826-4747-4332-b979-89a47ab8c1e3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:13.103049 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84a26826-4747-4332-b979-89a47ab8c1e3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:13.103526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84a26826-4747-4332-b979-89a47ab8c1e3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:13.196445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ca52a30c-f446-4eda-8835-1fc5de174060 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:13.205358 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ca52a30c-f446-4eda-8835-1fc5de174060 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb" status: 200 len: 1476 microversion: 2.1 time: 0.151810 Jul 25 13:01:13.206271 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2020/4119] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:13 2022] GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb => generated 1476 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:13.307169 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-84a26826-4747-4332-b979-89a47ab8c1e3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:13.315142 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-84a26826-4747-4332-b979-89a47ab8c1e3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1509 microversion: 2.1 time: 0.226246 Jul 25 13:01:13.317875 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2100/4120] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:13 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1509 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:13.564715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e1767308-9dc4-479f-8657-91c7937db926 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:13.565457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e1767308-9dc4-479f-8657-91c7937db926 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:13.577761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1767308-9dc4-479f-8657-91c7937db926 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:13.578436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1767308-9dc4-479f-8657-91c7937db926 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:13.579762 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1767308-9dc4-479f-8657-91c7937db926 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:13.580351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1767308-9dc4-479f-8657-91c7937db926 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:13.582885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2376ff1b-3e82-4774-bbe4-c63e68d33152 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:13.583763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2376ff1b-3e82-4774-bbe4-c63e68d33152 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:13.591953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2376ff1b-3e82-4774-bbe4-c63e68d33152 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:13.592917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2376ff1b-3e82-4774-bbe4-c63e68d33152 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:13.594439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2376ff1b-3e82-4774-bbe4-c63e68d33152 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:13.595117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2376ff1b-3e82-4774-bbe4-c63e68d33152 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:13.714629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e1767308-9dc4-479f-8657-91c7937db926 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:13.729395 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e1767308-9dc4-479f-8657-91c7937db926 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f" status: 200 len: 1467 microversion: 2.1 time: 0.167916 Jul 25 13:01:13.744315 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2021/4121] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:13 2022] GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f => generated 1467 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:13.783702 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2376ff1b-3e82-4774-bbe4-c63e68d33152 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:13.791946 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2376ff1b-3e82-4774-bbe4-c63e68d33152 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002" status: 200 len: 1520 microversion: 2.1 time: 0.215028 Jul 25 13:01:13.792560 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2101/4122] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:13 2022] GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:13.920941 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-257171a5-b8b5-4a6c-98fb-5887b6738647 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:13.921563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-257171a5-b8b5-4a6c-98fb-5887b6738647 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:13.930698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-257171a5-b8b5-4a6c-98fb-5887b6738647 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:13.931156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-257171a5-b8b5-4a6c-98fb-5887b6738647 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:13.931938 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-257171a5-b8b5-4a6c-98fb-5887b6738647 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:13.932375 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-257171a5-b8b5-4a6c-98fb-5887b6738647 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:14.161380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-257171a5-b8b5-4a6c-98fb-5887b6738647 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:14.172797 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-257171a5-b8b5-4a6c-98fb-5887b6738647 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1697 microversion: 2.1 time: 0.256505 Jul 25 13:01:14.184678 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2022/4123] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:13 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1697 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:14.228528 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3b884af1-f77c-447f-b4b8-4373122edbc4 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:14.229157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3b884af1-f77c-447f-b4b8-4373122edbc4 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:14.246155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b884af1-f77c-447f-b4b8-4373122edbc4 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:14.247219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b884af1-f77c-447f-b4b8-4373122edbc4 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:14.248902 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b884af1-f77c-447f-b4b8-4373122edbc4 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:14.250150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b884af1-f77c-447f-b4b8-4373122edbc4 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:14.312769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-b9ba5ef7-0f58-4bdf-9b89-2c0100b60082 req-aa91fc96-0866-45fb-bb6c-ce741ddb0d71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2", "name": "network-vif-unplugged", "status": "completed", "tag": "a2ca9e31-6d49-4fae-9ff5-c3c32be13ff6"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:14.346352 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b9ba5ef7-0f58-4bdf-9b89-2c0100b60082 req-aa91fc96-0866-45fb-bb6c-ce741ddb0d71 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:14.346928 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b9ba5ef7-0f58-4bdf-9b89-2c0100b60082 req-aa91fc96-0866-45fb-bb6c-ce741ddb0d71 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:14.367154 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-b9ba5ef7-0f58-4bdf-9b89-2c0100b60082 req-aa91fc96-0866-45fb-bb6c-ce741ddb0d71 service nova] Creating event network-vif-unplugged:a2ca9e31-6d49-4fae-9ff5-c3c32be13ff6 for instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 on n-h1-848886-15 Jul 25 13:01:14.372374 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-b9ba5ef7-0f58-4bdf-9b89-2c0100b60082 req-aa91fc96-0866-45fb-bb6c-ce741ddb0d71 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065950 Jul 25 13:01:14.373170 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2023/4124] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:01:14.380416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c6144876-66c3-4ea4-948f-6cc8c4621d07 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:14.381134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c6144876-66c3-4ea4-948f-6cc8c4621d07 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:14.389742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c6144876-66c3-4ea4-948f-6cc8c4621d07 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:14.390845 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c6144876-66c3-4ea4-948f-6cc8c4621d07 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:14.391643 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c6144876-66c3-4ea4-948f-6cc8c4621d07 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:14.392088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c6144876-66c3-4ea4-948f-6cc8c4621d07 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:14.585955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3b884af1-f77c-447f-b4b8-4373122edbc4 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:14.598573 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3b884af1-f77c-447f-b4b8-4373122edbc4 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb" status: 200 len: 1476 microversion: 2.1 time: 0.374195 Jul 25 13:01:14.601689 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2102/4125] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:14 2022] GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb => generated 1476 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:14.664362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c6144876-66c3-4ea4-948f-6cc8c4621d07 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:14.673584 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c6144876-66c3-4ea4-948f-6cc8c4621d07 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1509 microversion: 2.1 time: 0.298313 Jul 25 13:01:14.674487 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2024/4126] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:14 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1509 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:14.751009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e8c310ef-e55a-44fd-b5fc-51905b08447c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:14.751637 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e8c310ef-e55a-44fd-b5fc-51905b08447c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:14.762667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8c310ef-e55a-44fd-b5fc-51905b08447c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:14.764859 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8c310ef-e55a-44fd-b5fc-51905b08447c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:14.767217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8c310ef-e55a-44fd-b5fc-51905b08447c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:14.767898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8c310ef-e55a-44fd-b5fc-51905b08447c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:14.814339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-48f6a196-9225-49c6-a2a0-3094268ba460 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:14.815299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-48f6a196-9225-49c6-a2a0-3094268ba460 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:14.824627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48f6a196-9225-49c6-a2a0-3094268ba460 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:14.825080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48f6a196-9225-49c6-a2a0-3094268ba460 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:14.828067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48f6a196-9225-49c6-a2a0-3094268ba460 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:14.829865 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48f6a196-9225-49c6-a2a0-3094268ba460 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:15.042961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e8c310ef-e55a-44fd-b5fc-51905b08447c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:15.056834 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e8c310ef-e55a-44fd-b5fc-51905b08447c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f" status: 200 len: 1467 microversion: 2.1 time: 0.311618 Jul 25 13:01:15.057962 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2103/4127] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:14 2022] GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f => generated 1467 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:15.096054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-48f6a196-9225-49c6-a2a0-3094268ba460 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:15.105246 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-48f6a196-9225-49c6-a2a0-3094268ba460 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002" status: 200 len: 1520 microversion: 2.1 time: 0.294830 Jul 25 13:01:15.118985 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2025/4128] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:14 2022] GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002 => generated 1520 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:15.194436 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ba43da6e-efc9-4c6f-96e9-0d5d38a4767d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:15.195441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ba43da6e-efc9-4c6f-96e9-0d5d38a4767d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:15.202538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba43da6e-efc9-4c6f-96e9-0d5d38a4767d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:15.202992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba43da6e-efc9-4c6f-96e9-0d5d38a4767d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:15.203769 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba43da6e-efc9-4c6f-96e9-0d5d38a4767d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:15.204196 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba43da6e-efc9-4c6f-96e9-0d5d38a4767d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:15.485408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ba43da6e-efc9-4c6f-96e9-0d5d38a4767d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:15.495387 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ba43da6e-efc9-4c6f-96e9-0d5d38a4767d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1696 microversion: 2.1 time: 0.304778 Jul 25 13:01:15.495988 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2104/4129] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:15 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1696 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:15.633951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8f38eac1-7f27-4a42-b35c-6bebf07d7919 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:15.633951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8f38eac1-7f27-4a42-b35c-6bebf07d7919 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:15.651329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f38eac1-7f27-4a42-b35c-6bebf07d7919 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:15.651329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f38eac1-7f27-4a42-b35c-6bebf07d7919 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:15.652153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f38eac1-7f27-4a42-b35c-6bebf07d7919 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:15.652614 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f38eac1-7f27-4a42-b35c-6bebf07d7919 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:15.696321 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7c65f0b1-fc7e-4f36-a127-fe579196b73e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:15.697016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7c65f0b1-fc7e-4f36-a127-fe579196b73e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:15.704065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c65f0b1-fc7e-4f36-a127-fe579196b73e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:15.704762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c65f0b1-fc7e-4f36-a127-fe579196b73e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:15.705737 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c65f0b1-fc7e-4f36-a127-fe579196b73e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:15.706349 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c65f0b1-fc7e-4f36-a127-fe579196b73e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:15.925283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8f38eac1-7f27-4a42-b35c-6bebf07d7919 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:15.933625 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8f38eac1-7f27-4a42-b35c-6bebf07d7919 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb" status: 200 len: 1476 microversion: 2.1 time: 0.314030 Jul 25 13:01:15.938183 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2026/4130] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:15 2022] GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb => generated 1476 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:15.953910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-a415ce62-2d2d-4fd3-87f9-e8b3a89b35a2 req-c924de8d-7899-4e13-98cb-792174c1b1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5335837-15f6-4365-b5e0-baa45e59dc5f", "name": "network-vif-deleted", "tag": "933af734-9f5f-4958-934d-c40605fd0b13"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:15.989759 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a415ce62-2d2d-4fd3-87f9-e8b3a89b35a2 req-c924de8d-7899-4e13-98cb-792174c1b1d4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:15.990233 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a415ce62-2d2d-4fd3-87f9-e8b3a89b35a2 req-c924de8d-7899-4e13-98cb-792174c1b1d4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:16.021248 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-a415ce62-2d2d-4fd3-87f9-e8b3a89b35a2 req-c924de8d-7899-4e13-98cb-792174c1b1d4 service nova] Creating event network-vif-deleted:933af734-9f5f-4958-934d-c40605fd0b13 for instance f5335837-15f6-4365-b5e0-baa45e59dc5f on n-h2-848886-15 Jul 25 13:01:16.039720 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-a415ce62-2d2d-4fd3-87f9-e8b3a89b35a2 req-c924de8d-7899-4e13-98cb-792174c1b1d4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100041 Jul 25 13:01:16.041039 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2027/4131] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:01:16.076945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:16.089561 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0e6f9450-fec7-419c-a13c-4a269be7d267 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:16.090723 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0e6f9450-fec7-419c-a13c-4a269be7d267 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:16.100903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e6f9450-fec7-419c-a13c-4a269be7d267 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:16.101892 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e6f9450-fec7-419c-a13c-4a269be7d267 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:16.102966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e6f9450-fec7-419c-a13c-4a269be7d267 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:16.104102 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e6f9450-fec7-419c-a13c-4a269be7d267 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:16.156477 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e6f9450-fec7-419c-a13c-4a269be7d267 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:16.156948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e6f9450-fec7-419c-a13c-4a269be7d267 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:16.157464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-0e6f9450-fec7-419c-a13c-4a269be7d267 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lazy-loading 'fault' on Instance uuid f5335837-15f6-4365-b5e0-baa45e59dc5f {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:01:16.273225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0e6f9450-fec7-419c-a13c-4a269be7d267 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:16.285578 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0e6f9450-fec7-419c-a13c-4a269be7d267 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f" status: 200 len: 1305 microversion: 2.1 time: 0.209695 Jul 25 13:01:16.286417 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2028/4132] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:16 2022] GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f => generated 1305 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:16.292084 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-74c5c95f-6282-41d8-b923-d427a5ce63a3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:16.292853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-74c5c95f-6282-41d8-b923-d427a5ce63a3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:16.299323 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74c5c95f-6282-41d8-b923-d427a5ce63a3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:16.300261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74c5c95f-6282-41d8-b923-d427a5ce63a3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:16.301458 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74c5c95f-6282-41d8-b923-d427a5ce63a3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:16.302036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74c5c95f-6282-41d8-b923-d427a5ce63a3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:16.314178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7c65f0b1-fc7e-4f36-a127-fe579196b73e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:16.326641 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7c65f0b1-fc7e-4f36-a127-fe579196b73e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1452 microversion: 2.1 time: 0.635743 Jul 25 13:01:16.333164 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2105/4133] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:15 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1452 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:16.353819 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dcc8f9ff-c530-4f33-b7f4-4843f6e43773 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:16.354511 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dcc8f9ff-c530-4f33-b7f4-4843f6e43773 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:16.370509 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dcc8f9ff-c530-4f33-b7f4-4843f6e43773 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:16.373876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dcc8f9ff-c530-4f33-b7f4-4843f6e43773 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:16.374912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dcc8f9ff-c530-4f33-b7f4-4843f6e43773 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:16.378219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dcc8f9ff-c530-4f33-b7f4-4843f6e43773 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:16.613407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-74c5c95f-6282-41d8-b923-d427a5ce63a3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:16.625315 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-74c5c95f-6282-41d8-b923-d427a5ce63a3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002" status: 200 len: 1520 microversion: 2.1 time: 0.337104 Jul 25 13:01:16.626968 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2029/4134] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:16 2022] GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002 => generated 1520 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:16.633197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-632c9687-668e-4731-8cc5-98c8102d5e48 req-fba31aca-b388-449b-ae9d-f0594b44bebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7954e97-a6c3-4017-a41d-2e61083c6ab5", "name": "network-vif-unplugged", "status": "completed", "tag": "47fb272d-6ac9-419c-81e1-c632660c9f57"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:16.647888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-632c9687-668e-4731-8cc5-98c8102d5e48 req-fba31aca-b388-449b-ae9d-f0594b44bebe service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:16.648765 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-632c9687-668e-4731-8cc5-98c8102d5e48 req-fba31aca-b388-449b-ae9d-f0594b44bebe service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:16.666649 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-632c9687-668e-4731-8cc5-98c8102d5e48 req-fba31aca-b388-449b-ae9d-f0594b44bebe service nova] Creating event network-vif-unplugged:47fb272d-6ac9-419c-81e1-c632660c9f57 for instance d7954e97-a6c3-4017-a41d-2e61083c6ab5 on n-h1-848886-15 Jul 25 13:01:16.676523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [req-632c9687-668e-4731-8cc5-98c8102d5e48 req-fba31aca-b388-449b-ae9d-f0594b44bebe service nova] Instance d7954e97-a6c3-4017-a41d-2e61083c6ab5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125883) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:01:16.691164 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-632c9687-668e-4731-8cc5-98c8102d5e48 req-fba31aca-b388-449b-ae9d-f0594b44bebe service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061662 Jul 25 13:01:16.692409 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2030/4135] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:01:16.700248 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-091e5f9e-ea01-4462-99c5-48b602a1cb35 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:16.701407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-091e5f9e-ea01-4462-99c5-48b602a1cb35 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:16.709212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-091e5f9e-ea01-4462-99c5-48b602a1cb35 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:16.709995 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-091e5f9e-ea01-4462-99c5-48b602a1cb35 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:16.711128 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-091e5f9e-ea01-4462-99c5-48b602a1cb35 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:16.711944 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-091e5f9e-ea01-4462-99c5-48b602a1cb35 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:16.825383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dcc8f9ff-c530-4f33-b7f4-4843f6e43773 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:16.837147 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dcc8f9ff-c530-4f33-b7f4-4843f6e43773 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1452 microversion: 2.1 time: 0.487286 Jul 25 13:01:16.849940 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2106/4136] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:16 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1452 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:16.854681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-0a136681-4399-4531-bb6c-4c7e74be758a req-a6824e3b-da39-47bc-a210-be9df8d8915c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb", "name": "network-vif-deleted", "tag": "f8f71024-db00-4bd6-a3d5-51d3d0ef25a1"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:16.889622 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-0a136681-4399-4531-bb6c-4c7e74be758a req-a6824e3b-da39-47bc-a210-be9df8d8915c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:16.898611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-0a136681-4399-4531-bb6c-4c7e74be758a req-a6824e3b-da39-47bc-a210-be9df8d8915c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:16.930516 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-0a136681-4399-4531-bb6c-4c7e74be758a req-a6824e3b-da39-47bc-a210-be9df8d8915c service nova] Creating event network-vif-deleted:f8f71024-db00-4bd6-a3d5-51d3d0ef25a1 for instance 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb on n-h1-848886-15 Jul 25 13:01:16.947220 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-0a136681-4399-4531-bb6c-4c7e74be758a req-a6824e3b-da39-47bc-a210-be9df8d8915c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096032 Jul 25 13:01:16.948959 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2107/4137] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:01:16.954432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aac75e60-ba31-4d53-a888-374574aa17c4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:16.955067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-aac75e60-ba31-4d53-a888-374574aa17c4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:16.972188 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aac75e60-ba31-4d53-a888-374574aa17c4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:16.972652 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aac75e60-ba31-4d53-a888-374574aa17c4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:16.973573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aac75e60-ba31-4d53-a888-374574aa17c4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:16.974107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aac75e60-ba31-4d53-a888-374574aa17c4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:17.037226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-aac75e60-ba31-4d53-a888-374574aa17c4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lazy-loading 'flavor' on Instance uuid f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:01:17.059009 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-aac75e60-ba31-4d53-a888-374574aa17c4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Cannot 'shelve' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state shelved_offloaded Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aac75e60-ba31-4d53-a888-374574aa17c4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action HTTP/1.1 Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 14 Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: {"shelve": {}} Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: exception: Cannot 'shelve' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state shelved_offloaded Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2', 'body': {'shelve': {}}} Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 25 13:01:17.061111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 13:01:17.067116 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 13:01:17.067116 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 13:01:17.067116 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state shelved_offloaded Jul 25 13:01:17.067116 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:17.067116 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:17.067116 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:17.067116 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:17.067116 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:17.067116 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:17.067116 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:01:17.067116 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:01:17.067116 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state shelved_offloaded Jul 25 13:01:17.067116 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:17.070964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aac75e60-ba31-4d53-a888-374574aa17c4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 409 to user: Cannot 'shelve' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state shelved_offloaded {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:01:17.072068 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-aac75e60-ba31-4d53-a888-374574aa17c4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action" status: 409 len: 155 microversion: 2.1 time: 0.121958 Jul 25 13:01:17.077610 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2108/4138] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:01:16 2022] POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action => generated 155 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 13:01:17.087243 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ac8d769f-f8bb-4066-9f99-9bf44c6d4908 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:17.088117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ac8d769f-f8bb-4066-9f99-9bf44c6d4908 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:17.094982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac8d769f-f8bb-4066-9f99-9bf44c6d4908 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:17.095746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac8d769f-f8bb-4066-9f99-9bf44c6d4908 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:17.096741 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac8d769f-f8bb-4066-9f99-9bf44c6d4908 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:17.097379 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac8d769f-f8bb-4066-9f99-9bf44c6d4908 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:17.153613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac8d769f-f8bb-4066-9f99-9bf44c6d4908 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:17.154237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac8d769f-f8bb-4066-9f99-9bf44c6d4908 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:17.154775 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-ac8d769f-f8bb-4066-9f99-9bf44c6d4908 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lazy-loading 'fault' on Instance uuid 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:01:17.205248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:17.653117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ac8d769f-f8bb-4066-9f99-9bf44c6d4908 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:17.660546 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ac8d769f-f8bb-4066-9f99-9bf44c6d4908 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb" status: 200 len: 1330 microversion: 2.1 time: 0.581376 Jul 25 13:01:17.661144 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2109/4139] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:17 2022] GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb => generated 1330 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:17.675469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8a49c8c9-8beb-4c1c-8d73-4d460dd57b31 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:17.675469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8a49c8c9-8beb-4c1c-8d73-4d460dd57b31 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:17.681467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a49c8c9-8beb-4c1c-8d73-4d460dd57b31 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:17.683120 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a49c8c9-8beb-4c1c-8d73-4d460dd57b31 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:17.683986 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a49c8c9-8beb-4c1c-8d73-4d460dd57b31 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:17.684437 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a49c8c9-8beb-4c1c-8d73-4d460dd57b31 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:17.815870 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8a49c8c9-8beb-4c1c-8d73-4d460dd57b31 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action" status: 202 len: 0 microversion: 2.1 time: 0.153580 Jul 25 13:01:17.817928 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2110/4140] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:01:17 2022] POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:01:17.825094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d4a70d60-43a9-4af9-b531-54e47b9141c0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:17.828187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d4a70d60-43a9-4af9-b531-54e47b9141c0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: f5335837-15f6-4365-b5e0-baa45e59dc5f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:17.837470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d4a70d60-43a9-4af9-b531-54e47b9141c0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:17.838190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d4a70d60-43a9-4af9-b531-54e47b9141c0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:17.839248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d4a70d60-43a9-4af9-b531-54e47b9141c0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:17.839991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d4a70d60-43a9-4af9-b531-54e47b9141c0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:17.858876 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-d4a70d60-43a9-4af9-b531-54e47b9141c0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] HTTP exception thrown: Instance f5335837-15f6-4365-b5e0-baa45e59dc5f could not be found. Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d4a70d60-43a9-4af9-b531-54e47b9141c0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Request method failure captured: Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f HTTP/1.1 Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pHthUWL3emuzsBs4xsDYWyXYBkhJFaBBK9FQhgh1copL5lDP9Ma5bkE_HJxjDmond706Gp-3Rif1J8B87ZUnZtsSIpcsBH62MydK_2R5OL-M6p6aAVtQ-nWL1wmPtLFtWDAiH4ULAKYIyK232aQLG-PdxvIg00u9QiVZERdPXLac10 Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: b5abf45c9ba0419c8dec07847f3ff3c5 Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerActionsTestJSON-645693881 Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b5abf45c9ba0419c8dec07847f3ff3c5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b5abf45c9ba0419c8dec07847f3ff3c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5abf45c9ba0419c8dec07847f3ff3c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5abf45c9ba0419c8dec07847f3ff3c5"}]}] Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerActionsTestJSON-645693881 Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: b5abf45c9ba0419c8dec07847f3ff3c5 Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerActionsTestJSON-645693881 Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerActionsTestJSON-645693881-project Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 4d492d20a4864908a81902f86468d437 Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerActionsTestJSON-645693881-project Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance f5335837-15f6-4365-b5e0-baa45e59dc5f could not be found. Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'f5335837-15f6-4365-b5e0-baa45e59dc5f'} Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5335837-15f6-4365-b5e0-baa45e59dc5f could not be found. Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5335837-15f6-4365-b5e0-baa45e59dc5f could not be found. Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:17.860511 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:17.865288 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:17.865288 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:17.865288 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:17.865288 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:01:17.865288 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:01:17.865288 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5335837-15f6-4365-b5e0-baa45e59dc5f could not be found. Jul 25 13:01:17.865288 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:17.865288 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d4a70d60-43a9-4af9-b531-54e47b9141c0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Returning 404 to user: Instance f5335837-15f6-4365-b5e0-baa45e59dc5f could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:01:17.865288 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d4a70d60-43a9-4af9-b531-54e47b9141c0 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f" status: 404 len: 111 microversion: 2.1 time: 0.042692 Jul 25 13:01:17.866149 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2111/4141] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:17 2022] GET /compute/v2.1/servers/f5335837-15f6-4365-b5e0-baa45e59dc5f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:01:17.866734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-091e5f9e-ea01-4462-99c5-48b602a1cb35 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:17.873073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ffdd4fe3-bd81-4222-ae14-f8e69bfbb8f7 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:17.874418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ffdd4fe3-bd81-4222-ae14-f8e69bfbb8f7 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:17.882574 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-091e5f9e-ea01-4462-99c5-48b602a1cb35 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1696 microversion: 2.1 time: 1.188608 Jul 25 13:01:17.883217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ffdd4fe3-bd81-4222-ae14-f8e69bfbb8f7 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:17.883489 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2031/4142] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:16 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1696 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:17.883897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ffdd4fe3-bd81-4222-ae14-f8e69bfbb8f7 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:17.884844 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ffdd4fe3-bd81-4222-ae14-f8e69bfbb8f7 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:17.885426 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ffdd4fe3-bd81-4222-ae14-f8e69bfbb8f7 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:17.888111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-37e14d91-0c4a-4c43-b5bd-296556c13500 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:17.888724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-37e14d91-0c4a-4c43-b5bd-296556c13500 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:17.894915 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37e14d91-0c4a-4c43-b5bd-296556c13500 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:17.895558 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37e14d91-0c4a-4c43-b5bd-296556c13500 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:17.896502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37e14d91-0c4a-4c43-b5bd-296556c13500 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:17.897100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37e14d91-0c4a-4c43-b5bd-296556c13500 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:18.280215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-37e14d91-0c4a-4c43-b5bd-296556c13500 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:18.290729 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-37e14d91-0c4a-4c43-b5bd-296556c13500 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1460 microversion: 2.1 time: 0.405679 Jul 25 13:01:18.292345 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2032/4143] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:17 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1460 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:18.297987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-81592878-d5fd-4677-bbe9-313e9e7219ec tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:18.298871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-81592878-d5fd-4677-bbe9-313e9e7219ec tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:18.305455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ffdd4fe3-bd81-4222-ae14-f8e69bfbb8f7 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:18.306338 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-81592878-d5fd-4677-bbe9-313e9e7219ec tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:18.307027 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-81592878-d5fd-4677-bbe9-313e9e7219ec tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:18.308128 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-81592878-d5fd-4677-bbe9-313e9e7219ec tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:18.308909 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-81592878-d5fd-4677-bbe9-313e9e7219ec tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:18.317862 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ffdd4fe3-bd81-4222-ae14-f8e69bfbb8f7 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002" status: 200 len: 1520 microversion: 2.1 time: 0.446707 Jul 25 13:01:18.318601 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2112/4144] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:17 2022] GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002 => generated 1520 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:18.350982 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-81592878-d5fd-4677-bbe9-313e9e7219ec tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:01:18.408551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:18.521945 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-81592878-d5fd-4677-bbe9-313e9e7219ec tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a" status: 204 len: 0 microversion: 2.1 time: 0.226686 Jul 25 13:01:18.524345 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2033/4145] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:01:18 2022] DELETE /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:01:18.533175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-816875a7-880f-4034-a90a-6584ef0db06c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:18.534461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-816875a7-880f-4034-a90a-6584ef0db06c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:18.557795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-816875a7-880f-4034-a90a-6584ef0db06c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:18.578924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-816875a7-880f-4034-a90a-6584ef0db06c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:18.579829 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-816875a7-880f-4034-a90a-6584ef0db06c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:18.580287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-816875a7-880f-4034-a90a-6584ef0db06c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:18.593150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:18.682908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5f0c8710-2edb-44be-bdb2-335068037058 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:18.684274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5f0c8710-2edb-44be-bdb2-335068037058 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:18.694105 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f0c8710-2edb-44be-bdb2-335068037058 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:18.698511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f0c8710-2edb-44be-bdb2-335068037058 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:18.699632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f0c8710-2edb-44be-bdb2-335068037058 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:18.703001 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f0c8710-2edb-44be-bdb2-335068037058 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:18.722179 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-5f0c8710-2edb-44be-bdb2-335068037058 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] HTTP exception thrown: Instance 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb could not be found. Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5f0c8710-2edb-44be-bdb2-335068037058 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Request method failure captured: Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb HTTP/1.1 Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pOYSDLaTcDk9NR6BlQNDDk1JhSLw3Ju589ZGBWx37k3OJFyWLkl9eF05LIxoe6iyj5FTSNOeNsXKdWNsHSTopH1jC4jEARJlxQv6qByazO0Nq7s7ql6JfXXkqi7CFeoBLUvtb5-GePfOSUOG8j8ZHbabW7-9WvZEAhzl8lRjVN3OAc Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: bb007c5b5f894bc0a31b2c166b53adac Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-749125150 Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bb007c5b5f894bc0a31b2c166b53adac", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bb007c5b5f894bc0a31b2c166b53adac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bb007c5b5f894bc0a31b2c166b53adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bb007c5b5f894bc0a31b2c166b53adac"}]}] Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-TestSecurityGroupsBasicOps-749125150 Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: bb007c5b5f894bc0a31b2c166b53adac Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-749125150 Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-TestSecurityGroupsBasicOps-749125150-project Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: ad62262b424640728ef148dfaae6e074 Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-TestSecurityGroupsBasicOps-749125150-project Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb could not be found. Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb'} Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb could not be found. Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb could not be found. Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:18.724284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:18.728194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:18.728194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:18.728194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:18.728194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:01:18.728194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:01:18.728194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb could not be found. Jul 25 13:01:18.728194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:18.728194 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5f0c8710-2edb-44be-bdb2-335068037058 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Returning 404 to user: Instance 4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:01:18.734219 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5f0c8710-2edb-44be-bdb2-335068037058 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb" status: 404 len: 111 microversion: 2.1 time: 0.055461 Jul 25 13:01:18.734806 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2034/4146] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:18 2022] GET /compute/v2.1/servers/4ab85a8a-18e0-4ef4-a5bc-986d56c6a1fb => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:01:18.868004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-816875a7-880f-4034-a90a-6584ef0db06c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:18.878200 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-816875a7-880f-4034-a90a-6584ef0db06c tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a" status: 200 len: 1508 microversion: 2.1 time: 0.350080 Jul 25 13:01:18.878812 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2113/4147] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:18 2022] GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a => generated 1508 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:18.906498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-206c6e29-c8db-4244-9dff-a897ada8f586 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:18.907201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-206c6e29-c8db-4244-9dff-a897ada8f586 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:18.915901 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-206c6e29-c8db-4244-9dff-a897ada8f586 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:18.916427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-206c6e29-c8db-4244-9dff-a897ada8f586 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:18.917891 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-206c6e29-c8db-4244-9dff-a897ada8f586 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:18.918000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-206c6e29-c8db-4244-9dff-a897ada8f586 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:19.037497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-9cb32955-652c-4f19-a18a-468799b71ee6 req-a7a4364d-8ded-4cb6-80f1-d86c9f674bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7954e97-a6c3-4017-a41d-2e61083c6ab5", "tag": "47fb272d-6ac9-419c-81e1-c632660c9f57"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:19.050124 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9cb32955-652c-4f19-a18a-468799b71ee6 req-a7a4364d-8ded-4cb6-80f1-d86c9f674bd4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:19.050567 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9cb32955-652c-4f19-a18a-468799b71ee6 req-a7a4364d-8ded-4cb6-80f1-d86c9f674bd4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:19.083240 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-9cb32955-652c-4f19-a18a-468799b71ee6 req-a7a4364d-8ded-4cb6-80f1-d86c9f674bd4 service nova] Creating event network-changed:47fb272d-6ac9-419c-81e1-c632660c9f57 for instance d7954e97-a6c3-4017-a41d-2e61083c6ab5 on n-h1-848886-15 Jul 25 13:01:19.097740 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [req-9cb32955-652c-4f19-a18a-468799b71ee6 req-a7a4364d-8ded-4cb6-80f1-d86c9f674bd4 service nova] Instance d7954e97-a6c3-4017-a41d-2e61083c6ab5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:01:19.124171 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-9cb32955-652c-4f19-a18a-468799b71ee6 req-a7a4364d-8ded-4cb6-80f1-d86c9f674bd4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090067 Jul 25 13:01:19.125345 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2114/4148] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:01:19.167492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-206c6e29-c8db-4244-9dff-a897ada8f586 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:19.185966 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-206c6e29-c8db-4244-9dff-a897ada8f586 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1696 microversion: 2.1 time: 0.285127 Jul 25 13:01:19.186857 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2035/4149] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:18 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1696 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:19.326580 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3efbc76f-4870-42d3-8dac-7b90c0dde2e4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:19.327528 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3efbc76f-4870-42d3-8dac-7b90c0dde2e4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:19.343366 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e4f22ef8-80bd-4a66-a052-78865630b12d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:19.343985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e4f22ef8-80bd-4a66-a052-78865630b12d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:19.344529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3efbc76f-4870-42d3-8dac-7b90c0dde2e4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:19.345153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3efbc76f-4870-42d3-8dac-7b90c0dde2e4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:19.346269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3efbc76f-4870-42d3-8dac-7b90c0dde2e4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:19.346886 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3efbc76f-4870-42d3-8dac-7b90c0dde2e4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:19.352187 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4f22ef8-80bd-4a66-a052-78865630b12d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:19.355007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4f22ef8-80bd-4a66-a052-78865630b12d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:19.364856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4f22ef8-80bd-4a66-a052-78865630b12d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:19.367995 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4f22ef8-80bd-4a66-a052-78865630b12d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:19.605190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3efbc76f-4870-42d3-8dac-7b90c0dde2e4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:19.617183 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3efbc76f-4870-42d3-8dac-7b90c0dde2e4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1460 microversion: 2.1 time: 0.303071 Jul 25 13:01:19.636071 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2115/4150] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:19 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1460 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:19.675529 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e4f22ef8-80bd-4a66-a052-78865630b12d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:19.694988 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e4f22ef8-80bd-4a66-a052-78865630b12d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002" status: 200 len: 1520 microversion: 2.1 time: 0.355627 Jul 25 13:01:19.700844 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2036/4151] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:19 2022] GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002 => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:19.900890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bcf7b5b5-9e27-4280-90cb-fed301fb5a3e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:19.901520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bcf7b5b5-9e27-4280-90cb-fed301fb5a3e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:19.931891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bcf7b5b5-9e27-4280-90cb-fed301fb5a3e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:19.932647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bcf7b5b5-9e27-4280-90cb-fed301fb5a3e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:19.933690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bcf7b5b5-9e27-4280-90cb-fed301fb5a3e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:19.935516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bcf7b5b5-9e27-4280-90cb-fed301fb5a3e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:20.211619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-851c04bf-21dc-4474-a94b-6a793e3256ce tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:20.212236 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-851c04bf-21dc-4474-a94b-6a793e3256ce tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:20.226796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-851c04bf-21dc-4474-a94b-6a793e3256ce tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:20.227256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-851c04bf-21dc-4474-a94b-6a793e3256ce tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:20.228055 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-851c04bf-21dc-4474-a94b-6a793e3256ce tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:20.228484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-851c04bf-21dc-4474-a94b-6a793e3256ce tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:20.588799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bcf7b5b5-9e27-4280-90cb-fed301fb5a3e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:20.598001 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bcf7b5b5-9e27-4280-90cb-fed301fb5a3e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a" status: 200 len: 1508 microversion: 2.1 time: 0.701355 Jul 25 13:01:20.602007 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2116/4152] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:19 2022] GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a => generated 1508 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:20.644319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-623fccdc-e077-499c-81b5-e5c4b1dc1f22 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:20.645116 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-623fccdc-e077-499c-81b5-e5c4b1dc1f22 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:20.653104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-623fccdc-e077-499c-81b5-e5c4b1dc1f22 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:20.653959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-623fccdc-e077-499c-81b5-e5c4b1dc1f22 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:20.655044 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-623fccdc-e077-499c-81b5-e5c4b1dc1f22 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:20.655767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-623fccdc-e077-499c-81b5-e5c4b1dc1f22 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:20.814730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-851c04bf-21dc-4474-a94b-6a793e3256ce tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:20.829391 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-851c04bf-21dc-4474-a94b-6a793e3256ce tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1696 microversion: 2.1 time: 0.623017 Jul 25 13:01:20.835819 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2037/4153] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:20 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1696 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:20.840886 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-07e63957-5092-407b-8d02-1b07990a7ff9 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:20.843837 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-07e63957-5092-407b-8d02-1b07990a7ff9 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:20.857343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07e63957-5092-407b-8d02-1b07990a7ff9 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:20.859398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07e63957-5092-407b-8d02-1b07990a7ff9 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:20.861572 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07e63957-5092-407b-8d02-1b07990a7ff9 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:20.863455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07e63957-5092-407b-8d02-1b07990a7ff9 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:21.222626 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-623fccdc-e077-499c-81b5-e5c4b1dc1f22 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:21.236259 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-623fccdc-e077-499c-81b5-e5c4b1dc1f22 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1518 microversion: 2.1 time: 0.597208 Jul 25 13:01:21.238317 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2117/4154] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:20 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1518 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:21.396283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-07e63957-5092-407b-8d02-1b07990a7ff9 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:21.411384 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-07e63957-5092-407b-8d02-1b07990a7ff9 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002" status: 200 len: 1520 microversion: 2.1 time: 0.574143 Jul 25 13:01:21.414546 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2038/4155] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:20 2022] GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002 => generated 1520 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:21.629947 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-279de8b3-f55c-4e47-b79c-7fe340ae04ad tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:21.630953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-279de8b3-f55c-4e47-b79c-7fe340ae04ad tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:21.655799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-279de8b3-f55c-4e47-b79c-7fe340ae04ad tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:21.656466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-279de8b3-f55c-4e47-b79c-7fe340ae04ad tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:21.657979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-279de8b3-f55c-4e47-b79c-7fe340ae04ad tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:21.658613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-279de8b3-f55c-4e47-b79c-7fe340ae04ad tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:21.822017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:21.862050 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-302e14c9-cf84-4bd9-a090-c0d3ac1ce899 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:21.863103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-302e14c9-cf84-4bd9-a090-c0d3ac1ce899 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:21.867073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=16 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:21.874697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-302e14c9-cf84-4bd9-a090-c0d3ac1ce899 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:21.875742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-302e14c9-cf84-4bd9-a090-c0d3ac1ce899 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:21.876889 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-302e14c9-cf84-4bd9-a090-c0d3ac1ce899 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:21.877646 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-302e14c9-cf84-4bd9-a090-c0d3ac1ce899 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:22.067716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-279de8b3-f55c-4e47-b79c-7fe340ae04ad tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:22.079430 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-279de8b3-f55c-4e47-b79c-7fe340ae04ad tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a" status: 200 len: 1466 microversion: 2.1 time: 0.458854 Jul 25 13:01:22.080720 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2118/4156] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:21 2022] GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a => generated 1466 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:22.202084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-0fab5fcf-253a-4dbd-b422-3c5799019884 req-1c82e936-4ae2-4084-aafd-9c2672a075f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4983b6-4749-4747-9a74-b4405b42a22a", "name": "network-vif-deleted", "tag": "f6b6dbe2-98c3-4a98-b177-0dfb4116b9d2"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:22.225231 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-0fab5fcf-253a-4dbd-b422-3c5799019884 req-1c82e936-4ae2-4084-aafd-9c2672a075f5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:22.226115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-0fab5fcf-253a-4dbd-b422-3c5799019884 req-1c82e936-4ae2-4084-aafd-9c2672a075f5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:22.271043 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-0fab5fcf-253a-4dbd-b422-3c5799019884 req-1c82e936-4ae2-4084-aafd-9c2672a075f5 service nova] Creating event network-vif-deleted:f6b6dbe2-98c3-4a98-b177-0dfb4116b9d2 for instance 1b4983b6-4749-4747-9a74-b4405b42a22a on n-h1-848886-15 Jul 25 13:01:22.286211 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-0fab5fcf-253a-4dbd-b422-3c5799019884 req-1c82e936-4ae2-4084-aafd-9c2672a075f5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087900 Jul 25 13:01:22.289093 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2119/4157] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:01:22.309322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-761d9318-1dd7-4300-9a5f-073692e035ae tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:22.310533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-761d9318-1dd7-4300-9a5f-073692e035ae tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:22.347897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-761d9318-1dd7-4300-9a5f-073692e035ae tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:22.348274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-761d9318-1dd7-4300-9a5f-073692e035ae tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:22.357047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-761d9318-1dd7-4300-9a5f-073692e035ae tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:22.357782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-761d9318-1dd7-4300-9a5f-073692e035ae tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:22.855806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-302e14c9-cf84-4bd9-a090-c0d3ac1ce899 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:22.870537 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-302e14c9-cf84-4bd9-a090-c0d3ac1ce899 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1696 microversion: 2.1 time: 1.015006 Jul 25 13:01:22.885432 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2039/4158] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:21 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1696 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:22.902719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a57c08b6-5aa2-427a-9323-4f2a26272aad tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:22.903416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a57c08b6-5aa2-427a-9323-4f2a26272aad tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:22.927343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a57c08b6-5aa2-427a-9323-4f2a26272aad tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:22.927821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a57c08b6-5aa2-427a-9323-4f2a26272aad tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:22.936358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a57c08b6-5aa2-427a-9323-4f2a26272aad tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:22.937007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a57c08b6-5aa2-427a-9323-4f2a26272aad tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:23.279446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-761d9318-1dd7-4300-9a5f-073692e035ae tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:23.355266 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-761d9318-1dd7-4300-9a5f-073692e035ae tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1518 microversion: 2.1 time: 1.063829 Jul 25 13:01:23.355994 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2120/4159] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:22 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1518 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:23.384045 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9ae51123-3459-480a-a766-cd068f6828e9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:23.384667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9ae51123-3459-480a-a766-cd068f6828e9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:23.396641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ae51123-3459-480a-a766-cd068f6828e9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:23.397104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ae51123-3459-480a-a766-cd068f6828e9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:23.400356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ae51123-3459-480a-a766-cd068f6828e9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:23.405911 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ae51123-3459-480a-a766-cd068f6828e9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:23.407881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a57c08b6-5aa2-427a-9323-4f2a26272aad tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:23.417510 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a57c08b6-5aa2-427a-9323-4f2a26272aad tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002" status: 200 len: 1520 microversion: 2.1 time: 0.534533 Jul 25 13:01:23.438533 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2040/4160] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:22 2022] GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002 => generated 1520 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:23.575036 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9ae51123-3459-480a-a766-cd068f6828e9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:23.583248 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9ae51123-3459-480a-a766-cd068f6828e9 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a" status: 200 len: 1299 microversion: 2.1 time: 0.211716 Jul 25 13:01:23.586992 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2121/4161] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:23 2022] GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a => generated 1299 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:23.900560 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-77377501-f621-4856-b2fb-fdfdbbe42026 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:23.901187 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-77377501-f621-4856-b2fb-fdfdbbe42026 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:23.912697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77377501-f621-4856-b2fb-fdfdbbe42026 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:23.913085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77377501-f621-4856-b2fb-fdfdbbe42026 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:23.913945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77377501-f621-4856-b2fb-fdfdbbe42026 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:23.914391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77377501-f621-4856-b2fb-fdfdbbe42026 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:24.389173 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d5f156fb-e86e-462a-aead-fa05b8db36f9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:24.391640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d5f156fb-e86e-462a-aead-fa05b8db36f9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:24.406760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:24.407190 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-77377501-f621-4856-b2fb-fdfdbbe42026 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:24.426394 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-77377501-f621-4856-b2fb-fdfdbbe42026 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1694 microversion: 2.1 time: 0.533684 Jul 25 13:01:24.427294 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2041/4162] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:23 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1694 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:24.434233 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5f156fb-e86e-462a-aead-fa05b8db36f9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:24.434737 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5f156fb-e86e-462a-aead-fa05b8db36f9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:24.435528 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5f156fb-e86e-462a-aead-fa05b8db36f9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:24.436010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5f156fb-e86e-462a-aead-fa05b8db36f9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:24.448890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ca0a0531-905a-4442-82d2-fb43e6f8519d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:24.449661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ca0a0531-905a-4442-82d2-fb43e6f8519d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:24.463346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca0a0531-905a-4442-82d2-fb43e6f8519d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:24.465977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca0a0531-905a-4442-82d2-fb43e6f8519d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:24.467215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca0a0531-905a-4442-82d2-fb43e6f8519d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:24.468346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca0a0531-905a-4442-82d2-fb43e6f8519d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:25.392874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ca0a0531-905a-4442-82d2-fb43e6f8519d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:25.411241 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ca0a0531-905a-4442-82d2-fb43e6f8519d tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002" status: 200 len: 1520 microversion: 2.1 time: 0.964692 Jul 25 13:01:25.428879 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2042/4163] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:24 2022] GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002 => generated 1520 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:25.448612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1858bfda-6050-40ee-9f5f-87e6c10cb5df tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:25.451473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1858bfda-6050-40ee-9f5f-87e6c10cb5df tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:25.476829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:25.480471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1858bfda-6050-40ee-9f5f-87e6c10cb5df tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:25.483299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1858bfda-6050-40ee-9f5f-87e6c10cb5df tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:25.485094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1858bfda-6050-40ee-9f5f-87e6c10cb5df tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:25.485857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1858bfda-6050-40ee-9f5f-87e6c10cb5df tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:25.587365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1858bfda-6050-40ee-9f5f-87e6c10cb5df tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:25.590415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1858bfda-6050-40ee-9f5f-87e6c10cb5df tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:25.593402 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-1858bfda-6050-40ee-9f5f-87e6c10cb5df tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lazy-loading 'fault' on Instance uuid 1b4983b6-4749-4747-9a74-b4405b42a22a {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:01:26.099930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d5f156fb-e86e-462a-aead-fa05b8db36f9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:26.107966 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d5f156fb-e86e-462a-aead-fa05b8db36f9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1518 microversion: 2.1 time: 1.724479 Jul 25 13:01:26.108563 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2122/4164] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:24 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1518 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:26.152581 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6c9888fb-558e-4d11-9027-271a9dd1ce65 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:26.153358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6c9888fb-558e-4d11-9027-271a9dd1ce65 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:26.160078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c9888fb-558e-4d11-9027-271a9dd1ce65 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:26.160542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c9888fb-558e-4d11-9027-271a9dd1ce65 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:26.161328 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c9888fb-558e-4d11-9027-271a9dd1ce65 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:26.162431 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c9888fb-558e-4d11-9027-271a9dd1ce65 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:26.268933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1858bfda-6050-40ee-9f5f-87e6c10cb5df tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:26.283499 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1858bfda-6050-40ee-9f5f-87e6c10cb5df tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a" status: 200 len: 1304 microversion: 2.1 time: 0.852970 Jul 25 13:01:26.284013 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2043/4165] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:25 2022] GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a => generated 1304 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:26.436989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6998616d-5296-4cb2-a7a5-46b2cab98404 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:26.437705 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6998616d-5296-4cb2-a7a5-46b2cab98404 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:26.455456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6998616d-5296-4cb2-a7a5-46b2cab98404 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:26.455920 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6998616d-5296-4cb2-a7a5-46b2cab98404 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:26.456719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6998616d-5296-4cb2-a7a5-46b2cab98404 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:26.458700 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6998616d-5296-4cb2-a7a5-46b2cab98404 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:27.859059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6c9888fb-558e-4d11-9027-271a9dd1ce65 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:27.871166 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6c9888fb-558e-4d11-9027-271a9dd1ce65 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1691 microversion: 2.1 time: 1.758130 Jul 25 13:01:27.883144 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2123/4166] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:26 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1691 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:27.897648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-da35a167-c7b9-4723-9e3f-7edaed001f85 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:27.899364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-da35a167-c7b9-4723-9e3f-7edaed001f85 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:27.907499 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da35a167-c7b9-4723-9e3f-7edaed001f85 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:27.908313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da35a167-c7b9-4723-9e3f-7edaed001f85 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:27.909326 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da35a167-c7b9-4723-9e3f-7edaed001f85 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:27.910144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da35a167-c7b9-4723-9e3f-7edaed001f85 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:27.968469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6998616d-5296-4cb2-a7a5-46b2cab98404 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:27.988876 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6998616d-5296-4cb2-a7a5-46b2cab98404 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002" status: 200 len: 1497 microversion: 2.1 time: 1.556959 Jul 25 13:01:27.994882 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2044/4167] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:26 2022] GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002 => generated 1497 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:28.007408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ba2fcf00-d393-4c39-8d93-747d746e5edf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:28.008229 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ba2fcf00-d393-4c39-8d93-747d746e5edf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 1b4983b6-4749-4747-9a74-b4405b42a22a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:28.017892 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba2fcf00-d393-4c39-8d93-747d746e5edf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:28.018540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba2fcf00-d393-4c39-8d93-747d746e5edf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:28.019506 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba2fcf00-d393-4c39-8d93-747d746e5edf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:28.020058 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba2fcf00-d393-4c39-8d93-747d746e5edf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:28.065963 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-ba2fcf00-d393-4c39-8d93-747d746e5edf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] HTTP exception thrown: Instance 1b4983b6-4749-4747-9a74-b4405b42a22a could not be found. Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ba2fcf00-d393-4c39-8d93-747d746e5edf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Request method failure captured: Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a HTTP/1.1 Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pHthUWL3emuzsBs4xsDYWyXYBkhJFaBBK9FQhgh1copL5lDP9Ma5bkE_HJxjDmond706Gp-3Rif1J8B87ZUnZtsSIpcsBH62MydK_2R5OL-M6p6aAVtQ-nWL1wmPtLFtWDAiH4ULAKYIyK232aQLG-PdxvIg00u9QiVZERdPXLac10 Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: b5abf45c9ba0419c8dec07847f3ff3c5 Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerActionsTestJSON-645693881 Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b5abf45c9ba0419c8dec07847f3ff3c5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b5abf45c9ba0419c8dec07847f3ff3c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5abf45c9ba0419c8dec07847f3ff3c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5abf45c9ba0419c8dec07847f3ff3c5"}]}] Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerActionsTestJSON-645693881 Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: b5abf45c9ba0419c8dec07847f3ff3c5 Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerActionsTestJSON-645693881 Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerActionsTestJSON-645693881-project Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 4d492d20a4864908a81902f86468d437 Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerActionsTestJSON-645693881-project Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 1b4983b6-4749-4747-9a74-b4405b42a22a could not be found. Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '1b4983b6-4749-4747-9a74-b4405b42a22a'} Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b4983b6-4749-4747-9a74-b4405b42a22a could not be found. Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b4983b6-4749-4747-9a74-b4405b42a22a could not be found. Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:28.067760 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:28.072744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:28.072744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:28.072744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:28.072744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:01:28.072744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:01:28.072744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b4983b6-4749-4747-9a74-b4405b42a22a could not be found. Jul 25 13:01:28.072744 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:28.079233 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ba2fcf00-d393-4c39-8d93-747d746e5edf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Returning 404 to user: Instance 1b4983b6-4749-4747-9a74-b4405b42a22a could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:01:28.080600 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ba2fcf00-d393-4c39-8d93-747d746e5edf tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a" status: 404 len: 111 microversion: 2.1 time: 0.084477 Jul 25 13:01:28.087640 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2045/4168] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:27 2022] GET /compute/v2.1/servers/1b4983b6-4749-4747-9a74-b4405b42a22a => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:01:28.103594 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c719a68a-4120-47e4-9422-f075a0ec5474 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:28.104212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c719a68a-4120-47e4-9422-f075a0ec5474 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 3a938f7a-a9f5-4888-95f3-bde7040a576f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:28.115724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c719a68a-4120-47e4-9422-f075a0ec5474 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:28.121281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c719a68a-4120-47e4-9422-f075a0ec5474 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:28.124249 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c719a68a-4120-47e4-9422-f075a0ec5474 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:28.124942 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c719a68a-4120-47e4-9422-f075a0ec5474 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:28.195863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c719a68a-4120-47e4-9422-f075a0ec5474 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 3a938f7a-a9f5-4888-95f3-bde7040a576f] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:01:28.235965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-da35a167-c7b9-4723-9e3f-7edaed001f85 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:28.262686 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-da35a167-c7b9-4723-9e3f-7edaed001f85 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1518 microversion: 2.1 time: 0.361524 Jul 25 13:01:28.264003 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2124/4169] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:27 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1518 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:28.274768 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-49dceb16-861b-405e-a825-3b57bc0b23f4 req-46596525-5175-4120-9c67-2d2fc388fb4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a938f7a-a9f5-4888-95f3-bde7040a576f", "tag": "f572ee52-4fc3-4d61-b470-92ec430cead6"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:28.301360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-49dceb16-861b-405e-a825-3b57bc0b23f4 req-46596525-5175-4120-9c67-2d2fc388fb4c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:28.302635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-49dceb16-861b-405e-a825-3b57bc0b23f4 req-46596525-5175-4120-9c67-2d2fc388fb4c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:28.340607 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-49dceb16-861b-405e-a825-3b57bc0b23f4 req-46596525-5175-4120-9c67-2d2fc388fb4c service nova] Creating event network-changed:f572ee52-4fc3-4d61-b470-92ec430cead6 for instance 3a938f7a-a9f5-4888-95f3-bde7040a576f on n-h2-848886-15 Jul 25 13:01:28.375631 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-49dceb16-861b-405e-a825-3b57bc0b23f4 req-46596525-5175-4120-9c67-2d2fc388fb4c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109967 Jul 25 13:01:28.378336 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2125/4170] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:01:28.394934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f0ca6f78-c2cd-46ac-9999-9e42f40b1520 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:28.396532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f0ca6f78-c2cd-46ac-9999-9e42f40b1520 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:28.403472 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c719a68a-4120-47e4-9422-f075a0ec5474 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f" status: 204 len: 0 microversion: 2.1 time: 0.312714 Jul 25 13:01:28.404839 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2046/4171] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:01:28 2022] DELETE /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:01:28.420364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f0ca6f78-c2cd-46ac-9999-9e42f40b1520 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:28.424920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f0ca6f78-c2cd-46ac-9999-9e42f40b1520 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:28.426344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f0ca6f78-c2cd-46ac-9999-9e42f40b1520 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:28.427052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f0ca6f78-c2cd-46ac-9999-9e42f40b1520 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:28.432653 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-35b48f4d-bd4d-4d73-b3c1-ca7f578f2e11 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:28.458684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-35b48f4d-bd4d-4d73-b3c1-ca7f578f2e11 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:28.460068 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-35b48f4d-bd4d-4d73-b3c1-ca7f578f2e11 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '247832dc5b24483c82cddea22f81d2db'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:01:28.481096 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-35b48f4d-bd4d-4d73-b3c1-ca7f578f2e11 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:28.482178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-35b48f4d-bd4d-4d73-b3c1-ca7f578f2e11 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:28.485254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-35b48f4d-bd4d-4d73-b3c1-ca7f578f2e11 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:28.486677 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-35b48f4d-bd4d-4d73-b3c1-ca7f578f2e11 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:28.561165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-35b48f4d-bd4d-4d73-b3c1-ca7f578f2e11 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:01:28.588492 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f0ca6f78-c2cd-46ac-9999-9e42f40b1520 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "POST /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5/action" status: 204 len: 0 microversion: 2.1 time: 0.207891 Jul 25 13:01:28.590013 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2126/4172] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:01:28 2022] POST /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5/action => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:01:28.595629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5c98c6dc-b504-4e3c-9a8b-f71496055a3a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:28.596549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5c98c6dc-b504-4e3c-9a8b-f71496055a3a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:28.612027 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c98c6dc-b504-4e3c-9a8b-f71496055a3a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:28.612883 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c98c6dc-b504-4e3c-9a8b-f71496055a3a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:28.614292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c98c6dc-b504-4e3c-9a8b-f71496055a3a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:28.614987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c98c6dc-b504-4e3c-9a8b-f71496055a3a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:28.628630 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-35b48f4d-bd4d-4d73-b3c1-ca7f578f2e11 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.221292 Jul 25 13:01:28.633493 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2047/4173] 10.222.0.49 () {58 vars in 1154 bytes} [Mon Jul 25 13:01:28 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:01:28.641434 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9870c014-f3c1-4baf-8cb4-001d35dc3197 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:28.644749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9870c014-f3c1-4baf-8cb4-001d35dc3197 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 3a938f7a-a9f5-4888-95f3-bde7040a576f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:28.662487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9870c014-f3c1-4baf-8cb4-001d35dc3197 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:28.662973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9870c014-f3c1-4baf-8cb4-001d35dc3197 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:28.665999 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9870c014-f3c1-4baf-8cb4-001d35dc3197 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:28.666694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9870c014-f3c1-4baf-8cb4-001d35dc3197 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:28.698015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5c98c6dc-b504-4e3c-9a8b-f71496055a3a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:01:28.906124 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5c98c6dc-b504-4e3c-9a8b-f71496055a3a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 204 len: 0 microversion: 2.1 time: 0.314266 Jul 25 13:01:28.908232 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2127/4174] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:01:28 2022] DELETE /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:01:28.922586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-49928a50-aaa0-4d0e-882a-c852e7ead5a5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:28.924074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-49928a50-aaa0-4d0e-882a-c852e7ead5a5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:28.938210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49928a50-aaa0-4d0e-882a-c852e7ead5a5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:28.942673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49928a50-aaa0-4d0e-882a-c852e7ead5a5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:28.943792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49928a50-aaa0-4d0e-882a-c852e7ead5a5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:28.944439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49928a50-aaa0-4d0e-882a-c852e7ead5a5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:29.046456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:29.365449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9870c014-f3c1-4baf-8cb4-001d35dc3197 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:29.371083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:29.382082 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9870c014-f3c1-4baf-8cb4-001d35dc3197 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f" status: 200 len: 1764 microversion: 2.1 time: 0.747303 Jul 25 13:01:29.387337 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2048/4175] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:28 2022] GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f => generated 1764 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:29.406636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-06815b0c-8815-4d7b-a351-66594d5ff831 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:29.419101 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06815b0c-8815-4d7b-a351-66594d5ff831 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:29.419602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06815b0c-8815-4d7b-a351-66594d5ff831 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:29.486819 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-06815b0c-8815-4d7b-a351-66594d5ff831 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] Going to try to start instance {{(pid=125883) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 13:01:29.608487 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-06815b0c-8815-4d7b-a351-66594d5ff831 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "POST /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002/action" status: 202 len: 0 microversion: 2.1 time: 0.219242 Jul 25 13:01:29.612329 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2049/4176] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:01:29 2022] POST /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:01:29.619338 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9677cf4b-6620-4df9-a12e-1e4e270a9792 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:29.619338 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9677cf4b-6620-4df9-a12e-1e4e270a9792 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:29.644467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9677cf4b-6620-4df9-a12e-1e4e270a9792 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:29.645137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9677cf4b-6620-4df9-a12e-1e4e270a9792 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:29.646143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9677cf4b-6620-4df9-a12e-1e4e270a9792 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:29.650079 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9677cf4b-6620-4df9-a12e-1e4e270a9792 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:29.672596 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-49928a50-aaa0-4d0e-882a-c852e7ead5a5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:29.686525 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-49928a50-aaa0-4d0e-882a-c852e7ead5a5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1691 microversion: 2.1 time: 0.776509 Jul 25 13:01:29.687202 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2128/4177] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:28 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1691 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:29.699979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-61792894-c517-4e8c-bd9f-56c13ad0f79b req-2cf02b00-43e2-4ab3-8250-6f39580a36f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7954e97-a6c3-4017-a41d-2e61083c6ab5", "name": "network-vif-plugged", "status": "completed", "tag": "47fb272d-6ac9-419c-81e1-c632660c9f57"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:29.724658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-61792894-c517-4e8c-bd9f-56c13ad0f79b req-2cf02b00-43e2-4ab3-8250-6f39580a36f1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:29.725333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-61792894-c517-4e8c-bd9f-56c13ad0f79b req-2cf02b00-43e2-4ab3-8250-6f39580a36f1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:29.770547 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-61792894-c517-4e8c-bd9f-56c13ad0f79b req-2cf02b00-43e2-4ab3-8250-6f39580a36f1 service nova] Creating event network-vif-plugged:47fb272d-6ac9-419c-81e1-c632660c9f57 for instance d7954e97-a6c3-4017-a41d-2e61083c6ab5 on n-h1-848886-15 Jul 25 13:01:29.800692 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [req-61792894-c517-4e8c-bd9f-56c13ad0f79b req-2cf02b00-43e2-4ab3-8250-6f39580a36f1 service nova] Instance d7954e97-a6c3-4017-a41d-2e61083c6ab5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:01:29.850383 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-61792894-c517-4e8c-bd9f-56c13ad0f79b req-2cf02b00-43e2-4ab3-8250-6f39580a36f1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158005 Jul 25 13:01:29.852085 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2129/4178] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:01:29.871412 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c0f08b2d-b22e-4d0b-a0b6-406e39dc75bc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:29.874934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c0f08b2d-b22e-4d0b-a0b6-406e39dc75bc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:29.904937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c0f08b2d-b22e-4d0b-a0b6-406e39dc75bc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:29.905530 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c0f08b2d-b22e-4d0b-a0b6-406e39dc75bc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:29.906360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c0f08b2d-b22e-4d0b-a0b6-406e39dc75bc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:29.907100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c0f08b2d-b22e-4d0b-a0b6-406e39dc75bc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:30.345007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9677cf4b-6620-4df9-a12e-1e4e270a9792 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:30.362250 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9677cf4b-6620-4df9-a12e-1e4e270a9792 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1495 microversion: 2.1 time: 0.743893 Jul 25 13:01:30.363421 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2050/4179] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:29 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1495 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:30.372244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-52b7ed14-ae31-4230-a903-4e7abec8c217 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:30.373066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-52b7ed14-ae31-4230-a903-4e7abec8c217 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:30.382057 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-52b7ed14-ae31-4230-a903-4e7abec8c217 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:30.382516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-52b7ed14-ae31-4230-a903-4e7abec8c217 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:30.383322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-52b7ed14-ae31-4230-a903-4e7abec8c217 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:30.383779 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-52b7ed14-ae31-4230-a903-4e7abec8c217 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:31.292190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c0f08b2d-b22e-4d0b-a0b6-406e39dc75bc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:31.334774 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c0f08b2d-b22e-4d0b-a0b6-406e39dc75bc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1518 microversion: 2.1 time: 1.480174 Jul 25 13:01:31.351455 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2130/4180] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:29 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1518 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:31.385506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0ea63d05-5359-41bf-8bf1-f73adc0885d8 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:31.387850 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0ea63d05-5359-41bf-8bf1-f73adc0885d8 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 3a938f7a-a9f5-4888-95f3-bde7040a576f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:31.412882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ea63d05-5359-41bf-8bf1-f73adc0885d8 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:31.413639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ea63d05-5359-41bf-8bf1-f73adc0885d8 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:31.415252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ea63d05-5359-41bf-8bf1-f73adc0885d8 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:31.415876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ea63d05-5359-41bf-8bf1-f73adc0885d8 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:31.475752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-52b7ed14-ae31-4230-a903-4e7abec8c217 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:31.490824 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-52b7ed14-ae31-4230-a903-4e7abec8c217 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002" status: 200 len: 1506 microversion: 2.1 time: 1.126203 Jul 25 13:01:31.491748 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2051/4181] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:30 2022] GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002 => generated 1506 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:31.510921 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4d262dfe-31a5-42f1-a9c8-8a9b7b51d457 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:31.511908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4d262dfe-31a5-42f1-a9c8-8a9b7b51d457 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:31.558850 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4d262dfe-31a5-42f1-a9c8-8a9b7b51d457 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:31.562271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4d262dfe-31a5-42f1-a9c8-8a9b7b51d457 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:31.563817 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4d262dfe-31a5-42f1-a9c8-8a9b7b51d457 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:31.567768 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4d262dfe-31a5-42f1-a9c8-8a9b7b51d457 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:32.600635 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4d262dfe-31a5-42f1-a9c8-8a9b7b51d457 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:32.608355 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4d262dfe-31a5-42f1-a9c8-8a9b7b51d457 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1691 microversion: 2.1 time: 1.115069 Jul 25 13:01:32.609030 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2052/4182] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:31 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1691 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:32.619305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5f7253d2-8dc6-4d06-9207-6fa7b97afc9e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:32.619937 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5f7253d2-8dc6-4d06-9207-6fa7b97afc9e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:32.639350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f7253d2-8dc6-4d06-9207-6fa7b97afc9e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:32.639880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f7253d2-8dc6-4d06-9207-6fa7b97afc9e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:32.640716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f7253d2-8dc6-4d06-9207-6fa7b97afc9e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:32.641159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f7253d2-8dc6-4d06-9207-6fa7b97afc9e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:32.650263 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0ea63d05-5359-41bf-8bf1-f73adc0885d8 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad62262b424640728ef148dfaae6e074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb007c5b5f894bc0a31b2c166b53adac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:32.666322 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0ea63d05-5359-41bf-8bf1-f73adc0885d8 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f" status: 200 len: 1764 microversion: 2.1 time: 1.310365 Jul 25 13:01:32.667702 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2131/4183] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:31 2022] GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f => generated 1764 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:32.679134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-eddea255-e782-4a28-85e5-9c5354c686f9 req-57772f65-1b2b-4133-a25d-25d00fc7a5ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a938f7a-a9f5-4888-95f3-bde7040a576f", "name": "network-vif-deleted", "tag": "f572ee52-4fc3-4d61-b470-92ec430cead6"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:32.704925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-eddea255-e782-4a28-85e5-9c5354c686f9 req-57772f65-1b2b-4133-a25d-25d00fc7a5ad service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:32.708131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-eddea255-e782-4a28-85e5-9c5354c686f9 req-57772f65-1b2b-4133-a25d-25d00fc7a5ad service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:32.739345 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-eddea255-e782-4a28-85e5-9c5354c686f9 req-57772f65-1b2b-4133-a25d-25d00fc7a5ad service nova] Creating event network-vif-deleted:f572ee52-4fc3-4d61-b470-92ec430cead6 for instance 3a938f7a-a9f5-4888-95f3-bde7040a576f on n-h2-848886-15 Jul 25 13:01:32.757148 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-eddea255-e782-4a28-85e5-9c5354c686f9 req-57772f65-1b2b-4133-a25d-25d00fc7a5ad service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086238 Jul 25 13:01:32.759136 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2132/4184] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:01:32.765394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a502fb07-d986-43e3-bece-55eef81edd41 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:32.766793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a502fb07-d986-43e3-bece-55eef81edd41 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:32.775206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a502fb07-d986-43e3-bece-55eef81edd41 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:32.776041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a502fb07-d986-43e3-bece-55eef81edd41 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:32.777989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a502fb07-d986-43e3-bece-55eef81edd41 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:32.779206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a502fb07-d986-43e3-bece-55eef81edd41 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:33.193621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a502fb07-d986-43e3-bece-55eef81edd41 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:33.226351 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a502fb07-d986-43e3-bece-55eef81edd41 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1518 microversion: 2.1 time: 0.453285 Jul 25 13:01:33.227336 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2133/4185] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:32 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1518 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:33.238948 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-86ac91b8-ec03-441b-add4-bb2034c6a8c4 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:33.239979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-86ac91b8-ec03-441b-add4-bb2034c6a8c4 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:33.258597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-86ac91b8-ec03-441b-add4-bb2034c6a8c4 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:33.270621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-86ac91b8-ec03-441b-add4-bb2034c6a8c4 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:33.271784 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-86ac91b8-ec03-441b-add4-bb2034c6a8c4 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:33.272390 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-86ac91b8-ec03-441b-add4-bb2034c6a8c4 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:33.428683 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5f7253d2-8dc6-4d06-9207-6fa7b97afc9e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:33.457080 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5f7253d2-8dc6-4d06-9207-6fa7b97afc9e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1495 microversion: 2.1 time: 0.845861 Jul 25 13:01:33.477072 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2053/4186] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:32 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1495 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:33.635488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b540fc6b-6f9d-4d4d-847a-8eb5c9e0f4af tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:33.636949 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b540fc6b-6f9d-4d4d-847a-8eb5c9e0f4af tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:33.650103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b540fc6b-6f9d-4d4d-847a-8eb5c9e0f4af tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:33.650952 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b540fc6b-6f9d-4d4d-847a-8eb5c9e0f4af tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:33.652149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b540fc6b-6f9d-4d4d-847a-8eb5c9e0f4af tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:33.655182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b540fc6b-6f9d-4d4d-847a-8eb5c9e0f4af tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:33.978671 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-86ac91b8-ec03-441b-add4-bb2034c6a8c4 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:33.989879 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-86ac91b8-ec03-441b-add4-bb2034c6a8c4 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002" status: 200 len: 1510 microversion: 2.1 time: 0.754754 Jul 25 13:01:34.002818 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2134/4187] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:33 2022] GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002 => generated 1510 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:34.016597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-708c1041-19d8-4dc4-bd7d-3414d27de44d tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:34.017237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-708c1041-19d8-4dc4-bd7d-3414d27de44d tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] [instance: 3a938f7a-a9f5-4888-95f3-bde7040a576f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:34.025179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-708c1041-19d8-4dc4-bd7d-3414d27de44d tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:34.025823 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-708c1041-19d8-4dc4-bd7d-3414d27de44d tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:34.026800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-708c1041-19d8-4dc4-bd7d-3414d27de44d tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:34.027379 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-708c1041-19d8-4dc4-bd7d-3414d27de44d tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:34.066758 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-708c1041-19d8-4dc4-bd7d-3414d27de44d tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] HTTP exception thrown: Instance 3a938f7a-a9f5-4888-95f3-bde7040a576f could not be found. Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-708c1041-19d8-4dc4-bd7d-3414d27de44d tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Request method failure captured: Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f HTTP/1.1 Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pOYSDLaTcDk9NR6BlQNDDk1JhSLw3Ju589ZGBWx37k3OJFyWLkl9eF05LIxoe6iyj5FTSNOeNsXKdWNsHSTopH1jC4jEARJlxQv6qByazO0Nq7s7ql6JfXXkqi7CFeoBLUvtb5-GePfOSUOG8j8ZHbabW7-9WvZEAhzl8lRjVN3OAc Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: bb007c5b5f894bc0a31b2c166b53adac Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-749125150 Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bb007c5b5f894bc0a31b2c166b53adac", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bb007c5b5f894bc0a31b2c166b53adac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bb007c5b5f894bc0a31b2c166b53adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bb007c5b5f894bc0a31b2c166b53adac"}]}] Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestSecurityGroupsBasicOps-749125150 Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: bb007c5b5f894bc0a31b2c166b53adac Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-749125150 Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestSecurityGroupsBasicOps-749125150-project Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: ad62262b424640728ef148dfaae6e074 Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestSecurityGroupsBasicOps-749125150-project Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 3a938f7a-a9f5-4888-95f3-bde7040a576f could not be found. Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '3a938f7a-a9f5-4888-95f3-bde7040a576f'} Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a938f7a-a9f5-4888-95f3-bde7040a576f could not be found. Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a938f7a-a9f5-4888-95f3-bde7040a576f could not be found. Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:34.067837 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:34.072844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:34.072844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:34.072844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:34.072844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:01:34.072844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:01:34.072844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a938f7a-a9f5-4888-95f3-bde7040a576f could not be found. Jul 25 13:01:34.072844 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:34.074398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-708c1041-19d8-4dc4-bd7d-3414d27de44d tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Returning 404 to user: Instance 3a938f7a-a9f5-4888-95f3-bde7040a576f could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:01:34.075268 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-708c1041-19d8-4dc4-bd7d-3414d27de44d tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f" status: 404 len: 111 microversion: 2.1 time: 0.071212 Jul 25 13:01:34.075841 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2135/4188] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:34 2022] GET /compute/v2.1/servers/3a938f7a-a9f5-4888-95f3-bde7040a576f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:01:34.080504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7644cbfe-61bb-416a-8e13-4f42e801e631 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:34.085494 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7644cbfe-61bb-416a-8e13-4f42e801e631 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:34.085958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.compute.servers [None req-7644cbfe-61bb-416a-8e13-4f42e801e631 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Removing options 'limit' from query {{(pid=125884) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 25 13:01:34.086905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7644cbfe-61bb-416a-8e13-4f42e801e631 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Searching by: {'deleted': False, 'project_id': '247832dc5b24483c82cddea22f81d2db'} {{(pid=125884) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:01:34.088702 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7644cbfe-61bb-416a-8e13-4f42e801e631 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:34.089388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7644cbfe-61bb-416a-8e13-4f42e801e631 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:34.090611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7644cbfe-61bb-416a-8e13-4f42e801e631 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:34.091050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7644cbfe-61bb-416a-8e13-4f42e801e631 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:34.095509 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7644cbfe-61bb-416a-8e13-4f42e801e631 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.018162 Jul 25 13:01:34.106796 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2136/4189] 10.222.0.49 () {58 vars in 1140 bytes} [Mon Jul 25 13:01:34 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 13:01:34.112400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-40f5afc6-5225-48ac-aaf7-c7fae23283cb tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:34.113380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-40f5afc6-5225-48ac-aaf7-c7fae23283cb tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:34.137367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40f5afc6-5225-48ac-aaf7-c7fae23283cb tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:34.138750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40f5afc6-5225-48ac-aaf7-c7fae23283cb tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:34.145146 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40f5afc6-5225-48ac-aaf7-c7fae23283cb tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:34.145744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40f5afc6-5225-48ac-aaf7-c7fae23283cb tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:34.359614 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b540fc6b-6f9d-4d4d-847a-8eb5c9e0f4af tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:34.398173 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b540fc6b-6f9d-4d4d-847a-8eb5c9e0f4af tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1691 microversion: 2.1 time: 0.752686 Jul 25 13:01:34.417987 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2054/4190] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:33 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1691 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:34.434158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-caf4df25-6953-4691-8608-0139ea90a04c req-9a2c9646-6fbd-4dcc-90f9-9b9167aca0f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf29727-b5cc-4bb2-bbcc-74686ddd22a2", "name": "network-vif-deleted", "tag": "38b4c3eb-5cea-4889-accc-076c98a9feed"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:34.484678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-caf4df25-6953-4691-8608-0139ea90a04c req-9a2c9646-6fbd-4dcc-90f9-9b9167aca0f8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:34.485146 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-caf4df25-6953-4691-8608-0139ea90a04c req-9a2c9646-6fbd-4dcc-90f9-9b9167aca0f8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:34.503306 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-caf4df25-6953-4691-8608-0139ea90a04c req-9a2c9646-6fbd-4dcc-90f9-9b9167aca0f8 service nova] Creating event network-vif-deleted:38b4c3eb-5cea-4889-accc-076c98a9feed for instance 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 on n-h2-848886-15 Jul 25 13:01:34.511955 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-caf4df25-6953-4691-8608-0139ea90a04c req-9a2c9646-6fbd-4dcc-90f9-9b9167aca0f8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092432 Jul 25 13:01:34.513339 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2055/4191] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:01:34.520034 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5caffaca-4c17-453a-80bc-b185569df218 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:34.521373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5caffaca-4c17-453a-80bc-b185569df218 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:34.541330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5caffaca-4c17-453a-80bc-b185569df218 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:34.543419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5caffaca-4c17-453a-80bc-b185569df218 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:34.544405 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5caffaca-4c17-453a-80bc-b185569df218 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:34.545470 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5caffaca-4c17-453a-80bc-b185569df218 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:34.837362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-40f5afc6-5225-48ac-aaf7-c7fae23283cb tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:34.849070 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-40f5afc6-5225-48ac-aaf7-c7fae23283cb tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002" status: 200 len: 1510 microversion: 2.1 time: 0.740561 Jul 25 13:01:34.858412 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2137/4192] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:34 2022] GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002 => generated 1510 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:34.876331 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e79d0c28-5185-4248-a00f-35536954e6c4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:34.876331 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e79d0c28-5185-4248-a00f-35536954e6c4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:34.908274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e79d0c28-5185-4248-a00f-35536954e6c4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:34.912349 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e79d0c28-5185-4248-a00f-35536954e6c4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:34.913478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e79d0c28-5185-4248-a00f-35536954e6c4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:34.914115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e79d0c28-5185-4248-a00f-35536954e6c4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:34.995943 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5caffaca-4c17-453a-80bc-b185569df218 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:35.010536 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5caffaca-4c17-453a-80bc-b185569df218 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1518 microversion: 2.1 time: 0.494272 Jul 25 13:01:35.013414 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2056/4193] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:34 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1518 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:35.022285 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-86b46723-8d86-4fca-ac79-af94c03d3370 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:35.023271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-86b46723-8d86-4fca-ac79-af94c03d3370 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e8b5f22f-b68b-4533-8bbf-a94da6b3f872] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:35.040334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e79d0c28-5185-4248-a00f-35536954e6c4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:35.040911 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e79d0c28-5185-4248-a00f-35536954e6c4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:35.041493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-e79d0c28-5185-4248-a00f-35536954e6c4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lazy-loading 'fault' on Instance uuid 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:01:35.054321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86b46723-8d86-4fca-ac79-af94c03d3370 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:35.055621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86b46723-8d86-4fca-ac79-af94c03d3370 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:35.058586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86b46723-8d86-4fca-ac79-af94c03d3370 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:35.059235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86b46723-8d86-4fca-ac79-af94c03d3370 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:35.420646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e79d0c28-5185-4248-a00f-35536954e6c4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:35.428385 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e79d0c28-5185-4248-a00f-35536954e6c4 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 200 len: 1305 microversion: 2.1 time: 0.568667 Jul 25 13:01:35.428967 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2138/4194] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:34 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 1305 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:35.449181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-79210684-b1fb-4fcb-b416-0c93d5beeb3d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:35.449868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-79210684-b1fb-4fcb-b416-0c93d5beeb3d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:35.457961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-79210684-b1fb-4fcb-b416-0c93d5beeb3d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:35.458710 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-79210684-b1fb-4fcb-b416-0c93d5beeb3d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:35.459672 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-79210684-b1fb-4fcb-b416-0c93d5beeb3d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:35.460276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-79210684-b1fb-4fcb-b416-0c93d5beeb3d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:36.166733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-86b46723-8d86-4fca-ac79-af94c03d3370 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:36.189495 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-86b46723-8d86-4fca-ac79-af94c03d3370 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e8b5f22f-b68b-4533-8bbf-a94da6b3f872" status: 200 len: 1510 microversion: 2.1 time: 1.174583 Jul 25 13:01:36.190394 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2057/4195] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:35 2022] GET /compute/v2.1/servers/e8b5f22f-b68b-4533-8bbf-a94da6b3f872 => generated 1510 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:36.202232 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f9a15b9d-ca7a-4a7f-a9e3-bfc3705b9f92 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:36.205339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f9a15b9d-ca7a-4a7f-a9e3-bfc3705b9f92 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:36.227852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9a15b9d-ca7a-4a7f-a9e3-bfc3705b9f92 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:36.229321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9a15b9d-ca7a-4a7f-a9e3-bfc3705b9f92 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:36.230546 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9a15b9d-ca7a-4a7f-a9e3-bfc3705b9f92 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:36.231467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9a15b9d-ca7a-4a7f-a9e3-bfc3705b9f92 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:36.249230 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-79210684-b1fb-4fcb-b416-0c93d5beeb3d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:36.264299 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-79210684-b1fb-4fcb-b416-0c93d5beeb3d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1683 microversion: 2.1 time: 0.820402 Jul 25 13:01:36.270694 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2139/4196] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:35 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1683 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:36.279565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7110c513-d21a-465f-8399-250c82195fa7 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:36.280532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7110c513-d21a-465f-8399-250c82195fa7 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e0726aaf-f183-465c-ac33-313fd7858542] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:36.292491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7110c513-d21a-465f-8399-250c82195fa7 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:36.292974 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7110c513-d21a-465f-8399-250c82195fa7 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:36.293866 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7110c513-d21a-465f-8399-250c82195fa7 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:36.294372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7110c513-d21a-465f-8399-250c82195fa7 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:36.615134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f9a15b9d-ca7a-4a7f-a9e3-bfc3705b9f92 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:36.628994 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f9a15b9d-ca7a-4a7f-a9e3-bfc3705b9f92 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1518 microversion: 2.1 time: 0.436523 Jul 25 13:01:36.642633 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2058/4197] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:36 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1518 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:36.651531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6c0ee551-ede2-48ed-bac7-fc944952cd4e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:36.652056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6c0ee551-ede2-48ed-bac7-fc944952cd4e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:36.656506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7110c513-d21a-465f-8399-250c82195fa7 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:36.664250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c0ee551-ede2-48ed-bac7-fc944952cd4e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:36.664755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c0ee551-ede2-48ed-bac7-fc944952cd4e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:36.665539 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c0ee551-ede2-48ed-bac7-fc944952cd4e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:36.666557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c0ee551-ede2-48ed-bac7-fc944952cd4e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:36.669009 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7110c513-d21a-465f-8399-250c82195fa7 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542" status: 200 len: 1511 microversion: 2.1 time: 0.396654 Jul 25 13:01:36.669771 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2140/4198] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:36 2022] GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542 => generated 1511 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:36.684757 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-6c0ee551-ede2-48ed-bac7-fc944952cd4e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] HTTP exception thrown: Instance 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 could not be found. Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6c0ee551-ede2-48ed-bac7-fc944952cd4e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Request method failure captured: Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 HTTP/1.1 Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pHthUWL3emuzsBs4xsDYWyXYBkhJFaBBK9FQhgh1copL5lDP9Ma5bkE_HJxjDmond706Gp-3Rif1J8B87ZUnZtsSIpcsBH62MydK_2R5OL-M6p6aAVtQ-nWL1wmPtLFtWDAiH4ULAKYIyK232aQLG-PdxvIg00u9QiVZERdPXLac10 Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: b5abf45c9ba0419c8dec07847f3ff3c5 Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerActionsTestJSON-645693881 Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b5abf45c9ba0419c8dec07847f3ff3c5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b5abf45c9ba0419c8dec07847f3ff3c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5abf45c9ba0419c8dec07847f3ff3c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5abf45c9ba0419c8dec07847f3ff3c5"}]}] Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerActionsTestJSON-645693881 Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: b5abf45c9ba0419c8dec07847f3ff3c5 Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerActionsTestJSON-645693881 Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerActionsTestJSON-645693881-project Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 4d492d20a4864908a81902f86468d437 Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerActionsTestJSON-645693881-project Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 could not be found. Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '9bf29727-b5cc-4bb2-bbcc-74686ddd22a2'} Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 could not be found. Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 could not be found. Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:36.686773 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:36.691089 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:36.691089 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:36.691089 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:36.691089 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:01:36.691089 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:01:36.691089 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 could not be found. Jul 25 13:01:36.691089 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:36.692785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6c0ee551-ede2-48ed-bac7-fc944952cd4e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Returning 404 to user: Instance 9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:01:36.693773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b3c4f6d7-110c-4ae2-9ab0-feb8e4a4881b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:36.694044 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6c0ee551-ede2-48ed-bac7-fc944952cd4e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2" status: 404 len: 111 microversion: 2.1 time: 0.050101 Jul 25 13:01:36.697391 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2059/4199] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:36 2022] GET /compute/v2.1/servers/9bf29727-b5cc-4bb2-bbcc-74686ddd22a2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:01:36.699104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b3c4f6d7-110c-4ae2-9ab0-feb8e4a4881b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:36.699772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b3c4f6d7-110c-4ae2-9ab0-feb8e4a4881b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Searching by: {'ip': '172.20.0.7', 'deleted': False, 'project_id': '247832dc5b24483c82cddea22f81d2db'} {{(pid=125884) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:01:36.702733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c4d7d0ee-632c-4d90-94df-2010e5f3271a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:36.704094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c4d7d0ee-632c-4d90-94df-2010e5f3271a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:36.712649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4d7d0ee-632c-4d90-94df-2010e5f3271a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:36.713327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4d7d0ee-632c-4d90-94df-2010e5f3271a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:36.714369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4d7d0ee-632c-4d90-94df-2010e5f3271a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:36.714965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4d7d0ee-632c-4d90-94df-2010e5f3271a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:36.752024 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c4d7d0ee-632c-4d90-94df-2010e5f3271a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:01:36.858183 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c4d7d0ee-632c-4d90-94df-2010e5f3271a tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 204 len: 0 microversion: 2.1 time: 0.158401 Jul 25 13:01:36.859985 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2060/4200] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:01:36 2022] DELETE /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:01:36.872035 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5ef6c213-8313-417f-b672-a69cf3a7c1a3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:36.872932 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5ef6c213-8313-417f-b672-a69cf3a7c1a3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:36.882607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ef6c213-8313-417f-b672-a69cf3a7c1a3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:36.883322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ef6c213-8313-417f-b672-a69cf3a7c1a3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:36.884204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b3c4f6d7-110c-4ae2-9ab0-feb8e4a4881b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:36.884550 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ef6c213-8313-417f-b672-a69cf3a7c1a3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:36.885153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ef6c213-8313-417f-b672-a69cf3a7c1a3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:36.885656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b3c4f6d7-110c-4ae2-9ab0-feb8e4a4881b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:36.886710 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b3c4f6d7-110c-4ae2-9ab0-feb8e4a4881b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:36.887274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b3c4f6d7-110c-4ae2-9ab0-feb8e4a4881b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:36.995724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.multi_cell_list [None req-b3c4f6d7-110c-4ae2-9ab0-feb8e4a4881b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:01:37.096051 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b3c4f6d7-110c-4ae2-9ab0-feb8e4a4881b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers?ip=172.20.0.7" status: 200 len: 345 microversion: 2.1 time: 0.405376 Jul 25 13:01:37.097916 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2141/4201] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 13:01:36 2022] GET /compute/v2.1/servers?ip=172.20.0.7 => generated 345 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:01:37.114299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ff63db2b-65bc-46b7-8d53-ef9567b0829a tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:37.115413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ff63db2b-65bc-46b7-8d53-ef9567b0829a tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:37.126668 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff63db2b-65bc-46b7-8d53-ef9567b0829a tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:37.128700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff63db2b-65bc-46b7-8d53-ef9567b0829a tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:37.130310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff63db2b-65bc-46b7-8d53-ef9567b0829a tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:37.131229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff63db2b-65bc-46b7-8d53-ef9567b0829a tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:37.154569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5ef6c213-8313-417f-b672-a69cf3a7c1a3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:37.166815 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5ef6c213-8313-417f-b672-a69cf3a7c1a3 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1675 microversion: 2.1 time: 0.299921 Jul 25 13:01:37.167802 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2061/4202] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:36 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1675 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:37.490643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ff63db2b-65bc-46b7-8d53-ef9567b0829a tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:37.509653 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ff63db2b-65bc-46b7-8d53-ef9567b0829a tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002" status: 200 len: 1510 microversion: 2.1 time: 0.398757 Jul 25 13:01:37.512347 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2142/4203] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:37 2022] GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002 => generated 1510 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:37.550216 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8b39b6aa-bff9-4a06-858d-a47666b899c0 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:37.551344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8b39b6aa-bff9-4a06-858d-a47666b899c0 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e8b5f22f-b68b-4533-8bbf-a94da6b3f872] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:37.559162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b39b6aa-bff9-4a06-858d-a47666b899c0 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:37.560131 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b39b6aa-bff9-4a06-858d-a47666b899c0 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:37.561118 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b39b6aa-bff9-4a06-858d-a47666b899c0 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:37.561998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b39b6aa-bff9-4a06-858d-a47666b899c0 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:37.666436 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-60f36278-02c9-4aed-92f6-5cf30f425da9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:37.668309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-60f36278-02c9-4aed-92f6-5cf30f425da9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:37.684192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-60f36278-02c9-4aed-92f6-5cf30f425da9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:37.699742 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-60f36278-02c9-4aed-92f6-5cf30f425da9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:37.703815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-60f36278-02c9-4aed-92f6-5cf30f425da9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:37.707063 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-60f36278-02c9-4aed-92f6-5cf30f425da9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:37.969864 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8b39b6aa-bff9-4a06-858d-a47666b899c0 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:37.982570 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8b39b6aa-bff9-4a06-858d-a47666b899c0 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e8b5f22f-b68b-4533-8bbf-a94da6b3f872" status: 200 len: 1510 microversion: 2.1 time: 0.436712 Jul 25 13:01:37.984772 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2062/4204] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:37 2022] GET /compute/v2.1/servers/e8b5f22f-b68b-4533-8bbf-a94da6b3f872 => generated 1510 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:38.014153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a9989030-6685-42e7-9d97-c501e65bfcd8 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:38.016075 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a9989030-6685-42e7-9d97-c501e65bfcd8 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e0726aaf-f183-465c-ac33-313fd7858542] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:38.029784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9989030-6685-42e7-9d97-c501e65bfcd8 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:38.031956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9989030-6685-42e7-9d97-c501e65bfcd8 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:38.037104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9989030-6685-42e7-9d97-c501e65bfcd8 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:38.038025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9989030-6685-42e7-9d97-c501e65bfcd8 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:38.078565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-60f36278-02c9-4aed-92f6-5cf30f425da9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:38.087209 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-60f36278-02c9-4aed-92f6-5cf30f425da9 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1518 microversion: 2.1 time: 0.433731 Jul 25 13:01:38.103198 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2143/4205] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:37 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1518 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:38.187767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d8a68b9a-eef5-4213-8b32-098d078220b7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:38.188373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d8a68b9a-eef5-4213-8b32-098d078220b7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:38.195124 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8a68b9a-eef5-4213-8b32-098d078220b7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:38.195851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8a68b9a-eef5-4213-8b32-098d078220b7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:38.196845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8a68b9a-eef5-4213-8b32-098d078220b7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:38.197509 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8a68b9a-eef5-4213-8b32-098d078220b7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:38.370660 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a9989030-6685-42e7-9d97-c501e65bfcd8 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:38.389196 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a9989030-6685-42e7-9d97-c501e65bfcd8 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542" status: 200 len: 1511 microversion: 2.1 time: 0.386719 Jul 25 13:01:38.391363 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2063/4206] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:37 2022] GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542 => generated 1511 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:38.420066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a953f3d0-de56-4064-9c10-a6dc1ef94c68 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:38.436197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a953f3d0-de56-4064-9c10-a6dc1ef94c68 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:38.444190 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a953f3d0-de56-4064-9c10-a6dc1ef94c68 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Searching by: {'deleted': False, 'project_id': '247832dc5b24483c82cddea22f81d2db'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:01:38.452790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a953f3d0-de56-4064-9c10-a6dc1ef94c68 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:38.453414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a953f3d0-de56-4064-9c10-a6dc1ef94c68 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:38.455470 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a953f3d0-de56-4064-9c10-a6dc1ef94c68 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:38.456083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a953f3d0-de56-4064-9c10-a6dc1ef94c68 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:38.477613 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:38.496718 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-a953f3d0-de56-4064-9c10-a6dc1ef94c68 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:01:38.558226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a953f3d0-de56-4064-9c10-a6dc1ef94c68 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:38.567778 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a953f3d0-de56-4064-9c10-a6dc1ef94c68 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:38.568339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a953f3d0-de56-4064-9c10-a6dc1ef94c68 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:39.049164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d8a68b9a-eef5-4213-8b32-098d078220b7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:39.061816 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d8a68b9a-eef5-4213-8b32-098d078220b7 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1675 microversion: 2.1 time: 0.877800 Jul 25 13:01:39.063802 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2144/4207] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:38 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1675 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:39.116310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2e1cc2b3-bfb2-41f3-9d77-434b1c8d8d8d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:39.117233 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2e1cc2b3-bfb2-41f3-9d77-434b1c8d8d8d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:39.125292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2e1cc2b3-bfb2-41f3-9d77-434b1c8d8d8d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:39.127091 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2e1cc2b3-bfb2-41f3-9d77-434b1c8d8d8d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:39.128105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2e1cc2b3-bfb2-41f3-9d77-434b1c8d8d8d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:39.128791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2e1cc2b3-bfb2-41f3-9d77-434b1c8d8d8d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:39.338544 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a953f3d0-de56-4064-9c10-a6dc1ef94c68 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 4514 microversion: 2.1 time: 0.923451 Jul 25 13:01:39.356773 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2064/4208] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 13:01:38 2022] GET /compute/v2.1/servers/detail => generated 4514 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:39.370827 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-11882250-14b5-435a-9182-97438b735ad5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:39.379508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-11882250-14b5-435a-9182-97438b735ad5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:39.380393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-11882250-14b5-435a-9182-97438b735ad5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '247832dc5b24483c82cddea22f81d2db'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:01:39.575765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2e1cc2b3-bfb2-41f3-9d77-434b1c8d8d8d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:39.588281 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2e1cc2b3-bfb2-41f3-9d77-434b1c8d8d8d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1518 microversion: 2.1 time: 0.477348 Jul 25 13:01:39.590717 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2145/4209] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:39 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1518 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:39.607999 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-11882250-14b5-435a-9182-97438b735ad5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:39.608794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-11882250-14b5-435a-9182-97438b735ad5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:39.613689 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-11882250-14b5-435a-9182-97438b735ad5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:39.616173 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-11882250-14b5-435a-9182-97438b735ad5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:39.763472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-11882250-14b5-435a-9182-97438b735ad5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:01:39.840800 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-11882250-14b5-435a-9182-97438b735ad5 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.475661 Jul 25 13:01:39.845886 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2065/4210] 10.222.0.49 () {58 vars in 1150 bytes} [Mon Jul 25 13:01:39 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:39.857036 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-34d6111f-b1a2-424a-8850-4046abf54297 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:39.864366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-34d6111f-b1a2-424a-8850-4046abf54297 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:39.865342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-34d6111f-b1a2-424a-8850-4046abf54297 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '247832dc5b24483c82cddea22f81d2db'} {{(pid=125884) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:01:39.872214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-34d6111f-b1a2-424a-8850-4046abf54297 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:39.873309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-34d6111f-b1a2-424a-8850-4046abf54297 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:39.874371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-34d6111f-b1a2-424a-8850-4046abf54297 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:39.875417 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-34d6111f-b1a2-424a-8850-4046abf54297 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:39.982986 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.multi_cell_list [None req-34d6111f-b1a2-424a-8850-4046abf54297 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:01:40.034120 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:40.053898 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-34d6111f-b1a2-424a-8850-4046abf54297 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.200691 Jul 25 13:01:40.061634 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2146/4211] 10.222.0.49 () {58 vars in 1212 bytes} [Mon Jul 25 13:01:39 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:40.066601 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1105355a-5ecc-421e-8f92-87242c06c155 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:40.071634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1105355a-5ecc-421e-8f92-87242c06c155 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:40.075568 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1105355a-5ecc-421e-8f92-87242c06c155 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '247832dc5b24483c82cddea22f81d2db'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:01:40.085855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c7fb93fc-a669-4947-9431-37c2f7ca0fd2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:40.086628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c7fb93fc-a669-4947-9431-37c2f7ca0fd2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:40.088860 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1105355a-5ecc-421e-8f92-87242c06c155 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:40.089497 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1105355a-5ecc-421e-8f92-87242c06c155 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:40.090710 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1105355a-5ecc-421e-8f92-87242c06c155 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:40.092931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1105355a-5ecc-421e-8f92-87242c06c155 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:40.100384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7fb93fc-a669-4947-9431-37c2f7ca0fd2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:40.100864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7fb93fc-a669-4947-9431-37c2f7ca0fd2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:40.101665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7fb93fc-a669-4947-9431-37c2f7ca0fd2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:40.102129 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7fb93fc-a669-4947-9431-37c2f7ca0fd2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:40.336974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-1105355a-5ecc-421e-8f92-87242c06c155 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:01:40.483997 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1105355a-5ecc-421e-8f92-87242c06c155 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.415147 Jul 25 13:01:40.487551 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2066/4212] 10.222.0.49 () {58 vars in 1196 bytes} [Mon Jul 25 13:01:40 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:40.495936 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-0181be2d-5a2a-4a04-aea3-921675fb5364 req-4bba2a51-c266-46c1-8d00-ea7caa5a43da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2", "name": "network-vif-plugged", "status": "completed", "tag": "a2ca9e31-6d49-4fae-9ff5-c3c32be13ff6"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:40.525533 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0181be2d-5a2a-4a04-aea3-921675fb5364 req-4bba2a51-c266-46c1-8d00-ea7caa5a43da service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:40.527120 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0181be2d-5a2a-4a04-aea3-921675fb5364 req-4bba2a51-c266-46c1-8d00-ea7caa5a43da service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:40.565000 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-0181be2d-5a2a-4a04-aea3-921675fb5364 req-4bba2a51-c266-46c1-8d00-ea7caa5a43da service nova] Creating event network-vif-plugged:a2ca9e31-6d49-4fae-9ff5-c3c32be13ff6 for instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 on n-h1-848886-15 Jul 25 13:01:40.583580 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-0181be2d-5a2a-4a04-aea3-921675fb5364 req-4bba2a51-c266-46c1-8d00-ea7caa5a43da service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088460 Jul 25 13:01:40.588697 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2067/4213] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:01:40.595535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-191a2854-34f8-4181-b13a-6ad13968c1ca tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:40.603820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-191a2854-34f8-4181-b13a-6ad13968c1ca tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:40.616853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-191a2854-34f8-4181-b13a-6ad13968c1ca tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Searching by: {'name': '-743679323', 'deleted': False, 'project_id': '247832dc5b24483c82cddea22f81d2db'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:01:40.625432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-191a2854-34f8-4181-b13a-6ad13968c1ca tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:40.625911 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-191a2854-34f8-4181-b13a-6ad13968c1ca tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:40.626715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-191a2854-34f8-4181-b13a-6ad13968c1ca tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:40.627152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-191a2854-34f8-4181-b13a-6ad13968c1ca tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:40.826030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-191a2854-34f8-4181-b13a-6ad13968c1ca tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:01:40.946092 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-191a2854-34f8-4181-b13a-6ad13968c1ca tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers?name=-743679323" status: 200 len: 345 microversion: 2.1 time: 0.355786 Jul 25 13:01:40.955653 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2068/4214] 10.222.0.49 () {58 vars in 1156 bytes} [Mon Jul 25 13:01:40 2022] GET /compute/v2.1/servers?name=-743679323 => generated 345 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:01:40.960789 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c7fb93fc-a669-4947-9431-37c2f7ca0fd2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:40.963649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3953546f-ddb6-4d27-ae27-2675da2b9202 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:40.964460 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3953546f-ddb6-4d27-ae27-2675da2b9202 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:40.974487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3953546f-ddb6-4d27-ae27-2675da2b9202 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:40.974962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3953546f-ddb6-4d27-ae27-2675da2b9202 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:40.977284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3953546f-ddb6-4d27-ae27-2675da2b9202 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:40.977757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3953546f-ddb6-4d27-ae27-2675da2b9202 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:40.981166 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c7fb93fc-a669-4947-9431-37c2f7ca0fd2 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1675 microversion: 2.1 time: 0.900120 Jul 25 13:01:40.993476 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2147/4215] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:40 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1675 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:41.012700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-85cd5032-7c2a-4c5a-a85f-9de8efd17d30 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:41.031445 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-85cd5032-7c2a-4c5a-a85f-9de8efd17d30 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:41.032115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-85cd5032-7c2a-4c5a-a85f-9de8efd17d30 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '247832dc5b24483c82cddea22f81d2db'} {{(pid=125884) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:01:41.047604 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85cd5032-7c2a-4c5a-a85f-9de8efd17d30 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:41.048434 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85cd5032-7c2a-4c5a-a85f-9de8efd17d30 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:41.049318 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85cd5032-7c2a-4c5a-a85f-9de8efd17d30 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:41.049761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85cd5032-7c2a-4c5a-a85f-9de8efd17d30 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:41.212367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.multi_cell_list [None req-85cd5032-7c2a-4c5a-a85f-9de8efd17d30 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:01:41.344177 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-85cd5032-7c2a-4c5a-a85f-9de8efd17d30 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.350222 Jul 25 13:01:41.345818 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2148/4216] 10.222.0.49 () {58 vars in 1154 bytes} [Mon Jul 25 13:01:40 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:41.361491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c77641ed-9e16-422c-8e2f-2fb437adb7e3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:41.367409 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c77641ed-9e16-422c-8e2f-2fb437adb7e3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:41.374826 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c77641ed-9e16-422c-8e2f-2fb437adb7e3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-74367932', 'deleted': False, 'project_id': '247832dc5b24483c82cddea22f81d2db'} {{(pid=125884) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:01:41.389584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c77641ed-9e16-422c-8e2f-2fb437adb7e3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:41.390028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c77641ed-9e16-422c-8e2f-2fb437adb7e3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:41.390843 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c77641ed-9e16-422c-8e2f-2fb437adb7e3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:41.394694 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c77641ed-9e16-422c-8e2f-2fb437adb7e3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:41.571573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.multi_cell_list [None req-c77641ed-9e16-422c-8e2f-2fb437adb7e3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:01:41.647088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3953546f-ddb6-4d27-ae27-2675da2b9202 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:41.660454 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3953546f-ddb6-4d27-ae27-2675da2b9202 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1518 microversion: 2.1 time: 0.700871 Jul 25 13:01:41.661053 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2069/4217] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:40 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1518 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:41.703002 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c77641ed-9e16-422c-8e2f-2fb437adb7e3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-74367932" status: 200 len: 345 microversion: 2.1 time: 0.330531 Jul 25 13:01:41.704407 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2149/4218] 10.222.0.49 () {58 vars in 1226 bytes} [Mon Jul 25 13:01:41 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-74367932 => generated 345 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:01:41.717009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4c224a98-2c3e-4c6c-b7e9-34a34f73af9c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:41.717685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4c224a98-2c3e-4c6c-b7e9-34a34f73af9c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e0726aaf-f183-465c-ac33-313fd7858542] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:41.724369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c224a98-2c3e-4c6c-b7e9-34a34f73af9c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:41.724829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c224a98-2c3e-4c6c-b7e9-34a34f73af9c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:41.726925 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c224a98-2c3e-4c6c-b7e9-34a34f73af9c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:41.733244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c224a98-2c3e-4c6c-b7e9-34a34f73af9c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:41.791525 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4c224a98-2c3e-4c6c-b7e9-34a34f73af9c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e0726aaf-f183-465c-ac33-313fd7858542] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:01:42.003884 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9c8aca6c-d5fa-42aa-b35e-ad4bf4da0453 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:42.004517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9c8aca6c-d5fa-42aa-b35e-ad4bf4da0453 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:42.013292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9c8aca6c-d5fa-42aa-b35e-ad4bf4da0453 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:42.016139 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4c224a98-2c3e-4c6c-b7e9-34a34f73af9c tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542" status: 204 len: 0 microversion: 2.1 time: 0.303580 Jul 25 13:01:42.017976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9c8aca6c-d5fa-42aa-b35e-ad4bf4da0453 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:42.018855 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2070/4219] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:01:41 2022] DELETE /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:01:42.020892 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9c8aca6c-d5fa-42aa-b35e-ad4bf4da0453 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:42.021587 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9c8aca6c-d5fa-42aa-b35e-ad4bf4da0453 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:42.039423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2b121cd7-586b-4d47-9759-2cf159fba50f tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:42.052320 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2b121cd7-586b-4d47-9759-2cf159fba50f tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e0726aaf-f183-465c-ac33-313fd7858542] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:42.078250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b121cd7-586b-4d47-9759-2cf159fba50f tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:42.078880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b121cd7-586b-4d47-9759-2cf159fba50f tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:42.079902 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b121cd7-586b-4d47-9759-2cf159fba50f tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:42.080428 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b121cd7-586b-4d47-9759-2cf159fba50f tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:42.340175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9c8aca6c-d5fa-42aa-b35e-ad4bf4da0453 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d492d20a4864908a81902f86468d437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5abf45c9ba0419c8dec07847f3ff3c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:42.348706 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9c8aca6c-d5fa-42aa-b35e-ad4bf4da0453 tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 200 len: 1608 microversion: 2.1 time: 0.348833 Jul 25 13:01:42.351789 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2150/4220] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:41 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 1608 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:42.389871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-e42187ad-b97d-4ddc-8341-7f7904f26fda req-ffc023ef-fa66-4ca5-b99e-0311cf6a0256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b730aecb-2c1f-46ef-b457-8a3717655518", "name": "network-vif-deleted", "tag": "45191120-4204-4de7-9ef8-5d5c4ba83f89"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:42.409028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e42187ad-b97d-4ddc-8341-7f7904f26fda req-ffc023ef-fa66-4ca5-b99e-0311cf6a0256 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:42.409496 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e42187ad-b97d-4ddc-8341-7f7904f26fda req-ffc023ef-fa66-4ca5-b99e-0311cf6a0256 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:42.433721 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-e42187ad-b97d-4ddc-8341-7f7904f26fda req-ffc023ef-fa66-4ca5-b99e-0311cf6a0256 service nova] Creating event network-vif-deleted:45191120-4204-4de7-9ef8-5d5c4ba83f89 for instance b730aecb-2c1f-46ef-b457-8a3717655518 on n-h1-848886-15 Jul 25 13:01:42.447790 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-e42187ad-b97d-4ddc-8341-7f7904f26fda req-ffc023ef-fa66-4ca5-b99e-0311cf6a0256 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064035 Jul 25 13:01:42.448752 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2151/4221] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:01:42.613270 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2b121cd7-586b-4d47-9759-2cf159fba50f tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:42.641241 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2b121cd7-586b-4d47-9759-2cf159fba50f tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542" status: 200 len: 1517 microversion: 2.1 time: 0.610776 Jul 25 13:01:42.657861 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2071/4222] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:42 2022] GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542 => generated 1517 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:42.687249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e7524994-59be-4dff-b186-a4beb6223836 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:42.688122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e7524994-59be-4dff-b186-a4beb6223836 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:42.701398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e7524994-59be-4dff-b186-a4beb6223836 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:42.701876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e7524994-59be-4dff-b186-a4beb6223836 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:42.703106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e7524994-59be-4dff-b186-a4beb6223836 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:42.703566 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e7524994-59be-4dff-b186-a4beb6223836 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:43.110832 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e7524994-59be-4dff-b186-a4beb6223836 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:43.126888 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e7524994-59be-4dff-b186-a4beb6223836 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1518 microversion: 2.1 time: 0.440600 Jul 25 13:01:43.142447 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2152/4223] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:42 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1518 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:43.377491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a7668e57-af5d-49ca-affe-7f48870e4c7f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:43.378418 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a7668e57-af5d-49ca-affe-7f48870e4c7f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] [instance: b730aecb-2c1f-46ef-b457-8a3717655518] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:43.390844 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7668e57-af5d-49ca-affe-7f48870e4c7f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:43.391304 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7668e57-af5d-49ca-affe-7f48870e4c7f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:43.392089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7668e57-af5d-49ca-affe-7f48870e4c7f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:43.399674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7668e57-af5d-49ca-affe-7f48870e4c7f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:43.444897 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-a7668e57-af5d-49ca-affe-7f48870e4c7f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] HTTP exception thrown: Instance b730aecb-2c1f-46ef-b457-8a3717655518 could not be found. Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a7668e57-af5d-49ca-affe-7f48870e4c7f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Request method failure captured: Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 HTTP/1.1 Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pHthUWL3emuzsBs4xsDYWyXYBkhJFaBBK9FQhgh1copL5lDP9Ma5bkE_HJxjDmond706Gp-3Rif1J8B87ZUnZtsSIpcsBH62MydK_2R5OL-M6p6aAVtQ-nWL1wmPtLFtWDAiH4ULAKYIyK232aQLG-PdxvIg00u9QiVZERdPXLac10 Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: b5abf45c9ba0419c8dec07847f3ff3c5 Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerActionsTestJSON-645693881 Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b5abf45c9ba0419c8dec07847f3ff3c5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b5abf45c9ba0419c8dec07847f3ff3c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5abf45c9ba0419c8dec07847f3ff3c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5abf45c9ba0419c8dec07847f3ff3c5"}]}] Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerActionsTestJSON-645693881 Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: b5abf45c9ba0419c8dec07847f3ff3c5 Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerActionsTestJSON-645693881 Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerActionsTestJSON-645693881-project Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 4d492d20a4864908a81902f86468d437 Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerActionsTestJSON-645693881-project Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance b730aecb-2c1f-46ef-b457-8a3717655518 could not be found. Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'b730aecb-2c1f-46ef-b457-8a3717655518'} Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b730aecb-2c1f-46ef-b457-8a3717655518 could not be found. Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b730aecb-2c1f-46ef-b457-8a3717655518 could not be found. Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:43.456144 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:43.460943 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:43.460943 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:43.460943 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:43.460943 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:01:43.460943 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:01:43.460943 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b730aecb-2c1f-46ef-b457-8a3717655518 could not be found. Jul 25 13:01:43.460943 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:43.470395 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a7668e57-af5d-49ca-affe-7f48870e4c7f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Returning 404 to user: Instance b730aecb-2c1f-46ef-b457-8a3717655518 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:01:43.471541 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a7668e57-af5d-49ca-affe-7f48870e4c7f tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518" status: 404 len: 111 microversion: 2.1 time: 0.102669 Jul 25 13:01:43.473507 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2072/4224] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:43 2022] GET /compute/v2.1/servers/b730aecb-2c1f-46ef-b457-8a3717655518 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:01:43.481589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-354b098c-b2f3-4ee2-a40d-3bef9e192c1e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] Calling method '.version_select at 0x7efcf91fb790>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:43.508773 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-354b098c-b2f3-4ee2-a40d-3bef9e192c1e tempest-ServerActionsTestJSON-645693881 tempest-ServerActionsTestJSON-645693881-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1353753151" status: 202 len: 0 microversion: 2.1 time: 0.031121 Jul 25 13:01:43.510538 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2153/4225] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Jul 25 13:01:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1353753151 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:01:43.673673 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a58b5b5a-2ee4-43aa-8004-ee5838758fb6 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:43.674610 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a58b5b5a-2ee4-43aa-8004-ee5838758fb6 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e0726aaf-f183-465c-ac33-313fd7858542] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:43.684107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a58b5b5a-2ee4-43aa-8004-ee5838758fb6 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:43.689821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a58b5b5a-2ee4-43aa-8004-ee5838758fb6 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:43.690885 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a58b5b5a-2ee4-43aa-8004-ee5838758fb6 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:43.691416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a58b5b5a-2ee4-43aa-8004-ee5838758fb6 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:44.155048 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cf00e18d-4cdf-4c6b-8953-319dd4ca7140 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:44.156207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cf00e18d-4cdf-4c6b-8953-319dd4ca7140 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:44.163578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf00e18d-4cdf-4c6b-8953-319dd4ca7140 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:44.164662 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf00e18d-4cdf-4c6b-8953-319dd4ca7140 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:44.165961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf00e18d-4cdf-4c6b-8953-319dd4ca7140 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:44.166681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf00e18d-4cdf-4c6b-8953-319dd4ca7140 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:44.429792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a58b5b5a-2ee4-43aa-8004-ee5838758fb6 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:44.438581 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a58b5b5a-2ee4-43aa-8004-ee5838758fb6 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542" status: 200 len: 1517 microversion: 2.1 time: 0.769528 Jul 25 13:01:44.441978 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2073/4226] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:43 2022] GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542 => generated 1517 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:44.609659 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cf00e18d-4cdf-4c6b-8953-319dd4ca7140 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:44.631327 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cf00e18d-4cdf-4c6b-8953-319dd4ca7140 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.481468 Jul 25 13:01:44.633078 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2154/4227] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:44 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:44.652941 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9fa351ce-dced-44fa-b076-65e4b4a43f14 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:44.654129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9fa351ce-dced-44fa-b076-65e4b4a43f14 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:44.660721 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9fa351ce-dced-44fa-b076-65e4b4a43f14 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:44.661404 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9fa351ce-dced-44fa-b076-65e4b4a43f14 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:44.662513 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9fa351ce-dced-44fa-b076-65e4b4a43f14 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:44.663205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9fa351ce-dced-44fa-b076-65e4b4a43f14 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:44.875371 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9fa351ce-dced-44fa-b076-65e4b4a43f14 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:44.895830 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9fa351ce-dced-44fa-b076-65e4b4a43f14 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.246895 Jul 25 13:01:44.915398 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2074/4228] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:44 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:44.939894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3a6dda56-9564-4956-8a95-a70009c5e988 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:44.940756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3a6dda56-9564-4956-8a95-a70009c5e988 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:44.959633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a6dda56-9564-4956-8a95-a70009c5e988 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:44.960293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a6dda56-9564-4956-8a95-a70009c5e988 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:44.961227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a6dda56-9564-4956-8a95-a70009c5e988 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:44.961814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a6dda56-9564-4956-8a95-a70009c5e988 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:45.051524 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-5f103b72-b13c-415b-926a-f96fa22bd937 req-1e127a5b-1ccc-46d9-88e3-5172cd06de2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0726aaf-f183-465c-ac33-313fd7858542", "name": "network-vif-deleted", "tag": "76f58bf7-d942-480a-a6c7-6057d2be96f8"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:45.093751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-5f103b72-b13c-415b-926a-f96fa22bd937 req-1e127a5b-1ccc-46d9-88e3-5172cd06de2c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:45.094224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-5f103b72-b13c-415b-926a-f96fa22bd937 req-1e127a5b-1ccc-46d9-88e3-5172cd06de2c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:45.118048 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-5f103b72-b13c-415b-926a-f96fa22bd937 req-1e127a5b-1ccc-46d9-88e3-5172cd06de2c service nova] Creating event network-vif-deleted:76f58bf7-d942-480a-a6c7-6057d2be96f8 for instance e0726aaf-f183-465c-ac33-313fd7858542 on n-h2-848886-15 Jul 25 13:01:45.137969 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-5f103b72-b13c-415b-926a-f96fa22bd937 req-1e127a5b-1ccc-46d9-88e3-5172cd06de2c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095676 Jul 25 13:01:45.138580 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2075/4229] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:01:45.298706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3a6dda56-9564-4956-8a95-a70009c5e988 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:45.315827 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3a6dda56-9564-4956-8a95-a70009c5e988 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.379633 Jul 25 13:01:45.317513 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2155/4230] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:44 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:45.339642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8511238a-d18f-412e-9d29-c09a5641de68 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:45.346297 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-8511238a-d18f-412e-9d29-c09a5641de68 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Instance efc27e5a-4a99-4a91-8144-e5c7e654a53c has no mapping to a cell. Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8511238a-d18f-412e-9d29-c09a5641de68 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/efc27e5a-4a99-4a91-8144-e5c7e654a53c/action HTTP/1.1 Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 15 Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: {"os-stop": {}} Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance efc27e5a-4a99-4a91-8144-e5c7e654a53c has no mapping to a cell. Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'efc27e5a-4a99-4a91-8144-e5c7e654a53c', 'body': {'os-stop': {}}} Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance efc27e5a-4a99-4a91-8144-e5c7e654a53c has no mapping to a cell. Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:01:45.363005 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efc27e5a-4a99-4a91-8144-e5c7e654a53c has no mapping to a cell. Jul 25 13:01:45.367163 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:45.367163 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:45.367163 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:45.367163 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:45.367163 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:45.367163 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:45.367163 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:01:45.367163 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:01:45.367163 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efc27e5a-4a99-4a91-8144-e5c7e654a53c has no mapping to a cell. Jul 25 13:01:45.367163 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:45.369642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8511238a-d18f-412e-9d29-c09a5641de68 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 404 to user: Instance efc27e5a-4a99-4a91-8144-e5c7e654a53c has no mapping to a cell. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:01:45.370841 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8511238a-d18f-412e-9d29-c09a5641de68 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/efc27e5a-4a99-4a91-8144-e5c7e654a53c/action" status: 404 len: 117 microversion: 2.1 time: 0.037129 Jul 25 13:01:45.374606 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2076/4231] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:01:45 2022] POST /compute/v2.1/servers/efc27e5a-4a99-4a91-8144-e5c7e654a53c/action => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:01:45.385049 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bd320eb2-285f-4353-ad5c-d9fba42830e3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:45.386051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bd320eb2-285f-4353-ad5c-d9fba42830e3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:45.398002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd320eb2-285f-4353-ad5c-d9fba42830e3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:45.399101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd320eb2-285f-4353-ad5c-d9fba42830e3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:45.400512 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd320eb2-285f-4353-ad5c-d9fba42830e3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:45.401405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd320eb2-285f-4353-ad5c-d9fba42830e3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:45.467586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3f87fdcc-eee4-4988-ab70-92b2e61e1ddd tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:45.469431 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3f87fdcc-eee4-4988-ab70-92b2e61e1ddd tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e0726aaf-f183-465c-ac33-313fd7858542] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:45.483320 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3f87fdcc-eee4-4988-ab70-92b2e61e1ddd tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:45.484034 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3f87fdcc-eee4-4988-ab70-92b2e61e1ddd tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:45.485342 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3f87fdcc-eee4-4988-ab70-92b2e61e1ddd tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:45.486494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3f87fdcc-eee4-4988-ab70-92b2e61e1ddd tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:45.529548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3f87fdcc-eee4-4988-ab70-92b2e61e1ddd tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:45.530580 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3f87fdcc-eee4-4988-ab70-92b2e61e1ddd tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:45.531320 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-3f87fdcc-eee4-4988-ab70-92b2e61e1ddd tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lazy-loading 'fault' on Instance uuid e0726aaf-f183-465c-ac33-313fd7858542 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:01:45.600265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3f87fdcc-eee4-4988-ab70-92b2e61e1ddd tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:45.613730 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3f87fdcc-eee4-4988-ab70-92b2e61e1ddd tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542" status: 200 len: 1311 microversion: 2.1 time: 0.147058 Jul 25 13:01:45.614539 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2077/4232] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:45 2022] GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542 => generated 1311 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:45.629867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bd320eb2-285f-4353-ad5c-d9fba42830e3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:45.637728 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e8b46a54-b7ab-45de-916a-dbdbeafbfc10 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] Calling method '.version_select at 0x7efcfed65700>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:45.641895 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bd320eb2-285f-4353-ad5c-d9fba42830e3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.263758 Jul 25 13:01:45.652545 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2156/4233] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:45 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:45.691089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8c3bcc68-1964-48b1-87db-451fde38b38e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:45.691755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8c3bcc68-1964-48b1-87db-451fde38b38e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:45.693036 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e8b46a54-b7ab-45de-916a-dbdbeafbfc10 tempest-TestSecurityGroupsBasicOps-749125150 tempest-TestSecurityGroupsBasicOps-749125150-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-496810183" status: 202 len: 0 microversion: 2.1 time: 0.064649 Jul 25 13:01:45.699085 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2078/4234] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 13:01:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-496810183 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:01:45.701640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c3bcc68-1964-48b1-87db-451fde38b38e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:45.702294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c3bcc68-1964-48b1-87db-451fde38b38e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:45.703377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c3bcc68-1964-48b1-87db-451fde38b38e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:45.703962 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c3bcc68-1964-48b1-87db-451fde38b38e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:45.948740 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8c3bcc68-1964-48b1-87db-451fde38b38e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:45.962350 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8c3bcc68-1964-48b1-87db-451fde38b38e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.288709 Jul 25 13:01:45.964402 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2157/4235] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:45 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:45.993794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bf3d5bd4-d201-4645-ab5b-878090f79223 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:46.000102 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bf3d5bd4-d201-4645-ab5b-878090f79223 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 1b6e3cc0-14c2-4680-b899-b45455a3e1f1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:46.016673 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-bf3d5bd4-d201-4645-ab5b-878090f79223 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Instance 1b6e3cc0-14c2-4680-b899-b45455a3e1f1 could not be found. Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bf3d5bd4-d201-4645-ab5b-878090f79223 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/1b6e3cc0-14c2-4680-b899-b45455a3e1f1/action HTTP/1.1 Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 15 Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: {"suspend": {}} Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 1b6e3cc0-14c2-4680-b899-b45455a3e1f1 could not be found. Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '1b6e3cc0-14c2-4680-b899-b45455a3e1f1', 'body': {'suspend': {}}} Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b6e3cc0-14c2-4680-b899-b45455a3e1f1 could not be found. Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b6e3cc0-14c2-4680-b899-b45455a3e1f1 could not be found. Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:46.021003 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:46.025212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:01:46.025212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:01:46.025212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b6e3cc0-14c2-4680-b899-b45455a3e1f1 could not be found. Jul 25 13:01:46.025212 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:46.025212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bf3d5bd4-d201-4645-ab5b-878090f79223 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 404 to user: Instance 1b6e3cc0-14c2-4680-b899-b45455a3e1f1 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:01:46.025212 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bf3d5bd4-d201-4645-ab5b-878090f79223 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/1b6e3cc0-14c2-4680-b899-b45455a3e1f1/action" status: 404 len: 111 microversion: 2.1 time: 0.040507 Jul 25 13:01:46.026220 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2079/4236] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:01:45 2022] POST /compute/v2.1/servers/1b6e3cc0-14c2-4680-b899-b45455a3e1f1/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:01:46.048179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a1c7d35b-f559-4079-b9b5-e332481d22d3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:46.049189 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a1c7d35b-f559-4079-b9b5-e332481d22d3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:46.057242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1c7d35b-f559-4079-b9b5-e332481d22d3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:46.057895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1c7d35b-f559-4079-b9b5-e332481d22d3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:46.058970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1c7d35b-f559-4079-b9b5-e332481d22d3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:46.059566 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1c7d35b-f559-4079-b9b5-e332481d22d3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:46.345583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a1c7d35b-f559-4079-b9b5-e332481d22d3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:46.354958 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a1c7d35b-f559-4079-b9b5-e332481d22d3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.320331 Jul 25 13:01:46.377441 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2158/4237] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:46 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:46.384587 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-67fe1d71-21a7-49cf-92e5-8092d1614073 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:46.385336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-67fe1d71-21a7-49cf-92e5-8092d1614073 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:46.414263 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-67fe1d71-21a7-49cf-92e5-8092d1614073 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:46.415947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-67fe1d71-21a7-49cf-92e5-8092d1614073 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:46.416896 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-67fe1d71-21a7-49cf-92e5-8092d1614073 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:46.422886 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-67fe1d71-21a7-49cf-92e5-8092d1614073 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:46.640653 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-666708ad-a609-47d7-bb3e-e58554b19455 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:46.641290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-666708ad-a609-47d7-bb3e-e58554b19455 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e0726aaf-f183-465c-ac33-313fd7858542] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:46.654591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-666708ad-a609-47d7-bb3e-e58554b19455 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:46.655606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-666708ad-a609-47d7-bb3e-e58554b19455 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:46.656959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-666708ad-a609-47d7-bb3e-e58554b19455 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:46.657631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-666708ad-a609-47d7-bb3e-e58554b19455 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:46.688086 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-666708ad-a609-47d7-bb3e-e58554b19455 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] HTTP exception thrown: Instance e0726aaf-f183-465c-ac33-313fd7858542 could not be found. Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-666708ad-a609-47d7-bb3e-e58554b19455 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Request method failure captured: Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542 HTTP/1.1 Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pPwpNOy1GVftYfckXoS_eNQnOgnYSEkjtLE5wKGEeeKZYX-RAUV1AXIWt6JgX8YF1CyA2cwXi-Z29QC5-Y2Y5GgZpOQato-i7n0aG1Wot1QuB1Ajsa483WI4Y8tzVbcTk_CftkY-csnPzKx9gkXv3-14beo7OPu18AZUnRXInG3-Bw Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 247832dc5b24483c82cddea22f81d2db Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ListServerFiltersTestJSON-1729202216 Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_247832dc5b24483c82cddea22f81d2db", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/247832dc5b24483c82cddea22f81d2db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/247832dc5b24483c82cddea22f81d2db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/247832dc5b24483c82cddea22f81d2db"}]}] Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ListServerFiltersTestJSON-1729202216 Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 247832dc5b24483c82cddea22f81d2db Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1729202216 Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ListServerFiltersTestJSON-1729202216-project Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 8ab304e8bfdd454584c3d511c4646e45 Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ListServerFiltersTestJSON-1729202216-project Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance e0726aaf-f183-465c-ac33-313fd7858542 could not be found. Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'e0726aaf-f183-465c-ac33-313fd7858542'} Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0726aaf-f183-465c-ac33-313fd7858542 could not be found. Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0726aaf-f183-465c-ac33-313fd7858542 could not be found. Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:46.692178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:46.698207 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:46.698207 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:46.698207 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:46.698207 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:01:46.698207 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:01:46.698207 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0726aaf-f183-465c-ac33-313fd7858542 could not be found. Jul 25 13:01:46.698207 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:46.698207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-666708ad-a609-47d7-bb3e-e58554b19455 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Returning 404 to user: Instance e0726aaf-f183-465c-ac33-313fd7858542 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:01:46.698207 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-666708ad-a609-47d7-bb3e-e58554b19455 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542" status: 404 len: 111 microversion: 2.1 time: 0.057964 Jul 25 13:01:46.698207 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2159/4238] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:46 2022] GET /compute/v2.1/servers/e0726aaf-f183-465c-ac33-313fd7858542 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 13:01:46.713577 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a151da6b-65bf-42a9-a77c-aec41d00bda2 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:46.714159 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a151da6b-65bf-42a9-a77c-aec41d00bda2 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e8b5f22f-b68b-4533-8bbf-a94da6b3f872] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:46.723632 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a151da6b-65bf-42a9-a77c-aec41d00bda2 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:46.724186 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a151da6b-65bf-42a9-a77c-aec41d00bda2 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:46.724918 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a151da6b-65bf-42a9-a77c-aec41d00bda2 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:46.726630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a151da6b-65bf-42a9-a77c-aec41d00bda2 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:46.782436 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a151da6b-65bf-42a9-a77c-aec41d00bda2 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e8b5f22f-b68b-4533-8bbf-a94da6b3f872] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:01:46.926314 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a151da6b-65bf-42a9-a77c-aec41d00bda2 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e8b5f22f-b68b-4533-8bbf-a94da6b3f872" status: 204 len: 0 microversion: 2.1 time: 0.226743 Jul 25 13:01:46.927617 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2160/4239] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:01:46 2022] DELETE /compute/v2.1/servers/e8b5f22f-b68b-4533-8bbf-a94da6b3f872 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:01:46.947194 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9112b0e4-8fb4-448a-8494-40aa3323b0d1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:46.947794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9112b0e4-8fb4-448a-8494-40aa3323b0d1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e8b5f22f-b68b-4533-8bbf-a94da6b3f872] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:46.965822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9112b0e4-8fb4-448a-8494-40aa3323b0d1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:46.970725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9112b0e4-8fb4-448a-8494-40aa3323b0d1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:46.971331 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9112b0e4-8fb4-448a-8494-40aa3323b0d1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:46.971772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9112b0e4-8fb4-448a-8494-40aa3323b0d1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:47.171980 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-67fe1d71-21a7-49cf-92e5-8092d1614073 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:47.188533 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-67fe1d71-21a7-49cf-92e5-8092d1614073 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.811821 Jul 25 13:01:47.189355 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2080/4240] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:46 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:47.210943 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8e4526ba-caea-4ab3-b4fc-211b5daa1abe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:47.211486 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8e4526ba-caea-4ab3-b4fc-211b5daa1abe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:47.222494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:47.224654 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8e4526ba-caea-4ab3-b4fc-211b5daa1abe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:47.225150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8e4526ba-caea-4ab3-b4fc-211b5daa1abe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:47.237508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8e4526ba-caea-4ab3-b4fc-211b5daa1abe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:47.238293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8e4526ba-caea-4ab3-b4fc-211b5daa1abe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:47.324489 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-8e4526ba-caea-4ab3-b4fc-211b5daa1abe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lazy-loading 'flavor' on Instance uuid f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:01:47.415711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:47.431440 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9112b0e4-8fb4-448a-8494-40aa3323b0d1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:47.445577 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9112b0e4-8fb4-448a-8494-40aa3323b0d1 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e8b5f22f-b68b-4533-8bbf-a94da6b3f872" status: 200 len: 1516 microversion: 2.1 time: 0.509952 Jul 25 13:01:47.446927 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2161/4241] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:46 2022] GET /compute/v2.1/servers/e8b5f22f-b68b-4533-8bbf-a94da6b3f872 => generated 1516 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:47.540610 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8e4526ba-caea-4ab3-b4fc-211b5daa1abe tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action" status: 202 len: 0 microversion: 2.1 time: 0.333747 Jul 25 13:01:47.546403 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2081/4242] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:01:47 2022] POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 13:01:47.557506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f19ebdc9-ed09-42ee-8b62-8c7724478e9d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:47.558461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f19ebdc9-ed09-42ee-8b62-8c7724478e9d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:47.579742 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f19ebdc9-ed09-42ee-8b62-8c7724478e9d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:47.586603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f19ebdc9-ed09-42ee-8b62-8c7724478e9d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:47.591509 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f19ebdc9-ed09-42ee-8b62-8c7724478e9d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:47.592203 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f19ebdc9-ed09-42ee-8b62-8c7724478e9d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:47.899806 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f19ebdc9-ed09-42ee-8b62-8c7724478e9d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:47.911195 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f19ebdc9-ed09-42ee-8b62-8c7724478e9d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1513 microversion: 2.1 time: 0.364497 Jul 25 13:01:47.911803 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2162/4243] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:47 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1513 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:48.472364 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9c8287a7-fe7b-431f-9d85-0d2e86832975 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:48.473686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9c8287a7-fe7b-431f-9d85-0d2e86832975 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e8b5f22f-b68b-4533-8bbf-a94da6b3f872] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:48.485425 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c8287a7-fe7b-431f-9d85-0d2e86832975 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:48.488437 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c8287a7-fe7b-431f-9d85-0d2e86832975 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:48.489849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c8287a7-fe7b-431f-9d85-0d2e86832975 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:48.490505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9c8287a7-fe7b-431f-9d85-0d2e86832975 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:48.570552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:48.903703 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9c8287a7-fe7b-431f-9d85-0d2e86832975 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:48.924888 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9c8287a7-fe7b-431f-9d85-0d2e86832975 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e8b5f22f-b68b-4533-8bbf-a94da6b3f872" status: 200 len: 1516 microversion: 2.1 time: 0.457460 Jul 25 13:01:48.926358 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2082/4244] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:48 2022] GET /compute/v2.1/servers/e8b5f22f-b68b-4533-8bbf-a94da6b3f872 => generated 1516 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:48.943487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2ff6eb28-34cd-4184-9e75-29609b441a3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:48.944098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2ff6eb28-34cd-4184-9e75-29609b441a3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:48.954300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ff6eb28-34cd-4184-9e75-29609b441a3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:48.954679 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ff6eb28-34cd-4184-9e75-29609b441a3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:48.955735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ff6eb28-34cd-4184-9e75-29609b441a3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:48.958031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ff6eb28-34cd-4184-9e75-29609b441a3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:49.015059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:49.430610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2ff6eb28-34cd-4184-9e75-29609b441a3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:49.446970 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2ff6eb28-34cd-4184-9e75-29609b441a3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1496 microversion: 2.1 time: 0.506924 Jul 25 13:01:49.448387 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2163/4245] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:48 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1496 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:49.474161 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-541dbe97-b087-4066-97f9-f12e84ed18dc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:49.475232 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-541dbe97-b087-4066-97f9-f12e84ed18dc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:49.488475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-541dbe97-b087-4066-97f9-f12e84ed18dc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:49.488770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-541dbe97-b087-4066-97f9-f12e84ed18dc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:49.489592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-541dbe97-b087-4066-97f9-f12e84ed18dc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:49.490068 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-541dbe97-b087-4066-97f9-f12e84ed18dc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:49.554367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-541dbe97-b087-4066-97f9-f12e84ed18dc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lazy-loading 'flavor' on Instance uuid f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:01:49.586531 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-541dbe97-b087-4066-97f9-f12e84ed18dc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Cannot 'suspend' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state suspended Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-541dbe97-b087-4066-97f9-f12e84ed18dc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action HTTP/1.1 Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 15 Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: {"suspend": {}} Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: exception: Cannot 'suspend' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state suspended Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2', 'body': {'suspend': {}}} Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 in vm_state suspended. Cannot suspend while the instance is in this state. Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 25 13:01:49.588915 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 13:01:49.592930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 13:01:49.592930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 13:01:49.592930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state suspended Jul 25 13:01:49.592930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:49.592930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:49.592930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:49.592930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:49.592930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:49.592930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:49.592930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:01:49.592930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:01:49.592930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state suspended Jul 25 13:01:49.592930 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:49.592930 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-541dbe97-b087-4066-97f9-f12e84ed18dc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 409 to user: Cannot 'suspend' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state suspended {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:01:49.592930 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-541dbe97-b087-4066-97f9-f12e84ed18dc tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action" status: 409 len: 148 microversion: 2.1 time: 0.121618 Jul 25 13:01:49.597130 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2083/4246] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:01:49 2022] POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action => generated 148 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 25 13:01:49.603912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1b7e4e9c-29df-4db8-afbd-f1193f448e0e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:49.604705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1b7e4e9c-29df-4db8-afbd-f1193f448e0e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:49.625979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b7e4e9c-29df-4db8-afbd-f1193f448e0e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:49.626692 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b7e4e9c-29df-4db8-afbd-f1193f448e0e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:49.627370 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b7e4e9c-29df-4db8-afbd-f1193f448e0e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:49.627880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b7e4e9c-29df-4db8-afbd-f1193f448e0e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:49.765709 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1b7e4e9c-29df-4db8-afbd-f1193f448e0e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action" status: 202 len: 0 microversion: 2.1 time: 0.168164 Jul 25 13:01:49.769155 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2164/4247] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:01:49 2022] POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:01:49.781192 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4b95cce8-0116-4d3c-a9d4-2dddaff1a7b2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:49.782338 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4b95cce8-0116-4d3c-a9d4-2dddaff1a7b2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:49.789463 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b95cce8-0116-4d3c-a9d4-2dddaff1a7b2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:49.790056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b95cce8-0116-4d3c-a9d4-2dddaff1a7b2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:49.791085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b95cce8-0116-4d3c-a9d4-2dddaff1a7b2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:49.791532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b95cce8-0116-4d3c-a9d4-2dddaff1a7b2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:49.950098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-605cb66b-e4c9-450f-b4ca-a2c9bde397af tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:49.951856 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-605cb66b-e4c9-450f-b4ca-a2c9bde397af tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e8b5f22f-b68b-4533-8bbf-a94da6b3f872] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:49.962748 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-605cb66b-e4c9-450f-b4ca-a2c9bde397af tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:49.963603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-605cb66b-e4c9-450f-b4ca-a2c9bde397af tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:49.964949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-605cb66b-e4c9-450f-b4ca-a2c9bde397af tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:49.965700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-605cb66b-e4c9-450f-b4ca-a2c9bde397af tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:50.471145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4b95cce8-0116-4d3c-a9d4-2dddaff1a7b2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:50.480747 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4b95cce8-0116-4d3c-a9d4-2dddaff1a7b2 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1502 microversion: 2.1 time: 0.709113 Jul 25 13:01:50.481378 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2084/4248] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:49 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1502 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:50.596846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-605cb66b-e4c9-450f-b4ca-a2c9bde397af tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:50.616523 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-605cb66b-e4c9-450f-b4ca-a2c9bde397af tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e8b5f22f-b68b-4533-8bbf-a94da6b3f872" status: 200 len: 1516 microversion: 2.1 time: 0.670372 Jul 25 13:01:50.618502 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2165/4249] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:49 2022] GET /compute/v2.1/servers/e8b5f22f-b68b-4533-8bbf-a94da6b3f872 => generated 1516 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:50.751987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-b42b5e67-b82a-4d19-823b-11d14d0fd21d req-c30fde0b-39ec-4811-9bd0-b08cc5a7429e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b5f22f-b68b-4533-8bbf-a94da6b3f872", "name": "network-vif-deleted", "tag": "c2c6e375-3bea-4129-8d43-ce121d323d31"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:50.773166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=10 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:50.775925 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b42b5e67-b82a-4d19-823b-11d14d0fd21d req-c30fde0b-39ec-4811-9bd0-b08cc5a7429e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:50.787623 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b42b5e67-b82a-4d19-823b-11d14d0fd21d req-c30fde0b-39ec-4811-9bd0-b08cc5a7429e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:50.811980 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-b42b5e67-b82a-4d19-823b-11d14d0fd21d req-c30fde0b-39ec-4811-9bd0-b08cc5a7429e service nova] Creating event network-vif-deleted:c2c6e375-3bea-4129-8d43-ce121d323d31 for instance e8b5f22f-b68b-4533-8bbf-a94da6b3f872 on n-h1-848886-15 Jul 25 13:01:50.824967 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-b42b5e67-b82a-4d19-823b-11d14d0fd21d req-c30fde0b-39ec-4811-9bd0-b08cc5a7429e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078312 Jul 25 13:01:50.830398 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2085/4250] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:01:51.504709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6e1fc7a9-015d-4f58-9bf5-f7a89de2a245 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:51.505333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6e1fc7a9-015d-4f58-9bf5-f7a89de2a245 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:51.509041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=8 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:51.519451 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:51.542584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e1fc7a9-015d-4f58-9bf5-f7a89de2a245 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:51.543040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e1fc7a9-015d-4f58-9bf5-f7a89de2a245 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:51.554929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e1fc7a9-015d-4f58-9bf5-f7a89de2a245 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:51.555526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e1fc7a9-015d-4f58-9bf5-f7a89de2a245 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:51.643753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-396cf4b6-2b2f-4fee-8e95-4afa11f67691 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:51.644628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-396cf4b6-2b2f-4fee-8e95-4afa11f67691 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: e8b5f22f-b68b-4533-8bbf-a94da6b3f872] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:51.657908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-396cf4b6-2b2f-4fee-8e95-4afa11f67691 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:51.664807 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-396cf4b6-2b2f-4fee-8e95-4afa11f67691 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:51.666047 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-396cf4b6-2b2f-4fee-8e95-4afa11f67691 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:51.666710 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-396cf4b6-2b2f-4fee-8e95-4afa11f67691 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:51.698814 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-396cf4b6-2b2f-4fee-8e95-4afa11f67691 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] HTTP exception thrown: Instance e8b5f22f-b68b-4533-8bbf-a94da6b3f872 could not be found. Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-396cf4b6-2b2f-4fee-8e95-4afa11f67691 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Request method failure captured: Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/e8b5f22f-b68b-4533-8bbf-a94da6b3f872 HTTP/1.1 Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pPwpNOy1GVftYfckXoS_eNQnOgnYSEkjtLE5wKGEeeKZYX-RAUV1AXIWt6JgX8YF1CyA2cwXi-Z29QC5-Y2Y5GgZpOQato-i7n0aG1Wot1QuB1Ajsa483WI4Y8tzVbcTk_CftkY-csnPzKx9gkXv3-14beo7OPu18AZUnRXInG3-Bw Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 247832dc5b24483c82cddea22f81d2db Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ListServerFiltersTestJSON-1729202216 Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_247832dc5b24483c82cddea22f81d2db", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/247832dc5b24483c82cddea22f81d2db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/247832dc5b24483c82cddea22f81d2db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/247832dc5b24483c82cddea22f81d2db"}]}] Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ListServerFiltersTestJSON-1729202216 Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 247832dc5b24483c82cddea22f81d2db Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1729202216 Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ListServerFiltersTestJSON-1729202216-project Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8ab304e8bfdd454584c3d511c4646e45 Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ListServerFiltersTestJSON-1729202216-project Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance e8b5f22f-b68b-4533-8bbf-a94da6b3f872 could not be found. Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'e8b5f22f-b68b-4533-8bbf-a94da6b3f872'} Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8b5f22f-b68b-4533-8bbf-a94da6b3f872 could not be found. Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8b5f22f-b68b-4533-8bbf-a94da6b3f872 could not be found. Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:51.710194 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:51.715873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:51.715873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:51.715873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:51.715873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:01:51.715873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:01:51.715873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8b5f22f-b68b-4533-8bbf-a94da6b3f872 could not be found. Jul 25 13:01:51.715873 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:51.717546 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-396cf4b6-2b2f-4fee-8e95-4afa11f67691 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Returning 404 to user: Instance e8b5f22f-b68b-4533-8bbf-a94da6b3f872 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:01:51.718873 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-396cf4b6-2b2f-4fee-8e95-4afa11f67691 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/e8b5f22f-b68b-4533-8bbf-a94da6b3f872" status: 404 len: 111 microversion: 2.1 time: 0.080487 Jul 25 13:01:51.719954 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2086/4251] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:51 2022] GET /compute/v2.1/servers/e8b5f22f-b68b-4533-8bbf-a94da6b3f872 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:01:51.728141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3407bd3d-8d99-419a-99cd-290013407a91 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:51.729632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3407bd3d-8d99-419a-99cd-290013407a91 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:51.743896 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3407bd3d-8d99-419a-99cd-290013407a91 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:51.744662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3407bd3d-8d99-419a-99cd-290013407a91 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:51.745635 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3407bd3d-8d99-419a-99cd-290013407a91 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:51.749576 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3407bd3d-8d99-419a-99cd-290013407a91 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:51.805595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3407bd3d-8d99-419a-99cd-290013407a91 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:01:51.958808 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3407bd3d-8d99-419a-99cd-290013407a91 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "DELETE /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002" status: 204 len: 0 microversion: 2.1 time: 0.231357 Jul 25 13:01:51.960466 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2087/4252] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:01:51 2022] DELETE /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 13:01:51.970969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f918292c-c00a-4619-904b-0ecc5fb22bc2 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:51.972963 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f918292c-c00a-4619-904b-0ecc5fb22bc2 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:51.980471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f918292c-c00a-4619-904b-0ecc5fb22bc2 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:51.981237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f918292c-c00a-4619-904b-0ecc5fb22bc2 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:51.982286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f918292c-c00a-4619-904b-0ecc5fb22bc2 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:51.983017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f918292c-c00a-4619-904b-0ecc5fb22bc2 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:52.467117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6e1fc7a9-015d-4f58-9bf5-f7a89de2a245 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:52.486715 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6e1fc7a9-015d-4f58-9bf5-f7a89de2a245 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1502 microversion: 2.1 time: 0.987257 Jul 25 13:01:52.509888 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2166/4253] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:51 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1502 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:52.524450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f918292c-c00a-4619-904b-0ecc5fb22bc2 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:52.537026 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f918292c-c00a-4619-904b-0ecc5fb22bc2 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002" status: 200 len: 1516 microversion: 2.1 time: 0.570505 Jul 25 13:01:52.539108 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2088/4254] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:51 2022] GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002 => generated 1516 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:52.595017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fae0a8a2-482b-40ac-bce6-b4b4411f0e81 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:52.597355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fae0a8a2-482b-40ac-bce6-b4b4411f0e81 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:52.613516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fae0a8a2-482b-40ac-bce6-b4b4411f0e81 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:52.614226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fae0a8a2-482b-40ac-bce6-b4b4411f0e81 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:52.615161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fae0a8a2-482b-40ac-bce6-b4b4411f0e81 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:52.615777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fae0a8a2-482b-40ac-bce6-b4b4411f0e81 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:52.722505 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fae0a8a2-482b-40ac-bce6-b4b4411f0e81 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "POST /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5/action" status: 200 len: 24573 microversion: 2.1 time: 0.130733 Jul 25 13:01:52.723693 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2167/4255] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:01:52 2022] POST /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5/action => generated 24573 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:01:53.517481 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fffc32c2-ca4f-489c-9868-046e76b9f8a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:53.518822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fffc32c2-ca4f-489c-9868-046e76b9f8a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:53.540744 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fffc32c2-ca4f-489c-9868-046e76b9f8a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:53.541508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fffc32c2-ca4f-489c-9868-046e76b9f8a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:53.542581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fffc32c2-ca4f-489c-9868-046e76b9f8a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:53.543177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fffc32c2-ca4f-489c-9868-046e76b9f8a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:53.559446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f202a2d7-1761-4e8f-9e46-91924101b8b3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:53.560946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f202a2d7-1761-4e8f-9e46-91924101b8b3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:53.578746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f202a2d7-1761-4e8f-9e46-91924101b8b3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:53.586513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f202a2d7-1761-4e8f-9e46-91924101b8b3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:53.588465 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f202a2d7-1761-4e8f-9e46-91924101b8b3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:53.591781 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f202a2d7-1761-4e8f-9e46-91924101b8b3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:54.268195 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f202a2d7-1761-4e8f-9e46-91924101b8b3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:54.274575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fffc32c2-ca4f-489c-9868-046e76b9f8a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:54.288106 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fffc32c2-ca4f-489c-9868-046e76b9f8a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.774869 Jul 25 13:01:54.288367 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f202a2d7-1761-4e8f-9e46-91924101b8b3 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002" status: 200 len: 1516 microversion: 2.1 time: 0.732958 Jul 25 13:01:54.289511 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2089/4256] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:53 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:54.290241 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2168/4257] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:53 2022] GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002 => generated 1516 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:54.311541 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ec1ad4be-0fcf-4612-bab9-2f82d3529ba1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:54.312218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ec1ad4be-0fcf-4612-bab9-2f82d3529ba1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:54.318812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec1ad4be-0fcf-4612-bab9-2f82d3529ba1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:54.319263 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec1ad4be-0fcf-4612-bab9-2f82d3529ba1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:54.320046 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec1ad4be-0fcf-4612-bab9-2f82d3529ba1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:54.320493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec1ad4be-0fcf-4612-bab9-2f82d3529ba1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:54.581810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ec1ad4be-0fcf-4612-bab9-2f82d3529ba1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:54.597158 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ec1ad4be-0fcf-4612-bab9-2f82d3529ba1 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.289516 Jul 25 13:01:54.599474 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2090/4258] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:54 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:54.620336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-123c1aa4-591f-4754-aa3c-0b297223718d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:54.621454 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-123c1aa4-591f-4754-aa3c-0b297223718d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 216c0a5c-9c08-4c99-a4e2-18b1dce7c08a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:54.628761 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-123c1aa4-591f-4754-aa3c-0b297223718d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Instance 216c0a5c-9c08-4c99-a4e2-18b1dce7c08a could not be found. Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-123c1aa4-591f-4754-aa3c-0b297223718d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/216c0a5c-9c08-4c99-a4e2-18b1dce7c08a/action HTTP/1.1 Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 15 Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: {"unpause": {}} Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 216c0a5c-9c08-4c99-a4e2-18b1dce7c08a could not be found. Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '216c0a5c-9c08-4c99-a4e2-18b1dce7c08a', 'body': {'unpause': {}}} Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 216c0a5c-9c08-4c99-a4e2-18b1dce7c08a could not be found. Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 216c0a5c-9c08-4c99-a4e2-18b1dce7c08a could not be found. Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:54.632897 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:54.637720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:01:54.637720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:01:54.637720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 216c0a5c-9c08-4c99-a4e2-18b1dce7c08a could not be found. Jul 25 13:01:54.637720 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:54.639180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-123c1aa4-591f-4754-aa3c-0b297223718d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 404 to user: Instance 216c0a5c-9c08-4c99-a4e2-18b1dce7c08a could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:01:54.640223 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-123c1aa4-591f-4754-aa3c-0b297223718d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/216c0a5c-9c08-4c99-a4e2-18b1dce7c08a/action" status: 404 len: 111 microversion: 2.1 time: 0.023887 Jul 25 13:01:54.649336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-55952d60-0e98-4c17-9197-482d91609509 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:54.650228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-55952d60-0e98-4c17-9197-482d91609509 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:54.656480 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2169/4259] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:01:54 2022] POST /compute/v2.1/servers/216c0a5c-9c08-4c99-a4e2-18b1dce7c08a/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:01:54.658527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55952d60-0e98-4c17-9197-482d91609509 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:54.659326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55952d60-0e98-4c17-9197-482d91609509 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:54.660517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55952d60-0e98-4c17-9197-482d91609509 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:54.661217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55952d60-0e98-4c17-9197-482d91609509 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:54.763744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-22393838-ffc5-4728-944a-485c792139e5 req-54d998cc-0359-4640-88f3-f64e3401c2b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08f06850-1c68-450d-b47c-f5ef17f61002", "name": "network-vif-deleted", "tag": "ba60e464-f808-4ed5-832b-a2e66f2e29fd"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:54.817667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-22393838-ffc5-4728-944a-485c792139e5 req-54d998cc-0359-4640-88f3-f64e3401c2b4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:54.820216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-22393838-ffc5-4728-944a-485c792139e5 req-54d998cc-0359-4640-88f3-f64e3401c2b4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:54.844586 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-22393838-ffc5-4728-944a-485c792139e5 req-54d998cc-0359-4640-88f3-f64e3401c2b4 service nova] Creating event network-vif-deleted:ba60e464-f808-4ed5-832b-a2e66f2e29fd for instance 08f06850-1c68-450d-b47c-f5ef17f61002 on n-h2-848886-15 Jul 25 13:01:54.862960 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-22393838-ffc5-4728-944a-485c792139e5 req-54d998cc-0359-4640-88f3-f64e3401c2b4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103487 Jul 25 13:01:54.873855 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2170/4260] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:01:54.981401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-55952d60-0e98-4c17-9197-482d91609509 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:54.992773 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-55952d60-0e98-4c17-9197-482d91609509 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.347175 Jul 25 13:01:54.993942 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2091/4261] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:54 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:55.018387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-42ecba42-f659-4885-9fd1-95bc7298b7a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:55.021127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-42ecba42-f659-4885-9fd1-95bc7298b7a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:55.039902 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-42ecba42-f659-4885-9fd1-95bc7298b7a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:55.041446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-42ecba42-f659-4885-9fd1-95bc7298b7a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:55.043736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-42ecba42-f659-4885-9fd1-95bc7298b7a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:55.044183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-42ecba42-f659-4885-9fd1-95bc7298b7a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:55.239152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-42ecba42-f659-4885-9fd1-95bc7298b7a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:55.275123 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-42ecba42-f659-4885-9fd1-95bc7298b7a0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.262484 Jul 25 13:01:55.280559 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2171/4262] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:55 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:55.302697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5ccc03e4-6311-4bcb-b261-3b90aa7104e5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:55.303253 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5ccc03e4-6311-4bcb-b261-3b90aa7104e5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:55.315141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ccc03e4-6311-4bcb-b261-3b90aa7104e5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:55.315276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a880cd6b-29d8-4b55-a274-1a7247b5ad5b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:55.315798 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ccc03e4-6311-4bcb-b261-3b90aa7104e5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:55.315914 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a880cd6b-29d8-4b55-a274-1a7247b5ad5b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:55.316679 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ccc03e4-6311-4bcb-b261-3b90aa7104e5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:55.317156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ccc03e4-6311-4bcb-b261-3b90aa7104e5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:55.330376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a880cd6b-29d8-4b55-a274-1a7247b5ad5b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:55.330844 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a880cd6b-29d8-4b55-a274-1a7247b5ad5b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:55.334649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a880cd6b-29d8-4b55-a274-1a7247b5ad5b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:55.335798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a880cd6b-29d8-4b55-a274-1a7247b5ad5b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:55.379543 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-5ccc03e4-6311-4bcb-b261-3b90aa7104e5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Cannot 'unpause' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state active Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5ccc03e4-6311-4bcb-b261-3b90aa7104e5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action HTTP/1.1 Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 15 Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: {"unpause": {}} Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: exception: Cannot 'unpause' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state active Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2', 'body': {'unpause': {}}} Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 in vm_state active. Cannot unpause while the instance is in this state. Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state active Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:55.381423 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:55.385789 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:55.385789 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:01:55.385789 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:01:55.385789 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state active Jul 25 13:01:55.385789 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:55.385789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5ccc03e4-6311-4bcb-b261-3b90aa7104e5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 409 to user: Cannot 'unpause' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state active {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:01:55.385789 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5ccc03e4-6311-4bcb-b261-3b90aa7104e5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action" status: 409 len: 145 microversion: 2.1 time: 0.085750 Jul 25 13:01:55.394450 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2092/4263] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:01:55 2022] POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action => generated 145 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 13:01:55.407544 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-06f9c116-40dd-4d2f-8518-b8a336a12886 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:55.415688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-06f9c116-40dd-4d2f-8518-b8a336a12886 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:55.439570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06f9c116-40dd-4d2f-8518-b8a336a12886 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:55.442198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06f9c116-40dd-4d2f-8518-b8a336a12886 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:55.445672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06f9c116-40dd-4d2f-8518-b8a336a12886 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:55.453384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06f9c116-40dd-4d2f-8518-b8a336a12886 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:55.456897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a880cd6b-29d8-4b55-a274-1a7247b5ad5b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:55.457691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a880cd6b-29d8-4b55-a274-1a7247b5ad5b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:55.459955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-a880cd6b-29d8-4b55-a274-1a7247b5ad5b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lazy-loading 'fault' on Instance uuid 08f06850-1c68-450d-b47c-f5ef17f61002 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:01:55.576062 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a880cd6b-29d8-4b55-a274-1a7247b5ad5b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab304e8bfdd454584c3d511c4646e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247832dc5b24483c82cddea22f81d2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:55.607721 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a880cd6b-29d8-4b55-a274-1a7247b5ad5b tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002" status: 200 len: 1310 microversion: 2.1 time: 0.299464 Jul 25 13:01:55.610237 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2172/4264] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:55 2022] GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002 => generated 1310 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:55.863203 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-06f9c116-40dd-4d2f-8518-b8a336a12886 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:55.878019 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-06f9c116-40dd-4d2f-8518-b8a336a12886 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.477437 Jul 25 13:01:55.879446 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2093/4265] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:55 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:55.901860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-68e6c23c-0720-49f6-997f-eff4ba30f0d4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:55.903126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-68e6c23c-0720-49f6-997f-eff4ba30f0d4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:55.918441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68e6c23c-0720-49f6-997f-eff4ba30f0d4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:55.919458 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68e6c23c-0720-49f6-997f-eff4ba30f0d4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:55.923131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68e6c23c-0720-49f6-997f-eff4ba30f0d4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:55.924167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68e6c23c-0720-49f6-997f-eff4ba30f0d4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:56.330700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-68e6c23c-0720-49f6-997f-eff4ba30f0d4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:56.339553 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-68e6c23c-0720-49f6-997f-eff4ba30f0d4 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.442069 Jul 25 13:01:56.342496 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2173/4266] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:55 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:56.362899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-535f72e0-c632-403f-877f-b04e69278746 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:56.363766 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-535f72e0-c632-403f-877f-b04e69278746 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f26b1ecc-5cb6-4e03-9fdb-fdd799f10851] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:56.369608 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-535f72e0-c632-403f-877f-b04e69278746 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Instance f26b1ecc-5cb6-4e03-9fdb-fdd799f10851 could not be found. Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-535f72e0-c632-403f-877f-b04e69278746 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/f26b1ecc-5cb6-4e03-9fdb-fdd799f10851/action HTTP/1.1 Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 18 Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: {"unshelve": null} Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance f26b1ecc-5cb6-4e03-9fdb-fdd799f10851 could not be found. Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'f26b1ecc-5cb6-4e03-9fdb-fdd799f10851', 'body': {'unshelve': None}} Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f26b1ecc-5cb6-4e03-9fdb-fdd799f10851 could not be found. Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f26b1ecc-5cb6-4e03-9fdb-fdd799f10851 could not be found. Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:56.371917 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:56.377878 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:56.377878 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:01:56.377878 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:01:56.377878 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f26b1ecc-5cb6-4e03-9fdb-fdd799f10851 could not be found. Jul 25 13:01:56.377878 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:56.379414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-535f72e0-c632-403f-877f-b04e69278746 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 404 to user: Instance f26b1ecc-5cb6-4e03-9fdb-fdd799f10851 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:01:56.380520 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-535f72e0-c632-403f-877f-b04e69278746 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/f26b1ecc-5cb6-4e03-9fdb-fdd799f10851/action" status: 404 len: 111 microversion: 2.1 time: 0.022192 Jul 25 13:01:56.385041 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2094/4267] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:01:56 2022] POST /compute/v2.1/servers/f26b1ecc-5cb6-4e03-9fdb-fdd799f10851/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:01:56.390018 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0d934687-acad-4572-affb-ad3e22a21de7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:56.390747 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0d934687-acad-4572-affb-ad3e22a21de7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:56.397857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d934687-acad-4572-affb-ad3e22a21de7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:56.399330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d934687-acad-4572-affb-ad3e22a21de7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:56.400399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d934687-acad-4572-affb-ad3e22a21de7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:56.400917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d934687-acad-4572-affb-ad3e22a21de7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:56.631459 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9969849c-07fa-4fd3-a5d7-c6a3a7a7b677 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:56.632163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9969849c-07fa-4fd3-a5d7-c6a3a7a7b677 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] [instance: 08f06850-1c68-450d-b47c-f5ef17f61002] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:56.651329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9969849c-07fa-4fd3-a5d7-c6a3a7a7b677 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:56.651782 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9969849c-07fa-4fd3-a5d7-c6a3a7a7b677 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:56.652575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9969849c-07fa-4fd3-a5d7-c6a3a7a7b677 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:56.653469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9969849c-07fa-4fd3-a5d7-c6a3a7a7b677 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:56.690468 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-9969849c-07fa-4fd3-a5d7-c6a3a7a7b677 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] HTTP exception thrown: Instance 08f06850-1c68-450d-b47c-f5ef17f61002 could not be found. Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9969849c-07fa-4fd3-a5d7-c6a3a7a7b677 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Request method failure captured: Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002 HTTP/1.1 Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pPwpNOy1GVftYfckXoS_eNQnOgnYSEkjtLE5wKGEeeKZYX-RAUV1AXIWt6JgX8YF1CyA2cwXi-Z29QC5-Y2Y5GgZpOQato-i7n0aG1Wot1QuB1Ajsa483WI4Y8tzVbcTk_CftkY-csnPzKx9gkXv3-14beo7OPu18AZUnRXInG3-Bw Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 247832dc5b24483c82cddea22f81d2db Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ListServerFiltersTestJSON-1729202216 Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_247832dc5b24483c82cddea22f81d2db", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/247832dc5b24483c82cddea22f81d2db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/247832dc5b24483c82cddea22f81d2db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/247832dc5b24483c82cddea22f81d2db"}]}] Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ListServerFiltersTestJSON-1729202216 Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 247832dc5b24483c82cddea22f81d2db Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1729202216 Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ListServerFiltersTestJSON-1729202216-project Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8ab304e8bfdd454584c3d511c4646e45 Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ListServerFiltersTestJSON-1729202216-project Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 08f06850-1c68-450d-b47c-f5ef17f61002 could not be found. Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '08f06850-1c68-450d-b47c-f5ef17f61002'} Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08f06850-1c68-450d-b47c-f5ef17f61002 could not be found. Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08f06850-1c68-450d-b47c-f5ef17f61002 could not be found. Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:56.692345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:56.696688 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:56.696688 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:56.696688 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:56.696688 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:01:56.696688 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:01:56.696688 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08f06850-1c68-450d-b47c-f5ef17f61002 could not be found. Jul 25 13:01:56.696688 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:56.696688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9969849c-07fa-4fd3-a5d7-c6a3a7a7b677 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] Returning 404 to user: Instance 08f06850-1c68-450d-b47c-f5ef17f61002 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:01:56.696688 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9969849c-07fa-4fd3-a5d7-c6a3a7a7b677 tempest-ListServerFiltersTestJSON-1729202216 tempest-ListServerFiltersTestJSON-1729202216-project] 10.222.0.49 "GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002" status: 404 len: 111 microversion: 2.1 time: 0.066207 Jul 25 13:01:56.699225 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2095/4268] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:56 2022] GET /compute/v2.1/servers/08f06850-1c68-450d-b47c-f5ef17f61002 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 13:01:56.817489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0d934687-acad-4572-affb-ad3e22a21de7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:56.826115 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0d934687-acad-4572-affb-ad3e22a21de7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.439972 Jul 25 13:01:56.826770 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2174/4269] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:56 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:56.862754 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-62f98ff9-ec09-4713-8a37-6ea348cbdca5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:56.863784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-62f98ff9-ec09-4713-8a37-6ea348cbdca5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:56.879596 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62f98ff9-ec09-4713-8a37-6ea348cbdca5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:56.885003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62f98ff9-ec09-4713-8a37-6ea348cbdca5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:56.886503 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62f98ff9-ec09-4713-8a37-6ea348cbdca5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:56.889244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-62f98ff9-ec09-4713-8a37-6ea348cbdca5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:57.436490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-62f98ff9-ec09-4713-8a37-6ea348cbdca5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:57.447685 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-62f98ff9-ec09-4713-8a37-6ea348cbdca5 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.589367 Jul 25 13:01:57.450771 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2096/4270] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:56 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:57.475531 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-20ddc24a-021f-4f2f-9be0-70a29030cfb0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:57.478043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-20ddc24a-021f-4f2f-9be0-70a29030cfb0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:57.494988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20ddc24a-021f-4f2f-9be0-70a29030cfb0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:57.502293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20ddc24a-021f-4f2f-9be0-70a29030cfb0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:57.503586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20ddc24a-021f-4f2f-9be0-70a29030cfb0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:57.504147 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20ddc24a-021f-4f2f-9be0-70a29030cfb0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:57.555140 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-20ddc24a-021f-4f2f-9be0-70a29030cfb0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Cannot 'unshelve' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state active Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-20ddc24a-021f-4f2f-9be0-70a29030cfb0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action HTTP/1.1 Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 18 Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: {"unshelve": null} Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: exception: Cannot 'unshelve' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state active Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2', 'body': {'unshelve': None}} Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 in vm_state active. Cannot unshelve while the instance is in this state. Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state active Jul 25 13:01:57.558728 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:57.564725 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:57.564725 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:57.564725 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:57.564725 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:57.564725 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:57.564725 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:01:57.564725 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:01:57.564725 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state active Jul 25 13:01:57.564725 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:01:57.566006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-20ddc24a-021f-4f2f-9be0-70a29030cfb0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 409 to user: Cannot 'unshelve' instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 while it is in vm_state active {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:01:57.575644 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-20ddc24a-021f-4f2f-9be0-70a29030cfb0 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action" status: 409 len: 146 microversion: 2.1 time: 0.109179 Jul 25 13:01:57.576585 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2175/4271] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:01:57 2022] POST /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2/action => generated 146 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 13:01:57.586110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f2a38fc5-ee84-49f6-ba61-e4d4fd952ca8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:57.587220 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f2a38fc5-ee84-49f6-ba61-e4d4fd952ca8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:57.598218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f2a38fc5-ee84-49f6-ba61-e4d4fd952ca8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:57.599052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f2a38fc5-ee84-49f6-ba61-e4d4fd952ca8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:57.600112 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f2a38fc5-ee84-49f6-ba61-e4d4fd952ca8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:57.605802 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f2a38fc5-ee84-49f6-ba61-e4d4fd952ca8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:58.329584 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f2a38fc5-ee84-49f6-ba61-e4d4fd952ca8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:58.348436 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f2a38fc5-ee84-49f6-ba61-e4d4fd952ca8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.765701 Jul 25 13:01:58.350220 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2097/4272] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:57 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:58.376563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-588a4b10-8eff-42a1-b4d2-0bca3d8e5032 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:58.377257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-588a4b10-8eff-42a1-b4d2-0bca3d8e5032 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:58.390397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-588a4b10-8eff-42a1-b4d2-0bca3d8e5032 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:58.391887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-588a4b10-8eff-42a1-b4d2-0bca3d8e5032 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:58.392943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-588a4b10-8eff-42a1-b4d2-0bca3d8e5032 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:58.395698 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-588a4b10-8eff-42a1-b4d2-0bca3d8e5032 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:58.751730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-588a4b10-8eff-42a1-b4d2-0bca3d8e5032 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:58.767822 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-588a4b10-8eff-42a1-b4d2-0bca3d8e5032 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.389739 Jul 25 13:01:58.772936 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2176/4273] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:58 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:01:58.802925 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4b7338a9-4b51-40b6-8585-8c3724b49c0a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-453810497_updated"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:01:58.805958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4b7338a9-4b51-40b6-8585-8c3724b49c0a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 83ae46d3-262e-400b-9194-43dbfc23b4d4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:58.818419 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-4b7338a9-4b51-40b6-8585-8c3724b49c0a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Instance 83ae46d3-262e-400b-9194-43dbfc23b4d4 could not be found. Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4b7338a9-4b51-40b6-8585-8c3724b49c0a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: request: PUT /compute/v2.1/servers/83ae46d3-262e-400b-9194-43dbfc23b4d4 HTTP/1.1 Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 80 Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-453810497_updated"}} Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 83ae46d3-262e-400b-9194-43dbfc23b4d4 could not be found. Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '83ae46d3-262e-400b-9194-43dbfc23b4d4', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-453810497_updated'}}} Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83ae46d3-262e-400b-9194-43dbfc23b4d4 could not be found. Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 25 13:01:58.825499 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:01:58.834214 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:01:58.834214 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:01:58.834214 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:01:58.834214 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83ae46d3-262e-400b-9194-43dbfc23b4d4 could not be found. Jul 25 13:01:58.834214 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:58.834214 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:01:58.834214 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:58.834214 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:01:58.834214 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:01:58.834214 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:01:58.834214 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:01:58.834214 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:01:58.834214 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83ae46d3-262e-400b-9194-43dbfc23b4d4 could not be found. Jul 25 13:01:58.834214 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:01:58.834214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4b7338a9-4b51-40b6-8585-8c3724b49c0a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 404 to user: Instance 83ae46d3-262e-400b-9194-43dbfc23b4d4 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:01:58.834214 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4b7338a9-4b51-40b6-8585-8c3724b49c0a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "PUT /compute/v2.1/servers/83ae46d3-262e-400b-9194-43dbfc23b4d4" status: 404 len: 111 microversion: 2.1 time: 0.032026 Jul 25 13:01:58.840707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-295c86f2-6e53-4ace-adeb-270c1ad3d896 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:58.841508 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-295c86f2-6e53-4ace-adeb-270c1ad3d896 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:58.844643 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2098/4274] 10.222.0.49 () {60 vars in 1256 bytes} [Mon Jul 25 13:01:58 2022] PUT /compute/v2.1/servers/83ae46d3-262e-400b-9194-43dbfc23b4d4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:01:58.848211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-295c86f2-6e53-4ace-adeb-270c1ad3d896 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:58.853689 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-295c86f2-6e53-4ace-adeb-270c1ad3d896 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:58.854827 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-295c86f2-6e53-4ace-adeb-270c1ad3d896 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:58.855655 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-295c86f2-6e53-4ace-adeb-270c1ad3d896 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:58.956420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8608fa68-f8c5-41f4-abf7-fcee99e05150 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:58.958540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8608fa68-f8c5-41f4-abf7-fcee99e05150 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:58.973882 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8608fa68-f8c5-41f4-abf7-fcee99e05150 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:58.974728 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8608fa68-f8c5-41f4-abf7-fcee99e05150 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:58.975775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8608fa68-f8c5-41f4-abf7-fcee99e05150 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:58.976437 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8608fa68-f8c5-41f4-abf7-fcee99e05150 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:59.650593 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-295c86f2-6e53-4ace-adeb-270c1ad3d896 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:01:59.662464 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-295c86f2-6e53-4ace-adeb-270c1ad3d896 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.825660 Jul 25 13:01:59.666121 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2177/4275] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:58 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:59.732051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:59.748609 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8608fa68-f8c5-41f4-abf7-fcee99e05150 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1836 microversion: 2.1 time: 0.790655 Jul 25 13:01:59.753415 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2099/4276] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:58 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1836 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:01:59.772020 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dbdb6f0e-e9e2-4c1c-9d6a-8aadc7e6b064 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:01:59.772629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dbdb6f0e-e9e2-4c1c-9d6a-8aadc7e6b064 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:01:59.820445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbdb6f0e-e9e2-4c1c-9d6a-8aadc7e6b064 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:59.821421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbdb6f0e-e9e2-4c1c-9d6a-8aadc7e6b064 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:01:59.825096 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbdb6f0e-e9e2-4c1c-9d6a-8aadc7e6b064 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:01:59.835333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbdb6f0e-e9e2-4c1c-9d6a-8aadc7e6b064 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:00.299006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d68aa40d-0f87-4a48-804f-7d5df3f36eae tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1577778645", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "f46e86a9-fd84-45e5-9798-f49b6e2698ee"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:00.388043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-d68aa40d-0f87-4a48-804f-7d5df3f36eae tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] validate_networks() for [('f46e86a9-fd84-45e5-9798-f49b6e2698ee', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:02:00.408812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dbdb6f0e-e9e2-4c1c-9d6a-8aadc7e6b064 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:00.419950 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dbdb6f0e-e9e2-4c1c-9d6a-8aadc7e6b064 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.665015 Jul 25 13:02:00.429888 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2100/4277] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:01:59 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:00.448540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-068f6bfb-ac53-4a9c-9fb1-b0dde3eb552a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-068f6bfb-ac53-4a9c-9fb1-b0dde3eb552a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: request: PUT /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 HTTP/1.1 Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 280 Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:02:00.452993 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-068f6bfb-ac53-4a9c-9fb1-b0dde3eb552a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-068f6bfb-ac53-4a9c-9fb1-b0dde3eb552a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "PUT /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 400 len: 619 microversion: 2.1 time: 0.014417 Jul 25 13:02:00.459039 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2101/4278] 10.222.0.49 () {60 vars in 1257 bytes} [Mon Jul 25 13:02:00 2022] PUT /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 619 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:02:00.467955 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5f962577-652a-45d5-9b15-8b710a53eceb tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:00.471514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5f962577-652a-45d5-9b15-8b710a53eceb tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:00.482523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f962577-652a-45d5-9b15-8b710a53eceb tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:00.482973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f962577-652a-45d5-9b15-8b710a53eceb tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:00.483766 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f962577-652a-45d5-9b15-8b710a53eceb tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:00.484469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f962577-652a-45d5-9b15-8b710a53eceb tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:00.811947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5f962577-652a-45d5-9b15-8b710a53eceb tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:00.831403 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5f962577-652a-45d5-9b15-8b710a53eceb tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.367151 Jul 25 13:02:00.833564 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2102/4279] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:00 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:00.860776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2f915d63-f88d-4373-8394-d732f110cfc3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:00.862005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2f915d63-f88d-4373-8394-d732f110cfc3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:00.871294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f915d63-f88d-4373-8394-d732f110cfc3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:00.872352 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f915d63-f88d-4373-8394-d732f110cfc3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:00.874364 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f915d63-f88d-4373-8394-d732f110cfc3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:00.875058 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f915d63-f88d-4373-8394-d732f110cfc3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:01.326696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d68aa40d-0f87-4a48-804f-7d5df3f36eae tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:02:01.327865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d68aa40d-0f87-4a48-804f-7d5df3f36eae tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:02:01.328697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2f915d63-f88d-4373-8394-d732f110cfc3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:01.329368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d68aa40d-0f87-4a48-804f-7d5df3f36eae tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:02:01.331653 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d68aa40d-0f87-4a48-804f-7d5df3f36eae tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:02:01.332089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d68aa40d-0f87-4a48-804f-7d5df3f36eae tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:02:01.347300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d68aa40d-0f87-4a48-804f-7d5df3f36eae tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:01.347647 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2f915d63-f88d-4373-8394-d732f110cfc3 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.495034 Jul 25 13:02:01.348241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d68aa40d-0f87-4a48-804f-7d5df3f36eae tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:01.349504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d68aa40d-0f87-4a48-804f-7d5df3f36eae tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:01.350111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d68aa40d-0f87-4a48-804f-7d5df3f36eae tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:01.362013 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2103/4280] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:00 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:02:01.374144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a44eb561-9594-4c72-8105-c14db14b72f8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a44eb561-9594-4c72-8105-c14db14b72f8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: request: PUT /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 HTTP/1.1 Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 24 Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: {"server": {"name": ""}} Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2', 'body': {'server': {'name': ''}}} Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi '' Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 13:02:01.378778 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 25 13:02:01.384126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:02:01.384126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:02:01.384126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:02:01.384126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:02:01.384126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:02:01.384126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:02:01.384126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 13:02:01.384126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 13:02:01.384126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 25 13:02:01.384126 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:02:01.385479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-d68aa40d-0f87-4a48-804f-7d5df3f36eae tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Getting quotas for project 0542b4102fd6459e930e08104fc7a16b. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:02:01.385479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-d68aa40d-0f87-4a48-804f-7d5df3f36eae tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Getting quotas for user 25cc565157fa41bf8d0a1213964f48fb and project 0542b4102fd6459e930e08104fc7a16b. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:02:01.386643 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a44eb561-9594-4c72-8105-c14db14b72f8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:02:01.388036 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a44eb561-9594-4c72-8105-c14db14b72f8 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "PUT /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 400 len: 108 microversion: 2.1 time: 0.018876 Jul 25 13:02:01.390585 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2104/4281] 10.222.0.49 () {60 vars in 1256 bytes} [Mon Jul 25 13:02:01 2022] PUT /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:02:01.400216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d68aa40d-0f87-4a48-804f-7d5df3f36eae tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:02:01.402272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-73502245-0ea2-4c73-9790-66cffa660fb7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:01.403178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-73502245-0ea2-4c73-9790-66cffa660fb7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:01.409994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d68aa40d-0f87-4a48-804f-7d5df3f36eae tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:02:01.415885 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73502245-0ea2-4c73-9790-66cffa660fb7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:01.417022 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73502245-0ea2-4c73-9790-66cffa660fb7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:01.419014 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73502245-0ea2-4c73-9790-66cffa660fb7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:01.419865 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73502245-0ea2-4c73-9790-66cffa660fb7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:01.521250 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d68aa40d-0f87-4a48-804f-7d5df3f36eae tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.853111 Jul 25 13:02:01.523072 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2178/4282] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:01:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:02:01.543104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b05d2ecc-7d8d-4698-b733-6856095b2c4f tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:01.544173 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b05d2ecc-7d8d-4698-b733-6856095b2c4f tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:01.762335 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b05d2ecc-7d8d-4698-b733-6856095b2c4f tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:01.773185 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b05d2ecc-7d8d-4698-b733-6856095b2c4f tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1215 microversion: 2.1 time: 0.237094 Jul 25 13:02:01.773889 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2179/4283] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:01 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1215 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:01.849365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-73502245-0ea2-4c73-9790-66cffa660fb7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:01.870951 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-73502245-0ea2-4c73-9790-66cffa660fb7 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1505 microversion: 2.1 time: 0.472918 Jul 25 13:02:01.874168 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2105/4284] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:01 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1505 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:02:02.798579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-faab9ef3-3edc-4601-a07e-a5a7ee2cd27e tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:02.799452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-faab9ef3-3edc-4601-a07e-a5a7ee2cd27e tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:02.806908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1dd0b6b7-082f-4cb2-87a9-ff21179a0b9e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:02.807496 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1dd0b6b7-082f-4cb2-87a9-ff21179a0b9e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:02.826204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-faab9ef3-3edc-4601-a07e-a5a7ee2cd27e tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:02.828780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1dd0b6b7-082f-4cb2-87a9-ff21179a0b9e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:02.830831 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-faab9ef3-3edc-4601-a07e-a5a7ee2cd27e tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:02.831664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1dd0b6b7-082f-4cb2-87a9-ff21179a0b9e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:02.833101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-faab9ef3-3edc-4601-a07e-a5a7ee2cd27e tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:02.837619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-faab9ef3-3edc-4601-a07e-a5a7ee2cd27e tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:02.840006 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1dd0b6b7-082f-4cb2-87a9-ff21179a0b9e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:02.840686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1dd0b6b7-082f-4cb2-87a9-ff21179a0b9e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:02.951930 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1dd0b6b7-082f-4cb2-87a9-ff21179a0b9e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:02:02.993419 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-faab9ef3-3edc-4601-a07e-a5a7ee2cd27e tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:03.003073 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-faab9ef3-3edc-4601-a07e-a5a7ee2cd27e tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1211 microversion: 2.1 time: 0.209050 Jul 25 13:02:03.006033 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2180/4285] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:02 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1211 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:03.011544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-966f2b0f-fc54-497a-b7e7-b441d1511a23 req-465f23b5-0fcb-4385-9892-d0fc958acab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7954e97-a6c3-4017-a41d-2e61083c6ab5", "tag": "47fb272d-6ac9-419c-81e1-c632660c9f57"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:03.040834 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-966f2b0f-fc54-497a-b7e7-b441d1511a23 req-465f23b5-0fcb-4385-9892-d0fc958acab9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:03.041731 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-966f2b0f-fc54-497a-b7e7-b441d1511a23 req-465f23b5-0fcb-4385-9892-d0fc958acab9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:03.070504 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-966f2b0f-fc54-497a-b7e7-b441d1511a23 req-465f23b5-0fcb-4385-9892-d0fc958acab9 service nova] Creating event network-changed:47fb272d-6ac9-419c-81e1-c632660c9f57 for instance d7954e97-a6c3-4017-a41d-2e61083c6ab5 on n-h1-848886-15 Jul 25 13:02:03.090201 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-966f2b0f-fc54-497a-b7e7-b441d1511a23 req-465f23b5-0fcb-4385-9892-d0fc958acab9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082331 Jul 25 13:02:03.096451 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2181/4286] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:02:03.305123 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1dd0b6b7-082f-4cb2-87a9-ff21179a0b9e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 204 len: 0 microversion: 2.1 time: 0.493442 Jul 25 13:02:03.309348 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2106/4287] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:02:02 2022] DELETE /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 13:02:03.323221 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-43a5525c-0037-4283-b202-5d31869081b2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:03.324391 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-43a5525c-0037-4283-b202-5d31869081b2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:03.339592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-43a5525c-0037-4283-b202-5d31869081b2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:03.339592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-43a5525c-0037-4283-b202-5d31869081b2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:03.339592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-43a5525c-0037-4283-b202-5d31869081b2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:03.339592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-43a5525c-0037-4283-b202-5d31869081b2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:03.782764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-43a5525c-0037-4283-b202-5d31869081b2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:03.795868 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-43a5525c-0037-4283-b202-5d31869081b2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1689 microversion: 2.1 time: 0.480162 Jul 25 13:02:03.798487 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2182/4288] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:03 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1689 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:04.036466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a789dc44-8941-4e14-8c90-7c3581c471cb tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:04.043595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a789dc44-8941-4e14-8c90-7c3581c471cb tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:04.063715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a789dc44-8941-4e14-8c90-7c3581c471cb tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:04.064536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a789dc44-8941-4e14-8c90-7c3581c471cb tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:04.078767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a789dc44-8941-4e14-8c90-7c3581c471cb tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:04.079950 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a789dc44-8941-4e14-8c90-7c3581c471cb tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:04.213063 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a789dc44-8941-4e14-8c90-7c3581c471cb tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:04.226924 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a789dc44-8941-4e14-8c90-7c3581c471cb tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1275 microversion: 2.1 time: 0.191738 Jul 25 13:02:04.227716 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2107/4289] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:04 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1275 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:04.824497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-51bc811a-aa4c-4e09-98ef-bc941c1cc6c4 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:04.826873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-51bc811a-aa4c-4e09-98ef-bc941c1cc6c4 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:04.846249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-51bc811a-aa4c-4e09-98ef-bc941c1cc6c4 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:04.847112 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-51bc811a-aa4c-4e09-98ef-bc941c1cc6c4 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:04.848100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-51bc811a-aa4c-4e09-98ef-bc941c1cc6c4 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:04.848701 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-51bc811a-aa4c-4e09-98ef-bc941c1cc6c4 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:04.903316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:05.252326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ec1862b5-4822-4edc-adde-bf666c1c4958 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:05.253233 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ec1862b5-4822-4edc-adde-bf666c1c4958 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:05.272930 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec1862b5-4822-4edc-adde-bf666c1c4958 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:05.273377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec1862b5-4822-4edc-adde-bf666c1c4958 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:05.274397 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec1862b5-4822-4edc-adde-bf666c1c4958 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:05.278647 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec1862b5-4822-4edc-adde-bf666c1c4958 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:05.738209 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ec1862b5-4822-4edc-adde-bf666c1c4958 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:05.757600 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ec1862b5-4822-4edc-adde-bf666c1c4958 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1273 microversion: 2.1 time: 0.506361 Jul 25 13:02:05.759566 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2108/4290] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:05 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1273 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:06.041579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-51bc811a-aa4c-4e09-98ef-bc941c1cc6c4 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:06.082150 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-51bc811a-aa4c-4e09-98ef-bc941c1cc6c4 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1689 microversion: 2.1 time: 1.262433 Jul 25 13:02:06.083140 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2183/4291] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:04 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1689 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:06.783368 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-93017bd0-9715-4f7c-b0fe-3d1a76b38531 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:06.783912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-93017bd0-9715-4f7c-b0fe-3d1a76b38531 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:06.798565 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-93017bd0-9715-4f7c-b0fe-3d1a76b38531 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:06.798888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-93017bd0-9715-4f7c-b0fe-3d1a76b38531 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:06.799675 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-93017bd0-9715-4f7c-b0fe-3d1a76b38531 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:06.806797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-93017bd0-9715-4f7c-b0fe-3d1a76b38531 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:06.971594 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-93017bd0-9715-4f7c-b0fe-3d1a76b38531 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:06.982116 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-93017bd0-9715-4f7c-b0fe-3d1a76b38531 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1273 microversion: 2.1 time: 0.202749 Jul 25 13:02:07.005722 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2109/4292] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:06 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1273 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:07.105619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d77cc1bd-f2d2-4d89-ae75-a2adefff4142 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:07.106269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d77cc1bd-f2d2-4d89-ae75-a2adefff4142 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:07.123489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d77cc1bd-f2d2-4d89-ae75-a2adefff4142 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:07.126790 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d77cc1bd-f2d2-4d89-ae75-a2adefff4142 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:07.138326 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d77cc1bd-f2d2-4d89-ae75-a2adefff4142 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:07.139291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d77cc1bd-f2d2-4d89-ae75-a2adefff4142 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:07.706924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d77cc1bd-f2d2-4d89-ae75-a2adefff4142 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:07.715993 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d77cc1bd-f2d2-4d89-ae75-a2adefff4142 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1621 microversion: 2.1 time: 0.615020 Jul 25 13:02:07.716602 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2184/4293] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:07 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1621 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:08.012660 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8be55c9f-6d5a-4ee1-bad9-48933b32e2ce tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:08.014137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8be55c9f-6d5a-4ee1-bad9-48933b32e2ce tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:08.025127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8be55c9f-6d5a-4ee1-bad9-48933b32e2ce tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:08.026558 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8be55c9f-6d5a-4ee1-bad9-48933b32e2ce tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:08.027828 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8be55c9f-6d5a-4ee1-bad9-48933b32e2ce tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:08.028445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8be55c9f-6d5a-4ee1-bad9-48933b32e2ce tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:08.289067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8be55c9f-6d5a-4ee1-bad9-48933b32e2ce tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:08.311888 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8be55c9f-6d5a-4ee1-bad9-48933b32e2ce tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1273 microversion: 2.1 time: 0.303479 Jul 25 13:02:08.313085 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2110/4294] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:08 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1273 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:08.748970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-687a6d6c-55c7-40c2-97a6-a7bdf659d7cc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:08.748970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-687a6d6c-55c7-40c2-97a6-a7bdf659d7cc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:08.780311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-687a6d6c-55c7-40c2-97a6-a7bdf659d7cc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:08.782573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-687a6d6c-55c7-40c2-97a6-a7bdf659d7cc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:08.786070 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-687a6d6c-55c7-40c2-97a6-a7bdf659d7cc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:08.790003 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-687a6d6c-55c7-40c2-97a6-a7bdf659d7cc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:08.916842 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-5d49a6b3-c2ab-4bb9-aa97-1fd8b1d07339 req-b4d0ae3b-c6b1-4f5b-bf45-e349805f7bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7954e97-a6c3-4017-a41d-2e61083c6ab5", "name": "network-vif-deleted", "tag": "47fb272d-6ac9-419c-81e1-c632660c9f57"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:08.952256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-5d49a6b3-c2ab-4bb9-aa97-1fd8b1d07339 req-b4d0ae3b-c6b1-4f5b-bf45-e349805f7bbb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:08.953205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-5d49a6b3-c2ab-4bb9-aa97-1fd8b1d07339 req-b4d0ae3b-c6b1-4f5b-bf45-e349805f7bbb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:08.994508 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-5d49a6b3-c2ab-4bb9-aa97-1fd8b1d07339 req-b4d0ae3b-c6b1-4f5b-bf45-e349805f7bbb service nova] Creating event network-vif-deleted:47fb272d-6ac9-419c-81e1-c632660c9f57 for instance d7954e97-a6c3-4017-a41d-2e61083c6ab5 on n-h1-848886-15 Jul 25 13:02:09.007895 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-5d49a6b3-c2ab-4bb9-aa97-1fd8b1d07339 req-b4d0ae3b-c6b1-4f5b-bf45-e349805f7bbb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096504 Jul 25 13:02:09.011614 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2111/4295] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:02:09.071894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-687a6d6c-55c7-40c2-97a6-a7bdf659d7cc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:09.082233 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-687a6d6c-55c7-40c2-97a6-a7bdf659d7cc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 200 len: 1502 microversion: 2.1 time: 0.340239 Jul 25 13:02:09.090614 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2185/4296] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:08 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 1502 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:09.343415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f82ead49-3cfd-4aa4-91b4-22d9e0f15b17 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:09.344954 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f82ead49-3cfd-4aa4-91b4-22d9e0f15b17 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:09.359723 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f82ead49-3cfd-4aa4-91b4-22d9e0f15b17 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:09.366307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f82ead49-3cfd-4aa4-91b4-22d9e0f15b17 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:09.367976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f82ead49-3cfd-4aa4-91b4-22d9e0f15b17 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:09.368617 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f82ead49-3cfd-4aa4-91b4-22d9e0f15b17 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:10.114880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-05e002c3-8dff-4919-8c98-1c3daf1fd761 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:10.116588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-05e002c3-8dff-4919-8c98-1c3daf1fd761 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: d7954e97-a6c3-4017-a41d-2e61083c6ab5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:10.131470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05e002c3-8dff-4919-8c98-1c3daf1fd761 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:10.131964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05e002c3-8dff-4919-8c98-1c3daf1fd761 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:10.132817 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05e002c3-8dff-4919-8c98-1c3daf1fd761 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:10.133400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05e002c3-8dff-4919-8c98-1c3daf1fd761 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:10.171684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f82ead49-3cfd-4aa4-91b4-22d9e0f15b17 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:10.179554 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f82ead49-3cfd-4aa4-91b4-22d9e0f15b17 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1315 microversion: 2.1 time: 0.840665 Jul 25 13:02:10.184668 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2112/4297] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:09 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1315 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:02:10.226029 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-05e002c3-8dff-4919-8c98-1c3daf1fd761 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] HTTP exception thrown: Instance d7954e97-a6c3-4017-a41d-2e61083c6ab5 could not be found. Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-05e002c3-8dff-4919-8c98-1c3daf1fd761 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Request method failure captured: Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 HTTP/1.1 Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pOuxv1dAEBzvSabAQZ_ovDwuoLarmYwGpqO0VLOXbqAAPunlD8O5vVMgj3IKl9VjFTX9CDCr160FLaCnWQQdTWXXvoL3KfTvXE9pkHJ0Gohl1rBvvU5lXAiAERAFVQa6cNt2uvom2njdnumPINWUCHjcLWMzSCxBYR5oNDLeJ--HHc Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: c0d891a772834e43bdfcbde778a90498 Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-406327327 Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c0d891a772834e43bdfcbde778a90498", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c0d891a772834e43bdfcbde778a90498"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0d891a772834e43bdfcbde778a90498"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0d891a772834e43bdfcbde778a90498"}]}] Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestNetworkAdvancedServerOps-406327327 Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: c0d891a772834e43bdfcbde778a90498 Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-406327327 Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestNetworkAdvancedServerOps-406327327-project Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 4d6e2ae351744e0ab1f153d629e4f0e7 Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestNetworkAdvancedServerOps-406327327-project Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance d7954e97-a6c3-4017-a41d-2e61083c6ab5 could not be found. Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'd7954e97-a6c3-4017-a41d-2e61083c6ab5'} Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7954e97-a6c3-4017-a41d-2e61083c6ab5 could not be found. Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7954e97-a6c3-4017-a41d-2e61083c6ab5 could not be found. Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:02:10.228379 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:10.233403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:02:10.233403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:02:10.233403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:02:10.233403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:02:10.233403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:02:10.233403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7954e97-a6c3-4017-a41d-2e61083c6ab5 could not be found. Jul 25 13:02:10.233403 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:10.243032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-05e002c3-8dff-4919-8c98-1c3daf1fd761 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Returning 404 to user: Instance d7954e97-a6c3-4017-a41d-2e61083c6ab5 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:02:10.244289 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-05e002c3-8dff-4919-8c98-1c3daf1fd761 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5" status: 404 len: 111 microversion: 2.1 time: 0.133256 Jul 25 13:02:10.250026 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2186/4298] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:10 2022] GET /compute/v2.1/servers/d7954e97-a6c3-4017-a41d-2e61083c6ab5 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 13:02:11.205282 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-19589a55-ee3e-4498-86b3-d7e18bae3803 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:11.207816 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-19589a55-ee3e-4498-86b3-d7e18bae3803 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:11.228808 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19589a55-ee3e-4498-86b3-d7e18bae3803 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:11.229862 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19589a55-ee3e-4498-86b3-d7e18bae3803 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:11.230760 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19589a55-ee3e-4498-86b3-d7e18bae3803 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:11.233145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19589a55-ee3e-4498-86b3-d7e18bae3803 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:11.272147 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a5bdd41f-bd1f-4679-b4af-e88e6dedf68c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:11.273341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a5bdd41f-bd1f-4679-b4af-e88e6dedf68c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 10b1244b-a55e-40c5-a394-e1be83ed505b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:11.283938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5bdd41f-bd1f-4679-b4af-e88e6dedf68c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:11.291248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5bdd41f-bd1f-4679-b4af-e88e6dedf68c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:11.292477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5bdd41f-bd1f-4679-b4af-e88e6dedf68c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:11.293256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5bdd41f-bd1f-4679-b4af-e88e6dedf68c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:11.327653 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-a5bdd41f-bd1f-4679-b4af-e88e6dedf68c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a5bdd41f-bd1f-4679-b4af-e88e6dedf68c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b HTTP/1.1 Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '10b1244b-a55e-40c5-a394-e1be83ed505b'} Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:02:11.329612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:02:11.333733 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 13:02:11.333733 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:11.333733 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:02:11.333733 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:11.333733 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:02:11.333733 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:02:11.333733 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:02:11.333733 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:02:11.333733 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:02:11.333733 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 13:02:11.333733 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:11.336775 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a5bdd41f-bd1f-4679-b4af-e88e6dedf68c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 404 to user: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:02:11.337909 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a5bdd41f-bd1f-4679-b4af-e88e6dedf68c tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "DELETE /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b" status: 404 len: 111 microversion: 2.1 time: 0.069625 Jul 25 13:02:11.339014 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2187/4299] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:02:11 2022] DELETE /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:02:11.350636 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f80b5040-bfa8-47a1-9873-26f528ef5f3b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:11.352974 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f80b5040-bfa8-47a1-9873-26f528ef5f3b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: 10b1244b-a55e-40c5-a394-e1be83ed505b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:11.362316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f80b5040-bfa8-47a1-9873-26f528ef5f3b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:11.362599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f80b5040-bfa8-47a1-9873-26f528ef5f3b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:11.363595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f80b5040-bfa8-47a1-9873-26f528ef5f3b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:11.364179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f80b5040-bfa8-47a1-9873-26f528ef5f3b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:11.379709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:11.381515 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-f80b5040-bfa8-47a1-9873-26f528ef5f3b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f80b5040-bfa8-47a1-9873-26f528ef5f3b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b HTTP/1.1 Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '10b1244b-a55e-40c5-a394-e1be83ed505b'} Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:02:11.383308 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:11.388082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:02:11.388082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:02:11.388082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:02:11.388082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:02:11.388082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:02:11.388082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. Jul 25 13:02:11.388082 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:11.389607 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f80b5040-bfa8-47a1-9873-26f528ef5f3b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 404 to user: Instance 10b1244b-a55e-40c5-a394-e1be83ed505b could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:02:11.390697 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f80b5040-bfa8-47a1-9873-26f528ef5f3b tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b" status: 404 len: 111 microversion: 2.1 time: 0.044105 Jul 25 13:02:11.394176 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2188/4300] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:11 2022] GET /compute/v2.1/servers/10b1244b-a55e-40c5-a394-e1be83ed505b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:02:11.420875 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-933138eb-1ff3-4434-99cf-91e706d8000a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:11.421358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-933138eb-1ff3-4434-99cf-91e706d8000a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:11.428521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-933138eb-1ff3-4434-99cf-91e706d8000a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:11.429312 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-933138eb-1ff3-4434-99cf-91e706d8000a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:11.430670 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-933138eb-1ff3-4434-99cf-91e706d8000a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:11.432644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-933138eb-1ff3-4434-99cf-91e706d8000a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:11.466891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-933138eb-1ff3-4434-99cf-91e706d8000a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:02:11.623334 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-933138eb-1ff3-4434-99cf-91e706d8000a tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 204 len: 0 microversion: 2.1 time: 0.226699 Jul 25 13:02:11.629614 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2189/4301] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:02:11 2022] DELETE /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 13:02:11.645238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-be2d73f2-0ba6-4ef4-a783-5c87ecfd0801 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:11.647292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-be2d73f2-0ba6-4ef4-a783-5c87ecfd0801 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:11.660229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be2d73f2-0ba6-4ef4-a783-5c87ecfd0801 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:11.660998 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be2d73f2-0ba6-4ef4-a783-5c87ecfd0801 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:11.663043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be2d73f2-0ba6-4ef4-a783-5c87ecfd0801 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:11.663860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be2d73f2-0ba6-4ef4-a783-5c87ecfd0801 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:11.763991 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-19589a55-ee3e-4498-86b3-d7e18bae3803 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:11.767927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=8 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:11.774174 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-19589a55-ee3e-4498-86b3-d7e18bae3803 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1315 microversion: 2.1 time: 0.573030 Jul 25 13:02:11.775161 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2113/4302] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:11 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:12.063503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-be2d73f2-0ba6-4ef4-a783-5c87ecfd0801 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:12.074262 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-be2d73f2-0ba6-4ef4-a783-5c87ecfd0801 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1511 microversion: 2.1 time: 0.438184 Jul 25 13:02:12.074881 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2190/4303] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:11 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1511 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:12.795808 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-528d317d-3c2e-4224-b81b-91cfd4e62d5f tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:12.797077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-528d317d-3c2e-4224-b81b-91cfd4e62d5f tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:12.816938 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-528d317d-3c2e-4224-b81b-91cfd4e62d5f tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:12.820798 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-528d317d-3c2e-4224-b81b-91cfd4e62d5f tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:12.821770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-528d317d-3c2e-4224-b81b-91cfd4e62d5f tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:12.826578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-528d317d-3c2e-4224-b81b-91cfd4e62d5f tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:12.976169 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-388fb08d-5fee-400a-a04a-2ea4ed91c792 req-92de8d2e-9c48-41da-ba2d-16bec7e70a34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a62d654-72dd-4208-984f-1d8e8a807376", "tag": "2be9f87e-ddaa-436c-b7d1-9c9d4d63e373"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:12.998712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-388fb08d-5fee-400a-a04a-2ea4ed91c792 req-92de8d2e-9c48-41da-ba2d-16bec7e70a34 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:13.001791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-388fb08d-5fee-400a-a04a-2ea4ed91c792 req-92de8d2e-9c48-41da-ba2d-16bec7e70a34 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:13.042562 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-388fb08d-5fee-400a-a04a-2ea4ed91c792 req-92de8d2e-9c48-41da-ba2d-16bec7e70a34 service nova] Creating event network-changed:2be9f87e-ddaa-436c-b7d1-9c9d4d63e373 for instance 4a62d654-72dd-4208-984f-1d8e8a807376 on n-h1-848886-15 Jul 25 13:02:13.057712 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-388fb08d-5fee-400a-a04a-2ea4ed91c792 req-92de8d2e-9c48-41da-ba2d-16bec7e70a34 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085259 Jul 25 13:02:13.060150 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2191/4304] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:02:13.099918 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4cff3235-b268-4488-95a8-ff3b4dc60d99 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:13.100911 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4cff3235-b268-4488-95a8-ff3b4dc60d99 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:13.124905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4cff3235-b268-4488-95a8-ff3b4dc60d99 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:13.125359 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4cff3235-b268-4488-95a8-ff3b4dc60d99 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:13.126375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4cff3235-b268-4488-95a8-ff3b4dc60d99 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:13.127023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4cff3235-b268-4488-95a8-ff3b4dc60d99 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:13.528955 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-528d317d-3c2e-4224-b81b-91cfd4e62d5f tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:13.540651 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-528d317d-3c2e-4224-b81b-91cfd4e62d5f tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1315 microversion: 2.1 time: 0.748567 Jul 25 13:02:13.555199 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2114/4305] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:12 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1315 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:13.851804 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4cff3235-b268-4488-95a8-ff3b4dc60d99 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:13.861749 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4cff3235-b268-4488-95a8-ff3b4dc60d99 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1511 microversion: 2.1 time: 0.765340 Jul 25 13:02:13.866658 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2192/4306] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:13 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1511 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:14.564289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0157f93f-f21a-4d73-b6c2-1ee7f5bd03d0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:14.564918 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0157f93f-f21a-4d73-b6c2-1ee7f5bd03d0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:14.583189 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0157f93f-f21a-4d73-b6c2-1ee7f5bd03d0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:14.583659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0157f93f-f21a-4d73-b6c2-1ee7f5bd03d0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:14.584461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0157f93f-f21a-4d73-b6c2-1ee7f5bd03d0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:14.584906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0157f93f-f21a-4d73-b6c2-1ee7f5bd03d0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:14.890877 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fffd871e-d719-4ee5-91b9-a6b751ae8a3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:14.892049 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fffd871e-d719-4ee5-91b9-a6b751ae8a3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:14.900276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fffd871e-d719-4ee5-91b9-a6b751ae8a3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:14.903714 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fffd871e-d719-4ee5-91b9-a6b751ae8a3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:14.905083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fffd871e-d719-4ee5-91b9-a6b751ae8a3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:14.906987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fffd871e-d719-4ee5-91b9-a6b751ae8a3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:14.960481 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0157f93f-f21a-4d73-b6c2-1ee7f5bd03d0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:14.981576 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0157f93f-f21a-4d73-b6c2-1ee7f5bd03d0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1315 microversion: 2.1 time: 0.412374 Jul 25 13:02:14.982894 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2115/4307] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:14 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:15.213569 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fffd871e-d719-4ee5-91b9-a6b751ae8a3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:15.224192 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fffd871e-d719-4ee5-91b9-a6b751ae8a3d tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1469 microversion: 2.1 time: 0.337679 Jul 25 13:02:15.242889 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2193/4308] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:14 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1469 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:02:15.689250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dbf21e7d-0a4b-49ef-acea-9e987c86b1c9 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:15.689762 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dbf21e7d-0a4b-49ef-acea-9e987c86b1c9 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:15.714469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbf21e7d-0a4b-49ef-acea-9e987c86b1c9 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:15.715149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbf21e7d-0a4b-49ef-acea-9e987c86b1c9 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:15.719478 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbf21e7d-0a4b-49ef-acea-9e987c86b1c9 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:15.720357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbf21e7d-0a4b-49ef-acea-9e987c86b1c9 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:15.731195 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-1ddfa86d-f2d2-4e23-9713-150b83232397 req-5eaafa1b-ecaf-4012-a581-f3711ac0987d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2", "name": "network-vif-deleted", "tag": "a2ca9e31-6d49-4fae-9ff5-c3c32be13ff6"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:15.754721 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-1ddfa86d-f2d2-4e23-9713-150b83232397 req-5eaafa1b-ecaf-4012-a581-f3711ac0987d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:15.761037 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-1ddfa86d-f2d2-4e23-9713-150b83232397 req-5eaafa1b-ecaf-4012-a581-f3711ac0987d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:15.811490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dbf21e7d-0a4b-49ef-acea-9e987c86b1c9 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:02:15.883010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:15.997578 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dbf21e7d-0a4b-49ef-acea-9e987c86b1c9 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "DELETE /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 204 len: 0 microversion: 2.42 time: 0.852095 Jul 25 13:02:16.001707 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2116/4309] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 13:02:15 2022] DELETE /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 0 bytes in 854 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 13:02:16.007564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-636cbc72-7afe-469e-89c3-297a11e6459a tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:16.015275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-636cbc72-7afe-469e-89c3-297a11e6459a tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:16.022094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-636cbc72-7afe-469e-89c3-297a11e6459a tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:16.034141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-636cbc72-7afe-469e-89c3-297a11e6459a tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:16.035382 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-636cbc72-7afe-469e-89c3-297a11e6459a tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:16.036024 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-636cbc72-7afe-469e-89c3-297a11e6459a tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:16.436714 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-1ddfa86d-f2d2-4e23-9713-150b83232397 req-5eaafa1b-ecaf-4012-a581-f3711ac0987d service nova] Creating event network-vif-deleted:a2ca9e31-6d49-4fae-9ff5-c3c32be13ff6 for instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 on n-h1-848886-15 Jul 25 13:02:16.452948 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-1ddfa86d-f2d2-4e23-9713-150b83232397 req-5eaafa1b-ecaf-4012-a581-f3711ac0987d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.725469 Jul 25 13:02:16.457957 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2194/4310] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:02:16.473000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a2fefead-7147-488d-b37d-a22bef7d9d48 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:16.474463 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a2fefead-7147-488d-b37d-a22bef7d9d48 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:16.489879 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a2fefead-7147-488d-b37d-a22bef7d9d48 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:16.490642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a2fefead-7147-488d-b37d-a22bef7d9d48 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:16.491637 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a2fefead-7147-488d-b37d-a22bef7d9d48 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:16.492305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a2fefead-7147-488d-b37d-a22bef7d9d48 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:16.984301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-636cbc72-7afe-469e-89c3-297a11e6459a tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:17.002743 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-636cbc72-7afe-469e-89c3-297a11e6459a tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1315 microversion: 2.1 time: 0.997869 Jul 25 13:02:17.008084 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2117/4311] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:16 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1315 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:17.021956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5db99f00-d0fd-4d7e-a55b-9d886101f933 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:17.021956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5db99f00-d0fd-4d7e-a55b-9d886101f933 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:17.037100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5db99f00-d0fd-4d7e-a55b-9d886101f933 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:17.038381 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5db99f00-d0fd-4d7e-a55b-9d886101f933 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:17.039876 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5db99f00-d0fd-4d7e-a55b-9d886101f933 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:17.040911 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5db99f00-d0fd-4d7e-a55b-9d886101f933 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:17.133094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5db99f00-d0fd-4d7e-a55b-9d886101f933 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:17.138103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5db99f00-d0fd-4d7e-a55b-9d886101f933 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:17.138688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-5db99f00-d0fd-4d7e-a55b-9d886101f933 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lazy-loading 'fault' on Instance uuid f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:02:17.449604 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a2fefead-7147-488d-b37d-a22bef7d9d48 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:17.451936 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5db99f00-d0fd-4d7e-a55b-9d886101f933 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ffb5ac9fb47ba9e1314560898530a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd603ed2eec0344f1b95246394be424f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:17.463378 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5db99f00-d0fd-4d7e-a55b-9d886101f933 tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 200 len: 1306 microversion: 2.1 time: 0.453945 Jul 25 13:02:17.477007 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2118/4312] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:17 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 1306 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:17.477247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a2fefead-7147-488d-b37d-a22bef7d9d48 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:17.477247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a2fefead-7147-488d-b37d-a22bef7d9d48 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:17.477247 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a2fefead-7147-488d-b37d-a22bef7d9d48 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 2953 microversion: 2.42 time: 1.009775 Jul 25 13:02:17.492835 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2195/4313] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:02:16 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 2953 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:02:18.027720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-80a35470-dccb-4327-9c6c-6c3f15d364c5 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:18.028344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-80a35470-dccb-4327-9c6c-6c3f15d364c5 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:18.031620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:18.049118 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80a35470-dccb-4327-9c6c-6c3f15d364c5 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:18.050040 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80a35470-dccb-4327-9c6c-6c3f15d364c5 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:18.051070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80a35470-dccb-4327-9c6c-6c3f15d364c5 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:18.051728 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80a35470-dccb-4327-9c6c-6c3f15d364c5 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:18.485354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e57281a8-d30d-45e7-8706-fb12966efa1e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:18.486642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e57281a8-d30d-45e7-8706-fb12966efa1e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] [instance: f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:18.500746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e57281a8-d30d-45e7-8706-fb12966efa1e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:18.506937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e57281a8-d30d-45e7-8706-fb12966efa1e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:18.508930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e57281a8-d30d-45e7-8706-fb12966efa1e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:18.509498 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e57281a8-d30d-45e7-8706-fb12966efa1e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:18.548310 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-e57281a8-d30d-45e7-8706-fb12966efa1e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] HTTP exception thrown: Instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 could not be found. Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e57281a8-d30d-45e7-8706-fb12966efa1e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Request method failure captured: Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 HTTP/1.1 Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pN2Sobm1c0Cu3z1cTUqhTCb8QGhqFqymS0XSOWOzUs_fg-znPr1q4-TO7spuVwNJtTA3SEvGXfxMZLksAI56ddDcCBxJwI3XmvYxDxD1z3q_S5BC7P3vIoR6K7-A5mx1pgM0DXkIcB4VhAGueIL1ugCbBL1Wq0f_JD2AKw1YGrDzrE Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d603ed2eec0344f1b95246394be424f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d603ed2eec0344f1b95246394be424f1"}]}] Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d603ed2eec0344f1b95246394be424f1 Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-494267053 Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 036ffb5ac9fb47ba9e1314560898530a Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-494267053-project Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 could not be found. Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2'} Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 could not be found. Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 could not be found. Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:02:18.552737 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:18.559065 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:02:18.559065 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:02:18.559065 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:02:18.559065 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:02:18.559065 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:02:18.559065 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 could not be found. Jul 25 13:02:18.559065 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:18.559065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e57281a8-d30d-45e7-8706-fb12966efa1e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] Returning 404 to user: Instance f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:02:18.559065 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e57281a8-d30d-45e7-8706-fb12966efa1e tempest-ServersNegativeTestJSON-494267053 tempest-ServersNegativeTestJSON-494267053-project] 10.222.0.49 "GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2" status: 404 len: 111 microversion: 2.1 time: 0.076251 Jul 25 13:02:18.563275 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2196/4314] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:18 2022] GET /compute/v2.1/servers/f8d12a2f-4089-45e8-ac14-b8b7ca94b3f2 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:02:18.573611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-738094f4-91aa-48dc-be96-6e336d405ad1 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:18.582575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-738094f4-91aa-48dc-be96-6e336d405ad1 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:18.603666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-738094f4-91aa-48dc-be96-6e336d405ad1 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:18.605714 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-738094f4-91aa-48dc-be96-6e336d405ad1 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:18.607464 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-738094f4-91aa-48dc-be96-6e336d405ad1 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:18.623487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-738094f4-91aa-48dc-be96-6e336d405ad1 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:19.055894 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-80a35470-dccb-4327-9c6c-6c3f15d364c5 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:19.073753 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-80a35470-dccb-4327-9c6c-6c3f15d364c5 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1315 microversion: 2.1 time: 1.048207 Jul 25 13:02:19.075619 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2119/4315] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:18 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1315 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:19.330278 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-15ae768c-ecd0-4cee-8545-5a6336f82a00 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-647978346", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "a20635d2-de82-4896-a4f9-e744e4edcf6a"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:19.463063 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-15ae768c-ecd0-4cee-8545-5a6336f82a00 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] validate_networks() for [('a20635d2-de82-4896-a4f9-e744e4edcf6a', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:02:19.501688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-738094f4-91aa-48dc-be96-6e336d405ad1 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:19.533490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-738094f4-91aa-48dc-be96-6e336d405ad1 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:19.537357 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-738094f4-91aa-48dc-be96-6e336d405ad1 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:19.539623 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-738094f4-91aa-48dc-be96-6e336d405ad1 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 2953 microversion: 2.42 time: 0.975154 Jul 25 13:02:19.567202 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2197/4316] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:02:18 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 2953 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:02:19.683462 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-96ec695c-d080-4503-96bf-d261db244e06 req-e226b957-4eda-488a-bc15-4a3a551475c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a62d654-72dd-4208-984f-1d8e8a807376", "name": "network-vif-plugged", "status": "completed", "tag": "2be9f87e-ddaa-436c-b7d1-9c9d4d63e373"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:19.722634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-96ec695c-d080-4503-96bf-d261db244e06 req-e226b957-4eda-488a-bc15-4a3a551475c2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:19.726778 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-96ec695c-d080-4503-96bf-d261db244e06 req-e226b957-4eda-488a-bc15-4a3a551475c2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:19.762792 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-96ec695c-d080-4503-96bf-d261db244e06 req-e226b957-4eda-488a-bc15-4a3a551475c2 service nova] Creating event network-vif-plugged:2be9f87e-ddaa-436c-b7d1-9c9d4d63e373 for instance 4a62d654-72dd-4208-984f-1d8e8a807376 on n-h1-848886-15 Jul 25 13:02:19.777892 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-96ec695c-d080-4503-96bf-d261db244e06 req-e226b957-4eda-488a-bc15-4a3a551475c2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098218 Jul 25 13:02:19.780604 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2198/4317] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:02:20.097320 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f5fdcae5-58a7-4aa1-bff5-471c2fb2bfe4 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:20.098211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f5fdcae5-58a7-4aa1-bff5-471c2fb2bfe4 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:20.109207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5fdcae5-58a7-4aa1-bff5-471c2fb2bfe4 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:20.109663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5fdcae5-58a7-4aa1-bff5-471c2fb2bfe4 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:20.110489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5fdcae5-58a7-4aa1-bff5-471c2fb2bfe4 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:20.110932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5fdcae5-58a7-4aa1-bff5-471c2fb2bfe4 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:20.970360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f5fdcae5-58a7-4aa1-bff5-471c2fb2bfe4 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:20.989217 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f5fdcae5-58a7-4aa1-bff5-471c2fb2bfe4 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1315 microversion: 2.1 time: 0.892292 Jul 25 13:02:20.990602 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2199/4318] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:20 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1315 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:21.006977 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d59443e1-99e1-4313-9127-5792c15db88b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:21.008108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d59443e1-99e1-4313-9127-5792c15db88b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:21.024388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d59443e1-99e1-4313-9127-5792c15db88b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:21.025028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d59443e1-99e1-4313-9127-5792c15db88b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:21.025820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d59443e1-99e1-4313-9127-5792c15db88b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:21.026279 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d59443e1-99e1-4313-9127-5792c15db88b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:21.592465 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d59443e1-99e1-4313-9127-5792c15db88b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:21.605466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d59443e1-99e1-4313-9127-5792c15db88b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:21.611111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d59443e1-99e1-4313-9127-5792c15db88b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:21.612535 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d59443e1-99e1-4313-9127-5792c15db88b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 2953 microversion: 2.42 time: 0.620119 Jul 25 13:02:21.613114 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2200/4319] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:02:20 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 2953 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:02:22.019047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-257da595-c31a-4622-bae8-c4485995f0a0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:22.021598 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-257da595-c31a-4622-bae8-c4485995f0a0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:22.024962 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:22.038664 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-257da595-c31a-4622-bae8-c4485995f0a0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:22.039464 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-257da595-c31a-4622-bae8-c4485995f0a0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:22.040480 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-257da595-c31a-4622-bae8-c4485995f0a0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:22.046040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-257da595-c31a-4622-bae8-c4485995f0a0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:22.252768 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-15ae768c-ecd0-4cee-8545-5a6336f82a00 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:02:22.253556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-15ae768c-ecd0-4cee-8545-5a6336f82a00 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:02:22.254137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-15ae768c-ecd0-4cee-8545-5a6336f82a00 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:02:22.254674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-15ae768c-ecd0-4cee-8545-5a6336f82a00 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:02:22.255151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-15ae768c-ecd0-4cee-8545-5a6336f82a00 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:02:22.282138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15ae768c-ecd0-4cee-8545-5a6336f82a00 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:22.291984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15ae768c-ecd0-4cee-8545-5a6336f82a00 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:22.293626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15ae768c-ecd0-4cee-8545-5a6336f82a00 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:22.294422 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15ae768c-ecd0-4cee-8545-5a6336f82a00 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:22.323436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-15ae768c-ecd0-4cee-8545-5a6336f82a00 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Getting quotas for project 912d361eab8a474cb34434e4301bc4f6. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:02:22.332661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-15ae768c-ecd0-4cee-8545-5a6336f82a00 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Getting quotas for user e45b015e53c54c129ff2a04ce8da4964 and project 912d361eab8a474cb34434e4301bc4f6. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:02:22.355959 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-15ae768c-ecd0-4cee-8545-5a6336f82a00 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:02:22.358776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-15ae768c-ecd0-4cee-8545-5a6336f82a00 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:02:22.455151 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-15ae768c-ecd0-4cee-8545-5a6336f82a00 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.363132 Jul 25 13:02:22.455906 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2120/4320] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:02:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 3380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:02:22.472308 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c7370649-6f5f-4972-a068-a2b12b7d2ae7 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:22.473197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c7370649-6f5f-4972-a068-a2b12b7d2ae7 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:22.876641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c7370649-6f5f-4972-a068-a2b12b7d2ae7 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45b015e53c54c129ff2a04ce8da4964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912d361eab8a474cb34434e4301bc4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:22.893787 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c7370649-6f5f-4972-a068-a2b12b7d2ae7 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] 10.222.0.49 "GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255" status: 200 len: 1215 microversion: 2.1 time: 0.430330 Jul 25 13:02:22.895482 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2121/4321] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:22 2022] GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255 => generated 1215 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:22.911715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f44c6ea6-4c78-484e-8709-8c23f6899540 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:22.912347 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f44c6ea6-4c78-484e-8709-8c23f6899540 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:22.926472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f44c6ea6-4c78-484e-8709-8c23f6899540 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:22.926941 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f44c6ea6-4c78-484e-8709-8c23f6899540 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:22.927726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f44c6ea6-4c78-484e-8709-8c23f6899540 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:22.928173 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f44c6ea6-4c78-484e-8709-8c23f6899540 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:22.987903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-257da595-c31a-4622-bae8-c4485995f0a0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:23.000713 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-257da595-c31a-4622-bae8-c4485995f0a0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1503 microversion: 2.1 time: 0.983429 Jul 25 13:02:23.005034 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2201/4322] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:22 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1503 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:23.038678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4f950229-8228-4d5c-9ee7-a039145aa296 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:23.054834 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4f950229-8228-4d5c-9ee7-a039145aa296 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:23.074429 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f950229-8228-4d5c-9ee7-a039145aa296 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:23.077471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f950229-8228-4d5c-9ee7-a039145aa296 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:23.078587 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f950229-8228-4d5c-9ee7-a039145aa296 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:23.083656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f950229-8228-4d5c-9ee7-a039145aa296 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:24.356013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4f950229-8228-4d5c-9ee7-a039145aa296 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:24.377197 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4f950229-8228-4d5c-9ee7-a039145aa296 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1503 microversion: 2.1 time: 1.346073 Jul 25 13:02:24.377945 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2202/4323] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:23 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1503 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:24.416732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-3d402b22-b1a9-4802-9c5f-a2fe58db13ca req-bd12dc1e-5f12-47f3-9db6-acb3a045fcc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "name": "network-vif-unplugged", "status": "completed", "tag": "688cd2c2-4671-443a-89b1-550dc60cd0ee"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:24.485083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3d402b22-b1a9-4802-9c5f-a2fe58db13ca req-bd12dc1e-5f12-47f3-9db6-acb3a045fcc4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:24.485939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3d402b22-b1a9-4802-9c5f-a2fe58db13ca req-bd12dc1e-5f12-47f3-9db6-acb3a045fcc4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:24.504239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:24.538830 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-3d402b22-b1a9-4802-9c5f-a2fe58db13ca req-bd12dc1e-5f12-47f3-9db6-acb3a045fcc4 service nova] Creating event network-vif-unplugged:688cd2c2-4671-443a-89b1-550dc60cd0ee for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 13:02:24.558089 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-3d402b22-b1a9-4802-9c5f-a2fe58db13ca req-bd12dc1e-5f12-47f3-9db6-acb3a045fcc4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.167400 Jul 25 13:02:24.558942 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2203/4324] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:02:24.575706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bd6d2941-eff9-476b-8fd9-341d8f96ce18 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:24.577536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bd6d2941-eff9-476b-8fd9-341d8f96ce18 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:24.615986 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd6d2941-eff9-476b-8fd9-341d8f96ce18 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:24.617398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd6d2941-eff9-476b-8fd9-341d8f96ce18 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:24.620991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd6d2941-eff9-476b-8fd9-341d8f96ce18 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:24.622565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd6d2941-eff9-476b-8fd9-341d8f96ce18 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:25.249139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f44c6ea6-4c78-484e-8709-8c23f6899540 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:25.268799 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f44c6ea6-4c78-484e-8709-8c23f6899540 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:25.270863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f44c6ea6-4c78-484e-8709-8c23f6899540 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:25.272192 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f44c6ea6-4c78-484e-8709-8c23f6899540 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 2932 microversion: 2.42 time: 2.374981 Jul 25 13:02:25.274570 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2122/4325] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:02:22 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 2932 bytes in 2378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:02:25.399334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e1a71b65-0e56-4c3b-8440-117921117b10 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-399799083", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "2622c9df-7577-4221-b1ff-1bee8b03f6f5"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:25.479660 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-e1a71b65-0e56-4c3b-8440-117921117b10 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] validate_networks() for [('2622c9df-7577-4221-b1ff-1bee8b03f6f5', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:02:25.577367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bd6d2941-eff9-476b-8fd9-341d8f96ce18 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45b015e53c54c129ff2a04ce8da4964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912d361eab8a474cb34434e4301bc4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:25.612420 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bd6d2941-eff9-476b-8fd9-341d8f96ce18 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] 10.222.0.49 "GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255" status: 200 len: 1275 microversion: 2.1 time: 1.050111 Jul 25 13:02:25.621710 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2204/4326] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:24 2022] GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255 => generated 1275 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:25.643940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2974b1dc-a416-425c-9c83-56b0821d0822 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:25.650803 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2974b1dc-a416-425c-9c83-56b0821d0822 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:25.673240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2974b1dc-a416-425c-9c83-56b0821d0822 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:25.678534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2974b1dc-a416-425c-9c83-56b0821d0822 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:25.682128 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2974b1dc-a416-425c-9c83-56b0821d0822 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:25.686207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2974b1dc-a416-425c-9c83-56b0821d0822 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:25.760317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-2974b1dc-a416-425c-9c83-56b0821d0822 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lazy-loading 'flavor' on Instance uuid 4a62d654-72dd-4208-984f-1d8e8a807376 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:02:25.955868 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2974b1dc-a416-425c-9c83-56b0821d0822 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "POST /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376/action" status: 202 len: 0 microversion: 2.1 time: 0.332110 Jul 25 13:02:25.973005 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2205/4327] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:02:25 2022] POST /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:02:26.002545 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-94f5a1f6-204a-4978-8c96-f1a3dc1c302e tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:26.009344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-94f5a1f6-204a-4978-8c96-f1a3dc1c302e tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:26.043030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94f5a1f6-204a-4978-8c96-f1a3dc1c302e tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:26.043764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94f5a1f6-204a-4978-8c96-f1a3dc1c302e tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:26.045264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94f5a1f6-204a-4978-8c96-f1a3dc1c302e tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:26.047005 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94f5a1f6-204a-4978-8c96-f1a3dc1c302e tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:26.782893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-94f5a1f6-204a-4978-8c96-f1a3dc1c302e tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:26.797466 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-94f5a1f6-204a-4978-8c96-f1a3dc1c302e tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1511 microversion: 2.1 time: 0.817960 Jul 25 13:02:26.798168 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2206/4328] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:25 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1511 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:26.830414 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-87e92a25-9629-4383-868f-5421871eee1b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:26.831127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-87e92a25-9629-4383-868f-5421871eee1b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:26.850644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87e92a25-9629-4383-868f-5421871eee1b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:26.851680 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87e92a25-9629-4383-868f-5421871eee1b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:26.852482 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87e92a25-9629-4383-868f-5421871eee1b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:26.852967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-87e92a25-9629-4383-868f-5421871eee1b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:27.666924 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-e1a71b65-0e56-4c3b-8440-117921117b10 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:02:27.667492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-e1a71b65-0e56-4c3b-8440-117921117b10 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:02:27.668040 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-e1a71b65-0e56-4c3b-8440-117921117b10 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:02:27.668526 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-e1a71b65-0e56-4c3b-8440-117921117b10 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:02:27.669010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-e1a71b65-0e56-4c3b-8440-117921117b10 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:02:27.689766 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1a71b65-0e56-4c3b-8440-117921117b10 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:27.690296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1a71b65-0e56-4c3b-8440-117921117b10 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:27.695459 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1a71b65-0e56-4c3b-8440-117921117b10 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:27.695976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1a71b65-0e56-4c3b-8440-117921117b10 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:27.763254 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-87e92a25-9629-4383-868f-5421871eee1b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:27.767997 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-e1a71b65-0e56-4c3b-8440-117921117b10 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Getting quotas for project d0f5fe62e90146bcb87e76abaa6fe184. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:02:27.777885 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-e1a71b65-0e56-4c3b-8440-117921117b10 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Getting quotas for user b27acc4218084f638755250bfd349e86 and project d0f5fe62e90146bcb87e76abaa6fe184. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:02:27.794501 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e1a71b65-0e56-4c3b-8440-117921117b10 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Going to run 3 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:02:27.796723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-87e92a25-9629-4383-868f-5421871eee1b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:27.797776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e1a71b65-0e56-4c3b-8440-117921117b10 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: 4d9bf270-1783-415a-a809-4098ffbe35f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:02:27.803936 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-87e92a25-9629-4383-868f-5421871eee1b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:27.805315 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-87e92a25-9629-4383-868f-5421871eee1b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 2932 microversion: 2.42 time: 0.992904 Jul 25 13:02:27.822735 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2207/4329] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:02:26 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 2932 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:02:27.837635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-ba05d121-1785-4c1b-bcba-0d54e49d0fd0 req-32c2c7ea-1ff9-4869-816e-1d83cc1e28c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "name": "network-vif-unplugged", "status": "completed", "tag": "26bcc0bb-2e9b-4db5-8b7d-981c3d3a8e62"}, {"server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "name": "network-vif-unplugged", "status": "completed", "tag": "b2ed9ff7-f05b-47ef-83cb-258951d51489"}, {"server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "name": "network-vif-unplugged", "status": "completed", "tag": "619e5821-f34d-4084-bf18-5b7e99804fef"}, {"server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "name": "network-vif-unplugged", "status": "completed", "tag": "f6d2cc3f-fab3-4780-857c-9ee48589fd5f"}, {"server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "name": "network-vif-unplugged", "status": "completed", "tag": "cf0e5a93-6e29-451d-9c37-4cea02b17b40"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:27.882237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-ba05d121-1785-4c1b-bcba-0d54e49d0fd0 req-32c2c7ea-1ff9-4869-816e-1d83cc1e28c4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:27.886788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-ba05d121-1785-4c1b-bcba-0d54e49d0fd0 req-32c2c7ea-1ff9-4869-816e-1d83cc1e28c4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:27.893611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e1a71b65-0e56-4c3b-8440-117921117b10 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: befe3c76-6841-45ba-95b9-7d11592e404a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=4d9bf270-1783-415a-a809-4098ffbe35f1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:02:27.953909 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-ba05d121-1785-4c1b-bcba-0d54e49d0fd0 req-32c2c7ea-1ff9-4869-816e-1d83cc1e28c4 service nova] Creating event network-vif-unplugged:26bcc0bb-2e9b-4db5-8b7d-981c3d3a8e62 for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 13:02:27.957508 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-ba05d121-1785-4c1b-bcba-0d54e49d0fd0 req-32c2c7ea-1ff9-4869-816e-1d83cc1e28c4 service nova] Creating event network-vif-unplugged:b2ed9ff7-f05b-47ef-83cb-258951d51489 for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 13:02:27.958230 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-ba05d121-1785-4c1b-bcba-0d54e49d0fd0 req-32c2c7ea-1ff9-4869-816e-1d83cc1e28c4 service nova] Creating event network-vif-unplugged:619e5821-f34d-4084-bf18-5b7e99804fef for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 13:02:27.969763 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-ba05d121-1785-4c1b-bcba-0d54e49d0fd0 req-32c2c7ea-1ff9-4869-816e-1d83cc1e28c4 service nova] Creating event network-vif-unplugged:f6d2cc3f-fab3-4780-857c-9ee48589fd5f for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 13:02:27.974264 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-ba05d121-1785-4c1b-bcba-0d54e49d0fd0 req-32c2c7ea-1ff9-4869-816e-1d83cc1e28c4 service nova] Creating event network-vif-unplugged:cf0e5a93-6e29-451d-9c37-4cea02b17b40 for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 13:02:27.994401 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-ba05d121-1785-4c1b-bcba-0d54e49d0fd0 req-32c2c7ea-1ff9-4869-816e-1d83cc1e28c4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.166134 Jul 25 13:02:27.998320 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2208/4330] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:02:28.014048 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-eda99579-0703-4c6f-bf65-66a15a3b9359 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:28.018627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e1a71b65-0e56-4c3b-8440-117921117b10 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: a1136ad1-8b0f-4717-8255-e615d7753832] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=befe3c76-6841-45ba-95b9-7d11592e404a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:02:28.024517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eda99579-0703-4c6f-bf65-66a15a3b9359 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:28.051187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eda99579-0703-4c6f-bf65-66a15a3b9359 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:28.051742 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eda99579-0703-4c6f-bf65-66a15a3b9359 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:28.052406 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eda99579-0703-4c6f-bf65-66a15a3b9359 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:28.052842 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eda99579-0703-4c6f-bf65-66a15a3b9359 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:28.226711 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e1a71b65-0e56-4c3b-8440-117921117b10 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.934569 Jul 25 13:02:28.227623 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2123/4331] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:02:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:02:28.232721 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-59c97637-c56d-4122-b31e-35ba99552fa0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:28.233893 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-59c97637-c56d-4122-b31e-35ba99552fa0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:28.241376 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59c97637-c56d-4122-b31e-35ba99552fa0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:28.242128 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59c97637-c56d-4122-b31e-35ba99552fa0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:28.243470 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59c97637-c56d-4122-b31e-35ba99552fa0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:28.244137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-59c97637-c56d-4122-b31e-35ba99552fa0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:28.368333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-eda99579-0703-4c6f-bf65-66a15a3b9359 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45b015e53c54c129ff2a04ce8da4964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912d361eab8a474cb34434e4301bc4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:28.382594 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-eda99579-0703-4c6f-bf65-66a15a3b9359 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] 10.222.0.49 "GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255" status: 200 len: 1273 microversion: 2.1 time: 0.382620 Jul 25 13:02:28.383487 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2209/4332] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:27 2022] GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255 => generated 1273 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:28.418272 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-932d3d41-6664-4072-813b-c6df31d66f44 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:28.426249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-932d3d41-6664-4072-813b-c6df31d66f44 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:28.429399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-932d3d41-6664-4072-813b-c6df31d66f44 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Searching by: {'deleted': False, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184'} {{(pid=125884) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:02:28.517366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-932d3d41-6664-4072-813b-c6df31d66f44 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:28.523920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-932d3d41-6664-4072-813b-c6df31d66f44 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:28.529297 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-932d3d41-6664-4072-813b-c6df31d66f44 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:28.531162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-932d3d41-6664-4072-813b-c6df31d66f44 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:28.626203 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-932d3d41-6664-4072-813b-c6df31d66f44 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.229817 Jul 25 13:02:28.626808 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2210/4333] 10.222.0.49 () {58 vars in 1125 bytes} [Mon Jul 25 13:02:28 2022] GET /compute/v2.1/servers => generated 1015 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:28.643575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-462159cd-a83a-4f24-9a5f-82e5453b536e tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:28.652726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-462159cd-a83a-4f24-9a5f-82e5453b536e tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: a1136ad1-8b0f-4717-8255-e615d7753832] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:29.452805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-59c97637-c56d-4122-b31e-35ba99552fa0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:29.463723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-462159cd-a83a-4f24-9a5f-82e5453b536e tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:29.466851 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-59c97637-c56d-4122-b31e-35ba99552fa0 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1494 microversion: 2.1 time: 1.237647 Jul 25 13:02:29.467600 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2124/4334] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:28 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1494 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:29.482576 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5d54a1f0-97a4-425e-b648-75dda2b30990 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:29.483862 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5d54a1f0-97a4-425e-b648-75dda2b30990 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:29.492514 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-462159cd-a83a-4f24-9a5f-82e5453b536e tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832" status: 200 len: 1222 microversion: 2.1 time: 0.846185 Jul 25 13:02:29.493215 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2211/4335] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:28 2022] GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832 => generated 1222 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:29.501856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d54a1f0-97a4-425e-b648-75dda2b30990 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:29.505257 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d54a1f0-97a4-425e-b648-75dda2b30990 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:29.507140 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d54a1f0-97a4-425e-b648-75dda2b30990 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:29.509036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d54a1f0-97a4-425e-b648-75dda2b30990 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:29.516053 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-068675c1-a61d-4807-8e0d-5a74cadf66c6 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '.version_select at 0x7efcfa0e7a60>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:29.578778 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-068675c1-a61d-4807-8e0d-5a74cadf66c6 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1331126052" status: 202 len: 0 microversion: 2.1 time: 0.067152 Jul 25 13:02:29.579700 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2212/4336] 10.222.0.49 () {58 vars in 1284 bytes} [Mon Jul 25 13:02:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1331126052 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:02:29.602857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-11401476-7399-47fd-b14f-a3a3a49c3722 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:29.603364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-11401476-7399-47fd-b14f-a3a3a49c3722 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:29.636557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11401476-7399-47fd-b14f-a3a3a49c3722 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:29.636921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11401476-7399-47fd-b14f-a3a3a49c3722 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:29.637719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11401476-7399-47fd-b14f-a3a3a49c3722 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:29.638393 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11401476-7399-47fd-b14f-a3a3a49c3722 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:29.754857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-11401476-7399-47fd-b14f-a3a3a49c3722 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45b015e53c54c129ff2a04ce8da4964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912d361eab8a474cb34434e4301bc4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:29.767859 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-11401476-7399-47fd-b14f-a3a3a49c3722 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] 10.222.0.49 "GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255" status: 200 len: 1273 microversion: 2.1 time: 0.186971 Jul 25 13:02:29.768553 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2213/4337] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:29 2022] GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255 => generated 1273 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:29.782535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-a247e917-b1f4-49d1-ab57-c9dbf096fa8d req-21f17bcc-9bf5-443b-b6e9-3795a9940866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "name": "network-vif-deleted", "tag": "26bcc0bb-2e9b-4db5-8b7d-981c3d3a8e62"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:29.816228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a247e917-b1f4-49d1-ab57-c9dbf096fa8d req-21f17bcc-9bf5-443b-b6e9-3795a9940866 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:29.822292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a247e917-b1f4-49d1-ab57-c9dbf096fa8d req-21f17bcc-9bf5-443b-b6e9-3795a9940866 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:29.863288 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-a247e917-b1f4-49d1-ab57-c9dbf096fa8d req-21f17bcc-9bf5-443b-b6e9-3795a9940866 service nova] Creating event network-vif-deleted:26bcc0bb-2e9b-4db5-8b7d-981c3d3a8e62 for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 13:02:29.874935 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-a247e917-b1f4-49d1-ab57-c9dbf096fa8d req-21f17bcc-9bf5-443b-b6e9-3795a9940866 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105059 Jul 25 13:02:29.878399 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2214/4338] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:02:29.895713 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3b9f8313-a9a2-44c5-bd3b-b0dc9bff98c6 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:29.908363 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3b9f8313-a9a2-44c5-bd3b-b0dc9bff98c6 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:29.945022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b9f8313-a9a2-44c5-bd3b-b0dc9bff98c6 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:29.945524 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b9f8313-a9a2-44c5-bd3b-b0dc9bff98c6 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:29.946381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b9f8313-a9a2-44c5-bd3b-b0dc9bff98c6 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:29.948430 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b9f8313-a9a2-44c5-bd3b-b0dc9bff98c6 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:30.159606 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3b9f8313-a9a2-44c5-bd3b-b0dc9bff98c6 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "POST /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376/action" status: 202 len: 0 microversion: 2.1 time: 0.275270 Jul 25 13:02:30.161786 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2215/4339] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:02:29 2022] POST /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:02:30.173988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1e91145c-af57-4c54-a62e-9cee6d9510ff tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Action: 'create', calling method: .version_select at 0x7efcf8a71c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-137998169", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANNgfsmDqyjXZ3KCvGDgcZh9I/wNvQy1zI9U4a5C4SNDUn7yLpVkq0Wg9YkUnGSFZqv5AS48YoGKYIVv2mxGKPLdChOqqu1uLj5GAD/UUvucMu+waI42F28k+mn2jkodA=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:30.215745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-1e91145c-af57-4c54-a62e-9cee6d9510ff tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Getting quotas for project c0d891a772834e43bdfcbde778a90498. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:02:30.242237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-1e91145c-af57-4c54-a62e-9cee6d9510ff tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Getting quotas for user 4d6e2ae351744e0ab1f153d629e4f0e7 and project c0d891a772834e43bdfcbde778a90498. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:02:30.243129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5d54a1f0-97a4-425e-b648-75dda2b30990 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:30.255169 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5d54a1f0-97a4-425e-b648-75dda2b30990 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:30.256851 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5d54a1f0-97a4-425e-b648-75dda2b30990 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:30.258193 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5d54a1f0-97a4-425e-b648-75dda2b30990 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 2865 microversion: 2.42 time: 0.787825 Jul 25 13:02:30.264289 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2125/4340] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:02:29 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 2865 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:02:30.272138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6f91256d-144f-46ae-9c5b-8d0ba6c3b176 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:30.280917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6f91256d-144f-46ae-9c5b-8d0ba6c3b176 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:30.293960 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f91256d-144f-46ae-9c5b-8d0ba6c3b176 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:30.301587 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f91256d-144f-46ae-9c5b-8d0ba6c3b176 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:30.307489 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f91256d-144f-46ae-9c5b-8d0ba6c3b176 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:30.317017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f91256d-144f-46ae-9c5b-8d0ba6c3b176 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:30.338971 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1e91145c-af57-4c54-a62e-9cee6d9510ff tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.175557 Jul 25 13:02:30.344992 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2216/4341] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:02:30 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:02:30.519228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f6693535-a9ca-4634-8418-dd43f2716d7d tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:30.521375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f6693535-a9ca-4634-8418-dd43f2716d7d tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: a1136ad1-8b0f-4717-8255-e615d7753832] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:30.532641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f6693535-a9ca-4634-8418-dd43f2716d7d tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:30.535630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f6693535-a9ca-4634-8418-dd43f2716d7d tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:30.536678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f6693535-a9ca-4634-8418-dd43f2716d7d tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:30.538113 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f6693535-a9ca-4634-8418-dd43f2716d7d tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:30.809884 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f6693535-a9ca-4634-8418-dd43f2716d7d tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:30.827692 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f6693535-a9ca-4634-8418-dd43f2716d7d tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832" status: 200 len: 1218 microversion: 2.1 time: 0.313233 Jul 25 13:02:30.841625 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2217/4342] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:30 2022] GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832 => generated 1218 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:02:30.847152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a512a35b-30fe-4136-b242-ffe318c1b493 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:30.847845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a512a35b-30fe-4136-b242-ffe318c1b493 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:30.878280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a512a35b-30fe-4136-b242-ffe318c1b493 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:30.878826 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a512a35b-30fe-4136-b242-ffe318c1b493 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:30.879631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a512a35b-30fe-4136-b242-ffe318c1b493 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:30.880078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a512a35b-30fe-4136-b242-ffe318c1b493 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:31.014448 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6f91256d-144f-46ae-9c5b-8d0ba6c3b176 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:31.023721 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6f91256d-144f-46ae-9c5b-8d0ba6c3b176 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1500 microversion: 2.1 time: 0.757688 Jul 25 13:02:31.029151 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2126/4343] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:30 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1500 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:31.293332 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-44ad6b3b-6e3d-443e-ad1e-1b7731327802 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:31.294329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-44ad6b3b-6e3d-443e-ad1e-1b7731327802 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:31.312206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-44ad6b3b-6e3d-443e-ad1e-1b7731327802 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:31.313059 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-44ad6b3b-6e3d-443e-ad1e-1b7731327802 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:31.314369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-44ad6b3b-6e3d-443e-ad1e-1b7731327802 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:31.318810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-44ad6b3b-6e3d-443e-ad1e-1b7731327802 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:31.544693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a512a35b-30fe-4136-b242-ffe318c1b493 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45b015e53c54c129ff2a04ce8da4964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912d361eab8a474cb34434e4301bc4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:31.557911 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a512a35b-30fe-4136-b242-ffe318c1b493 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] 10.222.0.49 "GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255" status: 200 len: 1315 microversion: 2.1 time: 0.714232 Jul 25 13:02:31.559010 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2218/4344] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:30 2022] GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255 => generated 1315 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:31.849608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3c994ce0-44a7-44fe-9897-fea2ce4477d2 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:31.851221 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3c994ce0-44a7-44fe-9897-fea2ce4477d2 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: a1136ad1-8b0f-4717-8255-e615d7753832] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:31.863373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3c994ce0-44a7-44fe-9897-fea2ce4477d2 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:31.865090 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3c994ce0-44a7-44fe-9897-fea2ce4477d2 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:31.868622 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3c994ce0-44a7-44fe-9897-fea2ce4477d2 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:31.869136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3c994ce0-44a7-44fe-9897-fea2ce4477d2 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:32.145552 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3c994ce0-44a7-44fe-9897-fea2ce4477d2 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:32.164035 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3c994ce0-44a7-44fe-9897-fea2ce4477d2 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832" status: 200 len: 1280 microversion: 2.1 time: 0.314238 Jul 25 13:02:32.167280 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2219/4345] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:31 2022] GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832 => generated 1280 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:02:32.183407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-ffb5e4de-961a-4d42-85e5-3804b52cb158 req-f7aaf8a5-a617-4084-996b-ca2368cfe828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "name": "network-vif-deleted", "tag": "b2ed9ff7-f05b-47ef-83cb-258951d51489"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:32.207198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-ffb5e4de-961a-4d42-85e5-3804b52cb158 req-f7aaf8a5-a617-4084-996b-ca2368cfe828 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:32.207198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-ffb5e4de-961a-4d42-85e5-3804b52cb158 req-f7aaf8a5-a617-4084-996b-ca2368cfe828 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:32.220924 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-ffb5e4de-961a-4d42-85e5-3804b52cb158 req-f7aaf8a5-a617-4084-996b-ca2368cfe828 service nova] Creating event network-vif-deleted:b2ed9ff7-f05b-47ef-83cb-258951d51489 for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 13:02:32.240446 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-ffb5e4de-961a-4d42-85e5-3804b52cb158 req-f7aaf8a5-a617-4084-996b-ca2368cfe828 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071317 Jul 25 13:02:32.241315 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2220/4346] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:02:32.252074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6ec19133-eb1c-4f27-b3be-17a09e5af5a6 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:32.254351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6ec19133-eb1c-4f27-b3be-17a09e5af5a6 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:32.281307 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ec19133-eb1c-4f27-b3be-17a09e5af5a6 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:32.283380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ec19133-eb1c-4f27-b3be-17a09e5af5a6 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:32.285032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ec19133-eb1c-4f27-b3be-17a09e5af5a6 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:32.285725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ec19133-eb1c-4f27-b3be-17a09e5af5a6 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:32.359189 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-44ad6b3b-6e3d-443e-ad1e-1b7731327802 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:32.379545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-44ad6b3b-6e3d-443e-ad1e-1b7731327802 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:32.382086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-44ad6b3b-6e3d-443e-ad1e-1b7731327802 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:32.383848 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-44ad6b3b-6e3d-443e-ad1e-1b7731327802 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 2705 microversion: 2.42 time: 1.097029 Jul 25 13:02:32.385524 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2127/4347] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:02:31 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 2705 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:02:32.580638 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-05b8fc6e-1ea9-4898-9bec-1ad8301c62a8 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:32.581276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-05b8fc6e-1ea9-4898-9bec-1ad8301c62a8 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:32.601997 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05b8fc6e-1ea9-4898-9bec-1ad8301c62a8 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:32.602426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05b8fc6e-1ea9-4898-9bec-1ad8301c62a8 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:32.603291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05b8fc6e-1ea9-4898-9bec-1ad8301c62a8 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:32.603724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05b8fc6e-1ea9-4898-9bec-1ad8301c62a8 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:33.770648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-05b8fc6e-1ea9-4898-9bec-1ad8301c62a8 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45b015e53c54c129ff2a04ce8da4964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912d361eab8a474cb34434e4301bc4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:33.779839 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-05b8fc6e-1ea9-4898-9bec-1ad8301c62a8 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] 10.222.0.49 "GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255" status: 200 len: 1315 microversion: 2.1 time: 1.203979 Jul 25 13:02:33.790246 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2128/4348] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:32 2022] GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255 => generated 1315 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:33.795293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2792bd81-b6e9-4779-afcc-8afb664f12b3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:33.795909 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2792bd81-b6e9-4779-afcc-8afb664f12b3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: a1136ad1-8b0f-4717-8255-e615d7753832] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:33.808537 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2792bd81-b6e9-4779-afcc-8afb664f12b3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:33.808984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2792bd81-b6e9-4779-afcc-8afb664f12b3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:33.809766 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2792bd81-b6e9-4779-afcc-8afb664f12b3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:33.810227 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2792bd81-b6e9-4779-afcc-8afb664f12b3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:34.143353 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2792bd81-b6e9-4779-afcc-8afb664f12b3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:34.146902 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6ec19133-eb1c-4f27-b3be-17a09e5af5a6 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:34.151795 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2792bd81-b6e9-4779-afcc-8afb664f12b3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832" status: 200 len: 1280 microversion: 2.1 time: 0.360256 Jul 25 13:02:34.155238 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6ec19133-eb1c-4f27-b3be-17a09e5af5a6 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1500 microversion: 2.1 time: 1.912452 Jul 25 13:02:34.159649 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2221/4349] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:32 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1500 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:34.165709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-106f460d-207f-432a-b7c4-c41b202aa6d0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:34.166650 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2129/4350] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:33 2022] GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832 => generated 1280 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:34.171994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-106f460d-207f-432a-b7c4-c41b202aa6d0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:34.184838 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-106f460d-207f-432a-b7c4-c41b202aa6d0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:34.193188 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-106f460d-207f-432a-b7c4-c41b202aa6d0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:34.194822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-106f460d-207f-432a-b7c4-c41b202aa6d0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:34.195585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-106f460d-207f-432a-b7c4-c41b202aa6d0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:34.310144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-09dab4f6-562c-4021-a914-8c95828b553f req-a97567a5-7c40-4c73-9c5c-1d1497e4d32f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "name": "network-vif-deleted", "tag": "f6d2cc3f-fab3-4780-857c-9ee48589fd5f"}, {"server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "name": "network-vif-deleted", "tag": "688cd2c2-4671-443a-89b1-550dc60cd0ee"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:34.321489 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-09dab4f6-562c-4021-a914-8c95828b553f req-a97567a5-7c40-4c73-9c5c-1d1497e4d32f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:34.321977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-09dab4f6-562c-4021-a914-8c95828b553f req-a97567a5-7c40-4c73-9c5c-1d1497e4d32f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:34.335482 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-09dab4f6-562c-4021-a914-8c95828b553f req-a97567a5-7c40-4c73-9c5c-1d1497e4d32f service nova] Creating event network-vif-deleted:f6d2cc3f-fab3-4780-857c-9ee48589fd5f for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 13:02:34.336306 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-09dab4f6-562c-4021-a914-8c95828b553f req-a97567a5-7c40-4c73-9c5c-1d1497e4d32f service nova] Creating event network-vif-deleted:688cd2c2-4671-443a-89b1-550dc60cd0ee for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 13:02:34.341956 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-09dab4f6-562c-4021-a914-8c95828b553f req-a97567a5-7c40-4c73-9c5c-1d1497e4d32f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036016 Jul 25 13:02:34.342685 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2130/4351] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:02:34.802450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-273f5745-df10-49e8-86b5-0ee3752949d0 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:34.803859 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-273f5745-df10-49e8-86b5-0ee3752949d0 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:34.813804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-273f5745-df10-49e8-86b5-0ee3752949d0 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:34.814296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-273f5745-df10-49e8-86b5-0ee3752949d0 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:34.815157 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-273f5745-df10-49e8-86b5-0ee3752949d0 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:34.815608 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-273f5745-df10-49e8-86b5-0ee3752949d0 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:35.083474 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-106f460d-207f-432a-b7c4-c41b202aa6d0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:35.096884 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-106f460d-207f-432a-b7c4-c41b202aa6d0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:35.099687 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-106f460d-207f-432a-b7c4-c41b202aa6d0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:35.101878 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-106f460d-207f-432a-b7c4-c41b202aa6d0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 2500 microversion: 2.42 time: 0.940217 Jul 25 13:02:35.119934 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2222/4352] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:02:34 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 2500 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:02:35.190768 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c09c640c-b336-416a-9f9c-7c7ce0b5f9a3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:35.191354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c09c640c-b336-416a-9f9c-7c7ce0b5f9a3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: a1136ad1-8b0f-4717-8255-e615d7753832] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:35.200980 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c09c640c-b336-416a-9f9c-7c7ce0b5f9a3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:35.203135 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c09c640c-b336-416a-9f9c-7c7ce0b5f9a3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:35.204700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c09c640c-b336-416a-9f9c-7c7ce0b5f9a3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:35.205802 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c09c640c-b336-416a-9f9c-7c7ce0b5f9a3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:35.244238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:35.948008 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c09c640c-b336-416a-9f9c-7c7ce0b5f9a3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:35.963642 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c09c640c-b336-416a-9f9c-7c7ce0b5f9a3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832" status: 200 len: 1280 microversion: 2.1 time: 0.778328 Jul 25 13:02:35.965168 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2223/4353] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:35 2022] GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832 => generated 1280 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:35.982666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-105f4ebb-8f9d-41f1-a474-a2f1ff746261 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:35.984759 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-105f4ebb-8f9d-41f1-a474-a2f1ff746261 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:35.995108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-105f4ebb-8f9d-41f1-a474-a2f1ff746261 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:35.997676 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-105f4ebb-8f9d-41f1-a474-a2f1ff746261 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:35.999238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-105f4ebb-8f9d-41f1-a474-a2f1ff746261 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:36.006063 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-105f4ebb-8f9d-41f1-a474-a2f1ff746261 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:36.424718 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-273f5745-df10-49e8-86b5-0ee3752949d0 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45b015e53c54c129ff2a04ce8da4964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912d361eab8a474cb34434e4301bc4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:36.453767 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-273f5745-df10-49e8-86b5-0ee3752949d0 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] 10.222.0.49 "GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255" status: 200 len: 1315 microversion: 2.1 time: 1.655037 Jul 25 13:02:36.470773 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2131/4354] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:34 2022] GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255 => generated 1315 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:02:36.479369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-d54d9732-999f-4169-9169-07f95d3a53e4 req-9b94adb7-ed96-4608-826d-93a964d76edd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d06982e5-f9a9-45f6-86d6-1eecdc7ce255", "tag": "6ab39a95-042c-4e49-a9cf-3654ba5651a6"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:36.514863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d54d9732-999f-4169-9169-07f95d3a53e4 req-9b94adb7-ed96-4608-826d-93a964d76edd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:36.516283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d54d9732-999f-4169-9169-07f95d3a53e4 req-9b94adb7-ed96-4608-826d-93a964d76edd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:36.582865 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-d54d9732-999f-4169-9169-07f95d3a53e4 req-9b94adb7-ed96-4608-826d-93a964d76edd service nova] Creating event network-changed:6ab39a95-042c-4e49-a9cf-3654ba5651a6 for instance d06982e5-f9a9-45f6-86d6-1eecdc7ce255 on n-h2-848886-15 Jul 25 13:02:36.615071 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-d54d9732-999f-4169-9169-07f95d3a53e4 req-9b94adb7-ed96-4608-826d-93a964d76edd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137971 Jul 25 13:02:36.619559 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2132/4355] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:02:36.661182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8685801c-9359-4133-a3a3-1f69a5265de5 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:36.666502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8685801c-9359-4133-a3a3-1f69a5265de5 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:36.691048 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8685801c-9359-4133-a3a3-1f69a5265de5 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:36.693664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8685801c-9359-4133-a3a3-1f69a5265de5 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:36.698273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8685801c-9359-4133-a3a3-1f69a5265de5 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:36.699214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8685801c-9359-4133-a3a3-1f69a5265de5 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:37.172125 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8685801c-9359-4133-a3a3-1f69a5265de5 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:37.190588 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8685801c-9359-4133-a3a3-1f69a5265de5 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:37.193417 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8685801c-9359-4133-a3a3-1f69a5265de5 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:37.196848 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8685801c-9359-4133-a3a3-1f69a5265de5 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1605 microversion: 2.42 time: 0.558534 Jul 25 13:02:37.202421 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2133/4356] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:02:36 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1605 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:02:37.212642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-0c58e89e-bb1a-48af-afd0-fb113ec37343 req-22cda9d0-f767-497a-b9d9-224ed93fcde9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339809bb-41b5-4a8f-80b7-28a356aad3f4", "name": "network-vif-deleted", "tag": "cf0e5a93-6e29-451d-9c37-4cea02b17b40"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:37.236500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0c58e89e-bb1a-48af-afd0-fb113ec37343 req-22cda9d0-f767-497a-b9d9-224ed93fcde9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:37.242277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0c58e89e-bb1a-48af-afd0-fb113ec37343 req-22cda9d0-f767-497a-b9d9-224ed93fcde9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:37.281142 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-0c58e89e-bb1a-48af-afd0-fb113ec37343 req-22cda9d0-f767-497a-b9d9-224ed93fcde9 service nova] Creating event network-vif-deleted:cf0e5a93-6e29-451d-9c37-4cea02b17b40 for instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 on n-h1-848886-15 Jul 25 13:02:37.295740 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-0c58e89e-bb1a-48af-afd0-fb113ec37343 req-22cda9d0-f767-497a-b9d9-224ed93fcde9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091588 Jul 25 13:02:37.297000 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2134/4357] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:02:37.311790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a260a02e-3336-44d0-971e-66ff96b6adc5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:37.314964 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a260a02e-3336-44d0-971e-66ff96b6adc5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: a1136ad1-8b0f-4717-8255-e615d7753832] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:37.329085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a260a02e-3336-44d0-971e-66ff96b6adc5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:37.330103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a260a02e-3336-44d0-971e-66ff96b6adc5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:37.331207 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a260a02e-3336-44d0-971e-66ff96b6adc5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:37.331828 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a260a02e-3336-44d0-971e-66ff96b6adc5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:37.373369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-105f4ebb-8f9d-41f1-a474-a2f1ff746261 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:37.384462 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-105f4ebb-8f9d-41f1-a474-a2f1ff746261 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1503 microversion: 2.1 time: 1.417734 Jul 25 13:02:37.387786 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2224/4358] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:35 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1503 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:37.426378 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4658ab35-9353-4465-a463-4d6ec66639fb tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:37.427351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4658ab35-9353-4465-a463-4d6ec66639fb tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:37.437133 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4658ab35-9353-4465-a463-4d6ec66639fb tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:37.437824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4658ab35-9353-4465-a463-4d6ec66639fb tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:37.439395 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4658ab35-9353-4465-a463-4d6ec66639fb tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:37.440162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4658ab35-9353-4465-a463-4d6ec66639fb tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:37.495165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-4658ab35-9353-4465-a463-4d6ec66639fb tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lazy-loading 'flavor' on Instance uuid 4a62d654-72dd-4208-984f-1d8e8a807376 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:02:37.643664 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4658ab35-9353-4465-a463-4d6ec66639fb tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "POST /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376/action" status: 202 len: 0 microversion: 2.1 time: 0.230570 Jul 25 13:02:37.647704 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2225/4359] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:02:37 2022] POST /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:02:37.655424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a260a02e-3336-44d0-971e-66ff96b6adc5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:37.665220 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-002f151d-ef4f-4b4b-a283-2bd77c34e7ff tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:37.667318 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-002f151d-ef4f-4b4b-a283-2bd77c34e7ff tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:37.671764 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a260a02e-3336-44d0-971e-66ff96b6adc5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832" status: 200 len: 1280 microversion: 2.1 time: 0.373193 Jul 25 13:02:37.681537 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-002f151d-ef4f-4b4b-a283-2bd77c34e7ff tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:37.682701 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2135/4360] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:37 2022] GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832 => generated 1280 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:37.688032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-002f151d-ef4f-4b4b-a283-2bd77c34e7ff tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:37.689180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-002f151d-ef4f-4b4b-a283-2bd77c34e7ff tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:37.690394 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-743be60a-abd4-4981-9723-816065eb3380 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:37.693687 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-002f151d-ef4f-4b4b-a283-2bd77c34e7ff tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:37.699583 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-743be60a-abd4-4981-9723-816065eb3380 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:37.727230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-743be60a-abd4-4981-9723-816065eb3380 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:37.727690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-743be60a-abd4-4981-9723-816065eb3380 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:37.728560 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-743be60a-abd4-4981-9723-816065eb3380 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:37.728986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-743be60a-abd4-4981-9723-816065eb3380 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:37.729615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:37.800867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=14 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:37.810787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:38.538033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-743be60a-abd4-4981-9723-816065eb3380 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:38.552780 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-743be60a-abd4-4981-9723-816065eb3380 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1511 microversion: 2.1 time: 0.863837 Jul 25 13:02:38.555018 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2136/4361] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:37 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1511 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:38.567119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ddaacaef-0d61-4464-a6fa-01171239d85b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:38.567805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ddaacaef-0d61-4464-a6fa-01171239d85b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:38.568876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:38.584271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ddaacaef-0d61-4464-a6fa-01171239d85b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:38.586162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ddaacaef-0d61-4464-a6fa-01171239d85b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:38.587354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ddaacaef-0d61-4464-a6fa-01171239d85b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:38.587821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ddaacaef-0d61-4464-a6fa-01171239d85b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:39.220986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ddaacaef-0d61-4464-a6fa-01171239d85b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:39.227827 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-002f151d-ef4f-4b4b-a283-2bd77c34e7ff tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45b015e53c54c129ff2a04ce8da4964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912d361eab8a474cb34434e4301bc4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:39.239533 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-002f151d-ef4f-4b4b-a283-2bd77c34e7ff tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] 10.222.0.49 "GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255" status: 200 len: 1315 microversion: 2.1 time: 1.589960 Jul 25 13:02:39.240829 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2226/4362] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:37 2022] GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255 => generated 1315 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:39.256101 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ddaacaef-0d61-4464-a6fa-01171239d85b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:39.261173 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ddaacaef-0d61-4464-a6fa-01171239d85b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:39.263826 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ee9ae818-4ec3-4f69-95e6-86ae653d8d0c tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:39.264893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ee9ae818-4ec3-4f69-95e6-86ae653d8d0c tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: a1136ad1-8b0f-4717-8255-e615d7753832] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:39.269590 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ddaacaef-0d61-4464-a6fa-01171239d85b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1605 microversion: 2.42 time: 0.709303 Jul 25 13:02:39.270446 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2137/4363] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:02:38 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1605 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:02:39.273434 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee9ae818-4ec3-4f69-95e6-86ae653d8d0c tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:39.273924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee9ae818-4ec3-4f69-95e6-86ae653d8d0c tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:39.274711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee9ae818-4ec3-4f69-95e6-86ae653d8d0c tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:39.275145 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee9ae818-4ec3-4f69-95e6-86ae653d8d0c tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:39.574727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1ccdab79-b643-40e6-9a2e-0be0f52a3840 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:39.575503 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1ccdab79-b643-40e6-9a2e-0be0f52a3840 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:39.582083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ccdab79-b643-40e6-9a2e-0be0f52a3840 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:39.586481 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ccdab79-b643-40e6-9a2e-0be0f52a3840 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:39.590859 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ccdab79-b643-40e6-9a2e-0be0f52a3840 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:39.591500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ccdab79-b643-40e6-9a2e-0be0f52a3840 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:39.601582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ee9ae818-4ec3-4f69-95e6-86ae653d8d0c tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:39.621368 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ee9ae818-4ec3-4f69-95e6-86ae653d8d0c tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832" status: 200 len: 1280 microversion: 2.1 time: 0.362048 Jul 25 13:02:39.623765 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2227/4364] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:39 2022] GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832 => generated 1280 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:40.269241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-34456f67-d5f1-4c7d-8f8b-b9d69eaaa916 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:40.270730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-34456f67-d5f1-4c7d-8f8b-b9d69eaaa916 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:40.281196 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:40.287934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-34456f67-d5f1-4c7d-8f8b-b9d69eaaa916 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:40.288705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-34456f67-d5f1-4c7d-8f8b-b9d69eaaa916 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:40.289932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-34456f67-d5f1-4c7d-8f8b-b9d69eaaa916 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:40.291023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-34456f67-d5f1-4c7d-8f8b-b9d69eaaa916 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:40.609160 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1ccdab79-b643-40e6-9a2e-0be0f52a3840 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:40.633820 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1ccdab79-b643-40e6-9a2e-0be0f52a3840 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1494 microversion: 2.1 time: 1.062993 Jul 25 13:02:40.650055 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2138/4365] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:39 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1494 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:02:40.666430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e267a4c0-6160-435c-9bd9-6da335f1c89b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:40.667445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e267a4c0-6160-435c-9bd9-6da335f1c89b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:40.684490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e267a4c0-6160-435c-9bd9-6da335f1c89b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:40.688844 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e267a4c0-6160-435c-9bd9-6da335f1c89b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:40.690145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e267a4c0-6160-435c-9bd9-6da335f1c89b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:40.692210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e267a4c0-6160-435c-9bd9-6da335f1c89b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:40.963092 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e267a4c0-6160-435c-9bd9-6da335f1c89b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:40.975944 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e267a4c0-6160-435c-9bd9-6da335f1c89b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:40.977441 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e267a4c0-6160-435c-9bd9-6da335f1c89b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:40.978650 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e267a4c0-6160-435c-9bd9-6da335f1c89b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1605 microversion: 2.42 time: 0.327184 Jul 25 13:02:40.988712 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2139/4366] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:02:40 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1605 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:02:40.995630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bbc70843-756b-470d-9263-1e2047202c9e tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:40.997960 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bbc70843-756b-470d-9263-1e2047202c9e tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: a1136ad1-8b0f-4717-8255-e615d7753832] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:41.027744 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbc70843-756b-470d-9263-1e2047202c9e tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:41.028193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbc70843-756b-470d-9263-1e2047202c9e tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:41.028977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbc70843-756b-470d-9263-1e2047202c9e tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:41.029412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbc70843-756b-470d-9263-1e2047202c9e tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:41.073263 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-34456f67-d5f1-4c7d-8f8b-b9d69eaaa916 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45b015e53c54c129ff2a04ce8da4964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912d361eab8a474cb34434e4301bc4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:41.101752 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-34456f67-d5f1-4c7d-8f8b-b9d69eaaa916 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] 10.222.0.49 "GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255" status: 200 len: 1315 microversion: 2.1 time: 0.841712 Jul 25 13:02:41.104189 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2228/4367] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:40 2022] GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255 => generated 1315 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:02:41.128476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-00c5bd7f-21ca-4903-8bf6-126087e81003 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:41.130651 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-00c5bd7f-21ca-4903-8bf6-126087e81003 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:41.143972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-00c5bd7f-21ca-4903-8bf6-126087e81003 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:41.144994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-00c5bd7f-21ca-4903-8bf6-126087e81003 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:41.146024 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-00c5bd7f-21ca-4903-8bf6-126087e81003 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:41.147270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-00c5bd7f-21ca-4903-8bf6-126087e81003 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:41.319903 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-00c5bd7f-21ca-4903-8bf6-126087e81003 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "POST /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376/action" status: 202 len: 0 microversion: 2.1 time: 0.183697 Jul 25 13:02:41.327587 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2229/4368] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:02:41 2022] POST /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:02:41.348219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-040a76a4-5c83-45a8-a274-1a2af3ed8285 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:41.351891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-040a76a4-5c83-45a8-a274-1a2af3ed8285 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:41.368439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-040a76a4-5c83-45a8-a274-1a2af3ed8285 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:41.370785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-040a76a4-5c83-45a8-a274-1a2af3ed8285 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:41.374478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-040a76a4-5c83-45a8-a274-1a2af3ed8285 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:41.389888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-040a76a4-5c83-45a8-a274-1a2af3ed8285 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:41.533680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bbc70843-756b-470d-9263-1e2047202c9e tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:41.543002 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bbc70843-756b-470d-9263-1e2047202c9e tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832" status: 200 len: 1280 microversion: 2.1 time: 0.551096 Jul 25 13:02:41.546034 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2140/4369] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:40 2022] GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832 => generated 1280 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:42.012669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b84d93c6-9e29-46cb-a31e-f7228a15277b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:42.013658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b84d93c6-9e29-46cb-a31e-f7228a15277b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:42.030017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b84d93c6-9e29-46cb-a31e-f7228a15277b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:42.031922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b84d93c6-9e29-46cb-a31e-f7228a15277b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:42.035613 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b84d93c6-9e29-46cb-a31e-f7228a15277b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:42.042461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b84d93c6-9e29-46cb-a31e-f7228a15277b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:42.757309 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b84d93c6-9e29-46cb-a31e-f7228a15277b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:42.769997 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b84d93c6-9e29-46cb-a31e-f7228a15277b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:42.776133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b84d93c6-9e29-46cb-a31e-f7228a15277b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:42.782609 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b84d93c6-9e29-46cb-a31e-f7228a15277b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1605 microversion: 2.42 time: 0.773819 Jul 25 13:02:42.783882 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2141/4370] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:02:42 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1605 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:02:42.798385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-41d13c78-f55c-4300-909e-8a13501fa6d2 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:42.799323 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-41d13c78-f55c-4300-909e-8a13501fa6d2 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:42.829467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-41d13c78-f55c-4300-909e-8a13501fa6d2 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:42.832645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-41d13c78-f55c-4300-909e-8a13501fa6d2 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:42.833540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-41d13c78-f55c-4300-909e-8a13501fa6d2 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:42.834044 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-41d13c78-f55c-4300-909e-8a13501fa6d2 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:43.476124 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-040a76a4-5c83-45a8-a274-1a2af3ed8285 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:43.483884 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-040a76a4-5c83-45a8-a274-1a2af3ed8285 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1500 microversion: 2.1 time: 2.154300 Jul 25 13:02:43.484464 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2230/4371] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:41 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1500 bytes in 2156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:43.503621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cef489b6-06c7-442d-a9da-321e5b7150b5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:43.512444 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cef489b6-06c7-442d-a9da-321e5b7150b5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: a1136ad1-8b0f-4717-8255-e615d7753832] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:43.529675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cef489b6-06c7-442d-a9da-321e5b7150b5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:43.530543 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cef489b6-06c7-442d-a9da-321e5b7150b5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:43.531559 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cef489b6-06c7-442d-a9da-321e5b7150b5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:43.537175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cef489b6-06c7-442d-a9da-321e5b7150b5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:44.899223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-41d13c78-f55c-4300-909e-8a13501fa6d2 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45b015e53c54c129ff2a04ce8da4964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912d361eab8a474cb34434e4301bc4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:44.921554 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-41d13c78-f55c-4300-909e-8a13501fa6d2 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] 10.222.0.49 "GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255" status: 200 len: 1315 microversion: 2.1 time: 2.132039 Jul 25 13:02:44.922259 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2142/4372] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:42 2022] GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255 => generated 1315 bytes in 2138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:44.941700 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-74564f6d-9b05-44e6-97a8-1cfd8d420dd4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:44.944073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-74564f6d-9b05-44e6-97a8-1cfd8d420dd4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:44.956609 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74564f6d-9b05-44e6-97a8-1cfd8d420dd4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:44.960434 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74564f6d-9b05-44e6-97a8-1cfd8d420dd4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:44.968956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74564f6d-9b05-44e6-97a8-1cfd8d420dd4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:44.971023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74564f6d-9b05-44e6-97a8-1cfd8d420dd4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:45.233720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-74564f6d-9b05-44e6-97a8-1cfd8d420dd4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:45.260120 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-74564f6d-9b05-44e6-97a8-1cfd8d420dd4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:45.262515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-74564f6d-9b05-44e6-97a8-1cfd8d420dd4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:45.265110 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-74564f6d-9b05-44e6-97a8-1cfd8d420dd4 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1605 microversion: 2.42 time: 0.341816 Jul 25 13:02:45.265716 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2143/4373] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:02:44 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1605 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:02:45.300453 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3955e77d-6ae5-40fd-ba01-eba9bcda6994 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:45.301083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3955e77d-6ae5-40fd-ba01-eba9bcda6994 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:45.332375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cef489b6-06c7-442d-a9da-321e5b7150b5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:45.333085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3955e77d-6ae5-40fd-ba01-eba9bcda6994 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:45.336825 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3955e77d-6ae5-40fd-ba01-eba9bcda6994 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:45.338567 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3955e77d-6ae5-40fd-ba01-eba9bcda6994 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:45.342244 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cef489b6-06c7-442d-a9da-321e5b7150b5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832" status: 200 len: 1322 microversion: 2.1 time: 1.849608 Jul 25 13:02:45.344151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3955e77d-6ae5-40fd-ba01-eba9bcda6994 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:45.351523 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2231/4374] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:43 2022] GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832 => generated 1322 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:45.947330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d1c64557-8f74-4b16-805e-e2d00744b62a tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:45.948341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d1c64557-8f74-4b16-805e-e2d00744b62a tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:45.966286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1c64557-8f74-4b16-805e-e2d00744b62a tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:45.967269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1c64557-8f74-4b16-805e-e2d00744b62a tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:45.972644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1c64557-8f74-4b16-805e-e2d00744b62a tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:45.973619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1c64557-8f74-4b16-805e-e2d00744b62a tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:47.290790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3955e77d-6ae5-40fd-ba01-eba9bcda6994 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:47.327714 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3955e77d-6ae5-40fd-ba01-eba9bcda6994 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1503 microversion: 2.1 time: 2.031007 Jul 25 13:02:47.336848 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2144/4375] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:45 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1503 bytes in 2071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:47.360943 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-180e718c-4bb2-42d8-8da4-000f63d764d9 req-7982fc72-eb49-4957-8fb4-ac571b560140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d9bf270-1783-415a-a809-4098ffbe35f1", "tag": "6a73117f-96f4-498c-a3b6-ce82b669708a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:47.413789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-180e718c-4bb2-42d8-8da4-000f63d764d9 req-7982fc72-eb49-4957-8fb4-ac571b560140 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:47.417511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-180e718c-4bb2-42d8-8da4-000f63d764d9 req-7982fc72-eb49-4957-8fb4-ac571b560140 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:47.458103 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-180e718c-4bb2-42d8-8da4-000f63d764d9 req-7982fc72-eb49-4957-8fb4-ac571b560140 service nova] Creating event network-changed:6a73117f-96f4-498c-a3b6-ce82b669708a for instance 4d9bf270-1783-415a-a809-4098ffbe35f1 on n-h2-848886-15 Jul 25 13:02:47.472474 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-180e718c-4bb2-42d8-8da4-000f63d764d9 req-7982fc72-eb49-4957-8fb4-ac571b560140 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129434 Jul 25 13:02:47.479157 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2145/4376] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:02:47.498554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fde07f31-41ec-4f75-a63c-b0f5a29d2a7e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:47.499652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fde07f31-41ec-4f75-a63c-b0f5a29d2a7e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:47.515996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fde07f31-41ec-4f75-a63c-b0f5a29d2a7e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:47.520180 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fde07f31-41ec-4f75-a63c-b0f5a29d2a7e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:47.522848 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fde07f31-41ec-4f75-a63c-b0f5a29d2a7e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:47.526046 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fde07f31-41ec-4f75-a63c-b0f5a29d2a7e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:48.638553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d1c64557-8f74-4b16-805e-e2d00744b62a tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45b015e53c54c129ff2a04ce8da4964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912d361eab8a474cb34434e4301bc4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:48.650001 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d1c64557-8f74-4b16-805e-e2d00744b62a tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] 10.222.0.49 "GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255" status: 200 len: 1315 microversion: 2.1 time: 2.711075 Jul 25 13:02:48.650923 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2232/4377] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:45 2022] GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255 => generated 1315 bytes in 2713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:48.669274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2cc0e596-1b89-46fe-992d-175d89fe8503 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:48.670855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2cc0e596-1b89-46fe-992d-175d89fe8503 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: a1136ad1-8b0f-4717-8255-e615d7753832] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:48.683343 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2cc0e596-1b89-46fe-992d-175d89fe8503 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:48.686472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2cc0e596-1b89-46fe-992d-175d89fe8503 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:48.687672 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2cc0e596-1b89-46fe-992d-175d89fe8503 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:48.693987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2cc0e596-1b89-46fe-992d-175d89fe8503 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:48.847645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fde07f31-41ec-4f75-a63c-b0f5a29d2a7e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:48.862414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fde07f31-41ec-4f75-a63c-b0f5a29d2a7e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:48.863878 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fde07f31-41ec-4f75-a63c-b0f5a29d2a7e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:48.865127 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fde07f31-41ec-4f75-a63c-b0f5a29d2a7e tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1605 microversion: 2.42 time: 1.383922 Jul 25 13:02:48.865708 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2146/4378] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:02:47 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1605 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:02:48.885549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-de2a38d0-4882-45c7-ba27-1feb26df72bc tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:48.891853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-de2a38d0-4882-45c7-ba27-1feb26df72bc tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:48.917881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=12 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:48.921076 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de2a38d0-4882-45c7-ba27-1feb26df72bc tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:48.923141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de2a38d0-4882-45c7-ba27-1feb26df72bc tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:48.925419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de2a38d0-4882-45c7-ba27-1feb26df72bc tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:48.925930 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de2a38d0-4882-45c7-ba27-1feb26df72bc tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:49.012861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-de2a38d0-4882-45c7-ba27-1feb26df72bc tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:02:49.152653 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2cc0e596-1b89-46fe-992d-175d89fe8503 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:49.181712 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2cc0e596-1b89-46fe-992d-175d89fe8503 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832" status: 200 len: 1322 microversion: 2.1 time: 0.529663 Jul 25 13:02:49.183065 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-de2a38d0-4882-45c7-ba27-1feb26df72bc tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 204 len: 0 microversion: 2.1 time: 0.305738 Jul 25 13:02:49.184460 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2147/4379] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:02:48 2022] DELETE /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:02:49.192450 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2233/4380] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:48 2022] GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832 => generated 1322 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:49.193755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-21e3bfc6-01e3-4536-9a0c-5a01b67ac577 req-f2980ecd-aa68-426b-91db-1193d54eba3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d06982e5-f9a9-45f6-86d6-1eecdc7ce255", "name": "network-vif-plugged", "status": "completed", "tag": "6ab39a95-042c-4e49-a9cf-3654ba5651a6"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:49.212618 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ee1b02cc-2202-45cd-a0fe-6d5baa03ed95 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:49.214729 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-21e3bfc6-01e3-4536-9a0c-5a01b67ac577 req-f2980ecd-aa68-426b-91db-1193d54eba3f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:49.217152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-21e3bfc6-01e3-4536-9a0c-5a01b67ac577 req-f2980ecd-aa68-426b-91db-1193d54eba3f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:49.218043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ee1b02cc-2202-45cd-a0fe-6d5baa03ed95 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:49.247838 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-21e3bfc6-01e3-4536-9a0c-5a01b67ac577 req-f2980ecd-aa68-426b-91db-1193d54eba3f service nova] Creating event network-vif-plugged:6ab39a95-042c-4e49-a9cf-3654ba5651a6 for instance d06982e5-f9a9-45f6-86d6-1eecdc7ce255 on n-h2-848886-15 Jul 25 13:02:49.248417 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee1b02cc-2202-45cd-a0fe-6d5baa03ed95 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:49.251584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee1b02cc-2202-45cd-a0fe-6d5baa03ed95 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:49.256270 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-21e3bfc6-01e3-4536-9a0c-5a01b67ac577 req-f2980ecd-aa68-426b-91db-1193d54eba3f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068975 Jul 25 13:02:49.256793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee1b02cc-2202-45cd-a0fe-6d5baa03ed95 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:49.257692 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee1b02cc-2202-45cd-a0fe-6d5baa03ed95 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:49.267329 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2148/4381] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:02:49.565699 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-d71a2920-c440-48a1-a737-de0f411a55c3 req-16d2a0b1-b472-4cc7-bd99-b90726f463e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "befe3c76-6841-45ba-95b9-7d11592e404a", "tag": "33a77d2a-b53f-41de-88d0-4a1366eb9d42"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:49.590672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d71a2920-c440-48a1-a737-de0f411a55c3 req-16d2a0b1-b472-4cc7-bd99-b90726f463e8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:49.591488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d71a2920-c440-48a1-a737-de0f411a55c3 req-16d2a0b1-b472-4cc7-bd99-b90726f463e8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:49.623162 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-d71a2920-c440-48a1-a737-de0f411a55c3 req-16d2a0b1-b472-4cc7-bd99-b90726f463e8 service nova] Creating event network-changed:33a77d2a-b53f-41de-88d0-4a1366eb9d42 for instance befe3c76-6841-45ba-95b9-7d11592e404a on n-h1-848886-15 Jul 25 13:02:49.644090 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-d71a2920-c440-48a1-a737-de0f411a55c3 req-16d2a0b1-b472-4cc7-bd99-b90726f463e8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083693 Jul 25 13:02:49.645371 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2149/4382] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:02:49.674493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-852256b5-2aac-49f9-b3ba-0795f60ee741 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:49.675541 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-852256b5-2aac-49f9-b3ba-0795f60ee741 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:49.684136 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-852256b5-2aac-49f9-b3ba-0795f60ee741 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:49.685787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-852256b5-2aac-49f9-b3ba-0795f60ee741 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:49.687423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-852256b5-2aac-49f9-b3ba-0795f60ee741 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:49.688092 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-852256b5-2aac-49f9-b3ba-0795f60ee741 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:50.641859 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ee1b02cc-2202-45cd-a0fe-6d5baa03ed95 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:50.650895 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ee1b02cc-2202-45cd-a0fe-6d5baa03ed95 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1509 microversion: 2.1 time: 1.450425 Jul 25 13:02:50.651518 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2234/4383] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:49 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1509 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:50.686920 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-852256b5-2aac-49f9-b3ba-0795f60ee741 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45b015e53c54c129ff2a04ce8da4964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912d361eab8a474cb34434e4301bc4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:50.690411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-70191188-1521-4abb-8258-b0b056c85185 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:50.695415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-70191188-1521-4abb-8258-b0b056c85185 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:50.702089 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-852256b5-2aac-49f9-b3ba-0795f60ee741 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] 10.222.0.49 "GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255" status: 200 len: 1315 microversion: 2.1 time: 1.031365 Jul 25 13:02:50.705375 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2150/4384] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:49 2022] GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255 => generated 1315 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:02:50.718900 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ae327cdd-2417-46b1-a83d-2e218664a75b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:50.719804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ae327cdd-2417-46b1-a83d-2e218664a75b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: a1136ad1-8b0f-4717-8255-e615d7753832] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:50.719975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70191188-1521-4abb-8258-b0b056c85185 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:50.720398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70191188-1521-4abb-8258-b0b056c85185 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:50.727335 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70191188-1521-4abb-8258-b0b056c85185 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:50.727893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70191188-1521-4abb-8258-b0b056c85185 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:50.738703 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ae327cdd-2417-46b1-a83d-2e218664a75b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:50.745295 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ae327cdd-2417-46b1-a83d-2e218664a75b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:50.747328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ae327cdd-2417-46b1-a83d-2e218664a75b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:50.747784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ae327cdd-2417-46b1-a83d-2e218664a75b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:50.962222 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-70191188-1521-4abb-8258-b0b056c85185 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:50.995905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-70191188-1521-4abb-8258-b0b056c85185 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:51.001399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-70191188-1521-4abb-8258-b0b056c85185 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:51.003149 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-70191188-1521-4abb-8258-b0b056c85185 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1605 microversion: 2.42 time: 0.324193 Jul 25 13:02:51.005847 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2235/4385] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:02:50 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1605 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:02:51.159597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ae327cdd-2417-46b1-a83d-2e218664a75b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:51.195843 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ae327cdd-2417-46b1-a83d-2e218664a75b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832" status: 200 len: 1322 microversion: 2.1 time: 0.488385 Jul 25 13:02:51.197134 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2151/4386] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:50 2022] GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832 => generated 1322 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:51.675497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3740e43f-9701-45ac-8f63-95ddb8ae8a30 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:51.676276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3740e43f-9701-45ac-8f63-95ddb8ae8a30 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:51.689145 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3740e43f-9701-45ac-8f63-95ddb8ae8a30 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:51.689681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3740e43f-9701-45ac-8f63-95ddb8ae8a30 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:51.690557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3740e43f-9701-45ac-8f63-95ddb8ae8a30 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:51.691086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3740e43f-9701-45ac-8f63-95ddb8ae8a30 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:51.706914 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-fba66e70-6786-4902-917c-b58eec446735 req-18d025ca-a897-47dc-adbd-8ee4aadd6c8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1136ad1-8b0f-4717-8255-e615d7753832", "tag": "51bc438d-5b70-41e7-87e9-45507375284c"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:51.740853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fba66e70-6786-4902-917c-b58eec446735 req-18d025ca-a897-47dc-adbd-8ee4aadd6c8c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:51.741314 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fba66e70-6786-4902-917c-b58eec446735 req-18d025ca-a897-47dc-adbd-8ee4aadd6c8c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:51.765973 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-fba66e70-6786-4902-917c-b58eec446735 req-18d025ca-a897-47dc-adbd-8ee4aadd6c8c service nova] Creating event network-changed:51bc438d-5b70-41e7-87e9-45507375284c for instance a1136ad1-8b0f-4717-8255-e615d7753832 on n-h2-848886-15 Jul 25 13:02:51.779010 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-fba66e70-6786-4902-917c-b58eec446735 req-18d025ca-a897-47dc-adbd-8ee4aadd6c8c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076609 Jul 25 13:02:51.781405 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2152/4387] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:02:51.791578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ea437a25-7792-42c3-8cf1-0688aa1b0315 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:51.792297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ea437a25-7792-42c3-8cf1-0688aa1b0315 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:51.799466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea437a25-7792-42c3-8cf1-0688aa1b0315 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:51.800145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea437a25-7792-42c3-8cf1-0688aa1b0315 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:51.801119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea437a25-7792-42c3-8cf1-0688aa1b0315 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:51.801878 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea437a25-7792-42c3-8cf1-0688aa1b0315 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:52.273260 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ea437a25-7792-42c3-8cf1-0688aa1b0315 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45b015e53c54c129ff2a04ce8da4964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912d361eab8a474cb34434e4301bc4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:52.282134 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ea437a25-7792-42c3-8cf1-0688aa1b0315 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] 10.222.0.49 "GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255" status: 200 len: 1315 microversion: 2.1 time: 0.498535 Jul 25 13:02:52.287691 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2153/4388] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:51 2022] GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255 => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:52.295139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bb567d85-59dd-41e2-9001-08b0591f86d7 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:52.302845 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bb567d85-59dd-41e2-9001-08b0591f86d7 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:52.314197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bb567d85-59dd-41e2-9001-08b0591f86d7 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:52.316989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bb567d85-59dd-41e2-9001-08b0591f86d7 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:52.318276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bb567d85-59dd-41e2-9001-08b0591f86d7 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:52.320260 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bb567d85-59dd-41e2-9001-08b0591f86d7 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:52.379141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:52.448706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3740e43f-9701-45ac-8f63-95ddb8ae8a30 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cc565157fa41bf8d0a1213964f48fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0542b4102fd6459e930e08104fc7a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:52.466183 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3740e43f-9701-45ac-8f63-95ddb8ae8a30 tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 200 len: 1509 microversion: 2.1 time: 0.795329 Jul 25 13:02:52.469394 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2236/4389] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:51 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 1509 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:52.488446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f99728a3-1df0-489f-9073-fc41e6373bf8 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:52.500390 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f99728a3-1df0-489f-9073-fc41e6373bf8 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: a1136ad1-8b0f-4717-8255-e615d7753832] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:52.506582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:52.510924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f99728a3-1df0-489f-9073-fc41e6373bf8 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:52.511694 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f99728a3-1df0-489f-9073-fc41e6373bf8 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:52.512873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f99728a3-1df0-489f-9073-fc41e6373bf8 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:52.513785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f99728a3-1df0-489f-9073-fc41e6373bf8 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:52.545929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:52.573777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bb567d85-59dd-41e2-9001-08b0591f86d7 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:52.596645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bb567d85-59dd-41e2-9001-08b0591f86d7 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:52.598198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bb567d85-59dd-41e2-9001-08b0591f86d7 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:52.599446 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bb567d85-59dd-41e2-9001-08b0591f86d7 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1605 microversion: 2.42 time: 0.310282 Jul 25 13:02:52.600031 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2154/4390] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:02:52 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1605 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:02:52.621450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0a68c2b4-3da8-49fd-95aa-4ee140686375 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1469644805", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "4662c0db-4a59-4fd2-9c92-c0c680bac122"}], "key_name": "tempest-TestNetworkAdvancedServerOps-137998169", "security_groups": [{"name": "tempest-secgroup-smoke-694875081"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:54.424908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-0a68c2b4-3da8-49fd-95aa-4ee140686375 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] validate_networks() for [('4662c0db-4a59-4fd2-9c92-c0c680bac122', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:02:54.708232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f99728a3-1df0-489f-9073-fc41e6373bf8 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:54.727683 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f99728a3-1df0-489f-9073-fc41e6373bf8 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832" status: 200 len: 1322 microversion: 2.1 time: 2.256845 Jul 25 13:02:54.729138 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2237/4391] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:52 2022] GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832 => generated 1322 bytes in 2259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:54.734588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-da98a5b1-7a0b-40f6-af91-74a705f6f51e tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:54.745759 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-da98a5b1-7a0b-40f6-af91-74a705f6f51e tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:54.779827 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da98a5b1-7a0b-40f6-af91-74a705f6f51e tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:54.780430 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da98a5b1-7a0b-40f6-af91-74a705f6f51e tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:54.784558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da98a5b1-7a0b-40f6-af91-74a705f6f51e tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:54.785032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da98a5b1-7a0b-40f6-af91-74a705f6f51e tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:55.530515 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-da98a5b1-7a0b-40f6-af91-74a705f6f51e tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45b015e53c54c129ff2a04ce8da4964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912d361eab8a474cb34434e4301bc4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:55.544967 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-da98a5b1-7a0b-40f6-af91-74a705f6f51e tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] 10.222.0.49 "GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255" status: 200 len: 1502 microversion: 2.1 time: 0.809372 Jul 25 13:02:55.550965 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2238/4392] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:54 2022] GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255 => generated 1502 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:55.566136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-06b4ef18-5cbe-454c-ab7d-91fa1e9135ab req-5272ef60-bac5-4afc-be66-37cc2c049051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a62d654-72dd-4208-984f-1d8e8a807376", "name": "network-vif-deleted", "tag": "2be9f87e-ddaa-436c-b7d1-9c9d4d63e373"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:55.594035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-06b4ef18-5cbe-454c-ab7d-91fa1e9135ab req-5272ef60-bac5-4afc-be66-37cc2c049051 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:55.594493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-06b4ef18-5cbe-454c-ab7d-91fa1e9135ab req-5272ef60-bac5-4afc-be66-37cc2c049051 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:55.664134 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-06b4ef18-5cbe-454c-ab7d-91fa1e9135ab req-5272ef60-bac5-4afc-be66-37cc2c049051 service nova] Creating event network-vif-deleted:2be9f87e-ddaa-436c-b7d1-9c9d4d63e373 for instance 4a62d654-72dd-4208-984f-1d8e8a807376 on n-h1-848886-15 Jul 25 13:02:55.683929 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-06b4ef18-5cbe-454c-ab7d-91fa1e9135ab req-5272ef60-bac5-4afc-be66-37cc2c049051 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131554 Jul 25 13:02:55.687878 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2239/4393] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:02:55.695441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b4b47c2e-ccf7-4a20-ac2b-68e183a3dfee tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:55.710004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b4b47c2e-ccf7-4a20-ac2b-68e183a3dfee tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] [instance: 4a62d654-72dd-4208-984f-1d8e8a807376] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:55.729301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4b47c2e-ccf7-4a20-ac2b-68e183a3dfee tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:55.730508 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4b47c2e-ccf7-4a20-ac2b-68e183a3dfee tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:55.732518 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4b47c2e-ccf7-4a20-ac2b-68e183a3dfee tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:55.735632 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4b47c2e-ccf7-4a20-ac2b-68e183a3dfee tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:55.770755 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-b4b47c2e-ccf7-4a20-ac2b-68e183a3dfee tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] HTTP exception thrown: Instance 4a62d654-72dd-4208-984f-1d8e8a807376 could not be found. Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b4b47c2e-ccf7-4a20-ac2b-68e183a3dfee tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Request method failure captured: Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 HTTP/1.1 Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pRDSzHU2uyqf3I8_pVvcvrp-W7MibBdWLvGc4Sd9KRS6Kwss61pvWGvMXjJPgD2DaTEE8NAYNTbsW6pq9uHo6j8F2QXtf7c2sjCa49LX5acukLbOn4iRjoKc3QatSNN1yAb4tAzIOCrpcznwfgtnZ5Qfvbx9CpNPeRnR1P_ZkozaDA Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 0542b4102fd6459e930e08104fc7a16b Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestServerAdvancedOps-1200476583 Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0542b4102fd6459e930e08104fc7a16b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0542b4102fd6459e930e08104fc7a16b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0542b4102fd6459e930e08104fc7a16b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0542b4102fd6459e930e08104fc7a16b"}]}] Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestServerAdvancedOps-1200476583 Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 0542b4102fd6459e930e08104fc7a16b Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestServerAdvancedOps-1200476583 Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestServerAdvancedOps-1200476583-project Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 25cc565157fa41bf8d0a1213964f48fb Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestServerAdvancedOps-1200476583-project Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 4a62d654-72dd-4208-984f-1d8e8a807376 could not be found. Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '4a62d654-72dd-4208-984f-1d8e8a807376'} Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a62d654-72dd-4208-984f-1d8e8a807376 could not be found. Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a62d654-72dd-4208-984f-1d8e8a807376 could not be found. Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:02:55.775303 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:55.780358 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:02:55.780358 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:02:55.780358 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:02:55.780358 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:02:55.780358 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:02:55.780358 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a62d654-72dd-4208-984f-1d8e8a807376 could not be found. Jul 25 13:02:55.780358 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:02:55.784573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b4b47c2e-ccf7-4a20-ac2b-68e183a3dfee tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] Returning 404 to user: Instance 4a62d654-72dd-4208-984f-1d8e8a807376 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:02:55.788094 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b4b47c2e-ccf7-4a20-ac2b-68e183a3dfee tempest-TestServerAdvancedOps-1200476583 tempest-TestServerAdvancedOps-1200476583-project] 10.222.0.49 "GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376" status: 404 len: 111 microversion: 2.1 time: 0.097673 Jul 25 13:02:55.791977 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2240/4394] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:55 2022] GET /compute/v2.1/servers/4a62d654-72dd-4208-984f-1d8e8a807376 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:02:55.799658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9377ec3f-9513-4c19-9e38-f7011f3b5c7b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:55.804230 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9377ec3f-9513-4c19-9e38-f7011f3b5c7b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:55.820659 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9377ec3f-9513-4c19-9e38-f7011f3b5c7b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:55.822770 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9377ec3f-9513-4c19-9e38-f7011f3b5c7b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:55.828161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9377ec3f-9513-4c19-9e38-f7011f3b5c7b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:55.828831 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9377ec3f-9513-4c19-9e38-f7011f3b5c7b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:56.272611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9377ec3f-9513-4c19-9e38-f7011f3b5c7b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:56.283083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9377ec3f-9513-4c19-9e38-f7011f3b5c7b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:56.297143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9377ec3f-9513-4c19-9e38-f7011f3b5c7b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:56.301887 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9377ec3f-9513-4c19-9e38-f7011f3b5c7b tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1605 microversion: 2.42 time: 0.508481 Jul 25 13:02:56.317863 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2241/4395] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:02:55 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1605 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:02:56.317863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d6902a74-55b7-488e-a49a-1886ffcefaad tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:56.317863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d6902a74-55b7-488e-a49a-1886ffcefaad tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:56.339991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d6902a74-55b7-488e-a49a-1886ffcefaad tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:56.340530 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d6902a74-55b7-488e-a49a-1886ffcefaad tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:56.341411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d6902a74-55b7-488e-a49a-1886ffcefaad tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:56.341961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d6902a74-55b7-488e-a49a-1886ffcefaad tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:56.523399 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d6902a74-55b7-488e-a49a-1886ffcefaad tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.218190 Jul 25 13:02:56.526741 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2242/4396] 10.222.0.49 () {58 vars in 1296 bytes} [Mon Jul 25 13:02:56 2022] DELETE /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255/os-server-password => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:02:56.547686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5dc19b30-29e3-434d-9863-cf972322e5a2 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:56.548347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5dc19b30-29e3-434d-9863-cf972322e5a2 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: a1136ad1-8b0f-4717-8255-e615d7753832] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:56.572155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5dc19b30-29e3-434d-9863-cf972322e5a2 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:56.582656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5dc19b30-29e3-434d-9863-cf972322e5a2 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:56.583526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5dc19b30-29e3-434d-9863-cf972322e5a2 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:56.590664 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5dc19b30-29e3-434d-9863-cf972322e5a2 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:59.126688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5dc19b30-29e3-434d-9863-cf972322e5a2 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:59.144211 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5dc19b30-29e3-434d-9863-cf972322e5a2 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832" status: 200 len: 1322 microversion: 2.1 time: 2.615980 Jul 25 13:02:59.155537 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2243/4397] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:56 2022] GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832 => generated 1322 bytes in 2618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:59.158351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ceeca2a5-cc6d-4996-9496-c955e6413796 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:59.158874 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ceeca2a5-cc6d-4996-9496-c955e6413796 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:59.161198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-0a68c2b4-3da8-49fd-95aa-4ee140686375 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:02:59.161704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-0a68c2b4-3da8-49fd-95aa-4ee140686375 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:02:59.162143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-0a68c2b4-3da8-49fd-95aa-4ee140686375 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:02:59.162584 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-0a68c2b4-3da8-49fd-95aa-4ee140686375 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:02:59.162974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-0a68c2b4-3da8-49fd-95aa-4ee140686375 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:02:59.174756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ceeca2a5-cc6d-4996-9496-c955e6413796 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:59.178375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ceeca2a5-cc6d-4996-9496-c955e6413796 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:59.179754 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ceeca2a5-cc6d-4996-9496-c955e6413796 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:59.180443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ceeca2a5-cc6d-4996-9496-c955e6413796 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:59.236845 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a68c2b4-3da8-49fd-95aa-4ee140686375 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:59.243210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a68c2b4-3da8-49fd-95aa-4ee140686375 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:59.249398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a68c2b4-3da8-49fd-95aa-4ee140686375 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:59.250724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a68c2b4-3da8-49fd-95aa-4ee140686375 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:59.260698 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ceeca2a5-cc6d-4996-9496-c955e6413796 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] 10.222.0.49 "GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.114181 Jul 25 13:02:59.269950 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2244/4398] 10.222.0.49 () {58 vars in 1293 bytes} [Mon Jul 25 13:02:59 2022] GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255/os-server-password => generated 16 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 13:02:59.281688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-94e86f24-ba91-45d7-8009-a332f0b6f1e0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:59.294490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-94e86f24-ba91-45d7-8009-a332f0b6f1e0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:59.303401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94e86f24-ba91-45d7-8009-a332f0b6f1e0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:59.306220 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94e86f24-ba91-45d7-8009-a332f0b6f1e0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:59.307528 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94e86f24-ba91-45d7-8009-a332f0b6f1e0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:59.307999 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94e86f24-ba91-45d7-8009-a332f0b6f1e0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:59.327247 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-0a68c2b4-3da8-49fd-95aa-4ee140686375 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Getting quotas for project c0d891a772834e43bdfcbde778a90498. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:02:59.340702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-0a68c2b4-3da8-49fd-95aa-4ee140686375 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Getting quotas for user 4d6e2ae351744e0ab1f153d629e4f0e7 and project c0d891a772834e43bdfcbde778a90498. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:02:59.405783 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0a68c2b4-3da8-49fd-95aa-4ee140686375 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:02:59.410896 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0a68c2b4-3da8-49fd-95aa-4ee140686375 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:02:59.450415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-94e86f24-ba91-45d7-8009-a332f0b6f1e0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:59.460788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-94e86f24-ba91-45d7-8009-a332f0b6f1e0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:59.462365 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-94e86f24-ba91-45d7-8009-a332f0b6f1e0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:59.472085 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-94e86f24-ba91-45d7-8009-a332f0b6f1e0 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1605 microversion: 2.42 time: 0.200847 Jul 25 13:02:59.503889 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2245/4399] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:02:59 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1605 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:02:59.561923 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0a68c2b4-3da8-49fd-95aa-4ee140686375 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 6.960757 Jul 25 13:02:59.566354 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2155/4400] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:02:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 6966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:02:59.575305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-37d8682f-f15a-4720-a69b-836bcb788f4f req-a8d8c587-6926-481c-bbde-e0c9857cfcd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d9bf270-1783-415a-a809-4098ffbe35f1", "name": "network-vif-plugged", "status": "completed", "tag": "6a73117f-96f4-498c-a3b6-ce82b669708a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:59.638620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-37d8682f-f15a-4720-a69b-836bcb788f4f req-a8d8c587-6926-481c-bbde-e0c9857cfcd5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:59.639530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-37d8682f-f15a-4720-a69b-836bcb788f4f req-a8d8c587-6926-481c-bbde-e0c9857cfcd5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:59.697004 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-37d8682f-f15a-4720-a69b-836bcb788f4f req-a8d8c587-6926-481c-bbde-e0c9857cfcd5 service nova] Creating event network-vif-plugged:6a73117f-96f4-498c-a3b6-ce82b669708a for instance 4d9bf270-1783-415a-a809-4098ffbe35f1 on n-h2-848886-15 Jul 25 13:02:59.709586 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-37d8682f-f15a-4720-a69b-836bcb788f4f req-a8d8c587-6926-481c-bbde-e0c9857cfcd5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141355 Jul 25 13:02:59.715818 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2156/4401] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:02:59.724276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ea554748-3f56-4f88-b0d9-4b5817c51579 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:59.727491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ea554748-3f56-4f88-b0d9-4b5817c51579 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:59.755162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea554748-3f56-4f88-b0d9-4b5817c51579 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:59.758502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea554748-3f56-4f88-b0d9-4b5817c51579 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:59.759818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea554748-3f56-4f88-b0d9-4b5817c51579 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:59.763143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea554748-3f56-4f88-b0d9-4b5817c51579 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:59.890312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ea554748-3f56-4f88-b0d9-4b5817c51579 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:03:00.232045 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-effe5863-efcf-45ef-99d9-eec8b86bd59a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Action: 'create', calling method: .version_select at 0x7efcfa1e73a0>, body: {"keypair": {"name": "tempest-keypair-1064422132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDirt6Rn7gK92k1JM5MfsuVWRS8f11F3gE0e4pw8ug1T76fKlw1ymBEOburAKGoNC/h4Sg393LdScj2JWlActLQgOnA+kPP0ndDHQVlbhYz0B/Vy2PhdJrknNHD+Ij9uyg=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:03:00.245618 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ea554748-3f56-4f88-b0d9-4b5817c51579 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255" status: 204 len: 0 microversion: 2.1 time: 0.527556 Jul 25 13:03:00.247261 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2157/4402] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:02:59 2022] DELETE /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:03:00.265010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-11b09db2-0ba9-47b9-848d-1bfadcce71db tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:00.266278 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-11b09db2-0ba9-47b9-848d-1bfadcce71db tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:00.297902 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-effe5863-efcf-45ef-99d9-eec8b86bd59a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Getting quotas for project 4bb3fd31125b4879bd1f58cd3d1358a3. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:03:00.315184 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-effe5863-efcf-45ef-99d9-eec8b86bd59a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Getting quotas for user 3dc3da4ae9f444e7a4471e509868d088 and project 4bb3fd31125b4879bd1f58cd3d1358a3. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:03:00.441369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-11b09db2-0ba9-47b9-848d-1bfadcce71db tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:00.454519 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-effe5863-efcf-45ef-99d9-eec8b86bd59a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.931282 Jul 25 13:03:00.463126 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-11b09db2-0ba9-47b9-848d-1bfadcce71db tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1266 microversion: 2.1 time: 0.208982 Jul 25 13:03:00.463263 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2246/4403] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:02:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:03:00.471762 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2158/4404] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:00 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:00.494996 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b58d2848-84f3-40b8-be75-751ea00342fd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:00.499129 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b58d2848-84f3-40b8-be75-751ea00342fd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: a1136ad1-8b0f-4717-8255-e615d7753832] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:00.500580 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f8c1ca79-c396-45ee-9bed-429bd812995d tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:00.502207 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f8c1ca79-c396-45ee-9bed-429bd812995d tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:00.528028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b58d2848-84f3-40b8-be75-751ea00342fd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:00.528830 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b58d2848-84f3-40b8-be75-751ea00342fd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:00.529265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8c1ca79-c396-45ee-9bed-429bd812995d tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:00.529944 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8c1ca79-c396-45ee-9bed-429bd812995d tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:00.531039 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b58d2848-84f3-40b8-be75-751ea00342fd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:00.532022 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8c1ca79-c396-45ee-9bed-429bd812995d tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:00.532823 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b58d2848-84f3-40b8-be75-751ea00342fd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:00.533514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8c1ca79-c396-45ee-9bed-429bd812995d tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:01.328843 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f8c1ca79-c396-45ee-9bed-429bd812995d tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45b015e53c54c129ff2a04ce8da4964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912d361eab8a474cb34434e4301bc4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:01.345602 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f8c1ca79-c396-45ee-9bed-429bd812995d tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] 10.222.0.49 "GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255" status: 200 len: 1508 microversion: 2.1 time: 0.868153 Jul 25 13:03:01.349142 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2159/4405] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:00 2022] GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255 => generated 1508 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:01.360005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-714111b2-3dfc-47c5-bd30-1bcba3012c6a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:01.361387 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-714111b2-3dfc-47c5-bd30-1bcba3012c6a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:01.381395 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-714111b2-3dfc-47c5-bd30-1bcba3012c6a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:01.395382 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-714111b2-3dfc-47c5-bd30-1bcba3012c6a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:01.398357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-714111b2-3dfc-47c5-bd30-1bcba3012c6a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:01.399679 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-714111b2-3dfc-47c5-bd30-1bcba3012c6a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:01.483207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b58d2848-84f3-40b8-be75-751ea00342fd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:01.498545 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b58d2848-84f3-40b8-be75-751ea00342fd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832" status: 200 len: 1322 microversion: 2.1 time: 1.032309 Jul 25 13:03:01.499184 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2247/4406] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:00 2022] GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832 => generated 1322 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:01.507537 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-28dbecde-c03f-4780-a017-4cbdd238705a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:01.508170 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-28dbecde-c03f-4780-a017-4cbdd238705a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:01.521628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-28dbecde-c03f-4780-a017-4cbdd238705a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:01.522130 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-28dbecde-c03f-4780-a017-4cbdd238705a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:01.522940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-28dbecde-c03f-4780-a017-4cbdd238705a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:01.523392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-28dbecde-c03f-4780-a017-4cbdd238705a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:01.646105 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-714111b2-3dfc-47c5-bd30-1bcba3012c6a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:01.671786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-714111b2-3dfc-47c5-bd30-1bcba3012c6a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:01.673510 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-714111b2-3dfc-47c5-bd30-1bcba3012c6a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:01.675202 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-714111b2-3dfc-47c5-bd30-1bcba3012c6a tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1605 microversion: 2.42 time: 0.324782 Jul 25 13:03:01.676296 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2160/4407] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:03:01 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1605 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:03:01.691999 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-28dbecde-c03f-4780-a017-4cbdd238705a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:01.706672 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-28dbecde-c03f-4780-a017-4cbdd238705a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1318 microversion: 2.1 time: 0.206169 Jul 25 13:03:01.707801 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2248/4408] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:01 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:01.933231 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-994a08cd-9292-478b-b785-bd06ec80e4aa req-3fe09782-b754-4574-a4dd-0dc0cc6491c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "befe3c76-6841-45ba-95b9-7d11592e404a", "name": "network-vif-plugged", "status": "completed", "tag": "33a77d2a-b53f-41de-88d0-4a1366eb9d42"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:03:01.967838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-994a08cd-9292-478b-b785-bd06ec80e4aa req-3fe09782-b754-4574-a4dd-0dc0cc6491c9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:01.968308 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-994a08cd-9292-478b-b785-bd06ec80e4aa req-3fe09782-b754-4574-a4dd-0dc0cc6491c9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:02.000104 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-994a08cd-9292-478b-b785-bd06ec80e4aa req-3fe09782-b754-4574-a4dd-0dc0cc6491c9 service nova] Creating event network-vif-plugged:33a77d2a-b53f-41de-88d0-4a1366eb9d42 for instance befe3c76-6841-45ba-95b9-7d11592e404a on n-h1-848886-15 Jul 25 13:03:02.014012 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-994a08cd-9292-478b-b785-bd06ec80e4aa req-3fe09782-b754-4574-a4dd-0dc0cc6491c9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083700 Jul 25 13:03:02.015051 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2161/4409] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:03:02.371191 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-16035c9f-fead-4270-b278-0707718b10e1 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:02.372190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-16035c9f-fead-4270-b278-0707718b10e1 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:02.386368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16035c9f-fead-4270-b278-0707718b10e1 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:02.386827 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16035c9f-fead-4270-b278-0707718b10e1 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:02.387622 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16035c9f-fead-4270-b278-0707718b10e1 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:02.388065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16035c9f-fead-4270-b278-0707718b10e1 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:02.520682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a7649c6f-cce7-42b9-a67e-51ed72166758 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:02.522057 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a7649c6f-cce7-42b9-a67e-51ed72166758 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: a1136ad1-8b0f-4717-8255-e615d7753832] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:02.542482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7649c6f-cce7-42b9-a67e-51ed72166758 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:02.549778 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7649c6f-cce7-42b9-a67e-51ed72166758 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:02.551106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7649c6f-cce7-42b9-a67e-51ed72166758 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:02.555822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7649c6f-cce7-42b9-a67e-51ed72166758 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:02.918956 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-16035c9f-fead-4270-b278-0707718b10e1 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45b015e53c54c129ff2a04ce8da4964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912d361eab8a474cb34434e4301bc4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:02.949814 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-16035c9f-fead-4270-b278-0707718b10e1 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] 10.222.0.49 "GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255" status: 200 len: 1508 microversion: 2.1 time: 0.575990 Jul 25 13:03:02.950581 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2249/4410] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:02 2022] GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255 => generated 1508 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:02.956802 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-90c04cee-50db-4535-8b31-f60ee613675f tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:02.962793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-90c04cee-50db-4535-8b31-f60ee613675f tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:02.982724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90c04cee-50db-4535-8b31-f60ee613675f tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:02.983682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90c04cee-50db-4535-8b31-f60ee613675f tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:02.984729 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90c04cee-50db-4535-8b31-f60ee613675f tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:02.985347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90c04cee-50db-4535-8b31-f60ee613675f tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:03.043395 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a7649c6f-cce7-42b9-a67e-51ed72166758 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:03.056708 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a7649c6f-cce7-42b9-a67e-51ed72166758 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832" status: 200 len: 1322 microversion: 2.1 time: 0.540226 Jul 25 13:03:03.061158 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2162/4411] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:02 2022] GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832 => generated 1322 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:03:03.069704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4413dd9f-6a0d-4f04-958a-8076fdb6dbc3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:03.071830 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4413dd9f-6a0d-4f04-958a-8076fdb6dbc3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:03.094664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4413dd9f-6a0d-4f04-958a-8076fdb6dbc3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:03.097400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4413dd9f-6a0d-4f04-958a-8076fdb6dbc3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:03.099055 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4413dd9f-6a0d-4f04-958a-8076fdb6dbc3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:03.104067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4413dd9f-6a0d-4f04-958a-8076fdb6dbc3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:03.272936 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-90c04cee-50db-4535-8b31-f60ee613675f tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:03.298427 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-90c04cee-50db-4535-8b31-f60ee613675f tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:03.307096 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-90c04cee-50db-4535-8b31-f60ee613675f tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:03.314061 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-90c04cee-50db-4535-8b31-f60ee613675f tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1605 microversion: 2.42 time: 0.357634 Jul 25 13:03:03.335293 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2250/4412] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:03:02 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1605 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:03:03.979135 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bc0a6548-99f4-4568-a640-c225c7c4c19a tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:03.979932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bc0a6548-99f4-4568-a640-c225c7c4c19a tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:03.994328 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc0a6548-99f4-4568-a640-c225c7c4c19a tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:03.996682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc0a6548-99f4-4568-a640-c225c7c4c19a tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:03.997592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc0a6548-99f4-4568-a640-c225c7c4c19a tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:03.999244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc0a6548-99f4-4568-a640-c225c7c4c19a tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:04.196615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4413dd9f-6a0d-4f04-958a-8076fdb6dbc3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:04.217181 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4413dd9f-6a0d-4f04-958a-8076fdb6dbc3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1324 microversion: 2.1 time: 1.154412 Jul 25 13:03:04.227364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bc0a6548-99f4-4568-a640-c225c7c4c19a tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45b015e53c54c129ff2a04ce8da4964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912d361eab8a474cb34434e4301bc4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:04.227653 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2163/4413] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:03 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1324 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:04.247693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-502dc36f-cec2-4a4e-8944-f6ea4f36c04b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:04.252695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-502dc36f-cec2-4a4e-8944-f6ea4f36c04b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: a1136ad1-8b0f-4717-8255-e615d7753832] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:04.264077 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bc0a6548-99f4-4568-a640-c225c7c4c19a tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] 10.222.0.49 "GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255" status: 200 len: 1466 microversion: 2.1 time: 0.290022 Jul 25 13:03:04.278287 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2251/4414] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:03 2022] GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255 => generated 1466 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:03:04.292458 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-502dc36f-cec2-4a4e-8944-f6ea4f36c04b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:04.292924 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-502dc36f-cec2-4a4e-8944-f6ea4f36c04b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:04.293715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-502dc36f-cec2-4a4e-8944-f6ea4f36c04b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:04.294196 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-502dc36f-cec2-4a4e-8944-f6ea4f36c04b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:04.298676 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-3c82349b-cd86-48db-9b87-9bae52256938 req-e17e9039-a482-47a1-8cc8-ac260edc71d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1136ad1-8b0f-4717-8255-e615d7753832", "name": "network-vif-plugged", "status": "completed", "tag": "51bc438d-5b70-41e7-87e9-45507375284c"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:03:04.338595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3c82349b-cd86-48db-9b87-9bae52256938 req-e17e9039-a482-47a1-8cc8-ac260edc71d6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:04.339059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3c82349b-cd86-48db-9b87-9bae52256938 req-e17e9039-a482-47a1-8cc8-ac260edc71d6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:04.379790 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-3c82349b-cd86-48db-9b87-9bae52256938 req-e17e9039-a482-47a1-8cc8-ac260edc71d6 service nova] Creating event network-vif-plugged:51bc438d-5b70-41e7-87e9-45507375284c for instance a1136ad1-8b0f-4717-8255-e615d7753832 on n-h2-848886-15 Jul 25 13:03:04.418465 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-3c82349b-cd86-48db-9b87-9bae52256938 req-e17e9039-a482-47a1-8cc8-ac260edc71d6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140582 Jul 25 13:03:04.419097 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2252/4415] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:03:04.438861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-353200a3-2882-4a03-9b57-1c280cd10514 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:04.439882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-353200a3-2882-4a03-9b57-1c280cd10514 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:04.458978 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-353200a3-2882-4a03-9b57-1c280cd10514 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:04.460553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-353200a3-2882-4a03-9b57-1c280cd10514 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:04.463979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-353200a3-2882-4a03-9b57-1c280cd10514 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:04.464735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-353200a3-2882-4a03-9b57-1c280cd10514 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:04.582920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-353200a3-2882-4a03-9b57-1c280cd10514 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:04.583387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-353200a3-2882-4a03-9b57-1c280cd10514 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:04.594138 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-353200a3-2882-4a03-9b57-1c280cd10514 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lazy-loading 'fault' on Instance uuid 339809bb-41b5-4a8f-80b7-28a356aad3f4 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:03:04.815827 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-353200a3-2882-4a03-9b57-1c280cd10514 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:04.855021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-353200a3-2882-4a03-9b57-1c280cd10514 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:04.864909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-353200a3-2882-4a03-9b57-1c280cd10514 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30345ec1766e4f29a7393616070201bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52d102917f4b968a0f06c93f37994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:04.870175 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-353200a3-2882-4a03-9b57-1c280cd10514 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 200 len: 1372 microversion: 2.42 time: 0.448096 Jul 25 13:03:04.871227 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2253/4416] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:03:04 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 1372 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:03:04.895517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-e10044ad-3678-4718-9ca9-4c9bb624426d req-c9246948-06af-4876-97a9-2bb5218bd986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d06982e5-f9a9-45f6-86d6-1eecdc7ce255", "name": "network-vif-deleted", "tag": "6ab39a95-042c-4e49-a9cf-3654ba5651a6"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:03:04.924241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e10044ad-3678-4718-9ca9-4c9bb624426d req-c9246948-06af-4876-97a9-2bb5218bd986 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:04.924785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e10044ad-3678-4718-9ca9-4c9bb624426d req-c9246948-06af-4876-97a9-2bb5218bd986 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:04.975396 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-e10044ad-3678-4718-9ca9-4c9bb624426d req-c9246948-06af-4876-97a9-2bb5218bd986 service nova] Creating event network-vif-deleted:6ab39a95-042c-4e49-a9cf-3654ba5651a6 for instance d06982e5-f9a9-45f6-86d6-1eecdc7ce255 on n-h2-848886-15 Jul 25 13:03:04.994261 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-e10044ad-3678-4718-9ca9-4c9bb624426d req-c9246948-06af-4876-97a9-2bb5218bd986 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118595 Jul 25 13:03:04.997624 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2254/4417] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:03:05.086859 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-502dc36f-cec2-4a4e-8944-f6ea4f36c04b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:05.096006 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-502dc36f-cec2-4a4e-8944-f6ea4f36c04b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832" status: 200 len: 1322 microversion: 2.1 time: 0.866950 Jul 25 13:03:05.102925 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2164/4418] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:04 2022] GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832 => generated 1322 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:05.263903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-acda1cc7-403c-4967-8809-eb342429457e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:05.267050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-acda1cc7-403c-4967-8809-eb342429457e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:05.290955 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e9144fb3-dc9d-4b9e-b95f-4f5aeac9e738 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:05.291580 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e9144fb3-dc9d-4b9e-b95f-4f5aeac9e738 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:05.296650 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acda1cc7-403c-4967-8809-eb342429457e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:05.297106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acda1cc7-403c-4967-8809-eb342429457e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:05.302133 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acda1cc7-403c-4967-8809-eb342429457e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:05.302644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acda1cc7-403c-4967-8809-eb342429457e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:05.302772 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e9144fb3-dc9d-4b9e-b95f-4f5aeac9e738 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:05.303226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e9144fb3-dc9d-4b9e-b95f-4f5aeac9e738 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:05.304225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e9144fb3-dc9d-4b9e-b95f-4f5aeac9e738 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:05.304676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e9144fb3-dc9d-4b9e-b95f-4f5aeac9e738 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:05.397925 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e9144fb3-dc9d-4b9e-b95f-4f5aeac9e738 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:05.398395 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e9144fb3-dc9d-4b9e-b95f-4f5aeac9e738 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:05.407171 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-e9144fb3-dc9d-4b9e-b95f-4f5aeac9e738 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lazy-loading 'fault' on Instance uuid d06982e5-f9a9-45f6-86d6-1eecdc7ce255 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:03:05.763507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e9144fb3-dc9d-4b9e-b95f-4f5aeac9e738 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45b015e53c54c129ff2a04ce8da4964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912d361eab8a474cb34434e4301bc4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:05.781103 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e9144fb3-dc9d-4b9e-b95f-4f5aeac9e738 tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] 10.222.0.49 "GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255" status: 200 len: 1305 microversion: 2.1 time: 0.493462 Jul 25 13:03:05.789125 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2165/4419] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:05 2022] GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255 => generated 1305 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:05.906183 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-07097dc9-68bf-4fd9-87d7-ade859f4104d tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:05.907182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-07097dc9-68bf-4fd9-87d7-ade859f4104d tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:05.928237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07097dc9-68bf-4fd9-87d7-ade859f4104d tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:05.928927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07097dc9-68bf-4fd9-87d7-ade859f4104d tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:05.936331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07097dc9-68bf-4fd9-87d7-ade859f4104d tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:05.937260 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07097dc9-68bf-4fd9-87d7-ade859f4104d tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:05.965869 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-07097dc9-68bf-4fd9-87d7-ade859f4104d tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] HTTP exception thrown: Instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 could not be found. Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-07097dc9-68bf-4fd9-87d7-ade859f4104d tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Request method failure captured: Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 HTTP/1.1 Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pLUy_qaHZrTobidfnUGpoUm-zUCEM2-dYUeKUoH4r7if-9i3IZYrAkUlgGLHUpgrc4G7eZ3-M6sO9iG6X1De-ZpVH9xPBpVwYtCByNu21pzLi1t1gdmmwrMBqHShuekTyjmkIewleLfNMUzhUkix0XDTPxUap4K9b-EAj1weyMix7Q Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: X-Openstack-Nova-Api-Version: 2.42 Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: cd52d102917f4b968a0f06c93f37994a Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1322165547 Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cd52d102917f4b968a0f06c93f37994a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cd52d102917f4b968a0f06c93f37994a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd52d102917f4b968a0f06c93f37994a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd52d102917f4b968a0f06c93f37994a"}]}] Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1322165547 Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: cd52d102917f4b968a0f06c93f37994a Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1322165547 Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-TaggedBootDevicesTest_v242-1322165547-project Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 30345ec1766e4f29a7393616070201bd Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1322165547-project Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 could not be found. Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '339809bb-41b5-4a8f-80b7-28a356aad3f4'} Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 could not be found. Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 could not be found. Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:05.970429 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:05.976338 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:05.976338 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:05.976338 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:05.976338 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:05.976338 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:03:05.976338 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:03:05.976338 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 could not be found. Jul 25 13:03:05.976338 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:05.981466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-07097dc9-68bf-4fd9-87d7-ade859f4104d tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Returning 404 to user: Instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:03:05.989751 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-07097dc9-68bf-4fd9-87d7-ade859f4104d tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 404 len: 111 microversion: 2.42 time: 0.093850 Jul 25 13:03:05.996187 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2166/4420] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:03:05 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:03:06.005752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-76726cae-a0e4-4c1a-8a7c-688bbc56dbdc tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '.version_select at 0x7efcf98c70d0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:06.042303 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-76726cae-a0e4-4c1a-8a7c-688bbc56dbdc tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1128830064" status: 204 len: 0 microversion: 2.42 time: 0.044023 Jul 25 13:03:06.043514 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2167/4421] 10.222.0.49 () {60 vars in 1262 bytes} [Mon Jul 25 13:03:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1128830064 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 13:03:06.127862 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a448e48e-04fb-4eba-b940-c5d0f1d3b5c6 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:06.129169 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a448e48e-04fb-4eba-b940-c5d0f1d3b5c6 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: a1136ad1-8b0f-4717-8255-e615d7753832] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:06.145283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a448e48e-04fb-4eba-b940-c5d0f1d3b5c6 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:06.146095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a448e48e-04fb-4eba-b940-c5d0f1d3b5c6 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:06.147184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a448e48e-04fb-4eba-b940-c5d0f1d3b5c6 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:06.147783 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a448e48e-04fb-4eba-b940-c5d0f1d3b5c6 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:06.490871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-acda1cc7-403c-4967-8809-eb342429457e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:06.506565 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-acda1cc7-403c-4967-8809-eb342429457e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1391 microversion: 2.1 time: 1.265007 Jul 25 13:03:06.507231 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2255/4422] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:05 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1391 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:06.798958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d690a6c4-6243-47b0-8b68-d9b4d7fa6ffa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-160558975", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "974e2b05-9cf4-4edf-a41e-e53067f36c57"}], "security_groups": [{"name": "tempest-securitygroup--150816953"}], "key_name": "tempest-keypair-1064422132", "user_data": "}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:03:07.160873 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a448e48e-04fb-4eba-b940-c5d0f1d3b5c6 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:07.176432 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a448e48e-04fb-4eba-b940-c5d0f1d3b5c6 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832" status: 200 len: 1322 microversion: 2.1 time: 1.052866 Jul 25 13:03:07.179971 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2168/4423] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:06 2022] GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832 => generated 1322 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:07.193611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5016c06e-4d03-4819-8192-8434c78ce02b tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:07.194923 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5016c06e-4d03-4819-8192-8434c78ce02b tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] [instance: d06982e5-f9a9-45f6-86d6-1eecdc7ce255] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:07.218475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5016c06e-4d03-4819-8192-8434c78ce02b tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:07.220145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5016c06e-4d03-4819-8192-8434c78ce02b tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:07.222236 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5016c06e-4d03-4819-8192-8434c78ce02b tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:07.223477 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5016c06e-4d03-4819-8192-8434c78ce02b tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:07.267773 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-5016c06e-4d03-4819-8192-8434c78ce02b tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] HTTP exception thrown: Instance d06982e5-f9a9-45f6-86d6-1eecdc7ce255 could not be found. Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5016c06e-4d03-4819-8192-8434c78ce02b tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Request method failure captured: Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255 HTTP/1.1 Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pRayCN4-y04NE6vbK0fDr-gYArpv84uTy9QsMZfozbtraap-55MuYnyawGz6aW50AmhQmh-fBQNLSH97LS_JqPfBsd-GXY9ChiCevSI7Pr5dnX3_XIX_LRlt7VWoUGIbD-e0oGo7c3HdQVC211uH2b_QCaQ_vo40FtvwkZQV4LBWUY Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 912d361eab8a474cb34434e4301bc4f6 Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerPasswordTestJSON-60845029 Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_912d361eab8a474cb34434e4301bc4f6", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/912d361eab8a474cb34434e4301bc4f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/912d361eab8a474cb34434e4301bc4f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/912d361eab8a474cb34434e4301bc4f6"}]}] Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerPasswordTestJSON-60845029 Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 912d361eab8a474cb34434e4301bc4f6 Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerPasswordTestJSON-60845029 Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerPasswordTestJSON-60845029-project Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: e45b015e53c54c129ff2a04ce8da4964 Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerPasswordTestJSON-60845029-project Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance d06982e5-f9a9-45f6-86d6-1eecdc7ce255 could not be found. Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'd06982e5-f9a9-45f6-86d6-1eecdc7ce255'} Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d06982e5-f9a9-45f6-86d6-1eecdc7ce255 could not be found. Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d06982e5-f9a9-45f6-86d6-1eecdc7ce255 could not be found. Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:07.269440 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:07.274690 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:07.274690 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:07.274690 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:07.274690 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:03:07.274690 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:03:07.274690 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d06982e5-f9a9-45f6-86d6-1eecdc7ce255 could not be found. Jul 25 13:03:07.274690 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:07.274690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5016c06e-4d03-4819-8192-8434c78ce02b tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] Returning 404 to user: Instance d06982e5-f9a9-45f6-86d6-1eecdc7ce255 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:03:07.274690 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5016c06e-4d03-4819-8192-8434c78ce02b tempest-ServerPasswordTestJSON-60845029 tempest-ServerPasswordTestJSON-60845029-project] 10.222.0.49 "GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255" status: 404 len: 111 microversion: 2.1 time: 0.089723 Jul 25 13:03:07.274690 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2169/4424] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:07 2022] GET /compute/v2.1/servers/d06982e5-f9a9-45f6-86d6-1eecdc7ce255 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:03:07.330374 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-d690a6c4-6243-47b0-8b68-d9b4d7fa6ffa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] validate_networks() for [('974e2b05-9cf4-4edf-a41e-e53067f36c57', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:03:07.534868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4720a07e-12b0-493c-bbe6-9dc32a7fd0ff tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:07.535855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4720a07e-12b0-493c-bbe6-9dc32a7fd0ff tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:07.546543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4720a07e-12b0-493c-bbe6-9dc32a7fd0ff tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:07.548375 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4720a07e-12b0-493c-bbe6-9dc32a7fd0ff tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:07.555621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4720a07e-12b0-493c-bbe6-9dc32a7fd0ff tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:07.556450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4720a07e-12b0-493c-bbe6-9dc32a7fd0ff tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:08.177055 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4720a07e-12b0-493c-bbe6-9dc32a7fd0ff tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:08.186465 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4720a07e-12b0-493c-bbe6-9dc32a7fd0ff tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1391 microversion: 2.1 time: 0.659199 Jul 25 13:03:08.215077 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2170/4425] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:07 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1391 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:08.225858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0acc3a73-d6f3-49b9-af5b-072c9e753dab tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:08.227729 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0acc3a73-d6f3-49b9-af5b-072c9e753dab tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: a1136ad1-8b0f-4717-8255-e615d7753832] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:08.236856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0acc3a73-d6f3-49b9-af5b-072c9e753dab tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:08.237608 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0acc3a73-d6f3-49b9-af5b-072c9e753dab tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:08.238660 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0acc3a73-d6f3-49b9-af5b-072c9e753dab tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:08.239281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0acc3a73-d6f3-49b9-af5b-072c9e753dab tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:08.748592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0acc3a73-d6f3-49b9-af5b-072c9e753dab tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:08.777509 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0acc3a73-d6f3-49b9-af5b-072c9e753dab tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832" status: 200 len: 1515 microversion: 2.1 time: 0.560844 Jul 25 13:03:08.805936 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2171/4426] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:08 2022] GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832 => generated 1515 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:08.829975 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9aaaf420-4c1f-4cb7-a5ef-3176eb7752d1 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:08.833786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9aaaf420-4c1f-4cb7-a5ef-3176eb7752d1 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: befe3c76-6841-45ba-95b9-7d11592e404a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:08.869413 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9aaaf420-4c1f-4cb7-a5ef-3176eb7752d1 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:08.870186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9aaaf420-4c1f-4cb7-a5ef-3176eb7752d1 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:08.871867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9aaaf420-4c1f-4cb7-a5ef-3176eb7752d1 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:08.875131 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9aaaf420-4c1f-4cb7-a5ef-3176eb7752d1 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:09.229563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d690a6c4-6243-47b0-8b68-d9b4d7fa6ffa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:03:09.234895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d690a6c4-6243-47b0-8b68-d9b4d7fa6ffa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:03:09.235762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d690a6c4-6243-47b0-8b68-d9b4d7fa6ffa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:03:09.236472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d690a6c4-6243-47b0-8b68-d9b4d7fa6ffa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:03:09.238063 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d690a6c4-6243-47b0-8b68-d9b4d7fa6ffa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:03:09.262691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d690a6c4-6243-47b0-8b68-d9b4d7fa6ffa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:09.263428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d690a6c4-6243-47b0-8b68-d9b4d7fa6ffa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:09.264678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d690a6c4-6243-47b0-8b68-d9b4d7fa6ffa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:09.265307 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d690a6c4-6243-47b0-8b68-d9b4d7fa6ffa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:09.286872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:09.347007 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-d690a6c4-6243-47b0-8b68-d9b4d7fa6ffa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Getting quotas for project 4bb3fd31125b4879bd1f58cd3d1358a3. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:03:09.364408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-d690a6c4-6243-47b0-8b68-d9b4d7fa6ffa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Getting quotas for user 3dc3da4ae9f444e7a4471e509868d088 and project 4bb3fd31125b4879bd1f58cd3d1358a3. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:03:09.434590 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d690a6c4-6243-47b0-8b68-d9b4d7fa6ffa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:03:09.438711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d690a6c4-6243-47b0-8b68-d9b4d7fa6ffa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:03:09.553106 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d690a6c4-6243-47b0-8b68-d9b4d7fa6ffa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.758697 Jul 25 13:03:09.562441 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2256/4427] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:03:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 2764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:03:09.595469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-a3df704b-3a23-4d6f-bd8f-50094e45c44e req-a2f68168-dab2-4038-9142-07d4449f550e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "486f49b3-3f54-478c-9c21-c33a16ae4fde", "tag": "fefdb487-385f-4f8b-b1dd-99ad9fb2469d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:03:09.634547 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a3df704b-3a23-4d6f-bd8f-50094e45c44e req-a2f68168-dab2-4038-9142-07d4449f550e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:09.637673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a3df704b-3a23-4d6f-bd8f-50094e45c44e req-a2f68168-dab2-4038-9142-07d4449f550e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:09.642769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9aaaf420-4c1f-4cb7-a5ef-3176eb7752d1 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:09.651690 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9aaaf420-4c1f-4cb7-a5ef-3176eb7752d1 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/befe3c76-6841-45ba-95b9-7d11592e404a" status: 200 len: 1514 microversion: 2.1 time: 0.844052 Jul 25 13:03:09.656361 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2172/4428] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:08 2022] GET /compute/v2.1/servers/befe3c76-6841-45ba-95b9-7d11592e404a => generated 1514 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:09.665916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-81802b6d-4eaa-4053-9286-bba9ec8a0272 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:09.666916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-81802b6d-4eaa-4053-9286-bba9ec8a0272 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:09.676473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:09.681222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-81802b6d-4eaa-4053-9286-bba9ec8a0272 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:09.682369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-81802b6d-4eaa-4053-9286-bba9ec8a0272 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:09.683241 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-a3df704b-3a23-4d6f-bd8f-50094e45c44e req-a2f68168-dab2-4038-9142-07d4449f550e service nova] Creating event network-changed:fefdb487-385f-4f8b-b1dd-99ad9fb2469d for instance 486f49b3-3f54-478c-9c21-c33a16ae4fde on n-h1-848886-15 Jul 25 13:03:09.684461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-81802b6d-4eaa-4053-9286-bba9ec8a0272 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:09.687604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-81802b6d-4eaa-4053-9286-bba9ec8a0272 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:09.689848 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-a3df704b-3a23-4d6f-bd8f-50094e45c44e req-a2f68168-dab2-4038-9142-07d4449f550e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130251 Jul 25 13:03:09.691356 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2257/4429] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:03:09.698740 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a83d7b4b-2e10-43aa-89d1-b5f132305e26 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:09.701300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a83d7b4b-2e10-43aa-89d1-b5f132305e26 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:09.939986 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a83d7b4b-2e10-43aa-89d1-b5f132305e26 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:09.962497 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a83d7b4b-2e10-43aa-89d1-b5f132305e26 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1237 microversion: 2.1 time: 0.261173 Jul 25 13:03:09.973300 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2258/4430] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:09 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1237 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:09.986668 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fc1f452c-0be5-4ccd-b71c-59cd708f36cd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:09.990671 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fc1f452c-0be5-4ccd-b71c-59cd708f36cd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: 4d9bf270-1783-415a-a809-4098ffbe35f1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:10.010654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc1f452c-0be5-4ccd-b71c-59cd708f36cd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:10.012955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc1f452c-0be5-4ccd-b71c-59cd708f36cd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:10.014258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc1f452c-0be5-4ccd-b71c-59cd708f36cd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:10.017715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc1f452c-0be5-4ccd-b71c-59cd708f36cd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:10.460061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=8 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:10.719028 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-81802b6d-4eaa-4053-9286-bba9ec8a0272 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:10.735271 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-81802b6d-4eaa-4053-9286-bba9ec8a0272 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1391 microversion: 2.1 time: 1.071740 Jul 25 13:03:10.736422 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2173/4431] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:09 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1391 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:10.856544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fc1f452c-0be5-4ccd-b71c-59cd708f36cd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:10.880651 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fc1f452c-0be5-4ccd-b71c-59cd708f36cd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/4d9bf270-1783-415a-a809-4098ffbe35f1" status: 200 len: 1514 microversion: 2.1 time: 0.912478 Jul 25 13:03:10.893819 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2259/4432] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:09 2022] GET /compute/v2.1/servers/4d9bf270-1783-415a-a809-4098ffbe35f1 => generated 1514 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:10.909853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4cfafd5b-7177-40ab-8b6c-a77eccbb9cb4 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:10.921106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4cfafd5b-7177-40ab-8b6c-a77eccbb9cb4 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: 4d9bf270-1783-415a-a809-4098ffbe35f1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:10.937109 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4cfafd5b-7177-40ab-8b6c-a77eccbb9cb4 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:10.938967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4cfafd5b-7177-40ab-8b6c-a77eccbb9cb4 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:10.939860 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4cfafd5b-7177-40ab-8b6c-a77eccbb9cb4 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:10.940303 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4cfafd5b-7177-40ab-8b6c-a77eccbb9cb4 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:10.958510 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:10.997077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-80dbcfef-3ac4-413d-8e02-49936c517ba6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:10.998121 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-80dbcfef-3ac4-413d-8e02-49936c517ba6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:11.011714 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-80dbcfef-3ac4-413d-8e02-49936c517ba6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:11.012814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-80dbcfef-3ac4-413d-8e02-49936c517ba6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:11.013935 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-80dbcfef-3ac4-413d-8e02-49936c517ba6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:11.014605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-80dbcfef-3ac4-413d-8e02-49936c517ba6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:11.045493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4cfafd5b-7177-40ab-8b6c-a77eccbb9cb4 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: 4d9bf270-1783-415a-a809-4098ffbe35f1] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:03:11.249645 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4cfafd5b-7177-40ab-8b6c-a77eccbb9cb4 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4d9bf270-1783-415a-a809-4098ffbe35f1" status: 204 len: 0 microversion: 2.1 time: 0.345229 Jul 25 13:03:11.251170 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2174/4433] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:03:10 2022] DELETE /compute/v2.1/servers/4d9bf270-1783-415a-a809-4098ffbe35f1 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:03:11.267620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-75e700ae-ff61-4b6a-87cf-43abceeae05f tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:11.274007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-75e700ae-ff61-4b6a-87cf-43abceeae05f tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: 4d9bf270-1783-415a-a809-4098ffbe35f1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:11.283712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-75e700ae-ff61-4b6a-87cf-43abceeae05f tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:11.284343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-75e700ae-ff61-4b6a-87cf-43abceeae05f tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:11.285306 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-75e700ae-ff61-4b6a-87cf-43abceeae05f tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:11.285892 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-75e700ae-ff61-4b6a-87cf-43abceeae05f tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:11.734180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-80dbcfef-3ac4-413d-8e02-49936c517ba6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:11.753243 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-80dbcfef-3ac4-413d-8e02-49936c517ba6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1233 microversion: 2.1 time: 0.766684 Jul 25 13:03:11.761423 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2260/4434] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:10 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1233 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:11.766848 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9327d49c-ba70-4a9e-b37b-51e9c7704d44 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:11.767784 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9327d49c-ba70-4a9e-b37b-51e9c7704d44 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:11.784074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9327d49c-ba70-4a9e-b37b-51e9c7704d44 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:11.784885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9327d49c-ba70-4a9e-b37b-51e9c7704d44 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:11.785968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9327d49c-ba70-4a9e-b37b-51e9c7704d44 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:11.786641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9327d49c-ba70-4a9e-b37b-51e9c7704d44 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:12.507637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-75e700ae-ff61-4b6a-87cf-43abceeae05f tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:12.523075 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-75e700ae-ff61-4b6a-87cf-43abceeae05f tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/4d9bf270-1783-415a-a809-4098ffbe35f1" status: 200 len: 1520 microversion: 2.1 time: 1.265191 Jul 25 13:03:12.525393 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2175/4435] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:11 2022] GET /compute/v2.1/servers/4d9bf270-1783-415a-a809-4098ffbe35f1 => generated 1520 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:12.625682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9327d49c-ba70-4a9e-b37b-51e9c7704d44 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:12.649137 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9327d49c-ba70-4a9e-b37b-51e9c7704d44 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1391 microversion: 2.1 time: 0.880124 Jul 25 13:03:12.650634 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2261/4436] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:11 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1391 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:12.774827 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6eaa8f58-7ea8-4e4e-aa6e-034dd3ef4cbb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:12.775841 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6eaa8f58-7ea8-4e4e-aa6e-034dd3ef4cbb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:12.783392 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6eaa8f58-7ea8-4e4e-aa6e-034dd3ef4cbb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:12.784229 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6eaa8f58-7ea8-4e4e-aa6e-034dd3ef4cbb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:12.785290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6eaa8f58-7ea8-4e4e-aa6e-034dd3ef4cbb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:12.785914 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6eaa8f58-7ea8-4e4e-aa6e-034dd3ef4cbb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:13.245196 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6eaa8f58-7ea8-4e4e-aa6e-034dd3ef4cbb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:13.256179 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6eaa8f58-7ea8-4e4e-aa6e-034dd3ef4cbb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1295 microversion: 2.1 time: 0.485262 Jul 25 13:03:13.257198 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2176/4437] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:12 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1295 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:13.546253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-263fc3fc-02bc-4e91-a3c2-f5658aa3d549 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:13.550735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-263fc3fc-02bc-4e91-a3c2-f5658aa3d549 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: 4d9bf270-1783-415a-a809-4098ffbe35f1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:13.563546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-263fc3fc-02bc-4e91-a3c2-f5658aa3d549 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:13.568388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-263fc3fc-02bc-4e91-a3c2-f5658aa3d549 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:13.569522 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-263fc3fc-02bc-4e91-a3c2-f5658aa3d549 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:13.570220 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-263fc3fc-02bc-4e91-a3c2-f5658aa3d549 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:13.671002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-27d754d7-3055-4e1b-b9c8-9c94e4ad6845 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:13.672169 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-27d754d7-3055-4e1b-b9c8-9c94e4ad6845 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:13.674869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:13.685614 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27d754d7-3055-4e1b-b9c8-9c94e4ad6845 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:13.688317 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27d754d7-3055-4e1b-b9c8-9c94e4ad6845 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:13.691391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27d754d7-3055-4e1b-b9c8-9c94e4ad6845 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:13.692032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27d754d7-3055-4e1b-b9c8-9c94e4ad6845 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:14.217634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-263fc3fc-02bc-4e91-a3c2-f5658aa3d549 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:14.237254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-27d754d7-3055-4e1b-b9c8-9c94e4ad6845 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:14.254350 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-263fc3fc-02bc-4e91-a3c2-f5658aa3d549 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/4d9bf270-1783-415a-a809-4098ffbe35f1" status: 200 len: 1520 microversion: 2.1 time: 0.713375 Jul 25 13:03:14.255632 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-27d754d7-3055-4e1b-b9c8-9c94e4ad6845 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1391 microversion: 2.1 time: 0.588978 Jul 25 13:03:14.256584 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2262/4438] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:13 2022] GET /compute/v2.1/servers/4d9bf270-1783-415a-a809-4098ffbe35f1 => generated 1520 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:14.257577 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2177/4439] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:13 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1391 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:03:14.278109 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d3d4a2a3-ff8e-46f2-a4bd-02fbd26dbbde tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:14.278996 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d3d4a2a3-ff8e-46f2-a4bd-02fbd26dbbde tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:14.285492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3d4a2a3-ff8e-46f2-a4bd-02fbd26dbbde tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:14.286281 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3d4a2a3-ff8e-46f2-a4bd-02fbd26dbbde tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:14.287212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3d4a2a3-ff8e-46f2-a4bd-02fbd26dbbde tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:14.287817 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3d4a2a3-ff8e-46f2-a4bd-02fbd26dbbde tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:14.394271 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d3d4a2a3-ff8e-46f2-a4bd-02fbd26dbbde tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:14.405513 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d3d4a2a3-ff8e-46f2-a4bd-02fbd26dbbde tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1295 microversion: 2.1 time: 0.131259 Jul 25 13:03:14.407902 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2263/4440] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:14 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1295 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:15.281088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-09165042-79cd-43b3-8763-961aa3ec477b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:15.283027 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-09165042-79cd-43b3-8763-961aa3ec477b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: 4d9bf270-1783-415a-a809-4098ffbe35f1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:15.285108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-59defae3-211c-4548-b9a5-811e7129c1a8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:15.285747 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-59defae3-211c-4548-b9a5-811e7129c1a8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:15.292189 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09165042-79cd-43b3-8763-961aa3ec477b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:15.294585 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09165042-79cd-43b3-8763-961aa3ec477b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:15.295762 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09165042-79cd-43b3-8763-961aa3ec477b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:15.296426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09165042-79cd-43b3-8763-961aa3ec477b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:15.307686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59defae3-211c-4548-b9a5-811e7129c1a8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:15.308540 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59defae3-211c-4548-b9a5-811e7129c1a8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:15.312881 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59defae3-211c-4548-b9a5-811e7129c1a8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:15.314753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59defae3-211c-4548-b9a5-811e7129c1a8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:15.516602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-09165042-79cd-43b3-8763-961aa3ec477b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:15.529780 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-09165042-79cd-43b3-8763-961aa3ec477b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/4d9bf270-1783-415a-a809-4098ffbe35f1" status: 200 len: 1478 microversion: 2.1 time: 0.253017 Jul 25 13:03:15.533043 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2178/4441] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:15 2022] GET /compute/v2.1/servers/4d9bf270-1783-415a-a809-4098ffbe35f1 => generated 1478 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:15.560179 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5d8577d9-d9ce-4eb1-a1d4-00b838f48947 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:15.560739 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5d8577d9-d9ce-4eb1-a1d4-00b838f48947 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:15.581624 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d8577d9-d9ce-4eb1-a1d4-00b838f48947 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:15.582446 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d8577d9-d9ce-4eb1-a1d4-00b838f48947 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:15.582992 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d8577d9-d9ce-4eb1-a1d4-00b838f48947 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:15.583447 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d8577d9-d9ce-4eb1-a1d4-00b838f48947 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:16.192092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-59defae3-211c-4548-b9a5-811e7129c1a8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:16.208608 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-59defae3-211c-4548-b9a5-811e7129c1a8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1391 microversion: 2.1 time: 0.930764 Jul 25 13:03:16.210033 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2264/4442] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:15 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1391 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:16.218406 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-0cc358f1-d51d-4cce-865c-15495a5f7043 req-a6eb47ce-87d3-4786-8e6a-5fcac4d7b3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "486f49b3-3f54-478c-9c21-c33a16ae4fde", "name": "network-vif-plugged", "status": "completed", "tag": "fefdb487-385f-4f8b-b1dd-99ad9fb2469d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:03:16.244260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-0cc358f1-d51d-4cce-865c-15495a5f7043 req-a6eb47ce-87d3-4786-8e6a-5fcac4d7b3a3 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:16.247654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-0cc358f1-d51d-4cce-865c-15495a5f7043 req-a6eb47ce-87d3-4786-8e6a-5fcac4d7b3a3 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:16.264242 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-0cc358f1-d51d-4cce-865c-15495a5f7043 req-a6eb47ce-87d3-4786-8e6a-5fcac4d7b3a3 service nova] Creating event network-vif-plugged:fefdb487-385f-4f8b-b1dd-99ad9fb2469d for instance 486f49b3-3f54-478c-9c21-c33a16ae4fde on n-h1-848886-15 Jul 25 13:03:16.272728 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5d8577d9-d9ce-4eb1-a1d4-00b838f48947 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:16.284959 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5d8577d9-d9ce-4eb1-a1d4-00b838f48947 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1362 microversion: 2.1 time: 0.737391 Jul 25 13:03:16.298378 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2179/4443] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:15 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1362 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:16.311044 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-465e99c8-bfa8-40a0-8a70-40f2396365ec req-799b1cd9-bd46-49dd-bb23-8e8bfbd0f5ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d9bf270-1783-415a-a809-4098ffbe35f1", "name": "network-vif-deleted", "tag": "6a73117f-96f4-498c-a3b6-ce82b669708a"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:03:16.325545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-465e99c8-bfa8-40a0-8a70-40f2396365ec req-799b1cd9-bd46-49dd-bb23-8e8bfbd0f5ba service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:16.326410 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-465e99c8-bfa8-40a0-8a70-40f2396365ec req-799b1cd9-bd46-49dd-bb23-8e8bfbd0f5ba service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:16.329120 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-0cc358f1-d51d-4cce-865c-15495a5f7043 req-a6eb47ce-87d3-4786-8e6a-5fcac4d7b3a3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117586 Jul 25 13:03:16.332298 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2265/4444] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:03:16.343065 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-465e99c8-bfa8-40a0-8a70-40f2396365ec req-799b1cd9-bd46-49dd-bb23-8e8bfbd0f5ba service nova] Creating event network-vif-deleted:6a73117f-96f4-498c-a3b6-ce82b669708a for instance 4d9bf270-1783-415a-a809-4098ffbe35f1 on n-h2-848886-15 Jul 25 13:03:16.364932 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-465e99c8-bfa8-40a0-8a70-40f2396365ec req-799b1cd9-bd46-49dd-bb23-8e8bfbd0f5ba service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064744 Jul 25 13:03:16.370377 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2180/4445] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:03:16.555196 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9f190d27-de68-4a8c-bf6e-eb2c83e9c746 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:16.556197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9f190d27-de68-4a8c-bf6e-eb2c83e9c746 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: 4d9bf270-1783-415a-a809-4098ffbe35f1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:16.575020 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f190d27-de68-4a8c-bf6e-eb2c83e9c746 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:16.575780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f190d27-de68-4a8c-bf6e-eb2c83e9c746 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:16.576816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f190d27-de68-4a8c-bf6e-eb2c83e9c746 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:16.577433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f190d27-de68-4a8c-bf6e-eb2c83e9c746 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:16.598553 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-9f190d27-de68-4a8c-bf6e-eb2c83e9c746 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] HTTP exception thrown: Instance 4d9bf270-1783-415a-a809-4098ffbe35f1 could not be found. Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9f190d27-de68-4a8c-bf6e-eb2c83e9c746 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Request method failure captured: Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/4d9bf270-1783-415a-a809-4098ffbe35f1 HTTP/1.1 Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pRfILdWlqqTlzEx1Z-J6f_3Aatp6Kv-MjPkIgUvuGaHJV6gZ4r3iQ7qh9e_4QXegs5GtnTB06DT36FwGnC6A0QcYrDiiAi0wQR0Qjcy4fDLf56C4tLviUeVBhsgKKfrFk-XWoFFsdeE-8veIAPPeihm1oZCC7qyfoK5ZY4xa-Wbp8s Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d0f5fe62e90146bcb87e76abaa6fe184 Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d0f5fe62e90146bcb87e76abaa6fe184", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d0f5fe62e90146bcb87e76abaa6fe184"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d0f5fe62e90146bcb87e76abaa6fe184"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d0f5fe62e90146bcb87e76abaa6fe184"}]}] Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d0f5fe62e90146bcb87e76abaa6fe184 Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ListServersNegativeTestJSON-2010429994-project Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: b27acc4218084f638755250bfd349e86 Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ListServersNegativeTestJSON-2010429994-project Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 4d9bf270-1783-415a-a809-4098ffbe35f1 could not be found. Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '4d9bf270-1783-415a-a809-4098ffbe35f1'} Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d9bf270-1783-415a-a809-4098ffbe35f1 could not be found. Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d9bf270-1783-415a-a809-4098ffbe35f1 could not be found. Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:16.601319 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:16.607612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:16.607612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:16.607612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:16.607612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:03:16.607612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:03:16.607612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d9bf270-1783-415a-a809-4098ffbe35f1 could not be found. Jul 25 13:03:16.607612 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:16.612166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9f190d27-de68-4a8c-bf6e-eb2c83e9c746 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Returning 404 to user: Instance 4d9bf270-1783-415a-a809-4098ffbe35f1 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:03:16.619164 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9f190d27-de68-4a8c-bf6e-eb2c83e9c746 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/4d9bf270-1783-415a-a809-4098ffbe35f1" status: 404 len: 111 microversion: 2.1 time: 0.069171 Jul 25 13:03:16.623878 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2266/4446] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:16 2022] GET /compute/v2.1/servers/4d9bf270-1783-415a-a809-4098ffbe35f1 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:03:16.630320 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bc60a249-b684-44c3-b7fc-5553655f8769 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:16.635634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bc60a249-b684-44c3-b7fc-5553655f8769 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:16.636579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bc60a249-b684-44c3-b7fc-5553655f8769 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:03:16.663400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc60a249-b684-44c3-b7fc-5553655f8769 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:16.664196 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc60a249-b684-44c3-b7fc-5553655f8769 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:16.665708 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc60a249-b684-44c3-b7fc-5553655f8769 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:16.666381 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc60a249-b684-44c3-b7fc-5553655f8769 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:16.792806 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bc60a249-b684-44c3-b7fc-5553655f8769 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.166758 Jul 25 13:03:16.793431 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2181/4447] 10.222.0.49 () {58 vars in 1230 bytes} [Mon Jul 25 13:03:16 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 13:03:16.807108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bf6b37d2-a2e6-4cb4-b619-fb33c5003dae tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bf6b37d2-a2e6-4cb4-b619-fb33c5003dae tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Request method failure captured: Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pRfILdWlqqTlzEx1Z-J6f_3Aatp6Kv-MjPkIgUvuGaHJV6gZ4r3iQ7qh9e_4QXegs5GtnTB06DT36FwGnC6A0QcYrDiiAi0wQR0Qjcy4fDLf56C4tLviUeVBhsgKKfrFk-XWoFFsdeE-8veIAPPeihm1oZCC7qyfoK5ZY4xa-Wbp8s Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d0f5fe62e90146bcb87e76abaa6fe184 Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d0f5fe62e90146bcb87e76abaa6fe184", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d0f5fe62e90146bcb87e76abaa6fe184"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d0f5fe62e90146bcb87e76abaa6fe184"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d0f5fe62e90146bcb87e76abaa6fe184"}]}] Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d0f5fe62e90146bcb87e76abaa6fe184 Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ListServersNegativeTestJSON-2010429994-project Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: b27acc4218084f638755250bfd349e86 Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ListServersNegativeTestJSON-2010429994-project Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: action_args: {} Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise error Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 25 13:03:16.811872 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 13:03:16.816838 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 13:03:16.816838 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 13:03:16.816838 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 13:03:16.816838 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 25 13:03:16.816838 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:16.816838 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:16.816838 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:16.816838 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:16.816838 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:16.816838 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:16.816838 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 13:03:16.816838 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 13:03:16.816838 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 25 13:03:16.816838 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:16.819597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bf6b37d2-a2e6-4cb4-b619-fb33c5003dae tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:03:16.820706 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bf6b37d2-a2e6-4cb4-b619-fb33c5003dae tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.018000 Jul 25 13:03:16.822129 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2267/4448] 10.222.0.49 () {58 vars in 1182 bytes} [Mon Jul 25 13:03:16 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:03:16.832005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-80d50d40-d8a7-45d0-9441-38b16a992da5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:16.836689 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-80d50d40-d8a7-45d0-9441-38b16a992da5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:16.837611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-80d50d40-d8a7-45d0-9441-38b16a992da5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Searching by: {'deleted': False, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:03:16.844043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80d50d40-d8a7-45d0-9441-38b16a992da5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:16.844745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80d50d40-d8a7-45d0-9441-38b16a992da5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:16.846014 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80d50d40-d8a7-45d0-9441-38b16a992da5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:16.846650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80d50d40-d8a7-45d0-9441-38b16a992da5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:16.888439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-80d50d40-d8a7-45d0-9441-38b16a992da5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:03:16.934747 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-80d50d40-d8a7-45d0-9441-38b16a992da5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.107218 Jul 25 13:03:16.945312 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2182/4449] 10.222.0.49 () {58 vars in 1125 bytes} [Mon Jul 25 13:03:16 2022] GET /compute/v2.1/servers => generated 681 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:03:16.950094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-425f6b79-28ee-4aec-beed-49b07daad51d tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:16.957319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-425f6b79-28ee-4aec-beed-49b07daad51d tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:16.958114 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.compute.servers [None req-425f6b79-28ee-4aec-beed-49b07daad51d tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Removing options 'limit' from query {{(pid=125884) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 25 13:03:16.959075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-425f6b79-28ee-4aec-beed-49b07daad51d tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Searching by: {'deleted': False, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184'} {{(pid=125884) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:03:16.965794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-425f6b79-28ee-4aec-beed-49b07daad51d tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:16.966676 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-425f6b79-28ee-4aec-beed-49b07daad51d tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:16.967744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-425f6b79-28ee-4aec-beed-49b07daad51d tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:16.968431 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-425f6b79-28ee-4aec-beed-49b07daad51d tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:17.010205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.multi_cell_list [None req-425f6b79-28ee-4aec-beed-49b07daad51d tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=125884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:03:17.051802 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-425f6b79-28ee-4aec-beed-49b07daad51d tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.107875 Jul 25 13:03:17.069648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7571925d-3d46-46d1-b882-ddf86c918c7a tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7571925d-3d46-46d1-b882-ddf86c918c7a tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Request method failure captured: Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pRfILdWlqqTlzEx1Z-J6f_3Aatp6Kv-MjPkIgUvuGaHJV6gZ4r3iQ7qh9e_4QXegs5GtnTB06DT36FwGnC6A0QcYrDiiAi0wQR0Qjcy4fDLf56C4tLviUeVBhsgKKfrFk-XWoFFsdeE-8veIAPPeihm1oZCC7qyfoK5ZY4xa-Wbp8s Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d0f5fe62e90146bcb87e76abaa6fe184 Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d0f5fe62e90146bcb87e76abaa6fe184", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d0f5fe62e90146bcb87e76abaa6fe184"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d0f5fe62e90146bcb87e76abaa6fe184"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d0f5fe62e90146bcb87e76abaa6fe184"}]}] Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d0f5fe62e90146bcb87e76abaa6fe184 Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ListServersNegativeTestJSON-2010429994-project Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: b27acc4218084f638755250bfd349e86 Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ListServersNegativeTestJSON-2010429994-project Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: action_args: {} Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi '-1' Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 25 13:03:17.074460 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 25 13:03:17.080945 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 13:03:17.080945 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 13:03:17.080945 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 13:03:17.080945 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 13:03:17.080945 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 25 13:03:17.080945 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:17.080945 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:17.080945 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:17.080945 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:17.080945 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:17.080945 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:17.080945 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 13:03:17.080945 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 13:03:17.080945 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 25 13:03:17.080945 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:17.080945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7571925d-3d46-46d1-b882-ddf86c918c7a tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:03:17.080945 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7571925d-3d46-46d1-b882-ddf86c918c7a tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.010720 Jul 25 13:03:17.080945 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2183/4450] 10.222.0.49 () {58 vars in 1142 bytes} [Mon Jul 25 13:03:17 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:03:17.084495 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2268/4451] 10.222.0.49 () {58 vars in 1144 bytes} [Mon Jul 25 13:03:16 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:03:17.095280 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1af36c88-9ab1-4961-80a9-de52243681e6 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1af36c88-9ab1-4961-80a9-de52243681e6 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Request method failure captured: Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pRfILdWlqqTlzEx1Z-J6f_3Aatp6Kv-MjPkIgUvuGaHJV6gZ4r3iQ7qh9e_4QXegs5GtnTB06DT36FwGnC6A0QcYrDiiAi0wQR0Qjcy4fDLf56C4tLviUeVBhsgKKfrFk-XWoFFsdeE-8veIAPPeihm1oZCC7qyfoK5ZY4xa-Wbp8s Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d0f5fe62e90146bcb87e76abaa6fe184 Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d0f5fe62e90146bcb87e76abaa6fe184", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d0f5fe62e90146bcb87e76abaa6fe184"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d0f5fe62e90146bcb87e76abaa6fe184"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d0f5fe62e90146bcb87e76abaa6fe184"}]}] Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d0f5fe62e90146bcb87e76abaa6fe184 Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ListServersNegativeTestJSON-2010429994-project Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: b27acc4218084f638755250bfd349e86 Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ListServersNegativeTestJSON-2010429994-project Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: action_args: {} Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'testing' Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 25 13:03:17.098750 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 25 13:03:17.104153 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 13:03:17.104153 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 13:03:17.104153 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 13:03:17.104153 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 13:03:17.104153 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 25 13:03:17.104153 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:17.104153 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:17.104153 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:17.104153 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:17.104153 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:17.104153 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:17.104153 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 13:03:17.104153 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 13:03:17.104153 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 25 13:03:17.104153 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:17.104153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1af36c88-9ab1-4961-80a9-de52243681e6 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:03:17.104153 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1af36c88-9ab1-4961-80a9-de52243681e6 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.009146 Jul 25 13:03:17.104153 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2184/4452] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 13:03:17 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:03:17.114403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-93f9a615-5f6f-4299-9a23-58721dcb4386 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:17.134940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-93f9a615-5f6f-4299-9a23-58721dcb4386 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:17.135953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-93f9a615-5f6f-4299-9a23-58721dcb4386 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184'} {{(pid=125884) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:03:17.156678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.compute.servers [None req-93f9a615-5f6f-4299-9a23-58721dcb4386 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Flavor 'non_existing_flavor' could not be found {{(pid=125884) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 25 13:03:17.158401 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-93f9a615-5f6f-4299-9a23-58721dcb4386 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.050815 Jul 25 13:03:17.159939 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2269/4453] 10.222.0.49 () {58 vars in 1178 bytes} [Mon Jul 25 13:03:17 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 13:03:17.173426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-44c84eb0-f7a3-4b18-af4e-bf2fdefa2fd5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:17.178114 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-44c84eb0-f7a3-4b18-af4e-bf2fdefa2fd5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:17.178783 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-44c84eb0-f7a3-4b18-af4e-bf2fdefa2fd5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:03:17.191632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-44c84eb0-f7a3-4b18-af4e-bf2fdefa2fd5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:17.191632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-44c84eb0-f7a3-4b18-af4e-bf2fdefa2fd5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:17.192552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-44c84eb0-f7a3-4b18-af4e-bf2fdefa2fd5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:17.193005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-44c84eb0-f7a3-4b18-af4e-bf2fdefa2fd5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:17.232992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8c752538-22b5-466b-bde6-98190d920db3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:17.233958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8c752538-22b5-466b-bde6-98190d920db3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:17.245692 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c752538-22b5-466b-bde6-98190d920db3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:17.246843 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c752538-22b5-466b-bde6-98190d920db3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:17.247920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c752538-22b5-466b-bde6-98190d920db3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:17.249521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c752538-22b5-466b-bde6-98190d920db3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:17.344465 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-44c84eb0-f7a3-4b18-af4e-bf2fdefa2fd5 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.175866 Jul 25 13:03:17.346407 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2185/4454] 10.222.0.49 () {58 vars in 1174 bytes} [Mon Jul 25 13:03:17 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 13:03:17.360962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6eae83aa-4df9-4c4f-837a-1836bc7c85e8 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:17.361982 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6eae83aa-4df9-4c4f-837a-1836bc7c85e8 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:17.369598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6eae83aa-4df9-4c4f-837a-1836bc7c85e8 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:17.370278 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6eae83aa-4df9-4c4f-837a-1836bc7c85e8 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:17.371644 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6eae83aa-4df9-4c4f-837a-1836bc7c85e8 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:17.372453 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6eae83aa-4df9-4c4f-837a-1836bc7c85e8 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:17.751643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8c752538-22b5-466b-bde6-98190d920db3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:17.764244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6eae83aa-4df9-4c4f-837a-1836bc7c85e8 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:17.805239 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8c752538-22b5-466b-bde6-98190d920db3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1391 microversion: 2.1 time: 0.575190 Jul 25 13:03:17.809036 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6eae83aa-4df9-4c4f-837a-1836bc7c85e8 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1362 microversion: 2.1 time: 0.458673 Jul 25 13:03:17.810066 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2270/4455] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:17 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1391 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:03:17.812637 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2186/4456] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:17 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1362 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:17.834325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ecb87423-7e96-4f6b-952a-1434e1e9de6b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:17.848416 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ecb87423-7e96-4f6b-952a-1434e1e9de6b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:17.853134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ecb87423-7e96-4f6b-952a-1434e1e9de6b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184'} {{(pid=125884) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:03:17.875506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ecb87423-7e96-4f6b-952a-1434e1e9de6b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:17.876151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ecb87423-7e96-4f6b-952a-1434e1e9de6b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:17.878031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ecb87423-7e96-4f6b-952a-1434e1e9de6b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:17.878988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ecb87423-7e96-4f6b-952a-1434e1e9de6b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:18.214283 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ecb87423-7e96-4f6b-952a-1434e1e9de6b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.401786 Jul 25 13:03:18.238107 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2271/4457] 10.222.0.49 () {58 vars in 1184 bytes} [Mon Jul 25 13:03:17 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 13:03:18.240988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-93828d7a-ea19-4371-9015-ac7b6afdfee1 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:18.247398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-93828d7a-ea19-4371-9015-ac7b6afdfee1 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:18.248715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-93828d7a-ea19-4371-9015-ac7b6afdfee1 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Searching by: {'deleted': False, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:03:18.256506 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-93828d7a-ea19-4371-9015-ac7b6afdfee1 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:18.257194 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-93828d7a-ea19-4371-9015-ac7b6afdfee1 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:18.258264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-93828d7a-ea19-4371-9015-ac7b6afdfee1 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:18.258924 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-93828d7a-ea19-4371-9015-ac7b6afdfee1 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:18.304816 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-93828d7a-ea19-4371-9015-ac7b6afdfee1 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:03:18.373424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-93828d7a-ea19-4371-9015-ac7b6afdfee1 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:18.381588 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-93828d7a-ea19-4371-9015-ac7b6afdfee1 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:18.382368 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-93828d7a-ea19-4371-9015-ac7b6afdfee1 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:18.816988 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-93828d7a-ea19-4371-9015-ac7b6afdfee1 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 3022 microversion: 2.1 time: 0.580602 Jul 25 13:03:18.832846 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2187/4458] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 13:03:18 2022] GET /compute/v2.1/servers/detail => generated 3022 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:18.846776 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-da68e181-e87a-414e-9855-fdaa2bc6b5cd tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:18.847348 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-38c0979c-e5d3-4456-a321-4460d38fcd85 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:18.848130 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-da68e181-e87a-414e-9855-fdaa2bc6b5cd tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:18.848348 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-38c0979c-e5d3-4456-a321-4460d38fcd85 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:18.861101 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-38c0979c-e5d3-4456-a321-4460d38fcd85 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:18.861565 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-38c0979c-e5d3-4456-a321-4460d38fcd85 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:18.863156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-38c0979c-e5d3-4456-a321-4460d38fcd85 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:18.863291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da68e181-e87a-414e-9855-fdaa2bc6b5cd tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:18.863628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da68e181-e87a-414e-9855-fdaa2bc6b5cd tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:18.864428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da68e181-e87a-414e-9855-fdaa2bc6b5cd tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:18.864874 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da68e181-e87a-414e-9855-fdaa2bc6b5cd tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:18.865298 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-38c0979c-e5d3-4456-a321-4460d38fcd85 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:19.455941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-da68e181-e87a-414e-9855-fdaa2bc6b5cd tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:19.470273 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-da68e181-e87a-414e-9855-fdaa2bc6b5cd tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1362 microversion: 2.1 time: 0.632791 Jul 25 13:03:19.479912 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2272/4459] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:18 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1362 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:19.489742 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7944c0ba-e2c9-4eaa-be28-57528efa421b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:19.502677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7944c0ba-e2c9-4eaa-be28-57528efa421b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:19.515372 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7944c0ba-e2c9-4eaa-be28-57528efa421b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.033138 Jul 25 13:03:19.516280 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2273/4460] 10.222.0.49 () {58 vars in 1178 bytes} [Mon Jul 25 13:03:19 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 13:03:19.524951 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-8faff29b-3720-4cf4-870d-390dfa2e0965 req-0bf03e3a-5aee-4cdc-b5f4-5edb62a75a3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1870a72-72de-47e8-8776-d342d9ece98e", "tag": "beeda1f8-ff74-41c7-a0bd-97d2a674f2af"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:03:19.545642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:19.561391 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-8faff29b-3720-4cf4-870d-390dfa2e0965 req-0bf03e3a-5aee-4cdc-b5f4-5edb62a75a3d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:19.562593 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-8faff29b-3720-4cf4-870d-390dfa2e0965 req-0bf03e3a-5aee-4cdc-b5f4-5edb62a75a3d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:19.599869 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-8faff29b-3720-4cf4-870d-390dfa2e0965 req-0bf03e3a-5aee-4cdc-b5f4-5edb62a75a3d service nova] Creating event network-changed:beeda1f8-ff74-41c7-a0bd-97d2a674f2af for instance f1870a72-72de-47e8-8776-d342d9ece98e on n-h1-848886-15 Jul 25 13:03:19.605650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-38c0979c-e5d3-4456-a321-4460d38fcd85 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:19.622718 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-38c0979c-e5d3-4456-a321-4460d38fcd85 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1564 microversion: 2.1 time: 0.779468 Jul 25 13:03:19.625157 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2188/4461] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:18 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1564 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:19.631798 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-8faff29b-3720-4cf4-870d-390dfa2e0965 req-0bf03e3a-5aee-4cdc-b5f4-5edb62a75a3d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111432 Jul 25 13:03:19.639316 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2274/4462] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:03:19.640338 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-218a9616-541c-4aa8-b98c-24bf2007817b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:19.647724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8e579754-4fe1-4897-a866-878570dd4dff tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:19.651834 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-218a9616-541c-4aa8-b98c-24bf2007817b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:19.655072 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8e579754-4fe1-4897-a866-878570dd4dff tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:19.659689 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-218a9616-541c-4aa8-b98c-24bf2007817b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Searching by: {'deleted': False, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:03:19.675239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e579754-4fe1-4897-a866-878570dd4dff tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:19.677584 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-218a9616-541c-4aa8-b98c-24bf2007817b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:19.682719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e579754-4fe1-4897-a866-878570dd4dff tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:19.683538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-218a9616-541c-4aa8-b98c-24bf2007817b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:19.684493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e579754-4fe1-4897-a866-878570dd4dff tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:19.686321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-218a9616-541c-4aa8-b98c-24bf2007817b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:19.687205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e579754-4fe1-4897-a866-878570dd4dff tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:19.687928 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-218a9616-541c-4aa8-b98c-24bf2007817b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:19.776156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-218a9616-541c-4aa8-b98c-24bf2007817b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:03:19.837189 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-218a9616-541c-4aa8-b98c-24bf2007817b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.210490 Jul 25 13:03:19.848917 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2189/4463] 10.222.0.49 () {58 vars in 1125 bytes} [Mon Jul 25 13:03:19 2022] GET /compute/v2.1/servers => generated 681 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:03:19.856301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-76fc536b-bcc7-4602-a6ff-7595fc1e2b4b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:19.857018 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-76fc536b-bcc7-4602-a6ff-7595fc1e2b4b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: 4d9bf270-1783-415a-a809-4098ffbe35f1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:19.866494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-76fc536b-bcc7-4602-a6ff-7595fc1e2b4b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:19.868801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-76fc536b-bcc7-4602-a6ff-7595fc1e2b4b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:19.869726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-76fc536b-bcc7-4602-a6ff-7595fc1e2b4b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:19.871422 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-76fc536b-bcc7-4602-a6ff-7595fc1e2b4b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:19.903695 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-76fc536b-bcc7-4602-a6ff-7595fc1e2b4b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] HTTP exception thrown: Instance 4d9bf270-1783-415a-a809-4098ffbe35f1 could not be found. Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-76fc536b-bcc7-4602-a6ff-7595fc1e2b4b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Request method failure captured: Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/4d9bf270-1783-415a-a809-4098ffbe35f1 HTTP/1.1 Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pRfILdWlqqTlzEx1Z-J6f_3Aatp6Kv-MjPkIgUvuGaHJV6gZ4r3iQ7qh9e_4QXegs5GtnTB06DT36FwGnC6A0QcYrDiiAi0wQR0Qjcy4fDLf56C4tLviUeVBhsgKKfrFk-XWoFFsdeE-8veIAPPeihm1oZCC7qyfoK5ZY4xa-Wbp8s Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d0f5fe62e90146bcb87e76abaa6fe184 Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d0f5fe62e90146bcb87e76abaa6fe184", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d0f5fe62e90146bcb87e76abaa6fe184"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d0f5fe62e90146bcb87e76abaa6fe184"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d0f5fe62e90146bcb87e76abaa6fe184"}]}] Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d0f5fe62e90146bcb87e76abaa6fe184 Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ListServersNegativeTestJSON-2010429994-project Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: b27acc4218084f638755250bfd349e86 Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ListServersNegativeTestJSON-2010429994-project Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 4d9bf270-1783-415a-a809-4098ffbe35f1 could not be found. Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '4d9bf270-1783-415a-a809-4098ffbe35f1'} Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d9bf270-1783-415a-a809-4098ffbe35f1 could not be found. Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:03:19.907584 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:03:19.912707 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d9bf270-1783-415a-a809-4098ffbe35f1 could not be found. Jul 25 13:03:19.912707 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:19.912707 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:19.912707 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:19.912707 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:19.912707 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:19.912707 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:19.912707 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:03:19.912707 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:03:19.912707 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d9bf270-1783-415a-a809-4098ffbe35f1 could not be found. Jul 25 13:03:19.912707 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:19.914393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-76fc536b-bcc7-4602-a6ff-7595fc1e2b4b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Returning 404 to user: Instance 4d9bf270-1783-415a-a809-4098ffbe35f1 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:03:19.919967 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-76fc536b-bcc7-4602-a6ff-7595fc1e2b4b tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4d9bf270-1783-415a-a809-4098ffbe35f1" status: 404 len: 111 microversion: 2.1 time: 0.069364 Jul 25 13:03:19.920760 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2190/4464] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:03:19 2022] DELETE /compute/v2.1/servers/4d9bf270-1783-415a-a809-4098ffbe35f1 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:03:19.934160 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a16e5cfc-bf70-44fa-84eb-35036e3b6d83 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:19.935072 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a16e5cfc-bf70-44fa-84eb-35036e3b6d83 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: befe3c76-6841-45ba-95b9-7d11592e404a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:19.946300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=12 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:19.950075 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a16e5cfc-bf70-44fa-84eb-35036e3b6d83 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:19.950589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a16e5cfc-bf70-44fa-84eb-35036e3b6d83 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:19.951470 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a16e5cfc-bf70-44fa-84eb-35036e3b6d83 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:19.952161 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a16e5cfc-bf70-44fa-84eb-35036e3b6d83 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:19.994881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a16e5cfc-bf70-44fa-84eb-35036e3b6d83 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: befe3c76-6841-45ba-95b9-7d11592e404a] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:03:20.066035 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:20.198315 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a16e5cfc-bf70-44fa-84eb-35036e3b6d83 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "DELETE /compute/v2.1/servers/befe3c76-6841-45ba-95b9-7d11592e404a" status: 204 len: 0 microversion: 2.1 time: 0.272940 Jul 25 13:03:20.199231 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2191/4465] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:03:19 2022] DELETE /compute/v2.1/servers/befe3c76-6841-45ba-95b9-7d11592e404a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:03:20.208214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ba244fb4-6c9d-4e2e-b8f0-20412649bca9 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:20.208805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ba244fb4-6c9d-4e2e-b8f0-20412649bca9 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: a1136ad1-8b0f-4717-8255-e615d7753832] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:20.231895 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba244fb4-6c9d-4e2e-b8f0-20412649bca9 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:20.232351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba244fb4-6c9d-4e2e-b8f0-20412649bca9 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:20.233142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba244fb4-6c9d-4e2e-b8f0-20412649bca9 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:20.233579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba244fb4-6c9d-4e2e-b8f0-20412649bca9 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:20.313531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ba244fb4-6c9d-4e2e-b8f0-20412649bca9 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: a1136ad1-8b0f-4717-8255-e615d7753832] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:03:20.456747 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8e579754-4fe1-4897-a866-878570dd4dff tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:20.468221 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8e579754-4fe1-4897-a866-878570dd4dff tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1564 microversion: 2.1 time: 0.824674 Jul 25 13:03:20.469129 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2275/4466] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:19 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1564 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:03:20.488283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-68676ab6-609c-4616-a433-f6b636fc07f5 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:20.488818 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-68676ab6-609c-4616-a433-f6b636fc07f5 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:20.513666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68676ab6-609c-4616-a433-f6b636fc07f5 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:20.516349 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68676ab6-609c-4616-a433-f6b636fc07f5 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:20.517223 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68676ab6-609c-4616-a433-f6b636fc07f5 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:20.517670 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68676ab6-609c-4616-a433-f6b636fc07f5 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:20.577765 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-68676ab6-609c-4616-a433-f6b636fc07f5 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] HTTP exception thrown: Instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 could not be found. Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-68676ab6-609c-4616-a433-f6b636fc07f5 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Request method failure captured: Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 HTTP/1.1 Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pLUy_qaHZrTobidfnUGpoUm-zUCEM2-dYUeKUoH4r7if-9i3IZYrAkUlgGLHUpgrc4G7eZ3-M6sO9iG6X1De-ZpVH9xPBpVwYtCByNu21pzLi1t1gdmmwrMBqHShuekTyjmkIewleLfNMUzhUkix0XDTPxUap4K9b-EAj1weyMix7Q Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: X-Openstack-Nova-Api-Version: 2.42 Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: cd52d102917f4b968a0f06c93f37994a Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1322165547 Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cd52d102917f4b968a0f06c93f37994a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cd52d102917f4b968a0f06c93f37994a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd52d102917f4b968a0f06c93f37994a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd52d102917f4b968a0f06c93f37994a"}]}] Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1322165547 Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: cd52d102917f4b968a0f06c93f37994a Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1322165547 Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TaggedBootDevicesTest_v242-1322165547-project Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 30345ec1766e4f29a7393616070201bd Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1322165547-project Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 could not be found. Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '339809bb-41b5-4a8f-80b7-28a356aad3f4'} Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 could not be found. Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:03:20.586908 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:03:20.593851 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 could not be found. Jul 25 13:03:20.593851 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:20.593851 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:20.593851 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:20.593851 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:20.593851 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:20.593851 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:20.593851 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:03:20.593851 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:03:20.593851 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 could not be found. Jul 25 13:03:20.593851 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:20.596801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-68676ab6-609c-4616-a433-f6b636fc07f5 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Returning 404 to user: Instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:03:20.598257 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-68676ab6-609c-4616-a433-f6b636fc07f5 tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "DELETE /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 404 len: 111 microversion: 2.42 time: 0.127652 Jul 25 13:03:20.602863 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2276/4467] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 13:03:20 2022] DELETE /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:03:20.604320 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ba244fb4-6c9d-4e2e-b8f0-20412649bca9 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832" status: 204 len: 0 microversion: 2.1 time: 0.400442 Jul 25 13:03:20.614372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-11a059d3-d19d-4527-b90d-e3e85e5a544d tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:20.615956 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-11a059d3-d19d-4527-b90d-e3e85e5a544d tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:20.619421 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2192/4468] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:03:20 2022] DELETE /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:03:20.627698 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11a059d3-d19d-4527-b90d-e3e85e5a544d tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:20.629484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11a059d3-d19d-4527-b90d-e3e85e5a544d tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:20.630816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11a059d3-d19d-4527-b90d-e3e85e5a544d tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:20.631736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11a059d3-d19d-4527-b90d-e3e85e5a544d tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:20.657970 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1ceb2d07-ab55-4fd7-8f02-9545f2a4692c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:20.670735 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1ceb2d07-ab55-4fd7-8f02-9545f2a4692c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] [instance: 339809bb-41b5-4a8f-80b7-28a356aad3f4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:20.685380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ceb2d07-ab55-4fd7-8f02-9545f2a4692c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:20.686397 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ceb2d07-ab55-4fd7-8f02-9545f2a4692c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:20.687396 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ceb2d07-ab55-4fd7-8f02-9545f2a4692c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:20.688066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ceb2d07-ab55-4fd7-8f02-9545f2a4692c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:20.717441 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-1ceb2d07-ab55-4fd7-8f02-9545f2a4692c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] HTTP exception thrown: Instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 could not be found. Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1ceb2d07-ab55-4fd7-8f02-9545f2a4692c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Request method failure captured: Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 HTTP/1.1 Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pLUy_qaHZrTobidfnUGpoUm-zUCEM2-dYUeKUoH4r7if-9i3IZYrAkUlgGLHUpgrc4G7eZ3-M6sO9iG6X1De-ZpVH9xPBpVwYtCByNu21pzLi1t1gdmmwrMBqHShuekTyjmkIewleLfNMUzhUkix0XDTPxUap4K9b-EAj1weyMix7Q Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: X-Openstack-Nova-Api-Version: 2.42 Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: cd52d102917f4b968a0f06c93f37994a Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1322165547 Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cd52d102917f4b968a0f06c93f37994a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cd52d102917f4b968a0f06c93f37994a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd52d102917f4b968a0f06c93f37994a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd52d102917f4b968a0f06c93f37994a"}]}] Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1322165547 Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: cd52d102917f4b968a0f06c93f37994a Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1322165547 Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-TaggedBootDevicesTest_v242-1322165547-project Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 30345ec1766e4f29a7393616070201bd Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1322165547-project Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 could not be found. Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '339809bb-41b5-4a8f-80b7-28a356aad3f4'} Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 could not be found. Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 could not be found. Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:20.719497 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:20.724542 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:20.724542 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:20.724542 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:20.724542 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:20.724542 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:03:20.724542 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:03:20.724542 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 could not be found. Jul 25 13:03:20.724542 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:20.726302 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1ceb2d07-ab55-4fd7-8f02-9545f2a4692c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] Returning 404 to user: Instance 339809bb-41b5-4a8f-80b7-28a356aad3f4 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:03:20.727372 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1ceb2d07-ab55-4fd7-8f02-9545f2a4692c tempest-TaggedBootDevicesTest_v242-1322165547 tempest-TaggedBootDevicesTest_v242-1322165547-project] 10.222.0.49 "GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4" status: 404 len: 111 microversion: 2.42 time: 0.106454 Jul 25 13:03:20.728136 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2193/4469] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:03:20 2022] GET /compute/v2.1/servers/339809bb-41b5-4a8f-80b7-28a356aad3f4 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:03:20.736962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-827820cd-a3ce-4cc6-afa1-e0b44e20b9bd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:20.737892 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-827820cd-a3ce-4cc6-afa1-e0b44e20b9bd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: 4d9bf270-1783-415a-a809-4098ffbe35f1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:20.751509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-827820cd-a3ce-4cc6-afa1-e0b44e20b9bd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:20.752238 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-827820cd-a3ce-4cc6-afa1-e0b44e20b9bd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:20.753057 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-827820cd-a3ce-4cc6-afa1-e0b44e20b9bd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:20.753494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-827820cd-a3ce-4cc6-afa1-e0b44e20b9bd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:20.789086 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-827820cd-a3ce-4cc6-afa1-e0b44e20b9bd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] HTTP exception thrown: Instance 4d9bf270-1783-415a-a809-4098ffbe35f1 could not be found. Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-827820cd-a3ce-4cc6-afa1-e0b44e20b9bd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Request method failure captured: Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/4d9bf270-1783-415a-a809-4098ffbe35f1 HTTP/1.1 Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pRfILdWlqqTlzEx1Z-J6f_3Aatp6Kv-MjPkIgUvuGaHJV6gZ4r3iQ7qh9e_4QXegs5GtnTB06DT36FwGnC6A0QcYrDiiAi0wQR0Qjcy4fDLf56C4tLviUeVBhsgKKfrFk-XWoFFsdeE-8veIAPPeihm1oZCC7qyfoK5ZY4xa-Wbp8s Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d0f5fe62e90146bcb87e76abaa6fe184 Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d0f5fe62e90146bcb87e76abaa6fe184", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d0f5fe62e90146bcb87e76abaa6fe184"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d0f5fe62e90146bcb87e76abaa6fe184"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d0f5fe62e90146bcb87e76abaa6fe184"}]}] Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d0f5fe62e90146bcb87e76abaa6fe184 Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ListServersNegativeTestJSON-2010429994-project Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: b27acc4218084f638755250bfd349e86 Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ListServersNegativeTestJSON-2010429994-project Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 4d9bf270-1783-415a-a809-4098ffbe35f1 could not be found. Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '4d9bf270-1783-415a-a809-4098ffbe35f1'} Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d9bf270-1783-415a-a809-4098ffbe35f1 could not be found. Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d9bf270-1783-415a-a809-4098ffbe35f1 could not be found. Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:20.794140 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:20.804767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:20.804767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:20.804767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:20.804767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:03:20.804767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:03:20.804767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d9bf270-1783-415a-a809-4098ffbe35f1 could not be found. Jul 25 13:03:20.804767 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:20.804767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-827820cd-a3ce-4cc6-afa1-e0b44e20b9bd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Returning 404 to user: Instance 4d9bf270-1783-415a-a809-4098ffbe35f1 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:03:20.804767 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-827820cd-a3ce-4cc6-afa1-e0b44e20b9bd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/4d9bf270-1783-415a-a809-4098ffbe35f1" status: 404 len: 111 microversion: 2.1 time: 0.064303 Jul 25 13:03:20.804767 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2194/4470] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:20 2022] GET /compute/v2.1/servers/4d9bf270-1783-415a-a809-4098ffbe35f1 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:03:20.820101 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-69309a4f-4aeb-459f-a614-52633c3c01f3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:20.821230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-69309a4f-4aeb-459f-a614-52633c3c01f3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: befe3c76-6841-45ba-95b9-7d11592e404a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:20.839955 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-69309a4f-4aeb-459f-a614-52633c3c01f3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:20.841907 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-69309a4f-4aeb-459f-a614-52633c3c01f3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:20.843383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-69309a4f-4aeb-459f-a614-52633c3c01f3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:20.845690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-69309a4f-4aeb-459f-a614-52633c3c01f3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:21.331133 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-11a059d3-d19d-4527-b90d-e3e85e5a544d tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:21.344138 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-11a059d3-d19d-4527-b90d-e3e85e5a544d tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1362 microversion: 2.1 time: 0.734719 Jul 25 13:03:21.346929 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2277/4471] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:20 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1362 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:21.728607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-69309a4f-4aeb-459f-a614-52633c3c01f3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:21.741814 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-69309a4f-4aeb-459f-a614-52633c3c01f3 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/befe3c76-6841-45ba-95b9-7d11592e404a" status: 200 len: 1520 microversion: 2.1 time: 0.939340 Jul 25 13:03:21.744572 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2195/4472] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:20 2022] GET /compute/v2.1/servers/befe3c76-6841-45ba-95b9-7d11592e404a => generated 1520 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:22.365146 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9ca4b2cf-462f-4f0a-a31c-1dc9b18f32f9 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:22.366220 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9ca4b2cf-462f-4f0a-a31c-1dc9b18f32f9 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:22.392907 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ca4b2cf-462f-4f0a-a31c-1dc9b18f32f9 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:22.394149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ca4b2cf-462f-4f0a-a31c-1dc9b18f32f9 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:22.400976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ca4b2cf-462f-4f0a-a31c-1dc9b18f32f9 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:22.405029 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ca4b2cf-462f-4f0a-a31c-1dc9b18f32f9 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:22.765726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-08383710-9828-42f6-ba38-438da61b0f76 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:22.766445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-08383710-9828-42f6-ba38-438da61b0f76 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: befe3c76-6841-45ba-95b9-7d11592e404a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:22.775709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-08383710-9828-42f6-ba38-438da61b0f76 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:22.776436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-08383710-9828-42f6-ba38-438da61b0f76 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:22.777540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-08383710-9828-42f6-ba38-438da61b0f76 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:22.778216 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-08383710-9828-42f6-ba38-438da61b0f76 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:24.091260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9ca4b2cf-462f-4f0a-a31c-1dc9b18f32f9 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:24.105518 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9ca4b2cf-462f-4f0a-a31c-1dc9b18f32f9 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1362 microversion: 2.1 time: 1.744559 Jul 25 13:03:24.145955 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2278/4473] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:22 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1362 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:24.860556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-aa4c9cd8-aaab-4dbd-a8aa-cd61229e5028 req-fd4bf85e-2b40-4dbc-93cc-30d291bbc661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1136ad1-8b0f-4717-8255-e615d7753832", "name": "network-vif-unplugged", "status": "completed", "tag": "51bc438d-5b70-41e7-87e9-45507375284c"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:03:24.895096 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-aa4c9cd8-aaab-4dbd-a8aa-cd61229e5028 req-fd4bf85e-2b40-4dbc-93cc-30d291bbc661 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:24.896574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-aa4c9cd8-aaab-4dbd-a8aa-cd61229e5028 req-fd4bf85e-2b40-4dbc-93cc-30d291bbc661 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:24.936584 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-aa4c9cd8-aaab-4dbd-a8aa-cd61229e5028 req-fd4bf85e-2b40-4dbc-93cc-30d291bbc661 service nova] Creating event network-vif-unplugged:51bc438d-5b70-41e7-87e9-45507375284c for instance a1136ad1-8b0f-4717-8255-e615d7753832 on n-h2-848886-15 Jul 25 13:03:24.950364 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-aa4c9cd8-aaab-4dbd-a8aa-cd61229e5028 req-fd4bf85e-2b40-4dbc-93cc-30d291bbc661 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095153 Jul 25 13:03:24.951389 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2279/4474] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:03:25.145254 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d71ef9ba-aa18-4cd5-afe4-2ce3f52b749b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:25.146854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d71ef9ba-aa18-4cd5-afe4-2ce3f52b749b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:25.161222 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d71ef9ba-aa18-4cd5-afe4-2ce3f52b749b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:25.163500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d71ef9ba-aa18-4cd5-afe4-2ce3f52b749b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:25.166969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d71ef9ba-aa18-4cd5-afe4-2ce3f52b749b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:25.169767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d71ef9ba-aa18-4cd5-afe4-2ce3f52b749b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:25.460034 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-08383710-9828-42f6-ba38-438da61b0f76 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:25.474489 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-08383710-9828-42f6-ba38-438da61b0f76 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/befe3c76-6841-45ba-95b9-7d11592e404a" status: 200 len: 1520 microversion: 2.1 time: 2.709439 Jul 25 13:03:25.477871 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2196/4475] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:22 2022] GET /compute/v2.1/servers/befe3c76-6841-45ba-95b9-7d11592e404a => generated 1520 bytes in 2718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:03:26.497193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4ec2becc-22bf-4000-9561-49c81a5696dd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:26.498474 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4ec2becc-22bf-4000-9561-49c81a5696dd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: befe3c76-6841-45ba-95b9-7d11592e404a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:26.527564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ec2becc-22bf-4000-9561-49c81a5696dd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:26.530678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ec2becc-22bf-4000-9561-49c81a5696dd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:26.533286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ec2becc-22bf-4000-9561-49c81a5696dd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:26.533759 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ec2becc-22bf-4000-9561-49c81a5696dd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:26.862940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d71ef9ba-aa18-4cd5-afe4-2ce3f52b749b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:26.880920 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d71ef9ba-aa18-4cd5-afe4-2ce3f52b749b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1362 microversion: 2.1 time: 1.744567 Jul 25 13:03:26.885192 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2280/4476] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:25 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1362 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:26.944616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4ec2becc-22bf-4000-9561-49c81a5696dd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27acc4218084f638755250bfd349e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f5fe62e90146bcb87e76abaa6fe184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:26.960793 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4ec2becc-22bf-4000-9561-49c81a5696dd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/befe3c76-6841-45ba-95b9-7d11592e404a" status: 200 len: 1478 microversion: 2.1 time: 0.467405 Jul 25 13:03:26.964018 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2197/4477] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:26 2022] GET /compute/v2.1/servers/befe3c76-6841-45ba-95b9-7d11592e404a => generated 1478 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:03:27.292180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-0e70c414-109a-498e-a17a-e9c60d1f423a req-07d5f5ff-700c-4496-94ec-97966180b1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "befe3c76-6841-45ba-95b9-7d11592e404a", "name": "network-vif-deleted", "tag": "33a77d2a-b53f-41de-88d0-4a1366eb9d42"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:03:27.327102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-0e70c414-109a-498e-a17a-e9c60d1f423a req-07d5f5ff-700c-4496-94ec-97966180b1f8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:27.327798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-0e70c414-109a-498e-a17a-e9c60d1f423a req-07d5f5ff-700c-4496-94ec-97966180b1f8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:27.359212 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-0e70c414-109a-498e-a17a-e9c60d1f423a req-07d5f5ff-700c-4496-94ec-97966180b1f8 service nova] Creating event network-vif-deleted:33a77d2a-b53f-41de-88d0-4a1366eb9d42 for instance befe3c76-6841-45ba-95b9-7d11592e404a on n-h1-848886-15 Jul 25 13:03:27.371267 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-0e70c414-109a-498e-a17a-e9c60d1f423a req-07d5f5ff-700c-4496-94ec-97966180b1f8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083791 Jul 25 13:03:27.391335 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2281/4478] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:03:27.905134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-28e24e38-a854-4ce2-be86-390bca2b2608 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:27.905757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-28e24e38-a854-4ce2-be86-390bca2b2608 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:27.914245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-28e24e38-a854-4ce2-be86-390bca2b2608 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:27.915003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-28e24e38-a854-4ce2-be86-390bca2b2608 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:27.921376 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-28e24e38-a854-4ce2-be86-390bca2b2608 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:27.921866 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-28e24e38-a854-4ce2-be86-390bca2b2608 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:27.984240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d09d513d-0c87-4a74-87d7-a3a6ad46fcfd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:27.984939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d09d513d-0c87-4a74-87d7-a3a6ad46fcfd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: befe3c76-6841-45ba-95b9-7d11592e404a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:28.011708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d09d513d-0c87-4a74-87d7-a3a6ad46fcfd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:28.013594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d09d513d-0c87-4a74-87d7-a3a6ad46fcfd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:28.017108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d09d513d-0c87-4a74-87d7-a3a6ad46fcfd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:28.017911 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d09d513d-0c87-4a74-87d7-a3a6ad46fcfd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:28.053064 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-d09d513d-0c87-4a74-87d7-a3a6ad46fcfd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] HTTP exception thrown: Instance befe3c76-6841-45ba-95b9-7d11592e404a could not be found. Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d09d513d-0c87-4a74-87d7-a3a6ad46fcfd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Request method failure captured: Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/befe3c76-6841-45ba-95b9-7d11592e404a HTTP/1.1 Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pRfILdWlqqTlzEx1Z-J6f_3Aatp6Kv-MjPkIgUvuGaHJV6gZ4r3iQ7qh9e_4QXegs5GtnTB06DT36FwGnC6A0QcYrDiiAi0wQR0Qjcy4fDLf56C4tLviUeVBhsgKKfrFk-XWoFFsdeE-8veIAPPeihm1oZCC7qyfoK5ZY4xa-Wbp8s Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d0f5fe62e90146bcb87e76abaa6fe184 Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d0f5fe62e90146bcb87e76abaa6fe184", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d0f5fe62e90146bcb87e76abaa6fe184"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d0f5fe62e90146bcb87e76abaa6fe184"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d0f5fe62e90146bcb87e76abaa6fe184"}]}] Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d0f5fe62e90146bcb87e76abaa6fe184 Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ListServersNegativeTestJSON-2010429994-project Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: b27acc4218084f638755250bfd349e86 Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ListServersNegativeTestJSON-2010429994-project Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance befe3c76-6841-45ba-95b9-7d11592e404a could not be found. Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'befe3c76-6841-45ba-95b9-7d11592e404a'} Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance befe3c76-6841-45ba-95b9-7d11592e404a could not be found. Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance befe3c76-6841-45ba-95b9-7d11592e404a could not be found. Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:28.055088 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:28.060210 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:28.060210 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:28.060210 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:28.060210 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:03:28.060210 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:03:28.060210 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance befe3c76-6841-45ba-95b9-7d11592e404a could not be found. Jul 25 13:03:28.060210 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:28.063728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d09d513d-0c87-4a74-87d7-a3a6ad46fcfd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Returning 404 to user: Instance befe3c76-6841-45ba-95b9-7d11592e404a could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:03:28.067480 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d09d513d-0c87-4a74-87d7-a3a6ad46fcfd tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/befe3c76-6841-45ba-95b9-7d11592e404a" status: 404 len: 111 microversion: 2.1 time: 0.085936 Jul 25 13:03:28.071836 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2282/4479] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:27 2022] GET /compute/v2.1/servers/befe3c76-6841-45ba-95b9-7d11592e404a => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:03:28.082547 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0719ce3c-b951-46cd-810f-152858da7258 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:28.085694 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0719ce3c-b951-46cd-810f-152858da7258 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] [instance: a1136ad1-8b0f-4717-8255-e615d7753832] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:28.102485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:28.106531 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0719ce3c-b951-46cd-810f-152858da7258 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:28.112468 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0719ce3c-b951-46cd-810f-152858da7258 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:28.151501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0719ce3c-b951-46cd-810f-152858da7258 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:28.153339 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0719ce3c-b951-46cd-810f-152858da7258 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:28.185666 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-0719ce3c-b951-46cd-810f-152858da7258 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] HTTP exception thrown: Instance a1136ad1-8b0f-4717-8255-e615d7753832 could not be found. Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0719ce3c-b951-46cd-810f-152858da7258 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Request method failure captured: Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832 HTTP/1.1 Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pRfILdWlqqTlzEx1Z-J6f_3Aatp6Kv-MjPkIgUvuGaHJV6gZ4r3iQ7qh9e_4QXegs5GtnTB06DT36FwGnC6A0QcYrDiiAi0wQR0Qjcy4fDLf56C4tLviUeVBhsgKKfrFk-XWoFFsdeE-8veIAPPeihm1oZCC7qyfoK5ZY4xa-Wbp8s Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d0f5fe62e90146bcb87e76abaa6fe184 Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d0f5fe62e90146bcb87e76abaa6fe184", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d0f5fe62e90146bcb87e76abaa6fe184"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d0f5fe62e90146bcb87e76abaa6fe184"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d0f5fe62e90146bcb87e76abaa6fe184"}]}] Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d0f5fe62e90146bcb87e76abaa6fe184 Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2010429994 Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ListServersNegativeTestJSON-2010429994-project Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: b27acc4218084f638755250bfd349e86 Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ListServersNegativeTestJSON-2010429994-project Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance a1136ad1-8b0f-4717-8255-e615d7753832 could not be found. Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'a1136ad1-8b0f-4717-8255-e615d7753832'} Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1136ad1-8b0f-4717-8255-e615d7753832 could not be found. Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1136ad1-8b0f-4717-8255-e615d7753832 could not be found. Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:28.187555 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:28.193812 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:28.193812 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:28.193812 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:28.193812 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:03:28.193812 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:03:28.193812 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1136ad1-8b0f-4717-8255-e615d7753832 could not be found. Jul 25 13:03:28.193812 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:03:28.198433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0719ce3c-b951-46cd-810f-152858da7258 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] Returning 404 to user: Instance a1136ad1-8b0f-4717-8255-e615d7753832 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:03:28.199700 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0719ce3c-b951-46cd-810f-152858da7258 tempest-ListServersNegativeTestJSON-2010429994 tempest-ListServersNegativeTestJSON-2010429994-project] 10.222.0.49 "GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832" status: 404 len: 111 microversion: 2.1 time: 0.126528 Jul 25 13:03:28.200797 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2283/4480] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:28 2022] GET /compute/v2.1/servers/a1136ad1-8b0f-4717-8255-e615d7753832 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:03:28.372103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:28.573626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-28e24e38-a854-4ce2-be86-390bca2b2608 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:28.587187 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-28e24e38-a854-4ce2-be86-390bca2b2608 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1362 microversion: 2.1 time: 0.684835 Jul 25 13:03:28.603558 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2198/4481] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:27 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1362 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:29.012419 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ce766c61-bf7b-460c-8814-d3f8fcfadc7c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:29.013094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ce766c61-bf7b-460c-8814-d3f8fcfadc7c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:29.035023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ce766c61-bf7b-460c-8814-d3f8fcfadc7c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:29.038916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ce766c61-bf7b-460c-8814-d3f8fcfadc7c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:29.044235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ce766c61-bf7b-460c-8814-d3f8fcfadc7c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:29.045075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ce766c61-bf7b-460c-8814-d3f8fcfadc7c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:29.140578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:29.354849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ce766c61-bf7b-460c-8814-d3f8fcfadc7c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:29.367736 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ce766c61-bf7b-460c-8814-d3f8fcfadc7c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1564 microversion: 2.1 time: 0.362680 Jul 25 13:03:29.368736 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2284/4482] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:29 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1564 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:29.416363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-c0bf5543-2d95-4dc8-b1b1-84287c3bfbe9 req-f1dfb374-988a-48ef-9f84-9cf1fd217a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1136ad1-8b0f-4717-8255-e615d7753832", "name": "network-vif-deleted", "tag": "51bc438d-5b70-41e7-87e9-45507375284c"}, {"name": "network-changed", "server_uuid": "486f49b3-3f54-478c-9c21-c33a16ae4fde", "tag": "fefdb487-385f-4f8b-b1dd-99ad9fb2469d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:03:29.477746 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c0bf5543-2d95-4dc8-b1b1-84287c3bfbe9 req-f1dfb374-988a-48ef-9f84-9cf1fd217a3b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:29.482978 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c0bf5543-2d95-4dc8-b1b1-84287c3bfbe9 req-f1dfb374-988a-48ef-9f84-9cf1fd217a3b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:29.533135 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-c0bf5543-2d95-4dc8-b1b1-84287c3bfbe9 req-f1dfb374-988a-48ef-9f84-9cf1fd217a3b service nova] Creating event network-vif-deleted:51bc438d-5b70-41e7-87e9-45507375284c for instance a1136ad1-8b0f-4717-8255-e615d7753832 on n-h2-848886-15 Jul 25 13:03:29.534008 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-c0bf5543-2d95-4dc8-b1b1-84287c3bfbe9 req-f1dfb374-988a-48ef-9f84-9cf1fd217a3b service nova] Creating event network-changed:fefdb487-385f-4f8b-b1dd-99ad9fb2469d for instance 486f49b3-3f54-478c-9c21-c33a16ae4fde on n-h1-848886-15 Jul 25 13:03:29.560176 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-c0bf5543-2d95-4dc8-b1b1-84287c3bfbe9 req-f1dfb374-988a-48ef-9f84-9cf1fd217a3b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.161540 Jul 25 13:03:29.564449 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2199/4483] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:03:29.609772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6bea61a4-c5a9-4aac-a223-8cd28f5c144a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:29.611093 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6bea61a4-c5a9-4aac-a223-8cd28f5c144a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:29.636746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6bea61a4-c5a9-4aac-a223-8cd28f5c144a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:29.640785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6bea61a4-c5a9-4aac-a223-8cd28f5c144a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:29.643152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6bea61a4-c5a9-4aac-a223-8cd28f5c144a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:29.646773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6bea61a4-c5a9-4aac-a223-8cd28f5c144a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:30.072910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-3cfc0c75-6e78-4309-a13f-87d51d567be3 req-19ca0465-c681-4845-a2c5-32416eff635a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1870a72-72de-47e8-8776-d342d9ece98e", "name": "network-vif-plugged", "status": "completed", "tag": "beeda1f8-ff74-41c7-a0bd-97d2a674f2af"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:03:30.093780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=10 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:30.100890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-3cfc0c75-6e78-4309-a13f-87d51d567be3 req-19ca0465-c681-4845-a2c5-32416eff635a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:30.102430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-3cfc0c75-6e78-4309-a13f-87d51d567be3 req-19ca0465-c681-4845-a2c5-32416eff635a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:30.160359 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-3cfc0c75-6e78-4309-a13f-87d51d567be3 req-19ca0465-c681-4845-a2c5-32416eff635a service nova] Creating event network-vif-plugged:beeda1f8-ff74-41c7-a0bd-97d2a674f2af for instance f1870a72-72de-47e8-8776-d342d9ece98e on n-h1-848886-15 Jul 25 13:03:30.178673 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-3cfc0c75-6e78-4309-a13f-87d51d567be3 req-19ca0465-c681-4845-a2c5-32416eff635a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110184 Jul 25 13:03:30.186907 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2200/4484] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:03:30.483581 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6bea61a4-c5a9-4aac-a223-8cd28f5c144a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:30.497811 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6bea61a4-c5a9-4aac-a223-8cd28f5c144a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1362 microversion: 2.1 time: 0.892735 Jul 25 13:03:30.498986 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2285/4485] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:29 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1362 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:31.521729 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-35c2ae1b-b365-44f3-9c1d-345b57559662 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:31.522887 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-35c2ae1b-b365-44f3-9c1d-345b57559662 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:31.540230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-35c2ae1b-b365-44f3-9c1d-345b57559662 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:31.540806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-35c2ae1b-b365-44f3-9c1d-345b57559662 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:31.543813 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-35c2ae1b-b365-44f3-9c1d-345b57559662 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:31.544260 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-35c2ae1b-b365-44f3-9c1d-345b57559662 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:31.876859 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-35c2ae1b-b365-44f3-9c1d-345b57559662 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:31.973966 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-35c2ae1b-b365-44f3-9c1d-345b57559662 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1362 microversion: 2.1 time: 0.457423 Jul 25 13:03:31.988749 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2201/4486] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:31 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1362 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:32.999079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c6128df2-dc33-4c52-9899-fc4a4d5268e6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:33.000670 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c6128df2-dc33-4c52-9899-fc4a4d5268e6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:33.018196 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c6128df2-dc33-4c52-9899-fc4a4d5268e6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:33.023718 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c6128df2-dc33-4c52-9899-fc4a4d5268e6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:33.025264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c6128df2-dc33-4c52-9899-fc4a4d5268e6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:33.026943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c6128df2-dc33-4c52-9899-fc4a4d5268e6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:33.523084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c6128df2-dc33-4c52-9899-fc4a4d5268e6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:33.541657 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c6128df2-dc33-4c52-9899-fc4a4d5268e6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1547 microversion: 2.1 time: 0.549309 Jul 25 13:03:33.546201 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2286/4487] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:32 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1547 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:33.567633 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-43f13829-5aa8-46bc-adaf-5b5c06b7b526 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:33.569618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-43f13829-5aa8-46bc-adaf-5b5c06b7b526 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:33.580154 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43f13829-5aa8-46bc-adaf-5b5c06b7b526 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:33.580958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43f13829-5aa8-46bc-adaf-5b5c06b7b526 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:33.582916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43f13829-5aa8-46bc-adaf-5b5c06b7b526 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:33.584134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43f13829-5aa8-46bc-adaf-5b5c06b7b526 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:34.058645 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-43f13829-5aa8-46bc-adaf-5b5c06b7b526 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.495586 Jul 25 13:03:34.059655 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2202/4488] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 13:03:33 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e/os-interface => generated 284 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:03:39.415796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-f77f6b00-1a34-43c4-9739-aa7e70aad475 req-78a6a211-90ac-4127-8c25-c777a208cead service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1870a72-72de-47e8-8776-d342d9ece98e", "tag": "beeda1f8-ff74-41c7-a0bd-97d2a674f2af"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:03:39.469644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f77f6b00-1a34-43c4-9739-aa7e70aad475 req-78a6a211-90ac-4127-8c25-c777a208cead service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:39.470504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f77f6b00-1a34-43c4-9739-aa7e70aad475 req-78a6a211-90ac-4127-8c25-c777a208cead service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:39.536188 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-f77f6b00-1a34-43c4-9739-aa7e70aad475 req-78a6a211-90ac-4127-8c25-c777a208cead service nova] Creating event network-changed:beeda1f8-ff74-41c7-a0bd-97d2a674f2af for instance f1870a72-72de-47e8-8776-d342d9ece98e on n-h1-848886-15 Jul 25 13:03:39.564367 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-f77f6b00-1a34-43c4-9739-aa7e70aad475 req-78a6a211-90ac-4127-8c25-c777a208cead service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146937 Jul 25 13:03:39.567108 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2287/4489] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:03:43.054205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5717a606-52af-42ad-916e-a591dbc1f7d4 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1964195436", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": "none"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:03:43.180606 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5717a606-52af-42ad-916e-a591dbc1f7d4 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:03:43.181016 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5717a606-52af-42ad-916e-a591dbc1f7d4 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:03:43.181604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5717a606-52af-42ad-916e-a591dbc1f7d4 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:03:43.184306 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5717a606-52af-42ad-916e-a591dbc1f7d4 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:03:43.184792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5717a606-52af-42ad-916e-a591dbc1f7d4 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:03:43.203403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5717a606-52af-42ad-916e-a591dbc1f7d4 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:43.204338 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5717a606-52af-42ad-916e-a591dbc1f7d4 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:43.205555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5717a606-52af-42ad-916e-a591dbc1f7d4 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:43.206278 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5717a606-52af-42ad-916e-a591dbc1f7d4 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:43.278031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-5717a606-52af-42ad-916e-a591dbc1f7d4 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Getting quotas for project 0747b08d4f514b1aac90c4c66104d44a. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:03:43.288906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-5717a606-52af-42ad-916e-a591dbc1f7d4 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Getting quotas for user ad6ab9f716a14b9ab28e867c6d497777 and project 0747b08d4f514b1aac90c4c66104d44a. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:03:43.322583 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5717a606-52af-42ad-916e-a591dbc1f7d4 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:03:43.330313 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5717a606-52af-42ad-916e-a591dbc1f7d4 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] [instance: 3d976748-46cc-41bd-a035-3c01b3f5647c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:03:43.420162 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5717a606-52af-42ad-916e-a591dbc1f7d4 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.627092 Jul 25 13:03:43.426692 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2203/4490] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Jul 25 13:03:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 13:03:43.432527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-201d06c8-127e-4229-84ff-16dfe9afc66d tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:43.433229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-201d06c8-127e-4229-84ff-16dfe9afc66d tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] [instance: 3d976748-46cc-41bd-a035-3c01b3f5647c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:43.628490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-201d06c8-127e-4229-84ff-16dfe9afc66d tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:43.639524 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-201d06c8-127e-4229-84ff-16dfe9afc66d tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:43.642256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-201d06c8-127e-4229-84ff-16dfe9afc66d tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:43.643826 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-201d06c8-127e-4229-84ff-16dfe9afc66d tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] 10.222.0.49 "GET /compute/v2.1/servers/3d976748-46cc-41bd-a035-3c01b3f5647c" status: 200 len: 1281 microversion: 2.47 time: 0.215638 Jul 25 13:03:43.670361 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2288/4491] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:03:43 2022] GET /compute/v2.1/servers/3d976748-46cc-41bd-a035-3c01b3f5647c => generated 1281 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:03:44.066854 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a754027e-9355-408f-a074-7b3eef84c802 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:03:44.069583 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a754027e-9355-408f-a074-7b3eef84c802 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:44.077574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:44.082976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a754027e-9355-408f-a074-7b3eef84c802 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:44.083833 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a754027e-9355-408f-a074-7b3eef84c802 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:44.085361 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a754027e-9355-408f-a074-7b3eef84c802 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:44.086186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a754027e-9355-408f-a074-7b3eef84c802 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:44.199369 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a754027e-9355-408f-a074-7b3eef84c802 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "POST /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde/action" status: 200 len: 24548 microversion: 2.1 time: 0.137274 Jul 25 13:03:44.200194 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2204/4492] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:03:44 2022] POST /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde/action => generated 24548 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:03:44.676985 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f94e47b5-7cfe-4bb3-bb5f-6edc3a2d327c tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:44.677629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f94e47b5-7cfe-4bb3-bb5f-6edc3a2d327c tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] [instance: 3d976748-46cc-41bd-a035-3c01b3f5647c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:44.834400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f94e47b5-7cfe-4bb3-bb5f-6edc3a2d327c tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:44.864864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f94e47b5-7cfe-4bb3-bb5f-6edc3a2d327c tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:44.867974 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f94e47b5-7cfe-4bb3-bb5f-6edc3a2d327c tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:44.869533 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f94e47b5-7cfe-4bb3-bb5f-6edc3a2d327c tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] 10.222.0.49 "GET /compute/v2.1/servers/3d976748-46cc-41bd-a035-3c01b3f5647c" status: 200 len: 1281 microversion: 2.47 time: 0.200433 Jul 25 13:03:44.888626 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2289/4493] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:03:44 2022] GET /compute/v2.1/servers/3d976748-46cc-41bd-a035-3c01b3f5647c => generated 1281 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:03:45.895466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f5a244b1-8d8b-4c03-925e-b18ac35705ff tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:45.896187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f5a244b1-8d8b-4c03-925e-b18ac35705ff tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] [instance: 3d976748-46cc-41bd-a035-3c01b3f5647c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:45.921280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5a244b1-8d8b-4c03-925e-b18ac35705ff tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:45.921669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5a244b1-8d8b-4c03-925e-b18ac35705ff tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:45.922513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5a244b1-8d8b-4c03-925e-b18ac35705ff tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:45.922995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5a244b1-8d8b-4c03-925e-b18ac35705ff tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:46.159667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d1fc4f4f-21fe-4ef6-afc7-c069ea2fa81b tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Action: 'create', calling method: .version_select at 0x7efcfed64280>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1160942223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2JlTZGISsD7Ucnju+N5CDwXunezPc4U0ybxMT929so2yECJZUffYg6UQ/lIRSYCrk8AqyBdpVBr+vHOGI1T0GfM1xdFADM1hYRzLqqHoeAr229cyfjABnH5Xo3y/sOVw=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:03:46.239835 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-d1fc4f4f-21fe-4ef6-afc7-c069ea2fa81b tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Getting quotas for project d9ef6028fa1c460b8cab5f7d9082abfa. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:03:46.261676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-d1fc4f4f-21fe-4ef6-afc7-c069ea2fa81b tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Getting quotas for user 48e6a20408894330b3b3734a455a078c and project d9ef6028fa1c460b8cab5f7d9082abfa. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:03:46.376848 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d1fc4f4f-21fe-4ef6-afc7-c069ea2fa81b tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.618559 Jul 25 13:03:46.392246 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2205/4494] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:03:45 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:03:46.830539 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f5a244b1-8d8b-4c03-925e-b18ac35705ff tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:46.843455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f5a244b1-8d8b-4c03-925e-b18ac35705ff tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:46.847543 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f5a244b1-8d8b-4c03-925e-b18ac35705ff tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:46.855589 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f5a244b1-8d8b-4c03-925e-b18ac35705ff tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] 10.222.0.49 "GET /compute/v2.1/servers/3d976748-46cc-41bd-a035-3c01b3f5647c" status: 200 len: 1351 microversion: 2.47 time: 0.965645 Jul 25 13:03:46.856785 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2290/4495] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:03:45 2022] GET /compute/v2.1/servers/3d976748-46cc-41bd-a035-3c01b3f5647c => generated 1351 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:03:47.884603 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4d48ecd9-cf37-4580-ab76-0fb2d381c6e1 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:47.886266 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4d48ecd9-cf37-4580-ab76-0fb2d381c6e1 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] [instance: 3d976748-46cc-41bd-a035-3c01b3f5647c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:47.900018 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4d48ecd9-cf37-4580-ab76-0fb2d381c6e1 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:47.900869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4d48ecd9-cf37-4580-ab76-0fb2d381c6e1 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:47.902103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4d48ecd9-cf37-4580-ab76-0fb2d381c6e1 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:47.902787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4d48ecd9-cf37-4580-ab76-0fb2d381c6e1 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:48.127706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4d48ecd9-cf37-4580-ab76-0fb2d381c6e1 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:48.157215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4d48ecd9-cf37-4580-ab76-0fb2d381c6e1 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:48.160261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4d48ecd9-cf37-4580-ab76-0fb2d381c6e1 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:48.163305 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4d48ecd9-cf37-4580-ab76-0fb2d381c6e1 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] 10.222.0.49 "GET /compute/v2.1/servers/3d976748-46cc-41bd-a035-3c01b3f5647c" status: 200 len: 1339 microversion: 2.47 time: 0.283023 Jul 25 13:03:48.167420 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2206/4496] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:03:47 2022] GET /compute/v2.1/servers/3d976748-46cc-41bd-a035-3c01b3f5647c => generated 1339 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:03:49.191344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d24fcae2-7146-43e6-ae6a-e2a05801b3a0 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:49.192957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d24fcae2-7146-43e6-ae6a-e2a05801b3a0 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] [instance: 3d976748-46cc-41bd-a035-3c01b3f5647c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:49.211123 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d24fcae2-7146-43e6-ae6a-e2a05801b3a0 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:49.211793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d24fcae2-7146-43e6-ae6a-e2a05801b3a0 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:49.212922 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d24fcae2-7146-43e6-ae6a-e2a05801b3a0 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:49.213548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d24fcae2-7146-43e6-ae6a-e2a05801b3a0 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:49.532442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d24fcae2-7146-43e6-ae6a-e2a05801b3a0 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:49.548409 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d24fcae2-7146-43e6-ae6a-e2a05801b3a0 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:49.555503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d24fcae2-7146-43e6-ae6a-e2a05801b3a0 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:49.557908 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d24fcae2-7146-43e6-ae6a-e2a05801b3a0 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] 10.222.0.49 "GET /compute/v2.1/servers/3d976748-46cc-41bd-a035-3c01b3f5647c" status: 200 len: 1360 microversion: 2.47 time: 0.371434 Jul 25 13:03:49.561354 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2291/4497] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:03:49 2022] GET /compute/v2.1/servers/3d976748-46cc-41bd-a035-3c01b3f5647c => generated 1360 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:03:49.591831 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8c211d44-cccb-4484-8c4e-75f123324ef9 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1318565791"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:03:49.598021 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8c211d44-cccb-4484-8c4e-75f123324ef9 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] [instance: 3d976748-46cc-41bd-a035-3c01b3f5647c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:49.641061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c211d44-cccb-4484-8c4e-75f123324ef9 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:49.641469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c211d44-cccb-4484-8c4e-75f123324ef9 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:49.642296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c211d44-cccb-4484-8c4e-75f123324ef9 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:49.646458 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c211d44-cccb-4484-8c4e-75f123324ef9 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:50.219300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=79,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:50.258112 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8c211d44-cccb-4484-8c4e-75f123324ef9 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] 10.222.0.49 "POST /compute/v2.1/servers/3d976748-46cc-41bd-a035-3c01b3f5647c/action" status: 202 len: 52 microversion: 2.47 time: 0.672293 Jul 25 13:03:50.265258 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2207/4498] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Jul 25 13:03:49 2022] POST /compute/v2.1/servers/3d976748-46cc-41bd-a035-3c01b3f5647c/action => generated 52 bytes in 681 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 25 13:03:50.289507 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8c1d8a46-96fb-440b-a3c8-0feb8172c5f2 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:50.292179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8c1d8a46-96fb-440b-a3c8-0feb8172c5f2 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] [instance: 3d976748-46cc-41bd-a035-3c01b3f5647c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:50.312614 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=40 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:50.323723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c1d8a46-96fb-440b-a3c8-0feb8172c5f2 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:50.330177 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c1d8a46-96fb-440b-a3c8-0feb8172c5f2 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:50.335844 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c1d8a46-96fb-440b-a3c8-0feb8172c5f2 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:50.337537 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c1d8a46-96fb-440b-a3c8-0feb8172c5f2 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:50.457635 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d60a5dad-40bc-4d9e-8091-5608d4a0d324 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:50.462254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d60a5dad-40bc-4d9e-8091-5608d4a0d324 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:50.476967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8c1d8a46-96fb-440b-a3c8-0feb8172c5f2 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] [instance: 3d976748-46cc-41bd-a035-3c01b3f5647c] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:03:50.480942 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d60a5dad-40bc-4d9e-8091-5608d4a0d324 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:50.481758 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d60a5dad-40bc-4d9e-8091-5608d4a0d324 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:50.482976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d60a5dad-40bc-4d9e-8091-5608d4a0d324 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:50.490785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d60a5dad-40bc-4d9e-8091-5608d4a0d324 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:50.725063 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8c1d8a46-96fb-440b-a3c8-0feb8172c5f2 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3d976748-46cc-41bd-a035-3c01b3f5647c" status: 204 len: 0 microversion: 2.47 time: 0.457728 Jul 25 13:03:50.730068 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2292/4499] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 13:03:50 2022] DELETE /compute/v2.1/servers/3d976748-46cc-41bd-a035-3c01b3f5647c => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 13:03:50.743488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fd8cd833-c13a-42aa-8602-c62c4955e867 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:50.746108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fd8cd833-c13a-42aa-8602-c62c4955e867 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] [instance: 3d976748-46cc-41bd-a035-3c01b3f5647c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:50.755619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd8cd833-c13a-42aa-8602-c62c4955e867 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:50.756071 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd8cd833-c13a-42aa-8602-c62c4955e867 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:50.757035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd8cd833-c13a-42aa-8602-c62c4955e867 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:50.758474 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd8cd833-c13a-42aa-8602-c62c4955e867 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:51.359067 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d60a5dad-40bc-4d9e-8091-5608d4a0d324 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1835 microversion: 2.1 time: 0.909867 Jul 25 13:03:51.382020 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2208/4500] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:50 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1835 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:51.440011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fd8cd833-c13a-42aa-8602-c62c4955e867 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:51.474012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fd8cd833-c13a-42aa-8602-c62c4955e867 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:51.482614 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fd8cd833-c13a-42aa-8602-c62c4955e867 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:51.483906 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fd8cd833-c13a-42aa-8602-c62c4955e867 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] 10.222.0.49 "GET /compute/v2.1/servers/3d976748-46cc-41bd-a035-3c01b3f5647c" status: 200 len: 1366 microversion: 2.47 time: 0.748067 Jul 25 13:03:51.510136 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2293/4501] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:03:50 2022] GET /compute/v2.1/servers/3d976748-46cc-41bd-a035-3c01b3f5647c => generated 1366 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:03:51.525571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a91b27b8-0e79-41f0-90a4-2bf6e14a688c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:51.526228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a91b27b8-0e79-41f0-90a4-2bf6e14a688c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:51.539941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a91b27b8-0e79-41f0-90a4-2bf6e14a688c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:51.540403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a91b27b8-0e79-41f0-90a4-2bf6e14a688c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:51.541212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a91b27b8-0e79-41f0-90a4-2bf6e14a688c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:51.541653 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a91b27b8-0e79-41f0-90a4-2bf6e14a688c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:51.792815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c9eb161d-1a53-4fc2-ba0e-b0df0bcc20f1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-268729986", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:03:51.915177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-c9eb161d-1a53-4fc2-ba0e-b0df0bcc20f1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] validate_networks() for [('c1395e55-cd66-4325-bef1-b570c194020a', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:03:52.619350 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a91b27b8-0e79-41f0-90a4-2bf6e14a688c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:52.633302 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a91b27b8-0e79-41f0-90a4-2bf6e14a688c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1682 microversion: 2.1 time: 1.122597 Jul 25 13:03:52.634051 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2294/4502] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:51 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1682 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:52.657136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-04de3785-d733-40ba-9b7c-0f48055cfb63 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:52.657984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-04de3785-d733-40ba-9b7c-0f48055cfb63 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] [instance: 3d976748-46cc-41bd-a035-3c01b3f5647c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:52.676643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04de3785-d733-40ba-9b7c-0f48055cfb63 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:52.679224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04de3785-d733-40ba-9b7c-0f48055cfb63 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:52.682153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04de3785-d733-40ba-9b7c-0f48055cfb63 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:52.684205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04de3785-d733-40ba-9b7c-0f48055cfb63 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:52.924854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-04de3785-d733-40ba-9b7c-0f48055cfb63 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:52.945477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-04de3785-d733-40ba-9b7c-0f48055cfb63 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:52.957076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-04de3785-d733-40ba-9b7c-0f48055cfb63 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:52.962738 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-04de3785-d733-40ba-9b7c-0f48055cfb63 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] 10.222.0.49 "GET /compute/v2.1/servers/3d976748-46cc-41bd-a035-3c01b3f5647c" status: 200 len: 1366 microversion: 2.47 time: 0.317579 Jul 25 13:03:52.963823 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2295/4503] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:03:52 2022] GET /compute/v2.1/servers/3d976748-46cc-41bd-a035-3c01b3f5647c => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:03:52.990626 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-727f4653-63c9-4d97-8317-3f9fb9de3062 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:03:52.993006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-727f4653-63c9-4d97-8317-3f9fb9de3062 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:53.005002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-727f4653-63c9-4d97-8317-3f9fb9de3062 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:53.005481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-727f4653-63c9-4d97-8317-3f9fb9de3062 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:53.006889 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-727f4653-63c9-4d97-8317-3f9fb9de3062 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:53.007977 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-727f4653-63c9-4d97-8317-3f9fb9de3062 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:53.075110 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-727f4653-63c9-4d97-8317-3f9fb9de3062 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "POST /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde/action" status: 200 len: 32622 microversion: 2.1 time: 0.098626 Jul 25 13:03:53.083320 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2296/4504] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:03:52 2022] POST /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde/action => generated 32622 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:03:53.240527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:53.310249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9ab1b0af-6d31-40c3-93a9-c038b9d2b66a tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:03:53.311276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9ab1b0af-6d31-40c3-93a9-c038b9d2b66a tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:53.341061 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ab1b0af-6d31-40c3-93a9-c038b9d2b66a tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:53.341797 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ab1b0af-6d31-40c3-93a9-c038b9d2b66a tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:53.355459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ab1b0af-6d31-40c3-93a9-c038b9d2b66a tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:53.356355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ab1b0af-6d31-40c3-93a9-c038b9d2b66a tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:53.466054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9ab1b0af-6d31-40c3-93a9-c038b9d2b66a tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'cba0ce5d42b344fa9c90d32358917451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b553cd19e4287905a9375d142f990', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:53.467053 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9ab1b0af-6d31-40c3-93a9-c038b9d2b66a tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] flavor_id is None. Assuming migration. {{(pid=125884) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 25 13:03:53.467827 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9ab1b0af-6d31-40c3-93a9-c038b9d2b66a tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125884) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 13:03:53.570661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c9eb161d-1a53-4fc2-ba0e-b0df0bcc20f1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:03:53.571188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c9eb161d-1a53-4fc2-ba0e-b0df0bcc20f1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:03:53.571753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c9eb161d-1a53-4fc2-ba0e-b0df0bcc20f1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:03:53.573858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c9eb161d-1a53-4fc2-ba0e-b0df0bcc20f1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:03:53.574589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c9eb161d-1a53-4fc2-ba0e-b0df0bcc20f1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:03:53.606991 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c9eb161d-1a53-4fc2-ba0e-b0df0bcc20f1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:53.607444 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c9eb161d-1a53-4fc2-ba0e-b0df0bcc20f1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:53.608245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c9eb161d-1a53-4fc2-ba0e-b0df0bcc20f1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:53.608684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c9eb161d-1a53-4fc2-ba0e-b0df0bcc20f1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:53.701757 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9ab1b0af-6d31-40c3-93a9-c038b9d2b66a tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde/action" status: 202 len: 0 microversion: 2.1 time: 0.398235 Jul 25 13:03:53.706394 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2297/4505] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:03:53 2022] POST /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 13:03:53.715148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-14f9f474-72b9-4c77-832d-41b59d380d39 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:53.715980 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-14f9f474-72b9-4c77-832d-41b59d380d39 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:53.727027 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14f9f474-72b9-4c77-832d-41b59d380d39 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:53.727525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14f9f474-72b9-4c77-832d-41b59d380d39 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:53.728576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14f9f474-72b9-4c77-832d-41b59d380d39 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:53.729020 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14f9f474-72b9-4c77-832d-41b59d380d39 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:53.735968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-c9eb161d-1a53-4fc2-ba0e-b0df0bcc20f1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Getting quotas for project f791ac394f9f4b8d99d2f48f7d04eae9. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:03:53.774432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-c9eb161d-1a53-4fc2-ba0e-b0df0bcc20f1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Getting quotas for user 72f34c080e4a4024a38660e8af252a29 and project f791ac394f9f4b8d99d2f48f7d04eae9. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:03:53.836776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c9eb161d-1a53-4fc2-ba0e-b0df0bcc20f1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:03:53.839384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c9eb161d-1a53-4fc2-ba0e-b0df0bcc20f1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:03:54.012891 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c9eb161d-1a53-4fc2-ba0e-b0df0bcc20f1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.628855 Jul 25 13:03:54.015942 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2209/4506] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:03:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 2633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:03:54.028678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6f375192-44fb-46b1-93b4-481042a0bff6 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:54.031707 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6f375192-44fb-46b1-93b4-481042a0bff6 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] [instance: 3d976748-46cc-41bd-a035-3c01b3f5647c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:54.059291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f375192-44fb-46b1-93b4-481042a0bff6 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:54.061162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f375192-44fb-46b1-93b4-481042a0bff6 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:54.062074 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f375192-44fb-46b1-93b4-481042a0bff6 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:54.062531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f375192-44fb-46b1-93b4-481042a0bff6 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:54.307113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6f375192-44fb-46b1-93b4-481042a0bff6 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:54.320835 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6f375192-44fb-46b1-93b4-481042a0bff6 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:54.322406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6f375192-44fb-46b1-93b4-481042a0bff6 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad6ab9f716a14b9ab28e867c6d497777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0747b08d4f514b1aac90c4c66104d44a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:54.326193 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6f375192-44fb-46b1-93b4-481042a0bff6 tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] 10.222.0.49 "GET /compute/v2.1/servers/3d976748-46cc-41bd-a035-3c01b3f5647c" status: 200 len: 1366 microversion: 2.47 time: 0.308474 Jul 25 13:03:54.326791 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2210/4507] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:03:54 2022] GET /compute/v2.1/servers/3d976748-46cc-41bd-a035-3c01b3f5647c => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:03:54.343079 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-92ab78d2-1dad-40a7-8fe9-e16523890a51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:54.343715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-92ab78d2-1dad-40a7-8fe9-e16523890a51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:54.526963 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-92ab78d2-1dad-40a7-8fe9-e16523890a51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:54.539894 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-92ab78d2-1dad-40a7-8fe9-e16523890a51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1221 microversion: 2.1 time: 0.202904 Jul 25 13:03:54.543752 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2211/4508] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:54 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1221 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:54.699749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2fbfcfae-34fc-4767-b9a2-c2e47c3a8a51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2145900238", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:03:54.784000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-14f9f474-72b9-4c77-832d-41b59d380d39 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:03:54.810056 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-14f9f474-72b9-4c77-832d-41b59d380d39 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1691 microversion: 2.1 time: 1.099634 Jul 25 13:03:54.810683 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2298/4509] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:53 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1691 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:03:54.878180 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-2fbfcfae-34fc-4767-b9a2-c2e47c3a8a51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] validate_networks() for [('c1395e55-cd66-4325-bef1-b570c194020a', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:03:55.067907 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fca3353b-8f2b-4b19-a57d-01ec8e7bcb6d tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-125355213", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1160942223", "security_groups": [{"name": "tempest-secgroup-smoke-1197596824"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "014b76eb-14bb-48f1-8ceb-f0149dfdbb2e"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:03:55.101592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:55.569728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-fca3353b-8f2b-4b19-a57d-01ec8e7bcb6d tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] validate_networks() for [('014b76eb-14bb-48f1-8ceb-f0149dfdbb2e', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:03:59.022422 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2fbfcfae-34fc-4767-b9a2-c2e47c3a8a51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:03:59.023640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2fbfcfae-34fc-4767-b9a2-c2e47c3a8a51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:03:59.024325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2fbfcfae-34fc-4767-b9a2-c2e47c3a8a51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:03:59.024915 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2fbfcfae-34fc-4767-b9a2-c2e47c3a8a51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:03:59.025522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2fbfcfae-34fc-4767-b9a2-c2e47c3a8a51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:03:59.057035 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fbfcfae-34fc-4767-b9a2-c2e47c3a8a51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:59.064156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fbfcfae-34fc-4767-b9a2-c2e47c3a8a51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:59.068357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fbfcfae-34fc-4767-b9a2-c2e47c3a8a51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:59.073520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fbfcfae-34fc-4767-b9a2-c2e47c3a8a51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:59.162087 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-2fbfcfae-34fc-4767-b9a2-c2e47c3a8a51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Getting quotas for project f791ac394f9f4b8d99d2f48f7d04eae9. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:03:59.175291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-2fbfcfae-34fc-4767-b9a2-c2e47c3a8a51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Getting quotas for user 72f34c080e4a4024a38660e8af252a29 and project f791ac394f9f4b8d99d2f48f7d04eae9. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:03:59.205571 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2fbfcfae-34fc-4767-b9a2-c2e47c3a8a51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:03:59.209230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2fbfcfae-34fc-4767-b9a2-c2e47c3a8a51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:03:59.286348 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2fbfcfae-34fc-4767-b9a2-c2e47c3a8a51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.593413 Jul 25 13:03:59.288928 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2212/4510] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:03:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 4597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:03:59.316234 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ed45db91-2e95-4a28-a330-9235e7a5b61e tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:59.320168 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ed45db91-2e95-4a28-a330-9235e7a5b61e tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] [instance: 3d976748-46cc-41bd-a035-3c01b3f5647c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:59.358170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ed45db91-2e95-4a28-a330-9235e7a5b61e tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:59.365903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ed45db91-2e95-4a28-a330-9235e7a5b61e tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:59.372215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ed45db91-2e95-4a28-a330-9235e7a5b61e tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:59.374718 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ed45db91-2e95-4a28-a330-9235e7a5b61e tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:59.427359 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-ed45db91-2e95-4a28-a330-9235e7a5b61e tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] HTTP exception thrown: Instance 3d976748-46cc-41bd-a035-3c01b3f5647c could not be found. Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ed45db91-2e95-4a28-a330-9235e7a5b61e tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Request method failure captured: Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/3d976748-46cc-41bd-a035-3c01b3f5647c HTTP/1.1 Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pSuoMG_0mjFQm_OyIAFVsuIROBrcOP1vUYSvI0SNAo29mJ1mpw1R63ur4_9bf6cPrLyW66xO4pYi_In1Q2dibyd69MKyzSw3byiWNDztDW7HxajBhc52rQUhgesXaLDXCG6MMFD0prXPxnmuqawc83DPzVHMQ9JO-kxaSOTy4YIJck Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: X-Openstack-Nova-Api-Version: 2.47 Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 0747b08d4f514b1aac90c4c66104d44a Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersAaction247Test-1272976753 Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0747b08d4f514b1aac90c4c66104d44a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0747b08d4f514b1aac90c4c66104d44a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0747b08d4f514b1aac90c4c66104d44a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0747b08d4f514b1aac90c4c66104d44a"}]}] Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersAaction247Test-1272976753 Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 0747b08d4f514b1aac90c4c66104d44a Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersAaction247Test-1272976753 Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersAaction247Test-1272976753-project Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: ad6ab9f716a14b9ab28e867c6d497777 Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersAaction247Test-1272976753-project Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 3d976748-46cc-41bd-a035-3c01b3f5647c could not be found. Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '3d976748-46cc-41bd-a035-3c01b3f5647c'} Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d976748-46cc-41bd-a035-3c01b3f5647c could not be found. Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d976748-46cc-41bd-a035-3c01b3f5647c could not be found. Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:03:59.429476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:59.436043 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:03:59.436043 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:03:59.436043 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:03:59.436043 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:03:59.436043 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:03:59.436043 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d976748-46cc-41bd-a035-3c01b3f5647c could not be found. Jul 25 13:03:59.436043 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:03:59.438211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ed45db91-2e95-4a28-a330-9235e7a5b61e tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] Returning 404 to user: Instance 3d976748-46cc-41bd-a035-3c01b3f5647c could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:03:59.439819 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ed45db91-2e95-4a28-a330-9235e7a5b61e tempest-ServersAaction247Test-1272976753 tempest-ServersAaction247Test-1272976753-project] 10.222.0.49 "GET /compute/v2.1/servers/3d976748-46cc-41bd-a035-3c01b3f5647c" status: 404 len: 111 microversion: 2.47 time: 0.147874 Jul 25 13:03:59.441514 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2213/4511] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:03:59 2022] GET /compute/v2.1/servers/3d976748-46cc-41bd-a035-3c01b3f5647c => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:03:59.467378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e47d95ca-081b-4d98-9b16-2bfbf6db8470 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:03:59.471730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e47d95ca-081b-4d98-9b16-2bfbf6db8470 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:03:59.506587 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e47d95ca-081b-4d98-9b16-2bfbf6db8470 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:59.507062 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e47d95ca-081b-4d98-9b16-2bfbf6db8470 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:03:59.510839 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e47d95ca-081b-4d98-9b16-2bfbf6db8470 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:03:59.511313 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e47d95ca-081b-4d98-9b16-2bfbf6db8470 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:00.740666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-fca3353b-8f2b-4b19-a57d-01ec8e7bcb6d tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Getting quotas for project d9ef6028fa1c460b8cab5f7d9082abfa. Resources: dict_keys(['metadata_items']) {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:04:00.756819 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-fca3353b-8f2b-4b19-a57d-01ec8e7bcb6d tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Getting quotas for user 48e6a20408894330b3b3734a455a078c and project d9ef6028fa1c460b8cab5f7d9082abfa. Resources: dict_keys(['metadata_items']) {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:04:00.784759 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-fca3353b-8f2b-4b19-a57d-01ec8e7bcb6d tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:04:00.785497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-fca3353b-8f2b-4b19-a57d-01ec8e7bcb6d tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:04:00.786203 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-fca3353b-8f2b-4b19-a57d-01ec8e7bcb6d tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:04:00.786816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-fca3353b-8f2b-4b19-a57d-01ec8e7bcb6d tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:04:00.787471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-fca3353b-8f2b-4b19-a57d-01ec8e7bcb6d tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:04:00.803635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fca3353b-8f2b-4b19-a57d-01ec8e7bcb6d tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:00.804478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fca3353b-8f2b-4b19-a57d-01ec8e7bcb6d tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:00.805529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fca3353b-8f2b-4b19-a57d-01ec8e7bcb6d tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:00.806364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fca3353b-8f2b-4b19-a57d-01ec8e7bcb6d tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:00.820488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:00.852716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-fca3353b-8f2b-4b19-a57d-01ec8e7bcb6d tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Getting quotas for project d9ef6028fa1c460b8cab5f7d9082abfa. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:04:00.894016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-fca3353b-8f2b-4b19-a57d-01ec8e7bcb6d tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Getting quotas for user 48e6a20408894330b3b3734a455a078c and project d9ef6028fa1c460b8cab5f7d9082abfa. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:04:00.954361 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fca3353b-8f2b-4b19-a57d-01ec8e7bcb6d tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:04:00.959136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fca3353b-8f2b-4b19-a57d-01ec8e7bcb6d tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:04:01.116034 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fca3353b-8f2b-4b19-a57d-01ec8e7bcb6d tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 6.052671 Jul 25 13:04:01.148770 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2299/4512] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:03:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 6086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:04:01.156650 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5868a25e-a30f-4f3f-ab0b-a60b2758478a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:01.157651 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5868a25e-a30f-4f3f-ab0b-a60b2758478a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:01.199038 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5868a25e-a30f-4f3f-ab0b-a60b2758478a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:01.200055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5868a25e-a30f-4f3f-ab0b-a60b2758478a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:01.201281 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5868a25e-a30f-4f3f-ab0b-a60b2758478a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:01.210671 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5868a25e-a30f-4f3f-ab0b-a60b2758478a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:02.038995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5868a25e-a30f-4f3f-ab0b-a60b2758478a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:02.076678 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5868a25e-a30f-4f3f-ab0b-a60b2758478a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1274 microversion: 2.1 time: 0.922021 Jul 25 13:04:02.078435 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2300/4513] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:01 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1274 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:02.102247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9aa6c6a6-0d74-4dbb-8739-9f57f14d4be1 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:02.105277 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9aa6c6a6-0d74-4dbb-8739-9f57f14d4be1 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:02.139587 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e47d95ca-081b-4d98-9b16-2bfbf6db8470 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:02.148404 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e47d95ca-081b-4d98-9b16-2bfbf6db8470 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1691 microversion: 2.1 time: 2.702099 Jul 25 13:04:02.153437 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2214/4514] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:03:59 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1691 bytes in 2708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:02.279160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9aa6c6a6-0d74-4dbb-8739-9f57f14d4be1 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e6a20408894330b3b3734a455a078c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ef6028fa1c460b8cab5f7d9082abfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:02.312954 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9aa6c6a6-0d74-4dbb-8739-9f57f14d4be1 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 200 len: 1302 microversion: 2.1 time: 0.231351 Jul 25 13:04:02.314048 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2301/4515] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:02 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 1302 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:03.100174 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-34bbb7f1-1966-4c3a-9a4f-6a2fcb250b16 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:03.101872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-34bbb7f1-1966-4c3a-9a4f-6a2fcb250b16 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:03.114740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-34bbb7f1-1966-4c3a-9a4f-6a2fcb250b16 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:03.129182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-34bbb7f1-1966-4c3a-9a4f-6a2fcb250b16 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:03.133482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-34bbb7f1-1966-4c3a-9a4f-6a2fcb250b16 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:03.133482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-34bbb7f1-1966-4c3a-9a4f-6a2fcb250b16 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:03.196169 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a5f6ceb1-ab5a-487d-ba87-a1e65e6f89cb tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:03.196638 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a5f6ceb1-ab5a-487d-ba87-a1e65e6f89cb tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:03.222440 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5f6ceb1-ab5a-487d-ba87-a1e65e6f89cb tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:03.224092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5f6ceb1-ab5a-487d-ba87-a1e65e6f89cb tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:03.226471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5f6ceb1-ab5a-487d-ba87-a1e65e6f89cb tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:03.230065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5f6ceb1-ab5a-487d-ba87-a1e65e6f89cb tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:03.742196 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-34bbb7f1-1966-4c3a-9a4f-6a2fcb250b16 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:03.758282 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-34bbb7f1-1966-4c3a-9a4f-6a2fcb250b16 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1280 microversion: 2.1 time: 0.658887 Jul 25 13:04:03.770959 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2215/4516] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:03 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1280 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:03.821638 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-22799e79-742b-471d-8ec5-62bea0c7b99a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:03.823517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-22799e79-742b-471d-8ec5-62bea0c7b99a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:03.843134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22799e79-742b-471d-8ec5-62bea0c7b99a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:03.846578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22799e79-742b-471d-8ec5-62bea0c7b99a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:03.848471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22799e79-742b-471d-8ec5-62bea0c7b99a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:03.851507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22799e79-742b-471d-8ec5-62bea0c7b99a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:04.067247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a5f6ceb1-ab5a-487d-ba87-a1e65e6f89cb tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:04.082837 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a5f6ceb1-ab5a-487d-ba87-a1e65e6f89cb tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1696 microversion: 2.1 time: 0.901730 Jul 25 13:04:04.083765 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2302/4517] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:03 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1696 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:04.172592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-22799e79-742b-471d-8ec5-62bea0c7b99a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e6a20408894330b3b3734a455a078c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ef6028fa1c460b8cab5f7d9082abfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:04.193365 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-22799e79-742b-471d-8ec5-62bea0c7b99a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 200 len: 1360 microversion: 2.1 time: 0.420739 Jul 25 13:04:04.196008 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2216/4518] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:03 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 1360 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:04.788489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5402fa19-05ac-42b7-b8a4-76ae8913ce22 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:04.789119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5402fa19-05ac-42b7-b8a4-76ae8913ce22 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:04.805357 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5402fa19-05ac-42b7-b8a4-76ae8913ce22 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:04.805822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5402fa19-05ac-42b7-b8a4-76ae8913ce22 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:04.806770 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5402fa19-05ac-42b7-b8a4-76ae8913ce22 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:04.807210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5402fa19-05ac-42b7-b8a4-76ae8913ce22 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:05.107425 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1ff207d8-8c0b-452c-8de7-8941449c8d96 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:05.109271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1ff207d8-8c0b-452c-8de7-8941449c8d96 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:05.123753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ff207d8-8c0b-452c-8de7-8941449c8d96 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:05.126070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ff207d8-8c0b-452c-8de7-8941449c8d96 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:05.127205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ff207d8-8c0b-452c-8de7-8941449c8d96 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:05.127828 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ff207d8-8c0b-452c-8de7-8941449c8d96 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:05.262628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5402fa19-05ac-42b7-b8a4-76ae8913ce22 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:05.274609 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5402fa19-05ac-42b7-b8a4-76ae8913ce22 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1280 microversion: 2.1 time: 0.490128 Jul 25 13:04:05.275982 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2303/4519] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:04 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1280 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:05.283066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5ffc397c-846f-4135-923f-59aeddc26e70 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:05.284180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5ffc397c-846f-4135-923f-59aeddc26e70 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:05.298996 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5ffc397c-846f-4135-923f-59aeddc26e70 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:05.299971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5ffc397c-846f-4135-923f-59aeddc26e70 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:05.302245 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5ffc397c-846f-4135-923f-59aeddc26e70 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:05.303419 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5ffc397c-846f-4135-923f-59aeddc26e70 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:05.557042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5ffc397c-846f-4135-923f-59aeddc26e70 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e6a20408894330b3b3734a455a078c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ef6028fa1c460b8cab5f7d9082abfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:05.571782 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5ffc397c-846f-4135-923f-59aeddc26e70 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 200 len: 1360 microversion: 2.1 time: 0.293369 Jul 25 13:04:05.573019 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2304/4520] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:05 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 1360 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:05.894559 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1ff207d8-8c0b-452c-8de7-8941449c8d96 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:05.903840 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1ff207d8-8c0b-452c-8de7-8941449c8d96 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1696 microversion: 2.1 time: 0.800246 Jul 25 13:04:05.906184 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2217/4521] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:05 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1696 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:04:06.298176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d4a7d9c5-a5f8-4ad1-99ff-ae69d19ed354 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:06.299107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d4a7d9c5-a5f8-4ad1-99ff-ae69d19ed354 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:06.315099 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d4a7d9c5-a5f8-4ad1-99ff-ae69d19ed354 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:06.315602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d4a7d9c5-a5f8-4ad1-99ff-ae69d19ed354 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:06.316581 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d4a7d9c5-a5f8-4ad1-99ff-ae69d19ed354 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:06.318332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d4a7d9c5-a5f8-4ad1-99ff-ae69d19ed354 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:06.595058 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6a8eec7e-89d7-4904-a373-b81fc2508f82 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:06.595892 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6a8eec7e-89d7-4904-a373-b81fc2508f82 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:06.619368 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a8eec7e-89d7-4904-a373-b81fc2508f82 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:06.622197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a8eec7e-89d7-4904-a373-b81fc2508f82 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:06.623185 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a8eec7e-89d7-4904-a373-b81fc2508f82 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:06.626325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a8eec7e-89d7-4904-a373-b81fc2508f82 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:07.330475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6a8eec7e-89d7-4904-a373-b81fc2508f82 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e6a20408894330b3b3734a455a078c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ef6028fa1c460b8cab5f7d9082abfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:07.342249 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6a8eec7e-89d7-4904-a373-b81fc2508f82 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 200 len: 1360 microversion: 2.1 time: 0.753405 Jul 25 13:04:07.343302 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2218/4522] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:06 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 1360 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:07.348951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b67fc209-e6e6-45be-9b4f-cb01bc79c0ab tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:07.351461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b67fc209-e6e6-45be-9b4f-cb01bc79c0ab tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:07.380505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b67fc209-e6e6-45be-9b4f-cb01bc79c0ab tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:07.391841 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b67fc209-e6e6-45be-9b4f-cb01bc79c0ab tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:07.398135 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b67fc209-e6e6-45be-9b4f-cb01bc79c0ab tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:07.401136 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b67fc209-e6e6-45be-9b4f-cb01bc79c0ab tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:07.494986 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d4a7d9c5-a5f8-4ad1-99ff-ae69d19ed354 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:07.509809 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d4a7d9c5-a5f8-4ad1-99ff-ae69d19ed354 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1322 microversion: 2.1 time: 1.216812 Jul 25 13:04:07.527697 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2305/4523] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:06 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1322 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:07.760425 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-59874597-2a10-42a6-9129-dc73966aa93e req-54326266-128f-4a95-a01a-c4fcc0a958da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a", "tag": "2bb09fac-7b20-4053-a73f-18fa6c811b67"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:07.778334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-59874597-2a10-42a6-9129-dc73966aa93e req-54326266-128f-4a95-a01a-c4fcc0a958da service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:07.782940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-59874597-2a10-42a6-9129-dc73966aa93e req-54326266-128f-4a95-a01a-c4fcc0a958da service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:07.806504 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-59874597-2a10-42a6-9129-dc73966aa93e req-54326266-128f-4a95-a01a-c4fcc0a958da service nova] Creating event network-changed:2bb09fac-7b20-4053-a73f-18fa6c811b67 for instance 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a on n-h2-848886-15 Jul 25 13:04:07.814689 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-59874597-2a10-42a6-9129-dc73966aa93e req-54326266-128f-4a95-a01a-c4fcc0a958da service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058718 Jul 25 13:04:07.818485 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2306/4524] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:04:08.358346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b67fc209-e6e6-45be-9b4f-cb01bc79c0ab tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:08.364726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b1a78e88-08d5-40b5-b07b-08bf26ad558e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:08.365449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b1a78e88-08d5-40b5-b07b-08bf26ad558e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:08.375670 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b67fc209-e6e6-45be-9b4f-cb01bc79c0ab tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1696 microversion: 2.1 time: 1.030884 Jul 25 13:04:08.377866 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b1a78e88-08d5-40b5-b07b-08bf26ad558e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:08.378341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b1a78e88-08d5-40b5-b07b-08bf26ad558e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:08.379177 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b1a78e88-08d5-40b5-b07b-08bf26ad558e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:08.379627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b1a78e88-08d5-40b5-b07b-08bf26ad558e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:08.399069 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2219/4525] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:07 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1696 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:08.542582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-39335dbb-6fd4-419f-8187-69ebba7e3f62 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:08.544347 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-39335dbb-6fd4-419f-8187-69ebba7e3f62 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:08.580245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39335dbb-6fd4-419f-8187-69ebba7e3f62 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:08.580580 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39335dbb-6fd4-419f-8187-69ebba7e3f62 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:08.581395 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39335dbb-6fd4-419f-8187-69ebba7e3f62 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:08.581884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39335dbb-6fd4-419f-8187-69ebba7e3f62 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:08.755005 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b1a78e88-08d5-40b5-b07b-08bf26ad558e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e6a20408894330b3b3734a455a078c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ef6028fa1c460b8cab5f7d9082abfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:08.768532 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b1a78e88-08d5-40b5-b07b-08bf26ad558e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 200 len: 1360 microversion: 2.1 time: 0.408897 Jul 25 13:04:08.769759 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2307/4526] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:08 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 1360 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:04:09.106825 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:09.185182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=24 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:09.404906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ca5f54f7-010f-48a6-9d99-8a309d7fe29d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:09.406123 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ca5f54f7-010f-48a6-9d99-8a309d7fe29d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:09.440142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ca5f54f7-010f-48a6-9d99-8a309d7fe29d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:09.441824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ca5f54f7-010f-48a6-9d99-8a309d7fe29d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:09.454533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ca5f54f7-010f-48a6-9d99-8a309d7fe29d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:09.455774 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ca5f54f7-010f-48a6-9d99-8a309d7fe29d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:09.670467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-39335dbb-6fd4-419f-8187-69ebba7e3f62 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:09.682722 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-39335dbb-6fd4-419f-8187-69ebba7e3f62 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1322 microversion: 2.1 time: 1.143558 Jul 25 13:04:09.699654 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2220/4527] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:08 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1322 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:09.796653 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c482ab29-0664-433a-ac9d-42dd807f591e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:09.797701 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c482ab29-0664-433a-ac9d-42dd807f591e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:09.822201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c482ab29-0664-433a-ac9d-42dd807f591e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:09.830616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c482ab29-0664-433a-ac9d-42dd807f591e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:09.834114 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c482ab29-0664-433a-ac9d-42dd807f591e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:09.834855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c482ab29-0664-433a-ac9d-42dd807f591e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:10.822941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:11.464500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ca5f54f7-010f-48a6-9d99-8a309d7fe29d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:11.486966 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ca5f54f7-010f-48a6-9d99-8a309d7fe29d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1696 microversion: 2.1 time: 2.084117 Jul 25 13:04:11.503833 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2308/4528] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:09 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1696 bytes in 2098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:11.521020 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1e988684-5df2-4019-95f6-4e1c4f7ddad2 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:11.521938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1e988684-5df2-4019-95f6-4e1c4f7ddad2 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:11.530319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1e988684-5df2-4019-95f6-4e1c4f7ddad2 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:11.531072 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1e988684-5df2-4019-95f6-4e1c4f7ddad2 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:11.532106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1e988684-5df2-4019-95f6-4e1c4f7ddad2 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:11.532704 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1e988684-5df2-4019-95f6-4e1c4f7ddad2 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:11.602777 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1e988684-5df2-4019-95f6-4e1c4f7ddad2 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e/ips" status: 200 len: 145 microversion: 2.1 time: 0.085648 Jul 25 13:04:11.613781 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2309/4529] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Jul 25 13:04:11 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e/ips => generated 145 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:04:11.624844 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-964ea5b9-f4f2-4852-aa20-dabf59b24f0b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:11.626529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-964ea5b9-f4f2-4852-aa20-dabf59b24f0b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:11.646916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-964ea5b9-f4f2-4852-aa20-dabf59b24f0b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:11.652560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-964ea5b9-f4f2-4852-aa20-dabf59b24f0b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:11.654101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-964ea5b9-f4f2-4852-aa20-dabf59b24f0b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:11.654745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-964ea5b9-f4f2-4852-aa20-dabf59b24f0b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:12.005498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c482ab29-0664-433a-ac9d-42dd807f591e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e6a20408894330b3b3734a455a078c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ef6028fa1c460b8cab5f7d9082abfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:12.020623 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c482ab29-0664-433a-ac9d-42dd807f591e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 200 len: 1428 microversion: 2.1 time: 2.227906 Jul 25 13:04:12.025968 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2221/4530] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:09 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 1428 bytes in 2232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:04:12.290506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=12 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:12.541299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3a741ca9-171b-4c3c-b7bf-25a0d3985590 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:12.542359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3a741ca9-171b-4c3c-b7bf-25a0d3985590 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:12.585444 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a741ca9-171b-4c3c-b7bf-25a0d3985590 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:12.588337 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a741ca9-171b-4c3c-b7bf-25a0d3985590 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:12.589748 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a741ca9-171b-4c3c-b7bf-25a0d3985590 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:12.597483 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a741ca9-171b-4c3c-b7bf-25a0d3985590 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:13.009711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-964ea5b9-f4f2-4852-aa20-dabf59b24f0b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:13.034267 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-964ea5b9-f4f2-4852-aa20-dabf59b24f0b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1322 microversion: 2.1 time: 1.416283 Jul 25 13:04:13.038187 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2310/4531] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:11 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1322 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:13.076304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b8b78543-645d-4063-b5da-afe57112dea6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:13.086249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b8b78543-645d-4063-b5da-afe57112dea6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:13.119825 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8b78543-645d-4063-b5da-afe57112dea6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:13.121882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8b78543-645d-4063-b5da-afe57112dea6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:13.129133 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8b78543-645d-4063-b5da-afe57112dea6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:13.131821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8b78543-645d-4063-b5da-afe57112dea6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:13.429115 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3a741ca9-171b-4c3c-b7bf-25a0d3985590 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:13.459022 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3a741ca9-171b-4c3c-b7bf-25a0d3985590 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1696 microversion: 2.1 time: 0.951497 Jul 25 13:04:13.460024 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2222/4532] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:12 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1696 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:14.064542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-99b4a9c4-5ccb-4b1e-9db6-c20285ad498f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:14.065460 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-99b4a9c4-5ccb-4b1e-9db6-c20285ad498f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:14.080224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-99b4a9c4-5ccb-4b1e-9db6-c20285ad498f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:14.081126 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-99b4a9c4-5ccb-4b1e-9db6-c20285ad498f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:14.082784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-99b4a9c4-5ccb-4b1e-9db6-c20285ad498f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:14.088194 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-99b4a9c4-5ccb-4b1e-9db6-c20285ad498f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:14.142594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b8b78543-645d-4063-b5da-afe57112dea6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e6a20408894330b3b3734a455a078c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ef6028fa1c460b8cab5f7d9082abfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:14.159130 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b8b78543-645d-4063-b5da-afe57112dea6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 200 len: 1428 microversion: 2.1 time: 1.107212 Jul 25 13:04:14.163681 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2311/4533] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:13 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 1428 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:14.343635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-bdd5b1cf-6d52-42a4-89d1-a755127a05d1 req-53915182-929e-4f31-b65e-4719243dabc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8931f252-9f17-4c5f-ba34-8de681154571", "tag": "adfd7df8-3366-4c53-9640-277b67fb3cc1"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:14.363780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-bdd5b1cf-6d52-42a4-89d1-a755127a05d1 req-53915182-929e-4f31-b65e-4719243dabc7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:14.364600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-bdd5b1cf-6d52-42a4-89d1-a755127a05d1 req-53915182-929e-4f31-b65e-4719243dabc7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:14.387177 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-bdd5b1cf-6d52-42a4-89d1-a755127a05d1 req-53915182-929e-4f31-b65e-4719243dabc7 service nova] Creating event network-changed:adfd7df8-3366-4c53-9640-277b67fb3cc1 for instance 8931f252-9f17-4c5f-ba34-8de681154571 on n-h2-848886-15 Jul 25 13:04:14.416022 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-bdd5b1cf-6d52-42a4-89d1-a755127a05d1 req-53915182-929e-4f31-b65e-4719243dabc7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077836 Jul 25 13:04:14.418217 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2312/4534] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:04:14.486596 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-33d243df-5e52-4e2a-890c-59184962a30a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:14.487389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-33d243df-5e52-4e2a-890c-59184962a30a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:14.515347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-33d243df-5e52-4e2a-890c-59184962a30a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:14.516043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-33d243df-5e52-4e2a-890c-59184962a30a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:14.516968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-33d243df-5e52-4e2a-890c-59184962a30a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:14.519556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-33d243df-5e52-4e2a-890c-59184962a30a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:16.297671 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-99b4a9c4-5ccb-4b1e-9db6-c20285ad498f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:16.305762 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-99b4a9c4-5ccb-4b1e-9db6-c20285ad498f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1322 microversion: 2.1 time: 2.245555 Jul 25 13:04:16.309226 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2223/4535] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:14 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1322 bytes in 2250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:04:16.316303 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0aaaa37e-34be-4960-9c5c-737aeda98729 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:16.320263 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0aaaa37e-34be-4960-9c5c-737aeda98729 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:16.332481 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=7 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:16.336971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0aaaa37e-34be-4960-9c5c-737aeda98729 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:16.338977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0aaaa37e-34be-4960-9c5c-737aeda98729 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:16.339859 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0aaaa37e-34be-4960-9c5c-737aeda98729 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:16.340481 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0aaaa37e-34be-4960-9c5c-737aeda98729 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:16.814855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-33d243df-5e52-4e2a-890c-59184962a30a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:16.832690 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-33d243df-5e52-4e2a-890c-59184962a30a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1695 microversion: 2.1 time: 2.351052 Jul 25 13:04:16.837904 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2313/4536] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:14 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1695 bytes in 2354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:04:17.063192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-6cccf88c-d525-4b72-8f88-9abb109f3062 req-ba1ecfd3-cb9d-4f71-98bc-6d42bebeac36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a", "name": "network-vif-plugged", "status": "completed", "tag": "2bb09fac-7b20-4053-a73f-18fa6c811b67"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:17.079540 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6cccf88c-d525-4b72-8f88-9abb109f3062 req-ba1ecfd3-cb9d-4f71-98bc-6d42bebeac36 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:17.080291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6cccf88c-d525-4b72-8f88-9abb109f3062 req-ba1ecfd3-cb9d-4f71-98bc-6d42bebeac36 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:17.092999 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-6cccf88c-d525-4b72-8f88-9abb109f3062 req-ba1ecfd3-cb9d-4f71-98bc-6d42bebeac36 service nova] Creating event network-vif-plugged:2bb09fac-7b20-4053-a73f-18fa6c811b67 for instance 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a on n-h2-848886-15 Jul 25 13:04:17.099627 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-6cccf88c-d525-4b72-8f88-9abb109f3062 req-ba1ecfd3-cb9d-4f71-98bc-6d42bebeac36 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.263614 Jul 25 13:04:17.100901 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2314/4537] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:04:17.109061 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ffc58ec8-0076-4eb2-bf3a-db2a4fd2d488 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2b21791-dcb4-48ad-86dc-5e592c10e644"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:17.112324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ffc58ec8-0076-4eb2-bf3a-db2a4fd2d488 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:17.121368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ffc58ec8-0076-4eb2-bf3a-db2a4fd2d488 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:17.124505 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ffc58ec8-0076-4eb2-bf3a-db2a4fd2d488 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:17.125700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ffc58ec8-0076-4eb2-bf3a-db2a4fd2d488 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:17.126420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ffc58ec8-0076-4eb2-bf3a-db2a4fd2d488 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:17.522024 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ffc58ec8-0076-4eb2-bf3a-db2a4fd2d488 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "POST /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.419383 Jul 25 13:04:17.525763 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2315/4538] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Jul 25 13:04:17 2022] POST /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:04:17.539248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-99093492-0447-4cb8-81c6-4d74b7e8d186 req-48a07c3b-99fb-460e-9799-0ef4885801eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83ce5d82-2762-4aa7-855c-963a23f26665", "tag": "35e7321c-7aa5-4daa-8504-c9f77811ff51"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:17.596997 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-99093492-0447-4cb8-81c6-4d74b7e8d186 req-48a07c3b-99fb-460e-9799-0ef4885801eb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:17.598876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-99093492-0447-4cb8-81c6-4d74b7e8d186 req-48a07c3b-99fb-460e-9799-0ef4885801eb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:17.629539 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0aaaa37e-34be-4960-9c5c-737aeda98729 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e6a20408894330b3b3734a455a078c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ef6028fa1c460b8cab5f7d9082abfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:17.643577 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0aaaa37e-34be-4960-9c5c-737aeda98729 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 200 len: 1428 microversion: 2.1 time: 1.332864 Jul 25 13:04:17.649950 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2224/4539] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:16 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 1428 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:17.656051 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-99093492-0447-4cb8-81c6-4d74b7e8d186 req-48a07c3b-99fb-460e-9799-0ef4885801eb service nova] Creating event network-changed:35e7321c-7aa5-4daa-8504-c9f77811ff51 for instance 83ce5d82-2762-4aa7-855c-963a23f26665 on n-h1-848886-15 Jul 25 13:04:17.661364 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-76b9a17d-fec2-48b6-a6fe-8aa05ac8e699 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:17.667869 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-99093492-0447-4cb8-81c6-4d74b7e8d186 req-48a07c3b-99fb-460e-9799-0ef4885801eb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140036 Jul 25 13:04:17.678095 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2316/4540] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:04:17.678602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-76b9a17d-fec2-48b6-a6fe-8aa05ac8e699 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:17.713376 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-76b9a17d-fec2-48b6-a6fe-8aa05ac8e699 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:17.719515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-76b9a17d-fec2-48b6-a6fe-8aa05ac8e699 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:17.724447 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-76b9a17d-fec2-48b6-a6fe-8aa05ac8e699 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:17.724986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-76b9a17d-fec2-48b6-a6fe-8aa05ac8e699 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:17.862431 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-26894955-45dc-4493-bd59-fa36390cd5d6 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:17.863897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-26894955-45dc-4493-bd59-fa36390cd5d6 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:17.874490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-26894955-45dc-4493-bd59-fa36390cd5d6 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:17.878401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-26894955-45dc-4493-bd59-fa36390cd5d6 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:17.883550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-26894955-45dc-4493-bd59-fa36390cd5d6 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:17.884252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-26894955-45dc-4493-bd59-fa36390cd5d6 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:19.608402 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-26894955-45dc-4493-bd59-fa36390cd5d6 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:19.638381 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-26894955-45dc-4493-bd59-fa36390cd5d6 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1695 microversion: 2.1 time: 1.783498 Jul 25 13:04:19.639803 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2317/4541] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:17 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1695 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:19.647600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-351fda78-1b77-44cb-82cc-55aa1a48c73f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:19.651398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-351fda78-1b77-44cb-82cc-55aa1a48c73f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:19.663866 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-76b9a17d-fec2-48b6-a6fe-8aa05ac8e699 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:19.690337 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-76b9a17d-fec2-48b6-a6fe-8aa05ac8e699 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1322 microversion: 2.1 time: 2.037685 Jul 25 13:04:19.695058 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-351fda78-1b77-44cb-82cc-55aa1a48c73f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:19.697297 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-351fda78-1b77-44cb-82cc-55aa1a48c73f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:19.698399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-351fda78-1b77-44cb-82cc-55aa1a48c73f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:19.698525 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2225/4542] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:17 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1322 bytes in 2047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:19.700790 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-351fda78-1b77-44cb-82cc-55aa1a48c73f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:19.879616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-e7954671-c862-49f6-be3b-6c523624c385 req-4b9735fa-a8e3-40a1-87da-725a29694d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "486f49b3-3f54-478c-9c21-c33a16ae4fde", "name": "network-vif-unplugged", "status": "completed", "tag": "fefdb487-385f-4f8b-b1dd-99ad9fb2469d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:19.911096 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e7954671-c862-49f6-be3b-6c523624c385 req-4b9735fa-a8e3-40a1-87da-725a29694d6a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:19.911462 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e7954671-c862-49f6-be3b-6c523624c385 req-4b9735fa-a8e3-40a1-87da-725a29694d6a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:19.976521 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-e7954671-c862-49f6-be3b-6c523624c385 req-4b9735fa-a8e3-40a1-87da-725a29694d6a service nova] Creating event network-vif-unplugged:fefdb487-385f-4f8b-b1dd-99ad9fb2469d for instance 486f49b3-3f54-478c-9c21-c33a16ae4fde on n-h2-848886-15 Jul 25 13:04:19.990366 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:19.997228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [req-e7954671-c862-49f6-be3b-6c523624c385 req-4b9735fa-a8e3-40a1-87da-725a29694d6a service nova] Instance 486f49b3-3f54-478c-9c21-c33a16ae4fde is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125883) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:04:20.019491 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-e7954671-c862-49f6-be3b-6c523624c385 req-4b9735fa-a8e3-40a1-87da-725a29694d6a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.144864 Jul 25 13:04:20.021102 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2226/4543] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:04:20.664295 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8ea66658-f615-43d2-a5f5-38eec3c25d4c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:20.665367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8ea66658-f615-43d2-a5f5-38eec3c25d4c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:20.702097 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ea66658-f615-43d2-a5f5-38eec3c25d4c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:20.710359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ea66658-f615-43d2-a5f5-38eec3c25d4c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:20.711586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ea66658-f615-43d2-a5f5-38eec3c25d4c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:20.715242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ea66658-f615-43d2-a5f5-38eec3c25d4c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:20.802025 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-351fda78-1b77-44cb-82cc-55aa1a48c73f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e6a20408894330b3b3734a455a078c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ef6028fa1c460b8cab5f7d9082abfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:20.816480 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-351fda78-1b77-44cb-82cc-55aa1a48c73f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 200 len: 1428 microversion: 2.1 time: 1.175136 Jul 25 13:04:20.817739 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2318/4544] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:19 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 1428 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:20.822855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-810b52d1-f807-4fd2-b386-27d82fe52cef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:20.834610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-810b52d1-f807-4fd2-b386-27d82fe52cef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:20.837291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:20.851461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-810b52d1-f807-4fd2-b386-27d82fe52cef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:20.852211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-810b52d1-f807-4fd2-b386-27d82fe52cef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:20.853196 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-810b52d1-f807-4fd2-b386-27d82fe52cef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:20.853818 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-810b52d1-f807-4fd2-b386-27d82fe52cef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:20.857778 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:21.840400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8ea66658-f615-43d2-a5f5-38eec3c25d4c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:21.856075 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8ea66658-f615-43d2-a5f5-38eec3c25d4c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1695 microversion: 2.1 time: 1.188255 Jul 25 13:04:21.856758 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2227/4545] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:20 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1695 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:21.870549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-edf7e559-b104-4528-83a2-0e2afea3eb31 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:21.871518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-edf7e559-b104-4528-83a2-0e2afea3eb31 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:21.888593 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-edf7e559-b104-4528-83a2-0e2afea3eb31 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:21.897455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-edf7e559-b104-4528-83a2-0e2afea3eb31 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:21.898612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-edf7e559-b104-4528-83a2-0e2afea3eb31 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:21.899238 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-edf7e559-b104-4528-83a2-0e2afea3eb31 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:22.032209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-810b52d1-f807-4fd2-b386-27d82fe52cef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:22.045559 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-810b52d1-f807-4fd2-b386-27d82fe52cef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1322 microversion: 2.1 time: 1.226368 Jul 25 13:04:22.051624 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2319/4546] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:20 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1322 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:22.700290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-edf7e559-b104-4528-83a2-0e2afea3eb31 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e6a20408894330b3b3734a455a078c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ef6028fa1c460b8cab5f7d9082abfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:22.721769 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-edf7e559-b104-4528-83a2-0e2afea3eb31 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 200 len: 1428 microversion: 2.1 time: 0.863505 Jul 25 13:04:22.734431 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2228/4547] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:21 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 1428 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:22.881183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-008d3413-b17c-46a9-93e7-8e267b994f58 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:22.881474 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-008d3413-b17c-46a9-93e7-8e267b994f58 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:22.911021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-008d3413-b17c-46a9-93e7-8e267b994f58 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:22.917043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-008d3413-b17c-46a9-93e7-8e267b994f58 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:22.923376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-008d3413-b17c-46a9-93e7-8e267b994f58 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:22.928875 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-008d3413-b17c-46a9-93e7-8e267b994f58 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:23.081200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3c1e5003-eb15-4d33-8f07-3ac84bc6ce20 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:23.082467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3c1e5003-eb15-4d33-8f07-3ac84bc6ce20 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:23.093992 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c1e5003-eb15-4d33-8f07-3ac84bc6ce20 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:23.094905 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c1e5003-eb15-4d33-8f07-3ac84bc6ce20 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:23.095969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c1e5003-eb15-4d33-8f07-3ac84bc6ce20 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:23.101229 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3c1e5003-eb15-4d33-8f07-3ac84bc6ce20 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:24.783849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-008d3413-b17c-46a9-93e7-8e267b994f58 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:24.797338 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-008d3413-b17c-46a9-93e7-8e267b994f58 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1695 microversion: 2.1 time: 1.917646 Jul 25 13:04:24.815446 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2320/4548] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:22 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1695 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:04:24.830047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0be3ec61-be07-434f-8e96-9f856640ea61 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:24.831163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0be3ec61-be07-434f-8e96-9f856640ea61 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:24.847502 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0be3ec61-be07-434f-8e96-9f856640ea61 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:24.848284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0be3ec61-be07-434f-8e96-9f856640ea61 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:24.849336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0be3ec61-be07-434f-8e96-9f856640ea61 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:24.850078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0be3ec61-be07-434f-8e96-9f856640ea61 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:24.888966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3c1e5003-eb15-4d33-8f07-3ac84bc6ce20 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:24.908974 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3c1e5003-eb15-4d33-8f07-3ac84bc6ce20 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1322 microversion: 2.1 time: 1.831877 Jul 25 13:04:24.929162 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2229/4549] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:23 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1322 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:25.461319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-e07ffa34-07cf-4140-9471-ab77ae9ae285 req-19505f9a-41b8-4b0f-a54f-e9904f851093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "486f49b3-3f54-478c-9c21-c33a16ae4fde", "tag": "fefdb487-385f-4f8b-b1dd-99ad9fb2469d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:25.512891 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e07ffa34-07cf-4140-9471-ab77ae9ae285 req-19505f9a-41b8-4b0f-a54f-e9904f851093 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:25.513364 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e07ffa34-07cf-4140-9471-ab77ae9ae285 req-19505f9a-41b8-4b0f-a54f-e9904f851093 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:25.540840 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0be3ec61-be07-434f-8e96-9f856640ea61 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e6a20408894330b3b3734a455a078c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ef6028fa1c460b8cab5f7d9082abfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:25.560172 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0be3ec61-be07-434f-8e96-9f856640ea61 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 200 len: 1428 microversion: 2.1 time: 0.738920 Jul 25 13:04:25.560844 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2321/4550] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:24 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 1428 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:25.597143 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-e07ffa34-07cf-4140-9471-ab77ae9ae285 req-19505f9a-41b8-4b0f-a54f-e9904f851093 service nova] Creating event network-changed:fefdb487-385f-4f8b-b1dd-99ad9fb2469d for instance 486f49b3-3f54-478c-9c21-c33a16ae4fde on n-h2-848886-15 Jul 25 13:04:25.611449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [req-e07ffa34-07cf-4140-9471-ab77ae9ae285 req-19505f9a-41b8-4b0f-a54f-e9904f851093 service nova] Instance 486f49b3-3f54-478c-9c21-c33a16ae4fde is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125883) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:04:25.683189 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-e07ffa34-07cf-4140-9471-ab77ae9ae285 req-19505f9a-41b8-4b0f-a54f-e9904f851093 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.760591 Jul 25 13:04:25.685921 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2230/4551] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:04:25.821988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f136565c-d176-4178-9fb7-24345faa8f33 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:25.822652 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f136565c-d176-4178-9fb7-24345faa8f33 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:25.860706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f136565c-d176-4178-9fb7-24345faa8f33 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:25.862083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f136565c-d176-4178-9fb7-24345faa8f33 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:25.867637 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f136565c-d176-4178-9fb7-24345faa8f33 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:25.883954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f136565c-d176-4178-9fb7-24345faa8f33 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:25.942087 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-94ef25c3-aac6-4f6a-a3f5-8049ebffa6d1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:25.944125 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-94ef25c3-aac6-4f6a-a3f5-8049ebffa6d1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:25.992847 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-94ef25c3-aac6-4f6a-a3f5-8049ebffa6d1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:25.993180 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-94ef25c3-aac6-4f6a-a3f5-8049ebffa6d1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:25.993877 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-94ef25c3-aac6-4f6a-a3f5-8049ebffa6d1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:26.010390 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-94ef25c3-aac6-4f6a-a3f5-8049ebffa6d1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:27.219897 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-94ef25c3-aac6-4f6a-a3f5-8049ebffa6d1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:27.242718 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-94ef25c3-aac6-4f6a-a3f5-8049ebffa6d1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1322 microversion: 2.1 time: 1.301298 Jul 25 13:04:27.244047 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2231/4552] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:25 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1322 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:27.251821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-44ff1fd0-d006-409f-849b-cb126e205a9f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:27.263001 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-44ff1fd0-d006-409f-849b-cb126e205a9f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:27.278023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f136565c-d176-4178-9fb7-24345faa8f33 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:27.287488 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f136565c-d176-4178-9fb7-24345faa8f33 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1695 microversion: 2.1 time: 1.469523 Jul 25 13:04:27.292612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-44ff1fd0-d006-409f-849b-cb126e205a9f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:27.294551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-44ff1fd0-d006-409f-849b-cb126e205a9f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:27.303185 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-44ff1fd0-d006-409f-849b-cb126e205a9f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:27.317054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-44ff1fd0-d006-409f-849b-cb126e205a9f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:27.317707 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2322/4553] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:25 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1695 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:27.925980 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-44ff1fd0-d006-409f-849b-cb126e205a9f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e6a20408894330b3b3734a455a078c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ef6028fa1c460b8cab5f7d9082abfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:27.947189 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-44ff1fd0-d006-409f-849b-cb126e205a9f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 200 len: 1428 microversion: 2.1 time: 0.690410 Jul 25 13:04:27.953036 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2232/4554] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:27 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 1428 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:28.267816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b7f197ea-812c-4db5-8a8b-9c6c6a816f2d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:28.268438 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b7f197ea-812c-4db5-8a8b-9c6c6a816f2d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:28.295252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7f197ea-812c-4db5-8a8b-9c6c6a816f2d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:28.295252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7f197ea-812c-4db5-8a8b-9c6c6a816f2d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:28.295252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7f197ea-812c-4db5-8a8b-9c6c6a816f2d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:28.295252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7f197ea-812c-4db5-8a8b-9c6c6a816f2d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:28.667354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9882d396-60aa-4180-ba4c-78d3bae259b3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:28.668983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9882d396-60aa-4180-ba4c-78d3bae259b3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:28.702717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9882d396-60aa-4180-ba4c-78d3bae259b3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:28.704717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9882d396-60aa-4180-ba4c-78d3bae259b3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:28.710341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9882d396-60aa-4180-ba4c-78d3bae259b3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:28.715321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9882d396-60aa-4180-ba4c-78d3bae259b3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:28.933643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b7f197ea-812c-4db5-8a8b-9c6c6a816f2d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:28.941625 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b7f197ea-812c-4db5-8a8b-9c6c6a816f2d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1322 microversion: 2.1 time: 0.677811 Jul 25 13:04:28.952713 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2323/4555] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:28 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1322 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:28.976082 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6980f849-46f7-4a03-9bd7-599e3d3dd48e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:28.976999 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6980f849-46f7-4a03-9bd7-599e3d3dd48e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:28.989186 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6980f849-46f7-4a03-9bd7-599e3d3dd48e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:28.994611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6980f849-46f7-4a03-9bd7-599e3d3dd48e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:29.003098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6980f849-46f7-4a03-9bd7-599e3d3dd48e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:29.004496 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6980f849-46f7-4a03-9bd7-599e3d3dd48e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:29.878314 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9882d396-60aa-4180-ba4c-78d3bae259b3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:29.893348 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9882d396-60aa-4180-ba4c-78d3bae259b3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1693 microversion: 2.1 time: 1.564413 Jul 25 13:04:29.895353 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2233/4556] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:28 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1693 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:29.920030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6980f849-46f7-4a03-9bd7-599e3d3dd48e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e6a20408894330b3b3734a455a078c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ef6028fa1c460b8cab5f7d9082abfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:29.929468 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6980f849-46f7-4a03-9bd7-599e3d3dd48e tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 200 len: 1428 microversion: 2.1 time: 0.957523 Jul 25 13:04:29.930760 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2324/4557] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:28 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 1428 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:29.970633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ba2cb6d9-85ec-46ad-a56a-7a9d95e33a44 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:29.972238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ba2cb6d9-85ec-46ad-a56a-7a9d95e33a44 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:29.985588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba2cb6d9-85ec-46ad-a56a-7a9d95e33a44 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:29.986074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba2cb6d9-85ec-46ad-a56a-7a9d95e33a44 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:29.986980 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba2cb6d9-85ec-46ad-a56a-7a9d95e33a44 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:29.987419 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba2cb6d9-85ec-46ad-a56a-7a9d95e33a44 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:30.025351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4f368673-34eb-436a-8dfd-611227d7ca39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1859926025", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "41e863a3-713c-4d35-a204-58098a16a6e3"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:30.099689 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-4f368673-34eb-436a-8dfd-611227d7ca39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] validate_networks() for [('41e863a3-713c-4d35-a204-58098a16a6e3', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:04:30.593781 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ba2cb6d9-85ec-46ad-a56a-7a9d95e33a44 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:30.607142 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ba2cb6d9-85ec-46ad-a56a-7a9d95e33a44 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1322 microversion: 2.1 time: 0.641471 Jul 25 13:04:30.608078 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2325/4558] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:29 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1322 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:30.923206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0ae3c4a4-c356-43b9-a6de-35a479700bc2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:30.924081 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0ae3c4a4-c356-43b9-a6de-35a479700bc2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:30.935976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ae3c4a4-c356-43b9-a6de-35a479700bc2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:30.936830 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ae3c4a4-c356-43b9-a6de-35a479700bc2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:30.940018 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ae3c4a4-c356-43b9-a6de-35a479700bc2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:30.940815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ae3c4a4-c356-43b9-a6de-35a479700bc2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:30.986542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4f368673-34eb-436a-8dfd-611227d7ca39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:04:30.987727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4f368673-34eb-436a-8dfd-611227d7ca39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:04:30.988836 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4f368673-34eb-436a-8dfd-611227d7ca39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:04:30.989999 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4f368673-34eb-436a-8dfd-611227d7ca39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:04:30.990766 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4f368673-34eb-436a-8dfd-611227d7ca39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:04:31.007634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4f368673-34eb-436a-8dfd-611227d7ca39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:31.013378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4f368673-34eb-436a-8dfd-611227d7ca39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:31.015696 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4f368673-34eb-436a-8dfd-611227d7ca39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:31.016738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4f368673-34eb-436a-8dfd-611227d7ca39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:31.049875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-4f368673-34eb-436a-8dfd-611227d7ca39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Getting quotas for project ebb6a07295234370aa1aa5067b8ee930. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:04:31.058262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-4f368673-34eb-436a-8dfd-611227d7ca39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Getting quotas for user 60d84eb7c45449cbad3141d9f363e693 and project ebb6a07295234370aa1aa5067b8ee930. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:04:31.080394 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4f368673-34eb-436a-8dfd-611227d7ca39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:04:31.089975 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4f368673-34eb-436a-8dfd-611227d7ca39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 5b9513b8-10cf-4f0c-9676-231d951d717d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:04:31.165554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0ae3c4a4-c356-43b9-a6de-35a479700bc2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:31.178440 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0ae3c4a4-c356-43b9-a6de-35a479700bc2 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1690 microversion: 2.1 time: 0.259125 Jul 25 13:04:31.183056 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4f368673-34eb-436a-8dfd-611227d7ca39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.278900 Jul 25 13:04:31.183542 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2326/4559] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:30 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1690 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:31.191211 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2234/4560] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:04:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:04:31.197599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7cd0c98c-42ed-4ce3-ba39-49b7e2dfccb0 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:31.198675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7cd0c98c-42ed-4ce3-ba39-49b7e2dfccb0 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:31.201003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-ce14a5ac-e241-436d-930d-ec465905e379 req-61d59f6b-cd0d-4f42-bb1b-b185ad05089c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8931f252-9f17-4c5f-ba34-8de681154571", "name": "network-vif-plugged", "status": "completed", "tag": "adfd7df8-3366-4c53-9640-277b67fb3cc1"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:31.218765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7cd0c98c-42ed-4ce3-ba39-49b7e2dfccb0 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:31.221375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7cd0c98c-42ed-4ce3-ba39-49b7e2dfccb0 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:31.222648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7cd0c98c-42ed-4ce3-ba39-49b7e2dfccb0 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:31.225475 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7cd0c98c-42ed-4ce3-ba39-49b7e2dfccb0 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:31.233925 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ce14a5ac-e241-436d-930d-ec465905e379 req-61d59f6b-cd0d-4f42-bb1b-b185ad05089c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:31.234872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ce14a5ac-e241-436d-930d-ec465905e379 req-61d59f6b-cd0d-4f42-bb1b-b185ad05089c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:31.261741 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-ce14a5ac-e241-436d-930d-ec465905e379 req-61d59f6b-cd0d-4f42-bb1b-b185ad05089c service nova] Creating event network-vif-plugged:adfd7df8-3366-4c53-9640-277b67fb3cc1 for instance 8931f252-9f17-4c5f-ba34-8de681154571 on n-h2-848886-15 Jul 25 13:04:31.274702 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-ce14a5ac-e241-436d-930d-ec465905e379 req-61d59f6b-cd0d-4f42-bb1b-b185ad05089c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081936 Jul 25 13:04:31.279518 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2235/4561] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:04:31.292184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-56b81ee7-07e3-423a-814f-dc946ee82495 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:31.292926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-56b81ee7-07e3-423a-814f-dc946ee82495 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:31.309688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56b81ee7-07e3-423a-814f-dc946ee82495 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:31.310666 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56b81ee7-07e3-423a-814f-dc946ee82495 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:31.311758 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56b81ee7-07e3-423a-814f-dc946ee82495 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:31.312479 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56b81ee7-07e3-423a-814f-dc946ee82495 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:31.667850 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-56b81ee7-07e3-423a-814f-dc946ee82495 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "POST /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde/action" status: 202 len: 0 microversion: 2.1 time: 0.383773 Jul 25 13:04:31.672339 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2236/4562] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:04:31 2022] POST /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:04:31.694482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1b09a0d6-53a3-4468-b514-654ba3c57994 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:31.695435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1b09a0d6-53a3-4468-b514-654ba3c57994 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 5b9513b8-10cf-4f0c-9676-231d951d717d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:32.034933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1b09a0d6-53a3-4468-b514-654ba3c57994 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:32.049517 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1b09a0d6-53a3-4468-b514-654ba3c57994 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d" status: 200 len: 1193 microversion: 2.1 time: 0.372625 Jul 25 13:04:32.057930 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2237/4563] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:31 2022] GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d => generated 1193 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:32.076012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8f438868-2489-4467-81ce-fb3233ed7248 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:32.076533 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8f438868-2489-4467-81ce-fb3233ed7248 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:32.102931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f438868-2489-4467-81ce-fb3233ed7248 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:32.103384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f438868-2489-4467-81ce-fb3233ed7248 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:32.104590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f438868-2489-4467-81ce-fb3233ed7248 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:32.105242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f438868-2489-4467-81ce-fb3233ed7248 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:32.543689 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7cd0c98c-42ed-4ce3-ba39-49b7e2dfccb0 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e6a20408894330b3b3734a455a078c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ef6028fa1c460b8cab5f7d9082abfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:32.560546 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7cd0c98c-42ed-4ce3-ba39-49b7e2dfccb0 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 200 len: 1428 microversion: 2.1 time: 1.373785 Jul 25 13:04:32.561197 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2327/4564] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:31 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 1428 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:32.580217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5dbbfe12-932a-4e12-9916-c65a179e56de tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:32.586426 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5dbbfe12-932a-4e12-9916-c65a179e56de tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:32.641534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5dbbfe12-932a-4e12-9916-c65a179e56de tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:32.642211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5dbbfe12-932a-4e12-9916-c65a179e56de tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:32.649591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5dbbfe12-932a-4e12-9916-c65a179e56de tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:32.655120 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5dbbfe12-932a-4e12-9916-c65a179e56de tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:32.779012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8f438868-2489-4467-81ce-fb3233ed7248 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:32.790644 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8f438868-2489-4467-81ce-fb3233ed7248 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1322 microversion: 2.1 time: 0.738937 Jul 25 13:04:32.813885 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2238/4565] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:32 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1322 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:33.078649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1e777ceb-2f08-47d4-97d7-7d5fcc9fcdd7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:33.079430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1e777ceb-2f08-47d4-97d7-7d5fcc9fcdd7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 5b9513b8-10cf-4f0c-9676-231d951d717d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:33.097869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1e777ceb-2f08-47d4-97d7-7d5fcc9fcdd7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:33.099237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1e777ceb-2f08-47d4-97d7-7d5fcc9fcdd7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:33.105940 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1e777ceb-2f08-47d4-97d7-7d5fcc9fcdd7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:33.107477 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1e777ceb-2f08-47d4-97d7-7d5fcc9fcdd7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:33.521147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1e777ceb-2f08-47d4-97d7-7d5fcc9fcdd7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:33.532423 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1e777ceb-2f08-47d4-97d7-7d5fcc9fcdd7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d" status: 200 len: 1245 microversion: 2.1 time: 0.459086 Jul 25 13:04:33.541798 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2239/4566] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:33 2022] GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d => generated 1245 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:04:33.585882 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-afa6cef0-6f45-46b9-a34f-7449dedf7934 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:33.588019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-afa6cef0-6f45-46b9-a34f-7449dedf7934 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:33.609484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afa6cef0-6f45-46b9-a34f-7449dedf7934 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:33.609996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afa6cef0-6f45-46b9-a34f-7449dedf7934 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:33.616752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afa6cef0-6f45-46b9-a34f-7449dedf7934 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:33.617682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afa6cef0-6f45-46b9-a34f-7449dedf7934 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:33.635742 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5dbbfe12-932a-4e12-9916-c65a179e56de tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:33.644143 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5dbbfe12-932a-4e12-9916-c65a179e56de tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1689 microversion: 2.1 time: 1.081849 Jul 25 13:04:33.644756 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2328/4567] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:32 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1689 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:33.824646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fd824d93-8cf5-4826-a52f-5110e3777ea0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:33.825273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fd824d93-8cf5-4826-a52f-5110e3777ea0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:33.835238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd824d93-8cf5-4826-a52f-5110e3777ea0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:33.835777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd824d93-8cf5-4826-a52f-5110e3777ea0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:33.841349 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd824d93-8cf5-4826-a52f-5110e3777ea0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:33.841810 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd824d93-8cf5-4826-a52f-5110e3777ea0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:34.751153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-afa6cef0-6f45-46b9-a34f-7449dedf7934 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e6a20408894330b3b3734a455a078c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ef6028fa1c460b8cab5f7d9082abfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:34.780015 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-afa6cef0-6f45-46b9-a34f-7449dedf7934 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 200 len: 1428 microversion: 2.1 time: 1.199869 Jul 25 13:04:34.793527 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2240/4568] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:33 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 1428 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:34.812141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-ed08d06c-b3ec-4c83-b069-5a695022fe42 req-eadade87-89ee-48c1-bc6e-a5040c05d7c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83ce5d82-2762-4aa7-855c-963a23f26665", "name": "network-vif-plugged", "status": "completed", "tag": "35e7321c-7aa5-4daa-8504-c9f77811ff51"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:34.871035 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ed08d06c-b3ec-4c83-b069-5a695022fe42 req-eadade87-89ee-48c1-bc6e-a5040c05d7c8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:34.871230 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fd824d93-8cf5-4826-a52f-5110e3777ea0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:34.874161 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ed08d06c-b3ec-4c83-b069-5a695022fe42 req-eadade87-89ee-48c1-bc6e-a5040c05d7c8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:34.886134 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fd824d93-8cf5-4826-a52f-5110e3777ea0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1322 microversion: 2.1 time: 1.066408 Jul 25 13:04:34.898332 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2329/4569] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:33 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1322 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:04:34.898332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4c5cdbe4-811c-4be2-a793-e64d10a4ebe0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:34.899027 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4c5cdbe4-811c-4be2-a793-e64d10a4ebe0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 5b9513b8-10cf-4f0c-9676-231d951d717d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:34.918611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c5cdbe4-811c-4be2-a793-e64d10a4ebe0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:34.919425 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c5cdbe4-811c-4be2-a793-e64d10a4ebe0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:34.922134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c5cdbe4-811c-4be2-a793-e64d10a4ebe0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:34.922968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c5cdbe4-811c-4be2-a793-e64d10a4ebe0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:34.976659 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-ed08d06c-b3ec-4c83-b069-5a695022fe42 req-eadade87-89ee-48c1-bc6e-a5040c05d7c8 service nova] Creating event network-vif-plugged:35e7321c-7aa5-4daa-8504-c9f77811ff51 for instance 83ce5d82-2762-4aa7-855c-963a23f26665 on n-h1-848886-15 Jul 25 13:04:35.024885 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-ed08d06c-b3ec-4c83-b069-5a695022fe42 req-eadade87-89ee-48c1-bc6e-a5040c05d7c8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226586 Jul 25 13:04:35.038262 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2241/4570] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:04:35.094052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e94f4aad-49dd-4bb5-a85b-f1cf18de8ec0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:35.104056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e94f4aad-49dd-4bb5-a85b-f1cf18de8ec0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:35.150775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e94f4aad-49dd-4bb5-a85b-f1cf18de8ec0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:35.151795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e94f4aad-49dd-4bb5-a85b-f1cf18de8ec0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:35.152664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e94f4aad-49dd-4bb5-a85b-f1cf18de8ec0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:35.158753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e94f4aad-49dd-4bb5-a85b-f1cf18de8ec0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:35.442894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4c5cdbe4-811c-4be2-a793-e64d10a4ebe0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:35.450928 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4c5cdbe4-811c-4be2-a793-e64d10a4ebe0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d" status: 200 len: 1251 microversion: 2.1 time: 0.561982 Jul 25 13:04:35.465773 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2330/4571] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:34 2022] GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d => generated 1251 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:35.471772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f025828f-41eb-45f3-b500-7e5d9fee1f4b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:35.481661 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f025828f-41eb-45f3-b500-7e5d9fee1f4b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:35.482774 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f025828f-41eb-45f3-b500-7e5d9fee1f4b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:35.537108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f025828f-41eb-45f3-b500-7e5d9fee1f4b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Going to try to stop instance {{(pid=125884) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 13:04:35.631675 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f025828f-41eb-45f3-b500-7e5d9fee1f4b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "POST /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e/action" status: 202 len: 0 microversion: 2.1 time: 0.162734 Jul 25 13:04:35.637334 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2331/4572] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:04:35 2022] POST /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:04:35.654769 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1f96b6ac-1ef5-44f2-b5a2-f2435c51be48 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:35.657993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1f96b6ac-1ef5-44f2-b5a2-f2435c51be48 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:35.675081 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f96b6ac-1ef5-44f2-b5a2-f2435c51be48 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:35.675531 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f96b6ac-1ef5-44f2-b5a2-f2435c51be48 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:35.676324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f96b6ac-1ef5-44f2-b5a2-f2435c51be48 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:35.681086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f96b6ac-1ef5-44f2-b5a2-f2435c51be48 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:35.954544 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e94f4aad-49dd-4bb5-a85b-f1cf18de8ec0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:35.969081 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e94f4aad-49dd-4bb5-a85b-f1cf18de8ec0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1689 microversion: 2.1 time: 0.926932 Jul 25 13:04:35.970551 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2242/4573] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:35 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1689 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:35.981146 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-55e8aeb9-d492-4ca8-87d1-1ab2ca5878c6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:35.987610 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-55e8aeb9-d492-4ca8-87d1-1ab2ca5878c6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:36.001807 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55e8aeb9-d492-4ca8-87d1-1ab2ca5878c6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:36.006719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55e8aeb9-d492-4ca8-87d1-1ab2ca5878c6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:36.008051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55e8aeb9-d492-4ca8-87d1-1ab2ca5878c6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:36.008983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55e8aeb9-d492-4ca8-87d1-1ab2ca5878c6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:37.364347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1f96b6ac-1ef5-44f2-b5a2-f2435c51be48 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:37.384194 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1f96b6ac-1ef5-44f2-b5a2-f2435c51be48 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1722 microversion: 2.1 time: 1.743286 Jul 25 13:04:37.386343 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2332/4574] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:35 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1722 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:37.393668 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a12010b3-39a9-4270-9188-a84ac50c0a23 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:37.395028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a12010b3-39a9-4270-9188-a84ac50c0a23 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:37.406255 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a12010b3-39a9-4270-9188-a84ac50c0a23 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:37.407513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a12010b3-39a9-4270-9188-a84ac50c0a23 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:37.408848 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a12010b3-39a9-4270-9188-a84ac50c0a23 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:37.409648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a12010b3-39a9-4270-9188-a84ac50c0a23 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:37.513268 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-55e8aeb9-d492-4ca8-87d1-1ab2ca5878c6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e6a20408894330b3b3734a455a078c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ef6028fa1c460b8cab5f7d9082abfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:37.523899 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-55e8aeb9-d492-4ca8-87d1-1ab2ca5878c6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 200 len: 1428 microversion: 2.1 time: 1.551415 Jul 25 13:04:37.528101 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2243/4575] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:35 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 1428 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:37.538614 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2ef30ae8-1eb8-48b2-bd0c-17bf1f64a71c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:37.541349 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2ef30ae8-1eb8-48b2-bd0c-17bf1f64a71c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 5b9513b8-10cf-4f0c-9676-231d951d717d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:37.559257 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2ef30ae8-1eb8-48b2-bd0c-17bf1f64a71c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:37.568393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2ef30ae8-1eb8-48b2-bd0c-17bf1f64a71c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:37.569945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2ef30ae8-1eb8-48b2-bd0c-17bf1f64a71c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:37.570637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2ef30ae8-1eb8-48b2-bd0c-17bf1f64a71c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:37.804358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2ef30ae8-1eb8-48b2-bd0c-17bf1f64a71c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:37.808521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:37.832244 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2ef30ae8-1eb8-48b2-bd0c-17bf1f64a71c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d" status: 200 len: 1251 microversion: 2.1 time: 0.301389 Jul 25 13:04:37.833143 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2244/4576] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:37 2022] GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d => generated 1251 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:37.852877 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0a91c804-9dc7-4988-9e57-ef9a0ac66580 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:37.858065 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0a91c804-9dc7-4988-9e57-ef9a0ac66580 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:37.863683 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a12010b3-39a9-4270-9188-a84ac50c0a23 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:37.878523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a91c804-9dc7-4988-9e57-ef9a0ac66580 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:37.879130 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a91c804-9dc7-4988-9e57-ef9a0ac66580 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:37.879815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a91c804-9dc7-4988-9e57-ef9a0ac66580 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:37.888593 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a12010b3-39a9-4270-9188-a84ac50c0a23 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1516 microversion: 2.1 time: 0.500734 Jul 25 13:04:37.891353 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2333/4577] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:37 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1516 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:37.893008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a91c804-9dc7-4988-9e57-ef9a0ac66580 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:38.013316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4fd20e41-c067-4bd2-b056-da4fa08ce936 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-576402125", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "92120f14-8dc0-43e9-bbb4-9f71c08ef7f2"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:38.214554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-4fd20e41-c067-4bd2-b056-da4fa08ce936 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] validate_networks() for [('92120f14-8dc0-43e9-bbb4-9f71c08ef7f2', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:04:38.711340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0a91c804-9dc7-4988-9e57-ef9a0ac66580 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:38.726688 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0a91c804-9dc7-4988-9e57-ef9a0ac66580 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1689 microversion: 2.1 time: 0.891437 Jul 25 13:04:38.727669 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2245/4578] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:37 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1689 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:38.747774 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c9475c5c-d8c8-40e3-adca-1c07796c6cef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:38.753988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c9475c5c-d8c8-40e3-adca-1c07796c6cef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:38.777006 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c9475c5c-d8c8-40e3-adca-1c07796c6cef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:38.785526 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c9475c5c-d8c8-40e3-adca-1c07796c6cef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:38.786778 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c9475c5c-d8c8-40e3-adca-1c07796c6cef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:38.789165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c9475c5c-d8c8-40e3-adca-1c07796c6cef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:38.866387 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-c9475c5c-d8c8-40e3-adca-1c07796c6cef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lazy-loading 'flavor' on Instance uuid 8931f252-9f17-4c5f-ba34-8de681154571 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:04:39.078677 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c9475c5c-d8c8-40e3-adca-1c07796c6cef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "POST /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571/action" status: 200 len: 32 microversion: 2.1 time: 0.347657 Jul 25 13:04:39.088689 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2246/4579] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:04:38 2022] POST /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571/action => generated 32 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 13:04:39.140947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-27b58406-ee62-4425-b792-82c5deb9c95a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:39.155948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-27b58406-ee62-4425-b792-82c5deb9c95a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:39.177599 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27b58406-ee62-4425-b792-82c5deb9c95a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:39.181289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27b58406-ee62-4425-b792-82c5deb9c95a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:39.185241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27b58406-ee62-4425-b792-82c5deb9c95a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:39.186174 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27b58406-ee62-4425-b792-82c5deb9c95a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:39.946240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-27b58406-ee62-4425-b792-82c5deb9c95a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:39.959890 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-27b58406-ee62-4425-b792-82c5deb9c95a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1722 microversion: 2.1 time: 0.853798 Jul 25 13:04:39.963727 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2247/4580] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:39 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1722 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:39.974258 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f93dede4-b54d-468d-8339-2da6bf513251 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:39.975099 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f93dede4-b54d-468d-8339-2da6bf513251 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:39.992606 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f93dede4-b54d-468d-8339-2da6bf513251 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:39.993730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f93dede4-b54d-468d-8339-2da6bf513251 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:39.997619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f93dede4-b54d-468d-8339-2da6bf513251 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:39.999008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f93dede4-b54d-468d-8339-2da6bf513251 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:40.740155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-4fd20e41-c067-4bd2-b056-da4fa08ce936 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:04:40.741264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-4fd20e41-c067-4bd2-b056-da4fa08ce936 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:04:40.741942 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-4fd20e41-c067-4bd2-b056-da4fa08ce936 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:04:40.742520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-4fd20e41-c067-4bd2-b056-da4fa08ce936 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:04:40.743286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-4fd20e41-c067-4bd2-b056-da4fa08ce936 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:04:40.768965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4fd20e41-c067-4bd2-b056-da4fa08ce936 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:40.769680 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4fd20e41-c067-4bd2-b056-da4fa08ce936 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:40.770716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4fd20e41-c067-4bd2-b056-da4fa08ce936 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:40.771353 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4fd20e41-c067-4bd2-b056-da4fa08ce936 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:40.821078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-4fd20e41-c067-4bd2-b056-da4fa08ce936 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Getting quotas for project a62f3f0b511c4a0faf02063de1517eef. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:04:40.837618 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-4fd20e41-c067-4bd2-b056-da4fa08ce936 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Getting quotas for user b8ba307908a44f1ba364276838d47e78 and project a62f3f0b511c4a0faf02063de1517eef. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:04:40.863732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4fd20e41-c067-4bd2-b056-da4fa08ce936 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:04:40.866051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4fd20e41-c067-4bd2-b056-da4fa08ce936 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] [instance: b1ea495c-376d-4582-b18e-05cdbb7dc6b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:04:40.905256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f93dede4-b54d-468d-8339-2da6bf513251 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e6a20408894330b3b3734a455a078c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ef6028fa1c460b8cab5f7d9082abfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:40.927358 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f93dede4-b54d-468d-8339-2da6bf513251 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 200 len: 1607 microversion: 2.1 time: 0.962332 Jul 25 13:04:40.927996 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2248/4581] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:39 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 1607 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:40.955322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a0280a51-1431-45b3-ad10-dc78fbcb71a8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:40.968090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a0280a51-1431-45b3-ad10-dc78fbcb71a8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 5b9513b8-10cf-4f0c-9676-231d951d717d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:40.985335 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a0280a51-1431-45b3-ad10-dc78fbcb71a8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:40.985794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a0280a51-1431-45b3-ad10-dc78fbcb71a8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:40.986613 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a0280a51-1431-45b3-ad10-dc78fbcb71a8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:40.987054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a0280a51-1431-45b3-ad10-dc78fbcb71a8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:41.028166 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4fd20e41-c067-4bd2-b056-da4fa08ce936 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.135151 Jul 25 13:04:41.042505 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2334/4582] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Jul 25 13:04:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3150 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 13:04:41.047643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0ccfb02d-54c6-4dee-8183-0307b400119b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:41.048217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0ccfb02d-54c6-4dee-8183-0307b400119b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:41.091140 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:41.110596 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ccfb02d-54c6-4dee-8183-0307b400119b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:41.111069 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ccfb02d-54c6-4dee-8183-0307b400119b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:41.119930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ccfb02d-54c6-4dee-8183-0307b400119b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:41.120814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ccfb02d-54c6-4dee-8183-0307b400119b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:41.173873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:41.968721 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a0280a51-1431-45b3-ad10-dc78fbcb71a8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:41.982946 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a0280a51-1431-45b3-ad10-dc78fbcb71a8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d" status: 200 len: 1293 microversion: 2.1 time: 1.031245 Jul 25 13:04:41.984231 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2249/4583] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:40 2022] GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d => generated 1293 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:41.989707 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f47a6506-71fe-4320-8266-7644076e1d25 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:41.991762 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f47a6506-71fe-4320-8266-7644076e1d25 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:42.009503 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f47a6506-71fe-4320-8266-7644076e1d25 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:42.013861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f47a6506-71fe-4320-8266-7644076e1d25 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:42.014998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f47a6506-71fe-4320-8266-7644076e1d25 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:42.017187 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f47a6506-71fe-4320-8266-7644076e1d25 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:42.075700 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=8 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:42.442344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0ccfb02d-54c6-4dee-8183-0307b400119b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:42.473298 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0ccfb02d-54c6-4dee-8183-0307b400119b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1522 microversion: 2.1 time: 1.428781 Jul 25 13:04:42.477096 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2335/4584] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:41 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1522 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:42.490164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e37a4fa3-e051-4b15-ae59-592c2724ce4f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:42.491122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e37a4fa3-e051-4b15-ae59-592c2724ce4f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:42.506148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e37a4fa3-e051-4b15-ae59-592c2724ce4f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:42.506824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e37a4fa3-e051-4b15-ae59-592c2724ce4f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:42.508062 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e37a4fa3-e051-4b15-ae59-592c2724ce4f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:42.508677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e37a4fa3-e051-4b15-ae59-592c2724ce4f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:43.389733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f47a6506-71fe-4320-8266-7644076e1d25 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:43.404564 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f47a6506-71fe-4320-8266-7644076e1d25 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1689 microversion: 2.1 time: 1.416404 Jul 25 13:04:43.406885 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2250/4585] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:41 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1689 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:43.416430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0952acdb-34e9-4097-95a2-ddaa58aed229 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:43.420804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0952acdb-34e9-4097-95a2-ddaa58aed229 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:43.441380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0952acdb-34e9-4097-95a2-ddaa58aed229 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:43.442200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0952acdb-34e9-4097-95a2-ddaa58aed229 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:43.444795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0952acdb-34e9-4097-95a2-ddaa58aed229 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:43.445440 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0952acdb-34e9-4097-95a2-ddaa58aed229 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:44.197934 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0952acdb-34e9-4097-95a2-ddaa58aed229 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:44.214373 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0952acdb-34e9-4097-95a2-ddaa58aed229 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1722 microversion: 2.1 time: 0.804164 Jul 25 13:04:44.217068 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2251/4586] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:43 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1722 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:44.232741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-54eff0ce-83ae-431d-b467-ac6517c2411d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:44.233456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-54eff0ce-83ae-431d-b467-ac6517c2411d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] [instance: b1ea495c-376d-4582-b18e-05cdbb7dc6b1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:44.263032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54eff0ce-83ae-431d-b467-ac6517c2411d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:44.266468 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54eff0ce-83ae-431d-b467-ac6517c2411d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:44.281738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54eff0ce-83ae-431d-b467-ac6517c2411d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:44.282239 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54eff0ce-83ae-431d-b467-ac6517c2411d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:44.583010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-54eff0ce-83ae-431d-b467-ac6517c2411d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:44.593282 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-54eff0ce-83ae-431d-b467-ac6517c2411d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:44.594927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-54eff0ce-83ae-431d-b467-ac6517c2411d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:44.607808 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-54eff0ce-83ae-431d-b467-ac6517c2411d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] 10.222.0.49 "GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1" status: 200 len: 1316 microversion: 2.21 time: 0.383027 Jul 25 13:04:44.608528 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2252/4587] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:04:44 2022] GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1 => generated 1316 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:04:44.633214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-58a93fc3-a37e-46c8-ab72-d1e90bb08ef7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:44.638825 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-58a93fc3-a37e-46c8-ab72-d1e90bb08ef7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 5b9513b8-10cf-4f0c-9676-231d951d717d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:44.653784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-58a93fc3-a37e-46c8-ab72-d1e90bb08ef7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:44.654576 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-58a93fc3-a37e-46c8-ab72-d1e90bb08ef7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:44.655590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-58a93fc3-a37e-46c8-ab72-d1e90bb08ef7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:44.656280 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-58a93fc3-a37e-46c8-ab72-d1e90bb08ef7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:44.976404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e37a4fa3-e051-4b15-ae59-592c2724ce4f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e6a20408894330b3b3734a455a078c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ef6028fa1c460b8cab5f7d9082abfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:44.989036 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e37a4fa3-e051-4b15-ae59-592c2724ce4f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 200 len: 1607 microversion: 2.1 time: 2.510303 Jul 25 13:04:44.991890 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2336/4588] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:42 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 1607 bytes in 2514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:45.003642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-35721b44-52ba-4d2d-a75d-208c5898f7bb req-848c87ae-2809-4dc7-bbd0-d37f7048dec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b9513b8-10cf-4f0c-9676-231d951d717d", "tag": "c0e54450-2df6-43de-bfa7-1fa00aa426e4"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:45.027976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-35721b44-52ba-4d2d-a75d-208c5898f7bb req-848c87ae-2809-4dc7-bbd0-d37f7048dec4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:45.030738 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-35721b44-52ba-4d2d-a75d-208c5898f7bb req-848c87ae-2809-4dc7-bbd0-d37f7048dec4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:45.056117 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-35721b44-52ba-4d2d-a75d-208c5898f7bb req-848c87ae-2809-4dc7-bbd0-d37f7048dec4 service nova] Creating event network-changed:c0e54450-2df6-43de-bfa7-1fa00aa426e4 for instance 5b9513b8-10cf-4f0c-9676-231d951d717d on n-h2-848886-15 Jul 25 13:04:45.072063 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-35721b44-52ba-4d2d-a75d-208c5898f7bb req-848c87ae-2809-4dc7-bbd0-d37f7048dec4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078036 Jul 25 13:04:45.072997 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2337/4589] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:04:45.095773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0d49ca66-848a-4d4d-8c26-49524fb52c93 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:45.096717 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0d49ca66-848a-4d4d-8c26-49524fb52c93 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:45.122990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d49ca66-848a-4d4d-8c26-49524fb52c93 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:45.124110 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d49ca66-848a-4d4d-8c26-49524fb52c93 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:45.126521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d49ca66-848a-4d4d-8c26-49524fb52c93 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:45.127159 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d49ca66-848a-4d4d-8c26-49524fb52c93 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:45.319174 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-58a93fc3-a37e-46c8-ab72-d1e90bb08ef7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:45.331038 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-58a93fc3-a37e-46c8-ab72-d1e90bb08ef7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d" status: 200 len: 1293 microversion: 2.1 time: 0.705600 Jul 25 13:04:45.336102 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2253/4590] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:44 2022] GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d => generated 1293 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:45.366230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0c8a0207-31d0-4552-81de-4a2e3d47dc1e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:45.367269 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0c8a0207-31d0-4552-81de-4a2e3d47dc1e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:45.384921 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c8a0207-31d0-4552-81de-4a2e3d47dc1e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:45.385383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c8a0207-31d0-4552-81de-4a2e3d47dc1e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:45.386220 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c8a0207-31d0-4552-81de-4a2e3d47dc1e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:45.386674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c8a0207-31d0-4552-81de-4a2e3d47dc1e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:45.755336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0d49ca66-848a-4d4d-8c26-49524fb52c93 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:45.763715 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0d49ca66-848a-4d4d-8c26-49524fb52c93 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1522 microversion: 2.1 time: 0.688377 Jul 25 13:04:45.766783 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2338/4591] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:45 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1522 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:45.779944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-977d1817-d4f6-45c7-9604-4cf183fb6b8a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:45.792362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-977d1817-d4f6-45c7-9604-4cf183fb6b8a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:45.818039 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-977d1817-d4f6-45c7-9604-4cf183fb6b8a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:45.819904 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-977d1817-d4f6-45c7-9604-4cf183fb6b8a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:45.826089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-977d1817-d4f6-45c7-9604-4cf183fb6b8a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:45.826575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-977d1817-d4f6-45c7-9604-4cf183fb6b8a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:46.149626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0c8a0207-31d0-4552-81de-4a2e3d47dc1e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:46.165995 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0c8a0207-31d0-4552-81de-4a2e3d47dc1e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1689 microversion: 2.1 time: 0.820609 Jul 25 13:04:46.167322 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2254/4592] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:45 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1689 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:46.178822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-500af6e4-327d-44fc-803e-5269a9a7171f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:46.181895 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-500af6e4-327d-44fc-803e-5269a9a7171f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:46.198061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-500af6e4-327d-44fc-803e-5269a9a7171f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:46.199220 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-500af6e4-327d-44fc-803e-5269a9a7171f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:46.205566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-500af6e4-327d-44fc-803e-5269a9a7171f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:46.206322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-500af6e4-327d-44fc-803e-5269a9a7171f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:46.275435 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-977d1817-d4f6-45c7-9604-4cf183fb6b8a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e6a20408894330b3b3734a455a078c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ef6028fa1c460b8cab5f7d9082abfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:46.287473 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-977d1817-d4f6-45c7-9604-4cf183fb6b8a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 200 len: 1607 microversion: 2.1 time: 0.512593 Jul 25 13:04:46.294244 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2339/4593] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:45 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 1607 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:46.299590 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8ff26f0e-5f76-47ec-a64b-13ec4d60b205 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:46.300132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8ff26f0e-5f76-47ec-a64b-13ec4d60b205 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] [instance: b1ea495c-376d-4582-b18e-05cdbb7dc6b1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:46.332749 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ff26f0e-5f76-47ec-a64b-13ec4d60b205 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:46.334533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ff26f0e-5f76-47ec-a64b-13ec4d60b205 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:46.335617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ff26f0e-5f76-47ec-a64b-13ec4d60b205 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:46.339746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ff26f0e-5f76-47ec-a64b-13ec4d60b205 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:47.678401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-500af6e4-327d-44fc-803e-5269a9a7171f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:47.700494 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-500af6e4-327d-44fc-803e-5269a9a7171f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1722 microversion: 2.1 time: 1.530359 Jul 25 13:04:47.721175 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2255/4594] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:46 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1722 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:47.746687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bd6b2d7b-3852-4c83-ada2-5a3c8e6a802c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:47.747876 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bd6b2d7b-3852-4c83-ada2-5a3c8e6a802c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 5b9513b8-10cf-4f0c-9676-231d951d717d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:47.758110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:47.761626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd6b2d7b-3852-4c83-ada2-5a3c8e6a802c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:47.764034 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd6b2d7b-3852-4c83-ada2-5a3c8e6a802c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:47.768037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd6b2d7b-3852-4c83-ada2-5a3c8e6a802c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:47.770933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd6b2d7b-3852-4c83-ada2-5a3c8e6a802c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:47.862602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8ff26f0e-5f76-47ec-a64b-13ec4d60b205 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:47.880685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8ff26f0e-5f76-47ec-a64b-13ec4d60b205 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:47.887705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8ff26f0e-5f76-47ec-a64b-13ec4d60b205 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:47.892419 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8ff26f0e-5f76-47ec-a64b-13ec4d60b205 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] 10.222.0.49 "GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1" status: 200 len: 1358 microversion: 2.21 time: 1.596927 Jul 25 13:04:47.895465 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2340/4595] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:04:46 2022] GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1 => generated 1358 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:04:47.907894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-954a809a-58f8-4b45-bea6-6627ca3f75e8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:47.908826 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-954a809a-58f8-4b45-bea6-6627ca3f75e8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:47.922418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-954a809a-58f8-4b45-bea6-6627ca3f75e8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:47.926175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-954a809a-58f8-4b45-bea6-6627ca3f75e8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:47.929845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-954a809a-58f8-4b45-bea6-6627ca3f75e8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:47.931221 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-954a809a-58f8-4b45-bea6-6627ca3f75e8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:48.698620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bd6b2d7b-3852-4c83-ada2-5a3c8e6a802c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:48.703717 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-954a809a-58f8-4b45-bea6-6627ca3f75e8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:48.713240 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-954a809a-58f8-4b45-bea6-6627ca3f75e8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1522 microversion: 2.1 time: 0.815089 Jul 25 13:04:48.719648 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bd6b2d7b-3852-4c83-ada2-5a3c8e6a802c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d" status: 200 len: 1293 microversion: 2.1 time: 0.994805 Jul 25 13:04:48.734635 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2341/4596] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:47 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1522 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:48.736639 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2256/4597] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:47 2022] GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d => generated 1293 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:48.743747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-3475a88a-5eb1-4948-b3d8-4afa075c3c69 req-a2223f30-4ed2-4389-a8c0-a81b9d934b27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "486f49b3-3f54-478c-9c21-c33a16ae4fde", "tag": "fefdb487-385f-4f8b-b1dd-99ad9fb2469d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:48.746121 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a39d74c7-4aaf-4000-8371-f6c7bc1a5601 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:48.746975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a39d74c7-4aaf-4000-8371-f6c7bc1a5601 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:48.761538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a39d74c7-4aaf-4000-8371-f6c7bc1a5601 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:48.762327 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a39d74c7-4aaf-4000-8371-f6c7bc1a5601 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:48.763621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a39d74c7-4aaf-4000-8371-f6c7bc1a5601 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:48.764232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a39d74c7-4aaf-4000-8371-f6c7bc1a5601 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:48.765474 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-3475a88a-5eb1-4948-b3d8-4afa075c3c69 req-a2223f30-4ed2-4389-a8c0-a81b9d934b27 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:48.765961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-3475a88a-5eb1-4948-b3d8-4afa075c3c69 req-a2223f30-4ed2-4389-a8c0-a81b9d934b27 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:48.784197 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-3475a88a-5eb1-4948-b3d8-4afa075c3c69 req-a2223f30-4ed2-4389-a8c0-a81b9d934b27 service nova] Creating event network-changed:fefdb487-385f-4f8b-b1dd-99ad9fb2469d for instance 486f49b3-3f54-478c-9c21-c33a16ae4fde on n-h1-848886-15 Jul 25 13:04:48.795097 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [req-3475a88a-5eb1-4948-b3d8-4afa075c3c69 req-a2223f30-4ed2-4389-a8c0-a81b9d934b27 service nova] Instance 486f49b3-3f54-478c-9c21-c33a16ae4fde is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125883) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:04:48.824613 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-3475a88a-5eb1-4948-b3d8-4afa075c3c69 req-a2223f30-4ed2-4389-a8c0-a81b9d934b27 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086411 Jul 25 13:04:48.827054 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2257/4598] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:04:48.845594 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7c346119-7f46-4a53-aae0-f7b612e5aeee tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:48.849114 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7c346119-7f46-4a53-aae0-f7b612e5aeee tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:48.858879 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c346119-7f46-4a53-aae0-f7b612e5aeee tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:48.859586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c346119-7f46-4a53-aae0-f7b612e5aeee tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:48.864624 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c346119-7f46-4a53-aae0-f7b612e5aeee tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:48.865252 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c346119-7f46-4a53-aae0-f7b612e5aeee tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:49.826758 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a39d74c7-4aaf-4000-8371-f6c7bc1a5601 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:49.837928 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a39d74c7-4aaf-4000-8371-f6c7bc1a5601 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1689 microversion: 2.1 time: 1.101427 Jul 25 13:04:49.840510 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2342/4599] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:48 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1689 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:49.847363 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2df5e6e0-315d-435e-bafc-4206c9401700 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:49.848793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2df5e6e0-315d-435e-bafc-4206c9401700 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] [instance: b1ea495c-376d-4582-b18e-05cdbb7dc6b1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:49.856712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2df5e6e0-315d-435e-bafc-4206c9401700 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:49.858312 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2df5e6e0-315d-435e-bafc-4206c9401700 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:49.860016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2df5e6e0-315d-435e-bafc-4206c9401700 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:49.860707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2df5e6e0-315d-435e-bafc-4206c9401700 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:49.932437 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7c346119-7f46-4a53-aae0-f7b612e5aeee tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:49.951476 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7c346119-7f46-4a53-aae0-f7b612e5aeee tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1722 microversion: 2.1 time: 1.114624 Jul 25 13:04:49.969131 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2258/4600] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:48 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1722 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:49.979504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9e296c30-e37a-4729-946b-a5d0974505d5 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:49.980639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9e296c30-e37a-4729-946b-a5d0974505d5 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:49.990630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e296c30-e37a-4729-946b-a5d0974505d5 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:49.993627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e296c30-e37a-4729-946b-a5d0974505d5 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:49.995553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e296c30-e37a-4729-946b-a5d0974505d5 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:49.996782 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e296c30-e37a-4729-946b-a5d0974505d5 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:50.449988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2df5e6e0-315d-435e-bafc-4206c9401700 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:50.466560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2df5e6e0-315d-435e-bafc-4206c9401700 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:50.476035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2df5e6e0-315d-435e-bafc-4206c9401700 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:50.480407 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2df5e6e0-315d-435e-bafc-4206c9401700 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] 10.222.0.49 "GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1" status: 200 len: 1358 microversion: 2.21 time: 0.638540 Jul 25 13:04:50.481600 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2343/4601] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:04:49 2022] GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1 => generated 1358 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:04:50.486613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d86c092a-c838-4fcd-810b-f7e9d5e2a580 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:50.487532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d86c092a-c838-4fcd-810b-f7e9d5e2a580 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 5b9513b8-10cf-4f0c-9676-231d951d717d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:50.494868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d86c092a-c838-4fcd-810b-f7e9d5e2a580 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:50.495679 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d86c092a-c838-4fcd-810b-f7e9d5e2a580 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:50.496707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d86c092a-c838-4fcd-810b-f7e9d5e2a580 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:50.497365 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d86c092a-c838-4fcd-810b-f7e9d5e2a580 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:50.527772 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9e296c30-e37a-4729-946b-a5d0974505d5 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:50.531967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:50.537922 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9e296c30-e37a-4729-946b-a5d0974505d5 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1522 microversion: 2.1 time: 0.566561 Jul 25 13:04:50.550645 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2259/4602] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:49 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1522 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:50.786208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:50.800425 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-41635c2f-12e0-451a-91c0-7adce40b6fc7 req-4822ad9a-ed0a-40f0-ae7e-f0a2be67beb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1ea495c-376d-4582-b18e-05cdbb7dc6b1", "tag": "ea32be53-f0fc-4563-bdab-c68a215112aa"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:50.828707 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-41635c2f-12e0-451a-91c0-7adce40b6fc7 req-4822ad9a-ed0a-40f0-ae7e-f0a2be67beb4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:50.829264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-41635c2f-12e0-451a-91c0-7adce40b6fc7 req-4822ad9a-ed0a-40f0-ae7e-f0a2be67beb4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:50.849497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:50.872506 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-41635c2f-12e0-451a-91c0-7adce40b6fc7 req-4822ad9a-ed0a-40f0-ae7e-f0a2be67beb4 service nova] Creating event network-changed:ea32be53-f0fc-4563-bdab-c68a215112aa for instance b1ea495c-376d-4582-b18e-05cdbb7dc6b1 on n-h1-848886-15 Jul 25 13:04:50.886149 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-41635c2f-12e0-451a-91c0-7adce40b6fc7 req-4822ad9a-ed0a-40f0-ae7e-f0a2be67beb4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202847 Jul 25 13:04:50.887467 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2260/4603] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:04:50.903172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5cd238d6-e5df-4b15-a47a-b9d2a6e1420c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:50.909064 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5cd238d6-e5df-4b15-a47a-b9d2a6e1420c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:50.922505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cd238d6-e5df-4b15-a47a-b9d2a6e1420c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:50.923386 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cd238d6-e5df-4b15-a47a-b9d2a6e1420c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:50.924467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cd238d6-e5df-4b15-a47a-b9d2a6e1420c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:50.927568 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cd238d6-e5df-4b15-a47a-b9d2a6e1420c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:50.986149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d86c092a-c838-4fcd-810b-f7e9d5e2a580 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:50.999292 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d86c092a-c838-4fcd-810b-f7e9d5e2a580 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d" status: 200 len: 1293 microversion: 2.1 time: 0.516218 Jul 25 13:04:51.018899 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2344/4604] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:50 2022] GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d => generated 1293 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:51.024035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f92fa62f-ad08-4a39-a20a-29de929b6415 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:51.024808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f92fa62f-ad08-4a39-a20a-29de929b6415 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:51.026891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:51.037248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f92fa62f-ad08-4a39-a20a-29de929b6415 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:51.038117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f92fa62f-ad08-4a39-a20a-29de929b6415 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:51.040921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f92fa62f-ad08-4a39-a20a-29de929b6415 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:51.041617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f92fa62f-ad08-4a39-a20a-29de929b6415 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:51.358743 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5cd238d6-e5df-4b15-a47a-b9d2a6e1420c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:51.386992 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5cd238d6-e5df-4b15-a47a-b9d2a6e1420c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1689 microversion: 2.1 time: 0.497949 Jul 25 13:04:51.393720 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2261/4605] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:50 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1689 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:51.452309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f92fa62f-ad08-4a39-a20a-29de929b6415 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:51.464282 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f92fa62f-ad08-4a39-a20a-29de929b6415 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1722 microversion: 2.1 time: 0.443632 Jul 25 13:04:51.478249 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2345/4606] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:51 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1722 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:51.506051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bbda89cc-eedd-44cd-ad26-d2b034fb7773 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:51.506696 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bbda89cc-eedd-44cd-ad26-d2b034fb7773 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] [instance: b1ea495c-376d-4582-b18e-05cdbb7dc6b1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:51.515054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbda89cc-eedd-44cd-ad26-d2b034fb7773 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:51.515772 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbda89cc-eedd-44cd-ad26-d2b034fb7773 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:51.516581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbda89cc-eedd-44cd-ad26-d2b034fb7773 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:51.517026 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbda89cc-eedd-44cd-ad26-d2b034fb7773 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:51.565412 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aac93ef5-91b3-45fd-a131-20124f284315 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:51.567880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-aac93ef5-91b3-45fd-a131-20124f284315 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:51.578055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aac93ef5-91b3-45fd-a131-20124f284315 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:51.580539 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aac93ef5-91b3-45fd-a131-20124f284315 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:51.582214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aac93ef5-91b3-45fd-a131-20124f284315 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:51.583464 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aac93ef5-91b3-45fd-a131-20124f284315 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:52.009801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bbda89cc-eedd-44cd-ad26-d2b034fb7773 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:52.035397 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bbda89cc-eedd-44cd-ad26-d2b034fb7773 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:52.041209 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bbda89cc-eedd-44cd-ad26-d2b034fb7773 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:52.045271 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bbda89cc-eedd-44cd-ad26-d2b034fb7773 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] 10.222.0.49 "GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1" status: 200 len: 1358 microversion: 2.21 time: 0.544253 Jul 25 13:04:52.045932 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2262/4607] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:04:51 2022] GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1 => generated 1358 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:04:52.072541 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-e924f027-af77-417d-b626-2457b54e9294 req-d37e43f7-e39a-4d62-b7bc-6454a77368a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b9513b8-10cf-4f0c-9676-231d951d717d", "name": "network-vif-plugged", "status": "completed", "tag": "c0e54450-2df6-43de-bfa7-1fa00aa426e4"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:52.084082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e924f027-af77-417d-b626-2457b54e9294 req-d37e43f7-e39a-4d62-b7bc-6454a77368a0 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:52.084355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-aac93ef5-91b3-45fd-a131-20124f284315 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:52.085532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e924f027-af77-417d-b626-2457b54e9294 req-d37e43f7-e39a-4d62-b7bc-6454a77368a0 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:52.093793 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-aac93ef5-91b3-45fd-a131-20124f284315 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1522 microversion: 2.1 time: 0.532312 Jul 25 13:04:52.102003 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-e924f027-af77-417d-b626-2457b54e9294 req-d37e43f7-e39a-4d62-b7bc-6454a77368a0 service nova] Creating event network-vif-plugged:c0e54450-2df6-43de-bfa7-1fa00aa426e4 for instance 5b9513b8-10cf-4f0c-9676-231d951d717d on n-h2-848886-15 Jul 25 13:04:52.103176 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2346/4608] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:51 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1522 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:04:52.108380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-570b23e1-277e-4352-a322-a20543c60ed8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:52.108953 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-e924f027-af77-417d-b626-2457b54e9294 req-d37e43f7-e39a-4d62-b7bc-6454a77368a0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041118 Jul 25 13:04:52.109101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-570b23e1-277e-4352-a322-a20543c60ed8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 5b9513b8-10cf-4f0c-9676-231d951d717d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:52.109969 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2263/4609] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:04:52.134094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-570b23e1-277e-4352-a322-a20543c60ed8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:52.138359 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-570b23e1-277e-4352-a322-a20543c60ed8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:52.141126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-570b23e1-277e-4352-a322-a20543c60ed8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:52.142468 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-570b23e1-277e-4352-a322-a20543c60ed8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:52.418839 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-937fa5db-ebd5-4a8c-b1f8-14e3fcc7c9bc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:52.420432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-937fa5db-ebd5-4a8c-b1f8-14e3fcc7c9bc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:52.427413 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-937fa5db-ebd5-4a8c-b1f8-14e3fcc7c9bc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:52.428110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-937fa5db-ebd5-4a8c-b1f8-14e3fcc7c9bc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:52.429090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-937fa5db-ebd5-4a8c-b1f8-14e3fcc7c9bc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:52.429704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-937fa5db-ebd5-4a8c-b1f8-14e3fcc7c9bc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:52.516586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-570b23e1-277e-4352-a322-a20543c60ed8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:52.532596 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-570b23e1-277e-4352-a322-a20543c60ed8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d" status: 200 len: 1293 microversion: 2.1 time: 0.428188 Jul 25 13:04:52.542771 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2347/4610] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:52 2022] GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d => generated 1293 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:52.555205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-29684bd9-4f66-4f13-9560-8c298eb26a32 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:52.559967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-29684bd9-4f66-4f13-9560-8c298eb26a32 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:52.574870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29684bd9-4f66-4f13-9560-8c298eb26a32 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:52.575323 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29684bd9-4f66-4f13-9560-8c298eb26a32 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:52.576111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29684bd9-4f66-4f13-9560-8c298eb26a32 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:52.576550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29684bd9-4f66-4f13-9560-8c298eb26a32 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:52.737817 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-937fa5db-ebd5-4a8c-b1f8-14e3fcc7c9bc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:52.753669 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-937fa5db-ebd5-4a8c-b1f8-14e3fcc7c9bc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1682 microversion: 2.1 time: 0.338989 Jul 25 13:04:52.754854 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2264/4611] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:52 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1682 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:04:52.987639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-29684bd9-4f66-4f13-9560-8c298eb26a32 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:52.997120 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-29684bd9-4f66-4f13-9560-8c298eb26a32 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1722 microversion: 2.1 time: 0.449910 Jul 25 13:04:53.006351 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2348/4612] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:52 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1722 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:53.072564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5d45393f-fe24-4164-905d-7bf9a289d50d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:53.073189 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5d45393f-fe24-4164-905d-7bf9a289d50d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] [instance: b1ea495c-376d-4582-b18e-05cdbb7dc6b1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:53.081950 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d45393f-fe24-4164-905d-7bf9a289d50d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:53.082703 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d45393f-fe24-4164-905d-7bf9a289d50d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:53.083684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d45393f-fe24-4164-905d-7bf9a289d50d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:53.084440 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d45393f-fe24-4164-905d-7bf9a289d50d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:53.124582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-29766793-0f2d-4bd5-a2fb-297835ff1f45 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:53.125387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-29766793-0f2d-4bd5-a2fb-297835ff1f45 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:53.133101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29766793-0f2d-4bd5-a2fb-297835ff1f45 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:53.133707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29766793-0f2d-4bd5-a2fb-297835ff1f45 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:53.135526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29766793-0f2d-4bd5-a2fb-297835ff1f45 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:53.136403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29766793-0f2d-4bd5-a2fb-297835ff1f45 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:53.386730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5d45393f-fe24-4164-905d-7bf9a289d50d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:53.392397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-29766793-0f2d-4bd5-a2fb-297835ff1f45 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:53.403662 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-29766793-0f2d-4bd5-a2fb-297835ff1f45 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1522 microversion: 2.1 time: 0.283033 Jul 25 13:04:53.410499 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5d45393f-fe24-4164-905d-7bf9a289d50d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:53.415008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5d45393f-fe24-4164-905d-7bf9a289d50d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:53.421018 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2349/4613] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:53 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:53.422372 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5d45393f-fe24-4164-905d-7bf9a289d50d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] 10.222.0.49 "GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1" status: 200 len: 1358 microversion: 2.21 time: 0.353717 Jul 25 13:04:53.435946 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2265/4614] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:04:53 2022] GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1 => generated 1358 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:04:53.576852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c29ad27e-95d8-472d-9e54-7e38d13745d1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:53.579459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c29ad27e-95d8-472d-9e54-7e38d13745d1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 5b9513b8-10cf-4f0c-9676-231d951d717d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:53.588235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c29ad27e-95d8-472d-9e54-7e38d13745d1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:53.589667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c29ad27e-95d8-472d-9e54-7e38d13745d1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:53.590919 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c29ad27e-95d8-472d-9e54-7e38d13745d1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:53.591619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c29ad27e-95d8-472d-9e54-7e38d13745d1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:54.017386 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c29ad27e-95d8-472d-9e54-7e38d13745d1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:54.020851 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-10603f34-5af7-4883-a77c-441549df77ac tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:54.021806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-10603f34-5af7-4883-a77c-441549df77ac tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:54.028484 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c29ad27e-95d8-472d-9e54-7e38d13745d1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d" status: 200 len: 1293 microversion: 2.1 time: 0.455408 Jul 25 13:04:54.029445 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2350/4615] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:53 2022] GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d => generated 1293 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:54.036824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10603f34-5af7-4883-a77c-441549df77ac tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:54.037297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10603f34-5af7-4883-a77c-441549df77ac tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:54.038155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10603f34-5af7-4883-a77c-441549df77ac tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:54.038602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10603f34-5af7-4883-a77c-441549df77ac tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:54.214594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-c99ba9c1-8c37-4e77-8058-a71f756637a9 req-f69237ea-b009-4726-bc71-25f42b2ed740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83ce5d82-2762-4aa7-855c-963a23f26665", "tag": "35e7321c-7aa5-4daa-8504-c9f77811ff51"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:54.235891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c99ba9c1-8c37-4e77-8058-a71f756637a9 req-f69237ea-b009-4726-bc71-25f42b2ed740 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:54.236655 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c99ba9c1-8c37-4e77-8058-a71f756637a9 req-f69237ea-b009-4726-bc71-25f42b2ed740 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:54.274539 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-c99ba9c1-8c37-4e77-8058-a71f756637a9 req-f69237ea-b009-4726-bc71-25f42b2ed740 service nova] Creating event network-changed:35e7321c-7aa5-4daa-8504-c9f77811ff51 for instance 83ce5d82-2762-4aa7-855c-963a23f26665 on n-h1-848886-15 Jul 25 13:04:54.281939 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-c99ba9c1-8c37-4e77-8058-a71f756637a9 req-f69237ea-b009-4726-bc71-25f42b2ed740 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072005 Jul 25 13:04:54.283238 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2351/4616] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:04:54.431171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-37b8b307-d83c-4644-a9e3-aa60061043b3 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:54.437366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-37b8b307-d83c-4644-a9e3-aa60061043b3 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:54.461324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-37b8b307-d83c-4644-a9e3-aa60061043b3 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:54.463182 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-37b8b307-d83c-4644-a9e3-aa60061043b3 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:54.466876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-37b8b307-d83c-4644-a9e3-aa60061043b3 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:54.467585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-37b8b307-d83c-4644-a9e3-aa60061043b3 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:54.476279 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-10603f34-5af7-4883-a77c-441549df77ac tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:54.491940 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-10603f34-5af7-4883-a77c-441549df77ac tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1722 microversion: 2.1 time: 0.474954 Jul 25 13:04:54.507396 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2266/4617] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:54 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1722 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:54.523693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fdfae715-ff62-449c-bc18-122f7f421578 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:54.525147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fdfae715-ff62-449c-bc18-122f7f421578 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] [instance: b1ea495c-376d-4582-b18e-05cdbb7dc6b1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:54.551602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fdfae715-ff62-449c-bc18-122f7f421578 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:54.555782 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fdfae715-ff62-449c-bc18-122f7f421578 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:54.558755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fdfae715-ff62-449c-bc18-122f7f421578 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:54.559584 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fdfae715-ff62-449c-bc18-122f7f421578 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:55.649179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-37b8b307-d83c-4644-a9e3-aa60061043b3 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:55.665075 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-37b8b307-d83c-4644-a9e3-aa60061043b3 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1522 microversion: 2.1 time: 1.243305 Jul 25 13:04:55.674059 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2352/4618] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:54 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1522 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:04:55.683376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-625b3269-1cc7-472f-9de2-3a887ca5fb6a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:55.685478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-625b3269-1cc7-472f-9de2-3a887ca5fb6a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 5b9513b8-10cf-4f0c-9676-231d951d717d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:55.692961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fdfae715-ff62-449c-bc18-122f7f421578 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:55.694565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-625b3269-1cc7-472f-9de2-3a887ca5fb6a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:55.696277 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-625b3269-1cc7-472f-9de2-3a887ca5fb6a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:55.698301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-625b3269-1cc7-472f-9de2-3a887ca5fb6a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:55.699082 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-625b3269-1cc7-472f-9de2-3a887ca5fb6a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:55.706518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fdfae715-ff62-449c-bc18-122f7f421578 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:55.708604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fdfae715-ff62-449c-bc18-122f7f421578 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:55.710052 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fdfae715-ff62-449c-bc18-122f7f421578 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] 10.222.0.49 "GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1" status: 200 len: 1358 microversion: 2.21 time: 1.198469 Jul 25 13:04:55.713330 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2267/4619] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:04:54 2022] GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1 => generated 1358 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:04:55.717460 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bdbf71a7-2d51-456a-8064-056365e11061 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:55.718431 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bdbf71a7-2d51-456a-8064-056365e11061 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:55.728843 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bdbf71a7-2d51-456a-8064-056365e11061 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:55.730327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bdbf71a7-2d51-456a-8064-056365e11061 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:55.731439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bdbf71a7-2d51-456a-8064-056365e11061 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:55.732502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bdbf71a7-2d51-456a-8064-056365e11061 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:55.736862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:56.090050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-625b3269-1cc7-472f-9de2-3a887ca5fb6a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:56.103637 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-625b3269-1cc7-472f-9de2-3a887ca5fb6a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d" status: 200 len: 1473 microversion: 2.1 time: 0.425911 Jul 25 13:04:56.104219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bdbf71a7-2d51-456a-8064-056365e11061 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:56.120070 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bdbf71a7-2d51-456a-8064-056365e11061 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1722 microversion: 2.1 time: 0.406575 Jul 25 13:04:56.129797 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2353/4620] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:55 2022] GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d => generated 1473 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:56.147144 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2268/4621] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:55 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1722 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:56.163546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-e8ad86ad-e238-4148-b525-88494a5d0e67 req-759554b9-02e8-4759-af60-a62c35e492d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "486f49b3-3f54-478c-9c21-c33a16ae4fde", "name": "network-vif-plugged", "status": "completed", "tag": "fefdb487-385f-4f8b-b1dd-99ad9fb2469d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:56.183336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e8ad86ad-e238-4148-b525-88494a5d0e67 req-759554b9-02e8-4759-af60-a62c35e492d9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:56.188768 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e8ad86ad-e238-4148-b525-88494a5d0e67 req-759554b9-02e8-4759-af60-a62c35e492d9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:56.203071 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-041fc674-1519-434e-a6a7-e2ea578f6b15 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-753946996", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:56.214378 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-e8ad86ad-e238-4148-b525-88494a5d0e67 req-759554b9-02e8-4759-af60-a62c35e492d9 service nova] Creating event network-vif-plugged:fefdb487-385f-4f8b-b1dd-99ad9fb2469d for instance 486f49b3-3f54-478c-9c21-c33a16ae4fde on n-h1-848886-15 Jul 25 13:04:56.233024 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-e8ad86ad-e238-4148-b525-88494a5d0e67 req-759554b9-02e8-4759-af60-a62c35e492d9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070498 Jul 25 13:04:56.234910 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2354/4622] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:04:56.292843 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-041fc674-1519-434e-a6a7-e2ea578f6b15 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] validate_networks() for [('41e863a3-713c-4d35-a204-58098a16a6e3', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:04:56.690163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ff583c97-ce32-4bbf-b696-4034164f1842 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:56.697622 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ff583c97-ce32-4bbf-b696-4034164f1842 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:56.716211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff583c97-ce32-4bbf-b696-4034164f1842 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:56.718511 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff583c97-ce32-4bbf-b696-4034164f1842 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:56.720680 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff583c97-ce32-4bbf-b696-4034164f1842 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:56.722132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff583c97-ce32-4bbf-b696-4034164f1842 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:57.114864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ff583c97-ce32-4bbf-b696-4034164f1842 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:57.130710 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ff583c97-ce32-4bbf-b696-4034164f1842 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1522 microversion: 2.1 time: 0.446600 Jul 25 13:04:57.131587 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2355/4623] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:56 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1522 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:57.136553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-18c2fca5-e31c-4610-b570-d136c0e65f37 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:57.138558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-18c2fca5-e31c-4610-b570-d136c0e65f37 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] [instance: b1ea495c-376d-4582-b18e-05cdbb7dc6b1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:57.156681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-18c2fca5-e31c-4610-b570-d136c0e65f37 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:57.159224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-18c2fca5-e31c-4610-b570-d136c0e65f37 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:57.161567 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-18c2fca5-e31c-4610-b570-d136c0e65f37 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:57.162600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-18c2fca5-e31c-4610-b570-d136c0e65f37 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:57.500848 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-041fc674-1519-434e-a6a7-e2ea578f6b15 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:04:57.501701 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-041fc674-1519-434e-a6a7-e2ea578f6b15 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:04:57.501982 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-041fc674-1519-434e-a6a7-e2ea578f6b15 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:04:57.502589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-041fc674-1519-434e-a6a7-e2ea578f6b15 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:04:57.503000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-041fc674-1519-434e-a6a7-e2ea578f6b15 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:04:57.513412 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-18c2fca5-e31c-4610-b570-d136c0e65f37 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:57.521490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-041fc674-1519-434e-a6a7-e2ea578f6b15 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:57.522683 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-18c2fca5-e31c-4610-b570-d136c0e65f37 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:57.523899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-041fc674-1519-434e-a6a7-e2ea578f6b15 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:57.524197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-18c2fca5-e31c-4610-b570-d136c0e65f37 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:57.525353 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-18c2fca5-e31c-4610-b570-d136c0e65f37 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] 10.222.0.49 "GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1" status: 200 len: 1358 microversion: 2.21 time: 0.392634 Jul 25 13:04:57.526321 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2356/4624] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:04:57 2022] GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1 => generated 1358 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:04:57.528435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-041fc674-1519-434e-a6a7-e2ea578f6b15 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:57.530086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-041fc674-1519-434e-a6a7-e2ea578f6b15 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:57.538437 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a4b38e47-aa27-41ab-aa9e-40eed28a73cb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:57.539354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a4b38e47-aa27-41ab-aa9e-40eed28a73cb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:57.546188 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4b38e47-aa27-41ab-aa9e-40eed28a73cb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:57.546972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4b38e47-aa27-41ab-aa9e-40eed28a73cb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:57.547920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4b38e47-aa27-41ab-aa9e-40eed28a73cb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:57.548525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4b38e47-aa27-41ab-aa9e-40eed28a73cb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:57.573186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-041fc674-1519-434e-a6a7-e2ea578f6b15 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Getting quotas for project ebb6a07295234370aa1aa5067b8ee930. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:04:57.586665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-041fc674-1519-434e-a6a7-e2ea578f6b15 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Getting quotas for user 60d84eb7c45449cbad3141d9f363e693 and project ebb6a07295234370aa1aa5067b8ee930. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:04:57.625645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-041fc674-1519-434e-a6a7-e2ea578f6b15 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:04:57.630500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-041fc674-1519-434e-a6a7-e2ea578f6b15 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: f004578f-490b-4d27-9162-fd7b047373d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:04:57.702722 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-041fc674-1519-434e-a6a7-e2ea578f6b15 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.503770 Jul 25 13:04:57.703990 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2269/4625] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:04:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 13:04:57.719605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8271dbca-72e8-43ce-a306-ca93f75128ec tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:57.720426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8271dbca-72e8-43ce-a306-ca93f75128ec tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: f004578f-490b-4d27-9162-fd7b047373d0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:57.798147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8271dbca-72e8-43ce-a306-ca93f75128ec tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: f004578f-490b-4d27-9162-fd7b047373d0] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:04:58.083737 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a4b38e47-aa27-41ab-aa9e-40eed28a73cb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:58.105301 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a4b38e47-aa27-41ab-aa9e-40eed28a73cb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1699 microversion: 2.1 time: 0.572586 Jul 25 13:04:58.106943 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2357/4626] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:57 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1699 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:58.140719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1cda50d8-52da-41bd-b7ca-585f5e28c16e tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:58.163386 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1cda50d8-52da-41bd-b7ca-585f5e28c16e tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:58.166319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1cda50d8-52da-41bd-b7ca-585f5e28c16e tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:58.228908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1cda50d8-52da-41bd-b7ca-585f5e28c16e tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Going to try to start instance {{(pid=125884) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 13:04:58.338443 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1cda50d8-52da-41bd-b7ca-585f5e28c16e tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "POST /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e/action" status: 202 len: 0 microversion: 2.1 time: 0.210321 Jul 25 13:04:58.343999 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2358/4627] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:04:58 2022] POST /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:04:58.354607 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-eefbe2a5-9f5a-4029-bfb8-1248e2720850 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:58.364165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eefbe2a5-9f5a-4029-bfb8-1248e2720850 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:58.373264 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.scheduler.client.report [None req-8271dbca-72e8-43ce-a306-ca93f75128ec tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Deleted allocations for instance f004578f-490b-4d27-9162-fd7b047373d0 Jul 25 13:04:58.379437 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eefbe2a5-9f5a-4029-bfb8-1248e2720850 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:58.380153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eefbe2a5-9f5a-4029-bfb8-1248e2720850 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:58.381238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eefbe2a5-9f5a-4029-bfb8-1248e2720850 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:58.381946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eefbe2a5-9f5a-4029-bfb8-1248e2720850 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:58.408541 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8271dbca-72e8-43ce-a306-ca93f75128ec tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f004578f-490b-4d27-9162-fd7b047373d0" status: 204 len: 0 microversion: 2.1 time: 0.693178 Jul 25 13:04:58.409998 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2270/4628] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:04:57 2022] DELETE /compute/v2.1/servers/f004578f-490b-4d27-9162-fd7b047373d0 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:04:58.415820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f9e1b1d4-0636-4f64-bb7a-16e937bcb004 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:58.416792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f9e1b1d4-0636-4f64-bb7a-16e937bcb004 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:58.433470 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9e1b1d4-0636-4f64-bb7a-16e937bcb004 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:58.434272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9e1b1d4-0636-4f64-bb7a-16e937bcb004 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:58.435243 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9e1b1d4-0636-4f64-bb7a-16e937bcb004 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:58.435871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9e1b1d4-0636-4f64-bb7a-16e937bcb004 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:58.717587 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-eefbe2a5-9f5a-4029-bfb8-1248e2720850 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:58.730469 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-eefbe2a5-9f5a-4029-bfb8-1248e2720850 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1522 microversion: 2.1 time: 0.385733 Jul 25 13:04:58.748586 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2359/4629] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:58 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1522 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:58.760413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-82f7c8c4-0189-4a4f-a9b0-5b72e3e0c2ed req-792dd5c6-3d01-4020-853e-016281ed5c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1ea495c-376d-4582-b18e-05cdbb7dc6b1", "name": "network-vif-plugged", "status": "completed", "tag": "ea32be53-f0fc-4563-bdab-c68a215112aa"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:58.786441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-82f7c8c4-0189-4a4f-a9b0-5b72e3e0c2ed req-792dd5c6-3d01-4020-853e-016281ed5c8a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:58.789486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-82f7c8c4-0189-4a4f-a9b0-5b72e3e0c2ed req-792dd5c6-3d01-4020-853e-016281ed5c8a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:58.814756 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-82f7c8c4-0189-4a4f-a9b0-5b72e3e0c2ed req-792dd5c6-3d01-4020-853e-016281ed5c8a service nova] Creating event network-vif-plugged:ea32be53-f0fc-4563-bdab-c68a215112aa for instance b1ea495c-376d-4582-b18e-05cdbb7dc6b1 on n-h1-848886-15 Jul 25 13:04:58.826384 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-82f7c8c4-0189-4a4f-a9b0-5b72e3e0c2ed req-792dd5c6-3d01-4020-853e-016281ed5c8a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073272 Jul 25 13:04:58.847921 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2360/4630] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:04:58.860732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c8e5f1cd-5f31-4c43-ac21-c3c632c34a9e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:58.861683 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c8e5f1cd-5f31-4c43-ac21-c3c632c34a9e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: f004578f-490b-4d27-9162-fd7b047373d0] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:58.876471 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-c8e5f1cd-5f31-4c43-ac21-c3c632c34a9e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] HTTP exception thrown: Instance f004578f-490b-4d27-9162-fd7b047373d0 could not be found. Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c8e5f1cd-5f31-4c43-ac21-c3c632c34a9e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Request method failure captured: Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/f004578f-490b-4d27-9162-fd7b047373d0 HTTP/1.1 Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pTdZnYy3zWCXLN8GI-lAb9Aac2xutmWdntWmHOJQQOAHuSaLRru4vmbdxH-2ipAsIwdgHGRBCQV52EgrlBqV5LzQtSAIs0OqruuNBUIA1ZYGpGU7ybcvN2tekv0vVPxk7wJZaAmUwppQmT0JDG4pBCSl5Rw9dXMoK1Y6yvluyRvyio Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersTestJSON-733750618 Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebb6a07295234370aa1aa5067b8ee930", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}] Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersTestJSON-733750618 Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersTestJSON-733750618 Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersTestJSON-733750618-project Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 60d84eb7c45449cbad3141d9f363e693 Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersTestJSON-733750618-project Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance f004578f-490b-4d27-9162-fd7b047373d0 could not be found. Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'f004578f-490b-4d27-9162-fd7b047373d0'} Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f004578f-490b-4d27-9162-fd7b047373d0 could not be found. Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f004578f-490b-4d27-9162-fd7b047373d0 could not be found. Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:04:58.881049 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:04:58.886767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:04:58.886767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:04:58.886767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f004578f-490b-4d27-9162-fd7b047373d0 could not be found. Jul 25 13:04:58.886767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:04:58.890435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f9e1b1d4-0636-4f64-bb7a-16e937bcb004 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:58.892748 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c8e5f1cd-5f31-4c43-ac21-c3c632c34a9e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Returning 404 to user: Instance f004578f-490b-4d27-9162-fd7b047373d0 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:04:58.894815 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c8e5f1cd-5f31-4c43-ac21-c3c632c34a9e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/f004578f-490b-4d27-9162-fd7b047373d0" status: 404 len: 111 microversion: 2.1 time: 0.044661 Jul 25 13:04:58.898251 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2361/4631] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:58 2022] GET /compute/v2.1/servers/f004578f-490b-4d27-9162-fd7b047373d0 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:04:58.905486 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f9e1b1d4-0636-4f64-bb7a-16e937bcb004 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1708 microversion: 2.1 time: 0.488214 Jul 25 13:04:58.912001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7d4e9642-72a4-4f1d-96f4-e6879f8292b2 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:58.913107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7d4e9642-72a4-4f1d-96f4-e6879f8292b2 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] [instance: b1ea495c-376d-4582-b18e-05cdbb7dc6b1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:58.919240 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2271/4632] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:58 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1708 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:58.924047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d4e9642-72a4-4f1d-96f4-e6879f8292b2 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:58.924744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d4e9642-72a4-4f1d-96f4-e6879f8292b2 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:58.925976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d4e9642-72a4-4f1d-96f4-e6879f8292b2 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:58.926572 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d4e9642-72a4-4f1d-96f4-e6879f8292b2 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:58.985957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e944dd17-a67d-41ae-96c5-831ffe4b9db4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-265729438", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "41e863a3-713c-4d35-a204-58098a16a6e3"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:59.113090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-e944dd17-a67d-41ae-96c5-831ffe4b9db4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] validate_networks() for [('41e863a3-713c-4d35-a204-58098a16a6e3', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:05:00.350924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7d4e9642-72a4-4f1d-96f4-e6879f8292b2 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:00.378296 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7d4e9642-72a4-4f1d-96f4-e6879f8292b2 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:00.387089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7d4e9642-72a4-4f1d-96f4-e6879f8292b2 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:00.390914 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7d4e9642-72a4-4f1d-96f4-e6879f8292b2 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] 10.222.0.49 "GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1" status: 200 len: 1358 microversion: 2.21 time: 1.491114 Jul 25 13:05:00.453938 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2362/4633] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:04:58 2022] GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1 => generated 1358 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:05:00.491772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8020966e-e4de-48ef-864c-b4c60ba0631f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:00.493495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8020966e-e4de-48ef-864c-b4c60ba0631f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:00.509564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8020966e-e4de-48ef-864c-b4c60ba0631f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:00.510918 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8020966e-e4de-48ef-864c-b4c60ba0631f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:00.512598 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8020966e-e4de-48ef-864c-b4c60ba0631f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:00.513761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8020966e-e4de-48ef-864c-b4c60ba0631f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:00.965028 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-e944dd17-a67d-41ae-96c5-831ffe4b9db4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:05:00.965504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-e944dd17-a67d-41ae-96c5-831ffe4b9db4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:05:00.966096 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-e944dd17-a67d-41ae-96c5-831ffe4b9db4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:05:00.968182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-e944dd17-a67d-41ae-96c5-831ffe4b9db4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:05:00.968635 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-e944dd17-a67d-41ae-96c5-831ffe4b9db4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:05:00.979422 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e944dd17-a67d-41ae-96c5-831ffe4b9db4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:00.979918 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e944dd17-a67d-41ae-96c5-831ffe4b9db4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:00.980751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e944dd17-a67d-41ae-96c5-831ffe4b9db4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:00.981201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e944dd17-a67d-41ae-96c5-831ffe4b9db4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:01.015393 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8020966e-e4de-48ef-864c-b4c60ba0631f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:01.028168 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-e944dd17-a67d-41ae-96c5-831ffe4b9db4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Getting quotas for project ebb6a07295234370aa1aa5067b8ee930. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:05:01.030670 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8020966e-e4de-48ef-864c-b4c60ba0631f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1522 microversion: 2.1 time: 0.573622 Jul 25 13:05:01.031275 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2363/4634] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:00 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1522 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:01.035998 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7bca5da2-6c77-4ade-8f45-1cbde90e6793 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:01.036608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7bca5da2-6c77-4ade-8f45-1cbde90e6793 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:01.050318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-e944dd17-a67d-41ae-96c5-831ffe4b9db4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Getting quotas for user 60d84eb7c45449cbad3141d9f363e693 and project ebb6a07295234370aa1aa5067b8ee930. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:05:01.050887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7bca5da2-6c77-4ade-8f45-1cbde90e6793 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:01.051371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7bca5da2-6c77-4ade-8f45-1cbde90e6793 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:01.052164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7bca5da2-6c77-4ade-8f45-1cbde90e6793 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:01.052605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7bca5da2-6c77-4ade-8f45-1cbde90e6793 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:01.067511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e944dd17-a67d-41ae-96c5-831ffe4b9db4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:05:01.070649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e944dd17-a67d-41ae-96c5-831ffe4b9db4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 310aaeaf-1647-441a-9cac-ab0b8b66a750] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:05:01.160981 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e944dd17-a67d-41ae-96c5-831ffe4b9db4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.179922 Jul 25 13:05:01.161537 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2272/4635] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:04:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:05:01.180724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5f3bfb48-4c54-4ca4-8a6e-60a388724f36 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:01.183240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5f3bfb48-4c54-4ca4-8a6e-60a388724f36 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 310aaeaf-1647-441a-9cac-ab0b8b66a750] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:01.300816 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5f3bfb48-4c54-4ca4-8a6e-60a388724f36 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:01.310736 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5f3bfb48-4c54-4ca4-8a6e-60a388724f36 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750" status: 200 len: 1220 microversion: 2.1 time: 0.139419 Jul 25 13:05:01.311892 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2273/4636] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:01 2022] GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750 => generated 1220 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:01.366450 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7bca5da2-6c77-4ade-8f45-1cbde90e6793 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:01.382298 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7bca5da2-6c77-4ade-8f45-1cbde90e6793 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1712 microversion: 2.1 time: 0.349841 Jul 25 13:05:01.383527 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2364/4637] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:01 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1712 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:01.438823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3500087f-7fb8-4c72-b6db-895b581d3950 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:01.440582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3500087f-7fb8-4c72-b6db-895b581d3950 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] [instance: b1ea495c-376d-4582-b18e-05cdbb7dc6b1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:01.450787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3500087f-7fb8-4c72-b6db-895b581d3950 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:01.451462 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3500087f-7fb8-4c72-b6db-895b581d3950 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:01.452478 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3500087f-7fb8-4c72-b6db-895b581d3950 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:01.453372 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3500087f-7fb8-4c72-b6db-895b581d3950 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:02.059797 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-eb838ba9-514c-406d-8c51-ae3a9d244452 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:02.060000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3500087f-7fb8-4c72-b6db-895b581d3950 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:02.061498 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eb838ba9-514c-406d-8c51-ae3a9d244452 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:02.069784 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb838ba9-514c-406d-8c51-ae3a9d244452 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:02.070725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb838ba9-514c-406d-8c51-ae3a9d244452 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:02.073010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb838ba9-514c-406d-8c51-ae3a9d244452 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:02.073765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb838ba9-514c-406d-8c51-ae3a9d244452 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:02.087198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3500087f-7fb8-4c72-b6db-895b581d3950 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:02.090084 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3500087f-7fb8-4c72-b6db-895b581d3950 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:02.092290 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3500087f-7fb8-4c72-b6db-895b581d3950 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] 10.222.0.49 "GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1" status: 200 len: 1358 microversion: 2.21 time: 0.659366 Jul 25 13:05:02.105051 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2274/4638] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:05:01 2022] GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1 => generated 1358 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:05:02.339291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-78822e35-38f5-4ec5-ab85-317b4475d99d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:02.340388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-78822e35-38f5-4ec5-ab85-317b4475d99d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 310aaeaf-1647-441a-9cac-ab0b8b66a750] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:02.356187 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78822e35-38f5-4ec5-ab85-317b4475d99d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:02.357309 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78822e35-38f5-4ec5-ab85-317b4475d99d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:02.358685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78822e35-38f5-4ec5-ab85-317b4475d99d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:02.359028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-eb838ba9-514c-406d-8c51-ae3a9d244452 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:02.360174 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78822e35-38f5-4ec5-ab85-317b4475d99d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:02.374559 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-eb838ba9-514c-406d-8c51-ae3a9d244452 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1522 microversion: 2.1 time: 0.325268 Jul 25 13:05:02.375812 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2365/4639] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:02 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:05:02.482291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-78822e35-38f5-4ec5-ab85-317b4475d99d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:02.495930 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-78822e35-38f5-4ec5-ab85-317b4475d99d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750" status: 200 len: 1272 microversion: 2.1 time: 0.165257 Jul 25 13:05:02.505495 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2275/4640] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:02 2022] GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750 => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:05:03.126119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-32ae2400-5649-449a-940c-dbdf136614ea tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:03.126892 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-32ae2400-5649-449a-940c-dbdf136614ea tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] [instance: b1ea495c-376d-4582-b18e-05cdbb7dc6b1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:03.143617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32ae2400-5649-449a-940c-dbdf136614ea tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:03.144247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32ae2400-5649-449a-940c-dbdf136614ea tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:03.148078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32ae2400-5649-449a-940c-dbdf136614ea tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:03.148705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32ae2400-5649-449a-940c-dbdf136614ea tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:03.398828 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fd7f5898-703c-4133-98d8-7afb82ab4f0c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:03.399376 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fd7f5898-703c-4133-98d8-7afb82ab4f0c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:03.406759 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd7f5898-703c-4133-98d8-7afb82ab4f0c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:03.407567 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd7f5898-703c-4133-98d8-7afb82ab4f0c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:03.408357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd7f5898-703c-4133-98d8-7afb82ab4f0c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:03.409160 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd7f5898-703c-4133-98d8-7afb82ab4f0c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:03.996941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-32ae2400-5649-449a-940c-dbdf136614ea tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:04.021461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-32ae2400-5649-449a-940c-dbdf136614ea tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:04.029117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-32ae2400-5649-449a-940c-dbdf136614ea tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:04.030332 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-32ae2400-5649-449a-940c-dbdf136614ea tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] 10.222.0.49 "GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1" status: 200 len: 1550 microversion: 2.21 time: 0.917531 Jul 25 13:05:04.031899 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2366/4641] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:05:03 2022] GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1 => generated 1550 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:05:04.046367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-eb9109c2-b6aa-4a18-b8c6-35deb9786b84 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:04.050869 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eb9109c2-b6aa-4a18-b8c6-35deb9786b84 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 310aaeaf-1647-441a-9cac-ab0b8b66a750] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:04.058159 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb9109c2-b6aa-4a18-b8c6-35deb9786b84 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:04.058881 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb9109c2-b6aa-4a18-b8c6-35deb9786b84 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:04.059707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb9109c2-b6aa-4a18-b8c6-35deb9786b84 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:04.060134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb9109c2-b6aa-4a18-b8c6-35deb9786b84 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:04.196335 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-eb9109c2-b6aa-4a18-b8c6-35deb9786b84 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:04.206247 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-eb9109c2-b6aa-4a18-b8c6-35deb9786b84 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750" status: 200 len: 1278 microversion: 2.1 time: 0.172913 Jul 25 13:05:04.207129 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2367/4642] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:04 2022] GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750 => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:04.212690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-16e58633-d4dd-49c5-94a0-77d72350522d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:04.213538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-16e58633-d4dd-49c5-94a0-77d72350522d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] [instance: b1ea495c-376d-4582-b18e-05cdbb7dc6b1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:04.220682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16e58633-d4dd-49c5-94a0-77d72350522d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:04.221169 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16e58633-d4dd-49c5-94a0-77d72350522d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:04.222090 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16e58633-d4dd-49c5-94a0-77d72350522d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:04.222539 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16e58633-d4dd-49c5-94a0-77d72350522d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:04.232653 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fd7f5898-703c-4133-98d8-7afb82ab4f0c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:04.243745 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fd7f5898-703c-4133-98d8-7afb82ab4f0c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1522 microversion: 2.1 time: 0.851291 Jul 25 13:05:04.245387 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2276/4643] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:03 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1522 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:05:04.263837 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-16e58633-d4dd-49c5-94a0-77d72350522d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] [instance: b1ea495c-376d-4582-b18e-05cdbb7dc6b1] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:05:04.399971 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-16e58633-d4dd-49c5-94a0-77d72350522d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1" status: 204 len: 0 microversion: 2.21 time: 0.191342 Jul 25 13:05:04.401125 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2368/4644] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 13:05:04 2022] DELETE /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 13:05:04.412690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-440dfdc2-7b5a-44c9-b84d-3eba257f6d12 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:04.414705 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-440dfdc2-7b5a-44c9-b84d-3eba257f6d12 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] [instance: b1ea495c-376d-4582-b18e-05cdbb7dc6b1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:04.428695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-440dfdc2-7b5a-44c9-b84d-3eba257f6d12 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:04.429147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-440dfdc2-7b5a-44c9-b84d-3eba257f6d12 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:04.430477 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-440dfdc2-7b5a-44c9-b84d-3eba257f6d12 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:04.431720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-440dfdc2-7b5a-44c9-b84d-3eba257f6d12 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:04.701191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-440dfdc2-7b5a-44c9-b84d-3eba257f6d12 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:04.712834 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-440dfdc2-7b5a-44c9-b84d-3eba257f6d12 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:04.714887 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-440dfdc2-7b5a-44c9-b84d-3eba257f6d12 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:04.716573 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-440dfdc2-7b5a-44c9-b84d-3eba257f6d12 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] 10.222.0.49 "GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1" status: 200 len: 1556 microversion: 2.21 time: 0.311297 Jul 25 13:05:04.718133 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2277/4645] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:05:04 2022] GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1 => generated 1556 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:05:05.230942 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8040167d-268c-4c3f-b840-f8f68d44dc0f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:05.232699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8040167d-268c-4c3f-b840-f8f68d44dc0f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 310aaeaf-1647-441a-9cac-ab0b8b66a750] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:05.243031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8040167d-268c-4c3f-b840-f8f68d44dc0f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:05.243371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8040167d-268c-4c3f-b840-f8f68d44dc0f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:05.244849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8040167d-268c-4c3f-b840-f8f68d44dc0f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:05.245248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8040167d-268c-4c3f-b840-f8f68d44dc0f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:05.268717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fb3c8dc4-ceb1-489a-865b-dacf18cfc6f7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:05.269540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fb3c8dc4-ceb1-489a-865b-dacf18cfc6f7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:05.278182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb3c8dc4-ceb1-489a-865b-dacf18cfc6f7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:05.281119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb3c8dc4-ceb1-489a-865b-dacf18cfc6f7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:05.282361 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb3c8dc4-ceb1-489a-865b-dacf18cfc6f7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:05.283111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb3c8dc4-ceb1-489a-865b-dacf18cfc6f7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:05.808780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8040167d-268c-4c3f-b840-f8f68d44dc0f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:05.815666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:05.828352 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8040167d-268c-4c3f-b840-f8f68d44dc0f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750" status: 200 len: 1320 microversion: 2.1 time: 0.602705 Jul 25 13:05:05.831688 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2369/4646] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:05 2022] GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750 => generated 1320 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:05.843773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e60e5601-d34b-437e-92d2-94116c1214d8 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:05.852873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e60e5601-d34b-437e-92d2-94116c1214d8 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] [instance: b1ea495c-376d-4582-b18e-05cdbb7dc6b1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:05.859269 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fb3c8dc4-ceb1-489a-865b-dacf18cfc6f7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:05.869801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e60e5601-d34b-437e-92d2-94116c1214d8 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:05.870673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e60e5601-d34b-437e-92d2-94116c1214d8 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:05.873139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e60e5601-d34b-437e-92d2-94116c1214d8 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:05.873928 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e60e5601-d34b-437e-92d2-94116c1214d8 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:05.877187 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fb3c8dc4-ceb1-489a-865b-dacf18cfc6f7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1522 microversion: 2.1 time: 0.613517 Jul 25 13:05:05.877806 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2278/4647] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:05 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1522 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:05:06.223369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e60e5601-d34b-437e-92d2-94116c1214d8 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:06.234279 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e60e5601-d34b-437e-92d2-94116c1214d8 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:06.236817 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e60e5601-d34b-437e-92d2-94116c1214d8 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:06.238116 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e60e5601-d34b-437e-92d2-94116c1214d8 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] 10.222.0.49 "GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1" status: 200 len: 1556 microversion: 2.21 time: 0.404900 Jul 25 13:05:06.240782 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2370/4648] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:05:05 2022] GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1 => generated 1556 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:05:06.857097 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e539647a-092f-41a2-9b0f-d7fae7cb7673 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:06.858040 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e539647a-092f-41a2-9b0f-d7fae7cb7673 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 310aaeaf-1647-441a-9cac-ab0b8b66a750] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:06.879294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e539647a-092f-41a2-9b0f-d7fae7cb7673 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:06.879952 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e539647a-092f-41a2-9b0f-d7fae7cb7673 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:06.886771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e539647a-092f-41a2-9b0f-d7fae7cb7673 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:06.888736 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e539647a-092f-41a2-9b0f-d7fae7cb7673 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:06.900279 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ec4ebc91-5813-4130-a0c2-39cf9e54bfd6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:06.902735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ec4ebc91-5813-4130-a0c2-39cf9e54bfd6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:06.916799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ec4ebc91-5813-4130-a0c2-39cf9e54bfd6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:06.923077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ec4ebc91-5813-4130-a0c2-39cf9e54bfd6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:06.929313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ec4ebc91-5813-4130-a0c2-39cf9e54bfd6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:06.930235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ec4ebc91-5813-4130-a0c2-39cf9e54bfd6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:07.566300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ec4ebc91-5813-4130-a0c2-39cf9e54bfd6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:07.581397 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ec4ebc91-5813-4130-a0c2-39cf9e54bfd6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1522 microversion: 2.1 time: 0.685548 Jul 25 13:05:07.582045 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2371/4649] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:06 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1522 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:07.590589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d8f6bde2-d907-4436-b993-4d1a8f6e0400 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:07.592154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d8f6bde2-d907-4436-b993-4d1a8f6e0400 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] [instance: b1ea495c-376d-4582-b18e-05cdbb7dc6b1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:07.608881 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8f6bde2-d907-4436-b993-4d1a8f6e0400 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:07.609727 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8f6bde2-d907-4436-b993-4d1a8f6e0400 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:07.614523 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8f6bde2-d907-4436-b993-4d1a8f6e0400 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:07.615239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8f6bde2-d907-4436-b993-4d1a8f6e0400 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:07.742052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d8f6bde2-d907-4436-b993-4d1a8f6e0400 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:07.754885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d8f6bde2-d907-4436-b993-4d1a8f6e0400 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:07.763043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d8f6bde2-d907-4436-b993-4d1a8f6e0400 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ba307908a44f1ba364276838d47e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62f3f0b511c4a0faf02063de1517eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:07.767176 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d8f6bde2-d907-4436-b993-4d1a8f6e0400 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] 10.222.0.49 "GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1" status: 200 len: 1514 microversion: 2.21 time: 0.184114 Jul 25 13:05:07.767983 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2372/4650] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:05:07 2022] GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1 => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:05:07.833171 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e539647a-092f-41a2-9b0f-d7fae7cb7673 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:07.850693 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e539647a-092f-41a2-9b0f-d7fae7cb7673 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750" status: 200 len: 1320 microversion: 2.1 time: 1.003207 Jul 25 13:05:07.858903 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2279/4651] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:06 2022] GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750 => generated 1320 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:07.963054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-45a706bc-5bc1-443d-8886-d6e33c40f956 req-ba1e63d7-08f9-4244-96c7-549ea40f61bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "310aaeaf-1647-441a-9cac-ab0b8b66a750", "tag": "f310278d-1c8e-4911-8beb-dac76734e3b8"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:08.050669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-45a706bc-5bc1-443d-8886-d6e33c40f956 req-ba1e63d7-08f9-4244-96c7-549ea40f61bc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:08.056772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-45a706bc-5bc1-443d-8886-d6e33c40f956 req-ba1e63d7-08f9-4244-96c7-549ea40f61bc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:08.083114 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-45a706bc-5bc1-443d-8886-d6e33c40f956 req-ba1e63d7-08f9-4244-96c7-549ea40f61bc service nova] Creating event network-changed:f310278d-1c8e-4911-8beb-dac76734e3b8 for instance 310aaeaf-1647-441a-9cac-ab0b8b66a750 on n-h2-848886-15 Jul 25 13:05:08.094709 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-45a706bc-5bc1-443d-8886-d6e33c40f956 req-ba1e63d7-08f9-4244-96c7-549ea40f61bc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147485 Jul 25 13:05:08.095337 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2373/4652] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:05:08.607187 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-db869ed5-bd0f-478c-98a5-1529bcb48f0a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:08.607849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-db869ed5-bd0f-478c-98a5-1529bcb48f0a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:08.618051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-db869ed5-bd0f-478c-98a5-1529bcb48f0a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:08.618527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-db869ed5-bd0f-478c-98a5-1529bcb48f0a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:08.619704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-db869ed5-bd0f-478c-98a5-1529bcb48f0a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:08.620150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-db869ed5-bd0f-478c-98a5-1529bcb48f0a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:08.794523 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d86a4275-817e-4896-b071-30deb6374087 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:08.795369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d86a4275-817e-4896-b071-30deb6374087 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] [instance: b1ea495c-376d-4582-b18e-05cdbb7dc6b1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:08.815408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d86a4275-817e-4896-b071-30deb6374087 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:08.822608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d86a4275-817e-4896-b071-30deb6374087 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:08.823801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d86a4275-817e-4896-b071-30deb6374087 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:08.824489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d86a4275-817e-4896-b071-30deb6374087 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:08.864353 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-d86a4275-817e-4896-b071-30deb6374087 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] HTTP exception thrown: Instance b1ea495c-376d-4582-b18e-05cdbb7dc6b1 could not be found. Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d86a4275-817e-4896-b071-30deb6374087 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Request method failure captured: Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1 HTTP/1.1 Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pTkqpjX2SHHZH7aheSpuYNY__rhjWni79QbOJE2vurV-3GTBO14hH6JTbcLXiohORNzp5FEKU7qIM7ro74S3CvpMGL6VzP84QsER5IHJ-TFjH_JgFmjUp4-4vNIz7t_ehDe4jr0MESHoi4_GI-9NEtWJ0omg9p2mgNIWoZmyy0SrN0 Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: X-Openstack-Nova-Api-Version: 2.21 Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: a62f3f0b511c4a0faf02063de1517eef Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-InstanceActionsV221TestJSON-470510014 Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a62f3f0b511c4a0faf02063de1517eef", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a62f3f0b511c4a0faf02063de1517eef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a62f3f0b511c4a0faf02063de1517eef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a62f3f0b511c4a0faf02063de1517eef"}]}] Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-InstanceActionsV221TestJSON-470510014 Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: a62f3f0b511c4a0faf02063de1517eef Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-470510014 Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-InstanceActionsV221TestJSON-470510014-project Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: b8ba307908a44f1ba364276838d47e78 Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-InstanceActionsV221TestJSON-470510014-project Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance b1ea495c-376d-4582-b18e-05cdbb7dc6b1 could not be found. Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'b1ea495c-376d-4582-b18e-05cdbb7dc6b1'} Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1ea495c-376d-4582-b18e-05cdbb7dc6b1 could not be found. Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1ea495c-376d-4582-b18e-05cdbb7dc6b1 could not be found. Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:08.868371 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:05:08.879372 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:08.879372 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:08.879372 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:05:08.879372 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:05:08.879372 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:05:08.879372 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:05:08.879372 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1ea495c-376d-4582-b18e-05cdbb7dc6b1 could not be found. Jul 25 13:05:08.879372 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:08.885651 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d86a4275-817e-4896-b071-30deb6374087 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Returning 404 to user: Instance b1ea495c-376d-4582-b18e-05cdbb7dc6b1 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:05:08.888031 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d86a4275-817e-4896-b071-30deb6374087 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] 10.222.0.49 "GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1" status: 404 len: 111 microversion: 2.21 time: 0.098605 Jul 25 13:05:08.889408 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2374/4653] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:05:08 2022] GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 25 13:05:08.897142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-701eae1a-4e2c-4736-8258-2c0daf3c928b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:08.900125 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-701eae1a-4e2c-4736-8258-2c0daf3c928b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 310aaeaf-1647-441a-9cac-ab0b8b66a750] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:08.909923 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-701eae1a-4e2c-4736-8258-2c0daf3c928b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:08.910669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-701eae1a-4e2c-4736-8258-2c0daf3c928b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:08.911591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-701eae1a-4e2c-4736-8258-2c0daf3c928b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:08.912434 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-701eae1a-4e2c-4736-8258-2c0daf3c928b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:08.953995 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-db869ed5-bd0f-478c-98a5-1529bcb48f0a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:08.970526 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-db869ed5-bd0f-478c-98a5-1529bcb48f0a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1502 microversion: 2.1 time: 0.367270 Jul 25 13:05:08.983049 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2280/4654] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:08 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1502 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:08.988831 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9099ad67-0669-435a-b949-5d720a831d49 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Calling method '.version_select at 0x7efcf906cd30>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:08.989894 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9099ad67-0669-435a-b949-5d720a831d49 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] [instance: b1ea495c-376d-4582-b18e-05cdbb7dc6b1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:09.009565 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9099ad67-0669-435a-b949-5d720a831d49 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:09.010516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9099ad67-0669-435a-b949-5d720a831d49 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:09.011627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9099ad67-0669-435a-b949-5d720a831d49 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:09.014216 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9099ad67-0669-435a-b949-5d720a831d49 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:09.088693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:09.126555 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-701eae1a-4e2c-4736-8258-2c0daf3c928b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:09.136929 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-701eae1a-4e2c-4736-8258-2c0daf3c928b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750" status: 200 len: 1320 microversion: 2.1 time: 0.245920 Jul 25 13:05:09.154567 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2375/4655] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:08 2022] GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750 => generated 1320 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:09.160940 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9099ad67-0669-435a-b949-5d720a831d49 tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] 10.222.0.49 "GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.175984 Jul 25 13:05:09.161823 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2281/4656] 10.222.0.49 () {60 vars in 1337 bytes} [Mon Jul 25 13:05:08 2022] GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1/os-instance-actions => generated 611 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:05:09.173509 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-93656a98-3ba5-4f09-ba02-1ef1a3547a1e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:09.179348 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-93656a98-3ba5-4f09-ba02-1ef1a3547a1e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:09.188127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4c1cc4ed-7f05-4b8d-bb00-e7ec09af213d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:09.188943 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4c1cc4ed-7f05-4b8d-bb00-e7ec09af213d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] [instance: b1ea495c-376d-4582-b18e-05cdbb7dc6b1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:09.197473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93656a98-3ba5-4f09-ba02-1ef1a3547a1e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:09.198644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93656a98-3ba5-4f09-ba02-1ef1a3547a1e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:09.200186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c1cc4ed-7f05-4b8d-bb00-e7ec09af213d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:09.200514 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93656a98-3ba5-4f09-ba02-1ef1a3547a1e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:09.200714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c1cc4ed-7f05-4b8d-bb00-e7ec09af213d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:09.201425 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c1cc4ed-7f05-4b8d-bb00-e7ec09af213d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:09.202055 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c1cc4ed-7f05-4b8d-bb00-e7ec09af213d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:09.202990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93656a98-3ba5-4f09-ba02-1ef1a3547a1e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:09.245271 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-4c1cc4ed-7f05-4b8d-bb00-e7ec09af213d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] HTTP exception thrown: Instance b1ea495c-376d-4582-b18e-05cdbb7dc6b1 could not be found. Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4c1cc4ed-7f05-4b8d-bb00-e7ec09af213d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Request method failure captured: Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1 HTTP/1.1 Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pTkqpjX2SHHZH7aheSpuYNY__rhjWni79QbOJE2vurV-3GTBO14hH6JTbcLXiohORNzp5FEKU7qIM7ro74S3CvpMGL6VzP84QsER5IHJ-TFjH_JgFmjUp4-4vNIz7t_ehDe4jr0MESHoi4_GI-9NEtWJ0omg9p2mgNIWoZmyy0SrN0 Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: X-Openstack-Nova-Api-Version: 2.21 Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: a62f3f0b511c4a0faf02063de1517eef Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-InstanceActionsV221TestJSON-470510014 Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a62f3f0b511c4a0faf02063de1517eef", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a62f3f0b511c4a0faf02063de1517eef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a62f3f0b511c4a0faf02063de1517eef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a62f3f0b511c4a0faf02063de1517eef"}]}] Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-InstanceActionsV221TestJSON-470510014 Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: a62f3f0b511c4a0faf02063de1517eef Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-470510014 Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-InstanceActionsV221TestJSON-470510014-project Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: b8ba307908a44f1ba364276838d47e78 Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-InstanceActionsV221TestJSON-470510014-project Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance b1ea495c-376d-4582-b18e-05cdbb7dc6b1 could not be found. Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'b1ea495c-376d-4582-b18e-05cdbb7dc6b1'} Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1ea495c-376d-4582-b18e-05cdbb7dc6b1 could not be found. Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:05:09.247484 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:05:09.252273 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1ea495c-376d-4582-b18e-05cdbb7dc6b1 could not be found. Jul 25 13:05:09.252273 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:05:09.252273 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:05:09.252273 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:05:09.252273 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:09.252273 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:05:09.252273 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:05:09.252273 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:05:09.252273 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:05:09.252273 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1ea495c-376d-4582-b18e-05cdbb7dc6b1 could not be found. Jul 25 13:05:09.252273 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:05:09.256247 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4c1cc4ed-7f05-4b8d-bb00-e7ec09af213d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Returning 404 to user: Instance b1ea495c-376d-4582-b18e-05cdbb7dc6b1 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:05:09.257732 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4c1cc4ed-7f05-4b8d-bb00-e7ec09af213d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1" status: 404 len: 111 microversion: 2.21 time: 0.079334 Jul 25 13:05:09.261895 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2282/4657] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 13:05:09 2022] DELETE /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:05:09.268089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e1bbf292-628a-4340-a81e-df058665b93d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:09.269048 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e1bbf292-628a-4340-a81e-df058665b93d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] [instance: b1ea495c-376d-4582-b18e-05cdbb7dc6b1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:09.276442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1bbf292-628a-4340-a81e-df058665b93d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:09.277410 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1bbf292-628a-4340-a81e-df058665b93d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:09.278864 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1bbf292-628a-4340-a81e-df058665b93d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:09.279532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1bbf292-628a-4340-a81e-df058665b93d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:09.298582 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-e1bbf292-628a-4340-a81e-df058665b93d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] HTTP exception thrown: Instance b1ea495c-376d-4582-b18e-05cdbb7dc6b1 could not be found. Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e1bbf292-628a-4340-a81e-df058665b93d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Request method failure captured: Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1 HTTP/1.1 Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pTkqpjX2SHHZH7aheSpuYNY__rhjWni79QbOJE2vurV-3GTBO14hH6JTbcLXiohORNzp5FEKU7qIM7ro74S3CvpMGL6VzP84QsER5IHJ-TFjH_JgFmjUp4-4vNIz7t_ehDe4jr0MESHoi4_GI-9NEtWJ0omg9p2mgNIWoZmyy0SrN0 Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: X-Openstack-Nova-Api-Version: 2.21 Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: a62f3f0b511c4a0faf02063de1517eef Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-InstanceActionsV221TestJSON-470510014 Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a62f3f0b511c4a0faf02063de1517eef", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a62f3f0b511c4a0faf02063de1517eef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a62f3f0b511c4a0faf02063de1517eef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a62f3f0b511c4a0faf02063de1517eef"}]}] Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-InstanceActionsV221TestJSON-470510014 Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: a62f3f0b511c4a0faf02063de1517eef Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-470510014 Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-InstanceActionsV221TestJSON-470510014-project Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: b8ba307908a44f1ba364276838d47e78 Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-InstanceActionsV221TestJSON-470510014-project Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance b1ea495c-376d-4582-b18e-05cdbb7dc6b1 could not be found. Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'b1ea495c-376d-4582-b18e-05cdbb7dc6b1'} Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1ea495c-376d-4582-b18e-05cdbb7dc6b1 could not be found. Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1ea495c-376d-4582-b18e-05cdbb7dc6b1 could not be found. Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:05:09.300500 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:05:09.305048 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:05:09.305048 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:09.305048 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:05:09.305048 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:05:09.305048 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:05:09.305048 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:05:09.305048 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1ea495c-376d-4582-b18e-05cdbb7dc6b1 could not be found. Jul 25 13:05:09.305048 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:05:09.307130 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e1bbf292-628a-4340-a81e-df058665b93d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] Returning 404 to user: Instance b1ea495c-376d-4582-b18e-05cdbb7dc6b1 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:05:09.308302 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e1bbf292-628a-4340-a81e-df058665b93d tempest-InstanceActionsV221TestJSON-470510014 tempest-InstanceActionsV221TestJSON-470510014-project] 10.222.0.49 "GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1" status: 404 len: 111 microversion: 2.21 time: 0.045097 Jul 25 13:05:09.312901 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2283/4658] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:05:09 2022] GET /compute/v2.1/servers/b1ea495c-376d-4582-b18e-05cdbb7dc6b1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:05:09.437887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-93656a98-3ba5-4f09-ba02-1ef1a3547a1e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:09.446779 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-93656a98-3ba5-4f09-ba02-1ef1a3547a1e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1514 microversion: 2.1 time: 0.290471 Jul 25 13:05:09.465246 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2376/4659] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:09 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1514 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:09.471837 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-43545716-bee9-4e38-8620-ca7c0bd339af tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:09.475325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-43545716-bee9-4e38-8620-ca7c0bd339af tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: a86c887b-6e9f-4cde-adcc-67da6498458d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:09.480838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:09.485940 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-43545716-bee9-4e38-8620-ca7c0bd339af tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] HTTP exception thrown: Instance a86c887b-6e9f-4cde-adcc-67da6498458d could not be found. Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-43545716-bee9-4e38-8620-ca7c0bd339af tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Request method failure captured: Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/a86c887b-6e9f-4cde-adcc-67da6498458d/action HTTP/1.1 Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 14 Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pS2fizNtGcP0shojWUAR1ukudLDJRoXVlsPYG2HQcSlgo2We_QWqoULmyxY8IuKrW-0MGgmtrhM3h66oISYSRqIRFBaYspnVlW3g8FUdRvhwOpsGmp2Y9wrcYeXMJCu6fdAfgxIzqcJ6TFFh6UfkfCkGP1n9iDHq6IO37482VYIk-U Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: f791ac394f9f4b8d99d2f48f7d04eae9 Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f791ac394f9f4b8d99d2f48f7d04eae9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f791ac394f9f4b8d99d2f48f7d04eae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f791ac394f9f4b8d99d2f48f7d04eae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f791ac394f9f4b8d99d2f48f7d04eae9"}]}] Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: f791ac394f9f4b8d99d2f48f7d04eae9 Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerRescueNegativeTestJSON-1618399313-project Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 72f34c080e4a4024a38660e8af252a29 Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1618399313-project Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: {"rescue": {}} Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance a86c887b-6e9f-4cde-adcc-67da6498458d could not be found. Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'a86c887b-6e9f-4cde-adcc-67da6498458d', 'body': {'rescue': {}}} Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a86c887b-6e9f-4cde-adcc-67da6498458d could not be found. Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a86c887b-6e9f-4cde-adcc-67da6498458d could not be found. Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:05:09.493192 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:09.499556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:05:09.499556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:05:09.499556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:05:09.499556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:05:09.499556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a86c887b-6e9f-4cde-adcc-67da6498458d could not be found. Jul 25 13:05:09.499556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:05:09.501764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-43545716-bee9-4e38-8620-ca7c0bd339af tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Returning 404 to user: Instance a86c887b-6e9f-4cde-adcc-67da6498458d could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:05:09.502856 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-43545716-bee9-4e38-8620-ca7c0bd339af tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "POST /compute/v2.1/servers/a86c887b-6e9f-4cde-adcc-67da6498458d/action" status: 404 len: 111 microversion: 2.1 time: 0.035856 Jul 25 13:05:09.517951 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-21bae971-c1c8-492c-b068-3e5ef1ad0353 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:09.519645 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-21bae971-c1c8-492c-b068-3e5ef1ad0353 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:09.523266 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2284/4660] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:05:09 2022] POST /compute/v2.1/servers/a86c887b-6e9f-4cde-adcc-67da6498458d/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:05:09.528516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-21bae971-c1c8-492c-b068-3e5ef1ad0353 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:09.530321 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-21bae971-c1c8-492c-b068-3e5ef1ad0353 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:09.531384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-21bae971-c1c8-492c-b068-3e5ef1ad0353 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:09.531995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-21bae971-c1c8-492c-b068-3e5ef1ad0353 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:09.639387 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-21bae971-c1c8-492c-b068-3e5ef1ad0353 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "POST /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a/action" status: 202 len: 0 microversion: 2.1 time: 0.129564 Jul 25 13:05:09.640620 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2377/4661] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:05:09 2022] POST /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 13:05:09.651986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e54eee31-0243-4024-9e15-ac6d926d820e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:09.653402 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e54eee31-0243-4024-9e15-ac6d926d820e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:09.683317 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e54eee31-0243-4024-9e15-ac6d926d820e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:09.684334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e54eee31-0243-4024-9e15-ac6d926d820e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:09.685307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e54eee31-0243-4024-9e15-ac6d926d820e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:09.685944 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e54eee31-0243-4024-9e15-ac6d926d820e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:10.178704 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8799c01a-1667-43a4-bb40-9faec3992ced tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:10.180137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8799c01a-1667-43a4-bb40-9faec3992ced tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 310aaeaf-1647-441a-9cac-ab0b8b66a750] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:10.200242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8799c01a-1667-43a4-bb40-9faec3992ced tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:10.201274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8799c01a-1667-43a4-bb40-9faec3992ced tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:10.202345 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8799c01a-1667-43a4-bb40-9faec3992ced tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:10.202964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8799c01a-1667-43a4-bb40-9faec3992ced tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:11.001507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:11.092602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e54eee31-0243-4024-9e15-ac6d926d820e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:11.106321 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e54eee31-0243-4024-9e15-ac6d926d820e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1519 microversion: 2.1 time: 1.460945 Jul 25 13:05:11.119431 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2285/4662] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:09 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1519 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:11.127523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-7c6a72fd-961d-473f-b178-06aa579b333e req-8184a543-f7d2-41b3-9325-16052b318bff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1ea495c-376d-4582-b18e-05cdbb7dc6b1", "name": "network-vif-deleted", "tag": "ea32be53-f0fc-4563-bdab-c68a215112aa"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:11.139578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-7c6a72fd-961d-473f-b178-06aa579b333e req-8184a543-f7d2-41b3-9325-16052b318bff service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:11.140300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-7c6a72fd-961d-473f-b178-06aa579b333e req-8184a543-f7d2-41b3-9325-16052b318bff service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:11.153518 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-7c6a72fd-961d-473f-b178-06aa579b333e req-8184a543-f7d2-41b3-9325-16052b318bff service nova] Creating event network-vif-deleted:ea32be53-f0fc-4563-bdab-c68a215112aa for instance b1ea495c-376d-4582-b18e-05cdbb7dc6b1 on n-h1-848886-15 Jul 25 13:05:11.159150 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-7c6a72fd-961d-473f-b178-06aa579b333e req-8184a543-f7d2-41b3-9325-16052b318bff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038079 Jul 25 13:05:11.160625 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2286/4663] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:05:11.348478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8799c01a-1667-43a4-bb40-9faec3992ced tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:11.379940 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8799c01a-1667-43a4-bb40-9faec3992ced tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750" status: 200 len: 1320 microversion: 2.1 time: 1.207128 Jul 25 13:05:11.393862 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2378/4664] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:10 2022] GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750 => generated 1320 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:12.133633 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0d8cadcf-3578-402f-bdc9-9c49f367f6a4 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:12.134495 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0d8cadcf-3578-402f-bdc9-9c49f367f6a4 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:12.136476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=16 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:12.155746 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d8cadcf-3578-402f-bdc9-9c49f367f6a4 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:12.156182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d8cadcf-3578-402f-bdc9-9c49f367f6a4 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:12.165169 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d8cadcf-3578-402f-bdc9-9c49f367f6a4 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:12.165942 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d8cadcf-3578-402f-bdc9-9c49f367f6a4 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:12.405118 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e359e7c9-ec43-4b8e-b0b4-dc07ec1e06b4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:12.405804 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e359e7c9-ec43-4b8e-b0b4-dc07ec1e06b4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 310aaeaf-1647-441a-9cac-ab0b8b66a750] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:12.418937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e359e7c9-ec43-4b8e-b0b4-dc07ec1e06b4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:12.421862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e359e7c9-ec43-4b8e-b0b4-dc07ec1e06b4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:12.424182 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e359e7c9-ec43-4b8e-b0b4-dc07ec1e06b4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:12.424580 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e359e7c9-ec43-4b8e-b0b4-dc07ec1e06b4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:12.682574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0d8cadcf-3578-402f-bdc9-9c49f367f6a4 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:12.707968 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0d8cadcf-3578-402f-bdc9-9c49f367f6a4 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1499 microversion: 2.1 time: 0.579385 Jul 25 13:05:12.726634 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2287/4665] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:12 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1499 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:12.733314 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d93b810d-900a-4ff6-902d-51be9fd6d741 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:12.736228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d93b810d-900a-4ff6-902d-51be9fd6d741 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:12.744680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d93b810d-900a-4ff6-902d-51be9fd6d741 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:12.745306 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d93b810d-900a-4ff6-902d-51be9fd6d741 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:12.746244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d93b810d-900a-4ff6-902d-51be9fd6d741 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:12.746791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d93b810d-900a-4ff6-902d-51be9fd6d741 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:12.779775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-d93b810d-900a-4ff6-902d-51be9fd6d741 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lazy-loading 'flavor' on Instance uuid 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:05:12.800519 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-d93b810d-900a-4ff6-902d-51be9fd6d741 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] HTTP exception thrown: Cannot 'rescue' instance 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a while it is in vm_state paused Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d93b810d-900a-4ff6-902d-51be9fd6d741 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Request method failure captured: Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a/action HTTP/1.1 Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 14 Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pS2fizNtGcP0shojWUAR1ukudLDJRoXVlsPYG2HQcSlgo2We_QWqoULmyxY8IuKrW-0MGgmtrhM3h66oISYSRqIRFBaYspnVlW3g8FUdRvhwOpsGmp2Y9wrcYeXMJCu6fdAfgxIzqcJ6TFFh6UfkfCkGP1n9iDHq6IO37482VYIk-U Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: f791ac394f9f4b8d99d2f48f7d04eae9 Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f791ac394f9f4b8d99d2f48f7d04eae9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f791ac394f9f4b8d99d2f48f7d04eae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f791ac394f9f4b8d99d2f48f7d04eae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f791ac394f9f4b8d99d2f48f7d04eae9"}]}] Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: f791ac394f9f4b8d99d2f48f7d04eae9 Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerRescueNegativeTestJSON-1618399313-project Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 72f34c080e4a4024a38660e8af252a29 Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1618399313-project Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: {"rescue": {}} Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: exception: Cannot 'rescue' instance 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a while it is in vm_state paused Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a', 'body': {'rescue': {}}} Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a in vm_state paused. Cannot rescue while the instance is in this state. Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a while it is in vm_state paused Jul 25 13:05:12.802556 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:05:12.807178 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:05:12.807178 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:05:12.807178 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:12.807178 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:05:12.807178 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:05:12.807178 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:05:12.807178 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:05:12.807178 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a while it is in vm_state paused Jul 25 13:05:12.807178 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:05:12.809574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d93b810d-900a-4ff6-902d-51be9fd6d741 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Returning 409 to user: Cannot 'rescue' instance 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a while it is in vm_state paused {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:05:12.811298 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d93b810d-900a-4ff6-902d-51be9fd6d741 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "POST /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a/action" status: 409 len: 144 microversion: 2.1 time: 0.083136 Jul 25 13:05:12.812306 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2288/4666] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:05:12 2022] POST /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a/action => generated 144 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 13:05:12.823100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b8ffe01a-3403-46c4-bbf2-2f7c89b9c82e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:12.824111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b8ffe01a-3403-46c4-bbf2-2f7c89b9c82e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:12.837280 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b8ffe01a-3403-46c4-bbf2-2f7c89b9c82e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:12.838118 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b8ffe01a-3403-46c4-bbf2-2f7c89b9c82e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:12.840232 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b8ffe01a-3403-46c4-bbf2-2f7c89b9c82e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:12.840917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b8ffe01a-3403-46c4-bbf2-2f7c89b9c82e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:12.937639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e359e7c9-ec43-4b8e-b0b4-dc07ec1e06b4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:12.946951 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e359e7c9-ec43-4b8e-b0b4-dc07ec1e06b4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750" status: 200 len: 1320 microversion: 2.1 time: 0.548584 Jul 25 13:05:12.948190 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2379/4667] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:12 2022] GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750 => generated 1320 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:13.009857 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b8ffe01a-3403-46c4-bbf2-2f7c89b9c82e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "POST /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a/action" status: 202 len: 0 microversion: 2.1 time: 0.192573 Jul 25 13:05:13.010796 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2289/4668] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:05:12 2022] POST /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:05:13.019428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-372a3479-9fb3-4a79-88dd-97cb0efde2de tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:13.020050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-372a3479-9fb3-4a79-88dd-97cb0efde2de tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:13.030226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-372a3479-9fb3-4a79-88dd-97cb0efde2de tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:13.030622 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-372a3479-9fb3-4a79-88dd-97cb0efde2de tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:13.033516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-372a3479-9fb3-4a79-88dd-97cb0efde2de tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:13.034235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-372a3479-9fb3-4a79-88dd-97cb0efde2de tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:13.769345 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-372a3479-9fb3-4a79-88dd-97cb0efde2de tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:13.781953 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-372a3479-9fb3-4a79-88dd-97cb0efde2de tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1506 microversion: 2.1 time: 0.766564 Jul 25 13:05:13.784046 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2380/4669] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:13 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1506 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:13.854042 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-94273b8d-f5e8-4079-9d21-c66a96a448e3 req-1e4e95a2-02fe-4319-b783-8ade0c803a89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "310aaeaf-1647-441a-9cac-ab0b8b66a750", "name": "network-vif-plugged", "status": "completed", "tag": "f310278d-1c8e-4911-8beb-dac76734e3b8"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:13.866010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-94273b8d-f5e8-4079-9d21-c66a96a448e3 req-1e4e95a2-02fe-4319-b783-8ade0c803a89 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:13.866479 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-94273b8d-f5e8-4079-9d21-c66a96a448e3 req-1e4e95a2-02fe-4319-b783-8ade0c803a89 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:13.883265 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-94273b8d-f5e8-4079-9d21-c66a96a448e3 req-1e4e95a2-02fe-4319-b783-8ade0c803a89 service nova] Creating event network-vif-plugged:f310278d-1c8e-4911-8beb-dac76734e3b8 for instance 310aaeaf-1647-441a-9cac-ab0b8b66a750 on n-h2-848886-15 Jul 25 13:05:13.888149 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-94273b8d-f5e8-4079-9d21-c66a96a448e3 req-1e4e95a2-02fe-4319-b783-8ade0c803a89 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039763 Jul 25 13:05:13.888822 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2290/4670] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:05:13.972260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b27a49b3-2086-4db9-ba2c-7292e413f5d1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:13.973319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b27a49b3-2086-4db9-ba2c-7292e413f5d1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 310aaeaf-1647-441a-9cac-ab0b8b66a750] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:13.981415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b27a49b3-2086-4db9-ba2c-7292e413f5d1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:13.981915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b27a49b3-2086-4db9-ba2c-7292e413f5d1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:13.982839 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b27a49b3-2086-4db9-ba2c-7292e413f5d1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:13.983548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b27a49b3-2086-4db9-ba2c-7292e413f5d1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:14.296738 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b27a49b3-2086-4db9-ba2c-7292e413f5d1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:14.314822 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b27a49b3-2086-4db9-ba2c-7292e413f5d1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750" status: 200 len: 1320 microversion: 2.1 time: 0.348393 Jul 25 13:05:14.316238 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2381/4671] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:13 2022] GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750 => generated 1320 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:14.805068 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d4f0d059-b2e1-4f62-9564-751e8e00fc51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:14.805773 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d4f0d059-b2e1-4f62-9564-751e8e00fc51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:14.824083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4f0d059-b2e1-4f62-9564-751e8e00fc51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:14.824543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4f0d059-b2e1-4f62-9564-751e8e00fc51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:14.825351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4f0d059-b2e1-4f62-9564-751e8e00fc51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:14.825788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4f0d059-b2e1-4f62-9564-751e8e00fc51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:15.166515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d4f0d059-b2e1-4f62-9564-751e8e00fc51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:15.177701 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d4f0d059-b2e1-4f62-9564-751e8e00fc51 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1514 microversion: 2.1 time: 0.376460 Jul 25 13:05:15.186163 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2291/4672] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:14 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1514 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:15.370431 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c92265cc-e4bd-4683-afe0-011f44d9882b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:15.371409 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c92265cc-e4bd-4683-afe0-011f44d9882b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 310aaeaf-1647-441a-9cac-ab0b8b66a750] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:15.424101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c92265cc-e4bd-4683-afe0-011f44d9882b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:15.424887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c92265cc-e4bd-4683-afe0-011f44d9882b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:15.430112 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c92265cc-e4bd-4683-afe0-011f44d9882b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:15.433327 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c92265cc-e4bd-4683-afe0-011f44d9882b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:15.819201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c92265cc-e4bd-4683-afe0-011f44d9882b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:15.831904 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c92265cc-e4bd-4683-afe0-011f44d9882b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750" status: 200 len: 1320 microversion: 2.1 time: 0.498956 Jul 25 13:05:15.845859 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2382/4673] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:15 2022] GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750 => generated 1320 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:16.858852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2b38296b-5ab1-49f9-a061-c7894fde46bc tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:16.860255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2b38296b-5ab1-49f9-a061-c7894fde46bc tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 310aaeaf-1647-441a-9cac-ab0b8b66a750] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:16.870293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b38296b-5ab1-49f9-a061-c7894fde46bc tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:16.871109 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b38296b-5ab1-49f9-a061-c7894fde46bc tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:16.872125 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b38296b-5ab1-49f9-a061-c7894fde46bc tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:16.872777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b38296b-5ab1-49f9-a061-c7894fde46bc tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:17.601166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2b38296b-5ab1-49f9-a061-c7894fde46bc tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:17.612310 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2b38296b-5ab1-49f9-a061-c7894fde46bc tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750" status: 200 len: 1500 microversion: 2.1 time: 0.759360 Jul 25 13:05:17.614925 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2292/4674] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:16 2022] GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750 => generated 1500 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:17.644544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-75c2e5ce-7bdb-4b94-a6b1-0de6c42ba922 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:17.661994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-75c2e5ce-7bdb-4b94-a6b1-0de6c42ba922 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 310aaeaf-1647-441a-9cac-ab0b8b66a750] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:17.673937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75c2e5ce-7bdb-4b94-a6b1-0de6c42ba922 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:17.674391 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75c2e5ce-7bdb-4b94-a6b1-0de6c42ba922 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:17.675170 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75c2e5ce-7bdb-4b94-a6b1-0de6c42ba922 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:17.675604 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75c2e5ce-7bdb-4b94-a6b1-0de6c42ba922 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:18.007820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-73919521-4d41-4fff-9d10-e8cd0d8cd722 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:18.010904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-73919521-4d41-4fff-9d10-e8cd0d8cd722 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:18.018581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73919521-4d41-4fff-9d10-e8cd0d8cd722 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:18.019285 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73919521-4d41-4fff-9d10-e8cd0d8cd722 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:18.020319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73919521-4d41-4fff-9d10-e8cd0d8cd722 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:18.020951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73919521-4d41-4fff-9d10-e8cd0d8cd722 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:18.037262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-75c2e5ce-7bdb-4b94-a6b1-0de6c42ba922 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:18.051626 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-75c2e5ce-7bdb-4b94-a6b1-0de6c42ba922 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750" status: 200 len: 1500 microversion: 2.1 time: 0.419400 Jul 25 13:05:18.060704 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2383/4675] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:17 2022] GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750 => generated 1500 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:18.074942 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-73919521-4d41-4fff-9d10-e8cd0d8cd722 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lazy-loading 'flavor' on Instance uuid 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:05:18.080828 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c7b3280e-6920-47fd-b6a8-01ae63b38ad9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:18.082887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c7b3280e-6920-47fd-b6a8-01ae63b38ad9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 310aaeaf-1647-441a-9cac-ab0b8b66a750] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:18.100111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7b3280e-6920-47fd-b6a8-01ae63b38ad9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:18.100519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7b3280e-6920-47fd-b6a8-01ae63b38ad9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:18.101354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7b3280e-6920-47fd-b6a8-01ae63b38ad9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:18.101804 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7b3280e-6920-47fd-b6a8-01ae63b38ad9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:18.203621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c7b3280e-6920-47fd-b6a8-01ae63b38ad9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 310aaeaf-1647-441a-9cac-ab0b8b66a750] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:05:18.240238 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-73919521-4d41-4fff-9d10-e8cd0d8cd722 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "POST /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a/action" status: 200 len: 32 microversion: 2.1 time: 0.236270 Jul 25 13:05:18.242495 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2293/4676] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:05:18 2022] POST /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a/action => generated 32 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 13:05:18.271291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8f14dad6-e757-4236-9f04-e3444daa9ec0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:18.275112 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8f14dad6-e757-4236-9f04-e3444daa9ec0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:18.292629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f14dad6-e757-4236-9f04-e3444daa9ec0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:18.294383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f14dad6-e757-4236-9f04-e3444daa9ec0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:18.297163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f14dad6-e757-4236-9f04-e3444daa9ec0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:18.298623 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f14dad6-e757-4236-9f04-e3444daa9ec0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:18.421819 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c7b3280e-6920-47fd-b6a8-01ae63b38ad9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "DELETE /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750" status: 204 len: 0 microversion: 2.1 time: 0.352771 Jul 25 13:05:18.423406 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2384/4677] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:05:18 2022] DELETE /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:05:18.436962 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8415f289-1662-4349-8418-cfefb9aa5134 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:18.438166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8415f289-1662-4349-8418-cfefb9aa5134 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 310aaeaf-1647-441a-9cac-ab0b8b66a750] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:18.447648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8415f289-1662-4349-8418-cfefb9aa5134 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:18.448595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8415f289-1662-4349-8418-cfefb9aa5134 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:18.450764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8415f289-1662-4349-8418-cfefb9aa5134 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:18.451505 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8415f289-1662-4349-8418-cfefb9aa5134 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:18.481072 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:18.672367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8f14dad6-e757-4236-9f04-e3444daa9ec0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:18.684439 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8f14dad6-e757-4236-9f04-e3444daa9ec0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1520 microversion: 2.1 time: 0.436612 Jul 25 13:05:18.685086 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2294/4678] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:18 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1520 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:18.760710 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8415f289-1662-4349-8418-cfefb9aa5134 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:18.774974 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8415f289-1662-4349-8418-cfefb9aa5134 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750" status: 200 len: 1506 microversion: 2.1 time: 0.344411 Jul 25 13:05:18.776584 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2385/4679] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:18 2022] GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750 => generated 1506 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:19.704791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-246e3fb6-1a19-466f-b6b0-8efd7ec3ad66 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:19.706433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-246e3fb6-1a19-466f-b6b0-8efd7ec3ad66 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:19.720893 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-246e3fb6-1a19-466f-b6b0-8efd7ec3ad66 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:19.721913 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-246e3fb6-1a19-466f-b6b0-8efd7ec3ad66 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:19.724616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-246e3fb6-1a19-466f-b6b0-8efd7ec3ad66 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:19.725356 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-246e3fb6-1a19-466f-b6b0-8efd7ec3ad66 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:19.797318 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-429d5f0e-8f76-45e6-a5f7-493a8a71101c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:19.798238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-429d5f0e-8f76-45e6-a5f7-493a8a71101c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 310aaeaf-1647-441a-9cac-ab0b8b66a750] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:19.815495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-429d5f0e-8f76-45e6-a5f7-493a8a71101c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:19.821725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-429d5f0e-8f76-45e6-a5f7-493a8a71101c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:19.827195 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-429d5f0e-8f76-45e6-a5f7-493a8a71101c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:19.828189 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-429d5f0e-8f76-45e6-a5f7-493a8a71101c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:20.490661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-246e3fb6-1a19-466f-b6b0-8efd7ec3ad66 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:20.502677 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-246e3fb6-1a19-466f-b6b0-8efd7ec3ad66 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1520 microversion: 2.1 time: 0.801777 Jul 25 13:05:20.503674 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2295/4680] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:19 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1520 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:20.515152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-429d5f0e-8f76-45e6-a5f7-493a8a71101c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:20.531676 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-429d5f0e-8f76-45e6-a5f7-493a8a71101c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750" status: 200 len: 1506 microversion: 2.1 time: 0.738679 Jul 25 13:05:20.532729 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2386/4681] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:19 2022] GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750 => generated 1506 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:05:21.144857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bd60ade7-c4c1-43a5-8754-1de82e367aae tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:21.149088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bd60ade7-c4c1-43a5-8754-1de82e367aae tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:21.188276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd60ade7-c4c1-43a5-8754-1de82e367aae tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:21.189486 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd60ade7-c4c1-43a5-8754-1de82e367aae tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:21.194730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd60ade7-c4c1-43a5-8754-1de82e367aae tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:21.198441 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd60ade7-c4c1-43a5-8754-1de82e367aae tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:21.291054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-162aba27-05ec-44f5-bd42-0aca8393cd03 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:21.291700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-162aba27-05ec-44f5-bd42-0aca8393cd03 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:21.295519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:21.317013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-162aba27-05ec-44f5-bd42-0aca8393cd03 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:21.318510 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-162aba27-05ec-44f5-bd42-0aca8393cd03 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:21.320769 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-162aba27-05ec-44f5-bd42-0aca8393cd03 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:21.323055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-162aba27-05ec-44f5-bd42-0aca8393cd03 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:21.341374 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bd60ade7-c4c1-43a5-8754-1de82e367aae tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "POST /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde/action" status: 200 len: 63192 microversion: 2.1 time: 0.202853 Jul 25 13:05:21.343365 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2296/4682] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:05:21 2022] POST /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde/action => generated 63192 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:05:21.452763 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-162aba27-05ec-44f5-bd42-0aca8393cd03 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.165639 Jul 25 13:05:21.470431 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2387/4683] 10.222.0.49 () {58 vars in 1293 bytes} [Mon Jul 25 13:05:21 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665/os-server-password => generated 116 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:05:21.529521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9ddd2c4d-3691-49e0-a237-d8b116475ca7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:21.530681 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9ddd2c4d-3691-49e0-a237-d8b116475ca7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:21.542964 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ddd2c4d-3691-49e0-a237-d8b116475ca7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:21.545461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ddd2c4d-3691-49e0-a237-d8b116475ca7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:21.546791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ddd2c4d-3691-49e0-a237-d8b116475ca7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:21.547719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ddd2c4d-3691-49e0-a237-d8b116475ca7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:21.554595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c6bcf069-3a7a-4288-9ca7-376231379466 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:21.555479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c6bcf069-3a7a-4288-9ca7-376231379466 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 310aaeaf-1647-441a-9cac-ab0b8b66a750] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:21.569865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c6bcf069-3a7a-4288-9ca7-376231379466 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:21.570625 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c6bcf069-3a7a-4288-9ca7-376231379466 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:21.571593 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c6bcf069-3a7a-4288-9ca7-376231379466 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:21.574679 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c6bcf069-3a7a-4288-9ca7-376231379466 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:21.856971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c6bcf069-3a7a-4288-9ca7-376231379466 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:21.891339 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c6bcf069-3a7a-4288-9ca7-376231379466 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750" status: 200 len: 1464 microversion: 2.1 time: 0.342222 Jul 25 13:05:21.893819 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2388/4684] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:21 2022] GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750 => generated 1464 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:22.070069 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-353a726b-0499-4062-94fe-20ce0441a48b req-c5b53d26-c3d4-4659-96da-6b201ca35050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "310aaeaf-1647-441a-9cac-ab0b8b66a750", "name": "network-vif-deleted", "tag": "f310278d-1c8e-4911-8beb-dac76734e3b8"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:22.093013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-353a726b-0499-4062-94fe-20ce0441a48b req-c5b53d26-c3d4-4659-96da-6b201ca35050 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:22.093820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-353a726b-0499-4062-94fe-20ce0441a48b req-c5b53d26-c3d4-4659-96da-6b201ca35050 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:22.155628 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-353a726b-0499-4062-94fe-20ce0441a48b req-c5b53d26-c3d4-4659-96da-6b201ca35050 service nova] Creating event network-vif-deleted:f310278d-1c8e-4911-8beb-dac76734e3b8 for instance 310aaeaf-1647-441a-9cac-ab0b8b66a750 on n-h2-848886-15 Jul 25 13:05:22.176131 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-353a726b-0499-4062-94fe-20ce0441a48b req-c5b53d26-c3d4-4659-96da-6b201ca35050 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119438 Jul 25 13:05:22.177062 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2389/4685] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:05:22.219124 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9ddd2c4d-3691-49e0-a237-d8b116475ca7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:22.228628 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9ddd2c4d-3691-49e0-a237-d8b116475ca7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1520 microversion: 2.1 time: 0.707161 Jul 25 13:05:22.242193 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2297/4686] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:21 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1520 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:22.917014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9b490fdd-f062-4584-bb39-ee78cd00e6cf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:22.918418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9b490fdd-f062-4584-bb39-ee78cd00e6cf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 310aaeaf-1647-441a-9cac-ab0b8b66a750] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:22.955175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b490fdd-f062-4584-bb39-ee78cd00e6cf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:22.957367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b490fdd-f062-4584-bb39-ee78cd00e6cf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:22.960187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b490fdd-f062-4584-bb39-ee78cd00e6cf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:22.960635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b490fdd-f062-4584-bb39-ee78cd00e6cf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:22.998814 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-9b490fdd-f062-4584-bb39-ee78cd00e6cf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] HTTP exception thrown: Instance 310aaeaf-1647-441a-9cac-ab0b8b66a750 could not be found. Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9b490fdd-f062-4584-bb39-ee78cd00e6cf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Request method failure captured: Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750 HTTP/1.1 Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pTdZnYy3zWCXLN8GI-lAb9Aac2xutmWdntWmHOJQQOAHuSaLRru4vmbdxH-2ipAsIwdgHGRBCQV52EgrlBqV5LzQtSAIs0OqruuNBUIA1ZYGpGU7ybcvN2tekv0vVPxk7wJZaAmUwppQmT0JDG4pBCSl5Rw9dXMoK1Y6yvluyRvyio Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersTestJSON-733750618 Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebb6a07295234370aa1aa5067b8ee930", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}] Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersTestJSON-733750618 Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersTestJSON-733750618 Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersTestJSON-733750618-project Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 60d84eb7c45449cbad3141d9f363e693 Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersTestJSON-733750618-project Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 310aaeaf-1647-441a-9cac-ab0b8b66a750 could not be found. Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '310aaeaf-1647-441a-9cac-ab0b8b66a750'} Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 310aaeaf-1647-441a-9cac-ab0b8b66a750 could not be found. Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 310aaeaf-1647-441a-9cac-ab0b8b66a750 could not be found. Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:23.000767 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:23.008482 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:05:23.008482 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:05:23.008482 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:05:23.008482 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:05:23.008482 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 310aaeaf-1647-441a-9cac-ab0b8b66a750 could not be found. Jul 25 13:05:23.008482 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:23.008482 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9b490fdd-f062-4584-bb39-ee78cd00e6cf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Returning 404 to user: Instance 310aaeaf-1647-441a-9cac-ab0b8b66a750 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:05:23.008482 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9b490fdd-f062-4584-bb39-ee78cd00e6cf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750" status: 404 len: 111 microversion: 2.1 time: 0.090110 Jul 25 13:05:23.016738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-74acd45a-be30-42e1-8a4d-453d50622538 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Action: 'create', calling method: .version_select at 0x7efcf8c86f70>, body: {"keypair": {"name": "tempest-key-2003265210", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMagvmDJlUe6LuVhbaonP8tnvn650nlWKg99myWDhw9yX06KAGBwlsqL1TvXQbKERlzyoS2hiKxW5BgYfX4gb5iD4uzp1cs35wHedNOhv/DCAtLQ9g913Cof8dpAZnfUw=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:23.030608 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2390/4687] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:22 2022] GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:05:23.059309 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-74acd45a-be30-42e1-8a4d-453d50622538 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Getting quotas for project ebb6a07295234370aa1aa5067b8ee930. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:05:23.077772 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-74acd45a-be30-42e1-8a4d-453d50622538 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Getting quotas for user 60d84eb7c45449cbad3141d9f363e693 and project ebb6a07295234370aa1aa5067b8ee930. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:05:23.124500 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-74acd45a-be30-42e1-8a4d-453d50622538 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.104607 Jul 25 13:05:23.143468 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-949a3010-9220-4f4f-ae1b-95207e1a7773 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '.version_select at 0x7efcf9caf670>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:23.145729 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2298/4688] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:05:23 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:05:23.153530 n-d-848886-15 devstack@n-api.service[125884]: WARNING oslo_db.sqlalchemy.utils [None req-949a3010-9220-4f4f-ae1b-95207e1a7773 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 13:05:23.163690 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-949a3010-9220-4f4f-ae1b-95207e1a7773 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.024425 Jul 25 13:05:23.164344 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2391/4689] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 13:05:23 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:05:23.252959 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3d4671af-2151-456f-9077-e5a8fbe5fdca tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:23.253620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3d4671af-2151-456f-9077-e5a8fbe5fdca tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:23.267290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3d4671af-2151-456f-9077-e5a8fbe5fdca tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:23.267530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3d4671af-2151-456f-9077-e5a8fbe5fdca tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:23.268648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3d4671af-2151-456f-9077-e5a8fbe5fdca tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:23.268822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3d4671af-2151-456f-9077-e5a8fbe5fdca tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:23.372360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bfa28524-6bc2-4d0b-97d8-e69a3a80fa55 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-231447817", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "key_name": "tempest-key-2003265210", "networks": [{"uuid": "41e863a3-713c-4d35-a204-58098a16a6e3"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:23.451302 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-bfa28524-6bc2-4d0b-97d8-e69a3a80fa55 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] validate_networks() for [('41e863a3-713c-4d35-a204-58098a16a6e3', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:05:24.439554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3d4671af-2151-456f-9077-e5a8fbe5fdca tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:24.447348 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:24.461916 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3d4671af-2151-456f-9077-e5a8fbe5fdca tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1520 microversion: 2.1 time: 1.201120 Jul 25 13:05:24.463445 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2299/4690] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:23 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1520 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:24.669143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bfa28524-6bc2-4d0b-97d8-e69a3a80fa55 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:05:24.669983 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bfa28524-6bc2-4d0b-97d8-e69a3a80fa55 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:05:24.670473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bfa28524-6bc2-4d0b-97d8-e69a3a80fa55 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:05:24.671252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bfa28524-6bc2-4d0b-97d8-e69a3a80fa55 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:05:24.671735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-bfa28524-6bc2-4d0b-97d8-e69a3a80fa55 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:05:24.691846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bfa28524-6bc2-4d0b-97d8-e69a3a80fa55 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:24.692227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bfa28524-6bc2-4d0b-97d8-e69a3a80fa55 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:24.693046 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bfa28524-6bc2-4d0b-97d8-e69a3a80fa55 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:24.693492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bfa28524-6bc2-4d0b-97d8-e69a3a80fa55 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:24.751290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-bfa28524-6bc2-4d0b-97d8-e69a3a80fa55 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Getting quotas for project ebb6a07295234370aa1aa5067b8ee930. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:05:24.784629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-bfa28524-6bc2-4d0b-97d8-e69a3a80fa55 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Getting quotas for user 60d84eb7c45449cbad3141d9f363e693 and project ebb6a07295234370aa1aa5067b8ee930. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:05:24.824974 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bfa28524-6bc2-4d0b-97d8-e69a3a80fa55 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:05:24.849117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bfa28524-6bc2-4d0b-97d8-e69a3a80fa55 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 28dc8442-8d68-462f-9077-47707180800d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:05:24.984490 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bfa28524-6bc2-4d0b-97d8-e69a3a80fa55 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.616916 Jul 25 13:05:24.987907 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2392/4691] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:05:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 13:05:25.012286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b4e45250-fc34-4dec-bb91-16befef51186 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:25.014469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b4e45250-fc34-4dec-bb91-16befef51186 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 28dc8442-8d68-462f-9077-47707180800d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:25.119934 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b4e45250-fc34-4dec-bb91-16befef51186 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:25.132735 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b4e45250-fc34-4dec-bb91-16befef51186 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d" status: 200 len: 1228 microversion: 2.1 time: 0.135245 Jul 25 13:05:25.137112 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2300/4692] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:24 2022] GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d => generated 1228 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:25.488370 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-be96ca44-80ad-415e-9e36-910975b529cc tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:25.489426 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-be96ca44-80ad-415e-9e36-910975b529cc tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:25.504240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be96ca44-80ad-415e-9e36-910975b529cc tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:25.509344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be96ca44-80ad-415e-9e36-910975b529cc tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:25.510373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be96ca44-80ad-415e-9e36-910975b529cc tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:25.511224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be96ca44-80ad-415e-9e36-910975b529cc tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:26.138105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-be96ca44-80ad-415e-9e36-910975b529cc tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:26.155319 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-be96ca44-80ad-415e-9e36-910975b529cc tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1520 microversion: 2.1 time: 0.671466 Jul 25 13:05:26.157568 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c6cb2f1e-f5b6-41f6-b008-9b69628a7b88 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:26.158498 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2393/4693] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:25 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1520 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:26.159367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c6cb2f1e-f5b6-41f6-b008-9b69628a7b88 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 28dc8442-8d68-462f-9077-47707180800d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:26.169451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c6cb2f1e-f5b6-41f6-b008-9b69628a7b88 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:26.169975 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c6cb2f1e-f5b6-41f6-b008-9b69628a7b88 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:26.178775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c6cb2f1e-f5b6-41f6-b008-9b69628a7b88 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:26.179506 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c6cb2f1e-f5b6-41f6-b008-9b69628a7b88 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:26.331418 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c6cb2f1e-f5b6-41f6-b008-9b69628a7b88 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:26.341558 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c6cb2f1e-f5b6-41f6-b008-9b69628a7b88 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d" status: 200 len: 1232 microversion: 2.1 time: 0.189988 Jul 25 13:05:26.343820 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2301/4694] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:26 2022] GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d => generated 1232 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:27.180460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b0885071-5c32-410d-9a17-5f6ad4d3c1d8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:27.182544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b0885071-5c32-410d-9a17-5f6ad4d3c1d8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:27.194491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0885071-5c32-410d-9a17-5f6ad4d3c1d8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:27.198205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0885071-5c32-410d-9a17-5f6ad4d3c1d8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:27.199066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0885071-5c32-410d-9a17-5f6ad4d3c1d8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:27.201356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0885071-5c32-410d-9a17-5f6ad4d3c1d8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:27.364685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-26ca64f3-5315-4573-9f6d-3ad3fd1e3661 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:27.365456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-26ca64f3-5315-4573-9f6d-3ad3fd1e3661 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 28dc8442-8d68-462f-9077-47707180800d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:27.373347 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26ca64f3-5315-4573-9f6d-3ad3fd1e3661 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:27.377634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26ca64f3-5315-4573-9f6d-3ad3fd1e3661 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:27.378995 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26ca64f3-5315-4573-9f6d-3ad3fd1e3661 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:27.379685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26ca64f3-5315-4573-9f6d-3ad3fd1e3661 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:27.549378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-26ca64f3-5315-4573-9f6d-3ad3fd1e3661 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:27.573911 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-26ca64f3-5315-4573-9f6d-3ad3fd1e3661 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d" status: 200 len: 1286 microversion: 2.1 time: 0.213225 Jul 25 13:05:27.576150 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2302/4695] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:27 2022] GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d => generated 1286 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:27.778501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b0885071-5c32-410d-9a17-5f6ad4d3c1d8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:27.793978 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b0885071-5c32-410d-9a17-5f6ad4d3c1d8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1520 microversion: 2.1 time: 0.617305 Jul 25 13:05:27.797076 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2394/4696] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:27 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1520 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:28.114876 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4545fdba-4b52-494b-a220-921af2bbbe0b tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:28.115945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4545fdba-4b52-494b-a220-921af2bbbe0b tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:28.128799 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4545fdba-4b52-494b-a220-921af2bbbe0b tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:28.132872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4545fdba-4b52-494b-a220-921af2bbbe0b tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:28.134225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4545fdba-4b52-494b-a220-921af2bbbe0b tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:28.134909 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4545fdba-4b52-494b-a220-921af2bbbe0b tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:28.486249 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4545fdba-4b52-494b-a220-921af2bbbe0b tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1835 microversion: 2.1 time: 0.747568 Jul 25 13:05:28.488755 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2303/4697] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:27 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1835 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:05:28.601103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-56f6d62f-c59c-4ea3-93de-c1e61d83891a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:28.602280 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-56f6d62f-c59c-4ea3-93de-c1e61d83891a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 28dc8442-8d68-462f-9077-47707180800d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:28.609890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56f6d62f-c59c-4ea3-93de-c1e61d83891a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:28.610343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56f6d62f-c59c-4ea3-93de-c1e61d83891a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:28.611121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56f6d62f-c59c-4ea3-93de-c1e61d83891a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:28.611552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56f6d62f-c59c-4ea3-93de-c1e61d83891a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:28.634369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3173d8d7-8bde-4833-9a5a-e4cc3f245afa tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-71984846", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "f8dd4848-5b5d-46d0-a206-788b64fd9152"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:28.731910 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-3173d8d7-8bde-4833-9a5a-e4cc3f245afa tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] validate_networks() for [('f8dd4848-5b5d-46d0-a206-788b64fd9152', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:05:29.226732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-56f6d62f-c59c-4ea3-93de-c1e61d83891a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:29.242266 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-56f6d62f-c59c-4ea3-93de-c1e61d83891a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d" status: 200 len: 1328 microversion: 2.1 time: 0.645969 Jul 25 13:05:29.249611 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2304/4698] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:28 2022] GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d => generated 1328 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:05:29.256745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e8c6724a-8b31-463b-8222-e0a47ce22790 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:29.257367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e8c6724a-8b31-463b-8222-e0a47ce22790 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:29.283729 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e8c6724a-8b31-463b-8222-e0a47ce22790 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:29.302084 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e8c6724a-8b31-463b-8222-e0a47ce22790 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:29.302948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e8c6724a-8b31-463b-8222-e0a47ce22790 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:29.303404 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e8c6724a-8b31-463b-8222-e0a47ce22790 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:29.803950 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e8c6724a-8b31-463b-8222-e0a47ce22790 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:29.814597 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e8c6724a-8b31-463b-8222-e0a47ce22790 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1520 microversion: 2.1 time: 0.563563 Jul 25 13:05:29.833652 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2305/4699] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:29 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1520 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:30.052074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-3173d8d7-8bde-4833-9a5a-e4cc3f245afa tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:05:30.052737 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-3173d8d7-8bde-4833-9a5a-e4cc3f245afa tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:05:30.054127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-3173d8d7-8bde-4833-9a5a-e4cc3f245afa tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:05:30.054695 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-3173d8d7-8bde-4833-9a5a-e4cc3f245afa tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:05:30.055227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-3173d8d7-8bde-4833-9a5a-e4cc3f245afa tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:05:30.082899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3173d8d7-8bde-4833-9a5a-e4cc3f245afa tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:30.085167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3173d8d7-8bde-4833-9a5a-e4cc3f245afa tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:30.088159 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3173d8d7-8bde-4833-9a5a-e4cc3f245afa tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:30.090724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3173d8d7-8bde-4833-9a5a-e4cc3f245afa tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:30.154867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-3173d8d7-8bde-4833-9a5a-e4cc3f245afa tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Getting quotas for project 21e13193378b494e847f9812268749d9. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:05:30.176514 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-3173d8d7-8bde-4833-9a5a-e4cc3f245afa tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Getting quotas for user 390bc47d040a4435acf81010b5532f79 and project 21e13193378b494e847f9812268749d9. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:05:30.215495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3173d8d7-8bde-4833-9a5a-e4cc3f245afa tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Going to run 2 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:05:30.232043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3173d8d7-8bde-4833-9a5a-e4cc3f245afa tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: c876a631-1a8a-476d-8627-96aadf865337] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:05:30.273230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a032829d-623a-4c78-872b-c421844b4645 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:30.273877 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a032829d-623a-4c78-872b-c421844b4645 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 28dc8442-8d68-462f-9077-47707180800d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:30.280888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a032829d-623a-4c78-872b-c421844b4645 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:30.291981 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a032829d-623a-4c78-872b-c421844b4645 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:30.293387 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a032829d-623a-4c78-872b-c421844b4645 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:30.293872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a032829d-623a-4c78-872b-c421844b4645 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:30.300586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3173d8d7-8bde-4833-9a5a-e4cc3f245afa tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 9dd0d352-d214-4127-b3a7-db71ae5c162d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=c876a631-1a8a-476d-8627-96aadf865337,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:05:30.445013 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3173d8d7-8bde-4833-9a5a-e4cc3f245afa tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.995784 Jul 25 13:05:30.456431 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2395/4700] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:05:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:05:30.480884 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c908518c-d59a-4db1-94b6-8bc57f9a8b03 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:30.505176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c908518c-d59a-4db1-94b6-8bc57f9a8b03 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:30.510748 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c908518c-d59a-4db1-94b6-8bc57f9a8b03 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Searching by: {'deleted': False, 'project_id': '21e13193378b494e847f9812268749d9'} {{(pid=125884) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:05:30.570709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c908518c-d59a-4db1-94b6-8bc57f9a8b03 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:30.574390 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c908518c-d59a-4db1-94b6-8bc57f9a8b03 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:30.577278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c908518c-d59a-4db1-94b6-8bc57f9a8b03 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:30.577902 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c908518c-d59a-4db1-94b6-8bc57f9a8b03 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:30.619437 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c908518c-d59a-4db1-94b6-8bc57f9a8b03 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 673 microversion: 2.1 time: 0.160695 Jul 25 13:05:30.620480 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2396/4701] 10.222.0.49 () {58 vars in 1125 bytes} [Mon Jul 25 13:05:30 2022] GET /compute/v2.1/servers => generated 673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:05:30.636079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-974a7859-3641-4a00-9b6c-559604a059a3 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:30.638875 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-974a7859-3641-4a00-9b6c-559604a059a3 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 9dd0d352-d214-4127-b3a7-db71ae5c162d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:30.830386 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-974a7859-3641-4a00-9b6c-559604a059a3 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:30.840358 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-974a7859-3641-4a00-9b6c-559604a059a3 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d" status: 200 len: 1218 microversion: 2.1 time: 0.210868 Jul 25 13:05:30.846721 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2397/4702] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:30 2022] GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d => generated 1218 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:30.869499 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0e5487de-2615-4860-a1b3-5c258287c8e0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:30.875704 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0e5487de-2615-4860-a1b3-5c258287c8e0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:30.903273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e5487de-2615-4860-a1b3-5c258287c8e0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:30.904429 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e5487de-2615-4860-a1b3-5c258287c8e0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:30.907442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e5487de-2615-4860-a1b3-5c258287c8e0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:30.909793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e5487de-2615-4860-a1b3-5c258287c8e0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:30.969963 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a032829d-623a-4c78-872b-c421844b4645 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:30.986787 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a032829d-623a-4c78-872b-c421844b4645 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d" status: 200 len: 1328 microversion: 2.1 time: 0.716982 Jul 25 13:05:30.988158 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2306/4703] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:30 2022] GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d => generated 1328 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:05:31.104288 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-21d8d452-ff4b-472d-87f4-45720779c765 req-9f8da109-1fcd-4d2b-a66a-4e46290893ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28dc8442-8d68-462f-9077-47707180800d", "tag": "1c3402f0-063b-4032-82ec-81c6c4a7b469"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:31.129525 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-21d8d452-ff4b-472d-87f4-45720779c765 req-9f8da109-1fcd-4d2b-a66a-4e46290893ae service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:31.129823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-21d8d452-ff4b-472d-87f4-45720779c765 req-9f8da109-1fcd-4d2b-a66a-4e46290893ae service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:31.164449 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-21d8d452-ff4b-472d-87f4-45720779c765 req-9f8da109-1fcd-4d2b-a66a-4e46290893ae service nova] Creating event network-changed:1c3402f0-063b-4032-82ec-81c6c4a7b469 for instance 28dc8442-8d68-462f-9077-47707180800d on n-h1-848886-15 Jul 25 13:05:31.183458 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-21d8d452-ff4b-472d-87f4-45720779c765 req-9f8da109-1fcd-4d2b-a66a-4e46290893ae service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076924 Jul 25 13:05:31.184207 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2307/4704] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:05:31.357708 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fd3e788f-eccd-4212-817f-12b991ebd9b3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:31.360052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fd3e788f-eccd-4212-817f-12b991ebd9b3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:31.385018 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd3e788f-eccd-4212-817f-12b991ebd9b3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:31.385499 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd3e788f-eccd-4212-817f-12b991ebd9b3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:31.386343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd3e788f-eccd-4212-817f-12b991ebd9b3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:31.386796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd3e788f-eccd-4212-817f-12b991ebd9b3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:31.491244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fd3e788f-eccd-4212-817f-12b991ebd9b3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:05:31.685605 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fd3e788f-eccd-4212-817f-12b991ebd9b3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "DELETE /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 204 len: 0 microversion: 2.1 time: 0.330621 Jul 25 13:05:31.687236 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2308/4705] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:05:31 2022] DELETE /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:05:31.693347 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-06f3b129-1488-406d-bd2e-3efc8c7feca8 req-723fa84a-4465-463d-a2a1-12fac2913ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "486f49b3-3f54-478c-9c21-c33a16ae4fde", "tag": "fefdb487-385f-4f8b-b1dd-99ad9fb2469d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:31.705127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-06f3b129-1488-406d-bd2e-3efc8c7feca8 req-723fa84a-4465-463d-a2a1-12fac2913ac2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:31.706130 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-06f3b129-1488-406d-bd2e-3efc8c7feca8 req-723fa84a-4465-463d-a2a1-12fac2913ac2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:31.723592 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-06f3b129-1488-406d-bd2e-3efc8c7feca8 req-723fa84a-4465-463d-a2a1-12fac2913ac2 service nova] Creating event network-changed:fefdb487-385f-4f8b-b1dd-99ad9fb2469d for instance 486f49b3-3f54-478c-9c21-c33a16ae4fde on n-h1-848886-15 Jul 25 13:05:31.729254 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-06f3b129-1488-406d-bd2e-3efc8c7feca8 req-723fa84a-4465-463d-a2a1-12fac2913ac2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040129 Jul 25 13:05:31.730234 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2309/4706] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:05:31.743323 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8b38c707-9079-4da9-8683-3bedd2796610 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:31.744867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8b38c707-9079-4da9-8683-3bedd2796610 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:31.758289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b38c707-9079-4da9-8683-3bedd2796610 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:31.758745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b38c707-9079-4da9-8683-3bedd2796610 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:31.762695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b38c707-9079-4da9-8683-3bedd2796610 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:31.763165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b38c707-9079-4da9-8683-3bedd2796610 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:32.303021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0e5487de-2615-4860-a1b3-5c258287c8e0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:32.312188 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0e5487de-2615-4860-a1b3-5c258287c8e0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1520 microversion: 2.1 time: 1.458756 Jul 25 13:05:32.319423 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2398/4707] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:30 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1520 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:32.339679 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2ad5ddd1-0401-413a-a810-d268d5c61438 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:32.342726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2ad5ddd1-0401-413a-a810-d268d5c61438 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 9dd0d352-d214-4127-b3a7-db71ae5c162d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:32.357571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ad5ddd1-0401-413a-a810-d268d5c61438 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:32.358379 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ad5ddd1-0401-413a-a810-d268d5c61438 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:32.361180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ad5ddd1-0401-413a-a810-d268d5c61438 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:32.362366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ad5ddd1-0401-413a-a810-d268d5c61438 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:32.564926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2ad5ddd1-0401-413a-a810-d268d5c61438 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:32.582954 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2ad5ddd1-0401-413a-a810-d268d5c61438 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d" status: 200 len: 1222 microversion: 2.1 time: 0.251327 Jul 25 13:05:32.584435 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2399/4708] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:32 2022] GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d => generated 1222 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:32.603333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bbdc2867-a635-4d29-a533-88565f4cd32f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:32.604140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bbdc2867-a635-4d29-a533-88565f4cd32f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 28dc8442-8d68-462f-9077-47707180800d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:32.621587 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bbdc2867-a635-4d29-a533-88565f4cd32f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:32.622381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bbdc2867-a635-4d29-a533-88565f4cd32f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:32.639951 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bbdc2867-a635-4d29-a533-88565f4cd32f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:32.644125 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bbdc2867-a635-4d29-a533-88565f4cd32f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:32.827369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8b38c707-9079-4da9-8683-3bedd2796610 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:32.842449 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8b38c707-9079-4da9-8683-3bedd2796610 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1688 microversion: 2.1 time: 1.110698 Jul 25 13:05:32.843060 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2310/4709] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:31 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1688 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:33.027799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bbdc2867-a635-4d29-a533-88565f4cd32f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:33.047792 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bbdc2867-a635-4d29-a533-88565f4cd32f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d" status: 200 len: 1328 microversion: 2.1 time: 0.460129 Jul 25 13:05:33.048966 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2400/4710] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:32 2022] GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d => generated 1328 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:33.345028 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b172e373-41ce-4604-9817-a7404530be5d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:33.345696 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b172e373-41ce-4604-9817-a7404530be5d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:33.362883 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b172e373-41ce-4604-9817-a7404530be5d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:33.363352 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b172e373-41ce-4604-9817-a7404530be5d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:33.366602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b172e373-41ce-4604-9817-a7404530be5d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:33.367118 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b172e373-41ce-4604-9817-a7404530be5d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:33.604234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f99d44ff-3341-4102-883a-8534fb8613ec tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:33.604829 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f99d44ff-3341-4102-883a-8534fb8613ec tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 9dd0d352-d214-4127-b3a7-db71ae5c162d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:33.617996 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f99d44ff-3341-4102-883a-8534fb8613ec tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:33.619039 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f99d44ff-3341-4102-883a-8534fb8613ec tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:33.622777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f99d44ff-3341-4102-883a-8534fb8613ec tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:33.624656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f99d44ff-3341-4102-883a-8534fb8613ec tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:34.124337 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f99d44ff-3341-4102-883a-8534fb8613ec tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:34.138716 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f99d44ff-3341-4102-883a-8534fb8613ec tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d" status: 200 len: 1278 microversion: 2.1 time: 0.538004 Jul 25 13:05:34.154926 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2401/4711] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:33 2022] GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d => generated 1278 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:05:34.160872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d7024864-4050-4833-a1ab-ea6ffdce8715 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:34.162289 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d7024864-4050-4833-a1ab-ea6ffdce8715 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:34.170794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7024864-4050-4833-a1ab-ea6ffdce8715 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:34.171655 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7024864-4050-4833-a1ab-ea6ffdce8715 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:34.173325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7024864-4050-4833-a1ab-ea6ffdce8715 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:34.174122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7024864-4050-4833-a1ab-ea6ffdce8715 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:34.374002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b172e373-41ce-4604-9817-a7404530be5d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:34.381944 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b172e373-41ce-4604-9817-a7404530be5d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1520 microversion: 2.1 time: 1.040878 Jul 25 13:05:34.401858 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2311/4712] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:33 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1520 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:34.401858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ee1e9e23-44ab-4a7f-b317-5c3f0a1273f4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:34.401858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ee1e9e23-44ab-4a7f-b317-5c3f0a1273f4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 28dc8442-8d68-462f-9077-47707180800d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:34.413547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee1e9e23-44ab-4a7f-b317-5c3f0a1273f4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:34.414047 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee1e9e23-44ab-4a7f-b317-5c3f0a1273f4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:34.414842 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee1e9e23-44ab-4a7f-b317-5c3f0a1273f4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:34.415284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee1e9e23-44ab-4a7f-b317-5c3f0a1273f4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:35.085550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d7024864-4050-4833-a1ab-ea6ffdce8715 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:35.096734 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d7024864-4050-4833-a1ab-ea6ffdce8715 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1688 microversion: 2.1 time: 0.940099 Jul 25 13:05:35.101801 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2402/4713] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:34 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1688 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:35.127249 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:35.131284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-71b0b31c-7bea-4f6b-b0a8-7bc3934b5b20 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:35.136573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-71b0b31c-7bea-4f6b-b0a8-7bc3934b5b20 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:35.150442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71b0b31c-7bea-4f6b-b0a8-7bc3934b5b20 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:35.157668 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71b0b31c-7bea-4f6b-b0a8-7bc3934b5b20 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:35.161282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71b0b31c-7bea-4f6b-b0a8-7bc3934b5b20 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:35.161799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71b0b31c-7bea-4f6b-b0a8-7bc3934b5b20 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:35.258176 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ee1e9e23-44ab-4a7f-b317-5c3f0a1273f4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:35.271679 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ee1e9e23-44ab-4a7f-b317-5c3f0a1273f4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d" status: 200 len: 1328 microversion: 2.1 time: 0.879554 Jul 25 13:05:35.274704 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2312/4714] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:34 2022] GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d => generated 1328 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:35.281686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-d12d2cb8-dd53-44c2-a4ca-cbe32aa5686f req-bfd39779-6df8-4492-8504-a9230967e096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "486f49b3-3f54-478c-9c21-c33a16ae4fde", "name": "network-vif-deleted", "tag": "fefdb487-385f-4f8b-b1dd-99ad9fb2469d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:35.295665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d12d2cb8-dd53-44c2-a4ca-cbe32aa5686f req-bfd39779-6df8-4492-8504-a9230967e096 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:35.296354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d12d2cb8-dd53-44c2-a4ca-cbe32aa5686f req-bfd39779-6df8-4492-8504-a9230967e096 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:35.315637 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-d12d2cb8-dd53-44c2-a4ca-cbe32aa5686f req-bfd39779-6df8-4492-8504-a9230967e096 service nova] Creating event network-vif-deleted:fefdb487-385f-4f8b-b1dd-99ad9fb2469d for instance 486f49b3-3f54-478c-9c21-c33a16ae4fde on n-h1-848886-15 Jul 25 13:05:35.338421 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-d12d2cb8-dd53-44c2-a4ca-cbe32aa5686f req-bfd39779-6df8-4492-8504-a9230967e096 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058581 Jul 25 13:05:35.340735 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2313/4715] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:05:35.347959 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-985d0710-ced0-4997-93f4-117d24173871 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:35.349502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-985d0710-ced0-4997-93f4-117d24173871 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 9dd0d352-d214-4127-b3a7-db71ae5c162d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:35.393858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-985d0710-ced0-4997-93f4-117d24173871 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:35.396530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-985d0710-ced0-4997-93f4-117d24173871 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:35.396686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-71b0b31c-7bea-4f6b-b0a8-7bc3934b5b20 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lazy-loading 'services' on Instance uuid f1870a72-72de-47e8-8776-d342d9ece98e {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:05:35.398713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-985d0710-ced0-4997-93f4-117d24173871 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:35.403007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-985d0710-ced0-4997-93f4-117d24173871 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:35.594375 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-985d0710-ced0-4997-93f4-117d24173871 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:35.600108 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-71b0b31c-7bea-4f6b-b0a8-7bc3934b5b20 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e/os-volume_attachments/b2b21791-dcb4-48ad-86dc-5e592c10e644" status: 202 len: 0 microversion: 2.1 time: 0.481682 Jul 25 13:05:35.601197 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2403/4716] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Jul 25 13:05:35 2022] DELETE /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e/os-volume_attachments/b2b21791-dcb4-48ad-86dc-5e592c10e644 => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:05:35.611554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-804eb7a8-64be-44b6-bdc7-76f2143506eb tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:35.612273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-804eb7a8-64be-44b6-bdc7-76f2143506eb tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:35.615658 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-985d0710-ced0-4997-93f4-117d24173871 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d" status: 200 len: 1276 microversion: 2.1 time: 0.273402 Jul 25 13:05:35.619801 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2314/4717] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:35 2022] GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d => generated 1276 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:35.631492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-804eb7a8-64be-44b6-bdc7-76f2143506eb tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:35.634757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-804eb7a8-64be-44b6-bdc7-76f2143506eb tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:35.636899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-804eb7a8-64be-44b6-bdc7-76f2143506eb tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:35.638378 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-804eb7a8-64be-44b6-bdc7-76f2143506eb tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:36.139039 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-618b2ada-dae9-4298-8f5f-b2998bfff3d0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:36.140443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-618b2ada-dae9-4298-8f5f-b2998bfff3d0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:36.158082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-618b2ada-dae9-4298-8f5f-b2998bfff3d0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:36.159753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-618b2ada-dae9-4298-8f5f-b2998bfff3d0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:36.162388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-618b2ada-dae9-4298-8f5f-b2998bfff3d0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:36.163341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-804eb7a8-64be-44b6-bdc7-76f2143506eb tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:36.163784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-618b2ada-dae9-4298-8f5f-b2998bfff3d0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:36.191047 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-804eb7a8-64be-44b6-bdc7-76f2143506eb tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1520 microversion: 2.1 time: 0.588367 Jul 25 13:05:36.191752 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2404/4718] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:35 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1520 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:36.293993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-618b2ada-dae9-4298-8f5f-b2998bfff3d0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:36.294668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-618b2ada-dae9-4298-8f5f-b2998bfff3d0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:36.295349 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-618b2ada-dae9-4298-8f5f-b2998bfff3d0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lazy-loading 'fault' on Instance uuid 486f49b3-3f54-478c-9c21-c33a16ae4fde {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:05:36.298519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6bbf14ae-62f8-4394-8297-a10985e87919 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:36.299145 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6bbf14ae-62f8-4394-8297-a10985e87919 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 28dc8442-8d68-462f-9077-47707180800d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:36.310545 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6bbf14ae-62f8-4394-8297-a10985e87919 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:36.311130 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6bbf14ae-62f8-4394-8297-a10985e87919 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:36.314804 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6bbf14ae-62f8-4394-8297-a10985e87919 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:36.315513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6bbf14ae-62f8-4394-8297-a10985e87919 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:36.401367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-618b2ada-dae9-4298-8f5f-b2998bfff3d0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:36.411982 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-618b2ada-dae9-4298-8f5f-b2998bfff3d0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 200 len: 1356 microversion: 2.1 time: 0.286058 Jul 25 13:05:36.412584 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2315/4719] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:36 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 1356 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:05:36.640853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1005b254-696c-4d54-9c79-d5dfc87dca68 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:36.641535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1005b254-696c-4d54-9c79-d5dfc87dca68 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 9dd0d352-d214-4127-b3a7-db71ae5c162d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:36.657624 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1005b254-696c-4d54-9c79-d5dfc87dca68 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:36.658481 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1005b254-696c-4d54-9c79-d5dfc87dca68 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:36.677712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1005b254-696c-4d54-9c79-d5dfc87dca68 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:36.681490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1005b254-696c-4d54-9c79-d5dfc87dca68 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:36.877040 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1005b254-696c-4d54-9c79-d5dfc87dca68 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:36.893943 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1005b254-696c-4d54-9c79-d5dfc87dca68 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d" status: 200 len: 1276 microversion: 2.1 time: 0.254450 Jul 25 13:05:36.911188 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2316/4720] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:36 2022] GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d => generated 1276 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:37.003390 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6bbf14ae-62f8-4394-8297-a10985e87919 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:37.017669 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6bbf14ae-62f8-4394-8297-a10985e87919 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d" status: 200 len: 1328 microversion: 2.1 time: 0.722896 Jul 25 13:05:37.020923 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2405/4721] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:36 2022] GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d => generated 1328 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:05:37.221069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2da98f6b-5f06-49ac-927c-01c578f371b1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:37.221696 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2da98f6b-5f06-49ac-927c-01c578f371b1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:37.233416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2da98f6b-5f06-49ac-927c-01c578f371b1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:37.233897 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2da98f6b-5f06-49ac-927c-01c578f371b1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:37.235838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2da98f6b-5f06-49ac-927c-01c578f371b1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:37.236326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2da98f6b-5f06-49ac-927c-01c578f371b1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:37.296967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:37.435655 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c0ee12a7-2836-4d92-9056-8c0fbd526a42 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:37.436310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c0ee12a7-2836-4d92-9056-8c0fbd526a42 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 486f49b3-3f54-478c-9c21-c33a16ae4fde] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:37.446965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c0ee12a7-2836-4d92-9056-8c0fbd526a42 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:37.450627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c0ee12a7-2836-4d92-9056-8c0fbd526a42 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:37.451848 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c0ee12a7-2836-4d92-9056-8c0fbd526a42 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:37.454250 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c0ee12a7-2836-4d92-9056-8c0fbd526a42 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:37.485393 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-c0ee12a7-2836-4d92-9056-8c0fbd526a42 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] HTTP exception thrown: Instance 486f49b3-3f54-478c-9c21-c33a16ae4fde could not be found. Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c0ee12a7-2836-4d92-9056-8c0fbd526a42 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Request method failure captured: Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde HTTP/1.1 Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pOuxv1dAEBzvSabAQZ_ovDwuoLarmYwGpqO0VLOXbqAAPunlD8O5vVMgj3IKl9VjFTX9CDCr160FLaCnWQQdTWXXvoL3KfTvXE9pkHJ0Gohl1rBvvU5lXAiAERAFVQa6cNt2uvom2njdnumPINWUCHjcLWMzSCxBYR5oNDLeJ--HHc Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: c0d891a772834e43bdfcbde778a90498 Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-406327327 Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c0d891a772834e43bdfcbde778a90498", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c0d891a772834e43bdfcbde778a90498"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0d891a772834e43bdfcbde778a90498"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0d891a772834e43bdfcbde778a90498"}]}] Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestNetworkAdvancedServerOps-406327327 Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: c0d891a772834e43bdfcbde778a90498 Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-406327327 Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestNetworkAdvancedServerOps-406327327-project Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 4d6e2ae351744e0ab1f153d629e4f0e7 Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestNetworkAdvancedServerOps-406327327-project Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 486f49b3-3f54-478c-9c21-c33a16ae4fde could not be found. Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '486f49b3-3f54-478c-9c21-c33a16ae4fde'} Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 486f49b3-3f54-478c-9c21-c33a16ae4fde could not be found. Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 486f49b3-3f54-478c-9c21-c33a16ae4fde could not be found. Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:05:37.492103 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:37.501689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:37.501689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:05:37.501689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:05:37.501689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:05:37.501689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:05:37.501689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 486f49b3-3f54-478c-9c21-c33a16ae4fde could not be found. Jul 25 13:05:37.501689 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:37.501689 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c0ee12a7-2836-4d92-9056-8c0fbd526a42 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Returning 404 to user: Instance 486f49b3-3f54-478c-9c21-c33a16ae4fde could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:05:37.501689 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c0ee12a7-2836-4d92-9056-8c0fbd526a42 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde" status: 404 len: 111 microversion: 2.1 time: 0.063065 Jul 25 13:05:37.501689 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2406/4722] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:37 2022] GET /compute/v2.1/servers/486f49b3-3f54-478c-9c21-c33a16ae4fde => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:05:37.918478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9ee4744f-bc35-4d64-8cd4-80b09c8da090 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:37.919337 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9ee4744f-bc35-4d64-8cd4-80b09c8da090 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 9dd0d352-d214-4127-b3a7-db71ae5c162d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:37.933097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ee4744f-bc35-4d64-8cd4-80b09c8da090 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:37.937397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ee4744f-bc35-4d64-8cd4-80b09c8da090 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:37.938592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ee4744f-bc35-4d64-8cd4-80b09c8da090 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:37.939206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ee4744f-bc35-4d64-8cd4-80b09c8da090 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:38.016915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:38.284360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9ee4744f-bc35-4d64-8cd4-80b09c8da090 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:38.327054 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9ee4744f-bc35-4d64-8cd4-80b09c8da090 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d" status: 200 len: 1276 microversion: 2.1 time: 0.412856 Jul 25 13:05:38.328920 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2407/4723] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:37 2022] GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d => generated 1276 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:05:38.350693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1a465f6c-3a5b-4a08-9593-ec393ee2456f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:38.351756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1a465f6c-3a5b-4a08-9593-ec393ee2456f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 28dc8442-8d68-462f-9077-47707180800d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:38.362240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2da98f6b-5f06-49ac-927c-01c578f371b1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:38.376862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a465f6c-3a5b-4a08-9593-ec393ee2456f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:38.378570 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a465f6c-3a5b-4a08-9593-ec393ee2456f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:38.381539 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a465f6c-3a5b-4a08-9593-ec393ee2456f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:38.385510 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2da98f6b-5f06-49ac-927c-01c578f371b1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1520 microversion: 2.1 time: 1.166835 Jul 25 13:05:38.389279 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a465f6c-3a5b-4a08-9593-ec393ee2456f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:38.389605 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2317/4724] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:37 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1520 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:38.799370 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1a465f6c-3a5b-4a08-9593-ec393ee2456f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:38.812791 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1a465f6c-3a5b-4a08-9593-ec393ee2456f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d" status: 200 len: 1328 microversion: 2.1 time: 0.478433 Jul 25 13:05:38.813701 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2408/4725] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:38 2022] GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d => generated 1328 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:39.351430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f19a0eab-e0c3-44b8-8d25-25b136480219 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:39.354573 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f19a0eab-e0c3-44b8-8d25-25b136480219 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 9dd0d352-d214-4127-b3a7-db71ae5c162d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:39.373034 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f19a0eab-e0c3-44b8-8d25-25b136480219 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:39.377503 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f19a0eab-e0c3-44b8-8d25-25b136480219 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:39.380921 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f19a0eab-e0c3-44b8-8d25-25b136480219 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:39.385845 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f19a0eab-e0c3-44b8-8d25-25b136480219 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:39.408906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4f5583bb-a27c-4c22-9d0f-85c12dfc8360 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:39.409528 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4f5583bb-a27c-4c22-9d0f-85c12dfc8360 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:39.427825 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f5583bb-a27c-4c22-9d0f-85c12dfc8360 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:39.428288 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f5583bb-a27c-4c22-9d0f-85c12dfc8360 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:39.429098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f5583bb-a27c-4c22-9d0f-85c12dfc8360 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:39.429539 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f5583bb-a27c-4c22-9d0f-85c12dfc8360 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:40.008055 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f19a0eab-e0c3-44b8-8d25-25b136480219 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:40.041318 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f19a0eab-e0c3-44b8-8d25-25b136480219 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d" status: 200 len: 1318 microversion: 2.1 time: 0.695817 Jul 25 13:05:40.041946 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2318/4726] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:39 2022] GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d => generated 1318 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:40.066956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-52893c13-814d-4bfb-8b61-00b338dfb772 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:40.067581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-52893c13-814d-4bfb-8b61-00b338dfb772 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 28dc8442-8d68-462f-9077-47707180800d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:40.069792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:40.085565 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-52893c13-814d-4bfb-8b61-00b338dfb772 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:40.086525 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-52893c13-814d-4bfb-8b61-00b338dfb772 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:40.087517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-52893c13-814d-4bfb-8b61-00b338dfb772 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:40.088131 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-52893c13-814d-4bfb-8b61-00b338dfb772 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:40.114448 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4f5583bb-a27c-4c22-9d0f-85c12dfc8360 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:40.129621 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4f5583bb-a27c-4c22-9d0f-85c12dfc8360 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1520 microversion: 2.1 time: 0.724406 Jul 25 13:05:40.130982 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2409/4727] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:39 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1520 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:40.566674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-b42ec0c7-754f-4440-aba7-9119d2c7669e req-282576f4-f241-41c9-90f1-f33bf6df86b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c876a631-1a8a-476d-8627-96aadf865337", "tag": "d6fe26e5-9a74-48c7-84da-d769003f1bec"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:40.578220 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b42ec0c7-754f-4440-aba7-9119d2c7669e req-282576f4-f241-41c9-90f1-f33bf6df86b1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:40.578990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b42ec0c7-754f-4440-aba7-9119d2c7669e req-282576f4-f241-41c9-90f1-f33bf6df86b1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:40.606132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:40.608657 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-b42ec0c7-754f-4440-aba7-9119d2c7669e req-282576f4-f241-41c9-90f1-f33bf6df86b1 service nova] Creating event network-changed:d6fe26e5-9a74-48c7-84da-d769003f1bec for instance c876a631-1a8a-476d-8627-96aadf865337 on n-h2-848886-15 Jul 25 13:05:40.625806 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-b42ec0c7-754f-4440-aba7-9119d2c7669e req-282576f4-f241-41c9-90f1-f33bf6df86b1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062791 Jul 25 13:05:40.626869 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2410/4728] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:05:40.850178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-52893c13-814d-4bfb-8b61-00b338dfb772 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:40.866055 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-52893c13-814d-4bfb-8b61-00b338dfb772 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d" status: 200 len: 1328 microversion: 2.1 time: 0.807165 Jul 25 13:05:40.867820 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2319/4729] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:40 2022] GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d => generated 1328 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:41.062792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6b499b78-a7f9-472f-83a2-ad1258b0b043 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:41.063527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6b499b78-a7f9-472f-83a2-ad1258b0b043 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 9dd0d352-d214-4127-b3a7-db71ae5c162d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:41.065629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=14 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:41.071866 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b499b78-a7f9-472f-83a2-ad1258b0b043 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:41.072410 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b499b78-a7f9-472f-83a2-ad1258b0b043 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:41.073203 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b499b78-a7f9-472f-83a2-ad1258b0b043 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:41.074260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b499b78-a7f9-472f-83a2-ad1258b0b043 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:41.151775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-06d26f86-e333-406f-94af-8d4358ab976b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:41.152710 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-06d26f86-e333-406f-94af-8d4358ab976b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:41.161163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06d26f86-e333-406f-94af-8d4358ab976b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:41.167274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06d26f86-e333-406f-94af-8d4358ab976b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:41.168392 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06d26f86-e333-406f-94af-8d4358ab976b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:41.169018 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06d26f86-e333-406f-94af-8d4358ab976b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:42.233316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-06d26f86-e333-406f-94af-8d4358ab976b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:42.254119 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-06d26f86-e333-406f-94af-8d4358ab976b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1520 microversion: 2.1 time: 1.103553 Jul 25 13:05:42.254763 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2320/4730] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:41 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1520 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:42.259702 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6b499b78-a7f9-472f-83a2-ad1258b0b043 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:42.267972 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6b499b78-a7f9-472f-83a2-ad1258b0b043 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d" status: 200 len: 1318 microversion: 2.1 time: 1.209609 Jul 25 13:05:42.268272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-170e742b-c3a6-4fc0-8643-9b3a751ebda1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:42.270501 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-170e742b-c3a6-4fc0-8643-9b3a751ebda1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 28dc8442-8d68-462f-9077-47707180800d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:42.271571 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2411/4731] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:41 2022] GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d => generated 1318 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:42.287273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-170e742b-c3a6-4fc0-8643-9b3a751ebda1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:42.290425 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-170e742b-c3a6-4fc0-8643-9b3a751ebda1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:42.293328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-170e742b-c3a6-4fc0-8643-9b3a751ebda1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:42.294074 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-170e742b-c3a6-4fc0-8643-9b3a751ebda1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:42.582066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-0f28622c-1601-4b08-97e1-cc44abdb6124 req-a3e216b7-e7da-4304-a6c2-1fb72003eb41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28dc8442-8d68-462f-9077-47707180800d", "name": "network-vif-plugged", "status": "completed", "tag": "1c3402f0-063b-4032-82ec-81c6c4a7b469"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:42.611573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-0f28622c-1601-4b08-97e1-cc44abdb6124 req-a3e216b7-e7da-4304-a6c2-1fb72003eb41 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:42.612969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-0f28622c-1601-4b08-97e1-cc44abdb6124 req-a3e216b7-e7da-4304-a6c2-1fb72003eb41 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:42.642458 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-0f28622c-1601-4b08-97e1-cc44abdb6124 req-a3e216b7-e7da-4304-a6c2-1fb72003eb41 service nova] Creating event network-vif-plugged:1c3402f0-063b-4032-82ec-81c6c4a7b469 for instance 28dc8442-8d68-462f-9077-47707180800d on n-h1-848886-15 Jul 25 13:05:42.650963 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-0f28622c-1601-4b08-97e1-cc44abdb6124 req-a3e216b7-e7da-4304-a6c2-1fb72003eb41 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071806 Jul 25 13:05:42.653514 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2412/4732] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:05:42.812584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-bbf89d22-3d19-40cc-b37a-6437482e7d76 req-3aa28c9b-d6e5-469c-802d-3a585a81b0f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dd0d352-d214-4127-b3a7-db71ae5c162d", "tag": "adfa66e4-ad90-4e2a-858b-4fb2ede116e4"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:42.835874 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-bbf89d22-3d19-40cc-b37a-6437482e7d76 req-3aa28c9b-d6e5-469c-802d-3a585a81b0f8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:42.840544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-bbf89d22-3d19-40cc-b37a-6437482e7d76 req-3aa28c9b-d6e5-469c-802d-3a585a81b0f8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:42.882454 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-bbf89d22-3d19-40cc-b37a-6437482e7d76 req-3aa28c9b-d6e5-469c-802d-3a585a81b0f8 service nova] Creating event network-changed:adfa66e4-ad90-4e2a-858b-4fb2ede116e4 for instance 9dd0d352-d214-4127-b3a7-db71ae5c162d on n-h1-848886-15 Jul 25 13:05:42.895324 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-bbf89d22-3d19-40cc-b37a-6437482e7d76 req-3aa28c9b-d6e5-469c-802d-3a585a81b0f8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087154 Jul 25 13:05:42.899096 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2413/4733] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:05:42.948218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-170e742b-c3a6-4fc0-8643-9b3a751ebda1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:42.961675 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-170e742b-c3a6-4fc0-8643-9b3a751ebda1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d" status: 200 len: 1328 microversion: 2.1 time: 0.702528 Jul 25 13:05:42.962594 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2321/4734] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:42 2022] GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d => generated 1328 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:43.276358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-80b3930e-e151-4bdf-9f89-06270c20da70 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:43.277677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-80b3930e-e151-4bdf-9f89-06270c20da70 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:43.284532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-80b3930e-e151-4bdf-9f89-06270c20da70 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:43.285224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-80b3930e-e151-4bdf-9f89-06270c20da70 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:43.286232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-80b3930e-e151-4bdf-9f89-06270c20da70 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:43.286843 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-80b3930e-e151-4bdf-9f89-06270c20da70 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:43.296172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bc1e1036-0736-441f-80d4-6a052274565a tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:43.297391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bc1e1036-0736-441f-80d4-6a052274565a tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 9dd0d352-d214-4127-b3a7-db71ae5c162d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:43.306881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc1e1036-0736-441f-80d4-6a052274565a tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:43.310403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc1e1036-0736-441f-80d4-6a052274565a tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:43.312444 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc1e1036-0736-441f-80d4-6a052274565a tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:43.314358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc1e1036-0736-441f-80d4-6a052274565a tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:43.548508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bc1e1036-0736-441f-80d4-6a052274565a tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:43.561764 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bc1e1036-0736-441f-80d4-6a052274565a tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d" status: 200 len: 1318 microversion: 2.1 time: 0.268699 Jul 25 13:05:43.563334 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2322/4735] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:43 2022] GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:43.589583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-80b3930e-e151-4bdf-9f89-06270c20da70 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:43.601099 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-80b3930e-e151-4bdf-9f89-06270c20da70 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1520 microversion: 2.1 time: 0.328888 Jul 25 13:05:43.613694 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2414/4736] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:43 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1520 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:43.988170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-79717d6d-8d35-4bc5-84b5-761b67d46c2f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:43.988965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-79717d6d-8d35-4bc5-84b5-761b67d46c2f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 28dc8442-8d68-462f-9077-47707180800d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:43.999994 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79717d6d-8d35-4bc5-84b5-761b67d46c2f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:44.001298 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79717d6d-8d35-4bc5-84b5-761b67d46c2f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:44.002276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79717d6d-8d35-4bc5-84b5-761b67d46c2f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:44.002806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79717d6d-8d35-4bc5-84b5-761b67d46c2f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:44.582805 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bad36917-b979-4a3c-853f-c9067137bf49 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:44.584107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bad36917-b979-4a3c-853f-c9067137bf49 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 9dd0d352-d214-4127-b3a7-db71ae5c162d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:44.597516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bad36917-b979-4a3c-853f-c9067137bf49 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:44.597995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bad36917-b979-4a3c-853f-c9067137bf49 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:44.598776 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bad36917-b979-4a3c-853f-c9067137bf49 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:44.599209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bad36917-b979-4a3c-853f-c9067137bf49 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:45.129425 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-79717d6d-8d35-4bc5-84b5-761b67d46c2f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:45.155973 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-79717d6d-8d35-4bc5-84b5-761b67d46c2f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d" status: 200 len: 1328 microversion: 2.1 time: 1.174468 Jul 25 13:05:45.156927 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2323/4737] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:43 2022] GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d => generated 1328 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:45.178071 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-24b47c29-dc5c-4f1d-bdcb-10f97ab0f102 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:45.178917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-24b47c29-dc5c-4f1d-bdcb-10f97ab0f102 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:45.179908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bad36917-b979-4a3c-853f-c9067137bf49 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:45.188763 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bad36917-b979-4a3c-853f-c9067137bf49 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d" status: 200 len: 1318 microversion: 2.1 time: 0.610289 Jul 25 13:05:45.189319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-24b47c29-dc5c-4f1d-bdcb-10f97ab0f102 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:45.190003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-24b47c29-dc5c-4f1d-bdcb-10f97ab0f102 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:45.192303 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-24b47c29-dc5c-4f1d-bdcb-10f97ab0f102 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:45.193086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-24b47c29-dc5c-4f1d-bdcb-10f97ab0f102 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:45.205802 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2415/4738] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:44 2022] GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d => generated 1318 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:05:45.212241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-59e80071-44f8-4f37-a4f7-1cb42d11452b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:45.218937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59e80071-44f8-4f37-a4f7-1cb42d11452b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:45.219710 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59e80071-44f8-4f37-a4f7-1cb42d11452b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:45.244514 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-59e80071-44f8-4f37-a4f7-1cb42d11452b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Going to try to stop instance {{(pid=125884) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 13:05:45.331090 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-59e80071-44f8-4f37-a4f7-1cb42d11452b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "POST /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e/action" status: 202 len: 0 microversion: 2.1 time: 0.123426 Jul 25 13:05:45.339097 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2416/4739] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:05:45 2022] POST /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:05:45.362780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2a28c9dd-59e6-4a1b-a543-d03d70472a7a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:45.366318 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2a28c9dd-59e6-4a1b-a543-d03d70472a7a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:45.384086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a28c9dd-59e6-4a1b-a543-d03d70472a7a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:45.384950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a28c9dd-59e6-4a1b-a543-d03d70472a7a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:45.386882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a28c9dd-59e6-4a1b-a543-d03d70472a7a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:45.387517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a28c9dd-59e6-4a1b-a543-d03d70472a7a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:45.727684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-24b47c29-dc5c-4f1d-bdcb-10f97ab0f102 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:45.739564 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-24b47c29-dc5c-4f1d-bdcb-10f97ab0f102 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1520 microversion: 2.1 time: 0.566633 Jul 25 13:05:45.742582 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2324/4740] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:45 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1520 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:45.858175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2a28c9dd-59e6-4a1b-a543-d03d70472a7a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:45.878148 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2a28c9dd-59e6-4a1b-a543-d03d70472a7a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1676 microversion: 2.1 time: 0.537352 Jul 25 13:05:45.880157 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2417/4741] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:45 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1676 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:46.182793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6b07c1e5-5bc7-4d5f-8a19-7ab95064bf6d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:46.184120 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6b07c1e5-5bc7-4d5f-8a19-7ab95064bf6d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 28dc8442-8d68-462f-9077-47707180800d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:46.192280 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b07c1e5-5bc7-4d5f-8a19-7ab95064bf6d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:46.193425 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b07c1e5-5bc7-4d5f-8a19-7ab95064bf6d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:46.195609 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b07c1e5-5bc7-4d5f-8a19-7ab95064bf6d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:46.196255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b07c1e5-5bc7-4d5f-8a19-7ab95064bf6d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:46.217040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-364faab8-6a70-456f-b537-9028af812017 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:46.219324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-364faab8-6a70-456f-b537-9028af812017 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 9dd0d352-d214-4127-b3a7-db71ae5c162d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:46.237990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-364faab8-6a70-456f-b537-9028af812017 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:46.242221 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-364faab8-6a70-456f-b537-9028af812017 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:46.243926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-364faab8-6a70-456f-b537-9028af812017 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:46.247293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-364faab8-6a70-456f-b537-9028af812017 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:46.616723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-364faab8-6a70-456f-b537-9028af812017 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:46.628744 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-364faab8-6a70-456f-b537-9028af812017 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d" status: 200 len: 1318 microversion: 2.1 time: 0.419021 Jul 25 13:05:46.630480 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2418/4742] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:46 2022] GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:46.679428 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6b07c1e5-5bc7-4d5f-8a19-7ab95064bf6d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:46.702855 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6b07c1e5-5bc7-4d5f-8a19-7ab95064bf6d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d" status: 200 len: 1509 microversion: 2.1 time: 0.525327 Jul 25 13:05:46.706563 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2325/4743] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:46 2022] GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d => generated 1509 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:46.727717 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aee2d63e-17ce-48d9-b1f9-95d5c435bc81 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:46.728642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-aee2d63e-17ce-48d9-b1f9-95d5c435bc81 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 28dc8442-8d68-462f-9077-47707180800d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:46.735663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:46.738058 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aee2d63e-17ce-48d9-b1f9-95d5c435bc81 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:46.739264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aee2d63e-17ce-48d9-b1f9-95d5c435bc81 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:46.740305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aee2d63e-17ce-48d9-b1f9-95d5c435bc81 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:46.740908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aee2d63e-17ce-48d9-b1f9-95d5c435bc81 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:46.765265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aaa33b1f-0994-4f96-9641-b0ba947ef476 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:46.766225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-aaa33b1f-0994-4f96-9641-b0ba947ef476 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:46.773390 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aaa33b1f-0994-4f96-9641-b0ba947ef476 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:46.774165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aaa33b1f-0994-4f96-9641-b0ba947ef476 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:46.775384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aaa33b1f-0994-4f96-9641-b0ba947ef476 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:46.776003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aaa33b1f-0994-4f96-9641-b0ba947ef476 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:47.099573 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-aaa33b1f-0994-4f96-9641-b0ba947ef476 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:47.111934 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aaa33b1f-0994-4f96-9641-b0ba947ef476 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1520 microversion: 2.1 time: 0.351152 Jul 25 13:05:47.112724 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2326/4744] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:46 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1520 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:47.130574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2715b28e-fdf3-45d2-8f8d-8b497560a848 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:47.131596 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2715b28e-fdf3-45d2-8f8d-8b497560a848 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:47.145692 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2715b28e-fdf3-45d2-8f8d-8b497560a848 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:47.146508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2715b28e-fdf3-45d2-8f8d-8b497560a848 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:47.149709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2715b28e-fdf3-45d2-8f8d-8b497560a848 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:47.152974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2715b28e-fdf3-45d2-8f8d-8b497560a848 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:47.200461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-aee2d63e-17ce-48d9-b1f9-95d5c435bc81 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:47.209707 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-aee2d63e-17ce-48d9-b1f9-95d5c435bc81 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d" status: 200 len: 1509 microversion: 2.1 time: 0.486489 Jul 25 13:05:47.227131 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2419/4745] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:46 2022] GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d => generated 1509 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:47.239544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cc563988-5e2d-4e21-864a-edc6f0a90708 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:47.240152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cc563988-5e2d-4e21-864a-edc6f0a90708 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 28dc8442-8d68-462f-9077-47707180800d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:47.247278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc563988-5e2d-4e21-864a-edc6f0a90708 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:47.248100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc563988-5e2d-4e21-864a-edc6f0a90708 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:47.249263 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc563988-5e2d-4e21-864a-edc6f0a90708 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:47.250006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc563988-5e2d-4e21-864a-edc6f0a90708 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:47.293958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cc563988-5e2d-4e21-864a-edc6f0a90708 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 28dc8442-8d68-462f-9077-47707180800d] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:05:47.480533 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cc563988-5e2d-4e21-864a-edc6f0a90708 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "DELETE /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d" status: 204 len: 0 microversion: 2.1 time: 0.244975 Jul 25 13:05:47.481147 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2420/4746] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:05:47 2022] DELETE /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:05:47.499916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3fb2f052-a90e-4ea1-8f3b-ef524576fa6d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:47.500896 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3fb2f052-a90e-4ea1-8f3b-ef524576fa6d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 28dc8442-8d68-462f-9077-47707180800d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:47.516303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3fb2f052-a90e-4ea1-8f3b-ef524576fa6d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:47.516946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3fb2f052-a90e-4ea1-8f3b-ef524576fa6d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:47.517941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3fb2f052-a90e-4ea1-8f3b-ef524576fa6d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:47.518534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3fb2f052-a90e-4ea1-8f3b-ef524576fa6d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:47.553405 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2715b28e-fdf3-45d2-8f8d-8b497560a848 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:47.569729 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2715b28e-fdf3-45d2-8f8d-8b497560a848 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1676 microversion: 2.1 time: 0.454596 Jul 25 13:05:47.571021 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2327/4747] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:47 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1676 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:47.660087 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-173cfa35-2877-4b1b-a398-a3d37d96a3e5 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:47.660897 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-173cfa35-2877-4b1b-a398-a3d37d96a3e5 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 9dd0d352-d214-4127-b3a7-db71ae5c162d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:47.674426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-173cfa35-2877-4b1b-a398-a3d37d96a3e5 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:47.674931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-173cfa35-2877-4b1b-a398-a3d37d96a3e5 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:47.687854 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-173cfa35-2877-4b1b-a398-a3d37d96a3e5 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:47.687854 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-173cfa35-2877-4b1b-a398-a3d37d96a3e5 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:47.756262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3fb2f052-a90e-4ea1-8f3b-ef524576fa6d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:47.774203 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3fb2f052-a90e-4ea1-8f3b-ef524576fa6d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d" status: 200 len: 1515 microversion: 2.1 time: 0.278087 Jul 25 13:05:47.777771 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2421/4748] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:47 2022] GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d => generated 1515 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:48.144192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-accd3ec5-612e-4ded-8592-5049baa41166 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:48.144814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-accd3ec5-612e-4ded-8592-5049baa41166 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:48.160464 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-accd3ec5-612e-4ded-8592-5049baa41166 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:48.160963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-accd3ec5-612e-4ded-8592-5049baa41166 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:48.161898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-accd3ec5-612e-4ded-8592-5049baa41166 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:48.179989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-accd3ec5-612e-4ded-8592-5049baa41166 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:48.181658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-173cfa35-2877-4b1b-a398-a3d37d96a3e5 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:48.198023 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-173cfa35-2877-4b1b-a398-a3d37d96a3e5 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d" status: 200 len: 1318 microversion: 2.1 time: 0.546945 Jul 25 13:05:48.198622 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2328/4749] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:47 2022] GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d => generated 1318 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:05:48.594625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-15f68b05-97e5-4f15-86cc-801e8928bcd1 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:48.599504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-15f68b05-97e5-4f15-86cc-801e8928bcd1 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:48.613901 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15f68b05-97e5-4f15-86cc-801e8928bcd1 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:48.616577 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15f68b05-97e5-4f15-86cc-801e8928bcd1 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:48.618068 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15f68b05-97e5-4f15-86cc-801e8928bcd1 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:48.619111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15f68b05-97e5-4f15-86cc-801e8928bcd1 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:48.813941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-accd3ec5-612e-4ded-8592-5049baa41166 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:48.861615 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-accd3ec5-612e-4ded-8592-5049baa41166 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1520 microversion: 2.1 time: 0.710883 Jul 25 13:05:48.866435 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2422/4750] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:48 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1520 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:48.877173 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-20e5a41a-5298-4ca0-8157-a6086655797b tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '.version_select at 0x7efcf92feb80>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:48.913897 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-20e5a41a-5298-4ca0-8157-a6086655797b tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-137998169" status: 202 len: 0 microversion: 2.1 time: 0.045542 Jul 25 13:05:48.918027 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2423/4751] 10.222.0.49 () {58 vars in 1281 bytes} [Mon Jul 25 13:05:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-137998169 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:05:48.933483 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8f3fbb70-6afa-4bcb-a137-8165d5841887 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:48.934682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8f3fbb70-6afa-4bcb-a137-8165d5841887 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 28dc8442-8d68-462f-9077-47707180800d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:48.955705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8f3fbb70-6afa-4bcb-a137-8165d5841887 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:48.956529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8f3fbb70-6afa-4bcb-a137-8165d5841887 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:48.957533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8f3fbb70-6afa-4bcb-a137-8165d5841887 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:48.958253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8f3fbb70-6afa-4bcb-a137-8165d5841887 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:48.983097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:48.983269 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-15f68b05-97e5-4f15-86cc-801e8928bcd1 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:48.999909 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-15f68b05-97e5-4f15-86cc-801e8928bcd1 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1676 microversion: 2.1 time: 0.410812 Jul 25 13:05:49.005795 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2329/4752] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:48 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1676 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:49.012497 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e393cf75-c872-44ad-9c98-4817148ebf40 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Action: 'create', calling method: .version_select at 0x7efcfed64af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-455498142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+lr9SRSv+DXn1H9V6tnmTViyGuXgbTxFbXtjhioK6J7OKdTb2ZlnzpMIjqIYvbauwz8amF3geFXa76MPL5eHYN3gspBnQ5x2MdTlqUx8p0rgz92p3QPq65mW2pvnxOxQ=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:49.048948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-e393cf75-c872-44ad-9c98-4817148ebf40 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Getting quotas for project c0d891a772834e43bdfcbde778a90498. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:05:49.065380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-e393cf75-c872-44ad-9c98-4817148ebf40 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Getting quotas for user 4d6e2ae351744e0ab1f153d629e4f0e7 and project c0d891a772834e43bdfcbde778a90498. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:05:49.113993 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e393cf75-c872-44ad-9c98-4817148ebf40 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.106572 Jul 25 13:05:49.114846 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2330/4753] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:05:49 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:05:49.234362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aa62eacd-cd37-47e3-9073-b89caff5f0e8 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:49.235726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-aa62eacd-cd37-47e3-9073-b89caff5f0e8 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 9dd0d352-d214-4127-b3a7-db71ae5c162d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:49.246145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa62eacd-cd37-47e3-9073-b89caff5f0e8 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:49.247198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa62eacd-cd37-47e3-9073-b89caff5f0e8 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:49.248178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa62eacd-cd37-47e3-9073-b89caff5f0e8 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:49.249954 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa62eacd-cd37-47e3-9073-b89caff5f0e8 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:49.513555 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8f3fbb70-6afa-4bcb-a137-8165d5841887 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:49.523013 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8f3fbb70-6afa-4bcb-a137-8165d5841887 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d" status: 200 len: 1515 microversion: 2.1 time: 0.606912 Jul 25 13:05:49.539784 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2424/4754] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:48 2022] GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d => generated 1515 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:49.749680 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-4db57aab-1852-4f56-be5f-4c7997feba9b req-26170b9d-f229-45d3-9a56-d46e730ae368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28dc8442-8d68-462f-9077-47707180800d", "name": "network-vif-deleted", "tag": "1c3402f0-063b-4032-82ec-81c6c4a7b469"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:49.777536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4db57aab-1852-4f56-be5f-4c7997feba9b req-26170b9d-f229-45d3-9a56-d46e730ae368 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:49.778162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4db57aab-1852-4f56-be5f-4c7997feba9b req-26170b9d-f229-45d3-9a56-d46e730ae368 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:49.796604 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-4db57aab-1852-4f56-be5f-4c7997feba9b req-26170b9d-f229-45d3-9a56-d46e730ae368 service nova] Creating event network-vif-deleted:1c3402f0-063b-4032-82ec-81c6c4a7b469 for instance 28dc8442-8d68-462f-9077-47707180800d on n-h1-848886-15 Jul 25 13:05:49.804616 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-4db57aab-1852-4f56-be5f-4c7997feba9b req-26170b9d-f229-45d3-9a56-d46e730ae368 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061379 Jul 25 13:05:49.805952 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2425/4755] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:05:49.822771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-aa62eacd-cd37-47e3-9073-b89caff5f0e8 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:49.842509 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aa62eacd-cd37-47e3-9073-b89caff5f0e8 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d" status: 200 len: 1318 microversion: 2.1 time: 0.625829 Jul 25 13:05:49.843650 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2331/4756] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:49 2022] GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d => generated 1318 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:49.888611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a27145d9-78c9-472b-b991-5f34d428ff9b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:49.889767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a27145d9-78c9-472b-b991-5f34d428ff9b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:49.910026 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a27145d9-78c9-472b-b991-5f34d428ff9b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:49.910612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a27145d9-78c9-472b-b991-5f34d428ff9b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:49.914097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a27145d9-78c9-472b-b991-5f34d428ff9b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:49.915200 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a27145d9-78c9-472b-b991-5f34d428ff9b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:50.025395 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-460f0cd8-4a65-4bff-9eab-19a405d090d6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:50.026058 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-460f0cd8-4a65-4bff-9eab-19a405d090d6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:50.038782 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-460f0cd8-4a65-4bff-9eab-19a405d090d6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:50.039294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-460f0cd8-4a65-4bff-9eab-19a405d090d6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:50.041984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-460f0cd8-4a65-4bff-9eab-19a405d090d6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:50.042377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-460f0cd8-4a65-4bff-9eab-19a405d090d6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:50.920008 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a27145d9-78c9-472b-b991-5f34d428ff9b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:50.932751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-460f0cd8-4a65-4bff-9eab-19a405d090d6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:50.943413 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a27145d9-78c9-472b-b991-5f34d428ff9b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1500 microversion: 2.1 time: 1.054166 Jul 25 13:05:50.944259 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2426/4757] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:49 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1500 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:50.948917 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-460f0cd8-4a65-4bff-9eab-19a405d090d6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1676 microversion: 2.1 time: 0.928770 Jul 25 13:05:50.949878 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2332/4758] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:50 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1676 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:50.956041 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-87256bde-c334-49ac-af9e-42ccb30c5c74 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:50.957198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-87256bde-c334-49ac-af9e-42ccb30c5c74 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 9dd0d352-d214-4127-b3a7-db71ae5c162d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:50.968050 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87256bde-c334-49ac-af9e-42ccb30c5c74 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:50.969856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87256bde-c334-49ac-af9e-42ccb30c5c74 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:50.972244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87256bde-c334-49ac-af9e-42ccb30c5c74 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:50.973611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87256bde-c334-49ac-af9e-42ccb30c5c74 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:50.973959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bc6850d9-e377-481a-b2de-09e06e0a0ad0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:50.974599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bc6850d9-e377-481a-b2de-09e06e0a0ad0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 28dc8442-8d68-462f-9077-47707180800d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:50.993049 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc6850d9-e377-481a-b2de-09e06e0a0ad0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:50.993915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc6850d9-e377-481a-b2de-09e06e0a0ad0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:50.994717 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc6850d9-e377-481a-b2de-09e06e0a0ad0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:50.995161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc6850d9-e377-481a-b2de-09e06e0a0ad0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:51.020151 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-bc6850d9-e377-481a-b2de-09e06e0a0ad0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] HTTP exception thrown: Instance 28dc8442-8d68-462f-9077-47707180800d could not be found. Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bc6850d9-e377-481a-b2de-09e06e0a0ad0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Request method failure captured: Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d HTTP/1.1 Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pTdZnYy3zWCXLN8GI-lAb9Aac2xutmWdntWmHOJQQOAHuSaLRru4vmbdxH-2ipAsIwdgHGRBCQV52EgrlBqV5LzQtSAIs0OqruuNBUIA1ZYGpGU7ybcvN2tekv0vVPxk7wJZaAmUwppQmT0JDG4pBCSl5Rw9dXMoK1Y6yvluyRvyio Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersTestJSON-733750618 Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebb6a07295234370aa1aa5067b8ee930", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}] Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersTestJSON-733750618 Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersTestJSON-733750618 Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersTestJSON-733750618-project Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 60d84eb7c45449cbad3141d9f363e693 Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersTestJSON-733750618-project Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 28dc8442-8d68-462f-9077-47707180800d could not be found. Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '28dc8442-8d68-462f-9077-47707180800d'} Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28dc8442-8d68-462f-9077-47707180800d could not be found. Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28dc8442-8d68-462f-9077-47707180800d could not be found. Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:51.021877 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:51.026959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:05:51.026959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:05:51.026959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:05:51.026959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:05:51.026959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28dc8442-8d68-462f-9077-47707180800d could not be found. Jul 25 13:05:51.026959 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:51.026959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bc6850d9-e377-481a-b2de-09e06e0a0ad0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Returning 404 to user: Instance 28dc8442-8d68-462f-9077-47707180800d could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:05:51.026959 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bc6850d9-e377-481a-b2de-09e06e0a0ad0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d" status: 404 len: 111 microversion: 2.1 time: 0.064506 Jul 25 13:05:51.027747 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2427/4759] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:50 2022] GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:05:51.033037 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f72d9ecd-edf1-4972-9a5e-104daf505482 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "959cf4e2-f905-42d3-bfec-7f3149e2db6d"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:51.035601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f72d9ecd-edf1-4972-9a5e-104daf505482 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:51.051057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f72d9ecd-edf1-4972-9a5e-104daf505482 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:51.053258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f72d9ecd-edf1-4972-9a5e-104daf505482 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:51.055946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f72d9ecd-edf1-4972-9a5e-104daf505482 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:51.057166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f72d9ecd-edf1-4972-9a5e-104daf505482 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:51.101551 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-f72d9ecd-edf1-4972-9a5e-104daf505482 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] HTTP exception thrown: Cannot 'attach_volume' instance 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a while it is in vm_state rescued Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f72d9ecd-edf1-4972-9a5e-104daf505482 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Request method failure captured: Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a/os-volume_attachments HTTP/1.1 Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 74 Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pS2fizNtGcP0shojWUAR1ukudLDJRoXVlsPYG2HQcSlgo2We_QWqoULmyxY8IuKrW-0MGgmtrhM3h66oISYSRqIRFBaYspnVlW3g8FUdRvhwOpsGmp2Y9wrcYeXMJCu6fdAfgxIzqcJ6TFFh6UfkfCkGP1n9iDHq6IO37482VYIk-U Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: f791ac394f9f4b8d99d2f48f7d04eae9 Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f791ac394f9f4b8d99d2f48f7d04eae9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f791ac394f9f4b8d99d2f48f7d04eae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f791ac394f9f4b8d99d2f48f7d04eae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f791ac394f9f4b8d99d2f48f7d04eae9"}]}] Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: f791ac394f9f4b8d99d2f48f7d04eae9 Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerRescueNegativeTestJSON-1618399313-project Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 72f34c080e4a4024a38660e8af252a29 Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1618399313-project Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: {"volumeAttachment": {"volumeId": "959cf4e2-f905-42d3-bfec-7f3149e2db6d"}} Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: exception: Cannot 'attach_volume' instance 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a while it is in vm_state rescued Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'server_id': '8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a', 'body': {'volumeAttachment': {'volumeId': '959cf4e2-f905-42d3-bfec-7f3149e2db6d'}}} Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 25 13:05:51.105933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 13:05:51.110739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 13:05:51.110739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 13:05:51.110739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a while it is in vm_state rescued Jul 25 13:05:51.110739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:51.110739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:05:51.110739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:51.110739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:05:51.110739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:05:51.110739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:05:51.110739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:05:51.110739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:05:51.110739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a while it is in vm_state rescued Jul 25 13:05:51.110739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:05:51.110739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f72d9ecd-edf1-4972-9a5e-104daf505482 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Returning 409 to user: Cannot 'attach_volume' instance 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a while it is in vm_state rescued {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:05:51.110739 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f72d9ecd-edf1-4972-9a5e-104daf505482 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "POST /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.078904 Jul 25 13:05:51.112221 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2428/4760] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Jul 25 13:05:51 2022] POST /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a/os-volume_attachments => generated 152 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 13:05:51.127595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-85d781a0-a4f9-4af3-b61a-7228ea25707b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '.version_select at 0x7efcf91d60d0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:51.159054 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-85d781a0-a4f9-4af3-b61a-7228ea25707b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-key-2003265210" status: 202 len: 0 microversion: 2.1 time: 0.045557 Jul 25 13:05:51.159618 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2429/4761] 10.222.0.49 () {58 vars in 1209 bytes} [Mon Jul 25 13:05:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-2003265210 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:05:51.166493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5192f8a4-19b0-43af-80b3-ac1d2eebe3e9 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:51.169259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5192f8a4-19b0-43af-80b3-ac1d2eebe3e9 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:51.182840 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5192f8a4-19b0-43af-80b3-ac1d2eebe3e9 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:51.183425 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5192f8a4-19b0-43af-80b3-ac1d2eebe3e9 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:51.190501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5192f8a4-19b0-43af-80b3-ac1d2eebe3e9 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:51.190957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5192f8a4-19b0-43af-80b3-ac1d2eebe3e9 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:51.231338 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-87256bde-c334-49ac-af9e-42ccb30c5c74 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:51.247947 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-87256bde-c334-49ac-af9e-42ccb30c5c74 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d" status: 200 len: 1318 microversion: 2.1 time: 0.296089 Jul 25 13:05:51.255803 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2333/4762] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:50 2022] GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:51.317054 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5192f8a4-19b0-43af-80b3-ac1d2eebe3e9 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "POST /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a/action" status: 202 len: 0 microversion: 2.1 time: 0.154487 Jul 25 13:05:51.318745 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2430/4763] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:05:51 2022] POST /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:05:51.327331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a815bc61-4fd7-4b8a-b6f4-f4b5451dff4c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:51.328372 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a815bc61-4fd7-4b8a-b6f4-f4b5451dff4c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:51.343102 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a815bc61-4fd7-4b8a-b6f4-f4b5451dff4c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:51.344216 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a815bc61-4fd7-4b8a-b6f4-f4b5451dff4c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:51.345097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ccab34a5-23bd-4700-ac97-5774e83659a0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1629974181", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "41e863a3-713c-4d35-a204-58098a16a6e3"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:51.345512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a815bc61-4fd7-4b8a-b6f4-f4b5451dff4c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:51.346648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a815bc61-4fd7-4b8a-b6f4-f4b5451dff4c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:51.418452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-ccab34a5-23bd-4700-ac97-5774e83659a0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] validate_networks() for [('41e863a3-713c-4d35-a204-58098a16a6e3', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:05:51.748547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a815bc61-4fd7-4b8a-b6f4-f4b5451dff4c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:51.758736 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a815bc61-4fd7-4b8a-b6f4-f4b5451dff4c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1508 microversion: 2.1 time: 0.435532 Jul 25 13:05:51.759877 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2334/4764] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:51 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1508 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:51.765726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-5ad26bdc-9870-47f2-b5c4-1f7b5c7c6134 req-0e66deae-1172-4b7c-9814-f57798b0160b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dd0d352-d214-4127-b3a7-db71ae5c162d", "name": "network-vif-plugged", "status": "completed", "tag": "adfa66e4-ad90-4e2a-858b-4fb2ede116e4"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:51.776920 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-5ad26bdc-9870-47f2-b5c4-1f7b5c7c6134 req-0e66deae-1172-4b7c-9814-f57798b0160b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:51.777366 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-5ad26bdc-9870-47f2-b5c4-1f7b5c7c6134 req-0e66deae-1172-4b7c-9814-f57798b0160b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:51.782532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:51.792460 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-5ad26bdc-9870-47f2-b5c4-1f7b5c7c6134 req-0e66deae-1172-4b7c-9814-f57798b0160b service nova] Creating event network-vif-plugged:adfa66e4-ad90-4e2a-858b-4fb2ede116e4 for instance 9dd0d352-d214-4127-b3a7-db71ae5c162d on n-h1-848886-15 Jul 25 13:05:51.799748 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-5ad26bdc-9870-47f2-b5c4-1f7b5c7c6134 req-0e66deae-1172-4b7c-9814-f57798b0160b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038015 Jul 25 13:05:51.800975 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2335/4765] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:05:51.974983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d7151b37-567e-44cc-86ad-a69f34d327e7 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:51.975733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d7151b37-567e-44cc-86ad-a69f34d327e7 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:51.990300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d7151b37-567e-44cc-86ad-a69f34d327e7 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:51.990666 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d7151b37-567e-44cc-86ad-a69f34d327e7 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:51.991468 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d7151b37-567e-44cc-86ad-a69f34d327e7 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:51.992704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d7151b37-567e-44cc-86ad-a69f34d327e7 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:52.467801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d7151b37-567e-44cc-86ad-a69f34d327e7 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:52.521811 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d7151b37-567e-44cc-86ad-a69f34d327e7 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1676 microversion: 2.1 time: 0.551888 Jul 25 13:05:52.526820 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2336/4766] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:51 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1676 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:52.559577 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8f2fbbda-0098-4da5-87ea-59d5eb9c6e14 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:52.560625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8f2fbbda-0098-4da5-87ea-59d5eb9c6e14 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 9dd0d352-d214-4127-b3a7-db71ae5c162d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:52.580056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f2fbbda-0098-4da5-87ea-59d5eb9c6e14 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:52.580388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f2fbbda-0098-4da5-87ea-59d5eb9c6e14 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:52.581186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f2fbbda-0098-4da5-87ea-59d5eb9c6e14 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:52.581763 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8f2fbbda-0098-4da5-87ea-59d5eb9c6e14 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:53.103364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ccab34a5-23bd-4700-ac97-5774e83659a0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:05:53.103969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ccab34a5-23bd-4700-ac97-5774e83659a0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:05:53.104427 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ccab34a5-23bd-4700-ac97-5774e83659a0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:05:53.104915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ccab34a5-23bd-4700-ac97-5774e83659a0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:05:53.105405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ccab34a5-23bd-4700-ac97-5774e83659a0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:05:53.117316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccab34a5-23bd-4700-ac97-5774e83659a0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:53.118575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccab34a5-23bd-4700-ac97-5774e83659a0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:53.120140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccab34a5-23bd-4700-ac97-5774e83659a0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:53.120912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ccab34a5-23bd-4700-ac97-5774e83659a0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:53.136796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8f2fbbda-0098-4da5-87ea-59d5eb9c6e14 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:53.147984 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8f2fbbda-0098-4da5-87ea-59d5eb9c6e14 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d" status: 200 len: 1318 microversion: 2.1 time: 0.616128 Jul 25 13:05:53.152734 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2337/4767] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:52 2022] GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d => generated 1318 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:53.174083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-285a9a21-bc00-498e-8bbf-590990150b1c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:53.175146 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-285a9a21-bc00-498e-8bbf-590990150b1c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:53.191530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-285a9a21-bc00-498e-8bbf-590990150b1c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:53.195179 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-285a9a21-bc00-498e-8bbf-590990150b1c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:53.197730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-285a9a21-bc00-498e-8bbf-590990150b1c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:53.199360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-ccab34a5-23bd-4700-ac97-5774e83659a0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Getting quotas for project ebb6a07295234370aa1aa5067b8ee930. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:05:53.200219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-285a9a21-bc00-498e-8bbf-590990150b1c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:53.216757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-ccab34a5-23bd-4700-ac97-5774e83659a0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Getting quotas for user 60d84eb7c45449cbad3141d9f363e693 and project ebb6a07295234370aa1aa5067b8ee930. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:05:53.255815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ccab34a5-23bd-4700-ac97-5774e83659a0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:05:53.270477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ccab34a5-23bd-4700-ac97-5774e83659a0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:05:53.345600 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ccab34a5-23bd-4700-ac97-5774e83659a0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.007407 Jul 25 13:05:53.354496 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2431/4768] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:05:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:05:53.370292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-230bce45-2b0b-43bc-9700-d7b692a6354d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:53.370922 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-230bce45-2b0b-43bc-9700-d7b692a6354d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:53.674647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-230bce45-2b0b-43bc-9700-d7b692a6354d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:53.683586 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-230bce45-2b0b-43bc-9700-d7b692a6354d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885" status: 200 len: 1209 microversion: 2.1 time: 0.328203 Jul 25 13:05:53.684223 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2432/4769] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:53 2022] GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 => generated 1209 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:53.695105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1f41cced-5faa-4f86-9713-3e1513c0ea08 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:53.695937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1f41cced-5faa-4f86-9713-3e1513c0ea08 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:53.703556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f41cced-5faa-4f86-9713-3e1513c0ea08 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:53.704428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f41cced-5faa-4f86-9713-3e1513c0ea08 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:53.705478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f41cced-5faa-4f86-9713-3e1513c0ea08 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:53.706214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f41cced-5faa-4f86-9713-3e1513c0ea08 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:53.769611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-285a9a21-bc00-498e-8bbf-590990150b1c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:53.784465 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-285a9a21-bc00-498e-8bbf-590990150b1c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1508 microversion: 2.1 time: 0.629390 Jul 25 13:05:53.787219 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2338/4770] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:53 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1508 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:53.836075 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-bafbc7df-8a26-46c4-82b9-62703d3c6df1 req-e0659b31-4326-4b59-8288-b00964abda3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c876a631-1a8a-476d-8627-96aadf865337", "name": "network-vif-plugged", "status": "completed", "tag": "d6fe26e5-9a74-48c7-84da-d769003f1bec"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:53.848702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-bafbc7df-8a26-46c4-82b9-62703d3c6df1 req-e0659b31-4326-4b59-8288-b00964abda3a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:53.849152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-bafbc7df-8a26-46c4-82b9-62703d3c6df1 req-e0659b31-4326-4b59-8288-b00964abda3a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:53.887274 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-bafbc7df-8a26-46c4-82b9-62703d3c6df1 req-e0659b31-4326-4b59-8288-b00964abda3a service nova] Creating event network-vif-plugged:d6fe26e5-9a74-48c7-84da-d769003f1bec for instance c876a631-1a8a-476d-8627-96aadf865337 on n-h2-848886-15 Jul 25 13:05:53.899395 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-bafbc7df-8a26-46c4-82b9-62703d3c6df1 req-e0659b31-4326-4b59-8288-b00964abda3a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070681 Jul 25 13:05:53.904318 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2339/4771] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:05:54.177384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7e2cd86c-fddf-4a77-ab37-3c6997895ac6 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:54.178922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7e2cd86c-fddf-4a77-ab37-3c6997895ac6 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 9dd0d352-d214-4127-b3a7-db71ae5c162d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:54.194840 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e2cd86c-fddf-4a77-ab37-3c6997895ac6 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:54.203358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e2cd86c-fddf-4a77-ab37-3c6997895ac6 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:54.204561 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e2cd86c-fddf-4a77-ab37-3c6997895ac6 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:54.205197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e2cd86c-fddf-4a77-ab37-3c6997895ac6 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:54.348408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1f41cced-5faa-4f86-9713-3e1513c0ea08 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:54.358910 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1f41cced-5faa-4f86-9713-3e1513c0ea08 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1676 microversion: 2.1 time: 0.671146 Jul 25 13:05:54.364727 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2433/4772] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:53 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1676 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:54.709043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-824b9c21-7d2f-489c-adf4-c227f7612f1a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:54.709705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-824b9c21-7d2f-489c-adf4-c227f7612f1a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:54.720888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-824b9c21-7d2f-489c-adf4-c227f7612f1a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:54.721618 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-824b9c21-7d2f-489c-adf4-c227f7612f1a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:54.725269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-824b9c21-7d2f-489c-adf4-c227f7612f1a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:54.726155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-824b9c21-7d2f-489c-adf4-c227f7612f1a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:54.809415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7e2cd86c-fddf-4a77-ab37-3c6997895ac6 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:54.819406 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7e2cd86c-fddf-4a77-ab37-3c6997895ac6 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d" status: 200 len: 1506 microversion: 2.1 time: 0.649455 Jul 25 13:05:54.843474 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2340/4773] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:54 2022] GET /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d => generated 1506 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:54.889086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ff3f1f31-5e9f-4794-badb-73ad28079d33 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:54.891452 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ff3f1f31-5e9f-4794-badb-73ad28079d33 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:54.912763 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff3f1f31-5e9f-4794-badb-73ad28079d33 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:54.913533 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff3f1f31-5e9f-4794-badb-73ad28079d33 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:54.917303 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff3f1f31-5e9f-4794-badb-73ad28079d33 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:54.918559 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff3f1f31-5e9f-4794-badb-73ad28079d33 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:55.032599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-824b9c21-7d2f-489c-adf4-c227f7612f1a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:55.049509 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-824b9c21-7d2f-489c-adf4-c227f7612f1a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885" status: 200 len: 1205 microversion: 2.1 time: 0.344928 Jul 25 13:05:55.053144 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2434/4774] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:54 2022] GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 => generated 1205 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:55.079631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-38d7ec7e-596e-49f2-ac13-270ea92a5550 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:55.086974 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-38d7ec7e-596e-49f2-ac13-270ea92a5550 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: c876a631-1a8a-476d-8627-96aadf865337] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:55.113272 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38d7ec7e-596e-49f2-ac13-270ea92a5550 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:55.114002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38d7ec7e-596e-49f2-ac13-270ea92a5550 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:55.114856 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38d7ec7e-596e-49f2-ac13-270ea92a5550 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:55.115293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38d7ec7e-596e-49f2-ac13-270ea92a5550 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:56.337350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ff3f1f31-5e9f-4794-badb-73ad28079d33 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:56.358105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-38d7ec7e-596e-49f2-ac13-270ea92a5550 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:56.361053 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ff3f1f31-5e9f-4794-badb-73ad28079d33 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1508 microversion: 2.1 time: 1.515323 Jul 25 13:05:56.362310 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2341/4775] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:54 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1508 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:56.380083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-71fed557-c60e-4e4b-9ee2-3b9351821fae tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:56.380550 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-38d7ec7e-596e-49f2-ac13-270ea92a5550 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/c876a631-1a8a-476d-8627-96aadf865337" status: 200 len: 1318 microversion: 2.1 time: 1.324070 Jul 25 13:05:56.381045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-71fed557-c60e-4e4b-9ee2-3b9351821fae tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:56.392299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-71fed557-c60e-4e4b-9ee2-3b9351821fae tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:56.393179 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-71fed557-c60e-4e4b-9ee2-3b9351821fae tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:56.394527 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2435/4776] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:55 2022] GET /compute/v2.1/servers/c876a631-1a8a-476d-8627-96aadf865337 => generated 1318 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:56.395443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-71fed557-c60e-4e4b-9ee2-3b9351821fae tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:56.395906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-71fed557-c60e-4e4b-9ee2-3b9351821fae tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:56.400172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ed91839b-522c-4249-ab67-e647aba3f2e3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:56.401171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ed91839b-522c-4249-ab67-e647aba3f2e3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:56.408521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed91839b-522c-4249-ab67-e647aba3f2e3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:56.409394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed91839b-522c-4249-ab67-e647aba3f2e3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:56.411057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed91839b-522c-4249-ab67-e647aba3f2e3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:56.411807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed91839b-522c-4249-ab67-e647aba3f2e3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:56.703242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ed91839b-522c-4249-ab67-e647aba3f2e3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:56.716079 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ed91839b-522c-4249-ab67-e647aba3f2e3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885" status: 200 len: 1267 microversion: 2.1 time: 0.320037 Jul 25 13:05:56.717017 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2436/4777] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:56 2022] GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 => generated 1267 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:56.906847 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-71fed557-c60e-4e4b-9ee2-3b9351821fae tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:56.924252 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-71fed557-c60e-4e4b-9ee2-3b9351821fae tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1653 microversion: 2.1 time: 0.560109 Jul 25 13:05:56.924823 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2342/4778] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:56 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1653 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:56.947657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c3dfee64-c854-4cd7-893f-9b6ead67b80a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:05:56.966550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c3dfee64-c854-4cd7-893f-9b6ead67b80a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:56.967000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c3dfee64-c854-4cd7-893f-9b6ead67b80a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:57.021541 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c3dfee64-c854-4cd7-893f-9b6ead67b80a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Going to try to start instance {{(pid=125884) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 13:05:57.145645 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c3dfee64-c854-4cd7-893f-9b6ead67b80a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "POST /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e/action" status: 202 len: 0 microversion: 2.1 time: 0.201942 Jul 25 13:05:57.146479 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2437/4779] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:05:56 2022] POST /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:05:57.155160 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-621a628b-46d6-41f0-8cf6-75ced7559b7b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:57.155690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-621a628b-46d6-41f0-8cf6-75ced7559b7b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:57.172931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-621a628b-46d6-41f0-8cf6-75ced7559b7b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:57.173476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-621a628b-46d6-41f0-8cf6-75ced7559b7b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:57.174343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-621a628b-46d6-41f0-8cf6-75ced7559b7b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:57.174784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-621a628b-46d6-41f0-8cf6-75ced7559b7b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:57.384118 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c4621c68-37a8-45d4-99c9-2055d6a9727d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:57.384837 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c4621c68-37a8-45d4-99c9-2055d6a9727d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:57.393808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c4621c68-37a8-45d4-99c9-2055d6a9727d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:57.394441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c4621c68-37a8-45d4-99c9-2055d6a9727d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:57.402415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c4621c68-37a8-45d4-99c9-2055d6a9727d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:57.403246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c4621c68-37a8-45d4-99c9-2055d6a9727d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:58.075710 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-621a628b-46d6-41f0-8cf6-75ced7559b7b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:58.092786 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-621a628b-46d6-41f0-8cf6-75ced7559b7b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1662 microversion: 2.1 time: 0.941876 Jul 25 13:05:58.093396 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2343/4780] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:57 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1662 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:58.107079 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8ea98398-e0f5-4b33-aa80-19fb0dfb5405 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:58.112952 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8ea98398-e0f5-4b33-aa80-19fb0dfb5405 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: c876a631-1a8a-476d-8627-96aadf865337] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:58.128394 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ea98398-e0f5-4b33-aa80-19fb0dfb5405 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:58.135974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ea98398-e0f5-4b33-aa80-19fb0dfb5405 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:58.148331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ea98398-e0f5-4b33-aa80-19fb0dfb5405 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:58.148796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ea98398-e0f5-4b33-aa80-19fb0dfb5405 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:59.083487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:59.391164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c4621c68-37a8-45d4-99c9-2055d6a9727d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:59.420151 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c4621c68-37a8-45d4-99c9-2055d6a9727d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1514 microversion: 2.1 time: 2.040191 Jul 25 13:05:59.421048 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2438/4781] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:57 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1514 bytes in 2042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:05:59.443118 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-97f3bd12-05ce-40ee-bcb9-ec3cca009fe4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:59.443739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-97f3bd12-05ce-40ee-bcb9-ec3cca009fe4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:59.458688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-97f3bd12-05ce-40ee-bcb9-ec3cca009fe4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:59.464305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-97f3bd12-05ce-40ee-bcb9-ec3cca009fe4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:59.465368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-97f3bd12-05ce-40ee-bcb9-ec3cca009fe4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:59.466013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-97f3bd12-05ce-40ee-bcb9-ec3cca009fe4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:59.480666 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8ea98398-e0f5-4b33-aa80-19fb0dfb5405 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:05:59.491551 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8ea98398-e0f5-4b33-aa80-19fb0dfb5405 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/c876a631-1a8a-476d-8627-96aadf865337" status: 200 len: 1506 microversion: 2.1 time: 1.388338 Jul 25 13:05:59.510091 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2344/4782] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:58 2022] GET /compute/v2.1/servers/c876a631-1a8a-476d-8627-96aadf865337 => generated 1506 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:05:59.520351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-14e249d4-2b67-42bb-b4d7-c7fd6de2d74b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:05:59.521226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-14e249d4-2b67-42bb-b4d7-c7fd6de2d74b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:05:59.529243 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14e249d4-2b67-42bb-b4d7-c7fd6de2d74b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:59.534592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14e249d4-2b67-42bb-b4d7-c7fd6de2d74b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:05:59.535704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14e249d4-2b67-42bb-b4d7-c7fd6de2d74b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:05:59.536318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14e249d4-2b67-42bb-b4d7-c7fd6de2d74b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:00.640447 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-14e249d4-2b67-42bb-b4d7-c7fd6de2d74b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:00.664764 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-14e249d4-2b67-42bb-b4d7-c7fd6de2d74b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1662 microversion: 2.1 time: 1.149447 Jul 25 13:06:00.667860 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2345/4783] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:59 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1662 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:00.688732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dd4accdf-3587-4c79-96f7-8a33193873eb tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:00.689675 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dd4accdf-3587-4c79-96f7-8a33193873eb tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: c876a631-1a8a-476d-8627-96aadf865337] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:00.692601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-97f3bd12-05ce-40ee-bcb9-ec3cca009fe4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:00.704143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dd4accdf-3587-4c79-96f7-8a33193873eb tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:00.704947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dd4accdf-3587-4c79-96f7-8a33193873eb tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:00.707494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dd4accdf-3587-4c79-96f7-8a33193873eb tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:00.709451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dd4accdf-3587-4c79-96f7-8a33193873eb tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:00.719308 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-97f3bd12-05ce-40ee-bcb9-ec3cca009fe4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885" status: 200 len: 1309 microversion: 2.1 time: 1.297427 Jul 25 13:06:00.728192 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2439/4784] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:05:59 2022] GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 => generated 1309 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:00.761538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-756ebf4e-b8ee-407d-b841-3b29da173371 req-61e36aea-78bb-4d85-9dd0-e59378a384c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885", "tag": "dbd358de-1cec-4153-926f-cace9fc21096"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:00.764686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dd4accdf-3587-4c79-96f7-8a33193873eb tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: c876a631-1a8a-476d-8627-96aadf865337] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:06:00.792898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-756ebf4e-b8ee-407d-b841-3b29da173371 req-61e36aea-78bb-4d85-9dd0-e59378a384c7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:00.793467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-756ebf4e-b8ee-407d-b841-3b29da173371 req-61e36aea-78bb-4d85-9dd0-e59378a384c7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:00.809510 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-756ebf4e-b8ee-407d-b841-3b29da173371 req-61e36aea-78bb-4d85-9dd0-e59378a384c7 service nova] Creating event network-changed:dbd358de-1cec-4153-926f-cace9fc21096 for instance e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 on n-h1-848886-15 Jul 25 13:06:00.836848 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-756ebf4e-b8ee-407d-b841-3b29da173371 req-61e36aea-78bb-4d85-9dd0-e59378a384c7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104181 Jul 25 13:06:00.837940 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2440/4785] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:00.962963 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dd4accdf-3587-4c79-96f7-8a33193873eb tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c876a631-1a8a-476d-8627-96aadf865337" status: 204 len: 0 microversion: 2.1 time: 0.293235 Jul 25 13:06:00.964402 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2346/4786] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:06:00 2022] DELETE /compute/v2.1/servers/c876a631-1a8a-476d-8627-96aadf865337 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:06:00.973597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e0078383-0e3a-4b02-9bc1-de2a37ff9422 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:00.974464 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e0078383-0e3a-4b02-9bc1-de2a37ff9422 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 9dd0d352-d214-4127-b3a7-db71ae5c162d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:00.983496 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0078383-0e3a-4b02-9bc1-de2a37ff9422 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:00.997080 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0078383-0e3a-4b02-9bc1-de2a37ff9422 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:00.998200 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0078383-0e3a-4b02-9bc1-de2a37ff9422 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:00.998765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0078383-0e3a-4b02-9bc1-de2a37ff9422 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:01.062805 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e0078383-0e3a-4b02-9bc1-de2a37ff9422 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 9dd0d352-d214-4127-b3a7-db71ae5c162d] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:06:01.325336 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e0078383-0e3a-4b02-9bc1-de2a37ff9422 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d" status: 204 len: 0 microversion: 2.1 time: 0.355618 Jul 25 13:06:01.327452 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2441/4787] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:06:00 2022] DELETE /compute/v2.1/servers/9dd0d352-d214-4127-b3a7-db71ae5c162d => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:06:01.575334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-19ae09e5-2371-4169-a79c-6256af098748 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1452950121", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "f8dd4848-5b5d-46d0-a206-788b64fd9152"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:01.686713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-19ae09e5-2371-4169-a79c-6256af098748 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] validate_networks() for [('f8dd4848-5b5d-46d0-a206-788b64fd9152', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:06:01.690760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-373638e4-9c30-4272-97cb-3a8fa21abd5a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:01.691480 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-373638e4-9c30-4272-97cb-3a8fa21abd5a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:01.705131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-373638e4-9c30-4272-97cb-3a8fa21abd5a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:01.705822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-373638e4-9c30-4272-97cb-3a8fa21abd5a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:01.706480 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-373638e4-9c30-4272-97cb-3a8fa21abd5a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:01.706919 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-373638e4-9c30-4272-97cb-3a8fa21abd5a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:01.751799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:02.182301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-373638e4-9c30-4272-97cb-3a8fa21abd5a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:02.193038 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-373638e4-9c30-4272-97cb-3a8fa21abd5a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1662 microversion: 2.1 time: 0.508089 Jul 25 13:06:02.213869 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2442/4788] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:01 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1662 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:02.233181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8d218768-6400-45cc-ac60-1e76a1741173 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:02.234347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8d218768-6400-45cc-ac60-1e76a1741173 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:02.246625 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d218768-6400-45cc-ac60-1e76a1741173 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:02.250995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d218768-6400-45cc-ac60-1e76a1741173 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:02.252241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d218768-6400-45cc-ac60-1e76a1741173 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:02.257327 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8d218768-6400-45cc-ac60-1e76a1741173 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:03.164642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:03.490137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8d218768-6400-45cc-ac60-1e76a1741173 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:03.515678 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8d218768-6400-45cc-ac60-1e76a1741173 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885" status: 200 len: 1309 microversion: 2.1 time: 1.299708 Jul 25 13:06:03.531728 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2443/4789] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:02 2022] GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 => generated 1309 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:03.537722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-07d074a5-a5eb-486f-a4ed-0e4fda71e39c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Action: 'create', calling method: .version_select at 0x7efcf9d35dc0>, body: {"keypair": {"name": "tempest-keypair-2074184316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+TDW+10blfIYYGRfEQS58UNI2pNYFbArHx0053jTMXCf6V5xfpKfD0LZqEwFXlmVVvK8qafaqYPvYGBijfo6aThNIUihFc1o5XBR8s+B03c+XmfynZ81+TnFZk6fRZwQ=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:03.561923 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-07d074a5-a5eb-486f-a4ed-0e4fda71e39c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Getting quotas for project f791ac394f9f4b8d99d2f48f7d04eae9. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:06:03.571131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-07d074a5-a5eb-486f-a4ed-0e4fda71e39c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Getting quotas for user 72f34c080e4a4024a38660e8af252a29 and project f791ac394f9f4b8d99d2f48f7d04eae9. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:06:03.607951 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-07d074a5-a5eb-486f-a4ed-0e4fda71e39c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074878 Jul 25 13:06:03.608689 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2444/4790] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:06:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:03.621127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6710a6b0-8875-4b0e-90a3-0968dab9ab89 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:03.622670 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6710a6b0-8875-4b0e-90a3-0968dab9ab89 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:03.630815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6710a6b0-8875-4b0e-90a3-0968dab9ab89 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:03.631871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-19ae09e5-2371-4169-a79c-6256af098748 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:06:03.632368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6710a6b0-8875-4b0e-90a3-0968dab9ab89 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:03.633154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6710a6b0-8875-4b0e-90a3-0968dab9ab89 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:03.634202 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6710a6b0-8875-4b0e-90a3-0968dab9ab89 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:03.634928 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-19ae09e5-2371-4169-a79c-6256af098748 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:06:03.635805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-19ae09e5-2371-4169-a79c-6256af098748 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:06:03.636492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-19ae09e5-2371-4169-a79c-6256af098748 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:06:03.637179 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-19ae09e5-2371-4169-a79c-6256af098748 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:06:03.658727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19ae09e5-2371-4169-a79c-6256af098748 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:03.659210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19ae09e5-2371-4169-a79c-6256af098748 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:03.660177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19ae09e5-2371-4169-a79c-6256af098748 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:03.660637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19ae09e5-2371-4169-a79c-6256af098748 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:03.712234 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-19ae09e5-2371-4169-a79c-6256af098748 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Getting quotas for project 21e13193378b494e847f9812268749d9. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:06:03.719090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-19ae09e5-2371-4169-a79c-6256af098748 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Getting quotas for user 390bc47d040a4435acf81010b5532f79 and project 21e13193378b494e847f9812268749d9. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:06:03.745798 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-19ae09e5-2371-4169-a79c-6256af098748 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Going to run 2 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:06:03.748923 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-19ae09e5-2371-4169-a79c-6256af098748 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 20fc7977-10be-4f70-8d94-31b38bf61fee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:06:03.790111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-19ae09e5-2371-4169-a79c-6256af098748 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: a622522d-8862-4aab-a007-9d0edc692586] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=20fc7977-10be-4f70-8d94-31b38bf61fee,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:06:03.916558 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-19ae09e5-2371-4169-a79c-6256af098748 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.346193 Jul 25 13:06:03.918036 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2347/4791] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:06:01 2022] POST /compute/v2.1/servers => generated 32 bytes in 2348 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 25 13:06:03.929367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0100f06c-bb76-4589-bb96-a5be07e003a5 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:04.002538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0100f06c-bb76-4589-bb96-a5be07e003a5 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:04.004166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0100f06c-bb76-4589-bb96-a5be07e003a5 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Searching by: {'deleted': False, 'project_id': '21e13193378b494e847f9812268749d9'} {{(pid=125883) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:06:04.054240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0100f06c-bb76-4589-bb96-a5be07e003a5 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:04.054804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0100f06c-bb76-4589-bb96-a5be07e003a5 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:04.055714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0100f06c-bb76-4589-bb96-a5be07e003a5 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:04.056182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0100f06c-bb76-4589-bb96-a5be07e003a5 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:04.119335 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.multi_cell_list [None req-0100f06c-bb76-4589-bb96-a5be07e003a5 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=125883) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:06:04.161875 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0100f06c-bb76-4589-bb96-a5be07e003a5 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.237719 Jul 25 13:06:04.173602 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2348/4792] 10.222.0.49 () {58 vars in 1125 bytes} [Mon Jul 25 13:06:03 2022] GET /compute/v2.1/servers => generated 1333 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:04.179613 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-36bbbf84-1fe3-428f-b604-b7ced0e8de5c tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:04.180434 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-36bbbf84-1fe3-428f-b604-b7ced0e8de5c tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: a622522d-8862-4aab-a007-9d0edc692586] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:04.259735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6710a6b0-8875-4b0e-90a3-0968dab9ab89 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:04.284805 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6710a6b0-8875-4b0e-90a3-0968dab9ab89 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1666 microversion: 2.1 time: 0.665835 Jul 25 13:06:04.288300 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2445/4793] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:03 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1666 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:04.374206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-36bbbf84-1fe3-428f-b604-b7ced0e8de5c tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:04.382103 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-36bbbf84-1fe3-428f-b604-b7ced0e8de5c tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586" status: 200 len: 1218 microversion: 2.1 time: 0.206959 Jul 25 13:06:04.382707 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2349/4794] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:04 2022] GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586 => generated 1218 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:04.537639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0b8e906c-c5f2-418e-9bf4-e7359d300bf5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:04.538400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0b8e906c-c5f2-418e-9bf4-e7359d300bf5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:04.548867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b8e906c-c5f2-418e-9bf4-e7359d300bf5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:04.550846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b8e906c-c5f2-418e-9bf4-e7359d300bf5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:04.551675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b8e906c-c5f2-418e-9bf4-e7359d300bf5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:04.552120 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b8e906c-c5f2-418e-9bf4-e7359d300bf5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:05.403266 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-15da87ff-3d0b-4bb5-b11f-62c42be2b5d2 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:05.403898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-15da87ff-3d0b-4bb5-b11f-62c42be2b5d2 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: a622522d-8862-4aab-a007-9d0edc692586] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:05.416299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15da87ff-3d0b-4bb5-b11f-62c42be2b5d2 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:05.416767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15da87ff-3d0b-4bb5-b11f-62c42be2b5d2 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:05.417566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15da87ff-3d0b-4bb5-b11f-62c42be2b5d2 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:05.418047 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15da87ff-3d0b-4bb5-b11f-62c42be2b5d2 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:05.782500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0b8e906c-c5f2-418e-9bf4-e7359d300bf5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:05.803517 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0b8e906c-c5f2-418e-9bf4-e7359d300bf5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885" status: 200 len: 1309 microversion: 2.1 time: 1.266802 Jul 25 13:06:05.807943 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2446/4795] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:04 2022] GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 => generated 1309 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:05.865809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-15da87ff-3d0b-4bb5-b11f-62c42be2b5d2 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:05.874455 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-15da87ff-3d0b-4bb5-b11f-62c42be2b5d2 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586" status: 200 len: 1222 microversion: 2.1 time: 0.474942 Jul 25 13:06:05.880852 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2350/4796] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:05 2022] GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586 => generated 1222 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:05.912562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-d81c096a-707c-43e8-af18-992ef2e66a02 req-2d27a8f9-8b49-43fe-88eb-89e827ff04d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c876a631-1a8a-476d-8627-96aadf865337", "name": "network-vif-deleted", "tag": "d6fe26e5-9a74-48c7-84da-d769003f1bec"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:05.926032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d81c096a-707c-43e8-af18-992ef2e66a02 req-2d27a8f9-8b49-43fe-88eb-89e827ff04d9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:05.937026 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d81c096a-707c-43e8-af18-992ef2e66a02 req-2d27a8f9-8b49-43fe-88eb-89e827ff04d9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:05.957692 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-d81c096a-707c-43e8-af18-992ef2e66a02 req-2d27a8f9-8b49-43fe-88eb-89e827ff04d9 service nova] Creating event network-vif-deleted:d6fe26e5-9a74-48c7-84da-d769003f1bec for instance c876a631-1a8a-476d-8627-96aadf865337 on n-h2-848886-15 Jul 25 13:06:05.989874 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-d81c096a-707c-43e8-af18-992ef2e66a02 req-2d27a8f9-8b49-43fe-88eb-89e827ff04d9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075199 Jul 25 13:06:05.991112 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2447/4797] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:06:06.831106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e1570284-ab09-4d8e-a863-0893b0c6a01e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:06.831719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e1570284-ab09-4d8e-a863-0893b0c6a01e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:06.835643 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:06.843804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1570284-ab09-4d8e-a863-0893b0c6a01e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:06.844285 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1570284-ab09-4d8e-a863-0893b0c6a01e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:06.845093 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1570284-ab09-4d8e-a863-0893b0c6a01e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:06.854230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1570284-ab09-4d8e-a863-0893b0c6a01e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:06.903115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dfeb539b-4aeb-4858-a528-138b3c3348bb tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:06.905068 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dfeb539b-4aeb-4858-a528-138b3c3348bb tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: a622522d-8862-4aab-a007-9d0edc692586] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:06.914744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:07.020105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dfeb539b-4aeb-4858-a528-138b3c3348bb tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:07.020105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dfeb539b-4aeb-4858-a528-138b3c3348bb tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:07.020105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dfeb539b-4aeb-4858-a528-138b3c3348bb tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:07.020105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dfeb539b-4aeb-4858-a528-138b3c3348bb tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:07.599908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dfeb539b-4aeb-4858-a528-138b3c3348bb tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:07.621566 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dfeb539b-4aeb-4858-a528-138b3c3348bb tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586" status: 200 len: 1278 microversion: 2.1 time: 0.724742 Jul 25 13:06:07.622823 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2448/4798] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:06 2022] GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586 => generated 1278 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:06:08.101981 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-d4a03a35-aa76-4dc2-8a15-9c7b93a90a66 req-3c94a095-3e3a-47c7-801f-3aaef0f617a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dd0d352-d214-4127-b3a7-db71ae5c162d", "name": "network-vif-deleted", "tag": "adfa66e4-ad90-4e2a-858b-4fb2ede116e4"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:08.133505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e1570284-ab09-4d8e-a863-0893b0c6a01e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:08.135151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d4a03a35-aa76-4dc2-8a15-9c7b93a90a66 req-3c94a095-3e3a-47c7-801f-3aaef0f617a2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:08.135708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d4a03a35-aa76-4dc2-8a15-9c7b93a90a66 req-3c94a095-3e3a-47c7-801f-3aaef0f617a2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:08.151890 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e1570284-ab09-4d8e-a863-0893b0c6a01e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885" status: 200 len: 1309 microversion: 2.1 time: 1.318208 Jul 25 13:06:08.156483 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2351/4799] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:06 2022] GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 => generated 1309 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:08.181186 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-d4a03a35-aa76-4dc2-8a15-9c7b93a90a66 req-3c94a095-3e3a-47c7-801f-3aaef0f617a2 service nova] Creating event network-vif-deleted:adfa66e4-ad90-4e2a-858b-4fb2ede116e4 for instance 9dd0d352-d214-4127-b3a7-db71ae5c162d on n-h1-848886-15 Jul 25 13:06:08.209798 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-d4a03a35-aa76-4dc2-8a15-9c7b93a90a66 req-3c94a095-3e3a-47c7-801f-3aaef0f617a2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111559 Jul 25 13:06:08.220791 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2449/4800] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:08.649701 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-366d6b67-d324-4bb1-9d01-58c7d88d746c tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:08.650726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-366d6b67-d324-4bb1-9d01-58c7d88d746c tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: a622522d-8862-4aab-a007-9d0edc692586] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:08.663063 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-366d6b67-d324-4bb1-9d01-58c7d88d746c tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:08.666089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-366d6b67-d324-4bb1-9d01-58c7d88d746c tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:08.670715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-366d6b67-d324-4bb1-9d01-58c7d88d746c tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:08.671984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-366d6b67-d324-4bb1-9d01-58c7d88d746c tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:08.906662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-366d6b67-d324-4bb1-9d01-58c7d88d746c tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:08.920869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:08.926075 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-366d6b67-d324-4bb1-9d01-58c7d88d746c tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586" status: 200 len: 1276 microversion: 2.1 time: 0.281727 Jul 25 13:06:08.931032 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2352/4801] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:08 2022] GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586 => generated 1276 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:09.178700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-97b76392-29f7-43cf-85e9-1b56e469615a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:09.180916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-97b76392-29f7-43cf-85e9-1b56e469615a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:09.216921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-97b76392-29f7-43cf-85e9-1b56e469615a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:09.217584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-97b76392-29f7-43cf-85e9-1b56e469615a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:09.218223 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-97b76392-29f7-43cf-85e9-1b56e469615a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:09.218665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-97b76392-29f7-43cf-85e9-1b56e469615a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:09.778827 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-97b76392-29f7-43cf-85e9-1b56e469615a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:09.810636 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-97b76392-29f7-43cf-85e9-1b56e469615a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885" status: 200 len: 1309 microversion: 2.1 time: 0.640272 Jul 25 13:06:09.824369 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2450/4802] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:09 2022] GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 => generated 1309 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:09.951754 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a150249d-f307-4bb6-803f-9041bcb540f3 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:09.952696 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a150249d-f307-4bb6-803f-9041bcb540f3 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: a622522d-8862-4aab-a007-9d0edc692586] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:09.968298 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a150249d-f307-4bb6-803f-9041bcb540f3 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:09.971485 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a150249d-f307-4bb6-803f-9041bcb540f3 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:09.972606 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a150249d-f307-4bb6-803f-9041bcb540f3 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:09.973122 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a150249d-f307-4bb6-803f-9041bcb540f3 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:10.162591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a150249d-f307-4bb6-803f-9041bcb540f3 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:10.170739 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a150249d-f307-4bb6-803f-9041bcb540f3 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586" status: 200 len: 1276 microversion: 2.1 time: 0.222733 Jul 25 13:06:10.178202 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2353/4803] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:09 2022] GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586 => generated 1276 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:10.832283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1c23d195-d0df-41b0-95f9-1f134836cec9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:10.832927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1c23d195-d0df-41b0-95f9-1f134836cec9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:10.852954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1c23d195-d0df-41b0-95f9-1f134836cec9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:10.853677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1c23d195-d0df-41b0-95f9-1f134836cec9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:10.856976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1c23d195-d0df-41b0-95f9-1f134836cec9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:10.857457 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1c23d195-d0df-41b0-95f9-1f134836cec9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:10.996922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-92965db5-5a16-4bcb-a743-180300aaa9dc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-255644850", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "92e1a236-8e90-4405-911c-7d489358890a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2e9a011a-2cfb-4a86-9ca1-b23997eebbe8"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:11.166333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-92965db5-5a16-4bcb-a743-180300aaa9dc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] validate_networks() for [('2e9a011a-2cfb-4a86-9ca1-b23997eebbe8', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:06:12.283541 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1c23d195-d0df-41b0-95f9-1f134836cec9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:12.292921 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1c23d195-d0df-41b0-95f9-1f134836cec9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885" status: 200 len: 1309 microversion: 2.1 time: 1.464504 Jul 25 13:06:12.313869 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2451/4804] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:10 2022] GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 => generated 1309 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:12.313869 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9e187260-a422-43df-8944-9691e5760168 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:12.323398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9e187260-a422-43df-8944-9691e5760168 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: a622522d-8862-4aab-a007-9d0edc692586] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:12.339163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e187260-a422-43df-8944-9691e5760168 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:12.342310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e187260-a422-43df-8944-9691e5760168 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:12.346461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e187260-a422-43df-8944-9691e5760168 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:12.347365 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e187260-a422-43df-8944-9691e5760168 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:12.587563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9e187260-a422-43df-8944-9691e5760168 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:12.599294 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9e187260-a422-43df-8944-9691e5760168 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586" status: 200 len: 1276 microversion: 2.1 time: 0.294727 Jul 25 13:06:12.601144 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2452/4805] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:12 2022] GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586 => generated 1276 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:12.607457 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-7dd56dd5-1e5e-48e3-89be-a2e9c9b7e9ad req-26e35f2a-060d-4575-b264-87c644aa0582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885", "name": "network-vif-plugged", "status": "completed", "tag": "dbd358de-1cec-4153-926f-cace9fc21096"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:12.620804 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-7dd56dd5-1e5e-48e3-89be-a2e9c9b7e9ad req-26e35f2a-060d-4575-b264-87c644aa0582 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:12.622086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-7dd56dd5-1e5e-48e3-89be-a2e9c9b7e9ad req-26e35f2a-060d-4575-b264-87c644aa0582 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:12.642751 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-7dd56dd5-1e5e-48e3-89be-a2e9c9b7e9ad req-26e35f2a-060d-4575-b264-87c644aa0582 service nova] Creating event network-vif-plugged:dbd358de-1cec-4153-926f-cace9fc21096 for instance e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 on n-h1-848886-15 Jul 25 13:06:12.650354 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-7dd56dd5-1e5e-48e3-89be-a2e9c9b7e9ad req-26e35f2a-060d-4575-b264-87c644aa0582 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047736 Jul 25 13:06:12.652518 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2453/4806] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:13.017669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d74fab96-cfaf-4371-840d-3ef6d4802b89 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1540293789", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "7deb38f6-d536-4fbf-b2dc-86b0a0eb995e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-455498142", "security_groups": [{"name": "tempest-secgroup-smoke-969394022"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:13.585067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=12 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:13.647505 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-d74fab96-cfaf-4371-840d-3ef6d4802b89 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] validate_networks() for [('7deb38f6-d536-4fbf-b2dc-86b0a0eb995e', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:06:14.071443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:14.381852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=8 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:14.438994 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-92965db5-5a16-4bcb-a743-180300aaa9dc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:06:14.439844 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-92965db5-5a16-4bcb-a743-180300aaa9dc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:06:14.440894 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-92965db5-5a16-4bcb-a743-180300aaa9dc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:06:14.441813 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-92965db5-5a16-4bcb-a743-180300aaa9dc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:06:14.442489 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-92965db5-5a16-4bcb-a743-180300aaa9dc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:06:14.460674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92965db5-5a16-4bcb-a743-180300aaa9dc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:14.465538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92965db5-5a16-4bcb-a743-180300aaa9dc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:14.466851 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92965db5-5a16-4bcb-a743-180300aaa9dc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:14.468615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92965db5-5a16-4bcb-a743-180300aaa9dc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:14.503908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-92965db5-5a16-4bcb-a743-180300aaa9dc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Getting quotas for project b2fbd681752c41d0a24a9cf34ebc8389. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:06:14.513955 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-92965db5-5a16-4bcb-a743-180300aaa9dc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Getting quotas for user 9face2aaa9df430cb5d361c6e1fdf242 and project b2fbd681752c41d0a24a9cf34ebc8389. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:06:14.646380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-92965db5-5a16-4bcb-a743-180300aaa9dc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:06:14.649124 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-92965db5-5a16-4bcb-a743-180300aaa9dc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='92e1a236-8e90-4405-911c-7d489358890a',volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:06:14.919960 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-92965db5-5a16-4bcb-a743-180300aaa9dc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.926604 Jul 25 13:06:14.930661 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2354/4807] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:06:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 13:06:14.960242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ded4546e-303a-42e6-b852-b924a004d343 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:14.962072 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ded4546e-303a-42e6-b852-b924a004d343 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:14.976520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ded4546e-303a-42e6-b852-b924a004d343 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:14.977025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ded4546e-303a-42e6-b852-b924a004d343 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:14.977917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ded4546e-303a-42e6-b852-b924a004d343 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:14.978372 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ded4546e-303a-42e6-b852-b924a004d343 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:16.012245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ded4546e-303a-42e6-b852-b924a004d343 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:16.031578 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ded4546e-303a-42e6-b852-b924a004d343 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885" status: 200 len: 1490 microversion: 2.1 time: 1.099053 Jul 25 13:06:16.032435 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2355/4808] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:14 2022] GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 => generated 1490 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:16.051031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5d1ff354-d38a-4278-94d1-58d207694284 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:16.051980 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5d1ff354-d38a-4278-94d1-58d207694284 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: a622522d-8862-4aab-a007-9d0edc692586] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:16.070691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d1ff354-d38a-4278-94d1-58d207694284 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:16.082639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d1ff354-d38a-4278-94d1-58d207694284 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:16.083611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d1ff354-d38a-4278-94d1-58d207694284 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:16.084407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d1ff354-d38a-4278-94d1-58d207694284 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:16.271329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d74fab96-cfaf-4371-840d-3ef6d4802b89 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:06:16.272392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d74fab96-cfaf-4371-840d-3ef6d4802b89 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:06:16.273503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d74fab96-cfaf-4371-840d-3ef6d4802b89 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:06:16.274223 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d74fab96-cfaf-4371-840d-3ef6d4802b89 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:06:16.274780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-d74fab96-cfaf-4371-840d-3ef6d4802b89 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:06:16.297521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d74fab96-cfaf-4371-840d-3ef6d4802b89 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:16.298011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d74fab96-cfaf-4371-840d-3ef6d4802b89 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:16.301404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d74fab96-cfaf-4371-840d-3ef6d4802b89 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:16.303430 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d74fab96-cfaf-4371-840d-3ef6d4802b89 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:16.379944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-d74fab96-cfaf-4371-840d-3ef6d4802b89 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Getting quotas for project c0d891a772834e43bdfcbde778a90498. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:06:16.429504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-d74fab96-cfaf-4371-840d-3ef6d4802b89 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Getting quotas for user 4d6e2ae351744e0ab1f153d629e4f0e7 and project c0d891a772834e43bdfcbde778a90498. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:06:16.461970 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5d1ff354-d38a-4278-94d1-58d207694284 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:16.480419 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5d1ff354-d38a-4278-94d1-58d207694284 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586" status: 200 len: 1318 microversion: 2.1 time: 0.446628 Jul 25 13:06:16.481187 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2356/4809] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:16 2022] GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586 => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:16.487832 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d74fab96-cfaf-4371-840d-3ef6d4802b89 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:06:16.495610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d74fab96-cfaf-4371-840d-3ef6d4802b89 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:06:16.511737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-316b9e5d-8fff-4050-8947-5e858e51d7f8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-348876140", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1395e55-cd66-4325-bef1-b570c194020a"}], "security_groups": [{"name": "tempest-securitygroup--2028296814"}], "key_name": "tempest-keypair-2074184316", "user_data": "}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:16.610338 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d74fab96-cfaf-4371-840d-3ef6d4802b89 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.597767 Jul 25 13:06:16.616317 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2454/4810] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:06:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 3605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 13:06:16.623379 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6db13295-40dd-4674-a3a0-849f6bede50d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:16.624231 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6db13295-40dd-4674-a3a0-849f6bede50d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:16.641004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6db13295-40dd-4674-a3a0-849f6bede50d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:16.641728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6db13295-40dd-4674-a3a0-849f6bede50d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:16.643583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6db13295-40dd-4674-a3a0-849f6bede50d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:16.644183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6db13295-40dd-4674-a3a0-849f6bede50d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:16.811067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-316b9e5d-8fff-4050-8947-5e858e51d7f8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] validate_networks() for [('c1395e55-cd66-4325-bef1-b570c194020a', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:06:16.900922 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6db13295-40dd-4674-a3a0-849f6bede50d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:16.909932 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6db13295-40dd-4674-a3a0-849f6bede50d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1098 microversion: 2.1 time: 0.290642 Jul 25 13:06:16.930550 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2455/4811] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:16 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1098 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:16.946614 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-beb4caec-94ab-4159-9d1c-4d3abfdc33b6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1629974181", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "41e863a3-713c-4d35-a204-58098a16a6e3"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:17.076273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-beb4caec-94ab-4159-9d1c-4d3abfdc33b6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] validate_networks() for [('41e863a3-713c-4d35-a204-58098a16a6e3', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:06:19.395471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-316b9e5d-8fff-4050-8947-5e858e51d7f8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:06:19.396474 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-316b9e5d-8fff-4050-8947-5e858e51d7f8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:06:19.397060 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-316b9e5d-8fff-4050-8947-5e858e51d7f8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:06:19.397800 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-316b9e5d-8fff-4050-8947-5e858e51d7f8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:06:19.398448 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-316b9e5d-8fff-4050-8947-5e858e51d7f8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:06:19.416310 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-316b9e5d-8fff-4050-8947-5e858e51d7f8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:19.421301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-316b9e5d-8fff-4050-8947-5e858e51d7f8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:19.423172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-beb4caec-94ab-4159-9d1c-4d3abfdc33b6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:06:19.423744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-beb4caec-94ab-4159-9d1c-4d3abfdc33b6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:06:19.424913 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-beb4caec-94ab-4159-9d1c-4d3abfdc33b6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:06:19.425425 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-316b9e5d-8fff-4050-8947-5e858e51d7f8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:19.425538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-beb4caec-94ab-4159-9d1c-4d3abfdc33b6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:06:19.426014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-beb4caec-94ab-4159-9d1c-4d3abfdc33b6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:06:19.430326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-316b9e5d-8fff-4050-8947-5e858e51d7f8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:19.447389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-beb4caec-94ab-4159-9d1c-4d3abfdc33b6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:19.447861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-beb4caec-94ab-4159-9d1c-4d3abfdc33b6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:19.451992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-beb4caec-94ab-4159-9d1c-4d3abfdc33b6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:19.457039 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-beb4caec-94ab-4159-9d1c-4d3abfdc33b6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:19.491763 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-316b9e5d-8fff-4050-8947-5e858e51d7f8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Getting quotas for project f791ac394f9f4b8d99d2f48f7d04eae9. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:06:19.501485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-beb4caec-94ab-4159-9d1c-4d3abfdc33b6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Getting quotas for project ebb6a07295234370aa1aa5067b8ee930. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:06:19.510137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-316b9e5d-8fff-4050-8947-5e858e51d7f8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Getting quotas for user 72f34c080e4a4024a38660e8af252a29 and project f791ac394f9f4b8d99d2f48f7d04eae9. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:06:19.524507 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-beb4caec-94ab-4159-9d1c-4d3abfdc33b6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Getting quotas for user 60d84eb7c45449cbad3141d9f363e693 and project ebb6a07295234370aa1aa5067b8ee930. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:06:19.534901 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-316b9e5d-8fff-4050-8947-5e858e51d7f8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:06:19.537550 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-316b9e5d-8fff-4050-8947-5e858e51d7f8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:06:19.561160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-beb4caec-94ab-4159-9d1c-4d3abfdc33b6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:06:19.571464 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-beb4caec-94ab-4159-9d1c-4d3abfdc33b6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 58447a88-a579-4078-9af4-d6b7379de5cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:06:19.641493 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-316b9e5d-8fff-4050-8947-5e858e51d7f8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.154926 Jul 25 13:06:19.642298 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2357/4812] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:06:16 2022] POST /compute/v2.1/servers => generated 409 bytes in 3161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:06:19.658313 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-36f8db64-b696-4973-ae13-f06b6926d76c req-f32005ce-38fe-4e45-b931-3e239464032b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20fc7977-10be-4f70-8d94-31b38bf61fee", "tag": "7d0be5d0-a71c-43c9-bfa6-fa0f42c5fc22"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:19.686445 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-beb4caec-94ab-4159-9d1c-4d3abfdc33b6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.743881 Jul 25 13:06:19.687520 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2456/4813] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:06:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:06:19.695452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7ffea3ee-e80a-4e58-8122-c4b0d7bc978d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:19.696893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7ffea3ee-e80a-4e58-8122-c4b0d7bc978d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:19.705059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ffea3ee-e80a-4e58-8122-c4b0d7bc978d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:19.705726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ffea3ee-e80a-4e58-8122-c4b0d7bc978d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:19.706745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ffea3ee-e80a-4e58-8122-c4b0d7bc978d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:19.707349 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ffea3ee-e80a-4e58-8122-c4b0d7bc978d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:19.718897 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-36f8db64-b696-4973-ae13-f06b6926d76c req-f32005ce-38fe-4e45-b931-3e239464032b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:19.719351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-36f8db64-b696-4973-ae13-f06b6926d76c req-f32005ce-38fe-4e45-b931-3e239464032b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:19.753584 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-36f8db64-b696-4973-ae13-f06b6926d76c req-f32005ce-38fe-4e45-b931-3e239464032b service nova] Creating event network-changed:7d0be5d0-a71c-43c9-bfa6-fa0f42c5fc22 for instance 20fc7977-10be-4f70-8d94-31b38bf61fee on n-h2-848886-15 Jul 25 13:06:19.761240 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-36f8db64-b696-4973-ae13-f06b6926d76c req-f32005ce-38fe-4e45-b931-3e239464032b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111781 Jul 25 13:06:19.765157 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2358/4814] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:19.773927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-566d1e3e-efe4-452b-8fe2-3620f2ae92ad tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:19.778818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-566d1e3e-efe4-452b-8fe2-3620f2ae92ad tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: a622522d-8862-4aab-a007-9d0edc692586] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:19.792656 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-566d1e3e-efe4-452b-8fe2-3620f2ae92ad tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:19.793240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-566d1e3e-efe4-452b-8fe2-3620f2ae92ad tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:19.798152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-566d1e3e-efe4-452b-8fe2-3620f2ae92ad tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:19.798759 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-566d1e3e-efe4-452b-8fe2-3620f2ae92ad tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:21.003108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7ffea3ee-e80a-4e58-8122-c4b0d7bc978d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:21.014709 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7ffea3ee-e80a-4e58-8122-c4b0d7bc978d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1324 microversion: 2.1 time: 1.325709 Jul 25 13:06:21.017082 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2457/4815] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:19 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1324 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:21.042946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b8fdef79-28b9-42ac-8f8c-92d4b5ac0e02 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:21.043723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b8fdef79-28b9-42ac-8f8c-92d4b5ac0e02 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:21.058903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8fdef79-28b9-42ac-8f8c-92d4b5ac0e02 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:21.059516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8fdef79-28b9-42ac-8f8c-92d4b5ac0e02 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:21.060498 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8fdef79-28b9-42ac-8f8c-92d4b5ac0e02 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:21.066891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8fdef79-28b9-42ac-8f8c-92d4b5ac0e02 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:21.336866 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b8fdef79-28b9-42ac-8f8c-92d4b5ac0e02 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:21.354336 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b8fdef79-28b9-42ac-8f8c-92d4b5ac0e02 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1172 microversion: 2.1 time: 0.313608 Jul 25 13:06:21.356358 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2458/4816] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:21 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1172 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:21.370989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-41b7999e-f997-4e11-aa8a-43461b2cedbf tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:21.371916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-41b7999e-f997-4e11-aa8a-43461b2cedbf tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:21.407867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-566d1e3e-efe4-452b-8fe2-3620f2ae92ad tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:21.424427 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-566d1e3e-efe4-452b-8fe2-3620f2ae92ad tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586" status: 200 len: 1318 microversion: 2.1 time: 1.657719 Jul 25 13:06:21.437909 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2359/4817] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:19 2022] GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586 => generated 1318 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:21.439994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-41b7999e-f997-4e11-aa8a-43461b2cedbf tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:21.441517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-41b7999e-f997-4e11-aa8a-43461b2cedbf tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:21.445767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-41b7999e-f997-4e11-aa8a-43461b2cedbf tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:21.451245 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-41b7999e-f997-4e11-aa8a-43461b2cedbf tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:21.478577 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c2f9277d-7b59-46f6-99ca-db04bc053ca5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:21.480678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c2f9277d-7b59-46f6-99ca-db04bc053ca5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 58447a88-a579-4078-9af4-d6b7379de5cf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:21.498350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2f9277d-7b59-46f6-99ca-db04bc053ca5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:21.504786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2f9277d-7b59-46f6-99ca-db04bc053ca5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:21.505536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2f9277d-7b59-46f6-99ca-db04bc053ca5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:21.506114 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2f9277d-7b59-46f6-99ca-db04bc053ca5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:21.707648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-41b7999e-f997-4e11-aa8a-43461b2cedbf tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:21.717584 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-41b7999e-f997-4e11-aa8a-43461b2cedbf tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1305 microversion: 2.1 time: 0.358724 Jul 25 13:06:21.730694 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2459/4818] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:21 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1305 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:22.001712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c2f9277d-7b59-46f6-99ca-db04bc053ca5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:22.012640 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c2f9277d-7b59-46f6-99ca-db04bc053ca5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf" status: 200 len: 1261 microversion: 2.1 time: 0.570587 Jul 25 13:06:22.015720 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2360/4819] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:21 2022] GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf => generated 1261 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:22.037381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ef09171f-7ee7-468c-a2b2-7ae8c7f9b4a9 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:22.038238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ef09171f-7ee7-468c-a2b2-7ae8c7f9b4a9 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:22.055937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef09171f-7ee7-468c-a2b2-7ae8c7f9b4a9 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:22.056563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef09171f-7ee7-468c-a2b2-7ae8c7f9b4a9 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:22.057455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef09171f-7ee7-468c-a2b2-7ae8c7f9b4a9 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:22.058032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef09171f-7ee7-468c-a2b2-7ae8c7f9b4a9 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:22.318560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ef09171f-7ee7-468c-a2b2-7ae8c7f9b4a9 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:22.332514 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ef09171f-7ee7-468c-a2b2-7ae8c7f9b4a9 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1324 microversion: 2.1 time: 0.297191 Jul 25 13:06:22.349484 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2460/4820] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:22 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1324 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:22.381219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-055da6b7-3bd3-48e4-bf8d-f2f9ed2a26a7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:22.382067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-055da6b7-3bd3-48e4-bf8d-f2f9ed2a26a7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:22.389373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-055da6b7-3bd3-48e4-bf8d-f2f9ed2a26a7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:22.390163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-055da6b7-3bd3-48e4-bf8d-f2f9ed2a26a7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:22.391052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-055da6b7-3bd3-48e4-bf8d-f2f9ed2a26a7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:22.391758 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-055da6b7-3bd3-48e4-bf8d-f2f9ed2a26a7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:22.445962 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-68b6c1ff-d88c-4712-9f6a-8a7c518ced66 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:22.447568 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-68b6c1ff-d88c-4712-9f6a-8a7c518ced66 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: a622522d-8862-4aab-a007-9d0edc692586] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:22.458202 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68b6c1ff-d88c-4712-9f6a-8a7c518ced66 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:22.459393 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68b6c1ff-d88c-4712-9f6a-8a7c518ced66 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:22.461504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68b6c1ff-d88c-4712-9f6a-8a7c518ced66 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:22.463001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68b6c1ff-d88c-4712-9f6a-8a7c518ced66 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:22.598164 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-055da6b7-3bd3-48e4-bf8d-f2f9ed2a26a7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:22.614604 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-055da6b7-3bd3-48e4-bf8d-f2f9ed2a26a7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1172 microversion: 2.1 time: 0.238126 Jul 25 13:06:22.628109 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2361/4821] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:22 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1172 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:22.754543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c09f43e5-be7d-4340-b211-a0ca10249691 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:22.756122 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c09f43e5-be7d-4340-b211-a0ca10249691 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:22.768647 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c09f43e5-be7d-4340-b211-a0ca10249691 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:22.769386 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c09f43e5-be7d-4340-b211-a0ca10249691 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:22.770428 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c09f43e5-be7d-4340-b211-a0ca10249691 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:22.771029 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c09f43e5-be7d-4340-b211-a0ca10249691 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:22.886662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c09f43e5-be7d-4340-b211-a0ca10249691 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:22.896929 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c09f43e5-be7d-4340-b211-a0ca10249691 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1303 microversion: 2.1 time: 0.146055 Jul 25 13:06:22.900634 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2362/4822] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:22 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1303 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:22.905611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-f6821cd6-b021-482f-9ef9-07b4d83786ec req-297ccb3e-8941-4648-a790-ef3d4651c3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a622522d-8862-4aab-a007-9d0edc692586", "tag": "71775d6b-3349-4215-846d-fafd1964c7fc"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:22.934326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-f6821cd6-b021-482f-9ef9-07b4d83786ec req-297ccb3e-8941-4648-a790-ef3d4651c3a0 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:22.935776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-f6821cd6-b021-482f-9ef9-07b4d83786ec req-297ccb3e-8941-4648-a790-ef3d4651c3a0 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:22.961449 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-f6821cd6-b021-482f-9ef9-07b4d83786ec req-297ccb3e-8941-4648-a790-ef3d4651c3a0 service nova] Creating event network-changed:71775d6b-3349-4215-846d-fafd1964c7fc for instance a622522d-8862-4aab-a007-9d0edc692586 on n-h1-848886-15 Jul 25 13:06:22.974848 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-f6821cd6-b021-482f-9ef9-07b4d83786ec req-297ccb3e-8941-4648-a790-ef3d4651c3a0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072646 Jul 25 13:06:22.976560 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2363/4823] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:23.011929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-68b6c1ff-d88c-4712-9f6a-8a7c518ced66 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:23.019877 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-68b6c1ff-d88c-4712-9f6a-8a7c518ced66 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586" status: 200 len: 1318 microversion: 2.1 time: 0.578975 Jul 25 13:06:23.020481 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2461/4824] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:22 2022] GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586 => generated 1318 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:06:23.039396 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b71434a8-843a-474b-a549-520c2fbadb8a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:23.040201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b71434a8-843a-474b-a549-520c2fbadb8a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 58447a88-a579-4078-9af4-d6b7379de5cf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:23.052797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b71434a8-843a-474b-a549-520c2fbadb8a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:23.053288 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b71434a8-843a-474b-a549-520c2fbadb8a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:23.054123 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b71434a8-843a-474b-a549-520c2fbadb8a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:23.054562 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b71434a8-843a-474b-a549-520c2fbadb8a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:23.357728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2b479ae9-147d-4f71-8435-77f3a6fd70a7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:23.358587 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2b479ae9-147d-4f71-8435-77f3a6fd70a7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:23.378669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2b479ae9-147d-4f71-8435-77f3a6fd70a7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:23.379337 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2b479ae9-147d-4f71-8435-77f3a6fd70a7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:23.380593 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2b479ae9-147d-4f71-8435-77f3a6fd70a7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:23.381469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2b479ae9-147d-4f71-8435-77f3a6fd70a7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:23.718566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b71434a8-843a-474b-a549-520c2fbadb8a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:23.734699 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b71434a8-843a-474b-a549-520c2fbadb8a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf" status: 200 len: 1267 microversion: 2.1 time: 0.699611 Jul 25 13:06:23.736999 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2364/4825] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:23 2022] GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf => generated 1267 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:23.746960 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bda790a5-15cc-4bf9-ba59-859444d17fc3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:23.747978 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bda790a5-15cc-4bf9-ba59-859444d17fc3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:23.756817 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bda790a5-15cc-4bf9-ba59-859444d17fc3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:23.758359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bda790a5-15cc-4bf9-ba59-859444d17fc3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:23.759680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bda790a5-15cc-4bf9-ba59-859444d17fc3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:23.760363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bda790a5-15cc-4bf9-ba59-859444d17fc3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:24.111852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2b479ae9-147d-4f71-8435-77f3a6fd70a7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:24.141171 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2b479ae9-147d-4f71-8435-77f3a6fd70a7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1324 microversion: 2.1 time: 0.788256 Jul 25 13:06:24.145451 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2462/4826] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:23 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1324 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:24.167949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e866b3f6-c8a3-4423-b8e4-89aaa7aa43ae tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:24.170684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e866b3f6-c8a3-4423-b8e4-89aaa7aa43ae tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:24.200441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e866b3f6-c8a3-4423-b8e4-89aaa7aa43ae tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:24.200862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e866b3f6-c8a3-4423-b8e4-89aaa7aa43ae tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:24.201662 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e866b3f6-c8a3-4423-b8e4-89aaa7aa43ae tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:24.202133 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e866b3f6-c8a3-4423-b8e4-89aaa7aa43ae tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:24.251548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:26.409632 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e866b3f6-c8a3-4423-b8e4-89aaa7aa43ae tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:26.427844 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bda790a5-15cc-4bf9-ba59-859444d17fc3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:26.431130 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e866b3f6-c8a3-4423-b8e4-89aaa7aa43ae tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1371 microversion: 2.1 time: 2.280305 Jul 25 13:06:26.433764 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2463/4827] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:24 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1371 bytes in 2285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:26.442777 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bda790a5-15cc-4bf9-ba59-859444d17fc3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1214 microversion: 2.1 time: 2.703633 Jul 25 13:06:26.443017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-449f470d-0db0-41c6-bfb3-b431b37c8411 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:26.443841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-449f470d-0db0-41c6-bfb3-b431b37c8411 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: a622522d-8862-4aab-a007-9d0edc692586] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:26.444957 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2365/4828] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:23 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1214 bytes in 2707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:26.454125 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-449f470d-0db0-41c6-bfb3-b431b37c8411 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:26.454830 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-449f470d-0db0-41c6-bfb3-b431b37c8411 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:26.456038 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-449f470d-0db0-41c6-bfb3-b431b37c8411 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:26.456906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-449f470d-0db0-41c6-bfb3-b431b37c8411 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:26.461543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-57ebd242-ffc4-4443-80b4-13d33487ad8f req-d2f49101-21bc-4e85-9c95-21e2439ba0e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20fc7977-10be-4f70-8d94-31b38bf61fee", "name": "network-vif-plugged", "status": "completed", "tag": "7d0be5d0-a71c-43c9-bfa6-fa0f42c5fc22"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:26.487460 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-57ebd242-ffc4-4443-80b4-13d33487ad8f req-d2f49101-21bc-4e85-9c95-21e2439ba0e2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:26.488215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-57ebd242-ffc4-4443-80b4-13d33487ad8f req-d2f49101-21bc-4e85-9c95-21e2439ba0e2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:26.518938 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-57ebd242-ffc4-4443-80b4-13d33487ad8f req-d2f49101-21bc-4e85-9c95-21e2439ba0e2 service nova] Creating event network-vif-plugged:7d0be5d0-a71c-43c9-bfa6-fa0f42c5fc22 for instance 20fc7977-10be-4f70-8d94-31b38bf61fee on n-h2-848886-15 Jul 25 13:06:26.531952 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-57ebd242-ffc4-4443-80b4-13d33487ad8f req-d2f49101-21bc-4e85-9c95-21e2439ba0e2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085129 Jul 25 13:06:26.534126 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2366/4829] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:26.546423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0268f387-9d58-4b85-ba5a-80170a8ab539 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:26.548892 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0268f387-9d58-4b85-ba5a-80170a8ab539 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 58447a88-a579-4078-9af4-d6b7379de5cf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:26.564467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0268f387-9d58-4b85-ba5a-80170a8ab539 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:26.566953 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0268f387-9d58-4b85-ba5a-80170a8ab539 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:26.568066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0268f387-9d58-4b85-ba5a-80170a8ab539 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:26.581794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0268f387-9d58-4b85-ba5a-80170a8ab539 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:27.262900 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0268f387-9d58-4b85-ba5a-80170a8ab539 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:27.278584 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0268f387-9d58-4b85-ba5a-80170a8ab539 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf" status: 200 len: 1309 microversion: 2.1 time: 0.742716 Jul 25 13:06:27.279472 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2367/4830] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:26 2022] GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf => generated 1309 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:27.284457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-598b721d-e7e7-4b9f-bbf3-a2d92c29e93e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:27.285076 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-598b721d-e7e7-4b9f-bbf3-a2d92c29e93e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:27.299618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-598b721d-e7e7-4b9f-bbf3-a2d92c29e93e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:27.300306 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-598b721d-e7e7-4b9f-bbf3-a2d92c29e93e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:27.301111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-598b721d-e7e7-4b9f-bbf3-a2d92c29e93e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:27.301552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-598b721d-e7e7-4b9f-bbf3-a2d92c29e93e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:27.352205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-449f470d-0db0-41c6-bfb3-b431b37c8411 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:27.366721 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-449f470d-0db0-41c6-bfb3-b431b37c8411 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586" status: 200 len: 1318 microversion: 2.1 time: 0.930942 Jul 25 13:06:27.368003 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2464/4831] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:26 2022] GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586 => generated 1318 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:27.372705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-fec02b2c-7d7e-4836-841a-1850bed973e1 req-1d004ab3-69bb-4050-883a-8d12c3a9a595 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3baaf3bb-a036-43d5-b1d0-799f44fb5ef3", "tag": "d22254f0-f882-4f44-966f-f95b96c6c9ff"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:27.386615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fec02b2c-7d7e-4836-841a-1850bed973e1 req-1d004ab3-69bb-4050-883a-8d12c3a9a595 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:27.387948 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fec02b2c-7d7e-4836-841a-1850bed973e1 req-1d004ab3-69bb-4050-883a-8d12c3a9a595 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:27.402685 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-fec02b2c-7d7e-4836-841a-1850bed973e1 req-1d004ab3-69bb-4050-883a-8d12c3a9a595 service nova] Creating event network-changed:d22254f0-f882-4f44-966f-f95b96c6c9ff for instance 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 on n-h1-848886-15 Jul 25 13:06:27.409381 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-fec02b2c-7d7e-4836-841a-1850bed973e1 req-1d004ab3-69bb-4050-883a-8d12c3a9a595 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039976 Jul 25 13:06:27.410628 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2465/4832] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:27.458347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-65280c0c-d773-456f-8445-0302134dc2d7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:27.459332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-65280c0c-d773-456f-8445-0302134dc2d7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:27.467680 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65280c0c-d773-456f-8445-0302134dc2d7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:27.468596 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65280c0c-d773-456f-8445-0302134dc2d7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:27.469564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65280c0c-d773-456f-8445-0302134dc2d7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:27.470214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65280c0c-d773-456f-8445-0302134dc2d7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:27.835746 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-598b721d-e7e7-4b9f-bbf3-a2d92c29e93e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:27.860330 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-598b721d-e7e7-4b9f-bbf3-a2d92c29e93e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1391 microversion: 2.1 time: 0.579341 Jul 25 13:06:27.862010 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2368/4833] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:27 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1391 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:27.871901 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1c1ca613-92f6-47f6-bdf5-7451b7ae852e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:27.879024 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1c1ca613-92f6-47f6-bdf5-7451b7ae852e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:27.899107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1c1ca613-92f6-47f6-bdf5-7451b7ae852e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:27.900349 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1c1ca613-92f6-47f6-bdf5-7451b7ae852e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:27.904102 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1c1ca613-92f6-47f6-bdf5-7451b7ae852e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:27.904756 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1c1ca613-92f6-47f6-bdf5-7451b7ae852e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:27.930974 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-65280c0c-d773-456f-8445-0302134dc2d7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:27.960816 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-65280c0c-d773-456f-8445-0302134dc2d7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1371 microversion: 2.1 time: 0.506638 Jul 25 13:06:27.961709 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2466/4834] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:27 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1371 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:06:28.303236 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aa60c60c-c079-4519-9a45-e2db3ccf9201 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:28.304606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-aa60c60c-c079-4519-9a45-e2db3ccf9201 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 58447a88-a579-4078-9af4-d6b7379de5cf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:28.324788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa60c60c-c079-4519-9a45-e2db3ccf9201 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:28.327162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa60c60c-c079-4519-9a45-e2db3ccf9201 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:28.332134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa60c60c-c079-4519-9a45-e2db3ccf9201 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:28.332928 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa60c60c-c079-4519-9a45-e2db3ccf9201 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:28.634427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1c1ca613-92f6-47f6-bdf5-7451b7ae852e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:28.648054 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1c1ca613-92f6-47f6-bdf5-7451b7ae852e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1202 microversion: 2.1 time: 0.782032 Jul 25 13:06:28.649494 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2369/4835] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:27 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1202 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:28.666429 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ef789ae8-cc04-4de4-93c8-777f24e55258 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:28.667561 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ef789ae8-cc04-4de4-93c8-777f24e55258 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: a622522d-8862-4aab-a007-9d0edc692586] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:28.674511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef789ae8-cc04-4de4-93c8-777f24e55258 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:28.675306 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef789ae8-cc04-4de4-93c8-777f24e55258 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:28.676572 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef789ae8-cc04-4de4-93c8-777f24e55258 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:28.677216 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ef789ae8-cc04-4de4-93c8-777f24e55258 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:28.714089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-aa60c60c-c079-4519-9a45-e2db3ccf9201 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:28.724053 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-aa60c60c-c079-4519-9a45-e2db3ccf9201 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf" status: 200 len: 1309 microversion: 2.1 time: 0.424694 Jul 25 13:06:28.729515 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2467/4836] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:28 2022] GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf => generated 1309 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:28.885238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-912af692-e173-4570-9e68-2a029b9584d1 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:28.886082 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-912af692-e173-4570-9e68-2a029b9584d1 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:28.898240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-912af692-e173-4570-9e68-2a029b9584d1 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:28.901113 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-912af692-e173-4570-9e68-2a029b9584d1 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:28.902143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-912af692-e173-4570-9e68-2a029b9584d1 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:28.904285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-912af692-e173-4570-9e68-2a029b9584d1 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:29.448625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:29.482354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:29.529166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=12 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:29.540151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ef789ae8-cc04-4de4-93c8-777f24e55258 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:29.546771 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=12 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:29.556817 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ef789ae8-cc04-4de4-93c8-777f24e55258 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586" status: 200 len: 1318 microversion: 2.1 time: 0.904228 Jul 25 13:06:29.558195 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2370/4837] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:28 2022] GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586 => generated 1318 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:29.578658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2e9ca0f4-772c-4b40-9c88-31252dc6de83 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:29.579520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2e9ca0f4-772c-4b40-9c88-31252dc6de83 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:29.596579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e9ca0f4-772c-4b40-9c88-31252dc6de83 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:29.597391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e9ca0f4-772c-4b40-9c88-31252dc6de83 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:29.598481 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e9ca0f4-772c-4b40-9c88-31252dc6de83 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:29.604940 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e9ca0f4-772c-4b40-9c88-31252dc6de83 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:29.682596 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-912af692-e173-4570-9e68-2a029b9584d1 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:29.692076 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-912af692-e173-4570-9e68-2a029b9584d1 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1391 microversion: 2.1 time: 0.810981 Jul 25 13:06:29.693165 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2468/4838] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:28 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1391 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:06:29.698066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-f7421084-371d-41a5-9a9c-acfaa3968169 req-7064154d-c5f8-4011-8b7a-16ce1694bba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a622522d-8862-4aab-a007-9d0edc692586", "name": "network-vif-plugged", "status": "completed", "tag": "71775d6b-3349-4215-846d-fafd1964c7fc"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:29.716667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f7421084-371d-41a5-9a9c-acfaa3968169 req-7064154d-c5f8-4011-8b7a-16ce1694bba1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:29.717927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f7421084-371d-41a5-9a9c-acfaa3968169 req-7064154d-c5f8-4011-8b7a-16ce1694bba1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:29.732179 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-f7421084-371d-41a5-9a9c-acfaa3968169 req-7064154d-c5f8-4011-8b7a-16ce1694bba1 service nova] Creating event network-vif-plugged:71775d6b-3349-4215-846d-fafd1964c7fc for instance a622522d-8862-4aab-a007-9d0edc692586 on n-h1-848886-15 Jul 25 13:06:29.738396 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-f7421084-371d-41a5-9a9c-acfaa3968169 req-7064154d-c5f8-4011-8b7a-16ce1694bba1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043291 Jul 25 13:06:29.739033 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2469/4839] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:29.747790 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-5f42f866-0139-4b41-b8de-b423e6ca9f38 req-f34ab1e7-8b40-4563-8d66-0101ab93084e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58447a88-a579-4078-9af4-d6b7379de5cf", "tag": "a79d04cd-d8f6-4ab1-ab81-2465b124b9dd"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:29.764207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5f42f866-0139-4b41-b8de-b423e6ca9f38 req-f34ab1e7-8b40-4563-8d66-0101ab93084e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:29.764207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5f42f866-0139-4b41-b8de-b423e6ca9f38 req-f34ab1e7-8b40-4563-8d66-0101ab93084e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:29.776764 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-5f42f866-0139-4b41-b8de-b423e6ca9f38 req-f34ab1e7-8b40-4563-8d66-0101ab93084e service nova] Creating event network-changed:a79d04cd-d8f6-4ab1-ab81-2465b124b9dd for instance 58447a88-a579-4078-9af4-d6b7379de5cf on n-h1-848886-15 Jul 25 13:06:29.783308 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-5f42f866-0139-4b41-b8de-b423e6ca9f38 req-f34ab1e7-8b40-4563-8d66-0101ab93084e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042102 Jul 25 13:06:29.785200 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2470/4840] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:29.792013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e6a41999-aacc-4432-82a3-b8842e8e0c4b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:29.793161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e6a41999-aacc-4432-82a3-b8842e8e0c4b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:29.802335 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e6a41999-aacc-4432-82a3-b8842e8e0c4b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:29.802798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e6a41999-aacc-4432-82a3-b8842e8e0c4b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:29.803912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e6a41999-aacc-4432-82a3-b8842e8e0c4b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:29.804354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e6a41999-aacc-4432-82a3-b8842e8e0c4b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:30.658322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2e9ca0f4-772c-4b40-9c88-31252dc6de83 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:30.666152 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2e9ca0f4-772c-4b40-9c88-31252dc6de83 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1371 microversion: 2.1 time: 1.106708 Jul 25 13:06:30.666747 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2371/4841] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:29 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1371 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:30.678426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9f43b247-a100-494a-91d5-d0d9fa69d440 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:30.678426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9f43b247-a100-494a-91d5-d0d9fa69d440 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 58447a88-a579-4078-9af4-d6b7379de5cf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:30.678426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9f43b247-a100-494a-91d5-d0d9fa69d440 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:30.678684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9f43b247-a100-494a-91d5-d0d9fa69d440 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:30.679428 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9f43b247-a100-494a-91d5-d0d9fa69d440 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:30.680076 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9f43b247-a100-494a-91d5-d0d9fa69d440 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:30.750608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e6a41999-aacc-4432-82a3-b8842e8e0c4b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:30.759012 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e6a41999-aacc-4432-82a3-b8842e8e0c4b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1202 microversion: 2.1 time: 0.972395 Jul 25 13:06:30.759609 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2471/4842] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:29 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1202 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:30.764422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-51761438-9df4-4ac0-9afc-6475f24259a7 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:30.765227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-51761438-9df4-4ac0-9afc-6475f24259a7 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: a622522d-8862-4aab-a007-9d0edc692586] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:30.771605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-51761438-9df4-4ac0-9afc-6475f24259a7 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:30.772072 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-51761438-9df4-4ac0-9afc-6475f24259a7 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:30.772857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-51761438-9df4-4ac0-9afc-6475f24259a7 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:30.773296 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-51761438-9df4-4ac0-9afc-6475f24259a7 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:31.357186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9f43b247-a100-494a-91d5-d0d9fa69d440 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:31.361963 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:31.369637 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9f43b247-a100-494a-91d5-d0d9fa69d440 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf" status: 200 len: 1309 microversion: 2.1 time: 0.701806 Jul 25 13:06:31.370573 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2372/4843] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:30 2022] GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf => generated 1309 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:31.375967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-16cfaa9b-08bc-4188-8844-8ba265085c31 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:31.376585 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-16cfaa9b-08bc-4188-8844-8ba265085c31 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:31.383117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16cfaa9b-08bc-4188-8844-8ba265085c31 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:31.383596 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16cfaa9b-08bc-4188-8844-8ba265085c31 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:31.384349 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16cfaa9b-08bc-4188-8844-8ba265085c31 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:31.384994 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16cfaa9b-08bc-4188-8844-8ba265085c31 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:31.416450 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-51761438-9df4-4ac0-9afc-6475f24259a7 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:31.426088 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-51761438-9df4-4ac0-9afc-6475f24259a7 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586" status: 200 len: 1318 microversion: 2.1 time: 0.665211 Jul 25 13:06:31.426689 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2472/4844] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:30 2022] GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586 => generated 1318 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:31.690290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7e7b88e8-54a1-4c72-94c0-38a01307d4eb tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:31.690918 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7e7b88e8-54a1-4c72-94c0-38a01307d4eb tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:31.699077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e7b88e8-54a1-4c72-94c0-38a01307d4eb tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:31.699553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e7b88e8-54a1-4c72-94c0-38a01307d4eb tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:31.700374 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e7b88e8-54a1-4c72-94c0-38a01307d4eb tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:31.700807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e7b88e8-54a1-4c72-94c0-38a01307d4eb tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:31.931629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-16cfaa9b-08bc-4188-8844-8ba265085c31 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:31.947256 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-16cfaa9b-08bc-4188-8844-8ba265085c31 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1391 microversion: 2.1 time: 0.575372 Jul 25 13:06:31.950416 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2373/4845] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:31 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1391 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:31.956838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-427c79d0-e14c-4333-9aa0-03a3ad65cd85 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:31.957811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-427c79d0-e14c-4333-9aa0-03a3ad65cd85 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:31.968370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-427c79d0-e14c-4333-9aa0-03a3ad65cd85 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:31.970232 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-427c79d0-e14c-4333-9aa0-03a3ad65cd85 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:31.971805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-427c79d0-e14c-4333-9aa0-03a3ad65cd85 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:31.972910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-427c79d0-e14c-4333-9aa0-03a3ad65cd85 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:32.152671 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7e7b88e8-54a1-4c72-94c0-38a01307d4eb tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:32.161245 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7e7b88e8-54a1-4c72-94c0-38a01307d4eb tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1371 microversion: 2.1 time: 0.475345 Jul 25 13:06:32.175143 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2473/4846] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:31 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1371 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:32.180880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-1c04aab3-cadf-457a-82fb-8f2055d879a1 req-dc87da87-0258-4c28-84c7-cf1876664f58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c5b9754-035f-4b86-888a-68aecbac2cee", "tag": "28882e01-e9b0-4de8-9520-5575425b9c64"}, {"name": "network-changed", "server_uuid": "f6cffb3b-3dc6-439e-9433-b9107bfccfcc", "tag": "adbcb40b-638c-4e4f-928f-2406ca66229f"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:32.193228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-1c04aab3-cadf-457a-82fb-8f2055d879a1 req-dc87da87-0258-4c28-84c7-cf1876664f58 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:32.194213 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-1c04aab3-cadf-457a-82fb-8f2055d879a1 req-dc87da87-0258-4c28-84c7-cf1876664f58 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:32.205309 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-427c79d0-e14c-4333-9aa0-03a3ad65cd85 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:32.211573 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-1c04aab3-cadf-457a-82fb-8f2055d879a1 req-dc87da87-0258-4c28-84c7-cf1876664f58 service nova] Creating event network-changed:28882e01-e9b0-4de8-9520-5575425b9c64 for instance 4c5b9754-035f-4b86-888a-68aecbac2cee on n-h2-848886-15 Jul 25 13:06:32.212090 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-1c04aab3-cadf-457a-82fb-8f2055d879a1 req-dc87da87-0258-4c28-84c7-cf1876664f58 service nova] Creating event network-changed:adbcb40b-638c-4e4f-928f-2406ca66229f for instance f6cffb3b-3dc6-439e-9433-b9107bfccfcc on n-h2-848886-15 Jul 25 13:06:32.216135 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-427c79d0-e14c-4333-9aa0-03a3ad65cd85 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1202 microversion: 2.1 time: 0.263991 Jul 25 13:06:32.216816 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2374/4847] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:31 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1202 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:32.222708 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-1c04aab3-cadf-457a-82fb-8f2055d879a1 req-dc87da87-0258-4c28-84c7-cf1876664f58 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045590 Jul 25 13:06:32.223552 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2474/4848] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:32.393067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1ca300ff-20d5-4aa9-aec4-1734cdcc8780 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:32.393711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1ca300ff-20d5-4aa9-aec4-1734cdcc8780 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 58447a88-a579-4078-9af4-d6b7379de5cf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:32.410688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ca300ff-20d5-4aa9-aec4-1734cdcc8780 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:32.411164 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ca300ff-20d5-4aa9-aec4-1734cdcc8780 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:32.412169 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ca300ff-20d5-4aa9-aec4-1734cdcc8780 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:32.412788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ca300ff-20d5-4aa9-aec4-1734cdcc8780 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:32.449266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cfe42a5d-c4a2-4dd5-abc7-0c83765a1eec tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:32.450011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cfe42a5d-c4a2-4dd5-abc7-0c83765a1eec tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: a622522d-8862-4aab-a007-9d0edc692586] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:32.458966 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cfe42a5d-c4a2-4dd5-abc7-0c83765a1eec tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:32.459894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cfe42a5d-c4a2-4dd5-abc7-0c83765a1eec tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:32.461629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cfe42a5d-c4a2-4dd5-abc7-0c83765a1eec tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:32.462512 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cfe42a5d-c4a2-4dd5-abc7-0c83765a1eec tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:32.793853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1ca300ff-20d5-4aa9-aec4-1734cdcc8780 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:32.807143 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1ca300ff-20d5-4aa9-aec4-1734cdcc8780 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf" status: 200 len: 1309 microversion: 2.1 time: 0.419439 Jul 25 13:06:32.808179 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2375/4849] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:32 2022] GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf => generated 1309 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:32.829504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cfe42a5d-c4a2-4dd5-abc7-0c83765a1eec tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:32.838420 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cfe42a5d-c4a2-4dd5-abc7-0c83765a1eec tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586" status: 200 len: 1507 microversion: 2.1 time: 0.395205 Jul 25 13:06:32.839143 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2475/4850] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:32 2022] GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586 => generated 1507 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:32.861300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4a1dd9b5-d0bd-426d-8678-e7a8827b857e tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:32.861953 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4a1dd9b5-d0bd-426d-8678-e7a8827b857e tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 20fc7977-10be-4f70-8d94-31b38bf61fee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:32.875527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a1dd9b5-d0bd-426d-8678-e7a8827b857e tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:32.875985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a1dd9b5-d0bd-426d-8678-e7a8827b857e tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:32.878684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a1dd9b5-d0bd-426d-8678-e7a8827b857e tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:32.879299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a1dd9b5-d0bd-426d-8678-e7a8827b857e tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:32.975528 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8ced2270-6ec5-4344-bf36-e6620358035c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:32.977400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8ced2270-6ec5-4344-bf36-e6620358035c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:32.994422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ced2270-6ec5-4344-bf36-e6620358035c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:32.994853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ced2270-6ec5-4344-bf36-e6620358035c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:32.995673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ced2270-6ec5-4344-bf36-e6620358035c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:32.996113 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ced2270-6ec5-4344-bf36-e6620358035c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:33.208840 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4a1dd9b5-d0bd-426d-8678-e7a8827b857e tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:33.224560 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4a1dd9b5-d0bd-426d-8678-e7a8827b857e tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/20fc7977-10be-4f70-8d94-31b38bf61fee" status: 200 len: 1506 microversion: 2.1 time: 0.365557 Jul 25 13:06:33.227953 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2376/4851] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:32 2022] GET /compute/v2.1/servers/20fc7977-10be-4f70-8d94-31b38bf61fee => generated 1506 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:33.236471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8fde668c-482b-4548-ad00-a2565d6ec2e8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:33.240007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8fde668c-482b-4548-ad00-a2565d6ec2e8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:33.250000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8fde668c-482b-4548-ad00-a2565d6ec2e8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:33.250770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8fde668c-482b-4548-ad00-a2565d6ec2e8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:33.252230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8fde668c-482b-4548-ad00-a2565d6ec2e8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:33.252861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8fde668c-482b-4548-ad00-a2565d6ec2e8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:33.436198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8ced2270-6ec5-4344-bf36-e6620358035c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:33.452750 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8ced2270-6ec5-4344-bf36-e6620358035c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1391 microversion: 2.1 time: 0.481523 Jul 25 13:06:33.454187 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2476/4852] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:32 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1391 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:33.460930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-42395750-39bc-4807-adfd-1e8eb2d3a63a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:33.461913 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-42395750-39bc-4807-adfd-1e8eb2d3a63a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:33.495509 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-42395750-39bc-4807-adfd-1e8eb2d3a63a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:33.499071 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-42395750-39bc-4807-adfd-1e8eb2d3a63a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:33.500317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-42395750-39bc-4807-adfd-1e8eb2d3a63a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:33.506492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-42395750-39bc-4807-adfd-1e8eb2d3a63a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:33.605865 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8fde668c-482b-4548-ad00-a2565d6ec2e8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:33.635529 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8fde668c-482b-4548-ad00-a2565d6ec2e8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1371 microversion: 2.1 time: 0.405145 Jul 25 13:06:33.636160 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2377/4853] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:33 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1371 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:33.641785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6fa2d6e5-fb54-4bab-adc3-dbd85d4fc497 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:33.642536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6fa2d6e5-fb54-4bab-adc3-dbd85d4fc497 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 20fc7977-10be-4f70-8d94-31b38bf61fee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:33.652979 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6fa2d6e5-fb54-4bab-adc3-dbd85d4fc497 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:33.653600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6fa2d6e5-fb54-4bab-adc3-dbd85d4fc497 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:33.654609 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6fa2d6e5-fb54-4bab-adc3-dbd85d4fc497 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:33.655055 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6fa2d6e5-fb54-4bab-adc3-dbd85d4fc497 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:33.685505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6fa2d6e5-fb54-4bab-adc3-dbd85d4fc497 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 20fc7977-10be-4f70-8d94-31b38bf61fee] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:06:33.801507 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6fa2d6e5-fb54-4bab-adc3-dbd85d4fc497 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/20fc7977-10be-4f70-8d94-31b38bf61fee" status: 204 len: 0 microversion: 2.1 time: 0.163680 Jul 25 13:06:33.802955 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2378/4854] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:06:33 2022] DELETE /compute/v2.1/servers/20fc7977-10be-4f70-8d94-31b38bf61fee => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:06:33.808906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-4cf75d74-f29a-4652-a8a5-96154cc4f041 req-240b8094-caef-4b45-bb4d-ecb5cf1fa8ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3baaf3bb-a036-43d5-b1d0-799f44fb5ef3", "name": "network-vif-plugged", "status": "completed", "tag": "d22254f0-f882-4f44-966f-f95b96c6c9ff"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:33.820090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4cf75d74-f29a-4652-a8a5-96154cc4f041 req-240b8094-caef-4b45-bb4d-ecb5cf1fa8ab service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:33.820548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4cf75d74-f29a-4652-a8a5-96154cc4f041 req-240b8094-caef-4b45-bb4d-ecb5cf1fa8ab service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:33.832967 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-4cf75d74-f29a-4652-a8a5-96154cc4f041 req-240b8094-caef-4b45-bb4d-ecb5cf1fa8ab service nova] Creating event network-vif-plugged:d22254f0-f882-4f44-966f-f95b96c6c9ff for instance 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 on n-h1-848886-15 Jul 25 13:06:33.838102 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-4cf75d74-f29a-4652-a8a5-96154cc4f041 req-240b8094-caef-4b45-bb4d-ecb5cf1fa8ab service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033607 Jul 25 13:06:33.839078 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2379/4855] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:33.844398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3f71a5be-186d-43bc-9909-40be21cdeef9 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:33.845056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3f71a5be-186d-43bc-9909-40be21cdeef9 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: a622522d-8862-4aab-a007-9d0edc692586] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:33.851734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3f71a5be-186d-43bc-9909-40be21cdeef9 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:33.852191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3f71a5be-186d-43bc-9909-40be21cdeef9 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:33.853040 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3f71a5be-186d-43bc-9909-40be21cdeef9 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:33.853487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3f71a5be-186d-43bc-9909-40be21cdeef9 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:33.891139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3f71a5be-186d-43bc-9909-40be21cdeef9 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: a622522d-8862-4aab-a007-9d0edc692586] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:06:33.929756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-42395750-39bc-4807-adfd-1e8eb2d3a63a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:33.939692 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-42395750-39bc-4807-adfd-1e8eb2d3a63a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1202 microversion: 2.1 time: 0.483721 Jul 25 13:06:33.940318 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2477/4856] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:33 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1202 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:33.958201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-59752de4-043e-4ea8-91d7-5bb43e9d3be2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:33.958824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-59752de4-043e-4ea8-91d7-5bb43e9d3be2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 58447a88-a579-4078-9af4-d6b7379de5cf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:33.974425 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59752de4-043e-4ea8-91d7-5bb43e9d3be2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:33.975610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59752de4-043e-4ea8-91d7-5bb43e9d3be2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:33.981524 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59752de4-043e-4ea8-91d7-5bb43e9d3be2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:33.982892 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59752de4-043e-4ea8-91d7-5bb43e9d3be2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:34.026237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:34.040509 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3f71a5be-186d-43bc-9909-40be21cdeef9 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586" status: 204 len: 0 microversion: 2.1 time: 0.199326 Jul 25 13:06:34.045118 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2380/4857] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:06:33 2022] DELETE /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:06:34.051789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-42567c87-32f2-4a97-b061-56cb06a69595 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:34.052807 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-42567c87-32f2-4a97-b061-56cb06a69595 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 20fc7977-10be-4f70-8d94-31b38bf61fee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:34.060641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-42567c87-32f2-4a97-b061-56cb06a69595 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:34.061325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-42567c87-32f2-4a97-b061-56cb06a69595 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:34.062399 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-42567c87-32f2-4a97-b061-56cb06a69595 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:34.062998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-42567c87-32f2-4a97-b061-56cb06a69595 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:34.762308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-59752de4-043e-4ea8-91d7-5bb43e9d3be2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:34.766052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-42567c87-32f2-4a97-b061-56cb06a69595 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:34.773161 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-59752de4-043e-4ea8-91d7-5bb43e9d3be2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf" status: 200 len: 1309 microversion: 2.1 time: 0.827687 Jul 25 13:06:34.773749 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2478/4858] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:33 2022] GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf => generated 1309 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:34.779237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5d38e076-6c1c-426e-9c8f-0a1540d402de tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:34.780298 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5d38e076-6c1c-426e-9c8f-0a1540d402de tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:34.786585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d38e076-6c1c-426e-9c8f-0a1540d402de tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:34.787306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d38e076-6c1c-426e-9c8f-0a1540d402de tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:34.788379 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d38e076-6c1c-426e-9c8f-0a1540d402de tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:34.788858 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-42567c87-32f2-4a97-b061-56cb06a69595 tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/20fc7977-10be-4f70-8d94-31b38bf61fee" status: 200 len: 1512 microversion: 2.1 time: 0.741847 Jul 25 13:06:34.788979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d38e076-6c1c-426e-9c8f-0a1540d402de tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:34.789650 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2381/4859] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:34 2022] GET /compute/v2.1/servers/20fc7977-10be-4f70-8d94-31b38bf61fee => generated 1512 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:34.799421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4a6cd235-0f02-47e8-9fc5-5b5debdd88ad tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:34.800663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4a6cd235-0f02-47e8-9fc5-5b5debdd88ad tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:34.807693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a6cd235-0f02-47e8-9fc5-5b5debdd88ad tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:34.808545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a6cd235-0f02-47e8-9fc5-5b5debdd88ad tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:34.809333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a6cd235-0f02-47e8-9fc5-5b5debdd88ad tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:34.809872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a6cd235-0f02-47e8-9fc5-5b5debdd88ad tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:35.090407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5d38e076-6c1c-426e-9c8f-0a1540d402de tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:35.102431 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4a6cd235-0f02-47e8-9fc5-5b5debdd88ad tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:35.104954 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5d38e076-6c1c-426e-9c8f-0a1540d402de tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1391 microversion: 2.1 time: 0.329465 Jul 25 13:06:35.106520 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2479/4860] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:34 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1391 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:35.112546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f7ced159-8f7d-426e-b77b-d265a4d2164f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:35.113326 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f7ced159-8f7d-426e-b77b-d265a4d2164f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:35.114214 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4a6cd235-0f02-47e8-9fc5-5b5debdd88ad tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1371 microversion: 2.1 time: 0.318950 Jul 25 13:06:35.115195 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2382/4861] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:34 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1371 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:35.121676 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7ced159-8f7d-426e-b77b-d265a4d2164f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:35.122461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7ced159-8f7d-426e-b77b-d265a4d2164f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:35.123271 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7ced159-8f7d-426e-b77b-d265a4d2164f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:35.123717 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7ced159-8f7d-426e-b77b-d265a4d2164f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:35.630392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f7ced159-8f7d-426e-b77b-d265a4d2164f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:35.648015 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f7ced159-8f7d-426e-b77b-d265a4d2164f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1202 microversion: 2.1 time: 0.538846 Jul 25 13:06:35.649753 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2480/4862] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:35 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1202 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:35.794975 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-235323dc-7e3a-46db-a00a-3a94609dda5e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:35.795811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-235323dc-7e3a-46db-a00a-3a94609dda5e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 58447a88-a579-4078-9af4-d6b7379de5cf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:35.809402 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-235323dc-7e3a-46db-a00a-3a94609dda5e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:35.809967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-235323dc-7e3a-46db-a00a-3a94609dda5e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:35.810764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-235323dc-7e3a-46db-a00a-3a94609dda5e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:35.811373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-235323dc-7e3a-46db-a00a-3a94609dda5e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:35.812139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-881fdce6-2532-4f14-a04d-db52def4ec4a tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:35.812777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-881fdce6-2532-4f14-a04d-db52def4ec4a tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 20fc7977-10be-4f70-8d94-31b38bf61fee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:35.825705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-881fdce6-2532-4f14-a04d-db52def4ec4a tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:35.826223 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-881fdce6-2532-4f14-a04d-db52def4ec4a tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:35.827029 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-881fdce6-2532-4f14-a04d-db52def4ec4a tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:35.827475 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-881fdce6-2532-4f14-a04d-db52def4ec4a tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:36.261000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-235323dc-7e3a-46db-a00a-3a94609dda5e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:36.274449 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-235323dc-7e3a-46db-a00a-3a94609dda5e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf" status: 200 len: 1309 microversion: 2.1 time: 0.483371 Jul 25 13:06:36.275241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-881fdce6-2532-4f14-a04d-db52def4ec4a tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:36.275365 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2383/4863] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:35 2022] GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf => generated 1309 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:36.287682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9e0c548f-cee3-427f-99db-87dc30bf5ab0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:36.288651 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9e0c548f-cee3-427f-99db-87dc30bf5ab0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:36.293872 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-881fdce6-2532-4f14-a04d-db52def4ec4a tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/20fc7977-10be-4f70-8d94-31b38bf61fee" status: 200 len: 1512 microversion: 2.1 time: 0.486186 Jul 25 13:06:36.295746 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2481/4864] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:35 2022] GET /compute/v2.1/servers/20fc7977-10be-4f70-8d94-31b38bf61fee => generated 1512 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:36.304149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e0c548f-cee3-427f-99db-87dc30bf5ab0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:36.304607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e0c548f-cee3-427f-99db-87dc30bf5ab0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:36.305567 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e0c548f-cee3-427f-99db-87dc30bf5ab0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:36.306199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e0c548f-cee3-427f-99db-87dc30bf5ab0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:36.309561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6893e6e5-0016-4a24-b4d2-c860202d2748 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:36.331341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6893e6e5-0016-4a24-b4d2-c860202d2748 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:36.363800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6893e6e5-0016-4a24-b4d2-c860202d2748 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:36.366826 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6893e6e5-0016-4a24-b4d2-c860202d2748 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:36.370950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6893e6e5-0016-4a24-b4d2-c860202d2748 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:36.371592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6893e6e5-0016-4a24-b4d2-c860202d2748 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:36.806755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6893e6e5-0016-4a24-b4d2-c860202d2748 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:36.811848 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:36.839037 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6893e6e5-0016-4a24-b4d2-c860202d2748 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1371 microversion: 2.1 time: 0.537057 Jul 25 13:06:36.841748 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2482/4865] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:36 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1371 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:36.900420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-b21f3014-2676-46bb-b88e-aefedfe7964d req-b20fb37d-59e4-43f2-a1cc-56cae532f7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a622522d-8862-4aab-a007-9d0edc692586", "name": "network-vif-deleted", "tag": "71775d6b-3349-4215-846d-fafd1964c7fc"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:36.917396 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:36.922621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b21f3014-2676-46bb-b88e-aefedfe7964d req-b20fb37d-59e4-43f2-a1cc-56cae532f7a2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:36.923631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b21f3014-2676-46bb-b88e-aefedfe7964d req-b20fb37d-59e4-43f2-a1cc-56cae532f7a2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:36.952105 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-b21f3014-2676-46bb-b88e-aefedfe7964d req-b20fb37d-59e4-43f2-a1cc-56cae532f7a2 service nova] Creating event network-vif-deleted:71775d6b-3349-4215-846d-fafd1964c7fc for instance a622522d-8862-4aab-a007-9d0edc692586 on n-h1-848886-15 Jul 25 13:06:36.961087 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-b21f3014-2676-46bb-b88e-aefedfe7964d req-b20fb37d-59e4-43f2-a1cc-56cae532f7a2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117081 Jul 25 13:06:36.962782 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2483/4866] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:36.969248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d1e61502-97b2-4b92-922f-dce7781eef08 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:36.970473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d1e61502-97b2-4b92-922f-dce7781eef08 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:36.979921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1e61502-97b2-4b92-922f-dce7781eef08 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:36.981126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1e61502-97b2-4b92-922f-dce7781eef08 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:36.983228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1e61502-97b2-4b92-922f-dce7781eef08 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:36.983933 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1e61502-97b2-4b92-922f-dce7781eef08 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:37.051060 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9e0c548f-cee3-427f-99db-87dc30bf5ab0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:37.067954 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9e0c548f-cee3-427f-99db-87dc30bf5ab0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1391 microversion: 2.1 time: 0.791224 Jul 25 13:06:37.069200 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2384/4867] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:36 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1391 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:37.088005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-a5589904-d832-491a-b9c7-546540c41e2f req-9fae1a03-8d6b-40d7-b8cd-5106a6e99784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20fc7977-10be-4f70-8d94-31b38bf61fee", "name": "network-vif-deleted", "tag": "7d0be5d0-a71c-43c9-bfa6-fa0f42c5fc22"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:37.100765 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a5589904-d832-491a-b9c7-546540c41e2f req-9fae1a03-8d6b-40d7-b8cd-5106a6e99784 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:37.101373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a5589904-d832-491a-b9c7-546540c41e2f req-9fae1a03-8d6b-40d7-b8cd-5106a6e99784 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:37.139410 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-a5589904-d832-491a-b9c7-546540c41e2f req-9fae1a03-8d6b-40d7-b8cd-5106a6e99784 service nova] Creating event network-vif-deleted:7d0be5d0-a71c-43c9-bfa6-fa0f42c5fc22 for instance 20fc7977-10be-4f70-8d94-31b38bf61fee on n-h2-848886-15 Jul 25 13:06:37.144623 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-a5589904-d832-491a-b9c7-546540c41e2f req-9fae1a03-8d6b-40d7-b8cd-5106a6e99784 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060926 Jul 25 13:06:37.145755 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2385/4868] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:37.311270 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-033226e2-6c8a-44c3-a787-04e0c2ddd9de tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:37.312407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-033226e2-6c8a-44c3-a787-04e0c2ddd9de tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 58447a88-a579-4078-9af4-d6b7379de5cf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:37.324061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-033226e2-6c8a-44c3-a787-04e0c2ddd9de tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:37.324669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-033226e2-6c8a-44c3-a787-04e0c2ddd9de tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:37.325575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-033226e2-6c8a-44c3-a787-04e0c2ddd9de tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:37.326277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-033226e2-6c8a-44c3-a787-04e0c2ddd9de tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:37.521219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d1e61502-97b2-4b92-922f-dce7781eef08 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:37.533679 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d1e61502-97b2-4b92-922f-dce7781eef08 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1202 microversion: 2.1 time: 0.569296 Jul 25 13:06:37.550319 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2484/4869] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:36 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1202 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:37.557054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dd6c1fd5-1590-4260-845d-93abc741bc9d tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:37.558183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dd6c1fd5-1590-4260-845d-93abc741bc9d tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 20fc7977-10be-4f70-8d94-31b38bf61fee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:37.570896 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd6c1fd5-1590-4260-845d-93abc741bc9d tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:37.571595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd6c1fd5-1590-4260-845d-93abc741bc9d tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:37.573494 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd6c1fd5-1590-4260-845d-93abc741bc9d tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:37.574518 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd6c1fd5-1590-4260-845d-93abc741bc9d tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:37.606378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-033226e2-6c8a-44c3-a787-04e0c2ddd9de tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:37.619991 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-033226e2-6c8a-44c3-a787-04e0c2ddd9de tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf" status: 200 len: 1309 microversion: 2.1 time: 0.317851 Jul 25 13:06:37.621431 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2386/4870] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:37 2022] GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf => generated 1309 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:37.627085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b46ff480-48db-4f82-8b37-2ed0b4d839bb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:37.630210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b46ff480-48db-4f82-8b37-2ed0b4d839bb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:37.643324 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b46ff480-48db-4f82-8b37-2ed0b4d839bb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:37.643794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b46ff480-48db-4f82-8b37-2ed0b4d839bb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:37.646457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b46ff480-48db-4f82-8b37-2ed0b4d839bb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:37.647266 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b46ff480-48db-4f82-8b37-2ed0b4d839bb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:37.651945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd6c1fd5-1590-4260-845d-93abc741bc9d tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:37.653090 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd6c1fd5-1590-4260-845d-93abc741bc9d tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:37.653964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-dd6c1fd5-1590-4260-845d-93abc741bc9d tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lazy-loading 'fault' on Instance uuid 20fc7977-10be-4f70-8d94-31b38bf61fee {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:06:37.694118 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:37.710912 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b46ff480-48db-4f82-8b37-2ed0b4d839bb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087517 Jul 25 13:06:37.711864 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2387/4871] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:06:37 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 13:06:37.796576 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-530f38b4-c372-4cd7-b706-924e7dfe4ee8 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:37.798803 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-530f38b4-c372-4cd7-b706-924e7dfe4ee8 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:37.809248 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-530f38b4-c372-4cd7-b706-924e7dfe4ee8 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:37.810216 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-530f38b4-c372-4cd7-b706-924e7dfe4ee8 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:37.811519 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-530f38b4-c372-4cd7-b706-924e7dfe4ee8 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:37.812258 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-530f38b4-c372-4cd7-b706-924e7dfe4ee8 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:37.827667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dd6c1fd5-1590-4260-845d-93abc741bc9d tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390bc47d040a4435acf81010b5532f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e13193378b494e847f9812268749d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:37.842529 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dd6c1fd5-1590-4260-845d-93abc741bc9d tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/20fc7977-10be-4f70-8d94-31b38bf61fee" status: 200 len: 1308 microversion: 2.1 time: 0.289101 Jul 25 13:06:37.843898 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2485/4872] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:37 2022] GET /compute/v2.1/servers/20fc7977-10be-4f70-8d94-31b38bf61fee => generated 1308 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:37.863666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c7cb287e-7a7c-4acb-bd6c-fb5fa8edf8b0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:37.864556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c7cb287e-7a7c-4acb-bd6c-fb5fa8edf8b0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:37.874899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7cb287e-7a7c-4acb-bd6c-fb5fa8edf8b0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:37.876081 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7cb287e-7a7c-4acb-bd6c-fb5fa8edf8b0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:37.877416 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7cb287e-7a7c-4acb-bd6c-fb5fa8edf8b0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:37.878115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7cb287e-7a7c-4acb-bd6c-fb5fa8edf8b0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:37.883127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-530f38b4-c372-4cd7-b706-924e7dfe4ee8 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:06:38.032452 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-530f38b4-c372-4cd7-b706-924e7dfe4ee8 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 204 len: 0 microversion: 2.1 time: 0.241962 Jul 25 13:06:38.033085 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2388/4873] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:06:37 2022] DELETE /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 13:06:38.038193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-d279dc8f-7c50-4c41-9891-c279ec39104a req-36b4a6af-cb7d-4f58-a205-c4763a3c18aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58447a88-a579-4078-9af4-d6b7379de5cf", "name": "network-vif-plugged", "status": "completed", "tag": "a79d04cd-d8f6-4ab1-ab81-2465b124b9dd"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:38.048204 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d279dc8f-7c50-4c41-9891-c279ec39104a req-36b4a6af-cb7d-4f58-a205-c4763a3c18aa service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:38.048655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d279dc8f-7c50-4c41-9891-c279ec39104a req-36b4a6af-cb7d-4f58-a205-c4763a3c18aa service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:38.061561 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-d279dc8f-7c50-4c41-9891-c279ec39104a req-36b4a6af-cb7d-4f58-a205-c4763a3c18aa service nova] Creating event network-vif-plugged:a79d04cd-d8f6-4ab1-ab81-2465b124b9dd for instance 58447a88-a579-4078-9af4-d6b7379de5cf on n-h1-848886-15 Jul 25 13:06:38.066535 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-d279dc8f-7c50-4c41-9891-c279ec39104a req-36b4a6af-cb7d-4f58-a205-c4763a3c18aa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032082 Jul 25 13:06:38.067534 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2389/4874] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:38.072908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-671b4915-75d9-4de4-8760-f53f93cdc194 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:38.074002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-671b4915-75d9-4de4-8760-f53f93cdc194 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:38.080990 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-671b4915-75d9-4de4-8760-f53f93cdc194 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:38.081757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-671b4915-75d9-4de4-8760-f53f93cdc194 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:38.082762 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-671b4915-75d9-4de4-8760-f53f93cdc194 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:38.083365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-671b4915-75d9-4de4-8760-f53f93cdc194 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:38.237007 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c7cb287e-7a7c-4acb-bd6c-fb5fa8edf8b0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:38.246009 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c7cb287e-7a7c-4acb-bd6c-fb5fa8edf8b0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1564 microversion: 2.1 time: 0.386603 Jul 25 13:06:38.253507 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2486/4875] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:37 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1564 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:06:38.253507 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8aaa68ae-432b-4b12-92bf-2270eb21dfae tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:38.254113 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8aaa68ae-432b-4b12-92bf-2270eb21dfae tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:38.263605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8aaa68ae-432b-4b12-92bf-2270eb21dfae tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:38.264527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8aaa68ae-432b-4b12-92bf-2270eb21dfae tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:38.266054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8aaa68ae-432b-4b12-92bf-2270eb21dfae tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:38.266427 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8aaa68ae-432b-4b12-92bf-2270eb21dfae tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:38.378751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-671b4915-75d9-4de4-8760-f53f93cdc194 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:38.401559 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-671b4915-75d9-4de4-8760-f53f93cdc194 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1672 microversion: 2.1 time: 0.332486 Jul 25 13:06:38.402175 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2390/4876] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:38 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1672 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:38.407232 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-837655f0-34ac-4ba6-b350-14100d0d4bf0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:38.407732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-837655f0-34ac-4ba6-b350-14100d0d4bf0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:38.425656 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-837655f0-34ac-4ba6-b350-14100d0d4bf0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:38.426150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-837655f0-34ac-4ba6-b350-14100d0d4bf0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:38.426946 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-837655f0-34ac-4ba6-b350-14100d0d4bf0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:38.427384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-837655f0-34ac-4ba6-b350-14100d0d4bf0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:38.602243 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-837655f0-34ac-4ba6-b350-14100d0d4bf0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.198695 Jul 25 13:06:38.607580 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8aaa68ae-432b-4b12-92bf-2270eb21dfae tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:38.615492 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2391/4877] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 13:06:38 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-interface => generated 284 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:38.628747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-734e0f40-d1cf-4a1b-96f1-850fb218e063 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:38.630257 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-734e0f40-d1cf-4a1b-96f1-850fb218e063 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:38.633648 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8aaa68ae-432b-4b12-92bf-2270eb21dfae tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1391 microversion: 2.1 time: 0.384260 Jul 25 13:06:38.638885 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2487/4878] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:38 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1391 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:38.647994 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-734e0f40-d1cf-4a1b-96f1-850fb218e063 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:38.648462 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-734e0f40-d1cf-4a1b-96f1-850fb218e063 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:38.649293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-734e0f40-d1cf-4a1b-96f1-850fb218e063 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:38.649733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-734e0f40-d1cf-4a1b-96f1-850fb218e063 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:38.652140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d57a94b8-a844-4bbf-a263-f1c418d4094c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:38.654205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d57a94b8-a844-4bbf-a263-f1c418d4094c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 58447a88-a579-4078-9af4-d6b7379de5cf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:38.676542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d57a94b8-a844-4bbf-a263-f1c418d4094c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:38.677558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d57a94b8-a844-4bbf-a263-f1c418d4094c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:38.679702 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d57a94b8-a844-4bbf-a263-f1c418d4094c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:38.680406 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d57a94b8-a844-4bbf-a263-f1c418d4094c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:39.060474 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-734e0f40-d1cf-4a1b-96f1-850fb218e063 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:39.064143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d57a94b8-a844-4bbf-a263-f1c418d4094c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:39.075088 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d57a94b8-a844-4bbf-a263-f1c418d4094c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf" status: 200 len: 1309 microversion: 2.1 time: 0.432806 Jul 25 13:06:39.076154 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-734e0f40-d1cf-4a1b-96f1-850fb218e063 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1202 microversion: 2.1 time: 0.458463 Jul 25 13:06:39.087576 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2488/4879] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:38 2022] GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf => generated 1309 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:39.095310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f5271dcf-7caa-41e0-98e2-d0107b4b9b1c tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:39.095942 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f5271dcf-7caa-41e0-98e2-d0107b4b9b1c tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: 20fc7977-10be-4f70-8d94-31b38bf61fee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:39.098775 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2392/4880] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:38 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1202 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:39.116000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5271dcf-7caa-41e0-98e2-d0107b4b9b1c tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:39.116471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5271dcf-7caa-41e0-98e2-d0107b4b9b1c tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:39.117815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5271dcf-7caa-41e0-98e2-d0107b4b9b1c tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:39.118456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5271dcf-7caa-41e0-98e2-d0107b4b9b1c tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:39.149665 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-f5271dcf-7caa-41e0-98e2-d0107b4b9b1c tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] HTTP exception thrown: Instance 20fc7977-10be-4f70-8d94-31b38bf61fee could not be found. Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f5271dcf-7caa-41e0-98e2-d0107b4b9b1c tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Request method failure captured: Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/20fc7977-10be-4f70-8d94-31b38bf61fee HTTP/1.1 Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pUYPTPME0i7YzTX2Z_mMaCHIlZdkYbp6c6wYYdzUrYoDuPZqihXi6f_zP_lF78hEoYLsys1YcLykJtbw5HdmUxW0-rRArn-bQDN97ymysbVrlfDiCNn5_tSRI3idXPmNaMTJuU244Wi5PlGVp6IPWIl7n8-z_bu_HlaO3C_7cfV7KM Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 21e13193378b494e847f9812268749d9 Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-MultipleCreateTestJSON-461286785 Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_21e13193378b494e847f9812268749d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/21e13193378b494e847f9812268749d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/21e13193378b494e847f9812268749d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/21e13193378b494e847f9812268749d9"}]}] Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-MultipleCreateTestJSON-461286785 Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 21e13193378b494e847f9812268749d9 Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-MultipleCreateTestJSON-461286785 Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-MultipleCreateTestJSON-461286785-project Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 390bc47d040a4435acf81010b5532f79 Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-MultipleCreateTestJSON-461286785-project Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 20fc7977-10be-4f70-8d94-31b38bf61fee could not be found. Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '20fc7977-10be-4f70-8d94-31b38bf61fee'} Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20fc7977-10be-4f70-8d94-31b38bf61fee could not be found. Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20fc7977-10be-4f70-8d94-31b38bf61fee could not be found. Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:06:39.151389 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:06:39.155825 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:06:39.155825 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:06:39.155825 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:06:39.155825 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:06:39.155825 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:06:39.155825 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20fc7977-10be-4f70-8d94-31b38bf61fee could not be found. Jul 25 13:06:39.155825 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:06:39.155825 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f5271dcf-7caa-41e0-98e2-d0107b4b9b1c tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Returning 404 to user: Instance 20fc7977-10be-4f70-8d94-31b38bf61fee could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:06:39.155825 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f5271dcf-7caa-41e0-98e2-d0107b4b9b1c tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/20fc7977-10be-4f70-8d94-31b38bf61fee" status: 404 len: 111 microversion: 2.1 time: 0.074860 Jul 25 13:06:39.167970 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2489/4881] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:39 2022] GET /compute/v2.1/servers/20fc7977-10be-4f70-8d94-31b38bf61fee => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:06:39.178806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fd3652e1-b257-4ef6-933f-ebb087b7852b tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:39.179993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fd3652e1-b257-4ef6-933f-ebb087b7852b tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] [instance: a622522d-8862-4aab-a007-9d0edc692586] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:39.202485 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd3652e1-b257-4ef6-933f-ebb087b7852b tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:39.203023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd3652e1-b257-4ef6-933f-ebb087b7852b tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:39.204073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd3652e1-b257-4ef6-933f-ebb087b7852b tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:39.204698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd3652e1-b257-4ef6-933f-ebb087b7852b tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:39.227749 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-fd3652e1-b257-4ef6-933f-ebb087b7852b tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] HTTP exception thrown: Instance a622522d-8862-4aab-a007-9d0edc692586 could not be found. Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fd3652e1-b257-4ef6-933f-ebb087b7852b tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Request method failure captured: Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586 HTTP/1.1 Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pUYPTPME0i7YzTX2Z_mMaCHIlZdkYbp6c6wYYdzUrYoDuPZqihXi6f_zP_lF78hEoYLsys1YcLykJtbw5HdmUxW0-rRArn-bQDN97ymysbVrlfDiCNn5_tSRI3idXPmNaMTJuU244Wi5PlGVp6IPWIl7n8-z_bu_HlaO3C_7cfV7KM Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 21e13193378b494e847f9812268749d9 Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-MultipleCreateTestJSON-461286785 Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_21e13193378b494e847f9812268749d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/21e13193378b494e847f9812268749d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/21e13193378b494e847f9812268749d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/21e13193378b494e847f9812268749d9"}]}] Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-MultipleCreateTestJSON-461286785 Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 21e13193378b494e847f9812268749d9 Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-MultipleCreateTestJSON-461286785 Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-MultipleCreateTestJSON-461286785-project Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 390bc47d040a4435acf81010b5532f79 Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-MultipleCreateTestJSON-461286785-project Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance a622522d-8862-4aab-a007-9d0edc692586 could not be found. Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'a622522d-8862-4aab-a007-9d0edc692586'} Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a622522d-8862-4aab-a007-9d0edc692586 could not be found. Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a622522d-8862-4aab-a007-9d0edc692586 could not be found. Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:06:39.231002 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:06:39.234309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:06:39.234309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:06:39.234309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:06:39.234309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:06:39.234309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:06:39.234309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a622522d-8862-4aab-a007-9d0edc692586 could not be found. Jul 25 13:06:39.234309 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:06:39.235937 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fd3652e1-b257-4ef6-933f-ebb087b7852b tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] Returning 404 to user: Instance a622522d-8862-4aab-a007-9d0edc692586 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:06:39.237075 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fd3652e1-b257-4ef6-933f-ebb087b7852b tempest-MultipleCreateTestJSON-461286785 tempest-MultipleCreateTestJSON-461286785-project] 10.222.0.49 "GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586" status: 404 len: 111 microversion: 2.1 time: 0.066916 Jul 25 13:06:39.238293 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2393/4882] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:39 2022] GET /compute/v2.1/servers/a622522d-8862-4aab-a007-9d0edc692586 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:06:39.431551 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-54034bf9-4f5f-4ec0-9a5a-3d43ffafe08b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:39.432347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-54034bf9-4f5f-4ec0-9a5a-3d43ffafe08b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:39.440035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-54034bf9-4f5f-4ec0-9a5a-3d43ffafe08b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:39.440995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-54034bf9-4f5f-4ec0-9a5a-3d43ffafe08b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:39.442309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-54034bf9-4f5f-4ec0-9a5a-3d43ffafe08b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:39.442964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-54034bf9-4f5f-4ec0-9a5a-3d43ffafe08b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:39.655291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-857aa6c8-0302-44df-8258-709f9e587edc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:39.656998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-857aa6c8-0302-44df-8258-709f9e587edc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:39.665909 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-857aa6c8-0302-44df-8258-709f9e587edc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:39.666801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-857aa6c8-0302-44df-8258-709f9e587edc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:39.667814 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-857aa6c8-0302-44df-8258-709f9e587edc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:39.668447 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-857aa6c8-0302-44df-8258-709f9e587edc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:39.939913 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-54034bf9-4f5f-4ec0-9a5a-3d43ffafe08b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:39.949512 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-54034bf9-4f5f-4ec0-9a5a-3d43ffafe08b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1672 microversion: 2.1 time: 0.521842 Jul 25 13:06:39.958461 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2490/4883] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:39 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1672 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:40.011349 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-857aa6c8-0302-44df-8258-709f9e587edc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:40.020168 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-857aa6c8-0302-44df-8258-709f9e587edc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1391 microversion: 2.1 time: 0.369057 Jul 25 13:06:40.024350 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2394/4884] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:39 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1391 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:06:40.105151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-927aedc7-ce2e-45b6-8dbe-fddd5e373f05 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:40.105815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-927aedc7-ce2e-45b6-8dbe-fddd5e373f05 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 58447a88-a579-4078-9af4-d6b7379de5cf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:40.119259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a7ee7261-38c6-48d3-a516-93c238a65845 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:40.121966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a7ee7261-38c6-48d3-a516-93c238a65845 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:40.135675 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7ee7261-38c6-48d3-a516-93c238a65845 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:40.135828 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7ee7261-38c6-48d3-a516-93c238a65845 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:40.136811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7ee7261-38c6-48d3-a516-93c238a65845 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:40.140344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7ee7261-38c6-48d3-a516-93c238a65845 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:40.144691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-927aedc7-ce2e-45b6-8dbe-fddd5e373f05 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:40.146344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-927aedc7-ce2e-45b6-8dbe-fddd5e373f05 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:40.147482 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-927aedc7-ce2e-45b6-8dbe-fddd5e373f05 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:40.148121 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-927aedc7-ce2e-45b6-8dbe-fddd5e373f05 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:40.749294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a7ee7261-38c6-48d3-a516-93c238a65845 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:40.767792 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a7ee7261-38c6-48d3-a516-93c238a65845 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1202 microversion: 2.1 time: 0.652335 Jul 25 13:06:40.769958 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2395/4885] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:40 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1202 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:06:40.811453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-927aedc7-ce2e-45b6-8dbe-fddd5e373f05 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:40.820896 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-927aedc7-ce2e-45b6-8dbe-fddd5e373f05 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf" status: 200 len: 1309 microversion: 2.1 time: 0.722913 Jul 25 13:06:40.822273 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2491/4886] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:40 2022] GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf => generated 1309 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:40.971879 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5f01f7f1-d00c-4f06-8fee-fafd655e5638 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:40.973032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5f01f7f1-d00c-4f06-8fee-fafd655e5638 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:40.980637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f01f7f1-d00c-4f06-8fee-fafd655e5638 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:40.981554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f01f7f1-d00c-4f06-8fee-fafd655e5638 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:40.982724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f01f7f1-d00c-4f06-8fee-fafd655e5638 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:40.983432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f01f7f1-d00c-4f06-8fee-fafd655e5638 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:41.044824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-44ac1e4f-f7e0-4080-8511-467270cac05e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:41.045722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-44ac1e4f-f7e0-4080-8511-467270cac05e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:41.055001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44ac1e4f-f7e0-4080-8511-467270cac05e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:41.055757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44ac1e4f-f7e0-4080-8511-467270cac05e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:41.056732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44ac1e4f-f7e0-4080-8511-467270cac05e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:41.057354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44ac1e4f-f7e0-4080-8511-467270cac05e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:41.439383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-44ac1e4f-f7e0-4080-8511-467270cac05e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:41.460059 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-44ac1e4f-f7e0-4080-8511-467270cac05e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1391 microversion: 2.1 time: 0.419081 Jul 25 13:06:41.463521 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2492/4887] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:41 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1391 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:41.484293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-8a70b9bc-2cf1-429f-918b-3471a72b32cb req-ba5a6dcf-197d-432f-95ce-f0ec0452a6c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6cffb3b-3dc6-439e-9433-b9107bfccfcc", "name": "network-vif-plugged", "status": "completed", "tag": "adbcb40b-638c-4e4f-928f-2406ca66229f"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:41.491694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5f01f7f1-d00c-4f06-8fee-fafd655e5638 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:41.510280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-8a70b9bc-2cf1-429f-918b-3471a72b32cb req-ba5a6dcf-197d-432f-95ce-f0ec0452a6c9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:41.511207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-8a70b9bc-2cf1-429f-918b-3471a72b32cb req-ba5a6dcf-197d-432f-95ce-f0ec0452a6c9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:41.515067 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5f01f7f1-d00c-4f06-8fee-fafd655e5638 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1672 microversion: 2.1 time: 0.547767 Jul 25 13:06:41.515899 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2396/4888] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:40 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1672 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:41.527694 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-8a70b9bc-2cf1-429f-918b-3471a72b32cb req-ba5a6dcf-197d-432f-95ce-f0ec0452a6c9 service nova] Creating event network-vif-plugged:adbcb40b-638c-4e4f-928f-2406ca66229f for instance f6cffb3b-3dc6-439e-9433-b9107bfccfcc on n-h2-848886-15 Jul 25 13:06:41.535233 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-8a70b9bc-2cf1-429f-918b-3471a72b32cb req-ba5a6dcf-197d-432f-95ce-f0ec0452a6c9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069409 Jul 25 13:06:41.536583 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2493/4889] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:41.790857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-846418b6-9720-4b00-b5f2-e977b2a19b7d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:41.791809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-846418b6-9720-4b00-b5f2-e977b2a19b7d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:41.799312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-846418b6-9720-4b00-b5f2-e977b2a19b7d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:41.800101 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-846418b6-9720-4b00-b5f2-e977b2a19b7d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:41.801138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-846418b6-9720-4b00-b5f2-e977b2a19b7d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:41.801788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-846418b6-9720-4b00-b5f2-e977b2a19b7d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:41.861900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-57428cd1-52b7-4571-b68c-904975721e7b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:41.877601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-57428cd1-52b7-4571-b68c-904975721e7b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 58447a88-a579-4078-9af4-d6b7379de5cf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:41.896012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57428cd1-52b7-4571-b68c-904975721e7b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:41.896609 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57428cd1-52b7-4571-b68c-904975721e7b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:41.897420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57428cd1-52b7-4571-b68c-904975721e7b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:41.901165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57428cd1-52b7-4571-b68c-904975721e7b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:42.403640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-846418b6-9720-4b00-b5f2-e977b2a19b7d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:42.418665 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-846418b6-9720-4b00-b5f2-e977b2a19b7d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1202 microversion: 2.1 time: 0.632079 Jul 25 13:06:42.422902 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2397/4890] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:41 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1202 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:42.464009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-2257be82-a871-4837-b9ab-b2542f802a57 req-7ec9bf87-b7f2-4f53-b2bc-9d26f6859baa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3baaf3bb-a036-43d5-b1d0-799f44fb5ef3", "tag": "d22254f0-f882-4f44-966f-f95b96c6c9ff"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:42.470579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-57428cd1-52b7-4571-b68c-904975721e7b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:42.485900 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-57428cd1-52b7-4571-b68c-904975721e7b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf" status: 200 len: 1490 microversion: 2.1 time: 0.646422 Jul 25 13:06:42.487811 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2494/4891] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:41 2022] GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf => generated 1490 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:42.490129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2257be82-a871-4837-b9ab-b2542f802a57 req-7ec9bf87-b7f2-4f53-b2bc-9d26f6859baa service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:42.491070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2257be82-a871-4837-b9ab-b2542f802a57 req-7ec9bf87-b7f2-4f53-b2bc-9d26f6859baa service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:42.496767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9b65b1aa-bfc1-4902-9a74-d6197c1d95a6 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:42.500420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9b65b1aa-bfc1-4902-9a74-d6197c1d95a6 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:42.516246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b65b1aa-bfc1-4902-9a74-d6197c1d95a6 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:42.520142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b65b1aa-bfc1-4902-9a74-d6197c1d95a6 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:42.523353 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b65b1aa-bfc1-4902-9a74-d6197c1d95a6 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:42.524079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b65b1aa-bfc1-4902-9a74-d6197c1d95a6 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:42.527893 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-2257be82-a871-4837-b9ab-b2542f802a57 req-7ec9bf87-b7f2-4f53-b2bc-9d26f6859baa service nova] Creating event network-changed:d22254f0-f882-4f44-966f-f95b96c6c9ff for instance 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 on n-h1-848886-15 Jul 25 13:06:42.544067 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-2257be82-a871-4837-b9ab-b2542f802a57 req-7ec9bf87-b7f2-4f53-b2bc-9d26f6859baa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086494 Jul 25 13:06:42.544814 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2398/4892] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:06:42.559005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c09d479a-9ee2-4e4d-9e88-9b15ab494a76 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:42.561701 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c09d479a-9ee2-4e4d-9e88-9b15ab494a76 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:42.579884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c09d479a-9ee2-4e4d-9e88-9b15ab494a76 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:42.580348 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c09d479a-9ee2-4e4d-9e88-9b15ab494a76 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:42.581162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c09d479a-9ee2-4e4d-9e88-9b15ab494a76 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:42.581586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c09d479a-9ee2-4e4d-9e88-9b15ab494a76 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:43.040587 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9b65b1aa-bfc1-4902-9a74-d6197c1d95a6 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:43.063505 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9b65b1aa-bfc1-4902-9a74-d6197c1d95a6 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1391 microversion: 2.1 time: 0.568562 Jul 25 13:06:43.065193 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2495/4893] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:42 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1391 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:43.072953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-70145199-69e8-4c8c-a88f-12bd8bfc84c1 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:43.074350 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-70145199-69e8-4c8c-a88f-12bd8bfc84c1 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:43.084577 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70145199-69e8-4c8c-a88f-12bd8bfc84c1 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:43.085963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70145199-69e8-4c8c-a88f-12bd8bfc84c1 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:43.086965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70145199-69e8-4c8c-a88f-12bd8bfc84c1 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:43.087643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70145199-69e8-4c8c-a88f-12bd8bfc84c1 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:43.150904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c09d479a-9ee2-4e4d-9e88-9b15ab494a76 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:43.164823 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c09d479a-9ee2-4e4d-9e88-9b15ab494a76 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885" status: 200 len: 1490 microversion: 2.1 time: 0.618738 Jul 25 13:06:43.167486 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2399/4894] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:42 2022] GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 => generated 1490 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:43.192186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4e89b30e-03df-4039-8566-47ebc32968d2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:43.192820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4e89b30e-03df-4039-8566-47ebc32968d2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 58447a88-a579-4078-9af4-d6b7379de5cf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:43.208360 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e89b30e-03df-4039-8566-47ebc32968d2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:43.208820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e89b30e-03df-4039-8566-47ebc32968d2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:43.209608 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e89b30e-03df-4039-8566-47ebc32968d2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:43.210275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e89b30e-03df-4039-8566-47ebc32968d2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:43.359817 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-70145199-69e8-4c8c-a88f-12bd8bfc84c1 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:43.376444 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-70145199-69e8-4c8c-a88f-12bd8bfc84c1 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1605 microversion: 2.1 time: 0.309120 Jul 25 13:06:43.394169 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2496/4895] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:43 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1605 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:43.446179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4b611b38-b1cf-4617-8ed5-44305cb9caed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:43.446914 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4b611b38-b1cf-4617-8ed5-44305cb9caed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:43.463560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4b611b38-b1cf-4617-8ed5-44305cb9caed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:43.464600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4b611b38-b1cf-4617-8ed5-44305cb9caed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:43.465427 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4b611b38-b1cf-4617-8ed5-44305cb9caed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:43.465895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4b611b38-b1cf-4617-8ed5-44305cb9caed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:44.053015 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4e89b30e-03df-4039-8566-47ebc32968d2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:44.067797 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4e89b30e-03df-4039-8566-47ebc32968d2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf" status: 200 len: 1490 microversion: 2.1 time: 0.879524 Jul 25 13:06:44.068396 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2400/4896] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:43 2022] GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf => generated 1490 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:44.087091 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-32b67a50-329b-4ac7-97a6-93283aded0fb req-93aa6009-85df-4c91-a455-322c4cd66bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c5b9754-035f-4b86-888a-68aecbac2cee", "name": "network-vif-plugged", "status": "completed", "tag": "28882e01-e9b0-4de8-9520-5575425b9c64"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:44.119993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-32b67a50-329b-4ac7-97a6-93283aded0fb req-93aa6009-85df-4c91-a455-322c4cd66bdb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:44.120349 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-32b67a50-329b-4ac7-97a6-93283aded0fb req-93aa6009-85df-4c91-a455-322c4cd66bdb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:44.163004 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-32b67a50-329b-4ac7-97a6-93283aded0fb req-93aa6009-85df-4c91-a455-322c4cd66bdb service nova] Creating event network-vif-plugged:28882e01-e9b0-4de8-9520-5575425b9c64 for instance 4c5b9754-035f-4b86-888a-68aecbac2cee on n-h2-848886-15 Jul 25 13:06:44.182099 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-32b67a50-329b-4ac7-97a6-93283aded0fb req-93aa6009-85df-4c91-a455-322c4cd66bdb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098738 Jul 25 13:06:44.184437 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2401/4897] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:44.207424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aefa387f-09ac-4292-bea5-2bbf4499acfe tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:44.215107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-aefa387f-09ac-4292-bea5-2bbf4499acfe tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:44.232452 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aefa387f-09ac-4292-bea5-2bbf4499acfe tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:44.232927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aefa387f-09ac-4292-bea5-2bbf4499acfe tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:44.233750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aefa387f-09ac-4292-bea5-2bbf4499acfe tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:44.234214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aefa387f-09ac-4292-bea5-2bbf4499acfe tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:44.234492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4b611b38-b1cf-4617-8ed5-44305cb9caed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:44.255184 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4b611b38-b1cf-4617-8ed5-44305cb9caed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1202 microversion: 2.1 time: 0.813486 Jul 25 13:06:44.256321 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2497/4898] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:43 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1202 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:06:44.261182 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-21a6f4c4-e742-4856-8422-9238d461db8a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:44.261764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-21a6f4c4-e742-4856-8422-9238d461db8a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 58447a88-a579-4078-9af4-d6b7379de5cf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:44.276627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-21a6f4c4-e742-4856-8422-9238d461db8a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:44.277084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-21a6f4c4-e742-4856-8422-9238d461db8a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:44.281230 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-21a6f4c4-e742-4856-8422-9238d461db8a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:44.282433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-21a6f4c4-e742-4856-8422-9238d461db8a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:44.344867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-21a6f4c4-e742-4856-8422-9238d461db8a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 58447a88-a579-4078-9af4-d6b7379de5cf] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:06:44.493370 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-21a6f4c4-e742-4856-8422-9238d461db8a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "DELETE /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf" status: 204 len: 0 microversion: 2.1 time: 0.234874 Jul 25 13:06:44.494705 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2498/4899] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:06:44 2022] DELETE /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:06:44.504584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9671653f-0921-4446-9f2c-7e3b33d1e4d6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:44.506536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9671653f-0921-4446-9f2c-7e3b33d1e4d6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:44.516418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9671653f-0921-4446-9f2c-7e3b33d1e4d6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:44.517462 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9671653f-0921-4446-9f2c-7e3b33d1e4d6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:44.519793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9671653f-0921-4446-9f2c-7e3b33d1e4d6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:44.521138 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9671653f-0921-4446-9f2c-7e3b33d1e4d6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:44.553521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:44.576103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9671653f-0921-4446-9f2c-7e3b33d1e4d6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:44.576807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9671653f-0921-4446-9f2c-7e3b33d1e4d6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:44.577403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-9671653f-0921-4446-9f2c-7e3b33d1e4d6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lazy-loading 'fault' on Instance uuid f1870a72-72de-47e8-8776-d342d9ece98e {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:06:44.606488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-aefa387f-09ac-4292-bea5-2bbf4499acfe tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:44.624934 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aefa387f-09ac-4292-bea5-2bbf4499acfe tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1564 microversion: 2.1 time: 0.439451 Jul 25 13:06:44.626382 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2402/4900] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:44 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1564 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:44.642310 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cf37a2fd-ed66-4b76-b2e5-4ae3c65d9bb2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:44.645389 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cf37a2fd-ed66-4b76-b2e5-4ae3c65d9bb2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 58447a88-a579-4078-9af4-d6b7379de5cf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:44.669182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf37a2fd-ed66-4b76-b2e5-4ae3c65d9bb2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:44.671779 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf37a2fd-ed66-4b76-b2e5-4ae3c65d9bb2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:44.674051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf37a2fd-ed66-4b76-b2e5-4ae3c65d9bb2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:44.675729 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf37a2fd-ed66-4b76-b2e5-4ae3c65d9bb2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:44.687646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9671653f-0921-4446-9f2c-7e3b33d1e4d6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:44.701220 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9671653f-0921-4446-9f2c-7e3b33d1e4d6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 200 len: 1327 microversion: 2.1 time: 0.204792 Jul 25 13:06:44.703604 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2499/4901] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:44 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 1327 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:44.717075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-1d1f4fbb-697e-493a-98ca-9ee1ebb7d9ac req-a2cc39d7-f2f5-47dd-995f-34a93893562b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1870a72-72de-47e8-8776-d342d9ece98e", "name": "network-vif-deleted", "tag": "beeda1f8-ff74-41c7-a0bd-97d2a674f2af"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:44.752405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-1d1f4fbb-697e-493a-98ca-9ee1ebb7d9ac req-a2cc39d7-f2f5-47dd-995f-34a93893562b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:44.753194 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-1d1f4fbb-697e-493a-98ca-9ee1ebb7d9ac req-a2cc39d7-f2f5-47dd-995f-34a93893562b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:44.787532 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-1d1f4fbb-697e-493a-98ca-9ee1ebb7d9ac req-a2cc39d7-f2f5-47dd-995f-34a93893562b service nova] Creating event network-vif-deleted:beeda1f8-ff74-41c7-a0bd-97d2a674f2af for instance f1870a72-72de-47e8-8776-d342d9ece98e on n-h1-848886-15 Jul 25 13:06:44.815947 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-1d1f4fbb-697e-493a-98ca-9ee1ebb7d9ac req-a2cc39d7-f2f5-47dd-995f-34a93893562b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108637 Jul 25 13:06:44.817617 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2500/4902] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:44.827450 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4c2aa748-36da-4b22-baa4-cfef22cd8e19 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:44.831004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4c2aa748-36da-4b22-baa4-cfef22cd8e19 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:44.848306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c2aa748-36da-4b22-baa4-cfef22cd8e19 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:44.848734 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c2aa748-36da-4b22-baa4-cfef22cd8e19 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:44.849539 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c2aa748-36da-4b22-baa4-cfef22cd8e19 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:44.850025 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c2aa748-36da-4b22-baa4-cfef22cd8e19 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:45.150833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4c2aa748-36da-4b22-baa4-cfef22cd8e19 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:45.161325 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4c2aa748-36da-4b22-baa4-cfef22cd8e19 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1564 microversion: 2.1 time: 0.338225 Jul 25 13:06:45.186909 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2501/4903] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:44 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1564 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:45.221198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cf37a2fd-ed66-4b76-b2e5-4ae3c65d9bb2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:45.240136 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cf37a2fd-ed66-4b76-b2e5-4ae3c65d9bb2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf" status: 200 len: 1496 microversion: 2.1 time: 0.605394 Jul 25 13:06:45.243381 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2403/4904] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:44 2022] GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf => generated 1496 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:45.278332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-476cc287-92b3-4a9b-a755-b872e832fe56 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:45.279171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-476cc287-92b3-4a9b-a755-b872e832fe56 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:45.315808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-476cc287-92b3-4a9b-a755-b872e832fe56 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:45.316533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-476cc287-92b3-4a9b-a755-b872e832fe56 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:45.317504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-476cc287-92b3-4a9b-a755-b872e832fe56 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:45.318020 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-476cc287-92b3-4a9b-a755-b872e832fe56 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:45.747003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7d6b0ee5-b5a8-4d63-afdc-7a94ee713349 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:45.748327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7d6b0ee5-b5a8-4d63-afdc-7a94ee713349 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:45.776657 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7d6b0ee5-b5a8-4d63-afdc-7a94ee713349 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:45.777121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7d6b0ee5-b5a8-4d63-afdc-7a94ee713349 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:45.785289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7d6b0ee5-b5a8-4d63-afdc-7a94ee713349 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:45.786693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7d6b0ee5-b5a8-4d63-afdc-7a94ee713349 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:45.814198 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-7d6b0ee5-b5a8-4d63-afdc-7a94ee713349 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] HTTP exception thrown: Instance f1870a72-72de-47e8-8776-d342d9ece98e could not be found. Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7d6b0ee5-b5a8-4d63-afdc-7a94ee713349 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Request method failure captured: Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e HTTP/1.1 Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pSCjjOUwJBu27M5A9MAS8o0O9uH59U0acLx6g4qcIv23mWGrrOjdt2IgvHoN5SP9_hokB-pDlt0bhwjuhztdf3OfFL8q2AxT_lIsoS4eI1n-QKNDGNhCYx3Rf762DwHeDuXOtp5hrUjGY9docgShhhp_Ocv4GQAeCWMuSoQhVJjgBY Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 4bb3fd31125b4879bd1f58cd3d1358a3 Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AttachVolumeTestJSON-1292371232 Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4bb3fd31125b4879bd1f58cd3d1358a3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4bb3fd31125b4879bd1f58cd3d1358a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4bb3fd31125b4879bd1f58cd3d1358a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4bb3fd31125b4879bd1f58cd3d1358a3"}]}] Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AttachVolumeTestJSON-1292371232 Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 4bb3fd31125b4879bd1f58cd3d1358a3 Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1292371232 Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AttachVolumeTestJSON-1292371232-project Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 3dc3da4ae9f444e7a4471e509868d088 Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AttachVolumeTestJSON-1292371232-project Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance f1870a72-72de-47e8-8776-d342d9ece98e could not be found. Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'f1870a72-72de-47e8-8776-d342d9ece98e'} Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1870a72-72de-47e8-8776-d342d9ece98e could not be found. Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1870a72-72de-47e8-8776-d342d9ece98e could not be found. Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:06:45.816191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:06:45.819685 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:06:45.819685 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:06:45.819685 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:06:45.819685 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:06:45.819685 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:06:45.819685 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1870a72-72de-47e8-8776-d342d9ece98e could not be found. Jul 25 13:06:45.819685 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:06:45.819685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7d6b0ee5-b5a8-4d63-afdc-7a94ee713349 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Returning 404 to user: Instance f1870a72-72de-47e8-8776-d342d9ece98e could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:06:45.819685 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7d6b0ee5-b5a8-4d63-afdc-7a94ee713349 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 404 len: 111 microversion: 2.1 time: 0.096663 Jul 25 13:06:45.822465 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2404/4905] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:45 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:06:45.830458 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8c33acab-312b-43d7-ba33-d301635bca9b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '.version_select at 0x7efcf9726430>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:45.858152 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8c33acab-312b-43d7-ba33-d301635bca9b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064422132" status: 202 len: 0 microversion: 2.1 time: 0.033769 Jul 25 13:06:45.862991 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2405/4906] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Jul 25 13:06:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064422132 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:06:46.265568 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3e817c95-e588-411c-a560-57af76232157 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:46.266446 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3e817c95-e588-411c-a560-57af76232157 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 58447a88-a579-4078-9af4-d6b7379de5cf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:46.287049 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3e817c95-e588-411c-a560-57af76232157 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:46.287514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3e817c95-e588-411c-a560-57af76232157 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:46.289080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3e817c95-e588-411c-a560-57af76232157 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:46.289705 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3e817c95-e588-411c-a560-57af76232157 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:46.598704 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-476cc287-92b3-4a9b-a755-b872e832fe56 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:46.608397 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-476cc287-92b3-4a9b-a755-b872e832fe56 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1202 microversion: 2.1 time: 1.335543 Jul 25 13:06:46.610427 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2502/4907] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:45 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1202 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:46.797584 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3e817c95-e588-411c-a560-57af76232157 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:46.816743 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3e817c95-e588-411c-a560-57af76232157 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf" status: 200 len: 1496 microversion: 2.1 time: 0.555463 Jul 25 13:06:46.819183 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2406/4908] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:46 2022] GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf => generated 1496 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:06:47.631714 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b0231ae9-8d1b-4b8a-9ab4-0470b21fe296 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:47.641299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b0231ae9-8d1b-4b8a-9ab4-0470b21fe296 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:47.666186 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0231ae9-8d1b-4b8a-9ab4-0470b21fe296 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:47.666828 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0231ae9-8d1b-4b8a-9ab4-0470b21fe296 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:47.667794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0231ae9-8d1b-4b8a-9ab4-0470b21fe296 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:47.672623 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0231ae9-8d1b-4b8a-9ab4-0470b21fe296 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:47.709849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d401108b-c8df-48f8-81e4-26b1d7d7044b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Action: 'create', calling method: .version_select at 0x7efcf8c4c1f0>, body: {"keypair": {"name": "tempest-keypair-1636914572", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLW/bvgIfPeIKKcIZkqNwcicjGeiQ8kgdsijR/Av/NWGgWoWcgOml9tmDBwyktU3PgHc2rfi9e4GHlXvW9wWCLR3Xb4eDrFwQePbSHpM6cXcP4+KZS5QZsM3FkG5U2b8HQ=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:47.807321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-d401108b-c8df-48f8-81e4-26b1d7d7044b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Getting quotas for project 4bb3fd31125b4879bd1f58cd3d1358a3. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:06:47.852852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-d401108b-c8df-48f8-81e4-26b1d7d7044b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Getting quotas for user 3dc3da4ae9f444e7a4471e509868d088 and project 4bb3fd31125b4879bd1f58cd3d1358a3. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:06:47.940480 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d401108b-c8df-48f8-81e4-26b1d7d7044b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.234582 Jul 25 13:06:47.941976 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2407/4909] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:06:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:47.947598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-320d9c2e-da14-4bd8-93ea-c35d1d062050 req-2bacaf21-7c89-4ae1-a7cc-ba69818d461e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58447a88-a579-4078-9af4-d6b7379de5cf", "name": "network-vif-deleted", "tag": "a79d04cd-d8f6-4ab1-ab81-2465b124b9dd"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:47.959939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-320d9c2e-da14-4bd8-93ea-c35d1d062050 req-2bacaf21-7c89-4ae1-a7cc-ba69818d461e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:47.960749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-320d9c2e-da14-4bd8-93ea-c35d1d062050 req-2bacaf21-7c89-4ae1-a7cc-ba69818d461e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:47.982970 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:47.986049 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-320d9c2e-da14-4bd8-93ea-c35d1d062050 req-2bacaf21-7c89-4ae1-a7cc-ba69818d461e service nova] Creating event network-vif-deleted:a79d04cd-d8f6-4ab1-ab81-2465b124b9dd for instance 58447a88-a579-4078-9af4-d6b7379de5cf on n-h1-848886-15 Jul 25 13:06:47.992534 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-320d9c2e-da14-4bd8-93ea-c35d1d062050 req-2bacaf21-7c89-4ae1-a7cc-ba69818d461e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048677 Jul 25 13:06:47.994248 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2408/4910] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:48.000299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7b0d59d4-0a59-4b1b-84b9-caa02b2dbcb3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:48.001466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7b0d59d4-0a59-4b1b-84b9-caa02b2dbcb3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 58447a88-a579-4078-9af4-d6b7379de5cf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:48.016838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b0d59d4-0a59-4b1b-84b9-caa02b2dbcb3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:48.019860 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b0d59d4-0a59-4b1b-84b9-caa02b2dbcb3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:48.020871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b0d59d4-0a59-4b1b-84b9-caa02b2dbcb3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:48.022259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b0d59d4-0a59-4b1b-84b9-caa02b2dbcb3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:48.102665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b0d59d4-0a59-4b1b-84b9-caa02b2dbcb3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:48.103120 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b0d59d4-0a59-4b1b-84b9-caa02b2dbcb3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:48.111030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-7b0d59d4-0a59-4b1b-84b9-caa02b2dbcb3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lazy-loading 'fault' on Instance uuid 58447a88-a579-4078-9af4-d6b7379de5cf {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:06:48.254110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7b0d59d4-0a59-4b1b-84b9-caa02b2dbcb3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:48.267337 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7b0d59d4-0a59-4b1b-84b9-caa02b2dbcb3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf" status: 200 len: 1299 microversion: 2.1 time: 0.271428 Jul 25 13:06:48.281798 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2409/4911] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:47 2022] GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf => generated 1299 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:48.290662 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b0231ae9-8d1b-4b8a-9ab4-0470b21fe296 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:48.306212 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b0231ae9-8d1b-4b8a-9ab4-0470b21fe296 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1388 microversion: 2.1 time: 0.677203 Jul 25 13:06:48.317006 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2503/4912] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:47 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1388 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:48.334811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c2f8d511-803c-4b6d-8ccf-3c38c6844de5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:48.335664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c2f8d511-803c-4b6d-8ccf-3c38c6844de5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:48.344309 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2f8d511-803c-4b6d-8ccf-3c38c6844de5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:48.345323 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2f8d511-803c-4b6d-8ccf-3c38c6844de5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:48.346719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2f8d511-803c-4b6d-8ccf-3c38c6844de5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:48.347865 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2f8d511-803c-4b6d-8ccf-3c38c6844de5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:48.743640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c2f8d511-803c-4b6d-8ccf-3c38c6844de5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:48.756700 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c2f8d511-803c-4b6d-8ccf-3c38c6844de5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1388 microversion: 2.1 time: 0.426438 Jul 25 13:06:48.757305 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2410/4913] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:48 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1388 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:48.781104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a3ee2223-b338-4622-86cf-d9ca345b79de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:48.782516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a3ee2223-b338-4622-86cf-d9ca345b79de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:48.791060 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3ee2223-b338-4622-86cf-d9ca345b79de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:48.791556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3ee2223-b338-4622-86cf-d9ca345b79de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:48.792686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3ee2223-b338-4622-86cf-d9ca345b79de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:48.793136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3ee2223-b338-4622-86cf-d9ca345b79de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:49.226663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a3ee2223-b338-4622-86cf-d9ca345b79de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:49.235855 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a3ee2223-b338-4622-86cf-d9ca345b79de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1388 microversion: 2.1 time: 0.459343 Jul 25 13:06:49.240351 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2504/4914] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:48 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1388 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:49.259943 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-27dcd3ed-b6b5-4118-92d9-793091a2ddc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:49.260687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-27dcd3ed-b6b5-4118-92d9-793091a2ddc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:49.271925 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27dcd3ed-b6b5-4118-92d9-793091a2ddc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:49.272733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27dcd3ed-b6b5-4118-92d9-793091a2ddc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:49.274095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27dcd3ed-b6b5-4118-92d9-793091a2ddc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:49.275410 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27dcd3ed-b6b5-4118-92d9-793091a2ddc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:49.290125 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b6a0530c-633b-46c6-97d1-e9ba57ede9e0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:49.291683 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b6a0530c-633b-46c6-97d1-e9ba57ede9e0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 58447a88-a579-4078-9af4-d6b7379de5cf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:49.308685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6a0530c-633b-46c6-97d1-e9ba57ede9e0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:49.310054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6a0530c-633b-46c6-97d1-e9ba57ede9e0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:49.311506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6a0530c-633b-46c6-97d1-e9ba57ede9e0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:49.312428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6a0530c-633b-46c6-97d1-e9ba57ede9e0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:49.331208 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-b6a0530c-633b-46c6-97d1-e9ba57ede9e0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] HTTP exception thrown: Instance 58447a88-a579-4078-9af4-d6b7379de5cf could not be found. Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b6a0530c-633b-46c6-97d1-e9ba57ede9e0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Request method failure captured: Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf HTTP/1.1 Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pTdZnYy3zWCXLN8GI-lAb9Aac2xutmWdntWmHOJQQOAHuSaLRru4vmbdxH-2ipAsIwdgHGRBCQV52EgrlBqV5LzQtSAIs0OqruuNBUIA1ZYGpGU7ybcvN2tekv0vVPxk7wJZaAmUwppQmT0JDG4pBCSl5Rw9dXMoK1Y6yvluyRvyio Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersTestJSON-733750618 Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebb6a07295234370aa1aa5067b8ee930", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}] Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersTestJSON-733750618 Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersTestJSON-733750618 Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersTestJSON-733750618-project Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 60d84eb7c45449cbad3141d9f363e693 Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersTestJSON-733750618-project Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 58447a88-a579-4078-9af4-d6b7379de5cf could not be found. Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '58447a88-a579-4078-9af4-d6b7379de5cf'} Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58447a88-a579-4078-9af4-d6b7379de5cf could not be found. Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58447a88-a579-4078-9af4-d6b7379de5cf could not be found. Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:06:49.334431 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:06:49.337722 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:06:49.337722 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:06:49.337722 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:06:49.337722 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:06:49.337722 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58447a88-a579-4078-9af4-d6b7379de5cf could not be found. Jul 25 13:06:49.337722 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:06:49.340772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b6a0530c-633b-46c6-97d1-e9ba57ede9e0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Returning 404 to user: Instance 58447a88-a579-4078-9af4-d6b7379de5cf could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:06:49.344756 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b6a0530c-633b-46c6-97d1-e9ba57ede9e0 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf" status: 404 len: 111 microversion: 2.1 time: 0.059608 Jul 25 13:06:49.346361 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2505/4915] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:49 2022] GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 13:06:49.362964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f38f9630-9da6-4c96-aa90-1fdc80741d7a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:49.363800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f38f9630-9da6-4c96-aa90-1fdc80741d7a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:49.366571 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-27dcd3ed-b6b5-4118-92d9-793091a2ddc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:06:49.373017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f38f9630-9da6-4c96-aa90-1fdc80741d7a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:49.373746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f38f9630-9da6-4c96-aa90-1fdc80741d7a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:49.374733 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f38f9630-9da6-4c96-aa90-1fdc80741d7a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:49.375421 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f38f9630-9da6-4c96-aa90-1fdc80741d7a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:49.409631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f38f9630-9da6-4c96-aa90-1fdc80741d7a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:06:49.573434 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f38f9630-9da6-4c96-aa90-1fdc80741d7a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885" status: 204 len: 0 microversion: 2.1 time: 0.222967 Jul 25 13:06:49.574382 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2506/4916] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:06:49 2022] DELETE /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:06:49.587651 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-27dcd3ed-b6b5-4118-92d9-793091a2ddc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 204 len: 0 microversion: 2.1 time: 0.332831 Jul 25 13:06:49.588854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-127c7b8e-4448-4446-8c16-6e6c672495d7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:49.589626 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2411/4917] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:06:49 2022] DELETE /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:06:49.593673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-127c7b8e-4448-4446-8c16-6e6c672495d7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:49.608205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-819f0bbf-0aa4-49c8-a006-ba16b72d9f22 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:49.609188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-819f0bbf-0aa4-49c8-a006-ba16b72d9f22 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:49.609589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-127c7b8e-4448-4446-8c16-6e6c672495d7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:49.610452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-127c7b8e-4448-4446-8c16-6e6c672495d7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:49.614435 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-127c7b8e-4448-4446-8c16-6e6c672495d7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:49.615169 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-127c7b8e-4448-4446-8c16-6e6c672495d7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:49.625235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-819f0bbf-0aa4-49c8-a006-ba16b72d9f22 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:49.631534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-819f0bbf-0aa4-49c8-a006-ba16b72d9f22 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:49.636850 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-819f0bbf-0aa4-49c8-a006-ba16b72d9f22 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:49.638409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-819f0bbf-0aa4-49c8-a006-ba16b72d9f22 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:50.085858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-819f0bbf-0aa4-49c8-a006-ba16b72d9f22 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:50.100891 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-819f0bbf-0aa4-49c8-a006-ba16b72d9f22 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1394 microversion: 2.1 time: 0.504308 Jul 25 13:06:50.101506 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2412/4918] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:49 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1394 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:50.123852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-127c7b8e-4448-4446-8c16-6e6c672495d7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:50.142309 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-127c7b8e-4448-4446-8c16-6e6c672495d7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885" status: 200 len: 1496 microversion: 2.1 time: 0.560745 Jul 25 13:06:50.143247 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2507/4919] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:49 2022] GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 => generated 1496 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:06:50.267044 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6e1c2e42-d71c-43cc-9e7d-3afdcae4b077 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-791841644", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "974e2b05-9cf4-4edf-a41e-e53067f36c57"}], "security_groups": [{"name": "tempest-securitygroup--2073523926"}], "key_name": "tempest-keypair-1636914572", "user_data": "}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:50.813077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-6e1c2e42-d71c-43cc-9e7d-3afdcae4b077 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] validate_networks() for [('974e2b05-9cf4-4edf-a41e-e53067f36c57', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:06:51.126375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-85b0da4f-03b3-40df-b1df-3bee9545d338 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:51.127747 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-85b0da4f-03b3-40df-b1df-3bee9545d338 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:51.136588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85b0da4f-03b3-40df-b1df-3bee9545d338 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:51.137042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85b0da4f-03b3-40df-b1df-3bee9545d338 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:51.137860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85b0da4f-03b3-40df-b1df-3bee9545d338 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:51.138494 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85b0da4f-03b3-40df-b1df-3bee9545d338 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:51.897664 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-85b0da4f-03b3-40df-b1df-3bee9545d338 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:51.908531 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-85b0da4f-03b3-40df-b1df-3bee9545d338 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1394 microversion: 2.1 time: 0.787522 Jul 25 13:06:51.910571 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2508/4920] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:51 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1394 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:06:51.916014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f5aae665-976e-430b-9dd1-054d8016c0f1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:51.916840 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f5aae665-976e-430b-9dd1-054d8016c0f1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:51.923548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5aae665-976e-430b-9dd1-054d8016c0f1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:51.924270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5aae665-976e-430b-9dd1-054d8016c0f1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:51.925202 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5aae665-976e-430b-9dd1-054d8016c0f1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:51.925774 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5aae665-976e-430b-9dd1-054d8016c0f1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:52.511271 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f5aae665-976e-430b-9dd1-054d8016c0f1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:52.523018 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f5aae665-976e-430b-9dd1-054d8016c0f1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885" status: 200 len: 1496 microversion: 2.1 time: 0.611153 Jul 25 13:06:52.533919 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2509/4921] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:51 2022] GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 => generated 1496 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:52.539893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-54a55c0f-d2d8-4967-bd6a-d6ed13e6c62b tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:52.547115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-54a55c0f-d2d8-4967-bd6a-d6ed13e6c62b tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:52.562973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-54a55c0f-d2d8-4967-bd6a-d6ed13e6c62b tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:52.569142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-54a55c0f-d2d8-4967-bd6a-d6ed13e6c62b tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:52.571443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-54a55c0f-d2d8-4967-bd6a-d6ed13e6c62b tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:52.572257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-54a55c0f-d2d8-4967-bd6a-d6ed13e6c62b tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:52.765296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-6e1c2e42-d71c-43cc-9e7d-3afdcae4b077 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:06:52.767651 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-6e1c2e42-d71c-43cc-9e7d-3afdcae4b077 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:06:52.768411 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-6e1c2e42-d71c-43cc-9e7d-3afdcae4b077 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:06:52.768999 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-6e1c2e42-d71c-43cc-9e7d-3afdcae4b077 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:06:52.770463 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-6e1c2e42-d71c-43cc-9e7d-3afdcae4b077 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:06:52.787355 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6e1c2e42-d71c-43cc-9e7d-3afdcae4b077 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:52.789242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6e1c2e42-d71c-43cc-9e7d-3afdcae4b077 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:52.792791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6e1c2e42-d71c-43cc-9e7d-3afdcae4b077 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:52.794077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6e1c2e42-d71c-43cc-9e7d-3afdcae4b077 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:52.825197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-6e1c2e42-d71c-43cc-9e7d-3afdcae4b077 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Getting quotas for project 4bb3fd31125b4879bd1f58cd3d1358a3. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:06:52.829455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:52.840088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-6e1c2e42-d71c-43cc-9e7d-3afdcae4b077 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Getting quotas for user 3dc3da4ae9f444e7a4471e509868d088 and project 4bb3fd31125b4879bd1f58cd3d1358a3. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:06:52.841923 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-54a55c0f-d2d8-4967-bd6a-d6ed13e6c62b tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:52.853152 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-54a55c0f-d2d8-4967-bd6a-d6ed13e6c62b tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1564 microversion: 2.1 time: 0.317085 Jul 25 13:06:52.854863 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2510/4922] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:52 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1564 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:52.868685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-75c7da92-5ab3-417f-9148-7d33d7c73f8f req-e58cff73-5eff-49fe-96c6-6aae79ee2641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6cffb3b-3dc6-439e-9433-b9107bfccfcc", "tag": "adbcb40b-638c-4e4f-928f-2406ca66229f"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:52.900221 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-75c7da92-5ab3-417f-9148-7d33d7c73f8f req-e58cff73-5eff-49fe-96c6-6aae79ee2641 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:52.901044 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-75c7da92-5ab3-417f-9148-7d33d7c73f8f req-e58cff73-5eff-49fe-96c6-6aae79ee2641 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:52.914208 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6e1c2e42-d71c-43cc-9e7d-3afdcae4b077 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:06:52.919467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6e1c2e42-d71c-43cc-9e7d-3afdcae4b077 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:06:52.931126 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-75c7da92-5ab3-417f-9148-7d33d7c73f8f req-e58cff73-5eff-49fe-96c6-6aae79ee2641 service nova] Creating event network-changed:adbcb40b-638c-4e4f-928f-2406ca66229f for instance f6cffb3b-3dc6-439e-9433-b9107bfccfcc on n-h2-848886-15 Jul 25 13:06:52.942180 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-75c7da92-5ab3-417f-9148-7d33d7c73f8f req-e58cff73-5eff-49fe-96c6-6aae79ee2641 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085811 Jul 25 13:06:52.946642 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2511/4923] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:52.960903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-958648ab-1137-4d49-b7f0-d67279ef1bba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:52.961993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-958648ab-1137-4d49-b7f0-d67279ef1bba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:52.981126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-958648ab-1137-4d49-b7f0-d67279ef1bba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:52.982278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-958648ab-1137-4d49-b7f0-d67279ef1bba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:52.983461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-958648ab-1137-4d49-b7f0-d67279ef1bba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:52.985594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-958648ab-1137-4d49-b7f0-d67279ef1bba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:52.999318 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6e1c2e42-d71c-43cc-9e7d-3afdcae4b077 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.734281 Jul 25 13:06:53.001232 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2413/4924] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:06:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 2739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 13:06:53.013727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-286206bb-5890-4783-9df7-168e8b31b4ec tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:53.014111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-286206bb-5890-4783-9df7-168e8b31b4ec tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:53.880068 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-286206bb-5890-4783-9df7-168e8b31b4ec tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:53.888086 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-286206bb-5890-4783-9df7-168e8b31b4ec tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9" status: 200 len: 1237 microversion: 2.1 time: 0.879982 Jul 25 13:06:53.900067 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2414/4925] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:53 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9 => generated 1237 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:06:53.907615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c6d327df-9d20-4222-8f79-82940f149feb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:53.909059 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c6d327df-9d20-4222-8f79-82940f149feb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:53.930780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c6d327df-9d20-4222-8f79-82940f149feb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:53.931524 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c6d327df-9d20-4222-8f79-82940f149feb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:53.932465 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c6d327df-9d20-4222-8f79-82940f149feb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:53.933042 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c6d327df-9d20-4222-8f79-82940f149feb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:53.987598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c6d327df-9d20-4222-8f79-82940f149feb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:53.988241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c6d327df-9d20-4222-8f79-82940f149feb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:53.988848 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-c6d327df-9d20-4222-8f79-82940f149feb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lazy-loading 'fault' on Instance uuid e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:06:54.091492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c6d327df-9d20-4222-8f79-82940f149feb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:54.107774 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c6d327df-9d20-4222-8f79-82940f149feb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885" status: 200 len: 1299 microversion: 2.1 time: 0.205665 Jul 25 13:06:54.109716 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2415/4926] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:53 2022] GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 => generated 1299 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:54.236771 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-958648ab-1137-4d49-b7f0-d67279ef1bba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:54.290283 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-958648ab-1137-4d49-b7f0-d67279ef1bba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1394 microversion: 2.1 time: 1.339069 Jul 25 13:06:54.315928 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2512/4927] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:52 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1394 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:54.921225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5d510b87-4fab-45df-9a1e-13aabc49ef5f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:54.923412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5d510b87-4fab-45df-9a1e-13aabc49ef5f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:54.938890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d510b87-4fab-45df-9a1e-13aabc49ef5f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:54.941728 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d510b87-4fab-45df-9a1e-13aabc49ef5f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:54.947071 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d510b87-4fab-45df-9a1e-13aabc49ef5f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:54.947881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d510b87-4fab-45df-9a1e-13aabc49ef5f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:55.028999 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-01fa48e5-b6bc-45ab-bbe4-184707947b79 req-4e4cae0a-a2e9-4ee4-a0b6-cc85b983cc71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885", "name": "network-vif-deleted", "tag": "dbd358de-1cec-4153-926f-cace9fc21096"}, {"server_uuid": "4c5b9754-035f-4b86-888a-68aecbac2cee", "name": "network-vif-deleted", "tag": "28882e01-e9b0-4de8-9520-5575425b9c64"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:55.049752 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-01fa48e5-b6bc-45ab-bbe4-184707947b79 req-4e4cae0a-a2e9-4ee4-a0b6-cc85b983cc71 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:55.053729 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-01fa48e5-b6bc-45ab-bbe4-184707947b79 req-4e4cae0a-a2e9-4ee4-a0b6-cc85b983cc71 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:55.090561 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-01fa48e5-b6bc-45ab-bbe4-184707947b79 req-4e4cae0a-a2e9-4ee4-a0b6-cc85b983cc71 service nova] Creating event network-vif-deleted:dbd358de-1cec-4153-926f-cace9fc21096 for instance e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 on n-h1-848886-15 Jul 25 13:06:55.096826 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-01fa48e5-b6bc-45ab-bbe4-184707947b79 req-4e4cae0a-a2e9-4ee4-a0b6-cc85b983cc71 service nova] Creating event network-vif-deleted:28882e01-e9b0-4de8-9520-5575425b9c64 for instance 4c5b9754-035f-4b86-888a-68aecbac2cee on n-h2-848886-15 Jul 25 13:06:55.121759 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-01fa48e5-b6bc-45ab-bbe4-184707947b79 req-4e4cae0a-a2e9-4ee4-a0b6-cc85b983cc71 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.096589 Jul 25 13:06:55.123194 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2513/4928] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:55.136844 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-280b2e68-2f43-4ab8-ab3b-1d18fafcfeab tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:55.137989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-280b2e68-2f43-4ab8-ab3b-1d18fafcfeab tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:55.154700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-280b2e68-2f43-4ab8-ab3b-1d18fafcfeab tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:55.160529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-280b2e68-2f43-4ab8-ab3b-1d18fafcfeab tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:55.165637 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-280b2e68-2f43-4ab8-ab3b-1d18fafcfeab tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:55.166377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-280b2e68-2f43-4ab8-ab3b-1d18fafcfeab tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:55.197335 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-280b2e68-2f43-4ab8-ab3b-1d18fafcfeab tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] HTTP exception thrown: Instance e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 could not be found. Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-280b2e68-2f43-4ab8-ab3b-1d18fafcfeab tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Request method failure captured: Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 HTTP/1.1 Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pTdZnYy3zWCXLN8GI-lAb9Aac2xutmWdntWmHOJQQOAHuSaLRru4vmbdxH-2ipAsIwdgHGRBCQV52EgrlBqV5LzQtSAIs0OqruuNBUIA1ZYGpGU7ybcvN2tekv0vVPxk7wJZaAmUwppQmT0JDG4pBCSl5Rw9dXMoK1Y6yvluyRvyio Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersTestJSON-733750618 Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebb6a07295234370aa1aa5067b8ee930", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}] Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersTestJSON-733750618 Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersTestJSON-733750618 Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersTestJSON-733750618-project Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 60d84eb7c45449cbad3141d9f363e693 Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersTestJSON-733750618-project Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 could not be found. Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885'} Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 could not be found. Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 could not be found. Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:06:55.199033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:06:55.204044 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:06:55.204044 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:06:55.204044 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:06:55.204044 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:06:55.204044 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 could not be found. Jul 25 13:06:55.204044 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:06:55.204044 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-280b2e68-2f43-4ab8-ab3b-1d18fafcfeab tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Returning 404 to user: Instance e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:06:55.204044 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-280b2e68-2f43-4ab8-ab3b-1d18fafcfeab tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885" status: 404 len: 111 microversion: 2.1 time: 0.068612 Jul 25 13:06:55.206227 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2514/4929] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:55 2022] GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:06:55.215322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5d510b87-4fab-45df-9a1e-13aabc49ef5f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:55.233131 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5d510b87-4fab-45df-9a1e-13aabc49ef5f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9" status: 200 len: 1289 microversion: 2.1 time: 0.316899 Jul 25 13:06:55.233734 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2416/4930] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:54 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9 => generated 1289 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:55.333697 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8686d4ab-6c43-451c-9d4e-b30e73f35343 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:55.334338 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8686d4ab-6c43-451c-9d4e-b30e73f35343 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:55.344559 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8686d4ab-6c43-451c-9d4e-b30e73f35343 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:55.354602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8686d4ab-6c43-451c-9d4e-b30e73f35343 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:55.355780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8686d4ab-6c43-451c-9d4e-b30e73f35343 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:55.356536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8686d4ab-6c43-451c-9d4e-b30e73f35343 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:55.416704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-475e85bf-ae33-4e7b-b738-934f03b7e2ed tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1576977242", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "41e863a3-713c-4d35-a204-58098a16a6e3"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:55.506317 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-475e85bf-ae33-4e7b-b738-934f03b7e2ed tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] validate_networks() for [('41e863a3-713c-4d35-a204-58098a16a6e3', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:06:55.539051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8686d4ab-6c43-451c-9d4e-b30e73f35343 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:55.550752 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8686d4ab-6c43-451c-9d4e-b30e73f35343 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1187 microversion: 2.1 time: 0.220917 Jul 25 13:06:55.551537 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2515/4931] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:55 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1187 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:56.259504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2b18994c-e2f0-4e29-a3ea-d13e1b806c67 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:56.260231 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2b18994c-e2f0-4e29-a3ea-d13e1b806c67 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:56.282802 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2b18994c-e2f0-4e29-a3ea-d13e1b806c67 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:56.283291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2b18994c-e2f0-4e29-a3ea-d13e1b806c67 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:56.287621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2b18994c-e2f0-4e29-a3ea-d13e1b806c67 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:56.288330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2b18994c-e2f0-4e29-a3ea-d13e1b806c67 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:56.796811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-475e85bf-ae33-4e7b-b738-934f03b7e2ed tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:06:56.797885 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-475e85bf-ae33-4e7b-b738-934f03b7e2ed tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:06:56.798328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-475e85bf-ae33-4e7b-b738-934f03b7e2ed tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:06:56.798817 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-475e85bf-ae33-4e7b-b738-934f03b7e2ed tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:06:56.799337 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-475e85bf-ae33-4e7b-b738-934f03b7e2ed tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:06:56.816574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-475e85bf-ae33-4e7b-b738-934f03b7e2ed tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:56.817163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-475e85bf-ae33-4e7b-b738-934f03b7e2ed tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:56.822625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-475e85bf-ae33-4e7b-b738-934f03b7e2ed tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:56.823421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-475e85bf-ae33-4e7b-b738-934f03b7e2ed tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:56.873144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-475e85bf-ae33-4e7b-b738-934f03b7e2ed tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Getting quotas for project ebb6a07295234370aa1aa5067b8ee930. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:06:56.883688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-475e85bf-ae33-4e7b-b738-934f03b7e2ed tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Getting quotas for user 60d84eb7c45449cbad3141d9f363e693 and project ebb6a07295234370aa1aa5067b8ee930. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:06:56.903611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-475e85bf-ae33-4e7b-b738-934f03b7e2ed tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:06:56.909214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-475e85bf-ae33-4e7b-b738-934f03b7e2ed tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:06:57.017554 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-475e85bf-ae33-4e7b-b738-934f03b7e2ed tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.601917 Jul 25 13:06:57.020913 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2417/4932] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:06:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 13:06:57.036123 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4c274a84-4eda-4f4a-8fe7-4bf479262c60 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:57.055973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4c274a84-4eda-4f4a-8fe7-4bf479262c60 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:57.096973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c274a84-4eda-4f4a-8fe7-4bf479262c60 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:57.097497 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c274a84-4eda-4f4a-8fe7-4bf479262c60 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:57.099287 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c274a84-4eda-4f4a-8fe7-4bf479262c60 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:57.099732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c274a84-4eda-4f4a-8fe7-4bf479262c60 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:57.326310 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4c274a84-4eda-4f4a-8fe7-4bf479262c60 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:57.337413 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4c274a84-4eda-4f4a-8fe7-4bf479262c60 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1187 microversion: 2.1 time: 0.312282 Jul 25 13:06:57.342009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2b18994c-e2f0-4e29-a3ea-d13e1b806c67 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:57.343349 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2418/4933] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:57 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1187 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:57.351619 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2b18994c-e2f0-4e29-a3ea-d13e1b806c67 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9" status: 200 len: 1363 microversion: 2.1 time: 1.096461 Jul 25 13:06:57.356292 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2516/4934] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:56 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9 => generated 1363 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:06:57.367370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-607203a2-dc5e-44ea-be1e-f64f487e4fc7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:57.378023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-607203a2-dc5e-44ea-be1e-f64f487e4fc7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:57.551198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-607203a2-dc5e-44ea-be1e-f64f487e4fc7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:57.560654 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-607203a2-dc5e-44ea-be1e-f64f487e4fc7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226" status: 200 len: 1209 microversion: 2.1 time: 0.216082 Jul 25 13:06:57.562750 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2419/4935] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:57 2022] GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 => generated 1209 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:58.368635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bf1e53d9-bc88-446e-bc39-801dff9cf8b3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:58.369684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bf1e53d9-bc88-446e-bc39-801dff9cf8b3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:58.379156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3aff5fe5-11a4-4732-ad27-9741876d9927 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:58.380209 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3aff5fe5-11a4-4732-ad27-9741876d9927 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:58.397856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3aff5fe5-11a4-4732-ad27-9741876d9927 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:58.401186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3aff5fe5-11a4-4732-ad27-9741876d9927 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:58.405870 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3aff5fe5-11a4-4732-ad27-9741876d9927 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:58.408901 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3aff5fe5-11a4-4732-ad27-9741876d9927 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:58.419508 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf1e53d9-bc88-446e-bc39-801dff9cf8b3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:58.420279 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf1e53d9-bc88-446e-bc39-801dff9cf8b3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:58.421619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf1e53d9-bc88-446e-bc39-801dff9cf8b3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:58.422377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bf1e53d9-bc88-446e-bc39-801dff9cf8b3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:58.533698 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:58.669514 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bf1e53d9-bc88-446e-bc39-801dff9cf8b3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:58.679600 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bf1e53d9-bc88-446e-bc39-801dff9cf8b3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1187 microversion: 2.1 time: 0.320256 Jul 25 13:06:58.680184 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2517/4936] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:58 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1187 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:58.695567 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e5d37a18-15a9-464a-aa62-2880bda7730e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:58.696187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e5d37a18-15a9-464a-aa62-2880bda7730e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:58.709552 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5d37a18-15a9-464a-aa62-2880bda7730e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:58.710029 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5d37a18-15a9-464a-aa62-2880bda7730e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:58.710814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5d37a18-15a9-464a-aa62-2880bda7730e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:58.711248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5d37a18-15a9-464a-aa62-2880bda7730e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:58.915974 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e5d37a18-15a9-464a-aa62-2880bda7730e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:58.924161 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e5d37a18-15a9-464a-aa62-2880bda7730e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226" status: 200 len: 1261 microversion: 2.1 time: 0.242893 Jul 25 13:06:58.924766 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2518/4937] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:58 2022] GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 => generated 1261 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:06:58.955658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3aff5fe5-11a4-4732-ad27-9741876d9927 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:06:58.992654 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3aff5fe5-11a4-4732-ad27-9741876d9927 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9" status: 200 len: 1363 microversion: 2.1 time: 0.618529 Jul 25 13:06:59.003647 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2420/4938] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:58 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9 => generated 1363 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:06:59.023163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-49a4abcb-aed1-4a72-87f9-39f1faf933ef req-c96c91c6-cc18-4a67-84e2-194beda03a0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7efe0544-de4c-4966-9e19-5ae73b5c5fe9", "tag": "14a7c2d1-b1e9-49d5-a254-064411c0e1f7"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:06:59.042253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-49a4abcb-aed1-4a72-87f9-39f1faf933ef req-c96c91c6-cc18-4a67-84e2-194beda03a0a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:59.042785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-49a4abcb-aed1-4a72-87f9-39f1faf933ef req-c96c91c6-cc18-4a67-84e2-194beda03a0a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:59.069456 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-49a4abcb-aed1-4a72-87f9-39f1faf933ef req-c96c91c6-cc18-4a67-84e2-194beda03a0a service nova] Creating event network-changed:14a7c2d1-b1e9-49d5-a254-064411c0e1f7 for instance 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 on n-h1-848886-15 Jul 25 13:06:59.078228 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-49a4abcb-aed1-4a72-87f9-39f1faf933ef req-c96c91c6-cc18-4a67-84e2-194beda03a0a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058378 Jul 25 13:06:59.082580 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2519/4939] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:06:59.700540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ad1b87f6-9730-427d-a9c4-8d2e24912ba2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:59.701082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ad1b87f6-9730-427d-a9c4-8d2e24912ba2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:59.709515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad1b87f6-9730-427d-a9c4-8d2e24912ba2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:59.710311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad1b87f6-9730-427d-a9c4-8d2e24912ba2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:59.711262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad1b87f6-9730-427d-a9c4-8d2e24912ba2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:59.711874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad1b87f6-9730-427d-a9c4-8d2e24912ba2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:59.953197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9dc73b40-01fb-4291-ae7e-9811bc381ba6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:06:59.954505 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9dc73b40-01fb-4291-ae7e-9811bc381ba6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:06:59.971467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9dc73b40-01fb-4291-ae7e-9811bc381ba6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:59.972180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9dc73b40-01fb-4291-ae7e-9811bc381ba6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:59.973137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9dc73b40-01fb-4291-ae7e-9811bc381ba6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:06:59.973733 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9dc73b40-01fb-4291-ae7e-9811bc381ba6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:06:59.996663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ad1b87f6-9730-427d-a9c4-8d2e24912ba2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:00.005180 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ad1b87f6-9730-427d-a9c4-8d2e24912ba2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1187 microversion: 2.1 time: 0.308635 Jul 25 13:07:00.015728 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2421/4940] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:59 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1187 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:00.024589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-484fc7f3-ba50-4e83-8ee8-a7cae9afa58f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:00.034801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-484fc7f3-ba50-4e83-8ee8-a7cae9afa58f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:00.045956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-484fc7f3-ba50-4e83-8ee8-a7cae9afa58f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:00.046590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-484fc7f3-ba50-4e83-8ee8-a7cae9afa58f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:00.047933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-484fc7f3-ba50-4e83-8ee8-a7cae9afa58f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:00.048519 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-484fc7f3-ba50-4e83-8ee8-a7cae9afa58f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:00.203267 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9dc73b40-01fb-4291-ae7e-9811bc381ba6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:00.221384 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9dc73b40-01fb-4291-ae7e-9811bc381ba6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226" status: 200 len: 1267 microversion: 2.1 time: 0.272259 Jul 25 13:07:00.222350 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2520/4941] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:06:59 2022] GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 => generated 1267 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:07:00.385487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-484fc7f3-ba50-4e83-8ee8-a7cae9afa58f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:00.395999 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-484fc7f3-ba50-4e83-8ee8-a7cae9afa58f tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9" status: 200 len: 1363 microversion: 2.1 time: 0.374193 Jul 25 13:07:00.396934 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2422/4942] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:00 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9 => generated 1363 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:07:01.030937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bc898be2-01dc-4fb2-a5b5-d419323a8fc4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:01.031858 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bc898be2-01dc-4fb2-a5b5-d419323a8fc4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:01.052050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc898be2-01dc-4fb2-a5b5-d419323a8fc4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:01.056635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc898be2-01dc-4fb2-a5b5-d419323a8fc4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:01.059211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc898be2-01dc-4fb2-a5b5-d419323a8fc4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:01.060278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc898be2-01dc-4fb2-a5b5-d419323a8fc4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:01.244101 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e46c3d22-979c-4516-b298-7e80791c27dc tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:01.244729 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e46c3d22-979c-4516-b298-7e80791c27dc tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:01.254396 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bc898be2-01dc-4fb2-a5b5-d419323a8fc4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:01.280441 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e46c3d22-979c-4516-b298-7e80791c27dc tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:01.280898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e46c3d22-979c-4516-b298-7e80791c27dc tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:01.282023 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bc898be2-01dc-4fb2-a5b5-d419323a8fc4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1187 microversion: 2.1 time: 0.251091 Jul 25 13:07:01.293866 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2521/4943] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:01 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1187 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:01.294193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e46c3d22-979c-4516-b298-7e80791c27dc tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:01.294193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e46c3d22-979c-4516-b298-7e80791c27dc tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:01.417818 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-788dce1d-1b43-431f-bc06-138f095b1cfa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:01.418402 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-788dce1d-1b43-431f-bc06-138f095b1cfa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:01.431098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-788dce1d-1b43-431f-bc06-138f095b1cfa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:01.432015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-788dce1d-1b43-431f-bc06-138f095b1cfa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:01.435293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-788dce1d-1b43-431f-bc06-138f095b1cfa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:01.435914 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-788dce1d-1b43-431f-bc06-138f095b1cfa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:01.928239 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e46c3d22-979c-4516-b298-7e80791c27dc tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:01.937467 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e46c3d22-979c-4516-b298-7e80791c27dc tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226" status: 200 len: 1309 microversion: 2.1 time: 0.697678 Jul 25 13:07:01.941698 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2423/4944] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:01 2022] GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 => generated 1309 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:07:02.309033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4b7af5ac-f4e6-468f-9edc-a8f4c52427d5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:02.309851 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4b7af5ac-f4e6-468f-9edc-a8f4c52427d5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:02.320921 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b7af5ac-f4e6-468f-9edc-a8f4c52427d5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:02.327812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b7af5ac-f4e6-468f-9edc-a8f4c52427d5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:02.328134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b7af5ac-f4e6-468f-9edc-a8f4c52427d5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:02.328675 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b7af5ac-f4e6-468f-9edc-a8f4c52427d5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:02.405988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b7af5ac-f4e6-468f-9edc-a8f4c52427d5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:02.406601 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b7af5ac-f4e6-468f-9edc-a8f4c52427d5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:02.407179 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-4b7af5ac-f4e6-468f-9edc-a8f4c52427d5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lazy-loading 'fault' on Instance uuid 4c5b9754-035f-4b86-888a-68aecbac2cee {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:07:02.605186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4b7af5ac-f4e6-468f-9edc-a8f4c52427d5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:02.614398 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4b7af5ac-f4e6-468f-9edc-a8f4c52427d5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 200 len: 1146 microversion: 2.1 time: 0.310779 Jul 25 13:07:02.616512 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2424/4945] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:02 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 1146 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:07:02.715845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-788dce1d-1b43-431f-bc06-138f095b1cfa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:02.728329 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-788dce1d-1b43-431f-bc06-138f095b1cfa tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9" status: 200 len: 1363 microversion: 2.1 time: 1.315368 Jul 25 13:07:02.732542 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2522/4946] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:01 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9 => generated 1363 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:02.963340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-81e5809b-ab90-44d4-ae95-2cfe9f505491 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:02.963961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-81e5809b-ab90-44d4-ae95-2cfe9f505491 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:02.972020 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-81e5809b-ab90-44d4-ae95-2cfe9f505491 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:02.973426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-81e5809b-ab90-44d4-ae95-2cfe9f505491 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:02.974747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-81e5809b-ab90-44d4-ae95-2cfe9f505491 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:02.975374 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-81e5809b-ab90-44d4-ae95-2cfe9f505491 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:03.167216 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-81e5809b-ab90-44d4-ae95-2cfe9f505491 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:03.180351 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-81e5809b-ab90-44d4-ae95-2cfe9f505491 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226" status: 200 len: 1309 microversion: 2.1 time: 0.220714 Jul 25 13:07:03.190000 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2425/4947] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:02 2022] GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 => generated 1309 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:03.638198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-89563caa-6eca-43af-a74a-99a93b604ede tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:03.638980 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-89563caa-6eca-43af-a74a-99a93b604ede tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 4c5b9754-035f-4b86-888a-68aecbac2cee] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:03.654829 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-89563caa-6eca-43af-a74a-99a93b604ede tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:03.655783 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-89563caa-6eca-43af-a74a-99a93b604ede tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:03.656961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-89563caa-6eca-43af-a74a-99a93b604ede tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:03.657872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-89563caa-6eca-43af-a74a-99a93b604ede tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:03.676071 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-89563caa-6eca-43af-a74a-99a93b604ede tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] HTTP exception thrown: Instance 4c5b9754-035f-4b86-888a-68aecbac2cee could not be found. Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-89563caa-6eca-43af-a74a-99a93b604ede tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Request method failure captured: Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee HTTP/1.1 Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pUsgUlyXXDFjpaxtInCA3ErKU2P2TTpSljieML2SSsbmedwjUWvmtCPv6cpRR2_rKwVTBeB1pN0R0PaQlKkP3JB2H_nZ9mFVhTCd_Xl4_Gcw-PsIj4Ff-CbWbJlbzuA6BFxmfwmUVgHks2P6PoEesxOn8j894_Z-5Z842qklFD2ecs Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b2fbd681752c41d0a24a9cf34ebc8389", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}] Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 9face2aaa9df430cb5d361c6e1fdf242 Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 4c5b9754-035f-4b86-888a-68aecbac2cee could not be found. Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '4c5b9754-035f-4b86-888a-68aecbac2cee'} Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c5b9754-035f-4b86-888a-68aecbac2cee could not be found. Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c5b9754-035f-4b86-888a-68aecbac2cee could not be found. Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:07:03.678243 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:07:03.682361 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:07:03.682361 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:07:03.682361 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:07:03.682361 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:07:03.682361 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:07:03.682361 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c5b9754-035f-4b86-888a-68aecbac2cee could not be found. Jul 25 13:07:03.682361 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:07:03.683536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-89563caa-6eca-43af-a74a-99a93b604ede tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Returning 404 to user: Instance 4c5b9754-035f-4b86-888a-68aecbac2cee could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:07:03.684755 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-89563caa-6eca-43af-a74a-99a93b604ede tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee" status: 404 len: 111 microversion: 2.1 time: 0.051597 Jul 25 13:07:03.685921 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2523/4948] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:03 2022] GET /compute/v2.1/servers/4c5b9754-035f-4b86-888a-68aecbac2cee => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:07:03.753460 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-e2c3a336-9ca6-4c62-84f2-4db7de8088de req-ec1fd4b6-cdc5-4e32-9e3d-c6c34ff01a34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "966b2836-cec0-45b1-b147-bfde8ea67226", "tag": "adf555d0-10bb-406a-acdd-ef93f9eded13"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:03.755818 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-be15788a-fddd-48cd-893e-f30442f18157 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:03.756876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-be15788a-fddd-48cd-893e-f30442f18157 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:03.768136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be15788a-fddd-48cd-893e-f30442f18157 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:03.775802 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be15788a-fddd-48cd-893e-f30442f18157 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:03.777385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be15788a-fddd-48cd-893e-f30442f18157 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:03.778056 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be15788a-fddd-48cd-893e-f30442f18157 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:03.778483 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e2c3a336-9ca6-4c62-84f2-4db7de8088de req-ec1fd4b6-cdc5-4e32-9e3d-c6c34ff01a34 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:03.778953 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e2c3a336-9ca6-4c62-84f2-4db7de8088de req-ec1fd4b6-cdc5-4e32-9e3d-c6c34ff01a34 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:03.784441 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:07:03.804410 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-e2c3a336-9ca6-4c62-84f2-4db7de8088de req-ec1fd4b6-cdc5-4e32-9e3d-c6c34ff01a34 service nova] Creating event network-changed:adf555d0-10bb-406a-acdd-ef93f9eded13 for instance 966b2836-cec0-45b1-b147-bfde8ea67226 on n-h1-848886-15 Jul 25 13:07:03.820391 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-e2c3a336-9ca6-4c62-84f2-4db7de8088de req-ec1fd4b6-cdc5-4e32-9e3d-c6c34ff01a34 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072078 Jul 25 13:07:03.821291 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2426/4949] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:07:04.202416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-939e5d5b-51bc-4798-a98f-9bb6311ab87d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:04.203530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-939e5d5b-51bc-4798-a98f-9bb6311ab87d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:04.217450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-939e5d5b-51bc-4798-a98f-9bb6311ab87d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:04.218203 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-939e5d5b-51bc-4798-a98f-9bb6311ab87d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:04.219372 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-939e5d5b-51bc-4798-a98f-9bb6311ab87d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:04.221483 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-939e5d5b-51bc-4798-a98f-9bb6311ab87d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:04.229319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-be15788a-fddd-48cd-893e-f30442f18157 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:04.237820 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-be15788a-fddd-48cd-893e-f30442f18157 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9" status: 200 len: 1363 microversion: 2.1 time: 0.487974 Jul 25 13:07:04.238456 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2524/4950] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:03 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9 => generated 1363 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:07:04.616111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-939e5d5b-51bc-4798-a98f-9bb6311ab87d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:04.637081 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-939e5d5b-51bc-4798-a98f-9bb6311ab87d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226" status: 200 len: 1309 microversion: 2.1 time: 0.440109 Jul 25 13:07:04.638493 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2427/4951] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:04 2022] GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 => generated 1309 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:07:04.741452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4825b1c5-3e70-4ed4-a988-2d3db6192e4e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-894222852", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "b720d638-39d0-4f8f-b0c8-cfe2dc63c6bc"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:04.763555 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:07:04.844191 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-4825b1c5-3e70-4ed4-a988-2d3db6192e4e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] validate_networks() for [('b720d638-39d0-4f8f-b0c8-cfe2dc63c6bc', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:07:05.265769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-020f38a3-96b6-48c4-aaab-23fb9da712db tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:05.266642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-020f38a3-96b6-48c4-aaab-23fb9da712db tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:05.281966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-020f38a3-96b6-48c4-aaab-23fb9da712db tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:05.285112 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-020f38a3-96b6-48c4-aaab-23fb9da712db tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:05.288940 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-020f38a3-96b6-48c4-aaab-23fb9da712db tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:05.291023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-020f38a3-96b6-48c4-aaab-23fb9da712db tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:05.730604 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-4825b1c5-3e70-4ed4-a988-2d3db6192e4e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:07:05.731380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-4825b1c5-3e70-4ed4-a988-2d3db6192e4e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:07:05.734984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-4825b1c5-3e70-4ed4-a988-2d3db6192e4e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:07:05.735693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-4825b1c5-3e70-4ed4-a988-2d3db6192e4e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:07:05.736432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-4825b1c5-3e70-4ed4-a988-2d3db6192e4e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:07:05.749656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4825b1c5-3e70-4ed4-a988-2d3db6192e4e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:05.750563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4825b1c5-3e70-4ed4-a988-2d3db6192e4e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:05.755762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4825b1c5-3e70-4ed4-a988-2d3db6192e4e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:05.756449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4825b1c5-3e70-4ed4-a988-2d3db6192e4e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:05.785193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-020f38a3-96b6-48c4-aaab-23fb9da712db tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:05.786854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-4825b1c5-3e70-4ed4-a988-2d3db6192e4e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Getting quotas for project ffa28f3617964bf3b2abda804a2d4c9d. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:07:05.796830 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-4825b1c5-3e70-4ed4-a988-2d3db6192e4e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Getting quotas for user 135fc0b1f4cf4fd5a89e15d4cba96fa6 and project ffa28f3617964bf3b2abda804a2d4c9d. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:07:05.802685 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-020f38a3-96b6-48c4-aaab-23fb9da712db tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9" status: 200 len: 1363 microversion: 2.1 time: 0.538994 Jul 25 13:07:05.812703 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2428/4952] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:05 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9 => generated 1363 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:07:05.825677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4825b1c5-3e70-4ed4-a988-2d3db6192e4e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:07:05.825849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-5eb61d8d-ef0e-4c9c-ad33-6c3063acb571 req-1146c3ce-93fa-40e4-b1c5-dcea701c37af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7efe0544-de4c-4966-9e19-5ae73b5c5fe9", "name": "network-vif-plugged", "status": "completed", "tag": "14a7c2d1-b1e9-49d5-a254-064411c0e1f7"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:05.825953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4825b1c5-3e70-4ed4-a988-2d3db6192e4e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] [instance: cb270188-15b8-471f-980f-53248b4fc71c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:07:05.862300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-5eb61d8d-ef0e-4c9c-ad33-6c3063acb571 req-1146c3ce-93fa-40e4-b1c5-dcea701c37af service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:05.863075 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-5eb61d8d-ef0e-4c9c-ad33-6c3063acb571 req-1146c3ce-93fa-40e4-b1c5-dcea701c37af service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:05.901465 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4825b1c5-3e70-4ed4-a988-2d3db6192e4e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.402233 Jul 25 13:07:05.903071 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-5eb61d8d-ef0e-4c9c-ad33-6c3063acb571 req-1146c3ce-93fa-40e4-b1c5-dcea701c37af service nova] Creating event network-vif-plugged:14a7c2d1-b1e9-49d5-a254-064411c0e1f7 for instance 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 on n-h1-848886-15 Jul 25 13:07:05.909438 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2525/4953] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:07:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 13:07:05.916470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6168a56b-f817-42e7-a8e2-084d48920238 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:05.917923 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-5eb61d8d-ef0e-4c9c-ad33-6c3063acb571 req-1146c3ce-93fa-40e4-b1c5-dcea701c37af service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103815 Jul 25 13:07:05.918625 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6168a56b-f817-42e7-a8e2-084d48920238 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:05.919279 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2429/4954] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:07:05.926980 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6168a56b-f817-42e7-a8e2-084d48920238 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:05.927603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6168a56b-f817-42e7-a8e2-084d48920238 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:05.928443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6168a56b-f817-42e7-a8e2-084d48920238 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:05.928979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6168a56b-f817-42e7-a8e2-084d48920238 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:05.942525 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-48b72fde-b51d-4f60-ac22-9a89edafc8dc tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:05.943439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-48b72fde-b51d-4f60-ac22-9a89edafc8dc tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] [instance: cb270188-15b8-471f-980f-53248b4fc71c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:06.107156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-48b72fde-b51d-4f60-ac22-9a89edafc8dc tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135fc0b1f4cf4fd5a89e15d4cba96fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa28f3617964bf3b2abda804a2d4c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:06.121364 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-48b72fde-b51d-4f60-ac22-9a89edafc8dc tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] 10.222.0.49 "GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c" status: 200 len: 1216 microversion: 2.1 time: 0.200692 Jul 25 13:07:06.146944 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2430/4955] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:05 2022] GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c => generated 1216 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:06.369303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6168a56b-f817-42e7-a8e2-084d48920238 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:06.386941 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6168a56b-f817-42e7-a8e2-084d48920238 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226" status: 200 len: 1309 microversion: 2.1 time: 0.481479 Jul 25 13:07:06.388067 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2526/4956] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:05 2022] GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 => generated 1309 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:06.832967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7e414a11-c295-4421-81c1-1c0c749dcb40 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:06.833596 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7e414a11-c295-4421-81c1-1c0c749dcb40 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:06.850297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:07:06.876534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e414a11-c295-4421-81c1-1c0c749dcb40 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:06.877629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e414a11-c295-4421-81c1-1c0c749dcb40 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:06.878521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e414a11-c295-4421-81c1-1c0c749dcb40 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:06.879139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e414a11-c295-4421-81c1-1c0c749dcb40 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:07.058265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7e414a11-c295-4421-81c1-1c0c749dcb40 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:07.072022 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7e414a11-c295-4421-81c1-1c0c749dcb40 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9" status: 200 len: 1363 microversion: 2.1 time: 0.242966 Jul 25 13:07:07.073432 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2431/4957] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:06 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:07.153309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1083a7e1-c16d-4458-8ae9-3009b845f0a0 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:07.154815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1083a7e1-c16d-4458-8ae9-3009b845f0a0 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] [instance: cb270188-15b8-471f-980f-53248b4fc71c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:07.170961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1083a7e1-c16d-4458-8ae9-3009b845f0a0 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:07.171685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1083a7e1-c16d-4458-8ae9-3009b845f0a0 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:07.173009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1083a7e1-c16d-4458-8ae9-3009b845f0a0 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:07.173445 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1083a7e1-c16d-4458-8ae9-3009b845f0a0 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:07.272639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1083a7e1-c16d-4458-8ae9-3009b845f0a0 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135fc0b1f4cf4fd5a89e15d4cba96fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa28f3617964bf3b2abda804a2d4c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:07.281856 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1083a7e1-c16d-4458-8ae9-3009b845f0a0 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] 10.222.0.49 "GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c" status: 200 len: 1212 microversion: 2.1 time: 0.133682 Jul 25 13:07:07.285888 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2527/4958] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:07 2022] GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c => generated 1212 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:07.411735 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e6312132-21f5-4167-ba32-10cc728df74d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:07.412967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e6312132-21f5-4167-ba32-10cc728df74d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:07.419985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e6312132-21f5-4167-ba32-10cc728df74d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:07.421088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e6312132-21f5-4167-ba32-10cc728df74d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:07.423081 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e6312132-21f5-4167-ba32-10cc728df74d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:07.424231 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e6312132-21f5-4167-ba32-10cc728df74d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:07.592958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e6312132-21f5-4167-ba32-10cc728df74d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:07.604207 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e6312132-21f5-4167-ba32-10cc728df74d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226" status: 200 len: 1309 microversion: 2.1 time: 0.197361 Jul 25 13:07:07.618818 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2432/4959] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:07 2022] GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 => generated 1309 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:08.099307 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b3c341b5-2ab2-45b2-85a3-41f9b7e882d4 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:08.100198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b3c341b5-2ab2-45b2-85a3-41f9b7e882d4 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:08.116399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b3c341b5-2ab2-45b2-85a3-41f9b7e882d4 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:08.119138 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b3c341b5-2ab2-45b2-85a3-41f9b7e882d4 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:08.120047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b3c341b5-2ab2-45b2-85a3-41f9b7e882d4 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:08.120487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b3c341b5-2ab2-45b2-85a3-41f9b7e882d4 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:08.303158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-221b49b6-ca9f-4830-8416-57959d605d47 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:08.304214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-221b49b6-ca9f-4830-8416-57959d605d47 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] [instance: cb270188-15b8-471f-980f-53248b4fc71c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:08.317293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-221b49b6-ca9f-4830-8416-57959d605d47 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:08.321433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-221b49b6-ca9f-4830-8416-57959d605d47 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:08.322329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-221b49b6-ca9f-4830-8416-57959d605d47 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:08.322789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-221b49b6-ca9f-4830-8416-57959d605d47 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:08.483209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b3c341b5-2ab2-45b2-85a3-41f9b7e882d4 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:08.501328 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b3c341b5-2ab2-45b2-85a3-41f9b7e882d4 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9" status: 200 len: 1548 microversion: 2.1 time: 0.411000 Jul 25 13:07:08.513128 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2528/4960] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:08 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9 => generated 1548 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:08.521534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-221b49b6-ca9f-4830-8416-57959d605d47 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135fc0b1f4cf4fd5a89e15d4cba96fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa28f3617964bf3b2abda804a2d4c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:08.536845 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-221b49b6-ca9f-4830-8416-57959d605d47 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] 10.222.0.49 "GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c" status: 200 len: 1274 microversion: 2.1 time: 0.237605 Jul 25 13:07:08.537988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-64ab7a60-762e-41bf-b5f3-c27a10769d6c tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:08.538503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-64ab7a60-762e-41bf-b5f3-c27a10769d6c tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:08.545444 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2433/4961] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:08 2022] GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c => generated 1274 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:08.547632 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64ab7a60-762e-41bf-b5f3-c27a10769d6c tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:08.548400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64ab7a60-762e-41bf-b5f3-c27a10769d6c tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:08.550257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64ab7a60-762e-41bf-b5f3-c27a10769d6c tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:08.553193 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64ab7a60-762e-41bf-b5f3-c27a10769d6c tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:08.628993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-09880010-8d7a-46bf-b57c-20cc4fdce5bf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:08.629685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-09880010-8d7a-46bf-b57c-20cc4fdce5bf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:08.636046 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09880010-8d7a-46bf-b57c-20cc4fdce5bf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:08.636508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09880010-8d7a-46bf-b57c-20cc4fdce5bf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:08.637536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09880010-8d7a-46bf-b57c-20cc4fdce5bf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:08.638375 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09880010-8d7a-46bf-b57c-20cc4fdce5bf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:08.813530 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-64ab7a60-762e-41bf-b5f3-c27a10769d6c tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.280440 Jul 25 13:07:08.815263 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2529/4962] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 13:07:08 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-interface => generated 284 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:07:09.004492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-09880010-8d7a-46bf-b57c-20cc4fdce5bf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:09.018719 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-09880010-8d7a-46bf-b57c-20cc4fdce5bf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226" status: 200 len: 1309 microversion: 2.1 time: 0.393956 Jul 25 13:07:09.020553 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2434/4963] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:08 2022] GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 => generated 1309 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:07:09.567004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-007f015e-14c3-4de0-8ea1-187ddcbf863e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:09.568899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-007f015e-14c3-4de0-8ea1-187ddcbf863e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] [instance: cb270188-15b8-471f-980f-53248b4fc71c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:09.584374 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-007f015e-14c3-4de0-8ea1-187ddcbf863e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:09.585610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-007f015e-14c3-4de0-8ea1-187ddcbf863e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:09.588274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-007f015e-14c3-4de0-8ea1-187ddcbf863e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:09.592940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-007f015e-14c3-4de0-8ea1-187ddcbf863e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:10.045439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-390c8dc1-1db8-4fd2-8a19-decca44638a2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:10.046740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-390c8dc1-1db8-4fd2-8a19-decca44638a2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:10.061986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-390c8dc1-1db8-4fd2-8a19-decca44638a2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:10.067158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-390c8dc1-1db8-4fd2-8a19-decca44638a2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:10.068289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-390c8dc1-1db8-4fd2-8a19-decca44638a2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:10.070680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-390c8dc1-1db8-4fd2-8a19-decca44638a2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:10.286591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-007f015e-14c3-4de0-8ea1-187ddcbf863e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135fc0b1f4cf4fd5a89e15d4cba96fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa28f3617964bf3b2abda804a2d4c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:10.302661 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-007f015e-14c3-4de0-8ea1-187ddcbf863e tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] 10.222.0.49 "GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c" status: 200 len: 1316 microversion: 2.1 time: 0.741682 Jul 25 13:07:10.303269 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2530/4964] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:09 2022] GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c => generated 1316 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:10.436665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-390c8dc1-1db8-4fd2-8a19-decca44638a2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:10.448056 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-390c8dc1-1db8-4fd2-8a19-decca44638a2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226" status: 200 len: 1309 microversion: 2.1 time: 0.407123 Jul 25 13:07:10.449748 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2435/4965] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:10 2022] GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 => generated 1309 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:10.878782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-4d6cbaaa-94b5-4026-849f-b79986d4a32c req-c689fc6e-af23-4f52-ae17-cfff7dc97aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb270188-15b8-471f-980f-53248b4fc71c", "tag": "982ba447-66be-4a3f-92a1-8122ca3ed816"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:10.892785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-789fc43b-9468-4056-b656-9faef97daa94 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:10.897900 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-789fc43b-9468-4056-b656-9faef97daa94 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:10.910855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4d6cbaaa-94b5-4026-849f-b79986d4a32c req-c689fc6e-af23-4f52-ae17-cfff7dc97aa1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:10.912359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-789fc43b-9468-4056-b656-9faef97daa94 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:10.914171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4d6cbaaa-94b5-4026-849f-b79986d4a32c req-c689fc6e-af23-4f52-ae17-cfff7dc97aa1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:10.922075 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-789fc43b-9468-4056-b656-9faef97daa94 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:10.925521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-789fc43b-9468-4056-b656-9faef97daa94 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:10.937396 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-789fc43b-9468-4056-b656-9faef97daa94 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:10.948495 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-4d6cbaaa-94b5-4026-849f-b79986d4a32c req-c689fc6e-af23-4f52-ae17-cfff7dc97aa1 service nova] Creating event network-changed:982ba447-66be-4a3f-92a1-8122ca3ed816 for instance cb270188-15b8-471f-980f-53248b4fc71c on n-h2-848886-15 Jul 25 13:07:10.959728 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-4d6cbaaa-94b5-4026-849f-b79986d4a32c req-c689fc6e-af23-4f52-ae17-cfff7dc97aa1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088056 Jul 25 13:07:10.964865 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2531/4966] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:07:11.048148 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-789fc43b-9468-4056-b656-9faef97daa94 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "POST /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc/action" status: 200 len: 24571 microversion: 2.1 time: 0.163550 Jul 25 13:07:11.057236 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2436/4967] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:07:10 2022] POST /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc/action => generated 24571 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:07:11.158479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-88fd0970-e5ca-41b4-89ec-2b4813c4287f req-acf20a85-09a2-4602-8ddc-6402c3a24887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7efe0544-de4c-4966-9e19-5ae73b5c5fe9", "tag": "14a7c2d1-b1e9-49d5-a254-064411c0e1f7"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:11.195661 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-88fd0970-e5ca-41b4-89ec-2b4813c4287f req-acf20a85-09a2-4602-8ddc-6402c3a24887 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:11.196119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-88fd0970-e5ca-41b4-89ec-2b4813c4287f req-acf20a85-09a2-4602-8ddc-6402c3a24887 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:11.218314 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-88fd0970-e5ca-41b4-89ec-2b4813c4287f req-acf20a85-09a2-4602-8ddc-6402c3a24887 service nova] Creating event network-changed:14a7c2d1-b1e9-49d5-a254-064411c0e1f7 for instance 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 on n-h1-848886-15 Jul 25 13:07:11.238571 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-88fd0970-e5ca-41b4-89ec-2b4813c4287f req-acf20a85-09a2-4602-8ddc-6402c3a24887 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085556 Jul 25 13:07:11.239582 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2532/4968] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:07:11.325745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e5bf9c0a-f71c-4b59-aad8-48a700cc0ed2 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:11.326990 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e5bf9c0a-f71c-4b59-aad8-48a700cc0ed2 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] [instance: cb270188-15b8-471f-980f-53248b4fc71c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:11.346221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e5bf9c0a-f71c-4b59-aad8-48a700cc0ed2 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:11.348178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e5bf9c0a-f71c-4b59-aad8-48a700cc0ed2 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:11.349428 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e5bf9c0a-f71c-4b59-aad8-48a700cc0ed2 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:11.349538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e5bf9c0a-f71c-4b59-aad8-48a700cc0ed2 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:11.473347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-50b75f2b-2739-4b53-be98-27393afa6c71 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:11.474058 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-50b75f2b-2739-4b53-be98-27393afa6c71 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:11.491383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50b75f2b-2739-4b53-be98-27393afa6c71 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:11.492666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50b75f2b-2739-4b53-be98-27393afa6c71 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:11.494544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50b75f2b-2739-4b53-be98-27393afa6c71 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:11.496947 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50b75f2b-2739-4b53-be98-27393afa6c71 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:11.763054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e5bf9c0a-f71c-4b59-aad8-48a700cc0ed2 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135fc0b1f4cf4fd5a89e15d4cba96fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa28f3617964bf3b2abda804a2d4c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:11.772197 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e5bf9c0a-f71c-4b59-aad8-48a700cc0ed2 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] 10.222.0.49 "GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c" status: 200 len: 1316 microversion: 2.1 time: 0.452130 Jul 25 13:07:11.777019 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2437/4969] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:11 2022] GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:11.819022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-50b75f2b-2739-4b53-be98-27393afa6c71 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:11.831419 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-50b75f2b-2739-4b53-be98-27393afa6c71 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226" status: 200 len: 1309 microversion: 2.1 time: 0.366371 Jul 25 13:07:11.832405 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2533/4970] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:11 2022] GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 => generated 1309 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:12.105351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-60c21579-9f2e-4028-9fdd-0ab76ca30e8e req-7dad4218-45c4-45fe-83ee-9eab5f471e85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "966b2836-cec0-45b1-b147-bfde8ea67226", "name": "network-vif-plugged", "status": "completed", "tag": "adf555d0-10bb-406a-acdd-ef93f9eded13"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:12.132328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-60c21579-9f2e-4028-9fdd-0ab76ca30e8e req-7dad4218-45c4-45fe-83ee-9eab5f471e85 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:12.139469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-60c21579-9f2e-4028-9fdd-0ab76ca30e8e req-7dad4218-45c4-45fe-83ee-9eab5f471e85 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:12.157178 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-60c21579-9f2e-4028-9fdd-0ab76ca30e8e req-7dad4218-45c4-45fe-83ee-9eab5f471e85 service nova] Creating event network-vif-plugged:adf555d0-10bb-406a-acdd-ef93f9eded13 for instance 966b2836-cec0-45b1-b147-bfde8ea67226 on n-h1-848886-15 Jul 25 13:07:12.162728 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-60c21579-9f2e-4028-9fdd-0ab76ca30e8e req-7dad4218-45c4-45fe-83ee-9eab5f471e85 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063796 Jul 25 13:07:12.163558 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2438/4971] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:07:12.799614 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-588edc11-87a4-4bad-91f9-4816f850ffec tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:12.801375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-588edc11-87a4-4bad-91f9-4816f850ffec tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] [instance: cb270188-15b8-471f-980f-53248b4fc71c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:12.816207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-588edc11-87a4-4bad-91f9-4816f850ffec tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:12.816978 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-588edc11-87a4-4bad-91f9-4816f850ffec tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:12.821765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-588edc11-87a4-4bad-91f9-4816f850ffec tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:12.822244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-588edc11-87a4-4bad-91f9-4816f850ffec tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:12.853218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fd000934-0565-4235-a63b-3bb81b0531a2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:12.854238 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fd000934-0565-4235-a63b-3bb81b0531a2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:12.884956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd000934-0565-4235-a63b-3bb81b0531a2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:12.885664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd000934-0565-4235-a63b-3bb81b0531a2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:12.886496 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd000934-0565-4235-a63b-3bb81b0531a2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:12.886932 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd000934-0565-4235-a63b-3bb81b0531a2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:13.276696 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fd000934-0565-4235-a63b-3bb81b0531a2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:13.291869 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fd000934-0565-4235-a63b-3bb81b0531a2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226" status: 200 len: 1309 microversion: 2.1 time: 0.441999 Jul 25 13:07:13.293241 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2439/4972] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:12 2022] GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 => generated 1309 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:13.297096 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-588edc11-87a4-4bad-91f9-4816f850ffec tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135fc0b1f4cf4fd5a89e15d4cba96fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa28f3617964bf3b2abda804a2d4c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:13.304654 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-588edc11-87a4-4bad-91f9-4816f850ffec tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] 10.222.0.49 "GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c" status: 200 len: 1316 microversion: 2.1 time: 0.511863 Jul 25 13:07:13.318601 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2534/4973] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:12 2022] GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c => generated 1316 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:14.315206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b45f0f3a-0832-4fa7-82a8-322d588e62bb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:14.316582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b45f0f3a-0832-4fa7-82a8-322d588e62bb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:14.326523 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-29073326-e9b7-4c6e-96ba-e6919f50fea2 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:14.328319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-29073326-e9b7-4c6e-96ba-e6919f50fea2 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] [instance: cb270188-15b8-471f-980f-53248b4fc71c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:14.341763 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b45f0f3a-0832-4fa7-82a8-322d588e62bb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:14.342102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29073326-e9b7-4c6e-96ba-e6919f50fea2 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:14.343434 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29073326-e9b7-4c6e-96ba-e6919f50fea2 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:14.343727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b45f0f3a-0832-4fa7-82a8-322d588e62bb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:14.346858 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29073326-e9b7-4c6e-96ba-e6919f50fea2 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:14.347079 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b45f0f3a-0832-4fa7-82a8-322d588e62bb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:14.348455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b45f0f3a-0832-4fa7-82a8-322d588e62bb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:14.348665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29073326-e9b7-4c6e-96ba-e6919f50fea2 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:14.912595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-29073326-e9b7-4c6e-96ba-e6919f50fea2 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135fc0b1f4cf4fd5a89e15d4cba96fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa28f3617964bf3b2abda804a2d4c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:14.926869 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-29073326-e9b7-4c6e-96ba-e6919f50fea2 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] 10.222.0.49 "GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c" status: 200 len: 1316 microversion: 2.1 time: 0.604705 Jul 25 13:07:14.944006 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2535/4974] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:14 2022] GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c => generated 1316 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:14.965986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b45f0f3a-0832-4fa7-82a8-322d588e62bb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:14.975413 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b45f0f3a-0832-4fa7-82a8-322d588e62bb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226" status: 200 len: 1489 microversion: 2.1 time: 0.665491 Jul 25 13:07:14.989857 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2440/4975] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:14 2022] GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 => generated 1489 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:14.997787 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-94c47cf4-8efe-4721-80cb-78f248b119c6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:15.000852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-94c47cf4-8efe-4721-80cb-78f248b119c6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:15.007891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94c47cf4-8efe-4721-80cb-78f248b119c6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:15.008387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94c47cf4-8efe-4721-80cb-78f248b119c6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:15.009193 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94c47cf4-8efe-4721-80cb-78f248b119c6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:15.009622 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94c47cf4-8efe-4721-80cb-78f248b119c6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:15.088255 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-94c47cf4-8efe-4721-80cb-78f248b119c6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "PUT /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226" status: 200 len: 1084 microversion: 2.1 time: 0.094722 Jul 25 13:07:15.088919 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2536/4976] 10.222.0.49 () {60 vars in 1256 bytes} [Mon Jul 25 13:07:14 2022] PUT /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 => generated 1084 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:15.107522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2da63f0d-9a7e-4945-85f1-0325d8acbfc6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:15.109293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2da63f0d-9a7e-4945-85f1-0325d8acbfc6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:15.126020 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2da63f0d-9a7e-4945-85f1-0325d8acbfc6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:15.126752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2da63f0d-9a7e-4945-85f1-0325d8acbfc6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:15.127774 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2da63f0d-9a7e-4945-85f1-0325d8acbfc6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:15.128282 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2da63f0d-9a7e-4945-85f1-0325d8acbfc6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:15.287432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2da63f0d-9a7e-4945-85f1-0325d8acbfc6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:15.296628 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2da63f0d-9a7e-4945-85f1-0325d8acbfc6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226" status: 200 len: 1510 microversion: 2.1 time: 0.194005 Jul 25 13:07:15.297318 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2441/4977] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:15 2022] GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 => generated 1510 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:15.317454 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4fd78ff0-7b4e-42c4-90aa-3f1ba434cd86 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:15.318108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4fd78ff0-7b4e-42c4-90aa-3f1ba434cd86 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:15.327174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4fd78ff0-7b4e-42c4-90aa-3f1ba434cd86 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:15.327786 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4fd78ff0-7b4e-42c4-90aa-3f1ba434cd86 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:15.328415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4fd78ff0-7b4e-42c4-90aa-3f1ba434cd86 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:15.328859 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4fd78ff0-7b4e-42c4-90aa-3f1ba434cd86 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:15.334500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:07:15.484608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4fd78ff0-7b4e-42c4-90aa-3f1ba434cd86 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:15.494017 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4fd78ff0-7b4e-42c4-90aa-3f1ba434cd86 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226" status: 200 len: 1510 microversion: 2.1 time: 0.180518 Jul 25 13:07:15.495177 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2537/4978] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:15 2022] GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:15.515306 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-daa3771b-1cc1-4f06-818e-32bcf420fa00 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:15.516092 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-daa3771b-1cc1-4f06-818e-32bcf420fa00 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:15.524369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-daa3771b-1cc1-4f06-818e-32bcf420fa00 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:15.525016 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-daa3771b-1cc1-4f06-818e-32bcf420fa00 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:15.525801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-daa3771b-1cc1-4f06-818e-32bcf420fa00 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:15.526415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-daa3771b-1cc1-4f06-818e-32bcf420fa00 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:15.554516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-daa3771b-1cc1-4f06-818e-32bcf420fa00 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:07:15.656636 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-daa3771b-1cc1-4f06-818e-32bcf420fa00 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "DELETE /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226" status: 204 len: 0 microversion: 2.1 time: 0.145377 Jul 25 13:07:15.657592 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2442/4979] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:07:15 2022] DELETE /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:07:15.666655 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6eb85565-7e47-4d93-8ce6-e994dc1c8fe8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:15.667792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6eb85565-7e47-4d93-8ce6-e994dc1c8fe8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:15.675076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6eb85565-7e47-4d93-8ce6-e994dc1c8fe8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:15.675853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6eb85565-7e47-4d93-8ce6-e994dc1c8fe8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:15.676811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6eb85565-7e47-4d93-8ce6-e994dc1c8fe8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:15.677416 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6eb85565-7e47-4d93-8ce6-e994dc1c8fe8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:15.770371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:07:15.807750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:07:15.953570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d110120c-d424-4196-a3f4-7406ee7a8166 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:15.955192 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d110120c-d424-4196-a3f4-7406ee7a8166 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] [instance: cb270188-15b8-471f-980f-53248b4fc71c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:15.960860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6eb85565-7e47-4d93-8ce6-e994dc1c8fe8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:15.972865 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d110120c-d424-4196-a3f4-7406ee7a8166 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:15.973038 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6eb85565-7e47-4d93-8ce6-e994dc1c8fe8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226" status: 200 len: 1516 microversion: 2.1 time: 0.311256 Jul 25 13:07:15.973638 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2538/4980] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:15 2022] GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 => generated 1516 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:15.974224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d110120c-d424-4196-a3f4-7406ee7a8166 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:15.975228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d110120c-d424-4196-a3f4-7406ee7a8166 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:15.975665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d110120c-d424-4196-a3f4-7406ee7a8166 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:16.079452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e4c961d6-0e17-4a08-a25d-21a3296743af tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9d00a7d-21d5-4501-ad07-293369dd6f01"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:16.082789 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e4c961d6-0e17-4a08-a25d-21a3296743af tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:16.089390 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4c961d6-0e17-4a08-a25d-21a3296743af tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:16.089910 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4c961d6-0e17-4a08-a25d-21a3296743af tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:16.091051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4c961d6-0e17-4a08-a25d-21a3296743af tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:16.091516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4c961d6-0e17-4a08-a25d-21a3296743af tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:16.121751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=22 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:07:16.203129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d110120c-d424-4196-a3f4-7406ee7a8166 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135fc0b1f4cf4fd5a89e15d4cba96fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa28f3617964bf3b2abda804a2d4c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:16.211280 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d110120c-d424-4196-a3f4-7406ee7a8166 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] 10.222.0.49 "GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c" status: 200 len: 1316 microversion: 2.1 time: 0.265740 Jul 25 13:07:16.212068 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2443/4981] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:15 2022] GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:16.511373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-97e904dc-a34e-4e0d-a83f-1d507465e181 req-2cc14b5f-51c0-4f59-af67-6dae2ee32ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb270188-15b8-471f-980f-53248b4fc71c", "name": "network-vif-plugged", "status": "completed", "tag": "982ba447-66be-4a3f-92a1-8122ca3ed816"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:16.521536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:07:16.524914 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-97e904dc-a34e-4e0d-a83f-1d507465e181 req-2cc14b5f-51c0-4f59-af67-6dae2ee32ce6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:16.527888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-97e904dc-a34e-4e0d-a83f-1d507465e181 req-2cc14b5f-51c0-4f59-af67-6dae2ee32ce6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:16.550977 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-97e904dc-a34e-4e0d-a83f-1d507465e181 req-2cc14b5f-51c0-4f59-af67-6dae2ee32ce6 service nova] Creating event network-vif-plugged:982ba447-66be-4a3f-92a1-8122ca3ed816 for instance cb270188-15b8-471f-980f-53248b4fc71c on n-h2-848886-15 Jul 25 13:07:16.556356 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-97e904dc-a34e-4e0d-a83f-1d507465e181 req-2cc14b5f-51c0-4f59-af67-6dae2ee32ce6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048603 Jul 25 13:07:16.557266 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2444/4982] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:07:16.948713 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e4c961d6-0e17-4a08-a25d-21a3296743af tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "POST /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.873040 Jul 25 13:07:16.949977 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2539/4983] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Jul 25 13:07:16 2022] POST /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments => generated 194 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:07:16.997704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-97e7e7a1-c92d-4608-83f7-079498df9cea tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:16.998590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-97e7e7a1-c92d-4608-83f7-079498df9cea tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:17.007447 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97e7e7a1-c92d-4608-83f7-079498df9cea tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:17.008159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97e7e7a1-c92d-4608-83f7-079498df9cea tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:17.009217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97e7e7a1-c92d-4608-83f7-079498df9cea tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:17.009984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97e7e7a1-c92d-4608-83f7-079498df9cea tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:17.016075 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:07:17.196550 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-97e7e7a1-c92d-4608-83f7-079498df9cea tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:17.212235 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-97e7e7a1-c92d-4608-83f7-079498df9cea tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226" status: 200 len: 1516 microversion: 2.1 time: 0.219125 Jul 25 13:07:17.213116 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2445/4984] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:16 2022] GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 => generated 1516 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:17.234930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7095253e-8cb8-4212-9b58-8f7706b877e9 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:17.235898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7095253e-8cb8-4212-9b58-8f7706b877e9 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] [instance: cb270188-15b8-471f-980f-53248b4fc71c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:17.244284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7095253e-8cb8-4212-9b58-8f7706b877e9 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:17.244999 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7095253e-8cb8-4212-9b58-8f7706b877e9 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:17.245789 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7095253e-8cb8-4212-9b58-8f7706b877e9 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:17.246275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7095253e-8cb8-4212-9b58-8f7706b877e9 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:17.476052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7095253e-8cb8-4212-9b58-8f7706b877e9 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135fc0b1f4cf4fd5a89e15d4cba96fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa28f3617964bf3b2abda804a2d4c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:17.488036 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7095253e-8cb8-4212-9b58-8f7706b877e9 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] 10.222.0.49 "GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c" status: 200 len: 1316 microversion: 2.1 time: 0.258285 Jul 25 13:07:17.492068 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2540/4985] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:17 2022] GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:17.853968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-90c75c7e-b1e5-4d9e-89de-1f7829050b90 req-56d31048-c3b6-405d-8778-666d53adf16f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "966b2836-cec0-45b1-b147-bfde8ea67226", "name": "network-vif-deleted", "tag": "adf555d0-10bb-406a-acdd-ef93f9eded13"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:17.881064 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-90c75c7e-b1e5-4d9e-89de-1f7829050b90 req-56d31048-c3b6-405d-8778-666d53adf16f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:17.881721 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-90c75c7e-b1e5-4d9e-89de-1f7829050b90 req-56d31048-c3b6-405d-8778-666d53adf16f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:17.909014 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-90c75c7e-b1e5-4d9e-89de-1f7829050b90 req-56d31048-c3b6-405d-8778-666d53adf16f service nova] Creating event network-vif-deleted:adf555d0-10bb-406a-acdd-ef93f9eded13 for instance 966b2836-cec0-45b1-b147-bfde8ea67226 on n-h1-848886-15 Jul 25 13:07:17.924885 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-90c75c7e-b1e5-4d9e-89de-1f7829050b90 req-56d31048-c3b6-405d-8778-666d53adf16f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076304 Jul 25 13:07:17.928177 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2446/4986] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:07:18.235444 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0ba766ac-a788-4357-807e-154586cb83b1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:18.236200 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0ba766ac-a788-4357-807e-154586cb83b1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:18.243690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ba766ac-a788-4357-807e-154586cb83b1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:18.244618 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ba766ac-a788-4357-807e-154586cb83b1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:18.245605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ba766ac-a788-4357-807e-154586cb83b1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:18.246248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ba766ac-a788-4357-807e-154586cb83b1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:18.280265 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ba766ac-a788-4357-807e-154586cb83b1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:18.281029 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ba766ac-a788-4357-807e-154586cb83b1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:18.281705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-0ba766ac-a788-4357-807e-154586cb83b1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lazy-loading 'fault' on Instance uuid 966b2836-cec0-45b1-b147-bfde8ea67226 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:07:18.350988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0ba766ac-a788-4357-807e-154586cb83b1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:18.367784 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0ba766ac-a788-4357-807e-154586cb83b1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226" status: 200 len: 1320 microversion: 2.1 time: 0.136401 Jul 25 13:07:18.372146 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2541/4987] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:18 2022] GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 => generated 1320 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:18.513669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8d672874-2c0d-4660-a030-f09f2e8486d9 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:18.515142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8d672874-2c0d-4660-a030-f09f2e8486d9 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] [instance: cb270188-15b8-471f-980f-53248b4fc71c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:18.527022 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d672874-2c0d-4660-a030-f09f2e8486d9 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:18.530304 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d672874-2c0d-4660-a030-f09f2e8486d9 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:18.532218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d672874-2c0d-4660-a030-f09f2e8486d9 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:18.534861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d672874-2c0d-4660-a030-f09f2e8486d9 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:18.769006 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8d672874-2c0d-4660-a030-f09f2e8486d9 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135fc0b1f4cf4fd5a89e15d4cba96fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa28f3617964bf3b2abda804a2d4c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:18.779182 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8d672874-2c0d-4660-a030-f09f2e8486d9 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] 10.222.0.49 "GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c" status: 200 len: 1504 microversion: 2.1 time: 0.270170 Jul 25 13:07:18.781467 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2447/4988] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:18 2022] GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c => generated 1504 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:18.802743 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-eaf67c93-ee89-4503-a2c3-05d96786bb40 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:18.803329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eaf67c93-ee89-4503-a2c3-05d96786bb40 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] [instance: cb270188-15b8-471f-980f-53248b4fc71c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:18.811705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eaf67c93-ee89-4503-a2c3-05d96786bb40 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:18.812488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eaf67c93-ee89-4503-a2c3-05d96786bb40 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:18.813471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eaf67c93-ee89-4503-a2c3-05d96786bb40 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:18.814116 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eaf67c93-ee89-4503-a2c3-05d96786bb40 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:18.844851 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-eaf67c93-ee89-4503-a2c3-05d96786bb40 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] 10.222.0.49 "GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c/ips" status: 200 len: 108 microversion: 2.1 time: 0.046658 Jul 25 13:07:18.846974 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2542/4989] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Jul 25 13:07:18 2022] GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c/ips => generated 108 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:07:18.863496 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b55cc7b6-b102-4e10-be93-8fb6e44fe552 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:18.864908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b55cc7b6-b102-4e10-be93-8fb6e44fe552 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] [instance: cb270188-15b8-471f-980f-53248b4fc71c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:18.873473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b55cc7b6-b102-4e10-be93-8fb6e44fe552 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:18.874162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b55cc7b6-b102-4e10-be93-8fb6e44fe552 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:18.875132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b55cc7b6-b102-4e10-be93-8fb6e44fe552 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:18.875561 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b55cc7b6-b102-4e10-be93-8fb6e44fe552 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:18.908130 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b55cc7b6-b102-4e10-be93-8fb6e44fe552 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] 10.222.0.49 "GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c/ips" status: 200 len: 108 microversion: 2.1 time: 0.052771 Jul 25 13:07:18.914388 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2448/4990] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Jul 25 13:07:18 2022] GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c/ips => generated 108 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:07:18.919743 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-891a7ce9-0d6f-4e61-8cfb-0618ed5cfc1f tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:18.920275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-891a7ce9-0d6f-4e61-8cfb-0618ed5cfc1f tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] [instance: cb270188-15b8-471f-980f-53248b4fc71c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:18.926927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-891a7ce9-0d6f-4e61-8cfb-0618ed5cfc1f tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:18.927660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-891a7ce9-0d6f-4e61-8cfb-0618ed5cfc1f tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:18.928730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-891a7ce9-0d6f-4e61-8cfb-0618ed5cfc1f tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:18.929177 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-891a7ce9-0d6f-4e61-8cfb-0618ed5cfc1f tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:18.959020 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-891a7ce9-0d6f-4e61-8cfb-0618ed5cfc1f tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] 10.222.0.49 "GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c/ips/tempest-ServerAddressesTestJSON-655531765-network" status: 200 len: 93 microversion: 2.1 time: 0.043196 Jul 25 13:07:18.960366 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2543/4991] 10.222.0.49 () {58 vars in 1398 bytes} [Mon Jul 25 13:07:18 2022] GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c/ips/tempest-ServerAddressesTestJSON-655531765-network => generated 93 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 13:07:18.971659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b8322a02-7ae6-4923-b209-84b9cfab66cf tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:18.972170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b8322a02-7ae6-4923-b209-84b9cfab66cf tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] [instance: cb270188-15b8-471f-980f-53248b4fc71c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:18.978520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b8322a02-7ae6-4923-b209-84b9cfab66cf tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:18.979242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b8322a02-7ae6-4923-b209-84b9cfab66cf tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:18.980480 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b8322a02-7ae6-4923-b209-84b9cfab66cf tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:18.981236 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b8322a02-7ae6-4923-b209-84b9cfab66cf tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:19.021378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b8322a02-7ae6-4923-b209-84b9cfab66cf tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] [instance: cb270188-15b8-471f-980f-53248b4fc71c] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:07:19.149880 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b8322a02-7ae6-4923-b209-84b9cfab66cf tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c" status: 204 len: 0 microversion: 2.1 time: 0.181804 Jul 25 13:07:19.156190 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2449/4992] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:07:18 2022] DELETE /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:07:19.161459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-72b52d1f-1ba0-4cc8-9669-5a5800a42126 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:19.162054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-72b52d1f-1ba0-4cc8-9669-5a5800a42126 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] [instance: cb270188-15b8-471f-980f-53248b4fc71c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:19.169611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-72b52d1f-1ba0-4cc8-9669-5a5800a42126 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:19.175154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-72b52d1f-1ba0-4cc8-9669-5a5800a42126 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:19.176037 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-72b52d1f-1ba0-4cc8-9669-5a5800a42126 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:19.176483 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-72b52d1f-1ba0-4cc8-9669-5a5800a42126 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:19.395370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bd389271-b16f-42d0-9a14-b562deb1be8b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:19.396129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bd389271-b16f-42d0-9a14-b562deb1be8b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:19.407594 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd389271-b16f-42d0-9a14-b562deb1be8b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:19.408049 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd389271-b16f-42d0-9a14-b562deb1be8b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:19.411327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd389271-b16f-42d0-9a14-b562deb1be8b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:19.411862 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd389271-b16f-42d0-9a14-b562deb1be8b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:19.435630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-72b52d1f-1ba0-4cc8-9669-5a5800a42126 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135fc0b1f4cf4fd5a89e15d4cba96fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa28f3617964bf3b2abda804a2d4c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:19.448392 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-72b52d1f-1ba0-4cc8-9669-5a5800a42126 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] 10.222.0.49 "GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c" status: 200 len: 1510 microversion: 2.1 time: 0.289084 Jul 25 13:07:19.448997 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2544/4993] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:19 2022] GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c => generated 1510 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-bd389271-b16f-42d0-9a14-b562deb1be8b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] HTTP exception thrown: Instance 966b2836-cec0-45b1-b147-bfde8ea67226 could not be found. Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bd389271-b16f-42d0-9a14-b562deb1be8b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Request method failure captured: Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 HTTP/1.1 Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pTdZnYy3zWCXLN8GI-lAb9Aac2xutmWdntWmHOJQQOAHuSaLRru4vmbdxH-2ipAsIwdgHGRBCQV52EgrlBqV5LzQtSAIs0OqruuNBUIA1ZYGpGU7ybcvN2tekv0vVPxk7wJZaAmUwppQmT0JDG4pBCSl5Rw9dXMoK1Y6yvluyRvyio Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersTestJSON-733750618 Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebb6a07295234370aa1aa5067b8ee930", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}] Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersTestJSON-733750618 Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersTestJSON-733750618 Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersTestJSON-733750618-project Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 60d84eb7c45449cbad3141d9f363e693 Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersTestJSON-733750618-project Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 966b2836-cec0-45b1-b147-bfde8ea67226 could not be found. Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '966b2836-cec0-45b1-b147-bfde8ea67226'} Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 966b2836-cec0-45b1-b147-bfde8ea67226 could not be found. Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:07:19.464189 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:07:19.468616 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 966b2836-cec0-45b1-b147-bfde8ea67226 could not be found. Jul 25 13:07:19.468616 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:07:19.468616 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:07:19.468616 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:07:19.468616 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:07:19.468616 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:07:19.468616 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:07:19.468616 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:07:19.468616 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:07:19.468616 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 966b2836-cec0-45b1-b147-bfde8ea67226 could not be found. Jul 25 13:07:19.468616 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:07:19.468616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bd389271-b16f-42d0-9a14-b562deb1be8b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Returning 404 to user: Instance 966b2836-cec0-45b1-b147-bfde8ea67226 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:07:19.468616 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bd389271-b16f-42d0-9a14-b562deb1be8b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226" status: 404 len: 111 microversion: 2.1 time: 0.077197 Jul 25 13:07:19.468616 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2450/4994] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:19 2022] GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 13:07:19.643493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a84aee76-804f-460a-b858-9a7867d69c42 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-572902921", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "41e863a3-713c-4d35-a204-58098a16a6e3"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:19.756839 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-a84aee76-804f-460a-b858-9a7867d69c42 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] validate_networks() for [('41e863a3-713c-4d35-a204-58098a16a6e3', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:07:20.413798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-a84aee76-804f-460a-b858-9a7867d69c42 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:07:20.414389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-a84aee76-804f-460a-b858-9a7867d69c42 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:07:20.415003 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-a84aee76-804f-460a-b858-9a7867d69c42 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:07:20.415592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-a84aee76-804f-460a-b858-9a7867d69c42 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:07:20.416193 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-a84aee76-804f-460a-b858-9a7867d69c42 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:07:20.429972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a84aee76-804f-460a-b858-9a7867d69c42 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:20.430674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a84aee76-804f-460a-b858-9a7867d69c42 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:20.431778 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a84aee76-804f-460a-b858-9a7867d69c42 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:20.432617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a84aee76-804f-460a-b858-9a7867d69c42 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:20.469308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-a84aee76-804f-460a-b858-9a7867d69c42 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Getting quotas for project ebb6a07295234370aa1aa5067b8ee930. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:07:20.470301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-eedd3a00-8d4b-4347-96b4-20417d0c62a1 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:20.471063 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-eedd3a00-8d4b-4347-96b4-20417d0c62a1 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] [instance: cb270188-15b8-471f-980f-53248b4fc71c] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:20.478939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eedd3a00-8d4b-4347-96b4-20417d0c62a1 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:20.480264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eedd3a00-8d4b-4347-96b4-20417d0c62a1 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:20.481169 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eedd3a00-8d4b-4347-96b4-20417d0c62a1 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:20.482937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-a84aee76-804f-460a-b858-9a7867d69c42 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Getting quotas for user 60d84eb7c45449cbad3141d9f363e693 and project ebb6a07295234370aa1aa5067b8ee930. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:07:20.483309 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eedd3a00-8d4b-4347-96b4-20417d0c62a1 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:20.520949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a84aee76-804f-460a-b858-9a7867d69c42 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:07:20.523786 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a84aee76-804f-460a-b858-9a7867d69c42 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:07:20.644221 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a84aee76-804f-460a-b858-9a7867d69c42 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.005598 Jul 25 13:07:20.645770 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2545/4995] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:07:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:07:20.656746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ca8d227b-c359-4b99-abbb-6266cf783f07 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:20.670737 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ca8d227b-c359-4b99-abbb-6266cf783f07 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:20.947762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ca8d227b-c359-4b99-abbb-6266cf783f07 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:20.977690 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ca8d227b-c359-4b99-abbb-6266cf783f07 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1208 microversion: 2.1 time: 0.324847 Jul 25 13:07:20.985356 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2546/4996] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:20 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1208 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:07:21.255912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-eedd3a00-8d4b-4347-96b4-20417d0c62a1 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135fc0b1f4cf4fd5a89e15d4cba96fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa28f3617964bf3b2abda804a2d4c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:21.271634 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-eedd3a00-8d4b-4347-96b4-20417d0c62a1 tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] 10.222.0.49 "GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c" status: 200 len: 1510 microversion: 2.1 time: 0.799546 Jul 25 13:07:21.286592 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2451/4997] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:20 2022] GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c => generated 1510 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:07:22.008126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f0acc147-f4bd-43b3-87e9-0c6699556d4d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:22.008799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f0acc147-f4bd-43b3-87e9-0c6699556d4d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:22.030870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f0acc147-f4bd-43b3-87e9-0c6699556d4d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:22.031341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f0acc147-f4bd-43b3-87e9-0c6699556d4d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:22.032171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f0acc147-f4bd-43b3-87e9-0c6699556d4d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:22.032607 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f0acc147-f4bd-43b3-87e9-0c6699556d4d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:22.092786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-aa3b09ac-5500-4005-8021-8c34f57b972d req-57f0d6a6-b22a-41f1-b1cd-e0632b34f6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb270188-15b8-471f-980f-53248b4fc71c", "name": "network-vif-deleted", "tag": "982ba447-66be-4a3f-92a1-8122ca3ed816"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:22.117214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-aa3b09ac-5500-4005-8021-8c34f57b972d req-57f0d6a6-b22a-41f1-b1cd-e0632b34f6a9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:22.119747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-aa3b09ac-5500-4005-8021-8c34f57b972d req-57f0d6a6-b22a-41f1-b1cd-e0632b34f6a9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:22.182589 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-aa3b09ac-5500-4005-8021-8c34f57b972d req-57f0d6a6-b22a-41f1-b1cd-e0632b34f6a9 service nova] Creating event network-vif-deleted:982ba447-66be-4a3f-92a1-8122ca3ed816 for instance cb270188-15b8-471f-980f-53248b4fc71c on n-h2-848886-15 Jul 25 13:07:22.203244 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-aa3b09ac-5500-4005-8021-8c34f57b972d req-57f0d6a6-b22a-41f1-b1cd-e0632b34f6a9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119673 Jul 25 13:07:22.205622 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2452/4998] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:07:22.228039 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0b9ad4e2-b9f1-4d35-8a54-f09bdfef90f4 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:22.236968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0b9ad4e2-b9f1-4d35-8a54-f09bdfef90f4 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:22.259576 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0b9ad4e2-b9f1-4d35-8a54-f09bdfef90f4 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:22.262616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0b9ad4e2-b9f1-4d35-8a54-f09bdfef90f4 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:22.265553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0b9ad4e2-b9f1-4d35-8a54-f09bdfef90f4 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:22.266887 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0b9ad4e2-b9f1-4d35-8a54-f09bdfef90f4 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:22.294099 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f0acc147-f4bd-43b3-87e9-0c6699556d4d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:22.302646 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f0acc147-f4bd-43b3-87e9-0c6699556d4d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1260 microversion: 2.1 time: 0.299762 Jul 25 13:07:22.305729 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2547/4999] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:22 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1260 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:22.335208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0526ec47-13b7-40c2-9f23-76955244a69c tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:22.356299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0526ec47-13b7-40c2-9f23-76955244a69c tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] [instance: cb270188-15b8-471f-980f-53248b4fc71c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:22.387047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0526ec47-13b7-40c2-9f23-76955244a69c tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:22.387514 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0526ec47-13b7-40c2-9f23-76955244a69c tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:22.388306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0526ec47-13b7-40c2-9f23-76955244a69c tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:22.388744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0526ec47-13b7-40c2-9f23-76955244a69c tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:22.523066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0526ec47-13b7-40c2-9f23-76955244a69c tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:22.525075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0526ec47-13b7-40c2-9f23-76955244a69c tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:22.530226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-0526ec47-13b7-40c2-9f23-76955244a69c tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lazy-loading 'fault' on Instance uuid cb270188-15b8-471f-980f-53248b4fc71c {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:07:22.604299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0526ec47-13b7-40c2-9f23-76955244a69c tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135fc0b1f4cf4fd5a89e15d4cba96fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa28f3617964bf3b2abda804a2d4c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:22.617943 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0b9ad4e2-b9f1-4d35-8a54-f09bdfef90f4 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:22.618848 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0526ec47-13b7-40c2-9f23-76955244a69c tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] 10.222.0.49 "GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c" status: 200 len: 1306 microversion: 2.1 time: 0.309866 Jul 25 13:07:22.619461 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2548/5000] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:22 2022] GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c => generated 1306 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:22.642317 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0b9ad4e2-b9f1-4d35-8a54-f09bdfef90f4 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1683 microversion: 2.1 time: 0.425167 Jul 25 13:07:22.643013 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2453/5001] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:22 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1683 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:22.766709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-420febeb-3da5-4c4b-81e9-762198cac11f tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:22.769214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-420febeb-3da5-4c4b-81e9-762198cac11f tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:22.780835 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-420febeb-3da5-4c4b-81e9-762198cac11f tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:22.790560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-420febeb-3da5-4c4b-81e9-762198cac11f tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:22.797415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-420febeb-3da5-4c4b-81e9-762198cac11f tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:22.798200 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-420febeb-3da5-4c4b-81e9-762198cac11f tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:22.878205 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-420febeb-3da5-4c4b-81e9-762198cac11f tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "POST /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc/action" status: 200 len: 32642 microversion: 2.1 time: 0.115878 Jul 25 13:07:22.879078 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2549/5002] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:07:22 2022] POST /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc/action => generated 32642 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:07:23.042917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-29d3dbae-e04c-4a8d-b639-a480469cd473 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:23.043492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-29d3dbae-e04c-4a8d-b639-a480469cd473 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:23.056563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29d3dbae-e04c-4a8d-b639-a480469cd473 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:23.057019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29d3dbae-e04c-4a8d-b639-a480469cd473 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:23.057821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29d3dbae-e04c-4a8d-b639-a480469cd473 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:23.058283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29d3dbae-e04c-4a8d-b639-a480469cd473 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:23.331028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1969a8c4-8012-42ca-94ee-3a888810717c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:23.331656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1969a8c4-8012-42ca-94ee-3a888810717c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:23.344670 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1969a8c4-8012-42ca-94ee-3a888810717c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:23.345384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1969a8c4-8012-42ca-94ee-3a888810717c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:23.349146 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1969a8c4-8012-42ca-94ee-3a888810717c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:23.349791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1969a8c4-8012-42ca-94ee-3a888810717c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:23.435038 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-29d3dbae-e04c-4a8d-b639-a480469cd473 tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1836 microversion: 2.1 time: 0.393437 Jul 25 13:07:23.451164 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2454/5003] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:23 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1836 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:23.470277 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1969a8c4-8012-42ca-94ee-3a888810717c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:23.486509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7c5bee42-0a5a-4c5d-862a-82211acc599a tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:23.495792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7c5bee42-0a5a-4c5d-862a-82211acc599a tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:23.502146 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1969a8c4-8012-42ca-94ee-3a888810717c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1266 microversion: 2.1 time: 0.173521 Jul 25 13:07:23.503494 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2550/5004] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:23 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:23.508697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c5bee42-0a5a-4c5d-862a-82211acc599a tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:23.509703 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c5bee42-0a5a-4c5d-862a-82211acc599a tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:23.511024 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c5bee42-0a5a-4c5d-862a-82211acc599a tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:23.511672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c5bee42-0a5a-4c5d-862a-82211acc599a tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:23.577539 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-7c5bee42-0a5a-4c5d-862a-82211acc599a tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lazy-loading 'flavor' on Instance uuid f6cffb3b-3dc6-439e-9433-b9107bfccfcc {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:07:23.591519 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7c5bee42-0a5a-4c5d-862a-82211acc599a tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Going to try to live migrate instance to another host {{(pid=125883) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 13:07:23.639732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7ac48e58-16ab-4120-9d49-d46b941ca3be tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:23.641100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7ac48e58-16ab-4120-9d49-d46b941ca3be tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] [instance: cb270188-15b8-471f-980f-53248b4fc71c] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:23.658903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ac48e58-16ab-4120-9d49-d46b941ca3be tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:23.660635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ac48e58-16ab-4120-9d49-d46b941ca3be tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:23.662502 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ac48e58-16ab-4120-9d49-d46b941ca3be tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:23.665377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ac48e58-16ab-4120-9d49-d46b941ca3be tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:23.704849 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-7ac48e58-16ab-4120-9d49-d46b941ca3be tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] HTTP exception thrown: Instance cb270188-15b8-471f-980f-53248b4fc71c could not be found. Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7ac48e58-16ab-4120-9d49-d46b941ca3be tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Request method failure captured: Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c HTTP/1.1 Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pV4izzbNagwnotgf9JRG-WlzncZPfVjbZ-uTRRsA8qshLshUnQ3RQvDgrRvWzwklJyXuD2D5t7tTS6Do0TnfOGRTnu0ZNd0RQO3IwJv_u3jZgivmqSbGp0eEGx9GV0AROeLFcZce249_eom_KQFCXIeEl1-1bCzrQvSKTdM_Ad38JU Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: ffa28f3617964bf3b2abda804a2d4c9d Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerAddressesTestJSON-237314128 Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ffa28f3617964bf3b2abda804a2d4c9d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ffa28f3617964bf3b2abda804a2d4c9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ffa28f3617964bf3b2abda804a2d4c9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ffa28f3617964bf3b2abda804a2d4c9d"}]}] Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerAddressesTestJSON-237314128 Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: ffa28f3617964bf3b2abda804a2d4c9d Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerAddressesTestJSON-237314128 Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerAddressesTestJSON-237314128-project Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 135fc0b1f4cf4fd5a89e15d4cba96fa6 Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerAddressesTestJSON-237314128-project Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance cb270188-15b8-471f-980f-53248b4fc71c could not be found. Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'cb270188-15b8-471f-980f-53248b4fc71c'} Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb270188-15b8-471f-980f-53248b4fc71c could not be found. Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb270188-15b8-471f-980f-53248b4fc71c could not be found. Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:07:23.707381 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:07:23.712169 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:07:23.712169 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:07:23.712169 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:07:23.712169 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:07:23.712169 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:07:23.712169 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb270188-15b8-471f-980f-53248b4fc71c could not be found. Jul 25 13:07:23.712169 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:07:23.714260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7ac48e58-16ab-4120-9d49-d46b941ca3be tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] Returning 404 to user: Instance cb270188-15b8-471f-980f-53248b4fc71c could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:07:23.715365 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7ac48e58-16ab-4120-9d49-d46b941ca3be tempest-ServerAddressesTestJSON-237314128 tempest-ServerAddressesTestJSON-237314128-project] 10.222.0.49 "GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c" status: 404 len: 111 microversion: 2.1 time: 0.079788 Jul 25 13:07:23.716861 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2551/5005] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:23 2022] GET /compute/v2.1/servers/cb270188-15b8-471f-980f-53248b4fc71c => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 13:07:24.531609 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c1df2593-b476-4a5f-8e28-2285b2693aa4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:24.532259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c1df2593-b476-4a5f-8e28-2285b2693aa4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:24.547067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1df2593-b476-4a5f-8e28-2285b2693aa4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:24.548780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1df2593-b476-4a5f-8e28-2285b2693aa4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:24.551186 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1df2593-b476-4a5f-8e28-2285b2693aa4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:24.551692 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c1df2593-b476-4a5f-8e28-2285b2693aa4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:25.138457 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c1df2593-b476-4a5f-8e28-2285b2693aa4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:25.157872 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c1df2593-b476-4a5f-8e28-2285b2693aa4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1308 microversion: 2.1 time: 0.622834 Jul 25 13:07:25.159026 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2552/5006] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:24 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1308 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:25.870042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-3ab74cf4-ad88-4bdc-b564-e8c325871013 req-cd329b86-deae-4880-859d-060d9e30844b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9029dd8-106b-4795-bf7d-9eff09d4abb8", "tag": "73b3ecbb-bec7-4104-97cb-88cec161c39e"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:25.894013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3ab74cf4-ad88-4bdc-b564-e8c325871013 req-cd329b86-deae-4880-859d-060d9e30844b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:25.894699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3ab74cf4-ad88-4bdc-b564-e8c325871013 req-cd329b86-deae-4880-859d-060d9e30844b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:25.924973 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-3ab74cf4-ad88-4bdc-b564-e8c325871013 req-cd329b86-deae-4880-859d-060d9e30844b service nova] Creating event network-changed:73b3ecbb-bec7-4104-97cb-88cec161c39e for instance c9029dd8-106b-4795-bf7d-9eff09d4abb8 on n-h1-848886-15 Jul 25 13:07:25.939860 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-3ab74cf4-ad88-4bdc-b564-e8c325871013 req-cd329b86-deae-4880-859d-060d9e30844b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074407 Jul 25 13:07:25.942952 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2553/5007] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:07:26.185591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-38eb1c56-d5be-4e75-be0a-8f10ddc79c6a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:26.190658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-38eb1c56-d5be-4e75-be0a-8f10ddc79c6a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:26.219107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38eb1c56-d5be-4e75-be0a-8f10ddc79c6a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:26.223572 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38eb1c56-d5be-4e75-be0a-8f10ddc79c6a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:26.227331 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38eb1c56-d5be-4e75-be0a-8f10ddc79c6a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:26.228009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38eb1c56-d5be-4e75-be0a-8f10ddc79c6a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:26.934427 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-38eb1c56-d5be-4e75-be0a-8f10ddc79c6a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:26.954382 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-38eb1c56-d5be-4e75-be0a-8f10ddc79c6a tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1308 microversion: 2.1 time: 0.778544 Jul 25 13:07:26.956208 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2554/5008] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:26 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1308 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:27.139188 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7c5bee42-0a5a-4c5d-862a-82211acc599a tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc/action" status: 202 len: 0 microversion: 2.1 time: 3.662208 Jul 25 13:07:27.140393 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2455/5009] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:07:23 2022] POST /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc/action => generated 0 bytes in 3666 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:07:27.151623 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d5994c8f-ae84-48a5-b847-277fd892ab73 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:27.152248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d5994c8f-ae84-48a5-b847-277fd892ab73 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:27.182985 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5994c8f-ae84-48a5-b847-277fd892ab73 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:27.186574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5994c8f-ae84-48a5-b847-277fd892ab73 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:27.188433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5994c8f-ae84-48a5-b847-277fd892ab73 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:27.189034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5994c8f-ae84-48a5-b847-277fd892ab73 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:27.534165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d5994c8f-ae84-48a5-b847-277fd892ab73 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:27.537075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:07:27.547757 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d5994c8f-ae84-48a5-b847-277fd892ab73 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1693 microversion: 2.1 time: 0.399996 Jul 25 13:07:27.555095 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2555/5010] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:27 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1693 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:27.978579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4aaf4ce1-0bfa-47fd-981f-8b40b66bc9c9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:27.979212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4aaf4ce1-0bfa-47fd-981f-8b40b66bc9c9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:28.003477 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4aaf4ce1-0bfa-47fd-981f-8b40b66bc9c9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:28.003937 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4aaf4ce1-0bfa-47fd-981f-8b40b66bc9c9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:28.004774 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4aaf4ce1-0bfa-47fd-981f-8b40b66bc9c9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:28.005799 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4aaf4ce1-0bfa-47fd-981f-8b40b66bc9c9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:28.574236 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4aaf4ce1-0bfa-47fd-981f-8b40b66bc9c9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:28.576342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-25257f00-c0e6-4e41-9b3d-47cd4ca51cc8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:28.577614 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-25257f00-c0e6-4e41-9b3d-47cd4ca51cc8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:28.592193 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4aaf4ce1-0bfa-47fd-981f-8b40b66bc9c9 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1308 microversion: 2.1 time: 0.617976 Jul 25 13:07:28.593854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25257f00-c0e6-4e41-9b3d-47cd4ca51cc8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:28.596647 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2456/5011] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:27 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1308 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:07:28.596922 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25257f00-c0e6-4e41-9b3d-47cd4ca51cc8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:28.599224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25257f00-c0e6-4e41-9b3d-47cd4ca51cc8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:28.601142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25257f00-c0e6-4e41-9b3d-47cd4ca51cc8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:29.067701 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-25257f00-c0e6-4e41-9b3d-47cd4ca51cc8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:29.079311 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-25257f00-c0e6-4e41-9b3d-47cd4ca51cc8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1693 microversion: 2.1 time: 0.507787 Jul 25 13:07:29.079949 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2556/5012] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:28 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1693 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:07:29.622473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d4ffa68e-2c08-4a90-a64f-f944bc384202 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:29.623029 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d4ffa68e-2c08-4a90-a64f-f944bc384202 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:29.646661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4ffa68e-2c08-4a90-a64f-f944bc384202 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:29.649559 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4ffa68e-2c08-4a90-a64f-f944bc384202 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:29.654378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4ffa68e-2c08-4a90-a64f-f944bc384202 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:29.655062 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4ffa68e-2c08-4a90-a64f-f944bc384202 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:30.103353 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c28b4835-37ca-485f-9008-bf49e72fef8b tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:30.103960 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c28b4835-37ca-485f-9008-bf49e72fef8b tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:30.115341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c28b4835-37ca-485f-9008-bf49e72fef8b tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:30.119400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c28b4835-37ca-485f-9008-bf49e72fef8b tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:30.120439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c28b4835-37ca-485f-9008-bf49e72fef8b tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:30.121054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c28b4835-37ca-485f-9008-bf49e72fef8b tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:30.151851 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d4ffa68e-2c08-4a90-a64f-f944bc384202 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:30.166233 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d4ffa68e-2c08-4a90-a64f-f944bc384202 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1308 microversion: 2.1 time: 0.553208 Jul 25 13:07:30.167066 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2457/5013] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:29 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1308 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:30.453930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c28b4835-37ca-485f-9008-bf49e72fef8b tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:30.462899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:07:30.465917 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c28b4835-37ca-485f-9008-bf49e72fef8b tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1693 microversion: 2.1 time: 0.366684 Jul 25 13:07:30.480305 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2557/5014] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:30 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1693 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:07:30.724624 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-f69c43cd-0bc7-4b70-a772-c556fd23f5a7 req-40a8e988-6985-45bf-aeb2-4f999cd97d0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6cffb3b-3dc6-439e-9433-b9107bfccfcc", "name": "network-vif-unplugged", "status": "completed", "tag": "adbcb40b-638c-4e4f-928f-2406ca66229f"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:30.739969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-f69c43cd-0bc7-4b70-a772-c556fd23f5a7 req-40a8e988-6985-45bf-aeb2-4f999cd97d0d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:30.740750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-f69c43cd-0bc7-4b70-a772-c556fd23f5a7 req-40a8e988-6985-45bf-aeb2-4f999cd97d0d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:30.757049 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-f69c43cd-0bc7-4b70-a772-c556fd23f5a7 req-40a8e988-6985-45bf-aeb2-4f999cd97d0d service nova] Creating event network-vif-unplugged:adbcb40b-638c-4e4f-928f-2406ca66229f for instance f6cffb3b-3dc6-439e-9433-b9107bfccfcc on n-h2-848886-15 Jul 25 13:07:30.767259 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-f69c43cd-0bc7-4b70-a772-c556fd23f5a7 req-40a8e988-6985-45bf-aeb2-4f999cd97d0d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044992 Jul 25 13:07:30.769121 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2458/5015] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:07:31.197819 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-77f46f53-2044-4622-9f9d-a4fb00fdf0cb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:31.203008 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-77f46f53-2044-4622-9f9d-a4fb00fdf0cb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:31.213288 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=8 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:07:31.215772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:07:31.245403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-77f46f53-2044-4622-9f9d-a4fb00fdf0cb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:31.248037 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-77f46f53-2044-4622-9f9d-a4fb00fdf0cb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:31.253459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-77f46f53-2044-4622-9f9d-a4fb00fdf0cb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:31.255900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-77f46f53-2044-4622-9f9d-a4fb00fdf0cb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:31.493780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c69a8516-820c-4343-bf33-40336744f3c1 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:31.498510 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c69a8516-820c-4343-bf33-40336744f3c1 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:31.514913 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c69a8516-820c-4343-bf33-40336744f3c1 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:31.515586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c69a8516-820c-4343-bf33-40336744f3c1 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:31.516832 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c69a8516-820c-4343-bf33-40336744f3c1 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:31.518786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c69a8516-820c-4343-bf33-40336744f3c1 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:31.542693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-77f46f53-2044-4622-9f9d-a4fb00fdf0cb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:31.551201 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-77f46f53-2044-4622-9f9d-a4fb00fdf0cb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1308 microversion: 2.1 time: 0.366394 Jul 25 13:07:31.552499 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2558/5016] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:31 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1308 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:31.700474 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6a854506-ef2c-4ec3-bbfd-de4293cc1a34 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:31.702885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6a854506-ef2c-4ec3-bbfd-de4293cc1a34 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:31.718305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a854506-ef2c-4ec3-bbfd-de4293cc1a34 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:31.719008 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a854506-ef2c-4ec3-bbfd-de4293cc1a34 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:31.720240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a854506-ef2c-4ec3-bbfd-de4293cc1a34 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:31.720861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a854506-ef2c-4ec3-bbfd-de4293cc1a34 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:31.750672 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-6a854506-ef2c-4ec3-bbfd-de4293cc1a34 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lazy-loading 'flavor' on Instance uuid 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:07:31.840235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c69a8516-820c-4343-bf33-40336744f3c1 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:31.856725 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c69a8516-820c-4343-bf33-40336744f3c1 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1693 microversion: 2.1 time: 0.368146 Jul 25 13:07:31.857463 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2459/5017] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:31 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1693 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:07:32.021512 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6a854506-ef2c-4ec3-bbfd-de4293cc1a34 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "POST /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/action" status: 200 len: 32 microversion: 2.1 time: 0.324890 Jul 25 13:07:32.022269 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2559/5018] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:07:31 2022] POST /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/action => generated 32 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 13:07:32.032234 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9591a8ab-f89c-42c0-9ba6-3d0af529bb7c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:32.033135 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9591a8ab-f89c-42c0-9ba6-3d0af529bb7c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:32.042167 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9591a8ab-f89c-42c0-9ba6-3d0af529bb7c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:32.046459 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9591a8ab-f89c-42c0-9ba6-3d0af529bb7c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:32.047613 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9591a8ab-f89c-42c0-9ba6-3d0af529bb7c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:32.049846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9591a8ab-f89c-42c0-9ba6-3d0af529bb7c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:32.573634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cdbd89c9-36aa-4d0c-ae6a-2c9c2de423f8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:32.575443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cdbd89c9-36aa-4d0c-ae6a-2c9c2de423f8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:32.594279 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cdbd89c9-36aa-4d0c-ae6a-2c9c2de423f8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:32.595100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cdbd89c9-36aa-4d0c-ae6a-2c9c2de423f8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:32.596076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cdbd89c9-36aa-4d0c-ae6a-2c9c2de423f8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:32.596695 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cdbd89c9-36aa-4d0c-ae6a-2c9c2de423f8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:33.025032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9591a8ab-f89c-42c0-9ba6-3d0af529bb7c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:33.042960 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9591a8ab-f89c-42c0-9ba6-3d0af529bb7c tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1735 microversion: 2.1 time: 1.014982 Jul 25 13:07:33.044044 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2460/5019] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:32 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1735 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:33.049057 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-6ba23b64-4ef3-4cc4-a543-0549f2ca91f0 req-33601f30-6d2b-4a71-8264-34eb6ea68eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9029dd8-106b-4795-bf7d-9eff09d4abb8", "name": "network-vif-plugged", "status": "completed", "tag": "73b3ecbb-bec7-4104-97cb-88cec161c39e"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:33.060933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-6ba23b64-4ef3-4cc4-a543-0549f2ca91f0 req-33601f30-6d2b-4a71-8264-34eb6ea68eff service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:33.061531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-6ba23b64-4ef3-4cc4-a543-0549f2ca91f0 req-33601f30-6d2b-4a71-8264-34eb6ea68eff service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:33.073755 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-6ba23b64-4ef3-4cc4-a543-0549f2ca91f0 req-33601f30-6d2b-4a71-8264-34eb6ea68eff service nova] Creating event network-vif-plugged:73b3ecbb-bec7-4104-97cb-88cec161c39e for instance c9029dd8-106b-4795-bf7d-9eff09d4abb8 on n-h1-848886-15 Jul 25 13:07:33.080848 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-6ba23b64-4ef3-4cc4-a543-0549f2ca91f0 req-33601f30-6d2b-4a71-8264-34eb6ea68eff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035448 Jul 25 13:07:33.085269 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2461/5020] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:07:33.091168 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-923fae72-0262-49fc-b465-ec33c846c514 req-e86e5e50-44e4-4e4c-bb64-929736dbb719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6cffb3b-3dc6-439e-9433-b9107bfccfcc", "tag": "adbcb40b-638c-4e4f-928f-2406ca66229f"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:33.102487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-923fae72-0262-49fc-b465-ec33c846c514 req-e86e5e50-44e4-4e4c-bb64-929736dbb719 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:33.103271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-923fae72-0262-49fc-b465-ec33c846c514 req-e86e5e50-44e4-4e4c-bb64-929736dbb719 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:33.108245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:07:33.120296 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-923fae72-0262-49fc-b465-ec33c846c514 req-e86e5e50-44e4-4e4c-bb64-929736dbb719 service nova] Creating event network-changed:adbcb40b-638c-4e4f-928f-2406ca66229f for instance f6cffb3b-3dc6-439e-9433-b9107bfccfcc on n-h2-848886-15 Jul 25 13:07:33.128633 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-923fae72-0262-49fc-b465-ec33c846c514 req-e86e5e50-44e4-4e4c-bb64-929736dbb719 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041628 Jul 25 13:07:33.129884 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2462/5021] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:07:33.135358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3175e4be-aeba-4ca9-8722-62a659bb9594 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:33.136514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3175e4be-aeba-4ca9-8722-62a659bb9594 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:33.143646 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3175e4be-aeba-4ca9-8722-62a659bb9594 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:33.144440 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3175e4be-aeba-4ca9-8722-62a659bb9594 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:33.145427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3175e4be-aeba-4ca9-8722-62a659bb9594 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:33.146092 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3175e4be-aeba-4ca9-8722-62a659bb9594 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:33.349592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cdbd89c9-36aa-4d0c-ae6a-2c9c2de423f8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:33.364793 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cdbd89c9-36aa-4d0c-ae6a-2c9c2de423f8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1308 microversion: 2.1 time: 0.795616 Jul 25 13:07:33.380472 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2560/5022] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:32 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1308 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:33.544082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3175e4be-aeba-4ca9-8722-62a659bb9594 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:33.555646 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3175e4be-aeba-4ca9-8722-62a659bb9594 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1693 microversion: 2.1 time: 0.424133 Jul 25 13:07:33.556533 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2463/5023] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:33 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1693 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:34.070621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-85f53df2-84e0-41ac-860a-997216ee38b9 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:34.073498 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-85f53df2-84e0-41ac-860a-997216ee38b9 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:34.082536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85f53df2-84e0-41ac-860a-997216ee38b9 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:34.083338 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85f53df2-84e0-41ac-860a-997216ee38b9 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:34.084426 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85f53df2-84e0-41ac-860a-997216ee38b9 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:34.085476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85f53df2-84e0-41ac-860a-997216ee38b9 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:34.321623 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-85f53df2-84e0-41ac-860a-997216ee38b9 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:34.342045 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-85f53df2-84e0-41ac-860a-997216ee38b9 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1735 microversion: 2.1 time: 0.276736 Jul 25 13:07:34.343573 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2561/5024] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:34 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1735 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:34.390224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-996950c8-495a-4de4-b239-67868adbdb51 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:34.390836 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-996950c8-495a-4de4-b239-67868adbdb51 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:34.401172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-996950c8-495a-4de4-b239-67868adbdb51 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:34.406424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-996950c8-495a-4de4-b239-67868adbdb51 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:34.407403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-996950c8-495a-4de4-b239-67868adbdb51 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:34.407984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-996950c8-495a-4de4-b239-67868adbdb51 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:34.578888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-27cc80d9-7026-4fd5-ba62-3958e57664ce tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:34.580018 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-27cc80d9-7026-4fd5-ba62-3958e57664ce tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:34.589606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27cc80d9-7026-4fd5-ba62-3958e57664ce tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:34.593287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27cc80d9-7026-4fd5-ba62-3958e57664ce tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:34.594317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27cc80d9-7026-4fd5-ba62-3958e57664ce tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:34.596953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27cc80d9-7026-4fd5-ba62-3958e57664ce tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:34.597089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-996950c8-495a-4de4-b239-67868adbdb51 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:34.606033 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-996950c8-495a-4de4-b239-67868adbdb51 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1308 microversion: 2.1 time: 0.220386 Jul 25 13:07:34.607237 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2464/5025] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:34 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1308 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:34.824597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-27cc80d9-7026-4fd5-ba62-3958e57664ce tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:34.835631 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-27cc80d9-7026-4fd5-ba62-3958e57664ce tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1693 microversion: 2.1 time: 0.260050 Jul 25 13:07:34.848052 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2562/5026] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:34 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1693 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:07:35.364718 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9e045f10-fc8d-4d6a-9003-4ca1c3ee6e44 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:35.365250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9e045f10-fc8d-4d6a-9003-4ca1c3ee6e44 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:35.372776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e045f10-fc8d-4d6a-9003-4ca1c3ee6e44 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:35.373727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e045f10-fc8d-4d6a-9003-4ca1c3ee6e44 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:35.374531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e045f10-fc8d-4d6a-9003-4ca1c3ee6e44 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:35.375048 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e045f10-fc8d-4d6a-9003-4ca1c3ee6e44 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:35.629730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ae01adfe-74b2-495f-80a7-a745b6fd72bf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:35.630780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ae01adfe-74b2-495f-80a7-a745b6fd72bf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:35.638391 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae01adfe-74b2-495f-80a7-a745b6fd72bf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:35.638881 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae01adfe-74b2-495f-80a7-a745b6fd72bf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:35.639601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae01adfe-74b2-495f-80a7-a745b6fd72bf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:35.640034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae01adfe-74b2-495f-80a7-a745b6fd72bf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:35.656595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9e045f10-fc8d-4d6a-9003-4ca1c3ee6e44 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:35.669677 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9e045f10-fc8d-4d6a-9003-4ca1c3ee6e44 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1735 microversion: 2.1 time: 0.309328 Jul 25 13:07:35.670299 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2465/5027] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:35 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1735 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:35.857023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-28239e9a-8aeb-48a2-903c-8a92548e6305 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:35.857642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-28239e9a-8aeb-48a2-903c-8a92548e6305 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:35.864362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-28239e9a-8aeb-48a2-903c-8a92548e6305 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:35.864859 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-28239e9a-8aeb-48a2-903c-8a92548e6305 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:35.865715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-28239e9a-8aeb-48a2-903c-8a92548e6305 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:35.866160 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-28239e9a-8aeb-48a2-903c-8a92548e6305 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:36.046892 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ae01adfe-74b2-495f-80a7-a745b6fd72bf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:36.058953 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ae01adfe-74b2-495f-80a7-a745b6fd72bf tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1489 microversion: 2.1 time: 0.434728 Jul 25 13:07:36.059545 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2563/5028] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:35 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1489 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:36.082856 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6f3922b9-16dc-4f58-b34b-2efb2cae7a51 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1771955936"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:36.086055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6f3922b9-16dc-4f58-b34b-2efb2cae7a51 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:36.104522 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6f3922b9-16dc-4f58-b34b-2efb2cae7a51 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:36.104981 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6f3922b9-16dc-4f58-b34b-2efb2cae7a51 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:36.105982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6f3922b9-16dc-4f58-b34b-2efb2cae7a51 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:36.106422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6f3922b9-16dc-4f58-b34b-2efb2cae7a51 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:36.166906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-28239e9a-8aeb-48a2-903c-8a92548e6305 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:36.177696 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-28239e9a-8aeb-48a2-903c-8a92548e6305 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1693 microversion: 2.1 time: 0.324630 Jul 25 13:07:36.180158 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2466/5029] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:35 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1693 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:36.225282 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6f3922b9-16dc-4f58-b34b-2efb2cae7a51 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "PUT /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1075 microversion: 2.1 time: 0.146249 Jul 25 13:07:36.226943 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2564/5030] 10.222.0.49 () {60 vars in 1256 bytes} [Mon Jul 25 13:07:36 2022] PUT /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1075 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:07:36.246483 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b11a031a-ce3d-470b-bb15-20230b3a002e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:36.247267 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b11a031a-ce3d-470b-bb15-20230b3a002e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:36.253527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b11a031a-ce3d-470b-bb15-20230b3a002e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:36.254222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b11a031a-ce3d-470b-bb15-20230b3a002e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:36.255176 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b11a031a-ce3d-470b-bb15-20230b3a002e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:36.255757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b11a031a-ce3d-470b-bb15-20230b3a002e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:36.431261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b11a031a-ce3d-470b-bb15-20230b3a002e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:36.440496 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b11a031a-ce3d-470b-bb15-20230b3a002e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1501 microversion: 2.1 time: 0.197839 Jul 25 13:07:36.441414 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2467/5031] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:36 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1501 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:36.461216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bd365e62-b5f2-4d93-a09b-029aac24ee39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:36.461897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bd365e62-b5f2-4d93-a09b-029aac24ee39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:36.468357 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd365e62-b5f2-4d93-a09b-029aac24ee39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:36.469020 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd365e62-b5f2-4d93-a09b-029aac24ee39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:36.469807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd365e62-b5f2-4d93-a09b-029aac24ee39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:36.470288 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd365e62-b5f2-4d93-a09b-029aac24ee39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:36.706264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5aac1cd0-4608-4197-8095-4031f6269c6b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:36.707005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5aac1cd0-4608-4197-8095-4031f6269c6b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:36.719227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bd365e62-b5f2-4d93-a09b-029aac24ee39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:36.719769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5aac1cd0-4608-4197-8095-4031f6269c6b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:36.719921 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5aac1cd0-4608-4197-8095-4031f6269c6b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:36.720618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5aac1cd0-4608-4197-8095-4031f6269c6b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:36.721077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5aac1cd0-4608-4197-8095-4031f6269c6b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:36.738645 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bd365e62-b5f2-4d93-a09b-029aac24ee39 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1501 microversion: 2.1 time: 0.281223 Jul 25 13:07:36.739626 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2565/5032] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:36 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1501 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:36.761307 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-84ef45ad-5ee1-442d-9dcc-3fc2ce861808 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:36.771166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84ef45ad-5ee1-442d-9dcc-3fc2ce861808 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:36.771848 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84ef45ad-5ee1-442d-9dcc-3fc2ce861808 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:36.824083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-84ef45ad-5ee1-442d-9dcc-3fc2ce861808 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Going to try to stop instance {{(pid=125884) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 13:07:36.921954 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-84ef45ad-5ee1-442d-9dcc-3fc2ce861808 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "POST /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8/action" status: 202 len: 0 microversion: 2.1 time: 0.162930 Jul 25 13:07:36.928687 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2566/5033] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:07:36 2022] POST /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 13:07:36.952175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e9842ebd-24db-4ec0-ad47-c07df50fdd5e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:36.953172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e9842ebd-24db-4ec0-ad47-c07df50fdd5e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:36.967426 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9842ebd-24db-4ec0-ad47-c07df50fdd5e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:36.968955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9842ebd-24db-4ec0-ad47-c07df50fdd5e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:36.970205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9842ebd-24db-4ec0-ad47-c07df50fdd5e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:36.970829 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9842ebd-24db-4ec0-ad47-c07df50fdd5e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:37.168493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5aac1cd0-4608-4197-8095-4031f6269c6b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:37.185200 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5aac1cd0-4608-4197-8095-4031f6269c6b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1735 microversion: 2.1 time: 0.488380 Jul 25 13:07:37.216530 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2468/5034] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:36 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1735 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:37.224635 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8c9b93c0-1bca-46d3-9e4c-6575ed7646bc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:37.226259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8c9b93c0-1bca-46d3-9e4c-6575ed7646bc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:37.242725 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c9b93c0-1bca-46d3-9e4c-6575ed7646bc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:37.243441 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c9b93c0-1bca-46d3-9e4c-6575ed7646bc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:37.244776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c9b93c0-1bca-46d3-9e4c-6575ed7646bc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:37.245574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c9b93c0-1bca-46d3-9e4c-6575ed7646bc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:37.542013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e9842ebd-24db-4ec0-ad47-c07df50fdd5e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:37.556466 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e9842ebd-24db-4ec0-ad47-c07df50fdd5e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1511 microversion: 2.1 time: 0.625927 Jul 25 13:07:37.557656 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2567/5035] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:36 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1511 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:37.616926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8c9b93c0-1bca-46d3-9e4c-6575ed7646bc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:37.631181 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8c9b93c0-1bca-46d3-9e4c-6575ed7646bc tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1693 microversion: 2.1 time: 0.412656 Jul 25 13:07:37.631904 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2469/5036] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:37 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1693 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:38.044273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-6646b207-ad25-4440-8749-1bef7cc79d63 req-e34dcc10-49b0-4d4c-9478-ef67897bf850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6cffb3b-3dc6-439e-9433-b9107bfccfcc", "name": "network-vif-unplugged", "status": "completed", "tag": "adbcb40b-638c-4e4f-928f-2406ca66229f"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:38.073756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6646b207-ad25-4440-8749-1bef7cc79d63 req-e34dcc10-49b0-4d4c-9478-ef67897bf850 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:38.081349 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6646b207-ad25-4440-8749-1bef7cc79d63 req-e34dcc10-49b0-4d4c-9478-ef67897bf850 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:38.123905 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-6646b207-ad25-4440-8749-1bef7cc79d63 req-e34dcc10-49b0-4d4c-9478-ef67897bf850 service nova] Creating event network-vif-unplugged:adbcb40b-638c-4e4f-928f-2406ca66229f for instance f6cffb3b-3dc6-439e-9433-b9107bfccfcc on n-h2-848886-15 Jul 25 13:07:38.130567 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-6646b207-ad25-4440-8749-1bef7cc79d63 req-e34dcc10-49b0-4d4c-9478-ef67897bf850 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090813 Jul 25 13:07:38.131751 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2568/5037] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:07:38.224566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0c6c8c96-a0d4-4455-8445-c2f32a88a4d0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:38.229422 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0c6c8c96-a0d4-4455-8445-c2f32a88a4d0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:38.258734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c6c8c96-a0d4-4455-8445-c2f32a88a4d0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:38.269562 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c6c8c96-a0d4-4455-8445-c2f32a88a4d0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:38.270539 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c6c8c96-a0d4-4455-8445-c2f32a88a4d0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:38.270986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c6c8c96-a0d4-4455-8445-c2f32a88a4d0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:38.579293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a7f11271-fa90-41bf-813b-43417a210c26 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:38.580236 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a7f11271-fa90-41bf-813b-43417a210c26 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:38.593310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7f11271-fa90-41bf-813b-43417a210c26 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:38.594357 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7f11271-fa90-41bf-813b-43417a210c26 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:38.598601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7f11271-fa90-41bf-813b-43417a210c26 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:38.599181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7f11271-fa90-41bf-813b-43417a210c26 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:38.624618 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:07:38.886869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0c6c8c96-a0d4-4455-8445-c2f32a88a4d0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:38.902090 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0c6c8c96-a0d4-4455-8445-c2f32a88a4d0 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1735 microversion: 2.1 time: 0.692751 Jul 25 13:07:38.903450 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2470/5038] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:38 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1735 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:07:38.917912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-800064ee-3134-48f1-9203-b46e6dcca6cd tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:38.918812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-800064ee-3134-48f1-9203-b46e6dcca6cd tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:38.957641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-800064ee-3134-48f1-9203-b46e6dcca6cd tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:38.958142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-800064ee-3134-48f1-9203-b46e6dcca6cd tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:38.958984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-800064ee-3134-48f1-9203-b46e6dcca6cd tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:38.959422 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-800064ee-3134-48f1-9203-b46e6dcca6cd tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:39.175798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a7f11271-fa90-41bf-813b-43417a210c26 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:39.183899 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a7f11271-fa90-41bf-813b-43417a210c26 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1511 microversion: 2.1 time: 0.608818 Jul 25 13:07:39.184803 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2569/5039] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:38 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1511 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:07:39.869653 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-800064ee-3134-48f1-9203-b46e6dcca6cd tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:39.889163 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-800064ee-3134-48f1-9203-b46e6dcca6cd tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1693 microversion: 2.1 time: 0.981969 Jul 25 13:07:39.890644 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2471/5040] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:38 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1693 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:39.928620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5ca08341-0deb-45f6-93a4-4dc736a936d2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:39.929512 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5ca08341-0deb-45f6-93a4-4dc736a936d2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:39.945484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5ca08341-0deb-45f6-93a4-4dc736a936d2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:39.947146 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5ca08341-0deb-45f6-93a4-4dc736a936d2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:39.949155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5ca08341-0deb-45f6-93a4-4dc736a936d2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:39.949905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5ca08341-0deb-45f6-93a4-4dc736a936d2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:39.968592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-037c4cb9-674c-41d7-a560-bfaa276d621b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-741873438", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5c097d01-9111-4493-a050-2ebb1e4d0e66", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "2e9a011a-2cfb-4a86-9ca1-b23997eebbe8"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:40.205072 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-037c4cb9-674c-41d7-a560-bfaa276d621b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] validate_networks() for [('2e9a011a-2cfb-4a86-9ca1-b23997eebbe8', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:07:40.549780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5ca08341-0deb-45f6-93a4-4dc736a936d2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:40.564928 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5ca08341-0deb-45f6-93a4-4dc736a936d2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1735 microversion: 2.1 time: 0.641000 Jul 25 13:07:40.565779 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2570/5041] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:39 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1735 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:40.578708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1383b7f0-c4f8-402a-8c10-ef65f5b0fde1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:40.579677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1383b7f0-c4f8-402a-8c10-ef65f5b0fde1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:40.595054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1383b7f0-c4f8-402a-8c10-ef65f5b0fde1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:40.595794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1383b7f0-c4f8-402a-8c10-ef65f5b0fde1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:40.597589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1383b7f0-c4f8-402a-8c10-ef65f5b0fde1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:40.600966 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1383b7f0-c4f8-402a-8c10-ef65f5b0fde1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:41.227575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1383b7f0-c4f8-402a-8c10-ef65f5b0fde1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:41.237097 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1383b7f0-c4f8-402a-8c10-ef65f5b0fde1 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1511 microversion: 2.1 time: 0.670039 Jul 25 13:07:41.237702 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2571/5042] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:40 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1511 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:41.249751 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-93615454-ae63-4677-aae4-fcbb9140853f tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:41.250398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-93615454-ae63-4677-aae4-fcbb9140853f tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:41.273924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93615454-ae63-4677-aae4-fcbb9140853f tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:41.276840 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93615454-ae63-4677-aae4-fcbb9140853f tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:41.291083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93615454-ae63-4677-aae4-fcbb9140853f tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:41.291850 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93615454-ae63-4677-aae4-fcbb9140853f tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:41.850873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-93615454-ae63-4677-aae4-fcbb9140853f tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:41.859535 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-93615454-ae63-4677-aae4-fcbb9140853f tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1693 microversion: 2.1 time: 0.613657 Jul 25 13:07:41.874583 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2572/5043] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:41 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1693 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:41.886946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-da117f18-667a-4717-963e-6316a5657081 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:41.887569 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-da117f18-667a-4717-963e-6316a5657081 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:41.895154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da117f18-667a-4717-963e-6316a5657081 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:41.895683 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da117f18-667a-4717-963e-6316a5657081 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:41.896682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da117f18-667a-4717-963e-6316a5657081 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:41.897956 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da117f18-667a-4717-963e-6316a5657081 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:42.288972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-037c4cb9-674c-41d7-a560-bfaa276d621b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:07:42.290745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-037c4cb9-674c-41d7-a560-bfaa276d621b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:07:42.291781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-037c4cb9-674c-41d7-a560-bfaa276d621b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:07:42.292406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-037c4cb9-674c-41d7-a560-bfaa276d621b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:07:42.293066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-037c4cb9-674c-41d7-a560-bfaa276d621b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:07:42.312123 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-037c4cb9-674c-41d7-a560-bfaa276d621b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:42.317786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-037c4cb9-674c-41d7-a560-bfaa276d621b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:42.319874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-037c4cb9-674c-41d7-a560-bfaa276d621b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:42.321115 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-037c4cb9-674c-41d7-a560-bfaa276d621b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:42.345097 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-037c4cb9-674c-41d7-a560-bfaa276d621b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Getting quotas for project b2fbd681752c41d0a24a9cf34ebc8389. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:07:42.352369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-037c4cb9-674c-41d7-a560-bfaa276d621b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Getting quotas for user 9face2aaa9df430cb5d361c6e1fdf242 and project b2fbd681752c41d0a24a9cf34ebc8389. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:07:42.399024 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-037c4cb9-674c-41d7-a560-bfaa276d621b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:07:42.401240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-037c4cb9-674c-41d7-a560-bfaa276d621b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='5c097d01-9111-4493-a050-2ebb1e4d0e66',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:07:42.424535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-da117f18-667a-4717-963e-6316a5657081 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:42.441515 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-da117f18-667a-4717-963e-6316a5657081 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1735 microversion: 2.1 time: 0.563946 Jul 25 13:07:42.442285 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2573/5044] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:41 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1735 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:42.448852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-57751c1f-d17a-45de-b5db-872eb5e28389 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:42.455005 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-57751c1f-d17a-45de-b5db-872eb5e28389 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:42.485861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57751c1f-d17a-45de-b5db-872eb5e28389 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:42.486492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57751c1f-d17a-45de-b5db-872eb5e28389 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:42.487351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57751c1f-d17a-45de-b5db-872eb5e28389 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:42.491933 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57751c1f-d17a-45de-b5db-872eb5e28389 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:42.584596 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-037c4cb9-674c-41d7-a560-bfaa276d621b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.625209 Jul 25 13:07:42.585923 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2472/5045] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:07:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 13:07:42.599074 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f65885fc-309e-4f80-8950-cfd2f032f710 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:42.600707 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f65885fc-309e-4f80-8950-cfd2f032f710 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:42.712741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f65885fc-309e-4f80-8950-cfd2f032f710 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:42.720897 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f65885fc-309e-4f80-8950-cfd2f032f710 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1056 microversion: 2.1 time: 0.128308 Jul 25 13:07:42.721503 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2473/5046] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:42 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1056 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:07:42.875012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-57751c1f-d17a-45de-b5db-872eb5e28389 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:42.893178 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-57751c1f-d17a-45de-b5db-872eb5e28389 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1511 microversion: 2.1 time: 0.449226 Jul 25 13:07:42.893987 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2574/5047] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:42 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1511 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:42.904387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8c9d08e1-9659-487d-ad58-b319973d7402 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:42.905022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8c9d08e1-9659-487d-ad58-b319973d7402 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:42.929512 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c9d08e1-9659-487d-ad58-b319973d7402 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:42.930036 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c9d08e1-9659-487d-ad58-b319973d7402 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:42.932033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c9d08e1-9659-487d-ad58-b319973d7402 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:42.933803 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c9d08e1-9659-487d-ad58-b319973d7402 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:42.984618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4dc26870-4c10-4d80-9e5c-a2990cbb72e3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-197769330", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "8529a16e-b7bf-4399-adc1-db6e6ba3cc6b"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:43.103758 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-4dc26870-4c10-4d80-9e5c-a2990cbb72e3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] validate_networks() for [('8529a16e-b7bf-4399-adc1-db6e6ba3cc6b', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:07:43.226841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8c9d08e1-9659-487d-ad58-b319973d7402 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:43.235569 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8c9d08e1-9659-487d-ad58-b319973d7402 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1683 microversion: 2.1 time: 0.340183 Jul 25 13:07:43.236083 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2575/5048] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:42 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1683 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:43.263656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8899a475-6b6a-4f44-9436-a9b7017192fd tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:43.264607 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8899a475-6b6a-4f44-9436-a9b7017192fd tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:43.272833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8899a475-6b6a-4f44-9436-a9b7017192fd tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:43.273540 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8899a475-6b6a-4f44-9436-a9b7017192fd tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:43.274638 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8899a475-6b6a-4f44-9436-a9b7017192fd tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:43.275990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8899a475-6b6a-4f44-9436-a9b7017192fd tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:43.634682 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8899a475-6b6a-4f44-9436-a9b7017192fd tempest-TestNetworkAdvancedServerOps-1716754468 tempest-TestNetworkAdvancedServerOps-1716754468-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1836 microversion: 2.1 time: 0.377449 Jul 25 13:07:43.638132 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2576/5049] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:43 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1836 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:07:43.650007 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bd84386a-dda7-48c0-aae0-0182bb2c9409 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:43.650647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bd84386a-dda7-48c0-aae0-0182bb2c9409 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:43.666411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd84386a-dda7-48c0-aae0-0182bb2c9409 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:43.666871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd84386a-dda7-48c0-aae0-0182bb2c9409 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:43.669169 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd84386a-dda7-48c0-aae0-0182bb2c9409 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:43.670841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd84386a-dda7-48c0-aae0-0182bb2c9409 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:43.927184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4dc26870-4c10-4d80-9e5c-a2990cbb72e3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:07:43.928416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4dc26870-4c10-4d80-9e5c-a2990cbb72e3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:07:43.929278 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4dc26870-4c10-4d80-9e5c-a2990cbb72e3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:07:43.929926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4dc26870-4c10-4d80-9e5c-a2990cbb72e3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:07:43.930542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-4dc26870-4c10-4d80-9e5c-a2990cbb72e3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:07:43.957569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4dc26870-4c10-4d80-9e5c-a2990cbb72e3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:43.966446 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4dc26870-4c10-4d80-9e5c-a2990cbb72e3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:43.967772 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4dc26870-4c10-4d80-9e5c-a2990cbb72e3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:43.968218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4dc26870-4c10-4d80-9e5c-a2990cbb72e3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:43.985255 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bd84386a-dda7-48c0-aae0-0182bb2c9409 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:44.007117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-4dc26870-4c10-4d80-9e5c-a2990cbb72e3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Getting quotas for project b39fba18c6c64ee9bcf7f3335014cdd5. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:07:44.010356 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bd84386a-dda7-48c0-aae0-0182bb2c9409 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1735 microversion: 2.1 time: 0.369052 Jul 25 13:07:44.015350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-4dc26870-4c10-4d80-9e5c-a2990cbb72e3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Getting quotas for user a295be0f5bd94c0c853feb09c47f9ffa and project b39fba18c6c64ee9bcf7f3335014cdd5. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:07:44.024747 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2577/5050] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:43 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1735 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:44.044436 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a2b70f8c-f024-4f5b-a6b1-2a2d530b7c35 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:44.047044 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a2b70f8c-f024-4f5b-a6b1-2a2d530b7c35 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:44.048485 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4dc26870-4c10-4d80-9e5c-a2990cbb72e3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:07:44.054127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4dc26870-4c10-4d80-9e5c-a2990cbb72e3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] [instance: fa3ea3d7-202d-4464-a4bc-e99d48072c3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:07:44.057319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a2b70f8c-f024-4f5b-a6b1-2a2d530b7c35 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:44.058044 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a2b70f8c-f024-4f5b-a6b1-2a2d530b7c35 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:44.059217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a2b70f8c-f024-4f5b-a6b1-2a2d530b7c35 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:44.059948 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a2b70f8c-f024-4f5b-a6b1-2a2d530b7c35 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:44.144726 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4dc26870-4c10-4d80-9e5c-a2990cbb72e3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.416714 Jul 25 13:07:44.152133 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2474/5051] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:07:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:07:44.166712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4dbc4db7-c315-4423-99fb-b0e02f073554 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:44.167637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4dbc4db7-c315-4423-99fb-b0e02f073554 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:44.190339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:07:44.205665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4dbc4db7-c315-4423-99fb-b0e02f073554 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:44.206899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4dbc4db7-c315-4423-99fb-b0e02f073554 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:44.210869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4dbc4db7-c315-4423-99fb-b0e02f073554 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:44.211812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4dbc4db7-c315-4423-99fb-b0e02f073554 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:44.569554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4dbc4db7-c315-4423-99fb-b0e02f073554 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:44.581964 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4dbc4db7-c315-4423-99fb-b0e02f073554 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1108 microversion: 2.1 time: 0.428294 Jul 25 13:07:44.595757 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2475/5052] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:44 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1108 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:44.604243 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fd9f9f1f-5292-4eaa-831f-5b6daad27ca5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:44.606523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fd9f9f1f-5292-4eaa-831f-5b6daad27ca5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:44.614996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd9f9f1f-5292-4eaa-831f-5b6daad27ca5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:44.616788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd9f9f1f-5292-4eaa-831f-5b6daad27ca5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:44.617724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd9f9f1f-5292-4eaa-831f-5b6daad27ca5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:44.618335 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fd9f9f1f-5292-4eaa-831f-5b6daad27ca5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:44.872453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a2b70f8c-f024-4f5b-a6b1-2a2d530b7c35 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:44.886953 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a2b70f8c-f024-4f5b-a6b1-2a2d530b7c35 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1683 microversion: 2.1 time: 0.861122 Jul 25 13:07:44.887546 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2578/5053] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:44 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1683 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:44.910295 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-90d84519-286e-4ff6-865c-a2319615ff6f tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:44.910920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-90d84519-286e-4ff6-865c-a2319615ff6f tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] [instance: fa3ea3d7-202d-4464-a4bc-e99d48072c3a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:44.927921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90d84519-286e-4ff6-865c-a2319615ff6f tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:44.928624 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90d84519-286e-4ff6-865c-a2319615ff6f tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:44.929592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90d84519-286e-4ff6-865c-a2319615ff6f tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:44.930229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90d84519-286e-4ff6-865c-a2319615ff6f tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:45.140117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-90d84519-286e-4ff6-865c-a2319615ff6f tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295be0f5bd94c0c853feb09c47f9ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39fba18c6c64ee9bcf7f3335014cdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:45.152808 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-90d84519-286e-4ff6-865c-a2319615ff6f tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a" status: 200 len: 1227 microversion: 2.1 time: 0.249089 Jul 25 13:07:45.157787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fd9f9f1f-5292-4eaa-831f-5b6daad27ca5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:45.160377 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2579/5054] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:44 2022] GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a => generated 1227 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:45.165506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-17f2fc51-2368-41eb-9e92-9e6a788de9d6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:45.166416 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-17f2fc51-2368-41eb-9e92-9e6a788de9d6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:45.168163 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fd9f9f1f-5292-4eaa-831f-5b6daad27ca5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1511 microversion: 2.1 time: 0.570066 Jul 25 13:07:45.168163 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2476/5055] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:44 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1511 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:45.180141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-17f2fc51-2368-41eb-9e92-9e6a788de9d6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:45.180961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-17f2fc51-2368-41eb-9e92-9e6a788de9d6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:45.181978 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-17f2fc51-2368-41eb-9e92-9e6a788de9d6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:45.182616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-17f2fc51-2368-41eb-9e92-9e6a788de9d6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:45.196465 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7b5de1c0-f26f-4e70-92b6-34a9eef560ef tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:45.202877 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7b5de1c0-f26f-4e70-92b6-34a9eef560ef tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:45.229125 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b5de1c0-f26f-4e70-92b6-34a9eef560ef tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:45.229978 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b5de1c0-f26f-4e70-92b6-34a9eef560ef tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:45.231081 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b5de1c0-f26f-4e70-92b6-34a9eef560ef tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:45.231947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b5de1c0-f26f-4e70-92b6-34a9eef560ef tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:45.339756 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7b5de1c0-f26f-4e70-92b6-34a9eef560ef tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "POST /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc/action" status: 200 len: 38609 microversion: 2.1 time: 0.153893 Jul 25 13:07:45.340478 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2477/5056] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:07:45 2022] POST /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc/action => generated 38609 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:07:45.609343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8ba3f81e-20d5-4cc9-aa97-73b5a7aae6d1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:45.610216 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8ba3f81e-20d5-4cc9-aa97-73b5a7aae6d1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:45.625273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ba3f81e-20d5-4cc9-aa97-73b5a7aae6d1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:45.628347 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ba3f81e-20d5-4cc9-aa97-73b5a7aae6d1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:45.631581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ba3f81e-20d5-4cc9-aa97-73b5a7aae6d1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:45.632301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ba3f81e-20d5-4cc9-aa97-73b5a7aae6d1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:46.540152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8ba3f81e-20d5-4cc9-aa97-73b5a7aae6d1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:46.554554 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8ba3f81e-20d5-4cc9-aa97-73b5a7aae6d1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1126 microversion: 2.1 time: 0.945221 Jul 25 13:07:46.574545 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2478/5057] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:45 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1126 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:46.580193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-eee4e85b-6b00-443e-a227-1ff5fff2cab2 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:46.585133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-eee4e85b-6b00-443e-a227-1ff5fff2cab2 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] [instance: fa3ea3d7-202d-4464-a4bc-e99d48072c3a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:46.598944 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eee4e85b-6b00-443e-a227-1ff5fff2cab2 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:46.599544 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eee4e85b-6b00-443e-a227-1ff5fff2cab2 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:46.600402 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eee4e85b-6b00-443e-a227-1ff5fff2cab2 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:46.600937 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eee4e85b-6b00-443e-a227-1ff5fff2cab2 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:46.631985 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-17f2fc51-2368-41eb-9e92-9e6a788de9d6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:46.646278 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-17f2fc51-2368-41eb-9e92-9e6a788de9d6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1735 microversion: 2.1 time: 1.482206 Jul 25 13:07:46.649244 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2580/5058] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:45 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1735 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:46.665118 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2ee462a0-3315-4a9d-a1d9-1dcfd2c05330 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:46.666063 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2ee462a0-3315-4a9d-a1d9-1dcfd2c05330 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:46.679950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ee462a0-3315-4a9d-a1d9-1dcfd2c05330 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:46.684237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ee462a0-3315-4a9d-a1d9-1dcfd2c05330 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:46.688627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ee462a0-3315-4a9d-a1d9-1dcfd2c05330 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:46.689504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ee462a0-3315-4a9d-a1d9-1dcfd2c05330 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:46.785341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-eee4e85b-6b00-443e-a227-1ff5fff2cab2 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295be0f5bd94c0c853feb09c47f9ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39fba18c6c64ee9bcf7f3335014cdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:46.795658 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-eee4e85b-6b00-443e-a227-1ff5fff2cab2 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a" status: 200 len: 1281 microversion: 2.1 time: 0.219690 Jul 25 13:07:46.800081 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2479/5059] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:46 2022] GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a => generated 1281 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:47.095354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b3dca0af-06f9-42ee-b1ff-cb1d9c216d40 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:47.096157 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b3dca0af-06f9-42ee-b1ff-cb1d9c216d40 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:47.103643 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3dca0af-06f9-42ee-b1ff-cb1d9c216d40 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:47.104300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3dca0af-06f9-42ee-b1ff-cb1d9c216d40 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:47.105267 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3dca0af-06f9-42ee-b1ff-cb1d9c216d40 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:47.105936 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3dca0af-06f9-42ee-b1ff-cb1d9c216d40 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:47.138046 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b3dca0af-06f9-42ee-b1ff-cb1d9c216d40 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:07:47.215735 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:07:47.271091 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b3dca0af-06f9-42ee-b1ff-cb1d9c216d40 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 204 len: 0 microversion: 2.1 time: 0.180055 Jul 25 13:07:47.274856 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2480/5060] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:07:47 2022] DELETE /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 13:07:47.285088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-0a9f786b-8034-4ef4-adca-2d3e79e2b75e req-54d0b6e3-35a9-454d-baac-71cb1efbd817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6cffb3b-3dc6-439e-9433-b9107bfccfcc", "tag": "adbcb40b-638c-4e4f-928f-2406ca66229f"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:47.299460 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0a9f786b-8034-4ef4-adca-2d3e79e2b75e req-54d0b6e3-35a9-454d-baac-71cb1efbd817 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:47.300258 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0a9f786b-8034-4ef4-adca-2d3e79e2b75e req-54d0b6e3-35a9-454d-baac-71cb1efbd817 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:47.323240 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-0a9f786b-8034-4ef4-adca-2d3e79e2b75e req-54d0b6e3-35a9-454d-baac-71cb1efbd817 service nova] Creating event network-changed:adbcb40b-638c-4e4f-928f-2406ca66229f for instance f6cffb3b-3dc6-439e-9433-b9107bfccfcc on n-h1-848886-15 Jul 25 13:07:47.336796 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-0a9f786b-8034-4ef4-adca-2d3e79e2b75e req-54d0b6e3-35a9-454d-baac-71cb1efbd817 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056861 Jul 25 13:07:47.338598 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2481/5061] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:07:47.354686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d2cd816e-60a0-4d39-a379-27884395836a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:47.355746 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d2cd816e-60a0-4d39-a379-27884395836a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:47.371394 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2cd816e-60a0-4d39-a379-27884395836a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:47.371834 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2cd816e-60a0-4d39-a379-27884395836a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:47.372813 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2cd816e-60a0-4d39-a379-27884395836a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:47.373048 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2cd816e-60a0-4d39-a379-27884395836a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:47.846902 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2ee462a0-3315-4a9d-a1d9-1dcfd2c05330 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:47.861735 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2ee462a0-3315-4a9d-a1d9-1dcfd2c05330 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1511 microversion: 2.1 time: 1.211018 Jul 25 13:07:47.862832 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2581/5062] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:46 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1511 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:47.881949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d0fd1519-4bd7-4d7d-9863-5dd12c9336cb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:47.883073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d0fd1519-4bd7-4d7d-9863-5dd12c9336cb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:47.896151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d0fd1519-4bd7-4d7d-9863-5dd12c9336cb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:47.899392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d0fd1519-4bd7-4d7d-9863-5dd12c9336cb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:47.900444 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d0fd1519-4bd7-4d7d-9863-5dd12c9336cb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:47.902306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d0fd1519-4bd7-4d7d-9863-5dd12c9336cb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:48.072454 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d2cd816e-60a0-4d39-a379-27884395836a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:48.086555 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d2cd816e-60a0-4d39-a379-27884395836a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1689 microversion: 2.1 time: 0.745310 Jul 25 13:07:48.088383 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2482/5063] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:47 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1689 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:48.103026 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fbc44f20-baa5-48a9-b5a7-b10fd5348f1a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:48.118867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fbc44f20-baa5-48a9-b5a7-b10fd5348f1a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:48.135325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fbc44f20-baa5-48a9-b5a7-b10fd5348f1a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:48.136046 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fbc44f20-baa5-48a9-b5a7-b10fd5348f1a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:48.137326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fbc44f20-baa5-48a9-b5a7-b10fd5348f1a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:48.138109 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fbc44f20-baa5-48a9-b5a7-b10fd5348f1a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:49.209147 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d0fd1519-4bd7-4d7d-9863-5dd12c9336cb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:49.246531 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d0fd1519-4bd7-4d7d-9863-5dd12c9336cb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1168 microversion: 2.1 time: 1.382316 Jul 25 13:07:49.251403 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2582/5064] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:47 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1168 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:49.252720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fbc44f20-baa5-48a9-b5a7-b10fd5348f1a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:49.266026 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0c2c7b57-ab50-47a2-ab66-2b452012f6f5 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:49.273576 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fbc44f20-baa5-48a9-b5a7-b10fd5348f1a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1735 microversion: 2.1 time: 1.181470 Jul 25 13:07:49.276231 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2483/5065] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:48 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1735 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:49.286166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-15cc8691-4d00-498e-adef-05249f9bd911 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:49.286166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-15cc8691-4d00-498e-adef-05249f9bd911 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:49.301397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0c2c7b57-ab50-47a2-ab66-2b452012f6f5 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] [instance: fa3ea3d7-202d-4464-a4bc-e99d48072c3a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:49.306284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15cc8691-4d00-498e-adef-05249f9bd911 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:49.307945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15cc8691-4d00-498e-adef-05249f9bd911 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:49.309029 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15cc8691-4d00-498e-adef-05249f9bd911 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:49.310614 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-15cc8691-4d00-498e-adef-05249f9bd911 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:49.322788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0c2c7b57-ab50-47a2-ab66-2b452012f6f5 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:49.323955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0c2c7b57-ab50-47a2-ab66-2b452012f6f5 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:49.325131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0c2c7b57-ab50-47a2-ab66-2b452012f6f5 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:49.325756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0c2c7b57-ab50-47a2-ab66-2b452012f6f5 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:49.552437 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0c2c7b57-ab50-47a2-ab66-2b452012f6f5 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295be0f5bd94c0c853feb09c47f9ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39fba18c6c64ee9bcf7f3335014cdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:49.566576 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0c2c7b57-ab50-47a2-ab66-2b452012f6f5 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a" status: 200 len: 1281 microversion: 2.1 time: 0.313460 Jul 25 13:07:49.567661 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2583/5066] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:49 2022] GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a => generated 1281 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:49.573423 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-15be58d8-1f11-4f95-aac8-0ea375507d73 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:49.574145 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-15be58d8-1f11-4f95-aac8-0ea375507d73 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:49.582893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-15be58d8-1f11-4f95-aac8-0ea375507d73 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:49.583407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-15be58d8-1f11-4f95-aac8-0ea375507d73 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:49.584200 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-15be58d8-1f11-4f95-aac8-0ea375507d73 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:49.584721 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-15be58d8-1f11-4f95-aac8-0ea375507d73 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:49.620266 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-15be58d8-1f11-4f95-aac8-0ea375507d73 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/ips" status: 200 len: 145 microversion: 2.1 time: 0.051265 Jul 25 13:07:49.621532 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2584/5067] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Jul 25 13:07:49 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/ips => generated 145 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:07:49.629216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-199e4f8f-bd6c-440f-bf25-b1ceb42c2d8d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:49.630235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-199e4f8f-bd6c-440f-bf25-b1ceb42c2d8d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:49.647402 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-199e4f8f-bd6c-440f-bf25-b1ceb42c2d8d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:49.648192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-199e4f8f-bd6c-440f-bf25-b1ceb42c2d8d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:49.649324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-199e4f8f-bd6c-440f-bf25-b1ceb42c2d8d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:49.649955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-199e4f8f-bd6c-440f-bf25-b1ceb42c2d8d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:50.618815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-15cc8691-4d00-498e-adef-05249f9bd911 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:50.633871 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-15cc8691-4d00-498e-adef-05249f9bd911 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1511 microversion: 2.1 time: 1.355463 Jul 25 13:07:50.634813 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2484/5068] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:49 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1511 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:50.644757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-962734ac-917b-4971-85d5-cb47c7c25215 req-4097a0b6-4c86-4574-9c6a-7c02a8635e3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6cffb3b-3dc6-439e-9433-b9107bfccfcc", "name": "network-vif-deleted", "tag": "adbcb40b-638c-4e4f-928f-2406ca66229f"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:50.657402 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-962734ac-917b-4971-85d5-cb47c7c25215 req-4097a0b6-4c86-4574-9c6a-7c02a8635e3a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:50.663007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-962734ac-917b-4971-85d5-cb47c7c25215 req-4097a0b6-4c86-4574-9c6a-7c02a8635e3a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:50.696794 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-962734ac-917b-4971-85d5-cb47c7c25215 req-4097a0b6-4c86-4574-9c6a-7c02a8635e3a service nova] Creating event network-vif-deleted:adbcb40b-638c-4e4f-928f-2406ca66229f for instance f6cffb3b-3dc6-439e-9433-b9107bfccfcc on n-h1-848886-15 Jul 25 13:07:50.702744 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-962734ac-917b-4971-85d5-cb47c7c25215 req-4097a0b6-4c86-4574-9c6a-7c02a8635e3a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066362 Jul 25 13:07:50.703650 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2485/5069] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:07:50.709122 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-56cfb7f2-db83-4fcc-80b4-336cf18966c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:50.714771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-56cfb7f2-db83-4fcc-80b4-336cf18966c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:50.724812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56cfb7f2-db83-4fcc-80b4-336cf18966c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:50.725538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56cfb7f2-db83-4fcc-80b4-336cf18966c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:50.726509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56cfb7f2-db83-4fcc-80b4-336cf18966c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:50.727096 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56cfb7f2-db83-4fcc-80b4-336cf18966c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:51.166378 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-199e4f8f-bd6c-440f-bf25-b1ceb42c2d8d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:51.191834 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-199e4f8f-bd6c-440f-bf25-b1ceb42c2d8d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 200 len: 1689 microversion: 2.1 time: 1.557192 Jul 25 13:07:51.209333 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2585/5070] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:49 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 1689 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:51.225184 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-56a9ae95-328e-4521-823b-c879cf82bd33 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:51.226147 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-56a9ae95-328e-4521-823b-c879cf82bd33 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:51.304125 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56a9ae95-328e-4521-823b-c879cf82bd33 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:51.305217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56a9ae95-328e-4521-823b-c879cf82bd33 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:51.306411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56a9ae95-328e-4521-823b-c879cf82bd33 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:51.307137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56a9ae95-328e-4521-823b-c879cf82bd33 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:51.388052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:07:51.392495 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-56cfb7f2-db83-4fcc-80b4-336cf18966c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:51.401104 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-56cfb7f2-db83-4fcc-80b4-336cf18966c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1168 microversion: 2.1 time: 0.696066 Jul 25 13:07:51.405413 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2486/5071] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:50 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1168 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:51.410418 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cb803b2c-a99c-45dd-b09b-e48b0bf64f61 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:51.414920 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cb803b2c-a99c-45dd-b09b-e48b0bf64f61 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] [instance: fa3ea3d7-202d-4464-a4bc-e99d48072c3a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:51.431471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb803b2c-a99c-45dd-b09b-e48b0bf64f61 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:51.432193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb803b2c-a99c-45dd-b09b-e48b0bf64f61 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:51.435471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb803b2c-a99c-45dd-b09b-e48b0bf64f61 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:51.436110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb803b2c-a99c-45dd-b09b-e48b0bf64f61 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:51.958199 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-56a9ae95-328e-4521-823b-c879cf82bd33 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:51.959888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cb803b2c-a99c-45dd-b09b-e48b0bf64f61 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295be0f5bd94c0c853feb09c47f9ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39fba18c6c64ee9bcf7f3335014cdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:51.972519 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cb803b2c-a99c-45dd-b09b-e48b0bf64f61 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a" status: 200 len: 1323 microversion: 2.1 time: 0.565478 Jul 25 13:07:51.975144 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2487/5072] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:51 2022] GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a => generated 1323 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:51.985114 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-56a9ae95-328e-4521-823b-c879cf82bd33 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1735 microversion: 2.1 time: 0.778196 Jul 25 13:07:51.989260 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-352a4a6b-c35d-4304-8522-f183f0aa4375 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:51.991853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-352a4a6b-c35d-4304-8522-f183f0aa4375 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:52.007458 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2586/5073] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:51 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1735 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:52.037461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-352a4a6b-c35d-4304-8522-f183f0aa4375 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:52.038495 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-352a4a6b-c35d-4304-8522-f183f0aa4375 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:52.041601 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-352a4a6b-c35d-4304-8522-f183f0aa4375 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:52.042464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-352a4a6b-c35d-4304-8522-f183f0aa4375 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:52.227869 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f77bf876-43dd-4dc9-9e5d-4286e655ed76 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:52.230220 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f77bf876-43dd-4dc9-9e5d-4286e655ed76 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: f6cffb3b-3dc6-439e-9433-b9107bfccfcc] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:52.257737 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f77bf876-43dd-4dc9-9e5d-4286e655ed76 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:52.258590 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f77bf876-43dd-4dc9-9e5d-4286e655ed76 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:52.259820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f77bf876-43dd-4dc9-9e5d-4286e655ed76 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:52.260410 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f77bf876-43dd-4dc9-9e5d-4286e655ed76 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:52.313815 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-f77bf876-43dd-4dc9-9e5d-4286e655ed76 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] HTTP exception thrown: Instance f6cffb3b-3dc6-439e-9433-b9107bfccfcc could not be found. Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f77bf876-43dd-4dc9-9e5d-4286e655ed76 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Request method failure captured: Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc HTTP/1.1 Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pOuxv1dAEBzvSabAQZ_ovDwuoLarmYwGpqO0VLOXbqAAPunlD8O5vVMgj3IKl9VjFTX9CDCr160FLaCnWQQdTWXXvoL3KfTvXE9pkHJ0Gohl1rBvvU5lXAiAERAFVQa6cNt2uvom2njdnumPINWUCHjcLWMzSCxBYR5oNDLeJ--HHc Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: c0d891a772834e43bdfcbde778a90498 Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-406327327 Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c0d891a772834e43bdfcbde778a90498", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c0d891a772834e43bdfcbde778a90498"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0d891a772834e43bdfcbde778a90498"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0d891a772834e43bdfcbde778a90498"}]}] Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestNetworkAdvancedServerOps-406327327 Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: c0d891a772834e43bdfcbde778a90498 Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-406327327 Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestNetworkAdvancedServerOps-406327327-project Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 4d6e2ae351744e0ab1f153d629e4f0e7 Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestNetworkAdvancedServerOps-406327327-project Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance f6cffb3b-3dc6-439e-9433-b9107bfccfcc could not be found. Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'f6cffb3b-3dc6-439e-9433-b9107bfccfcc'} Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6cffb3b-3dc6-439e-9433-b9107bfccfcc could not be found. Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6cffb3b-3dc6-439e-9433-b9107bfccfcc could not be found. Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:07:52.320279 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:07:52.324581 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:07:52.324581 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:07:52.324581 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:07:52.324581 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:07:52.324581 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:07:52.324581 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6cffb3b-3dc6-439e-9433-b9107bfccfcc could not be found. Jul 25 13:07:52.324581 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:07:52.331138 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f77bf876-43dd-4dc9-9e5d-4286e655ed76 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Returning 404 to user: Instance f6cffb3b-3dc6-439e-9433-b9107bfccfcc could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:07:52.334137 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f77bf876-43dd-4dc9-9e5d-4286e655ed76 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc" status: 404 len: 111 microversion: 2.1 time: 0.110965 Jul 25 13:07:52.337646 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2587/5074] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:52 2022] GET /compute/v2.1/servers/f6cffb3b-3dc6-439e-9433-b9107bfccfcc => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:07:52.443509 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6f89c29d-37c2-41cb-b068-3413812a76a2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:52.452132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6f89c29d-37c2-41cb-b068-3413812a76a2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:52.479357 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6f89c29d-37c2-41cb-b068-3413812a76a2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:52.482448 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6f89c29d-37c2-41cb-b068-3413812a76a2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:52.483647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6f89c29d-37c2-41cb-b068-3413812a76a2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:52.489910 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6f89c29d-37c2-41cb-b068-3413812a76a2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:52.707593 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-352a4a6b-c35d-4304-8522-f183f0aa4375 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:52.720502 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-352a4a6b-c35d-4304-8522-f183f0aa4375 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1511 microversion: 2.1 time: 0.743467 Jul 25 13:07:52.721618 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2488/5075] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:51 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1511 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:52.728127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8c85834e-559f-452b-a291-642af3b83ab6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ec0e596-e155-4a91-9564-b7f294711099"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:52.731532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8c85834e-559f-452b-a291-642af3b83ab6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:52.738757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c85834e-559f-452b-a291-642af3b83ab6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:52.739473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c85834e-559f-452b-a291-642af3b83ab6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:52.740415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c85834e-559f-452b-a291-642af3b83ab6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:52.741556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c85834e-559f-452b-a291-642af3b83ab6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:52.888067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6f89c29d-37c2-41cb-b068-3413812a76a2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:52.906600 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6f89c29d-37c2-41cb-b068-3413812a76a2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1168 microversion: 2.1 time: 0.468869 Jul 25 13:07:52.907600 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2588/5076] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:52 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1168 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:07:52.997998 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-48a5c615-7849-47bf-9deb-34317315748a tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:52.998852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-48a5c615-7849-47bf-9deb-34317315748a tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] [instance: fa3ea3d7-202d-4464-a4bc-e99d48072c3a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:53.007846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48a5c615-7849-47bf-9deb-34317315748a tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:53.008825 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48a5c615-7849-47bf-9deb-34317315748a tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:53.009971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48a5c615-7849-47bf-9deb-34317315748a tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:53.010711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48a5c615-7849-47bf-9deb-34317315748a tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:53.282905 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8c85834e-559f-452b-a291-642af3b83ab6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "POST /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.559769 Jul 25 13:07:53.284455 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2489/5077] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Jul 25 13:07:52 2022] POST /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-volume_attachments => generated 194 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:07:53.313081 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4040009d-09cd-42ce-9ae5-f240c0d2b104 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:53.314456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4040009d-09cd-42ce-9ae5-f240c0d2b104 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:53.342557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4040009d-09cd-42ce-9ae5-f240c0d2b104 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:53.348623 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4040009d-09cd-42ce-9ae5-f240c0d2b104 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:53.350044 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4040009d-09cd-42ce-9ae5-f240c0d2b104 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:53.362939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4040009d-09cd-42ce-9ae5-f240c0d2b104 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:53.905706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-48a5c615-7849-47bf-9deb-34317315748a tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295be0f5bd94c0c853feb09c47f9ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39fba18c6c64ee9bcf7f3335014cdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:53.916766 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-48a5c615-7849-47bf-9deb-34317315748a tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a" status: 200 len: 1323 microversion: 2.1 time: 0.923156 Jul 25 13:07:53.919231 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2589/5078] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:52 2022] GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a => generated 1323 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:07:53.947883 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-893edcb2-d33e-41bb-8179-d6def2778813 req-e8cb7617-9ad2-440b-92fd-440083a66268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65ea99de-138b-45a9-af3d-33b113423436", "tag": "7253b734-6699-4bd0-a4ab-ecee21d6de74"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:53.972748 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-893edcb2-d33e-41bb-8179-d6def2778813 req-e8cb7617-9ad2-440b-92fd-440083a66268 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:53.974643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-893edcb2-d33e-41bb-8179-d6def2778813 req-e8cb7617-9ad2-440b-92fd-440083a66268 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:53.999360 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:07:54.004120 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-893edcb2-d33e-41bb-8179-d6def2778813 req-e8cb7617-9ad2-440b-92fd-440083a66268 service nova] Creating event network-changed:7253b734-6699-4bd0-a4ab-ecee21d6de74 for instance 65ea99de-138b-45a9-af3d-33b113423436 on n-h2-848886-15 Jul 25 13:07:54.019518 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-893edcb2-d33e-41bb-8179-d6def2778813 req-e8cb7617-9ad2-440b-92fd-440083a66268 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098094 Jul 25 13:07:54.020243 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2590/5079] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:07:54.030838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=14 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:07:54.036054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e5f0907e-d8be-49a3-b37f-a7ad7814fe08 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:54.037118 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e5f0907e-d8be-49a3-b37f-a7ad7814fe08 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:54.050779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5f0907e-d8be-49a3-b37f-a7ad7814fe08 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:54.051569 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5f0907e-d8be-49a3-b37f-a7ad7814fe08 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:54.052703 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5f0907e-d8be-49a3-b37f-a7ad7814fe08 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:54.056336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5f0907e-d8be-49a3-b37f-a7ad7814fe08 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:54.300590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4040009d-09cd-42ce-9ae5-f240c0d2b104 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:54.318751 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4040009d-09cd-42ce-9ae5-f240c0d2b104 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1735 microversion: 2.1 time: 1.032725 Jul 25 13:07:54.319469 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2490/5080] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:53 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1735 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:54.359794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-10144b10-8e6d-4bbf-a217-57a754ec2b5d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:54.369582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-10144b10-8e6d-4bbf-a217-57a754ec2b5d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:54.433965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10144b10-8e6d-4bbf-a217-57a754ec2b5d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:54.450983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10144b10-8e6d-4bbf-a217-57a754ec2b5d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:54.458066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10144b10-8e6d-4bbf-a217-57a754ec2b5d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:54.463567 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10144b10-8e6d-4bbf-a217-57a754ec2b5d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:55.257043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e5f0907e-d8be-49a3-b37f-a7ad7814fe08 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:55.267753 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e5f0907e-d8be-49a3-b37f-a7ad7814fe08 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1511 microversion: 2.1 time: 1.245450 Jul 25 13:07:55.278199 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2591/5081] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:54 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1511 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:55.283305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d0e8c0cf-a5ee-4d4d-9f4d-330ba7fc9938 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:55.286969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d0e8c0cf-a5ee-4d4d-9f4d-330ba7fc9938 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] [instance: fa3ea3d7-202d-4464-a4bc-e99d48072c3a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:55.301107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d0e8c0cf-a5ee-4d4d-9f4d-330ba7fc9938 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:55.301863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d0e8c0cf-a5ee-4d4d-9f4d-330ba7fc9938 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:55.305571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d0e8c0cf-a5ee-4d4d-9f4d-330ba7fc9938 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:55.306233 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d0e8c0cf-a5ee-4d4d-9f4d-330ba7fc9938 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:56.333048 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-10144b10-8e6d-4bbf-a217-57a754ec2b5d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:56.362289 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-10144b10-8e6d-4bbf-a217-57a754ec2b5d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1168 microversion: 2.1 time: 2.027251 Jul 25 13:07:56.369103 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2491/5082] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:54 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1168 bytes in 2049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:56.398996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cd446599-be18-4bc4-89c6-cc601bb25cf8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:56.405974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cd446599-be18-4bc4-89c6-cc601bb25cf8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:56.429616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd446599-be18-4bc4-89c6-cc601bb25cf8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:56.432611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd446599-be18-4bc4-89c6-cc601bb25cf8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:56.433620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd446599-be18-4bc4-89c6-cc601bb25cf8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:56.434254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd446599-be18-4bc4-89c6-cc601bb25cf8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:56.682295 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d0e8c0cf-a5ee-4d4d-9f4d-330ba7fc9938 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295be0f5bd94c0c853feb09c47f9ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39fba18c6c64ee9bcf7f3335014cdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:56.705178 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d0e8c0cf-a5ee-4d4d-9f4d-330ba7fc9938 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a" status: 200 len: 1323 microversion: 2.1 time: 1.425533 Jul 25 13:07:56.706148 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2592/5083] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:55 2022] GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a => generated 1323 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:56.717007 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-5f0d306c-75d3-4426-8f8b-0700be6ac11e req-74d21cf0-9a0c-460a-b88a-d48d6094897d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa3ea3d7-202d-4464-a4bc-e99d48072c3a", "tag": "02b43449-72fb-401f-9b43-29d271616827"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:07:56.742380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5f0d306c-75d3-4426-8f8b-0700be6ac11e req-74d21cf0-9a0c-460a-b88a-d48d6094897d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:56.744217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5f0d306c-75d3-4426-8f8b-0700be6ac11e req-74d21cf0-9a0c-460a-b88a-d48d6094897d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:56.773985 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-5f0d306c-75d3-4426-8f8b-0700be6ac11e req-74d21cf0-9a0c-460a-b88a-d48d6094897d service nova] Creating event network-changed:02b43449-72fb-401f-9b43-29d271616827 for instance fa3ea3d7-202d-4464-a4bc-e99d48072c3a on n-h2-848886-15 Jul 25 13:07:56.781804 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-5f0d306c-75d3-4426-8f8b-0700be6ac11e req-74d21cf0-9a0c-460a-b88a-d48d6094897d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074115 Jul 25 13:07:56.782604 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2593/5084] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:07:56.788722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b69791b5-b18d-4277-b30c-f030ee80be9b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:56.789699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b69791b5-b18d-4277-b30c-f030ee80be9b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:56.796693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b69791b5-b18d-4277-b30c-f030ee80be9b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:56.797462 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b69791b5-b18d-4277-b30c-f030ee80be9b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:56.809346 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b69791b5-b18d-4277-b30c-f030ee80be9b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:56.811603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b69791b5-b18d-4277-b30c-f030ee80be9b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:58.383577 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cd446599-be18-4bc4-89c6-cc601bb25cf8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:58.392873 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cd446599-be18-4bc4-89c6-cc601bb25cf8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1735 microversion: 2.1 time: 2.018661 Jul 25 13:07:58.405178 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2492/5085] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:56 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1735 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:58.439948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1b392b26-6d76-4c94-b5c6-682ea82a00f1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:58.445214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1b392b26-6d76-4c94-b5c6-682ea82a00f1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:58.497517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b392b26-6d76-4c94-b5c6-682ea82a00f1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:58.500964 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b392b26-6d76-4c94-b5c6-682ea82a00f1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:58.502650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b392b26-6d76-4c94-b5c6-682ea82a00f1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:58.506329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b392b26-6d76-4c94-b5c6-682ea82a00f1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:58.752463 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b69791b5-b18d-4277-b30c-f030ee80be9b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:58.788247 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b69791b5-b18d-4277-b30c-f030ee80be9b tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1511 microversion: 2.1 time: 2.003942 Jul 25 13:07:58.797550 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2594/5086] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:56 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1511 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:58.830084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-04ea2768-bd8b-48ce-90a3-70c87dfb6268 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:58.830726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-04ea2768-bd8b-48ce-90a3-70c87dfb6268 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] [instance: fa3ea3d7-202d-4464-a4bc-e99d48072c3a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:58.860576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04ea2768-bd8b-48ce-90a3-70c87dfb6268 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:58.861033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04ea2768-bd8b-48ce-90a3-70c87dfb6268 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:58.873966 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04ea2768-bd8b-48ce-90a3-70c87dfb6268 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:58.874600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04ea2768-bd8b-48ce-90a3-70c87dfb6268 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:59.516462 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1b392b26-6d76-4c94-b5c6-682ea82a00f1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:07:59.527306 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1b392b26-6d76-4c94-b5c6-682ea82a00f1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1168 microversion: 2.1 time: 1.113731 Jul 25 13:07:59.527934 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2493/5087] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:58 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1168 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:07:59.548220 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4098c285-cf24-4a52-8277-9e90a6249b2a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:07:59.549260 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4098c285-cf24-4a52-8277-9e90a6249b2a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:07:59.565527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4098c285-cf24-4a52-8277-9e90a6249b2a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:59.567591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4098c285-cf24-4a52-8277-9e90a6249b2a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:07:59.569555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4098c285-cf24-4a52-8277-9e90a6249b2a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:07:59.572861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4098c285-cf24-4a52-8277-9e90a6249b2a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:00.267090 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-04ea2768-bd8b-48ce-90a3-70c87dfb6268 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295be0f5bd94c0c853feb09c47f9ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39fba18c6c64ee9bcf7f3335014cdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:00.301679 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-04ea2768-bd8b-48ce-90a3-70c87dfb6268 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a" status: 200 len: 1323 microversion: 2.1 time: 1.499835 Jul 25 13:08:00.305171 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2595/5088] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:58 2022] GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a => generated 1323 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:00.316052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bd5c02ac-cb2f-410b-b280-74b4078103c4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:00.321145 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bd5c02ac-cb2f-410b-b280-74b4078103c4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:00.337351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd5c02ac-cb2f-410b-b280-74b4078103c4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:00.338009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd5c02ac-cb2f-410b-b280-74b4078103c4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:00.340812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd5c02ac-cb2f-410b-b280-74b4078103c4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:00.343389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd5c02ac-cb2f-410b-b280-74b4078103c4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:00.814215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4098c285-cf24-4a52-8277-9e90a6249b2a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:00.824446 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4098c285-cf24-4a52-8277-9e90a6249b2a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1735 microversion: 2.1 time: 1.295357 Jul 25 13:08:00.835361 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2494/5089] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:07:59 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1735 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:00.846129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4b7b148b-bb4f-4432-9fe0-b1b9ed64e74b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:00.846129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4b7b148b-bb4f-4432-9fe0-b1b9ed64e74b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:00.863835 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b7b148b-bb4f-4432-9fe0-b1b9ed64e74b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:00.864347 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b7b148b-bb4f-4432-9fe0-b1b9ed64e74b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:00.865342 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b7b148b-bb4f-4432-9fe0-b1b9ed64e74b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:00.866320 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b7b148b-bb4f-4432-9fe0-b1b9ed64e74b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:01.539565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bd5c02ac-cb2f-410b-b280-74b4078103c4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:01.550578 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bd5c02ac-cb2f-410b-b280-74b4078103c4 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1511 microversion: 2.1 time: 1.243630 Jul 25 13:08:01.552816 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2596/5090] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:00 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1511 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:01.560371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5fb6fd44-6371-4280-8ecc-829c2a67b581 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '.version_select at 0x7efcf8955550>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:01.575019 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=78 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:08:01.592151 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5fb6fd44-6371-4280-8ecc-829c2a67b581 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-455498142" status: 202 len: 0 microversion: 2.1 time: 0.037051 Jul 25 13:08:01.594234 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2597/5091] 10.222.0.49 () {58 vars in 1281 bytes} [Mon Jul 25 13:08:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-455498142 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:08:01.624700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-103602c1-864a-4980-a424-df2ce4cb49fa tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:01.626041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-103602c1-864a-4980-a424-df2ce4cb49fa tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] [instance: fa3ea3d7-202d-4464-a4bc-e99d48072c3a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:01.635366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-103602c1-864a-4980-a424-df2ce4cb49fa tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:01.636105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-103602c1-864a-4980-a424-df2ce4cb49fa tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:01.637174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-103602c1-864a-4980-a424-df2ce4cb49fa tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:01.637863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-103602c1-864a-4980-a424-df2ce4cb49fa tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:01.722305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4b7b148b-bb4f-4432-9fe0-b1b9ed64e74b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:01.730232 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4b7b148b-bb4f-4432-9fe0-b1b9ed64e74b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1168 microversion: 2.1 time: 0.893616 Jul 25 13:08:01.744265 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2495/5092] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:00 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1168 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:01.749858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ad2c0bd9-609e-4272-80ee-e5313859d61c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Action: 'create', calling method: .version_select at 0x7efcf848eaf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1758790213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHfbrCObBu1o+ZCtQJf3Wp8bPEMoEczOz9X4VkAVJvceogQpjGWZOkpl9++sKyNEOd2At586xzCzPj3LFtSfpCo0q3OLAdwoMecjenlsSoRbm4Dc8neNfhxN3Z1qy/TeA=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:01.771433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-ad2c0bd9-609e-4272-80ee-e5313859d61c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Getting quotas for project c0d891a772834e43bdfcbde778a90498. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:08:01.778406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-ad2c0bd9-609e-4272-80ee-e5313859d61c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Getting quotas for user 4d6e2ae351744e0ab1f153d629e4f0e7 and project c0d891a772834e43bdfcbde778a90498. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:08:01.838625 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ad2c0bd9-609e-4272-80ee-e5313859d61c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.092621 Jul 25 13:08:01.845894 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2496/5093] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:08:01 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:01.858172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-af611a6d-e9de-4361-a369-46f4233f35b1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:01.858804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-af611a6d-e9de-4361-a369-46f4233f35b1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:01.867724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af611a6d-e9de-4361-a369-46f4233f35b1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:01.868184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af611a6d-e9de-4361-a369-46f4233f35b1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:01.868975 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af611a6d-e9de-4361-a369-46f4233f35b1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:01.869412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af611a6d-e9de-4361-a369-46f4233f35b1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:01.925513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-103602c1-864a-4980-a424-df2ce4cb49fa tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295be0f5bd94c0c853feb09c47f9ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39fba18c6c64ee9bcf7f3335014cdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:01.935940 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-103602c1-864a-4980-a424-df2ce4cb49fa tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a" status: 200 len: 1323 microversion: 2.1 time: 0.338572 Jul 25 13:08:01.936752 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2598/5094] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:01 2022] GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a => generated 1323 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:02.155747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-af611a6d-e9de-4361-a369-46f4233f35b1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:02.166479 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-af611a6d-e9de-4361-a369-46f4233f35b1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1735 microversion: 2.1 time: 0.313419 Jul 25 13:08:02.167850 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2497/5095] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:01 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1735 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:02.578790 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-74b61aed-a7e2-46e4-9289-037152a794a8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:02.587756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-74b61aed-a7e2-46e4-9289-037152a794a8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:02.610800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-74b61aed-a7e2-46e4-9289-037152a794a8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:02.611281 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-74b61aed-a7e2-46e4-9289-037152a794a8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:02.614486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-74b61aed-a7e2-46e4-9289-037152a794a8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:02.614926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-74b61aed-a7e2-46e4-9289-037152a794a8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:02.751755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b7c9bd1c-0d45-437c-bf7e-b00f16c6de45 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:02.752397 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b7c9bd1c-0d45-437c-bf7e-b00f16c6de45 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:02.775852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b7c9bd1c-0d45-437c-bf7e-b00f16c6de45 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:02.776528 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b7c9bd1c-0d45-437c-bf7e-b00f16c6de45 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:02.777931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b7c9bd1c-0d45-437c-bf7e-b00f16c6de45 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:02.780482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b7c9bd1c-0d45-437c-bf7e-b00f16c6de45 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:02.795624 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:08:03.059625 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-74b61aed-a7e2-46e4-9289-037152a794a8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:03.078674 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-74b61aed-a7e2-46e4-9289-037152a794a8 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1488 microversion: 2.1 time: 0.506266 Jul 25 13:08:03.079439 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2599/5096] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:02 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1488 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:03.100078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-899a805c-104a-4570-acd8-4a5ccf8c2680 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:03.100777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-899a805c-104a-4570-acd8-4a5ccf8c2680 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] [instance: fa3ea3d7-202d-4464-a4bc-e99d48072c3a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:03.124740 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-899a805c-104a-4570-acd8-4a5ccf8c2680 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:03.126213 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-899a805c-104a-4570-acd8-4a5ccf8c2680 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:03.127536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-899a805c-104a-4570-acd8-4a5ccf8c2680 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:03.128137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-899a805c-104a-4570-acd8-4a5ccf8c2680 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:03.152906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b7c9bd1c-0d45-437c-bf7e-b00f16c6de45 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:03.164720 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b7c9bd1c-0d45-437c-bf7e-b00f16c6de45 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1168 microversion: 2.1 time: 0.417041 Jul 25 13:08:03.174649 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2498/5097] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:02 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1168 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:08:03.184965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-bb4f8a90-c455-4490-81a8-bd1c9751d6eb req-07259088-15cb-4216-9279-6fe5b535a297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa3ea3d7-202d-4464-a4bc-e99d48072c3a", "name": "network-vif-plugged", "status": "completed", "tag": "02b43449-72fb-401f-9b43-29d271616827"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:03.211212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-bb4f8a90-c455-4490-81a8-bd1c9751d6eb req-07259088-15cb-4216-9279-6fe5b535a297 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:03.212005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-bb4f8a90-c455-4490-81a8-bd1c9751d6eb req-07259088-15cb-4216-9279-6fe5b535a297 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:03.227901 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-bb4f8a90-c455-4490-81a8-bd1c9751d6eb req-07259088-15cb-4216-9279-6fe5b535a297 service nova] Creating event network-vif-plugged:02b43449-72fb-401f-9b43-29d271616827 for instance fa3ea3d7-202d-4464-a4bc-e99d48072c3a on n-h2-848886-15 Jul 25 13:08:03.236362 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-bb4f8a90-c455-4490-81a8-bd1c9751d6eb req-07259088-15cb-4216-9279-6fe5b535a297 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060188 Jul 25 13:08:03.244054 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2499/5098] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:03.251202 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-88bb895a-87c6-44b9-8752-3c761a931930 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-915061438"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:03.254177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-88bb895a-87c6-44b9-8752-3c761a931930 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:03.262331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-88bb895a-87c6-44b9-8752-3c761a931930 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:03.263958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-88bb895a-87c6-44b9-8752-3c761a931930 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:03.265082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-88bb895a-87c6-44b9-8752-3c761a931930 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:03.267138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-88bb895a-87c6-44b9-8752-3c761a931930 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:03.368619 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-88bb895a-87c6-44b9-8752-3c761a931930 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "PUT /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1060 microversion: 2.1 time: 0.122929 Jul 25 13:08:03.388780 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2500/5099] 10.222.0.49 () {60 vars in 1256 bytes} [Mon Jul 25 13:08:03 2022] PUT /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1060 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:03.395281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ff8ffa36-745a-4dad-af37-64b327b263c8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:03.396227 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ff8ffa36-745a-4dad-af37-64b327b263c8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:03.420505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff8ffa36-745a-4dad-af37-64b327b263c8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:03.420957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff8ffa36-745a-4dad-af37-64b327b263c8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:03.424041 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff8ffa36-745a-4dad-af37-64b327b263c8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:03.429124 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff8ffa36-745a-4dad-af37-64b327b263c8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:03.477950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-899a805c-104a-4570-acd8-4a5ccf8c2680 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295be0f5bd94c0c853feb09c47f9ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39fba18c6c64ee9bcf7f3335014cdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:03.503601 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-899a805c-104a-4570-acd8-4a5ccf8c2680 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a" status: 200 len: 1323 microversion: 2.1 time: 0.421021 Jul 25 13:08:03.504755 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2600/5100] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:03 2022] GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a => generated 1323 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:03.516742 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-de6f6028-242b-46fa-a2a6-5e633cb4f7be tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:03.517825 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-de6f6028-242b-46fa-a2a6-5e633cb4f7be tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:03.525027 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de6f6028-242b-46fa-a2a6-5e633cb4f7be tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:03.525903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de6f6028-242b-46fa-a2a6-5e633cb4f7be tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:03.526913 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de6f6028-242b-46fa-a2a6-5e633cb4f7be tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:03.527637 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de6f6028-242b-46fa-a2a6-5e633cb4f7be tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:03.860986 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-de6f6028-242b-46fa-a2a6-5e633cb4f7be tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:03.884773 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-de6f6028-242b-46fa-a2a6-5e633cb4f7be tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1487 microversion: 2.1 time: 0.376179 Jul 25 13:08:03.886718 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2601/5101] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:03 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1487 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:03.894890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ff8ffa36-745a-4dad-af37-64b327b263c8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:03.905174 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ff8ffa36-745a-4dad-af37-64b327b263c8 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1735 microversion: 2.1 time: 0.514848 Jul 25 13:08:03.907106 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2501/5102] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:03 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1735 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:03.907244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3b0cabf9-d284-48e3-b8dd-4ea40bbc3cd5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:03.907762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3b0cabf9-d284-48e3-b8dd-4ea40bbc3cd5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:03.914237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b0cabf9-d284-48e3-b8dd-4ea40bbc3cd5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:03.914892 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b0cabf9-d284-48e3-b8dd-4ea40bbc3cd5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:03.915665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b0cabf9-d284-48e3-b8dd-4ea40bbc3cd5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:03.916099 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b0cabf9-d284-48e3-b8dd-4ea40bbc3cd5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:04.064022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3b0cabf9-d284-48e3-b8dd-4ea40bbc3cd5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:04.072844 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3b0cabf9-d284-48e3-b8dd-4ea40bbc3cd5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1487 microversion: 2.1 time: 0.169832 Jul 25 13:08:04.073915 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2602/5103] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:03 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1487 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:04.095894 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-069de42a-d959-4b0b-badf-a494136715e2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:04.096383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-069de42a-d959-4b0b-badf-a494136715e2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:04.103607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-069de42a-d959-4b0b-badf-a494136715e2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:04.104057 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-069de42a-d959-4b0b-badf-a494136715e2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:04.104845 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-069de42a-d959-4b0b-badf-a494136715e2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:04.105371 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-069de42a-d959-4b0b-badf-a494136715e2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:04.138842 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-069de42a-d959-4b0b-badf-a494136715e2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:08:04.199194 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4202d311-afe2-4d85-9603-5d2377aa106c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:04.199816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4202d311-afe2-4d85-9603-5d2377aa106c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:04.208818 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4202d311-afe2-4d85-9603-5d2377aa106c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:04.212486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4202d311-afe2-4d85-9603-5d2377aa106c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:04.213584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4202d311-afe2-4d85-9603-5d2377aa106c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:04.214200 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4202d311-afe2-4d85-9603-5d2377aa106c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:04.284615 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-069de42a-d959-4b0b-badf-a494136715e2 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 204 len: 0 microversion: 2.1 time: 0.192417 Jul 25 13:08:04.285238 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2502/5104] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:08:04 2022] DELETE /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:08:04.295116 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f01f6cf9-0db9-486e-a85e-db200afa7bcb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:04.296093 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f01f6cf9-0db9-486e-a85e-db200afa7bcb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:04.302607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f01f6cf9-0db9-486e-a85e-db200afa7bcb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:04.303278 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f01f6cf9-0db9-486e-a85e-db200afa7bcb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:04.304211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f01f6cf9-0db9-486e-a85e-db200afa7bcb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:04.304795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f01f6cf9-0db9-486e-a85e-db200afa7bcb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:04.658022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4202d311-afe2-4d85-9603-5d2377aa106c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:04.667916 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4202d311-afe2-4d85-9603-5d2377aa106c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1168 microversion: 2.1 time: 0.473429 Jul 25 13:08:04.673301 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2603/5105] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:04 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1168 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:04.685073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bb7e7823-ec54-4b8c-a567-a27b3e817e2b tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:04.686156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bb7e7823-ec54-4b8c-a567-a27b3e817e2b tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] [instance: fa3ea3d7-202d-4464-a4bc-e99d48072c3a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:04.702143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bb7e7823-ec54-4b8c-a567-a27b3e817e2b tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:04.704617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bb7e7823-ec54-4b8c-a567-a27b3e817e2b tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:04.706670 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bb7e7823-ec54-4b8c-a567-a27b3e817e2b tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:04.707229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bb7e7823-ec54-4b8c-a567-a27b3e817e2b tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:04.722255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f01f6cf9-0db9-486e-a85e-db200afa7bcb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:04.733733 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f01f6cf9-0db9-486e-a85e-db200afa7bcb tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1493 microversion: 2.1 time: 0.443924 Jul 25 13:08:04.748883 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2503/5106] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:04 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1493 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:08:04.931659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9dc12506-9543-4817-99a5-5dfa8056c8d7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:04.933494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9dc12506-9543-4817-99a5-5dfa8056c8d7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:04.944198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9dc12506-9543-4817-99a5-5dfa8056c8d7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:04.944649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9dc12506-9543-4817-99a5-5dfa8056c8d7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:04.945425 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9dc12506-9543-4817-99a5-5dfa8056c8d7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:04.946772 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9dc12506-9543-4817-99a5-5dfa8056c8d7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:05.220252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bb7e7823-ec54-4b8c-a567-a27b3e817e2b tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295be0f5bd94c0c853feb09c47f9ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39fba18c6c64ee9bcf7f3335014cdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:05.228730 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bb7e7823-ec54-4b8c-a567-a27b3e817e2b tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a" status: 200 len: 1323 microversion: 2.1 time: 0.553942 Jul 25 13:08:05.229302 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2604/5107] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:04 2022] GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a => generated 1323 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:05.380805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9dc12506-9543-4817-99a5-5dfa8056c8d7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:05.389650 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9dc12506-9543-4817-99a5-5dfa8056c8d7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1735 microversion: 2.1 time: 0.462440 Jul 25 13:08:05.390272 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2504/5108] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:04 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1735 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:05.694183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0087ff5c-81f6-4153-8d3b-566abf42865c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:05.694961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0087ff5c-81f6-4153-8d3b-566abf42865c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:05.702244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0087ff5c-81f6-4153-8d3b-566abf42865c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:05.702958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0087ff5c-81f6-4153-8d3b-566abf42865c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:05.703738 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0087ff5c-81f6-4153-8d3b-566abf42865c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:05.704171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0087ff5c-81f6-4153-8d3b-566abf42865c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:05.755717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ca5635c9-de30-4996-8950-d3b22e51f168 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:05.756331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ca5635c9-de30-4996-8950-d3b22e51f168 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:05.763288 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca5635c9-de30-4996-8950-d3b22e51f168 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:05.763777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca5635c9-de30-4996-8950-d3b22e51f168 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:05.764779 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca5635c9-de30-4996-8950-d3b22e51f168 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:05.765226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca5635c9-de30-4996-8950-d3b22e51f168 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:06.450945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ca5635c9-de30-4996-8950-d3b22e51f168 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:06.461285 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ca5635c9-de30-4996-8950-d3b22e51f168 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1493 microversion: 2.1 time: 0.709506 Jul 25 13:08:06.462675 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2505/5109] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:05 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1493 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:06.467392 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ad72ee63-39b5-416e-b9ce-d03b1fe2c0a4 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:06.468123 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ad72ee63-39b5-416e-b9ce-d03b1fe2c0a4 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] [instance: fa3ea3d7-202d-4464-a4bc-e99d48072c3a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:06.474703 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad72ee63-39b5-416e-b9ce-d03b1fe2c0a4 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:06.475274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad72ee63-39b5-416e-b9ce-d03b1fe2c0a4 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:06.476155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad72ee63-39b5-416e-b9ce-d03b1fe2c0a4 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:06.476687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad72ee63-39b5-416e-b9ce-d03b1fe2c0a4 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:06.519335 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0087ff5c-81f6-4153-8d3b-566abf42865c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:06.529861 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0087ff5c-81f6-4153-8d3b-566abf42865c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1168 microversion: 2.1 time: 0.839733 Jul 25 13:08:06.530529 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2605/5110] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:05 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1168 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:06.537096 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5b713e63-d328-4565-b54b-b56b075bf831 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:06.538038 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5b713e63-d328-4565-b54b-b56b075bf831 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:06.544847 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b713e63-d328-4565-b54b-b56b075bf831 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:06.545389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b713e63-d328-4565-b54b-b56b075bf831 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:06.546265 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b713e63-d328-4565-b54b-b56b075bf831 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:06.546794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b713e63-d328-4565-b54b-b56b075bf831 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:06.552229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:08:06.916171 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ad72ee63-39b5-416e-b9ce-d03b1fe2c0a4 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295be0f5bd94c0c853feb09c47f9ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39fba18c6c64ee9bcf7f3335014cdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:06.931394 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ad72ee63-39b5-416e-b9ce-d03b1fe2c0a4 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a" status: 200 len: 1519 microversion: 2.1 time: 0.467380 Jul 25 13:08:06.932396 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2506/5111] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:06 2022] GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a => generated 1519 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:06.982526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5b713e63-d328-4565-b54b-b56b075bf831 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:07.000800 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5b713e63-d328-4565-b54b-b56b075bf831 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1735 microversion: 2.1 time: 0.468520 Jul 25 13:08:07.001847 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2606/5112] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:06 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1735 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:07.002480 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-45cad99d-a684-469d-a347-f5128ae5d3ce tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-894438273", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8529a16e-b7bf-4399-adc1-db6e6ba3cc6b"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-45cad99d-a684-469d-a347-f5128ae5d3ce tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Request method failure captured: Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 242 Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pWe8xiLQNNY7Kv74yLnM28RNIsfq2ROKEDC8kIe3lQqWqcZq9x6naQO5HdZYbOime0GjH7f8LUokghwbRnVi7_uXUl-GwFhXReioDE-lRulVWBuaTEDjghLwz4ZNK1Hi3OEVuMkvis1ZLw-pmNMl95cdbpGAeWU2B3nROjPswqUa-E Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: b39fba18c6c64ee9bcf7f3335014cdd5 Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b39fba18c6c64ee9bcf7f3335014cdd5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b39fba18c6c64ee9bcf7f3335014cdd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b39fba18c6c64ee9bcf7f3335014cdd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b39fba18c6c64ee9bcf7f3335014cdd5"}]}] Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: b39fba18c6c64ee9bcf7f3335014cdd5 Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerMetadataNegativeTestJSON-822010234-project Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: a295be0f5bd94c0c853feb09c47f9ffa Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-822010234-project Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-894438273", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8529a16e-b7bf-4399-adc1-db6e6ba3cc6b"}]}} Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-894438273', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '8529a16e-b7bf-4399-adc1-db6e6ba3cc6b'}]}}} Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:08:07.007107 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:08:07.010804 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 13:08:07.010804 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 13:08:07.010804 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 13:08:07.010804 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 13:08:07.010804 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 13:08:07.010804 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 13:08:07.010804 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 13:08:07.010804 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.010804 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:07.010804 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.010804 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:07.010804 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:07.010804 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:07.010804 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 13:08:07.010804 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 13:08:07.010804 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 13:08:07.010804 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.014663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-45cad99d-a684-469d-a347-f5128ae5d3ce tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:07.015687 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-45cad99d-a684-469d-a347-f5128ae5d3ce tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.017063 Jul 25 13:08:07.022909 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2507/5113] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:08:06 2022] POST /compute/v2.1/servers => generated 175 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 13:08:07.042963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-30f9cd57-50af-414e-9a4e-8dd53346e632 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:07.044002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-30f9cd57-50af-414e-9a4e-8dd53346e632 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] [instance: caea2c16-d152-473b-988e-d985be71777e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:07.051339 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-30f9cd57-50af-414e-9a4e-8dd53346e632 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] HTTP exception thrown: Instance caea2c16-d152-473b-988e-d985be71777e could not be found. Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-30f9cd57-50af-414e-9a4e-8dd53346e632 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Request method failure captured: Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/caea2c16-d152-473b-988e-d985be71777e/metadata HTTP/1.1 Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pWe8xiLQNNY7Kv74yLnM28RNIsfq2ROKEDC8kIe3lQqWqcZq9x6naQO5HdZYbOime0GjH7f8LUokghwbRnVi7_uXUl-GwFhXReioDE-lRulVWBuaTEDjghLwz4ZNK1Hi3OEVuMkvis1ZLw-pmNMl95cdbpGAeWU2B3nROjPswqUa-E Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: b39fba18c6c64ee9bcf7f3335014cdd5 Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b39fba18c6c64ee9bcf7f3335014cdd5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b39fba18c6c64ee9bcf7f3335014cdd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b39fba18c6c64ee9bcf7f3335014cdd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b39fba18c6c64ee9bcf7f3335014cdd5"}]}] Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: b39fba18c6c64ee9bcf7f3335014cdd5 Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerMetadataNegativeTestJSON-822010234-project Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: a295be0f5bd94c0c853feb09c47f9ffa Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-822010234-project Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance caea2c16-d152-473b-988e-d985be71777e could not be found. Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'server_id': 'caea2c16-d152-473b-988e-d985be71777e'} Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caea2c16-d152-473b-988e-d985be71777e could not be found. Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caea2c16-d152-473b-988e-d985be71777e could not be found. Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:07.059130 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:07.062686 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:07.062686 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:07.062686 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caea2c16-d152-473b-988e-d985be71777e could not be found. Jul 25 13:08:07.062686 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.062686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-30f9cd57-50af-414e-9a4e-8dd53346e632 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Returning 404 to user: Instance caea2c16-d152-473b-988e-d985be71777e could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:07.062686 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-30f9cd57-50af-414e-9a4e-8dd53346e632 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "GET /compute/v2.1/servers/caea2c16-d152-473b-988e-d985be71777e/metadata" status: 404 len: 111 microversion: 2.1 time: 0.026783 Jul 25 13:08:07.064062 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2607/5114] 10.222.0.49 () {58 vars in 1263 bytes} [Mon Jul 25 13:08:07 2022] GET /compute/v2.1/servers/caea2c16-d152-473b-988e-d985be71777e/metadata => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:08:07.134318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-704baa37-d097-4d03-abf8-c0825cc7e92f tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-585320663", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8529a16e-b7bf-4399-adc1-db6e6ba3cc6b"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-704baa37-d097-4d03-abf8-c0825cc7e92f tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Request method failure captured: Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 498 Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pWe8xiLQNNY7Kv74yLnM28RNIsfq2ROKEDC8kIe3lQqWqcZq9x6naQO5HdZYbOime0GjH7f8LUokghwbRnVi7_uXUl-GwFhXReioDE-lRulVWBuaTEDjghLwz4ZNK1Hi3OEVuMkvis1ZLw-pmNMl95cdbpGAeWU2B3nROjPswqUa-E Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: b39fba18c6c64ee9bcf7f3335014cdd5 Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b39fba18c6c64ee9bcf7f3335014cdd5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b39fba18c6c64ee9bcf7f3335014cdd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b39fba18c6c64ee9bcf7f3335014cdd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b39fba18c6c64ee9bcf7f3335014cdd5"}]}] Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: b39fba18c6c64ee9bcf7f3335014cdd5 Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerMetadataNegativeTestJSON-822010234-project Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: a295be0f5bd94c0c853feb09c47f9ffa Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-822010234-project Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-585320663", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8529a16e-b7bf-4399-adc1-db6e6ba3cc6b"}]}} Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-585320663', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8529a16e-b7bf-4399-adc1-db6e6ba3cc6b'}]}}} Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 13:08:07.141238 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 13:08:07.144067 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.149420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-704baa37-d097-4d03-abf8-c0825cc7e92f tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:07.150817 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-704baa37-d097-4d03-abf8-c0825cc7e92f tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.022318 Jul 25 13:08:07.152403 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2508/5115] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:08:07 2022] POST /compute/v2.1/servers => generated 687 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:08:07.211021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-90a0529f-1273-4f7d-880d-8370245ffc72 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-502916427", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8529a16e-b7bf-4399-adc1-db6e6ba3cc6b"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-90a0529f-1273-4f7d-880d-8370245ffc72 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Request method failure captured: Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 499 Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pWe8xiLQNNY7Kv74yLnM28RNIsfq2ROKEDC8kIe3lQqWqcZq9x6naQO5HdZYbOime0GjH7f8LUokghwbRnVi7_uXUl-GwFhXReioDE-lRulVWBuaTEDjghLwz4ZNK1Hi3OEVuMkvis1ZLw-pmNMl95cdbpGAeWU2B3nROjPswqUa-E Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: b39fba18c6c64ee9bcf7f3335014cdd5 Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b39fba18c6c64ee9bcf7f3335014cdd5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b39fba18c6c64ee9bcf7f3335014cdd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b39fba18c6c64ee9bcf7f3335014cdd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b39fba18c6c64ee9bcf7f3335014cdd5"}]}] Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: b39fba18c6c64ee9bcf7f3335014cdd5 Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerMetadataNegativeTestJSON-822010234-project Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: a295be0f5bd94c0c853feb09c47f9ffa Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-822010234-project Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-502916427", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8529a16e-b7bf-4399-adc1-db6e6ba3cc6b"}]}} Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-502916427', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8529a16e-b7bf-4399-adc1-db6e6ba3cc6b'}]}}} Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise error Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 13:08:07.215428 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-90a0529f-1273-4f7d-880d-8370245ffc72 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-90a0529f-1273-4f7d-880d-8370245ffc72 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.009770 Jul 25 13:08:07.223033 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2608/5116] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:08:07 2022] POST /compute/v2.1/servers => generated 689 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:08:07.287760 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6cb525be-d408-450a-9e47-095981b04c48 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1885887960", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8529a16e-b7bf-4399-adc1-db6e6ba3cc6b"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6cb525be-d408-450a-9e47-095981b04c48 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Request method failure captured: Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 754 Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pWe8xiLQNNY7Kv74yLnM28RNIsfq2ROKEDC8kIe3lQqWqcZq9x6naQO5HdZYbOime0GjH7f8LUokghwbRnVi7_uXUl-GwFhXReioDE-lRulVWBuaTEDjghLwz4ZNK1Hi3OEVuMkvis1ZLw-pmNMl95cdbpGAeWU2B3nROjPswqUa-E Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: b39fba18c6c64ee9bcf7f3335014cdd5 Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b39fba18c6c64ee9bcf7f3335014cdd5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b39fba18c6c64ee9bcf7f3335014cdd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b39fba18c6c64ee9bcf7f3335014cdd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b39fba18c6c64ee9bcf7f3335014cdd5"}]}] Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: b39fba18c6c64ee9bcf7f3335014cdd5 Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerMetadataNegativeTestJSON-822010234-project Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: a295be0f5bd94c0c853feb09c47f9ffa Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-822010234-project Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1885887960", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8529a16e-b7bf-4399-adc1-db6e6ba3cc6b"}]}} Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1885887960', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8529a16e-b7bf-4399-adc1-db6e6ba3cc6b'}]}}} Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 13:08:07.292182 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 13:08:07.304188 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 13:08:07.307349 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 13:08:07.307349 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.307349 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6cb525be-d408-450a-9e47-095981b04c48 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:07.307349 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6cb525be-d408-450a-9e47-095981b04c48 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.010981 Jul 25 13:08:07.307349 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2509/5117] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:08:07 2022] POST /compute/v2.1/servers => generated 1197 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 25 13:08:07.383460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e4a48399-8fbb-4164-98a1-348aaf29632a tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-489501799", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8529a16e-b7bf-4399-adc1-db6e6ba3cc6b"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e4a48399-8fbb-4164-98a1-348aaf29632a tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Request method failure captured: Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 1265 Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pWe8xiLQNNY7Kv74yLnM28RNIsfq2ROKEDC8kIe3lQqWqcZq9x6naQO5HdZYbOime0GjH7f8LUokghwbRnVi7_uXUl-GwFhXReioDE-lRulVWBuaTEDjghLwz4ZNK1Hi3OEVuMkvis1ZLw-pmNMl95cdbpGAeWU2B3nROjPswqUa-E Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: b39fba18c6c64ee9bcf7f3335014cdd5 Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b39fba18c6c64ee9bcf7f3335014cdd5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b39fba18c6c64ee9bcf7f3335014cdd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b39fba18c6c64ee9bcf7f3335014cdd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b39fba18c6c64ee9bcf7f3335014cdd5"}]}] Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: b39fba18c6c64ee9bcf7f3335014cdd5 Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerMetadataNegativeTestJSON-822010234-project Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: a295be0f5bd94c0c853feb09c47f9ffa Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-822010234-project Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-489501799", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8529a16e-b7bf-4399-adc1-db6e6ba3cc6b"}]}} Jul 25 13:08:07.398690 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:08:07.401095 n-d-848886-15 devstack@n-api.service[125884]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 13:08:07.401095 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-489501799', 'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8529a16e-b7bf-4399-adc1-db6e6ba3cc6b'}]}}} Jul 25 13:08:07.401095 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:07.401095 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:07.401095 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 13:08:07.401095 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 13:08:07.401095 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 13:08:07.401095 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise error Jul 25 13:08:07.401095 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 13:08:07.401095 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.401095 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 25 13:08:07.401095 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 13:08:07.401095 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 13:08:07.401095 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 13:08:07.401095 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 13:08:07.401095 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.401095 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 13:08:07.402785 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 13:08:07.405671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 13:08:07.405671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.405671 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e4a48399-8fbb-4164-98a1-348aaf29632a tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:07.405671 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e4a48399-8fbb-4164-98a1-348aaf29632a tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.023558 Jul 25 13:08:07.405671 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2609/5118] 10.222.0.49 () {60 vars in 1148 bytes} [Mon Jul 25 13:08:07 2022] POST /compute/v2.1/servers => generated 2221 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 25 13:08:07.422496 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-65e75abf-a89d-418f-ab70-a5293f7724d2 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:07.423322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-65e75abf-a89d-418f-ab70-a5293f7724d2 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] [instance: 909fe58b-d68c-4513-84c1-144ce9876190] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:07.438631 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-65e75abf-a89d-418f-ab70-a5293f7724d2 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] HTTP exception thrown: Instance 909fe58b-d68c-4513-84c1-144ce9876190 could not be found. Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-65e75abf-a89d-418f-ab70-a5293f7724d2 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Request method failure captured: Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/909fe58b-d68c-4513-84c1-144ce9876190/metadata/test2 HTTP/1.1 Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pWe8xiLQNNY7Kv74yLnM28RNIsfq2ROKEDC8kIe3lQqWqcZq9x6naQO5HdZYbOime0GjH7f8LUokghwbRnVi7_uXUl-GwFhXReioDE-lRulVWBuaTEDjghLwz4ZNK1Hi3OEVuMkvis1ZLw-pmNMl95cdbpGAeWU2B3nROjPswqUa-E Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: b39fba18c6c64ee9bcf7f3335014cdd5 Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b39fba18c6c64ee9bcf7f3335014cdd5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b39fba18c6c64ee9bcf7f3335014cdd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b39fba18c6c64ee9bcf7f3335014cdd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b39fba18c6c64ee9bcf7f3335014cdd5"}]}] Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: b39fba18c6c64ee9bcf7f3335014cdd5 Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerMetadataNegativeTestJSON-822010234-project Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: a295be0f5bd94c0c853feb09c47f9ffa Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-822010234-project Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 909fe58b-d68c-4513-84c1-144ce9876190 could not be found. Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'server_id': '909fe58b-d68c-4513-84c1-144ce9876190', 'id': 'test2'} Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 909fe58b-d68c-4513-84c1-144ce9876190 could not be found. Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 909fe58b-d68c-4513-84c1-144ce9876190 could not be found. Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:07.440385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:07.443741 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:07.443741 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:07.443741 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 909fe58b-d68c-4513-84c1-144ce9876190 could not be found. Jul 25 13:08:07.443741 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:07.443741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-65e75abf-a89d-418f-ab70-a5293f7724d2 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Returning 404 to user: Instance 909fe58b-d68c-4513-84c1-144ce9876190 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:07.443741 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-65e75abf-a89d-418f-ab70-a5293f7724d2 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "GET /compute/v2.1/servers/909fe58b-d68c-4513-84c1-144ce9876190/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.024905 Jul 25 13:08:07.449271 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2510/5119] 10.222.0.49 () {58 vars in 1281 bytes} [Mon Jul 25 13:08:07 2022] GET /compute/v2.1/servers/909fe58b-d68c-4513-84c1-144ce9876190/metadata/test2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:08:07.471791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4d7320a8-abed-4850-b0dd-a63513b93299 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:07.472303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4d7320a8-abed-4850-b0dd-a63513b93299 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] [instance: fa3ea3d7-202d-4464-a4bc-e99d48072c3a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:07.480074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d7320a8-abed-4850-b0dd-a63513b93299 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:07.480822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d7320a8-abed-4850-b0dd-a63513b93299 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:07.481881 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d7320a8-abed-4850-b0dd-a63513b93299 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:07.482545 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d7320a8-abed-4850-b0dd-a63513b93299 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:07.487155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-73bd2b4c-08de-4965-b328-0d55c3be3d1d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:07.489628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-73bd2b4c-08de-4965-b328-0d55c3be3d1d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:07.504279 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73bd2b4c-08de-4965-b328-0d55c3be3d1d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:07.505151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73bd2b4c-08de-4965-b328-0d55c3be3d1d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:07.508076 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73bd2b4c-08de-4965-b328-0d55c3be3d1d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:07.509070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73bd2b4c-08de-4965-b328-0d55c3be3d1d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:07.544218 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4d7320a8-abed-4850-b0dd-a63513b93299 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] [instance: fa3ea3d7-202d-4464-a4bc-e99d48072c3a] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:08:07.684039 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-73bd2b4c-08de-4965-b328-0d55c3be3d1d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:07.689284 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4d7320a8-abed-4850-b0dd-a63513b93299 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a" status: 204 len: 0 microversion: 2.1 time: 0.221228 Jul 25 13:08:07.690645 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2610/5120] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:08:07 2022] DELETE /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:08:07.704525 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-73bd2b4c-08de-4965-b328-0d55c3be3d1d tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 200 len: 1451 microversion: 2.1 time: 0.222195 Jul 25 13:08:07.717857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f8e4cda5-6e4b-48b7-ba55-dd9b013acc42 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:07.717857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f8e4cda5-6e4b-48b7-ba55-dd9b013acc42 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:07.718169 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2511/5121] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:07 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 1451 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:07.724541 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-6be9854a-b1d0-4835-a703-be951cb6113c req-a1978903-211a-40f6-9fb8-77c9912f93a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9029dd8-106b-4795-bf7d-9eff09d4abb8", "name": "network-vif-deleted", "tag": "73b3ecbb-bec7-4104-97cb-88cec161c39e"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:07.726966 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8e4cda5-6e4b-48b7-ba55-dd9b013acc42 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:07.729863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8e4cda5-6e4b-48b7-ba55-dd9b013acc42 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:07.731163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8e4cda5-6e4b-48b7-ba55-dd9b013acc42 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:07.731710 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8e4cda5-6e4b-48b7-ba55-dd9b013acc42 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:07.747065 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-6be9854a-b1d0-4835-a703-be951cb6113c req-a1978903-211a-40f6-9fb8-77c9912f93a2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:07.747505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-6be9854a-b1d0-4835-a703-be951cb6113c req-a1978903-211a-40f6-9fb8-77c9912f93a2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:07.771072 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-6be9854a-b1d0-4835-a703-be951cb6113c req-a1978903-211a-40f6-9fb8-77c9912f93a2 service nova] Creating event network-vif-deleted:73b3ecbb-bec7-4104-97cb-88cec161c39e for instance c9029dd8-106b-4795-bf7d-9eff09d4abb8 on n-h1-848886-15 Jul 25 13:08:07.777148 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-6be9854a-b1d0-4835-a703-be951cb6113c req-a1978903-211a-40f6-9fb8-77c9912f93a2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060904 Jul 25 13:08:07.782654 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2512/5122] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:07.788365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2a6f7829-4e48-4734-bcc3-b6af50ce3aa3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:07.795374 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2a6f7829-4e48-4734-bcc3-b6af50ce3aa3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] [instance: fa3ea3d7-202d-4464-a4bc-e99d48072c3a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:07.815901 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2a6f7829-4e48-4734-bcc3-b6af50ce3aa3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:07.816351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2a6f7829-4e48-4734-bcc3-b6af50ce3aa3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:07.823245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2a6f7829-4e48-4734-bcc3-b6af50ce3aa3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:07.823926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2a6f7829-4e48-4734-bcc3-b6af50ce3aa3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:08.161312 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f8e4cda5-6e4b-48b7-ba55-dd9b013acc42 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:08.178729 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f8e4cda5-6e4b-48b7-ba55-dd9b013acc42 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1168 microversion: 2.1 time: 0.485156 Jul 25 13:08:08.180147 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2611/5123] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:07 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1168 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:08.189050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0374d1a6-c2da-4484-897f-44f83c8f2fca tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:08.189664 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0374d1a6-c2da-4484-897f-44f83c8f2fca tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:08.209199 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0374d1a6-c2da-4484-897f-44f83c8f2fca tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:08.210221 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0374d1a6-c2da-4484-897f-44f83c8f2fca tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:08.211930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0374d1a6-c2da-4484-897f-44f83c8f2fca tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:08.212369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0374d1a6-c2da-4484-897f-44f83c8f2fca tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:08.312533 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2a6f7829-4e48-4734-bcc3-b6af50ce3aa3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295be0f5bd94c0c853feb09c47f9ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39fba18c6c64ee9bcf7f3335014cdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:08.320975 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2a6f7829-4e48-4734-bcc3-b6af50ce3aa3 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a" status: 200 len: 1525 microversion: 2.1 time: 0.536827 Jul 25 13:08:08.330133 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2513/5124] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:07 2022] GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a => generated 1525 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:08.729061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-17d0b65e-1ab6-46ee-9ef1-5755a9ef1fc5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:08.731022 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-17d0b65e-1ab6-46ee-9ef1-5755a9ef1fc5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:08.739828 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-17d0b65e-1ab6-46ee-9ef1-5755a9ef1fc5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:08.740346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-17d0b65e-1ab6-46ee-9ef1-5755a9ef1fc5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:08.741578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-17d0b65e-1ab6-46ee-9ef1-5755a9ef1fc5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:08.751286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-17d0b65e-1ab6-46ee-9ef1-5755a9ef1fc5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:08.775941 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-17d0b65e-1ab6-46ee-9ef1-5755a9ef1fc5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] HTTP exception thrown: Instance c9029dd8-106b-4795-bf7d-9eff09d4abb8 could not be found. Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-17d0b65e-1ab6-46ee-9ef1-5755a9ef1fc5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Request method failure captured: Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 HTTP/1.1 Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pTdZnYy3zWCXLN8GI-lAb9Aac2xutmWdntWmHOJQQOAHuSaLRru4vmbdxH-2ipAsIwdgHGRBCQV52EgrlBqV5LzQtSAIs0OqruuNBUIA1ZYGpGU7ybcvN2tekv0vVPxk7wJZaAmUwppQmT0JDG4pBCSl5Rw9dXMoK1Y6yvluyRvyio Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebb6a07295234370aa1aa5067b8ee930", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}] Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersTestJSON-733750618 Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersTestJSON-733750618-project Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 60d84eb7c45449cbad3141d9f363e693 Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersTestJSON-733750618-project Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance c9029dd8-106b-4795-bf7d-9eff09d4abb8 could not be found. Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'c9029dd8-106b-4795-bf7d-9eff09d4abb8'} Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9029dd8-106b-4795-bf7d-9eff09d4abb8 could not be found. Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9029dd8-106b-4795-bf7d-9eff09d4abb8 could not be found. Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:08.778284 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:08.783766 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:08.783766 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:08.783766 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:08.783766 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:08.783766 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9029dd8-106b-4795-bf7d-9eff09d4abb8 could not be found. Jul 25 13:08:08.783766 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:08.786357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-17d0b65e-1ab6-46ee-9ef1-5755a9ef1fc5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Returning 404 to user: Instance c9029dd8-106b-4795-bf7d-9eff09d4abb8 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:08.787456 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-17d0b65e-1ab6-46ee-9ef1-5755a9ef1fc5 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 404 len: 111 microversion: 2.1 time: 0.062649 Jul 25 13:08:08.788853 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2514/5125] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:08 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 13:08:08.804519 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-89a1d4de-8727-4b21-bac6-f597f8a70b01 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:08.807286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-89a1d4de-8727-4b21-bac6-f597f8a70b01 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:08.819177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89a1d4de-8727-4b21-bac6-f597f8a70b01 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:08.820048 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89a1d4de-8727-4b21-bac6-f597f8a70b01 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:08.821637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89a1d4de-8727-4b21-bac6-f597f8a70b01 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:08.823697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89a1d4de-8727-4b21-bac6-f597f8a70b01 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:08.860427 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-89a1d4de-8727-4b21-bac6-f597f8a70b01 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] HTTP exception thrown: Instance c9029dd8-106b-4795-bf7d-9eff09d4abb8 could not be found. Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-89a1d4de-8727-4b21-bac6-f597f8a70b01 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Request method failure captured: Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 HTTP/1.1 Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pTdZnYy3zWCXLN8GI-lAb9Aac2xutmWdntWmHOJQQOAHuSaLRru4vmbdxH-2ipAsIwdgHGRBCQV52EgrlBqV5LzQtSAIs0OqruuNBUIA1ZYGpGU7ybcvN2tekv0vVPxk7wJZaAmUwppQmT0JDG4pBCSl5Rw9dXMoK1Y6yvluyRvyio Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebb6a07295234370aa1aa5067b8ee930", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}] Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersTestJSON-733750618 Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersTestJSON-733750618-project Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 60d84eb7c45449cbad3141d9f363e693 Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersTestJSON-733750618-project Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance c9029dd8-106b-4795-bf7d-9eff09d4abb8 could not be found. Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'c9029dd8-106b-4795-bf7d-9eff09d4abb8'} Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9029dd8-106b-4795-bf7d-9eff09d4abb8 could not be found. Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:08:08.863264 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9029dd8-106b-4795-bf7d-9eff09d4abb8 could not be found. Jul 25 13:08:08.868241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:08.868241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:08.868241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:08.868241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:08.868241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:08.868241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:08.868241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:08.868241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:08.868241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9029dd8-106b-4795-bf7d-9eff09d4abb8 could not be found. Jul 25 13:08:08.868241 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:08.870037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-89a1d4de-8727-4b21-bac6-f597f8a70b01 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Returning 404 to user: Instance c9029dd8-106b-4795-bf7d-9eff09d4abb8 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:08.872250 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-89a1d4de-8727-4b21-bac6-f597f8a70b01 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 404 len: 111 microversion: 2.1 time: 0.069346 Jul 25 13:08:08.873919 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2515/5126] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:08:08 2022] DELETE /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:08:08.900854 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-239c01dd-5916-4dce-b655-2ef1b4edacba tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:08.902482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-239c01dd-5916-4dce-b655-2ef1b4edacba tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: c9029dd8-106b-4795-bf7d-9eff09d4abb8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:08.908927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-239c01dd-5916-4dce-b655-2ef1b4edacba tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:08.909300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-239c01dd-5916-4dce-b655-2ef1b4edacba tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:08.910203 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-239c01dd-5916-4dce-b655-2ef1b4edacba tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:08.910531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-239c01dd-5916-4dce-b655-2ef1b4edacba tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:08.934214 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-239c01dd-5916-4dce-b655-2ef1b4edacba tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] HTTP exception thrown: Instance c9029dd8-106b-4795-bf7d-9eff09d4abb8 could not be found. Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-239c01dd-5916-4dce-b655-2ef1b4edacba tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Request method failure captured: Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 HTTP/1.1 Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pTdZnYy3zWCXLN8GI-lAb9Aac2xutmWdntWmHOJQQOAHuSaLRru4vmbdxH-2ipAsIwdgHGRBCQV52EgrlBqV5LzQtSAIs0OqruuNBUIA1ZYGpGU7ybcvN2tekv0vVPxk7wJZaAmUwppQmT0JDG4pBCSl5Rw9dXMoK1Y6yvluyRvyio Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebb6a07295234370aa1aa5067b8ee930", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}] Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersTestJSON-733750618 Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersTestJSON-733750618-project Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 60d84eb7c45449cbad3141d9f363e693 Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersTestJSON-733750618-project Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance c9029dd8-106b-4795-bf7d-9eff09d4abb8 could not be found. Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'c9029dd8-106b-4795-bf7d-9eff09d4abb8'} Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9029dd8-106b-4795-bf7d-9eff09d4abb8 could not be found. Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9029dd8-106b-4795-bf7d-9eff09d4abb8 could not be found. Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:08.936059 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:08.939671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:08.939671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:08.939671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:08.939671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:08.939671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9029dd8-106b-4795-bf7d-9eff09d4abb8 could not be found. Jul 25 13:08:08.939671 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:08.939671 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-239c01dd-5916-4dce-b655-2ef1b4edacba tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Returning 404 to user: Instance c9029dd8-106b-4795-bf7d-9eff09d4abb8 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:08.939671 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-239c01dd-5916-4dce-b655-2ef1b4edacba tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8" status: 404 len: 111 microversion: 2.1 time: 0.050126 Jul 25 13:08:08.939671 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2516/5127] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:08 2022] GET /compute/v2.1/servers/c9029dd8-106b-4795-bf7d-9eff09d4abb8 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:08:08.946196 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-378aa556-ef11-47f4-9332-eec352b5c383 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:08.946697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-378aa556-ef11-47f4-9332-eec352b5c383 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:08.948871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:08:08.956470 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-378aa556-ef11-47f4-9332-eec352b5c383 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:08.956859 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-378aa556-ef11-47f4-9332-eec352b5c383 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:08.958031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-378aa556-ef11-47f4-9332-eec352b5c383 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:08.958676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-378aa556-ef11-47f4-9332-eec352b5c383 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:08.980561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0374d1a6-c2da-4484-897f-44f83c8f2fca tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:08.981570 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-378aa556-ef11-47f4-9332-eec352b5c383 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] HTTP exception thrown: Instance 966b2836-cec0-45b1-b147-bfde8ea67226 could not be found. Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-378aa556-ef11-47f4-9332-eec352b5c383 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Request method failure captured: Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 HTTP/1.1 Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pTdZnYy3zWCXLN8GI-lAb9Aac2xutmWdntWmHOJQQOAHuSaLRru4vmbdxH-2ipAsIwdgHGRBCQV52EgrlBqV5LzQtSAIs0OqruuNBUIA1ZYGpGU7ybcvN2tekv0vVPxk7wJZaAmUwppQmT0JDG4pBCSl5Rw9dXMoK1Y6yvluyRvyio Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebb6a07295234370aa1aa5067b8ee930", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}] Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersTestJSON-733750618 Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersTestJSON-733750618-project Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 60d84eb7c45449cbad3141d9f363e693 Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersTestJSON-733750618-project Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 966b2836-cec0-45b1-b147-bfde8ea67226 could not be found. Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '966b2836-cec0-45b1-b147-bfde8ea67226'} Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 966b2836-cec0-45b1-b147-bfde8ea67226 could not be found. Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:08:08.983598 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 966b2836-cec0-45b1-b147-bfde8ea67226 could not be found. Jul 25 13:08:08.988158 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:08.988158 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:08.988158 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:08.988158 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:08.988158 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:08.988158 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:08.988158 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:08.988158 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:08.988158 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 966b2836-cec0-45b1-b147-bfde8ea67226 could not be found. Jul 25 13:08:08.988158 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:08.989818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-378aa556-ef11-47f4-9332-eec352b5c383 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Returning 404 to user: Instance 966b2836-cec0-45b1-b147-bfde8ea67226 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:08.991830 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-378aa556-ef11-47f4-9332-eec352b5c383 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "DELETE /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226" status: 404 len: 111 microversion: 2.1 time: 0.048732 Jul 25 13:08:08.992904 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2517/5128] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:08:08 2022] DELETE /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 13:08:08.997294 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0374d1a6-c2da-4484-897f-44f83c8f2fca tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1715 microversion: 2.1 time: 0.815863 Jul 25 13:08:09.003091 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-755cad20-86f5-4a6a-b2ea-f56826bc5f7e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:09.004062 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2612/5129] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:08 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1715 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:09.004754 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-755cad20-86f5-4a6a-b2ea-f56826bc5f7e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 966b2836-cec0-45b1-b147-bfde8ea67226] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:09.053241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-755cad20-86f5-4a6a-b2ea-f56826bc5f7e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:09.053822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-755cad20-86f5-4a6a-b2ea-f56826bc5f7e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:09.054836 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-755cad20-86f5-4a6a-b2ea-f56826bc5f7e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:09.055370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-755cad20-86f5-4a6a-b2ea-f56826bc5f7e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:09.087378 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-755cad20-86f5-4a6a-b2ea-f56826bc5f7e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] HTTP exception thrown: Instance 966b2836-cec0-45b1-b147-bfde8ea67226 could not be found. Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-755cad20-86f5-4a6a-b2ea-f56826bc5f7e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Request method failure captured: Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 HTTP/1.1 Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pTdZnYy3zWCXLN8GI-lAb9Aac2xutmWdntWmHOJQQOAHuSaLRru4vmbdxH-2ipAsIwdgHGRBCQV52EgrlBqV5LzQtSAIs0OqruuNBUIA1ZYGpGU7ybcvN2tekv0vVPxk7wJZaAmUwppQmT0JDG4pBCSl5Rw9dXMoK1Y6yvluyRvyio Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebb6a07295234370aa1aa5067b8ee930", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}] Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersTestJSON-733750618 Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersTestJSON-733750618-project Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 60d84eb7c45449cbad3141d9f363e693 Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersTestJSON-733750618-project Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 966b2836-cec0-45b1-b147-bfde8ea67226 could not be found. Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '966b2836-cec0-45b1-b147-bfde8ea67226'} Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 966b2836-cec0-45b1-b147-bfde8ea67226 could not be found. Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 966b2836-cec0-45b1-b147-bfde8ea67226 could not be found. Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.088971 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:09.095361 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:09.095361 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:09.095361 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:09.095361 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:09.095361 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 966b2836-cec0-45b1-b147-bfde8ea67226 could not be found. Jul 25 13:08:09.095361 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.095361 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-755cad20-86f5-4a6a-b2ea-f56826bc5f7e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Returning 404 to user: Instance 966b2836-cec0-45b1-b147-bfde8ea67226 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:09.095361 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-755cad20-86f5-4a6a-b2ea-f56826bc5f7e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226" status: 404 len: 111 microversion: 2.1 time: 0.093661 Jul 25 13:08:09.095361 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2518/5130] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:08 2022] GET /compute/v2.1/servers/966b2836-cec0-45b1-b147-bfde8ea67226 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:08:09.101241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9f5c9884-d9a6-42da-958a-17933220dbe6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:09.102153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9f5c9884-d9a6-42da-958a-17933220dbe6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 58447a88-a579-4078-9af4-d6b7379de5cf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:09.116216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f5c9884-d9a6-42da-958a-17933220dbe6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:09.117510 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f5c9884-d9a6-42da-958a-17933220dbe6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:09.118663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f5c9884-d9a6-42da-958a-17933220dbe6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:09.119328 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f5c9884-d9a6-42da-958a-17933220dbe6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:09.169965 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-9f5c9884-d9a6-42da-958a-17933220dbe6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] HTTP exception thrown: Instance 58447a88-a579-4078-9af4-d6b7379de5cf could not be found. Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9f5c9884-d9a6-42da-958a-17933220dbe6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Request method failure captured: Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf HTTP/1.1 Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pTdZnYy3zWCXLN8GI-lAb9Aac2xutmWdntWmHOJQQOAHuSaLRru4vmbdxH-2ipAsIwdgHGRBCQV52EgrlBqV5LzQtSAIs0OqruuNBUIA1ZYGpGU7ybcvN2tekv0vVPxk7wJZaAmUwppQmT0JDG4pBCSl5Rw9dXMoK1Y6yvluyRvyio Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebb6a07295234370aa1aa5067b8ee930", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}] Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersTestJSON-733750618 Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersTestJSON-733750618-project Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 60d84eb7c45449cbad3141d9f363e693 Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersTestJSON-733750618-project Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 58447a88-a579-4078-9af4-d6b7379de5cf could not be found. Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '58447a88-a579-4078-9af4-d6b7379de5cf'} Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58447a88-a579-4078-9af4-d6b7379de5cf could not be found. Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:08:09.174777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58447a88-a579-4078-9af4-d6b7379de5cf could not be found. Jul 25 13:08:09.178697 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.178697 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:09.178697 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.178697 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:09.178697 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:09.178697 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:09.178697 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:09.178697 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:09.178697 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58447a88-a579-4078-9af4-d6b7379de5cf could not be found. Jul 25 13:08:09.178697 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.178697 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9f5c9884-d9a6-42da-958a-17933220dbe6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Returning 404 to user: Instance 58447a88-a579-4078-9af4-d6b7379de5cf could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:09.178697 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9f5c9884-d9a6-42da-958a-17933220dbe6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "DELETE /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf" status: 404 len: 111 microversion: 2.1 time: 0.082175 Jul 25 13:08:09.187470 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e444a3c1-f4e2-4aba-80e3-d019a720b367 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:09.188172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e444a3c1-f4e2-4aba-80e3-d019a720b367 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 58447a88-a579-4078-9af4-d6b7379de5cf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:09.194242 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2613/5131] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:08:09 2022] DELETE /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:08:09.201396 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e444a3c1-f4e2-4aba-80e3-d019a720b367 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:09.205949 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e444a3c1-f4e2-4aba-80e3-d019a720b367 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:09.208448 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e444a3c1-f4e2-4aba-80e3-d019a720b367 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:09.209544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-14bcef0a-aabb-485b-9c6e-edc2edf1424d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:09.210530 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-14bcef0a-aabb-485b-9c6e-edc2edf1424d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:09.211324 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e444a3c1-f4e2-4aba-80e3-d019a720b367 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:09.219330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14bcef0a-aabb-485b-9c6e-edc2edf1424d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:09.220314 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14bcef0a-aabb-485b-9c6e-edc2edf1424d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:09.222132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14bcef0a-aabb-485b-9c6e-edc2edf1424d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:09.222804 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14bcef0a-aabb-485b-9c6e-edc2edf1424d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:09.232198 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-e444a3c1-f4e2-4aba-80e3-d019a720b367 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] HTTP exception thrown: Instance 58447a88-a579-4078-9af4-d6b7379de5cf could not be found. Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e444a3c1-f4e2-4aba-80e3-d019a720b367 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Request method failure captured: Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf HTTP/1.1 Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pTdZnYy3zWCXLN8GI-lAb9Aac2xutmWdntWmHOJQQOAHuSaLRru4vmbdxH-2ipAsIwdgHGRBCQV52EgrlBqV5LzQtSAIs0OqruuNBUIA1ZYGpGU7ybcvN2tekv0vVPxk7wJZaAmUwppQmT0JDG4pBCSl5Rw9dXMoK1Y6yvluyRvyio Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebb6a07295234370aa1aa5067b8ee930", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}] Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersTestJSON-733750618 Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersTestJSON-733750618-project Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 60d84eb7c45449cbad3141d9f363e693 Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersTestJSON-733750618-project Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 58447a88-a579-4078-9af4-d6b7379de5cf could not be found. Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '58447a88-a579-4078-9af4-d6b7379de5cf'} Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58447a88-a579-4078-9af4-d6b7379de5cf could not be found. Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58447a88-a579-4078-9af4-d6b7379de5cf could not be found. Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.236691 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:09.244674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:09.244674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:09.244674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:09.244674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:09.244674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58447a88-a579-4078-9af4-d6b7379de5cf could not be found. Jul 25 13:08:09.244674 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.246913 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e444a3c1-f4e2-4aba-80e3-d019a720b367 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Returning 404 to user: Instance 58447a88-a579-4078-9af4-d6b7379de5cf could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:09.255372 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e444a3c1-f4e2-4aba-80e3-d019a720b367 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf" status: 404 len: 111 microversion: 2.1 time: 0.064580 Jul 25 13:08:09.256200 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2519/5132] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:09 2022] GET /compute/v2.1/servers/58447a88-a579-4078-9af4-d6b7379de5cf => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 13:08:09.262240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f4be1360-6315-446b-b2e7-0129287b3f00 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:09.263044 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f4be1360-6315-446b-b2e7-0129287b3f00 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:09.269666 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4be1360-6315-446b-b2e7-0129287b3f00 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:09.270493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4be1360-6315-446b-b2e7-0129287b3f00 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:09.271504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4be1360-6315-446b-b2e7-0129287b3f00 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:09.272143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4be1360-6315-446b-b2e7-0129287b3f00 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:09.388234 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-f4be1360-6315-446b-b2e7-0129287b3f00 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] HTTP exception thrown: Cannot 'detach_volume' instance 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 while it is in vm_state rescued Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f4be1360-6315-446b-b2e7-0129287b3f00 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Request method failure captured: Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments/f9d00a7d-21d5-4501-ad07-293369dd6f01 HTTP/1.1 Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pS2fizNtGcP0shojWUAR1ukudLDJRoXVlsPYG2HQcSlgo2We_QWqoULmyxY8IuKrW-0MGgmtrhM3h66oISYSRqIRFBaYspnVlW3g8FUdRvhwOpsGmp2Y9wrcYeXMJCu6fdAfgxIzqcJ6TFFh6UfkfCkGP1n9iDHq6IO37482VYIk-U Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: f791ac394f9f4b8d99d2f48f7d04eae9 Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f791ac394f9f4b8d99d2f48f7d04eae9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f791ac394f9f4b8d99d2f48f7d04eae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f791ac394f9f4b8d99d2f48f7d04eae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f791ac394f9f4b8d99d2f48f7d04eae9"}]}] Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: f791ac394f9f4b8d99d2f48f7d04eae9 Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerRescueNegativeTestJSON-1618399313-project Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 72f34c080e4a4024a38660e8af252a29 Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1618399313-project Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: exception: Cannot 'detach_volume' instance 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 while it is in vm_state rescued Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'server_id': '3baaf3bb-a036-43d5-b1d0-799f44fb5ef3', 'id': 'f9d00a7d-21d5-4501-ad07-293369dd6f01'} Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 while it is in vm_state rescued Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.389759 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:09.393231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:09.393231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:09.393231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:09.393231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:09.393231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 while it is in vm_state rescued Jul 25 13:08:09.393231 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.393231 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f4be1360-6315-446b-b2e7-0129287b3f00 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Returning 409 to user: Cannot 'detach_volume' instance 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 while it is in vm_state rescued {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:09.393632 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f4be1360-6315-446b-b2e7-0129287b3f00 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments/f9d00a7d-21d5-4501-ad07-293369dd6f01" status: 409 len: 152 microversion: 2.1 time: 0.135913 Jul 25 13:08:09.397627 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2520/5133] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Jul 25 13:08:09 2022] DELETE /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments/f9d00a7d-21d5-4501-ad07-293369dd6f01 => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 13:08:09.403861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-745af330-fe11-4462-9c34-3b4cc06b98f6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:09.404382 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-745af330-fe11-4462-9c34-3b4cc06b98f6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:09.412454 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-745af330-fe11-4462-9c34-3b4cc06b98f6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:09.413248 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-745af330-fe11-4462-9c34-3b4cc06b98f6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:09.414646 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-745af330-fe11-4462-9c34-3b4cc06b98f6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:09.416238 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-745af330-fe11-4462-9c34-3b4cc06b98f6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:09.434738 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-745af330-fe11-4462-9c34-3b4cc06b98f6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] HTTP exception thrown: Instance e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 could not be found. Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-745af330-fe11-4462-9c34-3b4cc06b98f6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Request method failure captured: Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 HTTP/1.1 Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pTdZnYy3zWCXLN8GI-lAb9Aac2xutmWdntWmHOJQQOAHuSaLRru4vmbdxH-2ipAsIwdgHGRBCQV52EgrlBqV5LzQtSAIs0OqruuNBUIA1ZYGpGU7ybcvN2tekv0vVPxk7wJZaAmUwppQmT0JDG4pBCSl5Rw9dXMoK1Y6yvluyRvyio Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebb6a07295234370aa1aa5067b8ee930", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}] Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersTestJSON-733750618 Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersTestJSON-733750618-project Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 60d84eb7c45449cbad3141d9f363e693 Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersTestJSON-733750618-project Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 could not be found. Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885'} Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 could not be found. Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:08:09.436351 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 could not be found. Jul 25 13:08:09.441948 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.441948 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:09.441948 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.441948 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:09.441948 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:09.441948 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:09.441948 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:09.441948 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:09.441948 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 could not be found. Jul 25 13:08:09.441948 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.441948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-745af330-fe11-4462-9c34-3b4cc06b98f6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Returning 404 to user: Instance e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:09.441948 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-745af330-fe11-4462-9c34-3b4cc06b98f6 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885" status: 404 len: 111 microversion: 2.1 time: 0.038781 Jul 25 13:08:09.441948 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2521/5134] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:08:09 2022] DELETE /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:08:09.445560 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f8d44eb3-113f-45ec-8a73-c82c96dc4176 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:09.445560 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f8d44eb3-113f-45ec-8a73-c82c96dc4176 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] [instance: fa3ea3d7-202d-4464-a4bc-e99d48072c3a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:09.451972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8d44eb3-113f-45ec-8a73-c82c96dc4176 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:09.452711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8d44eb3-113f-45ec-8a73-c82c96dc4176 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:09.453488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8d44eb3-113f-45ec-8a73-c82c96dc4176 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:09.453968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8d44eb3-113f-45ec-8a73-c82c96dc4176 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:09.470020 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-14bcef0a-aabb-485b-9c6e-edc2edf1424d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:09.478549 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-14bcef0a-aabb-485b-9c6e-edc2edf1424d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1202 microversion: 2.1 time: 0.281374 Jul 25 13:08:09.478765 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:08:09.484995 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2614/5135] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:09 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1202 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:09.494706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7854cb78-9b72-4e1a-9eb6-c83d3865e714 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:09.495551 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7854cb78-9b72-4e1a-9eb6-c83d3865e714 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:09.506376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7854cb78-9b72-4e1a-9eb6-c83d3865e714 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:09.506833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7854cb78-9b72-4e1a-9eb6-c83d3865e714 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:09.507617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7854cb78-9b72-4e1a-9eb6-c83d3865e714 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:09.508063 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7854cb78-9b72-4e1a-9eb6-c83d3865e714 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:09.595935 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7854cb78-9b72-4e1a-9eb6-c83d3865e714 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "POST /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/action" status: 202 len: 0 microversion: 2.1 time: 0.109097 Jul 25 13:08:09.596673 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2615/5136] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:08:09 2022] POST /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:08:09.603503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-80664b73-9f62-4478-9758-4fb82f0aaa5a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:09.606775 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-80664b73-9f62-4478-9758-4fb82f0aaa5a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:09.619686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-80664b73-9f62-4478-9758-4fb82f0aaa5a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:09.620325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-80664b73-9f62-4478-9758-4fb82f0aaa5a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:09.621337 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-80664b73-9f62-4478-9758-4fb82f0aaa5a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:09.621820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-80664b73-9f62-4478-9758-4fb82f0aaa5a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:09.692933 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-80664b73-9f62-4478-9758-4fb82f0aaa5a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090731 Jul 25 13:08:09.694503 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2616/5137] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:08:09 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:09.705733 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-835b93f5-9ed9-46aa-bc7d-46b0122e4dfa tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:09.707370 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-835b93f5-9ed9-46aa-bc7d-46b0122e4dfa tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:09.714674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-835b93f5-9ed9-46aa-bc7d-46b0122e4dfa tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:09.715436 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-835b93f5-9ed9-46aa-bc7d-46b0122e4dfa tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:09.717865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-835b93f5-9ed9-46aa-bc7d-46b0122e4dfa tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:09.718601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-835b93f5-9ed9-46aa-bc7d-46b0122e4dfa tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:09.738024 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-835b93f5-9ed9-46aa-bc7d-46b0122e4dfa tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] HTTP exception thrown: Instance e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 could not be found. Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-835b93f5-9ed9-46aa-bc7d-46b0122e4dfa tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Request method failure captured: Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 HTTP/1.1 Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pTdZnYy3zWCXLN8GI-lAb9Aac2xutmWdntWmHOJQQOAHuSaLRru4vmbdxH-2ipAsIwdgHGRBCQV52EgrlBqV5LzQtSAIs0OqruuNBUIA1ZYGpGU7ybcvN2tekv0vVPxk7wJZaAmUwppQmT0JDG4pBCSl5Rw9dXMoK1Y6yvluyRvyio Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebb6a07295234370aa1aa5067b8ee930", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}] Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersTestJSON-733750618 Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersTestJSON-733750618-project Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 60d84eb7c45449cbad3141d9f363e693 Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersTestJSON-733750618-project Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 could not be found. Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885'} Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 could not be found. Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 could not be found. Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.741922 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:09.745567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:09.745567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:09.745567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:09.745567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:09.745567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 could not be found. Jul 25 13:08:09.745567 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:09.745567 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-835b93f5-9ed9-46aa-bc7d-46b0122e4dfa tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Returning 404 to user: Instance e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:09.745567 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-835b93f5-9ed9-46aa-bc7d-46b0122e4dfa tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885" status: 404 len: 111 microversion: 2.1 time: 0.042480 Jul 25 13:08:09.746672 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2617/5138] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:09 2022] GET /compute/v2.1/servers/e1f3da60-3f91-4ea2-ad5b-2ae2d51ea885 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:08:09.751481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d9ab51d8-aca9-494c-8ac1-2d5bb0a7dfd4 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:09.752447 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d9ab51d8-aca9-494c-8ac1-2d5bb0a7dfd4 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:09.759673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9ab51d8-aca9-494c-8ac1-2d5bb0a7dfd4 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:09.760134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9ab51d8-aca9-494c-8ac1-2d5bb0a7dfd4 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:09.760935 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9ab51d8-aca9-494c-8ac1-2d5bb0a7dfd4 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:09.761424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9ab51d8-aca9-494c-8ac1-2d5bb0a7dfd4 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:10.046914 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f8d44eb3-113f-45ec-8a73-c82c96dc4176 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295be0f5bd94c0c853feb09c47f9ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39fba18c6c64ee9bcf7f3335014cdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:10.063614 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f8d44eb3-113f-45ec-8a73-c82c96dc4176 tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a" status: 200 len: 1525 microversion: 2.1 time: 0.622899 Jul 25 13:08:10.064228 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2522/5139] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:09 2022] GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a => generated 1525 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:10.069147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-20e4b6f3-f86d-4cd3-ba45-eb4cd2cd864d tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:10.069648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-20e4b6f3-f86d-4cd3-ba45-eb4cd2cd864d tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:10.085509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20e4b6f3-f86d-4cd3-ba45-eb4cd2cd864d tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:10.086000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20e4b6f3-f86d-4cd3-ba45-eb4cd2cd864d tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:10.086792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20e4b6f3-f86d-4cd3-ba45-eb4cd2cd864d tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:10.087325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20e4b6f3-f86d-4cd3-ba45-eb4cd2cd864d tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:10.159452 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-20e4b6f3-f86d-4cd3-ba45-eb4cd2cd864d tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-volume_attachments/5ec0e596-e155-4a91-9564-b7f294711099" status: 200 len: 194 microversion: 2.1 time: 0.094076 Jul 25 13:08:10.163195 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2523/5140] 10.222.0.49 () {58 vars in 1413 bytes} [Mon Jul 25 13:08:10 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-volume_attachments/5ec0e596-e155-4a91-9564-b7f294711099 => generated 194 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:10.176329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-607554db-741c-41f4-b5b8-6fdfb27df9ec tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:10.183186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-607554db-741c-41f4-b5b8-6fdfb27df9ec tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 28dc8442-8d68-462f-9077-47707180800d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:10.190531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-607554db-741c-41f4-b5b8-6fdfb27df9ec tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:10.191271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-607554db-741c-41f4-b5b8-6fdfb27df9ec tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:10.192217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-607554db-741c-41f4-b5b8-6fdfb27df9ec tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:10.192799 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-607554db-741c-41f4-b5b8-6fdfb27df9ec tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:10.220943 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-607554db-741c-41f4-b5b8-6fdfb27df9ec tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] HTTP exception thrown: Instance 28dc8442-8d68-462f-9077-47707180800d could not be found. Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-607554db-741c-41f4-b5b8-6fdfb27df9ec tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Request method failure captured: Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d HTTP/1.1 Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pTdZnYy3zWCXLN8GI-lAb9Aac2xutmWdntWmHOJQQOAHuSaLRru4vmbdxH-2ipAsIwdgHGRBCQV52EgrlBqV5LzQtSAIs0OqruuNBUIA1ZYGpGU7ybcvN2tekv0vVPxk7wJZaAmUwppQmT0JDG4pBCSl5Rw9dXMoK1Y6yvluyRvyio Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebb6a07295234370aa1aa5067b8ee930", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}] Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersTestJSON-733750618 Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersTestJSON-733750618-project Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 60d84eb7c45449cbad3141d9f363e693 Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersTestJSON-733750618-project Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 28dc8442-8d68-462f-9077-47707180800d could not be found. Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '28dc8442-8d68-462f-9077-47707180800d'} Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28dc8442-8d68-462f-9077-47707180800d could not be found. Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:08:10.222726 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28dc8442-8d68-462f-9077-47707180800d could not be found. Jul 25 13:08:10.226123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.226123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:10.226123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.226123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:10.226123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:10.226123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:10.226123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:10.226123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:10.226123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28dc8442-8d68-462f-9077-47707180800d could not be found. Jul 25 13:08:10.226123 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.226123 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-607554db-741c-41f4-b5b8-6fdfb27df9ec tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Returning 404 to user: Instance 28dc8442-8d68-462f-9077-47707180800d could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:10.226123 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-607554db-741c-41f4-b5b8-6fdfb27df9ec tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "DELETE /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d" status: 404 len: 111 microversion: 2.1 time: 0.059904 Jul 25 13:08:10.228036 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2524/5141] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:08:10 2022] DELETE /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:08:10.233015 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3b7d4bf8-5018-4a43-8a48-01c34bf7037c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:10.233640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3b7d4bf8-5018-4a43-8a48-01c34bf7037c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 28dc8442-8d68-462f-9077-47707180800d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:10.259974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b7d4bf8-5018-4a43-8a48-01c34bf7037c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:10.260651 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b7d4bf8-5018-4a43-8a48-01c34bf7037c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:10.261656 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b7d4bf8-5018-4a43-8a48-01c34bf7037c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:10.262307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b7d4bf8-5018-4a43-8a48-01c34bf7037c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:10.278743 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-3b7d4bf8-5018-4a43-8a48-01c34bf7037c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] HTTP exception thrown: Instance 28dc8442-8d68-462f-9077-47707180800d could not be found. Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3b7d4bf8-5018-4a43-8a48-01c34bf7037c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Request method failure captured: Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d HTTP/1.1 Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pTdZnYy3zWCXLN8GI-lAb9Aac2xutmWdntWmHOJQQOAHuSaLRru4vmbdxH-2ipAsIwdgHGRBCQV52EgrlBqV5LzQtSAIs0OqruuNBUIA1ZYGpGU7ybcvN2tekv0vVPxk7wJZaAmUwppQmT0JDG4pBCSl5Rw9dXMoK1Y6yvluyRvyio Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebb6a07295234370aa1aa5067b8ee930", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}] Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersTestJSON-733750618 Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersTestJSON-733750618-project Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 60d84eb7c45449cbad3141d9f363e693 Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersTestJSON-733750618-project Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 28dc8442-8d68-462f-9077-47707180800d could not be found. Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '28dc8442-8d68-462f-9077-47707180800d'} Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28dc8442-8d68-462f-9077-47707180800d could not be found. Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28dc8442-8d68-462f-9077-47707180800d could not be found. Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.280729 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:10.284343 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:10.284343 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:10.284343 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:10.284343 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:10.284343 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28dc8442-8d68-462f-9077-47707180800d could not be found. Jul 25 13:08:10.284343 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.286254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3b7d4bf8-5018-4a43-8a48-01c34bf7037c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Returning 404 to user: Instance 28dc8442-8d68-462f-9077-47707180800d could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:10.287325 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3b7d4bf8-5018-4a43-8a48-01c34bf7037c tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d" status: 404 len: 111 microversion: 2.1 time: 0.058279 Jul 25 13:08:10.291585 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2525/5142] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:10 2022] GET /compute/v2.1/servers/28dc8442-8d68-462f-9077-47707180800d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:08:10.296768 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ad925327-d135-4397-aa35-09792ddf598f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:10.297548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ad925327-d135-4397-aa35-09792ddf598f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 310aaeaf-1647-441a-9cac-ab0b8b66a750] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:10.316521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad925327-d135-4397-aa35-09792ddf598f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:10.317780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad925327-d135-4397-aa35-09792ddf598f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:10.319577 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad925327-d135-4397-aa35-09792ddf598f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:10.320352 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad925327-d135-4397-aa35-09792ddf598f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:10.344538 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-ad925327-d135-4397-aa35-09792ddf598f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] HTTP exception thrown: Instance 310aaeaf-1647-441a-9cac-ab0b8b66a750 could not be found. Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ad925327-d135-4397-aa35-09792ddf598f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Request method failure captured: Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750 HTTP/1.1 Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pTdZnYy3zWCXLN8GI-lAb9Aac2xutmWdntWmHOJQQOAHuSaLRru4vmbdxH-2ipAsIwdgHGRBCQV52EgrlBqV5LzQtSAIs0OqruuNBUIA1ZYGpGU7ybcvN2tekv0vVPxk7wJZaAmUwppQmT0JDG4pBCSl5Rw9dXMoK1Y6yvluyRvyio Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebb6a07295234370aa1aa5067b8ee930", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}] Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersTestJSON-733750618 Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersTestJSON-733750618-project Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 60d84eb7c45449cbad3141d9f363e693 Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersTestJSON-733750618-project Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 310aaeaf-1647-441a-9cac-ab0b8b66a750 could not be found. Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '310aaeaf-1647-441a-9cac-ab0b8b66a750'} Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 310aaeaf-1647-441a-9cac-ab0b8b66a750 could not be found. Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:08:10.346395 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 310aaeaf-1647-441a-9cac-ab0b8b66a750 could not be found. Jul 25 13:08:10.349908 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.349908 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:10.349908 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.349908 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:10.349908 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:10.349908 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:10.349908 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:10.349908 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:10.349908 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 310aaeaf-1647-441a-9cac-ab0b8b66a750 could not be found. Jul 25 13:08:10.349908 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.352731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ad925327-d135-4397-aa35-09792ddf598f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Returning 404 to user: Instance 310aaeaf-1647-441a-9cac-ab0b8b66a750 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:10.354161 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ad925327-d135-4397-aa35-09792ddf598f tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "DELETE /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750" status: 404 len: 111 microversion: 2.1 time: 0.061167 Jul 25 13:08:10.355003 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2526/5143] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:08:10 2022] DELETE /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:08:10.366831 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c686eb7f-90de-44b6-bc0b-53d016dccecd tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:10.367737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c686eb7f-90de-44b6-bc0b-53d016dccecd tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 310aaeaf-1647-441a-9cac-ab0b8b66a750] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:10.375714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c686eb7f-90de-44b6-bc0b-53d016dccecd tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:10.377149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c686eb7f-90de-44b6-bc0b-53d016dccecd tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:10.378300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c686eb7f-90de-44b6-bc0b-53d016dccecd tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:10.378888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c686eb7f-90de-44b6-bc0b-53d016dccecd tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:10.394437 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-c686eb7f-90de-44b6-bc0b-53d016dccecd tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] HTTP exception thrown: Instance 310aaeaf-1647-441a-9cac-ab0b8b66a750 could not be found. Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c686eb7f-90de-44b6-bc0b-53d016dccecd tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Request method failure captured: Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750 HTTP/1.1 Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pTdZnYy3zWCXLN8GI-lAb9Aac2xutmWdntWmHOJQQOAHuSaLRru4vmbdxH-2ipAsIwdgHGRBCQV52EgrlBqV5LzQtSAIs0OqruuNBUIA1ZYGpGU7ybcvN2tekv0vVPxk7wJZaAmUwppQmT0JDG4pBCSl5Rw9dXMoK1Y6yvluyRvyio Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebb6a07295234370aa1aa5067b8ee930", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}] Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersTestJSON-733750618 Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersTestJSON-733750618-project Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 60d84eb7c45449cbad3141d9f363e693 Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersTestJSON-733750618-project Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 310aaeaf-1647-441a-9cac-ab0b8b66a750 could not be found. Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '310aaeaf-1647-441a-9cac-ab0b8b66a750'} Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 310aaeaf-1647-441a-9cac-ab0b8b66a750 could not be found. Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 310aaeaf-1647-441a-9cac-ab0b8b66a750 could not be found. Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.396548 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:10.400049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:10.400049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:10.400049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:10.400049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:10.400049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 310aaeaf-1647-441a-9cac-ab0b8b66a750 could not be found. Jul 25 13:08:10.400049 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.401797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c686eb7f-90de-44b6-bc0b-53d016dccecd tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Returning 404 to user: Instance 310aaeaf-1647-441a-9cac-ab0b8b66a750 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:10.402972 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c686eb7f-90de-44b6-bc0b-53d016dccecd tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750" status: 404 len: 111 microversion: 2.1 time: 0.041490 Jul 25 13:08:10.403680 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2527/5144] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:10 2022] GET /compute/v2.1/servers/310aaeaf-1647-441a-9cac-ab0b8b66a750 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:08:10.412080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7eb8955d-c0cf-41a4-b6eb-7ec105a19285 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:10.412646 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7eb8955d-c0cf-41a4-b6eb-7ec105a19285 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: f004578f-490b-4d27-9162-fd7b047373d0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:10.429951 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-7eb8955d-c0cf-41a4-b6eb-7ec105a19285 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] HTTP exception thrown: Instance f004578f-490b-4d27-9162-fd7b047373d0 could not be found. Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7eb8955d-c0cf-41a4-b6eb-7ec105a19285 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Request method failure captured: Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/f004578f-490b-4d27-9162-fd7b047373d0 HTTP/1.1 Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pTdZnYy3zWCXLN8GI-lAb9Aac2xutmWdntWmHOJQQOAHuSaLRru4vmbdxH-2ipAsIwdgHGRBCQV52EgrlBqV5LzQtSAIs0OqruuNBUIA1ZYGpGU7ybcvN2tekv0vVPxk7wJZaAmUwppQmT0JDG4pBCSl5Rw9dXMoK1Y6yvluyRvyio Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebb6a07295234370aa1aa5067b8ee930", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}] Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersTestJSON-733750618 Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersTestJSON-733750618-project Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 60d84eb7c45449cbad3141d9f363e693 Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersTestJSON-733750618-project Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance f004578f-490b-4d27-9162-fd7b047373d0 could not be found. Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'f004578f-490b-4d27-9162-fd7b047373d0'} Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f004578f-490b-4d27-9162-fd7b047373d0 could not be found. Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f004578f-490b-4d27-9162-fd7b047373d0 could not be found. Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:10.431489 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.436383 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:10.436383 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:10.436383 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:10.436383 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:10.436383 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:10.436383 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f004578f-490b-4d27-9162-fd7b047373d0 could not be found. Jul 25 13:08:10.436383 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.436383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7eb8955d-c0cf-41a4-b6eb-7ec105a19285 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Returning 404 to user: Instance f004578f-490b-4d27-9162-fd7b047373d0 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:10.436383 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7eb8955d-c0cf-41a4-b6eb-7ec105a19285 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f004578f-490b-4d27-9162-fd7b047373d0" status: 404 len: 111 microversion: 2.1 time: 0.024808 Jul 25 13:08:10.440276 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2528/5145] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:08:10 2022] DELETE /compute/v2.1/servers/f004578f-490b-4d27-9162-fd7b047373d0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:08:10.448180 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1b15dacb-56a4-4566-af3a-02ddf23825f7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:10.449277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1b15dacb-56a4-4566-af3a-02ddf23825f7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: f004578f-490b-4d27-9162-fd7b047373d0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:10.453929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d9ab51d8-aca9-494c-8ac1-2d5bb0a7dfd4 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:10.460645 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-1b15dacb-56a4-4566-af3a-02ddf23825f7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] HTTP exception thrown: Instance f004578f-490b-4d27-9162-fd7b047373d0 could not be found. Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1b15dacb-56a4-4566-af3a-02ddf23825f7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Request method failure captured: Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/f004578f-490b-4d27-9162-fd7b047373d0 HTTP/1.1 Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pTdZnYy3zWCXLN8GI-lAb9Aac2xutmWdntWmHOJQQOAHuSaLRru4vmbdxH-2ipAsIwdgHGRBCQV52EgrlBqV5LzQtSAIs0OqruuNBUIA1ZYGpGU7ybcvN2tekv0vVPxk7wJZaAmUwppQmT0JDG4pBCSl5Rw9dXMoK1Y6yvluyRvyio Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebb6a07295234370aa1aa5067b8ee930", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}] Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersTestJSON-733750618 Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersTestJSON-733750618-project Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 60d84eb7c45449cbad3141d9f363e693 Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersTestJSON-733750618-project Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance f004578f-490b-4d27-9162-fd7b047373d0 could not be found. Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'f004578f-490b-4d27-9162-fd7b047373d0'} Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f004578f-490b-4d27-9162-fd7b047373d0 could not be found. Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f004578f-490b-4d27-9162-fd7b047373d0 could not be found. Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:10.463734 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:10.471520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:10.471520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:10.471520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f004578f-490b-4d27-9162-fd7b047373d0 could not be found. Jul 25 13:08:10.471520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:08:10.472122 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d9ab51d8-aca9-494c-8ac1-2d5bb0a7dfd4 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1723 microversion: 2.1 time: 0.724185 Jul 25 13:08:10.473656 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1b15dacb-56a4-4566-af3a-02ddf23825f7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Returning 404 to user: Instance f004578f-490b-4d27-9162-fd7b047373d0 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:10.474884 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1b15dacb-56a4-4566-af3a-02ddf23825f7 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/f004578f-490b-4d27-9162-fd7b047373d0" status: 404 len: 111 microversion: 2.1 time: 0.032353 Jul 25 13:08:10.476083 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2529/5146] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:10 2022] GET /compute/v2.1/servers/f004578f-490b-4d27-9162-fd7b047373d0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:08:10.486848 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2618/5147] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:09 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1723 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:10.499063 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ebbce580-3ca9-44a2-8992-65a13a6906df tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:10.504300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ebbce580-3ca9-44a2-8992-65a13a6906df tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 5b9513b8-10cf-4f0c-9676-231d951d717d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:10.507572 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-05fbea5f-cddc-47aa-a089-0879cda04624 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:10.508556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-05fbea5f-cddc-47aa-a089-0879cda04624 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:10.514973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ebbce580-3ca9-44a2-8992-65a13a6906df tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:10.515428 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ebbce580-3ca9-44a2-8992-65a13a6906df tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:10.516344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ebbce580-3ca9-44a2-8992-65a13a6906df tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:10.517944 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ebbce580-3ca9-44a2-8992-65a13a6906df tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:10.521487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05fbea5f-cddc-47aa-a089-0879cda04624 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:10.523909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05fbea5f-cddc-47aa-a089-0879cda04624 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:10.528555 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05fbea5f-cddc-47aa-a089-0879cda04624 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:10.529199 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-05fbea5f-cddc-47aa-a089-0879cda04624 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:10.624820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ebbce580-3ca9-44a2-8992-65a13a6906df tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 5b9513b8-10cf-4f0c-9676-231d951d717d] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:08:10.787424 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ebbce580-3ca9-44a2-8992-65a13a6906df tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d" status: 204 len: 0 microversion: 2.1 time: 0.297285 Jul 25 13:08:10.790824 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2530/5148] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:08:10 2022] DELETE /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:08:10.808211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8080be49-e448-4d2c-95fd-1834cbd056ea tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:10.809176 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8080be49-e448-4d2c-95fd-1834cbd056ea tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 5b9513b8-10cf-4f0c-9676-231d951d717d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:10.825713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8080be49-e448-4d2c-95fd-1834cbd056ea tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:10.826810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8080be49-e448-4d2c-95fd-1834cbd056ea tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:10.828506 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8080be49-e448-4d2c-95fd-1834cbd056ea tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:10.829554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8080be49-e448-4d2c-95fd-1834cbd056ea tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:11.003460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-05fbea5f-cddc-47aa-a089-0879cda04624 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:11.014560 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-05fbea5f-cddc-47aa-a089-0879cda04624 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1202 microversion: 2.1 time: 0.510904 Jul 25 13:08:11.015173 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2619/5149] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:10 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1202 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:11.086459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1fd1b304-96dc-4cb5-9fc3-944f1237519a tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:11.087601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1fd1b304-96dc-4cb5-9fc3-944f1237519a tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] [instance: fa3ea3d7-202d-4464-a4bc-e99d48072c3a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:11.102186 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1fd1b304-96dc-4cb5-9fc3-944f1237519a tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:11.106955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1fd1b304-96dc-4cb5-9fc3-944f1237519a tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:11.108259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1fd1b304-96dc-4cb5-9fc3-944f1237519a tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:11.113963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1fd1b304-96dc-4cb5-9fc3-944f1237519a tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:11.316419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8080be49-e448-4d2c-95fd-1834cbd056ea tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:11.329656 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8080be49-e448-4d2c-95fd-1834cbd056ea tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d" status: 200 len: 1479 microversion: 2.1 time: 0.531021 Jul 25 13:08:11.332122 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2531/5150] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:10 2022] GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d => generated 1479 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:11.497401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cc2b6f2e-16e4-415d-bd63-e432ba407d16 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:11.498387 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cc2b6f2e-16e4-415d-bd63-e432ba407d16 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:11.510300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cc2b6f2e-16e4-415d-bd63-e432ba407d16 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:11.514549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cc2b6f2e-16e4-415d-bd63-e432ba407d16 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:11.515746 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cc2b6f2e-16e4-415d-bd63-e432ba407d16 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:11.518682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cc2b6f2e-16e4-415d-bd63-e432ba407d16 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:11.801675 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:08:11.856400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1fd1b304-96dc-4cb5-9fc3-944f1237519a tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295be0f5bd94c0c853feb09c47f9ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39fba18c6c64ee9bcf7f3335014cdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:11.865145 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1fd1b304-96dc-4cb5-9fc3-944f1237519a tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a" status: 200 len: 1525 microversion: 2.1 time: 0.783912 Jul 25 13:08:11.878848 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2620/5151] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:11 2022] GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a => generated 1525 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:08:11.900831 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-135e6643-288d-4c97-b9f7-2756b8ff224f req-31bf6354-1ef6-4365-ae28-83ac401df0cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa3ea3d7-202d-4464-a4bc-e99d48072c3a", "name": "network-vif-deleted", "tag": "02b43449-72fb-401f-9b43-29d271616827"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:11.935860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-135e6643-288d-4c97-b9f7-2756b8ff224f req-31bf6354-1ef6-4365-ae28-83ac401df0cb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:11.937247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-135e6643-288d-4c97-b9f7-2756b8ff224f req-31bf6354-1ef6-4365-ae28-83ac401df0cb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:11.996460 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-135e6643-288d-4c97-b9f7-2756b8ff224f req-31bf6354-1ef6-4365-ae28-83ac401df0cb service nova] Creating event network-vif-deleted:02b43449-72fb-401f-9b43-29d271616827 for instance fa3ea3d7-202d-4464-a4bc-e99d48072c3a on n-h2-848886-15 Jul 25 13:08:12.029549 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-135e6643-288d-4c97-b9f7-2756b8ff224f req-31bf6354-1ef6-4365-ae28-83ac401df0cb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149308 Jul 25 13:08:12.030210 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2621/5152] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:12.079186 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-39ad2bed-0611-4067-994a-fe7625046855 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:12.080161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-39ad2bed-0611-4067-994a-fe7625046855 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:12.097566 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-39ad2bed-0611-4067-994a-fe7625046855 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:12.098067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-39ad2bed-0611-4067-994a-fe7625046855 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:12.099147 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-39ad2bed-0611-4067-994a-fe7625046855 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:12.099748 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-39ad2bed-0611-4067-994a-fe7625046855 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:12.327421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cc2b6f2e-16e4-415d-bd63-e432ba407d16 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:12.337255 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cc2b6f2e-16e4-415d-bd63-e432ba407d16 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1723 microversion: 2.1 time: 0.845354 Jul 25 13:08:12.344479 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2532/5153] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:11 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1723 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:12.364474 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0d4c0f56-1980-4e8c-8b33-491d9c2b0337 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:12.366147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0d4c0f56-1980-4e8c-8b33-491d9c2b0337 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 5b9513b8-10cf-4f0c-9676-231d951d717d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:12.401496 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d4c0f56-1980-4e8c-8b33-491d9c2b0337 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:12.402566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d4c0f56-1980-4e8c-8b33-491d9c2b0337 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:12.406915 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d4c0f56-1980-4e8c-8b33-491d9c2b0337 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:12.408159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d4c0f56-1980-4e8c-8b33-491d9c2b0337 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:12.501413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-39ad2bed-0611-4067-994a-fe7625046855 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:12.510941 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-39ad2bed-0611-4067-994a-fe7625046855 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1202 microversion: 2.1 time: 0.456029 Jul 25 13:08:12.516135 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2622/5154] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:12 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1202 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:12.899760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-00aaa7d7-cd99-480c-925b-e3d49e2a240d tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:12.900580 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-00aaa7d7-cd99-480c-925b-e3d49e2a240d tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] [instance: fa3ea3d7-202d-4464-a4bc-e99d48072c3a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:12.935756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-00aaa7d7-cd99-480c-925b-e3d49e2a240d tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:12.943114 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-00aaa7d7-cd99-480c-925b-e3d49e2a240d tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:12.949301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-00aaa7d7-cd99-480c-925b-e3d49e2a240d tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:12.951243 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-00aaa7d7-cd99-480c-925b-e3d49e2a240d tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:12.983643 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-00aaa7d7-cd99-480c-925b-e3d49e2a240d tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] HTTP exception thrown: Instance fa3ea3d7-202d-4464-a4bc-e99d48072c3a could not be found. Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-00aaa7d7-cd99-480c-925b-e3d49e2a240d tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Request method failure captured: Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a HTTP/1.1 Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pWe8xiLQNNY7Kv74yLnM28RNIsfq2ROKEDC8kIe3lQqWqcZq9x6naQO5HdZYbOime0GjH7f8LUokghwbRnVi7_uXUl-GwFhXReioDE-lRulVWBuaTEDjghLwz4ZNK1Hi3OEVuMkvis1ZLw-pmNMl95cdbpGAeWU2B3nROjPswqUa-E Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: b39fba18c6c64ee9bcf7f3335014cdd5 Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b39fba18c6c64ee9bcf7f3335014cdd5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b39fba18c6c64ee9bcf7f3335014cdd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b39fba18c6c64ee9bcf7f3335014cdd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b39fba18c6c64ee9bcf7f3335014cdd5"}]}] Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: b39fba18c6c64ee9bcf7f3335014cdd5 Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-822010234 Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerMetadataNegativeTestJSON-822010234-project Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: a295be0f5bd94c0c853feb09c47f9ffa Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-822010234-project Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance fa3ea3d7-202d-4464-a4bc-e99d48072c3a could not be found. Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'fa3ea3d7-202d-4464-a4bc-e99d48072c3a'} Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa3ea3d7-202d-4464-a4bc-e99d48072c3a could not be found. Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa3ea3d7-202d-4464-a4bc-e99d48072c3a could not be found. Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:13.000643 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:13.004233 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:13.004233 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:13.004233 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:13.004233 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:13.004233 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:13.004233 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:13.004233 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa3ea3d7-202d-4464-a4bc-e99d48072c3a could not be found. Jul 25 13:08:13.004233 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:13.006780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-00aaa7d7-cd99-480c-925b-e3d49e2a240d tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] Returning 404 to user: Instance fa3ea3d7-202d-4464-a4bc-e99d48072c3a could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:13.008901 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-00aaa7d7-cd99-480c-925b-e3d49e2a240d tempest-ServerMetadataNegativeTestJSON-822010234 tempest-ServerMetadataNegativeTestJSON-822010234-project] 10.222.0.49 "GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a" status: 404 len: 111 microversion: 2.1 time: 0.115141 Jul 25 13:08:13.012272 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2623/5155] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:12 2022] GET /compute/v2.1/servers/fa3ea3d7-202d-4464-a4bc-e99d48072c3a => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:08:13.022170 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-214ee903-7dd9-4ddd-a1d7-e82c771a96bb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9af69ad6-8d85-4c55-9ed0-752eee78ad81"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:13.026826 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-214ee903-7dd9-4ddd-a1d7-e82c771a96bb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:13.049529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-214ee903-7dd9-4ddd-a1d7-e82c771a96bb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:13.055910 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-214ee903-7dd9-4ddd-a1d7-e82c771a96bb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:13.058091 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-214ee903-7dd9-4ddd-a1d7-e82c771a96bb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:13.062124 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-214ee903-7dd9-4ddd-a1d7-e82c771a96bb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:13.291692 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0d4c0f56-1980-4e8c-8b33-491d9c2b0337 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:13.306819 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0d4c0f56-1980-4e8c-8b33-491d9c2b0337 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d" status: 200 len: 1479 microversion: 2.1 time: 0.950016 Jul 25 13:08:13.318466 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2533/5156] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:12 2022] GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d => generated 1479 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:08:13.367930 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3aacbcfb-df57-4ca3-bec8-1a03ab098594 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:13.372418 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3aacbcfb-df57-4ca3-bec8-1a03ab098594 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:13.388341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3aacbcfb-df57-4ca3-bec8-1a03ab098594 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:13.389407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3aacbcfb-df57-4ca3-bec8-1a03ab098594 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:13.391776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3aacbcfb-df57-4ca3-bec8-1a03ab098594 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:13.392581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3aacbcfb-df57-4ca3-bec8-1a03ab098594 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:13.518191 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:08:13.559870 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-214ee903-7dd9-4ddd-a1d7-e82c771a96bb tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "POST /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.545382 Jul 25 13:08:13.561612 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2624/5157] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Jul 25 13:08:13 2022] POST /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-volume_attachments => generated 194 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:13.600242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d253f033-1ca8-4c73-a36f-af0874ab0f4e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:13.600957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d253f033-1ca8-4c73-a36f-af0874ab0f4e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:13.612346 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d253f033-1ca8-4c73-a36f-af0874ab0f4e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:13.613072 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d253f033-1ca8-4c73-a36f-af0874ab0f4e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:13.614260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d253f033-1ca8-4c73-a36f-af0874ab0f4e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:13.614856 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d253f033-1ca8-4c73-a36f-af0874ab0f4e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:14.041386 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3aacbcfb-df57-4ca3-bec8-1a03ab098594 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:14.058475 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3aacbcfb-df57-4ca3-bec8-1a03ab098594 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1729 microversion: 2.1 time: 0.694531 Jul 25 13:08:14.059217 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2534/5158] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:13 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1729 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:08:14.081403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-848bb134-7f3f-4abb-88e5-16d61382cdde tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:14.082132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-848bb134-7f3f-4abb-88e5-16d61382cdde tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:14.096854 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-848bb134-7f3f-4abb-88e5-16d61382cdde tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:14.097813 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-848bb134-7f3f-4abb-88e5-16d61382cdde tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:14.098846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-848bb134-7f3f-4abb-88e5-16d61382cdde tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:14.099391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-848bb134-7f3f-4abb-88e5-16d61382cdde tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:14.430400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d253f033-1ca8-4c73-a36f-af0874ab0f4e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:14.442215 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d253f033-1ca8-4c73-a36f-af0874ab0f4e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1202 microversion: 2.1 time: 0.878999 Jul 25 13:08:14.445462 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2625/5159] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:13 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1202 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:14.461486 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-848bb134-7f3f-4abb-88e5-16d61382cdde tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.384692 Jul 25 13:08:14.462010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ac50cf70-7815-4034-bab3-ea833c7710a3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:14.462205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ac50cf70-7815-4034-bab3-ea833c7710a3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 5b9513b8-10cf-4f0c-9676-231d951d717d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:14.463513 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2535/5160] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 13:08:14 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-interface => generated 284 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:14.477209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac50cf70-7815-4034-bab3-ea833c7710a3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:14.477961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac50cf70-7815-4034-bab3-ea833c7710a3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:14.478753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac50cf70-7815-4034-bab3-ea833c7710a3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:14.479191 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac50cf70-7815-4034-bab3-ea833c7710a3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:14.795295 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ac50cf70-7815-4034-bab3-ea833c7710a3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d84eb7c45449cbad3141d9f363e693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb6a07295234370aa1aa5067b8ee930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:14.807434 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ac50cf70-7815-4034-bab3-ea833c7710a3 tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d" status: 200 len: 1437 microversion: 2.1 time: 0.359586 Jul 25 13:08:14.808928 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2626/5161] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:14 2022] GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d => generated 1437 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:15.262559 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-b7c261d5-4ea8-4842-b7c2-806c92630524 req-555b69c9-df94-44ee-a528-7ab6a5fc120a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b9513b8-10cf-4f0c-9676-231d951d717d", "name": "network-vif-deleted", "tag": "c0e54450-2df6-43de-bfa7-1fa00aa426e4"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:15.274199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b7c261d5-4ea8-4842-b7c2-806c92630524 req-555b69c9-df94-44ee-a528-7ab6a5fc120a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:15.274917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b7c261d5-4ea8-4842-b7c2-806c92630524 req-555b69c9-df94-44ee-a528-7ab6a5fc120a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:15.290203 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-b7c261d5-4ea8-4842-b7c2-806c92630524 req-555b69c9-df94-44ee-a528-7ab6a5fc120a service nova] Creating event network-vif-deleted:c0e54450-2df6-43de-bfa7-1fa00aa426e4 for instance 5b9513b8-10cf-4f0c-9676-231d951d717d on n-h2-848886-15 Jul 25 13:08:15.296717 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-b7c261d5-4ea8-4842-b7c2-806c92630524 req-555b69c9-df94-44ee-a528-7ab6a5fc120a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039293 Jul 25 13:08:15.298402 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2536/5162] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:15.464203 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ee9dba74-95ae-4638-9a88-4f97ecef1390 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:15.465617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ee9dba74-95ae-4638-9a88-4f97ecef1390 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:15.481059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee9dba74-95ae-4638-9a88-4f97ecef1390 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:15.481516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee9dba74-95ae-4638-9a88-4f97ecef1390 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:15.482350 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee9dba74-95ae-4638-9a88-4f97ecef1390 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:15.483809 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee9dba74-95ae-4638-9a88-4f97ecef1390 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:15.827771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-057d01cf-e206-4871-bf33-bf8ddf52e47c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1466735514", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "109f3265-d403-4fc6-a65d-66e3d834c351"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1758790213", "security_groups": [{"name": "tempest-secgroup-smoke-912505976"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:17.249662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-057d01cf-e206-4871-bf33-bf8ddf52e47c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] validate_networks() for [('109f3265-d403-4fc6-a65d-66e3d834c351', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:08:18.096818 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ee9dba74-95ae-4638-9a88-4f97ecef1390 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:18.114605 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ee9dba74-95ae-4638-9a88-4f97ecef1390 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1202 microversion: 2.1 time: 2.655285 Jul 25 13:08:18.116759 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2627/5163] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:15 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1202 bytes in 2657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:18.143517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5380e77b-9404-405e-ba4e-93eb0d7dbf9e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:18.144137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5380e77b-9404-405e-ba4e-93eb0d7dbf9e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] [instance: 5b9513b8-10cf-4f0c-9676-231d951d717d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:18.175967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5380e77b-9404-405e-ba4e-93eb0d7dbf9e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:18.176438 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5380e77b-9404-405e-ba4e-93eb0d7dbf9e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:18.177239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5380e77b-9404-405e-ba4e-93eb0d7dbf9e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:18.177965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5380e77b-9404-405e-ba4e-93eb0d7dbf9e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:18.235321 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-5380e77b-9404-405e-ba4e-93eb0d7dbf9e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] HTTP exception thrown: Instance 5b9513b8-10cf-4f0c-9676-231d951d717d could not be found. Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5380e77b-9404-405e-ba4e-93eb0d7dbf9e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Request method failure captured: Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d HTTP/1.1 Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pTdZnYy3zWCXLN8GI-lAb9Aac2xutmWdntWmHOJQQOAHuSaLRru4vmbdxH-2ipAsIwdgHGRBCQV52EgrlBqV5LzQtSAIs0OqruuNBUIA1ZYGpGU7ybcvN2tekv0vVPxk7wJZaAmUwppQmT0JDG4pBCSl5Rw9dXMoK1Y6yvluyRvyio Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebb6a07295234370aa1aa5067b8ee930", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebb6a07295234370aa1aa5067b8ee930"}]}] Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersTestJSON-733750618 Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: ebb6a07295234370aa1aa5067b8ee930 Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersTestJSON-733750618 Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersTestJSON-733750618-project Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 60d84eb7c45449cbad3141d9f363e693 Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersTestJSON-733750618-project Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 5b9513b8-10cf-4f0c-9676-231d951d717d could not be found. Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '5b9513b8-10cf-4f0c-9676-231d951d717d'} Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b9513b8-10cf-4f0c-9676-231d951d717d could not be found. Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b9513b8-10cf-4f0c-9676-231d951d717d could not be found. Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:18.248842 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:18.253140 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:18.253140 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:18.253140 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:18.253140 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:18.253140 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b9513b8-10cf-4f0c-9676-231d951d717d could not be found. Jul 25 13:08:18.253140 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:18.259507 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5380e77b-9404-405e-ba4e-93eb0d7dbf9e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] Returning 404 to user: Instance 5b9513b8-10cf-4f0c-9676-231d951d717d could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:18.268085 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5380e77b-9404-405e-ba4e-93eb0d7dbf9e tempest-ServersTestJSON-733750618 tempest-ServersTestJSON-733750618-project] 10.222.0.49 "GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d" status: 404 len: 111 microversion: 2.1 time: 0.121797 Jul 25 13:08:18.271801 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2628/5164] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:18 2022] GET /compute/v2.1/servers/5b9513b8-10cf-4f0c-9676-231d951d717d => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:08:19.136002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1134a431-9bf6-48bc-8764-98e7617822d4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:19.138139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1134a431-9bf6-48bc-8764-98e7617822d4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:19.152718 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1134a431-9bf6-48bc-8764-98e7617822d4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:19.153431 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1134a431-9bf6-48bc-8764-98e7617822d4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:19.155902 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1134a431-9bf6-48bc-8764-98e7617822d4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:19.158320 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1134a431-9bf6-48bc-8764-98e7617822d4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:20.327632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-057d01cf-e206-4871-bf33-bf8ddf52e47c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:08:20.330150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-057d01cf-e206-4871-bf33-bf8ddf52e47c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:08:20.330692 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-057d01cf-e206-4871-bf33-bf8ddf52e47c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:08:20.336407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-057d01cf-e206-4871-bf33-bf8ddf52e47c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:08:20.337163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-057d01cf-e206-4871-bf33-bf8ddf52e47c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:08:20.373640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-057d01cf-e206-4871-bf33-bf8ddf52e47c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:20.377050 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-057d01cf-e206-4871-bf33-bf8ddf52e47c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:20.380962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-057d01cf-e206-4871-bf33-bf8ddf52e47c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:20.381459 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-057d01cf-e206-4871-bf33-bf8ddf52e47c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:20.492996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-057d01cf-e206-4871-bf33-bf8ddf52e47c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Getting quotas for project c0d891a772834e43bdfcbde778a90498. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:08:20.499823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-057d01cf-e206-4871-bf33-bf8ddf52e47c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Getting quotas for user 4d6e2ae351744e0ab1f153d629e4f0e7 and project c0d891a772834e43bdfcbde778a90498. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:08:20.535834 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-057d01cf-e206-4871-bf33-bf8ddf52e47c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:08:20.538320 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-057d01cf-e206-4871-bf33-bf8ddf52e47c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:08:20.669437 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-057d01cf-e206-4871-bf33-bf8ddf52e47c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 4.848388 Jul 25 13:08:20.678723 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2537/5165] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:08:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 4859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:08:20.712998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-83e15e52-d784-4b0f-83a8-e57886b808e9 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:20.714800 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-83e15e52-d784-4b0f-83a8-e57886b808e9 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:21.458085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-83e15e52-d784-4b0f-83a8-e57886b808e9 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:21.470352 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-83e15e52-d784-4b0f-83a8-e57886b808e9 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1267 microversion: 2.1 time: 0.787503 Jul 25 13:08:21.472462 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2538/5166] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:20 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1267 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:21.477301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1134a431-9bf6-48bc-8764-98e7617822d4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:21.500712 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1134a431-9bf6-48bc-8764-98e7617822d4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1202 microversion: 2.1 time: 2.368073 Jul 25 13:08:21.504246 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2629/5167] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:19 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1202 bytes in 2373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:21.522403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-ae6585db-e7bd-4e58-b098-1730006d534e req-e133cea3-1c81-4d9c-b548-26b61c1154d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3baaf3bb-a036-43d5-b1d0-799f44fb5ef3", "tag": "d22254f0-f882-4f44-966f-f95b96c6c9ff"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:21.541534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ae6585db-e7bd-4e58-b098-1730006d534e req-e133cea3-1c81-4d9c-b548-26b61c1154d4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:21.545044 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ae6585db-e7bd-4e58-b098-1730006d534e req-e133cea3-1c81-4d9c-b548-26b61c1154d4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:21.572770 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-ae6585db-e7bd-4e58-b098-1730006d534e req-e133cea3-1c81-4d9c-b548-26b61c1154d4 service nova] Creating event network-changed:d22254f0-f882-4f44-966f-f95b96c6c9ff for instance 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 on n-h1-848886-15 Jul 25 13:08:21.581499 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-ae6585db-e7bd-4e58-b098-1730006d534e req-e133cea3-1c81-4d9c-b548-26b61c1154d4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092864 Jul 25 13:08:21.583596 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2539/5168] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:22.496561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-013c4c94-e084-4abf-8b1f-e7b3265c0f9c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:22.498355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-013c4c94-e084-4abf-8b1f-e7b3265c0f9c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:22.516627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-013c4c94-e084-4abf-8b1f-e7b3265c0f9c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:22.517103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-013c4c94-e084-4abf-8b1f-e7b3265c0f9c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:22.518338 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-013c4c94-e084-4abf-8b1f-e7b3265c0f9c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:22.519011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-013c4c94-e084-4abf-8b1f-e7b3265c0f9c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:22.530240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f392d500-7eea-46bd-9232-0dbe2fef2cb1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:22.531719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f392d500-7eea-46bd-9232-0dbe2fef2cb1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:22.547975 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f392d500-7eea-46bd-9232-0dbe2fef2cb1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:22.549947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f392d500-7eea-46bd-9232-0dbe2fef2cb1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:22.551054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f392d500-7eea-46bd-9232-0dbe2fef2cb1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:22.556767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f392d500-7eea-46bd-9232-0dbe2fef2cb1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:23.035029 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-013c4c94-e084-4abf-8b1f-e7b3265c0f9c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:23.044294 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-013c4c94-e084-4abf-8b1f-e7b3265c0f9c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1319 microversion: 2.1 time: 0.552081 Jul 25 13:08:23.050057 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2630/5169] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:22 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1319 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:23.060617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-6e6b57d8-b484-4901-876f-32303abca120 req-a69907ae-1192-4fa2-870c-aab9ba9b89a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ea99de-138b-45a9-af3d-33b113423436", "name": "network-vif-plugged", "status": "completed", "tag": "7253b734-6699-4bd0-a4ab-ecee21d6de74"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:23.094791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6e6b57d8-b484-4901-876f-32303abca120 req-a69907ae-1192-4fa2-870c-aab9ba9b89a0 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:23.095268 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6e6b57d8-b484-4901-876f-32303abca120 req-a69907ae-1192-4fa2-870c-aab9ba9b89a0 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:23.133386 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-6e6b57d8-b484-4901-876f-32303abca120 req-a69907ae-1192-4fa2-870c-aab9ba9b89a0 service nova] Creating event network-vif-plugged:7253b734-6699-4bd0-a4ab-ecee21d6de74 for instance 65ea99de-138b-45a9-af3d-33b113423436 on n-h2-848886-15 Jul 25 13:08:23.146265 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-6e6b57d8-b484-4901-876f-32303abca120 req-a69907ae-1192-4fa2-870c-aab9ba9b89a0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092578 Jul 25 13:08:23.153006 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2631/5170] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:23.664585 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f392d500-7eea-46bd-9232-0dbe2fef2cb1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:23.677075 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f392d500-7eea-46bd-9232-0dbe2fef2cb1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1202 microversion: 2.1 time: 1.152025 Jul 25 13:08:23.678564 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2540/5171] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:22 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1202 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:08:23.718512 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-b92dcb6b-8112-442d-94f9-22822580021c req-1dde97a5-6dfe-4712-ab38-402c76021396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3baaf3bb-a036-43d5-b1d0-799f44fb5ef3", "tag": "d22254f0-f882-4f44-966f-f95b96c6c9ff"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:23.747294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b92dcb6b-8112-442d-94f9-22822580021c req-1dde97a5-6dfe-4712-ab38-402c76021396 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:23.747959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b92dcb6b-8112-442d-94f9-22822580021c req-1dde97a5-6dfe-4712-ab38-402c76021396 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:23.791920 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-b92dcb6b-8112-442d-94f9-22822580021c req-1dde97a5-6dfe-4712-ab38-402c76021396 service nova] Creating event network-changed:d22254f0-f882-4f44-966f-f95b96c6c9ff for instance 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 on n-h1-848886-15 Jul 25 13:08:23.808558 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-b92dcb6b-8112-442d-94f9-22822580021c req-1dde97a5-6dfe-4712-ab38-402c76021396 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093742 Jul 25 13:08:23.810827 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2632/5172] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:24.071716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0d3ff469-5f6a-4509-8461-35b3c0a27b77 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:24.072884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0d3ff469-5f6a-4509-8461-35b3c0a27b77 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:24.080733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d3ff469-5f6a-4509-8461-35b3c0a27b77 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:24.081436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d3ff469-5f6a-4509-8461-35b3c0a27b77 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:24.082820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d3ff469-5f6a-4509-8461-35b3c0a27b77 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:24.083553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d3ff469-5f6a-4509-8461-35b3c0a27b77 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:24.202067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0d3ff469-5f6a-4509-8461-35b3c0a27b77 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:24.218404 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0d3ff469-5f6a-4509-8461-35b3c0a27b77 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1325 microversion: 2.1 time: 0.150761 Jul 25 13:08:24.219051 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2541/5173] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:24 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1325 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:24.704248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7c308a05-9610-4a64-8684-80013795abf8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:24.704968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7c308a05-9610-4a64-8684-80013795abf8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:24.719956 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c308a05-9610-4a64-8684-80013795abf8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:24.721982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c308a05-9610-4a64-8684-80013795abf8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:24.726682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c308a05-9610-4a64-8684-80013795abf8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:24.727378 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7c308a05-9610-4a64-8684-80013795abf8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:25.241259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-211e16fd-45e7-41bd-9706-61a113a3d220 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:25.242704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-211e16fd-45e7-41bd-9706-61a113a3d220 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:25.250786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-211e16fd-45e7-41bd-9706-61a113a3d220 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:25.251669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-211e16fd-45e7-41bd-9706-61a113a3d220 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:25.252697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-211e16fd-45e7-41bd-9706-61a113a3d220 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:25.253361 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-211e16fd-45e7-41bd-9706-61a113a3d220 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:26.034441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7c308a05-9610-4a64-8684-80013795abf8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:26.052839 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7c308a05-9610-4a64-8684-80013795abf8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1202 microversion: 2.1 time: 1.356527 Jul 25 13:08:26.053474 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2633/5174] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:24 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1202 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:26.472412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-211e16fd-45e7-41bd-9706-61a113a3d220 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:26.483924 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-211e16fd-45e7-41bd-9706-61a113a3d220 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1392 microversion: 2.1 time: 1.246616 Jul 25 13:08:26.491806 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2542/5175] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:25 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1392 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:08:26.894439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-9683f247-01ff-4ca5-863a-87b96ddefcc6 req-a2b9638a-0a5a-4ab6-820b-eb93c7e64416 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "202c4ace-9409-4007-943f-c38a0d108f46", "tag": "384564b3-efda-41af-b265-0d12d529d0e0"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:26.924875 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9683f247-01ff-4ca5-863a-87b96ddefcc6 req-a2b9638a-0a5a-4ab6-820b-eb93c7e64416 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:26.925563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9683f247-01ff-4ca5-863a-87b96ddefcc6 req-a2b9638a-0a5a-4ab6-820b-eb93c7e64416 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:26.939691 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-9683f247-01ff-4ca5-863a-87b96ddefcc6 req-a2b9638a-0a5a-4ab6-820b-eb93c7e64416 service nova] Creating event network-changed:384564b3-efda-41af-b265-0d12d529d0e0 for instance 202c4ace-9409-4007-943f-c38a0d108f46 on n-h1-848886-15 Jul 25 13:08:26.947949 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-9683f247-01ff-4ca5-863a-87b96ddefcc6 req-a2b9638a-0a5a-4ab6-820b-eb93c7e64416 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057495 Jul 25 13:08:26.959585 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2634/5176] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:27.074638 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-58785b56-c321-461e-bc47-bfd50a876b77 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:27.075451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-58785b56-c321-461e-bc47-bfd50a876b77 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:27.087933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-58785b56-c321-461e-bc47-bfd50a876b77 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:27.088404 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-58785b56-c321-461e-bc47-bfd50a876b77 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:27.089293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-58785b56-c321-461e-bc47-bfd50a876b77 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:27.089741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-58785b56-c321-461e-bc47-bfd50a876b77 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:27.430539 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-58785b56-c321-461e-bc47-bfd50a876b77 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:27.441337 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-58785b56-c321-461e-bc47-bfd50a876b77 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1389 microversion: 2.1 time: 0.371186 Jul 25 13:08:27.443203 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2543/5177] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:27 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1389 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:27.463766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-eb8eab01-8c6e-43cd-ad3d-cfb0e91d4a62 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:27.464636 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eb8eab01-8c6e-43cd-ad3d-cfb0e91d4a62 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:27.475286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb8eab01-8c6e-43cd-ad3d-cfb0e91d4a62 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:27.481359 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb8eab01-8c6e-43cd-ad3d-cfb0e91d4a62 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:27.482559 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb8eab01-8c6e-43cd-ad3d-cfb0e91d4a62 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:27.483006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb8eab01-8c6e-43cd-ad3d-cfb0e91d4a62 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:27.504783 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-86941f7d-f5f0-4c36-bb68-c046a8507058 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:27.505606 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-86941f7d-f5f0-4c36-bb68-c046a8507058 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:27.517482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86941f7d-f5f0-4c36-bb68-c046a8507058 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:27.518349 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86941f7d-f5f0-4c36-bb68-c046a8507058 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:27.519484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86941f7d-f5f0-4c36-bb68-c046a8507058 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:27.520130 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86941f7d-f5f0-4c36-bb68-c046a8507058 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:27.979941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-eb8eab01-8c6e-43cd-ad3d-cfb0e91d4a62 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:27.991648 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-eb8eab01-8c6e-43cd-ad3d-cfb0e91d4a62 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1389 microversion: 2.1 time: 0.532003 Jul 25 13:08:27.992688 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2635/5178] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:27 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1389 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:28.013704 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-734dc21b-7a06-46b0-8597-f34565555c16 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:28.014571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-734dc21b-7a06-46b0-8597-f34565555c16 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:28.021259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-734dc21b-7a06-46b0-8597-f34565555c16 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:28.021880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-734dc21b-7a06-46b0-8597-f34565555c16 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:28.022795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-734dc21b-7a06-46b0-8597-f34565555c16 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:28.023334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-734dc21b-7a06-46b0-8597-f34565555c16 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:28.393861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-86941f7d-f5f0-4c36-bb68-c046a8507058 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:28.414881 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-86941f7d-f5f0-4c36-bb68-c046a8507058 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1392 microversion: 2.1 time: 0.913904 Jul 25 13:08:28.430857 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2544/5179] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:27 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1392 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:28.677238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-734dc21b-7a06-46b0-8597-f34565555c16 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:28.690423 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-734dc21b-7a06-46b0-8597-f34565555c16 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1389 microversion: 2.1 time: 0.681146 Jul 25 13:08:28.708487 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2636/5180] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:28 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1389 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:28.829956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9d91f5bf-71f2-459d-b063-c7340265d397 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:28.831129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9d91f5bf-71f2-459d-b063-c7340265d397 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:28.838974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9d91f5bf-71f2-459d-b063-c7340265d397 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:28.839478 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9d91f5bf-71f2-459d-b063-c7340265d397 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:28.840266 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9d91f5bf-71f2-459d-b063-c7340265d397 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:28.840691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9d91f5bf-71f2-459d-b063-c7340265d397 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:28.860432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:08:28.870026 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9d91f5bf-71f2-459d-b063-c7340265d397 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:08:28.980151 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9d91f5bf-71f2-459d-b063-c7340265d397 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "DELETE /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 204 len: 0 microversion: 2.1 time: 0.156380 Jul 25 13:08:28.981618 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2545/5181] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:08:28 2022] DELETE /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:08:28.998831 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-18c2e262-ff6b-4923-97af-5b2cd88279a2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:28.999529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-18c2e262-ff6b-4923-97af-5b2cd88279a2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:29.007814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-18c2e262-ff6b-4923-97af-5b2cd88279a2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:29.008767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-18c2e262-ff6b-4923-97af-5b2cd88279a2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:29.009937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-18c2e262-ff6b-4923-97af-5b2cd88279a2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:29.010630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-18c2e262-ff6b-4923-97af-5b2cd88279a2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:29.465572 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-521cfd46-7d9f-4858-92af-d06c079b83be tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:29.467091 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-521cfd46-7d9f-4858-92af-d06c079b83be tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:29.481368 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-521cfd46-7d9f-4858-92af-d06c079b83be tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:29.482305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-521cfd46-7d9f-4858-92af-d06c079b83be tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:29.483966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-521cfd46-7d9f-4858-92af-d06c079b83be tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:29.484655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-521cfd46-7d9f-4858-92af-d06c079b83be tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:29.543346 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-18c2e262-ff6b-4923-97af-5b2cd88279a2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:29.577183 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-18c2e262-ff6b-4923-97af-5b2cd88279a2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1395 microversion: 2.1 time: 0.590762 Jul 25 13:08:29.582378 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2637/5182] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:28 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1395 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:29.939649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-521cfd46-7d9f-4858-92af-d06c079b83be tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:29.951885 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-521cfd46-7d9f-4858-92af-d06c079b83be tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1392 microversion: 2.1 time: 0.509723 Jul 25 13:08:29.953019 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2546/5183] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:29 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1392 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:30.370314 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f3f59a99-64dd-42d9-82d8-7bf6bbe65ef1 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:30.375562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f3f59a99-64dd-42d9-82d8-7bf6bbe65ef1 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:30.386728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f3f59a99-64dd-42d9-82d8-7bf6bbe65ef1 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:30.387506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f3f59a99-64dd-42d9-82d8-7bf6bbe65ef1 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:30.389129 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f3f59a99-64dd-42d9-82d8-7bf6bbe65ef1 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:30.389853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f3f59a99-64dd-42d9-82d8-7bf6bbe65ef1 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:30.445822 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f3f59a99-64dd-42d9-82d8-7bf6bbe65ef1 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.082161 Jul 25 13:08:30.446871 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2638/5184] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:08:30 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-volume_attachments => generated 371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:30.607143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d4e95cc2-a0ba-4c26-b2ce-5bfa74d79b70 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:30.608072 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-63fa965c-0df6-40f9-927f-1b6dc4becd95 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:30.608840 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d4e95cc2-a0ba-4c26-b2ce-5bfa74d79b70 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:30.609619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-63fa965c-0df6-40f9-927f-1b6dc4becd95 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:30.618103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:08:30.633502 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-63fa965c-0df6-40f9-927f-1b6dc4becd95 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:30.634220 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-63fa965c-0df6-40f9-927f-1b6dc4becd95 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:30.636649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-63fa965c-0df6-40f9-927f-1b6dc4becd95 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:30.638945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-63fa965c-0df6-40f9-927f-1b6dc4becd95 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:30.641661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4e95cc2-a0ba-4c26-b2ce-5bfa74d79b70 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:30.642643 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4e95cc2-a0ba-4c26-b2ce-5bfa74d79b70 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:30.653993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4e95cc2-a0ba-4c26-b2ce-5bfa74d79b70 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:30.656291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4e95cc2-a0ba-4c26-b2ce-5bfa74d79b70 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:30.749348 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d4e95cc2-a0ba-4c26-b2ce-5bfa74d79b70 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-volume_attachments/5ec0e596-e155-4a91-9564-b7f294711099" status: 200 len: 194 microversion: 2.1 time: 0.156152 Jul 25 13:08:30.756736 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2547/5185] 10.222.0.49 () {58 vars in 1413 bytes} [Mon Jul 25 13:08:30 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-volume_attachments/5ec0e596-e155-4a91-9564-b7f294711099 => generated 194 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:30.766759 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-74a7c6b0-62c4-41b3-a8ba-66d2cfe9e0af tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:30.767557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-74a7c6b0-62c4-41b3-a8ba-66d2cfe9e0af tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:30.775986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74a7c6b0-62c4-41b3-a8ba-66d2cfe9e0af tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:30.776662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74a7c6b0-62c4-41b3-a8ba-66d2cfe9e0af tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:30.777902 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74a7c6b0-62c4-41b3-a8ba-66d2cfe9e0af tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:30.778455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74a7c6b0-62c4-41b3-a8ba-66d2cfe9e0af tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:30.878928 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-74a7c6b0-62c4-41b3-a8ba-66d2cfe9e0af tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lazy-loading 'services' on Instance uuid 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:08:30.973351 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-74a7c6b0-62c4-41b3-a8ba-66d2cfe9e0af tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-volume_attachments/5ec0e596-e155-4a91-9564-b7f294711099" status: 202 len: 0 microversion: 2.1 time: 0.214544 Jul 25 13:08:30.991526 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2548/5186] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Jul 25 13:08:30 2022] DELETE /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-volume_attachments/5ec0e596-e155-4a91-9564-b7f294711099 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:08:31.012615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9971dbd9-cda6-47f9-b7bc-743bedf765e8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:31.014739 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9971dbd9-cda6-47f9-b7bc-743bedf765e8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:31.036280 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9971dbd9-cda6-47f9-b7bc-743bedf765e8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:31.039203 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9971dbd9-cda6-47f9-b7bc-743bedf765e8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:31.041330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9971dbd9-cda6-47f9-b7bc-743bedf765e8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:31.043212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9971dbd9-cda6-47f9-b7bc-743bedf765e8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:31.426620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9971dbd9-cda6-47f9-b7bc-743bedf765e8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:31.447170 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9971dbd9-cda6-47f9-b7bc-743bedf765e8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1392 microversion: 2.1 time: 0.450060 Jul 25 13:08:31.450513 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2549/5187] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:30 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1392 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:31.462795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-7519bd23-766c-4635-80a0-3dc266b1f555 req-76fe237b-4b9d-4706-a2b2-ce2c903263a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ea99de-138b-45a9-af3d-33b113423436", "name": "network-vif-deleted", "tag": "7253b734-6699-4bd0-a4ab-ecee21d6de74"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:31.491953 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=8 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:08:31.504278 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-7519bd23-766c-4635-80a0-3dc266b1f555 req-76fe237b-4b9d-4706-a2b2-ce2c903263a6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:31.505557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-7519bd23-766c-4635-80a0-3dc266b1f555 req-76fe237b-4b9d-4706-a2b2-ce2c903263a6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:31.535941 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-7519bd23-766c-4635-80a0-3dc266b1f555 req-76fe237b-4b9d-4706-a2b2-ce2c903263a6 service nova] Creating event network-vif-deleted:7253b734-6699-4bd0-a4ab-ecee21d6de74 for instance 65ea99de-138b-45a9-af3d-33b113423436 on n-h2-848886-15 Jul 25 13:08:31.545971 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-7519bd23-766c-4635-80a0-3dc266b1f555 req-76fe237b-4b9d-4706-a2b2-ce2c903263a6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093699 Jul 25 13:08:31.548135 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2550/5188] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:31.568792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-63fa965c-0df6-40f9-927f-1b6dc4becd95 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:31.585657 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-63fa965c-0df6-40f9-927f-1b6dc4becd95 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1395 microversion: 2.1 time: 0.985889 Jul 25 13:08:31.606681 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2639/5189] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:30 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1395 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:32.472955 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1fccd2e6-fe57-45d1-b075-19589f3f6106 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:32.472955 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1fccd2e6-fe57-45d1-b075-19589f3f6106 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:32.485153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1fccd2e6-fe57-45d1-b075-19589f3f6106 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:32.485619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1fccd2e6-fe57-45d1-b075-19589f3f6106 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:32.486449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1fccd2e6-fe57-45d1-b075-19589f3f6106 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:32.486895 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1fccd2e6-fe57-45d1-b075-19589f3f6106 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:32.612994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b3aa111c-8ea4-405a-b807-dd50f278d616 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:32.614415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b3aa111c-8ea4-405a-b807-dd50f278d616 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:32.624369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:08:32.647974 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b3aa111c-8ea4-405a-b807-dd50f278d616 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:32.653157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b3aa111c-8ea4-405a-b807-dd50f278d616 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:32.655789 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b3aa111c-8ea4-405a-b807-dd50f278d616 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:32.656264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b3aa111c-8ea4-405a-b807-dd50f278d616 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:32.900175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b3aa111c-8ea4-405a-b807-dd50f278d616 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:32.923522 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b3aa111c-8ea4-405a-b807-dd50f278d616 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1187 microversion: 2.1 time: 0.312078 Jul 25 13:08:32.926015 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2640/5190] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:32 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1187 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:32.964331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1fccd2e6-fe57-45d1-b075-19589f3f6106 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:32.983247 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1fccd2e6-fe57-45d1-b075-19589f3f6106 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1392 microversion: 2.1 time: 0.512564 Jul 25 13:08:32.984234 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2551/5191] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:32 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1392 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:33.945700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-be39079c-904f-4b3b-96e8-0d08c0f40b0a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:33.946359 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-be39079c-904f-4b3b-96e8-0d08c0f40b0a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:33.970016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be39079c-904f-4b3b-96e8-0d08c0f40b0a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:33.971433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be39079c-904f-4b3b-96e8-0d08c0f40b0a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:33.976184 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be39079c-904f-4b3b-96e8-0d08c0f40b0a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:33.979103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be39079c-904f-4b3b-96e8-0d08c0f40b0a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:34.014535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8eb09d94-54e0-4c92-acc3-5f31efde5174 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:34.015159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8eb09d94-54e0-4c92-acc3-5f31efde5174 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:34.034899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:08:34.040000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8eb09d94-54e0-4c92-acc3-5f31efde5174 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:34.040458 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8eb09d94-54e0-4c92-acc3-5f31efde5174 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:34.041266 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8eb09d94-54e0-4c92-acc3-5f31efde5174 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:34.046154 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8eb09d94-54e0-4c92-acc3-5f31efde5174 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:34.290371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-be39079c-904f-4b3b-96e8-0d08c0f40b0a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:34.308377 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-be39079c-904f-4b3b-96e8-0d08c0f40b0a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1187 microversion: 2.1 time: 0.367539 Jul 25 13:08:34.312832 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2641/5192] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:33 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1187 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:34.565620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8eb09d94-54e0-4c92-acc3-5f31efde5174 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:34.578446 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8eb09d94-54e0-4c92-acc3-5f31efde5174 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1392 microversion: 2.1 time: 0.568441 Jul 25 13:08:34.592884 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2552/5193] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:34 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1392 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:34.680584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-b5219e77-1093-4554-b499-d90f87acfef0 req-f1f1e60e-8e0e-49b9-b7c8-bfac0c0fa5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "202c4ace-9409-4007-943f-c38a0d108f46", "name": "network-vif-plugged", "status": "completed", "tag": "384564b3-efda-41af-b265-0d12d529d0e0"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:34.714589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b5219e77-1093-4554-b499-d90f87acfef0 req-f1f1e60e-8e0e-49b9-b7c8-bfac0c0fa5c2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:34.716627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b5219e77-1093-4554-b499-d90f87acfef0 req-f1f1e60e-8e0e-49b9-b7c8-bfac0c0fa5c2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:34.752529 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-b5219e77-1093-4554-b499-d90f87acfef0 req-f1f1e60e-8e0e-49b9-b7c8-bfac0c0fa5c2 service nova] Creating event network-vif-plugged:384564b3-efda-41af-b265-0d12d529d0e0 for instance 202c4ace-9409-4007-943f-c38a0d108f46 on n-h1-848886-15 Jul 25 13:08:34.759596 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-b5219e77-1093-4554-b499-d90f87acfef0 req-f1f1e60e-8e0e-49b9-b7c8-bfac0c0fa5c2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083185 Jul 25 13:08:34.761502 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2642/5194] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:35.334890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-368f29f9-f14f-4a70-abd6-1f1b2c08e4c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:35.335686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-368f29f9-f14f-4a70-abd6-1f1b2c08e4c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:35.348139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-368f29f9-f14f-4a70-abd6-1f1b2c08e4c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:35.356679 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-368f29f9-f14f-4a70-abd6-1f1b2c08e4c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:35.358564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-368f29f9-f14f-4a70-abd6-1f1b2c08e4c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:35.362067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-368f29f9-f14f-4a70-abd6-1f1b2c08e4c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:35.600352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0293ecc9-c584-4971-908b-e01c03632c6c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:35.601697 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0293ecc9-c584-4971-908b-e01c03632c6c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:35.609163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0293ecc9-c584-4971-908b-e01c03632c6c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:35.620571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0293ecc9-c584-4971-908b-e01c03632c6c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:35.621722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0293ecc9-c584-4971-908b-e01c03632c6c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:35.622201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0293ecc9-c584-4971-908b-e01c03632c6c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:35.966154 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-368f29f9-f14f-4a70-abd6-1f1b2c08e4c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:35.975533 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-368f29f9-f14f-4a70-abd6-1f1b2c08e4c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1187 microversion: 2.1 time: 0.645732 Jul 25 13:08:35.977423 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2553/5195] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:35 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1187 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:36.130113 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0293ecc9-c584-4971-908b-e01c03632c6c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:36.148945 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0293ecc9-c584-4971-908b-e01c03632c6c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1392 microversion: 2.1 time: 0.550311 Jul 25 13:08:36.152106 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2643/5196] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:35 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1392 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:36.998100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-18ef20b9-36b1-4c0c-8097-b1efd6ac1cbd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:36.999956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-18ef20b9-36b1-4c0c-8097-b1efd6ac1cbd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:37.008829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18ef20b9-36b1-4c0c-8097-b1efd6ac1cbd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:37.009662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18ef20b9-36b1-4c0c-8097-b1efd6ac1cbd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:37.010693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18ef20b9-36b1-4c0c-8097-b1efd6ac1cbd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:37.011531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18ef20b9-36b1-4c0c-8097-b1efd6ac1cbd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:37.105054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-18ef20b9-36b1-4c0c-8097-b1efd6ac1cbd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:37.117993 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-18ef20b9-36b1-4c0c-8097-b1efd6ac1cbd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1187 microversion: 2.1 time: 0.124253 Jul 25 13:08:37.119233 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2554/5197] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:36 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1187 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:37.172901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-915ce6be-c4cd-4057-8d3b-1f3ee9da515a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:37.173519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-915ce6be-c4cd-4057-8d3b-1f3ee9da515a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:37.184066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-915ce6be-c4cd-4057-8d3b-1f3ee9da515a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:37.193087 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-915ce6be-c4cd-4057-8d3b-1f3ee9da515a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:37.194110 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-915ce6be-c4cd-4057-8d3b-1f3ee9da515a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:37.196489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-915ce6be-c4cd-4057-8d3b-1f3ee9da515a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:37.227951 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:08:37.534035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-915ce6be-c4cd-4057-8d3b-1f3ee9da515a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:37.557155 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-915ce6be-c4cd-4057-8d3b-1f3ee9da515a tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1564 microversion: 2.1 time: 0.388312 Jul 25 13:08:37.561707 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2644/5198] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:37 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1564 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:37.582926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-69f59a2e-594e-4c50-84da-4b83d08b5270 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:37.583548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-69f59a2e-594e-4c50-84da-4b83d08b5270 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:37.592068 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-69f59a2e-594e-4c50-84da-4b83d08b5270 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:37.592530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-69f59a2e-594e-4c50-84da-4b83d08b5270 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:37.593319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-69f59a2e-594e-4c50-84da-4b83d08b5270 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:37.593758 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-69f59a2e-594e-4c50-84da-4b83d08b5270 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:37.963846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-69f59a2e-594e-4c50-84da-4b83d08b5270 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:37.987955 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-69f59a2e-594e-4c50-84da-4b83d08b5270 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1564 microversion: 2.1 time: 0.409781 Jul 25 13:08:37.988567 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2555/5199] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:37 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1564 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:38.146486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4e214af4-0398-4df0-b241-b95532e0f1e1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:38.152029 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4e214af4-0398-4df0-b241-b95532e0f1e1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:38.168928 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e214af4-0398-4df0-b241-b95532e0f1e1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:38.169402 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e214af4-0398-4df0-b241-b95532e0f1e1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:38.170246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e214af4-0398-4df0-b241-b95532e0f1e1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:38.170684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e214af4-0398-4df0-b241-b95532e0f1e1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:38.299329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4e214af4-0398-4df0-b241-b95532e0f1e1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:38.313955 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4e214af4-0398-4df0-b241-b95532e0f1e1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1187 microversion: 2.1 time: 0.177507 Jul 25 13:08:38.314732 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2645/5200] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:38 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1187 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:39.337902 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ffc1e476-68cd-4bf3-883e-6502bb0bd66c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:39.340181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ffc1e476-68cd-4bf3-883e-6502bb0bd66c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:39.368057 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ffc1e476-68cd-4bf3-883e-6502bb0bd66c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:39.370883 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ffc1e476-68cd-4bf3-883e-6502bb0bd66c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:39.375576 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ffc1e476-68cd-4bf3-883e-6502bb0bd66c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:39.376046 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ffc1e476-68cd-4bf3-883e-6502bb0bd66c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:39.580798 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ffc1e476-68cd-4bf3-883e-6502bb0bd66c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:39.605533 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ffc1e476-68cd-4bf3-883e-6502bb0bd66c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 200 len: 1187 microversion: 2.1 time: 0.270887 Jul 25 13:08:39.622563 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2556/5201] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:39 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 1187 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:40.631007 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f70fedd9-f5d2-4a67-b28d-27983ca8c62a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:40.632865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f70fedd9-f5d2-4a67-b28d-27983ca8c62a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:40.643521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f70fedd9-f5d2-4a67-b28d-27983ca8c62a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:40.644226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f70fedd9-f5d2-4a67-b28d-27983ca8c62a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:40.645388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f70fedd9-f5d2-4a67-b28d-27983ca8c62a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:40.646101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f70fedd9-f5d2-4a67-b28d-27983ca8c62a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:40.667380 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-f70fedd9-f5d2-4a67-b28d-27983ca8c62a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] HTTP exception thrown: Instance 65ea99de-138b-45a9-af3d-33b113423436 could not be found. Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f70fedd9-f5d2-4a67-b28d-27983ca8c62a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Request method failure captured: Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 HTTP/1.1 Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pUsgUlyXXDFjpaxtInCA3ErKU2P2TTpSljieML2SSsbmedwjUWvmtCPv6cpRR2_rKwVTBeB1pN0R0PaQlKkP3JB2H_nZ9mFVhTCd_Xl4_Gcw-PsIj4Ff-CbWbJlbzuA6BFxmfwmUVgHks2P6PoEesxOn8j894_Z-5Z842qklFD2ecs Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b2fbd681752c41d0a24a9cf34ebc8389", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}] Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 9face2aaa9df430cb5d361c6e1fdf242 Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 65ea99de-138b-45a9-af3d-33b113423436 could not be found. Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '65ea99de-138b-45a9-af3d-33b113423436'} Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65ea99de-138b-45a9-af3d-33b113423436 could not be found. Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65ea99de-138b-45a9-af3d-33b113423436 could not be found. Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:40.670424 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:40.676123 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:40.676123 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:40.676123 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:40.676123 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:40.676123 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:40.676123 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65ea99de-138b-45a9-af3d-33b113423436 could not be found. Jul 25 13:08:40.676123 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:40.678573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f70fedd9-f5d2-4a67-b28d-27983ca8c62a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Returning 404 to user: Instance 65ea99de-138b-45a9-af3d-33b113423436 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:40.679694 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f70fedd9-f5d2-4a67-b28d-27983ca8c62a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 404 len: 111 microversion: 2.1 time: 0.053352 Jul 25 13:08:40.681613 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2646/5202] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:40 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:08:42.521455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-d5ff4511-dec2-41b5-bcd4-50809f315f05 req-7117f535-5d58-48a0-bf59-06b00d0e79a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "202c4ace-9409-4007-943f-c38a0d108f46", "tag": "384564b3-efda-41af-b265-0d12d529d0e0"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:42.548435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6f340ad5-9407-4fa1-9125-3faa46e5f43e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:42.549928 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6f340ad5-9407-4fa1-9125-3faa46e5f43e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:42.553690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d5ff4511-dec2-41b5-bcd4-50809f315f05 req-7117f535-5d58-48a0-bf59-06b00d0e79a0 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:42.560392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d5ff4511-dec2-41b5-bcd4-50809f315f05 req-7117f535-5d58-48a0-bf59-06b00d0e79a0 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:42.587325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f340ad5-9407-4fa1-9125-3faa46e5f43e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:42.593719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f340ad5-9407-4fa1-9125-3faa46e5f43e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:42.594720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f340ad5-9407-4fa1-9125-3faa46e5f43e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:42.595173 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f340ad5-9407-4fa1-9125-3faa46e5f43e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:42.601502 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-d5ff4511-dec2-41b5-bcd4-50809f315f05 req-7117f535-5d58-48a0-bf59-06b00d0e79a0 service nova] Creating event network-changed:384564b3-efda-41af-b265-0d12d529d0e0 for instance 202c4ace-9409-4007-943f-c38a0d108f46 on n-h1-848886-15 Jul 25 13:08:42.618293 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-d5ff4511-dec2-41b5-bcd4-50809f315f05 req-7117f535-5d58-48a0-bf59-06b00d0e79a0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100934 Jul 25 13:08:42.618920 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2647/5203] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:42.994778 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6f340ad5-9407-4fa1-9125-3faa46e5f43e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:43.010037 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6f340ad5-9407-4fa1-9125-3faa46e5f43e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1564 microversion: 2.1 time: 0.499261 Jul 25 13:08:43.023486 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2557/5204] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:42 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1564 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:44.416694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b1dde6a0-526b-4c36-a5b2-0f290fc2c890 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:44.417294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b1dde6a0-526b-4c36-a5b2-0f290fc2c890 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:44.433333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b1dde6a0-526b-4c36-a5b2-0f290fc2c890 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:44.435875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b1dde6a0-526b-4c36-a5b2-0f290fc2c890 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:44.441461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b1dde6a0-526b-4c36-a5b2-0f290fc2c890 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:44.442187 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b1dde6a0-526b-4c36-a5b2-0f290fc2c890 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:44.616813 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-b1dde6a0-526b-4c36-a5b2-0f290fc2c890 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lazy-loading 'services' on Instance uuid 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:08:44.633007 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ba695fea-b820-4011-8a53-c386d242f2c4 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1479097446", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:44.765897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-ba695fea-b820-4011-8a53-c386d242f2c4 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] validate_networks() for [('c98553ca-6019-4e4a-8de4-f4a4edf93d80', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:08:44.773564 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b1dde6a0-526b-4c36-a5b2-0f290fc2c890 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments/f9d00a7d-21d5-4501-ad07-293369dd6f01" status: 202 len: 0 microversion: 2.1 time: 0.362026 Jul 25 13:08:44.775991 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2558/5205] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Jul 25 13:08:44 2022] DELETE /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments/f9d00a7d-21d5-4501-ad07-293369dd6f01 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:08:44.785261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-78ba1e1f-c7a1-486b-a292-3bac9df8e7e4 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:44.796405 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-78ba1e1f-c7a1-486b-a292-3bac9df8e7e4 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:44.816647 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78ba1e1f-c7a1-486b-a292-3bac9df8e7e4 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:44.817522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78ba1e1f-c7a1-486b-a292-3bac9df8e7e4 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:44.819960 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78ba1e1f-c7a1-486b-a292-3bac9df8e7e4 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:44.820702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78ba1e1f-c7a1-486b-a292-3bac9df8e7e4 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:44.867552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:08:44.873218 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-78ba1e1f-c7a1-486b-a292-3bac9df8e7e4 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092694 Jul 25 13:08:44.876188 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2559/5206] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:08:44 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:45.708983 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ba695fea-b820-4011-8a53-c386d242f2c4 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:08:45.709516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ba695fea-b820-4011-8a53-c386d242f2c4 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:08:45.711940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ba695fea-b820-4011-8a53-c386d242f2c4 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:08:45.712460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ba695fea-b820-4011-8a53-c386d242f2c4 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:08:45.712881 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ba695fea-b820-4011-8a53-c386d242f2c4 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:08:45.732181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba695fea-b820-4011-8a53-c386d242f2c4 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:45.732790 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba695fea-b820-4011-8a53-c386d242f2c4 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:45.741032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba695fea-b820-4011-8a53-c386d242f2c4 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:45.742036 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ba695fea-b820-4011-8a53-c386d242f2c4 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:45.795709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-ba695fea-b820-4011-8a53-c386d242f2c4 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Getting quotas for project f152f46129a64fa48cfad35d5fd1073c. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:08:45.808957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-ba695fea-b820-4011-8a53-c386d242f2c4 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Getting quotas for user 9eadd925edad4cc088203acf4c73239b and project f152f46129a64fa48cfad35d5fd1073c. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:08:45.846898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ba695fea-b820-4011-8a53-c386d242f2c4 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:08:45.852061 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ba695fea-b820-4011-8a53-c386d242f2c4 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:08:45.893737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-70004394-aa6e-43a0-8e7b-0277f6aaccb3 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:45.898450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-70004394-aa6e-43a0-8e7b-0277f6aaccb3 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:45.925797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-70004394-aa6e-43a0-8e7b-0277f6aaccb3 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:45.929863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-70004394-aa6e-43a0-8e7b-0277f6aaccb3 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:45.932661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-70004394-aa6e-43a0-8e7b-0277f6aaccb3 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:45.935984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-70004394-aa6e-43a0-8e7b-0277f6aaccb3 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:46.021865 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ba695fea-b820-4011-8a53-c386d242f2c4 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.028109 Jul 25 13:08:46.027222 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2648/5207] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:08:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 2034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:08:46.057303 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-70004394-aa6e-43a0-8e7b-0277f6aaccb3 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172397 Jul 25 13:08:46.058554 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2560/5208] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:08:45 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:46.059653 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-115fb9bb-ff0c-4875-8de8-7b9a1e5ad6eb tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:46.060482 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-115fb9bb-ff0c-4875-8de8-7b9a1e5ad6eb tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:46.233206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-115fb9bb-ff0c-4875-8de8-7b9a1e5ad6eb tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:46.243730 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-115fb9bb-ff0c-4875-8de8-7b9a1e5ad6eb tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1223 microversion: 2.1 time: 0.198809 Jul 25 13:08:46.246060 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2649/5209] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:46 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1223 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:47.074681 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-597f1e85-3a21-4c16-af4e-02bf45ee7595 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:47.076973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-597f1e85-3a21-4c16-af4e-02bf45ee7595 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:47.109697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-597f1e85-3a21-4c16-af4e-02bf45ee7595 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:47.112569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-597f1e85-3a21-4c16-af4e-02bf45ee7595 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:47.118809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-597f1e85-3a21-4c16-af4e-02bf45ee7595 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:47.121218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-597f1e85-3a21-4c16-af4e-02bf45ee7595 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:47.231228 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-597f1e85-3a21-4c16-af4e-02bf45ee7595 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164900 Jul 25 13:08:47.237399 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2561/5210] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:08:47 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:47.266432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-07ff4f20-5c07-442c-873a-9d2015995108 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:47.267806 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-07ff4f20-5c07-442c-873a-9d2015995108 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:47.284755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07ff4f20-5c07-442c-873a-9d2015995108 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:47.286701 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07ff4f20-5c07-442c-873a-9d2015995108 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:47.287886 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07ff4f20-5c07-442c-873a-9d2015995108 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:47.289614 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07ff4f20-5c07-442c-873a-9d2015995108 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:47.408413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-07ff4f20-5c07-442c-873a-9d2015995108 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:47.416253 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-07ff4f20-5c07-442c-873a-9d2015995108 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1227 microversion: 2.1 time: 0.155475 Jul 25 13:08:47.422860 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2650/5211] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:47 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1227 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:47.948342 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-465d4858-e9eb-4c2c-a102-beef27c646b6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:47.948849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-465d4858-e9eb-4c2c-a102-beef27c646b6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:47.972035 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-465d4858-e9eb-4c2c-a102-beef27c646b6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:47.972431 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-465d4858-e9eb-4c2c-a102-beef27c646b6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:47.973434 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-465d4858-e9eb-4c2c-a102-beef27c646b6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:47.974063 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-465d4858-e9eb-4c2c-a102-beef27c646b6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:48.088543 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-465d4858-e9eb-4c2c-a102-beef27c646b6 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-volume_attachments/9af69ad6-8d85-4c55-9ed0-752eee78ad81" status: 200 len: 194 microversion: 2.1 time: 0.144281 Jul 25 13:08:48.104738 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f175f6f6-79fe-4711-8be5-9cd2eff6a902 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:48.105632 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f175f6f6-79fe-4711-8be5-9cd2eff6a902 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:48.114309 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2562/5212] 10.222.0.49 () {58 vars in 1413 bytes} [Mon Jul 25 13:08:47 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-volume_attachments/9af69ad6-8d85-4c55-9ed0-752eee78ad81 => generated 194 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:48.120731 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f175f6f6-79fe-4711-8be5-9cd2eff6a902 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:48.121541 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f175f6f6-79fe-4711-8be5-9cd2eff6a902 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:48.122585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f175f6f6-79fe-4711-8be5-9cd2eff6a902 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:48.123178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f175f6f6-79fe-4711-8be5-9cd2eff6a902 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:48.252898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-89ac21bd-4a2a-4e4e-9592-c5f12dc1ddb2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:48.260425 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-89ac21bd-4a2a-4e4e-9592-c5f12dc1ddb2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:48.287338 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89ac21bd-4a2a-4e4e-9592-c5f12dc1ddb2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:48.287958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89ac21bd-4a2a-4e4e-9592-c5f12dc1ddb2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:48.290033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89ac21bd-4a2a-4e4e-9592-c5f12dc1ddb2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:48.294166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89ac21bd-4a2a-4e4e-9592-c5f12dc1ddb2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:48.398090 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-89ac21bd-4a2a-4e4e-9592-c5f12dc1ddb2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157512 Jul 25 13:08:48.398820 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2563/5213] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:08:48 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:48.441665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9ddd0c2f-1c46-42c9-a027-1d49baf06a5f tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:48.448849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9ddd0c2f-1c46-42c9-a027-1d49baf06a5f tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:48.471262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-f175f6f6-79fe-4711-8be5-9cd2eff6a902 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lazy-loading 'services' on Instance uuid 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:08:48.495160 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ddd0c2f-1c46-42c9-a027-1d49baf06a5f tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:48.501089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ddd0c2f-1c46-42c9-a027-1d49baf06a5f tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:48.502587 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ddd0c2f-1c46-42c9-a027-1d49baf06a5f tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:48.504672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ddd0c2f-1c46-42c9-a027-1d49baf06a5f tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:48.687736 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f175f6f6-79fe-4711-8be5-9cd2eff6a902 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-volume_attachments/9af69ad6-8d85-4c55-9ed0-752eee78ad81" status: 202 len: 0 microversion: 2.1 time: 0.590809 Jul 25 13:08:48.717400 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2651/5214] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Jul 25 13:08:48 2022] DELETE /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-volume_attachments/9af69ad6-8d85-4c55-9ed0-752eee78ad81 => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 13:08:48.812162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9ddd0c2f-1c46-42c9-a027-1d49baf06a5f tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:48.827121 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9ddd0c2f-1c46-42c9-a027-1d49baf06a5f tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1281 microversion: 2.1 time: 0.393678 Jul 25 13:08:48.832863 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2564/5215] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:48 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1281 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:49.416327 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d79d1e54-89aa-4d22-a0e0-5fafaa9aaed2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:49.423337 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d79d1e54-89aa-4d22-a0e0-5fafaa9aaed2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:49.457745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d79d1e54-89aa-4d22-a0e0-5fafaa9aaed2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:49.463146 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d79d1e54-89aa-4d22-a0e0-5fafaa9aaed2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:49.465654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d79d1e54-89aa-4d22-a0e0-5fafaa9aaed2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:49.467562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d79d1e54-89aa-4d22-a0e0-5fafaa9aaed2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:49.623628 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d79d1e54-89aa-4d22-a0e0-5fafaa9aaed2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.214935 Jul 25 13:08:49.629775 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2652/5216] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:08:49 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:08:49.855093 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f7a85b66-a63b-4c55-bd1d-45ccab73dd2d tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:49.855766 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f7a85b66-a63b-4c55-bd1d-45ccab73dd2d tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:49.867215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7a85b66-a63b-4c55-bd1d-45ccab73dd2d tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:49.867922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7a85b66-a63b-4c55-bd1d-45ccab73dd2d tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:49.870506 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7a85b66-a63b-4c55-bd1d-45ccab73dd2d tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:49.874129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7a85b66-a63b-4c55-bd1d-45ccab73dd2d tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:50.179765 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f7a85b66-a63b-4c55-bd1d-45ccab73dd2d tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:50.193517 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f7a85b66-a63b-4c55-bd1d-45ccab73dd2d tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1323 microversion: 2.1 time: 0.342600 Jul 25 13:08:50.196925 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2565/5217] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:49 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1323 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:50.641633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0b188cf3-6a72-4f88-8c95-02f1a7f2d2ee tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:50.643903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0b188cf3-6a72-4f88-8c95-02f1a7f2d2ee tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:50.651063 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b188cf3-6a72-4f88-8c95-02f1a7f2d2ee tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:50.651882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b188cf3-6a72-4f88-8c95-02f1a7f2d2ee tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:50.652918 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b188cf3-6a72-4f88-8c95-02f1a7f2d2ee tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:50.653558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b188cf3-6a72-4f88-8c95-02f1a7f2d2ee tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:50.686514 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0b188cf3-6a72-4f88-8c95-02f1a7f2d2ee tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048648 Jul 25 13:08:50.687442 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2653/5218] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:08:50 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:51.219549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0f93847c-85f8-4943-be74-0c2eb20603c9 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:51.221057 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0f93847c-85f8-4943-be74-0c2eb20603c9 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:51.234803 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f93847c-85f8-4943-be74-0c2eb20603c9 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:51.235650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f93847c-85f8-4943-be74-0c2eb20603c9 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:51.236755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f93847c-85f8-4943-be74-0c2eb20603c9 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:51.237608 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f93847c-85f8-4943-be74-0c2eb20603c9 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:51.637748 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0f93847c-85f8-4943-be74-0c2eb20603c9 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:51.646698 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0f93847c-85f8-4943-be74-0c2eb20603c9 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1323 microversion: 2.1 time: 0.431658 Jul 25 13:08:51.650656 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2566/5219] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:51 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1323 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:51.703131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-218b6bf3-20da-4b12-8407-f6e9e9ace4f1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:51.705490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-218b6bf3-20da-4b12-8407-f6e9e9ace4f1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:51.714340 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-218b6bf3-20da-4b12-8407-f6e9e9ace4f1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:51.714838 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-218b6bf3-20da-4b12-8407-f6e9e9ace4f1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:51.715903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-218b6bf3-20da-4b12-8407-f6e9e9ace4f1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:51.716355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-218b6bf3-20da-4b12-8407-f6e9e9ace4f1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:51.772791 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-218b6bf3-20da-4b12-8407-f6e9e9ace4f1 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074761 Jul 25 13:08:51.774118 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2654/5220] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:08:51 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:51.864452 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-28ac9a40-dbd6-4d54-83b3-405abb758a52 req-fc6c0deb-c14f-4db1-ac80-36f2dc1a3d19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b2f025-146e-4ca4-bb43-be3cd6dae006", "tag": "9d3b39d1-8690-4827-8fe3-5f59fcd60174"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:51.910793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-28ac9a40-dbd6-4d54-83b3-405abb758a52 req-fc6c0deb-c14f-4db1-ac80-36f2dc1a3d19 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:51.912731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-28ac9a40-dbd6-4d54-83b3-405abb758a52 req-fc6c0deb-c14f-4db1-ac80-36f2dc1a3d19 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:51.939610 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-28ac9a40-dbd6-4d54-83b3-405abb758a52 req-fc6c0deb-c14f-4db1-ac80-36f2dc1a3d19 service nova] Creating event network-changed:9d3b39d1-8690-4827-8fe3-5f59fcd60174 for instance 58b2f025-146e-4ca4-bb43-be3cd6dae006 on n-h2-848886-15 Jul 25 13:08:51.947554 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-28ac9a40-dbd6-4d54-83b3-405abb758a52 req-fc6c0deb-c14f-4db1-ac80-36f2dc1a3d19 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088047 Jul 25 13:08:51.948516 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2567/5221] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:52.672111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-02628181-cc4f-4103-bf58-36b1406d9742 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:52.674919 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-02628181-cc4f-4103-bf58-36b1406d9742 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:52.682596 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02628181-cc4f-4103-bf58-36b1406d9742 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:52.683455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02628181-cc4f-4103-bf58-36b1406d9742 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:52.684486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02628181-cc4f-4103-bf58-36b1406d9742 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:52.685118 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02628181-cc4f-4103-bf58-36b1406d9742 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:53.069026 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-baab93f3-2457-4efd-bdf8-2ac98cb8b6db tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:53.071505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-baab93f3-2457-4efd-bdf8-2ac98cb8b6db tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:53.078815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-baab93f3-2457-4efd-bdf8-2ac98cb8b6db tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:53.079276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-baab93f3-2457-4efd-bdf8-2ac98cb8b6db tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:53.080067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-baab93f3-2457-4efd-bdf8-2ac98cb8b6db tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:53.080505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-baab93f3-2457-4efd-bdf8-2ac98cb8b6db tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:53.110342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-02628181-cc4f-4103-bf58-36b1406d9742 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:53.120268 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-baab93f3-2457-4efd-bdf8-2ac98cb8b6db tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.337898 Jul 25 13:08:53.133647 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2568/5222] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:08:52 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments => generated 197 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:08:53.140530 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-02628181-cc4f-4103-bf58-36b1406d9742 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1323 microversion: 2.1 time: 0.471761 Jul 25 13:08:53.143233 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2655/5223] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:52 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1323 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:54.133357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f02d5afd-e37c-4d52-b2e7-c84ec477c903 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:54.137311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f02d5afd-e37c-4d52-b2e7-c84ec477c903 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:54.148535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f02d5afd-e37c-4d52-b2e7-c84ec477c903 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:54.148998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f02d5afd-e37c-4d52-b2e7-c84ec477c903 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:54.149793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f02d5afd-e37c-4d52-b2e7-c84ec477c903 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:54.154432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f02d5afd-e37c-4d52-b2e7-c84ec477c903 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:54.163289 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9a8f41a0-07af-481b-8959-498f0247af54 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:54.164863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9a8f41a0-07af-481b-8959-498f0247af54 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:54.179912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9a8f41a0-07af-481b-8959-498f0247af54 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:54.181161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9a8f41a0-07af-481b-8959-498f0247af54 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:54.182208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9a8f41a0-07af-481b-8959-498f0247af54 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:54.190415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9a8f41a0-07af-481b-8959-498f0247af54 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:54.235215 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f02d5afd-e37c-4d52-b2e7-c84ec477c903 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105590 Jul 25 13:08:54.237984 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2569/5224] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:08:54 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:54.434647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9a8f41a0-07af-481b-8959-498f0247af54 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:54.460916 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9a8f41a0-07af-481b-8959-498f0247af54 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1323 microversion: 2.1 time: 0.301924 Jul 25 13:08:54.478691 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2656/5225] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:54 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1323 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:08:55.249466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2e267f76-bc1a-40c6-bdf5-bb7c0036dc23 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:55.251890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2e267f76-bc1a-40c6-bdf5-bb7c0036dc23 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:55.263267 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e267f76-bc1a-40c6-bdf5-bb7c0036dc23 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:55.263267 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e267f76-bc1a-40c6-bdf5-bb7c0036dc23 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:55.268059 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e267f76-bc1a-40c6-bdf5-bb7c0036dc23 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:55.268502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e267f76-bc1a-40c6-bdf5-bb7c0036dc23 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:55.305773 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2e267f76-bc1a-40c6-bdf5-bb7c0036dc23 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061708 Jul 25 13:08:55.309302 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2570/5226] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:08:55 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 13:08:55.420977 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3901525e-3ccc-4287-aede-39eb046509d2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:55.426789 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3901525e-3ccc-4287-aede-39eb046509d2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:55.442393 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3901525e-3ccc-4287-aede-39eb046509d2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:55.443008 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3901525e-3ccc-4287-aede-39eb046509d2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:55.443995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3901525e-3ccc-4287-aede-39eb046509d2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:55.444688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3901525e-3ccc-4287-aede-39eb046509d2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:55.485560 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-65a35e23-28cb-4f36-b85d-c054c1e95f2a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:55.486388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-65a35e23-28cb-4f36-b85d-c054c1e95f2a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:55.500093 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65a35e23-28cb-4f36-b85d-c054c1e95f2a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:55.502129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65a35e23-28cb-4f36-b85d-c054c1e95f2a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:55.505730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65a35e23-28cb-4f36-b85d-c054c1e95f2a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:55.506218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65a35e23-28cb-4f36-b85d-c054c1e95f2a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:55.541782 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-3901525e-3ccc-4287-aede-39eb046509d2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] HTTP exception thrown: Cannot 'reboot' instance 8931f252-9f17-4c5f-ba34-8de681154571 while it is in vm_state rescued Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3901525e-3ccc-4287-aede-39eb046509d2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Request method failure captured: Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571/action HTTP/1.1 Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 28 Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pS2fizNtGcP0shojWUAR1ukudLDJRoXVlsPYG2HQcSlgo2We_QWqoULmyxY8IuKrW-0MGgmtrhM3h66oISYSRqIRFBaYspnVlW3g8FUdRvhwOpsGmp2Y9wrcYeXMJCu6fdAfgxIzqcJ6TFFh6UfkfCkGP1n9iDHq6IO37482VYIk-U Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: f791ac394f9f4b8d99d2f48f7d04eae9 Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f791ac394f9f4b8d99d2f48f7d04eae9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f791ac394f9f4b8d99d2f48f7d04eae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f791ac394f9f4b8d99d2f48f7d04eae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f791ac394f9f4b8d99d2f48f7d04eae9"}]}] Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: f791ac394f9f4b8d99d2f48f7d04eae9 Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerRescueNegativeTestJSON-1618399313-project Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 72f34c080e4a4024a38660e8af252a29 Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1618399313-project Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: {"reboot": {"type": "HARD"}} Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: exception: Cannot 'reboot' instance 8931f252-9f17-4c5f-ba34-8de681154571 while it is in vm_state rescued Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '8931f252-9f17-4c5f-ba34-8de681154571', 'body': {'reboot': {'type': 'HARD'}}} Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8931f252-9f17-4c5f-ba34-8de681154571 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 13:08:55.543569 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 13:08:55.548918 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 8931f252-9f17-4c5f-ba34-8de681154571 while it is in vm_state rescued Jul 25 13:08:55.548918 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:55.548918 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:55.548918 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:55.548918 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:55.548918 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:55.548918 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:55.548918 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:55.548918 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:55.548918 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 8931f252-9f17-4c5f-ba34-8de681154571 while it is in vm_state rescued Jul 25 13:08:55.548918 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:55.548918 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3901525e-3ccc-4287-aede-39eb046509d2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Returning 409 to user: Cannot 'reboot' instance 8931f252-9f17-4c5f-ba34-8de681154571 while it is in vm_state rescued {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:55.548918 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3901525e-3ccc-4287-aede-39eb046509d2 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "POST /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571/action" status: 409 len: 145 microversion: 2.1 time: 0.129862 Jul 25 13:08:55.554888 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2657/5227] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:08:55 2022] POST /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571/action => generated 145 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 13:08:55.570860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fff6e56a-0c51-405f-b470-065c764e43ef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "97beeed7-7564-4203-abda-feef7e93cd98"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:55.577680 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fff6e56a-0c51-405f-b470-065c764e43ef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:55.603360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fff6e56a-0c51-405f-b470-065c764e43ef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:55.611077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fff6e56a-0c51-405f-b470-065c764e43ef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:55.611925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fff6e56a-0c51-405f-b470-065c764e43ef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:55.612378 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fff6e56a-0c51-405f-b470-065c764e43ef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:55.719193 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-fff6e56a-0c51-405f-b470-065c764e43ef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] HTTP exception thrown: Cannot 'rebuild' instance 8931f252-9f17-4c5f-ba34-8de681154571 while it is in vm_state rescued Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fff6e56a-0c51-405f-b470-065c764e43ef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Request method failure captured: Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571/action HTTP/1.1 Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 65 Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pS2fizNtGcP0shojWUAR1ukudLDJRoXVlsPYG2HQcSlgo2We_QWqoULmyxY8IuKrW-0MGgmtrhM3h66oISYSRqIRFBaYspnVlW3g8FUdRvhwOpsGmp2Y9wrcYeXMJCu6fdAfgxIzqcJ6TFFh6UfkfCkGP1n9iDHq6IO37482VYIk-U Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: f791ac394f9f4b8d99d2f48f7d04eae9 Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f791ac394f9f4b8d99d2f48f7d04eae9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f791ac394f9f4b8d99d2f48f7d04eae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f791ac394f9f4b8d99d2f48f7d04eae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f791ac394f9f4b8d99d2f48f7d04eae9"}]}] Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: f791ac394f9f4b8d99d2f48f7d04eae9 Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerRescueNegativeTestJSON-1618399313-project Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 72f34c080e4a4024a38660e8af252a29 Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1618399313-project Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: {"rebuild": {"imageRef": "97beeed7-7564-4203-abda-feef7e93cd98"}} Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: exception: Cannot 'rebuild' instance 8931f252-9f17-4c5f-ba34-8de681154571 while it is in vm_state rescued Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '8931f252-9f17-4c5f-ba34-8de681154571', 'body': {'rebuild': {'imageRef': '97beeed7-7564-4203-abda-feef7e93cd98'}}} Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8931f252-9f17-4c5f-ba34-8de681154571 in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:08:55.736542 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:08:55.741466 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:08:55.741466 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 25 13:08:55.741466 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 25 13:08:55.741466 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 13:08:55.741466 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 13:08:55.741466 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 13:08:55.741466 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 8931f252-9f17-4c5f-ba34-8de681154571 while it is in vm_state rescued Jul 25 13:08:55.741466 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:55.741466 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:55.741466 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:55.741466 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:55.741466 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:55.741466 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:55.741466 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:55.741466 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:55.741466 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 8931f252-9f17-4c5f-ba34-8de681154571 while it is in vm_state rescued Jul 25 13:08:55.741466 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:55.741466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fff6e56a-0c51-405f-b470-065c764e43ef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Returning 409 to user: Cannot 'rebuild' instance 8931f252-9f17-4c5f-ba34-8de681154571 while it is in vm_state rescued {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:55.741466 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fff6e56a-0c51-405f-b470-065c764e43ef tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "POST /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571/action" status: 409 len: 146 microversion: 2.1 time: 0.180873 Jul 25 13:08:55.741466 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2658/5228] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:08:55 2022] POST /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571/action => generated 146 bytes in 183 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 13:08:55.757446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6a77743b-9dbf-4632-a111-def25688dc22 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:55.757980 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6a77743b-9dbf-4632-a111-def25688dc22 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:55.771440 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:08:55.796779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a77743b-9dbf-4632-a111-def25688dc22 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:55.797243 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a77743b-9dbf-4632-a111-def25688dc22 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:55.805188 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a77743b-9dbf-4632-a111-def25688dc22 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:55.805783 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a77743b-9dbf-4632-a111-def25688dc22 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:55.876145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-65a35e23-28cb-4f36-b85d-c054c1e95f2a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:55.894999 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-65a35e23-28cb-4f36-b85d-c054c1e95f2a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1323 microversion: 2.1 time: 0.410301 Jul 25 13:08:55.904023 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2571/5229] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:55 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1323 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:55.911147 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6a77743b-9dbf-4632-a111-def25688dc22 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:08:56.051843 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6a77743b-9dbf-4632-a111-def25688dc22 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 204 len: 0 microversion: 2.1 time: 0.302565 Jul 25 13:08:56.054155 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2659/5230] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:08:55 2022] DELETE /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:08:56.064570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-37ec7a6e-07d4-4b10-ab39-e5623a43d7d6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:56.065223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-37ec7a6e-07d4-4b10-ab39-e5623a43d7d6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:56.072848 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37ec7a6e-07d4-4b10-ab39-e5623a43d7d6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:56.073484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37ec7a6e-07d4-4b10-ab39-e5623a43d7d6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:56.074663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37ec7a6e-07d4-4b10-ab39-e5623a43d7d6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:56.075316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-37ec7a6e-07d4-4b10-ab39-e5623a43d7d6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:56.353608 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-37ec7a6e-07d4-4b10-ab39-e5623a43d7d6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:56.368588 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-37ec7a6e-07d4-4b10-ab39-e5623a43d7d6 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1689 microversion: 2.1 time: 0.309812 Jul 25 13:08:56.369618 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2572/5231] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:56 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1689 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:56.917644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7dbae9f5-15eb-48cc-8d4b-6f5c759cbed0 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:56.918594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7dbae9f5-15eb-48cc-8d4b-6f5c759cbed0 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:56.920930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=8 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:08:56.939098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7dbae9f5-15eb-48cc-8d4b-6f5c759cbed0 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:56.940383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7dbae9f5-15eb-48cc-8d4b-6f5c759cbed0 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:56.941495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7dbae9f5-15eb-48cc-8d4b-6f5c759cbed0 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:56.942156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7dbae9f5-15eb-48cc-8d4b-6f5c759cbed0 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:57.267950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7dbae9f5-15eb-48cc-8d4b-6f5c759cbed0 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:57.285486 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7dbae9f5-15eb-48cc-8d4b-6f5c759cbed0 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1323 microversion: 2.1 time: 0.372410 Jul 25 13:08:57.287459 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2660/5232] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:56 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1323 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:57.390714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-67825deb-c2c7-4907-842f-0380fe9ae97e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:57.391698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-67825deb-c2c7-4907-842f-0380fe9ae97e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:57.404868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-67825deb-c2c7-4907-842f-0380fe9ae97e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:57.413132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-67825deb-c2c7-4907-842f-0380fe9ae97e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:57.414197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-67825deb-c2c7-4907-842f-0380fe9ae97e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:57.416588 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-67825deb-c2c7-4907-842f-0380fe9ae97e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:57.554689 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-856b6d52-314a-40ca-a36f-4f982c9f911c req-81ee2678-97bc-4017-970b-5db67ac3145e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b2f025-146e-4ca4-bb43-be3cd6dae006", "name": "network-vif-plugged", "status": "completed", "tag": "9d3b39d1-8690-4827-8fe3-5f59fcd60174"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:08:57.575458 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-856b6d52-314a-40ca-a36f-4f982c9f911c req-81ee2678-97bc-4017-970b-5db67ac3145e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:57.576217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-856b6d52-314a-40ca-a36f-4f982c9f911c req-81ee2678-97bc-4017-970b-5db67ac3145e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:57.589360 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-856b6d52-314a-40ca-a36f-4f982c9f911c req-81ee2678-97bc-4017-970b-5db67ac3145e service nova] Creating event network-vif-plugged:9d3b39d1-8690-4827-8fe3-5f59fcd60174 for instance 58b2f025-146e-4ca4-bb43-be3cd6dae006 on n-h2-848886-15 Jul 25 13:08:57.616320 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-856b6d52-314a-40ca-a36f-4f982c9f911c req-81ee2678-97bc-4017-970b-5db67ac3145e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065284 Jul 25 13:08:57.616954 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2661/5233] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:08:57.813375 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-67825deb-c2c7-4907-842f-0380fe9ae97e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:57.822619 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-67825deb-c2c7-4907-842f-0380fe9ae97e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1689 microversion: 2.1 time: 0.435859 Jul 25 13:08:57.823282 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2573/5234] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:57 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1689 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:58.310366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7153ccc4-42c2-434f-9f0b-92fd387553cf tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:58.311974 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7153ccc4-42c2-434f-9f0b-92fd387553cf tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:58.322265 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7153ccc4-42c2-434f-9f0b-92fd387553cf tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:58.323059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7153ccc4-42c2-434f-9f0b-92fd387553cf tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:58.324041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7153ccc4-42c2-434f-9f0b-92fd387553cf tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:58.324786 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7153ccc4-42c2-434f-9f0b-92fd387553cf tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:58.597904 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7153ccc4-42c2-434f-9f0b-92fd387553cf tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:58.613989 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7153ccc4-42c2-434f-9f0b-92fd387553cf tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1323 microversion: 2.1 time: 0.309901 Jul 25 13:08:58.617251 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2662/5235] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:58 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1323 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:58.848559 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2b6485de-17c9-4910-8beb-875a1765e28f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:58.849173 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2b6485de-17c9-4910-8beb-875a1765e28f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:58.866944 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b6485de-17c9-4910-8beb-875a1765e28f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:58.867637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b6485de-17c9-4910-8beb-875a1765e28f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:58.869272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b6485de-17c9-4910-8beb-875a1765e28f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:58.869929 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b6485de-17c9-4910-8beb-875a1765e28f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:59.189348 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b61d20e0-1f81-4183-a2db-c28af6b6b559 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:59.189902 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b61d20e0-1f81-4183-a2db-c28af6b6b559 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:59.202124 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b61d20e0-1f81-4183-a2db-c28af6b6b559 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:59.202605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b61d20e0-1f81-4183-a2db-c28af6b6b559 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:59.236228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b61d20e0-1f81-4183-a2db-c28af6b6b559 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:59.240627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b61d20e0-1f81-4183-a2db-c28af6b6b559 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:59.255498 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:08:59.274260 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-b61d20e0-1f81-4183-a2db-c28af6b6b559 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] HTTP exception thrown: Instance 65ea99de-138b-45a9-af3d-33b113423436 could not be found. Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b61d20e0-1f81-4183-a2db-c28af6b6b559 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Request method failure captured: Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 HTTP/1.1 Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pUsgUlyXXDFjpaxtInCA3ErKU2P2TTpSljieML2SSsbmedwjUWvmtCPv6cpRR2_rKwVTBeB1pN0R0PaQlKkP3JB2H_nZ9mFVhTCd_Xl4_Gcw-PsIj4Ff-CbWbJlbzuA6BFxmfwmUVgHks2P6PoEesxOn8j894_Z-5Z842qklFD2ecs Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b2fbd681752c41d0a24a9cf34ebc8389", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}] Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 9face2aaa9df430cb5d361c6e1fdf242 Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 65ea99de-138b-45a9-af3d-33b113423436 could not be found. Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '65ea99de-138b-45a9-af3d-33b113423436'} Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65ea99de-138b-45a9-af3d-33b113423436 could not be found. Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:08:59.276546 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:08:59.281625 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65ea99de-138b-45a9-af3d-33b113423436 could not be found. Jul 25 13:08:59.281625 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:59.281625 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:59.281625 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:59.281625 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:59.281625 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:59.281625 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:59.281625 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:59.281625 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:59.281625 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65ea99de-138b-45a9-af3d-33b113423436 could not be found. Jul 25 13:08:59.281625 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:59.281625 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b61d20e0-1f81-4183-a2db-c28af6b6b559 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Returning 404 to user: Instance 65ea99de-138b-45a9-af3d-33b113423436 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:59.281625 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b61d20e0-1f81-4183-a2db-c28af6b6b559 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "DELETE /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 404 len: 111 microversion: 2.1 time: 0.093999 Jul 25 13:08:59.281625 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2663/5236] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:08:59 2022] DELETE /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:08:59.289117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cf086be4-dffa-4460-8d66-394e4439d896 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:59.289850 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cf086be4-dffa-4460-8d66-394e4439d896 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 65ea99de-138b-45a9-af3d-33b113423436] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:59.296974 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf086be4-dffa-4460-8d66-394e4439d896 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:59.297705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf086be4-dffa-4460-8d66-394e4439d896 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:59.298827 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf086be4-dffa-4460-8d66-394e4439d896 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:59.299332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cf086be4-dffa-4460-8d66-394e4439d896 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:59.316578 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-cf086be4-dffa-4460-8d66-394e4439d896 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] HTTP exception thrown: Instance 65ea99de-138b-45a9-af3d-33b113423436 could not be found. Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cf086be4-dffa-4460-8d66-394e4439d896 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Request method failure captured: Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 HTTP/1.1 Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pUsgUlyXXDFjpaxtInCA3ErKU2P2TTpSljieML2SSsbmedwjUWvmtCPv6cpRR2_rKwVTBeB1pN0R0PaQlKkP3JB2H_nZ9mFVhTCd_Xl4_Gcw-PsIj4Ff-CbWbJlbzuA6BFxmfwmUVgHks2P6PoEesxOn8j894_Z-5Z842qklFD2ecs Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b2fbd681752c41d0a24a9cf34ebc8389", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}] Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 9face2aaa9df430cb5d361c6e1fdf242 Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 65ea99de-138b-45a9-af3d-33b113423436 could not be found. Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '65ea99de-138b-45a9-af3d-33b113423436'} Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65ea99de-138b-45a9-af3d-33b113423436 could not be found. Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65ea99de-138b-45a9-af3d-33b113423436 could not be found. Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:08:59.321063 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:59.325238 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:08:59.325238 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:08:59.325238 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:08:59.325238 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:08:59.325238 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:08:59.325238 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65ea99de-138b-45a9-af3d-33b113423436 could not be found. Jul 25 13:08:59.325238 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:08:59.329897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cf086be4-dffa-4460-8d66-394e4439d896 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Returning 404 to user: Instance 65ea99de-138b-45a9-af3d-33b113423436 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:08:59.332199 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cf086be4-dffa-4460-8d66-394e4439d896 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436" status: 404 len: 111 microversion: 2.1 time: 0.048278 Jul 25 13:08:59.333483 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2664/5237] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:59 2022] GET /compute/v2.1/servers/65ea99de-138b-45a9-af3d-33b113423436 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:08:59.526745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2b6485de-17c9-4910-8beb-875a1765e28f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:08:59.535147 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2b6485de-17c9-4910-8beb-875a1765e28f tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1689 microversion: 2.1 time: 0.690373 Jul 25 13:08:59.545969 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2574/5238] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:58 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1689 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:08:59.642274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a8849a1d-f53b-4cb2-99fe-0e50f6eda327 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:08:59.643821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a8849a1d-f53b-4cb2-99fe-0e50f6eda327 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:08:59.663279 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a8849a1d-f53b-4cb2-99fe-0e50f6eda327 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:59.666871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a8849a1d-f53b-4cb2-99fe-0e50f6eda327 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:08:59.672502 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a8849a1d-f53b-4cb2-99fe-0e50f6eda327 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:08:59.673370 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a8849a1d-f53b-4cb2-99fe-0e50f6eda327 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:00.212224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a8849a1d-f53b-4cb2-99fe-0e50f6eda327 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:00.222740 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a8849a1d-f53b-4cb2-99fe-0e50f6eda327 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1518 microversion: 2.1 time: 0.589664 Jul 25 13:09:00.228255 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2665/5239] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:08:59 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1518 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:00.254491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-56ef1e0e-957b-4e1c-97df-3192f2bf2877 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:09:00.257871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-56ef1e0e-957b-4e1c-97df-3192f2bf2877 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:00.284500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56ef1e0e-957b-4e1c-97df-3192f2bf2877 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:00.284961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56ef1e0e-957b-4e1c-97df-3192f2bf2877 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:00.289893 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56ef1e0e-957b-4e1c-97df-3192f2bf2877 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:00.290810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56ef1e0e-957b-4e1c-97df-3192f2bf2877 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:00.370910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-56ef1e0e-957b-4e1c-97df-3192f2bf2877 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lazy-loading 'flavor' on Instance uuid 58b2f025-146e-4ca4-bb43-be3cd6dae006 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:09:00.464762 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:09:00.501138 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-56ef1e0e-957b-4e1c-97df-3192f2bf2877 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "POST /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006/action" status: 200 len: 32 microversion: 2.1 time: 0.251711 Jul 25 13:09:00.502063 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2575/5240] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:09:00 2022] POST /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006/action => generated 32 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 13:09:00.511819 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5b99974a-a925-4e6a-93ce-ca807c279a4a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:00.512450 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5b99974a-a925-4e6a-93ce-ca807c279a4a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:00.523222 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b99974a-a925-4e6a-93ce-ca807c279a4a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:00.526536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b99974a-a925-4e6a-93ce-ca807c279a4a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:00.527833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b99974a-a925-4e6a-93ce-ca807c279a4a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:00.528652 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b99974a-a925-4e6a-93ce-ca807c279a4a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:00.569874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b8cfe896-0921-4c1f-a59b-5c14cf53846e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:00.570769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b8cfe896-0921-4c1f-a59b-5c14cf53846e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:00.582475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b8cfe896-0921-4c1f-a59b-5c14cf53846e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:00.589269 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b8cfe896-0921-4c1f-a59b-5c14cf53846e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:00.590719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b8cfe896-0921-4c1f-a59b-5c14cf53846e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:00.597010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b8cfe896-0921-4c1f-a59b-5c14cf53846e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:01.500849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b8cfe896-0921-4c1f-a59b-5c14cf53846e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:01.517562 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b8cfe896-0921-4c1f-a59b-5c14cf53846e tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1689 microversion: 2.1 time: 0.952639 Jul 25 13:09:01.518528 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2576/5241] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:00 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1689 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:01.616566 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5b99974a-a925-4e6a-93ce-ca807c279a4a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:01.638036 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5b99974a-a925-4e6a-93ce-ca807c279a4a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1524 microversion: 2.1 time: 1.118774 Jul 25 13:09:01.640122 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2666/5242] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:00 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1524 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:09:02.302145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-48b9f65c-938e-4b61-a666-9ac420e52ba0 req-cd964ca8-3d36-47c7-a69d-bc083fb22dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3baaf3bb-a036-43d5-b1d0-799f44fb5ef3", "name": "network-vif-deleted", "tag": "d22254f0-f882-4f44-966f-f95b96c6c9ff"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:09:02.336549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-48b9f65c-938e-4b61-a666-9ac420e52ba0 req-cd964ca8-3d36-47c7-a69d-bc083fb22dfe service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:02.337619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-48b9f65c-938e-4b61-a666-9ac420e52ba0 req-cd964ca8-3d36-47c7-a69d-bc083fb22dfe service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:02.386067 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-48b9f65c-938e-4b61-a666-9ac420e52ba0 req-cd964ca8-3d36-47c7-a69d-bc083fb22dfe service nova] Creating event network-vif-deleted:d22254f0-f882-4f44-966f-f95b96c6c9ff for instance 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 on n-h1-848886-15 Jul 25 13:09:02.418481 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-48b9f65c-938e-4b61-a666-9ac420e52ba0 req-cd964ca8-3d36-47c7-a69d-bc083fb22dfe service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114778 Jul 25 13:09:02.419796 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2577/5243] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:09:02.547126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dae298eb-3985-4217-af2a-c6c84cb92f27 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:02.547754 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dae298eb-3985-4217-af2a-c6c84cb92f27 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:02.560408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dae298eb-3985-4217-af2a-c6c84cb92f27 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:02.563113 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dae298eb-3985-4217-af2a-c6c84cb92f27 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:02.566284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dae298eb-3985-4217-af2a-c6c84cb92f27 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:02.567117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dae298eb-3985-4217-af2a-c6c84cb92f27 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:02.662702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5f114a09-fa4e-4ace-8711-2fdf8e18676b tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:02.664291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5f114a09-fa4e-4ace-8711-2fdf8e18676b tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:02.668105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dae298eb-3985-4217-af2a-c6c84cb92f27 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:02.679619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dae298eb-3985-4217-af2a-c6c84cb92f27 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:02.679893 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f114a09-fa4e-4ace-8711-2fdf8e18676b tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:02.680090 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-dae298eb-3985-4217-af2a-c6c84cb92f27 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lazy-loading 'fault' on Instance uuid 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:09:02.680236 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f114a09-fa4e-4ace-8711-2fdf8e18676b tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:02.680887 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f114a09-fa4e-4ace-8711-2fdf8e18676b tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:02.686032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f114a09-fa4e-4ace-8711-2fdf8e18676b tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:03.065334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dae298eb-3985-4217-af2a-c6c84cb92f27 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:03.079145 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dae298eb-3985-4217-af2a-c6c84cb92f27 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 200 len: 1335 microversion: 2.1 time: 0.538972 Jul 25 13:09:03.093265 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2667/5244] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:02 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 1335 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:03.093265 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3650865c-b9ce-4e8c-b22a-e44f82f512c5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:09:03.100084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3650865c-b9ce-4e8c-b22a-e44f82f512c5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:03.112785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:09:03.123020 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3650865c-b9ce-4e8c-b22a-e44f82f512c5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:03.123601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3650865c-b9ce-4e8c-b22a-e44f82f512c5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:03.124934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3650865c-b9ce-4e8c-b22a-e44f82f512c5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:03.124934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3650865c-b9ce-4e8c-b22a-e44f82f512c5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:03.268180 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3650865c-b9ce-4e8c-b22a-e44f82f512c5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "POST /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46/action" status: 200 len: 24568 microversion: 2.1 time: 0.186154 Jul 25 13:09:03.271301 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2668/5245] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:09:03 2022] POST /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46/action => generated 24568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:09:03.442023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5f114a09-fa4e-4ace-8711-2fdf8e18676b tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:03.452419 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5f114a09-fa4e-4ace-8711-2fdf8e18676b tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1524 microversion: 2.1 time: 0.794485 Jul 25 13:09:03.456045 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2578/5246] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:02 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1524 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:09:04.100681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-32039bbd-681d-4146-8e2b-5fcdb0cc6edf tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:04.102256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-32039bbd-681d-4146-8e2b-5fcdb0cc6edf tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:04.120567 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32039bbd-681d-4146-8e2b-5fcdb0cc6edf tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:04.121913 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32039bbd-681d-4146-8e2b-5fcdb0cc6edf tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:04.124693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32039bbd-681d-4146-8e2b-5fcdb0cc6edf tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:04.125783 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32039bbd-681d-4146-8e2b-5fcdb0cc6edf tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:04.168895 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-32039bbd-681d-4146-8e2b-5fcdb0cc6edf tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] HTTP exception thrown: Instance 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 could not be found. Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-32039bbd-681d-4146-8e2b-5fcdb0cc6edf tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Request method failure captured: Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 HTTP/1.1 Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pS2fizNtGcP0shojWUAR1ukudLDJRoXVlsPYG2HQcSlgo2We_QWqoULmyxY8IuKrW-0MGgmtrhM3h66oISYSRqIRFBaYspnVlW3g8FUdRvhwOpsGmp2Y9wrcYeXMJCu6fdAfgxIzqcJ6TFFh6UfkfCkGP1n9iDHq6IO37482VYIk-U Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: f791ac394f9f4b8d99d2f48f7d04eae9 Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f791ac394f9f4b8d99d2f48f7d04eae9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f791ac394f9f4b8d99d2f48f7d04eae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f791ac394f9f4b8d99d2f48f7d04eae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f791ac394f9f4b8d99d2f48f7d04eae9"}]}] Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: f791ac394f9f4b8d99d2f48f7d04eae9 Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerRescueNegativeTestJSON-1618399313-project Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 72f34c080e4a4024a38660e8af252a29 Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1618399313-project Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 could not be found. Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '3baaf3bb-a036-43d5-b1d0-799f44fb5ef3'} Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 could not be found. Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 could not be found. Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:04.170656 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:09:04.175449 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:04.175449 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:04.175449 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:09:04.175449 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:09:04.175449 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:09:04.175449 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:09:04.175449 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 could not be found. Jul 25 13:09:04.175449 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:04.175449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-32039bbd-681d-4146-8e2b-5fcdb0cc6edf tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Returning 404 to user: Instance 3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:09:04.175449 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-32039bbd-681d-4146-8e2b-5fcdb0cc6edf tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3" status: 404 len: 111 microversion: 2.1 time: 0.076187 Jul 25 13:09:04.177311 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2669/5247] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:04 2022] GET /compute/v2.1/servers/3baaf3bb-a036-43d5-b1d0-799f44fb5ef3 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:09:04.189764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0e9d25ea-a79e-445c-99d2-f8d286cd3161 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '.version_select at 0x7efcf845bb80>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:04.210789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=54 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:09:04.224985 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0e9d25ea-a79e-445c-99d2-f8d286cd3161 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2074184316" status: 202 len: 0 microversion: 2.1 time: 0.042967 Jul 25 13:09:04.225765 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2579/5248] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Jul 25 13:09:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2074184316 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:09:04.476794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-24b4643d-2454-4407-8084-85839df10975 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:04.477410 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-24b4643d-2454-4407-8084-85839df10975 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:04.500662 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24b4643d-2454-4407-8084-85839df10975 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:04.501208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24b4643d-2454-4407-8084-85839df10975 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:04.503156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24b4643d-2454-4407-8084-85839df10975 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:04.507228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24b4643d-2454-4407-8084-85839df10975 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:04.896526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-24b4643d-2454-4407-8084-85839df10975 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:04.906260 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-24b4643d-2454-4407-8084-85839df10975 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1524 microversion: 2.1 time: 0.433478 Jul 25 13:09:04.924847 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2670/5249] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:04 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1524 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:05.089263 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-14890850-6222-4d10-ab2f-e8ae20827f91 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:05.092476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-14890850-6222-4d10-ab2f-e8ae20827f91 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:05.108844 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14890850-6222-4d10-ab2f-e8ae20827f91 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:05.110051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14890850-6222-4d10-ab2f-e8ae20827f91 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:05.113248 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14890850-6222-4d10-ab2f-e8ae20827f91 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:05.116466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14890850-6222-4d10-ab2f-e8ae20827f91 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:05.201496 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-14890850-6222-4d10-ab2f-e8ae20827f91 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116527 Jul 25 13:09:05.209442 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2580/5250] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:09:05 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-volume_attachments => generated 25 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 13:09:05.379165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-65d9e394-19ea-4213-aa1d-1a7f6a476046 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:05.383063 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-65d9e394-19ea-4213-aa1d-1a7f6a476046 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:05.403201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65d9e394-19ea-4213-aa1d-1a7f6a476046 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:05.404466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65d9e394-19ea-4213-aa1d-1a7f6a476046 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:05.411028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65d9e394-19ea-4213-aa1d-1a7f6a476046 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:05.411816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65d9e394-19ea-4213-aa1d-1a7f6a476046 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:05.504542 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-65d9e394-19ea-4213-aa1d-1a7f6a476046 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.124269 Jul 25 13:09:05.505092 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2671/5251] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:09:05 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 13:09:05.591547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ec95673b-f858-4616-b41f-78d6deb879f2 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:05.592253 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ec95673b-f858-4616-b41f-78d6deb879f2 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:05.599731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec95673b-f858-4616-b41f-78d6deb879f2 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:05.600421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec95673b-f858-4616-b41f-78d6deb879f2 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:05.601405 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec95673b-f858-4616-b41f-78d6deb879f2 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:05.602042 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec95673b-f858-4616-b41f-78d6deb879f2 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:05.654984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ec95673b-f858-4616-b41f-78d6deb879f2 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:09:05.820895 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ec95673b-f858-4616-b41f-78d6deb879f2 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9" status: 204 len: 0 microversion: 2.1 time: 0.234339 Jul 25 13:09:05.822085 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2581/5252] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:09:05 2022] DELETE /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:09:05.830779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9d1409a1-72a5-4219-b8c2-7b6baee7bde9 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:05.831461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9d1409a1-72a5-4219-b8c2-7b6baee7bde9 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:05.843682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d1409a1-72a5-4219-b8c2-7b6baee7bde9 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:05.845533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d1409a1-72a5-4219-b8c2-7b6baee7bde9 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:05.846431 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d1409a1-72a5-4219-b8c2-7b6baee7bde9 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:05.846859 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d1409a1-72a5-4219-b8c2-7b6baee7bde9 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:05.933178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-64fa0612-1476-4bd1-88a2-10ec1b82ad41 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:05.934233 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-64fa0612-1476-4bd1-88a2-10ec1b82ad41 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:05.954957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-64fa0612-1476-4bd1-88a2-10ec1b82ad41 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:05.967228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-64fa0612-1476-4bd1-88a2-10ec1b82ad41 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:05.968361 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-64fa0612-1476-4bd1-88a2-10ec1b82ad41 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:05.970803 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-64fa0612-1476-4bd1-88a2-10ec1b82ad41 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:06.648973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9d1409a1-72a5-4219-b8c2-7b6baee7bde9 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:06.667623 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9d1409a1-72a5-4219-b8c2-7b6baee7bde9 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9" status: 200 len: 1673 microversion: 2.1 time: 0.839941 Jul 25 13:09:06.669962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-64fa0612-1476-4bd1-88a2-10ec1b82ad41 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:06.683445 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-64fa0612-1476-4bd1-88a2-10ec1b82ad41 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1524 microversion: 2.1 time: 0.755089 Jul 25 13:09:06.683698 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2672/5253] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:05 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9 => generated 1673 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:06.709391 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2582/5254] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:05 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1524 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:07.691022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f13ee0c8-4a3f-420d-b7ad-915a57035d03 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:07.691634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f13ee0c8-4a3f-420d-b7ad-915a57035d03 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:07.701657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f13ee0c8-4a3f-420d-b7ad-915a57035d03 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:07.708811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f13ee0c8-4a3f-420d-b7ad-915a57035d03 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:07.709860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f13ee0c8-4a3f-420d-b7ad-915a57035d03 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:07.710455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f13ee0c8-4a3f-420d-b7ad-915a57035d03 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:07.712514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0085c5f9-96df-4ba3-87d7-21488078c89a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:07.713146 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0085c5f9-96df-4ba3-87d7-21488078c89a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:07.724369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0085c5f9-96df-4ba3-87d7-21488078c89a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:07.730301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0085c5f9-96df-4ba3-87d7-21488078c89a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:07.731529 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0085c5f9-96df-4ba3-87d7-21488078c89a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:07.732123 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0085c5f9-96df-4ba3-87d7-21488078c89a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:08.272150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0085c5f9-96df-4ba3-87d7-21488078c89a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:08.281209 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0085c5f9-96df-4ba3-87d7-21488078c89a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1524 microversion: 2.1 time: 0.576523 Jul 25 13:09:08.287767 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2583/5255] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:07 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1524 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:08.342684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f13ee0c8-4a3f-420d-b7ad-915a57035d03 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:08.368443 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f13ee0c8-4a3f-420d-b7ad-915a57035d03 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9" status: 200 len: 1673 microversion: 2.1 time: 0.681079 Jul 25 13:09:08.382768 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2673/5256] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:07 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9 => generated 1673 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:09.312857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-100f769e-c0a1-4e09-a0dd-8121a8c630a3 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:09.314216 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-100f769e-c0a1-4e09-a0dd-8121a8c630a3 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:09.327133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-100f769e-c0a1-4e09-a0dd-8121a8c630a3 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:09.330604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-100f769e-c0a1-4e09-a0dd-8121a8c630a3 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:09.331741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-100f769e-c0a1-4e09-a0dd-8121a8c630a3 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:09.334584 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-100f769e-c0a1-4e09-a0dd-8121a8c630a3 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:09.393692 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5096977f-0349-4951-9800-07a90c9b0285 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:09.399580 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5096977f-0349-4951-9800-07a90c9b0285 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:09.422821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5096977f-0349-4951-9800-07a90c9b0285 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:09.432881 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5096977f-0349-4951-9800-07a90c9b0285 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:09.433864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5096977f-0349-4951-9800-07a90c9b0285 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:09.434335 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5096977f-0349-4951-9800-07a90c9b0285 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:09.790829 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5096977f-0349-4951-9800-07a90c9b0285 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:09.806060 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5096977f-0349-4951-9800-07a90c9b0285 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9" status: 200 len: 1605 microversion: 2.1 time: 0.413099 Jul 25 13:09:09.824096 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2674/5257] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:09 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9 => generated 1605 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:09.846597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-06c652ee-5e6b-46ca-81c7-7997227b71ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "97beeed7-7564-4203-abda-feef7e93cd98"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:09:09.858880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-06c652ee-5e6b-46ca-81c7-7997227b71ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:09.886209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-06c652ee-5e6b-46ca-81c7-7997227b71ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:09.887276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-06c652ee-5e6b-46ca-81c7-7997227b71ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:09.889367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-06c652ee-5e6b-46ca-81c7-7997227b71ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:09.890156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-06c652ee-5e6b-46ca-81c7-7997227b71ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:10.053609 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-100f769e-c0a1-4e09-a0dd-8121a8c630a3 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:10.065694 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-06c652ee-5e6b-46ca-81c7-7997227b71ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:09:10.066983 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-06c652ee-5e6b-46ca-81c7-7997227b71ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:09:10.067778 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-06c652ee-5e6b-46ca-81c7-7997227b71ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:09:10.068397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-06c652ee-5e6b-46ca-81c7-7997227b71ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:09:10.071012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-06c652ee-5e6b-46ca-81c7-7997227b71ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:09:10.079509 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-100f769e-c0a1-4e09-a0dd-8121a8c630a3 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1524 microversion: 2.1 time: 0.770388 Jul 25 13:09:10.097870 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2584/5258] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:09 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1524 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:10.285258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-06c652ee-5e6b-46ca-81c7-7997227b71ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:10.327796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-06c652ee-5e6b-46ca-81c7-7997227b71ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:10.328814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-06c652ee-5e6b-46ca-81c7-7997227b71ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:10.334889 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-06c652ee-5e6b-46ca-81c7-7997227b71ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:10.335577 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-06c652ee-5e6b-46ca-81c7-7997227b71ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:10.404944 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-06c652ee-5e6b-46ca-81c7-7997227b71ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "POST /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46/action" status: 202 len: 1138 microversion: 2.1 time: 0.579289 Jul 25 13:09:10.406319 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2675/5259] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:09:09 2022] POST /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46/action => generated 1138 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 13:09:10.426335 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1bf33574-6faf-4789-90bd-f825b0d653ad tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:10.427599 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1bf33574-6faf-4789-90bd-f825b0d653ad tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:10.441120 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1bf33574-6faf-4789-90bd-f825b0d653ad tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:10.444523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1bf33574-6faf-4789-90bd-f825b0d653ad tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:10.445651 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1bf33574-6faf-4789-90bd-f825b0d653ad tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:10.460824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1bf33574-6faf-4789-90bd-f825b0d653ad tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:10.714091 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1bf33574-6faf-4789-90bd-f825b0d653ad tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:10.727524 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1bf33574-6faf-4789-90bd-f825b0d653ad tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1692 microversion: 2.1 time: 0.302691 Jul 25 13:09:10.729859 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2585/5260] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:10 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1692 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:10.732057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-7f09e2e0-a446-4734-893a-aaead3664d71 req-8aabe5e3-cf7d-4c3d-8a6e-a8721d502efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7efe0544-de4c-4966-9e19-5ae73b5c5fe9", "name": "network-vif-deleted", "tag": "14a7c2d1-b1e9-49d5-a254-064411c0e1f7"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:09:10.766872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-7f09e2e0-a446-4734-893a-aaead3664d71 req-8aabe5e3-cf7d-4c3d-8a6e-a8721d502efd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:10.769037 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-7f09e2e0-a446-4734-893a-aaead3664d71 req-8aabe5e3-cf7d-4c3d-8a6e-a8721d502efd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:10.838000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-85d3cd46-9b9a-4654-9611-857f1bd3bd0e tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:10.841188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-85d3cd46-9b9a-4654-9611-857f1bd3bd0e tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:10.845036 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-7f09e2e0-a446-4734-893a-aaead3664d71 req-8aabe5e3-cf7d-4c3d-8a6e-a8721d502efd service nova] Creating event network-vif-deleted:14a7c2d1-b1e9-49d5-a254-064411c0e1f7 for instance 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 on n-h1-848886-15 Jul 25 13:09:10.868202 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-85d3cd46-9b9a-4654-9611-857f1bd3bd0e tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:10.869014 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-85d3cd46-9b9a-4654-9611-857f1bd3bd0e tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:10.869324 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-7f09e2e0-a446-4734-893a-aaead3664d71 req-8aabe5e3-cf7d-4c3d-8a6e-a8721d502efd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141258 Jul 25 13:09:10.871051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-85d3cd46-9b9a-4654-9611-857f1bd3bd0e tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:10.872577 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2676/5261] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:09:10.875841 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-85d3cd46-9b9a-4654-9611-857f1bd3bd0e tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:11.119745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1b3df330-7f9f-4b4d-8922-b681d509bd4b tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:11.122264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1b3df330-7f9f-4b4d-8922-b681d509bd4b tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:11.137132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b3df330-7f9f-4b4d-8922-b681d509bd4b tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:11.137976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b3df330-7f9f-4b4d-8922-b681d509bd4b tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:11.139015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b3df330-7f9f-4b4d-8922-b681d509bd4b tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:11.140727 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b3df330-7f9f-4b4d-8922-b681d509bd4b tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:11.180948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-85d3cd46-9b9a-4654-9611-857f1bd3bd0e tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc3da4ae9f444e7a4471e509868d088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb3fd31125b4879bd1f58cd3d1358a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:11.204798 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-85d3cd46-9b9a-4654-9611-857f1bd3bd0e tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9" status: 200 len: 1322 microversion: 2.1 time: 0.373737 Jul 25 13:09:11.211927 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2586/5262] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:10 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9 => generated 1322 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:09:11.756521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d2308cd7-ee47-4358-bc12-a46ab121eaf5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:11.757264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d2308cd7-ee47-4358-bc12-a46ab121eaf5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:11.775965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2308cd7-ee47-4358-bc12-a46ab121eaf5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:11.778743 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2308cd7-ee47-4358-bc12-a46ab121eaf5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:11.781151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2308cd7-ee47-4358-bc12-a46ab121eaf5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:11.782078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2308cd7-ee47-4358-bc12-a46ab121eaf5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:12.105823 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1b3df330-7f9f-4b4d-8922-b681d509bd4b tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:12.119055 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1b3df330-7f9f-4b4d-8922-b681d509bd4b tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1524 microversion: 2.1 time: 1.009292 Jul 25 13:09:12.135521 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2677/5263] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:11 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1524 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:12.237119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b4d9c071-9784-41ee-b632-2e9311e7d368 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:12.237744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b4d9c071-9784-41ee-b632-2e9311e7d368 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:12.258421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d2308cd7-ee47-4358-bc12-a46ab121eaf5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:12.259773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4d9c071-9784-41ee-b632-2e9311e7d368 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:12.260472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4d9c071-9784-41ee-b632-2e9311e7d368 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:12.261418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4d9c071-9784-41ee-b632-2e9311e7d368 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:12.261879 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4d9c071-9784-41ee-b632-2e9311e7d368 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:12.268227 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d2308cd7-ee47-4358-bc12-a46ab121eaf5 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1692 microversion: 2.1 time: 0.517133 Jul 25 13:09:12.286341 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-b4d9c071-9784-41ee-b632-2e9311e7d368 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] HTTP exception thrown: Instance 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 could not be found. Jul 25 13:09:12.286930 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2587/5264] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:11 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1692 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b4d9c071-9784-41ee-b632-2e9311e7d368 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Request method failure captured: Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9 HTTP/1.1 Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pSCjjOUwJBu27M5A9MAS8o0O9uH59U0acLx6g4qcIv23mWGrrOjdt2IgvHoN5SP9_hokB-pDlt0bhwjuhztdf3OfFL8q2AxT_lIsoS4eI1n-QKNDGNhCYx3Rf762DwHeDuXOtp5hrUjGY9docgShhhp_Ocv4GQAeCWMuSoQhVJjgBY Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 4bb3fd31125b4879bd1f58cd3d1358a3 Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-AttachVolumeTestJSON-1292371232 Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4bb3fd31125b4879bd1f58cd3d1358a3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4bb3fd31125b4879bd1f58cd3d1358a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4bb3fd31125b4879bd1f58cd3d1358a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4bb3fd31125b4879bd1f58cd3d1358a3"}]}] Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-AttachVolumeTestJSON-1292371232 Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 4bb3fd31125b4879bd1f58cd3d1358a3 Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1292371232 Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-AttachVolumeTestJSON-1292371232-project Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 3dc3da4ae9f444e7a4471e509868d088 Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-AttachVolumeTestJSON-1292371232-project Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 could not be found. Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '7efe0544-de4c-4966-9e19-5ae73b5c5fe9'} Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 could not be found. Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 could not be found. Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:09:12.299400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:12.303939 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:12.303939 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:09:12.303939 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:09:12.303939 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:09:12.303939 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:09:12.303939 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 could not be found. Jul 25 13:09:12.303939 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:12.305251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b4d9c071-9784-41ee-b632-2e9311e7d368 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Returning 404 to user: Instance 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:09:12.318868 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b4d9c071-9784-41ee-b632-2e9311e7d368 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9" status: 404 len: 111 microversion: 2.1 time: 0.085828 Jul 25 13:09:12.320045 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2678/5265] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:12 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 13:09:12.333030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f3fc84f4-ff7c-49bc-8843-1798b4d0831c tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '.version_select at 0x7efcf83c5ee0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:12.369415 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f3fc84f4-ff7c-49bc-8843-1798b4d0831c tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1636914572" status: 202 len: 0 microversion: 2.1 time: 0.043597 Jul 25 13:09:12.370991 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2588/5266] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Jul 25 13:09:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1636914572 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:09:13.151868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-37511bb3-0114-4b1b-9a9b-255f089a5c12 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:13.154305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-37511bb3-0114-4b1b-9a9b-255f089a5c12 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:13.175300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-37511bb3-0114-4b1b-9a9b-255f089a5c12 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:13.181773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-37511bb3-0114-4b1b-9a9b-255f089a5c12 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:13.183929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-37511bb3-0114-4b1b-9a9b-255f089a5c12 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:13.185417 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-37511bb3-0114-4b1b-9a9b-255f089a5c12 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:13.297424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4548fe54-31a5-4f80-b3d0-8e0a3b59262c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:13.299508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4548fe54-31a5-4f80-b3d0-8e0a3b59262c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:13.321742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4548fe54-31a5-4f80-b3d0-8e0a3b59262c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:13.325538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4548fe54-31a5-4f80-b3d0-8e0a3b59262c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:13.335692 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4548fe54-31a5-4f80-b3d0-8e0a3b59262c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:13.336571 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4548fe54-31a5-4f80-b3d0-8e0a3b59262c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:13.826212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-37511bb3-0114-4b1b-9a9b-255f089a5c12 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:13.840052 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-37511bb3-0114-4b1b-9a9b-255f089a5c12 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1524 microversion: 2.1 time: 0.694482 Jul 25 13:09:13.842159 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2679/5267] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:13 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1524 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:14.056234 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4548fe54-31a5-4f80-b3d0-8e0a3b59262c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:14.083207 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4548fe54-31a5-4f80-b3d0-8e0a3b59262c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1692 microversion: 2.1 time: 0.788406 Jul 25 13:09:14.097582 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2589/5268] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:13 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1692 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:14.866228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d98975c0-2dad-4c4d-bda6-a6c770891df2 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:14.867485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d98975c0-2dad-4c4d-bda6-a6c770891df2 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:14.881894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d98975c0-2dad-4c4d-bda6-a6c770891df2 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:14.882751 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d98975c0-2dad-4c4d-bda6-a6c770891df2 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:14.884181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d98975c0-2dad-4c4d-bda6-a6c770891df2 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:14.891650 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d98975c0-2dad-4c4d-bda6-a6c770891df2 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:15.124048 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7a67671d-baf4-403e-9f1f-85dcdf8f6ca8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:15.125290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7a67671d-baf4-403e-9f1f-85dcdf8f6ca8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:15.143501 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a67671d-baf4-403e-9f1f-85dcdf8f6ca8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:15.144247 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a67671d-baf4-403e-9f1f-85dcdf8f6ca8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:15.145232 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a67671d-baf4-403e-9f1f-85dcdf8f6ca8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:15.145890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a67671d-baf4-403e-9f1f-85dcdf8f6ca8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:15.481286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d98975c0-2dad-4c4d-bda6-a6c770891df2 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:15.491143 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d98975c0-2dad-4c4d-bda6-a6c770891df2 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1524 microversion: 2.1 time: 0.629947 Jul 25 13:09:15.510668 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2680/5269] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:14 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1524 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:15.847586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7a67671d-baf4-403e-9f1f-85dcdf8f6ca8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:15.859702 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7a67671d-baf4-403e-9f1f-85dcdf8f6ca8 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1692 microversion: 2.1 time: 0.737333 Jul 25 13:09:15.865917 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2590/5270] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:15 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1692 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:16.523354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1ac2ca0d-e3bf-44dc-8c9b-5b82f44a0fda tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:16.524794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1ac2ca0d-e3bf-44dc-8c9b-5b82f44a0fda tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:16.536924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ac2ca0d-e3bf-44dc-8c9b-5b82f44a0fda tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:16.542690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ac2ca0d-e3bf-44dc-8c9b-5b82f44a0fda tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:16.544941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ac2ca0d-e3bf-44dc-8c9b-5b82f44a0fda tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:16.545608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ac2ca0d-e3bf-44dc-8c9b-5b82f44a0fda tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:16.558943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:09:16.895873 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e3b5b1df-b8ab-41e5-b122-f2ee796d4507 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:16.897315 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e3b5b1df-b8ab-41e5-b122-f2ee796d4507 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:16.910290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3b5b1df-b8ab-41e5-b122-f2ee796d4507 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:16.911062 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3b5b1df-b8ab-41e5-b122-f2ee796d4507 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:16.912101 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3b5b1df-b8ab-41e5-b122-f2ee796d4507 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:16.912724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3b5b1df-b8ab-41e5-b122-f2ee796d4507 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:17.026254 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1ac2ca0d-e3bf-44dc-8c9b-5b82f44a0fda tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:17.064017 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1ac2ca0d-e3bf-44dc-8c9b-5b82f44a0fda tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1524 microversion: 2.1 time: 0.545573 Jul 25 13:09:17.091305 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2681/5271] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:16 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1524 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:17.354591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e3b5b1df-b8ab-41e5-b122-f2ee796d4507 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:17.368299 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e3b5b1df-b8ab-41e5-b122-f2ee796d4507 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1692 microversion: 2.1 time: 0.476956 Jul 25 13:09:17.371687 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2591/5272] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:16 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1692 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:09:18.113698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-10ee8ec2-d453-4aa8-a4c2-074c2124cf6e tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:18.114409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-10ee8ec2-d453-4aa8-a4c2-074c2124cf6e tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:18.115988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d1d6c6d8-18cd-43e1-bb42-47be49c0c154 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:18.116992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d1d6c6d8-18cd-43e1-bb42-47be49c0c154 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:18.144074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1d6c6d8-18cd-43e1-bb42-47be49c0c154 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:18.146521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1d6c6d8-18cd-43e1-bb42-47be49c0c154 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:18.157159 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1d6c6d8-18cd-43e1-bb42-47be49c0c154 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:18.158530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10ee8ec2-d453-4aa8-a4c2-074c2124cf6e tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:18.163260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1d6c6d8-18cd-43e1-bb42-47be49c0c154 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:18.166999 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10ee8ec2-d453-4aa8-a4c2-074c2124cf6e tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:18.168175 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10ee8ec2-d453-4aa8-a4c2-074c2124cf6e tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:18.173101 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10ee8ec2-d453-4aa8-a4c2-074c2124cf6e tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:18.272215 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d1d6c6d8-18cd-43e1-bb42-47be49c0c154 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:09:18.433357 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d1d6c6d8-18cd-43e1-bb42-47be49c0c154 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 204 len: 0 microversion: 2.1 time: 0.337188 Jul 25 13:09:18.434468 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2682/5273] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:09:18 2022] DELETE /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:09:18.440166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c13a0a03-3f93-415e-920f-86a15d68f122 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:18.442202 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c13a0a03-3f93-415e-920f-86a15d68f122 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:18.461012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c13a0a03-3f93-415e-920f-86a15d68f122 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:18.463529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c13a0a03-3f93-415e-920f-86a15d68f122 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:18.464436 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c13a0a03-3f93-415e-920f-86a15d68f122 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:18.464870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c13a0a03-3f93-415e-920f-86a15d68f122 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:18.486985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-10ee8ec2-d453-4aa8-a4c2-074c2124cf6e tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:18.499737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:09:18.504331 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-10ee8ec2-d453-4aa8-a4c2-074c2124cf6e tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1524 microversion: 2.1 time: 0.399019 Jul 25 13:09:18.504947 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2592/5274] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:18 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1524 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:18.517660 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cacd03bc-9190-4fe9-8737-cb883df206b7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:18.519657 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cacd03bc-9190-4fe9-8737-cb883df206b7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:18.546017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cacd03bc-9190-4fe9-8737-cb883df206b7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:18.546406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cacd03bc-9190-4fe9-8737-cb883df206b7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:18.552205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cacd03bc-9190-4fe9-8737-cb883df206b7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:18.552816 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cacd03bc-9190-4fe9-8737-cb883df206b7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:19.007636 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c13a0a03-3f93-415e-920f-86a15d68f122 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:19.025286 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c13a0a03-3f93-415e-920f-86a15d68f122 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1692 microversion: 2.1 time: 0.589341 Jul 25 13:09:19.032657 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2683/5275] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:18 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1692 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:19.200625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cacd03bc-9190-4fe9-8737-cb883df206b7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:19.213303 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cacd03bc-9190-4fe9-8737-cb883df206b7 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1508 microversion: 2.1 time: 0.707017 Jul 25 13:09:19.226337 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2593/5276] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:18 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1508 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:19.531590 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5dab8717-00a0-46b1-ae03-27e50e7c4b88 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:19.542879 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5dab8717-00a0-46b1-ae03-27e50e7c4b88 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:19.577174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5dab8717-00a0-46b1-ae03-27e50e7c4b88 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:19.581799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5dab8717-00a0-46b1-ae03-27e50e7c4b88 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:19.584947 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5dab8717-00a0-46b1-ae03-27e50e7c4b88 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:19.585460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5dab8717-00a0-46b1-ae03-27e50e7c4b88 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:19.945921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5dab8717-00a0-46b1-ae03-27e50e7c4b88 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:19.954698 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5dab8717-00a0-46b1-ae03-27e50e7c4b88 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1524 microversion: 2.1 time: 0.430381 Jul 25 13:09:19.968962 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2684/5277] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:19 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1524 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:20.056927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8bf83a66-3f4b-4590-842f-980dc6e3fe75 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:20.058537 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8bf83a66-3f4b-4590-842f-980dc6e3fe75 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:20.074794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bf83a66-3f4b-4590-842f-980dc6e3fe75 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:20.075987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bf83a66-3f4b-4590-842f-980dc6e3fe75 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:20.077080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bf83a66-3f4b-4590-842f-980dc6e3fe75 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:20.077755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bf83a66-3f4b-4590-842f-980dc6e3fe75 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:20.238488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-687078f8-6b75-4776-9ba4-e52a8b1fa864 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:20.239233 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-687078f8-6b75-4776-9ba4-e52a8b1fa864 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:20.251654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-687078f8-6b75-4776-9ba4-e52a8b1fa864 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:20.253801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-687078f8-6b75-4776-9ba4-e52a8b1fa864 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:20.254628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-687078f8-6b75-4776-9ba4-e52a8b1fa864 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:20.255389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-687078f8-6b75-4776-9ba4-e52a8b1fa864 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:20.534701 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8bf83a66-3f4b-4590-842f-980dc6e3fe75 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:20.552945 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8bf83a66-3f4b-4590-842f-980dc6e3fe75 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1692 microversion: 2.1 time: 0.500660 Jul 25 13:09:20.553541 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2594/5278] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:20 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1692 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:20.718896 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-687078f8-6b75-4776-9ba4-e52a8b1fa864 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:20.733772 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-687078f8-6b75-4776-9ba4-e52a8b1fa864 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1508 microversion: 2.1 time: 0.500022 Jul 25 13:09:20.745858 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2685/5279] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:20 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1508 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:20.977030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6eeb4680-aefc-4aaf-9719-e0ba6d7f3e46 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:20.977661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6eeb4680-aefc-4aaf-9719-e0ba6d7f3e46 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:21.006720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6eeb4680-aefc-4aaf-9719-e0ba6d7f3e46 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:21.007438 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6eeb4680-aefc-4aaf-9719-e0ba6d7f3e46 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:21.008434 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6eeb4680-aefc-4aaf-9719-e0ba6d7f3e46 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:21.011640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6eeb4680-aefc-4aaf-9719-e0ba6d7f3e46 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:21.581890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1a59cec4-3e5b-44f8-9fcf-efea79cec404 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:21.585149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1a59cec4-3e5b-44f8-9fcf-efea79cec404 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:21.604387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a59cec4-3e5b-44f8-9fcf-efea79cec404 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:21.605286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a59cec4-3e5b-44f8-9fcf-efea79cec404 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:21.610437 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a59cec4-3e5b-44f8-9fcf-efea79cec404 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:21.611192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a59cec4-3e5b-44f8-9fcf-efea79cec404 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:21.782536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6eeb4680-aefc-4aaf-9719-e0ba6d7f3e46 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:21.796272 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6eeb4680-aefc-4aaf-9719-e0ba6d7f3e46 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1524 microversion: 2.1 time: 0.823062 Jul 25 13:09:21.798276 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2595/5280] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:20 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1524 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:21.812297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9762eab2-42e9-442f-9479-a6d5a0fdaa98 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:21.813478 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9762eab2-42e9-442f-9479-a6d5a0fdaa98 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:21.829248 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9762eab2-42e9-442f-9479-a6d5a0fdaa98 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:21.832501 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9762eab2-42e9-442f-9479-a6d5a0fdaa98 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:21.837447 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9762eab2-42e9-442f-9479-a6d5a0fdaa98 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:21.838944 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9762eab2-42e9-442f-9479-a6d5a0fdaa98 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:22.621990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1a59cec4-3e5b-44f8-9fcf-efea79cec404 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:22.638399 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1a59cec4-3e5b-44f8-9fcf-efea79cec404 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1692 microversion: 2.1 time: 1.065473 Jul 25 13:09:22.658321 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2686/5281] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:21 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1692 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:22.772061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9762eab2-42e9-442f-9479-a6d5a0fdaa98 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:22.780722 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9762eab2-42e9-442f-9479-a6d5a0fdaa98 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 200 len: 1508 microversion: 2.1 time: 0.978668 Jul 25 13:09:22.783285 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2596/5282] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:21 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 1508 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:22.818585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9808a815-1220-414e-bdc9-80162a796576 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:22.819446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9808a815-1220-414e-bdc9-80162a796576 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:22.829621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9808a815-1220-414e-bdc9-80162a796576 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:22.830114 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9808a815-1220-414e-bdc9-80162a796576 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:22.830944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9808a815-1220-414e-bdc9-80162a796576 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:22.831486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9808a815-1220-414e-bdc9-80162a796576 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:22.951617 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-023942cf-f54c-471d-ab35-f67b3015921f req-7f2d884f-0c6f-445b-bc11-e0449f5b801d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8931f252-9f17-4c5f-ba34-8de681154571", "name": "network-vif-deleted", "tag": "adfd7df8-3366-4c53-9640-277b67fb3cc1"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:09:22.968076 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-023942cf-f54c-471d-ab35-f67b3015921f req-7f2d884f-0c6f-445b-bc11-e0449f5b801d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:22.971509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-023942cf-f54c-471d-ab35-f67b3015921f req-7f2d884f-0c6f-445b-bc11-e0449f5b801d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:22.999198 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-023942cf-f54c-471d-ab35-f67b3015921f req-7f2d884f-0c6f-445b-bc11-e0449f5b801d service nova] Creating event network-vif-deleted:adfd7df8-3366-4c53-9640-277b67fb3cc1 for instance 8931f252-9f17-4c5f-ba34-8de681154571 on n-h2-848886-15 Jul 25 13:09:23.015125 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-023942cf-f54c-471d-ab35-f67b3015921f req-7f2d884f-0c6f-445b-bc11-e0449f5b801d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068210 Jul 25 13:09:23.016234 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2597/5283] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:09:23.227743 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9808a815-1220-414e-bdc9-80162a796576 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:23.241702 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9808a815-1220-414e-bdc9-80162a796576 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1524 microversion: 2.1 time: 0.426900 Jul 25 13:09:23.244543 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2687/5284] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:22 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1524 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:23.667408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c57dda85-fc59-4866-a0ea-1c3b1354bb75 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:23.669101 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c57dda85-fc59-4866-a0ea-1c3b1354bb75 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:23.685958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c57dda85-fc59-4866-a0ea-1c3b1354bb75 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:23.688824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c57dda85-fc59-4866-a0ea-1c3b1354bb75 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:23.690246 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c57dda85-fc59-4866-a0ea-1c3b1354bb75 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:23.691330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c57dda85-fc59-4866-a0ea-1c3b1354bb75 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:23.804995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a4f9a360-d442-486f-a704-3f45010bd08a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:23.807240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a4f9a360-d442-486f-a704-3f45010bd08a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8931f252-9f17-4c5f-ba34-8de681154571] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:23.817010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4f9a360-d442-486f-a704-3f45010bd08a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:23.817882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4f9a360-d442-486f-a704-3f45010bd08a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:23.819276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4f9a360-d442-486f-a704-3f45010bd08a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:23.820065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4f9a360-d442-486f-a704-3f45010bd08a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:23.867103 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-a4f9a360-d442-486f-a704-3f45010bd08a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] HTTP exception thrown: Instance 8931f252-9f17-4c5f-ba34-8de681154571 could not be found. Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a4f9a360-d442-486f-a704-3f45010bd08a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Request method failure captured: Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 HTTP/1.1 Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pS2fizNtGcP0shojWUAR1ukudLDJRoXVlsPYG2HQcSlgo2We_QWqoULmyxY8IuKrW-0MGgmtrhM3h66oISYSRqIRFBaYspnVlW3g8FUdRvhwOpsGmp2Y9wrcYeXMJCu6fdAfgxIzqcJ6TFFh6UfkfCkGP1n9iDHq6IO37482VYIk-U Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: f791ac394f9f4b8d99d2f48f7d04eae9 Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f791ac394f9f4b8d99d2f48f7d04eae9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f791ac394f9f4b8d99d2f48f7d04eae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f791ac394f9f4b8d99d2f48f7d04eae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f791ac394f9f4b8d99d2f48f7d04eae9"}]}] Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: f791ac394f9f4b8d99d2f48f7d04eae9 Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerRescueNegativeTestJSON-1618399313-project Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 72f34c080e4a4024a38660e8af252a29 Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1618399313-project Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 8931f252-9f17-4c5f-ba34-8de681154571 could not be found. Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '8931f252-9f17-4c5f-ba34-8de681154571'} Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8931f252-9f17-4c5f-ba34-8de681154571 could not be found. Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8931f252-9f17-4c5f-ba34-8de681154571 could not be found. Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:23.869114 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:09:23.873160 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:23.873160 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:23.873160 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:09:23.873160 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:09:23.873160 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:09:23.873160 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:09:23.873160 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8931f252-9f17-4c5f-ba34-8de681154571 could not be found. Jul 25 13:09:23.873160 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:23.875717 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a4f9a360-d442-486f-a704-3f45010bd08a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Returning 404 to user: Instance 8931f252-9f17-4c5f-ba34-8de681154571 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:09:23.876863 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a4f9a360-d442-486f-a704-3f45010bd08a tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571" status: 404 len: 111 microversion: 2.1 time: 0.076490 Jul 25 13:09:23.881765 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2688/5285] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:23 2022] GET /compute/v2.1/servers/8931f252-9f17-4c5f-ba34-8de681154571 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:09:23.887927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b0e5b313-013c-458c-8235-4abc56df6e8b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:23.888745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b0e5b313-013c-458c-8235-4abc56df6e8b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:23.896203 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0e5b313-013c-458c-8235-4abc56df6e8b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:23.897027 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0e5b313-013c-458c-8235-4abc56df6e8b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:23.898074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0e5b313-013c-458c-8235-4abc56df6e8b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:23.898734 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0e5b313-013c-458c-8235-4abc56df6e8b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:23.930031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b0e5b313-013c-458c-8235-4abc56df6e8b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:09:24.096770 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b0e5b313-013c-458c-8235-4abc56df6e8b tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 204 len: 0 microversion: 2.1 time: 0.213231 Jul 25 13:09:24.098959 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2689/5286] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:09:23 2022] DELETE /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:09:24.125857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d563b444-7bbf-4472-8ca4-67e5db9f9668 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:24.136772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d563b444-7bbf-4472-8ca4-67e5db9f9668 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:24.146795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d563b444-7bbf-4472-8ca4-67e5db9f9668 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:24.147154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d563b444-7bbf-4472-8ca4-67e5db9f9668 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:24.147937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d563b444-7bbf-4472-8ca4-67e5db9f9668 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:24.148493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d563b444-7bbf-4472-8ca4-67e5db9f9668 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:24.248480 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c57dda85-fc59-4866-a0ea-1c3b1354bb75 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:24.262649 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c57dda85-fc59-4866-a0ea-1c3b1354bb75 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1698 microversion: 2.1 time: 0.603487 Jul 25 13:09:24.271217 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2598/5287] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:23 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1698 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:24.300493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ba424510-f78b-45a7-b01d-5001fe3c01c7 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:24.301412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ba424510-f78b-45a7-b01d-5001fe3c01c7 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:24.309498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba424510-f78b-45a7-b01d-5001fe3c01c7 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:24.310564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba424510-f78b-45a7-b01d-5001fe3c01c7 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:24.311854 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba424510-f78b-45a7-b01d-5001fe3c01c7 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:24.312642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba424510-f78b-45a7-b01d-5001fe3c01c7 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:24.640411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d563b444-7bbf-4472-8ca4-67e5db9f9668 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:24.658930 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d563b444-7bbf-4472-8ca4-67e5db9f9668 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1520 microversion: 2.1 time: 0.553968 Jul 25 13:09:24.659543 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2690/5288] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:24 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1520 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:24.885549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ba424510-f78b-45a7-b01d-5001fe3c01c7 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:24.905503 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ba424510-f78b-45a7-b01d-5001fe3c01c7 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1524 microversion: 2.1 time: 0.632150 Jul 25 13:09:24.908014 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2599/5289] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:24 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1524 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:25.285557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-904f01a7-736b-455a-89b6-e8bfb971b5a0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:25.287479 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-904f01a7-736b-455a-89b6-e8bfb971b5a0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:25.312498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-904f01a7-736b-455a-89b6-e8bfb971b5a0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:25.313292 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-904f01a7-736b-455a-89b6-e8bfb971b5a0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:25.314337 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-904f01a7-736b-455a-89b6-e8bfb971b5a0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:25.315021 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-904f01a7-736b-455a-89b6-e8bfb971b5a0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:25.678215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-904f01a7-736b-455a-89b6-e8bfb971b5a0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:25.694241 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-904f01a7-736b-455a-89b6-e8bfb971b5a0 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1698 microversion: 2.1 time: 0.405958 Jul 25 13:09:25.695680 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2600/5290] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:25 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1698 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:09:25.710149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0acb78d9-7e38-4677-b49d-4e131263c3de tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:25.710973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0acb78d9-7e38-4677-b49d-4e131263c3de tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:25.726378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0acb78d9-7e38-4677-b49d-4e131263c3de tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:25.727768 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0acb78d9-7e38-4677-b49d-4e131263c3de tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:25.736210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0acb78d9-7e38-4677-b49d-4e131263c3de tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:25.737027 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0acb78d9-7e38-4677-b49d-4e131263c3de tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:25.765687 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9d49a240-8013-4225-8be2-5ba774b9543a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:25.766878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9d49a240-8013-4225-8be2-5ba774b9543a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:25.782849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d49a240-8013-4225-8be2-5ba774b9543a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:25.783569 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d49a240-8013-4225-8be2-5ba774b9543a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:25.784984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d49a240-8013-4225-8be2-5ba774b9543a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:25.785929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d49a240-8013-4225-8be2-5ba774b9543a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:25.855921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9d49a240-8013-4225-8be2-5ba774b9543a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:09:26.018111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0acb78d9-7e38-4677-b49d-4e131263c3de tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:26.027662 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0acb78d9-7e38-4677-b49d-4e131263c3de tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1520 microversion: 2.1 time: 0.329519 Jul 25 13:09:26.030941 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2601/5291] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:25 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1520 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:26.037073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2eafb070-7b2b-48fe-885a-a771497aacb6 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:26.037969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2eafb070-7b2b-48fe-885a-a771497aacb6 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:26.045563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2eafb070-7b2b-48fe-885a-a771497aacb6 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:26.046416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2eafb070-7b2b-48fe-885a-a771497aacb6 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:26.047633 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2eafb070-7b2b-48fe-885a-a771497aacb6 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:26.048303 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2eafb070-7b2b-48fe-885a-a771497aacb6 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:26.107039 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9d49a240-8013-4225-8be2-5ba774b9543a tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "DELETE /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 204 len: 0 microversion: 2.1 time: 0.907307 Jul 25 13:09:26.107865 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2691/5292] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:09:25 2022] DELETE /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 0 bytes in 909 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:09:26.124717 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bc514b0c-c07e-4cfd-ad38-7deb6afb2e65 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:26.130282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bc514b0c-c07e-4cfd-ad38-7deb6afb2e65 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:26.156525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc514b0c-c07e-4cfd-ad38-7deb6afb2e65 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:26.157488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc514b0c-c07e-4cfd-ad38-7deb6afb2e65 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:26.173868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc514b0c-c07e-4cfd-ad38-7deb6afb2e65 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:26.177184 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc514b0c-c07e-4cfd-ad38-7deb6afb2e65 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:26.210672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2eafb070-7b2b-48fe-885a-a771497aacb6 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:26.227467 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2eafb070-7b2b-48fe-885a-a771497aacb6 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1524 microversion: 2.1 time: 0.192008 Jul 25 13:09:26.229905 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2602/5293] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:26 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1524 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:26.360647 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-af2376a2-beee-4226-bac0-b4ab6cb3f5ce tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:26.361892 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-af2376a2-beee-4226-bac0-b4ab6cb3f5ce tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:26.423571 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af2376a2-beee-4226-bac0-b4ab6cb3f5ce tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:26.423935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af2376a2-beee-4226-bac0-b4ab6cb3f5ce tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:26.424731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af2376a2-beee-4226-bac0-b4ab6cb3f5ce tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:26.434486 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af2376a2-beee-4226-bac0-b4ab6cb3f5ce tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:26.481253 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-af2376a2-beee-4226-bac0-b4ab6cb3f5ce tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] HTTP exception thrown: Instance 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 could not be found. Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-af2376a2-beee-4226-bac0-b4ab6cb3f5ce tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Request method failure captured: Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9 HTTP/1.1 Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pSCjjOUwJBu27M5A9MAS8o0O9uH59U0acLx6g4qcIv23mWGrrOjdt2IgvHoN5SP9_hokB-pDlt0bhwjuhztdf3OfFL8q2AxT_lIsoS4eI1n-QKNDGNhCYx3Rf762DwHeDuXOtp5hrUjGY9docgShhhp_Ocv4GQAeCWMuSoQhVJjgBY Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 4bb3fd31125b4879bd1f58cd3d1358a3 Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AttachVolumeTestJSON-1292371232 Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4bb3fd31125b4879bd1f58cd3d1358a3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4bb3fd31125b4879bd1f58cd3d1358a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4bb3fd31125b4879bd1f58cd3d1358a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4bb3fd31125b4879bd1f58cd3d1358a3"}]}] Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AttachVolumeTestJSON-1292371232 Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 4bb3fd31125b4879bd1f58cd3d1358a3 Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1292371232 Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AttachVolumeTestJSON-1292371232-project Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 3dc3da4ae9f444e7a4471e509868d088 Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AttachVolumeTestJSON-1292371232-project Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 could not be found. Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '7efe0544-de4c-4966-9e19-5ae73b5c5fe9'} Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 could not be found. Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:09:26.491038 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:09:26.496074 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 could not be found. Jul 25 13:09:26.496074 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:26.496074 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:09:26.496074 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:26.496074 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:26.496074 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:09:26.496074 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:09:26.496074 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:09:26.496074 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:09:26.496074 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 could not be found. Jul 25 13:09:26.496074 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:26.496074 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-af2376a2-beee-4226-bac0-b4ab6cb3f5ce tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Returning 404 to user: Instance 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:09:26.496074 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-af2376a2-beee-4226-bac0-b4ab6cb3f5ce tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9" status: 404 len: 111 microversion: 2.1 time: 0.139606 Jul 25 13:09:26.500196 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2603/5294] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:09:26 2022] DELETE /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:09:26.516733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a2889058-9120-4e90-8459-ef0e65d7231a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:26.522590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a2889058-9120-4e90-8459-ef0e65d7231a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: 7efe0544-de4c-4966-9e19-5ae73b5c5fe9] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:26.543275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2889058-9120-4e90-8459-ef0e65d7231a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:26.553457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2889058-9120-4e90-8459-ef0e65d7231a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:26.571321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2889058-9120-4e90-8459-ef0e65d7231a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:26.572232 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2889058-9120-4e90-8459-ef0e65d7231a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:26.595970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bc514b0c-c07e-4cfd-ad38-7deb6afb2e65 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e6a20408894330b3b3734a455a078c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ef6028fa1c460b8cab5f7d9082abfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:26.611104 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bc514b0c-c07e-4cfd-ad38-7deb6afb2e65 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 200 len: 1732 microversion: 2.1 time: 0.492873 Jul 25 13:09:26.611965 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2692/5295] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:26 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 1732 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:26.621489 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-a2889058-9120-4e90-8459-ef0e65d7231a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] HTTP exception thrown: Instance 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 could not be found. Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a2889058-9120-4e90-8459-ef0e65d7231a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Request method failure captured: Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9 HTTP/1.1 Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pSCjjOUwJBu27M5A9MAS8o0O9uH59U0acLx6g4qcIv23mWGrrOjdt2IgvHoN5SP9_hokB-pDlt0bhwjuhztdf3OfFL8q2AxT_lIsoS4eI1n-QKNDGNhCYx3Rf762DwHeDuXOtp5hrUjGY9docgShhhp_Ocv4GQAeCWMuSoQhVJjgBY Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 4bb3fd31125b4879bd1f58cd3d1358a3 Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AttachVolumeTestJSON-1292371232 Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4bb3fd31125b4879bd1f58cd3d1358a3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4bb3fd31125b4879bd1f58cd3d1358a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4bb3fd31125b4879bd1f58cd3d1358a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4bb3fd31125b4879bd1f58cd3d1358a3"}]}] Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AttachVolumeTestJSON-1292371232 Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 4bb3fd31125b4879bd1f58cd3d1358a3 Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1292371232 Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AttachVolumeTestJSON-1292371232-project Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 3dc3da4ae9f444e7a4471e509868d088 Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AttachVolumeTestJSON-1292371232-project Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 could not be found. Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '7efe0544-de4c-4966-9e19-5ae73b5c5fe9'} Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 could not be found. Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 could not be found. Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:09:26.623175 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:26.627554 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:26.627554 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:09:26.627554 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:09:26.627554 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:09:26.627554 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:09:26.627554 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 could not be found. Jul 25 13:09:26.627554 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:26.627554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a2889058-9120-4e90-8459-ef0e65d7231a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Returning 404 to user: Instance 7efe0544-de4c-4966-9e19-5ae73b5c5fe9 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:09:26.627554 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a2889058-9120-4e90-8459-ef0e65d7231a tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9" status: 404 len: 111 microversion: 2.1 time: 0.122684 Jul 25 13:09:26.627554 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2604/5296] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:26 2022] GET /compute/v2.1/servers/7efe0544-de4c-4966-9e19-5ae73b5c5fe9 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 13:09:26.718515 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7422ca00-940c-4629-adab-0e993d0af4ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:26.719197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7422ca00-940c-4629-adab-0e993d0af4ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:26.734160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7422ca00-940c-4629-adab-0e993d0af4ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:26.734958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7422ca00-940c-4629-adab-0e993d0af4ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:26.737551 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7422ca00-940c-4629-adab-0e993d0af4ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:26.739871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7422ca00-940c-4629-adab-0e993d0af4ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:26.808172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:09:27.056536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8e820f1c-1987-41f7-902c-f30c44924f1d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:27.057185 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8e820f1c-1987-41f7-902c-f30c44924f1d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:27.074824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8e820f1c-1987-41f7-902c-f30c44924f1d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:27.075176 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8e820f1c-1987-41f7-902c-f30c44924f1d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:27.080251 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8e820f1c-1987-41f7-902c-f30c44924f1d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:27.081368 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8e820f1c-1987-41f7-902c-f30c44924f1d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:28.719028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7422ca00-940c-4629-adab-0e993d0af4ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:28.731901 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7422ca00-940c-4629-adab-0e993d0af4ca tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1683 microversion: 2.1 time: 2.016825 Jul 25 13:09:28.734608 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2693/5297] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:26 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1683 bytes in 2022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:28.753885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-169077d1-51a3-4567-a432-8a5e10adb96d tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:28.759071 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-169077d1-51a3-4567-a432-8a5e10adb96d tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:28.775438 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-169077d1-51a3-4567-a432-8a5e10adb96d tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:28.780895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-169077d1-51a3-4567-a432-8a5e10adb96d tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:28.782938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-169077d1-51a3-4567-a432-8a5e10adb96d tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:28.783540 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-169077d1-51a3-4567-a432-8a5e10adb96d tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:29.091720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8e820f1c-1987-41f7-902c-f30c44924f1d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:29.111922 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8e820f1c-1987-41f7-902c-f30c44924f1d tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1520 microversion: 2.1 time: 2.057889 Jul 25 13:09:29.114912 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2605/5298] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:27 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1520 bytes in 2064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:29.556449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-e62d1651-fa48-4c18-9a2e-8fd4400f3ecc req-9484be7d-52c2-4926-9ea4-389b5f92bf08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "202c4ace-9409-4007-943f-c38a0d108f46", "name": "network-vif-unplugged", "status": "completed", "tag": "384564b3-efda-41af-b265-0d12d529d0e0"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:09:29.579163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e62d1651-fa48-4c18-9a2e-8fd4400f3ecc req-9484be7d-52c2-4926-9ea4-389b5f92bf08 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:29.580349 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e62d1651-fa48-4c18-9a2e-8fd4400f3ecc req-9484be7d-52c2-4926-9ea4-389b5f92bf08 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:29.604227 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-e62d1651-fa48-4c18-9a2e-8fd4400f3ecc req-9484be7d-52c2-4926-9ea4-389b5f92bf08 service nova] Creating event network-vif-unplugged:384564b3-efda-41af-b265-0d12d529d0e0 for instance 202c4ace-9409-4007-943f-c38a0d108f46 on n-h1-848886-15 Jul 25 13:09:29.621108 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-e62d1651-fa48-4c18-9a2e-8fd4400f3ecc req-9484be7d-52c2-4926-9ea4-389b5f92bf08 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.495399 Jul 25 13:09:29.622067 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2606/5299] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:09:29.630754 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b4d227cb-4171-48ba-a2df-ad309850768b tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:29.635684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b4d227cb-4171-48ba-a2df-ad309850768b tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:29.669729 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4d227cb-4171-48ba-a2df-ad309850768b tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:29.670537 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4d227cb-4171-48ba-a2df-ad309850768b tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:29.676211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4d227cb-4171-48ba-a2df-ad309850768b tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:29.684412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4d227cb-4171-48ba-a2df-ad309850768b tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:29.769239 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4d227cb-4171-48ba-a2df-ad309850768b tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:29.769704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4d227cb-4171-48ba-a2df-ad309850768b tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:29.773260 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-b4d227cb-4171-48ba-a2df-ad309850768b tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lazy-loading 'fault' on Instance uuid 83ce5d82-2762-4aa7-855c-963a23f26665 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:09:29.881139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b4d227cb-4171-48ba-a2df-ad309850768b tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e6a20408894330b3b3734a455a078c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ef6028fa1c460b8cab5f7d9082abfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:29.894269 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b4d227cb-4171-48ba-a2df-ad309850768b tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 200 len: 1388 microversion: 2.1 time: 0.269033 Jul 25 13:09:29.896305 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2607/5300] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:29 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 1388 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:29.908210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-d9609284-ff8d-4d36-8518-d7dd1b441e8e req-6a81be27-c100-4ccf-b893-ba903410f25a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83ce5d82-2762-4aa7-855c-963a23f26665", "name": "network-vif-deleted", "tag": "35e7321c-7aa5-4daa-8504-c9f77811ff51"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:09:29.934901 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d9609284-ff8d-4d36-8518-d7dd1b441e8e req-6a81be27-c100-4ccf-b893-ba903410f25a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:29.935898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d9609284-ff8d-4d36-8518-d7dd1b441e8e req-6a81be27-c100-4ccf-b893-ba903410f25a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:29.965202 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-d9609284-ff8d-4d36-8518-d7dd1b441e8e req-6a81be27-c100-4ccf-b893-ba903410f25a service nova] Creating event network-vif-deleted:35e7321c-7aa5-4daa-8504-c9f77811ff51 for instance 83ce5d82-2762-4aa7-855c-963a23f26665 on n-h1-848886-15 Jul 25 13:09:29.980143 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-d9609284-ff8d-4d36-8518-d7dd1b441e8e req-6a81be27-c100-4ccf-b893-ba903410f25a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080976 Jul 25 13:09:29.981274 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2608/5301] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:09:30.039261 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-169077d1-51a3-4567-a432-8a5e10adb96d tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:30.060500 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-169077d1-51a3-4567-a432-8a5e10adb96d tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1524 microversion: 2.1 time: 1.322354 Jul 25 13:09:30.061802 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2694/5302] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:28 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1524 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:30.140110 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-777ea4c4-d482-4ce7-abe3-e7b4a2647c62 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:30.140744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-777ea4c4-d482-4ce7-abe3-e7b4a2647c62 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:30.148708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-777ea4c4-d482-4ce7-abe3-e7b4a2647c62 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:30.149164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-777ea4c4-d482-4ce7-abe3-e7b4a2647c62 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:30.150004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-777ea4c4-d482-4ce7-abe3-e7b4a2647c62 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:30.152744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-777ea4c4-d482-4ce7-abe3-e7b4a2647c62 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:30.195904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-fd8135c8-1d79-410c-af8e-fc43635dcfeb req-dbe4c823-4799-4118-b453-48be6108f100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a", "name": "network-vif-deleted", "tag": "2bb09fac-7b20-4053-a73f-18fa6c811b67"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:09:30.205267 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-777ea4c4-d482-4ce7-abe3-e7b4a2647c62 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:30.206721 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-777ea4c4-d482-4ce7-abe3-e7b4a2647c62 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:30.207388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-777ea4c4-d482-4ce7-abe3-e7b4a2647c62 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lazy-loading 'fault' on Instance uuid 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:09:30.213769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fd8135c8-1d79-410c-af8e-fc43635dcfeb req-dbe4c823-4799-4118-b453-48be6108f100 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:30.220598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fd8135c8-1d79-410c-af8e-fc43635dcfeb req-dbe4c823-4799-4118-b453-48be6108f100 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:30.263203 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-fd8135c8-1d79-410c-af8e-fc43635dcfeb req-dbe4c823-4799-4118-b453-48be6108f100 service nova] Creating event network-vif-deleted:2bb09fac-7b20-4053-a73f-18fa6c811b67 for instance 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a on n-h2-848886-15 Jul 25 13:09:30.268564 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-fd8135c8-1d79-410c-af8e-fc43635dcfeb req-dbe4c823-4799-4118-b453-48be6108f100 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.284242 Jul 25 13:09:30.269956 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2609/5303] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:09:30.595174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-777ea4c4-d482-4ce7-abe3-e7b4a2647c62 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f34c080e4a4024a38660e8af252a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791ac394f9f4b8d99d2f48f7d04eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:30.603447 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-777ea4c4-d482-4ce7-abe3-e7b4a2647c62 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 200 len: 1311 microversion: 2.1 time: 0.467129 Jul 25 13:09:30.611789 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2695/5304] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:30 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 1311 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:30.924774 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-09758a5f-48f5-43cf-aa2d-2235fe26380f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:30.925969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-09758a5f-48f5-43cf-aa2d-2235fe26380f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:30.937111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09758a5f-48f5-43cf-aa2d-2235fe26380f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:30.938720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09758a5f-48f5-43cf-aa2d-2235fe26380f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:30.940601 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09758a5f-48f5-43cf-aa2d-2235fe26380f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:30.941114 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09758a5f-48f5-43cf-aa2d-2235fe26380f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:30.966186 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-09758a5f-48f5-43cf-aa2d-2235fe26380f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] HTTP exception thrown: Instance 83ce5d82-2762-4aa7-855c-963a23f26665 could not be found. Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-09758a5f-48f5-43cf-aa2d-2235fe26380f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Request method failure captured: Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 HTTP/1.1 Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pSaPwR5WbqXZAJ4TofJZvSfGwiab8lnDH5NUIQy-yJ1xSpZwclbN4ZRNxnLFNvktECFQ9iXk6TlJdLjIaQbaOIxm_-Q9jaNHcLskucCoXXsN_sBL0KDqXqb0GU8Uz2IkZD8XNbztApfbKqz1f369Qn73MfBkEt59Pzh2PDcHIsgTm8 Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: d9ef6028fa1c460b8cab5f7d9082abfa Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-TestServerBasicOps-164266772 Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d9ef6028fa1c460b8cab5f7d9082abfa", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d9ef6028fa1c460b8cab5f7d9082abfa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d9ef6028fa1c460b8cab5f7d9082abfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d9ef6028fa1c460b8cab5f7d9082abfa"}]}] Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-TestServerBasicOps-164266772 Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: d9ef6028fa1c460b8cab5f7d9082abfa Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-TestServerBasicOps-164266772 Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-TestServerBasicOps-164266772-project Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 48e6a20408894330b3b3734a455a078c Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-TestServerBasicOps-164266772-project Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 83ce5d82-2762-4aa7-855c-963a23f26665 could not be found. Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '83ce5d82-2762-4aa7-855c-963a23f26665'} Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83ce5d82-2762-4aa7-855c-963a23f26665 could not be found. Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83ce5d82-2762-4aa7-855c-963a23f26665 could not be found. Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:09:30.969680 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:30.974047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:30.974047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:09:30.974047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:09:30.974047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:09:30.974047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:09:30.974047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83ce5d82-2762-4aa7-855c-963a23f26665 could not be found. Jul 25 13:09:30.974047 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:30.986821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-09758a5f-48f5-43cf-aa2d-2235fe26380f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Returning 404 to user: Instance 83ce5d82-2762-4aa7-855c-963a23f26665 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:09:30.993104 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-09758a5f-48f5-43cf-aa2d-2235fe26380f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 404 len: 111 microversion: 2.1 time: 0.073237 Jul 25 13:09:30.994519 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2610/5305] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:30 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:09:31.087500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-58193dcf-eda5-470e-88b1-59cb0fcff02a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:31.088949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-58193dcf-eda5-470e-88b1-59cb0fcff02a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:31.096888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58193dcf-eda5-470e-88b1-59cb0fcff02a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:31.097735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58193dcf-eda5-470e-88b1-59cb0fcff02a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:31.100680 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58193dcf-eda5-470e-88b1-59cb0fcff02a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:31.101629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58193dcf-eda5-470e-88b1-59cb0fcff02a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:31.469153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-58193dcf-eda5-470e-88b1-59cb0fcff02a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:31.478648 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-58193dcf-eda5-470e-88b1-59cb0fcff02a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1524 microversion: 2.1 time: 0.396210 Jul 25 13:09:31.487415 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2696/5306] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:31 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1524 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:31.632277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-454ab5b1-d406-4e24-9fd1-424a452ee876 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:31.632910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-454ab5b1-d406-4e24-9fd1-424a452ee876 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] [instance: 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:31.638983 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-04bbd581-f117-4503-bfdc-bf169772f35c req-622ab583-8197-432e-92d5-10197879755d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "202c4ace-9409-4007-943f-c38a0d108f46", "name": "network-vif-plugged", "status": "completed", "tag": "384564b3-efda-41af-b265-0d12d529d0e0"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:09:31.644686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-454ab5b1-d406-4e24-9fd1-424a452ee876 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:31.652596 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-454ab5b1-d406-4e24-9fd1-424a452ee876 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:31.654002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-454ab5b1-d406-4e24-9fd1-424a452ee876 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:31.654671 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-454ab5b1-d406-4e24-9fd1-424a452ee876 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:31.661086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-04bbd581-f117-4503-bfdc-bf169772f35c req-622ab583-8197-432e-92d5-10197879755d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:31.661537 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-04bbd581-f117-4503-bfdc-bf169772f35c req-622ab583-8197-432e-92d5-10197879755d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:31.679693 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-04bbd581-f117-4503-bfdc-bf169772f35c req-622ab583-8197-432e-92d5-10197879755d service nova] Creating event network-vif-plugged:384564b3-efda-41af-b265-0d12d529d0e0 for instance 202c4ace-9409-4007-943f-c38a0d108f46 on n-h1-848886-15 Jul 25 13:09:31.684712 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-454ab5b1-d406-4e24-9fd1-424a452ee876 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] HTTP exception thrown: Instance 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a could not be found. Jul 25 13:09:31.692873 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-04bbd581-f117-4503-bfdc-bf169772f35c req-622ab583-8197-432e-92d5-10197879755d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058205 Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-454ab5b1-d406-4e24-9fd1-424a452ee876 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Request method failure captured: Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a HTTP/1.1 Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pS2fizNtGcP0shojWUAR1ukudLDJRoXVlsPYG2HQcSlgo2We_QWqoULmyxY8IuKrW-0MGgmtrhM3h66oISYSRqIRFBaYspnVlW3g8FUdRvhwOpsGmp2Y9wrcYeXMJCu6fdAfgxIzqcJ6TFFh6UfkfCkGP1n9iDHq6IO37482VYIk-U Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: f791ac394f9f4b8d99d2f48f7d04eae9 Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f791ac394f9f4b8d99d2f48f7d04eae9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f791ac394f9f4b8d99d2f48f7d04eae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f791ac394f9f4b8d99d2f48f7d04eae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f791ac394f9f4b8d99d2f48f7d04eae9"}]}] Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: f791ac394f9f4b8d99d2f48f7d04eae9 Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1618399313 Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerRescueNegativeTestJSON-1618399313-project Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 72f34c080e4a4024a38660e8af252a29 Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1618399313-project Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a could not be found. Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a'} Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a could not be found. Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a could not be found. Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:31.693399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:09:31.697367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:31.697367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:31.697367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:09:31.697367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:09:31.697367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:09:31.697367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:09:31.697367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a could not be found. Jul 25 13:09:31.697367 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:31.697367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-454ab5b1-d406-4e24-9fd1-424a452ee876 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] Returning 404 to user: Instance 8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:09:31.697367 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-454ab5b1-d406-4e24-9fd1-424a452ee876 tempest-ServerRescueNegativeTestJSON-1618399313 tempest-ServerRescueNegativeTestJSON-1618399313-project] 10.222.0.49 "GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a" status: 404 len: 111 microversion: 2.1 time: 0.066931 Jul 25 13:09:31.701436 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2611/5307] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:31 2022] GET /compute/v2.1/servers/8b04b0a9-ebd7-4d0c-b6c6-7461f0bd0b9a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:09:31.702201 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2697/5308] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:09:32.325730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-22ca15d6-e4ab-42d9-8ed0-f2abb0333a29 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:32.326263 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-22ca15d6-e4ab-42d9-8ed0-f2abb0333a29 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:32.341430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22ca15d6-e4ab-42d9-8ed0-f2abb0333a29 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:32.344671 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22ca15d6-e4ab-42d9-8ed0-f2abb0333a29 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:32.357231 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22ca15d6-e4ab-42d9-8ed0-f2abb0333a29 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:32.360119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22ca15d6-e4ab-42d9-8ed0-f2abb0333a29 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:32.399536 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-22ca15d6-e4ab-42d9-8ed0-f2abb0333a29 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] HTTP exception thrown: Instance f1870a72-72de-47e8-8776-d342d9ece98e could not be found. Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-22ca15d6-e4ab-42d9-8ed0-f2abb0333a29 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Request method failure captured: Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e HTTP/1.1 Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pSCjjOUwJBu27M5A9MAS8o0O9uH59U0acLx6g4qcIv23mWGrrOjdt2IgvHoN5SP9_hokB-pDlt0bhwjuhztdf3OfFL8q2AxT_lIsoS4eI1n-QKNDGNhCYx3Rf762DwHeDuXOtp5hrUjGY9docgShhhp_Ocv4GQAeCWMuSoQhVJjgBY Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 4bb3fd31125b4879bd1f58cd3d1358a3 Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AttachVolumeTestJSON-1292371232 Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4bb3fd31125b4879bd1f58cd3d1358a3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4bb3fd31125b4879bd1f58cd3d1358a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4bb3fd31125b4879bd1f58cd3d1358a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4bb3fd31125b4879bd1f58cd3d1358a3"}]}] Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AttachVolumeTestJSON-1292371232 Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 4bb3fd31125b4879bd1f58cd3d1358a3 Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1292371232 Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AttachVolumeTestJSON-1292371232-project Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 3dc3da4ae9f444e7a4471e509868d088 Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AttachVolumeTestJSON-1292371232-project Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance f1870a72-72de-47e8-8776-d342d9ece98e could not be found. Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'f1870a72-72de-47e8-8776-d342d9ece98e'} Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1870a72-72de-47e8-8776-d342d9ece98e could not be found. Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:09:32.401249 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:09:32.409909 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1870a72-72de-47e8-8776-d342d9ece98e could not be found. Jul 25 13:09:32.409909 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:32.409909 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:09:32.409909 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:32.409909 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:32.409909 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:09:32.409909 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:09:32.409909 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:09:32.409909 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:09:32.409909 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1870a72-72de-47e8-8776-d342d9ece98e could not be found. Jul 25 13:09:32.409909 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:09:32.409909 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-22ca15d6-e4ab-42d9-8ed0-f2abb0333a29 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Returning 404 to user: Instance f1870a72-72de-47e8-8776-d342d9ece98e could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:09:32.409909 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-22ca15d6-e4ab-42d9-8ed0-f2abb0333a29 tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 404 len: 111 microversion: 2.1 time: 0.080903 Jul 25 13:09:32.409909 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2612/5309] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:09:32 2022] DELETE /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:09:32.414371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5d5831f0-fa0c-4c8f-88e1-c0a885d29e0b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:32.415624 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5d5831f0-fa0c-4c8f-88e1-c0a885d29e0b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] [instance: f1870a72-72de-47e8-8776-d342d9ece98e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:32.432144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d5831f0-fa0c-4c8f-88e1-c0a885d29e0b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:32.436049 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d5831f0-fa0c-4c8f-88e1-c0a885d29e0b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:32.437146 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d5831f0-fa0c-4c8f-88e1-c0a885d29e0b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:32.439949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d5831f0-fa0c-4c8f-88e1-c0a885d29e0b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:32.493162 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-5d5831f0-fa0c-4c8f-88e1-c0a885d29e0b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] HTTP exception thrown: Instance f1870a72-72de-47e8-8776-d342d9ece98e could not be found. Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5d5831f0-fa0c-4c8f-88e1-c0a885d29e0b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Request method failure captured: Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e HTTP/1.1 Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pSCjjOUwJBu27M5A9MAS8o0O9uH59U0acLx6g4qcIv23mWGrrOjdt2IgvHoN5SP9_hokB-pDlt0bhwjuhztdf3OfFL8q2AxT_lIsoS4eI1n-QKNDGNhCYx3Rf762DwHeDuXOtp5hrUjGY9docgShhhp_Ocv4GQAeCWMuSoQhVJjgBY Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 4bb3fd31125b4879bd1f58cd3d1358a3 Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-AttachVolumeTestJSON-1292371232 Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4bb3fd31125b4879bd1f58cd3d1358a3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4bb3fd31125b4879bd1f58cd3d1358a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4bb3fd31125b4879bd1f58cd3d1358a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4bb3fd31125b4879bd1f58cd3d1358a3"}]}] Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-AttachVolumeTestJSON-1292371232 Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 4bb3fd31125b4879bd1f58cd3d1358a3 Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1292371232 Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-AttachVolumeTestJSON-1292371232-project Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 3dc3da4ae9f444e7a4471e509868d088 Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-AttachVolumeTestJSON-1292371232-project Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance f1870a72-72de-47e8-8776-d342d9ece98e could not be found. Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'f1870a72-72de-47e8-8776-d342d9ece98e'} Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1870a72-72de-47e8-8776-d342d9ece98e could not be found. Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1870a72-72de-47e8-8776-d342d9ece98e could not be found. Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:09:32.499884 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:32.504441 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:32.504441 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:09:32.504441 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:09:32.504441 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:09:32.504441 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:09:32.504441 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1870a72-72de-47e8-8776-d342d9ece98e could not be found. Jul 25 13:09:32.504441 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:32.504441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5d5831f0-fa0c-4c8f-88e1-c0a885d29e0b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] Returning 404 to user: Instance f1870a72-72de-47e8-8776-d342d9ece98e could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:09:32.504441 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5d5831f0-fa0c-4c8f-88e1-c0a885d29e0b tempest-AttachVolumeTestJSON-1292371232 tempest-AttachVolumeTestJSON-1292371232-project] 10.222.0.49 "GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e" status: 404 len: 111 microversion: 2.1 time: 0.093194 Jul 25 13:09:32.509767 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2698/5310] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:32 2022] GET /compute/v2.1/servers/f1870a72-72de-47e8-8776-d342d9ece98e => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:09:32.510887 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b94a5c01-2a41-46de-8bda-0e24a97cf766 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:32.511518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b94a5c01-2a41-46de-8bda-0e24a97cf766 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:32.522452 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b94a5c01-2a41-46de-8bda-0e24a97cf766 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:32.523181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b94a5c01-2a41-46de-8bda-0e24a97cf766 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:32.523987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b94a5c01-2a41-46de-8bda-0e24a97cf766 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:32.524433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b94a5c01-2a41-46de-8bda-0e24a97cf766 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:32.754864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e8f7ddb8-41ee-40c5-8124-4ff049b60ec6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:32.755171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e8f7ddb8-41ee-40c5-8124-4ff049b60ec6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:32.765631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8f7ddb8-41ee-40c5-8124-4ff049b60ec6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:32.766118 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8f7ddb8-41ee-40c5-8124-4ff049b60ec6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:32.766904 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8f7ddb8-41ee-40c5-8124-4ff049b60ec6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:32.772636 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e8f7ddb8-41ee-40c5-8124-4ff049b60ec6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:32.808012 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-e8f7ddb8-41ee-40c5-8124-4ff049b60ec6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] HTTP exception thrown: Instance 83ce5d82-2762-4aa7-855c-963a23f26665 could not be found. Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e8f7ddb8-41ee-40c5-8124-4ff049b60ec6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Request method failure captured: Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 HTTP/1.1 Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pSaPwR5WbqXZAJ4TofJZvSfGwiab8lnDH5NUIQy-yJ1xSpZwclbN4ZRNxnLFNvktECFQ9iXk6TlJdLjIaQbaOIxm_-Q9jaNHcLskucCoXXsN_sBL0KDqXqb0GU8Uz2IkZD8XNbztApfbKqz1f369Qn73MfBkEt59Pzh2PDcHIsgTm8 Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d9ef6028fa1c460b8cab5f7d9082abfa Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestServerBasicOps-164266772 Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d9ef6028fa1c460b8cab5f7d9082abfa", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d9ef6028fa1c460b8cab5f7d9082abfa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d9ef6028fa1c460b8cab5f7d9082abfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d9ef6028fa1c460b8cab5f7d9082abfa"}]}] Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestServerBasicOps-164266772 Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d9ef6028fa1c460b8cab5f7d9082abfa Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestServerBasicOps-164266772 Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestServerBasicOps-164266772-project Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 48e6a20408894330b3b3734a455a078c Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestServerBasicOps-164266772-project Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 83ce5d82-2762-4aa7-855c-963a23f26665 could not be found. Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '83ce5d82-2762-4aa7-855c-963a23f26665'} Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83ce5d82-2762-4aa7-855c-963a23f26665 could not be found. Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:09:32.810831 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83ce5d82-2762-4aa7-855c-963a23f26665 could not be found. Jul 25 13:09:32.814669 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:32.814669 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:09:32.814669 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:32.814669 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:32.814669 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:09:32.814669 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:09:32.814669 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:09:32.814669 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:09:32.814669 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83ce5d82-2762-4aa7-855c-963a23f26665 could not be found. Jul 25 13:09:32.814669 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:32.818713 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e8f7ddb8-41ee-40c5-8124-4ff049b60ec6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Returning 404 to user: Instance 83ce5d82-2762-4aa7-855c-963a23f26665 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:09:32.820153 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e8f7ddb8-41ee-40c5-8124-4ff049b60ec6 tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "DELETE /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 404 len: 111 microversion: 2.1 time: 0.070815 Jul 25 13:09:32.821338 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2699/5311] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:09:32 2022] DELETE /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 13:09:32.843816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d03e9a8c-af8a-4b2d-8783-02866d52451f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:32.846134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d03e9a8c-af8a-4b2d-8783-02866d52451f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] [instance: 83ce5d82-2762-4aa7-855c-963a23f26665] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:32.862687 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d03e9a8c-af8a-4b2d-8783-02866d52451f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:32.863140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d03e9a8c-af8a-4b2d-8783-02866d52451f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:32.864113 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d03e9a8c-af8a-4b2d-8783-02866d52451f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:32.865100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d03e9a8c-af8a-4b2d-8783-02866d52451f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:32.901083 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-d03e9a8c-af8a-4b2d-8783-02866d52451f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] HTTP exception thrown: Instance 83ce5d82-2762-4aa7-855c-963a23f26665 could not be found. Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d03e9a8c-af8a-4b2d-8783-02866d52451f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Request method failure captured: Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 HTTP/1.1 Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pSaPwR5WbqXZAJ4TofJZvSfGwiab8lnDH5NUIQy-yJ1xSpZwclbN4ZRNxnLFNvktECFQ9iXk6TlJdLjIaQbaOIxm_-Q9jaNHcLskucCoXXsN_sBL0KDqXqb0GU8Uz2IkZD8XNbztApfbKqz1f369Qn73MfBkEt59Pzh2PDcHIsgTm8 Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: d9ef6028fa1c460b8cab5f7d9082abfa Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestServerBasicOps-164266772 Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d9ef6028fa1c460b8cab5f7d9082abfa", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d9ef6028fa1c460b8cab5f7d9082abfa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d9ef6028fa1c460b8cab5f7d9082abfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d9ef6028fa1c460b8cab5f7d9082abfa"}]}] Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestServerBasicOps-164266772 Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: d9ef6028fa1c460b8cab5f7d9082abfa Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestServerBasicOps-164266772 Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestServerBasicOps-164266772-project Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 48e6a20408894330b3b3734a455a078c Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestServerBasicOps-164266772-project Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 83ce5d82-2762-4aa7-855c-963a23f26665 could not be found. Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '83ce5d82-2762-4aa7-855c-963a23f26665'} Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83ce5d82-2762-4aa7-855c-963a23f26665 could not be found. Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83ce5d82-2762-4aa7-855c-963a23f26665 could not be found. Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:09:32.903011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:32.915991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:09:32.915991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:09:32.915991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:09:32.915991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:09:32.915991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:09:32.915991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83ce5d82-2762-4aa7-855c-963a23f26665 could not be found. Jul 25 13:09:32.915991 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:09:32.915991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d03e9a8c-af8a-4b2d-8783-02866d52451f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Returning 404 to user: Instance 83ce5d82-2762-4aa7-855c-963a23f26665 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:09:32.915991 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d03e9a8c-af8a-4b2d-8783-02866d52451f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665" status: 404 len: 111 microversion: 2.1 time: 0.082718 Jul 25 13:09:32.915991 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2700/5312] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:32 2022] GET /compute/v2.1/servers/83ce5d82-2762-4aa7-855c-963a23f26665 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:09:33.303931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b94a5c01-2a41-46de-8bda-0e24a97cf766 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:33.317993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5b57c637-cacf-41e5-af11-112936dc509f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] Calling method '.version_select at 0x7efcf889eb80>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:33.320485 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b94a5c01-2a41-46de-8bda-0e24a97cf766 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1504 microversion: 2.1 time: 0.814363 Jul 25 13:09:33.321026 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2613/5313] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:32 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1504 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:33.334742 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:09:33.347364 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9429314d-1c73-4cd5-976f-f3911344cd77 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Action: 'create', calling method: .version_select at 0x7efcf83e5430>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1530835277", "description": "tempest-description-988029963"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:09:33.359476 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5b57c637-cacf-41e5-af11-112936dc509f tempest-TestServerBasicOps-164266772 tempest-TestServerBasicOps-164266772-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1160942223" status: 202 len: 0 microversion: 2.1 time: 0.045380 Jul 25 13:09:33.362288 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2701/5314] 10.222.0.49 () {58 vars in 1254 bytes} [Mon Jul 25 13:09:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1160942223 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:09:33.626209 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9429314d-1c73-4cd5-976f-f3911344cd77 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.283885 Jul 25 13:09:33.627003 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2614/5315] 10.222.0.49 () {60 vars in 1180 bytes} [Mon Jul 25 13:09:33 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:09:33.642219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4f6a3241-2ffc-446a-bccb-07fba7c0918a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1530835277"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:09:33.643354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4f6a3241-2ffc-446a-bccb-07fba7c0918a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:33.663915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f6a3241-2ffc-446a-bccb-07fba7c0918a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:33.664644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f6a3241-2ffc-446a-bccb-07fba7c0918a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:33.665691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f6a3241-2ffc-446a-bccb-07fba7c0918a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:33.666401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f6a3241-2ffc-446a-bccb-07fba7c0918a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:34.125861 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.network.security_group_api [None req-4f6a3241-2ffc-446a-bccb-07fba7c0918a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Adding security group 474d3e7e-da73-4f38-8640-23866b12f252 to port 9d3b39d1-8690-4827-8fe3-5f59fcd60174 Jul 25 13:09:34.730153 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4f6a3241-2ffc-446a-bccb-07fba7c0918a tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "POST /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006/action" status: 202 len: 0 microversion: 2.1 time: 1.094393 Jul 25 13:09:34.734552 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2702/5316] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:09:33 2022] POST /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006/action => generated 0 bytes in 1100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:09:34.744298 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8b5a4534-6ed9-4856-8be0-ee4af3ddc755 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1530835277"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:09:34.745264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8b5a4534-6ed9-4856-8be0-ee4af3ddc755 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:34.746598 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-f8c80532-f61e-4fdf-a524-018de2f18673 req-c14f2a20-b283-419c-8d67-36e26522694c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b2f025-146e-4ca4-bb43-be3cd6dae006", "tag": "9d3b39d1-8690-4827-8fe3-5f59fcd60174"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:09:34.751901 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:09:34.767330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f8c80532-f61e-4fdf-a524-018de2f18673 req-c14f2a20-b283-419c-8d67-36e26522694c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:34.767768 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f8c80532-f61e-4fdf-a524-018de2f18673 req-c14f2a20-b283-419c-8d67-36e26522694c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:34.773894 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b5a4534-6ed9-4856-8be0-ee4af3ddc755 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:34.774769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b5a4534-6ed9-4856-8be0-ee4af3ddc755 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:34.776060 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b5a4534-6ed9-4856-8be0-ee4af3ddc755 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:34.779633 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b5a4534-6ed9-4856-8be0-ee4af3ddc755 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:34.806017 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-f8c80532-f61e-4fdf-a524-018de2f18673 req-c14f2a20-b283-419c-8d67-36e26522694c service nova] Creating event network-changed:9d3b39d1-8690-4827-8fe3-5f59fcd60174 for instance 58b2f025-146e-4ca4-bb43-be3cd6dae006 on n-h2-848886-15 Jul 25 13:09:34.823555 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-f8c80532-f61e-4fdf-a524-018de2f18673 req-c14f2a20-b283-419c-8d67-36e26522694c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081125 Jul 25 13:09:34.824711 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2703/5317] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:09:35.632630 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.network.security_group_api [None req-8b5a4534-6ed9-4856-8be0-ee4af3ddc755 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Removing security group 474d3e7e-da73-4f38-8640-23866b12f252 from port 9d3b39d1-8690-4827-8fe3-5f59fcd60174 Jul 25 13:09:38.196242 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8b5a4534-6ed9-4856-8be0-ee4af3ddc755 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "POST /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006/action" status: 202 len: 0 microversion: 2.1 time: 3.460064 Jul 25 13:09:38.197612 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2615/5318] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:09:34 2022] POST /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006/action => generated 0 bytes in 3463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:09:38.210001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-408ca2ac-d1a4-444f-810e-287ca12e71d6 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Action: 'create', calling method: .version_select at 0x7efcf888b8b0>, body: {"pool": null} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:09:38.229276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-3f42d5ba-0270-4334-85e8-dabfe704c1e2 req-ea5b71ae-6826-49f5-b578-4058450730aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b2f025-146e-4ca4-bb43-be3cd6dae006", "tag": "9d3b39d1-8690-4827-8fe3-5f59fcd60174"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:09:38.254926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-3f42d5ba-0270-4334-85e8-dabfe704c1e2 req-ea5b71ae-6826-49f5-b578-4058450730aa service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:38.255368 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-3f42d5ba-0270-4334-85e8-dabfe704c1e2 req-ea5b71ae-6826-49f5-b578-4058450730aa service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:38.282269 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-3f42d5ba-0270-4334-85e8-dabfe704c1e2 req-ea5b71ae-6826-49f5-b578-4058450730aa service nova] Creating event network-changed:9d3b39d1-8690-4827-8fe3-5f59fcd60174 for instance 58b2f025-146e-4ca4-bb43-be3cd6dae006 on n-h2-848886-15 Jul 25 13:09:38.300616 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-3f42d5ba-0270-4334-85e8-dabfe704c1e2 req-ea5b71ae-6826-49f5-b578-4058450730aa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074924 Jul 25 13:09:38.301249 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2616/5319] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:09:42.768325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2e32c111-886c-4d72-aee3-0a1473d68121 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-798928256", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f2668901-e422-4995-a5ac-40f00b691986", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "2e9a011a-2cfb-4a86-9ca1-b23997eebbe8"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:09:42.913069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-2e32c111-886c-4d72-aee3-0a1473d68121 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] validate_networks() for [('2e9a011a-2cfb-4a86-9ca1-b23997eebbe8', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:09:43.464625 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-408ca2ac-d1a4-444f-810e-287ca12e71d6 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.259675 Jul 25 13:09:43.473561 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2704/5320] 10.222.0.49 () {60 vars in 1170 bytes} [Mon Jul 25 13:09:38 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:09:43.479860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-220c9594-1009-4d1c-a1b8-f6e128dd3755 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.207"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:09:43.488841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-220c9594-1009-4d1c-a1b8-f6e128dd3755 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:43.504777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-220c9594-1009-4d1c-a1b8-f6e128dd3755 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:43.505324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-220c9594-1009-4d1c-a1b8-f6e128dd3755 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:43.507635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-220c9594-1009-4d1c-a1b8-f6e128dd3755 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:43.508988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-220c9594-1009-4d1c-a1b8-f6e128dd3755 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:43.544826 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-220c9594-1009-4d1c-a1b8-f6e128dd3755 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Acquired lock "refresh_cache-58b2f025-146e-4ca4-bb43-be3cd6dae006" {{(pid=125884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 13:09:44.972389 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2e32c111-886c-4d72-aee3-0a1473d68121 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:09:44.972809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2e32c111-886c-4d72-aee3-0a1473d68121 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:09:44.973293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2e32c111-886c-4d72-aee3-0a1473d68121 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:09:44.973705 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2e32c111-886c-4d72-aee3-0a1473d68121 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:09:44.974155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2e32c111-886c-4d72-aee3-0a1473d68121 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:09:45.015809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e32c111-886c-4d72-aee3-0a1473d68121 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:45.018910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e32c111-886c-4d72-aee3-0a1473d68121 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:45.021979 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e32c111-886c-4d72-aee3-0a1473d68121 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:45.025598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e32c111-886c-4d72-aee3-0a1473d68121 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:45.054061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:09:45.103785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-2e32c111-886c-4d72-aee3-0a1473d68121 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Getting quotas for project b2fbd681752c41d0a24a9cf34ebc8389. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:09:45.121644 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-2e32c111-886c-4d72-aee3-0a1473d68121 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Getting quotas for user 9face2aaa9df430cb5d361c6e1fdf242 and project b2fbd681752c41d0a24a9cf34ebc8389. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:09:45.260935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2e32c111-886c-4d72-aee3-0a1473d68121 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:09:45.263853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2e32c111-886c-4d72-aee3-0a1473d68121 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f2668901-e422-4995-a5ac-40f00b691986',volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:09:45.563110 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2e32c111-886c-4d72-aee3-0a1473d68121 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.800024 Jul 25 13:09:45.563790 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2617/5321] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:09:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 13:09:45.575317 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-94c3bcba-df3d-446d-a13b-61e63ca2b758 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:45.575959 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-94c3bcba-df3d-446d-a13b-61e63ca2b758 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:45.706962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-94c3bcba-df3d-446d-a13b-61e63ca2b758 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:45.715099 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-94c3bcba-df3d-446d-a13b-61e63ca2b758 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1070 microversion: 2.1 time: 0.143665 Jul 25 13:09:45.717622 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2618/5322] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:45 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1070 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:46.190012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-220c9594-1009-4d1c-a1b8-f6e128dd3755 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Building network info cache for instance {{(pid=125884) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 13:09:46.203682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-3586a75d-890e-4de6-834f-5fef9af6b62f req-5a1b5bce-e746-4e0d-b47e-2099ad964c6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b2f025-146e-4ca4-bb43-be3cd6dae006", "tag": "9d3b39d1-8690-4827-8fe3-5f59fcd60174"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:09:46.249499 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-3586a75d-890e-4de6-834f-5fef9af6b62f req-5a1b5bce-e746-4e0d-b47e-2099ad964c6b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:46.252005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-3586a75d-890e-4de6-834f-5fef9af6b62f req-5a1b5bce-e746-4e0d-b47e-2099ad964c6b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:46.296744 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-3586a75d-890e-4de6-834f-5fef9af6b62f req-5a1b5bce-e746-4e0d-b47e-2099ad964c6b service nova] Creating event network-changed:9d3b39d1-8690-4827-8fe3-5f59fcd60174 for instance 58b2f025-146e-4ca4-bb43-be3cd6dae006 on n-h2-848886-15 Jul 25 13:09:46.308468 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-3586a75d-890e-4de6-834f-5fef9af6b62f req-5a1b5bce-e746-4e0d-b47e-2099ad964c6b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110492 Jul 25 13:09:46.312078 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2619/5323] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:09:46.737504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7d57b009-5f51-438c-bdb2-261c6e5fdc02 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:46.738617 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7d57b009-5f51-438c-bdb2-261c6e5fdc02 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:46.749842 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7d57b009-5f51-438c-bdb2-261c6e5fdc02 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:46.750581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7d57b009-5f51-438c-bdb2-261c6e5fdc02 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:46.751550 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7d57b009-5f51-438c-bdb2-261c6e5fdc02 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:46.752144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7d57b009-5f51-438c-bdb2-261c6e5fdc02 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:46.972140 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7d57b009-5f51-438c-bdb2-261c6e5fdc02 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:46.991841 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7d57b009-5f51-438c-bdb2-261c6e5fdc02 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1168 microversion: 2.1 time: 0.253889 Jul 25 13:09:47.006693 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2620/5324] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:46 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1168 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:09:48.014586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-48b75fb9-9f69-4e60-8769-787a696ec784 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:48.015980 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-48b75fb9-9f69-4e60-8769-787a696ec784 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:48.035233 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48b75fb9-9f69-4e60-8769-787a696ec784 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:48.036145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48b75fb9-9f69-4e60-8769-787a696ec784 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:48.037129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48b75fb9-9f69-4e60-8769-787a696ec784 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:48.037742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48b75fb9-9f69-4e60-8769-787a696ec784 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:48.208141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-48b75fb9-9f69-4e60-8769-787a696ec784 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:48.216024 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-48b75fb9-9f69-4e60-8769-787a696ec784 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1186 microversion: 2.1 time: 0.206326 Jul 25 13:09:48.229215 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2621/5325] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:48 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1186 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:48.681759 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-220c9594-1009-4d1c-a1b8-f6e128dd3755 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Updating instance_info_cache with network_info: [{"id": "9d3b39d1-8690-4827-8fe3-5f59fcd60174", "address": "fa:16:3e:2d:0e:47", "network": {"id": "c98553ca-6019-4e4a-8de4-f4a4edf93d80", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1943603076-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f152f46129a64fa48cfad35d5fd1073c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9d3b39d1-86", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125884) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 13:09:48.706548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-220c9594-1009-4d1c-a1b8-f6e128dd3755 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Releasing lock "refresh_cache-58b2f025-146e-4ca4-bb43-be3cd6dae006" {{(pid=125884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 13:09:48.707439 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-220c9594-1009-4d1c-a1b8-f6e128dd3755 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "POST /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006/action" status: 202 len: 0 microversion: 2.1 time: 5.233966 Jul 25 13:09:48.708405 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2705/5326] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:09:43 2022] POST /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006/action => generated 0 bytes in 5235 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jul 25 13:09:48.716527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f43785f8-32f9-477d-8a89-bc842e784acf tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.207"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:09:49.236733 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2aabe54c-a6be-484c-80a2-5522f35faa45 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:49.237373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2aabe54c-a6be-484c-80a2-5522f35faa45 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:49.253684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2aabe54c-a6be-484c-80a2-5522f35faa45 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:49.254178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2aabe54c-a6be-484c-80a2-5522f35faa45 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:49.254977 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2aabe54c-a6be-484c-80a2-5522f35faa45 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:49.264632 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2aabe54c-a6be-484c-80a2-5522f35faa45 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:49.542240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2aabe54c-a6be-484c-80a2-5522f35faa45 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:49.557450 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2aabe54c-a6be-484c-80a2-5522f35faa45 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1186 microversion: 2.1 time: 0.324568 Jul 25 13:09:49.563299 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2706/5327] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:49 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1186 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:49.877270 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f43785f8-32f9-477d-8a89-bc842e784acf tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:49.889095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f43785f8-32f9-477d-8a89-bc842e784acf tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:49.890775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f43785f8-32f9-477d-8a89-bc842e784acf tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:49.893952 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f43785f8-32f9-477d-8a89-bc842e784acf tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:49.896991 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f43785f8-32f9-477d-8a89-bc842e784acf tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:50.298518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f43785f8-32f9-477d-8a89-bc842e784acf tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Acquired lock "refresh_cache-58b2f025-146e-4ca4-bb43-be3cd6dae006" {{(pid=125883) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 13:09:50.584859 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d797ace5-dfe8-4539-aa4e-680cef55a6cd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:50.586231 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d797ace5-dfe8-4539-aa4e-680cef55a6cd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:50.601488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d797ace5-dfe8-4539-aa4e-680cef55a6cd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:50.603088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d797ace5-dfe8-4539-aa4e-680cef55a6cd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:50.605291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d797ace5-dfe8-4539-aa4e-680cef55a6cd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:50.606955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d797ace5-dfe8-4539-aa4e-680cef55a6cd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:52.300405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d797ace5-dfe8-4539-aa4e-680cef55a6cd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:52.308575 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d797ace5-dfe8-4539-aa4e-680cef55a6cd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1228 microversion: 2.1 time: 1.729704 Jul 25 13:09:52.309164 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2707/5328] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:50 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1228 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:52.318796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1dca3961-78c5-4381-a507-423db73e4f4d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:09:52.324228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1dca3961-78c5-4381-a507-423db73e4f4d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:52.337286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dca3961-78c5-4381-a507-423db73e4f4d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:52.337809 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dca3961-78c5-4381-a507-423db73e4f4d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:52.344817 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dca3961-78c5-4381-a507-423db73e4f4d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:52.346356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dca3961-78c5-4381-a507-423db73e4f4d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:52.440110 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1dca3961-78c5-4381-a507-423db73e4f4d tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "POST /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46/action" status: 200 len: 24572 microversion: 2.1 time: 0.124849 Jul 25 13:09:52.440762 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2708/5329] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:09:52 2022] POST /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46/action => generated 24572 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:09:53.334167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3bb4ec4b-ae49-4e33-8059-af8e75a5ec35 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:53.336936 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3bb4ec4b-ae49-4e33-8059-af8e75a5ec35 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:53.355490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3bb4ec4b-ae49-4e33-8059-af8e75a5ec35 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:53.357967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3bb4ec4b-ae49-4e33-8059-af8e75a5ec35 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:53.358830 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3bb4ec4b-ae49-4e33-8059-af8e75a5ec35 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:53.360307 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3bb4ec4b-ae49-4e33-8059-af8e75a5ec35 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:54.206226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3bb4ec4b-ae49-4e33-8059-af8e75a5ec35 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:54.223589 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3bb4ec4b-ae49-4e33-8059-af8e75a5ec35 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1228 microversion: 2.1 time: 0.893574 Jul 25 13:09:54.224493 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2709/5330] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:53 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1228 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:54.748718 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-f43785f8-32f9-477d-8a89-bc842e784acf tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Building network info cache for instance {{(pid=125883) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 13:09:54.795942 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-e391a9e8-519e-4c9b-ad3a-a71d60e504dc req-df955a65-3357-4c49-9911-109ad7e9dddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e801a411-aba7-43d5-a366-924c4f035471", "tag": "c29620ab-f7fc-428e-b6e7-7cc77b0cd0e9"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:09:54.814113 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e391a9e8-519e-4c9b-ad3a-a71d60e504dc req-df955a65-3357-4c49-9911-109ad7e9dddd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:54.818224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e391a9e8-519e-4c9b-ad3a-a71d60e504dc req-df955a65-3357-4c49-9911-109ad7e9dddd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:54.847704 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-e391a9e8-519e-4c9b-ad3a-a71d60e504dc req-df955a65-3357-4c49-9911-109ad7e9dddd service nova] Creating event network-changed:c29620ab-f7fc-428e-b6e7-7cc77b0cd0e9 for instance e801a411-aba7-43d5-a366-924c4f035471 on n-h1-848886-15 Jul 25 13:09:54.857925 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-e391a9e8-519e-4c9b-ad3a-a71d60e504dc req-df955a65-3357-4c49-9911-109ad7e9dddd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.556242 Jul 25 13:09:54.859254 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2710/5331] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:09:54.872009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-f7fce197-25eb-490c-8ba9-18821609398b req-551c5801-bb9c-49c0-be81-3b23dec1f5ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b2f025-146e-4ca4-bb43-be3cd6dae006", "tag": "9d3b39d1-8690-4827-8fe3-5f59fcd60174"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:09:54.918529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f7fce197-25eb-490c-8ba9-18821609398b req-551c5801-bb9c-49c0-be81-3b23dec1f5ce service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:54.921703 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f7fce197-25eb-490c-8ba9-18821609398b req-551c5801-bb9c-49c0-be81-3b23dec1f5ce service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:54.959744 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-f7fce197-25eb-490c-8ba9-18821609398b req-551c5801-bb9c-49c0-be81-3b23dec1f5ce service nova] Creating event network-changed:9d3b39d1-8690-4827-8fe3-5f59fcd60174 for instance 58b2f025-146e-4ca4-bb43-be3cd6dae006 on n-h2-848886-15 Jul 25 13:09:54.975180 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-f7fce197-25eb-490c-8ba9-18821609398b req-551c5801-bb9c-49c0-be81-3b23dec1f5ce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113437 Jul 25 13:09:54.983029 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2711/5332] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:09:55.055450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:09:55.251691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-963babc4-6c38-48aa-9d4d-f807c1d87cf2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:55.252710 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-963babc4-6c38-48aa-9d4d-f807c1d87cf2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:55.277493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-963babc4-6c38-48aa-9d4d-f807c1d87cf2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:55.281562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-963babc4-6c38-48aa-9d4d-f807c1d87cf2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:55.288174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-963babc4-6c38-48aa-9d4d-f807c1d87cf2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:55.291383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-963babc4-6c38-48aa-9d4d-f807c1d87cf2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:55.711116 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=8 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:09:56.359529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-963babc4-6c38-48aa-9d4d-f807c1d87cf2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:56.376048 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-963babc4-6c38-48aa-9d4d-f807c1d87cf2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1228 microversion: 2.1 time: 1.130180 Jul 25 13:09:56.377088 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2712/5333] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:55 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1228 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:09:57.401249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f1d5de80-400b-454c-9355-deaabb62c0fa tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:57.402165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f1d5de80-400b-454c-9355-deaabb62c0fa tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:57.414767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f1d5de80-400b-454c-9355-deaabb62c0fa tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:57.415217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f1d5de80-400b-454c-9355-deaabb62c0fa tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:57.428909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f1d5de80-400b-454c-9355-deaabb62c0fa tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:57.429550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f1d5de80-400b-454c-9355-deaabb62c0fa tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:57.432844 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=78,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:09:57.867985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-f43785f8-32f9-477d-8a89-bc842e784acf tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Updating instance_info_cache with network_info: [{"id": "9d3b39d1-8690-4827-8fe3-5f59fcd60174", "address": "fa:16:3e:2d:0e:47", "network": {"id": "c98553ca-6019-4e4a-8de4-f4a4edf93d80", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1943603076-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f152f46129a64fa48cfad35d5fd1073c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9d3b39d1-86", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125883) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 13:09:57.884877 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f43785f8-32f9-477d-8a89-bc842e784acf tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Releasing lock "refresh_cache-58b2f025-146e-4ca4-bb43-be3cd6dae006" {{(pid=125883) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 13:09:57.886771 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f43785f8-32f9-477d-8a89-bc842e784acf tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "POST /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006/action" status: 202 len: 0 microversion: 2.1 time: 9.173346 Jul 25 13:09:57.887386 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2622/5334] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:09:48 2022] POST /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006/action => generated 0 bytes in 9176 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 13:09:57.907183 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cd50c714-56fe-4d3f-a08f-0d1117c5ad5b tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '.version_select at 0x7efcf911fca0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:57.996325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f1d5de80-400b-454c-9355-deaabb62c0fa tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:58.007535 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f1d5de80-400b-454c-9355-deaabb62c0fa tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1216 microversion: 2.1 time: 0.610796 Jul 25 13:09:58.009907 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2713/5335] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:57 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1216 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:09:59.029576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-07853021-9e14-4b4b-999c-9c3609ce2bd0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:09:59.030284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-07853021-9e14-4b4b-999c-9c3609ce2bd0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:09:59.049262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07853021-9e14-4b4b-999c-9c3609ce2bd0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:59.049707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07853021-9e14-4b4b-999c-9c3609ce2bd0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:59.050528 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07853021-9e14-4b4b-999c-9c3609ce2bd0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:09:59.050973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07853021-9e14-4b4b-999c-9c3609ce2bd0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:09:59.830523 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-07853021-9e14-4b4b-999c-9c3609ce2bd0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:09:59.850245 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-07853021-9e14-4b4b-999c-9c3609ce2bd0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1216 microversion: 2.1 time: 0.824395 Jul 25 13:09:59.851252 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2714/5336] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:09:59 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1216 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:09:59.884799 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:10:00.155866 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cd50c714-56fe-4d3f-a08f-0d1117c5ad5b tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/c679b281-9075-41a5-aaf9-0d410d5748b4" status: 202 len: 0 microversion: 2.1 time: 2.263482 Jul 25 13:10:00.156997 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2623/5337] 10.222.0.49 () {58 vars in 1263 bytes} [Mon Jul 25 13:09:57 2022] DELETE /compute/v2.1/os-floating-ips/c679b281-9075-41a5-aaf9-0d410d5748b4 => generated 0 bytes in 2265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:10:00.167890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7ab61d44-0301-43e9-a468-7026d6127bae tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '.version_select at 0x7efcf8947a60>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:00.874374 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8411e66e-a648-4915-b1a2-95599f6f5f60 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:00.875612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8411e66e-a648-4915-b1a2-95599f6f5f60 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:00.893512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8411e66e-a648-4915-b1a2-95599f6f5f60 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:00.907878 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8411e66e-a648-4915-b1a2-95599f6f5f60 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:00.911396 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8411e66e-a648-4915-b1a2-95599f6f5f60 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:00.915152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8411e66e-a648-4915-b1a2-95599f6f5f60 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:01.442673 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7ab61d44-0301-43e9-a468-7026d6127bae tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/474d3e7e-da73-4f38-8640-23866b12f252" status: 202 len: 0 microversion: 2.1 time: 1.279020 Jul 25 13:10:01.444474 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2715/5338] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 13:10:00 2022] DELETE /compute/v2.1/os-security-groups/474d3e7e-da73-4f38-8640-23866b12f252 => generated 0 bytes in 1282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:10:01.452769 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6b4b4b95-0870-44b0-9599-5019798321db tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:01.454402 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6b4b4b95-0870-44b0-9599-5019798321db tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:01.472457 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b4b4b95-0870-44b0-9599-5019798321db tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:01.473198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b4b4b95-0870-44b0-9599-5019798321db tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:01.474257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b4b4b95-0870-44b0-9599-5019798321db tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:01.477990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b4b4b95-0870-44b0-9599-5019798321db tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:01.535060 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6b4b4b95-0870-44b0-9599-5019798321db tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:10:01.710469 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6b4b4b95-0870-44b0-9599-5019798321db tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "DELETE /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 204 len: 0 microversion: 2.1 time: 0.261786 Jul 25 13:10:01.711318 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2716/5339] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:10:01 2022] DELETE /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 13:10:01.726055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d9c565a5-489e-4d0d-8e74-6c396c51b1aa tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:01.732828 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d9c565a5-489e-4d0d-8e74-6c396c51b1aa tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:01.746874 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9c565a5-489e-4d0d-8e74-6c396c51b1aa tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:01.747653 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9c565a5-489e-4d0d-8e74-6c396c51b1aa tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:01.749923 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9c565a5-489e-4d0d-8e74-6c396c51b1aa tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:01.755389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9c565a5-489e-4d0d-8e74-6c396c51b1aa tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:02.023125 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8411e66e-a648-4915-b1a2-95599f6f5f60 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:02.052680 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8411e66e-a648-4915-b1a2-95599f6f5f60 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1216 microversion: 2.1 time: 1.184615 Jul 25 13:10:02.055164 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2624/5340] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:00 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1216 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:02.859424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d9c565a5-489e-4d0d-8e74-6c396c51b1aa tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:02.871793 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d9c565a5-489e-4d0d-8e74-6c396c51b1aa tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1510 microversion: 2.1 time: 1.155734 Jul 25 13:10:02.886700 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2717/5341] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:01 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1510 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:03.087995 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-82dafda5-5f7f-451f-a426-fb80fc60d185 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:03.088379 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-82dafda5-5f7f-451f-a426-fb80fc60d185 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:03.101402 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82dafda5-5f7f-451f-a426-fb80fc60d185 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:03.101885 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82dafda5-5f7f-451f-a426-fb80fc60d185 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:03.102688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82dafda5-5f7f-451f-a426-fb80fc60d185 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:03.109256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82dafda5-5f7f-451f-a426-fb80fc60d185 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:03.914538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3bcc01ec-e461-48c7-9196-b1bbd61ac144 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:03.915950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3bcc01ec-e461-48c7-9196-b1bbd61ac144 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:03.919725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:10:03.947562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3bcc01ec-e461-48c7-9196-b1bbd61ac144 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:03.950624 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3bcc01ec-e461-48c7-9196-b1bbd61ac144 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:03.956480 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3bcc01ec-e461-48c7-9196-b1bbd61ac144 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:03.957420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3bcc01ec-e461-48c7-9196-b1bbd61ac144 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:05.156012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-82dafda5-5f7f-451f-a426-fb80fc60d185 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:05.166342 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-82dafda5-5f7f-451f-a426-fb80fc60d185 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1216 microversion: 2.1 time: 2.083660 Jul 25 13:10:05.181854 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2625/5342] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:03 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1216 bytes in 2091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:05.623696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3bcc01ec-e461-48c7-9196-b1bbd61ac144 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadd925edad4cc088203acf4c73239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f152f46129a64fa48cfad35d5fd1073c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:05.630224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5d1f8f9e-fa87-4a83-a747-0eb09984773c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:05.630731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5d1f8f9e-fa87-4a83-a747-0eb09984773c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:05.651720 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3bcc01ec-e461-48c7-9196-b1bbd61ac144 tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 200 len: 1510 microversion: 2.1 time: 1.744390 Jul 25 13:10:05.663944 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d1f8f9e-fa87-4a83-a747-0eb09984773c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:05.664722 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d1f8f9e-fa87-4a83-a747-0eb09984773c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:05.665687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d1f8f9e-fa87-4a83-a747-0eb09984773c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:05.666163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d1f8f9e-fa87-4a83-a747-0eb09984773c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:05.669170 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2718/5343] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:03 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 1510 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:05.675820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-4052e3c3-0a07-407d-8f50-4fa00d260ed7 req-7bcf66ab-1893-4dc1-9cdb-69a7a17a660c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "202c4ace-9409-4007-943f-c38a0d108f46", "tag": "384564b3-efda-41af-b265-0d12d529d0e0"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:10:05.713583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4052e3c3-0a07-407d-8f50-4fa00d260ed7 req-7bcf66ab-1893-4dc1-9cdb-69a7a17a660c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:05.716587 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4052e3c3-0a07-407d-8f50-4fa00d260ed7 req-7bcf66ab-1893-4dc1-9cdb-69a7a17a660c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:05.743175 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-4052e3c3-0a07-407d-8f50-4fa00d260ed7 req-7bcf66ab-1893-4dc1-9cdb-69a7a17a660c service nova] Creating event network-changed:384564b3-efda-41af-b265-0d12d529d0e0 for instance 202c4ace-9409-4007-943f-c38a0d108f46 on n-h1-848886-15 Jul 25 13:10:05.760938 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-4052e3c3-0a07-407d-8f50-4fa00d260ed7 req-7bcf66ab-1893-4dc1-9cdb-69a7a17a660c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090394 Jul 25 13:10:05.766080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5d1f8f9e-fa87-4a83-a747-0eb09984773c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:10:05.774775 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2719/5344] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:10:05.935417 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5d1f8f9e-fa87-4a83-a747-0eb09984773c tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "DELETE /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 204 len: 0 microversion: 2.1 time: 0.308707 Jul 25 13:10:05.936523 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2626/5345] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:10:05 2022] DELETE /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 13:10:05.950789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c3ee79a6-efaa-46f3-9d09-354ff4306cc7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:05.951527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c3ee79a6-efaa-46f3-9d09-354ff4306cc7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:05.965028 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3ee79a6-efaa-46f3-9d09-354ff4306cc7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:05.965485 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3ee79a6-efaa-46f3-9d09-354ff4306cc7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:05.966302 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3ee79a6-efaa-46f3-9d09-354ff4306cc7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:05.966738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3ee79a6-efaa-46f3-9d09-354ff4306cc7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:06.037916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-edbb8eb8-81a1-42e1-b36c-eb341244b610 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-434778151", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "0c0ddad3-ee53-49f6-802e-a060916b1b50"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:10:06.183992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-edbb8eb8-81a1-42e1-b36c-eb341244b610 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] validate_networks() for [('0c0ddad3-ee53-49f6-802e-a060916b1b50', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:10:07.673984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c3ee79a6-efaa-46f3-9d09-354ff4306cc7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:07.687881 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c3ee79a6-efaa-46f3-9d09-354ff4306cc7 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1689 microversion: 2.1 time: 1.744681 Jul 25 13:10:07.689693 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2627/5346] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:05 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1689 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:07.707655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8cd8c5c0-0661-42ff-8c19-600ce99f4e51 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:07.711119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8cd8c5c0-0661-42ff-8c19-600ce99f4e51 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:07.727781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8cd8c5c0-0661-42ff-8c19-600ce99f4e51 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:07.746941 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8cd8c5c0-0661-42ff-8c19-600ce99f4e51 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:07.749495 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8cd8c5c0-0661-42ff-8c19-600ce99f4e51 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:07.754126 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8cd8c5c0-0661-42ff-8c19-600ce99f4e51 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:08.536005 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-edbb8eb8-81a1-42e1-b36c-eb341244b610 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:10:08.536725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-edbb8eb8-81a1-42e1-b36c-eb341244b610 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:10:08.537301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-edbb8eb8-81a1-42e1-b36c-eb341244b610 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:10:08.537793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-edbb8eb8-81a1-42e1-b36c-eb341244b610 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:10:08.538621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-edbb8eb8-81a1-42e1-b36c-eb341244b610 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:10:08.557236 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-edbb8eb8-81a1-42e1-b36c-eb341244b610 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:08.559381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-edbb8eb8-81a1-42e1-b36c-eb341244b610 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:08.561560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-edbb8eb8-81a1-42e1-b36c-eb341244b610 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:08.562122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-edbb8eb8-81a1-42e1-b36c-eb341244b610 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:08.608298 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-edbb8eb8-81a1-42e1-b36c-eb341244b610 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Getting quotas for project 7f59b3a36c064b2bbb1ab53255be976c. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:10:08.621730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-edbb8eb8-81a1-42e1-b36c-eb341244b610 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Getting quotas for user a214dd2589444280b4d9bb0e1e0db335 and project 7f59b3a36c064b2bbb1ab53255be976c. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:10:08.652311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-edbb8eb8-81a1-42e1-b36c-eb341244b610 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:10:08.656699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-edbb8eb8-81a1-42e1-b36c-eb341244b610 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:10:08.699667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8cd8c5c0-0661-42ff-8c19-600ce99f4e51 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:08.714935 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8cd8c5c0-0661-42ff-8c19-600ce99f4e51 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1216 microversion: 2.1 time: 1.018025 Jul 25 13:10:08.729921 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2628/5347] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:07 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1216 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:08.745444 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-99095c0d-3d47-43fe-a2c7-43fd21098a6f tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:08.746388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-99095c0d-3d47-43fe-a2c7-43fd21098a6f tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] [instance: 58b2f025-146e-4ca4-bb43-be3cd6dae006] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:08.760990 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-99095c0d-3d47-43fe-a2c7-43fd21098a6f tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:08.762126 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-99095c0d-3d47-43fe-a2c7-43fd21098a6f tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:08.763179 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-99095c0d-3d47-43fe-a2c7-43fd21098a6f tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:08.770136 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-99095c0d-3d47-43fe-a2c7-43fd21098a6f tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:08.814720 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-edbb8eb8-81a1-42e1-b36c-eb341244b610 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.035431 Jul 25 13:10:08.818110 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2720/5348] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Jul 25 13:10:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3043 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 13:10:08.825665 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-99095c0d-3d47-43fe-a2c7-43fd21098a6f tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] HTTP exception thrown: Instance 58b2f025-146e-4ca4-bb43-be3cd6dae006 could not be found. Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-99095c0d-3d47-43fe-a2c7-43fd21098a6f tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Request method failure captured: Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 HTTP/1.1 Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pXbiGpOPtfw_NyPpUAzIGvnU9scQgCKC3Gs0dc2-XDqeT2RkdrSl6ruR6uPNnT-_Hq0J_flQdDU35cHaswzUTWL72WSapX0YctD1ERYF4wlQElSnBtIGAttNDGEBDCB_zd6OU2FZGApM5N_s55v5pXX_ISo6roRaE9csi05BeAf6mU Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: f152f46129a64fa48cfad35d5fd1073c Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1707437075 Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f152f46129a64fa48cfad35d5fd1073c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f152f46129a64fa48cfad35d5fd1073c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f152f46129a64fa48cfad35d5fd1073c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f152f46129a64fa48cfad35d5fd1073c"}]}] Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1707437075 Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: f152f46129a64fa48cfad35d5fd1073c Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1707437075 Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerRescueTestJSONUnderV235-1707437075-project Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 9eadd925edad4cc088203acf4c73239b Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1707437075-project Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 58b2f025-146e-4ca4-bb43-be3cd6dae006 could not be found. Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '58b2f025-146e-4ca4-bb43-be3cd6dae006'} Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58b2f025-146e-4ca4-bb43-be3cd6dae006 could not be found. Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58b2f025-146e-4ca4-bb43-be3cd6dae006 could not be found. Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:10:08.830025 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:10:08.834191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:10:08.834191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:10:08.834191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:10:08.834191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:10:08.834191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:10:08.834191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:10:08.834191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b2f025-146e-4ca4-bb43-be3cd6dae006 could not be found. Jul 25 13:10:08.834191 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:10:08.843064 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-99095c0d-3d47-43fe-a2c7-43fd21098a6f tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] Returning 404 to user: Instance 58b2f025-146e-4ca4-bb43-be3cd6dae006 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:10:08.844403 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-99095c0d-3d47-43fe-a2c7-43fd21098a6f tempest-ServerRescueTestJSONUnderV235-1707437075 tempest-ServerRescueTestJSONUnderV235-1707437075-project] 10.222.0.49 "GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006" status: 404 len: 111 microversion: 2.1 time: 0.112041 Jul 25 13:10:08.845099 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-c9f65b2a-5bdb-4252-a36b-c40bda550021 req-b8660a8b-a707-4a0f-ba6a-ce0947998f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b2f025-146e-4ca4-bb43-be3cd6dae006", "name": "network-vif-deleted", "tag": "9d3b39d1-8690-4827-8fe3-5f59fcd60174"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:10:08.850166 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2629/5349] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:08 2022] GET /compute/v2.1/servers/58b2f025-146e-4ca4-bb43-be3cd6dae006 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:10:08.864750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f7ed4b40-3865-49b2-b5f6-a6f514ee94a3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:08.868331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f7ed4b40-3865-49b2-b5f6-a6f514ee94a3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:08.875654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c9f65b2a-5bdb-4252-a36b-c40bda550021 req-b8660a8b-a707-4a0f-ba6a-ce0947998f5f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:08.876165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c9f65b2a-5bdb-4252-a36b-c40bda550021 req-b8660a8b-a707-4a0f-ba6a-ce0947998f5f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:08.881674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7ed4b40-3865-49b2-b5f6-a6f514ee94a3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:08.882197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7ed4b40-3865-49b2-b5f6-a6f514ee94a3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:08.886030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7ed4b40-3865-49b2-b5f6-a6f514ee94a3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:08.887104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7ed4b40-3865-49b2-b5f6-a6f514ee94a3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:08.912405 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-c9f65b2a-5bdb-4252-a36b-c40bda550021 req-b8660a8b-a707-4a0f-ba6a-ce0947998f5f service nova] Creating event network-vif-deleted:9d3b39d1-8690-4827-8fe3-5f59fcd60174 for instance 58b2f025-146e-4ca4-bb43-be3cd6dae006 on n-h2-848886-15 Jul 25 13:10:08.921787 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-c9f65b2a-5bdb-4252-a36b-c40bda550021 req-b8660a8b-a707-4a0f-ba6a-ce0947998f5f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101714 Jul 25 13:10:08.926455 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2721/5350] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:10:08.938773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-44e844f8-defa-4c74-8c71-da0656e5d742 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:08.939728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-44e844f8-defa-4c74-8c71-da0656e5d742 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:09.376584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-44e844f8-defa-4c74-8c71-da0656e5d742 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:09.385345 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-44e844f8-defa-4c74-8c71-da0656e5d742 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:09.404491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-44e844f8-defa-4c74-8c71-da0656e5d742 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:09.405747 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-44e844f8-defa-4c74-8c71-da0656e5d742 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce" status: 200 len: 1261 microversion: 2.26 time: 0.477357 Jul 25 13:10:09.406385 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2722/5351] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:10:08 2022] GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce => generated 1261 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:10:09.737334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-355ad425-217a-41fa-88b1-8931d1f0b2ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:09.739912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-355ad425-217a-41fa-88b1-8931d1f0b2ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:09.755461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-355ad425-217a-41fa-88b1-8931d1f0b2ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:09.756987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-355ad425-217a-41fa-88b1-8931d1f0b2ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:09.758820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-355ad425-217a-41fa-88b1-8931d1f0b2ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:09.759510 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-355ad425-217a-41fa-88b1-8931d1f0b2ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:09.904784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f7ed4b40-3865-49b2-b5f6-a6f514ee94a3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:09.919911 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f7ed4b40-3865-49b2-b5f6-a6f514ee94a3 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1689 microversion: 2.1 time: 1.061382 Jul 25 13:10:09.921966 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2630/5352] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:08 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1689 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:10.436441 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a9130067-fd4c-40dc-afcd-1fd58adc7161 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:10.437979 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a9130067-fd4c-40dc-afcd-1fd58adc7161 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:10.452019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9130067-fd4c-40dc-afcd-1fd58adc7161 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:10.452490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9130067-fd4c-40dc-afcd-1fd58adc7161 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:10.464717 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-355ad425-217a-41fa-88b1-8931d1f0b2ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:10.465333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9130067-fd4c-40dc-afcd-1fd58adc7161 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:10.468971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9130067-fd4c-40dc-afcd-1fd58adc7161 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:10.475735 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-355ad425-217a-41fa-88b1-8931d1f0b2ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1216 microversion: 2.1 time: 0.743740 Jul 25 13:10:10.481454 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2723/5353] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:09 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1216 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:10.940766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b46f478f-5aef-43ce-98de-7be2f006106e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:10.941446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b46f478f-5aef-43ce-98de-7be2f006106e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:10.955470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b46f478f-5aef-43ce-98de-7be2f006106e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:10.962239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b46f478f-5aef-43ce-98de-7be2f006106e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:10.965135 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b46f478f-5aef-43ce-98de-7be2f006106e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:10.969090 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b46f478f-5aef-43ce-98de-7be2f006106e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:11.097472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b46f478f-5aef-43ce-98de-7be2f006106e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:11.105647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b46f478f-5aef-43ce-98de-7be2f006106e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:11.109150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-b46f478f-5aef-43ce-98de-7be2f006106e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lazy-loading 'fault' on Instance uuid 202c4ace-9409-4007-943f-c38a0d108f46 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:10:11.293161 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a9130067-fd4c-40dc-afcd-1fd58adc7161 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:11.323305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a9130067-fd4c-40dc-afcd-1fd58adc7161 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:11.326911 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a9130067-fd4c-40dc-afcd-1fd58adc7161 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:11.328897 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a9130067-fd4c-40dc-afcd-1fd58adc7161 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce" status: 200 len: 1321 microversion: 2.26 time: 0.897618 Jul 25 13:10:11.329681 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2631/5354] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:10:10 2022] GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce => generated 1321 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:10:11.356283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-06e1c225-b574-4491-a478-a1a174b8995b req-4d77c559-1ed8-4fdf-b363-aaf6242ffe4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "202c4ace-9409-4007-943f-c38a0d108f46", "name": "network-vif-deleted", "tag": "384564b3-efda-41af-b265-0d12d529d0e0"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:10:11.377056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-06e1c225-b574-4491-a478-a1a174b8995b req-4d77c559-1ed8-4fdf-b363-aaf6242ffe4e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:11.377467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-06e1c225-b574-4491-a478-a1a174b8995b req-4d77c559-1ed8-4fdf-b363-aaf6242ffe4e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:11.400431 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-06e1c225-b574-4491-a478-a1a174b8995b req-4d77c559-1ed8-4fdf-b363-aaf6242ffe4e service nova] Creating event network-vif-deleted:384564b3-efda-41af-b265-0d12d529d0e0 for instance 202c4ace-9409-4007-943f-c38a0d108f46 on n-h1-848886-15 Jul 25 13:10:11.407156 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-06e1c225-b574-4491-a478-a1a174b8995b req-4d77c559-1ed8-4fdf-b363-aaf6242ffe4e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060761 Jul 25 13:10:11.408795 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2632/5355] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:10:11.472314 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b46f478f-5aef-43ce-98de-7be2f006106e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6e2ae351744e0ab1f153d629e4f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d891a772834e43bdfcbde778a90498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:11.485749 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b46f478f-5aef-43ce-98de-7be2f006106e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 200 len: 1357 microversion: 2.1 time: 0.547417 Jul 25 13:10:11.488915 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2724/5356] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:10 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 1357 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:11.516432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-abb8ca91-ff1e-4b23-8215-2535d6a50a0b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:11.517159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-abb8ca91-ff1e-4b23-8215-2535d6a50a0b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:11.532254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-abb8ca91-ff1e-4b23-8215-2535d6a50a0b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:11.535574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-abb8ca91-ff1e-4b23-8215-2535d6a50a0b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:11.537569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-abb8ca91-ff1e-4b23-8215-2535d6a50a0b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:11.538086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-abb8ca91-ff1e-4b23-8215-2535d6a50a0b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:12.243045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-abb8ca91-ff1e-4b23-8215-2535d6a50a0b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:12.251331 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-abb8ca91-ff1e-4b23-8215-2535d6a50a0b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1216 microversion: 2.1 time: 0.748540 Jul 25 13:10:12.251935 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2633/5357] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:11 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1216 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:12.356872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8cca9592-bfcb-4bc8-a3df-fec710be1e97 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:12.357606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8cca9592-bfcb-4bc8-a3df-fec710be1e97 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:12.376909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8cca9592-bfcb-4bc8-a3df-fec710be1e97 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:12.379987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8cca9592-bfcb-4bc8-a3df-fec710be1e97 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:12.382084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8cca9592-bfcb-4bc8-a3df-fec710be1e97 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:12.382170 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8cca9592-bfcb-4bc8-a3df-fec710be1e97 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:12.517939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c86af935-da73-4360-b0ea-8a7651f5849e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:12.519380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c86af935-da73-4360-b0ea-8a7651f5849e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] [instance: 202c4ace-9409-4007-943f-c38a0d108f46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:12.533441 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c86af935-da73-4360-b0ea-8a7651f5849e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:12.533936 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c86af935-da73-4360-b0ea-8a7651f5849e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:12.534747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c86af935-da73-4360-b0ea-8a7651f5849e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:12.535196 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c86af935-da73-4360-b0ea-8a7651f5849e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:12.584203 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-c86af935-da73-4360-b0ea-8a7651f5849e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] HTTP exception thrown: Instance 202c4ace-9409-4007-943f-c38a0d108f46 could not be found. Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c86af935-da73-4360-b0ea-8a7651f5849e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Request method failure captured: Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 HTTP/1.1 Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pOuxv1dAEBzvSabAQZ_ovDwuoLarmYwGpqO0VLOXbqAAPunlD8O5vVMgj3IKl9VjFTX9CDCr160FLaCnWQQdTWXXvoL3KfTvXE9pkHJ0Gohl1rBvvU5lXAiAERAFVQa6cNt2uvom2njdnumPINWUCHjcLWMzSCxBYR5oNDLeJ--HHc Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: c0d891a772834e43bdfcbde778a90498 Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-406327327 Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c0d891a772834e43bdfcbde778a90498", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c0d891a772834e43bdfcbde778a90498"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0d891a772834e43bdfcbde778a90498"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0d891a772834e43bdfcbde778a90498"}]}] Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-TestNetworkAdvancedServerOps-406327327 Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: c0d891a772834e43bdfcbde778a90498 Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-406327327 Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-TestNetworkAdvancedServerOps-406327327-project Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 4d6e2ae351744e0ab1f153d629e4f0e7 Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-TestNetworkAdvancedServerOps-406327327-project Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 202c4ace-9409-4007-943f-c38a0d108f46 could not be found. Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '202c4ace-9409-4007-943f-c38a0d108f46'} Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 202c4ace-9409-4007-943f-c38a0d108f46 could not be found. Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 202c4ace-9409-4007-943f-c38a0d108f46 could not be found. Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:10:12.585983 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:10:12.591386 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:10:12.591386 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:10:12.591386 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:10:12.591386 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:10:12.591386 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:10:12.591386 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 202c4ace-9409-4007-943f-c38a0d108f46 could not be found. Jul 25 13:10:12.591386 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:10:12.591386 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c86af935-da73-4360-b0ea-8a7651f5849e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Returning 404 to user: Instance 202c4ace-9409-4007-943f-c38a0d108f46 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:10:12.591386 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c86af935-da73-4360-b0ea-8a7651f5849e tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46" status: 404 len: 111 microversion: 2.1 time: 0.073989 Jul 25 13:10:12.601037 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2634/5358] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:12 2022] GET /compute/v2.1/servers/202c4ace-9409-4007-943f-c38a0d108f46 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:10:12.639912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8cca9592-bfcb-4bc8-a3df-fec710be1e97 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:12.649585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8cca9592-bfcb-4bc8-a3df-fec710be1e97 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:12.651141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8cca9592-bfcb-4bc8-a3df-fec710be1e97 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:12.652323 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8cca9592-bfcb-4bc8-a3df-fec710be1e97 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce" status: 200 len: 1319 microversion: 2.26 time: 0.299596 Jul 25 13:10:12.660246 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2725/5359] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:10:12 2022] GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:10:13.272067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-eec79168-b4af-4807-ae2b-7848e1246a39 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:13.273253 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-eec79168-b4af-4807-ae2b-7848e1246a39 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:13.289552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eec79168-b4af-4807-ae2b-7848e1246a39 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:13.292053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eec79168-b4af-4807-ae2b-7848e1246a39 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:13.294451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eec79168-b4af-4807-ae2b-7848e1246a39 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:13.297336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eec79168-b4af-4807-ae2b-7848e1246a39 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:13.691103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dd0b20aa-2aaa-478b-8e28-cc8314b6e3a8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:13.692140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dd0b20aa-2aaa-478b-8e28-cc8314b6e3a8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:13.722466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd0b20aa-2aaa-478b-8e28-cc8314b6e3a8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:13.723053 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd0b20aa-2aaa-478b-8e28-cc8314b6e3a8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:13.725198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd0b20aa-2aaa-478b-8e28-cc8314b6e3a8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:13.728207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd0b20aa-2aaa-478b-8e28-cc8314b6e3a8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:14.216739 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-eec79168-b4af-4807-ae2b-7848e1246a39 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:14.225556 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-eec79168-b4af-4807-ae2b-7848e1246a39 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1216 microversion: 2.1 time: 0.958025 Jul 25 13:10:14.236481 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2635/5360] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:13 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1216 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:14.241469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dd0b20aa-2aaa-478b-8e28-cc8314b6e3a8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:14.250946 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-a0238f00-e5f3-49ff-9871-ce7232cf6298 req-bb0a76e3-3965-42c4-a90d-2d6f81170d6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e801a411-aba7-43d5-a366-924c4f035471", "name": "network-vif-plugged", "status": "completed", "tag": "c29620ab-f7fc-428e-b6e7-7cc77b0cd0e9"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:10:14.272432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dd0b20aa-2aaa-478b-8e28-cc8314b6e3a8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:14.278741 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dd0b20aa-2aaa-478b-8e28-cc8314b6e3a8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:14.291896 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dd0b20aa-2aaa-478b-8e28-cc8314b6e3a8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce" status: 200 len: 1361 microversion: 2.26 time: 0.615541 Jul 25 13:10:14.294101 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2726/5361] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:10:13 2022] GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce => generated 1361 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:10:14.347605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a0238f00-e5f3-49ff-9871-ce7232cf6298 req-bb0a76e3-3965-42c4-a90d-2d6f81170d6b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:14.348810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a0238f00-e5f3-49ff-9871-ce7232cf6298 req-bb0a76e3-3965-42c4-a90d-2d6f81170d6b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:14.376285 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-a0238f00-e5f3-49ff-9871-ce7232cf6298 req-bb0a76e3-3965-42c4-a90d-2d6f81170d6b service nova] Creating event network-vif-plugged:c29620ab-f7fc-428e-b6e7-7cc77b0cd0e9 for instance e801a411-aba7-43d5-a366-924c4f035471 on n-h1-848886-15 Jul 25 13:10:14.384454 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-a0238f00-e5f3-49ff-9871-ce7232cf6298 req-bb0a76e3-3965-42c4-a90d-2d6f81170d6b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145028 Jul 25 13:10:14.394561 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2636/5362] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:10:15.246894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-35c2cdc9-63e3-4be4-b1bf-22dca564d0de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:15.247527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-35c2cdc9-63e3-4be4-b1bf-22dca564d0de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:15.259118 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-35c2cdc9-63e3-4be4-b1bf-22dca564d0de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:15.260139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-35c2cdc9-63e3-4be4-b1bf-22dca564d0de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:15.263532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-35c2cdc9-63e3-4be4-b1bf-22dca564d0de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:15.265949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-35c2cdc9-63e3-4be4-b1bf-22dca564d0de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:15.324986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d543ba87-9c48-4a27-a7eb-194061ca2413 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:15.326516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d543ba87-9c48-4a27-a7eb-194061ca2413 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:15.377870 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d543ba87-9c48-4a27-a7eb-194061ca2413 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:15.381199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d543ba87-9c48-4a27-a7eb-194061ca2413 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:15.386349 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d543ba87-9c48-4a27-a7eb-194061ca2413 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:15.387061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d543ba87-9c48-4a27-a7eb-194061ca2413 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:15.475061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:10:15.996761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-35c2cdc9-63e3-4be4-b1bf-22dca564d0de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:16.008442 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-35c2cdc9-63e3-4be4-b1bf-22dca564d0de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1216 microversion: 2.1 time: 0.762917 Jul 25 13:10:16.009177 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2727/5363] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:15 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1216 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:16.174346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d543ba87-9c48-4a27-a7eb-194061ca2413 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:16.194855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d543ba87-9c48-4a27-a7eb-194061ca2413 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:16.200682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d543ba87-9c48-4a27-a7eb-194061ca2413 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:16.202109 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d543ba87-9c48-4a27-a7eb-194061ca2413 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce" status: 200 len: 1361 microversion: 2.26 time: 0.884592 Jul 25 13:10:16.202754 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2637/5364] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:10:15 2022] GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce => generated 1361 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:10:16.497211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-ce06c1ed-b4da-4afc-bbbe-6e7c23ebbac9 req-f48b8a2d-3a9b-4b5a-9adb-3d676eb56b43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec123606-bed7-4473-a31d-981829251dce", "tag": "72701222-b4fa-491e-b0a0-bbad14a09ff2"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:10:16.530845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-ce06c1ed-b4da-4afc-bbbe-6e7c23ebbac9 req-f48b8a2d-3a9b-4b5a-9adb-3d676eb56b43 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:16.531651 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-ce06c1ed-b4da-4afc-bbbe-6e7c23ebbac9 req-f48b8a2d-3a9b-4b5a-9adb-3d676eb56b43 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:16.564307 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-ce06c1ed-b4da-4afc-bbbe-6e7c23ebbac9 req-f48b8a2d-3a9b-4b5a-9adb-3d676eb56b43 service nova] Creating event network-changed:72701222-b4fa-491e-b0a0-bbad14a09ff2 for instance ec123606-bed7-4473-a31d-981829251dce on n-h2-848886-15 Jul 25 13:10:16.576524 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-ce06c1ed-b4da-4afc-bbbe-6e7c23ebbac9 req-f48b8a2d-3a9b-4b5a-9adb-3d676eb56b43 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082625 Jul 25 13:10:16.580143 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2728/5365] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:10:17.030131 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5639f576-1fc0-42d4-92cd-c795c6529672 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:17.031487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5639f576-1fc0-42d4-92cd-c795c6529672 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:17.051173 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5639f576-1fc0-42d4-92cd-c795c6529672 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:17.051645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5639f576-1fc0-42d4-92cd-c795c6529672 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:17.052446 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5639f576-1fc0-42d4-92cd-c795c6529672 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:17.058414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5639f576-1fc0-42d4-92cd-c795c6529672 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:17.237576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-38b6915f-0775-4f9f-b016-93eb504fa42f tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:17.240203 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-38b6915f-0775-4f9f-b016-93eb504fa42f tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:17.258277 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38b6915f-0775-4f9f-b016-93eb504fa42f tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:17.263274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38b6915f-0775-4f9f-b016-93eb504fa42f tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:17.272492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38b6915f-0775-4f9f-b016-93eb504fa42f tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:17.273246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38b6915f-0775-4f9f-b016-93eb504fa42f tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:18.286807 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5639f576-1fc0-42d4-92cd-c795c6529672 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:18.316654 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5639f576-1fc0-42d4-92cd-c795c6529672 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1402 microversion: 2.1 time: 1.289171 Jul 25 13:10:18.320626 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2638/5366] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:17 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1402 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:18.380188 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-38b6915f-0775-4f9f-b016-93eb504fa42f tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:18.384165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-295d583e-1968-44d1-b419-9bb673a883a7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:18.392035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-38b6915f-0775-4f9f-b016-93eb504fa42f tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:18.393542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-38b6915f-0775-4f9f-b016-93eb504fa42f tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:18.399595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-295d583e-1968-44d1-b419-9bb673a883a7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:18.415452 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-38b6915f-0775-4f9f-b016-93eb504fa42f tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce" status: 200 len: 1361 microversion: 2.26 time: 1.170036 Jul 25 13:10:18.417260 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2729/5367] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:10:17 2022] GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce => generated 1361 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:10:18.418615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-295d583e-1968-44d1-b419-9bb673a883a7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:18.419999 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-295d583e-1968-44d1-b419-9bb673a883a7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:18.421100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-295d583e-1968-44d1-b419-9bb673a883a7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:18.421750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-295d583e-1968-44d1-b419-9bb673a883a7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:19.443304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2ac2232b-fbc9-462f-9c66-8e110c2ee68a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:19.444489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2ac2232b-fbc9-462f-9c66-8e110c2ee68a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:19.447847 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:10:19.453040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=8 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:10:19.496206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ac2232b-fbc9-462f-9c66-8e110c2ee68a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:19.496664 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ac2232b-fbc9-462f-9c66-8e110c2ee68a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:19.505369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ac2232b-fbc9-462f-9c66-8e110c2ee68a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:19.505733 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ac2232b-fbc9-462f-9c66-8e110c2ee68a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:19.624734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-295d583e-1968-44d1-b419-9bb673a883a7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:19.639047 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-295d583e-1968-44d1-b419-9bb673a883a7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1402 microversion: 2.1 time: 1.292924 Jul 25 13:10:19.665820 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2639/5368] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:18 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1402 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:19.693302 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3f9be3f4-be90-4f45-aa9f-5e57d7020102 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1257250891"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:10:19.704755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3f9be3f4-be90-4f45-aa9f-5e57d7020102 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:19.723972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3f9be3f4-be90-4f45-aa9f-5e57d7020102 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:19.723972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3f9be3f4-be90-4f45-aa9f-5e57d7020102 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:19.723972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3f9be3f4-be90-4f45-aa9f-5e57d7020102 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:19.723972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3f9be3f4-be90-4f45-aa9f-5e57d7020102 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:20.007825 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.compute.api [None req-3f9be3f4-be90-4f45-aa9f-5e57d7020102 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Attempting to quiesce instance before volume snapshot. Jul 25 13:10:20.082547 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.compute.api [None req-3f9be3f4-be90-4f45-aa9f-5e57d7020102 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 25 13:10:20.333091 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3f9be3f4-be90-4f45-aa9f-5e57d7020102 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Creating snapshot from volume f2668901-e422-4995-a5ac-40f00b691986. {{(pid=125883) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jul 25 13:10:20.420068 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2ac2232b-fbc9-462f-9c66-8e110c2ee68a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:20.428975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2ac2232b-fbc9-462f-9c66-8e110c2ee68a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:20.430534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2ac2232b-fbc9-462f-9c66-8e110c2ee68a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:20.431738 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2ac2232b-fbc9-462f-9c66-8e110c2ee68a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce" status: 200 len: 1361 microversion: 2.26 time: 0.992433 Jul 25 13:10:20.432304 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2730/5369] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:10:19 2022] GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce => generated 1361 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:10:21.459810 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bafe081c-094b-474e-89a2-b7929f766db3 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:21.461162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bafe081c-094b-474e-89a2-b7929f766db3 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:21.483922 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bafe081c-094b-474e-89a2-b7929f766db3 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:21.484385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bafe081c-094b-474e-89a2-b7929f766db3 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:21.485190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bafe081c-094b-474e-89a2-b7929f766db3 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:21.485628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bafe081c-094b-474e-89a2-b7929f766db3 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:22.677052 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3f9be3f4-be90-4f45-aa9f-5e57d7020102 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "POST /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471/action" status: 202 len: 0 microversion: 2.1 time: 3.009170 Jul 25 13:10:22.678734 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2640/5370] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:10:19 2022] POST /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471/action => generated 0 bytes in 3012 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 13:10:22.945650 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bafe081c-094b-474e-89a2-b7929f766db3 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:22.955458 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bafe081c-094b-474e-89a2-b7929f766db3 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:22.957637 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bafe081c-094b-474e-89a2-b7929f766db3 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:22.959065 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bafe081c-094b-474e-89a2-b7929f766db3 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce" status: 200 len: 1361 microversion: 2.26 time: 1.504175 Jul 25 13:10:22.961192 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2731/5371] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:10:21 2022] GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce => generated 1361 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:10:23.990749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-50054b83-cdc7-4b4a-9ce0-3262c87df429 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:23.991596 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-50054b83-cdc7-4b4a-9ce0-3262c87df429 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:24.009273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50054b83-cdc7-4b4a-9ce0-3262c87df429 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:24.014034 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50054b83-cdc7-4b4a-9ce0-3262c87df429 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:24.020571 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50054b83-cdc7-4b4a-9ce0-3262c87df429 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:24.024290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50054b83-cdc7-4b4a-9ce0-3262c87df429 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:24.073033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-028ff199-424b-450d-949b-c1020b9fc6f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-804779254", "imageRef": "9c5ec367-962e-4fe5-b078-26bd1149d38d", "flavorRef": "452", "networks": [{"uuid": "2e9a011a-2cfb-4a86-9ca1-b23997eebbe8"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:10:24.156191 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-028ff199-424b-450d-949b-c1020b9fc6f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] validate_networks() for [('2e9a011a-2cfb-4a86-9ca1-b23997eebbe8', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:10:24.532595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-50054b83-cdc7-4b4a-9ce0-3262c87df429 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:24.541714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-50054b83-cdc7-4b4a-9ce0-3262c87df429 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:24.546285 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-50054b83-cdc7-4b4a-9ce0-3262c87df429 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:24.553899 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-50054b83-cdc7-4b4a-9ce0-3262c87df429 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce" status: 200 len: 1361 microversion: 2.26 time: 0.569947 Jul 25 13:10:24.555044 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2641/5372] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:10:23 2022] GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce => generated 1361 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:10:25.470846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-028ff199-424b-450d-949b-c1020b9fc6f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:10:25.471337 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-028ff199-424b-450d-949b-c1020b9fc6f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:10:25.471729 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-028ff199-424b-450d-949b-c1020b9fc6f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:10:25.472179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-028ff199-424b-450d-949b-c1020b9fc6f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:10:25.472954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-028ff199-424b-450d-949b-c1020b9fc6f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:10:25.484391 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-028ff199-424b-450d-949b-c1020b9fc6f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:25.484898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-028ff199-424b-450d-949b-c1020b9fc6f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:25.495646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-028ff199-424b-450d-949b-c1020b9fc6f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:25.496114 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-028ff199-424b-450d-949b-c1020b9fc6f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:25.539940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-028ff199-424b-450d-949b-c1020b9fc6f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Getting quotas for project b2fbd681752c41d0a24a9cf34ebc8389. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:10:25.552318 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-028ff199-424b-450d-949b-c1020b9fc6f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Getting quotas for user 9face2aaa9df430cb5d361c6e1fdf242 and project b2fbd681752c41d0a24a9cf34ebc8389. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:10:25.578225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4180a77c-fc94-456a-8594-5282c267a4cf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:25.579544 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4180a77c-fc94-456a-8594-5282c267a4cf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:25.594752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4180a77c-fc94-456a-8594-5282c267a4cf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:25.595639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4180a77c-fc94-456a-8594-5282c267a4cf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:25.596777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-028ff199-424b-450d-949b-c1020b9fc6f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:10:25.600878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-028ff199-424b-450d-949b-c1020b9fc6f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='323330bc-2c77-464e-a91a-225d8848e8e3',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:10:25.606442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4180a77c-fc94-456a-8594-5282c267a4cf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:25.606923 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4180a77c-fc94-456a-8594-5282c267a4cf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:25.752494 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-028ff199-424b-450d-949b-c1020b9fc6f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.683443 Jul 25 13:10:25.753695 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2732/5373] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:10:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 13:10:25.778723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9e5eb419-8272-4cd0-a7af-722ae69e5b7a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:25.779696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9e5eb419-8272-4cd0-a7af-722ae69e5b7a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:26.069175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9e5eb419-8272-4cd0-a7af-722ae69e5b7a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:26.078572 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9e5eb419-8272-4cd0-a7af-722ae69e5b7a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1229 microversion: 2.1 time: 0.313771 Jul 25 13:10:26.081408 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2733/5374] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:25 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1229 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:26.766410 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4180a77c-fc94-456a-8594-5282c267a4cf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:26.786532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4180a77c-fc94-456a-8594-5282c267a4cf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:26.795999 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4180a77c-fc94-456a-8594-5282c267a4cf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:26.802201 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4180a77c-fc94-456a-8594-5282c267a4cf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce" status: 200 len: 1361 microversion: 2.26 time: 1.225514 Jul 25 13:10:26.826111 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2642/5375] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:10:25 2022] GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce => generated 1361 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:10:27.100964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-28530270-c87c-4f77-ba9a-8490d6777271 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:27.101585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-28530270-c87c-4f77-ba9a-8490d6777271 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:27.133589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-28530270-c87c-4f77-ba9a-8490d6777271 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:27.134197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-28530270-c87c-4f77-ba9a-8490d6777271 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:27.150836 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-28530270-c87c-4f77-ba9a-8490d6777271 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:27.151315 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-28530270-c87c-4f77-ba9a-8490d6777271 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:27.173300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-c8cdeea2-0e7b-46f1-9e6c-8c44327e1d76 req-2a9aed46-8969-4b92-905d-d4bc3b82dc11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec123606-bed7-4473-a31d-981829251dce", "name": "network-vif-plugged", "status": "completed", "tag": "72701222-b4fa-491e-b0a0-bbad14a09ff2"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:10:27.198237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c8cdeea2-0e7b-46f1-9e6c-8c44327e1d76 req-2a9aed46-8969-4b92-905d-d4bc3b82dc11 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:27.198983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c8cdeea2-0e7b-46f1-9e6c-8c44327e1d76 req-2a9aed46-8969-4b92-905d-d4bc3b82dc11 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:27.220214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:10:27.232226 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-c8cdeea2-0e7b-46f1-9e6c-8c44327e1d76 req-2a9aed46-8969-4b92-905d-d4bc3b82dc11 service nova] Creating event network-vif-plugged:72701222-b4fa-491e-b0a0-bbad14a09ff2 for instance ec123606-bed7-4473-a31d-981829251dce on n-h2-848886-15 Jul 25 13:10:27.243077 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-c8cdeea2-0e7b-46f1-9e6c-8c44327e1d76 req-2a9aed46-8969-4b92-905d-d4bc3b82dc11 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073665 Jul 25 13:10:27.244393 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2643/5376] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:10:27.804030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-28530270-c87c-4f77-ba9a-8490d6777271 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:27.835761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9ca98489-c0da-45df-892a-b8f114f1dc8f tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:27.837711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9ca98489-c0da-45df-892a-b8f114f1dc8f tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:27.859458 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-28530270-c87c-4f77-ba9a-8490d6777271 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1281 microversion: 2.1 time: 0.759472 Jul 25 13:10:27.861127 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2734/5377] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:27 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1281 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:27.884047 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ca98489-c0da-45df-892a-b8f114f1dc8f tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:27.886079 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ca98489-c0da-45df-892a-b8f114f1dc8f tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:27.887036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ca98489-c0da-45df-892a-b8f114f1dc8f tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:27.887592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ca98489-c0da-45df-892a-b8f114f1dc8f tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:28.760078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9ca98489-c0da-45df-892a-b8f114f1dc8f tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:28.774892 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9ca98489-c0da-45df-892a-b8f114f1dc8f tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:28.778273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9ca98489-c0da-45df-892a-b8f114f1dc8f tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:28.782354 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9ca98489-c0da-45df-892a-b8f114f1dc8f tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce" status: 200 len: 1361 microversion: 2.26 time: 0.952854 Jul 25 13:10:28.787018 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2644/5378] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:10:27 2022] GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce => generated 1361 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:10:28.890781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f7d5e957-a863-4989-a049-4504d84c5c25 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:28.896317 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f7d5e957-a863-4989-a049-4504d84c5c25 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:28.938459 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7d5e957-a863-4989-a049-4504d84c5c25 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:28.941598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7d5e957-a863-4989-a049-4504d84c5c25 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:28.942723 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7d5e957-a863-4989-a049-4504d84c5c25 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:28.943263 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7d5e957-a863-4989-a049-4504d84c5c25 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:29.275975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1069fb27-0589-4f59-8105-456043e92ddb tempest-ComputeTenantNetworksTest-1308342730 tempest-ComputeTenantNetworksTest-1308342730-project] Calling method '.version_select at 0x7efcf88be9d0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:29.578521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f7d5e957-a863-4989-a049-4504d84c5c25 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:29.590471 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f7d5e957-a863-4989-a049-4504d84c5c25 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1299 microversion: 2.1 time: 0.704962 Jul 25 13:10:29.598292 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2645/5379] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:28 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1299 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:10:29.814398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e6fff916-5f9c-4bfc-8cea-2ecc33c2026a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:29.815797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e6fff916-5f9c-4bfc-8cea-2ecc33c2026a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:29.833941 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e6fff916-5f9c-4bfc-8cea-2ecc33c2026a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:29.835165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e6fff916-5f9c-4bfc-8cea-2ecc33c2026a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:29.840237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e6fff916-5f9c-4bfc-8cea-2ecc33c2026a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:29.844121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e6fff916-5f9c-4bfc-8cea-2ecc33c2026a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:29.913693 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1069fb27-0589-4f59-8105-456043e92ddb tempest-ComputeTenantNetworksTest-1308342730 tempest-ComputeTenantNetworksTest-1308342730-project] 10.222.0.49 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.312054 Jul 25 13:10:29.915489 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2735/5380] 10.222.0.49 () {58 vars in 1158 bytes} [Mon Jul 25 13:10:28 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:10:29.927623 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-81696ddc-feef-4f84-9940-4e3eced3de77 tempest-ComputeTenantNetworksTest-1308342730 tempest-ComputeTenantNetworksTest-1308342730-project] Calling method '.version_select at 0x7efcf9310ee0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:32.341463 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-81696ddc-feef-4f84-9940-4e3eced3de77 tempest-ComputeTenantNetworksTest-1308342730 tempest-ComputeTenantNetworksTest-1308342730-project] 10.222.0.49 "GET /compute/v2.1/os-tenant-networks/d3ad154f-672d-4dd6-8856-5f6d0f7840d3" status: 200 len: 140 microversion: 2.1 time: 2.419396 Jul 25 13:10:32.344090 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2736/5381] 10.222.0.49 () {58 vars in 1269 bytes} [Mon Jul 25 13:10:29 2022] GET /compute/v2.1/os-tenant-networks/d3ad154f-672d-4dd6-8856-5f6d0f7840d3 => generated 140 bytes in 2423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:10:32.352207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e6adc97e-3021-445f-8cf5-e0c31c58f337 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:32.353206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e6adc97e-3021-445f-8cf5-e0c31c58f337 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:32.386065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e6adc97e-3021-445f-8cf5-e0c31c58f337 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:32.393767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e6adc97e-3021-445f-8cf5-e0c31c58f337 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:32.412301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e6adc97e-3021-445f-8cf5-e0c31c58f337 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:32.412887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e6adc97e-3021-445f-8cf5-e0c31c58f337 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:32.662987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e6adc97e-3021-445f-8cf5-e0c31c58f337 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:32.688031 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e6adc97e-3021-445f-8cf5-e0c31c58f337 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1299 microversion: 2.1 time: 0.342348 Jul 25 13:10:32.692531 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2737/5382] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:32 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1299 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:32.702586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-32195928-a987-4abc-ab39-21fd49d26314 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] Calling method '.version_select at 0x7efcf9310430>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:32.728527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e6fff916-5f9c-4bfc-8cea-2ecc33c2026a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:32.745726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e6fff916-5f9c-4bfc-8cea-2ecc33c2026a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:32.751421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e6fff916-5f9c-4bfc-8cea-2ecc33c2026a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:32.755872 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e6fff916-5f9c-4bfc-8cea-2ecc33c2026a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce" status: 200 len: 1361 microversion: 2.26 time: 2.944572 Jul 25 13:10:32.759735 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-32195928-a987-4abc-ab39-21fd49d26314 tempest-TestNetworkAdvancedServerOps-406327327 tempest-TestNetworkAdvancedServerOps-406327327-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1758790213" status: 202 len: 0 microversion: 2.1 time: 0.065346 Jul 25 13:10:32.760772 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2646/5383] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:10:29 2022] GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce => generated 1361 bytes in 2950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:10:32.763741 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2738/5384] 10.222.0.49 () {58 vars in 1284 bytes} [Mon Jul 25 13:10:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1758790213 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:10:33.715882 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ad389c70-e73f-4898-9c97-674a7edd2a3c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:33.716711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ad389c70-e73f-4898-9c97-674a7edd2a3c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:33.744085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:10:33.759653 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad389c70-e73f-4898-9c97-674a7edd2a3c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:33.760127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad389c70-e73f-4898-9c97-674a7edd2a3c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:33.766808 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad389c70-e73f-4898-9c97-674a7edd2a3c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:33.767292 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad389c70-e73f-4898-9c97-674a7edd2a3c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:33.786992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dbb8abd4-ecb8-4b96-89ac-1ca1dcc4a7bc tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:33.791564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dbb8abd4-ecb8-4b96-89ac-1ca1dcc4a7bc tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:33.815596 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dbb8abd4-ecb8-4b96-89ac-1ca1dcc4a7bc tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:33.817073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dbb8abd4-ecb8-4b96-89ac-1ca1dcc4a7bc tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:33.820443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dbb8abd4-ecb8-4b96-89ac-1ca1dcc4a7bc tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:33.822799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dbb8abd4-ecb8-4b96-89ac-1ca1dcc4a7bc tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:34.409192 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ad389c70-e73f-4898-9c97-674a7edd2a3c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:34.420239 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ad389c70-e73f-4898-9c97-674a7edd2a3c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1341 microversion: 2.1 time: 0.708942 Jul 25 13:10:34.422141 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2647/5385] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:33 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1341 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:35.105845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dbb8abd4-ecb8-4b96-89ac-1ca1dcc4a7bc tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:35.144688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dbb8abd4-ecb8-4b96-89ac-1ca1dcc4a7bc tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:35.151564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dbb8abd4-ecb8-4b96-89ac-1ca1dcc4a7bc tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:35.158736 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dbb8abd4-ecb8-4b96-89ac-1ca1dcc4a7bc tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce" status: 200 len: 1544 microversion: 2.26 time: 1.375963 Jul 25 13:10:35.160047 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2739/5386] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:10:33 2022] GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce => generated 1544 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:10:35.186804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2c26bc59-d6eb-435b-8b1a-8923f38c8d36 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '.version_select at 0x7efcf83c19d0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:35.207919 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c26bc59-d6eb-435b-8b1a-8923f38c8d36 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:35.218916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c26bc59-d6eb-435b-8b1a-8923f38c8d36 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:35.220010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2c26bc59-d6eb-435b-8b1a-8923f38c8d36 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:35.240430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c26bc59-d6eb-435b-8b1a-8923f38c8d36 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:35.244170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c26bc59-d6eb-435b-8b1a-8923f38c8d36 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:35.245964 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c26bc59-d6eb-435b-8b1a-8923f38c8d36 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:35.249669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c26bc59-d6eb-435b-8b1a-8923f38c8d36 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:35.299414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c26bc59-d6eb-435b-8b1a-8923f38c8d36 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:35.299773 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c26bc59-d6eb-435b-8b1a-8923f38c8d36 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:35.316740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c26bc59-d6eb-435b-8b1a-8923f38c8d36 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:35.317209 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c26bc59-d6eb-435b-8b1a-8923f38c8d36 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:35.367924 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-2c26bc59-d6eb-435b-8b1a-8923f38c8d36 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lazy-loading 'flavor' on Instance uuid ec123606-bed7-4473-a31d-981829251dce {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:10:35.405037 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2c26bc59-d6eb-435b-8b1a-8923f38c8d36 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "PUT /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags/tempest-tag-1191840261" status: 201 len: 0 microversion: 2.26 time: 0.224260 Jul 25 13:10:35.409039 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2648/5387] 10.222.0.49 () {62 vars in 1380 bytes} [Mon Jul 25 13:10:35 2022] PUT /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags/tempest-tag-1191840261 => generated 0 bytes in 229 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 25 13:10:35.420202 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7e669784-bcf3-4a1c-84d9-4133868202e4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '.version_select at 0x7efcf8dcc670>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:35.446424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e669784-bcf3-4a1c-84d9-4133868202e4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:35.448334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e669784-bcf3-4a1c-84d9-4133868202e4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:35.483743 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7e669784-bcf3-4a1c-84d9-4133868202e4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags/tempest-tag-1191840261" status: 204 len: 0 microversion: 2.26 time: 0.066463 Jul 25 13:10:35.484511 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2649/5388] 10.222.0.49 () {60 vars in 1361 bytes} [Mon Jul 25 13:10:35 2022] GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags/tempest-tag-1191840261 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 13:10:35.502472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cad857de-e214-4eda-90c2-da39440fb20a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:35.504592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cad857de-e214-4eda-90c2-da39440fb20a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:35.515642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:10:35.521915 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cad857de-e214-4eda-90c2-da39440fb20a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:35.522402 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cad857de-e214-4eda-90c2-da39440fb20a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:35.523235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cad857de-e214-4eda-90c2-da39440fb20a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:35.523697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cad857de-e214-4eda-90c2-da39440fb20a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:35.811021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6843db0c-8ce2-4f04-a0da-52d73d040cff tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:35.812221 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 13:10:35.812221 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 13:10:35.814492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6843db0c-8ce2-4f04-a0da-52d73d040cff tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:35.815149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6843db0c-8ce2-4f04-a0da-52d73d040cff tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:35.816185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6843db0c-8ce2-4f04-a0da-52d73d040cff tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:35.817445 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6843db0c-8ce2-4f04-a0da-52d73d040cff tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:35.889047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:10:35.920251 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6843db0c-8ce2-4f04-a0da-52d73d040cff tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.630313 Jul 25 13:10:35.924219 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2740/5389] 10.222.0.49 () {58 vars in 1185 bytes} [Mon Jul 25 13:10:35 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:10:35.948634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f4ad6f09-fd5d-46bf-a079-223c1a7805d6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '.version_select at 0x7efcf8fd4040>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:35.978262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4ad6f09-fd5d-46bf-a079-223c1a7805d6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:35.979338 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4ad6f09-fd5d-46bf-a079-223c1a7805d6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:35.980937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f4ad6f09-fd5d-46bf-a079-223c1a7805d6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:36.004917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4ad6f09-fd5d-46bf-a079-223c1a7805d6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:36.005808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4ad6f09-fd5d-46bf-a079-223c1a7805d6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:36.007803 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4ad6f09-fd5d-46bf-a079-223c1a7805d6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:36.008605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4ad6f09-fd5d-46bf-a079-223c1a7805d6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:36.082479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=8 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:10:36.096269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4ad6f09-fd5d-46bf-a079-223c1a7805d6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:36.098077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4ad6f09-fd5d-46bf-a079-223c1a7805d6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:36.190326 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-f4ad6f09-fd5d-46bf-a079-223c1a7805d6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lazy-loading 'flavor' on Instance uuid ec123606-bed7-4473-a31d-981829251dce {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:10:36.275992 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f4ad6f09-fd5d-46bf-a079-223c1a7805d6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags" status: 204 len: 0 microversion: 2.26 time: 0.346982 Jul 25 13:10:36.282345 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2741/5390] 10.222.0.49 () {60 vars in 1295 bytes} [Mon Jul 25 13:10:35 2022] DELETE /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 13:10:36.288801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-47248e4b-0198-45e8-a74d-246543a8687f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-980884907", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "availability_zone": "nova:n-h1-848886-15", "networks": [{"uuid": "29506b21-6583-4b4f-82e0-919a6d1eeaf6"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:10:36.367483 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cad857de-e214-4eda-90c2-da39440fb20a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:36.373455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:10:36.387720 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cad857de-e214-4eda-90c2-da39440fb20a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1341 microversion: 2.1 time: 0.899760 Jul 25 13:10:36.390762 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2650/5391] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:35 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1341 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:36.397365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-088226eb-db7c-4ce1-a210-e6b729b62d79 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '.version_select at 0x7efcf8417280>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:36.427117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-47248e4b-0198-45e8-a74d-246543a8687f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] validate_networks() for [('29506b21-6583-4b4f-82e0-919a6d1eeaf6', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:10:36.445095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-088226eb-db7c-4ce1-a210-e6b729b62d79 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:36.446008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-088226eb-db7c-4ce1-a210-e6b729b62d79 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:36.486923 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-088226eb-db7c-4ce1-a210-e6b729b62d79 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags" status: 200 len: 12 microversion: 2.26 time: 0.094655 Jul 25 13:10:36.487964 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2651/5392] 10.222.0.49 () {60 vars in 1292 bytes} [Mon Jul 25 13:10:36 2022] GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags => generated 12 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:36.505492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-40610a54-4ef6-4f21-9fdb-3947ef7f4a1b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '.version_select at 0x7efcf84175e0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:36.540873 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-40610a54-4ef6-4f21-9fdb-3947ef7f4a1b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:36.552956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-40610a54-4ef6-4f21-9fdb-3947ef7f4a1b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:36.558357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-40610a54-4ef6-4f21-9fdb-3947ef7f4a1b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:36.574309 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-40610a54-4ef6-4f21-9fdb-3947ef7f4a1b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:36.579183 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-40610a54-4ef6-4f21-9fdb-3947ef7f4a1b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:36.585332 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-40610a54-4ef6-4f21-9fdb-3947ef7f4a1b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:36.585895 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-40610a54-4ef6-4f21-9fdb-3947ef7f4a1b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:36.682272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-40610a54-4ef6-4f21-9fdb-3947ef7f4a1b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:36.685076 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-40610a54-4ef6-4f21-9fdb-3947ef7f4a1b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:36.709568 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-40610a54-4ef6-4f21-9fdb-3947ef7f4a1b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:36.710076 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-40610a54-4ef6-4f21-9fdb-3947ef7f4a1b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:36.775164 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-40610a54-4ef6-4f21-9fdb-3947ef7f4a1b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lazy-loading 'flavor' on Instance uuid ec123606-bed7-4473-a31d-981829251dce {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:10:36.810982 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-40610a54-4ef6-4f21-9fdb-3947ef7f4a1b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "PUT /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags/tempest-tag-1673013830" status: 201 len: 0 microversion: 2.26 time: 0.315134 Jul 25 13:10:36.813876 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2652/5393] 10.222.0.49 () {62 vars in 1380 bytes} [Mon Jul 25 13:10:36 2022] PUT /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags/tempest-tag-1673013830 => generated 0 bytes in 318 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 25 13:10:36.834687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4a5e4a98-8269-468c-9997-ca2156713867 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '.version_select at 0x7efcf8bff0d0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:36.868822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a5e4a98-8269-468c-9997-ca2156713867 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:36.870949 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a5e4a98-8269-468c-9997-ca2156713867 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:36.908842 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4a5e4a98-8269-468c-9997-ca2156713867 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags" status: 200 len: 36 microversion: 2.26 time: 0.085099 Jul 25 13:10:36.912708 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2653/5394] 10.222.0.49 () {60 vars in 1292 bytes} [Mon Jul 25 13:10:36 2022] GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags => generated 36 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:36.934596 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9801eb65-1d58-4989-b026-543ace006142 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '.version_select at 0x7efcf8417550>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:36.958139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9801eb65-1d58-4989-b026-543ace006142 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:36.958882 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9801eb65-1d58-4989-b026-543ace006142 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:36.959403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9801eb65-1d58-4989-b026-543ace006142 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:36.977019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9801eb65-1d58-4989-b026-543ace006142 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:36.977709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9801eb65-1d58-4989-b026-543ace006142 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:36.981237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9801eb65-1d58-4989-b026-543ace006142 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:36.981795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9801eb65-1d58-4989-b026-543ace006142 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:37.035739 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9801eb65-1d58-4989-b026-543ace006142 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:37.036244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9801eb65-1d58-4989-b026-543ace006142 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:37.081429 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-9801eb65-1d58-4989-b026-543ace006142 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lazy-loading 'flavor' on Instance uuid ec123606-bed7-4473-a31d-981829251dce {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:10:37.128120 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9801eb65-1d58-4989-b026-543ace006142 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags/tempest-tag-1673013830" status: 204 len: 0 microversion: 2.26 time: 0.205084 Jul 25 13:10:37.136434 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2654/5395] 10.222.0.49 () {60 vars in 1364 bytes} [Mon Jul 25 13:10:36 2022] DELETE /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags/tempest-tag-1673013830 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 13:10:37.146752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c14910b0-192c-41c3-b561-5058189b3667 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '.version_select at 0x7efcf8405670>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:37.167483 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c14910b0-192c-41c3-b561-5058189b3667 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:37.167976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c14910b0-192c-41c3-b561-5058189b3667 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:37.196433 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c14910b0-192c-41c3-b561-5058189b3667 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags" status: 200 len: 12 microversion: 2.26 time: 0.056427 Jul 25 13:10:37.205023 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2655/5396] 10.222.0.49 () {60 vars in 1292 bytes} [Mon Jul 25 13:10:37 2022] GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags => generated 12 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:37.212110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-13e01265-e627-4d60-b1c9-e7acc59f0bb4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '.version_select at 0x7efcf8405550>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:37.239662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13e01265-e627-4d60-b1c9-e7acc59f0bb4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:37.240178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13e01265-e627-4d60-b1c9-e7acc59f0bb4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:37.240694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-13e01265-e627-4d60-b1c9-e7acc59f0bb4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:37.259866 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13e01265-e627-4d60-b1c9-e7acc59f0bb4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:37.260890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13e01265-e627-4d60-b1c9-e7acc59f0bb4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:37.262755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13e01265-e627-4d60-b1c9-e7acc59f0bb4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:37.263222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13e01265-e627-4d60-b1c9-e7acc59f0bb4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:37.332139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13e01265-e627-4d60-b1c9-e7acc59f0bb4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:37.337135 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13e01265-e627-4d60-b1c9-e7acc59f0bb4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:37.370973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-13e01265-e627-4d60-b1c9-e7acc59f0bb4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lazy-loading 'flavor' on Instance uuid ec123606-bed7-4473-a31d-981829251dce {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:10:37.409447 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-13e01265-e627-4d60-b1c9-e7acc59f0bb4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags" status: 204 len: 0 microversion: 2.26 time: 0.203375 Jul 25 13:10:37.410444 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2656/5397] 10.222.0.49 () {60 vars in 1295 bytes} [Mon Jul 25 13:10:37 2022] DELETE /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 13:10:37.420623 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-36cdb790-e903-415c-82fd-c58c7816d6fe tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '.version_select at 0x7efcfecb1820>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:37.452691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36cdb790-e903-415c-82fd-c58c7816d6fe tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:37.453988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36cdb790-e903-415c-82fd-c58c7816d6fe tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:37.454520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-36cdb790-e903-415c-82fd-c58c7816d6fe tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:37.471877 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36cdb790-e903-415c-82fd-c58c7816d6fe tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:37.473043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36cdb790-e903-415c-82fd-c58c7816d6fe tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:37.476654 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36cdb790-e903-415c-82fd-c58c7816d6fe tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:37.477669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36cdb790-e903-415c-82fd-c58c7816d6fe tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:37.560033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36cdb790-e903-415c-82fd-c58c7816d6fe tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:37.561259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36cdb790-e903-415c-82fd-c58c7816d6fe tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:37.587918 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36cdb790-e903-415c-82fd-c58c7816d6fe tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:37.588591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36cdb790-e903-415c-82fd-c58c7816d6fe tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:37.655247 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-36cdb790-e903-415c-82fd-c58c7816d6fe tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lazy-loading 'flavor' on Instance uuid ec123606-bed7-4473-a31d-981829251dce {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:10:37.698902 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-36cdb790-e903-415c-82fd-c58c7816d6fe tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "PUT /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags/tempest-tag-1705019854" status: 201 len: 0 microversion: 2.26 time: 0.282617 Jul 25 13:10:37.706307 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2657/5398] 10.222.0.49 () {62 vars in 1380 bytes} [Mon Jul 25 13:10:37 2022] PUT /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags/tempest-tag-1705019854 => generated 0 bytes in 291 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Jul 25 13:10:37.726206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4400ba72-7802-4323-a589-166e3827ad9f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:37.726964 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4400ba72-7802-4323-a589-166e3827ad9f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:37.756992 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4400ba72-7802-4323-a589-166e3827ad9f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:37.760393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4400ba72-7802-4323-a589-166e3827ad9f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:37.765283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4400ba72-7802-4323-a589-166e3827ad9f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:37.773958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4400ba72-7802-4323-a589-166e3827ad9f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:38.695554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4400ba72-7802-4323-a589-166e3827ad9f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:38.720539 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4400ba72-7802-4323-a589-166e3827ad9f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1341 microversion: 2.1 time: 1.012993 Jul 25 13:10:38.746881 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2658/5399] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:37 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1341 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:38.768036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-07927e93-eb32-4548-8970-050ef77e9d27 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '.version_select at 0x7efcf8b41940>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:38.789819 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07927e93-eb32-4548-8970-050ef77e9d27 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:38.791380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07927e93-eb32-4548-8970-050ef77e9d27 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:38.796720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-07927e93-eb32-4548-8970-050ef77e9d27 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:38.811382 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07927e93-eb32-4548-8970-050ef77e9d27 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:38.816178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07927e93-eb32-4548-8970-050ef77e9d27 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:38.817392 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07927e93-eb32-4548-8970-050ef77e9d27 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:38.818047 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07927e93-eb32-4548-8970-050ef77e9d27 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:38.899953 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07927e93-eb32-4548-8970-050ef77e9d27 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:38.900095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07927e93-eb32-4548-8970-050ef77e9d27 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:38.935553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07927e93-eb32-4548-8970-050ef77e9d27 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:38.936619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07927e93-eb32-4548-8970-050ef77e9d27 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:38.991010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-07927e93-eb32-4548-8970-050ef77e9d27 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lazy-loading 'flavor' on Instance uuid ec123606-bed7-4473-a31d-981829251dce {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:10:39.060550 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-07927e93-eb32-4548-8970-050ef77e9d27 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "PUT /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags/tempest-tag-2146961820" status: 201 len: 0 microversion: 2.26 time: 0.312382 Jul 25 13:10:39.063509 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2659/5400] 10.222.0.49 () {62 vars in 1380 bytes} [Mon Jul 25 13:10:38 2022] PUT /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags/tempest-tag-2146961820 => generated 0 bytes in 316 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 25 13:10:39.074589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-fe2b3846-4c75-47eb-85dd-d2bbd9954462 req-c65f7930-c1f0-4fe9-b7e9-2a1b9d9363bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ae5b75c-47c5-43a8-9a2b-534ef2da70ac", "tag": "1df08ef9-a76e-4c64-8cad-e0421a70a335"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:10:39.115318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fe2b3846-4c75-47eb-85dd-d2bbd9954462 req-c65f7930-c1f0-4fe9-b7e9-2a1b9d9363bf service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:39.116060 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fe2b3846-4c75-47eb-85dd-d2bbd9954462 req-c65f7930-c1f0-4fe9-b7e9-2a1b9d9363bf service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:39.147900 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-fe2b3846-4c75-47eb-85dd-d2bbd9954462 req-c65f7930-c1f0-4fe9-b7e9-2a1b9d9363bf service nova] Creating event network-changed:1df08ef9-a76e-4c64-8cad-e0421a70a335 for instance 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac on n-h2-848886-15 Jul 25 13:10:39.159832 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-fe2b3846-4c75-47eb-85dd-d2bbd9954462 req-c65f7930-c1f0-4fe9-b7e9-2a1b9d9363bf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092671 Jul 25 13:10:39.163414 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2660/5401] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:10:39.175121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8b340f70-511c-41cc-98d6-98a965d87ac6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '.version_select at 0x7efcf8b41040>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:39.198535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b340f70-511c-41cc-98d6-98a965d87ac6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:39.198980 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b340f70-511c-41cc-98d6-98a965d87ac6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:39.200326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8b340f70-511c-41cc-98d6-98a965d87ac6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:39.216445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b340f70-511c-41cc-98d6-98a965d87ac6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:39.217973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b340f70-511c-41cc-98d6-98a965d87ac6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:39.219950 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b340f70-511c-41cc-98d6-98a965d87ac6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:39.221989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b340f70-511c-41cc-98d6-98a965d87ac6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:39.238053 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-47248e4b-0198-45e8-a74d-246543a8687f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:10:39.239870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-47248e4b-0198-45e8-a74d-246543a8687f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:10:39.247920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-47248e4b-0198-45e8-a74d-246543a8687f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:10:39.250230 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-47248e4b-0198-45e8-a74d-246543a8687f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:10:39.252255 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-47248e4b-0198-45e8-a74d-246543a8687f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:10:39.288690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-47248e4b-0198-45e8-a74d-246543a8687f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:39.289436 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-47248e4b-0198-45e8-a74d-246543a8687f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:39.291938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-47248e4b-0198-45e8-a74d-246543a8687f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:39.292069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b340f70-511c-41cc-98d6-98a965d87ac6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:39.292550 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b340f70-511c-41cc-98d6-98a965d87ac6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:39.298882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-47248e4b-0198-45e8-a74d-246543a8687f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:39.347471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-8b340f70-511c-41cc-98d6-98a965d87ac6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lazy-loading 'flavor' on Instance uuid ec123606-bed7-4473-a31d-981829251dce {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:10:39.430710 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8b340f70-511c-41cc-98d6-98a965d87ac6 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags" status: 204 len: 0 microversion: 2.26 time: 0.261183 Jul 25 13:10:39.435923 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2661/5402] 10.222.0.49 () {60 vars in 1295 bytes} [Mon Jul 25 13:10:39 2022] DELETE /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 13:10:39.448515 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-47248e4b-0198-45e8-a74d-246543a8687f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Getting quotas for project 84a28c1fcb094a3b835d34f6e931fe0e. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:10:39.471383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5669c693-d9e8-4798-8c70-3f2519844c14 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '.version_select at 0x7efcf84179d0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:39.484775 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-47248e4b-0198-45e8-a74d-246543a8687f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Getting quotas for user 0ea4862fda714577b9be844b769a04ac and project 84a28c1fcb094a3b835d34f6e931fe0e. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:10:39.498911 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5669c693-d9e8-4798-8c70-3f2519844c14 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:39.501637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5669c693-d9e8-4798-8c70-3f2519844c14 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:39.543045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:10:39.550622 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5669c693-d9e8-4798-8c70-3f2519844c14 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags" status: 200 len: 12 microversion: 2.26 time: 0.105671 Jul 25 13:10:39.558346 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2662/5403] 10.222.0.49 () {60 vars in 1292 bytes} [Mon Jul 25 13:10:39 2022] GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags => generated 12 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:39.576612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5133ef9c-d539-4a03-8a02-e9729300a4f8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '.version_select at 0x7efcf8494430>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:39.590386 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-47248e4b-0198-45e8-a74d-246543a8687f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:10:39.603354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5133ef9c-d539-4a03-8a02-e9729300a4f8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:39.606723 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5133ef9c-d539-4a03-8a02-e9729300a4f8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:39.608234 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5133ef9c-d539-4a03-8a02-e9729300a4f8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:39.614599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-47248e4b-0198-45e8-a74d-246543a8687f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:10:39.653385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5133ef9c-d539-4a03-8a02-e9729300a4f8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:39.654106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5133ef9c-d539-4a03-8a02-e9729300a4f8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:39.663065 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5133ef9c-d539-4a03-8a02-e9729300a4f8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:39.663065 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5133ef9c-d539-4a03-8a02-e9729300a4f8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:39.815377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5133ef9c-d539-4a03-8a02-e9729300a4f8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:39.821898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5133ef9c-d539-4a03-8a02-e9729300a4f8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:39.935366 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-5133ef9c-d539-4a03-8a02-e9729300a4f8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lazy-loading 'flavor' on Instance uuid ec123606-bed7-4473-a31d-981829251dce {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:10:39.947479 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-47248e4b-0198-45e8-a74d-246543a8687f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.661522 Jul 25 13:10:39.954517 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2742/5404] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:10:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 3668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:10:40.001158 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bce6566b-9515-4387-9352-661f570e3adb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:40.002413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bce6566b-9515-4387-9352-661f570e3adb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:40.009896 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5133ef9c-d539-4a03-8a02-e9729300a4f8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags" status: 204 len: 0 microversion: 2.26 time: 0.446055 Jul 25 13:10:40.015227 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2663/5405] 10.222.0.49 () {60 vars in 1295 bytes} [Mon Jul 25 13:10:39 2022] DELETE /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 13:10:40.022631 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-846bdf91-4107-4966-990f-821f78ebbdb0 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:40.030780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-846bdf91-4107-4966-990f-821f78ebbdb0 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:40.064800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bce6566b-9515-4387-9352-661f570e3adb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:40.066380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bce6566b-9515-4387-9352-661f570e3adb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:40.072611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bce6566b-9515-4387-9352-661f570e3adb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:40.077295 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bce6566b-9515-4387-9352-661f570e3adb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:40.522151 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-846bdf91-4107-4966-990f-821f78ebbdb0 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa" status: 200 len: 1328 microversion: 2.1 time: 0.505304 Jul 25 13:10:40.522757 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2664/5406] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:40 2022] GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa => generated 1328 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:40.549480 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-726dadef-e263-4cbc-adc3-f93c01f030c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '.version_select at 0x7efcf8405dc0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:40.581882 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-726dadef-e263-4cbc-adc3-f93c01f030c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:40.584739 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-726dadef-e263-4cbc-adc3-f93c01f030c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:40.586238 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-726dadef-e263-4cbc-adc3-f93c01f030c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:40.610011 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-726dadef-e263-4cbc-adc3-f93c01f030c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:40.616462 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-726dadef-e263-4cbc-adc3-f93c01f030c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:40.619305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-726dadef-e263-4cbc-adc3-f93c01f030c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:40.626620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-726dadef-e263-4cbc-adc3-f93c01f030c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:40.739985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-726dadef-e263-4cbc-adc3-f93c01f030c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:40.740716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-726dadef-e263-4cbc-adc3-f93c01f030c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:40.777678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-726dadef-e263-4cbc-adc3-f93c01f030c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:40.779710 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-726dadef-e263-4cbc-adc3-f93c01f030c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:40.861054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-726dadef-e263-4cbc-adc3-f93c01f030c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lazy-loading 'flavor' on Instance uuid ec123606-bed7-4473-a31d-981829251dce {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:10:40.917281 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-726dadef-e263-4cbc-adc3-f93c01f030c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "PUT /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags/tempest-tag-1201081203" status: 201 len: 0 microversion: 2.26 time: 0.384832 Jul 25 13:10:40.939776 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2665/5407] 10.222.0.49 () {62 vars in 1380 bytes} [Mon Jul 25 13:10:40 2022] PUT /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags/tempest-tag-1201081203 => generated 0 bytes in 416 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 25 13:10:40.961079 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-afef89e3-906d-4faf-ae64-6dad34481cbf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '.version_select at 0x7efcf83c19d0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:41.023147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afef89e3-906d-4faf-ae64-6dad34481cbf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:41.026184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afef89e3-906d-4faf-ae64-6dad34481cbf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:41.029642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-afef89e3-906d-4faf-ae64-6dad34481cbf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:41.059082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afef89e3-906d-4faf-ae64-6dad34481cbf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:41.061919 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afef89e3-906d-4faf-ae64-6dad34481cbf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:41.064446 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afef89e3-906d-4faf-ae64-6dad34481cbf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:41.068647 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afef89e3-906d-4faf-ae64-6dad34481cbf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:41.205930 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afef89e3-906d-4faf-ae64-6dad34481cbf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:41.206854 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afef89e3-906d-4faf-ae64-6dad34481cbf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:41.234903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afef89e3-906d-4faf-ae64-6dad34481cbf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:41.238548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afef89e3-906d-4faf-ae64-6dad34481cbf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:41.303710 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bce6566b-9515-4387-9352-661f570e3adb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:41.318427 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bce6566b-9515-4387-9352-661f570e3adb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1341 microversion: 2.1 time: 1.366399 Jul 25 13:10:41.319599 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2743/5408] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:39 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1341 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:41.327166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-afef89e3-906d-4faf-ae64-6dad34481cbf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lazy-loading 'flavor' on Instance uuid ec123606-bed7-4473-a31d-981829251dce {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:10:41.359491 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-afef89e3-906d-4faf-ae64-6dad34481cbf tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "PUT /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags/tempest-tag-744304815" status: 201 len: 0 microversion: 2.26 time: 0.414694 Jul 25 13:10:41.365418 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2666/5409] 10.222.0.49 () {62 vars in 1377 bytes} [Mon Jul 25 13:10:40 2022] PUT /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags/tempest-tag-744304815 => generated 0 bytes in 421 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 25 13:10:41.371740 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-76df2b70-ffc3-49ea-9bec-1b4df7555b67 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Action: 'update_all', calling method: .version_select at 0x7efcf8fd4700>, body: {"tags": ["tempest-tag-174128187", "tempest-tag-813124892"]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:10:41.395580 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76df2b70-ffc3-49ea-9bec-1b4df7555b67 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:41.396807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76df2b70-ffc3-49ea-9bec-1b4df7555b67 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:41.397085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-76df2b70-ffc3-49ea-9bec-1b4df7555b67 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:41.413943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76df2b70-ffc3-49ea-9bec-1b4df7555b67 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:41.423636 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76df2b70-ffc3-49ea-9bec-1b4df7555b67 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:41.426078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76df2b70-ffc3-49ea-9bec-1b4df7555b67 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:41.435149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76df2b70-ffc3-49ea-9bec-1b4df7555b67 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:41.514049 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76df2b70-ffc3-49ea-9bec-1b4df7555b67 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:41.514756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76df2b70-ffc3-49ea-9bec-1b4df7555b67 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:41.543506 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-19c78e62-8a36-4fd3-8ce5-b6102e7fd1c8 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:41.544199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-19c78e62-8a36-4fd3-8ce5-b6102e7fd1c8 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:41.558906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19c78e62-8a36-4fd3-8ce5-b6102e7fd1c8 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:41.562820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19c78e62-8a36-4fd3-8ce5-b6102e7fd1c8 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:41.563750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19c78e62-8a36-4fd3-8ce5-b6102e7fd1c8 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:41.564212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-19c78e62-8a36-4fd3-8ce5-b6102e7fd1c8 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:41.604614 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-76df2b70-ffc3-49ea-9bec-1b4df7555b67 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lazy-loading 'flavor' on Instance uuid ec123606-bed7-4473-a31d-981829251dce {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:10:41.676109 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-76df2b70-ffc3-49ea-9bec-1b4df7555b67 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "PUT /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags" status: 200 len: 60 microversion: 2.26 time: 0.307227 Jul 25 13:10:41.686940 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2744/5410] 10.222.0.49 () {62 vars in 1312 bytes} [Mon Jul 25 13:10:41 2022] PUT /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags => generated 60 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:41.717310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-331a2bef-b60c-4d93-a64c-46c47cfda1c9 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '.version_select at 0x7efcf8987b80>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:41.768948 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-331a2bef-b60c-4d93-a64c-46c47cfda1c9 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:41.775706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-331a2bef-b60c-4d93-a64c-46c47cfda1c9 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:41.810181 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-331a2bef-b60c-4d93-a64c-46c47cfda1c9 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags" status: 200 len: 60 microversion: 2.26 time: 0.121578 Jul 25 13:10:41.815800 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2745/5411] 10.222.0.49 () {60 vars in 1292 bytes} [Mon Jul 25 13:10:41 2022] GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags => generated 60 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:41.832954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-95b696dd-3d02-403b-a010-05b771b890c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '.version_select at 0x7efcf8fd43a0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:41.866315 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95b696dd-3d02-403b-a010-05b771b890c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:41.867183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95b696dd-3d02-403b-a010-05b771b890c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:41.874079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-95b696dd-3d02-403b-a010-05b771b890c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:41.900162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95b696dd-3d02-403b-a010-05b771b890c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:41.900940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95b696dd-3d02-403b-a010-05b771b890c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:41.903972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95b696dd-3d02-403b-a010-05b771b890c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:41.910464 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95b696dd-3d02-403b-a010-05b771b890c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:41.985650 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95b696dd-3d02-403b-a010-05b771b890c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:42.018171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95b696dd-3d02-403b-a010-05b771b890c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:42.067085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-95b696dd-3d02-403b-a010-05b771b890c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lazy-loading 'flavor' on Instance uuid ec123606-bed7-4473-a31d-981829251dce {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:10:42.126842 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-19c78e62-8a36-4fd3-8ce5-b6102e7fd1c8 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa" status: 200 len: 1345 microversion: 2.1 time: 0.587161 Jul 25 13:10:42.130195 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-95b696dd-3d02-403b-a010-05b771b890c4 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags" status: 204 len: 0 microversion: 2.26 time: 0.307345 Jul 25 13:10:42.156501 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2667/5412] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:41 2022] GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa => generated 1345 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:42.166415 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2746/5413] 10.222.0.49 () {60 vars in 1295 bytes} [Mon Jul 25 13:10:41 2022] DELETE /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce/tags => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 13:10:42.178796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-31cc96b4-59a2-44ae-923c-905e05a4d49a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:42.185086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-31cc96b4-59a2-44ae-923c-905e05a4d49a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:42.208056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31cc96b4-59a2-44ae-923c-905e05a4d49a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:42.212517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31cc96b4-59a2-44ae-923c-905e05a4d49a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:42.215555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31cc96b4-59a2-44ae-923c-905e05a4d49a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:42.216298 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31cc96b4-59a2-44ae-923c-905e05a4d49a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:42.335773 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-31cc96b4-59a2-44ae-923c-905e05a4d49a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:10:42.346602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3be10697-787e-4002-9973-9e85b994bbe2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:42.347609 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3be10697-787e-4002-9973-9e85b994bbe2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:42.360695 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3be10697-787e-4002-9973-9e85b994bbe2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:42.361964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3be10697-787e-4002-9973-9e85b994bbe2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:42.363524 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3be10697-787e-4002-9973-9e85b994bbe2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:42.367011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3be10697-787e-4002-9973-9e85b994bbe2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:42.569533 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-31cc96b4-59a2-44ae-923c-905e05a4d49a tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce" status: 204 len: 0 microversion: 2.26 time: 0.395506 Jul 25 13:10:42.573364 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2668/5414] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 13:10:42 2022] DELETE /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 13:10:42.579779 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-834f8a2e-5e16-4f7e-b11f-1b950730de7b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:42.580562 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-834f8a2e-5e16-4f7e-b11f-1b950730de7b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:42.598736 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-834f8a2e-5e16-4f7e-b11f-1b950730de7b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:42.599593 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-834f8a2e-5e16-4f7e-b11f-1b950730de7b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:42.600674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-834f8a2e-5e16-4f7e-b11f-1b950730de7b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:42.601366 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-834f8a2e-5e16-4f7e-b11f-1b950730de7b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:43.395913 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-834f8a2e-5e16-4f7e-b11f-1b950730de7b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:43.427134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-834f8a2e-5e16-4f7e-b11f-1b950730de7b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:43.437750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-834f8a2e-5e16-4f7e-b11f-1b950730de7b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:43.445981 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-834f8a2e-5e16-4f7e-b11f-1b950730de7b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce" status: 200 len: 1550 microversion: 2.26 time: 0.867747 Jul 25 13:10:43.446664 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2669/5415] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:10:42 2022] GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce => generated 1550 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:10:43.465933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2db5f41d-af77-495f-a864-ce1723b3c45a tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:43.478961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2db5f41d-af77-495f-a864-ce1723b3c45a tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:43.505526 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2db5f41d-af77-495f-a864-ce1723b3c45a tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:43.508874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2db5f41d-af77-495f-a864-ce1723b3c45a tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:43.513339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2db5f41d-af77-495f-a864-ce1723b3c45a tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:43.514137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2db5f41d-af77-495f-a864-ce1723b3c45a tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:43.931016 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2db5f41d-af77-495f-a864-ce1723b3c45a tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa" status: 200 len: 1423 microversion: 2.1 time: 0.473870 Jul 25 13:10:43.932521 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2670/5416] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:43 2022] GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa => generated 1423 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:43.975280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3be10697-787e-4002-9973-9e85b994bbe2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:43.984998 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3be10697-787e-4002-9973-9e85b994bbe2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1341 microversion: 2.1 time: 1.643497 Jul 25 13:10:44.013539 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2747/5417] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:42 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1341 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:10:44.485241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8a359b8c-7460-47c8-98c3-a5cdaad73d7b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:44.486685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8a359b8c-7460-47c8-98c3-a5cdaad73d7b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:44.525409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8a359b8c-7460-47c8-98c3-a5cdaad73d7b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:44.530662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8a359b8c-7460-47c8-98c3-a5cdaad73d7b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:44.542788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8a359b8c-7460-47c8-98c3-a5cdaad73d7b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:44.550058 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8a359b8c-7460-47c8-98c3-a5cdaad73d7b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:44.961790 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f3b1be22-e4da-4b6d-96e3-54deb99238d8 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:44.964152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f3b1be22-e4da-4b6d-96e3-54deb99238d8 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:45.010107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f3b1be22-e4da-4b6d-96e3-54deb99238d8 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:45.018484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f3b1be22-e4da-4b6d-96e3-54deb99238d8 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:45.027908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f3b1be22-e4da-4b6d-96e3-54deb99238d8 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:45.031787 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f3b1be22-e4da-4b6d-96e3-54deb99238d8 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:46.840435 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f3b1be22-e4da-4b6d-96e3-54deb99238d8 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa" status: 200 len: 1423 microversion: 2.1 time: 1.885078 Jul 25 13:10:46.841211 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2748/5418] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:44 2022] GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa => generated 1423 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:10:46.857724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5df87253-cdb5-4307-9324-891f5e1adcc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:46.858922 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5df87253-cdb5-4307-9324-891f5e1adcc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:46.890270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5df87253-cdb5-4307-9324-891f5e1adcc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:46.893506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5df87253-cdb5-4307-9324-891f5e1adcc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:46.896168 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5df87253-cdb5-4307-9324-891f5e1adcc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:46.904966 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5df87253-cdb5-4307-9324-891f5e1adcc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:47.446366 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8a359b8c-7460-47c8-98c3-a5cdaad73d7b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:47.476310 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8a359b8c-7460-47c8-98c3-a5cdaad73d7b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:47.478804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8a359b8c-7460-47c8-98c3-a5cdaad73d7b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:47.480573 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8a359b8c-7460-47c8-98c3-a5cdaad73d7b tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce" status: 200 len: 1550 microversion: 2.26 time: 3.005219 Jul 25 13:10:47.490966 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2671/5419] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:10:44 2022] GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce => generated 1550 bytes in 3008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:10:47.862809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e3e7568a-9594-48fc-8e0d-a89cf83dca86 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:47.866073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e3e7568a-9594-48fc-8e0d-a89cf83dca86 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:47.887627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3e7568a-9594-48fc-8e0d-a89cf83dca86 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:47.898035 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3e7568a-9594-48fc-8e0d-a89cf83dca86 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:47.930310 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3e7568a-9594-48fc-8e0d-a89cf83dca86 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:47.932929 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3e7568a-9594-48fc-8e0d-a89cf83dca86 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:48.225237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5df87253-cdb5-4307-9324-891f5e1adcc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:48.270579 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5df87253-cdb5-4307-9324-891f5e1adcc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1341 microversion: 2.1 time: 1.424490 Jul 25 13:10:48.274705 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2749/5420] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:46 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1341 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:48.511965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f84a1e0c-da63-4456-af2a-bc6370bbb010 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:48.513133 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f84a1e0c-da63-4456-af2a-bc6370bbb010 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:48.534553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f84a1e0c-da63-4456-af2a-bc6370bbb010 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:48.536656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f84a1e0c-da63-4456-af2a-bc6370bbb010 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:48.541524 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f84a1e0c-da63-4456-af2a-bc6370bbb010 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:48.543563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f84a1e0c-da63-4456-af2a-bc6370bbb010 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:48.753218 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e3e7568a-9594-48fc-8e0d-a89cf83dca86 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa" status: 200 len: 1423 microversion: 2.1 time: 0.895814 Jul 25 13:10:48.753819 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2672/5421] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:47 2022] GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa => generated 1423 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:48.868305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-b7c9517f-b602-4d11-b841-829245ed5d0d req-96a8d270-eff0-40ec-ac73-8f31306f5e3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec123606-bed7-4473-a31d-981829251dce", "name": "network-vif-unplugged", "status": "completed", "tag": "72701222-b4fa-491e-b0a0-bbad14a09ff2"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:10:48.887597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b7c9517f-b602-4d11-b841-829245ed5d0d req-96a8d270-eff0-40ec-ac73-8f31306f5e3c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:48.897129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b7c9517f-b602-4d11-b841-829245ed5d0d req-96a8d270-eff0-40ec-ac73-8f31306f5e3c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:48.928720 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-b7c9517f-b602-4d11-b841-829245ed5d0d req-96a8d270-eff0-40ec-ac73-8f31306f5e3c service nova] Creating event network-vif-unplugged:72701222-b4fa-491e-b0a0-bbad14a09ff2 for instance ec123606-bed7-4473-a31d-981829251dce on n-h2-848886-15 Jul 25 13:10:48.944630 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-b7c9517f-b602-4d11-b841-829245ed5d0d req-96a8d270-eff0-40ec-ac73-8f31306f5e3c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080989 Jul 25 13:10:48.945621 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2673/5422] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:10:49.295103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-53e9e8b1-7cf6-435b-95e6-8353ccedaf2e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:49.295835 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-53e9e8b1-7cf6-435b-95e6-8353ccedaf2e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:49.309697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53e9e8b1-7cf6-435b-95e6-8353ccedaf2e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:49.310383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53e9e8b1-7cf6-435b-95e6-8353ccedaf2e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:49.311455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53e9e8b1-7cf6-435b-95e6-8353ccedaf2e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:49.311912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53e9e8b1-7cf6-435b-95e6-8353ccedaf2e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:49.399488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:10:49.540502 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:10:49.605511 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f84a1e0c-da63-4456-af2a-bc6370bbb010 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:49.630491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f84a1e0c-da63-4456-af2a-bc6370bbb010 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:49.635119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f84a1e0c-da63-4456-af2a-bc6370bbb010 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a214dd2589444280b4d9bb0e1e0db335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f59b3a36c064b2bbb1ab53255be976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:49.643232 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f84a1e0c-da63-4456-af2a-bc6370bbb010 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce" status: 200 len: 1550 microversion: 2.26 time: 1.135221 Jul 25 13:10:49.645388 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2750/5423] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:10:48 2022] GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce => generated 1550 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:10:49.779614 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-47508787-f546-4e44-a4f0-ddd74fe95f32 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:49.780230 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-47508787-f546-4e44-a4f0-ddd74fe95f32 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:49.798557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-47508787-f546-4e44-a4f0-ddd74fe95f32 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:49.802528 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-47508787-f546-4e44-a4f0-ddd74fe95f32 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:49.805808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-47508787-f546-4e44-a4f0-ddd74fe95f32 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:49.807151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-47508787-f546-4e44-a4f0-ddd74fe95f32 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:50.012461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-53e9e8b1-7cf6-435b-95e6-8353ccedaf2e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:50.034749 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-53e9e8b1-7cf6-435b-95e6-8353ccedaf2e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1341 microversion: 2.1 time: 0.744081 Jul 25 13:10:50.037406 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2674/5424] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:49 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1341 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:10:50.064487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-67ebfdb0-15b0-4b87-821d-260a53987282 req-2af1a3e9-00e7-4595-a4e8-eeab05b4eef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec123606-bed7-4473-a31d-981829251dce", "name": "network-vif-deleted", "tag": "72701222-b4fa-491e-b0a0-bbad14a09ff2"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:10:50.130345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-67ebfdb0-15b0-4b87-821d-260a53987282 req-2af1a3e9-00e7-4595-a4e8-eeab05b4eef6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:50.131587 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-67ebfdb0-15b0-4b87-821d-260a53987282 req-2af1a3e9-00e7-4595-a4e8-eeab05b4eef6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:50.159892 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=91,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:10:50.176034 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-67ebfdb0-15b0-4b87-821d-260a53987282 req-2af1a3e9-00e7-4595-a4e8-eeab05b4eef6 service nova] Creating event network-vif-deleted:72701222-b4fa-491e-b0a0-bbad14a09ff2 for instance ec123606-bed7-4473-a31d-981829251dce on n-h2-848886-15 Jul 25 13:10:50.181283 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-67ebfdb0-15b0-4b87-821d-260a53987282 req-2af1a3e9-00e7-4595-a4e8-eeab05b4eef6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128222 Jul 25 13:10:50.182085 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2675/5425] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:10:50.349083 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-47508787-f546-4e44-a4f0-ddd74fe95f32 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa" status: 200 len: 1465 microversion: 2.1 time: 0.572415 Jul 25 13:10:50.358598 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2751/5426] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:49 2022] GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa => generated 1465 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:10:50.667992 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:10:50.676511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-370d7294-c8cf-414d-a82a-eca367e0ced8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:50.677715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-370d7294-c8cf-414d-a82a-eca367e0ced8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] [instance: ec123606-bed7-4473-a31d-981829251dce] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:50.695318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-370d7294-c8cf-414d-a82a-eca367e0ced8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:50.696221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-370d7294-c8cf-414d-a82a-eca367e0ced8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:50.699579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-370d7294-c8cf-414d-a82a-eca367e0ced8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:50.700492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-370d7294-c8cf-414d-a82a-eca367e0ced8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:50.741734 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-370d7294-c8cf-414d-a82a-eca367e0ced8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] HTTP exception thrown: Instance ec123606-bed7-4473-a31d-981829251dce could not be found. Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-370d7294-c8cf-414d-a82a-eca367e0ced8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Request method failure captured: Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce HTTP/1.1 Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pYtNBw3o3sfcWOnQBcLeIqV6mLtQ4IpoVq2R1ukHIXLba1sdsH3Od4g58qZuKim6d22qM3eiNlGsHhhGEUeRgt1RUGfa8mIo6opSvZEHqdeaMjuBf5pQmy2nBXldtQGR7Dh_IHAqY9KBa1TJqAlWxwN6_uJcE3zLsZd5vY9StUoQB8 Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: X-Openstack-Nova-Api-Version: 2.26 Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 7f59b3a36c064b2bbb1ab53255be976c Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerTagsTestJSON-1318832610 Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7f59b3a36c064b2bbb1ab53255be976c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7f59b3a36c064b2bbb1ab53255be976c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7f59b3a36c064b2bbb1ab53255be976c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7f59b3a36c064b2bbb1ab53255be976c"}]}] Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerTagsTestJSON-1318832610 Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 7f59b3a36c064b2bbb1ab53255be976c Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerTagsTestJSON-1318832610 Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerTagsTestJSON-1318832610-project Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: a214dd2589444280b4d9bb0e1e0db335 Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerTagsTestJSON-1318832610-project Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance ec123606-bed7-4473-a31d-981829251dce could not be found. Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'ec123606-bed7-4473-a31d-981829251dce'} Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec123606-bed7-4473-a31d-981829251dce could not be found. Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec123606-bed7-4473-a31d-981829251dce could not be found. Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:10:50.747567 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:10:50.751898 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:10:50.751898 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:10:50.751898 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:10:50.751898 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:10:50.751898 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:10:50.751898 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec123606-bed7-4473-a31d-981829251dce could not be found. Jul 25 13:10:50.751898 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:10:50.751898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-370d7294-c8cf-414d-a82a-eca367e0ced8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] Returning 404 to user: Instance ec123606-bed7-4473-a31d-981829251dce could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:10:50.754450 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-370d7294-c8cf-414d-a82a-eca367e0ced8 tempest-ServerTagsTestJSON-1318832610 tempest-ServerTagsTestJSON-1318832610-project] 10.222.0.49 "GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce" status: 404 len: 111 microversion: 2.26 time: 0.085798 Jul 25 13:10:50.760550 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2676/5427] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:10:50 2022] GET /compute/v2.1/servers/ec123606-bed7-4473-a31d-981829251dce => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:10:51.062857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c5d6889f-159f-4d9e-a0ca-15093014815b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:51.063592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c5d6889f-159f-4d9e-a0ca-15093014815b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:51.077042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5d6889f-159f-4d9e-a0ca-15093014815b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:51.078329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5d6889f-159f-4d9e-a0ca-15093014815b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:51.084720 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5d6889f-159f-4d9e-a0ca-15093014815b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:51.085469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5d6889f-159f-4d9e-a0ca-15093014815b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:51.380636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6b4d2198-8ed4-4aa6-af03-9c6d9d86feb6 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:51.388347 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6b4d2198-8ed4-4aa6-af03-9c6d9d86feb6 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:51.416166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b4d2198-8ed4-4aa6-af03-9c6d9d86feb6 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:51.416642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b4d2198-8ed4-4aa6-af03-9c6d9d86feb6 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:51.417742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b4d2198-8ed4-4aa6-af03-9c6d9d86feb6 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:51.418020 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b4d2198-8ed4-4aa6-af03-9c6d9d86feb6 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:52.096996 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c5d6889f-159f-4d9e-a0ca-15093014815b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:52.112032 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c5d6889f-159f-4d9e-a0ca-15093014815b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1341 microversion: 2.1 time: 1.053710 Jul 25 13:10:52.115525 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2752/5428] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:51 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1341 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:53.140678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-29b58fed-323f-40fa-995b-cd7f438951b4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:53.141377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-29b58fed-323f-40fa-995b-cd7f438951b4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:53.162122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29b58fed-323f-40fa-995b-cd7f438951b4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:53.163058 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29b58fed-323f-40fa-995b-cd7f438951b4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:53.166200 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29b58fed-323f-40fa-995b-cd7f438951b4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:53.166891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29b58fed-323f-40fa-995b-cd7f438951b4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:53.259554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:DELETE=3,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:10:53.748465 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6b4d2198-8ed4-4aa6-af03-9c6d9d86feb6 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa" status: 200 len: 1465 microversion: 2.1 time: 2.378365 Jul 25 13:10:53.749284 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2677/5429] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:51 2022] GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa => generated 1465 bytes in 2380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:54.056746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-29b58fed-323f-40fa-995b-cd7f438951b4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:54.065640 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-29b58fed-323f-40fa-995b-cd7f438951b4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1341 microversion: 2.1 time: 0.931277 Jul 25 13:10:54.073535 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2753/5430] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:53 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1341 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:54.710516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-e35334ac-ec7b-4130-8fd3-e45942244d59 req-1d6acabf-8d1e-46e5-a75f-bfa0414b1127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f322627-079a-41d3-8e7d-0f2754ae0ffa", "tag": "c902af3a-eba4-43d4-aed4-bc7488fbde30"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:10:54.739691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e35334ac-ec7b-4130-8fd3-e45942244d59 req-1d6acabf-8d1e-46e5-a75f-bfa0414b1127 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:54.740216 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e35334ac-ec7b-4130-8fd3-e45942244d59 req-1d6acabf-8d1e-46e5-a75f-bfa0414b1127 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:54.769561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-99db7817-a510-4e03-8bda-8a1532ce316f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:54.770266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-99db7817-a510-4e03-8bda-8a1532ce316f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:54.780202 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-99db7817-a510-4e03-8bda-8a1532ce316f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:54.780655 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-99db7817-a510-4e03-8bda-8a1532ce316f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:54.781432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-99db7817-a510-4e03-8bda-8a1532ce316f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:54.797953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-99db7817-a510-4e03-8bda-8a1532ce316f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:54.803781 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-e35334ac-ec7b-4130-8fd3-e45942244d59 req-1d6acabf-8d1e-46e5-a75f-bfa0414b1127 service nova] Creating event network-changed:c902af3a-eba4-43d4-aed4-bc7488fbde30 for instance 9f322627-079a-41d3-8e7d-0f2754ae0ffa on n-h1-848886-15 Jul 25 13:10:54.821419 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-e35334ac-ec7b-4130-8fd3-e45942244d59 req-1d6acabf-8d1e-46e5-a75f-bfa0414b1127 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114551 Jul 25 13:10:54.834634 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2678/5431] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:10:55.099773 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-043fb7fb-f36e-496d-a839-d3316cec8648 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:55.100781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-043fb7fb-f36e-496d-a839-d3316cec8648 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:55.114741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-043fb7fb-f36e-496d-a839-d3316cec8648 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:55.115487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-043fb7fb-f36e-496d-a839-d3316cec8648 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:55.138416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-043fb7fb-f36e-496d-a839-d3316cec8648 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:55.139496 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-043fb7fb-f36e-496d-a839-d3316cec8648 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:55.928394 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-043fb7fb-f36e-496d-a839-d3316cec8648 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:55.942607 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-043fb7fb-f36e-496d-a839-d3316cec8648 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1341 microversion: 2.1 time: 0.841989 Jul 25 13:10:55.950768 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2679/5432] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:55 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1341 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:55.966273 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-99db7817-a510-4e03-8bda-8a1532ce316f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa" status: 200 len: 1465 microversion: 2.1 time: 1.200476 Jul 25 13:10:55.972182 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2754/5433] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:54 2022] GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa => generated 1465 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:10:56.965511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-faa09df5-4e4e-4186-9c18-e32aa5ca412e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:56.967010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-faa09df5-4e4e-4186-9c18-e32aa5ca412e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:56.990311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-faa09df5-4e4e-4186-9c18-e32aa5ca412e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:56.991189 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-faa09df5-4e4e-4186-9c18-e32aa5ca412e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:56.997332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7a0417c3-09e3-4a23-8e2f-3edc65004d1e tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:56.998910 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7a0417c3-09e3-4a23-8e2f-3edc65004d1e tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:57.004378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-faa09df5-4e4e-4186-9c18-e32aa5ca412e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:57.014078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-faa09df5-4e4e-4186-9c18-e32aa5ca412e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:57.032300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a0417c3-09e3-4a23-8e2f-3edc65004d1e tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:57.033385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a0417c3-09e3-4a23-8e2f-3edc65004d1e tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:57.037449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a0417c3-09e3-4a23-8e2f-3edc65004d1e tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:57.038412 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a0417c3-09e3-4a23-8e2f-3edc65004d1e tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:57.844881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-faa09df5-4e4e-4186-9c18-e32aa5ca412e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:10:57.918271 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-faa09df5-4e4e-4186-9c18-e32aa5ca412e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1341 microversion: 2.1 time: 0.956309 Jul 25 13:10:57.943941 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2680/5434] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:56 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1341 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:10:57.944477 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7a0417c3-09e3-4a23-8e2f-3edc65004d1e tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa" status: 200 len: 1465 microversion: 2.1 time: 0.950781 Jul 25 13:10:57.961713 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2755/5435] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:56 2022] GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa => generated 1465 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:10:58.941337 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bac736d8-138c-488a-8851-01b793057e3f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:58.942662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bac736d8-138c-488a-8851-01b793057e3f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:58.955102 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bac736d8-138c-488a-8851-01b793057e3f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:58.957629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bac736d8-138c-488a-8851-01b793057e3f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:58.972715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1251880d-2e96-48f0-a80c-2187e26b3062 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:10:58.973497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1251880d-2e96-48f0-a80c-2187e26b3062 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:10:58.977122 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bac736d8-138c-488a-8851-01b793057e3f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:58.978046 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bac736d8-138c-488a-8851-01b793057e3f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:58.997536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1251880d-2e96-48f0-a80c-2187e26b3062 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:58.998469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1251880d-2e96-48f0-a80c-2187e26b3062 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:10:59.013637 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1251880d-2e96-48f0-a80c-2187e26b3062 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:10:59.014632 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1251880d-2e96-48f0-a80c-2187e26b3062 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:01.116811 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1251880d-2e96-48f0-a80c-2187e26b3062 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa" status: 200 len: 1465 microversion: 2.1 time: 2.148306 Jul 25 13:11:01.118599 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2756/5436] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:58 2022] GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa => generated 1465 bytes in 2154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:01.213956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bac736d8-138c-488a-8851-01b793057e3f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:01.235314 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bac736d8-138c-488a-8851-01b793057e3f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1341 microversion: 2.1 time: 2.293019 Jul 25 13:11:01.242492 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2681/5437] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:10:58 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1341 bytes in 2306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:01.825737 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-44cf80b7-a391-4351-8b04-70c06f4835c5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Action: 'create', calling method: .version_select at 0x7efcfa4945e0>, body: {"keypair": {"name": "tempest-keypair-738074909", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxxHHLXSAK1/S0a2NX6WNVJuRM1/+AwQIgQZfyBUOGJTqAKuq37GQk/kDMD7sx+gCn6uPalIE244Q3/SSEzyU0jjv79OSkrLeHfO04dsIqWEqyN7xxvea0JqZZFYcKTNw=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:11:01.864466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-44cf80b7-a391-4351-8b04-70c06f4835c5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Getting quotas for project 7c757f689085487bbbfcbc5bdd365843. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:11:01.878925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-44cf80b7-a391-4351-8b04-70c06f4835c5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Getting quotas for user 36608374ffcf47f389e1169f454b2d9b and project 7c757f689085487bbbfcbc5bdd365843. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:11:01.945198 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-44cf80b7-a391-4351-8b04-70c06f4835c5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.360341 Jul 25 13:11:01.954287 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2757/5438] 10.222.0.49 () {62 vars in 1200 bytes} [Mon Jul 25 13:11:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 371 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 13:11:02.140600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6b708a54-6a8e-4b93-b256-bddf75dfb39c tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:02.141589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6b708a54-6a8e-4b93-b256-bddf75dfb39c tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:02.168307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b708a54-6a8e-4b93-b256-bddf75dfb39c tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:02.192108 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b708a54-6a8e-4b93-b256-bddf75dfb39c tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:02.194364 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b708a54-6a8e-4b93-b256-bddf75dfb39c tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:02.195520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b708a54-6a8e-4b93-b256-bddf75dfb39c tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:02.262055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dc7598df-0ad0-4d0a-9b63-652a93ec6ab6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:02.262901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dc7598df-0ad0-4d0a-9b63-652a93ec6ab6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:02.280668 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc7598df-0ad0-4d0a-9b63-652a93ec6ab6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:02.281140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc7598df-0ad0-4d0a-9b63-652a93ec6ab6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:02.282085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc7598df-0ad0-4d0a-9b63-652a93ec6ab6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:02.282595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc7598df-0ad0-4d0a-9b63-652a93ec6ab6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:02.839305 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6b708a54-6a8e-4b93-b256-bddf75dfb39c tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa" status: 200 len: 1465 microversion: 2.1 time: 0.703233 Jul 25 13:11:02.841010 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2682/5439] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:02 2022] GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa => generated 1465 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:03.192900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dc7598df-0ad0-4d0a-9b63-652a93ec6ab6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:03.203878 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dc7598df-0ad0-4d0a-9b63-652a93ec6ab6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1341 microversion: 2.1 time: 0.946909 Jul 25 13:11:03.233703 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2758/5440] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:02 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1341 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:11:03.863831 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1db802cd-3ee0-4cc9-831e-e5886daba53c tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:03.865367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1db802cd-3ee0-4cc9-831e-e5886daba53c tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:03.878804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:11:03.895613 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1db802cd-3ee0-4cc9-831e-e5886daba53c tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:03.896934 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1db802cd-3ee0-4cc9-831e-e5886daba53c tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:03.899584 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1db802cd-3ee0-4cc9-831e-e5886daba53c tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:03.901303 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1db802cd-3ee0-4cc9-831e-e5886daba53c tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:04.226588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-289628f8-bc93-483f-8a17-23a9ef574ad6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:04.227289 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-289628f8-bc93-483f-8a17-23a9ef574ad6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:04.251032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-289628f8-bc93-483f-8a17-23a9ef574ad6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:04.257536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-289628f8-bc93-483f-8a17-23a9ef574ad6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:04.259236 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-289628f8-bc93-483f-8a17-23a9ef574ad6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:04.259694 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-289628f8-bc93-483f-8a17-23a9ef574ad6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:05.161363 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1db802cd-3ee0-4cc9-831e-e5886daba53c tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa" status: 200 len: 1465 microversion: 2.1 time: 1.300702 Jul 25 13:11:05.165336 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2683/5441] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:03 2022] GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa => generated 1465 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:05.380016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-289628f8-bc93-483f-8a17-23a9ef574ad6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:05.405031 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-289628f8-bc93-483f-8a17-23a9ef574ad6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1341 microversion: 2.1 time: 1.182551 Jul 25 13:11:05.420357 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2759/5442] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:04 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1341 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:06.188142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7a13c83e-89cd-4ba8-abfd-2b761e1177f4 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:06.190006 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7a13c83e-89cd-4ba8-abfd-2b761e1177f4 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:06.232959 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a13c83e-89cd-4ba8-abfd-2b761e1177f4 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:06.237184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a13c83e-89cd-4ba8-abfd-2b761e1177f4 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:06.252434 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a13c83e-89cd-4ba8-abfd-2b761e1177f4 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:06.253171 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a13c83e-89cd-4ba8-abfd-2b761e1177f4 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:07.051201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3a441c81-1d0f-4802-90fc-511b80cb6728 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:07.052108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3a441c81-1d0f-4802-90fc-511b80cb6728 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:07.069554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:11:07.086180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a441c81-1d0f-4802-90fc-511b80cb6728 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:07.092203 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a441c81-1d0f-4802-90fc-511b80cb6728 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:07.095663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a441c81-1d0f-4802-90fc-511b80cb6728 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:07.096116 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a441c81-1d0f-4802-90fc-511b80cb6728 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:07.147251 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7a13c83e-89cd-4ba8-abfd-2b761e1177f4 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa" status: 200 len: 1465 microversion: 2.1 time: 0.966968 Jul 25 13:11:07.147864 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2684/5443] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:06 2022] GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa => generated 1465 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:08.026076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3a441c81-1d0f-4802-90fc-511b80cb6728 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:08.051718 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3a441c81-1d0f-4802-90fc-511b80cb6728 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1375 microversion: 2.1 time: 1.624275 Jul 25 13:11:08.079656 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2760/5444] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:06 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1375 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:08.174024 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b3dc2e7e-324c-4b7a-bc96-90246f0c5099 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:08.174813 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b3dc2e7e-324c-4b7a-bc96-90246f0c5099 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:08.209658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3dc2e7e-324c-4b7a-bc96-90246f0c5099 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:08.211147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3dc2e7e-324c-4b7a-bc96-90246f0c5099 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:08.214034 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3dc2e7e-324c-4b7a-bc96-90246f0c5099 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:08.214535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b3dc2e7e-324c-4b7a-bc96-90246f0c5099 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:08.888710 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b3dc2e7e-324c-4b7a-bc96-90246f0c5099 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa" status: 200 len: 1465 microversion: 2.1 time: 0.718987 Jul 25 13:11:08.910257 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2685/5445] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:08 2022] GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa => generated 1465 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:11:09.086934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aa71694b-0ff4-4d30-9d02-688896c57acd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:09.088370 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-aa71694b-0ff4-4d30-9d02-688896c57acd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:09.100783 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa71694b-0ff4-4d30-9d02-688896c57acd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:09.101587 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa71694b-0ff4-4d30-9d02-688896c57acd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:09.105997 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa71694b-0ff4-4d30-9d02-688896c57acd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:09.106686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aa71694b-0ff4-4d30-9d02-688896c57acd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:09.403672 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-aa71694b-0ff4-4d30-9d02-688896c57acd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:09.416775 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-aa71694b-0ff4-4d30-9d02-688896c57acd tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1375 microversion: 2.1 time: 0.332528 Jul 25 13:11:09.417819 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2761/5446] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:09 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1375 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:09.459710 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-74c3b418-518b-465e-ba9e-fe764f1b8f6a req-113c28d5-2f00-4d37-bdee-3fcb98bafb0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f322627-079a-41d3-8e7d-0f2754ae0ffa", "name": "network-vif-plugged", "status": "completed", "tag": "c902af3a-eba4-43d4-aed4-bc7488fbde30"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:11:09.479005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-74c3b418-518b-465e-ba9e-fe764f1b8f6a req-113c28d5-2f00-4d37-bdee-3fcb98bafb0f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:09.483233 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-74c3b418-518b-465e-ba9e-fe764f1b8f6a req-113c28d5-2f00-4d37-bdee-3fcb98bafb0f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:09.508897 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-74c3b418-518b-465e-ba9e-fe764f1b8f6a req-113c28d5-2f00-4d37-bdee-3fcb98bafb0f service nova] Creating event network-vif-plugged:c902af3a-eba4-43d4-aed4-bc7488fbde30 for instance 9f322627-079a-41d3-8e7d-0f2754ae0ffa on n-h1-848886-15 Jul 25 13:11:09.520882 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-74c3b418-518b-465e-ba9e-fe764f1b8f6a req-113c28d5-2f00-4d37-bdee-3fcb98bafb0f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061939 Jul 25 13:11:09.523867 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2686/5447] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:11:09.911561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b5bc07e0-0115-42fd-86c4-98bfd99b06aa tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:09.912267 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b5bc07e0-0115-42fd-86c4-98bfd99b06aa tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:09.923777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5bc07e0-0115-42fd-86c4-98bfd99b06aa tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:09.924665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5bc07e0-0115-42fd-86c4-98bfd99b06aa tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:09.925923 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5bc07e0-0115-42fd-86c4-98bfd99b06aa tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:09.928313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5bc07e0-0115-42fd-86c4-98bfd99b06aa tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:10.439498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b582358b-ff39-46b5-ba72-ab54f2eb3be5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:10.440401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b582358b-ff39-46b5-ba72-ab54f2eb3be5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:10.451201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b582358b-ff39-46b5-ba72-ab54f2eb3be5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:10.456713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b582358b-ff39-46b5-ba72-ab54f2eb3be5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:10.457712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b582358b-ff39-46b5-ba72-ab54f2eb3be5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:10.472275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b582358b-ff39-46b5-ba72-ab54f2eb3be5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:10.530449 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b5bc07e0-0115-42fd-86c4-98bfd99b06aa tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa" status: 200 len: 1465 microversion: 2.1 time: 0.622336 Jul 25 13:11:10.532275 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2762/5448] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:09 2022] GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa => generated 1465 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:10.899926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b582358b-ff39-46b5-ba72-ab54f2eb3be5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:10.909631 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b582358b-ff39-46b5-ba72-ab54f2eb3be5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1375 microversion: 2.1 time: 0.474338 Jul 25 13:11:10.913487 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2687/5449] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:10 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1375 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:11.556102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9e4a6a95-a0bd-4525-915c-5c70c5ccf921 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:11.556890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9e4a6a95-a0bd-4525-915c-5c70c5ccf921 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:11.572378 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e4a6a95-a0bd-4525-915c-5c70c5ccf921 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:11.575533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e4a6a95-a0bd-4525-915c-5c70c5ccf921 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:11.576446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e4a6a95-a0bd-4525-915c-5c70c5ccf921 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:11.576901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e4a6a95-a0bd-4525-915c-5c70c5ccf921 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:11.874778 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3a700da5-c232-4143-bf80-4d02916ba5db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1141953031", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "91d0beea-2451-4e14-b38a-2e48507623dc"}], "security_groups": [{"name": "tempest-securitygroup--1391909395"}], "key_name": "tempest-keypair-738074909", "user_data": "}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:11:11.898932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:11:12.195849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-3a700da5-c232-4143-bf80-4d02916ba5db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] validate_networks() for [('91d0beea-2451-4e14-b38a-2e48507623dc', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:11:12.632935 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9e4a6a95-a0bd-4525-915c-5c70c5ccf921 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa" status: 200 len: 1649 microversion: 2.1 time: 1.081604 Jul 25 13:11:12.634916 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2763/5450] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:11 2022] GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa => generated 1649 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:12.648264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1e7b10b3-7f28-459e-b54d-935cc94af1c5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:12.649362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1e7b10b3-7f28-459e-b54d-935cc94af1c5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:12.663517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1e7b10b3-7f28-459e-b54d-935cc94af1c5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:12.668365 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1e7b10b3-7f28-459e-b54d-935cc94af1c5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:12.669652 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1e7b10b3-7f28-459e-b54d-935cc94af1c5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:12.670136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1e7b10b3-7f28-459e-b54d-935cc94af1c5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:13.068934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1e7b10b3-7f28-459e-b54d-935cc94af1c5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:13.080335 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1e7b10b3-7f28-459e-b54d-935cc94af1c5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1375 microversion: 2.1 time: 0.444043 Jul 25 13:11:13.085662 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2764/5451] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:12 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1375 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:13.087037 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1e7b10b3-7f28-459e-b54d-935cc94af1c5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:13.088054 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1e7b10b3-7f28-459e-b54d-935cc94af1c5 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001407 Jul 25 13:11:13.090036 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2765/5452] 10.222.0.49 () {56 vars in 886 bytes} [Mon Jul 25 13:11:13 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 25 13:11:13.103637 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-04bc4f46-f60f-4473-a6cb-5ba5780c1407 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:13.104621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-04bc4f46-f60f-4473-a6cb-5ba5780c1407 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:13.119893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04bc4f46-f60f-4473-a6cb-5ba5780c1407 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:13.120683 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04bc4f46-f60f-4473-a6cb-5ba5780c1407 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:13.121729 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04bc4f46-f60f-4473-a6cb-5ba5780c1407 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:13.129997 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04bc4f46-f60f-4473-a6cb-5ba5780c1407 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:13.640638 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-04bc4f46-f60f-4473-a6cb-5ba5780c1407 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa" status: 200 len: 1649 microversion: 2.1 time: 0.547698 Jul 25 13:11:13.642165 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2766/5453] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:13 2022] GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa => generated 1649 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:13.656390 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-94e29cc8-76b9-4727-b8b2-248e733b8204 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Action: 'create', calling method: .version_select at 0x7efcf91d64c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-683657097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6J2aLy33Lnm6gkKJUioI6ImB5pEVDUMKO3ufc+n11jD0s5Ji0ifbTYj3wPFlzEL9cZf+TQ+yOlnXvNwIj8bhWcAKFFksXydjmPKps305CQiHcBQ+jG2V5S2C5A5CwKUg=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:11:13.671139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-3a700da5-c232-4143-bf80-4d02916ba5db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:11:13.671698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-3a700da5-c232-4143-bf80-4d02916ba5db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:11:13.672370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-3a700da5-c232-4143-bf80-4d02916ba5db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:11:13.672822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-3a700da5-c232-4143-bf80-4d02916ba5db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:11:13.673324 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-3a700da5-c232-4143-bf80-4d02916ba5db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:11:13.705443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a700da5-c232-4143-bf80-4d02916ba5db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:13.707853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a700da5-c232-4143-bf80-4d02916ba5db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:13.715228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a700da5-c232-4143-bf80-4d02916ba5db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:13.722982 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a700da5-c232-4143-bf80-4d02916ba5db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:13.754564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-3a700da5-c232-4143-bf80-4d02916ba5db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Getting quotas for project 7c757f689085487bbbfcbc5bdd365843. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:11:13.764442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-3a700da5-c232-4143-bf80-4d02916ba5db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Getting quotas for user 36608374ffcf47f389e1169f454b2d9b and project 7c757f689085487bbbfcbc5bdd365843. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:11:13.768032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-94e29cc8-76b9-4727-b8b2-248e733b8204 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Getting quotas for project 8d36edc3feda482686f9202892538c87. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:11:13.785136 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3a700da5-c232-4143-bf80-4d02916ba5db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:11:13.788103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3a700da5-c232-4143-bf80-4d02916ba5db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:11:13.790059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-94e29cc8-76b9-4727-b8b2-248e733b8204 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Getting quotas for user d165e33e297f4bd8a37c1f65aa35549d and project 8d36edc3feda482686f9202892538c87. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:11:13.857557 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-94e29cc8-76b9-4727-b8b2-248e733b8204 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.211624 Jul 25 13:11:13.858248 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2767/5454] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:11:13 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:13.869391 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-94e29cc8-76b9-4727-b8b2-248e733b8204 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:13.872475 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-94e29cc8-76b9-4727-b8b2-248e733b8204 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.005577 Jul 25 13:11:13.879707 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2768/5455] 10.222.0.49 () {54 vars in 1035 bytes} [Mon Jul 25 13:11:13 2022] GET /compute/v2/ => generated 379 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jul 25 13:11:13.887182 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d1d16d89-380c-4cdb-90ad-21b81cb23b65 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:13.889939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d1d16d89-380c-4cdb-90ad-21b81cb23b65 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:13.914166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1d16d89-380c-4cdb-90ad-21b81cb23b65 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:13.916133 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1d16d89-380c-4cdb-90ad-21b81cb23b65 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:13.919547 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1d16d89-380c-4cdb-90ad-21b81cb23b65 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:13.920035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1d16d89-380c-4cdb-90ad-21b81cb23b65 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:13.933312 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3a700da5-c232-4143-bf80-4d02916ba5db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.066440 Jul 25 13:11:13.936865 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2688/5456] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Jul 25 13:11:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 2072 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 13:11:13.938443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3a700da5-c232-4143-bf80-4d02916ba5db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:13.939740 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3a700da5-c232-4143-bf80-4d02916ba5db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001675 Jul 25 13:11:13.941050 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2689/5457] 10.222.0.49 () {54 vars in 1041 bytes} [Mon Jul 25 13:11:13 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:13.958752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b12ef5c2-cdb3-4619-8eec-b6f5a2779588 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:13.959799 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b12ef5c2-cdb3-4619-8eec-b6f5a2779588 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:14.037158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b12ef5c2-cdb3-4619-8eec-b6f5a2779588 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:14.049220 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b12ef5c2-cdb3-4619-8eec-b6f5a2779588 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:14.055033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b12ef5c2-cdb3-4619-8eec-b6f5a2779588 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:14.056692 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b12ef5c2-cdb3-4619-8eec-b6f5a2779588 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1281 microversion: 2.20 time: 0.104035 Jul 25 13:11:14.062233 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2690/5458] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:11:13 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1281 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:11:14.063626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b12ef5c2-cdb3-4619-8eec-b6f5a2779588 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:14.065983 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b12ef5c2-cdb3-4619-8eec-b6f5a2779588 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002004 Jul 25 13:11:14.078807 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2691/5459] 10.222.0.49 () {56 vars in 886 bytes} [Mon Jul 25 13:11:14 2022] GET /compute/ => generated 377 bytes in 16 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 25 13:11:14.108008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-847553ee-17c4-4f28-902d-30ad27f70338 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:14.109667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-847553ee-17c4-4f28-902d-30ad27f70338 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:14.140770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-847553ee-17c4-4f28-902d-30ad27f70338 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:14.143780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-847553ee-17c4-4f28-902d-30ad27f70338 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:14.145371 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-847553ee-17c4-4f28-902d-30ad27f70338 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:14.149231 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-847553ee-17c4-4f28-902d-30ad27f70338 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:14.550183 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d1d16d89-380c-4cdb-90ad-21b81cb23b65 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa" status: 200 len: 1649 microversion: 2.1 time: 0.674051 Jul 25 13:11:14.554892 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2769/5460] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:13 2022] GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa => generated 1649 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:14.711472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-847553ee-17c4-4f28-902d-30ad27f70338 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:14.729880 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-847553ee-17c4-4f28-902d-30ad27f70338 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1375 microversion: 2.1 time: 0.625921 Jul 25 13:11:14.732930 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2692/5461] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:14 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1375 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:11:15.058385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ddfe5546-b27b-496a-bb2b-722e90f6419b tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-110867778", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "availability_zone": "nova:n-h2-848886-15", "networks": [{"uuid": "29506b21-6583-4b4f-82e0-919a6d1eeaf6"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:11:15.094319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5323a6a4-c7c8-457f-8d4d-fd3cffb10d20 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:15.095332 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5323a6a4-c7c8-457f-8d4d-fd3cffb10d20 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:15.242104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-ddfe5546-b27b-496a-bb2b-722e90f6419b tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] validate_networks() for [('29506b21-6583-4b4f-82e0-919a6d1eeaf6', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:11:15.305488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5323a6a4-c7c8-457f-8d4d-fd3cffb10d20 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:15.322689 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5323a6a4-c7c8-457f-8d4d-fd3cffb10d20 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:15.327973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5323a6a4-c7c8-457f-8d4d-fd3cffb10d20 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:15.332569 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5323a6a4-c7c8-457f-8d4d-fd3cffb10d20 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1281 microversion: 2.20 time: 0.241662 Jul 25 13:11:15.348565 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2693/5462] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:11:15 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1281 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:11:15.753102 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9bf57692-36e6-49ce-90e4-bb88ce4c5bb6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:15.754632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9bf57692-36e6-49ce-90e4-bb88ce4c5bb6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:15.768874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9bf57692-36e6-49ce-90e4-bb88ce4c5bb6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:15.769561 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9bf57692-36e6-49ce-90e4-bb88ce4c5bb6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:15.772147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9bf57692-36e6-49ce-90e4-bb88ce4c5bb6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:15.773849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9bf57692-36e6-49ce-90e4-bb88ce4c5bb6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:16.214270 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9bf57692-36e6-49ce-90e4-bb88ce4c5bb6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:16.235430 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9bf57692-36e6-49ce-90e4-bb88ce4c5bb6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1375 microversion: 2.1 time: 0.486650 Jul 25 13:11:16.241809 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2694/5463] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:15 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1375 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:11:16.357918 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1589cfc7-291c-495d-a823-48b24e1b3a21 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:16.358598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1589cfc7-291c-495d-a823-48b24e1b3a21 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:16.366988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1589cfc7-291c-495d-a823-48b24e1b3a21 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:16.370818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1589cfc7-291c-495d-a823-48b24e1b3a21 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:16.372820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1589cfc7-291c-495d-a823-48b24e1b3a21 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:16.373378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1589cfc7-291c-495d-a823-48b24e1b3a21 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:16.510969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1589cfc7-291c-495d-a823-48b24e1b3a21 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:16.523711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1589cfc7-291c-495d-a823-48b24e1b3a21 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:16.526802 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1589cfc7-291c-495d-a823-48b24e1b3a21 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:16.531278 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1589cfc7-291c-495d-a823-48b24e1b3a21 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1333 microversion: 2.20 time: 0.178213 Jul 25 13:11:16.535284 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2695/5464] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:11:16 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1333 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:11:17.261733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1a9dbf2a-63a8-4acd-900a-53529c2eda4f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:17.263189 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1a9dbf2a-63a8-4acd-900a-53529c2eda4f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:17.278587 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a9dbf2a-63a8-4acd-900a-53529c2eda4f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:17.279473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a9dbf2a-63a8-4acd-900a-53529c2eda4f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:17.280507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a9dbf2a-63a8-4acd-900a-53529c2eda4f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:17.281132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a9dbf2a-63a8-4acd-900a-53529c2eda4f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:17.383054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ddfe5546-b27b-496a-bb2b-722e90f6419b tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:11:17.384616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ddfe5546-b27b-496a-bb2b-722e90f6419b tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:11:17.385365 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ddfe5546-b27b-496a-bb2b-722e90f6419b tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:11:17.386720 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ddfe5546-b27b-496a-bb2b-722e90f6419b tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:11:17.387560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ddfe5546-b27b-496a-bb2b-722e90f6419b tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:11:17.405472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ddfe5546-b27b-496a-bb2b-722e90f6419b tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:17.406944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ddfe5546-b27b-496a-bb2b-722e90f6419b tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:17.408352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ddfe5546-b27b-496a-bb2b-722e90f6419b tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:17.409280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ddfe5546-b27b-496a-bb2b-722e90f6419b tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:17.442233 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-ddfe5546-b27b-496a-bb2b-722e90f6419b tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Getting quotas for project 84a28c1fcb094a3b835d34f6e931fe0e. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:11:17.452242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-ddfe5546-b27b-496a-bb2b-722e90f6419b tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Getting quotas for user 0ea4862fda714577b9be844b769a04ac and project 84a28c1fcb094a3b835d34f6e931fe0e. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:11:17.474091 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ddfe5546-b27b-496a-bb2b-722e90f6419b tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:11:17.477195 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ddfe5546-b27b-496a-bb2b-722e90f6419b tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:11:17.587379 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ddfe5546-b27b-496a-bb2b-722e90f6419b tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.528434 Jul 25 13:11:17.591659 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2770/5465] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:11:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 13:11:17.619974 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c82cc255-9b30-4844-acdb-842725e76580 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:17.620620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c82cc255-9b30-4844-acdb-842725e76580 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:17.643897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c82cc255-9b30-4844-acdb-842725e76580 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:17.645398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c82cc255-9b30-4844-acdb-842725e76580 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:17.647800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c82cc255-9b30-4844-acdb-842725e76580 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:17.649396 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c82cc255-9b30-4844-acdb-842725e76580 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:17.788148 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1a9dbf2a-63a8-4acd-900a-53529c2eda4f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:17.810582 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1a9dbf2a-63a8-4acd-900a-53529c2eda4f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1375 microversion: 2.1 time: 0.552427 Jul 25 13:11:17.811469 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2696/5466] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:17 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1375 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:11:17.822318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9d98ea09-e513-4788-b58e-c55bcf505faa tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:17.822318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9d98ea09-e513-4788-b58e-c55bcf505faa tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:18.066441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c82cc255-9b30-4844-acdb-842725e76580 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:18.085548 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9d98ea09-e513-4788-b58e-c55bcf505faa tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 200 len: 1328 microversion: 2.1 time: 0.270753 Jul 25 13:11:18.086374 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2697/5467] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:17 2022] GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 1328 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:18.090739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c82cc255-9b30-4844-acdb-842725e76580 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:18.093337 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c82cc255-9b30-4844-acdb-842725e76580 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:18.093688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-ad5d6eec-b543-4a9c-9cb8-ec254d4daa07 req-6c0e7f5a-1b5c-4695-9089-0890ad8514fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae5b75c-47c5-43a8-9a2b-534ef2da70ac", "name": "network-vif-plugged", "status": "completed", "tag": "1df08ef9-a76e-4c64-8cad-e0421a70a335"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:11:18.095744 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c82cc255-9b30-4844-acdb-842725e76580 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1339 microversion: 2.20 time: 0.492475 Jul 25 13:11:18.105349 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ad5d6eec-b543-4a9c-9cb8-ec254d4daa07 req-6c0e7f5a-1b5c-4695-9089-0890ad8514fe service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:18.105809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ad5d6eec-b543-4a9c-9cb8-ec254d4daa07 req-6c0e7f5a-1b5c-4695-9089-0890ad8514fe service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:18.106180 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2771/5468] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:11:17 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1339 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:11:18.118183 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-ad5d6eec-b543-4a9c-9cb8-ec254d4daa07 req-6c0e7f5a-1b5c-4695-9089-0890ad8514fe service nova] Creating event network-vif-plugged:1df08ef9-a76e-4c64-8cad-e0421a70a335 for instance 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac on n-h2-848886-15 Jul 25 13:11:18.124362 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-ad5d6eec-b543-4a9c-9cb8-ec254d4daa07 req-6c0e7f5a-1b5c-4695-9089-0890ad8514fe service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036155 Jul 25 13:11:18.130268 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2698/5469] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:18.595302 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5a27d067-03df-431a-beab-924b3d3748ba tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1869560618", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "99d6e572-720f-4fd8-9096-3cf3c48b831d"}], "key_name": "tempest-TestNetworkBasicOps-683657097", "security_groups": [{"name": "tempest-secgroup-smoke-619928570"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:11:18.758272 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-5a27d067-03df-431a-beab-924b3d3748ba tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] validate_networks() for [('99d6e572-720f-4fd8-9096-3cf3c48b831d', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:11:18.839834 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bedc1be0-4b2d-4677-a6d7-0b5448289a57 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:18.840627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bedc1be0-4b2d-4677-a6d7-0b5448289a57 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:18.852050 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bedc1be0-4b2d-4677-a6d7-0b5448289a57 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:18.853118 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bedc1be0-4b2d-4677-a6d7-0b5448289a57 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:18.854162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bedc1be0-4b2d-4677-a6d7-0b5448289a57 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:18.854823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bedc1be0-4b2d-4677-a6d7-0b5448289a57 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:19.264086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bedc1be0-4b2d-4677-a6d7-0b5448289a57 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:19.276465 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bedc1be0-4b2d-4677-a6d7-0b5448289a57 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1375 microversion: 2.1 time: 0.443615 Jul 25 13:11:19.278178 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2699/5470] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:18 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1375 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:11:19.283163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2d5ca805-9866-4ad6-8b8d-9ff9ca62fc90 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:19.292876 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2d5ca805-9866-4ad6-8b8d-9ff9ca62fc90 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:19.306264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d5ca805-9866-4ad6-8b8d-9ff9ca62fc90 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:19.307292 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d5ca805-9866-4ad6-8b8d-9ff9ca62fc90 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:19.308796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d5ca805-9866-4ad6-8b8d-9ff9ca62fc90 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:19.309264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d5ca805-9866-4ad6-8b8d-9ff9ca62fc90 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:19.493804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:11:19.506653 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2d5ca805-9866-4ad6-8b8d-9ff9ca62fc90 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 200 len: 1417 microversion: 2.1 time: 0.226990 Jul 25 13:11:19.507469 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2700/5471] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:19 2022] GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 1417 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:19.512466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8aa73d84-2342-4237-937a-a6d709558b3e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:19.517888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8aa73d84-2342-4237-937a-a6d709558b3e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:19.527037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8aa73d84-2342-4237-937a-a6d709558b3e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:19.527742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8aa73d84-2342-4237-937a-a6d709558b3e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:19.528771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8aa73d84-2342-4237-937a-a6d709558b3e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:19.529445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8aa73d84-2342-4237-937a-a6d709558b3e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:20.358758 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-5a27d067-03df-431a-beab-924b3d3748ba tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:11:20.359431 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-5a27d067-03df-431a-beab-924b3d3748ba tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:11:20.359994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-5a27d067-03df-431a-beab-924b3d3748ba tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:11:20.360557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-5a27d067-03df-431a-beab-924b3d3748ba tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:11:20.361071 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-5a27d067-03df-431a-beab-924b3d3748ba tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:11:20.378247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a27d067-03df-431a-beab-924b3d3748ba tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:20.378871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a27d067-03df-431a-beab-924b3d3748ba tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:20.379810 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a27d067-03df-431a-beab-924b3d3748ba tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:20.380347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a27d067-03df-431a-beab-924b3d3748ba tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:20.419478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-5a27d067-03df-431a-beab-924b3d3748ba tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Getting quotas for project 8d36edc3feda482686f9202892538c87. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:11:20.425852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-5a27d067-03df-431a-beab-924b3d3748ba tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Getting quotas for user d165e33e297f4bd8a37c1f65aa35549d and project 8d36edc3feda482686f9202892538c87. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:11:20.438487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8aa73d84-2342-4237-937a-a6d709558b3e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:20.449908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5a27d067-03df-431a-beab-924b3d3748ba tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:11:20.452544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5a27d067-03df-431a-beab-924b3d3748ba tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: f5cd4124-73ad-4109-a774-b76ba75ab797] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:11:20.452978 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8aa73d84-2342-4237-937a-a6d709558b3e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:20.455529 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8aa73d84-2342-4237-937a-a6d709558b3e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:20.461277 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8aa73d84-2342-4237-937a-a6d709558b3e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1407 microversion: 2.20 time: 0.952438 Jul 25 13:11:20.466109 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2701/5472] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:11:19 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1407 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:11:20.549963 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5a27d067-03df-431a-beab-924b3d3748ba tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.958311 Jul 25 13:11:20.551117 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2772/5473] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:11:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:11:20.558318 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8e433133-e034-4103-bfc0-f11d349a6105 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:20.562084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8e433133-e034-4103-bfc0-f11d349a6105 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:20.573501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e433133-e034-4103-bfc0-f11d349a6105 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:20.574313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e433133-e034-4103-bfc0-f11d349a6105 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:20.578272 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e433133-e034-4103-bfc0-f11d349a6105 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:20.579500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8e433133-e034-4103-bfc0-f11d349a6105 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:20.651522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-147936db-2fb8-4be4-8a18-bce3ddb67f7e tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Action: 'create', calling method: .version_select at 0x7efcf8bdef70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-266009685"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:11:21.207080 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-147936db-2fb8-4be4-8a18-bce3ddb67f7e tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.736902 Jul 25 13:11:21.223022 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2702/5474] 10.222.0.49 () {60 vars in 1155 bytes} [Mon Jul 25 13:11:20 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 756 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 25 13:11:21.234347 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4fb158c5-0a32-4f59-8651-cf4f5648ea0e tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:21.239885 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4fb158c5-0a32-4f59-8651-cf4f5648ea0e tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:21.259329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4fb158c5-0a32-4f59-8651-cf4f5648ea0e tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:21.259854 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4fb158c5-0a32-4f59-8651-cf4f5648ea0e tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:21.260686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4fb158c5-0a32-4f59-8651-cf4f5648ea0e tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:21.261136 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4fb158c5-0a32-4f59-8651-cf4f5648ea0e tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:21.425006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8e433133-e034-4103-bfc0-f11d349a6105 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:21.443236 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8e433133-e034-4103-bfc0-f11d349a6105 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1562 microversion: 2.1 time: 0.890667 Jul 25 13:11:21.446072 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2773/5475] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:20 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1562 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:21.455669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f208ca6f-2440-4724-a1cd-b0b6b0149143 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:21.456432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f208ca6f-2440-4724-a1cd-b0b6b0149143 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: f5cd4124-73ad-4109-a774-b76ba75ab797] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:21.464026 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4fb158c5-0a32-4f59-8651-cf4f5648ea0e tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 200 len: 1423 microversion: 2.1 time: 0.239408 Jul 25 13:11:21.467833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f208ca6f-2440-4724-a1cd-b0b6b0149143 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:21.468317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f208ca6f-2440-4724-a1cd-b0b6b0149143 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:21.469164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f208ca6f-2440-4724-a1cd-b0b6b0149143 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:21.474107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f208ca6f-2440-4724-a1cd-b0b6b0149143 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:21.477084 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2703/5476] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:21 2022] GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 1423 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:21.495158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ba00ed57-1927-4657-a5f3-2414338eccc7 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Calling method '.version_select at 0x7efcf9726040>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:21.584506 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ba00ed57-1927-4657-a5f3-2414338eccc7 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/fbcbba1a-a262-45e2-bb9d-7a18da703c9a" status: 200 len: 344 microversion: 2.1 time: 0.105882 Jul 25 13:11:21.585545 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2704/5477] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Jul 25 13:11:21 2022] GET /compute/v2.1/os-volumes/fbcbba1a-a262-45e2-bb9d-7a18da703c9a => generated 344 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:21.590769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d2523d72-8df8-4b63-8e82-619d1922a87f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:21.591725 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d2523d72-8df8-4b63-8e82-619d1922a87f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:21.621242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2523d72-8df8-4b63-8e82-619d1922a87f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:21.622104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2523d72-8df8-4b63-8e82-619d1922a87f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:21.623293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2523d72-8df8-4b63-8e82-619d1922a87f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:21.627435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2523d72-8df8-4b63-8e82-619d1922a87f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:21.666958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f208ca6f-2440-4724-a1cd-b0b6b0149143 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:21.679067 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f208ca6f-2440-4724-a1cd-b0b6b0149143 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797" status: 200 len: 1252 microversion: 2.1 time: 0.231409 Jul 25 13:11:21.689977 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2774/5478] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:21 2022] GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797 => generated 1252 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:21.699002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-eb323ab0-3a69-41f0-bfb1-ac94344de405 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:21.708481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eb323ab0-3a69-41f0-bfb1-ac94344de405 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:21.719910 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb323ab0-3a69-41f0-bfb1-ac94344de405 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:21.727509 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb323ab0-3a69-41f0-bfb1-ac94344de405 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:21.728611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb323ab0-3a69-41f0-bfb1-ac94344de405 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:21.729263 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb323ab0-3a69-41f0-bfb1-ac94344de405 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:21.772076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:11:22.275675 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d2523d72-8df8-4b63-8e82-619d1922a87f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:22.286352 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d2523d72-8df8-4b63-8e82-619d1922a87f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1562 microversion: 2.1 time: 0.699246 Jul 25 13:11:22.288310 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2705/5479] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:21 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1562 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:22.463234 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9b708e1d-bf1b-41dd-b56c-8f9093fe948f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:22.464253 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9b708e1d-bf1b-41dd-b56c-8f9093fe948f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:22.480202 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b708e1d-bf1b-41dd-b56c-8f9093fe948f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:22.484225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b708e1d-bf1b-41dd-b56c-8f9093fe948f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:22.486796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-eb323ab0-3a69-41f0-bfb1-ac94344de405 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:22.487359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b708e1d-bf1b-41dd-b56c-8f9093fe948f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:22.488430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b708e1d-bf1b-41dd-b56c-8f9093fe948f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:22.504811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-eb323ab0-3a69-41f0-bfb1-ac94344de405 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:22.507143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-eb323ab0-3a69-41f0-bfb1-ac94344de405 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:22.514022 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-eb323ab0-3a69-41f0-bfb1-ac94344de405 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1407 microversion: 2.20 time: 0.818139 Jul 25 13:11:22.532523 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2775/5480] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:11:21 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1407 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:11:22.551988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a104be75-8658-44ff-a225-75d763834353 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:22.554675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a104be75-8658-44ff-a225-75d763834353 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:22.570688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a104be75-8658-44ff-a225-75d763834353 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:22.583306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a104be75-8658-44ff-a225-75d763834353 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:22.584362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a104be75-8658-44ff-a225-75d763834353 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:22.584910 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a104be75-8658-44ff-a225-75d763834353 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:22.594072 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9b708e1d-bf1b-41dd-b56c-8f9093fe948f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:11:22.805059 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9b708e1d-bf1b-41dd-b56c-8f9093fe948f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 204 len: 0 microversion: 2.1 time: 0.346807 Jul 25 13:11:22.813097 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2706/5481] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:11:22 2022] DELETE /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 13:11:22.819612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f4f59d63-a30e-4cfd-9587-e84887a2d812 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Calling method '.version_select at 0x7efcf8c985e0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:22.929376 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f4f59d63-a30e-4cfd-9587-e84887a2d812 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/fbcbba1a-a262-45e2-bb9d-7a18da703c9a" status: 200 len: 345 microversion: 2.1 time: 0.114690 Jul 25 13:11:22.934005 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2707/5482] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Jul 25 13:11:22 2022] GET /compute/v2.1/os-volumes/fbcbba1a-a262-45e2-bb9d-7a18da703c9a => generated 345 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:22.939719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-11616726-50b7-40da-badb-34cf24b52150 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:22.940528 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-11616726-50b7-40da-badb-34cf24b52150 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: f5cd4124-73ad-4109-a774-b76ba75ab797] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:22.951682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-11616726-50b7-40da-badb-34cf24b52150 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:22.952385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-11616726-50b7-40da-badb-34cf24b52150 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:22.954063 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-11616726-50b7-40da-badb-34cf24b52150 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:22.954685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-11616726-50b7-40da-badb-34cf24b52150 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:23.204519 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-11616726-50b7-40da-badb-34cf24b52150 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:23.215054 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-11616726-50b7-40da-badb-34cf24b52150 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797" status: 200 len: 1306 microversion: 2.1 time: 0.279120 Jul 25 13:11:23.231204 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2708/5483] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:22 2022] GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797 => generated 1306 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:23.236803 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3221f206-2a0a-4ad7-8180-53b90846cfad tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:23.238455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3221f206-2a0a-4ad7-8180-53b90846cfad tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:23.246749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3221f206-2a0a-4ad7-8180-53b90846cfad tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:23.248513 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3221f206-2a0a-4ad7-8180-53b90846cfad tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:23.249824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3221f206-2a0a-4ad7-8180-53b90846cfad tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:23.250466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3221f206-2a0a-4ad7-8180-53b90846cfad tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:23.482186 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a104be75-8658-44ff-a225-75d763834353 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 200 len: 1465 microversion: 2.1 time: 0.939294 Jul 25 13:11:23.483057 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2776/5484] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:22 2022] GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 1465 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:23.503722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-a9cda40f-b9d5-4f7f-8b7f-0965fcccc0f2 req-93f55b68-7278-470c-abfd-f2530dc163e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ffd02cb-a0ad-4b1f-b129-6fee94dc57af", "tag": "f70aacb3-9955-48b6-92e4-b936a8bc527b"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:11:23.515032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a9cda40f-b9d5-4f7f-8b7f-0965fcccc0f2 req-93f55b68-7278-470c-abfd-f2530dc163e6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:23.515565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a9cda40f-b9d5-4f7f-8b7f-0965fcccc0f2 req-93f55b68-7278-470c-abfd-f2530dc163e6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:23.530613 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-a9cda40f-b9d5-4f7f-8b7f-0965fcccc0f2 req-93f55b68-7278-470c-abfd-f2530dc163e6 service nova] Creating event network-changed:f70aacb3-9955-48b6-92e4-b936a8bc527b for instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af on n-h2-848886-15 Jul 25 13:11:23.543558 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-a9cda40f-b9d5-4f7f-8b7f-0965fcccc0f2 req-93f55b68-7278-470c-abfd-f2530dc163e6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044248 Jul 25 13:11:23.547290 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2777/5485] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:23.558724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e49443ea-60a6-4b48-a7c8-3a15a0194279 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Action: 'create', calling method: .version_select at 0x7efcf89e6310>, body: {"snapshot": {"volume_id": "fbcbba1a-a262-45e2-bb9d-7a18da703c9a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-792650246"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:11:23.691225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3221f206-2a0a-4ad7-8180-53b90846cfad tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:23.705776 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3221f206-2a0a-4ad7-8180-53b90846cfad tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1568 microversion: 2.1 time: 0.473026 Jul 25 13:11:23.717222 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2709/5486] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:23 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1568 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:23.735808 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-679a0ce6-bcaa-425a-8a60-321747a8a6ea tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:23.736592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-679a0ce6-bcaa-425a-8a60-321747a8a6ea tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:23.740845 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:11:23.752705 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-679a0ce6-bcaa-425a-8a60-321747a8a6ea tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:23.755634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-679a0ce6-bcaa-425a-8a60-321747a8a6ea tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:23.758548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-679a0ce6-bcaa-425a-8a60-321747a8a6ea tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:23.759083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-679a0ce6-bcaa-425a-8a60-321747a8a6ea tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:23.863528 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e49443ea-60a6-4b48-a7c8-3a15a0194279 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.312165 Jul 25 13:11:23.864235 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2778/5487] 10.222.0.49 () {60 vars in 1162 bytes} [Mon Jul 25 13:11:23 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:23.876408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-174521c5-a9c9-4ebe-b41c-ab6ce52029da tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Calling method '.version_select at 0x7efcf883b790>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:23.927199 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-174521c5-a9c9-4ebe-b41c-ab6ce52029da tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/d0347bc4-22e7-4318-aabe-5a8c838c955e" status: 200 len: 286 microversion: 2.1 time: 0.055678 Jul 25 13:11:23.933890 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2779/5488] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Jul 25 13:11:23 2022] GET /compute/v2.1/os-snapshots/d0347bc4-22e7-4318-aabe-5a8c838c955e => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:11:23.941387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e5462729-269e-48f7-9660-a522e4ca2e38 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Calling method '.version_select at 0x7efcf8e75af0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:23.993649 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e5462729-269e-48f7-9660-a522e4ca2e38 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.057423 Jul 25 13:11:23.994236 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2780/5489] 10.222.0.49 () {58 vars in 1140 bytes} [Mon Jul 25 13:11:23 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:24.005862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5a0e8524-924e-4bd7-bc5a-f913ea7f4885 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Calling method '.version_select at 0x7efcf883b430>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:24.053889 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5a0e8524-924e-4bd7-bc5a-f913ea7f4885 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/d0347bc4-22e7-4318-aabe-5a8c838c955e" status: 200 len: 286 microversion: 2.1 time: 0.050697 Jul 25 13:11:24.056415 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2781/5490] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Jul 25 13:11:24 2022] GET /compute/v2.1/os-snapshots/d0347bc4-22e7-4318-aabe-5a8c838c955e => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:11:24.245155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-813b70a7-96fc-4ef5-bc75-23f69bda29df tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:24.250278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-813b70a7-96fc-4ef5-bc75-23f69bda29df tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: f5cd4124-73ad-4109-a774-b76ba75ab797] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:24.298047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-813b70a7-96fc-4ef5-bc75-23f69bda29df tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:24.330490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-813b70a7-96fc-4ef5-bc75-23f69bda29df tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:24.359739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-813b70a7-96fc-4ef5-bc75-23f69bda29df tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:24.369819 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-813b70a7-96fc-4ef5-bc75-23f69bda29df tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:24.602264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-679a0ce6-bcaa-425a-8a60-321747a8a6ea tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:24.618914 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-679a0ce6-bcaa-425a-8a60-321747a8a6ea tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:24.624796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-679a0ce6-bcaa-425a-8a60-321747a8a6ea tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:24.634732 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-679a0ce6-bcaa-425a-8a60-321747a8a6ea tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1407 microversion: 2.20 time: 0.905029 Jul 25 13:11:24.644533 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2710/5491] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:11:23 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1407 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:11:24.681578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4af1a7d4-79c1-4df3-a35b-62ea5fe47865 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:24.682767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4af1a7d4-79c1-4df3-a35b-62ea5fe47865 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:24.692894 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4af1a7d4-79c1-4df3-a35b-62ea5fe47865 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:24.694598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4af1a7d4-79c1-4df3-a35b-62ea5fe47865 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:24.695714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4af1a7d4-79c1-4df3-a35b-62ea5fe47865 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:24.696427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4af1a7d4-79c1-4df3-a35b-62ea5fe47865 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:24.843182 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-813b70a7-96fc-4ef5-bc75-23f69bda29df tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:24.855842 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-813b70a7-96fc-4ef5-bc75-23f69bda29df tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797" status: 200 len: 1306 microversion: 2.1 time: 0.622162 Jul 25 13:11:24.861665 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2782/5492] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:24 2022] GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797 => generated 1306 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:24.870883 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3bd0f45d-9271-431f-a170-06b6e5fa5043 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:24.871846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3bd0f45d-9271-431f-a170-06b6e5fa5043 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:24.888813 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3bd0f45d-9271-431f-a170-06b6e5fa5043 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:24.889525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3bd0f45d-9271-431f-a170-06b6e5fa5043 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:24.891473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3bd0f45d-9271-431f-a170-06b6e5fa5043 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:24.893222 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3bd0f45d-9271-431f-a170-06b6e5fa5043 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:26.576523 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4af1a7d4-79c1-4df3-a35b-62ea5fe47865 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 200 len: 1465 microversion: 2.1 time: 1.905023 Jul 25 13:11:26.581258 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2711/5493] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:24 2022] GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 1465 bytes in 1911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:26.593041 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e91804b2-f561-428e-98b6-82249e6dadc6 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Calling method '.version_select at 0x7efcf8cff430>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:26.643134 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e91804b2-f561-428e-98b6-82249e6dadc6 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/d0347bc4-22e7-4318-aabe-5a8c838c955e" status: 200 len: 286 microversion: 2.1 time: 0.060251 Jul 25 13:11:26.649490 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2712/5494] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Jul 25 13:11:26 2022] GET /compute/v2.1/os-snapshots/d0347bc4-22e7-4318-aabe-5a8c838c955e => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:26.655077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b668c21d-d460-4fec-9907-28735e71d182 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:26.655734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b668c21d-d460-4fec-9907-28735e71d182 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:26.693764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b668c21d-d460-4fec-9907-28735e71d182 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:26.695852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b668c21d-d460-4fec-9907-28735e71d182 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:26.699460 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b668c21d-d460-4fec-9907-28735e71d182 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:26.700181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b668c21d-d460-4fec-9907-28735e71d182 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:26.855759 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3bd0f45d-9271-431f-a170-06b6e5fa5043 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:26.872725 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3bd0f45d-9271-431f-a170-06b6e5fa5043 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1568 microversion: 2.1 time: 2.008180 Jul 25 13:11:26.873624 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2783/5495] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:24 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1568 bytes in 2011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:26.913842 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-19a38f91-da5c-4e73-94ee-244198110f7a tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:26.914817 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-19a38f91-da5c-4e73-94ee-244198110f7a tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: f5cd4124-73ad-4109-a774-b76ba75ab797] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:26.927973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-19a38f91-da5c-4e73-94ee-244198110f7a tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:26.928659 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-19a38f91-da5c-4e73-94ee-244198110f7a tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:26.930141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-19a38f91-da5c-4e73-94ee-244198110f7a tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:26.931003 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-19a38f91-da5c-4e73-94ee-244198110f7a tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:27.756719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b668c21d-d460-4fec-9907-28735e71d182 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:27.769555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b668c21d-d460-4fec-9907-28735e71d182 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:27.771204 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b668c21d-d460-4fec-9907-28735e71d182 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:27.772404 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b668c21d-d460-4fec-9907-28735e71d182 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1407 microversion: 2.20 time: 1.121691 Jul 25 13:11:27.776263 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2713/5496] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:11:26 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1407 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:11:27.789148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-19a38f91-da5c-4e73-94ee-244198110f7a tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:27.794204 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0ca5853e-ebf2-44a7-870e-e3f25042a019 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:27.794818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0ca5853e-ebf2-44a7-870e-e3f25042a019 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:27.805635 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-19a38f91-da5c-4e73-94ee-244198110f7a tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797" status: 200 len: 1373 microversion: 2.1 time: 0.930593 Jul 25 13:11:27.806879 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2784/5497] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:26 2022] GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797 => generated 1373 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:27.816464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ca5853e-ebf2-44a7-870e-e3f25042a019 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:27.816934 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ca5853e-ebf2-44a7-870e-e3f25042a019 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:27.817740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ca5853e-ebf2-44a7-870e-e3f25042a019 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:27.818218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ca5853e-ebf2-44a7-870e-e3f25042a019 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:27.841639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6f69b4c3-ccdc-4c86-a6db-626a2ded2427 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Calling method '.version_select at 0x7efcf9310ca0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:27.923355 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6f69b4c3-ccdc-4c86-a6db-626a2ded2427 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/d0347bc4-22e7-4318-aabe-5a8c838c955e" status: 200 len: 287 microversion: 2.1 time: 0.115292 Jul 25 13:11:27.924685 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2785/5498] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Jul 25 13:11:27 2022] GET /compute/v2.1/os-snapshots/d0347bc4-22e7-4318-aabe-5a8c838c955e => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:27.931104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6b82da51-6acf-4a54-9b46-0e00b5d771c4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:27.932076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6b82da51-6acf-4a54-9b46-0e00b5d771c4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:27.957620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b82da51-6acf-4a54-9b46-0e00b5d771c4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:27.963324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b82da51-6acf-4a54-9b46-0e00b5d771c4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:27.964382 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b82da51-6acf-4a54-9b46-0e00b5d771c4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:27.964962 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b82da51-6acf-4a54-9b46-0e00b5d771c4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:28.074206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=12 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:11:28.441524 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0ca5853e-ebf2-44a7-870e-e3f25042a019 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 200 len: 1465 microversion: 2.1 time: 0.657165 Jul 25 13:11:28.445687 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2714/5499] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:27 2022] GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 1465 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:28.454593 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7727483f-e2b9-4377-95ab-75362327b668 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Calling method '.version_select at 0x7efcf903c160>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:28.466475 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6b82da51-6acf-4a54-9b46-0e00b5d771c4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:28.476838 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6b82da51-6acf-4a54-9b46-0e00b5d771c4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1568 microversion: 2.1 time: 0.550704 Jul 25 13:11:28.477790 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2786/5500] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:27 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1568 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:28.566537 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7727483f-e2b9-4377-95ab-75362327b668 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/d0347bc4-22e7-4318-aabe-5a8c838c955e" status: 202 len: 0 microversion: 2.1 time: 0.119531 Jul 25 13:11:28.570473 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2715/5501] 10.222.0.49 () {58 vars in 1254 bytes} [Mon Jul 25 13:11:28 2022] DELETE /compute/v2.1/os-snapshots/d0347bc4-22e7-4318-aabe-5a8c838c955e => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:11:28.577988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7e7d3955-c6ca-4df6-a7ee-2580be244646 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Calling method '.version_select at 0x7efcf8947c10>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:28.639791 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7e7d3955-c6ca-4df6-a7ee-2580be244646 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/d0347bc4-22e7-4318-aabe-5a8c838c955e" status: 200 len: 286 microversion: 2.1 time: 0.067693 Jul 25 13:11:28.644827 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2787/5502] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Jul 25 13:11:28 2022] GET /compute/v2.1/os-snapshots/d0347bc4-22e7-4318-aabe-5a8c838c955e => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:28.806721 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dae6a508-4551-43cd-953e-21978696f226 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:28.807457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dae6a508-4551-43cd-953e-21978696f226 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:28.817782 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dae6a508-4551-43cd-953e-21978696f226 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:28.819151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dae6a508-4551-43cd-953e-21978696f226 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:28.820002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dae6a508-4551-43cd-953e-21978696f226 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:28.833411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-24e24129-ce07-45be-a1c9-9e4e01ecccb6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:28.834208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-24e24129-ce07-45be-a1c9-9e4e01ecccb6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: f5cd4124-73ad-4109-a774-b76ba75ab797] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:28.844074 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dae6a508-4551-43cd-953e-21978696f226 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:28.845284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24e24129-ce07-45be-a1c9-9e4e01ecccb6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:28.846833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24e24129-ce07-45be-a1c9-9e4e01ecccb6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:28.849387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24e24129-ce07-45be-a1c9-9e4e01ecccb6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:28.851555 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-24e24129-ce07-45be-a1c9-9e4e01ecccb6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:29.943168 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dae6a508-4551-43cd-953e-21978696f226 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:29.974689 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dae6a508-4551-43cd-953e-21978696f226 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:29.979309 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dae6a508-4551-43cd-953e-21978696f226 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:29.980615 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dae6a508-4551-43cd-953e-21978696f226 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1407 microversion: 2.20 time: 1.178413 Jul 25 13:11:30.004552 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2716/5503] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:11:28 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1407 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:11:30.022065 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-6639122c-bf54-4fb0-bfbf-485d4d5edac1 req-81159daf-2ca0-49b4-98ee-ed2f8db0b95e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce5b1487-0b50-44f9-a231-108735a91af7", "tag": "5b64621f-a29d-42c2-86d3-b83fab0c338d"}, {"server_uuid": "2ae5b75c-47c5-43a8-9a2b-534ef2da70ac", "name": "network-vif-deleted", "tag": "1df08ef9-a76e-4c64-8cad-e0421a70a335"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:11:30.046382 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-6639122c-bf54-4fb0-bfbf-485d4d5edac1 req-81159daf-2ca0-49b4-98ee-ed2f8db0b95e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:30.046838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-6639122c-bf54-4fb0-bfbf-485d4d5edac1 req-81159daf-2ca0-49b4-98ee-ed2f8db0b95e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:30.083668 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-6639122c-bf54-4fb0-bfbf-485d4d5edac1 req-81159daf-2ca0-49b4-98ee-ed2f8db0b95e service nova] Creating event network-changed:5b64621f-a29d-42c2-86d3-b83fab0c338d for instance ce5b1487-0b50-44f9-a231-108735a91af7 on n-h2-848886-15 Jul 25 13:11:30.090646 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-6639122c-bf54-4fb0-bfbf-485d4d5edac1 req-81159daf-2ca0-49b4-98ee-ed2f8db0b95e service nova] Creating event network-vif-deleted:1df08ef9-a76e-4c64-8cad-e0421a70a335 for instance 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac on n-h2-848886-15 Jul 25 13:11:30.115083 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-6639122c-bf54-4fb0-bfbf-485d4d5edac1 req-81159daf-2ca0-49b4-98ee-ed2f8db0b95e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.103895 Jul 25 13:11:30.120164 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2717/5504] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:30.129415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-291fc676-68ea-4096-b425-5e688ca2de78 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:30.136844 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-291fc676-68ea-4096-b425-5e688ca2de78 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:30.152078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-291fc676-68ea-4096-b425-5e688ca2de78 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:30.152861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-291fc676-68ea-4096-b425-5e688ca2de78 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:30.154026 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-291fc676-68ea-4096-b425-5e688ca2de78 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:30.154686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-291fc676-68ea-4096-b425-5e688ca2de78 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:30.213687 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-24e24129-ce07-45be-a1c9-9e4e01ecccb6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:30.225676 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-24e24129-ce07-45be-a1c9-9e4e01ecccb6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797" status: 200 len: 1373 microversion: 2.1 time: 1.396357 Jul 25 13:11:30.246332 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2788/5505] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:28 2022] GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797 => generated 1373 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:11:30.255789 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-252b78f7-d501-497e-a071-d2c565e4ca32 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:30.262634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-252b78f7-d501-497e-a071-d2c565e4ca32 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:30.278674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-252b78f7-d501-497e-a071-d2c565e4ca32 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:30.279429 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-252b78f7-d501-497e-a071-d2c565e4ca32 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:30.282376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-252b78f7-d501-497e-a071-d2c565e4ca32 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:30.283654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-252b78f7-d501-497e-a071-d2c565e4ca32 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:30.395350 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:11:30.435597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=16 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:11:30.676629 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-291fc676-68ea-4096-b425-5e688ca2de78 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 200 len: 1465 microversion: 2.1 time: 0.552687 Jul 25 13:11:30.677308 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2718/5506] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:30 2022] GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 1465 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:30.693771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f6299b23-6c49-4ad6-8468-6ff2de7034ee tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Calling method '.version_select at 0x7efcf8417e50>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:30.711737 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-252b78f7-d501-497e-a071-d2c565e4ca32 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:30.725910 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-252b78f7-d501-497e-a071-d2c565e4ca32 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1360 microversion: 2.1 time: 0.477617 Jul 25 13:11:30.729048 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2789/5507] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:30 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1360 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:30.770471 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f6299b23-6c49-4ad6-8468-6ff2de7034ee tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/d0347bc4-22e7-4318-aabe-5a8c838c955e" status: 200 len: 286 microversion: 2.1 time: 0.089163 Jul 25 13:11:30.771482 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2719/5508] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Jul 25 13:11:30 2022] GET /compute/v2.1/os-snapshots/d0347bc4-22e7-4318-aabe-5a8c838c955e => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:31.016932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cc06c08f-b1c8-40d5-947d-6ef7b1a97cdb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:31.017909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cc06c08f-b1c8-40d5-947d-6ef7b1a97cdb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:31.030838 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc06c08f-b1c8-40d5-947d-6ef7b1a97cdb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:31.032076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc06c08f-b1c8-40d5-947d-6ef7b1a97cdb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:31.034852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc06c08f-b1c8-40d5-947d-6ef7b1a97cdb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:31.035552 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc06c08f-b1c8-40d5-947d-6ef7b1a97cdb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:31.255782 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a2049cc9-66a9-4e00-802e-788a03c5a6cc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:31.256444 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a2049cc9-66a9-4e00-802e-788a03c5a6cc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: f5cd4124-73ad-4109-a774-b76ba75ab797] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:31.265271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2049cc9-66a9-4e00-802e-788a03c5a6cc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:31.279000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2049cc9-66a9-4e00-802e-788a03c5a6cc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:31.280464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2049cc9-66a9-4e00-802e-788a03c5a6cc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:31.281184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a2049cc9-66a9-4e00-802e-788a03c5a6cc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:31.642247 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a2049cc9-66a9-4e00-802e-788a03c5a6cc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:31.658936 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a2049cc9-66a9-4e00-802e-788a03c5a6cc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797" status: 200 len: 1373 microversion: 2.1 time: 0.407979 Jul 25 13:11:31.659551 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2720/5509] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:31 2022] GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797 => generated 1373 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:11:31.710228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-912343e7-290d-471e-abef-dfc69531d2af tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:31.710896 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-912343e7-290d-471e-abef-dfc69531d2af tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:31.729783 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-912343e7-290d-471e-abef-dfc69531d2af tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:31.730275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-912343e7-290d-471e-abef-dfc69531d2af tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:31.731078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-912343e7-290d-471e-abef-dfc69531d2af tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:31.731528 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-912343e7-290d-471e-abef-dfc69531d2af tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:32.103577 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cc06c08f-b1c8-40d5-947d-6ef7b1a97cdb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:32.138753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cc06c08f-b1c8-40d5-947d-6ef7b1a97cdb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:32.150309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cc06c08f-b1c8-40d5-947d-6ef7b1a97cdb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:32.156050 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cc06c08f-b1c8-40d5-947d-6ef7b1a97cdb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1407 microversion: 2.20 time: 1.141037 Jul 25 13:11:32.159249 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2790/5510] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:11:31 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1407 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:11:32.164833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3e6413a6-0e5c-46c2-b165-d455afdb66a9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:32.173658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3e6413a6-0e5c-46c2-b165-d455afdb66a9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:32.191322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e6413a6-0e5c-46c2-b165-d455afdb66a9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:32.197210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e6413a6-0e5c-46c2-b165-d455afdb66a9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:32.198649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e6413a6-0e5c-46c2-b165-d455afdb66a9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:32.199357 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e6413a6-0e5c-46c2-b165-d455afdb66a9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:32.359014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3e6413a6-0e5c-46c2-b165-d455afdb66a9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:32.368295 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3e6413a6-0e5c-46c2-b165-d455afdb66a9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1360 microversion: 2.1 time: 0.207748 Jul 25 13:11:32.368899 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2791/5511] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:32 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1360 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:32.383885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5cd53f39-f98c-41ed-8f27-611f5b2ed00f tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Calling method '.version_select at 0x7efcf89470d0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:32.431040 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-5cd53f39-f98c-41ed-8f27-611f5b2ed00f tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] HTTP exception thrown: Snapshot d0347bc4-22e7-4318-aabe-5a8c838c955e could not be found. Jul 25 13:11:32.438073 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-912343e7-290d-471e-abef-dfc69531d2af tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 200 len: 1465 microversion: 2.1 time: 0.738822 Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5cd53f39-f98c-41ed-8f27-611f5b2ed00f tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Request method failure captured: Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/os-snapshots/d0347bc4-22e7-4318-aabe-5a8c838c955e HTTP/1.1 Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pZ3HfhrymEOgTdwrqHDh6j4EYt_886mjakIpTK8tTWvk1IX-hprqIhVAlcVrM8QfS22c_GJrX5vc2wstLgEimyyl37YgPfMIxV8C5RNG8FTezxNzP96W_p_0T0oWMyRU05Gjbbm-2b3x7MiN8Y_ww73xLlf9vRnRosPNAXpiE7u84g Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: fbbc3d20b8d14c4aa7a8bcebd1d6a20a Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-181105961 Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fbbc3d20b8d14c4aa7a8bcebd1d6a20a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fbbc3d20b8d14c4aa7a8bcebd1d6a20a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fbbc3d20b8d14c4aa7a8bcebd1d6a20a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fbbc3d20b8d14c4aa7a8bcebd1d6a20a"}]}] Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-VolumesSnapshotsTestJSON-181105961 Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: fbbc3d20b8d14c4aa7a8bcebd1d6a20a Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-181105961 Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-VolumesSnapshotsTestJSON-181105961-project Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 8008cc8478c14001a651014a99e3d4a2 Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-VolumesSnapshotsTestJSON-181105961-project Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: exception: Snapshot d0347bc4-22e7-4318-aabe-5a8c838c955e could not be found. Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'd0347bc4-22e7-4318-aabe-5a8c838c955e'} Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d0347bc4-22e7-4318-aabe-5a8c838c955e could not be found. (HTTP 404) (Request-ID: req-3191d050-f5c8-482e-a14c-6f5bf71609ea) Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 13:11:32.440134 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d0347bc4-22e7-4318-aabe-5a8c838c955e could not be found. Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d0347bc4-22e7-4318-aabe-5a8c838c955e could not be found. Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d0347bc4-22e7-4318-aabe-5a8c838c955e could not be found. Jul 25 13:11:32.444933 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:11:32.449591 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2721/5512] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:31 2022] GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 1465 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:11:32.449591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-478f3aea-59b7-45ad-94a1-55d3ff4a099d req-aa27dfe7-fb42-412c-8bfe-c86a07986130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5cd4124-73ad-4109-a774-b76ba75ab797", "tag": "c07fc42d-c325-4ff7-acd7-7c37f4071fd9"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:11:32.451026 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5cd53f39-f98c-41ed-8f27-611f5b2ed00f tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Returning 404 to user: Snapshot d0347bc4-22e7-4318-aabe-5a8c838c955e could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:11:32.451934 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5cd53f39-f98c-41ed-8f27-611f5b2ed00f tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/d0347bc4-22e7-4318-aabe-5a8c838c955e" status: 404 len: 111 microversion: 2.1 time: 0.078188 Jul 25 13:11:32.452518 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2792/5513] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Jul 25 13:11:32 2022] GET /compute/v2.1/os-snapshots/d0347bc4-22e7-4318-aabe-5a8c838c955e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:11:32.468020 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-62fa9081-e3f4-42df-89a7-2c35b2436352 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Calling method '.version_select at 0x7efcf8e58d30>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:32.472760 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-478f3aea-59b7-45ad-94a1-55d3ff4a099d req-aa27dfe7-fb42-412c-8bfe-c86a07986130 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:32.473229 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-478f3aea-59b7-45ad-94a1-55d3ff4a099d req-aa27dfe7-fb42-412c-8bfe-c86a07986130 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:32.508771 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-478f3aea-59b7-45ad-94a1-55d3ff4a099d req-aa27dfe7-fb42-412c-8bfe-c86a07986130 service nova] Creating event network-changed:c07fc42d-c325-4ff7-acd7-7c37f4071fd9 for instance f5cd4124-73ad-4109-a774-b76ba75ab797 on n-h1-848886-15 Jul 25 13:11:32.519426 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-478f3aea-59b7-45ad-94a1-55d3ff4a099d req-aa27dfe7-fb42-412c-8bfe-c86a07986130 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075923 Jul 25 13:11:32.526293 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2722/5514] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:32.581035 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-62fa9081-e3f4-42df-89a7-2c35b2436352 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/fbcbba1a-a262-45e2-bb9d-7a18da703c9a" status: 202 len: 0 microversion: 2.1 time: 0.123854 Jul 25 13:11:32.585244 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2793/5515] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Jul 25 13:11:32 2022] DELETE /compute/v2.1/os-volumes/fbcbba1a-a262-45e2-bb9d-7a18da703c9a => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 13:11:32.591012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b737252d-0166-4274-80fc-65227f5e5298 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Calling method '.version_select at 0x7efcf8405550>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:32.681077 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b737252d-0166-4274-80fc-65227f5e5298 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/fbcbba1a-a262-45e2-bb9d-7a18da703c9a" status: 200 len: 344 microversion: 2.1 time: 0.094421 Jul 25 13:11:32.682000 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2723/5516] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Jul 25 13:11:32 2022] GET /compute/v2.1/os-volumes/fbcbba1a-a262-45e2-bb9d-7a18da703c9a => generated 344 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:32.685235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-66764b4a-bf0c-4316-baae-133da148f635 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:32.686796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-66764b4a-bf0c-4316-baae-133da148f635 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: f5cd4124-73ad-4109-a774-b76ba75ab797] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:32.694196 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-66764b4a-bf0c-4316-baae-133da148f635 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:32.695069 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-66764b4a-bf0c-4316-baae-133da148f635 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:32.696102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-66764b4a-bf0c-4316-baae-133da148f635 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:32.696746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-66764b4a-bf0c-4316-baae-133da148f635 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:32.943382 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-66764b4a-bf0c-4316-baae-133da148f635 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:32.974890 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-66764b4a-bf0c-4316-baae-133da148f635 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797" status: 200 len: 1373 microversion: 2.1 time: 0.294390 Jul 25 13:11:32.976147 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2794/5517] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:32 2022] GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797 => generated 1373 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:11:33.181945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9b8ebc1d-0f60-4ece-9aba-c2a3a689f27b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:33.182726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9b8ebc1d-0f60-4ece-9aba-c2a3a689f27b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:33.194300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b8ebc1d-0f60-4ece-9aba-c2a3a689f27b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:33.198538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b8ebc1d-0f60-4ece-9aba-c2a3a689f27b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:33.199686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b8ebc1d-0f60-4ece-9aba-c2a3a689f27b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:33.200370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9b8ebc1d-0f60-4ece-9aba-c2a3a689f27b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:33.214641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:11:33.388938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-936f20b7-4848-4db2-8ca6-3a1f69e8a66d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:33.389620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-936f20b7-4848-4db2-8ca6-3a1f69e8a66d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:33.404871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-936f20b7-4848-4db2-8ca6-3a1f69e8a66d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:33.405366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-936f20b7-4848-4db2-8ca6-3a1f69e8a66d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:33.406422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-936f20b7-4848-4db2-8ca6-3a1f69e8a66d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:33.406916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-936f20b7-4848-4db2-8ca6-3a1f69e8a66d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:33.604753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9b8ebc1d-0f60-4ece-9aba-c2a3a689f27b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:33.615535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-936f20b7-4848-4db2-8ca6-3a1f69e8a66d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:33.626746 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-936f20b7-4848-4db2-8ca6-3a1f69e8a66d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1360 microversion: 2.1 time: 0.241833 Jul 25 13:11:33.629062 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9b8ebc1d-0f60-4ece-9aba-c2a3a689f27b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:33.631761 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2795/5518] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:33 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1360 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:33.631968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9b8ebc1d-0f60-4ece-9aba-c2a3a689f27b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:33.633787 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9b8ebc1d-0f60-4ece-9aba-c2a3a689f27b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1407 microversion: 2.20 time: 0.456866 Jul 25 13:11:33.634587 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2724/5519] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:11:33 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1407 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:11:33.651963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4ac2559f-1047-4b50-9cab-70f35770234d tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:33.657542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4ac2559f-1047-4b50-9cab-70f35770234d tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:33.682044 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4ac2559f-1047-4b50-9cab-70f35770234d tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:33.682947 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4ac2559f-1047-4b50-9cab-70f35770234d tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:33.683990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4ac2559f-1047-4b50-9cab-70f35770234d tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:33.684772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4ac2559f-1047-4b50-9cab-70f35770234d tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:33.695264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-828bf497-ac53-4464-a1c7-a6097b7e1b36 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Calling method '.version_select at 0x7efcf8cffdc0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:33.814998 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-828bf497-ac53-4464-a1c7-a6097b7e1b36 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/fbcbba1a-a262-45e2-bb9d-7a18da703c9a" status: 200 len: 344 microversion: 2.1 time: 0.123548 Jul 25 13:11:33.815959 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2725/5520] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Jul 25 13:11:33 2022] GET /compute/v2.1/os-volumes/fbcbba1a-a262-45e2-bb9d-7a18da703c9a => generated 344 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:11:34.005637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-22776500-1736-4394-95a2-9abe4fc27a90 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:34.007673 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-22776500-1736-4394-95a2-9abe4fc27a90 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: f5cd4124-73ad-4109-a774-b76ba75ab797] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:34.017517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:11:34.020432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22776500-1736-4394-95a2-9abe4fc27a90 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:34.021178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22776500-1736-4394-95a2-9abe4fc27a90 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:34.022715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22776500-1736-4394-95a2-9abe4fc27a90 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:34.023630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22776500-1736-4394-95a2-9abe4fc27a90 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:34.147605 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4ac2559f-1047-4b50-9cab-70f35770234d tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 200 len: 1465 microversion: 2.1 time: 0.504473 Jul 25 13:11:34.166261 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2796/5521] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:33 2022] GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 1465 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:34.176000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-813b0471-2bc8-484d-91f5-8d1a848e00bb req-3c20687e-6830-4be7-8159-479be9ea1904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffd02cb-a0ad-4b1f-b129-6fee94dc57af", "name": "network-vif-plugged", "status": "completed", "tag": "f70aacb3-9955-48b6-92e4-b936a8bc527b"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:11:34.200449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-813b0471-2bc8-484d-91f5-8d1a848e00bb req-3c20687e-6830-4be7-8159-479be9ea1904 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:34.201256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-813b0471-2bc8-484d-91f5-8d1a848e00bb req-3c20687e-6830-4be7-8159-479be9ea1904 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:34.216246 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-813b0471-2bc8-484d-91f5-8d1a848e00bb req-3c20687e-6830-4be7-8159-479be9ea1904 service nova] Creating event network-vif-plugged:f70aacb3-9955-48b6-92e4-b936a8bc527b for instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af on n-h2-848886-15 Jul 25 13:11:34.223788 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-813b0471-2bc8-484d-91f5-8d1a848e00bb req-3c20687e-6830-4be7-8159-479be9ea1904 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056029 Jul 25 13:11:34.228718 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2797/5522] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:34.517043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-22776500-1736-4394-95a2-9abe4fc27a90 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:34.536915 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-22776500-1736-4394-95a2-9abe4fc27a90 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797" status: 200 len: 1373 microversion: 2.1 time: 0.534850 Jul 25 13:11:34.537984 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2726/5523] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:33 2022] GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797 => generated 1373 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:34.653725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7485f58e-2e5d-4660-b799-5c94acc59fb3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:34.654620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7485f58e-2e5d-4660-b799-5c94acc59fb3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:34.661686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a621430c-d437-460c-98a9-9cb9378a9b96 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:34.663141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a621430c-d437-460c-98a9-9cb9378a9b96 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:34.694770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a621430c-d437-460c-98a9-9cb9378a9b96 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:34.695317 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a621430c-d437-460c-98a9-9cb9378a9b96 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:34.696135 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a621430c-d437-460c-98a9-9cb9378a9b96 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:34.696592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a621430c-d437-460c-98a9-9cb9378a9b96 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:34.698600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7485f58e-2e5d-4660-b799-5c94acc59fb3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:34.706805 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7485f58e-2e5d-4660-b799-5c94acc59fb3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:34.708770 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7485f58e-2e5d-4660-b799-5c94acc59fb3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:34.711662 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7485f58e-2e5d-4660-b799-5c94acc59fb3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:34.915749 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7485f58e-2e5d-4660-b799-5c94acc59fb3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:34.925232 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7485f58e-2e5d-4660-b799-5c94acc59fb3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1360 microversion: 2.1 time: 0.276824 Jul 25 13:11:34.938153 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2798/5524] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:34 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1360 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:11:34.943359 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6b7dc7d2-3730-4518-a8d4-4a5d86ad56ad tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Calling method '.version_select at 0x7efcf8e33790>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:35.036759 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6b7dc7d2-3730-4518-a8d4-4a5d86ad56ad tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/fbcbba1a-a262-45e2-bb9d-7a18da703c9a" status: 200 len: 344 microversion: 2.1 time: 0.097293 Jul 25 13:11:35.045877 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2799/5525] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Jul 25 13:11:34 2022] GET /compute/v2.1/os-volumes/fbcbba1a-a262-45e2-bb9d-7a18da703c9a => generated 344 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:35.095897 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a621430c-d437-460c-98a9-9cb9378a9b96 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:35.112642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a621430c-d437-460c-98a9-9cb9378a9b96 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:35.116629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a621430c-d437-460c-98a9-9cb9378a9b96 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:35.121353 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a621430c-d437-460c-98a9-9cb9378a9b96 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1407 microversion: 2.20 time: 0.463855 Jul 25 13:11:35.122715 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2727/5526] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:11:34 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1407 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:11:35.174183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-79bb76f1-fbcf-46f0-a476-8c6a552ec5d0 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:35.174813 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-79bb76f1-fbcf-46f0-a476-8c6a552ec5d0 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:35.185250 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:11:35.187105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-79bb76f1-fbcf-46f0-a476-8c6a552ec5d0 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:35.189896 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-79bb76f1-fbcf-46f0-a476-8c6a552ec5d0 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:35.194656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-79bb76f1-fbcf-46f0-a476-8c6a552ec5d0 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:35.194656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-79bb76f1-fbcf-46f0-a476-8c6a552ec5d0 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:35.508784 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-79bb76f1-fbcf-46f0-a476-8c6a552ec5d0 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 200 len: 1465 microversion: 2.1 time: 0.339422 Jul 25 13:11:35.524664 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2800/5527] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:35 2022] GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 1465 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:35.563686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-68926a82-8b3b-4f22-b3c8-3528c0f3acdd tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:35.564400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-68926a82-8b3b-4f22-b3c8-3528c0f3acdd tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: f5cd4124-73ad-4109-a774-b76ba75ab797] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:35.574502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68926a82-8b3b-4f22-b3c8-3528c0f3acdd tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:35.574979 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68926a82-8b3b-4f22-b3c8-3528c0f3acdd tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:35.575802 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68926a82-8b3b-4f22-b3c8-3528c0f3acdd tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:35.576259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68926a82-8b3b-4f22-b3c8-3528c0f3acdd tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:35.874501 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-68926a82-8b3b-4f22-b3c8-3528c0f3acdd tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:35.885799 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-68926a82-8b3b-4f22-b3c8-3528c0f3acdd tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797" status: 200 len: 1373 microversion: 2.1 time: 0.326574 Jul 25 13:11:35.887432 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2728/5528] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:35 2022] GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797 => generated 1373 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:35.963293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4d6e351f-4ce5-4d64-a793-084103713276 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:35.963967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4d6e351f-4ce5-4d64-a793-084103713276 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:35.971643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d6e351f-4ce5-4d64-a793-084103713276 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:35.972400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d6e351f-4ce5-4d64-a793-084103713276 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:35.973397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d6e351f-4ce5-4d64-a793-084103713276 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:35.979765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d6e351f-4ce5-4d64-a793-084103713276 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:36.051185 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1213d6fc-f72c-4202-9097-73ffe90b49d1 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Calling method '.version_select at 0x7efcf97263a0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:36.085045 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4d6e351f-4ce5-4d64-a793-084103713276 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:36.090810 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-1213d6fc-f72c-4202-9097-73ffe90b49d1 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] HTTP exception thrown: Volume fbcbba1a-a262-45e2-bb9d-7a18da703c9a could not be found. Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1213d6fc-f72c-4202-9097-73ffe90b49d1 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Request method failure captured: Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-volumes/fbcbba1a-a262-45e2-bb9d-7a18da703c9a HTTP/1.1 Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pZ3HfhrymEOgTdwrqHDh6j4EYt_886mjakIpTK8tTWvk1IX-hprqIhVAlcVrM8QfS22c_GJrX5vc2wstLgEimyyl37YgPfMIxV8C5RNG8FTezxNzP96W_p_0T0oWMyRU05Gjbbm-2b3x7MiN8Y_ww73xLlf9vRnRosPNAXpiE7u84g Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: fbbc3d20b8d14c4aa7a8bcebd1d6a20a Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-181105961 Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fbbc3d20b8d14c4aa7a8bcebd1d6a20a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fbbc3d20b8d14c4aa7a8bcebd1d6a20a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fbbc3d20b8d14c4aa7a8bcebd1d6a20a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fbbc3d20b8d14c4aa7a8bcebd1d6a20a"}]}] Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-VolumesSnapshotsTestJSON-181105961 Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: fbbc3d20b8d14c4aa7a8bcebd1d6a20a Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-181105961 Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-VolumesSnapshotsTestJSON-181105961-project Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8008cc8478c14001a651014a99e3d4a2 Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-VolumesSnapshotsTestJSON-181105961-project Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: exception: Volume fbcbba1a-a262-45e2-bb9d-7a18da703c9a could not be found. Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'fbcbba1a-a262-45e2-bb9d-7a18da703c9a'} Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fbcbba1a-a262-45e2-bb9d-7a18da703c9a could not be found. (HTTP 404) (Request-ID: req-9e6f11c9-bc45-4d22-85f7-7eeb869234f5) Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 13:11:36.092762 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fbcbba1a-a262-45e2-bb9d-7a18da703c9a could not be found. Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fbcbba1a-a262-45e2-bb9d-7a18da703c9a could not be found. Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fbcbba1a-a262-45e2-bb9d-7a18da703c9a could not be found. Jul 25 13:11:36.097711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:36.101201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1213d6fc-f72c-4202-9097-73ffe90b49d1 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Returning 404 to user: Volume fbcbba1a-a262-45e2-bb9d-7a18da703c9a could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:11:36.102155 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1213d6fc-f72c-4202-9097-73ffe90b49d1 tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/fbcbba1a-a262-45e2-bb9d-7a18da703c9a" status: 404 len: 109 microversion: 2.1 time: 0.054965 Jul 25 13:11:36.102756 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2729/5529] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Jul 25 13:11:36 2022] GET /compute/v2.1/os-volumes/fbcbba1a-a262-45e2-bb9d-7a18da703c9a => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 13:11:36.124596 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-980ae6f8-8a73-467e-8051-401c84495eea tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Calling method '.version_select at 0x7efcf8cf4430>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:36.127374 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4d6e351f-4ce5-4d64-a793-084103713276 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1360 microversion: 2.1 time: 0.168277 Jul 25 13:11:36.130154 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2801/5530] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:35 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1360 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:36.154234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-44ea83eb-e2d3-454f-96aa-896b6ab39502 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:36.155074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-44ea83eb-e2d3-454f-96aa-896b6ab39502 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:36.161852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44ea83eb-e2d3-454f-96aa-896b6ab39502 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:36.162520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44ea83eb-e2d3-454f-96aa-896b6ab39502 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:36.163485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44ea83eb-e2d3-454f-96aa-896b6ab39502 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:36.164327 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44ea83eb-e2d3-454f-96aa-896b6ab39502 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:36.198590 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-980ae6f8-8a73-467e-8051-401c84495eea tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] HTTP exception thrown: Volume fbcbba1a-a262-45e2-bb9d-7a18da703c9a could not be found. Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-980ae6f8-8a73-467e-8051-401c84495eea tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Request method failure captured: Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/os-volumes/fbcbba1a-a262-45e2-bb9d-7a18da703c9a HTTP/1.1 Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pZ3HfhrymEOgTdwrqHDh6j4EYt_886mjakIpTK8tTWvk1IX-hprqIhVAlcVrM8QfS22c_GJrX5vc2wstLgEimyyl37YgPfMIxV8C5RNG8FTezxNzP96W_p_0T0oWMyRU05Gjbbm-2b3x7MiN8Y_ww73xLlf9vRnRosPNAXpiE7u84g Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: fbbc3d20b8d14c4aa7a8bcebd1d6a20a Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-181105961 Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fbbc3d20b8d14c4aa7a8bcebd1d6a20a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fbbc3d20b8d14c4aa7a8bcebd1d6a20a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fbbc3d20b8d14c4aa7a8bcebd1d6a20a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fbbc3d20b8d14c4aa7a8bcebd1d6a20a"}]}] Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-VolumesSnapshotsTestJSON-181105961 Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: fbbc3d20b8d14c4aa7a8bcebd1d6a20a Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-181105961 Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-VolumesSnapshotsTestJSON-181105961-project Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8008cc8478c14001a651014a99e3d4a2 Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-VolumesSnapshotsTestJSON-181105961-project Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: exception: Volume fbcbba1a-a262-45e2-bb9d-7a18da703c9a could not be found. Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'fbcbba1a-a262-45e2-bb9d-7a18da703c9a'} Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fbcbba1a-a262-45e2-bb9d-7a18da703c9a could not be found. (HTTP 404) (Request-ID: req-c6cc4cf8-c537-4bbd-80ca-764b595fb384) Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 13:11:36.200732 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fbcbba1a-a262-45e2-bb9d-7a18da703c9a could not be found. Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fbcbba1a-a262-45e2-bb9d-7a18da703c9a could not be found. Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fbcbba1a-a262-45e2-bb9d-7a18da703c9a could not be found. Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-980ae6f8-8a73-467e-8051-401c84495eea tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Returning 404 to user: Volume fbcbba1a-a262-45e2-bb9d-7a18da703c9a could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-980ae6f8-8a73-467e-8051-401c84495eea tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/fbcbba1a-a262-45e2-bb9d-7a18da703c9a" status: 404 len: 109 microversion: 2.1 time: 0.093812 Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2730/5531] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Jul 25 13:11:36 2022] DELETE /compute/v2.1/os-volumes/fbcbba1a-a262-45e2-bb9d-7a18da703c9a => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 13:11:36.218857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d17496af-8d79-4c60-af2c-1f851339e6dc tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Calling method '.version_select at 0x7efcf9726d30>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:36.235270 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:11:36.315375 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-d17496af-8d79-4c60-af2c-1f851339e6dc tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] HTTP exception thrown: Volume fbcbba1a-a262-45e2-bb9d-7a18da703c9a could not be found. Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d17496af-8d79-4c60-af2c-1f851339e6dc tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Request method failure captured: Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-volumes/fbcbba1a-a262-45e2-bb9d-7a18da703c9a HTTP/1.1 Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pZ3HfhrymEOgTdwrqHDh6j4EYt_886mjakIpTK8tTWvk1IX-hprqIhVAlcVrM8QfS22c_GJrX5vc2wstLgEimyyl37YgPfMIxV8C5RNG8FTezxNzP96W_p_0T0oWMyRU05Gjbbm-2b3x7MiN8Y_ww73xLlf9vRnRosPNAXpiE7u84g Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: fbbc3d20b8d14c4aa7a8bcebd1d6a20a Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-181105961 Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fbbc3d20b8d14c4aa7a8bcebd1d6a20a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fbbc3d20b8d14c4aa7a8bcebd1d6a20a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fbbc3d20b8d14c4aa7a8bcebd1d6a20a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fbbc3d20b8d14c4aa7a8bcebd1d6a20a"}]}] Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-VolumesSnapshotsTestJSON-181105961 Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: fbbc3d20b8d14c4aa7a8bcebd1d6a20a Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-181105961 Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-VolumesSnapshotsTestJSON-181105961-project Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 8008cc8478c14001a651014a99e3d4a2 Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-VolumesSnapshotsTestJSON-181105961-project Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: exception: Volume fbcbba1a-a262-45e2-bb9d-7a18da703c9a could not be found. Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'fbcbba1a-a262-45e2-bb9d-7a18da703c9a'} Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fbcbba1a-a262-45e2-bb9d-7a18da703c9a could not be found. (HTTP 404) (Request-ID: req-fb41f914-ff50-40ca-943d-539ce5718d17) Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 13:11:36.317593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fbcbba1a-a262-45e2-bb9d-7a18da703c9a could not be found. Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fbcbba1a-a262-45e2-bb9d-7a18da703c9a could not be found. Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fbcbba1a-a262-45e2-bb9d-7a18da703c9a could not be found. Jul 25 13:11:36.321518 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:36.325984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d17496af-8d79-4c60-af2c-1f851339e6dc tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] Returning 404 to user: Volume fbcbba1a-a262-45e2-bb9d-7a18da703c9a could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:11:36.327121 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d17496af-8d79-4c60-af2c-1f851339e6dc tempest-VolumesSnapshotsTestJSON-181105961 tempest-VolumesSnapshotsTestJSON-181105961-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/fbcbba1a-a262-45e2-bb9d-7a18da703c9a" status: 404 len: 109 microversion: 2.1 time: 0.115843 Jul 25 13:11:36.327910 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2731/5532] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Jul 25 13:11:36 2022] GET /compute/v2.1/os-volumes/fbcbba1a-a262-45e2-bb9d-7a18da703c9a => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 13:11:36.536400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-226d639a-9c8f-43d9-b8ba-0252867231a9 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:36.539976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-226d639a-9c8f-43d9-b8ba-0252867231a9 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:36.566396 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-44ea83eb-e2d3-454f-96aa-896b6ab39502 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:36.580947 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-44ea83eb-e2d3-454f-96aa-896b6ab39502 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:36.583576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-44ea83eb-e2d3-454f-96aa-896b6ab39502 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:36.586257 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-44ea83eb-e2d3-454f-96aa-896b6ab39502 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1599 microversion: 2.20 time: 0.442323 Jul 25 13:11:36.587719 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2802/5533] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:11:36 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1599 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:11:36.594969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-226d639a-9c8f-43d9-b8ba-0252867231a9 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:36.599103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-226d639a-9c8f-43d9-b8ba-0252867231a9 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:36.603674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-226d639a-9c8f-43d9-b8ba-0252867231a9 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:36.606500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-226d639a-9c8f-43d9-b8ba-0252867231a9 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:36.612788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-be369876-f1a4-4f38-a937-f44f7996bd8d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:36.613657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-be369876-f1a4-4f38-a937-f44f7996bd8d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:36.622649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be369876-f1a4-4f38-a937-f44f7996bd8d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:36.623987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be369876-f1a4-4f38-a937-f44f7996bd8d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:36.625408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be369876-f1a4-4f38-a937-f44f7996bd8d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:36.626420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be369876-f1a4-4f38-a937-f44f7996bd8d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:37.055454 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-be369876-f1a4-4f38-a937-f44f7996bd8d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.447956 Jul 25 13:11:37.056110 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2803/5534] 10.222.0.49 () {60 vars in 1316 bytes} [Mon Jul 25 13:11:36 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/os-interface => generated 285 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 13:11:37.060937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-59983ae7-b5f4-4188-80ad-a2b67775acae tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:37.061911 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-59983ae7-b5f4-4188-80ad-a2b67775acae tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: f5cd4124-73ad-4109-a774-b76ba75ab797] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:37.090212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59983ae7-b5f4-4188-80ad-a2b67775acae tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:37.091076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59983ae7-b5f4-4188-80ad-a2b67775acae tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:37.092412 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59983ae7-b5f4-4188-80ad-a2b67775acae tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:37.097300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59983ae7-b5f4-4188-80ad-a2b67775acae tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:37.145976 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-226d639a-9c8f-43d9-b8ba-0252867231a9 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 200 len: 1465 microversion: 2.1 time: 0.615968 Jul 25 13:11:37.163075 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2732/5535] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:36 2022] GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 1465 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:11:37.172588 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5bf278a6-5d9a-4c12-b162-b13288104342 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:37.173226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5bf278a6-5d9a-4c12-b162-b13288104342 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:37.199773 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5bf278a6-5d9a-4c12-b162-b13288104342 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:37.212411 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5bf278a6-5d9a-4c12-b162-b13288104342 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:37.219697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5bf278a6-5d9a-4c12-b162-b13288104342 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:37.222203 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5bf278a6-5d9a-4c12-b162-b13288104342 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:37.535086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5bf278a6-5d9a-4c12-b162-b13288104342 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:37.546903 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5bf278a6-5d9a-4c12-b162-b13288104342 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 200 len: 1360 microversion: 2.1 time: 0.382457 Jul 25 13:11:37.547511 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2733/5536] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:37 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 1360 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:37.849683 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-59983ae7-b5f4-4188-80ad-a2b67775acae tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:37.896208 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-59983ae7-b5f4-4188-80ad-a2b67775acae tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797" status: 200 len: 1373 microversion: 2.1 time: 0.837517 Jul 25 13:11:37.898256 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2804/5537] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:37 2022] GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797 => generated 1373 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:38.171279 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-101479f4-5632-4888-8629-4962ea8b9339 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:38.172789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-101479f4-5632-4888-8629-4962ea8b9339 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:38.188029 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-101479f4-5632-4888-8629-4962ea8b9339 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:38.190510 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-101479f4-5632-4888-8629-4962ea8b9339 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:38.191652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-101479f4-5632-4888-8629-4962ea8b9339 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:38.193637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-101479f4-5632-4888-8629-4962ea8b9339 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:38.579384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a3077408-ae1e-4280-a5ca-9bc9367b2071 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:38.580858 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a3077408-ae1e-4280-a5ca-9bc9367b2071 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:38.603118 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3077408-ae1e-4280-a5ca-9bc9367b2071 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:38.606606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3077408-ae1e-4280-a5ca-9bc9367b2071 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:38.608834 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3077408-ae1e-4280-a5ca-9bc9367b2071 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:38.610244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3077408-ae1e-4280-a5ca-9bc9367b2071 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:38.650584 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-a3077408-ae1e-4280-a5ca-9bc9367b2071 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] HTTP exception thrown: Instance 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac could not be found. Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a3077408-ae1e-4280-a5ca-9bc9367b2071 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Request method failure captured: Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac HTTP/1.1 Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pUsgUlyXXDFjpaxtInCA3ErKU2P2TTpSljieML2SSsbmedwjUWvmtCPv6cpRR2_rKwVTBeB1pN0R0PaQlKkP3JB2H_nZ9mFVhTCd_Xl4_Gcw-PsIj4Ff-CbWbJlbzuA6BFxmfwmUVgHks2P6PoEesxOn8j894_Z-5Z842qklFD2ecs Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b2fbd681752c41d0a24a9cf34ebc8389", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}] Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 9face2aaa9df430cb5d361c6e1fdf242 Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac could not be found. Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '2ae5b75c-47c5-43a8-9a2b-534ef2da70ac'} Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac could not be found. Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac could not be found. Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:11:38.657888 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:11:38.662111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:38.662111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:11:38.662111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:11:38.662111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:11:38.662111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:11:38.662111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac could not be found. Jul 25 13:11:38.662111 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:11:38.664597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a3077408-ae1e-4280-a5ca-9bc9367b2071 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Returning 404 to user: Instance 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:11:38.667956 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a3077408-ae1e-4280-a5ca-9bc9367b2071 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 404 len: 111 microversion: 2.1 time: 0.094760 Jul 25 13:11:38.668932 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2805/5538] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:38 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:11:38.923806 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f35ad52e-499a-41d9-a815-18e52a73c512 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:38.925202 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f35ad52e-499a-41d9-a815-18e52a73c512 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: f5cd4124-73ad-4109-a774-b76ba75ab797] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:38.932384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f35ad52e-499a-41d9-a815-18e52a73c512 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:38.933182 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f35ad52e-499a-41d9-a815-18e52a73c512 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:38.934356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f35ad52e-499a-41d9-a815-18e52a73c512 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:38.935152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f35ad52e-499a-41d9-a815-18e52a73c512 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:39.048370 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-101479f4-5632-4888-8629-4962ea8b9339 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 200 len: 1465 microversion: 2.1 time: 0.881337 Jul 25 13:11:39.049620 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2734/5539] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:38 2022] GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 1465 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:39.548474 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f35ad52e-499a-41d9-a815-18e52a73c512 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:39.560571 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f35ad52e-499a-41d9-a815-18e52a73c512 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797" status: 200 len: 1373 microversion: 2.1 time: 0.641123 Jul 25 13:11:39.564730 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2806/5540] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:38 2022] GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797 => generated 1373 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:40.074751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-284f7f7b-6a84-4e07-bb9b-74ecc710e039 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:40.076229 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-284f7f7b-6a84-4e07-bb9b-74ecc710e039 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:40.087021 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-284f7f7b-6a84-4e07-bb9b-74ecc710e039 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:40.092834 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-284f7f7b-6a84-4e07-bb9b-74ecc710e039 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:40.093750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-284f7f7b-6a84-4e07-bb9b-74ecc710e039 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:40.094251 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-284f7f7b-6a84-4e07-bb9b-74ecc710e039 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:40.585521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2d4aeb6b-a384-4b9f-92bb-be18deec6b4f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:40.586143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2d4aeb6b-a384-4b9f-92bb-be18deec6b4f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: f5cd4124-73ad-4109-a774-b76ba75ab797] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:40.610141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d4aeb6b-a384-4b9f-92bb-be18deec6b4f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:40.615327 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d4aeb6b-a384-4b9f-92bb-be18deec6b4f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:40.620317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d4aeb6b-a384-4b9f-92bb-be18deec6b4f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:40.620849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d4aeb6b-a384-4b9f-92bb-be18deec6b4f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:40.827944 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-284f7f7b-6a84-4e07-bb9b-74ecc710e039 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 200 len: 1465 microversion: 2.1 time: 0.757364 Jul 25 13:11:40.832770 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2735/5541] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:40 2022] GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 1465 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:41.065988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2d4aeb6b-a384-4b9f-92bb-be18deec6b4f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:41.077083 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2d4aeb6b-a384-4b9f-92bb-be18deec6b4f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797" status: 200 len: 1373 microversion: 2.1 time: 0.495607 Jul 25 13:11:41.094380 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2807/5542] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:40 2022] GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797 => generated 1373 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:41.108038 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-5b7f0e25-8518-4691-997e-a2c589f25370 req-1d717c66-d396-4411-ba8b-0846a723f557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5cd4124-73ad-4109-a774-b76ba75ab797", "name": "network-vif-plugged", "status": "completed", "tag": "c07fc42d-c325-4ff7-acd7-7c37f4071fd9"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:11:41.129482 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5b7f0e25-8518-4691-997e-a2c589f25370 req-1d717c66-d396-4411-ba8b-0846a723f557 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:41.130854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5b7f0e25-8518-4691-997e-a2c589f25370 req-1d717c66-d396-4411-ba8b-0846a723f557 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:41.169802 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-5b7f0e25-8518-4691-997e-a2c589f25370 req-1d717c66-d396-4411-ba8b-0846a723f557 service nova] Creating event network-vif-plugged:c07fc42d-c325-4ff7-acd7-7c37f4071fd9 for instance f5cd4124-73ad-4109-a774-b76ba75ab797 on n-h1-848886-15 Jul 25 13:11:41.182887 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-5b7f0e25-8518-4691-997e-a2c589f25370 req-1d717c66-d396-4411-ba8b-0846a723f557 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085181 Jul 25 13:11:41.185329 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2808/5543] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:41.198862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-3b80eb23-acee-410c-b1a8-2a130a54a9d2 req-52168ddb-5e93-420c-ab5d-47719203d5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ffd02cb-a0ad-4b1f-b129-6fee94dc57af", "tag": "f70aacb3-9955-48b6-92e4-b936a8bc527b"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:11:41.214613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3b80eb23-acee-410c-b1a8-2a130a54a9d2 req-52168ddb-5e93-420c-ab5d-47719203d5d1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:41.215442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3b80eb23-acee-410c-b1a8-2a130a54a9d2 req-52168ddb-5e93-420c-ab5d-47719203d5d1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:41.228281 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-3b80eb23-acee-410c-b1a8-2a130a54a9d2 req-52168ddb-5e93-420c-ab5d-47719203d5d1 service nova] Creating event network-changed:f70aacb3-9955-48b6-92e4-b936a8bc527b for instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af on n-h2-848886-15 Jul 25 13:11:41.247475 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-3b80eb23-acee-410c-b1a8-2a130a54a9d2 req-52168ddb-5e93-420c-ab5d-47719203d5d1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060590 Jul 25 13:11:41.248908 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2809/5544] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:41.473565 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fcfa90c6-d7dd-4321-b888-4c48482ac719 tempest-VolumesGetTestJSON-605560477 tempest-VolumesGetTestJSON-605560477-project] Action: 'create', calling method: .version_select at 0x7efcf9e0d8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1361143080", "metadata": {"Type": "work"}}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:11:41.856629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e9febe94-5b6e-4a66-9ac2-bef3ee1b4677 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:41.858217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e9febe94-5b6e-4a66-9ac2-bef3ee1b4677 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:41.876367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9febe94-5b6e-4a66-9ac2-bef3ee1b4677 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:41.878051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9febe94-5b6e-4a66-9ac2-bef3ee1b4677 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:41.880388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9febe94-5b6e-4a66-9ac2-bef3ee1b4677 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:41.881957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9febe94-5b6e-4a66-9ac2-bef3ee1b4677 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:42.175525 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fcfa90c6-d7dd-4321-b888-4c48482ac719 tempest-VolumesGetTestJSON-605560477 tempest-VolumesGetTestJSON-605560477-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.240640 Jul 25 13:11:42.176371 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2736/5545] 10.222.0.49 () {60 vars in 1156 bytes} [Mon Jul 25 13:11:40 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1242 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 25 13:11:42.182767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-905ce3b0-b64c-4fc1-af7c-8a37bef43307 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:42.185106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-905ce3b0-b64c-4fc1-af7c-8a37bef43307 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: f5cd4124-73ad-4109-a774-b76ba75ab797] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:42.201163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-905ce3b0-b64c-4fc1-af7c-8a37bef43307 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:42.201691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-905ce3b0-b64c-4fc1-af7c-8a37bef43307 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:42.218730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-905ce3b0-b64c-4fc1-af7c-8a37bef43307 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:42.219244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-905ce3b0-b64c-4fc1-af7c-8a37bef43307 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:42.646859 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e9febe94-5b6e-4a66-9ac2-bef3ee1b4677 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 200 len: 1465 microversion: 2.1 time: 0.796690 Jul 25 13:11:42.647465 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2810/5546] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:41 2022] GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 1465 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:42.666492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-49de3fde-8a39-4a77-8b2f-55b82f410e2b tempest-VolumesGetTestJSON-605560477 tempest-VolumesGetTestJSON-605560477-project] Calling method '.version_select at 0x7efcf92fe4c0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:42.762515 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-49de3fde-8a39-4a77-8b2f-55b82f410e2b tempest-VolumesGetTestJSON-605560477 tempest-VolumesGetTestJSON-605560477-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/26f05db2-2d54-47ad-afc6-13c3fbf7c6ce" status: 200 len: 353 microversion: 2.1 time: 0.103365 Jul 25 13:11:42.763538 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2811/5547] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Jul 25 13:11:42 2022] GET /compute/v2.1/os-volumes/26f05db2-2d54-47ad-afc6-13c3fbf7c6ce => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:42.832606 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-905ce3b0-b64c-4fc1-af7c-8a37bef43307 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:42.841523 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-905ce3b0-b64c-4fc1-af7c-8a37bef43307 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797" status: 200 len: 1373 microversion: 2.1 time: 0.663625 Jul 25 13:11:42.854379 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2737/5548] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:42 2022] GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797 => generated 1373 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:43.566068 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-d43c1f9b-6802-43f4-b314-f0231fe7f9b4 req-a2925b5b-7876-437a-9172-656dd9ba4777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce5b1487-0b50-44f9-a231-108735a91af7", "name": "network-vif-plugged", "status": "completed", "tag": "5b64621f-a29d-42c2-86d3-b83fab0c338d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:11:43.592554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d43c1f9b-6802-43f4-b314-f0231fe7f9b4 req-a2925b5b-7876-437a-9172-656dd9ba4777 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:43.597055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d43c1f9b-6802-43f4-b314-f0231fe7f9b4 req-a2925b5b-7876-437a-9172-656dd9ba4777 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:43.613339 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-d43c1f9b-6802-43f4-b314-f0231fe7f9b4 req-a2925b5b-7876-437a-9172-656dd9ba4777 service nova] Creating event network-vif-plugged:5b64621f-a29d-42c2-86d3-b83fab0c338d for instance ce5b1487-0b50-44f9-a231-108735a91af7 on n-h2-848886-15 Jul 25 13:11:43.634882 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-d43c1f9b-6802-43f4-b314-f0231fe7f9b4 req-a2925b5b-7876-437a-9172-656dd9ba4777 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077017 Jul 25 13:11:43.636111 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2812/5549] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:43.669634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1dd9559e-0f05-43e5-a844-73e1f135e893 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:43.670425 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1dd9559e-0f05-43e5-a844-73e1f135e893 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:43.685873 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1dd9559e-0f05-43e5-a844-73e1f135e893 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:43.686507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1dd9559e-0f05-43e5-a844-73e1f135e893 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:43.689445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1dd9559e-0f05-43e5-a844-73e1f135e893 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:43.690667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1dd9559e-0f05-43e5-a844-73e1f135e893 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:43.778897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d064e822-5c50-4334-9c19-3b93e7938586 tempest-VolumesGetTestJSON-605560477 tempest-VolumesGetTestJSON-605560477-project] Calling method '.version_select at 0x7efcf8e58af0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:43.870199 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d064e822-5c50-4334-9c19-3b93e7938586 tempest-VolumesGetTestJSON-605560477 tempest-VolumesGetTestJSON-605560477-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/26f05db2-2d54-47ad-afc6-13c3fbf7c6ce" status: 200 len: 354 microversion: 2.1 time: 0.097086 Jul 25 13:11:43.871165 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2813/5550] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Jul 25 13:11:43 2022] GET /compute/v2.1/os-volumes/26f05db2-2d54-47ad-afc6-13c3fbf7c6ce => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:43.877203 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3e56e870-c736-4991-94aa-933d41f049dc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:43.878189 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3e56e870-c736-4991-94aa-933d41f049dc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: f5cd4124-73ad-4109-a774-b76ba75ab797] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:43.896504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e56e870-c736-4991-94aa-933d41f049dc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:43.897381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e56e870-c736-4991-94aa-933d41f049dc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:43.898641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e56e870-c736-4991-94aa-933d41f049dc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:43.902491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e56e870-c736-4991-94aa-933d41f049dc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:44.262222 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1dd9559e-0f05-43e5-a844-73e1f135e893 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 200 len: 1465 microversion: 2.1 time: 0.595445 Jul 25 13:11:44.264737 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2738/5551] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:43 2022] GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 1465 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:44.291646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3e56e870-c736-4991-94aa-933d41f049dc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:44.298568 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-28171136-cb44-482c-ba1c-b15854f8521f tempest-VolumesGetTestJSON-605560477 tempest-VolumesGetTestJSON-605560477-project] Calling method '.version_select at 0x7efcf904d1f0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:44.302549 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3e56e870-c736-4991-94aa-933d41f049dc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797" status: 200 len: 1545 microversion: 2.1 time: 0.429987 Jul 25 13:11:44.303908 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2814/5552] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:43 2022] GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797 => generated 1545 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:44.332324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f462dee3-bb01-4ff1-a509-6dbca1bd4d2b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:44.333217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f462dee3-bb01-4ff1-a509-6dbca1bd4d2b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: f5cd4124-73ad-4109-a774-b76ba75ab797] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:44.345220 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f462dee3-bb01-4ff1-a509-6dbca1bd4d2b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:44.345988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f462dee3-bb01-4ff1-a509-6dbca1bd4d2b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:44.347466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f462dee3-bb01-4ff1-a509-6dbca1bd4d2b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:44.348447 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f462dee3-bb01-4ff1-a509-6dbca1bd4d2b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:44.386026 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-28171136-cb44-482c-ba1c-b15854f8521f tempest-VolumesGetTestJSON-605560477 tempest-VolumesGetTestJSON-605560477-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/26f05db2-2d54-47ad-afc6-13c3fbf7c6ce" status: 200 len: 354 microversion: 2.1 time: 0.096023 Jul 25 13:11:44.386834 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2739/5553] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Jul 25 13:11:44 2022] GET /compute/v2.1/os-volumes/26f05db2-2d54-47ad-afc6-13c3fbf7c6ce => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:44.405047 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-af28c0ae-eb42-4834-a17c-c4667e88eed1 tempest-VolumesGetTestJSON-605560477 tempest-VolumesGetTestJSON-605560477-project] Calling method '.version_select at 0x7efcf8c141f0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:44.531453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f462dee3-bb01-4ff1-a509-6dbca1bd4d2b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:44.532715 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-af28c0ae-eb42-4834-a17c-c4667e88eed1 tempest-VolumesGetTestJSON-605560477 tempest-VolumesGetTestJSON-605560477-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/26f05db2-2d54-47ad-afc6-13c3fbf7c6ce" status: 202 len: 0 microversion: 2.1 time: 0.135549 Jul 25 13:11:44.533818 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2740/5554] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Jul 25 13:11:44 2022] DELETE /compute/v2.1/os-volumes/26f05db2-2d54-47ad-afc6-13c3fbf7c6ce => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:11:44.543374 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4d4c68e9-9fd7-4ac8-80e6-e9d616599431 tempest-VolumesGetTestJSON-605560477 tempest-VolumesGetTestJSON-605560477-project] Calling method '.version_select at 0x7efcf8d055e0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:44.551269 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f462dee3-bb01-4ff1-a509-6dbca1bd4d2b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797" status: 200 len: 1545 microversion: 2.1 time: 0.228124 Jul 25 13:11:44.562215 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2815/5555] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:44 2022] GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797 => generated 1545 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:44.651795 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4d4c68e9-9fd7-4ac8-80e6-e9d616599431 tempest-VolumesGetTestJSON-605560477 tempest-VolumesGetTestJSON-605560477-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/26f05db2-2d54-47ad-afc6-13c3fbf7c6ce" status: 200 len: 353 microversion: 2.1 time: 0.114042 Jul 25 13:11:44.652484 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2741/5556] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Jul 25 13:11:44 2022] GET /compute/v2.1/os-volumes/26f05db2-2d54-47ad-afc6-13c3fbf7c6ce => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:11:45.291443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e2e7d5f3-8187-4328-a012-4625728f948f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:45.291984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e2e7d5f3-8187-4328-a012-4625728f948f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:45.302012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2e7d5f3-8187-4328-a012-4625728f948f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:45.302467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2e7d5f3-8187-4328-a012-4625728f948f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:45.303259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2e7d5f3-8187-4328-a012-4625728f948f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:45.303693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2e7d5f3-8187-4328-a012-4625728f948f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:45.667599 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-38d41540-3a6b-4ee6-b88b-1477ffa3657e tempest-VolumesGetTestJSON-605560477 tempest-VolumesGetTestJSON-605560477-project] Calling method '.version_select at 0x7efcf8d53ca0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:45.762583 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-38d41540-3a6b-4ee6-b88b-1477ffa3657e tempest-VolumesGetTestJSON-605560477 tempest-VolumesGetTestJSON-605560477-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/26f05db2-2d54-47ad-afc6-13c3fbf7c6ce" status: 200 len: 353 microversion: 2.1 time: 0.100502 Jul 25 13:11:45.763199 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2742/5557] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Jul 25 13:11:45 2022] GET /compute/v2.1/os-volumes/26f05db2-2d54-47ad-afc6-13c3fbf7c6ce => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:11:46.145040 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e2e7d5f3-8187-4328-a012-4625728f948f tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 200 len: 1465 microversion: 2.1 time: 0.860650 Jul 25 13:11:46.146490 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2816/5558] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:45 2022] GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 1465 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:46.500410 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-357f9976-4c85-44f0-9070-00d7b4ba3fd7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:46.500960 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-357f9976-4c85-44f0-9070-00d7b4ba3fd7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:46.516383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-357f9976-4c85-44f0-9070-00d7b4ba3fd7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:46.517113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-357f9976-4c85-44f0-9070-00d7b4ba3fd7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:46.530484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-357f9976-4c85-44f0-9070-00d7b4ba3fd7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:46.530966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-357f9976-4c85-44f0-9070-00d7b4ba3fd7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:46.562844 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-357f9976-4c85-44f0-9070-00d7b4ba3fd7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:11:46.690381 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-357f9976-4c85-44f0-9070-00d7b4ba3fd7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 204 len: 0 microversion: 2.1 time: 0.199080 Jul 25 13:11:46.692174 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2743/5559] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:11:46 2022] DELETE /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:11:46.704388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e9d97833-f8b4-4376-a58c-5ecc01008de7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:46.705201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e9d97833-f8b4-4376-a58c-5ecc01008de7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:46.720422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9d97833-f8b4-4376-a58c-5ecc01008de7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:46.720912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9d97833-f8b4-4376-a58c-5ecc01008de7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:46.723150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9d97833-f8b4-4376-a58c-5ecc01008de7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:46.723772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9d97833-f8b4-4376-a58c-5ecc01008de7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:46.777426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-96d9af6a-0ffe-4c2d-ab74-9d879c9c4078 tempest-VolumesGetTestJSON-605560477 tempest-VolumesGetTestJSON-605560477-project] Calling method '.version_select at 0x7efcf8bde550>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:46.835821 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-96d9af6a-0ffe-4c2d-ab74-9d879c9c4078 tempest-VolumesGetTestJSON-605560477 tempest-VolumesGetTestJSON-605560477-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/26f05db2-2d54-47ad-afc6-13c3fbf7c6ce" status: 200 len: 353 microversion: 2.1 time: 0.062874 Jul 25 13:11:46.836452 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2744/5560] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Jul 25 13:11:46 2022] GET /compute/v2.1/os-volumes/26f05db2-2d54-47ad-afc6-13c3fbf7c6ce => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:11:47.081252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e9d97833-f8b4-4376-a58c-5ecc01008de7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:47.099870 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e9d97833-f8b4-4376-a58c-5ecc01008de7 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1408 microversion: 2.1 time: 0.402266 Jul 25 13:11:47.103892 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2817/5561] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:46 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1408 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:47.170132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-53e3382f-865c-413d-9b68-fbfc57ad42c2 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:47.172319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-53e3382f-865c-413d-9b68-fbfc57ad42c2 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:47.184135 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53e3382f-865c-413d-9b68-fbfc57ad42c2 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:47.185518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53e3382f-865c-413d-9b68-fbfc57ad42c2 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:47.187602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53e3382f-865c-413d-9b68-fbfc57ad42c2 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:47.188430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53e3382f-865c-413d-9b68-fbfc57ad42c2 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:47.543577 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-53e3382f-865c-413d-9b68-fbfc57ad42c2 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 200 len: 1650 microversion: 2.1 time: 0.379303 Jul 25 13:11:47.544591 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2745/5562] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:47 2022] GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 1650 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:47.567258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5fae86fc-5c4e-4d11-8308-4dac5601f3eb tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:47.568404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5fae86fc-5c4e-4d11-8308-4dac5601f3eb tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:47.586109 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5fae86fc-5c4e-4d11-8308-4dac5601f3eb tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:47.586887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5fae86fc-5c4e-4d11-8308-4dac5601f3eb tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:47.587878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5fae86fc-5c4e-4d11-8308-4dac5601f3eb tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:47.588330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5fae86fc-5c4e-4d11-8308-4dac5601f3eb tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:47.855196 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-98100bd4-cf13-4d46-aef4-55246e7c217f tempest-VolumesGetTestJSON-605560477 tempest-VolumesGetTestJSON-605560477-project] Calling method '.version_select at 0x7efcf8c4c160>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:47.932103 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-98100bd4-cf13-4d46-aef4-55246e7c217f tempest-VolumesGetTestJSON-605560477 tempest-VolumesGetTestJSON-605560477-project] HTTP exception thrown: Volume 26f05db2-2d54-47ad-afc6-13c3fbf7c6ce could not be found. Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-98100bd4-cf13-4d46-aef4-55246e7c217f tempest-VolumesGetTestJSON-605560477 tempest-VolumesGetTestJSON-605560477-project] Request method failure captured: Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-volumes/26f05db2-2d54-47ad-afc6-13c3fbf7c6ce HTTP/1.1 Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3paMNaWFO8sHM6pd70-pGbwdG-QmN08HFfBt3R7x497ojoODcN-KuDkp2NfL55apN3WalbGbls6ZqgziY6p1etYi_cQjRLLQzYed_9AcIalyPQhDUYb-l6mMm_0XlSG-eqlHeaeNdJD-IYlHQ-03wtKvGDRt2cFQOrz6oVOkGzVUo7k Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 611fe720e1214eff8d821efc2b24a4f7 Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-VolumesGetTestJSON-605560477 Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_611fe720e1214eff8d821efc2b24a4f7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/611fe720e1214eff8d821efc2b24a4f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/611fe720e1214eff8d821efc2b24a4f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/611fe720e1214eff8d821efc2b24a4f7"}]}] Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-VolumesGetTestJSON-605560477 Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 611fe720e1214eff8d821efc2b24a4f7 Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-VolumesGetTestJSON-605560477 Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-VolumesGetTestJSON-605560477-project Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: b15fe4e201004f9aa8a82e89b1d52906 Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-VolumesGetTestJSON-605560477-project Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: exception: Volume 26f05db2-2d54-47ad-afc6-13c3fbf7c6ce could not be found. Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '26f05db2-2d54-47ad-afc6-13c3fbf7c6ce'} Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 26f05db2-2d54-47ad-afc6-13c3fbf7c6ce could not be found. (HTTP 404) (Request-ID: req-0c52e0fb-7de1-467e-bc64-73c2441d0aa1) Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 13:11:47.934292 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 26f05db2-2d54-47ad-afc6-13c3fbf7c6ce could not be found. Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 26f05db2-2d54-47ad-afc6-13c3fbf7c6ce could not be found. Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 26f05db2-2d54-47ad-afc6-13c3fbf7c6ce could not be found. Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-98100bd4-cf13-4d46-aef4-55246e7c217f tempest-VolumesGetTestJSON-605560477 tempest-VolumesGetTestJSON-605560477-project] Returning 404 to user: Volume 26f05db2-2d54-47ad-afc6-13c3fbf7c6ce could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-98100bd4-cf13-4d46-aef4-55246e7c217f tempest-VolumesGetTestJSON-605560477 tempest-VolumesGetTestJSON-605560477-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/26f05db2-2d54-47ad-afc6-13c3fbf7c6ce" status: 404 len: 109 microversion: 2.1 time: 0.089896 Jul 25 13:11:47.939797 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2746/5563] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Jul 25 13:11:47 2022] GET /compute/v2.1/os-volumes/26f05db2-2d54-47ad-afc6-13c3fbf7c6ce => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:11:48.014810 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5fae86fc-5c4e-4d11-8308-4dac5601f3eb tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 200 len: 1650 microversion: 2.1 time: 0.451182 Jul 25 13:11:48.017284 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2818/5564] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:47 2022] GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 1650 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:48.041088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-faad18f9-b7fd-4bb2-b71b-bcad6e3d59eb tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:48.042074 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-faad18f9-b7fd-4bb2-b71b-bcad6e3d59eb tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:48.062263 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-faad18f9-b7fd-4bb2-b71b-bcad6e3d59eb tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:48.063070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-faad18f9-b7fd-4bb2-b71b-bcad6e3d59eb tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:48.064111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-faad18f9-b7fd-4bb2-b71b-bcad6e3d59eb tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:48.064750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-faad18f9-b7fd-4bb2-b71b-bcad6e3d59eb tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:48.121692 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ca73139e-bd4c-4929-b3e5-f92add544731 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:48.122347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ca73139e-bd4c-4929-b3e5-f92add544731 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:48.140121 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ca73139e-bd4c-4929-b3e5-f92add544731 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:48.140537 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ca73139e-bd4c-4929-b3e5-f92add544731 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:48.141609 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ca73139e-bd4c-4929-b3e5-f92add544731 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:48.142088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ca73139e-bd4c-4929-b3e5-f92add544731 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:48.760353 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ca73139e-bd4c-4929-b3e5-f92add544731 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:48.769443 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-faad18f9-b7fd-4bb2-b71b-bcad6e3d59eb tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 200 len: 1650 microversion: 2.1 time: 0.733343 Jul 25 13:11:48.773079 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ca73139e-bd4c-4929-b3e5-f92add544731 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1408 microversion: 2.1 time: 0.655251 Jul 25 13:11:48.775762 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2747/5565] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:48 2022] GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 1650 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:48.777576 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2819/5566] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:48 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1408 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:11:48.811833 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d96059e4-96ba-4ea0-8a05-ce0e2267c2fc tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:48.812377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d96059e4-96ba-4ea0-8a05-ce0e2267c2fc tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:48.823726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d96059e4-96ba-4ea0-8a05-ce0e2267c2fc tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:48.831319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d96059e4-96ba-4ea0-8a05-ce0e2267c2fc tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:48.832468 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d96059e4-96ba-4ea0-8a05-ce0e2267c2fc tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:48.832947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d96059e4-96ba-4ea0-8a05-ce0e2267c2fc tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:48.898153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d96059e4-96ba-4ea0-8a05-ce0e2267c2fc tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:11:49.034185 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:11:49.108570 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d96059e4-96ba-4ea0-8a05-ce0e2267c2fc tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "DELETE /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 204 len: 0 microversion: 2.1 time: 0.300392 Jul 25 13:11:49.114500 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2748/5567] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:11:48 2022] DELETE /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:11:49.139181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e5d0669a-5629-4efe-b278-dfd1aeb7ee66 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:49.139831 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e5d0669a-5629-4efe-b278-dfd1aeb7ee66 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:49.147632 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5d0669a-5629-4efe-b278-dfd1aeb7ee66 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:49.148904 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5d0669a-5629-4efe-b278-dfd1aeb7ee66 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:49.149976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5d0669a-5629-4efe-b278-dfd1aeb7ee66 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:49.150696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5d0669a-5629-4efe-b278-dfd1aeb7ee66 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:49.700651 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-0d764e7b-0a68-44b9-90d6-2fecbfa8bd7c req-5527f606-b660-402b-b796-26c13d4651a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5cd4124-73ad-4109-a774-b76ba75ab797", "tag": "c07fc42d-c325-4ff7-acd7-7c37f4071fd9"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:11:49.728437 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0d764e7b-0a68-44b9-90d6-2fecbfa8bd7c req-5527f606-b660-402b-b796-26c13d4651a2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:49.728901 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0d764e7b-0a68-44b9-90d6-2fecbfa8bd7c req-5527f606-b660-402b-b796-26c13d4651a2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:49.743069 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e5d0669a-5629-4efe-b278-dfd1aeb7ee66 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 200 len: 1656 microversion: 2.1 time: 0.628380 Jul 25 13:11:49.744813 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2820/5568] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:49 2022] GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 1656 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:49.762377 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-0d764e7b-0a68-44b9-90d6-2fecbfa8bd7c req-5527f606-b660-402b-b796-26c13d4651a2 service nova] Creating event network-changed:c07fc42d-c325-4ff7-acd7-7c37f4071fd9 for instance f5cd4124-73ad-4109-a774-b76ba75ab797 on n-h1-848886-15 Jul 25 13:11:49.772909 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-0d764e7b-0a68-44b9-90d6-2fecbfa8bd7c req-5527f606-b660-402b-b796-26c13d4651a2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075949 Jul 25 13:11:49.774074 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2749/5569] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:49.795785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e5b5d7b5-1375-455d-ba62-767e2fddf2be tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:49.796404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e5b5d7b5-1375-455d-ba62-767e2fddf2be tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:49.806061 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5b5d7b5-1375-455d-ba62-767e2fddf2be tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:49.809364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5b5d7b5-1375-455d-ba62-767e2fddf2be tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:49.810862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5b5d7b5-1375-455d-ba62-767e2fddf2be tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:49.812354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5b5d7b5-1375-455d-ba62-767e2fddf2be tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:49.990313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e5b5d7b5-1375-455d-ba62-767e2fddf2be tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:49.998987 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e5b5d7b5-1375-455d-ba62-767e2fddf2be tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1366 microversion: 2.1 time: 0.207585 Jul 25 13:11:50.012522 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2821/5570] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:49 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:50.766716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e69a1287-25d4-49c3-ab76-c0816fc38df5 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:50.768322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e69a1287-25d4-49c3-ab76-c0816fc38df5 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:50.782704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e69a1287-25d4-49c3-ab76-c0816fc38df5 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:50.785551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e69a1287-25d4-49c3-ab76-c0816fc38df5 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:50.786698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e69a1287-25d4-49c3-ab76-c0816fc38df5 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:50.791548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e69a1287-25d4-49c3-ab76-c0816fc38df5 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:51.021252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-235eda33-8a37-489c-8db1-f9ed56cd002a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:51.022649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-235eda33-8a37-489c-8db1-f9ed56cd002a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:51.031808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-235eda33-8a37-489c-8db1-f9ed56cd002a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:51.032815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-235eda33-8a37-489c-8db1-f9ed56cd002a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:51.034248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-235eda33-8a37-489c-8db1-f9ed56cd002a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:51.034906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-235eda33-8a37-489c-8db1-f9ed56cd002a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:51.701820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-235eda33-8a37-489c-8db1-f9ed56cd002a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:51.761820 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-235eda33-8a37-489c-8db1-f9ed56cd002a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1201 microversion: 2.1 time: 0.740715 Jul 25 13:11:51.776007 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2822/5571] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:51 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1201 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:11:51.801645 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-a65005c4-0587-40df-932a-f4e3b323ce77 req-31d4a3c0-10c4-4c89-a4aa-fda9bb69d76a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e801a411-aba7-43d5-a366-924c4f035471", "name": "network-vif-deleted", "tag": "c29620ab-f7fc-428e-b6e7-7cc77b0cd0e9"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:11:51.845608 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e69a1287-25d4-49c3-ab76-c0816fc38df5 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 200 len: 1656 microversion: 2.1 time: 1.081556 Jul 25 13:11:51.850562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a65005c4-0587-40df-932a-f4e3b323ce77 req-31d4a3c0-10c4-4c89-a4aa-fda9bb69d76a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:51.851074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a65005c4-0587-40df-932a-f4e3b323ce77 req-31d4a3c0-10c4-4c89-a4aa-fda9bb69d76a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:51.863711 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2750/5572] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:50 2022] GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 1656 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:51.899098 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-a65005c4-0587-40df-932a-f4e3b323ce77 req-31d4a3c0-10c4-4c89-a4aa-fda9bb69d76a service nova] Creating event network-vif-deleted:c29620ab-f7fc-428e-b6e7-7cc77b0cd0e9 for instance e801a411-aba7-43d5-a366-924c4f035471 on n-h1-848886-15 Jul 25 13:11:51.915066 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-a65005c4-0587-40df-932a-f4e3b323ce77 req-31d4a3c0-10c4-4c89-a4aa-fda9bb69d76a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121819 Jul 25 13:11:51.922484 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2823/5573] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:11:52.796627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-68c24e56-bd2e-4566-a53e-688a44536099 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:52.797016 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-68c24e56-bd2e-4566-a53e-688a44536099 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:52.806399 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68c24e56-bd2e-4566-a53e-688a44536099 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:52.806830 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68c24e56-bd2e-4566-a53e-688a44536099 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:52.807622 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68c24e56-bd2e-4566-a53e-688a44536099 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:52.808068 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68c24e56-bd2e-4566-a53e-688a44536099 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:52.885546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4590b1a6-82b3-488a-a4b1-144ef2c98703 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:52.886354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4590b1a6-82b3-488a-a4b1-144ef2c98703 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:52.897525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4590b1a6-82b3-488a-a4b1-144ef2c98703 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:52.898061 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4590b1a6-82b3-488a-a4b1-144ef2c98703 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:52.898913 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4590b1a6-82b3-488a-a4b1-144ef2c98703 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:52.909181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4590b1a6-82b3-488a-a4b1-144ef2c98703 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:53.011935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-68c24e56-bd2e-4566-a53e-688a44536099 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:53.021895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4590b1a6-82b3-488a-a4b1-144ef2c98703 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:53.022748 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-68c24e56-bd2e-4566-a53e-688a44536099 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1201 microversion: 2.1 time: 0.230243 Jul 25 13:11:53.023997 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4590b1a6-82b3-488a-a4b1-144ef2c98703 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:53.024466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-4590b1a6-82b3-488a-a4b1-144ef2c98703 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lazy-loading 'fault' on Instance uuid ce5b1487-0b50-44f9-a231-108735a91af7 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:11:53.028065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=100 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:11:53.029880 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2751/5574] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:52 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1201 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:53.078534 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4590b1a6-82b3-488a-a4b1-144ef2c98703 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 200 len: 1455 microversion: 2.1 time: 0.197506 Jul 25 13:11:53.079374 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2824/5575] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:52 2022] GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 1455 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:54.002223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-728bf762-11b7-4532-9ed6-75bf7c233182 req-8442786f-d126-4cda-be40-3fb5d9984bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce5b1487-0b50-44f9-a231-108735a91af7", "name": "network-vif-deleted", "tag": "5b64621f-a29d-42c2-86d3-b83fab0c338d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:11:54.033944 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-728bf762-11b7-4532-9ed6-75bf7c233182 req-8442786f-d126-4cda-be40-3fb5d9984bfc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:54.034605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-728bf762-11b7-4532-9ed6-75bf7c233182 req-8442786f-d126-4cda-be40-3fb5d9984bfc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:54.044517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-548e81af-8c2f-4ea3-a952-82edd35555fb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:54.045713 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-548e81af-8c2f-4ea3-a952-82edd35555fb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:54.055956 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-548e81af-8c2f-4ea3-a952-82edd35555fb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:54.060144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-548e81af-8c2f-4ea3-a952-82edd35555fb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:54.061246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-548e81af-8c2f-4ea3-a952-82edd35555fb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:54.061876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-548e81af-8c2f-4ea3-a952-82edd35555fb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:54.068892 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-728bf762-11b7-4532-9ed6-75bf7c233182 req-8442786f-d126-4cda-be40-3fb5d9984bfc service nova] Creating event network-vif-deleted:5b64621f-a29d-42c2-86d3-b83fab0c338d for instance ce5b1487-0b50-44f9-a231-108735a91af7 on n-h2-848886-15 Jul 25 13:11:54.078496 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-728bf762-11b7-4532-9ed6-75bf7c233182 req-8442786f-d126-4cda-be40-3fb5d9984bfc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078063 Jul 25 13:11:54.079134 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2752/5576] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:54.105412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4c9837eb-4b4d-4bed-bb6a-18601525af79 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:54.107118 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4c9837eb-4b4d-4bed-bb6a-18601525af79 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: ce5b1487-0b50-44f9-a231-108735a91af7] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:54.114462 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c9837eb-4b4d-4bed-bb6a-18601525af79 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:54.126180 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c9837eb-4b4d-4bed-bb6a-18601525af79 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:54.127230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c9837eb-4b4d-4bed-bb6a-18601525af79 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:54.127824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c9837eb-4b4d-4bed-bb6a-18601525af79 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:54.158376 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-4c9837eb-4b4d-4bed-bb6a-18601525af79 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] HTTP exception thrown: Instance ce5b1487-0b50-44f9-a231-108735a91af7 could not be found. Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4c9837eb-4b4d-4bed-bb6a-18601525af79 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Request method failure captured: Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 HTTP/1.1 Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pZKQ5mUtGddrRux9G_AoMbCe__VrtRZUOqHGwix-4gHRzeaWuKmDtlSsL7q6vEpmRhGYkna2kSBM4c-Ls5MbyGUYEQ_Gb4FJrfkhLfifdnLaaSNqYdg_11piUI7VwrlKl5LqJipwU1rW3b9nyj9Eyj_xSUKUMVKlb0q9ieefJDN0Wk Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 84a28c1fcb094a3b835d34f6e931fe0e Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-TestServerMultinode-886650789 Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84a28c1fcb094a3b835d34f6e931fe0e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84a28c1fcb094a3b835d34f6e931fe0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84a28c1fcb094a3b835d34f6e931fe0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84a28c1fcb094a3b835d34f6e931fe0e"}]}] Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-TestServerMultinode-886650789 Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 84a28c1fcb094a3b835d34f6e931fe0e Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-TestServerMultinode-886650789 Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-TestServerMultinode-886650789-project-admin Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 0ea4862fda714577b9be844b769a04ac Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-TestServerMultinode-886650789-project-admin Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance ce5b1487-0b50-44f9-a231-108735a91af7 could not be found. Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'ce5b1487-0b50-44f9-a231-108735a91af7'} Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce5b1487-0b50-44f9-a231-108735a91af7 could not be found. Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce5b1487-0b50-44f9-a231-108735a91af7 could not be found. Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:11:54.160111 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:54.165985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:54.165985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:11:54.165985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:11:54.165985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:11:54.165985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:11:54.165985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce5b1487-0b50-44f9-a231-108735a91af7 could not be found. Jul 25 13:11:54.165985 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:54.165985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4c9837eb-4b4d-4bed-bb6a-18601525af79 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Returning 404 to user: Instance ce5b1487-0b50-44f9-a231-108735a91af7 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:11:54.170249 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4c9837eb-4b4d-4bed-bb6a-18601525af79 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7" status: 404 len: 111 microversion: 2.1 time: 0.060982 Jul 25 13:11:54.171327 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2753/5577] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:54 2022] GET /compute/v2.1/servers/ce5b1487-0b50-44f9-a231-108735a91af7 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:11:54.191993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-da0d3d3a-8a3e-4e27-996e-f5008639fd7d tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:54.192855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-da0d3d3a-8a3e-4e27-996e-f5008639fd7d tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:54.200084 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da0d3d3a-8a3e-4e27-996e-f5008639fd7d tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:54.200807 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da0d3d3a-8a3e-4e27-996e-f5008639fd7d tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:54.206284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da0d3d3a-8a3e-4e27-996e-f5008639fd7d tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:54.206984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da0d3d3a-8a3e-4e27-996e-f5008639fd7d tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:54.216219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-548e81af-8c2f-4ea3-a952-82edd35555fb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:54.225529 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-548e81af-8c2f-4ea3-a952-82edd35555fb tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1201 microversion: 2.1 time: 0.185675 Jul 25 13:11:54.227580 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2825/5578] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:54 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1201 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:11:54.248396 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-da0d3d3a-8a3e-4e27-996e-f5008639fd7d tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:11:54.354217 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-da0d3d3a-8a3e-4e27-996e-f5008639fd7d tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "DELETE /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa" status: 204 len: 0 microversion: 2.1 time: 0.178139 Jul 25 13:11:54.355154 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2754/5579] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:11:54 2022] DELETE /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:11:54.364932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-39fe111d-7d80-4497-a75b-227cbb85c7cf tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:54.365788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-39fe111d-7d80-4497-a75b-227cbb85c7cf tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:54.378424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-39fe111d-7d80-4497-a75b-227cbb85c7cf tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:54.382603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-39fe111d-7d80-4497-a75b-227cbb85c7cf tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:54.387160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-39fe111d-7d80-4497-a75b-227cbb85c7cf tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:54.388261 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-39fe111d-7d80-4497-a75b-227cbb85c7cf tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:54.594254 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-39fe111d-7d80-4497-a75b-227cbb85c7cf tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa" status: 200 len: 1655 microversion: 2.1 time: 0.232946 Jul 25 13:11:54.596045 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2826/5580] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:54 2022] GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa => generated 1655 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:55.255235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2ee2fb70-7f04-4b3d-b1f2-6bc0504e2494 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:55.256569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2ee2fb70-7f04-4b3d-b1f2-6bc0504e2494 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:55.272271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2ee2fb70-7f04-4b3d-b1f2-6bc0504e2494 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:55.273101 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2ee2fb70-7f04-4b3d-b1f2-6bc0504e2494 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:55.274139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2ee2fb70-7f04-4b3d-b1f2-6bc0504e2494 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:55.274743 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2ee2fb70-7f04-4b3d-b1f2-6bc0504e2494 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:55.443580 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2ee2fb70-7f04-4b3d-b1f2-6bc0504e2494 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:55.454891 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2ee2fb70-7f04-4b3d-b1f2-6bc0504e2494 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1201 microversion: 2.1 time: 0.209525 Jul 25 13:11:55.455904 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2755/5581] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:55 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1201 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:55.619953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8ecdb2ff-5636-4289-9ca6-c726c2992955 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:55.623025 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8ecdb2ff-5636-4289-9ca6-c726c2992955 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:55.632638 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ecdb2ff-5636-4289-9ca6-c726c2992955 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:55.633563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ecdb2ff-5636-4289-9ca6-c726c2992955 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:55.635711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ecdb2ff-5636-4289-9ca6-c726c2992955 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:55.636444 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ecdb2ff-5636-4289-9ca6-c726c2992955 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:55.895851 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8ecdb2ff-5636-4289-9ca6-c726c2992955 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa" status: 200 len: 1655 microversion: 2.1 time: 0.281400 Jul 25 13:11:55.898566 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2827/5582] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:55 2022] GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa => generated 1655 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:56.483482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f2ecfd82-3409-4fcf-9e61-2ace3e3c718c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:56.485029 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f2ecfd82-3409-4fcf-9e61-2ace3e3c718c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:56.496094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f2ecfd82-3409-4fcf-9e61-2ace3e3c718c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:56.496920 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f2ecfd82-3409-4fcf-9e61-2ace3e3c718c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:56.498031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f2ecfd82-3409-4fcf-9e61-2ace3e3c718c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:56.499049 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f2ecfd82-3409-4fcf-9e61-2ace3e3c718c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:56.610476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f2ecfd82-3409-4fcf-9e61-2ace3e3c718c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:11:56.626333 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f2ecfd82-3409-4fcf-9e61-2ace3e3c718c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 200 len: 1201 microversion: 2.1 time: 0.152645 Jul 25 13:11:56.627022 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2756/5583] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:56 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 1201 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:56.682006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-981ba02b-8fa8-4fde-a9f8-9acbe7273651 req-67296ad3-f130-4b41-90bc-7e73efc7c7ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f322627-079a-41d3-8e7d-0f2754ae0ffa", "name": "network-vif-deleted", "tag": "c902af3a-eba4-43d4-aed4-bc7488fbde30"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:11:56.705613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-981ba02b-8fa8-4fde-a9f8-9acbe7273651 req-67296ad3-f130-4b41-90bc-7e73efc7c7ca service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:56.706136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-981ba02b-8fa8-4fde-a9f8-9acbe7273651 req-67296ad3-f130-4b41-90bc-7e73efc7c7ca service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:56.745217 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-981ba02b-8fa8-4fde-a9f8-9acbe7273651 req-67296ad3-f130-4b41-90bc-7e73efc7c7ca service nova] Creating event network-vif-deleted:c902af3a-eba4-43d4-aed4-bc7488fbde30 for instance 9f322627-079a-41d3-8e7d-0f2754ae0ffa on n-h1-848886-15 Jul 25 13:11:56.756282 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-981ba02b-8fa8-4fde-a9f8-9acbe7273651 req-67296ad3-f130-4b41-90bc-7e73efc7c7ca service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080421 Jul 25 13:11:56.764095 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2828/5584] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:11:56.919702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5fcb2853-ac18-460b-9fd6-509a9a1a5ddc tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:56.920389 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5fcb2853-ac18-460b-9fd6-509a9a1a5ddc tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:56.937526 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5fcb2853-ac18-460b-9fd6-509a9a1a5ddc tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:56.940165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5fcb2853-ac18-460b-9fd6-509a9a1a5ddc tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:56.941035 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5fcb2853-ac18-460b-9fd6-509a9a1a5ddc tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:56.941500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5fcb2853-ac18-460b-9fd6-509a9a1a5ddc tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:57.104429 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5fcb2853-ac18-460b-9fd6-509a9a1a5ddc tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa" status: 200 len: 1450 microversion: 2.1 time: 0.189729 Jul 25 13:11:57.105043 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2757/5585] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:56 2022] GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa => generated 1450 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:11:57.653079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5c6752d6-39e2-436e-a581-b44682b4b564 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:57.653793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5c6752d6-39e2-436e-a581-b44682b4b564 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:57.676371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c6752d6-39e2-436e-a581-b44682b4b564 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:57.677052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c6752d6-39e2-436e-a581-b44682b4b564 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:57.678338 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c6752d6-39e2-436e-a581-b44682b4b564 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:57.678812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c6752d6-39e2-436e-a581-b44682b4b564 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:57.717676 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-5c6752d6-39e2-436e-a581-b44682b4b564 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] HTTP exception thrown: Instance e801a411-aba7-43d5-a366-924c4f035471 could not be found. Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5c6752d6-39e2-436e-a581-b44682b4b564 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Request method failure captured: Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 HTTP/1.1 Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pUsgUlyXXDFjpaxtInCA3ErKU2P2TTpSljieML2SSsbmedwjUWvmtCPv6cpRR2_rKwVTBeB1pN0R0PaQlKkP3JB2H_nZ9mFVhTCd_Xl4_Gcw-PsIj4Ff-CbWbJlbzuA6BFxmfwmUVgHks2P6PoEesxOn8j894_Z-5Z842qklFD2ecs Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b2fbd681752c41d0a24a9cf34ebc8389", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}] Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 9face2aaa9df430cb5d361c6e1fdf242 Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance e801a411-aba7-43d5-a366-924c4f035471 could not be found. Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'e801a411-aba7-43d5-a366-924c4f035471'} Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e801a411-aba7-43d5-a366-924c4f035471 could not be found. Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e801a411-aba7-43d5-a366-924c4f035471 could not be found. Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:11:57.725609 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:11:57.731694 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:57.731694 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:11:57.731694 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:11:57.731694 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:11:57.731694 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:11:57.731694 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e801a411-aba7-43d5-a366-924c4f035471 could not be found. Jul 25 13:11:57.731694 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:11:57.731694 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5c6752d6-39e2-436e-a581-b44682b4b564 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Returning 404 to user: Instance e801a411-aba7-43d5-a366-924c4f035471 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:11:57.731694 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5c6752d6-39e2-436e-a581-b44682b4b564 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 404 len: 111 microversion: 2.1 time: 0.079458 Jul 25 13:11:57.748462 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2829/5586] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:57 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:11:58.130983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-896bae7a-8a48-4a0a-a27c-afc54633bc11 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:11:58.130983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-896bae7a-8a48-4a0a-a27c-afc54633bc11 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] [instance: 9f322627-079a-41d3-8e7d-0f2754ae0ffa] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:11:58.147455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-896bae7a-8a48-4a0a-a27c-afc54633bc11 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:58.148069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-896bae7a-8a48-4a0a-a27c-afc54633bc11 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:58.149014 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-896bae7a-8a48-4a0a-a27c-afc54633bc11 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:11:58.149469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-896bae7a-8a48-4a0a-a27c-afc54633bc11 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:11:58.175199 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-896bae7a-8a48-4a0a-a27c-afc54633bc11 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] HTTP exception thrown: Instance 9f322627-079a-41d3-8e7d-0f2754ae0ffa could not be found. Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-896bae7a-8a48-4a0a-a27c-afc54633bc11 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Request method failure captured: Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa HTTP/1.1 Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pZKQ5mUtGddrRux9G_AoMbCe__VrtRZUOqHGwix-4gHRzeaWuKmDtlSsL7q6vEpmRhGYkna2kSBM4c-Ls5MbyGUYEQ_Gb4FJrfkhLfifdnLaaSNqYdg_11piUI7VwrlKl5LqJipwU1rW3b9nyj9Eyj_xSUKUMVKlb0q9ieefJDN0Wk Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 84a28c1fcb094a3b835d34f6e931fe0e Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-TestServerMultinode-886650789 Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84a28c1fcb094a3b835d34f6e931fe0e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84a28c1fcb094a3b835d34f6e931fe0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84a28c1fcb094a3b835d34f6e931fe0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84a28c1fcb094a3b835d34f6e931fe0e"}]}] Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-TestServerMultinode-886650789 Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 84a28c1fcb094a3b835d34f6e931fe0e Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-TestServerMultinode-886650789 Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-TestServerMultinode-886650789-project-admin Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 0ea4862fda714577b9be844b769a04ac Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-TestServerMultinode-886650789-project-admin Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 9f322627-079a-41d3-8e7d-0f2754ae0ffa could not be found. Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '9f322627-079a-41d3-8e7d-0f2754ae0ffa'} Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f322627-079a-41d3-8e7d-0f2754ae0ffa could not be found. Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f322627-079a-41d3-8e7d-0f2754ae0ffa could not be found. Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:11:58.177113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:58.182780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:11:58.182780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:11:58.182780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:11:58.182780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:11:58.182780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:11:58.182780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f322627-079a-41d3-8e7d-0f2754ae0ffa could not be found. Jul 25 13:11:58.182780 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:11:58.182780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-896bae7a-8a48-4a0a-a27c-afc54633bc11 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] Returning 404 to user: Instance 9f322627-079a-41d3-8e7d-0f2754ae0ffa could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:11:58.182780 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-896bae7a-8a48-4a0a-a27c-afc54633bc11 tempest-TestServerMultinode-886650789 tempest-TestServerMultinode-886650789-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa" status: 404 len: 111 microversion: 2.1 time: 0.057126 Jul 25 13:11:58.197719 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2758/5587] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:11:58 2022] GET /compute/v2.1/servers/9f322627-079a-41d3-8e7d-0f2754ae0ffa => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:12:02.257335 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8a72f2f7-c605-44f5-b9bc-a6d3029315f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:02.258065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8a72f2f7-c605-44f5-b9bc-a6d3029315f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:02.267762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a72f2f7-c605-44f5-b9bc-a6d3029315f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:02.268226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a72f2f7-c605-44f5-b9bc-a6d3029315f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:02.269036 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a72f2f7-c605-44f5-b9bc-a6d3029315f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:02.269485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a72f2f7-c605-44f5-b9bc-a6d3029315f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:02.320960 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-8a72f2f7-c605-44f5-b9bc-a6d3029315f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] HTTP exception thrown: Instance 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac could not be found. Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8a72f2f7-c605-44f5-b9bc-a6d3029315f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Request method failure captured: Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac HTTP/1.1 Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pUsgUlyXXDFjpaxtInCA3ErKU2P2TTpSljieML2SSsbmedwjUWvmtCPv6cpRR2_rKwVTBeB1pN0R0PaQlKkP3JB2H_nZ9mFVhTCd_Xl4_Gcw-PsIj4Ff-CbWbJlbzuA6BFxmfwmUVgHks2P6PoEesxOn8j894_Z-5Z842qklFD2ecs Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b2fbd681752c41d0a24a9cf34ebc8389", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}] Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 9face2aaa9df430cb5d361c6e1fdf242 Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac could not be found. Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '2ae5b75c-47c5-43a8-9a2b-534ef2da70ac'} Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac could not be found. Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:12:02.331770 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:12:02.336983 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac could not be found. Jul 25 13:12:02.336983 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:12:02.336983 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:12:02.336983 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:12:02.336983 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:12:02.336983 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:12:02.336983 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:12:02.336983 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:12:02.336983 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:12:02.336983 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac could not be found. Jul 25 13:12:02.336983 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:12:02.338688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8a72f2f7-c605-44f5-b9bc-a6d3029315f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Returning 404 to user: Instance 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:12:02.339747 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8a72f2f7-c605-44f5-b9bc-a6d3029315f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 404 len: 111 microversion: 2.1 time: 0.086611 Jul 25 13:12:02.340863 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2830/5588] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:12:02 2022] DELETE /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:12:02.349068 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d23f06ad-ffcc-4322-bbad-1850614a2307 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:02.349702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d23f06ad-ffcc-4322-bbad-1850614a2307 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:02.370534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d23f06ad-ffcc-4322-bbad-1850614a2307 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:02.371001 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d23f06ad-ffcc-4322-bbad-1850614a2307 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:02.372749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d23f06ad-ffcc-4322-bbad-1850614a2307 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:02.373206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d23f06ad-ffcc-4322-bbad-1850614a2307 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:02.399910 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-d23f06ad-ffcc-4322-bbad-1850614a2307 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] HTTP exception thrown: Instance 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac could not be found. Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d23f06ad-ffcc-4322-bbad-1850614a2307 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Request method failure captured: Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac HTTP/1.1 Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pUsgUlyXXDFjpaxtInCA3ErKU2P2TTpSljieML2SSsbmedwjUWvmtCPv6cpRR2_rKwVTBeB1pN0R0PaQlKkP3JB2H_nZ9mFVhTCd_Xl4_Gcw-PsIj4Ff-CbWbJlbzuA6BFxmfwmUVgHks2P6PoEesxOn8j894_Z-5Z842qklFD2ecs Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b2fbd681752c41d0a24a9cf34ebc8389", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}] Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 9face2aaa9df430cb5d361c6e1fdf242 Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac could not be found. Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '2ae5b75c-47c5-43a8-9a2b-534ef2da70ac'} Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac could not be found. Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac could not be found. Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:12:02.401660 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:12:02.406555 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:12:02.406555 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:12:02.406555 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:12:02.406555 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:12:02.406555 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:12:02.406555 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac could not be found. Jul 25 13:12:02.406555 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:12:02.406555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d23f06ad-ffcc-4322-bbad-1850614a2307 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Returning 404 to user: Instance 2ae5b75c-47c5-43a8-9a2b-534ef2da70ac could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:12:02.407621 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d23f06ad-ffcc-4322-bbad-1850614a2307 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac" status: 404 len: 111 microversion: 2.1 time: 0.062511 Jul 25 13:12:02.408255 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2759/5589] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:02 2022] GET /compute/v2.1/servers/2ae5b75c-47c5-43a8-9a2b-534ef2da70ac => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:12:03.383644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c59729fc-a476-441d-9e79-49ff187b6222 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:03.384396 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c59729fc-a476-441d-9e79-49ff187b6222 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:03.393909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c59729fc-a476-441d-9e79-49ff187b6222 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:03.395057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c59729fc-a476-441d-9e79-49ff187b6222 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:03.396007 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c59729fc-a476-441d-9e79-49ff187b6222 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:03.399957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c59729fc-a476-441d-9e79-49ff187b6222 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:03.439059 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-c59729fc-a476-441d-9e79-49ff187b6222 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] HTTP exception thrown: Instance e801a411-aba7-43d5-a366-924c4f035471 could not be found. Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c59729fc-a476-441d-9e79-49ff187b6222 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Request method failure captured: Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 HTTP/1.1 Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pUsgUlyXXDFjpaxtInCA3ErKU2P2TTpSljieML2SSsbmedwjUWvmtCPv6cpRR2_rKwVTBeB1pN0R0PaQlKkP3JB2H_nZ9mFVhTCd_Xl4_Gcw-PsIj4Ff-CbWbJlbzuA6BFxmfwmUVgHks2P6PoEesxOn8j894_Z-5Z842qklFD2ecs Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b2fbd681752c41d0a24a9cf34ebc8389", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}] Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 9face2aaa9df430cb5d361c6e1fdf242 Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance e801a411-aba7-43d5-a366-924c4f035471 could not be found. Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'e801a411-aba7-43d5-a366-924c4f035471'} Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e801a411-aba7-43d5-a366-924c4f035471 could not be found. Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:12:03.441499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:12:03.447573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e801a411-aba7-43d5-a366-924c4f035471 could not be found. Jul 25 13:12:03.447573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:12:03.447573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:12:03.447573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:12:03.447573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:12:03.447573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:12:03.447573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:12:03.447573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:12:03.447573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:12:03.447573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e801a411-aba7-43d5-a366-924c4f035471 could not be found. Jul 25 13:12:03.447573 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:12:03.447573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c59729fc-a476-441d-9e79-49ff187b6222 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Returning 404 to user: Instance e801a411-aba7-43d5-a366-924c4f035471 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:12:03.447573 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c59729fc-a476-441d-9e79-49ff187b6222 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 404 len: 111 microversion: 2.1 time: 0.064548 Jul 25 13:12:03.447573 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2831/5590] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:12:03 2022] DELETE /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:12:03.456370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c3efc29e-2678-4d45-a729-a700161c7143 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:03.457041 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c3efc29e-2678-4d45-a729-a700161c7143 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: e801a411-aba7-43d5-a366-924c4f035471] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:03.467041 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3efc29e-2678-4d45-a729-a700161c7143 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:03.467507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3efc29e-2678-4d45-a729-a700161c7143 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:03.468309 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3efc29e-2678-4d45-a729-a700161c7143 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:03.468949 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3efc29e-2678-4d45-a729-a700161c7143 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:03.491042 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-c3efc29e-2678-4d45-a729-a700161c7143 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] HTTP exception thrown: Instance e801a411-aba7-43d5-a366-924c4f035471 could not be found. Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c3efc29e-2678-4d45-a729-a700161c7143 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Request method failure captured: Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 HTTP/1.1 Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pUsgUlyXXDFjpaxtInCA3ErKU2P2TTpSljieML2SSsbmedwjUWvmtCPv6cpRR2_rKwVTBeB1pN0R0PaQlKkP3JB2H_nZ9mFVhTCd_Xl4_Gcw-PsIj4Ff-CbWbJlbzuA6BFxmfwmUVgHks2P6PoEesxOn8j894_Z-5Z842qklFD2ecs Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b2fbd681752c41d0a24a9cf34ebc8389", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}] Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 9face2aaa9df430cb5d361c6e1fdf242 Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance e801a411-aba7-43d5-a366-924c4f035471 could not be found. Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'e801a411-aba7-43d5-a366-924c4f035471'} Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e801a411-aba7-43d5-a366-924c4f035471 could not be found. Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e801a411-aba7-43d5-a366-924c4f035471 could not be found. Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:12:03.493653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:12:03.498616 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:12:03.498616 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:12:03.498616 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:12:03.498616 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:12:03.498616 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:12:03.498616 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e801a411-aba7-43d5-a366-924c4f035471 could not be found. Jul 25 13:12:03.498616 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:12:03.501719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c3efc29e-2678-4d45-a729-a700161c7143 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Returning 404 to user: Instance e801a411-aba7-43d5-a366-924c4f035471 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:12:03.503353 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c3efc29e-2678-4d45-a729-a700161c7143 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471" status: 404 len: 111 microversion: 2.1 time: 0.053484 Jul 25 13:12:03.505695 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2760/5591] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:03 2022] GET /compute/v2.1/servers/e801a411-aba7-43d5-a366-924c4f035471 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:12:03.656319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-792426bd-9d76-46bc-b3ef-1f29167e949d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Action: 'create', calling method: .version_select at 0x7efcf883ac10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1436557910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1lIr2s98jb6z8bbu4Odzr2OVvKN9dAqZ8GEfvpQRhHMLH4xV5K2RQI2yiiW2UYlIHUGxxyWjXkQJ1KkaeF7b+RtUgCBk4S4JHJeO/HgxjWbp+naqEel8Wsji9C6//T6w=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:12:03.745134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-792426bd-9d76-46bc-b3ef-1f29167e949d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Getting quotas for project b2fbd681752c41d0a24a9cf34ebc8389. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:12:03.773309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-792426bd-9d76-46bc-b3ef-1f29167e949d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Getting quotas for user 9face2aaa9df430cb5d361c6e1fdf242 and project b2fbd681752c41d0a24a9cf34ebc8389. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:12:03.879218 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-792426bd-9d76-46bc-b3ef-1f29167e949d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.228139 Jul 25 13:12:03.880008 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2832/5592] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:12:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:12:08.580289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-abe05443-cb96-4f18-8966-f9a14b18a524 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:12:08.584031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-abe05443-cb96-4f18-8966-f9a14b18a524 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: f5cd4124-73ad-4109-a774-b76ba75ab797] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:08.597019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:12:08.599016 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-abe05443-cb96-4f18-8966-f9a14b18a524 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:08.599488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-abe05443-cb96-4f18-8966-f9a14b18a524 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:08.600393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-abe05443-cb96-4f18-8966-f9a14b18a524 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:08.600948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-abe05443-cb96-4f18-8966-f9a14b18a524 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:08.664483 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-abe05443-cb96-4f18-8966-f9a14b18a524 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "POST /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797/action" status: 200 len: 24533 microversion: 2.1 time: 0.088485 Jul 25 13:12:08.674483 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2761/5593] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:12:08 2022] POST /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797/action => generated 24533 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:12:12.764508 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-62e0b0d9-46ee-4e02-afd2-2e0358aa9b65 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:12.766105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-62e0b0d9-46ee-4e02-afd2-2e0358aa9b65 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:12.780648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:12:12.783666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-62e0b0d9-46ee-4e02-afd2-2e0358aa9b65 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:12.789025 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-62e0b0d9-46ee-4e02-afd2-2e0358aa9b65 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:12.792035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-62e0b0d9-46ee-4e02-afd2-2e0358aa9b65 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:12.794518 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-62e0b0d9-46ee-4e02-afd2-2e0358aa9b65 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:12.836950 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-62e0b0d9-46ee-4e02-afd2-2e0358aa9b65 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/ips" status: 200 len: 152 microversion: 2.20 time: 0.077741 Jul 25 13:12:12.838894 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2833/5594] 10.222.0.49 () {60 vars in 1289 bytes} [Mon Jul 25 13:12:12 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/ips => generated 152 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:12:16.364132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7a40faaf-f82f-4f8f-8478-6a3e55482e5e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:12:16.364878 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7a40faaf-f82f-4f8f-8478-6a3e55482e5e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:16.395246 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a40faaf-f82f-4f8f-8478-6a3e55482e5e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:16.396350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a40faaf-f82f-4f8f-8478-6a3e55482e5e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:16.397282 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a40faaf-f82f-4f8f-8478-6a3e55482e5e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:16.397747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a40faaf-f82f-4f8f-8478-6a3e55482e5e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:16.493154 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-7a40faaf-f82f-4f8f-8478-6a3e55482e5e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lazy-loading 'flavor' on Instance uuid 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:12:16.940798 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7a40faaf-f82f-4f8f-8478-6a3e55482e5e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "POST /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/action" status: 202 len: 0 microversion: 2.20 time: 0.581892 Jul 25 13:12:16.944547 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2762/5595] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Jul 25 13:12:16 2022] POST /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/action => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:12:16.953639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c8159a7d-1a3c-4310-bbae-dbb71b04a0e7 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:16.955494 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c8159a7d-1a3c-4310-bbae-dbb71b04a0e7 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:16.968387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:12:16.975946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c8159a7d-1a3c-4310-bbae-dbb71b04a0e7 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:16.977059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c8159a7d-1a3c-4310-bbae-dbb71b04a0e7 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:16.993056 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c8159a7d-1a3c-4310-bbae-dbb71b04a0e7 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:16.994050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c8159a7d-1a3c-4310-bbae-dbb71b04a0e7 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:17.589966 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c8159a7d-1a3c-4310-bbae-dbb71b04a0e7 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:17.629372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c8159a7d-1a3c-4310-bbae-dbb71b04a0e7 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:17.638933 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c8159a7d-1a3c-4310-bbae-dbb71b04a0e7 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:17.643665 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c8159a7d-1a3c-4310-bbae-dbb71b04a0e7 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1724 microversion: 2.20 time: 0.693425 Jul 25 13:12:17.647929 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2834/5596] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:16 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1724 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:12:18.670433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0eae7515-2209-4b14-9aae-e5f1e3fd9908 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:18.673321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0eae7515-2209-4b14-9aae-e5f1e3fd9908 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:18.686246 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0eae7515-2209-4b14-9aae-e5f1e3fd9908 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:18.688500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0eae7515-2209-4b14-9aae-e5f1e3fd9908 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:18.690346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0eae7515-2209-4b14-9aae-e5f1e3fd9908 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:18.691809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0eae7515-2209-4b14-9aae-e5f1e3fd9908 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:19.041755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0eae7515-2209-4b14-9aae-e5f1e3fd9908 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:19.080926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0eae7515-2209-4b14-9aae-e5f1e3fd9908 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:19.086556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0eae7515-2209-4b14-9aae-e5f1e3fd9908 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:19.095781 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0eae7515-2209-4b14-9aae-e5f1e3fd9908 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1724 microversion: 2.20 time: 0.427781 Jul 25 13:12:19.097116 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2763/5597] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:18 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1724 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:12:20.121097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d85df06a-ad48-4b41-8ee1-b7e5810498fe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:20.121715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d85df06a-ad48-4b41-8ee1-b7e5810498fe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:20.143952 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d85df06a-ad48-4b41-8ee1-b7e5810498fe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:20.144486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d85df06a-ad48-4b41-8ee1-b7e5810498fe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:20.145735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d85df06a-ad48-4b41-8ee1-b7e5810498fe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:20.146506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d85df06a-ad48-4b41-8ee1-b7e5810498fe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:20.763888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d85df06a-ad48-4b41-8ee1-b7e5810498fe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:20.812326 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d85df06a-ad48-4b41-8ee1-b7e5810498fe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:20.818535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d85df06a-ad48-4b41-8ee1-b7e5810498fe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:20.825251 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d85df06a-ad48-4b41-8ee1-b7e5810498fe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1724 microversion: 2.20 time: 0.709264 Jul 25 13:12:20.827338 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2835/5598] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:20 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1724 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:12:21.852863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e7b44adf-ef48-4fc2-99d4-a7a32616c40b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:21.853507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e7b44adf-ef48-4fc2-99d4-a7a32616c40b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:21.869893 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e7b44adf-ef48-4fc2-99d4-a7a32616c40b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:21.870857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e7b44adf-ef48-4fc2-99d4-a7a32616c40b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:21.877169 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e7b44adf-ef48-4fc2-99d4-a7a32616c40b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:21.880628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e7b44adf-ef48-4fc2-99d4-a7a32616c40b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:21.936631 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:12:22.273512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e7b44adf-ef48-4fc2-99d4-a7a32616c40b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:22.294201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e7b44adf-ef48-4fc2-99d4-a7a32616c40b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:22.300738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e7b44adf-ef48-4fc2-99d4-a7a32616c40b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:22.302168 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e7b44adf-ef48-4fc2-99d4-a7a32616c40b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1724 microversion: 2.20 time: 0.453987 Jul 25 13:12:22.307884 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2764/5599] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:21 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1724 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:12:23.334452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0a71b0f1-3c00-4d6d-b18a-0902a6a08442 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:23.335135 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0a71b0f1-3c00-4d6d-b18a-0902a6a08442 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:23.351022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a71b0f1-3c00-4d6d-b18a-0902a6a08442 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:23.351022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a71b0f1-3c00-4d6d-b18a-0902a6a08442 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:23.351824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a71b0f1-3c00-4d6d-b18a-0902a6a08442 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:23.352274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a71b0f1-3c00-4d6d-b18a-0902a6a08442 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:23.355708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=45 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:12:23.679287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0a71b0f1-3c00-4d6d-b18a-0902a6a08442 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:23.693082 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0a71b0f1-3c00-4d6d-b18a-0902a6a08442 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:23.697668 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0a71b0f1-3c00-4d6d-b18a-0902a6a08442 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:23.702329 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0a71b0f1-3c00-4d6d-b18a-0902a6a08442 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1724 microversion: 2.20 time: 0.371103 Jul 25 13:12:23.703211 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2836/5600] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:23 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1724 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:12:24.701586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6f0e6385-c8bc-4998-a8c4-50ffabeeb34b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Action: 'create', calling method: .version_select at 0x7efcf8c59f70>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1655722941", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5qKn1KtAEcUOcwXXWLsndQT2cBzGyuAIqilW39RQN/gR0+HwL9zVeuxobQrIF7/To+0BUsdhIeDvq1wwxQf4runB7IfJ3P68YtdHbw05VKg+StMBqEA2mO44l6Svdq9g=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:12:24.727271 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-64a077a5-9f14-4c8d-8919-31f53d57455d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:24.727945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-64a077a5-9f14-4c8d-8919-31f53d57455d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:24.738609 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64a077a5-9f14-4c8d-8919-31f53d57455d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:24.740153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-6f0e6385-c8bc-4998-a8c4-50ffabeeb34b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Getting quotas for project 8d36edc3feda482686f9202892538c87. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:12:24.743365 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64a077a5-9f14-4c8d-8919-31f53d57455d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:24.746416 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64a077a5-9f14-4c8d-8919-31f53d57455d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:24.749624 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-64a077a5-9f14-4c8d-8919-31f53d57455d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:24.757030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-6f0e6385-c8bc-4998-a8c4-50ffabeeb34b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Getting quotas for user d165e33e297f4bd8a37c1f65aa35549d and project 8d36edc3feda482686f9202892538c87. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:12:24.808542 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6f0e6385-c8bc-4998-a8c4-50ffabeeb34b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.111717 Jul 25 13:12:24.809455 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2765/5601] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:12:24 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:12:25.627017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-64a077a5-9f14-4c8d-8919-31f53d57455d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:25.642832 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-64a077a5-9f14-4c8d-8919-31f53d57455d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:25.647747 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-64a077a5-9f14-4c8d-8919-31f53d57455d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:25.649575 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-64a077a5-9f14-4c8d-8919-31f53d57455d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1724 microversion: 2.20 time: 0.926050 Jul 25 13:12:25.657339 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2837/5602] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:24 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1724 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:12:26.681731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-db7c9a3f-3a2d-48a9-9ab0-439ad26fc551 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:26.682837 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-db7c9a3f-3a2d-48a9-9ab0-439ad26fc551 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:26.691910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-db7c9a3f-3a2d-48a9-9ab0-439ad26fc551 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:26.692870 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-db7c9a3f-3a2d-48a9-9ab0-439ad26fc551 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:26.696779 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-db7c9a3f-3a2d-48a9-9ab0-439ad26fc551 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:26.697581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-db7c9a3f-3a2d-48a9-9ab0-439ad26fc551 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:26.794267 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7dfcdbd7-b8ae-4efd-9551-78b114906e34 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-832048804", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "608db3f9-1012-4133-92a3-2be75e58f4fc"}], "key_name": "tempest-TestNetworkBasicOps-1655722941", "security_groups": [{"name": "tempest-secgroup-smoke-555656984"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:12:26.968702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-db7c9a3f-3a2d-48a9-9ab0-439ad26fc551 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:26.988507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-db7c9a3f-3a2d-48a9-9ab0-439ad26fc551 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:26.998965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-db7c9a3f-3a2d-48a9-9ab0-439ad26fc551 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:27.006369 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-db7c9a3f-3a2d-48a9-9ab0-439ad26fc551 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1724 microversion: 2.20 time: 0.329468 Jul 25 13:12:27.010350 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2766/5603] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:26 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1724 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:12:27.015523 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-7dfcdbd7-b8ae-4efd-9551-78b114906e34 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] validate_networks() for [('608db3f9-1012-4133-92a3-2be75e58f4fc', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:12:27.744792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-7dfcdbd7-b8ae-4efd-9551-78b114906e34 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:12:27.745219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-7dfcdbd7-b8ae-4efd-9551-78b114906e34 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:12:27.745694 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-7dfcdbd7-b8ae-4efd-9551-78b114906e34 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:12:27.746280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-7dfcdbd7-b8ae-4efd-9551-78b114906e34 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:12:27.746707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-7dfcdbd7-b8ae-4efd-9551-78b114906e34 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:12:27.760865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7dfcdbd7-b8ae-4efd-9551-78b114906e34 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:27.761332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7dfcdbd7-b8ae-4efd-9551-78b114906e34 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:27.762206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7dfcdbd7-b8ae-4efd-9551-78b114906e34 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:27.768037 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7dfcdbd7-b8ae-4efd-9551-78b114906e34 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:27.794639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-7dfcdbd7-b8ae-4efd-9551-78b114906e34 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Getting quotas for project 8d36edc3feda482686f9202892538c87. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:12:27.801413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-7dfcdbd7-b8ae-4efd-9551-78b114906e34 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Getting quotas for user d165e33e297f4bd8a37c1f65aa35549d and project 8d36edc3feda482686f9202892538c87. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:12:27.817632 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7dfcdbd7-b8ae-4efd-9551-78b114906e34 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:12:27.820350 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7dfcdbd7-b8ae-4efd-9551-78b114906e34 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: 66c72a4d-b9fa-4e23-a3cb-0e462058acd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:12:27.894279 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7dfcdbd7-b8ae-4efd-9551-78b114906e34 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.105146 Jul 25 13:12:27.896821 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2838/5604] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:12:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:12:27.908700 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2d6f10dc-2053-4ee7-bb0e-e0b6e21d4ada tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:27.909633 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2d6f10dc-2053-4ee7-bb0e-e0b6e21d4ada tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: 66c72a4d-b9fa-4e23-a3cb-0e462058acd0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:28.036558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-be7f01b3-eceb-448d-9f8b-d7cabe8d1d9d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:28.037322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-be7f01b3-eceb-448d-9f8b-d7cabe8d1d9d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:28.057502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2d6f10dc-2053-4ee7-bb0e-e0b6e21d4ada tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:28.057724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be7f01b3-eceb-448d-9f8b-d7cabe8d1d9d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:28.065240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be7f01b3-eceb-448d-9f8b-d7cabe8d1d9d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:28.066315 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be7f01b3-eceb-448d-9f8b-d7cabe8d1d9d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:28.067017 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2d6f10dc-2053-4ee7-bb0e-e0b6e21d4ada tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0" status: 200 len: 1248 microversion: 2.1 time: 0.162146 Jul 25 13:12:28.070213 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be7f01b3-eceb-448d-9f8b-d7cabe8d1d9d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:28.084547 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2767/5605] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:27 2022] GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0 => generated 1248 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:12:28.360159 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-be7f01b3-eceb-448d-9f8b-d7cabe8d1d9d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:28.397327 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-be7f01b3-eceb-448d-9f8b-d7cabe8d1d9d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:28.408178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-be7f01b3-eceb-448d-9f8b-d7cabe8d1d9d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:28.410938 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-be7f01b3-eceb-448d-9f8b-d7cabe8d1d9d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1745 microversion: 2.20 time: 0.379023 Jul 25 13:12:28.411541 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2839/5606] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:28 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1745 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:12:29.090756 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c764b72c-4de8-4f04-b3a0-e396a683cc8f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:29.091510 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c764b72c-4de8-4f04-b3a0-e396a683cc8f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: 66c72a4d-b9fa-4e23-a3cb-0e462058acd0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:29.115144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c764b72c-4de8-4f04-b3a0-e396a683cc8f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:29.115832 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c764b72c-4de8-4f04-b3a0-e396a683cc8f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:29.122843 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c764b72c-4de8-4f04-b3a0-e396a683cc8f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:29.123832 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c764b72c-4de8-4f04-b3a0-e396a683cc8f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:29.258660 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c764b72c-4de8-4f04-b3a0-e396a683cc8f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:29.276525 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c764b72c-4de8-4f04-b3a0-e396a683cc8f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0" status: 200 len: 1244 microversion: 2.1 time: 0.190174 Jul 25 13:12:29.278909 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2768/5607] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:29 2022] GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0 => generated 1244 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:12:29.440369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7ee02a90-440d-4ebd-acde-c2bde377f4cf tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:29.442473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7ee02a90-440d-4ebd-acde-c2bde377f4cf tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:29.457794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ee02a90-440d-4ebd-acde-c2bde377f4cf tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:29.460070 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ee02a90-440d-4ebd-acde-c2bde377f4cf tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:29.463197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ee02a90-440d-4ebd-acde-c2bde377f4cf tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:29.464799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ee02a90-440d-4ebd-acde-c2bde377f4cf tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:29.898511 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7ee02a90-440d-4ebd-acde-c2bde377f4cf tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:29.908761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7ee02a90-440d-4ebd-acde-c2bde377f4cf tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:29.915064 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7ee02a90-440d-4ebd-acde-c2bde377f4cf tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:29.920565 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7ee02a90-440d-4ebd-acde-c2bde377f4cf tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1740 microversion: 2.20 time: 0.488001 Jul 25 13:12:29.921163 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2840/5608] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:29 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1740 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:12:30.302067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7134a6bd-4753-4204-9a47-2bdcc378cf5e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:30.304648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7134a6bd-4753-4204-9a47-2bdcc378cf5e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: 66c72a4d-b9fa-4e23-a3cb-0e462058acd0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:30.316749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7134a6bd-4753-4204-9a47-2bdcc378cf5e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:30.325981 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7134a6bd-4753-4204-9a47-2bdcc378cf5e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:30.330906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7134a6bd-4753-4204-9a47-2bdcc378cf5e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:30.350310 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7134a6bd-4753-4204-9a47-2bdcc378cf5e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:30.692030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7134a6bd-4753-4204-9a47-2bdcc378cf5e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:30.702107 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7134a6bd-4753-4204-9a47-2bdcc378cf5e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0" status: 200 len: 1306 microversion: 2.1 time: 0.405208 Jul 25 13:12:30.707548 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2769/5609] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:30 2022] GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0 => generated 1306 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:12:30.945700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6664589e-bda9-4511-8557-80e1dcf593c4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:30.946354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6664589e-bda9-4511-8557-80e1dcf593c4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:30.958471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6664589e-bda9-4511-8557-80e1dcf593c4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:30.958925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6664589e-bda9-4511-8557-80e1dcf593c4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:30.959826 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6664589e-bda9-4511-8557-80e1dcf593c4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:30.960265 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6664589e-bda9-4511-8557-80e1dcf593c4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:31.735264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-935b5f81-0815-4d61-b4c5-bff1b947b383 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:31.735903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-935b5f81-0815-4d61-b4c5-bff1b947b383 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: 66c72a4d-b9fa-4e23-a3cb-0e462058acd0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:31.772743 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-935b5f81-0815-4d61-b4c5-bff1b947b383 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:31.774581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-935b5f81-0815-4d61-b4c5-bff1b947b383 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:31.777678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-935b5f81-0815-4d61-b4c5-bff1b947b383 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:31.778408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-935b5f81-0815-4d61-b4c5-bff1b947b383 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:31.791495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6664589e-bda9-4511-8557-80e1dcf593c4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:31.800838 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6664589e-bda9-4511-8557-80e1dcf593c4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:31.814056 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6664589e-bda9-4511-8557-80e1dcf593c4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:31.823502 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6664589e-bda9-4511-8557-80e1dcf593c4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1740 microversion: 2.20 time: 0.881850 Jul 25 13:12:31.829323 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2841/5610] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:30 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1740 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:12:32.036632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-935b5f81-0815-4d61-b4c5-bff1b947b383 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:32.048562 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-935b5f81-0815-4d61-b4c5-bff1b947b383 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0" status: 200 len: 1306 microversion: 2.1 time: 0.318397 Jul 25 13:12:32.071110 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2770/5611] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:31 2022] GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0 => generated 1306 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:12:32.819156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-38d0fa29-df50-4ace-abce-d3cca76893b4 req-add91ab4-0b2f-4850-9d83-892b739fc86e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffd02cb-a0ad-4b1f-b129-6fee94dc57af", "name": "network-vif-plugged", "status": "completed", "tag": "f70aacb3-9955-48b6-92e4-b936a8bc527b"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:12:32.839472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-38d0fa29-df50-4ace-abce-d3cca76893b4 req-add91ab4-0b2f-4850-9d83-892b739fc86e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:32.852334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-38d0fa29-df50-4ace-abce-d3cca76893b4 req-add91ab4-0b2f-4850-9d83-892b739fc86e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:32.860930 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-752693d7-cfc8-4316-85b5-6db793c0a384 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:32.862639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-752693d7-cfc8-4316-85b5-6db793c0a384 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:32.894693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-752693d7-cfc8-4316-85b5-6db793c0a384 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:32.896491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-752693d7-cfc8-4316-85b5-6db793c0a384 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:32.902186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-752693d7-cfc8-4316-85b5-6db793c0a384 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:32.903767 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-38d0fa29-df50-4ace-abce-d3cca76893b4 req-add91ab4-0b2f-4850-9d83-892b739fc86e service nova] Creating event network-vif-plugged:f70aacb3-9955-48b6-92e4-b936a8bc527b for instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af on n-h2-848886-15 Jul 25 13:12:32.908106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-752693d7-cfc8-4316-85b5-6db793c0a384 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:32.919568 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-38d0fa29-df50-4ace-abce-d3cca76893b4 req-add91ab4-0b2f-4850-9d83-892b739fc86e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110253 Jul 25 13:12:32.930226 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2842/5612] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:12:33.077300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-48b1812a-a52d-4c41-9a2d-dbd6c675a988 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:33.078047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-48b1812a-a52d-4c41-9a2d-dbd6c675a988 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: 66c72a4d-b9fa-4e23-a3cb-0e462058acd0] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:33.091926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48b1812a-a52d-4c41-9a2d-dbd6c675a988 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:33.098564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48b1812a-a52d-4c41-9a2d-dbd6c675a988 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:33.100439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48b1812a-a52d-4c41-9a2d-dbd6c675a988 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:33.108368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48b1812a-a52d-4c41-9a2d-dbd6c675a988 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:33.848802 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-752693d7-cfc8-4316-85b5-6db793c0a384 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:33.863606 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-752693d7-cfc8-4316-85b5-6db793c0a384 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:33.871464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-752693d7-cfc8-4316-85b5-6db793c0a384 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:33.873427 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-752693d7-cfc8-4316-85b5-6db793c0a384 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1740 microversion: 2.20 time: 1.016759 Jul 25 13:12:33.894647 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2771/5613] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:32 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1740 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:12:33.923317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-48b1812a-a52d-4c41-9a2d-dbd6c675a988 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:33.935841 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-48b1812a-a52d-4c41-9a2d-dbd6c675a988 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0" status: 200 len: 1373 microversion: 2.1 time: 0.863049 Jul 25 13:12:33.961867 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2843/5614] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:33 2022] GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0 => generated 1373 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:12:34.900924 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f7a66dbb-116d-4577-8575-36f9ec7186fa tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:34.901666 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f7a66dbb-116d-4577-8575-36f9ec7186fa tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:34.934684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7a66dbb-116d-4577-8575-36f9ec7186fa tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:34.937690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7a66dbb-116d-4577-8575-36f9ec7186fa tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:34.938759 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7a66dbb-116d-4577-8575-36f9ec7186fa tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:34.939403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f7a66dbb-116d-4577-8575-36f9ec7186fa tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:34.977455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1d61e460-6445-4e7c-82c4-d44091b60f44 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:34.978888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1d61e460-6445-4e7c-82c4-d44091b60f44 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: 66c72a4d-b9fa-4e23-a3cb-0e462058acd0] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:34.991806 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1d61e460-6445-4e7c-82c4-d44091b60f44 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:34.993918 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1d61e460-6445-4e7c-82c4-d44091b60f44 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:34.995339 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1d61e460-6445-4e7c-82c4-d44091b60f44 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:34.998767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1d61e460-6445-4e7c-82c4-d44091b60f44 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:35.859928 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f7a66dbb-116d-4577-8575-36f9ec7186fa tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:35.879118 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f7a66dbb-116d-4577-8575-36f9ec7186fa tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:35.880810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f7a66dbb-116d-4577-8575-36f9ec7186fa tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:35.897573 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f7a66dbb-116d-4577-8575-36f9ec7186fa tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1740 microversion: 2.20 time: 0.996475 Jul 25 13:12:35.902251 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2772/5615] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:34 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1740 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:12:35.923058 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-2c4a6eeb-8fed-4212-8a9c-246fd1f109da req-96a89799-bee9-4082-871b-c1166d6871a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c72a4d-b9fa-4e23-a3cb-0e462058acd0", "tag": "397820d7-11b7-44df-9253-573fe363b8ac"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:12:35.955874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2c4a6eeb-8fed-4212-8a9c-246fd1f109da req-96a89799-bee9-4082-871b-c1166d6871a0 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:35.971078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2c4a6eeb-8fed-4212-8a9c-246fd1f109da req-96a89799-bee9-4082-871b-c1166d6871a0 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:36.023662 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-2c4a6eeb-8fed-4212-8a9c-246fd1f109da req-96a89799-bee9-4082-871b-c1166d6871a0 service nova] Creating event network-changed:397820d7-11b7-44df-9253-573fe363b8ac for instance 66c72a4d-b9fa-4e23-a3cb-0e462058acd0 on n-h2-848886-15 Jul 25 13:12:36.031343 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-2c4a6eeb-8fed-4212-8a9c-246fd1f109da req-96a89799-bee9-4082-871b-c1166d6871a0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127588 Jul 25 13:12:36.032709 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2773/5616] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:12:36.180936 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1d61e460-6445-4e7c-82c4-d44091b60f44 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:36.201918 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1d61e460-6445-4e7c-82c4-d44091b60f44 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0" status: 200 len: 1373 microversion: 2.1 time: 1.228551 Jul 25 13:12:36.207147 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2844/5617] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:34 2022] GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0 => generated 1373 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:12:36.930836 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d9e064e0-dfa2-4439-92bd-ae3229e31e14 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:36.931575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d9e064e0-dfa2-4439-92bd-ae3229e31e14 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:36.951742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9e064e0-dfa2-4439-92bd-ae3229e31e14 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:36.952334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9e064e0-dfa2-4439-92bd-ae3229e31e14 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:36.953377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9e064e0-dfa2-4439-92bd-ae3229e31e14 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:36.956853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9e064e0-dfa2-4439-92bd-ae3229e31e14 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:37.237793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f4e1d2aa-4168-4670-ae16-ab52d6c5b4d7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:37.238697 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f4e1d2aa-4168-4670-ae16-ab52d6c5b4d7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: 66c72a4d-b9fa-4e23-a3cb-0e462058acd0] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:37.255603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4e1d2aa-4168-4670-ae16-ab52d6c5b4d7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:37.256631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4e1d2aa-4168-4670-ae16-ab52d6c5b4d7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:37.257813 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4e1d2aa-4168-4670-ae16-ab52d6c5b4d7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:37.258486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f4e1d2aa-4168-4670-ae16-ab52d6c5b4d7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:37.309284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d9e064e0-dfa2-4439-92bd-ae3229e31e14 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:37.335665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d9e064e0-dfa2-4439-92bd-ae3229e31e14 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:37.335665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d9e064e0-dfa2-4439-92bd-ae3229e31e14 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:37.339087 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d9e064e0-dfa2-4439-92bd-ae3229e31e14 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1740 microversion: 2.20 time: 0.413461 Jul 25 13:12:37.355376 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2774/5618] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:36 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1740 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:12:37.581524 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f4e1d2aa-4168-4670-ae16-ab52d6c5b4d7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:37.609090 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f4e1d2aa-4168-4670-ae16-ab52d6c5b4d7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0" status: 200 len: 1373 microversion: 2.1 time: 0.376468 Jul 25 13:12:37.613893 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2845/5619] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:37 2022] GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0 => generated 1373 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:12:38.367541 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c5fae601-805b-4d2c-94b6-f0e15fe6b824 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:38.368365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c5fae601-805b-4d2c-94b6-f0e15fe6b824 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:38.390932 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:12:38.398684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5fae601-805b-4d2c-94b6-f0e15fe6b824 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:38.402256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5fae601-805b-4d2c-94b6-f0e15fe6b824 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:38.406953 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5fae601-805b-4d2c-94b6-f0e15fe6b824 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:38.409226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5fae601-805b-4d2c-94b6-f0e15fe6b824 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:38.636276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-322bfda0-2abc-4943-b73c-aac3bbe9d85d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:38.637063 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-322bfda0-2abc-4943-b73c-aac3bbe9d85d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: 66c72a4d-b9fa-4e23-a3cb-0e462058acd0] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:38.639227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:12:38.640216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:12:38.659871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-322bfda0-2abc-4943-b73c-aac3bbe9d85d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:38.660339 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-322bfda0-2abc-4943-b73c-aac3bbe9d85d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:38.663435 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-322bfda0-2abc-4943-b73c-aac3bbe9d85d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:38.663930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-322bfda0-2abc-4943-b73c-aac3bbe9d85d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:39.248349 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c5fae601-805b-4d2c-94b6-f0e15fe6b824 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:39.264359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c5fae601-805b-4d2c-94b6-f0e15fe6b824 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:39.269600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c5fae601-805b-4d2c-94b6-f0e15fe6b824 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:39.271335 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c5fae601-805b-4d2c-94b6-f0e15fe6b824 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1740 microversion: 2.20 time: 0.908152 Jul 25 13:12:39.274479 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2775/5620] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:38 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1740 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:12:39.388427 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-322bfda0-2abc-4943-b73c-aac3bbe9d85d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:39.398346 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-322bfda0-2abc-4943-b73c-aac3bbe9d85d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0" status: 200 len: 1373 microversion: 2.1 time: 0.767464 Jul 25 13:12:39.407279 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2846/5621] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:38 2022] GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0 => generated 1373 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:12:40.302734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8bf055a4-d555-419a-b9dc-8b3c3c26b67d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:40.304085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8bf055a4-d555-419a-b9dc-8b3c3c26b67d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:40.307459 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:12:40.319595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bf055a4-d555-419a-b9dc-8b3c3c26b67d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:40.323508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bf055a4-d555-419a-b9dc-8b3c3c26b67d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:40.324861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bf055a4-d555-419a-b9dc-8b3c3c26b67d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:40.325538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bf055a4-d555-419a-b9dc-8b3c3c26b67d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:40.431436 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2344c5b6-4a87-43ac-9ee4-4b194a4b3a89 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:40.432071 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2344c5b6-4a87-43ac-9ee4-4b194a4b3a89 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: 66c72a4d-b9fa-4e23-a3cb-0e462058acd0] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:40.459675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2344c5b6-4a87-43ac-9ee4-4b194a4b3a89 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:40.460141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2344c5b6-4a87-43ac-9ee4-4b194a4b3a89 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:40.467555 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2344c5b6-4a87-43ac-9ee4-4b194a4b3a89 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:40.468283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2344c5b6-4a87-43ac-9ee4-4b194a4b3a89 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:41.327018 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2344c5b6-4a87-43ac-9ee4-4b194a4b3a89 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:41.336230 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2344c5b6-4a87-43ac-9ee4-4b194a4b3a89 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0" status: 200 len: 1373 microversion: 2.1 time: 0.908683 Jul 25 13:12:41.341385 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2847/5622] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:40 2022] GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0 => generated 1373 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:12:41.351190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-91915cac-d00e-4fed-ade6-13a9e27856ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-360993755", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1436557910", "security_groups": [{"name": "tempest-secgroup-smoke-2026990488"}], "block_device_mapping_v2": [{"uuid": "e4da144f-7624-466c-bb35-7ad3b0e526ef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2e9a011a-2cfb-4a86-9ca1-b23997eebbe8"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:12:41.405883 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8bf055a4-d555-419a-b9dc-8b3c3c26b67d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:41.426336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8bf055a4-d555-419a-b9dc-8b3c3c26b67d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:41.432473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8bf055a4-d555-419a-b9dc-8b3c3c26b67d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:41.436670 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8bf055a4-d555-419a-b9dc-8b3c3c26b67d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1740 microversion: 2.20 time: 1.136603 Jul 25 13:12:41.458268 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2776/5623] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:40 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1740 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:12:41.729965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-91915cac-d00e-4fed-ade6-13a9e27856ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] validate_networks() for [('2e9a011a-2cfb-4a86-9ca1-b23997eebbe8', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:12:42.366774 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aca2504e-3c00-4153-a71a-c6688fdc161d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:42.367756 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-aca2504e-3c00-4153-a71a-c6688fdc161d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: 66c72a4d-b9fa-4e23-a3cb-0e462058acd0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:42.389777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aca2504e-3c00-4153-a71a-c6688fdc161d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:42.390713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aca2504e-3c00-4153-a71a-c6688fdc161d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:42.392351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aca2504e-3c00-4153-a71a-c6688fdc161d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:42.392981 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aca2504e-3c00-4153-a71a-c6688fdc161d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:43.287839 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-aca2504e-3c00-4153-a71a-c6688fdc161d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:43.302796 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aca2504e-3c00-4153-a71a-c6688fdc161d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0" status: 200 len: 1373 microversion: 2.1 time: 0.939881 Jul 25 13:12:43.303968 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2777/5624] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:42 2022] GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0 => generated 1373 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:12:43.317450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6defd75b-dc74-4e41-aaf5-8d6521c7caa8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:43.319307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6defd75b-dc74-4e41-aaf5-8d6521c7caa8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:43.337255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6defd75b-dc74-4e41-aaf5-8d6521c7caa8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:43.338310 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6defd75b-dc74-4e41-aaf5-8d6521c7caa8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:43.339304 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6defd75b-dc74-4e41-aaf5-8d6521c7caa8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:43.341588 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6defd75b-dc74-4e41-aaf5-8d6521c7caa8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:43.895968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6defd75b-dc74-4e41-aaf5-8d6521c7caa8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:43.909394 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6defd75b-dc74-4e41-aaf5-8d6521c7caa8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:43.917092 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6defd75b-dc74-4e41-aaf5-8d6521c7caa8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:43.918946 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6defd75b-dc74-4e41-aaf5-8d6521c7caa8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1740 microversion: 2.20 time: 0.611003 Jul 25 13:12:43.921014 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2778/5625] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:43 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1740 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:12:43.939418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-91915cac-d00e-4fed-ade6-13a9e27856ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:12:43.939418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-91915cac-d00e-4fed-ade6-13a9e27856ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:12:43.940031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-91915cac-d00e-4fed-ade6-13a9e27856ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:12:43.940141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-91915cac-d00e-4fed-ade6-13a9e27856ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:12:43.940550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-91915cac-d00e-4fed-ade6-13a9e27856ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:12:43.945367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:12:43.962458 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91915cac-d00e-4fed-ade6-13a9e27856ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:43.963130 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91915cac-d00e-4fed-ade6-13a9e27856ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:43.964699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91915cac-d00e-4fed-ade6-13a9e27856ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:43.965798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91915cac-d00e-4fed-ade6-13a9e27856ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:44.030898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-91915cac-d00e-4fed-ade6-13a9e27856ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Getting quotas for project b2fbd681752c41d0a24a9cf34ebc8389. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:12:44.044759 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-91915cac-d00e-4fed-ade6-13a9e27856ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Getting quotas for user 9face2aaa9df430cb5d361c6e1fdf242 and project b2fbd681752c41d0a24a9cf34ebc8389. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:12:44.189506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-91915cac-d00e-4fed-ade6-13a9e27856ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:12:44.193219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-91915cac-d00e-4fed-ade6-13a9e27856ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e4da144f-7624-466c-bb35-7ad3b0e526ef',volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:12:44.344654 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7bf25a6c-9d23-4a03-92dd-680fd22cc8a8 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:44.345311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7bf25a6c-9d23-4a03-92dd-680fd22cc8a8 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: 66c72a4d-b9fa-4e23-a3cb-0e462058acd0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:44.356495 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7bf25a6c-9d23-4a03-92dd-680fd22cc8a8 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:44.358329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7bf25a6c-9d23-4a03-92dd-680fd22cc8a8 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:44.360755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7bf25a6c-9d23-4a03-92dd-680fd22cc8a8 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:44.362032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7bf25a6c-9d23-4a03-92dd-680fd22cc8a8 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:44.554827 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-91915cac-d00e-4fed-ade6-13a9e27856ff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.211740 Jul 25 13:12:44.557526 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2848/5626] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:12:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 3215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:12:44.571705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-b68de30b-ae8d-4dc0-88f3-b7bb215e5745 req-f6623df6-f7f6-419d-9965-6d43cdde2644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c72a4d-b9fa-4e23-a3cb-0e462058acd0", "name": "network-vif-plugged", "status": "completed", "tag": "397820d7-11b7-44df-9253-573fe363b8ac"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:12:44.619969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b68de30b-ae8d-4dc0-88f3-b7bb215e5745 req-f6623df6-f7f6-419d-9965-6d43cdde2644 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:44.621288 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b68de30b-ae8d-4dc0-88f3-b7bb215e5745 req-f6623df6-f7f6-419d-9965-6d43cdde2644 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:44.660091 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-b68de30b-ae8d-4dc0-88f3-b7bb215e5745 req-f6623df6-f7f6-419d-9965-6d43cdde2644 service nova] Creating event network-vif-plugged:397820d7-11b7-44df-9253-573fe363b8ac for instance 66c72a4d-b9fa-4e23-a3cb-0e462058acd0 on n-h2-848886-15 Jul 25 13:12:44.677167 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-b68de30b-ae8d-4dc0-88f3-b7bb215e5745 req-f6623df6-f7f6-419d-9965-6d43cdde2644 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116542 Jul 25 13:12:44.681881 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2849/5627] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:12:44.688343 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-757a2ada-3ef7-416b-b5fe-d9629a9ccd92 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:44.690617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-757a2ada-3ef7-416b-b5fe-d9629a9ccd92 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:44.825804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7bf25a6c-9d23-4a03-92dd-680fd22cc8a8 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:44.842358 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7bf25a6c-9d23-4a03-92dd-680fd22cc8a8 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0" status: 200 len: 1373 microversion: 2.1 time: 0.501699 Jul 25 13:12:44.848003 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2779/5628] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:44 2022] GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0 => generated 1373 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:12:44.951157 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4f547171-c488-4b81-b718-f2e6eb4d3e8a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:44.952104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4f547171-c488-4b81-b718-f2e6eb4d3e8a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:44.961263 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4f547171-c488-4b81-b718-f2e6eb4d3e8a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:44.962157 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4f547171-c488-4b81-b718-f2e6eb4d3e8a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:44.963716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4f547171-c488-4b81-b718-f2e6eb4d3e8a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:44.964411 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4f547171-c488-4b81-b718-f2e6eb4d3e8a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:45.044179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-757a2ada-3ef7-416b-b5fe-d9629a9ccd92 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:45.055863 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-757a2ada-3ef7-416b-b5fe-d9629a9ccd92 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1094 microversion: 2.1 time: 0.372110 Jul 25 13:12:45.058234 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2850/5629] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:44 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1094 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:12:45.465989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4f547171-c488-4b81-b718-f2e6eb4d3e8a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:45.486426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4f547171-c488-4b81-b718-f2e6eb4d3e8a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:45.492740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4f547171-c488-4b81-b718-f2e6eb4d3e8a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:45.497438 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4f547171-c488-4b81-b718-f2e6eb4d3e8a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1740 microversion: 2.20 time: 0.551884 Jul 25 13:12:45.498915 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2780/5630] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:44 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1740 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:12:45.875500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-39e80e06-85e5-45d6-92ee-e10fbbfc4ed2 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:45.877141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-39e80e06-85e5-45d6-92ee-e10fbbfc4ed2 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: 66c72a4d-b9fa-4e23-a3cb-0e462058acd0] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:45.903809 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-39e80e06-85e5-45d6-92ee-e10fbbfc4ed2 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:45.905478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-39e80e06-85e5-45d6-92ee-e10fbbfc4ed2 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:45.908757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-39e80e06-85e5-45d6-92ee-e10fbbfc4ed2 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:45.909322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-39e80e06-85e5-45d6-92ee-e10fbbfc4ed2 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:46.083339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6978a019-f627-4ed9-bbc5-477ed539a183 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:46.084417 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6978a019-f627-4ed9-bbc5-477ed539a183 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:46.097429 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6978a019-f627-4ed9-bbc5-477ed539a183 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:46.098509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6978a019-f627-4ed9-bbc5-477ed539a183 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:46.101783 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6978a019-f627-4ed9-bbc5-477ed539a183 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:46.101783 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6978a019-f627-4ed9-bbc5-477ed539a183 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:46.558033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6978a019-f627-4ed9-bbc5-477ed539a183 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:46.563974 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-39e80e06-85e5-45d6-92ee-e10fbbfc4ed2 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:46.595753 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-39e80e06-85e5-45d6-92ee-e10fbbfc4ed2 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0" status: 200 len: 1373 microversion: 2.1 time: 0.713953 Jul 25 13:12:46.597524 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6978a019-f627-4ed9-bbc5-477ed539a183 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1192 microversion: 2.1 time: 0.510489 Jul 25 13:12:46.614741 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2851/5631] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:45 2022] GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0 => generated 1373 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:12:46.622915 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2781/5632] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:46 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1192 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:12:46.643234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8b75f1b6-a13b-40da-b3b6-f8ef6ee0701d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:46.644298 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8b75f1b6-a13b-40da-b3b6-f8ef6ee0701d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:46.664975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b75f1b6-a13b-40da-b3b6-f8ef6ee0701d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:46.670444 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b75f1b6-a13b-40da-b3b6-f8ef6ee0701d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:46.671601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b75f1b6-a13b-40da-b3b6-f8ef6ee0701d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:46.675042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b75f1b6-a13b-40da-b3b6-f8ef6ee0701d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:47.037336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8b75f1b6-a13b-40da-b3b6-f8ef6ee0701d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:47.052496 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8b75f1b6-a13b-40da-b3b6-f8ef6ee0701d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:47.056540 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8b75f1b6-a13b-40da-b3b6-f8ef6ee0701d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:47.060891 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8b75f1b6-a13b-40da-b3b6-f8ef6ee0701d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1740 microversion: 2.20 time: 0.443192 Jul 25 13:12:47.063578 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2852/5633] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:46 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1740 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:12:47.623151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9e31d64e-a6d6-4347-bd54-70a0d357bfed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:47.623696 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9e31d64e-a6d6-4347-bd54-70a0d357bfed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:47.635934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-acec5b6e-a133-45b3-aa5d-476c6ae3e47e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:47.637998 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-acec5b6e-a133-45b3-aa5d-476c6ae3e47e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: 66c72a4d-b9fa-4e23-a3cb-0e462058acd0] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:47.641130 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e31d64e-a6d6-4347-bd54-70a0d357bfed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:47.641598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e31d64e-a6d6-4347-bd54-70a0d357bfed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:47.651184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e31d64e-a6d6-4347-bd54-70a0d357bfed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:47.656739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acec5b6e-a133-45b3-aa5d-476c6ae3e47e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:47.657217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acec5b6e-a133-45b3-aa5d-476c6ae3e47e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:47.657446 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e31d64e-a6d6-4347-bd54-70a0d357bfed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:47.663375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acec5b6e-a133-45b3-aa5d-476c6ae3e47e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:47.664193 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acec5b6e-a133-45b3-aa5d-476c6ae3e47e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:47.866052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9e31d64e-a6d6-4347-bd54-70a0d357bfed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:47.879115 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9e31d64e-a6d6-4347-bd54-70a0d357bfed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1210 microversion: 2.1 time: 0.259998 Jul 25 13:12:47.883501 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2782/5634] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:47 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1210 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:12:48.090093 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2b9d5d3c-27d1-4acb-9fd8-4d40349b026f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:48.091303 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2b9d5d3c-27d1-4acb-9fd8-4d40349b026f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:48.103573 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b9d5d3c-27d1-4acb-9fd8-4d40349b026f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:48.105180 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b9d5d3c-27d1-4acb-9fd8-4d40349b026f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:48.106874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b9d5d3c-27d1-4acb-9fd8-4d40349b026f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:48.110408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b9d5d3c-27d1-4acb-9fd8-4d40349b026f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:48.173127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:12:48.702678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2b9d5d3c-27d1-4acb-9fd8-4d40349b026f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:48.715718 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2b9d5d3c-27d1-4acb-9fd8-4d40349b026f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:48.718896 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-acec5b6e-a133-45b3-aa5d-476c6ae3e47e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:48.720375 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2b9d5d3c-27d1-4acb-9fd8-4d40349b026f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:48.722700 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2b9d5d3c-27d1-4acb-9fd8-4d40349b026f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1740 microversion: 2.20 time: 0.637338 Jul 25 13:12:48.727550 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2783/5635] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:48 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1740 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:12:48.757998 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-acec5b6e-a133-45b3-aa5d-476c6ae3e47e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0" status: 200 len: 1546 microversion: 2.1 time: 1.124105 Jul 25 13:12:48.762857 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2853/5636] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:47 2022] GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0 => generated 1546 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:12:48.791083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-316d2c66-9725-4608-8b8f-958c4bee86db tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:48.791802 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-316d2c66-9725-4608-8b8f-958c4bee86db tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: 66c72a4d-b9fa-4e23-a3cb-0e462058acd0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:48.804380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-316d2c66-9725-4608-8b8f-958c4bee86db tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:48.805106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-316d2c66-9725-4608-8b8f-958c4bee86db tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:48.810514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-316d2c66-9725-4608-8b8f-958c4bee86db tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:48.811247 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-316d2c66-9725-4608-8b8f-958c4bee86db tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:48.910377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-956fbbe7-8601-404b-bd32-c22bdc5f0ab9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:48.915165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-956fbbe7-8601-404b-bd32-c22bdc5f0ab9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:48.942400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-956fbbe7-8601-404b-bd32-c22bdc5f0ab9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:48.944083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-956fbbe7-8601-404b-bd32-c22bdc5f0ab9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:48.953538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-956fbbe7-8601-404b-bd32-c22bdc5f0ab9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:48.958986 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-956fbbe7-8601-404b-bd32-c22bdc5f0ab9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:49.177384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-316d2c66-9725-4608-8b8f-958c4bee86db tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:49.191823 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-316d2c66-9725-4608-8b8f-958c4bee86db tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0" status: 200 len: 1546 microversion: 2.1 time: 0.402235 Jul 25 13:12:49.195250 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2784/5637] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:48 2022] GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0 => generated 1546 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:12:49.705650 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-956fbbe7-8601-404b-bd32-c22bdc5f0ab9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:49.727039 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-956fbbe7-8601-404b-bd32-c22bdc5f0ab9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1278 microversion: 2.1 time: 0.828975 Jul 25 13:12:49.730363 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2854/5638] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:48 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1278 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:12:49.756427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-10d24139-34f8-4bed-8c1f-6a90cf46c3b1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:49.758466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-10d24139-34f8-4bed-8c1f-6a90cf46c3b1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:49.795919 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10d24139-34f8-4bed-8c1f-6a90cf46c3b1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:49.802611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10d24139-34f8-4bed-8c1f-6a90cf46c3b1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:49.808664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10d24139-34f8-4bed-8c1f-6a90cf46c3b1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:49.809889 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10d24139-34f8-4bed-8c1f-6a90cf46c3b1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:50.588496 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-10d24139-34f8-4bed-8c1f-6a90cf46c3b1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:50.621412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-10d24139-34f8-4bed-8c1f-6a90cf46c3b1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:50.628972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-10d24139-34f8-4bed-8c1f-6a90cf46c3b1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:50.633286 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-10d24139-34f8-4bed-8c1f-6a90cf46c3b1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1740 microversion: 2.20 time: 0.882895 Jul 25 13:12:50.639020 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2785/5639] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:49 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1740 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:12:50.751191 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-067eaf76-497d-4e53-9205-abcd1215e191 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:50.754050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-067eaf76-497d-4e53-9205-abcd1215e191 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:50.773204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-067eaf76-497d-4e53-9205-abcd1215e191 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:50.775669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-067eaf76-497d-4e53-9205-abcd1215e191 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:50.776712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-067eaf76-497d-4e53-9205-abcd1215e191 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:50.778606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-067eaf76-497d-4e53-9205-abcd1215e191 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:51.661399 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d355e65a-5e0e-4c10-b7a5-3f1b92c96d0d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:51.662185 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d355e65a-5e0e-4c10-b7a5-3f1b92c96d0d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:51.679927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d355e65a-5e0e-4c10-b7a5-3f1b92c96d0d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:51.682752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d355e65a-5e0e-4c10-b7a5-3f1b92c96d0d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:51.686774 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d355e65a-5e0e-4c10-b7a5-3f1b92c96d0d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:51.691609 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d355e65a-5e0e-4c10-b7a5-3f1b92c96d0d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:52.723636 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-067eaf76-497d-4e53-9205-abcd1215e191 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:52.732308 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-067eaf76-497d-4e53-9205-abcd1215e191 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1278 microversion: 2.1 time: 1.985871 Jul 25 13:12:52.748484 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2855/5640] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:50 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1278 bytes in 2003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:12:53.247613 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d355e65a-5e0e-4c10-b7a5-3f1b92c96d0d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:53.258198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d355e65a-5e0e-4c10-b7a5-3f1b92c96d0d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:53.278847 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d355e65a-5e0e-4c10-b7a5-3f1b92c96d0d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:53.280115 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d355e65a-5e0e-4c10-b7a5-3f1b92c96d0d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1740 microversion: 2.20 time: 1.623044 Jul 25 13:12:53.282726 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2786/5641] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:51 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1740 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:12:53.769124 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-edb49c34-e8fd-4f6c-b36f-10ceade95fc9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:53.772068 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-edb49c34-e8fd-4f6c-b36f-10ceade95fc9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:53.808548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-edb49c34-e8fd-4f6c-b36f-10ceade95fc9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:53.813021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-edb49c34-e8fd-4f6c-b36f-10ceade95fc9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:53.816926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-edb49c34-e8fd-4f6c-b36f-10ceade95fc9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:53.820220 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-edb49c34-e8fd-4f6c-b36f-10ceade95fc9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:53.835366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:12:53.879041 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-55de9802-5827-4ac2-b6c3-687377628c11 req-f01adcd1-b808-4cb6-9ad8-e3f27c136291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "592f6a73-dce4-4a04-8aa8-c14fe0e324e2", "tag": "19542a94-8da7-43f4-b45d-cf5f52f5698d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:12:53.905605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-55de9802-5827-4ac2-b6c3-687377628c11 req-f01adcd1-b808-4cb6-9ad8-e3f27c136291 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:53.918439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-55de9802-5827-4ac2-b6c3-687377628c11 req-f01adcd1-b808-4cb6-9ad8-e3f27c136291 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:53.990782 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-55de9802-5827-4ac2-b6c3-687377628c11 req-f01adcd1-b808-4cb6-9ad8-e3f27c136291 service nova] Creating event network-changed:19542a94-8da7-43f4-b45d-cf5f52f5698d for instance 592f6a73-dce4-4a04-8aa8-c14fe0e324e2 on n-h1-848886-15 Jul 25 13:12:54.007671 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-55de9802-5827-4ac2-b6c3-687377628c11 req-f01adcd1-b808-4cb6-9ad8-e3f27c136291 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132429 Jul 25 13:12:54.009674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:12:54.017465 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2787/5642] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:12:54.308479 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-39edf00a-23d9-4a3c-9bff-a620b252ff54 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:54.310463 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-39edf00a-23d9-4a3c-9bff-a620b252ff54 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:54.328782 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39edf00a-23d9-4a3c-9bff-a620b252ff54 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:54.329564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39edf00a-23d9-4a3c-9bff-a620b252ff54 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:54.330663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39edf00a-23d9-4a3c-9bff-a620b252ff54 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:54.331339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39edf00a-23d9-4a3c-9bff-a620b252ff54 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:54.721472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-39edf00a-23d9-4a3c-9bff-a620b252ff54 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:54.747507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-39edf00a-23d9-4a3c-9bff-a620b252ff54 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:54.760258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-edb49c34-e8fd-4f6c-b36f-10ceade95fc9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:54.760899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-39edf00a-23d9-4a3c-9bff-a620b252ff54 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:54.763532 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-39edf00a-23d9-4a3c-9bff-a620b252ff54 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1740 microversion: 2.20 time: 0.459431 Jul 25 13:12:54.772729 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2788/5643] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:54 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1740 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:12:54.778540 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-edb49c34-e8fd-4f6c-b36f-10ceade95fc9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1278 microversion: 2.1 time: 1.012798 Jul 25 13:12:54.781961 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2856/5644] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:53 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1278 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:12:55.794755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-00a2e809-43e8-4c46-a868-4a3cb48eaa4f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:55.796344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-00a2e809-43e8-4c46-a868-4a3cb48eaa4f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:55.811411 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00a2e809-43e8-4c46-a868-4a3cb48eaa4f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:55.812762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ae113228-cb00-4aaa-9dd9-b7b66e973268 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:55.814203 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ae113228-cb00-4aaa-9dd9-b7b66e973268 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:55.819659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00a2e809-43e8-4c46-a868-4a3cb48eaa4f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:55.830427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00a2e809-43e8-4c46-a868-4a3cb48eaa4f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:55.831529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=8 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:12:55.836553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00a2e809-43e8-4c46-a868-4a3cb48eaa4f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:55.862275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae113228-cb00-4aaa-9dd9-b7b66e973268 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:55.864048 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae113228-cb00-4aaa-9dd9-b7b66e973268 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:55.866293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae113228-cb00-4aaa-9dd9-b7b66e973268 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:55.867232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae113228-cb00-4aaa-9dd9-b7b66e973268 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:56.477614 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ae113228-cb00-4aaa-9dd9-b7b66e973268 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:56.500363 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ae113228-cb00-4aaa-9dd9-b7b66e973268 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1278 microversion: 2.1 time: 0.695163 Jul 25 13:12:56.502901 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2857/5645] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:55 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1278 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:12:56.655902 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-00a2e809-43e8-4c46-a868-4a3cb48eaa4f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:56.671627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-00a2e809-43e8-4c46-a868-4a3cb48eaa4f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:56.673605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-00a2e809-43e8-4c46-a868-4a3cb48eaa4f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:56.679479 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-00a2e809-43e8-4c46-a868-4a3cb48eaa4f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1740 microversion: 2.20 time: 0.889004 Jul 25 13:12:56.686053 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2789/5646] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:55 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1740 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:12:57.525923 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-31461d0e-da4d-482c-aead-a67a60f75e30 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:57.527666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-31461d0e-da4d-482c-aead-a67a60f75e30 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:57.544022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-31461d0e-da4d-482c-aead-a67a60f75e30 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:57.545332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-31461d0e-da4d-482c-aead-a67a60f75e30 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:57.548385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-31461d0e-da4d-482c-aead-a67a60f75e30 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:57.549077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-31461d0e-da4d-482c-aead-a67a60f75e30 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:57.704299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e97ab493-2062-4a41-bcff-85d6b4fdc99c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:57.705109 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e97ab493-2062-4a41-bcff-85d6b4fdc99c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:57.718288 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e97ab493-2062-4a41-bcff-85d6b4fdc99c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:57.729897 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e97ab493-2062-4a41-bcff-85d6b4fdc99c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:57.731215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e97ab493-2062-4a41-bcff-85d6b4fdc99c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:57.731912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e97ab493-2062-4a41-bcff-85d6b4fdc99c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:58.405522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e97ab493-2062-4a41-bcff-85d6b4fdc99c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:58.423764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e97ab493-2062-4a41-bcff-85d6b4fdc99c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:58.429337 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e97ab493-2062-4a41-bcff-85d6b4fdc99c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:58.431062 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e97ab493-2062-4a41-bcff-85d6b4fdc99c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1740 microversion: 2.20 time: 0.731194 Jul 25 13:12:58.441259 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2790/5647] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:57 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1740 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:12:58.672425 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-31461d0e-da4d-482c-aead-a67a60f75e30 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:12:58.704801 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-31461d0e-da4d-482c-aead-a67a60f75e30 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1278 microversion: 2.1 time: 1.185817 Jul 25 13:12:58.706546 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2858/5648] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:57 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1278 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:12:59.469899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b0eaf035-c64e-4e15-a3b3-2ccc6525c133 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:59.470857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b0eaf035-c64e-4e15-a3b3-2ccc6525c133 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:59.498487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b0eaf035-c64e-4e15-a3b3-2ccc6525c133 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:59.499191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b0eaf035-c64e-4e15-a3b3-2ccc6525c133 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:59.500490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b0eaf035-c64e-4e15-a3b3-2ccc6525c133 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:59.501226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b0eaf035-c64e-4e15-a3b3-2ccc6525c133 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:59.729103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3f45d695-93c4-4e2b-bdf7-3195584e0169 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:12:59.729781 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3f45d695-93c4-4e2b-bdf7-3195584e0169 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:12:59.743392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f45d695-93c4-4e2b-bdf7-3195584e0169 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:59.744227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f45d695-93c4-4e2b-bdf7-3195584e0169 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:12:59.744962 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f45d695-93c4-4e2b-bdf7-3195584e0169 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:12:59.745408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f45d695-93c4-4e2b-bdf7-3195584e0169 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:00.194050 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b0eaf035-c64e-4e15-a3b3-2ccc6525c133 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:00.207323 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b0eaf035-c64e-4e15-a3b3-2ccc6525c133 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:00.213112 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b0eaf035-c64e-4e15-a3b3-2ccc6525c133 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:00.214625 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b0eaf035-c64e-4e15-a3b3-2ccc6525c133 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1722 microversion: 2.20 time: 0.753187 Jul 25 13:13:00.218838 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2791/5649] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:12:59 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1722 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:13:00.387283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3f45d695-93c4-4e2b-bdf7-3195584e0169 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:00.412729 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3f45d695-93c4-4e2b-bdf7-3195584e0169 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1278 microversion: 2.1 time: 0.685400 Jul 25 13:13:00.415288 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2859/5650] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:12:59 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1278 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:13:01.006382 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-db18f98d-fcbd-4762-9165-24351f572e19 req-e102a1af-4c52-4d1e-9b3b-3ff74d10d7cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffd02cb-a0ad-4b1f-b129-6fee94dc57af", "name": "network-vif-unplugged", "status": "completed", "tag": "f70aacb3-9955-48b6-92e4-b936a8bc527b"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:13:01.028716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-db18f98d-fcbd-4762-9165-24351f572e19 req-e102a1af-4c52-4d1e-9b3b-3ff74d10d7cc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:01.029177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-db18f98d-fcbd-4762-9165-24351f572e19 req-e102a1af-4c52-4d1e-9b3b-3ff74d10d7cc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:01.060037 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-db18f98d-fcbd-4762-9165-24351f572e19 req-e102a1af-4c52-4d1e-9b3b-3ff74d10d7cc service nova] Creating event network-vif-unplugged:f70aacb3-9955-48b6-92e4-b936a8bc527b for instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af on n-h2-848886-15 Jul 25 13:13:01.069541 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-db18f98d-fcbd-4762-9165-24351f572e19 req-e102a1af-4c52-4d1e-9b3b-3ff74d10d7cc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066845 Jul 25 13:13:01.080904 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2792/5651] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:13:01.242999 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b3deb6f4-1b20-4983-bd57-33739890ac46 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:01.243681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b3deb6f4-1b20-4983-bd57-33739890ac46 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:01.258286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b3deb6f4-1b20-4983-bd57-33739890ac46 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:01.259206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b3deb6f4-1b20-4983-bd57-33739890ac46 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:01.260178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b3deb6f4-1b20-4983-bd57-33739890ac46 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:01.260870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b3deb6f4-1b20-4983-bd57-33739890ac46 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:01.437818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ec08aea4-5f89-4537-9db6-8663524e20e0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:01.439557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ec08aea4-5f89-4537-9db6-8663524e20e0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:01.452284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec08aea4-5f89-4537-9db6-8663524e20e0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:01.452764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec08aea4-5f89-4537-9db6-8663524e20e0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:01.465599 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec08aea4-5f89-4537-9db6-8663524e20e0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:01.466383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec08aea4-5f89-4537-9db6-8663524e20e0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:02.204173 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ec08aea4-5f89-4537-9db6-8663524e20e0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:02.220351 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ec08aea4-5f89-4537-9db6-8663524e20e0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1266 microversion: 2.1 time: 0.785725 Jul 25 13:13:02.244733 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2793/5652] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:13:01 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1266 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:13:02.256787 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b3deb6f4-1b20-4983-bd57-33739890ac46 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:02.271172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b3deb6f4-1b20-4983-bd57-33739890ac46 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:02.302648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b3deb6f4-1b20-4983-bd57-33739890ac46 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:02.304030 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b3deb6f4-1b20-4983-bd57-33739890ac46 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1722 microversion: 2.20 time: 1.065220 Jul 25 13:13:02.305640 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2860/5653] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:01 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1722 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:13:03.250501 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1d759d57-94fe-4942-8d37-7a102a835afe tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:03.251800 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1d759d57-94fe-4942-8d37-7a102a835afe tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:03.267401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d759d57-94fe-4942-8d37-7a102a835afe tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:03.269127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d759d57-94fe-4942-8d37-7a102a835afe tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:03.273730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d759d57-94fe-4942-8d37-7a102a835afe tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:03.274269 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d759d57-94fe-4942-8d37-7a102a835afe tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:03.331783 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ebf4e745-f713-49a2-bfe5-e3e74a3d5562 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:03.332414 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ebf4e745-f713-49a2-bfe5-e3e74a3d5562 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:03.350356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ebf4e745-f713-49a2-bfe5-e3e74a3d5562 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:03.351142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ebf4e745-f713-49a2-bfe5-e3e74a3d5562 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:03.354281 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ebf4e745-f713-49a2-bfe5-e3e74a3d5562 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:03.355703 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ebf4e745-f713-49a2-bfe5-e3e74a3d5562 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:03.842872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1d759d57-94fe-4942-8d37-7a102a835afe tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:03.847969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ebf4e745-f713-49a2-bfe5-e3e74a3d5562 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:03.866246 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1d759d57-94fe-4942-8d37-7a102a835afe tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1266 microversion: 2.1 time: 0.626653 Jul 25 13:13:03.868125 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ebf4e745-f713-49a2-bfe5-e3e74a3d5562 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:03.884730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ebf4e745-f713-49a2-bfe5-e3e74a3d5562 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:03.885345 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2794/5654] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:13:03 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1266 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:13:03.886901 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ebf4e745-f713-49a2-bfe5-e3e74a3d5562 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1665 microversion: 2.20 time: 0.559405 Jul 25 13:13:03.888795 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2861/5655] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:03 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1665 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:13:03.913607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f06cea0b-d337-41cd-8274-8b966b613588 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ae593d4-2299-45ec-9765-d3fb5d86acc5"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:13:03.916260 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f06cea0b-d337-41cd-8274-8b966b613588 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:03.929507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f06cea0b-d337-41cd-8274-8b966b613588 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:03.931796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f06cea0b-d337-41cd-8274-8b966b613588 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:03.933334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f06cea0b-d337-41cd-8274-8b966b613588 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:03.934328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f06cea0b-d337-41cd-8274-8b966b613588 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:04.496274 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f06cea0b-d337-41cd-8274-8b966b613588 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "POST /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.586601 Jul 25 13:13:04.498210 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2795/5656] 10.222.0.49 () {62 vars in 1364 bytes} [Mon Jul 25 13:13:03 2022] POST /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/os-volume_attachments => generated 188 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:13:04.786356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d201f54b-df0d-43e0-b590-23d7983dd324 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:13:04.787798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d201f54b-df0d-43e0-b590-23d7983dd324 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:04.801648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d201f54b-df0d-43e0-b590-23d7983dd324 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:04.802407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d201f54b-df0d-43e0-b590-23d7983dd324 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:04.803511 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d201f54b-df0d-43e0-b590-23d7983dd324 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:04.804207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d201f54b-df0d-43e0-b590-23d7983dd324 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:04.908638 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d793bc60-24f7-4b7d-90c6-384e011b4fab tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:04.915643 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d793bc60-24f7-4b7d-90c6-384e011b4fab tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:04.943282 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d793bc60-24f7-4b7d-90c6-384e011b4fab tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:04.943863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d793bc60-24f7-4b7d-90c6-384e011b4fab tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:04.945170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d793bc60-24f7-4b7d-90c6-384e011b4fab tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:04.945780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d793bc60-24f7-4b7d-90c6-384e011b4fab tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:05.059032 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d201f54b-df0d-43e0-b590-23d7983dd324 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "POST /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/action" status: 202 len: 0 microversion: 2.20 time: 0.280874 Jul 25 13:13:05.065255 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2862/5657] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Jul 25 13:13:04 2022] POST /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:13:05.085275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f1ff12b9-77ee-4b9c-9f8d-7d8dbd914818 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:05.088600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f1ff12b9-77ee-4b9c-9f8d-7d8dbd914818 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:05.109383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f1ff12b9-77ee-4b9c-9f8d-7d8dbd914818 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:05.109870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f1ff12b9-77ee-4b9c-9f8d-7d8dbd914818 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:05.111401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f1ff12b9-77ee-4b9c-9f8d-7d8dbd914818 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:05.112090 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f1ff12b9-77ee-4b9c-9f8d-7d8dbd914818 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:05.544889 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d793bc60-24f7-4b7d-90c6-384e011b4fab tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:05.554175 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d793bc60-24f7-4b7d-90c6-384e011b4fab tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1266 microversion: 2.1 time: 0.667015 Jul 25 13:13:05.562558 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2796/5658] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:13:04 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1266 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:13:05.660803 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f1ff12b9-77ee-4b9c-9f8d-7d8dbd914818 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:05.680428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f1ff12b9-77ee-4b9c-9f8d-7d8dbd914818 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:05.681995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f1ff12b9-77ee-4b9c-9f8d-7d8dbd914818 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:05.683343 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f1ff12b9-77ee-4b9c-9f8d-7d8dbd914818 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1751 microversion: 2.20 time: 0.616664 Jul 25 13:13:05.684009 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2863/5659] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:05 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1751 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:13:06.585759 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-063a5be1-e7fd-4b40-92cb-54352777dcc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:06.587070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-063a5be1-e7fd-4b40-92cb-54352777dcc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:06.601946 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-063a5be1-e7fd-4b40-92cb-54352777dcc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:06.603868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-063a5be1-e7fd-4b40-92cb-54352777dcc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:06.608494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-063a5be1-e7fd-4b40-92cb-54352777dcc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:06.609795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-063a5be1-e7fd-4b40-92cb-54352777dcc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:06.707176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-51fc888d-8445-4a73-bb48-8af52e05e37a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:06.707800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-51fc888d-8445-4a73-bb48-8af52e05e37a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:06.716702 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-51fc888d-8445-4a73-bb48-8af52e05e37a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:06.717165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-51fc888d-8445-4a73-bb48-8af52e05e37a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:06.731102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-51fc888d-8445-4a73-bb48-8af52e05e37a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:06.731837 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-51fc888d-8445-4a73-bb48-8af52e05e37a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:07.786650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-063a5be1-e7fd-4b40-92cb-54352777dcc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:07.799283 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-063a5be1-e7fd-4b40-92cb-54352777dcc1 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1266 microversion: 2.1 time: 1.219449 Jul 25 13:13:07.799910 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2797/5660] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:13:06 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1266 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:13:07.984565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-51fc888d-8445-4a73-bb48-8af52e05e37a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:08.013704 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-51fc888d-8445-4a73-bb48-8af52e05e37a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:08.015603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-51fc888d-8445-4a73-bb48-8af52e05e37a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:08.017073 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-51fc888d-8445-4a73-bb48-8af52e05e37a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1751 microversion: 2.20 time: 1.313939 Jul 25 13:13:08.017639 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2864/5661] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:06 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1751 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:13:08.835471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4862fe20-c6f7-45bc-8453-016d112a895a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:08.836344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4862fe20-c6f7-45bc-8453-016d112a895a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:08.862167 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4862fe20-c6f7-45bc-8453-016d112a895a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:08.862644 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4862fe20-c6f7-45bc-8453-016d112a895a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:08.863487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4862fe20-c6f7-45bc-8453-016d112a895a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:08.863943 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4862fe20-c6f7-45bc-8453-016d112a895a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:09.043319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2a25ceba-3f74-4045-b32b-66807a20eef9 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:09.043959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2a25ceba-3f74-4045-b32b-66807a20eef9 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:09.056455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a25ceba-3f74-4045-b32b-66807a20eef9 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:09.056917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a25ceba-3f74-4045-b32b-66807a20eef9 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:09.057720 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a25ceba-3f74-4045-b32b-66807a20eef9 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:09.058253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a25ceba-3f74-4045-b32b-66807a20eef9 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:09.400903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4862fe20-c6f7-45bc-8453-016d112a895a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:09.409080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:13:09.417546 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4862fe20-c6f7-45bc-8453-016d112a895a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1266 microversion: 2.1 time: 0.585689 Jul 25 13:13:09.421430 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2798/5662] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:13:08 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1266 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:13:09.557183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2a25ceba-3f74-4045-b32b-66807a20eef9 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:09.570095 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2a25ceba-3f74-4045-b32b-66807a20eef9 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:09.576850 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2a25ceba-3f74-4045-b32b-66807a20eef9 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:09.582495 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2a25ceba-3f74-4045-b32b-66807a20eef9 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1753 microversion: 2.20 time: 0.543036 Jul 25 13:13:09.586832 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2865/5663] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:09 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1753 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:13:10.445479 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-791b4898-d32d-4f47-beef-fd3b01ba827a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:10.446884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-791b4898-d32d-4f47-beef-fd3b01ba827a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:10.458200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=46 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:13:10.466638 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-791b4898-d32d-4f47-beef-fd3b01ba827a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:10.467380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-791b4898-d32d-4f47-beef-fd3b01ba827a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:10.468390 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-791b4898-d32d-4f47-beef-fd3b01ba827a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:10.468998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-791b4898-d32d-4f47-beef-fd3b01ba827a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:10.619522 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6c70c89c-e52b-4112-8351-62f624a17ec6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:10.621089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6c70c89c-e52b-4112-8351-62f624a17ec6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:10.641536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c70c89c-e52b-4112-8351-62f624a17ec6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:10.642759 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c70c89c-e52b-4112-8351-62f624a17ec6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:10.644094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c70c89c-e52b-4112-8351-62f624a17ec6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:10.645035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c70c89c-e52b-4112-8351-62f624a17ec6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:11.295515 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6c70c89c-e52b-4112-8351-62f624a17ec6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:11.305231 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6c70c89c-e52b-4112-8351-62f624a17ec6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:11.306957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6c70c89c-e52b-4112-8351-62f624a17ec6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:11.308393 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6c70c89c-e52b-4112-8351-62f624a17ec6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1753 microversion: 2.20 time: 0.694309 Jul 25 13:13:11.309476 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2866/5664] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:10 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1753 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:13:11.319301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-791b4898-d32d-4f47-beef-fd3b01ba827a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:11.331439 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-791b4898-d32d-4f47-beef-fd3b01ba827a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1266 microversion: 2.1 time: 0.887964 Jul 25 13:13:11.333223 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2799/5665] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:13:10 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1266 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:13:12.333732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d12f683e-9b02-454c-9b93-adc060da6d3c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:12.334460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d12f683e-9b02-454c-9b93-adc060da6d3c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:12.353176 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9f89c64e-1f97-483e-8e9a-3d701c1641b2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:12.353815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9f89c64e-1f97-483e-8e9a-3d701c1641b2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:12.366477 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9f89c64e-1f97-483e-8e9a-3d701c1641b2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:12.367227 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9f89c64e-1f97-483e-8e9a-3d701c1641b2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:12.367586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d12f683e-9b02-454c-9b93-adc060da6d3c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:12.368360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d12f683e-9b02-454c-9b93-adc060da6d3c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:12.369496 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9f89c64e-1f97-483e-8e9a-3d701c1641b2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:12.370995 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9f89c64e-1f97-483e-8e9a-3d701c1641b2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:12.371316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d12f683e-9b02-454c-9b93-adc060da6d3c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:12.371950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d12f683e-9b02-454c-9b93-adc060da6d3c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:12.946922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9f89c64e-1f97-483e-8e9a-3d701c1641b2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:12.958010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d12f683e-9b02-454c-9b93-adc060da6d3c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:12.988812 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9f89c64e-1f97-483e-8e9a-3d701c1641b2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1266 microversion: 2.1 time: 0.639472 Jul 25 13:13:12.989427 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2800/5666] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:13:12 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1266 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:13:12.992058 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d12f683e-9b02-454c-9b93-adc060da6d3c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:13.003066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d12f683e-9b02-454c-9b93-adc060da6d3c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:13.009811 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d12f683e-9b02-454c-9b93-adc060da6d3c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1753 microversion: 2.20 time: 0.680055 Jul 25 13:13:13.011160 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-35429b95-8f08-4dfc-9893-66324ef7f619 req-48828485-ecbf-46b4-b57b-7deb46d407a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "592f6a73-dce4-4a04-8aa8-c14fe0e324e2", "name": "network-vif-plugged", "status": "completed", "tag": "19542a94-8da7-43f4-b45d-cf5f52f5698d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:13:13.013155 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2867/5667] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:12 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1753 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:13:13.034710 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-35429b95-8f08-4dfc-9893-66324ef7f619 req-48828485-ecbf-46b4-b57b-7deb46d407a1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:13.035456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-35429b95-8f08-4dfc-9893-66324ef7f619 req-48828485-ecbf-46b4-b57b-7deb46d407a1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:13.074836 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-35429b95-8f08-4dfc-9893-66324ef7f619 req-48828485-ecbf-46b4-b57b-7deb46d407a1 service nova] Creating event network-vif-plugged:19542a94-8da7-43f4-b45d-cf5f52f5698d for instance 592f6a73-dce4-4a04-8aa8-c14fe0e324e2 on n-h1-848886-15 Jul 25 13:13:13.091727 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-35429b95-8f08-4dfc-9893-66324ef7f619 req-48828485-ecbf-46b4-b57b-7deb46d407a1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093930 Jul 25 13:13:13.092645 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2801/5668] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:13:14.008753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f1a411ad-b1f6-4678-94f4-7209b01e14a9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:14.009389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f1a411ad-b1f6-4678-94f4-7209b01e14a9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:14.012416 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:13:14.023857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f1a411ad-b1f6-4678-94f4-7209b01e14a9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:14.024319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f1a411ad-b1f6-4678-94f4-7209b01e14a9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:14.038443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fe2358e6-7f34-4d60-a8e0-d21008d74e63 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:14.039173 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fe2358e6-7f34-4d60-a8e0-d21008d74e63 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:14.043456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f1a411ad-b1f6-4678-94f4-7209b01e14a9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:14.043931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f1a411ad-b1f6-4678-94f4-7209b01e14a9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:14.059893 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fe2358e6-7f34-4d60-a8e0-d21008d74e63 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:14.060359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fe2358e6-7f34-4d60-a8e0-d21008d74e63 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:14.061168 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fe2358e6-7f34-4d60-a8e0-d21008d74e63 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:14.061634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fe2358e6-7f34-4d60-a8e0-d21008d74e63 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:14.623971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f1a411ad-b1f6-4678-94f4-7209b01e14a9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:14.632930 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f1a411ad-b1f6-4678-94f4-7209b01e14a9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1266 microversion: 2.1 time: 0.627925 Jul 25 13:13:14.639896 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fe2358e6-7f34-4d60-a8e0-d21008d74e63 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:14.652401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fe2358e6-7f34-4d60-a8e0-d21008d74e63 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:14.656541 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2868/5669] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:13:14 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1266 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:13:14.666931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fe2358e6-7f34-4d60-a8e0-d21008d74e63 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:14.668486 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fe2358e6-7f34-4d60-a8e0-d21008d74e63 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1753 microversion: 2.20 time: 0.634606 Jul 25 13:13:14.669903 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2802/5670] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:14 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1753 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:13:15.678444 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7ccc763e-c4c4-4f5f-8910-983470549005 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:15.679241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7ccc763e-c4c4-4f5f-8910-983470549005 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:15.691277 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ccc763e-c4c4-4f5f-8910-983470549005 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:15.700672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8bad0f43-ca00-4f51-894c-41db8b01d3ef tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:15.701388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8bad0f43-ca00-4f51-894c-41db8b01d3ef tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:15.716341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ccc763e-c4c4-4f5f-8910-983470549005 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:15.724098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ccc763e-c4c4-4f5f-8910-983470549005 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:15.724647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ccc763e-c4c4-4f5f-8910-983470549005 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:15.728590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bad0f43-ca00-4f51-894c-41db8b01d3ef tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:15.732297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bad0f43-ca00-4f51-894c-41db8b01d3ef tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:15.739151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bad0f43-ca00-4f51-894c-41db8b01d3ef tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:15.739972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bad0f43-ca00-4f51-894c-41db8b01d3ef tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:16.145357 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7ccc763e-c4c4-4f5f-8910-983470549005 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:16.160085 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7ccc763e-c4c4-4f5f-8910-983470549005 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1452 microversion: 2.1 time: 0.486524 Jul 25 13:13:16.164651 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2869/5671] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:13:15 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1452 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:13:16.185729 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-71759025-218f-4d84-993e-ae48137f59ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:16.186745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-71759025-218f-4d84-993e-ae48137f59ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:16.200192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71759025-218f-4d84-993e-ae48137f59ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:16.201012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71759025-218f-4d84-993e-ae48137f59ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:16.202822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71759025-218f-4d84-993e-ae48137f59ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:16.205949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71759025-218f-4d84-993e-ae48137f59ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:16.324009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8bad0f43-ca00-4f51-894c-41db8b01d3ef tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:16.345233 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8bad0f43-ca00-4f51-894c-41db8b01d3ef tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:16.347642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8bad0f43-ca00-4f51-894c-41db8b01d3ef tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:16.351916 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8bad0f43-ca00-4f51-894c-41db8b01d3ef tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1753 microversion: 2.20 time: 0.656564 Jul 25 13:13:16.352723 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2803/5672] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:15 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1753 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:13:16.841226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-71759025-218f-4d84-993e-ae48137f59ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:16.858206 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-71759025-218f-4d84-993e-ae48137f59ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1452 microversion: 2.1 time: 0.676645 Jul 25 13:13:16.861315 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2870/5673] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:13:16 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1452 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:13:17.380351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0e6b7cf3-939b-42bf-9397-6824900b8a02 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:17.382511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0e6b7cf3-939b-42bf-9397-6824900b8a02 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:17.400081 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e6b7cf3-939b-42bf-9397-6824900b8a02 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:17.404843 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e6b7cf3-939b-42bf-9397-6824900b8a02 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:17.406536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e6b7cf3-939b-42bf-9397-6824900b8a02 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:17.414315 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e6b7cf3-939b-42bf-9397-6824900b8a02 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:17.802658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0e6b7cf3-939b-42bf-9397-6824900b8a02 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:17.812683 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0e6b7cf3-939b-42bf-9397-6824900b8a02 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:17.814670 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0e6b7cf3-939b-42bf-9397-6824900b8a02 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:17.816126 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0e6b7cf3-939b-42bf-9397-6824900b8a02 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1753 microversion: 2.20 time: 0.440434 Jul 25 13:13:17.817418 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2804/5674] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:17 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1753 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:13:18.839272 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8697d583-6988-443e-9b57-da94af1e26e8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:18.839886 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8697d583-6988-443e-9b57-da94af1e26e8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:18.847306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8697d583-6988-443e-9b57-da94af1e26e8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:18.848127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8697d583-6988-443e-9b57-da94af1e26e8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:18.849135 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8697d583-6988-443e-9b57-da94af1e26e8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:18.850017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8697d583-6988-443e-9b57-da94af1e26e8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:19.374323 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8697d583-6988-443e-9b57-da94af1e26e8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:19.376688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:13:19.394800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8697d583-6988-443e-9b57-da94af1e26e8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:19.398268 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8697d583-6988-443e-9b57-da94af1e26e8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:19.404209 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8697d583-6988-443e-9b57-da94af1e26e8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1809 microversion: 2.20 time: 0.564378 Jul 25 13:13:19.405214 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2871/5675] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:18 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1809 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:13:20.242488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-12b69cf8-69dd-48d1-b99f-586a239285cc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:20.243017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-12b69cf8-69dd-48d1-b99f-586a239285cc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: 66c72a4d-b9fa-4e23-a3cb-0e462058acd0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:20.261693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12b69cf8-69dd-48d1-b99f-586a239285cc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:20.262485 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12b69cf8-69dd-48d1-b99f-586a239285cc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:20.263224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12b69cf8-69dd-48d1-b99f-586a239285cc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:20.263702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-12b69cf8-69dd-48d1-b99f-586a239285cc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:20.317553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-12b69cf8-69dd-48d1-b99f-586a239285cc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: 66c72a4d-b9fa-4e23-a3cb-0e462058acd0] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:13:20.434557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-34b479b1-2c03-4896-a60d-5b4b3228aaa8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:20.436127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-34b479b1-2c03-4896-a60d-5b4b3228aaa8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:20.458407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-34b479b1-2c03-4896-a60d-5b4b3228aaa8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:20.461435 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-34b479b1-2c03-4896-a60d-5b4b3228aaa8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:20.463259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-34b479b1-2c03-4896-a60d-5b4b3228aaa8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:20.465171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-34b479b1-2c03-4896-a60d-5b4b3228aaa8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:20.486954 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-12b69cf8-69dd-48d1-b99f-586a239285cc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "DELETE /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0" status: 204 len: 0 microversion: 2.1 time: 0.248595 Jul 25 13:13:20.487886 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2805/5676] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:13:20 2022] DELETE /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:13:20.496727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b7438918-0811-45a8-b442-1d374074e85c tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:20.497455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b7438918-0811-45a8-b442-1d374074e85c tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: 66c72a4d-b9fa-4e23-a3cb-0e462058acd0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:20.510868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b7438918-0811-45a8-b442-1d374074e85c tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:20.511337 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b7438918-0811-45a8-b442-1d374074e85c tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:20.514381 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b7438918-0811-45a8-b442-1d374074e85c tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:20.515090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b7438918-0811-45a8-b442-1d374074e85c tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:21.190601 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b7438918-0811-45a8-b442-1d374074e85c tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:21.203496 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b7438918-0811-45a8-b442-1d374074e85c tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0" status: 200 len: 1552 microversion: 2.1 time: 0.711128 Jul 25 13:13:21.212236 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2806/5677] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:13:20 2022] GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0 => generated 1552 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:13:21.450263 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-34b479b1-2c03-4896-a60d-5b4b3228aaa8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:21.467774 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-34b479b1-2c03-4896-a60d-5b4b3228aaa8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:21.469953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-34b479b1-2c03-4896-a60d-5b4b3228aaa8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:21.473810 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-34b479b1-2c03-4896-a60d-5b4b3228aaa8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1809 microversion: 2.20 time: 1.044661 Jul 25 13:13:21.477300 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2872/5678] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:20 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1809 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:13:22.233085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bd93ae3d-260f-4cc7-a648-ab047b7e240d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:22.233792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bd93ae3d-260f-4cc7-a648-ab047b7e240d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: 66c72a4d-b9fa-4e23-a3cb-0e462058acd0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:22.253789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd93ae3d-260f-4cc7-a648-ab047b7e240d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:22.254473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd93ae3d-260f-4cc7-a648-ab047b7e240d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:22.255602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd93ae3d-260f-4cc7-a648-ab047b7e240d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:22.256161 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bd93ae3d-260f-4cc7-a648-ab047b7e240d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:22.503176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-45d9b5b4-2310-4383-b1f9-ec295c91a8bd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:22.505299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-45d9b5b4-2310-4383-b1f9-ec295c91a8bd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:22.537058 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45d9b5b4-2310-4383-b1f9-ec295c91a8bd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:22.549247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45d9b5b4-2310-4383-b1f9-ec295c91a8bd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:22.550775 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45d9b5b4-2310-4383-b1f9-ec295c91a8bd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:22.551447 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45d9b5b4-2310-4383-b1f9-ec295c91a8bd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:24.220173 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-45d9b5b4-2310-4383-b1f9-ec295c91a8bd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:24.235684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-45d9b5b4-2310-4383-b1f9-ec295c91a8bd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:24.238737 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-45d9b5b4-2310-4383-b1f9-ec295c91a8bd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:24.240317 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-45d9b5b4-2310-4383-b1f9-ec295c91a8bd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1809 microversion: 2.20 time: 1.741397 Jul 25 13:13:24.243804 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2873/5679] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:22 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1809 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:13:24.486776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bd93ae3d-260f-4cc7-a648-ab047b7e240d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:24.521336 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bd93ae3d-260f-4cc7-a648-ab047b7e240d tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0" status: 200 len: 1552 microversion: 2.1 time: 2.289158 Jul 25 13:13:24.524408 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2807/5680] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:13:22 2022] GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0 => generated 1552 bytes in 2296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:13:25.277629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1ba2503b-ff40-4441-88de-2ef96fd42c96 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:25.278994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1ba2503b-ff40-4441-88de-2ef96fd42c96 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:25.295003 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ba2503b-ff40-4441-88de-2ef96fd42c96 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:25.297242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ba2503b-ff40-4441-88de-2ef96fd42c96 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:25.299401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ba2503b-ff40-4441-88de-2ef96fd42c96 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:25.302509 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ba2503b-ff40-4441-88de-2ef96fd42c96 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:25.544493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b9a1f780-1be7-4e85-82b1-5c1a1f3a8e93 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:25.545742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b9a1f780-1be7-4e85-82b1-5c1a1f3a8e93 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: 66c72a4d-b9fa-4e23-a3cb-0e462058acd0] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:25.556748 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b9a1f780-1be7-4e85-82b1-5c1a1f3a8e93 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:25.564213 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b9a1f780-1be7-4e85-82b1-5c1a1f3a8e93 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:25.565450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b9a1f780-1be7-4e85-82b1-5c1a1f3a8e93 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:25.566161 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b9a1f780-1be7-4e85-82b1-5c1a1f3a8e93 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:26.507880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b9a1f780-1be7-4e85-82b1-5c1a1f3a8e93 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:26.518432 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b9a1f780-1be7-4e85-82b1-5c1a1f3a8e93 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0" status: 200 len: 1552 microversion: 2.1 time: 0.978194 Jul 25 13:13:26.525405 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2808/5681] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:13:25 2022] GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0 => generated 1552 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:13:26.751671 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-e742483e-dd1c-4e57-90e1-b13df39ddd27 req-a042d718-998a-41d8-ad49-26b43185abe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c72a4d-b9fa-4e23-a3cb-0e462058acd0", "name": "network-vif-deleted", "tag": "397820d7-11b7-44df-9253-573fe363b8ac"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:13:26.756845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1ba2503b-ff40-4441-88de-2ef96fd42c96 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:26.777374 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1ba2503b-ff40-4441-88de-2ef96fd42c96 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:26.780241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1ba2503b-ff40-4441-88de-2ef96fd42c96 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:26.782474 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1ba2503b-ff40-4441-88de-2ef96fd42c96 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1809 microversion: 2.20 time: 1.509793 Jul 25 13:13:26.788018 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2874/5682] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:25 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1809 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:13:26.835556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e742483e-dd1c-4e57-90e1-b13df39ddd27 req-a042d718-998a-41d8-ad49-26b43185abe6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:26.837578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e742483e-dd1c-4e57-90e1-b13df39ddd27 req-a042d718-998a-41d8-ad49-26b43185abe6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:26.916926 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-e742483e-dd1c-4e57-90e1-b13df39ddd27 req-a042d718-998a-41d8-ad49-26b43185abe6 service nova] Creating event network-vif-deleted:397820d7-11b7-44df-9253-573fe363b8ac for instance 66c72a4d-b9fa-4e23-a3cb-0e462058acd0 on n-h2-848886-15 Jul 25 13:13:26.930516 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-e742483e-dd1c-4e57-90e1-b13df39ddd27 req-a042d718-998a-41d8-ad49-26b43185abe6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183859 Jul 25 13:13:26.934295 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2809/5683] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:13:27.550457 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8f3af8b8-e033-4d66-b7c7-0655187f293a tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:27.551241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8f3af8b8-e033-4d66-b7c7-0655187f293a tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: 66c72a4d-b9fa-4e23-a3cb-0e462058acd0] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:27.570273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8f3af8b8-e033-4d66-b7c7-0655187f293a tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:27.571700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8f3af8b8-e033-4d66-b7c7-0655187f293a tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:27.577749 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8f3af8b8-e033-4d66-b7c7-0655187f293a tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:27.578819 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8f3af8b8-e033-4d66-b7c7-0655187f293a tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:27.623806 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8f3af8b8-e033-4d66-b7c7-0655187f293a tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:27.624640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8f3af8b8-e033-4d66-b7c7-0655187f293a tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:27.625333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-8f3af8b8-e033-4d66-b7c7-0655187f293a tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lazy-loading 'fault' on Instance uuid 66c72a4d-b9fa-4e23-a3cb-0e462058acd0 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:13:27.753000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8f3af8b8-e033-4d66-b7c7-0655187f293a tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:27.783828 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8f3af8b8-e033-4d66-b7c7-0655187f293a tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0" status: 200 len: 1338 microversion: 2.1 time: 0.238996 Jul 25 13:13:27.802357 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2875/5684] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:13:27 2022] GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0 => generated 1338 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:13:27.832634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8794b9d9-363a-4147-b2ea-134c0e212c4a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:27.844001 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8794b9d9-363a-4147-b2ea-134c0e212c4a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:27.874566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8794b9d9-363a-4147-b2ea-134c0e212c4a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:27.877732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8794b9d9-363a-4147-b2ea-134c0e212c4a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:27.879988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8794b9d9-363a-4147-b2ea-134c0e212c4a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:27.881982 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8794b9d9-363a-4147-b2ea-134c0e212c4a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:28.498593 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8794b9d9-363a-4147-b2ea-134c0e212c4a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:28.520821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8794b9d9-363a-4147-b2ea-134c0e212c4a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:28.526504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8794b9d9-363a-4147-b2ea-134c0e212c4a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:28.527993 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8794b9d9-363a-4147-b2ea-134c0e212c4a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1809 microversion: 2.20 time: 0.719870 Jul 25 13:13:28.555570 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2810/5685] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:27 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1809 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:13:28.823302 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-073bb620-a1da-49b5-b652-80e655b04cb6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:28.824595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-073bb620-a1da-49b5-b652-80e655b04cb6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: 66c72a4d-b9fa-4e23-a3cb-0e462058acd0] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:28.833942 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-073bb620-a1da-49b5-b652-80e655b04cb6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:28.834909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-073bb620-a1da-49b5-b652-80e655b04cb6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:28.836090 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-073bb620-a1da-49b5-b652-80e655b04cb6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:28.836699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-073bb620-a1da-49b5-b652-80e655b04cb6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:28.856243 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-073bb620-a1da-49b5-b652-80e655b04cb6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] HTTP exception thrown: Instance 66c72a4d-b9fa-4e23-a3cb-0e462058acd0 could not be found. Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-073bb620-a1da-49b5-b652-80e655b04cb6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Request method failure captured: Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0 HTTP/1.1 Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pZRNn0KTk3WhXB5GhdHQEO_V4HgelAR2fN1Z4OIFqGbhG8R37wlvJdqTn5LNmMrTBJXwUTFUCGgeLIdhJR08aRo4vRqP1YMFeKqmw43Uz2G-Rghw7NvOK3ejh1axAhJRQ58GPrG-V4tIUxFMHyO2nP4Q0z6rGtW8Q7pZso1tvUQYDk Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 8d36edc3feda482686f9202892538c87 Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestNetworkBasicOps-1905588592 Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8d36edc3feda482686f9202892538c87", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8d36edc3feda482686f9202892538c87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8d36edc3feda482686f9202892538c87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8d36edc3feda482686f9202892538c87"}]}] Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestNetworkBasicOps-1905588592 Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 8d36edc3feda482686f9202892538c87 Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestNetworkBasicOps-1905588592 Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestNetworkBasicOps-1905588592-project Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: d165e33e297f4bd8a37c1f65aa35549d Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestNetworkBasicOps-1905588592-project Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 66c72a4d-b9fa-4e23-a3cb-0e462058acd0 could not be found. Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '66c72a4d-b9fa-4e23-a3cb-0e462058acd0'} Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66c72a4d-b9fa-4e23-a3cb-0e462058acd0 could not be found. Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66c72a4d-b9fa-4e23-a3cb-0e462058acd0 could not be found. Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:13:28.860222 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:13:28.866449 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:13:28.866449 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:13:28.866449 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:13:28.866449 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:13:28.866449 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:13:28.866449 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66c72a4d-b9fa-4e23-a3cb-0e462058acd0 could not be found. Jul 25 13:13:28.866449 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:13:28.869527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-073bb620-a1da-49b5-b652-80e655b04cb6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Returning 404 to user: Instance 66c72a4d-b9fa-4e23-a3cb-0e462058acd0 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:13:28.870968 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-073bb620-a1da-49b5-b652-80e655b04cb6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0" status: 404 len: 111 microversion: 2.1 time: 0.061212 Jul 25 13:13:28.876009 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2876/5686] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:13:28 2022] GET /compute/v2.1/servers/66c72a4d-b9fa-4e23-a3cb-0e462058acd0 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:13:29.062444 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-715d6db8-d175-4db3-856c-4f2eed524fe8 req-2d9cd17e-68a7-43d7-953e-28e48c1fcdc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "592f6a73-dce4-4a04-8aa8-c14fe0e324e2", "tag": "19542a94-8da7-43f4-b45d-cf5f52f5698d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:13:29.099456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-715d6db8-d175-4db3-856c-4f2eed524fe8 req-2d9cd17e-68a7-43d7-953e-28e48c1fcdc5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:29.100720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-715d6db8-d175-4db3-856c-4f2eed524fe8 req-2d9cd17e-68a7-43d7-953e-28e48c1fcdc5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:29.141495 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-715d6db8-d175-4db3-856c-4f2eed524fe8 req-2d9cd17e-68a7-43d7-953e-28e48c1fcdc5 service nova] Creating event network-changed:19542a94-8da7-43f4-b45d-cf5f52f5698d for instance 592f6a73-dce4-4a04-8aa8-c14fe0e324e2 on n-h1-848886-15 Jul 25 13:13:29.150807 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-715d6db8-d175-4db3-856c-4f2eed524fe8 req-2d9cd17e-68a7-43d7-953e-28e48c1fcdc5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092980 Jul 25 13:13:29.156411 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2811/5687] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:13:29.561913 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-783dae0f-0051-48be-9718-d2115a76168a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:29.563092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-783dae0f-0051-48be-9718-d2115a76168a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:29.591827 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-783dae0f-0051-48be-9718-d2115a76168a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:29.592470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-783dae0f-0051-48be-9718-d2115a76168a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:29.593293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-783dae0f-0051-48be-9718-d2115a76168a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:29.593738 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-783dae0f-0051-48be-9718-d2115a76168a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:29.727319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fb26d952-4783-44b6-bc17-c1c833c4de42 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '.version_select at 0x7efcf8bdcf70>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:29.792241 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fb26d952-4783-44b6-bc17-c1c833c4de42 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1655722941" status: 202 len: 0 microversion: 2.1 time: 0.067785 Jul 25 13:13:29.794953 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2812/5688] 10.222.0.49 () {58 vars in 1257 bytes} [Mon Jul 25 13:13:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1655722941 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:13:30.628111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-783dae0f-0051-48be-9718-d2115a76168a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:30.647245 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-783dae0f-0051-48be-9718-d2115a76168a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:30.649269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-783dae0f-0051-48be-9718-d2115a76168a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:30.650837 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-783dae0f-0051-48be-9718-d2115a76168a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1809 microversion: 2.20 time: 1.093139 Jul 25 13:13:30.656828 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2877/5689] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:29 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1809 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:13:31.685629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dc95ab40-096c-4c15-b245-df1ae9c6f075 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:31.687331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dc95ab40-096c-4c15-b245-df1ae9c6f075 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:31.710336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dc95ab40-096c-4c15-b245-df1ae9c6f075 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:31.712273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dc95ab40-096c-4c15-b245-df1ae9c6f075 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:31.713594 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dc95ab40-096c-4c15-b245-df1ae9c6f075 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:31.714365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dc95ab40-096c-4c15-b245-df1ae9c6f075 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:31.999811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dc95ab40-096c-4c15-b245-df1ae9c6f075 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:32.020132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dc95ab40-096c-4c15-b245-df1ae9c6f075 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:32.025111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dc95ab40-096c-4c15-b245-df1ae9c6f075 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:32.026509 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dc95ab40-096c-4c15-b245-df1ae9c6f075 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1809 microversion: 2.20 time: 0.346653 Jul 25 13:13:32.032462 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2813/5690] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:31 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1809 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:13:33.058433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ae947451-1c2f-4673-99b7-b10dfa039fe6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:33.059686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ae947451-1c2f-4673-99b7-b10dfa039fe6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:33.067445 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae947451-1c2f-4673-99b7-b10dfa039fe6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:33.068065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae947451-1c2f-4673-99b7-b10dfa039fe6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:33.068896 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae947451-1c2f-4673-99b7-b10dfa039fe6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:33.069729 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae947451-1c2f-4673-99b7-b10dfa039fe6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:33.231713 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ae947451-1c2f-4673-99b7-b10dfa039fe6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:33.247148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ae947451-1c2f-4673-99b7-b10dfa039fe6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:33.248676 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ae947451-1c2f-4673-99b7-b10dfa039fe6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:33.258320 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ae947451-1c2f-4673-99b7-b10dfa039fe6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1809 microversion: 2.20 time: 0.205391 Jul 25 13:13:33.261666 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2878/5691] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:33 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:13:34.291438 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c0a6e536-cc83-4126-a979-858dfeeacd04 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:34.296383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c0a6e536-cc83-4126-a979-858dfeeacd04 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:34.320537 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0a6e536-cc83-4126-a979-858dfeeacd04 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:34.321580 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0a6e536-cc83-4126-a979-858dfeeacd04 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:34.322808 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0a6e536-cc83-4126-a979-858dfeeacd04 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:34.323564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0a6e536-cc83-4126-a979-858dfeeacd04 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:34.707323 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c0a6e536-cc83-4126-a979-858dfeeacd04 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:34.729042 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c0a6e536-cc83-4126-a979-858dfeeacd04 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:34.731754 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c0a6e536-cc83-4126-a979-858dfeeacd04 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:34.733943 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c0a6e536-cc83-4126-a979-858dfeeacd04 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1809 microversion: 2.20 time: 0.451674 Jul 25 13:13:34.734916 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2814/5692] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:34 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1809 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:13:35.323112 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1b48b083-b996-42bf-a9d4-ab2655f21ef6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:35.324554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1b48b083-b996-42bf-a9d4-ab2655f21ef6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: f5cd4124-73ad-4109-a774-b76ba75ab797] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:35.330917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-495f6430-39a3-4f65-a946-77af41dde895 req-3d0d66d0-59c3-4770-9b32-d87176ad4b2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5cd4124-73ad-4109-a774-b76ba75ab797", "tag": "c07fc42d-c325-4ff7-acd7-7c37f4071fd9"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:13:35.339447 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b48b083-b996-42bf-a9d4-ab2655f21ef6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:35.342442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b48b083-b996-42bf-a9d4-ab2655f21ef6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:35.343564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b48b083-b996-42bf-a9d4-ab2655f21ef6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:35.345030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b48b083-b996-42bf-a9d4-ab2655f21ef6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:35.347950 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-495f6430-39a3-4f65-a946-77af41dde895 req-3d0d66d0-59c3-4770-9b32-d87176ad4b2c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:35.348419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-495f6430-39a3-4f65-a946-77af41dde895 req-3d0d66d0-59c3-4770-9b32-d87176ad4b2c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:35.377927 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-495f6430-39a3-4f65-a946-77af41dde895 req-3d0d66d0-59c3-4770-9b32-d87176ad4b2c service nova] Creating event network-changed:c07fc42d-c325-4ff7-acd7-7c37f4071fd9 for instance f5cd4124-73ad-4109-a774-b76ba75ab797 on n-h1-848886-15 Jul 25 13:13:35.384025 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-495f6430-39a3-4f65-a946-77af41dde895 req-3d0d66d0-59c3-4770-9b32-d87176ad4b2c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057041 Jul 25 13:13:35.385755 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2815/5693] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:13:35.420979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1b48b083-b996-42bf-a9d4-ab2655f21ef6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: f5cd4124-73ad-4109-a774-b76ba75ab797] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:13:35.581333 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1b48b083-b996-42bf-a9d4-ab2655f21ef6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797" status: 204 len: 0 microversion: 2.1 time: 0.262036 Jul 25 13:13:35.583168 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2879/5694] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:13:35 2022] DELETE /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:13:35.593414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0ee59a8c-b039-423c-943f-9033cd8adaa2 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:35.594792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0ee59a8c-b039-423c-943f-9033cd8adaa2 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: f5cd4124-73ad-4109-a774-b76ba75ab797] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:35.602445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ee59a8c-b039-423c-943f-9033cd8adaa2 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:35.605968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ee59a8c-b039-423c-943f-9033cd8adaa2 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:35.611301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ee59a8c-b039-423c-943f-9033cd8adaa2 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:35.612104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ee59a8c-b039-423c-943f-9033cd8adaa2 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:35.761095 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8af70229-d6ad-47b5-850d-7341121e77b6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:35.762556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8af70229-d6ad-47b5-850d-7341121e77b6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:35.773386 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8af70229-d6ad-47b5-850d-7341121e77b6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:35.774959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8af70229-d6ad-47b5-850d-7341121e77b6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:35.776009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8af70229-d6ad-47b5-850d-7341121e77b6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:35.776773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8af70229-d6ad-47b5-850d-7341121e77b6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:35.829924 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0ee59a8c-b039-423c-943f-9033cd8adaa2 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:35.850886 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0ee59a8c-b039-423c-943f-9033cd8adaa2 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797" status: 200 len: 1669 microversion: 2.1 time: 0.259443 Jul 25 13:13:35.851637 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2816/5695] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:13:35 2022] GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797 => generated 1669 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:13:35.969096 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8af70229-d6ad-47b5-850d-7341121e77b6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:35.979700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8af70229-d6ad-47b5-850d-7341121e77b6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:35.981219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8af70229-d6ad-47b5-850d-7341121e77b6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:35.983353 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8af70229-d6ad-47b5-850d-7341121e77b6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1809 microversion: 2.20 time: 0.227916 Jul 25 13:13:35.984390 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2880/5696] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:35 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1809 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:13:36.873450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-53eee73d-f053-460c-b5a9-d0d6a7517b37 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:36.874950 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-53eee73d-f053-460c-b5a9-d0d6a7517b37 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: f5cd4124-73ad-4109-a774-b76ba75ab797] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:36.885821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53eee73d-f053-460c-b5a9-d0d6a7517b37 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:36.887486 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53eee73d-f053-460c-b5a9-d0d6a7517b37 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:36.888566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53eee73d-f053-460c-b5a9-d0d6a7517b37 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:36.889142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-53eee73d-f053-460c-b5a9-d0d6a7517b37 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:36.917376 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:13:37.011517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f5a51e81-44be-4f00-8d2e-df39d7dc6019 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:37.014042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f5a51e81-44be-4f00-8d2e-df39d7dc6019 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:37.023688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5a51e81-44be-4f00-8d2e-df39d7dc6019 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:37.024632 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5a51e81-44be-4f00-8d2e-df39d7dc6019 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:37.027097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5a51e81-44be-4f00-8d2e-df39d7dc6019 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:37.027782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5a51e81-44be-4f00-8d2e-df39d7dc6019 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:37.663340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-53eee73d-f053-460c-b5a9-d0d6a7517b37 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:37.698742 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-53eee73d-f053-460c-b5a9-d0d6a7517b37 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797" status: 200 len: 1669 microversion: 2.1 time: 0.829396 Jul 25 13:13:37.699708 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2817/5697] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:13:36 2022] GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797 => generated 1669 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:13:37.810496 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f5a51e81-44be-4f00-8d2e-df39d7dc6019 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:37.821333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f5a51e81-44be-4f00-8d2e-df39d7dc6019 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:37.841634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f5a51e81-44be-4f00-8d2e-df39d7dc6019 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:37.843306 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f5a51e81-44be-4f00-8d2e-df39d7dc6019 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1809 microversion: 2.20 time: 0.839652 Jul 25 13:13:37.854362 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2881/5698] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:37 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1809 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:13:38.466926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-d9d08c4d-f935-4c82-9455-2263370b28bd req-aba99302-dd8e-40a9-b821-71bbe300a2c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5cd4124-73ad-4109-a774-b76ba75ab797", "name": "network-vif-deleted", "tag": "c07fc42d-c325-4ff7-acd7-7c37f4071fd9"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:13:38.480449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d9d08c4d-f935-4c82-9455-2263370b28bd req-aba99302-dd8e-40a9-b821-71bbe300a2c7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:38.481204 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d9d08c4d-f935-4c82-9455-2263370b28bd req-aba99302-dd8e-40a9-b821-71bbe300a2c7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:38.500183 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-d9d08c4d-f935-4c82-9455-2263370b28bd req-aba99302-dd8e-40a9-b821-71bbe300a2c7 service nova] Creating event network-vif-deleted:c07fc42d-c325-4ff7-acd7-7c37f4071fd9 for instance f5cd4124-73ad-4109-a774-b76ba75ab797 on n-h1-848886-15 Jul 25 13:13:38.508415 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-d9d08c4d-f935-4c82-9455-2263370b28bd req-aba99302-dd8e-40a9-b821-71bbe300a2c7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047919 Jul 25 13:13:38.510078 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2818/5699] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:13:38.736472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-40064ca9-d64a-43ec-8f8b-e7425050b89b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:38.737321 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-40064ca9-d64a-43ec-8f8b-e7425050b89b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: f5cd4124-73ad-4109-a774-b76ba75ab797] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:38.749011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40064ca9-d64a-43ec-8f8b-e7425050b89b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:38.749459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40064ca9-d64a-43ec-8f8b-e7425050b89b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:38.750603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40064ca9-d64a-43ec-8f8b-e7425050b89b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:38.751422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40064ca9-d64a-43ec-8f8b-e7425050b89b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:38.888266 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-16722c07-9b91-4094-ab29-fe3ff34ca8cc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:38.889679 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-16722c07-9b91-4094-ab29-fe3ff34ca8cc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:38.897258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40064ca9-d64a-43ec-8f8b-e7425050b89b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:38.897729 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-40064ca9-d64a-43ec-8f8b-e7425050b89b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:38.898647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-40064ca9-d64a-43ec-8f8b-e7425050b89b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lazy-loading 'fault' on Instance uuid f5cd4124-73ad-4109-a774-b76ba75ab797 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:13:38.901125 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16722c07-9b91-4094-ab29-fe3ff34ca8cc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:38.901656 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16722c07-9b91-4094-ab29-fe3ff34ca8cc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:38.903384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16722c07-9b91-4094-ab29-fe3ff34ca8cc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:38.904036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16722c07-9b91-4094-ab29-fe3ff34ca8cc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:39.177533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-40064ca9-d64a-43ec-8f8b-e7425050b89b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:39.190633 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-40064ca9-d64a-43ec-8f8b-e7425050b89b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797" status: 200 len: 1338 microversion: 2.1 time: 0.466300 Jul 25 13:13:39.191311 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2882/5700] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:13:38 2022] GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797 => generated 1338 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:13:39.461438 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-16722c07-9b91-4094-ab29-fe3ff34ca8cc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:39.480458 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-16722c07-9b91-4094-ab29-fe3ff34ca8cc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:39.483607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-16722c07-9b91-4094-ab29-fe3ff34ca8cc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:39.485943 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-16722c07-9b91-4094-ab29-fe3ff34ca8cc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1809 microversion: 2.20 time: 0.622254 Jul 25 13:13:39.487418 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2819/5701] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:38 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1809 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:13:40.231183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f9035ac1-8a20-4556-a114-0a39c7fc07a0 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:40.232648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f9035ac1-8a20-4556-a114-0a39c7fc07a0 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: f5cd4124-73ad-4109-a774-b76ba75ab797] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:40.241963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9035ac1-8a20-4556-a114-0a39c7fc07a0 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:40.242513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9035ac1-8a20-4556-a114-0a39c7fc07a0 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:40.243371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9035ac1-8a20-4556-a114-0a39c7fc07a0 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:40.244042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9035ac1-8a20-4556-a114-0a39c7fc07a0 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:40.261464 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-f9035ac1-8a20-4556-a114-0a39c7fc07a0 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] HTTP exception thrown: Instance f5cd4124-73ad-4109-a774-b76ba75ab797 could not be found. Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f9035ac1-8a20-4556-a114-0a39c7fc07a0 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Request method failure captured: Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797 HTTP/1.1 Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pZRNn0KTk3WhXB5GhdHQEO_V4HgelAR2fN1Z4OIFqGbhG8R37wlvJdqTn5LNmMrTBJXwUTFUCGgeLIdhJR08aRo4vRqP1YMFeKqmw43Uz2G-Rghw7NvOK3ejh1axAhJRQ58GPrG-V4tIUxFMHyO2nP4Q0z6rGtW8Q7pZso1tvUQYDk Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 8d36edc3feda482686f9202892538c87 Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestNetworkBasicOps-1905588592 Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8d36edc3feda482686f9202892538c87", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8d36edc3feda482686f9202892538c87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8d36edc3feda482686f9202892538c87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8d36edc3feda482686f9202892538c87"}]}] Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestNetworkBasicOps-1905588592 Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 8d36edc3feda482686f9202892538c87 Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestNetworkBasicOps-1905588592 Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestNetworkBasicOps-1905588592-project Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: d165e33e297f4bd8a37c1f65aa35549d Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestNetworkBasicOps-1905588592-project Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance f5cd4124-73ad-4109-a774-b76ba75ab797 could not be found. Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'f5cd4124-73ad-4109-a774-b76ba75ab797'} Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5cd4124-73ad-4109-a774-b76ba75ab797 could not be found. Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5cd4124-73ad-4109-a774-b76ba75ab797 could not be found. Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:13:40.263963 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:13:40.269205 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:13:40.269205 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:13:40.269205 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:13:40.269205 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:13:40.269205 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:13:40.269205 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5cd4124-73ad-4109-a774-b76ba75ab797 could not be found. Jul 25 13:13:40.269205 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:13:40.269205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f9035ac1-8a20-4556-a114-0a39c7fc07a0 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Returning 404 to user: Instance f5cd4124-73ad-4109-a774-b76ba75ab797 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:13:40.269205 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f9035ac1-8a20-4556-a114-0a39c7fc07a0 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797" status: 404 len: 111 microversion: 2.1 time: 0.041297 Jul 25 13:13:40.270956 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2883/5702] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:13:40 2022] GET /compute/v2.1/servers/f5cd4124-73ad-4109-a774-b76ba75ab797 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:13:40.512095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a7310671-c302-495d-bef3-d902886951a5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:40.512947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a7310671-c302-495d-bef3-d902886951a5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:40.524118 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7310671-c302-495d-bef3-d902886951a5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:40.524875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7310671-c302-495d-bef3-d902886951a5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:40.526758 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7310671-c302-495d-bef3-d902886951a5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:40.527409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7310671-c302-495d-bef3-d902886951a5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:40.659470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-710887db-e92e-4181-9b6d-e5b26e712c6f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '.version_select at 0x7efcf9d359d0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:40.713623 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-710887db-e92e-4181-9b6d-e5b26e712c6f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-683657097" status: 202 len: 0 microversion: 2.1 time: 0.070375 Jul 25 13:13:40.718636 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2884/5703] 10.222.0.49 () {58 vars in 1254 bytes} [Mon Jul 25 13:13:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-683657097 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:13:40.963637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a7310671-c302-495d-bef3-d902886951a5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:40.979831 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a7310671-c302-495d-bef3-d902886951a5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:40.981998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a7310671-c302-495d-bef3-d902886951a5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:40.984071 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a7310671-c302-495d-bef3-d902886951a5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1809 microversion: 2.20 time: 0.478975 Jul 25 13:13:40.985872 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2820/5704] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:40 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1809 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:13:42.020767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dd50703e-9ad8-4a64-8de1-8467fb15f2c6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:42.028979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dd50703e-9ad8-4a64-8de1-8467fb15f2c6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:42.060223 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd50703e-9ad8-4a64-8de1-8467fb15f2c6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:42.060813 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd50703e-9ad8-4a64-8de1-8467fb15f2c6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:42.062239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd50703e-9ad8-4a64-8de1-8467fb15f2c6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:42.063033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd50703e-9ad8-4a64-8de1-8467fb15f2c6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:42.378793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dd50703e-9ad8-4a64-8de1-8467fb15f2c6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:42.390941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dd50703e-9ad8-4a64-8de1-8467fb15f2c6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:42.393904 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dd50703e-9ad8-4a64-8de1-8467fb15f2c6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:42.395454 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dd50703e-9ad8-4a64-8de1-8467fb15f2c6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1809 microversion: 2.20 time: 0.386608 Jul 25 13:13:42.396695 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2885/5705] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:42 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1809 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:13:43.421219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-208fc380-dc9f-44c3-ab5a-f6794f380c1b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:43.422023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-208fc380-dc9f-44c3-ab5a-f6794f380c1b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:43.425386 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:13:43.445783 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-208fc380-dc9f-44c3-ab5a-f6794f380c1b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:43.446724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-208fc380-dc9f-44c3-ab5a-f6794f380c1b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:43.447911 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-208fc380-dc9f-44c3-ab5a-f6794f380c1b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:43.448720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-208fc380-dc9f-44c3-ab5a-f6794f380c1b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:43.933738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-208fc380-dc9f-44c3-ab5a-f6794f380c1b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:43.952792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-208fc380-dc9f-44c3-ab5a-f6794f380c1b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:43.969531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-208fc380-dc9f-44c3-ab5a-f6794f380c1b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:43.972669 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-208fc380-dc9f-44c3-ab5a-f6794f380c1b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1809 microversion: 2.20 time: 0.556732 Jul 25 13:13:43.974277 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2821/5706] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:43 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1809 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:13:44.989507 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-8225dae1-4a62-428b-90f4-63fa04e0c8cb req-6d546838-8486-4a15-9029-d7a423b8b632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffd02cb-a0ad-4b1f-b129-6fee94dc57af", "name": "network-vif-plugged", "status": "completed", "tag": "f70aacb3-9955-48b6-92e4-b936a8bc527b"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:13:44.997239 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-23cf1ebf-6937-4d4c-85d9-035c43cb863b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:44.997974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-23cf1ebf-6937-4d4c-85d9-035c43cb863b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:45.018244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:13:45.020429 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-23cf1ebf-6937-4d4c-85d9-035c43cb863b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:45.022409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-23cf1ebf-6937-4d4c-85d9-035c43cb863b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:45.024264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-23cf1ebf-6937-4d4c-85d9-035c43cb863b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:45.034833 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-23cf1ebf-6937-4d4c-85d9-035c43cb863b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:45.045253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-8225dae1-4a62-428b-90f4-63fa04e0c8cb req-6d546838-8486-4a15-9029-d7a423b8b632 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:45.046105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-8225dae1-4a62-428b-90f4-63fa04e0c8cb req-6d546838-8486-4a15-9029-d7a423b8b632 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:45.077294 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-8225dae1-4a62-428b-90f4-63fa04e0c8cb req-6d546838-8486-4a15-9029-d7a423b8b632 service nova] Creating event network-vif-plugged:f70aacb3-9955-48b6-92e4-b936a8bc527b for instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af on n-h2-848886-15 Jul 25 13:13:45.095935 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-8225dae1-4a62-428b-90f4-63fa04e0c8cb req-6d546838-8486-4a15-9029-d7a423b8b632 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104178 Jul 25 13:13:45.097483 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2886/5707] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:13:46.047530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-23cf1ebf-6937-4d4c-85d9-035c43cb863b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:46.059485 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-23cf1ebf-6937-4d4c-85d9-035c43cb863b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:46.061720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-23cf1ebf-6937-4d4c-85d9-035c43cb863b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:46.063581 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-23cf1ebf-6937-4d4c-85d9-035c43cb863b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1809 microversion: 2.20 time: 1.070849 Jul 25 13:13:46.064637 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2822/5708] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:44 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1809 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:13:47.095822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-166ff517-1e09-475c-989e-f72a8b1a9d38 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:47.096604 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-166ff517-1e09-475c-989e-f72a8b1a9d38 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:47.114340 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-166ff517-1e09-475c-989e-f72a8b1a9d38 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:47.127004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-166ff517-1e09-475c-989e-f72a8b1a9d38 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:47.129311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-166ff517-1e09-475c-989e-f72a8b1a9d38 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:47.139324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-166ff517-1e09-475c-989e-f72a8b1a9d38 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:47.802166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-166ff517-1e09-475c-989e-f72a8b1a9d38 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:47.828762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-166ff517-1e09-475c-989e-f72a8b1a9d38 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:47.835411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-166ff517-1e09-475c-989e-f72a8b1a9d38 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:47.839944 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-166ff517-1e09-475c-989e-f72a8b1a9d38 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1809 microversion: 2.20 time: 0.753888 Jul 25 13:13:47.844816 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2887/5709] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:47 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1809 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:13:48.871912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5004ba3f-1956-4ae8-a290-9ff416fcc184 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:13:48.871912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5004ba3f-1956-4ae8-a290-9ff416fcc184 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:13:48.880012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5004ba3f-1956-4ae8-a290-9ff416fcc184 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:48.880779 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5004ba3f-1956-4ae8-a290-9ff416fcc184 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:48.881765 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5004ba3f-1956-4ae8-a290-9ff416fcc184 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:13:48.882434 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5004ba3f-1956-4ae8-a290-9ff416fcc184 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:13:49.228165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5004ba3f-1956-4ae8-a290-9ff416fcc184 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:49.257678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5004ba3f-1956-4ae8-a290-9ff416fcc184 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:49.260467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5004ba3f-1956-4ae8-a290-9ff416fcc184 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:13:49.261708 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5004ba3f-1956-4ae8-a290-9ff416fcc184 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1796 microversion: 2.20 time: 0.395172 Jul 25 13:13:49.262402 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2823/5710] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:13:48 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1796 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:14:00.361278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-739a50f3-4ef0-4bc4-99dc-2e00ec47d6b8 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Action: 'create', calling method: .version_select at 0x7efcf883a8b0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1947075666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCu4lxCs++Es4vYudJ1PcvnhQDkfYYZQte7ZzFwn4TtRxMuN2d/GeXlO9uvIPoY/HKs2wQIyb8mqVZOTBevwxbo6rPg72m05jczca5WxB2iYPOpjbm3GHG0TIEpw0P1mnQ=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:14:00.368637 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:14:00.370815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:14:00.404454 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-739a50f3-4ef0-4bc4-99dc-2e00ec47d6b8 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Getting quotas for project 8d36edc3feda482686f9202892538c87. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:14:00.411412 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-739a50f3-4ef0-4bc4-99dc-2e00ec47d6b8 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Getting quotas for user d165e33e297f4bd8a37c1f65aa35549d and project 8d36edc3feda482686f9202892538c87. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:14:00.468551 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-739a50f3-4ef0-4bc4-99dc-2e00ec47d6b8 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.111748 Jul 25 13:14:00.469965 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2888/5711] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:14:00 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:14:03.060543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-df63907c-7abb-452f-b9d6-0f3a2b07d86f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1342280950", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "e963663d-cb2f-4bd9-bc43-9702c508fe9d"}], "key_name": "tempest-TestNetworkBasicOps-1947075666", "security_groups": [{"name": "tempest-secgroup-smoke-1881106764"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:14:03.087576 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=5 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:14:03.088354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=35 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:14:03.318664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-df63907c-7abb-452f-b9d6-0f3a2b07d86f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] validate_networks() for [('e963663d-cb2f-4bd9-bc43-9702c508fe9d', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:14:04.490362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-df63907c-7abb-452f-b9d6-0f3a2b07d86f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:14:04.491553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-df63907c-7abb-452f-b9d6-0f3a2b07d86f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:14:04.492346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-df63907c-7abb-452f-b9d6-0f3a2b07d86f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:14:04.497847 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-df63907c-7abb-452f-b9d6-0f3a2b07d86f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:14:04.501115 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-df63907c-7abb-452f-b9d6-0f3a2b07d86f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:14:04.520787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-df63907c-7abb-452f-b9d6-0f3a2b07d86f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:04.521746 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-df63907c-7abb-452f-b9d6-0f3a2b07d86f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:04.522935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-df63907c-7abb-452f-b9d6-0f3a2b07d86f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:04.530522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-df63907c-7abb-452f-b9d6-0f3a2b07d86f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:04.588128 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-df63907c-7abb-452f-b9d6-0f3a2b07d86f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Getting quotas for project 8d36edc3feda482686f9202892538c87. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:14:04.598187 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-df63907c-7abb-452f-b9d6-0f3a2b07d86f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Getting quotas for user d165e33e297f4bd8a37c1f65aa35549d and project 8d36edc3feda482686f9202892538c87. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:14:04.621015 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-df63907c-7abb-452f-b9d6-0f3a2b07d86f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:14:04.628523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-df63907c-7abb-452f-b9d6-0f3a2b07d86f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:14:04.733681 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-df63907c-7abb-452f-b9d6-0f3a2b07d86f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.677168 Jul 25 13:14:04.737208 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2824/5712] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:14:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:14:04.747922 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2af6b005-8523-41e2-a986-666804a804dc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:04.749633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2af6b005-8523-41e2-a986-666804a804dc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:04.870082 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2af6b005-8523-41e2-a986-666804a804dc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:04.883426 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2af6b005-8523-41e2-a986-666804a804dc tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3" status: 200 len: 1249 microversion: 2.1 time: 0.140959 Jul 25 13:14:04.885817 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2889/5713] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:14:04 2022] GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 => generated 1249 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:14:05.909287 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-de739e1e-7e0f-4203-9a2e-9eb92f6590a5 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:05.910143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-de739e1e-7e0f-4203-9a2e-9eb92f6590a5 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:05.918713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de739e1e-7e0f-4203-9a2e-9eb92f6590a5 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:05.920549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de739e1e-7e0f-4203-9a2e-9eb92f6590a5 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:05.923038 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de739e1e-7e0f-4203-9a2e-9eb92f6590a5 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:05.923687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-de739e1e-7e0f-4203-9a2e-9eb92f6590a5 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:06.113392 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-de739e1e-7e0f-4203-9a2e-9eb92f6590a5 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:06.128075 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-de739e1e-7e0f-4203-9a2e-9eb92f6590a5 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3" status: 200 len: 1253 microversion: 2.1 time: 0.219027 Jul 25 13:14:06.129617 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2825/5714] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:14:05 2022] GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 => generated 1253 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:14:07.148739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c47f1605-9db4-44de-9b43-89adac795075 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:07.150306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c47f1605-9db4-44de-9b43-89adac795075 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:07.157986 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c47f1605-9db4-44de-9b43-89adac795075 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:07.158677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c47f1605-9db4-44de-9b43-89adac795075 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:07.159652 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c47f1605-9db4-44de-9b43-89adac795075 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:07.160087 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c47f1605-9db4-44de-9b43-89adac795075 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:07.282184 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c47f1605-9db4-44de-9b43-89adac795075 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:07.294264 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c47f1605-9db4-44de-9b43-89adac795075 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3" status: 200 len: 1307 microversion: 2.1 time: 0.149430 Jul 25 13:14:07.295268 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2890/5715] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:14:07 2022] GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 => generated 1307 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:14:08.316798 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7c938d35-057a-407e-9afa-1fce491a2c38 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:08.317566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7c938d35-057a-407e-9afa-1fce491a2c38 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:08.332158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c938d35-057a-407e-9afa-1fce491a2c38 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:08.342024 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c938d35-057a-407e-9afa-1fce491a2c38 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:08.343242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c938d35-057a-407e-9afa-1fce491a2c38 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:08.343718 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c938d35-057a-407e-9afa-1fce491a2c38 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:08.733863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7c938d35-057a-407e-9afa-1fce491a2c38 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:08.755152 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7c938d35-057a-407e-9afa-1fce491a2c38 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3" status: 200 len: 1307 microversion: 2.1 time: 0.439996 Jul 25 13:14:08.758171 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2826/5716] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:14:08 2022] GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 => generated 1307 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:14:09.776116 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4a25aa9b-4bff-4d6c-8cc6-8730be2d5b7f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:09.779571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4a25aa9b-4bff-4d6c-8cc6-8730be2d5b7f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:09.800236 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a25aa9b-4bff-4d6c-8cc6-8730be2d5b7f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:09.800648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a25aa9b-4bff-4d6c-8cc6-8730be2d5b7f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:09.801941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a25aa9b-4bff-4d6c-8cc6-8730be2d5b7f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:09.802386 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a25aa9b-4bff-4d6c-8cc6-8730be2d5b7f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:10.708234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4a25aa9b-4bff-4d6c-8cc6-8730be2d5b7f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:10.774374 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4a25aa9b-4bff-4d6c-8cc6-8730be2d5b7f tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3" status: 200 len: 1375 microversion: 2.1 time: 1.001423 Jul 25 13:14:10.781907 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2891/5717] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:14:09 2022] GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 => generated 1375 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:14:11.462522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-c92ac9df-ecbe-4fbf-b433-9d6806a1c080 req-f05e2d83-649d-4d73-982c-8b54f2e26f5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3", "tag": "5f88f7e7-d350-46f9-8d63-10932e12ddbf"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:14:11.480789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c92ac9df-ecbe-4fbf-b433-9d6806a1c080 req-f05e2d83-649d-4d73-982c-8b54f2e26f5c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:11.481254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c92ac9df-ecbe-4fbf-b433-9d6806a1c080 req-f05e2d83-649d-4d73-982c-8b54f2e26f5c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:11.568529 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-c92ac9df-ecbe-4fbf-b433-9d6806a1c080 req-f05e2d83-649d-4d73-982c-8b54f2e26f5c service nova] Creating event network-changed:5f88f7e7-d350-46f9-8d63-10932e12ddbf for instance e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 on n-h2-848886-15 Jul 25 13:14:11.582196 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-c92ac9df-ecbe-4fbf-b433-9d6806a1c080 req-f05e2d83-649d-4d73-982c-8b54f2e26f5c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123405 Jul 25 13:14:11.584734 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2827/5718] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:14:11.805538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ecb670b8-b785-426e-a354-399a4ffa82ef tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:11.807573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ecb670b8-b785-426e-a354-399a4ffa82ef tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:11.819152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ecb670b8-b785-426e-a354-399a4ffa82ef tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:11.820386 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ecb670b8-b785-426e-a354-399a4ffa82ef tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:11.821405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ecb670b8-b785-426e-a354-399a4ffa82ef tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:11.822239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ecb670b8-b785-426e-a354-399a4ffa82ef tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:12.064262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ecb670b8-b785-426e-a354-399a4ffa82ef tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:12.076960 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ecb670b8-b785-426e-a354-399a4ffa82ef tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3" status: 200 len: 1375 microversion: 2.1 time: 0.275867 Jul 25 13:14:12.077858 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2892/5719] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:14:11 2022] GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 => generated 1375 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:14:13.098777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3ceabef6-e042-4786-9c31-a77f7b0f1373 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:13.101272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3ceabef6-e042-4786-9c31-a77f7b0f1373 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:13.111119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3ceabef6-e042-4786-9c31-a77f7b0f1373 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:13.112073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3ceabef6-e042-4786-9c31-a77f7b0f1373 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:13.113613 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3ceabef6-e042-4786-9c31-a77f7b0f1373 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:13.114359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3ceabef6-e042-4786-9c31-a77f7b0f1373 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:13.515600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3ceabef6-e042-4786-9c31-a77f7b0f1373 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:13.533119 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3ceabef6-e042-4786-9c31-a77f7b0f1373 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3" status: 200 len: 1375 microversion: 2.1 time: 0.438506 Jul 25 13:14:13.551095 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2828/5720] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:14:13 2022] GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 => generated 1375 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:14:14.554809 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-14041390-04b5-415a-a976-6529b90355f7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:14.555423 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-14041390-04b5-415a-a976-6529b90355f7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:14.562773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14041390-04b5-415a-a976-6529b90355f7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:14.563278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14041390-04b5-415a-a976-6529b90355f7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:14.564062 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14041390-04b5-415a-a976-6529b90355f7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:14.564503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14041390-04b5-415a-a976-6529b90355f7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:14.722283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-14041390-04b5-415a-a976-6529b90355f7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:14.732207 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-14041390-04b5-415a-a976-6529b90355f7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3" status: 200 len: 1375 microversion: 2.1 time: 0.181258 Jul 25 13:14:14.746640 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2893/5721] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:14:14 2022] GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 => generated 1375 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:14:15.762979 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b599d72a-a2a5-4b04-b661-20cf4c698d41 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:15.764156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b599d72a-a2a5-4b04-b661-20cf4c698d41 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:15.776820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:14:15.779785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:14:15.782740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b599d72a-a2a5-4b04-b661-20cf4c698d41 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:15.783437 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b599d72a-a2a5-4b04-b661-20cf4c698d41 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:15.785167 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b599d72a-a2a5-4b04-b661-20cf4c698d41 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:15.785880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b599d72a-a2a5-4b04-b661-20cf4c698d41 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:16.001703 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b599d72a-a2a5-4b04-b661-20cf4c698d41 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:16.016721 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b599d72a-a2a5-4b04-b661-20cf4c698d41 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3" status: 200 len: 1375 microversion: 2.1 time: 0.263754 Jul 25 13:14:16.030680 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2829/5722] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:14:15 2022] GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 => generated 1375 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:14:17.045144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b692ff99-28dc-43d1-8ae2-6fdfb8718fc7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:17.046243 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b692ff99-28dc-43d1-8ae2-6fdfb8718fc7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:17.049275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:14:17.095849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b692ff99-28dc-43d1-8ae2-6fdfb8718fc7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:17.096528 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b692ff99-28dc-43d1-8ae2-6fdfb8718fc7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:17.097547 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b692ff99-28dc-43d1-8ae2-6fdfb8718fc7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:17.098290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b692ff99-28dc-43d1-8ae2-6fdfb8718fc7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:17.426017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b692ff99-28dc-43d1-8ae2-6fdfb8718fc7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:17.441262 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b692ff99-28dc-43d1-8ae2-6fdfb8718fc7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3" status: 200 len: 1375 microversion: 2.1 time: 0.401871 Jul 25 13:14:17.441262 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2894/5723] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:14:17 2022] GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 => generated 1375 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:14:18.462348 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f6c0db9c-e4eb-4fb7-82a2-d2c4a1e87d91 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:18.462972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f6c0db9c-e4eb-4fb7-82a2-d2c4a1e87d91 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:18.471336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f6c0db9c-e4eb-4fb7-82a2-d2c4a1e87d91 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:18.471881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f6c0db9c-e4eb-4fb7-82a2-d2c4a1e87d91 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:18.473568 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f6c0db9c-e4eb-4fb7-82a2-d2c4a1e87d91 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:18.474319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f6c0db9c-e4eb-4fb7-82a2-d2c4a1e87d91 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:18.646736 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f6c0db9c-e4eb-4fb7-82a2-d2c4a1e87d91 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:18.655931 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f6c0db9c-e4eb-4fb7-82a2-d2c4a1e87d91 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3" status: 200 len: 1375 microversion: 2.1 time: 0.198593 Jul 25 13:14:18.656866 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2830/5724] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:14:18 2022] GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 => generated 1375 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:14:19.493072 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-dfcc69b2-ae1c-4493-9bd3-2214ea604793 req-28ab9947-6da0-470b-8ef8-4f63e1f91a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3", "name": "network-vif-plugged", "status": "completed", "tag": "5f88f7e7-d350-46f9-8d63-10932e12ddbf"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:14:19.514375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-dfcc69b2-ae1c-4493-9bd3-2214ea604793 req-28ab9947-6da0-470b-8ef8-4f63e1f91a3f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:19.515113 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-dfcc69b2-ae1c-4493-9bd3-2214ea604793 req-28ab9947-6da0-470b-8ef8-4f63e1f91a3f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:19.529479 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-dfcc69b2-ae1c-4493-9bd3-2214ea604793 req-28ab9947-6da0-470b-8ef8-4f63e1f91a3f service nova] Creating event network-vif-plugged:5f88f7e7-d350-46f9-8d63-10932e12ddbf for instance e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 on n-h2-848886-15 Jul 25 13:14:19.559618 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-dfcc69b2-ae1c-4493-9bd3-2214ea604793 req-28ab9947-6da0-470b-8ef8-4f63e1f91a3f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071825 Jul 25 13:14:19.560559 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2895/5725] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:14:19.684646 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-79ed87a0-3517-4520-a522-0ebd7463a0cf tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:19.685350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-79ed87a0-3517-4520-a522-0ebd7463a0cf tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:19.693991 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79ed87a0-3517-4520-a522-0ebd7463a0cf tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:19.694475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79ed87a0-3517-4520-a522-0ebd7463a0cf tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:19.695286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79ed87a0-3517-4520-a522-0ebd7463a0cf tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:19.695746 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79ed87a0-3517-4520-a522-0ebd7463a0cf tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:20.314681 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-79ed87a0-3517-4520-a522-0ebd7463a0cf tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:20.325563 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-79ed87a0-3517-4520-a522-0ebd7463a0cf tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3" status: 200 len: 1375 microversion: 2.1 time: 0.646937 Jul 25 13:14:20.342470 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2831/5726] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:14:19 2022] GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 => generated 1375 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:14:21.350808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1ee2a981-7e04-469d-a73c-e4a58615077e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:21.352260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1ee2a981-7e04-469d-a73c-e4a58615077e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:21.371917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ee2a981-7e04-469d-a73c-e4a58615077e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:21.374189 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ee2a981-7e04-469d-a73c-e4a58615077e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:21.375117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ee2a981-7e04-469d-a73c-e4a58615077e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:21.380259 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ee2a981-7e04-469d-a73c-e4a58615077e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:21.712469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1ee2a981-7e04-469d-a73c-e4a58615077e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:21.727080 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1ee2a981-7e04-469d-a73c-e4a58615077e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3" status: 200 len: 1375 microversion: 2.1 time: 0.380621 Jul 25 13:14:21.732108 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2896/5727] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:14:21 2022] GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 => generated 1375 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:14:22.755106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-65506e2a-bcef-47c2-84c1-0fa93b90f884 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:22.755993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-65506e2a-bcef-47c2-84c1-0fa93b90f884 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:22.764383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65506e2a-bcef-47c2-84c1-0fa93b90f884 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:22.767659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65506e2a-bcef-47c2-84c1-0fa93b90f884 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:22.767659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65506e2a-bcef-47c2-84c1-0fa93b90f884 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:22.767659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65506e2a-bcef-47c2-84c1-0fa93b90f884 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:22.774139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d3b0699b-3d60-4d74-ba0d-4ee433c29377 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:22.774924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d3b0699b-3d60-4d74-ba0d-4ee433c29377 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:22.790189 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3b0699b-3d60-4d74-ba0d-4ee433c29377 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:22.792230 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3b0699b-3d60-4d74-ba0d-4ee433c29377 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:22.794469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3b0699b-3d60-4d74-ba0d-4ee433c29377 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:22.795043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3b0699b-3d60-4d74-ba0d-4ee433c29377 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:22.861418 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d3b0699b-3d60-4d74-ba0d-4ee433c29377 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/os-volume_attachments/1ae593d4-2299-45ec-9765-d3fb5d86acc5" status: 200 len: 194 microversion: 2.20 time: 0.092115 Jul 25 13:14:22.865950 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2897/5728] 10.222.0.49 () {60 vars in 1454 bytes} [Mon Jul 25 13:14:22 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/os-volume_attachments/1ae593d4-2299-45ec-9765-d3fb5d86acc5 => generated 194 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:14:22.951480 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-995e12dd-bb33-4e11-8b15-65f94d1dd6ff tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:22.952556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-995e12dd-bb33-4e11-8b15-65f94d1dd6ff tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:22.960285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-995e12dd-bb33-4e11-8b15-65f94d1dd6ff tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:22.961017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-995e12dd-bb33-4e11-8b15-65f94d1dd6ff tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:22.962089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-995e12dd-bb33-4e11-8b15-65f94d1dd6ff tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:22.962756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-995e12dd-bb33-4e11-8b15-65f94d1dd6ff tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:23.096438 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-995e12dd-bb33-4e11-8b15-65f94d1dd6ff tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lazy-loading 'services' on Instance uuid 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:14:23.198788 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-995e12dd-bb33-4e11-8b15-65f94d1dd6ff tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/os-volume_attachments/1ae593d4-2299-45ec-9765-d3fb5d86acc5" status: 202 len: 0 microversion: 2.20 time: 0.251255 Jul 25 13:14:23.200238 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2898/5729] 10.222.0.49 () {60 vars in 1457 bytes} [Mon Jul 25 13:14:22 2022] DELETE /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/os-volume_attachments/1ae593d4-2299-45ec-9765-d3fb5d86acc5 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 25 13:14:23.212021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-06c7f3bf-7857-4c4a-a779-d5b2d4994d39 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:23.215553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-06c7f3bf-7857-4c4a-a779-d5b2d4994d39 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:23.226218 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-06c7f3bf-7857-4c4a-a779-d5b2d4994d39 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:23.226939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-06c7f3bf-7857-4c4a-a779-d5b2d4994d39 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:23.227903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-06c7f3bf-7857-4c4a-a779-d5b2d4994d39 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:23.228473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-06c7f3bf-7857-4c4a-a779-d5b2d4994d39 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:23.247413 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-65506e2a-bcef-47c2-84c1-0fa93b90f884 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:23.262662 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-65506e2a-bcef-47c2-84c1-0fa93b90f884 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3" status: 200 len: 1547 microversion: 2.1 time: 0.507411 Jul 25 13:14:23.265705 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2832/5730] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:14:22 2022] GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 => generated 1547 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:14:23.281756 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-06c7f3bf-7857-4c4a-a779-d5b2d4994d39 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076269 Jul 25 13:14:23.282680 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2899/5731] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Jul 25 13:14:23 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 13:14:23.301078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a662aae6-1766-4d18-a6e4-a4af767e4664 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:23.302105 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a662aae6-1766-4d18-a6e4-a4af767e4664 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:23.333866 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a662aae6-1766-4d18-a6e4-a4af767e4664 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:23.334112 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a662aae6-1766-4d18-a6e4-a4af767e4664 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:23.335098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a662aae6-1766-4d18-a6e4-a4af767e4664 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:23.335234 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a662aae6-1766-4d18-a6e4-a4af767e4664 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:23.629537 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a662aae6-1766-4d18-a6e4-a4af767e4664 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:23.638198 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a662aae6-1766-4d18-a6e4-a4af767e4664 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3" status: 200 len: 1547 microversion: 2.1 time: 0.354059 Jul 25 13:14:23.638997 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2833/5732] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:14:23 2022] GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 => generated 1547 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:14:24.295928 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-eb5e66dd-6cda-45cd-b0e0-e7dc4c5a7460 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:24.298213 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eb5e66dd-6cda-45cd-b0e0-e7dc4c5a7460 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:24.311190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb5e66dd-6cda-45cd-b0e0-e7dc4c5a7460 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:24.312086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb5e66dd-6cda-45cd-b0e0-e7dc4c5a7460 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:24.313249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb5e66dd-6cda-45cd-b0e0-e7dc4c5a7460 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:24.314056 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb5e66dd-6cda-45cd-b0e0-e7dc4c5a7460 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:24.359751 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-eb5e66dd-6cda-45cd-b0e0-e7dc4c5a7460 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067471 Jul 25 13:14:24.361089 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2900/5733] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Jul 25 13:14:24 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:14:25.375211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d82f75e9-4834-4880-8d81-3185405645b0 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:25.380934 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d82f75e9-4834-4880-8d81-3185405645b0 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:25.391200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d82f75e9-4834-4880-8d81-3185405645b0 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:25.392069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d82f75e9-4834-4880-8d81-3185405645b0 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:25.393362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d82f75e9-4834-4880-8d81-3185405645b0 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:25.394124 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d82f75e9-4834-4880-8d81-3185405645b0 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:25.462847 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d82f75e9-4834-4880-8d81-3185405645b0 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.093337 Jul 25 13:14:25.469500 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2834/5734] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Jul 25 13:14:25 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:14:26.479849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e647379b-3f67-4a3a-9c7f-2cdbb00dc0e5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:26.487660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e647379b-3f67-4a3a-9c7f-2cdbb00dc0e5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:26.502162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e647379b-3f67-4a3a-9c7f-2cdbb00dc0e5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:26.502706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e647379b-3f67-4a3a-9c7f-2cdbb00dc0e5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:26.503809 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e647379b-3f67-4a3a-9c7f-2cdbb00dc0e5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:26.504370 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e647379b-3f67-4a3a-9c7f-2cdbb00dc0e5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:26.512320 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-4ec9aa9f-b947-4a21-801f-b581967f30f5 req-15cecb52-ab02-4ff0-94bd-ec1b63830aea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3", "tag": "5f88f7e7-d350-46f9-8d63-10932e12ddbf"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:14:26.530983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4ec9aa9f-b947-4a21-801f-b581967f30f5 req-15cecb52-ab02-4ff0-94bd-ec1b63830aea service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:26.531770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4ec9aa9f-b947-4a21-801f-b581967f30f5 req-15cecb52-ab02-4ff0-94bd-ec1b63830aea service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:26.547700 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e647379b-3f67-4a3a-9c7f-2cdbb00dc0e5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075699 Jul 25 13:14:26.548492 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-4ec9aa9f-b947-4a21-801f-b581967f30f5 req-15cecb52-ab02-4ff0-94bd-ec1b63830aea service nova] Creating event network-changed:5f88f7e7-d350-46f9-8d63-10932e12ddbf for instance e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 on n-h2-848886-15 Jul 25 13:14:26.549168 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2901/5735] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Jul 25 13:14:26 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:14:26.557903 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-4ec9aa9f-b947-4a21-801f-b581967f30f5 req-15cecb52-ab02-4ff0-94bd-ec1b63830aea service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050907 Jul 25 13:14:26.558912 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2835/5736] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:14:27.561948 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-482f9c6c-806c-4912-b25c-ba83bcbd7dd5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:27.564358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-482f9c6c-806c-4912-b25c-ba83bcbd7dd5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:27.572088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-482f9c6c-806c-4912-b25c-ba83bcbd7dd5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:27.572523 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-482f9c6c-806c-4912-b25c-ba83bcbd7dd5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:27.573355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-482f9c6c-806c-4912-b25c-ba83bcbd7dd5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:27.573795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-482f9c6c-806c-4912-b25c-ba83bcbd7dd5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:27.623685 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-482f9c6c-806c-4912-b25c-ba83bcbd7dd5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066350 Jul 25 13:14:27.624926 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2902/5737] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Jul 25 13:14:27 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:14:28.637996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-488c66d3-fa68-4f98-a3f1-6b2a5ffa19cd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:28.640502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-488c66d3-fa68-4f98-a3f1-6b2a5ffa19cd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:28.653122 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-488c66d3-fa68-4f98-a3f1-6b2a5ffa19cd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:28.653604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-488c66d3-fa68-4f98-a3f1-6b2a5ffa19cd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:28.654457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-488c66d3-fa68-4f98-a3f1-6b2a5ffa19cd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:28.654919 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-488c66d3-fa68-4f98-a3f1-6b2a5ffa19cd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:28.753003 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-488c66d3-fa68-4f98-a3f1-6b2a5ffa19cd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.119974 Jul 25 13:14:28.753956 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2836/5738] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Jul 25 13:14:28 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:14:29.767087 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0a4f84c3-7564-4221-8562-1ac67a1750d6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:29.782203 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0a4f84c3-7564-4221-8562-1ac67a1750d6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:29.815935 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a4f84c3-7564-4221-8562-1ac67a1750d6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:29.817800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a4f84c3-7564-4221-8562-1ac67a1750d6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:29.824176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a4f84c3-7564-4221-8562-1ac67a1750d6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:29.824642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a4f84c3-7564-4221-8562-1ac67a1750d6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:29.920140 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0a4f84c3-7564-4221-8562-1ac67a1750d6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.157286 Jul 25 13:14:29.922372 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2903/5739] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Jul 25 13:14:29 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af/os-volume_attachments => generated 25 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:14:30.077479 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5cd7f75c-f5a9-442f-9cdb-298991114767 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:30.078695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5cd7f75c-f5a9-442f-9cdb-298991114767 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:30.090419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cd7f75c-f5a9-442f-9cdb-298991114767 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:30.091117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cd7f75c-f5a9-442f-9cdb-298991114767 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:30.092808 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cd7f75c-f5a9-442f-9cdb-298991114767 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:30.093272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cd7f75c-f5a9-442f-9cdb-298991114767 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:30.146527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5cd7f75c-f5a9-442f-9cdb-298991114767 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:14:30.281300 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5cd7f75c-f5a9-442f-9cdb-298991114767 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 204 len: 0 microversion: 2.20 time: 0.207764 Jul 25 13:14:30.282833 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2837/5740] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 13:14:30 2022] DELETE /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 13:14:30.292304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-56b5b552-252b-4f66-91ff-d89624248cfe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:30.293430 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-56b5b552-252b-4f66-91ff-d89624248cfe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:30.302264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56b5b552-252b-4f66-91ff-d89624248cfe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:30.308607 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56b5b552-252b-4f66-91ff-d89624248cfe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:30.309715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56b5b552-252b-4f66-91ff-d89624248cfe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:30.310532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56b5b552-252b-4f66-91ff-d89624248cfe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:30.667041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-56b5b552-252b-4f66-91ff-d89624248cfe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:30.673523 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:14:30.676598 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-56b5b552-252b-4f66-91ff-d89624248cfe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:30.684423 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-56b5b552-252b-4f66-91ff-d89624248cfe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:30.686024 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-56b5b552-252b-4f66-91ff-d89624248cfe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1724 microversion: 2.20 time: 0.398163 Jul 25 13:14:30.688272 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2904/5741] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:14:30 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1724 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:14:31.724458 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c43035d9-e65d-49af-882d-7ecea97be68c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:31.725856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c43035d9-e65d-49af-882d-7ecea97be68c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:31.739395 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c43035d9-e65d-49af-882d-7ecea97be68c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:31.741346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c43035d9-e65d-49af-882d-7ecea97be68c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:31.743042 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c43035d9-e65d-49af-882d-7ecea97be68c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:31.745284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c43035d9-e65d-49af-882d-7ecea97be68c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:32.337494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c43035d9-e65d-49af-882d-7ecea97be68c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:32.349994 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c43035d9-e65d-49af-882d-7ecea97be68c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:32.361537 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c43035d9-e65d-49af-882d-7ecea97be68c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:32.375411 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c43035d9-e65d-49af-882d-7ecea97be68c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1724 microversion: 2.20 time: 0.650000 Jul 25 13:14:32.376906 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2838/5742] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:14:31 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1724 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:14:33.400193 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4c9bfb1f-fbdb-44bb-bc3d-bf6eb77bf18a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:33.400889 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4c9bfb1f-fbdb-44bb-bc3d-bf6eb77bf18a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:33.410318 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:14:33.442036 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c9bfb1f-fbdb-44bb-bc3d-bf6eb77bf18a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:33.442321 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c9bfb1f-fbdb-44bb-bc3d-bf6eb77bf18a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:33.443113 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c9bfb1f-fbdb-44bb-bc3d-bf6eb77bf18a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:33.443564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c9bfb1f-fbdb-44bb-bc3d-bf6eb77bf18a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:33.745083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4c9bfb1f-fbdb-44bb-bc3d-bf6eb77bf18a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:33.755932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4c9bfb1f-fbdb-44bb-bc3d-bf6eb77bf18a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:33.757483 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4c9bfb1f-fbdb-44bb-bc3d-bf6eb77bf18a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:33.771714 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4c9bfb1f-fbdb-44bb-bc3d-bf6eb77bf18a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1656 microversion: 2.20 time: 0.376070 Jul 25 13:14:33.780853 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2905/5743] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:14:33 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1656 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:14:34.801009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-759e84a3-33ae-422f-89f0-61a2eb17a0f4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:34.803697 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-759e84a3-33ae-422f-89f0-61a2eb17a0f4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:34.812847 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-759e84a3-33ae-422f-89f0-61a2eb17a0f4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:34.813302 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-759e84a3-33ae-422f-89f0-61a2eb17a0f4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:34.823034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-759e84a3-33ae-422f-89f0-61a2eb17a0f4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:34.836848 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-759e84a3-33ae-422f-89f0-61a2eb17a0f4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:34.916800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-759e84a3-33ae-422f-89f0-61a2eb17a0f4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:34.917284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-759e84a3-33ae-422f-89f0-61a2eb17a0f4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:34.917757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-759e84a3-33ae-422f-89f0-61a2eb17a0f4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lazy-loading 'fault' on Instance uuid 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:14:35.076109 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-0b13a6bf-8986-4925-9f52-047f996703b9 req-3bec9671-aa9c-4b96-bd02-cb0c07aafd89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffd02cb-a0ad-4b1f-b129-6fee94dc57af", "name": "network-vif-deleted", "tag": "f70aacb3-9955-48b6-92e4-b936a8bc527b"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:14:35.092128 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-759e84a3-33ae-422f-89f0-61a2eb17a0f4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:35.097348 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:14:35.103809 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-759e84a3-33ae-422f-89f0-61a2eb17a0f4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:35.105257 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0b13a6bf-8986-4925-9f52-047f996703b9 req-3bec9671-aa9c-4b96-bd02-cb0c07aafd89 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:35.105446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-759e84a3-33ae-422f-89f0-61a2eb17a0f4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:35.106590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0b13a6bf-8986-4925-9f52-047f996703b9 req-3bec9671-aa9c-4b96-bd02-cb0c07aafd89 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:35.110935 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-759e84a3-33ae-422f-89f0-61a2eb17a0f4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 200 len: 1371 microversion: 2.20 time: 0.313849 Jul 25 13:14:35.111884 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2906/5744] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:14:34 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 1371 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:14:35.149815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:14:35.181213 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-0b13a6bf-8986-4925-9f52-047f996703b9 req-3bec9671-aa9c-4b96-bd02-cb0c07aafd89 service nova] Creating event network-vif-deleted:f70aacb3-9955-48b6-92e4-b936a8bc527b for instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af on n-h2-848886-15 Jul 25 13:14:35.190189 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-0b13a6bf-8986-4925-9f52-047f996703b9 req-3bec9671-aa9c-4b96-bd02-cb0c07aafd89 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.470654 Jul 25 13:14:35.192472 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2839/5745] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:14:36.137883 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-75b02a3c-2eda-4a46-8a4e-11546046009d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:36.138513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-75b02a3c-2eda-4a46-8a4e-11546046009d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:36.153105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75b02a3c-2eda-4a46-8a4e-11546046009d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:36.153563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75b02a3c-2eda-4a46-8a4e-11546046009d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:36.155779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75b02a3c-2eda-4a46-8a4e-11546046009d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:36.156235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75b02a3c-2eda-4a46-8a4e-11546046009d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:36.175673 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-75b02a3c-2eda-4a46-8a4e-11546046009d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] HTTP exception thrown: Instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af could not be found. Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-75b02a3c-2eda-4a46-8a4e-11546046009d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Request method failure captured: Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af HTTP/1.1 Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pZlwsDLWPCrT8wHON_ekBxBFRhqHaz8o2_DkWQeSANKl_1AvmaypCHZ_skHHa_kgy83u_V2baEEF63dVMfXfQZz-EPPAWr64M4p0kAchxZIAYVGqpY3xI9Pek1MMMpkClDqEbjkBxNXIDnp1cyXs92dyDcWn-oxvVKs9-hlzZ5wsAk Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 7c757f689085487bbbfcbc5bdd365843 Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1281752976 Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7c757f689085487bbbfcbc5bdd365843", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7c757f689085487bbbfcbc5bdd365843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c757f689085487bbbfcbc5bdd365843"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c757f689085487bbbfcbc5bdd365843"}]}] Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1281752976 Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 7c757f689085487bbbfcbc5bdd365843 Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1281752976 Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-AttachVolumeShelveTestJSON-1281752976-project Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 36608374ffcf47f389e1169f454b2d9b Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1281752976-project Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af could not be found. Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '0ffd02cb-a0ad-4b1f-b129-6fee94dc57af'} Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af could not be found. Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af could not be found. Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:14:36.178409 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:14:36.185229 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:14:36.185229 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:14:36.185229 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:14:36.185229 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:14:36.185229 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:14:36.185229 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:14:36.185229 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af could not be found. Jul 25 13:14:36.185229 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:14:36.187612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-75b02a3c-2eda-4a46-8a4e-11546046009d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Returning 404 to user: Instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:14:36.188710 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-75b02a3c-2eda-4a46-8a4e-11546046009d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 404 len: 111 microversion: 2.20 time: 0.055916 Jul 25 13:14:36.189869 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2907/5746] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:14:36 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:14:36.199168 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9590576d-8f7e-43d0-b19c-a3832fe7a664 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '.version_select at 0x7efcf8fa73a0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:36.248470 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9590576d-8f7e-43d0-b19c-a3832fe7a664 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-738074909" status: 204 len: 0 microversion: 2.20 time: 0.053725 Jul 25 13:14:36.249449 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2840/5747] 10.222.0.49 () {60 vars in 1259 bytes} [Mon Jul 25 13:14:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-738074909 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 13:14:38.599800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0a9d56d9-e0cf-47c7-9787-e791b29fd031 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Action: 'create', calling method: .version_select at 0x7efcf9bac0d0>, body: {"keypair": {"name": "tempest-keypair-1865226521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBz2ZkFJEAlYiYwziTW7pWhgkOIgdizYtcQYX6aYFIruRAIQjjmgjnIeqXyRiP7wkpGh585VYXO7HVLl3oog+xgqMGLetr3uMe8FmLy5HzutjEqhsHjzc9RQz2Ap9VwcA=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:14:38.617739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-0a9d56d9-e0cf-47c7-9787-e791b29fd031 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Getting quotas for project 7c757f689085487bbbfcbc5bdd365843. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:14:38.624356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-0a9d56d9-e0cf-47c7-9787-e791b29fd031 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Getting quotas for user 36608374ffcf47f389e1169f454b2d9b and project 7c757f689085487bbbfcbc5bdd365843. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:14:38.650420 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0a9d56d9-e0cf-47c7-9787-e791b29fd031 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.054721 Jul 25 13:14:38.651741 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2908/5748] 10.222.0.49 () {62 vars in 1200 bytes} [Mon Jul 25 13:14:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 13:14:41.057798 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aa037d0b-f974-45ed-91f6-7d4663a96b89 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-492573860", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "91d0beea-2451-4e14-b38a-2e48507623dc"}], "security_groups": [{"name": "tempest-securitygroup--1172196952"}], "key_name": "tempest-keypair-1865226521", "user_data": "}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:14:41.222218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-aa037d0b-f974-45ed-91f6-7d4663a96b89 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] validate_networks() for [('91d0beea-2451-4e14-b38a-2e48507623dc', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:14:41.848830 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-aa037d0b-f974-45ed-91f6-7d4663a96b89 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:14:41.849320 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-aa037d0b-f974-45ed-91f6-7d4663a96b89 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:14:41.849855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-aa037d0b-f974-45ed-91f6-7d4663a96b89 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:14:41.850561 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-aa037d0b-f974-45ed-91f6-7d4663a96b89 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:14:41.851108 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-aa037d0b-f974-45ed-91f6-7d4663a96b89 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:14:41.868265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa037d0b-f974-45ed-91f6-7d4663a96b89 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:41.868735 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa037d0b-f974-45ed-91f6-7d4663a96b89 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:41.869750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa037d0b-f974-45ed-91f6-7d4663a96b89 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:41.870652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa037d0b-f974-45ed-91f6-7d4663a96b89 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:41.911101 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-aa037d0b-f974-45ed-91f6-7d4663a96b89 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Getting quotas for project 7c757f689085487bbbfcbc5bdd365843. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:14:41.918493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-aa037d0b-f974-45ed-91f6-7d4663a96b89 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Getting quotas for user 36608374ffcf47f389e1169f454b2d9b and project 7c757f689085487bbbfcbc5bdd365843. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:14:41.954857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-aa037d0b-f974-45ed-91f6-7d4663a96b89 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:14:41.957787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-aa037d0b-f974-45ed-91f6-7d4663a96b89 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:14:42.062263 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aa037d0b-f974-45ed-91f6-7d4663a96b89 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.010220 Jul 25 13:14:42.069230 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2841/5749] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Jul 25 13:14:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 13:14:42.076939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4c6edc03-809b-4b8a-91c3-34af33a54e6d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:42.077572 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4c6edc03-809b-4b8a-91c3-34af33a54e6d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:42.578996 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4c6edc03-809b-4b8a-91c3-34af33a54e6d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:42.586831 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4c6edc03-809b-4b8a-91c3-34af33a54e6d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:42.591667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4c6edc03-809b-4b8a-91c3-34af33a54e6d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:42.598817 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4c6edc03-809b-4b8a-91c3-34af33a54e6d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1281 microversion: 2.20 time: 0.528638 Jul 25 13:14:42.614402 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2909/5750] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:14:42 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1281 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:14:43.630867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f36022da-1745-417c-a599-fe49feb7ac9a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:43.631597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f36022da-1745-417c-a599-fe49feb7ac9a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:43.640837 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f36022da-1745-417c-a599-fe49feb7ac9a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:43.643299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f36022da-1745-417c-a599-fe49feb7ac9a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:43.644490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f36022da-1745-417c-a599-fe49feb7ac9a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:43.645258 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f36022da-1745-417c-a599-fe49feb7ac9a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:43.972450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f36022da-1745-417c-a599-fe49feb7ac9a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:44.004705 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f36022da-1745-417c-a599-fe49feb7ac9a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:44.006670 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f36022da-1745-417c-a599-fe49feb7ac9a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:44.008532 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f36022da-1745-417c-a599-fe49feb7ac9a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1341 microversion: 2.20 time: 0.389408 Jul 25 13:14:44.027511 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2842/5751] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:14:43 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1341 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:14:45.041389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3f5ac5c2-31de-4cc5-abe5-49aa8654f0e4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:45.042120 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3f5ac5c2-31de-4cc5-abe5-49aa8654f0e4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:45.054799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f5ac5c2-31de-4cc5-abe5-49aa8654f0e4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:45.060907 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f5ac5c2-31de-4cc5-abe5-49aa8654f0e4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:45.061853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f5ac5c2-31de-4cc5-abe5-49aa8654f0e4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:45.062300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3f5ac5c2-31de-4cc5-abe5-49aa8654f0e4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:45.207589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3f5ac5c2-31de-4cc5-abe5-49aa8654f0e4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:45.207589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3f5ac5c2-31de-4cc5-abe5-49aa8654f0e4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:45.207589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3f5ac5c2-31de-4cc5-abe5-49aa8654f0e4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:45.207589 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3f5ac5c2-31de-4cc5-abe5-49aa8654f0e4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1339 microversion: 2.20 time: 0.169082 Jul 25 13:14:45.207589 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2910/5752] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:14:45 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1339 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:14:46.233348 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-51def989-97e6-442a-86e2-637049affd34 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:46.234608 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-51def989-97e6-442a-86e2-637049affd34 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:46.247492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-51def989-97e6-442a-86e2-637049affd34 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:46.248505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-51def989-97e6-442a-86e2-637049affd34 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:46.250875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-51def989-97e6-442a-86e2-637049affd34 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:46.252472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-51def989-97e6-442a-86e2-637049affd34 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:46.821315 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-51def989-97e6-442a-86e2-637049affd34 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:46.833161 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-51def989-97e6-442a-86e2-637049affd34 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:46.841098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-51def989-97e6-442a-86e2-637049affd34 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:46.844579 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-51def989-97e6-442a-86e2-637049affd34 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1407 microversion: 2.20 time: 0.615258 Jul 25 13:14:46.866072 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2843/5753] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:14:46 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1407 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:14:47.629769 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-bacadb20-e32c-4227-bea0-7c63171964a9 req-189ff2bb-70a4-46cb-a8ec-4f5a971e7c16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ecfb163-569c-483d-9fbd-14c3b45d649e", "tag": "6c96878c-7b90-42b3-b3aa-b61e8018fcee"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:14:47.660791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-bacadb20-e32c-4227-bea0-7c63171964a9 req-189ff2bb-70a4-46cb-a8ec-4f5a971e7c16 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:47.661240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-bacadb20-e32c-4227-bea0-7c63171964a9 req-189ff2bb-70a4-46cb-a8ec-4f5a971e7c16 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:47.690748 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-bacadb20-e32c-4227-bea0-7c63171964a9 req-189ff2bb-70a4-46cb-a8ec-4f5a971e7c16 service nova] Creating event network-changed:6c96878c-7b90-42b3-b3aa-b61e8018fcee for instance 5ecfb163-569c-483d-9fbd-14c3b45d649e on n-h1-848886-15 Jul 25 13:14:47.702819 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-bacadb20-e32c-4227-bea0-7c63171964a9 req-189ff2bb-70a4-46cb-a8ec-4f5a971e7c16 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077532 Jul 25 13:14:47.703983 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2911/5754] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:14:47.872640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-73090ef8-0b7f-42ee-972e-d2b9c273b744 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:47.874144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-73090ef8-0b7f-42ee-972e-d2b9c273b744 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:47.882920 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73090ef8-0b7f-42ee-972e-d2b9c273b744 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:47.883737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73090ef8-0b7f-42ee-972e-d2b9c273b744 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:47.887073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73090ef8-0b7f-42ee-972e-d2b9c273b744 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:47.887672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-73090ef8-0b7f-42ee-972e-d2b9c273b744 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:48.172127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-73090ef8-0b7f-42ee-972e-d2b9c273b744 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:48.185461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-73090ef8-0b7f-42ee-972e-d2b9c273b744 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:48.187621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-73090ef8-0b7f-42ee-972e-d2b9c273b744 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:48.188942 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-73090ef8-0b7f-42ee-972e-d2b9c273b744 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1407 microversion: 2.20 time: 0.322208 Jul 25 13:14:48.189929 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2844/5755] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:14:47 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1407 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:14:49.215869 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-726ad4fa-f60d-433e-a70c-eb92ec5e4025 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:49.216664 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-726ad4fa-f60d-433e-a70c-eb92ec5e4025 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:49.224556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-726ad4fa-f60d-433e-a70c-eb92ec5e4025 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:49.225184 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-726ad4fa-f60d-433e-a70c-eb92ec5e4025 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:49.226343 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-726ad4fa-f60d-433e-a70c-eb92ec5e4025 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:49.226676 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-726ad4fa-f60d-433e-a70c-eb92ec5e4025 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:49.584508 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-726ad4fa-f60d-433e-a70c-eb92ec5e4025 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:49.597822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-726ad4fa-f60d-433e-a70c-eb92ec5e4025 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:49.599753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-726ad4fa-f60d-433e-a70c-eb92ec5e4025 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:49.600928 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-726ad4fa-f60d-433e-a70c-eb92ec5e4025 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1407 microversion: 2.20 time: 0.391876 Jul 25 13:14:49.616930 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2912/5756] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:14:49 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1407 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:14:49.727314 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2ac3448a-6b6f-4a5d-838f-740751fa2974 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:14:49.730805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2ac3448a-6b6f-4a5d-838f-740751fa2974 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:49.769940 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2ac3448a-6b6f-4a5d-838f-740751fa2974 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:49.771250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2ac3448a-6b6f-4a5d-838f-740751fa2974 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:49.772315 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2ac3448a-6b6f-4a5d-838f-740751fa2974 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:49.778132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2ac3448a-6b6f-4a5d-838f-740751fa2974 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:49.898938 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2ac3448a-6b6f-4a5d-838f-740751fa2974 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "POST /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3/action" status: 200 len: 24572 microversion: 2.1 time: 0.178329 Jul 25 13:14:49.899917 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2845/5757] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:14:49 2022] POST /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3/action => generated 24572 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:14:50.626221 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0b94d20e-5db1-42d9-a656-20f10dbe00fc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:50.628987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0b94d20e-5db1-42d9-a656-20f10dbe00fc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:50.639340 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b94d20e-5db1-42d9-a656-20f10dbe00fc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:50.640148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b94d20e-5db1-42d9-a656-20f10dbe00fc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:50.641179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b94d20e-5db1-42d9-a656-20f10dbe00fc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:50.641804 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b94d20e-5db1-42d9-a656-20f10dbe00fc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:50.986018 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0b94d20e-5db1-42d9-a656-20f10dbe00fc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:51.003454 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0b94d20e-5db1-42d9-a656-20f10dbe00fc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:51.005195 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0b94d20e-5db1-42d9-a656-20f10dbe00fc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:51.006481 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0b94d20e-5db1-42d9-a656-20f10dbe00fc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1407 microversion: 2.20 time: 0.386760 Jul 25 13:14:51.012132 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2913/5758] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:14:50 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1407 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:14:52.032493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8ba01840-a3a9-496a-9c82-5d25de687a02 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:52.035176 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8ba01840-a3a9-496a-9c82-5d25de687a02 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:52.048891 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:14:52.050775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:14:52.062063 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ba01840-a3a9-496a-9c82-5d25de687a02 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:52.070811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ba01840-a3a9-496a-9c82-5d25de687a02 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:52.071801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ba01840-a3a9-496a-9c82-5d25de687a02 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:52.072283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ba01840-a3a9-496a-9c82-5d25de687a02 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:52.318680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8ba01840-a3a9-496a-9c82-5d25de687a02 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:52.348174 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8ba01840-a3a9-496a-9c82-5d25de687a02 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:52.353691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8ba01840-a3a9-496a-9c82-5d25de687a02 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:52.356900 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8ba01840-a3a9-496a-9c82-5d25de687a02 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1407 microversion: 2.20 time: 0.330780 Jul 25 13:14:52.358114 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2846/5759] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:14:52 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:14:53.381597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e82c4d8a-b71a-4906-890a-19333054c4cb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:53.382229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e82c4d8a-b71a-4906-890a-19333054c4cb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:53.386779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:14:53.398109 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e82c4d8a-b71a-4906-890a-19333054c4cb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:53.398848 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e82c4d8a-b71a-4906-890a-19333054c4cb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:53.400063 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e82c4d8a-b71a-4906-890a-19333054c4cb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:53.400882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e82c4d8a-b71a-4906-890a-19333054c4cb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:53.708310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e82c4d8a-b71a-4906-890a-19333054c4cb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:53.721622 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e82c4d8a-b71a-4906-890a-19333054c4cb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:53.724648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e82c4d8a-b71a-4906-890a-19333054c4cb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:53.726459 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e82c4d8a-b71a-4906-890a-19333054c4cb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1407 microversion: 2.20 time: 0.349824 Jul 25 13:14:53.727292 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2914/5760] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:14:53 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1407 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:14:54.753580 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d71e3860-1ab1-4caa-9266-b00c9b33b32e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:54.755138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d71e3860-1ab1-4caa-9266-b00c9b33b32e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:54.768297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d71e3860-1ab1-4caa-9266-b00c9b33b32e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:54.771683 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d71e3860-1ab1-4caa-9266-b00c9b33b32e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:54.773296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d71e3860-1ab1-4caa-9266-b00c9b33b32e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:54.776199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d71e3860-1ab1-4caa-9266-b00c9b33b32e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:55.178058 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d71e3860-1ab1-4caa-9266-b00c9b33b32e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:55.192565 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d71e3860-1ab1-4caa-9266-b00c9b33b32e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:55.194493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d71e3860-1ab1-4caa-9266-b00c9b33b32e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:55.195863 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d71e3860-1ab1-4caa-9266-b00c9b33b32e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1407 microversion: 2.20 time: 0.448090 Jul 25 13:14:55.198728 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2847/5761] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:14:54 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1407 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:14:55.600719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-8e5e5931-2e25-4261-89d8-c2d81da32459 req-b56b6509-c857-49bc-a460-68871d3df81b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ecfb163-569c-483d-9fbd-14c3b45d649e", "name": "network-vif-plugged", "status": "completed", "tag": "6c96878c-7b90-42b3-b3aa-b61e8018fcee"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:14:55.615195 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-8e5e5931-2e25-4261-89d8-c2d81da32459 req-b56b6509-c857-49bc-a460-68871d3df81b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:55.615642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-8e5e5931-2e25-4261-89d8-c2d81da32459 req-b56b6509-c857-49bc-a460-68871d3df81b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:55.644709 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-8e5e5931-2e25-4261-89d8-c2d81da32459 req-b56b6509-c857-49bc-a460-68871d3df81b service nova] Creating event network-vif-plugged:6c96878c-7b90-42b3-b3aa-b61e8018fcee for instance 5ecfb163-569c-483d-9fbd-14c3b45d649e on n-h1-848886-15 Jul 25 13:14:55.654496 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-8e5e5931-2e25-4261-89d8-c2d81da32459 req-b56b6509-c857-49bc-a460-68871d3df81b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.278095 Jul 25 13:14:55.655126 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2915/5762] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:14:56.225643 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ad28c409-7ab3-4ab2-a3ff-fc5635c6f53d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:56.227542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ad28c409-7ab3-4ab2-a3ff-fc5635c6f53d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:56.236855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad28c409-7ab3-4ab2-a3ff-fc5635c6f53d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:56.237573 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad28c409-7ab3-4ab2-a3ff-fc5635c6f53d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:56.238758 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad28c409-7ab3-4ab2-a3ff-fc5635c6f53d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:56.239412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad28c409-7ab3-4ab2-a3ff-fc5635c6f53d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:56.448650 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d2dd790e-c5ac-4e2d-a4f7-1ad4e3703e4b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:14:56.451030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d2dd790e-c5ac-4e2d-a4f7-1ad4e3703e4b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:56.457797 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2dd790e-c5ac-4e2d-a4f7-1ad4e3703e4b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:56.458281 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2dd790e-c5ac-4e2d-a4f7-1ad4e3703e4b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:56.459258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2dd790e-c5ac-4e2d-a4f7-1ad4e3703e4b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:56.459694 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2dd790e-c5ac-4e2d-a4f7-1ad4e3703e4b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:56.518390 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d2dd790e-c5ac-4e2d-a4f7-1ad4e3703e4b tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "POST /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3/action" status: 200 len: 32637 microversion: 2.1 time: 0.073759 Jul 25 13:14:56.520485 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2916/5763] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:14:56 2022] POST /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3/action => generated 32637 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 13:14:56.532478 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ad28c409-7ab3-4ab2-a3ff-fc5635c6f53d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:56.543176 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ad28c409-7ab3-4ab2-a3ff-fc5635c6f53d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:56.544701 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ad28c409-7ab3-4ab2-a3ff-fc5635c6f53d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:56.550059 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ad28c409-7ab3-4ab2-a3ff-fc5635c6f53d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1407 microversion: 2.20 time: 0.326945 Jul 25 13:14:56.550961 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2848/5764] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:14:56 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:14:57.574687 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6312a5f5-0690-4809-a0e7-c8d3dad05e69 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:57.575396 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6312a5f5-0690-4809-a0e7-c8d3dad05e69 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:57.596105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6312a5f5-0690-4809-a0e7-c8d3dad05e69 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:57.596568 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6312a5f5-0690-4809-a0e7-c8d3dad05e69 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:57.597604 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6312a5f5-0690-4809-a0e7-c8d3dad05e69 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:57.597967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6312a5f5-0690-4809-a0e7-c8d3dad05e69 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:57.868608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6312a5f5-0690-4809-a0e7-c8d3dad05e69 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:57.890533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6312a5f5-0690-4809-a0e7-c8d3dad05e69 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:57.895532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6312a5f5-0690-4809-a0e7-c8d3dad05e69 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:14:57.902557 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6312a5f5-0690-4809-a0e7-c8d3dad05e69 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1599 microversion: 2.20 time: 0.332740 Jul 25 13:14:57.903485 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2917/5765] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:14:57 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1599 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:14:57.928579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5c594275-c4eb-47cb-b014-63187cfebc30 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:57.929917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5c594275-c4eb-47cb-b014-63187cfebc30 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:57.938789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c594275-c4eb-47cb-b014-63187cfebc30 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:57.939370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c594275-c4eb-47cb-b014-63187cfebc30 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:57.941267 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c594275-c4eb-47cb-b014-63187cfebc30 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:57.942211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c594275-c4eb-47cb-b014-63187cfebc30 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:58.101662 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5c594275-c4eb-47cb-b014-63187cfebc30 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.176066 Jul 25 13:14:58.110415 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2849/5766] 10.222.0.49 () {60 vars in 1316 bytes} [Mon Jul 25 13:14:57 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e/os-interface => generated 285 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:14:59.157551 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cb87c718-9252-4666-a99a-19c44a0d397e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:59.158240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cb87c718-9252-4666-a99a-19c44a0d397e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:59.176000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb87c718-9252-4666-a99a-19c44a0d397e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:59.178205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb87c718-9252-4666-a99a-19c44a0d397e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:59.180279 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb87c718-9252-4666-a99a-19c44a0d397e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:59.181420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb87c718-9252-4666-a99a-19c44a0d397e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:59.243684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cb87c718-9252-4666-a99a-19c44a0d397e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:14:59.432385 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cb87c718-9252-4666-a99a-19c44a0d397e tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3" status: 204 len: 0 microversion: 2.1 time: 0.280282 Jul 25 13:14:59.433621 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2918/5767] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:14:59 2022] DELETE /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:14:59.449942 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-da170470-ed62-486f-b7f5-ac7466e186c7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:14:59.452721 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-da170470-ed62-486f-b7f5-ac7466e186c7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:14:59.467711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da170470-ed62-486f-b7f5-ac7466e186c7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:59.471657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da170470-ed62-486f-b7f5-ac7466e186c7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:59.473000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da170470-ed62-486f-b7f5-ac7466e186c7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:59.473743 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-da170470-ed62-486f-b7f5-ac7466e186c7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:59.486339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-13cf6543-0d75-454e-991f-fc38559c815c req-35551f7f-7c60-43cf-acc3-89a1a746e56f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3", "tag": "5f88f7e7-d350-46f9-8d63-10932e12ddbf"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:14:59.513533 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-13cf6543-0d75-454e-991f-fc38559c815c req-35551f7f-7c60-43cf-acc3-89a1a746e56f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:14:59.515019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-13cf6543-0d75-454e-991f-fc38559c815c req-35551f7f-7c60-43cf-acc3-89a1a746e56f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:14:59.545038 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-13cf6543-0d75-454e-991f-fc38559c815c req-35551f7f-7c60-43cf-acc3-89a1a746e56f service nova] Creating event network-changed:5f88f7e7-d350-46f9-8d63-10932e12ddbf for instance e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 on n-h2-848886-15 Jul 25 13:14:59.554609 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-13cf6543-0d75-454e-991f-fc38559c815c req-35551f7f-7c60-43cf-acc3-89a1a746e56f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.374841 Jul 25 13:14:59.556713 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2850/5768] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:15:00.349318 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-da170470-ed62-486f-b7f5-ac7466e186c7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:00.359514 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-da170470-ed62-486f-b7f5-ac7466e186c7 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3" status: 200 len: 1672 microversion: 2.1 time: 0.919197 Jul 25 13:15:00.372574 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2919/5769] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:14:59 2022] GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 => generated 1672 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:01.387777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b85b1b61-48f0-44ab-9e06-4d58339b1430 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:01.389324 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b85b1b61-48f0-44ab-9e06-4d58339b1430 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:01.396954 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b85b1b61-48f0-44ab-9e06-4d58339b1430 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:01.397679 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b85b1b61-48f0-44ab-9e06-4d58339b1430 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:01.398748 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b85b1b61-48f0-44ab-9e06-4d58339b1430 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:01.399392 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b85b1b61-48f0-44ab-9e06-4d58339b1430 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:01.452584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-1ec82401-dd22-47e7-9ddf-a3b1b177facc req-473362ac-6d3f-4d34-98a2-7c73759d8b7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ecfb163-569c-483d-9fbd-14c3b45d649e", "tag": "6c96878c-7b90-42b3-b3aa-b61e8018fcee"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:15:01.470516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-1ec82401-dd22-47e7-9ddf-a3b1b177facc req-473362ac-6d3f-4d34-98a2-7c73759d8b7e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:01.470980 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-1ec82401-dd22-47e7-9ddf-a3b1b177facc req-473362ac-6d3f-4d34-98a2-7c73759d8b7e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:01.485287 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-1ec82401-dd22-47e7-9ddf-a3b1b177facc req-473362ac-6d3f-4d34-98a2-7c73759d8b7e service nova] Creating event network-changed:6c96878c-7b90-42b3-b3aa-b61e8018fcee for instance 5ecfb163-569c-483d-9fbd-14c3b45d649e on n-h1-848886-15 Jul 25 13:15:01.491302 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-1ec82401-dd22-47e7-9ddf-a3b1b177facc req-473362ac-6d3f-4d34-98a2-7c73759d8b7e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043881 Jul 25 13:15:01.495228 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2920/5770] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:15:02.335689 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b85b1b61-48f0-44ab-9e06-4d58339b1430 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:02.355722 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b85b1b61-48f0-44ab-9e06-4d58339b1430 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3" status: 200 len: 1672 microversion: 2.1 time: 0.973668 Jul 25 13:15:02.357043 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2851/5771] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:01 2022] GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 => generated 1672 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:03.380164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2091dc43-a024-4214-af5a-8e98144792b6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:03.380901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2091dc43-a024-4214-af5a-8e98144792b6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:03.387882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2091dc43-a024-4214-af5a-8e98144792b6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:03.388746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2091dc43-a024-4214-af5a-8e98144792b6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:03.389638 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2091dc43-a024-4214-af5a-8e98144792b6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:03.390205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2091dc43-a024-4214-af5a-8e98144792b6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:03.454828 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2091dc43-a024-4214-af5a-8e98144792b6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:03.455567 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2091dc43-a024-4214-af5a-8e98144792b6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:03.456410 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-2091dc43-a024-4214-af5a-8e98144792b6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lazy-loading 'fault' on Instance uuid e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:15:03.461143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:15:03.514853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2091dc43-a024-4214-af5a-8e98144792b6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165e33e297f4bd8a37c1f65aa35549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36edc3feda482686f9202892538c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:03.524317 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2091dc43-a024-4214-af5a-8e98144792b6 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3" status: 200 len: 1339 microversion: 2.1 time: 0.149426 Jul 25 13:15:03.525550 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2921/5772] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:03 2022] GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 => generated 1339 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:03.545136 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-8b15e6ad-1010-4cfe-9778-bfcabdf61cb1 req-0713f922-9213-4752-86c0-08f11ed1c98b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3", "name": "network-vif-deleted", "tag": "5f88f7e7-d350-46f9-8d63-10932e12ddbf"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:15:03.567697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-8b15e6ad-1010-4cfe-9778-bfcabdf61cb1 req-0713f922-9213-4752-86c0-08f11ed1c98b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:03.572636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-8b15e6ad-1010-4cfe-9778-bfcabdf61cb1 req-0713f922-9213-4752-86c0-08f11ed1c98b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:03.588133 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-8b15e6ad-1010-4cfe-9778-bfcabdf61cb1 req-0713f922-9213-4752-86c0-08f11ed1c98b service nova] Creating event network-vif-deleted:5f88f7e7-d350-46f9-8d63-10932e12ddbf for instance e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 on n-h2-848886-15 Jul 25 13:15:03.596595 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-8b15e6ad-1010-4cfe-9778-bfcabdf61cb1 req-0713f922-9213-4752-86c0-08f11ed1c98b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055443 Jul 25 13:15:03.600529 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2852/5773] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:15:04.549433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-92600fc3-dd3e-43c5-85eb-34e4f2c0cebf tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:04.552274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-92600fc3-dd3e-43c5-85eb-34e4f2c0cebf tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] [instance: e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:04.563725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:15:04.568127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-92600fc3-dd3e-43c5-85eb-34e4f2c0cebf tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:04.568908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-92600fc3-dd3e-43c5-85eb-34e4f2c0cebf tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:04.572245 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-92600fc3-dd3e-43c5-85eb-34e4f2c0cebf tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:04.573280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-92600fc3-dd3e-43c5-85eb-34e4f2c0cebf tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:04.599264 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-92600fc3-dd3e-43c5-85eb-34e4f2c0cebf tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] HTTP exception thrown: Instance e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 could not be found. Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-92600fc3-dd3e-43c5-85eb-34e4f2c0cebf tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Request method failure captured: Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 HTTP/1.1 Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pZRNn0KTk3WhXB5GhdHQEO_V4HgelAR2fN1Z4OIFqGbhG8R37wlvJdqTn5LNmMrTBJXwUTFUCGgeLIdhJR08aRo4vRqP1YMFeKqmw43Uz2G-Rghw7NvOK3ejh1axAhJRQ58GPrG-V4tIUxFMHyO2nP4Q0z6rGtW8Q7pZso1tvUQYDk Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 8d36edc3feda482686f9202892538c87 Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestNetworkBasicOps-1905588592 Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8d36edc3feda482686f9202892538c87", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8d36edc3feda482686f9202892538c87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8d36edc3feda482686f9202892538c87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8d36edc3feda482686f9202892538c87"}]}] Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestNetworkBasicOps-1905588592 Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 8d36edc3feda482686f9202892538c87 Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestNetworkBasicOps-1905588592 Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestNetworkBasicOps-1905588592-project Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: d165e33e297f4bd8a37c1f65aa35549d Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestNetworkBasicOps-1905588592-project Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 could not be found. Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3'} Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 could not be found. Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 could not be found. Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:15:04.601408 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:15:04.608149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:15:04.608149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:15:04.608149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:15:04.608149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:15:04.608149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:15:04.608149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 could not be found. Jul 25 13:15:04.608149 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:15:04.611658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-92600fc3-dd3e-43c5-85eb-34e4f2c0cebf tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Returning 404 to user: Instance e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:15:04.613090 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-92600fc3-dd3e-43c5-85eb-34e4f2c0cebf tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3" status: 404 len: 111 microversion: 2.1 time: 0.069893 Jul 25 13:15:04.614888 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2922/5774] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:04 2022] GET /compute/v2.1/servers/e5ec32e6-e587-4d3b-a72a-2ab81b3e26e3 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:15:05.032178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7cbd572a-e045-49cf-a728-163d03758967 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] Calling method '.version_select at 0x7efcfecb78b0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:05.081740 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7cbd572a-e045-49cf-a728-163d03758967 tempest-TestNetworkBasicOps-1905588592 tempest-TestNetworkBasicOps-1905588592-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1947075666" status: 202 len: 0 microversion: 2.1 time: 0.056828 Jul 25 13:15:05.082516 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2853/5775] 10.222.0.49 () {58 vars in 1257 bytes} [Mon Jul 25 13:15:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1947075666 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:15:16.035454 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7b50028f-cf67-44d3-923c-9e14f5d7dc77 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:16.036725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7b50028f-cf67-44d3-923c-9e14f5d7dc77 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:16.050814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=5 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:15:16.053205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7b50028f-cf67-44d3-923c-9e14f5d7dc77 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:16.053926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7b50028f-cf67-44d3-923c-9e14f5d7dc77 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:16.054976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7b50028f-cf67-44d3-923c-9e14f5d7dc77 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:16.055585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7b50028f-cf67-44d3-923c-9e14f5d7dc77 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:16.094774 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7b50028f-cf67-44d3-923c-9e14f5d7dc77 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:15:16.306369 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7b50028f-cf67-44d3-923c-9e14f5d7dc77 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "DELETE /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 204 len: 0 microversion: 2.1 time: 0.276099 Jul 25 13:15:16.308862 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2923/5776] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:15:16 2022] DELETE /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:15:16.314647 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=57 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:15:16.315427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:15:16.320384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-884cb117-161a-4205-a885-91b75c16161e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:16.321133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-884cb117-161a-4205-a885-91b75c16161e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:16.339326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-884cb117-161a-4205-a885-91b75c16161e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:16.340100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-884cb117-161a-4205-a885-91b75c16161e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:16.341099 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-884cb117-161a-4205-a885-91b75c16161e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:16.341730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-884cb117-161a-4205-a885-91b75c16161e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:16.831739 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-884cb117-161a-4205-a885-91b75c16161e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:16.841384 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-884cb117-161a-4205-a885-91b75c16161e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1576 microversion: 2.1 time: 0.528809 Jul 25 13:15:16.858956 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2854/5777] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:16 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1576 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:17.872163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-38e1b251-da48-4e43-b75a-26da94015e31 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:17.872163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-38e1b251-da48-4e43-b75a-26da94015e31 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:17.882500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38e1b251-da48-4e43-b75a-26da94015e31 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:17.882956 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38e1b251-da48-4e43-b75a-26da94015e31 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:17.883749 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38e1b251-da48-4e43-b75a-26da94015e31 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:17.884187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-38e1b251-da48-4e43-b75a-26da94015e31 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:18.378300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-38e1b251-da48-4e43-b75a-26da94015e31 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:18.401006 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-38e1b251-da48-4e43-b75a-26da94015e31 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1576 microversion: 2.1 time: 0.528173 Jul 25 13:15:18.402001 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2924/5778] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:17 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1576 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:19.422751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-848e1d8a-838f-46fe-9fad-f37dd7955a5d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:19.423392 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-848e1d8a-838f-46fe-9fad-f37dd7955a5d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:19.435068 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-848e1d8a-838f-46fe-9fad-f37dd7955a5d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:19.435542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-848e1d8a-838f-46fe-9fad-f37dd7955a5d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:19.436578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-848e1d8a-838f-46fe-9fad-f37dd7955a5d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:19.437029 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-848e1d8a-838f-46fe-9fad-f37dd7955a5d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:19.975609 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-848e1d8a-838f-46fe-9fad-f37dd7955a5d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:19.993779 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-848e1d8a-838f-46fe-9fad-f37dd7955a5d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1508 microversion: 2.1 time: 0.574422 Jul 25 13:15:19.995124 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2855/5779] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:19 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1508 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:20.690700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-e7e65b6f-8def-40b1-9139-f4a8dab38421 req-6d961b65-dc01-411a-97f9-2a5dbd2cd522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "592f6a73-dce4-4a04-8aa8-c14fe0e324e2", "name": "network-vif-deleted", "tag": "19542a94-8da7-43f4-b45d-cf5f52f5698d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:15:20.739033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e7e65b6f-8def-40b1-9139-f4a8dab38421 req-6d961b65-dc01-411a-97f9-2a5dbd2cd522 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:20.741499 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e7e65b6f-8def-40b1-9139-f4a8dab38421 req-6d961b65-dc01-411a-97f9-2a5dbd2cd522 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:20.789916 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-e7e65b6f-8def-40b1-9139-f4a8dab38421 req-6d961b65-dc01-411a-97f9-2a5dbd2cd522 service nova] Creating event network-vif-deleted:19542a94-8da7-43f4-b45d-cf5f52f5698d for instance 592f6a73-dce4-4a04-8aa8-c14fe0e324e2 on n-h1-848886-15 Jul 25 13:15:20.806854 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-e7e65b6f-8def-40b1-9139-f4a8dab38421 req-6d961b65-dc01-411a-97f9-2a5dbd2cd522 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121352 Jul 25 13:15:20.808188 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2925/5780] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:15:21.029461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d594c873-13d1-405c-9ec8-8fb7fed0d593 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:21.030736 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d594c873-13d1-405c-9ec8-8fb7fed0d593 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:21.054550 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d594c873-13d1-405c-9ec8-8fb7fed0d593 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:21.055051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d594c873-13d1-405c-9ec8-8fb7fed0d593 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:21.055920 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d594c873-13d1-405c-9ec8-8fb7fed0d593 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:21.056371 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d594c873-13d1-405c-9ec8-8fb7fed0d593 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:21.271311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d594c873-13d1-405c-9ec8-8fb7fed0d593 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:21.284646 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d594c873-13d1-405c-9ec8-8fb7fed0d593 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1225 microversion: 2.1 time: 0.262358 Jul 25 13:15:21.298819 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2856/5781] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:21 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1225 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:22.283210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-54036f3e-d267-4e15-b97f-86ab54d68783 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1138677767", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:15:22.308383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6b87b6c7-8359-4097-9890-fc12125aafa0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:22.309658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6b87b6c7-8359-4097-9890-fc12125aafa0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:22.320779 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b87b6c7-8359-4097-9890-fc12125aafa0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:22.321132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b87b6c7-8359-4097-9890-fc12125aafa0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:22.321976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b87b6c7-8359-4097-9890-fc12125aafa0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:22.326813 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b87b6c7-8359-4097-9890-fc12125aafa0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:22.405456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-54036f3e-d267-4e15-b97f-86ab54d68783 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] validate_networks() for None {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:15:22.514258 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6b87b6c7-8359-4097-9890-fc12125aafa0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:22.528477 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6b87b6c7-8359-4097-9890-fc12125aafa0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1225 microversion: 2.1 time: 0.224818 Jul 25 13:15:22.529098 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2857/5782] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:22 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1225 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:15:23.178330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-54036f3e-d267-4e15-b97f-86ab54d68783 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:15:23.180885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-54036f3e-d267-4e15-b97f-86ab54d68783 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:15:23.182589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-54036f3e-d267-4e15-b97f-86ab54d68783 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:15:23.183179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-54036f3e-d267-4e15-b97f-86ab54d68783 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:15:23.183751 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-54036f3e-d267-4e15-b97f-86ab54d68783 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:15:23.206709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-54036f3e-d267-4e15-b97f-86ab54d68783 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:23.207482 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-54036f3e-d267-4e15-b97f-86ab54d68783 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:23.208684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-54036f3e-d267-4e15-b97f-86ab54d68783 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:23.209301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-54036f3e-d267-4e15-b97f-86ab54d68783 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:23.266089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-54036f3e-d267-4e15-b97f-86ab54d68783 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Getting quotas for project aecb63aa224445e6912175d7b9360ae6. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:15:23.273569 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-54036f3e-d267-4e15-b97f-86ab54d68783 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Getting quotas for user b739ba60fa354ff9a0ef9e6cc01d7772 and project aecb63aa224445e6912175d7b9360ae6. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:15:23.317975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-54036f3e-d267-4e15-b97f-86ab54d68783 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:15:23.325707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-54036f3e-d267-4e15-b97f-86ab54d68783 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] [instance: 50cd2f20-ca6b-4043-a2b5-a319aca9ed40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:15:23.431122 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-54036f3e-d267-4e15-b97f-86ab54d68783 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.153348 Jul 25 13:15:23.436431 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2926/5783] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:15:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:15:23.444181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-38a61e9c-d570-4df5-9b59-e2b78c676750 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:23.444847 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-38a61e9c-d570-4df5-9b59-e2b78c676750 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] [instance: 50cd2f20-ca6b-4043-a2b5-a319aca9ed40] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:23.549862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1c888c15-6924-4096-8067-d3d7bf183c3b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:23.550919 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1c888c15-6924-4096-8067-d3d7bf183c3b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:23.563531 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1c888c15-6924-4096-8067-d3d7bf183c3b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:23.565148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1c888c15-6924-4096-8067-d3d7bf183c3b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:23.569797 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1c888c15-6924-4096-8067-d3d7bf183c3b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:23.570452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1c888c15-6924-4096-8067-d3d7bf183c3b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:23.818637 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1c888c15-6924-4096-8067-d3d7bf183c3b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:23.820574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-38a61e9c-d570-4df5-9b59-e2b78c676750 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b739ba60fa354ff9a0ef9e6cc01d7772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecb63aa224445e6912175d7b9360ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:23.828466 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1c888c15-6924-4096-8067-d3d7bf183c3b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1225 microversion: 2.1 time: 0.283344 Jul 25 13:15:23.834798 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2927/5784] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:23 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1225 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:23.850611 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-38a61e9c-d570-4df5-9b59-e2b78c676750 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] 10.222.0.49 "GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40" status: 200 len: 1214 microversion: 2.1 time: 0.388254 Jul 25 13:15:23.851638 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2858/5785] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:23 2022] GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40 => generated 1214 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:24.848577 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a3bce3d7-8f60-447b-a242-da1c5f9323de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:24.849749 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a3bce3d7-8f60-447b-a242-da1c5f9323de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:24.862271 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3bce3d7-8f60-447b-a242-da1c5f9323de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:24.869783 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3bce3d7-8f60-447b-a242-da1c5f9323de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:24.870975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3bce3d7-8f60-447b-a242-da1c5f9323de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:24.872491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-54cc4466-e574-4e35-8ee9-9faacda6786d tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:24.873326 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a3bce3d7-8f60-447b-a242-da1c5f9323de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:24.873763 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-54cc4466-e574-4e35-8ee9-9faacda6786d tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] [instance: 50cd2f20-ca6b-4043-a2b5-a319aca9ed40] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:24.903057 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54cc4466-e574-4e35-8ee9-9faacda6786d tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:24.907189 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54cc4466-e574-4e35-8ee9-9faacda6786d tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:24.908048 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54cc4466-e574-4e35-8ee9-9faacda6786d tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:24.908505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54cc4466-e574-4e35-8ee9-9faacda6786d tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:25.049618 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a3bce3d7-8f60-447b-a242-da1c5f9323de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:25.060454 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a3bce3d7-8f60-447b-a242-da1c5f9323de tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1225 microversion: 2.1 time: 0.215724 Jul 25 13:15:25.066146 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2928/5786] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:24 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1225 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:25.086688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-54cc4466-e574-4e35-8ee9-9faacda6786d tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b739ba60fa354ff9a0ef9e6cc01d7772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecb63aa224445e6912175d7b9360ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:25.102166 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-54cc4466-e574-4e35-8ee9-9faacda6786d tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] 10.222.0.49 "GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40" status: 200 len: 1266 microversion: 2.1 time: 0.233315 Jul 25 13:15:25.103741 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2859/5787] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:24 2022] GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:26.089520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2375aab3-fc40-4b95-b729-c33848c8f7c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:26.090714 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2375aab3-fc40-4b95-b729-c33848c8f7c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:26.100127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2375aab3-fc40-4b95-b729-c33848c8f7c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:26.100981 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2375aab3-fc40-4b95-b729-c33848c8f7c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:26.102212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2375aab3-fc40-4b95-b729-c33848c8f7c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:26.102830 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2375aab3-fc40-4b95-b729-c33848c8f7c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:26.137529 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fae4ca8b-f31a-4fc1-b9e7-42956d28189a tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:26.138200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fae4ca8b-f31a-4fc1-b9e7-42956d28189a tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] [instance: 50cd2f20-ca6b-4043-a2b5-a319aca9ed40] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:26.157046 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fae4ca8b-f31a-4fc1-b9e7-42956d28189a tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:26.158418 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fae4ca8b-f31a-4fc1-b9e7-42956d28189a tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:26.159586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fae4ca8b-f31a-4fc1-b9e7-42956d28189a tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:26.160205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fae4ca8b-f31a-4fc1-b9e7-42956d28189a tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:26.358594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2375aab3-fc40-4b95-b729-c33848c8f7c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:26.375020 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2375aab3-fc40-4b95-b729-c33848c8f7c0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1225 microversion: 2.1 time: 0.285727 Jul 25 13:15:26.376436 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2929/5788] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:26 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1225 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:26.387178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fae4ca8b-f31a-4fc1-b9e7-42956d28189a tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b739ba60fa354ff9a0ef9e6cc01d7772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecb63aa224445e6912175d7b9360ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:26.416682 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fae4ca8b-f31a-4fc1-b9e7-42956d28189a tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] 10.222.0.49 "GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40" status: 200 len: 1272 microversion: 2.1 time: 0.292254 Jul 25 13:15:26.417333 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2860/5789] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:26 2022] GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40 => generated 1272 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:15:27.410327 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b726918c-bd98-45a8-8c21-3c36f98b33f3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:27.410957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b726918c-bd98-45a8-8c21-3c36f98b33f3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:27.425953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b726918c-bd98-45a8-8c21-3c36f98b33f3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:27.426700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b726918c-bd98-45a8-8c21-3c36f98b33f3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:27.427697 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b726918c-bd98-45a8-8c21-3c36f98b33f3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:27.428311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b726918c-bd98-45a8-8c21-3c36f98b33f3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:27.438069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b2211dc7-a076-4f93-9154-651297e29213 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:27.439650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b2211dc7-a076-4f93-9154-651297e29213 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] [instance: 50cd2f20-ca6b-4043-a2b5-a319aca9ed40] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:27.467829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b2211dc7-a076-4f93-9154-651297e29213 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:27.468315 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b2211dc7-a076-4f93-9154-651297e29213 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:27.469110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b2211dc7-a076-4f93-9154-651297e29213 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:27.469562 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b2211dc7-a076-4f93-9154-651297e29213 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:27.646288 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b726918c-bd98-45a8-8c21-3c36f98b33f3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:27.655733 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b726918c-bd98-45a8-8c21-3c36f98b33f3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 200 len: 1225 microversion: 2.1 time: 0.258696 Jul 25 13:15:27.660364 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2930/5790] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:27 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 1225 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:27.738903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b2211dc7-a076-4f93-9154-651297e29213 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b739ba60fa354ff9a0ef9e6cc01d7772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecb63aa224445e6912175d7b9360ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:27.748492 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b2211dc7-a076-4f93-9154-651297e29213 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] 10.222.0.49 "GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40" status: 200 len: 1272 microversion: 2.1 time: 0.314747 Jul 25 13:15:27.761814 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2861/5791] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:27 2022] GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40 => generated 1272 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:28.680744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-65f5ef8c-32b3-4d8c-b3ec-07b232046f3d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:28.682310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-65f5ef8c-32b3-4d8c-b3ec-07b232046f3d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:28.699076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65f5ef8c-32b3-4d8c-b3ec-07b232046f3d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:28.699541 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65f5ef8c-32b3-4d8c-b3ec-07b232046f3d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:28.700440 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65f5ef8c-32b3-4d8c-b3ec-07b232046f3d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:28.700887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65f5ef8c-32b3-4d8c-b3ec-07b232046f3d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:28.735376 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-65f5ef8c-32b3-4d8c-b3ec-07b232046f3d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] HTTP exception thrown: Instance 592f6a73-dce4-4a04-8aa8-c14fe0e324e2 could not be found. Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-65f5ef8c-32b3-4d8c-b3ec-07b232046f3d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Request method failure captured: Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 HTTP/1.1 Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pUsgUlyXXDFjpaxtInCA3ErKU2P2TTpSljieML2SSsbmedwjUWvmtCPv6cpRR2_rKwVTBeB1pN0R0PaQlKkP3JB2H_nZ9mFVhTCd_Xl4_Gcw-PsIj4Ff-CbWbJlbzuA6BFxmfwmUVgHks2P6PoEesxOn8j894_Z-5Z842qklFD2ecs Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b2fbd681752c41d0a24a9cf34ebc8389", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}] Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 9face2aaa9df430cb5d361c6e1fdf242 Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 592f6a73-dce4-4a04-8aa8-c14fe0e324e2 could not be found. Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '592f6a73-dce4-4a04-8aa8-c14fe0e324e2'} Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 592f6a73-dce4-4a04-8aa8-c14fe0e324e2 could not be found. Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 592f6a73-dce4-4a04-8aa8-c14fe0e324e2 could not be found. Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:15:28.739509 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:15:28.744671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:15:28.744671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:15:28.744671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:15:28.744671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:15:28.744671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:15:28.744671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 592f6a73-dce4-4a04-8aa8-c14fe0e324e2 could not be found. Jul 25 13:15:28.744671 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:15:28.744671 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-65f5ef8c-32b3-4d8c-b3ec-07b232046f3d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Returning 404 to user: Instance 592f6a73-dce4-4a04-8aa8-c14fe0e324e2 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:15:28.744671 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-65f5ef8c-32b3-4d8c-b3ec-07b232046f3d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 404 len: 111 microversion: 2.1 time: 0.066281 Jul 25 13:15:28.746265 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2931/5792] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:28 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:15:28.771520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d4ef9258-1fe9-4f73-bc8c-eab2be9451a9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:28.772167 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d4ef9258-1fe9-4f73-bc8c-eab2be9451a9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] [instance: 50cd2f20-ca6b-4043-a2b5-a319aca9ed40] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:28.781300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4ef9258-1fe9-4f73-bc8c-eab2be9451a9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:28.782327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4ef9258-1fe9-4f73-bc8c-eab2be9451a9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:28.783385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4ef9258-1fe9-4f73-bc8c-eab2be9451a9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:28.784120 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4ef9258-1fe9-4f73-bc8c-eab2be9451a9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:28.953427 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8ba2f582-6a82-4b66-bbca-915da751ec4d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-753509059", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1436557910", "security_groups": [{"name": "tempest-secgroup-smoke-2026990488"}], "block_device_mapping_v2": [{"uuid": "e4da144f-7624-466c-bb35-7ad3b0e526ef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2e9a011a-2cfb-4a86-9ca1-b23997eebbe8"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:15:29.295380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-8ba2f582-6a82-4b66-bbca-915da751ec4d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] validate_networks() for [('2e9a011a-2cfb-4a86-9ca1-b23997eebbe8', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:15:29.478631 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d4ef9258-1fe9-4f73-bc8c-eab2be9451a9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b739ba60fa354ff9a0ef9e6cc01d7772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecb63aa224445e6912175d7b9360ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:29.492900 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d4ef9258-1fe9-4f73-bc8c-eab2be9451a9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] 10.222.0.49 "GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40" status: 200 len: 1314 microversion: 2.1 time: 0.725085 Jul 25 13:15:29.493580 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2862/5793] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:28 2022] GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40 => generated 1314 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:30.385782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-8ba2f582-6a82-4b66-bbca-915da751ec4d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:15:30.386279 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-8ba2f582-6a82-4b66-bbca-915da751ec4d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:15:30.386692 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-8ba2f582-6a82-4b66-bbca-915da751ec4d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:15:30.387163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-8ba2f582-6a82-4b66-bbca-915da751ec4d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:15:30.387570 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-8ba2f582-6a82-4b66-bbca-915da751ec4d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:15:30.401713 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ba2f582-6a82-4b66-bbca-915da751ec4d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:30.406822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ba2f582-6a82-4b66-bbca-915da751ec4d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:30.407577 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ba2f582-6a82-4b66-bbca-915da751ec4d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:30.408032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ba2f582-6a82-4b66-bbca-915da751ec4d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:30.441022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-8ba2f582-6a82-4b66-bbca-915da751ec4d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Getting quotas for project b2fbd681752c41d0a24a9cf34ebc8389. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:15:30.448084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-8ba2f582-6a82-4b66-bbca-915da751ec4d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Getting quotas for user 9face2aaa9df430cb5d361c6e1fdf242 and project b2fbd681752c41d0a24a9cf34ebc8389. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:15:30.515301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-092053ab-7d6a-402a-8d94-b3d8d0b28978 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:30.516713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-092053ab-7d6a-402a-8d94-b3d8d0b28978 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] [instance: 50cd2f20-ca6b-4043-a2b5-a319aca9ed40] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:30.532731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-092053ab-7d6a-402a-8d94-b3d8d0b28978 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:30.534462 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-092053ab-7d6a-402a-8d94-b3d8d0b28978 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:30.535991 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-092053ab-7d6a-402a-8d94-b3d8d0b28978 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:30.538155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-092053ab-7d6a-402a-8d94-b3d8d0b28978 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:30.567425 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8ba2f582-6a82-4b66-bbca-915da751ec4d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:15:30.579561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8ba2f582-6a82-4b66-bbca-915da751ec4d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e4da144f-7624-466c-bb35-7ad3b0e526ef',volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:15:30.890295 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8ba2f582-6a82-4b66-bbca-915da751ec4d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.941118 Jul 25 13:15:30.891264 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2932/5794] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:15:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 13:15:30.896023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-ca57cd33-e824-4597-9b65-cfc959bef4be req-596139de-6ec5-49d0-9d5e-fb7853a5a2b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50cd2f20-ca6b-4043-a2b5-a319aca9ed40", "tag": "8f42e6d9-db11-49b2-96eb-035f2a4b5f5a"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:15:30.916321 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-ca57cd33-e824-4597-9b65-cfc959bef4be req-596139de-6ec5-49d0-9d5e-fb7853a5a2b5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:30.916969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-ca57cd33-e824-4597-9b65-cfc959bef4be req-596139de-6ec5-49d0-9d5e-fb7853a5a2b5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:30.945430 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-ca57cd33-e824-4597-9b65-cfc959bef4be req-596139de-6ec5-49d0-9d5e-fb7853a5a2b5 service nova] Creating event network-changed:8f42e6d9-db11-49b2-96eb-035f2a4b5f5a for instance 50cd2f20-ca6b-4043-a2b5-a319aca9ed40 on n-h2-848886-15 Jul 25 13:15:30.971108 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-ca57cd33-e824-4597-9b65-cfc959bef4be req-596139de-6ec5-49d0-9d5e-fb7853a5a2b5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078294 Jul 25 13:15:30.971633 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2933/5795] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:15:30.979103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6a6d2da2-5994-4f09-af26-eea714e8c6bc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:31.001114 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6a6d2da2-5994-4f09-af26-eea714e8c6bc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:31.317973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6a6d2da2-5994-4f09-af26-eea714e8c6bc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:31.348640 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6a6d2da2-5994-4f09-af26-eea714e8c6bc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1094 microversion: 2.1 time: 0.357337 Jul 25 13:15:31.349810 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2934/5796] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:30 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1094 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:31.407563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-092053ab-7d6a-402a-8d94-b3d8d0b28978 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b739ba60fa354ff9a0ef9e6cc01d7772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecb63aa224445e6912175d7b9360ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:31.419828 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-092053ab-7d6a-402a-8d94-b3d8d0b28978 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] 10.222.0.49 "GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40" status: 200 len: 1314 microversion: 2.1 time: 0.910426 Jul 25 13:15:31.422576 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2863/5797] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:30 2022] GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40 => generated 1314 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:15:32.377608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0a1b28e6-bffc-4309-a990-d19dc55c8b39 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:32.379343 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0a1b28e6-bffc-4309-a990-d19dc55c8b39 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:32.412925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a1b28e6-bffc-4309-a990-d19dc55c8b39 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:32.414306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a1b28e6-bffc-4309-a990-d19dc55c8b39 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:32.416456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a1b28e6-bffc-4309-a990-d19dc55c8b39 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:32.417127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a1b28e6-bffc-4309-a990-d19dc55c8b39 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:32.440723 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-db55496c-b3f3-4a58-bc18-44c19a8ef123 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:32.442056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-db55496c-b3f3-4a58-bc18-44c19a8ef123 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] [instance: 50cd2f20-ca6b-4043-a2b5-a319aca9ed40] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:32.456387 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-db55496c-b3f3-4a58-bc18-44c19a8ef123 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:32.463740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-db55496c-b3f3-4a58-bc18-44c19a8ef123 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:32.464852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-db55496c-b3f3-4a58-bc18-44c19a8ef123 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:32.471417 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-db55496c-b3f3-4a58-bc18-44c19a8ef123 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:32.556461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0a1b28e6-bffc-4309-a990-d19dc55c8b39 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:32.568266 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0a1b28e6-bffc-4309-a990-d19dc55c8b39 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1210 microversion: 2.1 time: 0.197731 Jul 25 13:15:32.571418 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2935/5798] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:32 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1210 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:32.986837 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-db55496c-b3f3-4a58-bc18-44c19a8ef123 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b739ba60fa354ff9a0ef9e6cc01d7772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecb63aa224445e6912175d7b9360ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:32.995627 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-db55496c-b3f3-4a58-bc18-44c19a8ef123 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] 10.222.0.49 "GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40" status: 200 len: 1314 microversion: 2.1 time: 0.558912 Jul 25 13:15:33.000274 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2864/5799] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:32 2022] GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:33.594142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d7f2f84f-c4ba-4429-9808-3aa7d2580b9d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:33.595070 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d7f2f84f-c4ba-4429-9808-3aa7d2580b9d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:33.620995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7f2f84f-c4ba-4429-9808-3aa7d2580b9d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:33.621531 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7f2f84f-c4ba-4429-9808-3aa7d2580b9d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:33.624717 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7f2f84f-c4ba-4429-9808-3aa7d2580b9d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:33.625766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d7f2f84f-c4ba-4429-9808-3aa7d2580b9d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:34.022904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7d01b036-367d-4136-a4c0-3083e98dcdac tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:34.023747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7d01b036-367d-4136-a4c0-3083e98dcdac tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] [instance: 50cd2f20-ca6b-4043-a2b5-a319aca9ed40] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:34.036996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:15:34.040904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7d01b036-367d-4136-a4c0-3083e98dcdac tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:34.041727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7d01b036-367d-4136-a4c0-3083e98dcdac tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:34.044840 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7d01b036-367d-4136-a4c0-3083e98dcdac tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:34.046095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7d01b036-367d-4136-a4c0-3083e98dcdac tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:34.278724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d7f2f84f-c4ba-4429-9808-3aa7d2580b9d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:34.296498 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d7f2f84f-c4ba-4429-9808-3aa7d2580b9d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1210 microversion: 2.1 time: 0.705472 Jul 25 13:15:34.313548 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2936/5800] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:33 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1210 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:34.720249 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7d01b036-367d-4136-a4c0-3083e98dcdac tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b739ba60fa354ff9a0ef9e6cc01d7772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecb63aa224445e6912175d7b9360ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:34.734425 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7d01b036-367d-4136-a4c0-3083e98dcdac tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] 10.222.0.49 "GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40" status: 200 len: 1314 microversion: 2.1 time: 0.715363 Jul 25 13:15:34.736940 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2865/5801] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:34 2022] GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40 => generated 1314 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:34.908238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fc3c4d8b-1cd8-4b0b-80c1-f2c52b62fe01 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:34.908894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fc3c4d8b-1cd8-4b0b-80c1-f2c52b62fe01 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:34.924475 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc3c4d8b-1cd8-4b0b-80c1-f2c52b62fe01 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:34.926864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc3c4d8b-1cd8-4b0b-80c1-f2c52b62fe01 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:34.927964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc3c4d8b-1cd8-4b0b-80c1-f2c52b62fe01 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:34.928523 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc3c4d8b-1cd8-4b0b-80c1-f2c52b62fe01 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:34.993673 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fc3c4d8b-1cd8-4b0b-80c1-f2c52b62fe01 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e/ips" status: 200 len: 152 microversion: 2.20 time: 0.091650 Jul 25 13:15:34.995946 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2937/5802] 10.222.0.49 () {60 vars in 1289 bytes} [Mon Jul 25 13:15:34 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e/ips => generated 152 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:15:35.321869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-78cfecfd-fdd8-4d89-a68d-2cbbb02bfa66 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:35.322690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-78cfecfd-fdd8-4d89-a68d-2cbbb02bfa66 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:35.335813 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78cfecfd-fdd8-4d89-a68d-2cbbb02bfa66 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:35.336628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78cfecfd-fdd8-4d89-a68d-2cbbb02bfa66 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:35.339331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78cfecfd-fdd8-4d89-a68d-2cbbb02bfa66 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:35.342177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78cfecfd-fdd8-4d89-a68d-2cbbb02bfa66 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:35.760394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-59aac0ed-eab7-4530-95b3-6b0c57635dc5 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:35.761107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-59aac0ed-eab7-4530-95b3-6b0c57635dc5 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] [instance: 50cd2f20-ca6b-4043-a2b5-a319aca9ed40] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:35.767802 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59aac0ed-eab7-4530-95b3-6b0c57635dc5 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:35.772940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59aac0ed-eab7-4530-95b3-6b0c57635dc5 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:35.774211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59aac0ed-eab7-4530-95b3-6b0c57635dc5 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:35.775781 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-59aac0ed-eab7-4530-95b3-6b0c57635dc5 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:35.869570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-78cfecfd-fdd8-4d89-a68d-2cbbb02bfa66 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:35.884178 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-78cfecfd-fdd8-4d89-a68d-2cbbb02bfa66 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1278 microversion: 2.1 time: 0.566812 Jul 25 13:15:35.885779 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2866/5803] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:35 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1278 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:36.245857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-59aac0ed-eab7-4530-95b3-6b0c57635dc5 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b739ba60fa354ff9a0ef9e6cc01d7772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecb63aa224445e6912175d7b9360ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:36.260261 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-59aac0ed-eab7-4530-95b3-6b0c57635dc5 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] 10.222.0.49 "GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40" status: 200 len: 1314 microversion: 2.1 time: 0.499433 Jul 25 13:15:36.261291 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2938/5804] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:35 2022] GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40 => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:15:36.270011 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-5089e1eb-98a2-46ce-94c7-81055f93d93b req-c1aed7ba-d2c8-4770-aef9-62452ab55f34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "122cf21d-eead-4a88-b0f5-0c7b839fd163", "tag": "411fe352-2a1f-4b6e-b77b-b0d11abcce56"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:15:36.327914 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-5089e1eb-98a2-46ce-94c7-81055f93d93b req-c1aed7ba-d2c8-4770-aef9-62452ab55f34 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:36.328490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-5089e1eb-98a2-46ce-94c7-81055f93d93b req-c1aed7ba-d2c8-4770-aef9-62452ab55f34 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:36.373110 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-5089e1eb-98a2-46ce-94c7-81055f93d93b req-c1aed7ba-d2c8-4770-aef9-62452ab55f34 service nova] Creating event network-changed:411fe352-2a1f-4b6e-b77b-b0d11abcce56 for instance 122cf21d-eead-4a88-b0f5-0c7b839fd163 on n-h1-848886-15 Jul 25 13:15:36.405844 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-5089e1eb-98a2-46ce-94c7-81055f93d93b req-c1aed7ba-d2c8-4770-aef9-62452ab55f34 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142192 Jul 25 13:15:36.407510 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2867/5805] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:15:36.933513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fa672d5e-aacf-4904-8ab7-71e854b4153d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:36.935145 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fa672d5e-aacf-4904-8ab7-71e854b4153d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:36.960079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa672d5e-aacf-4904-8ab7-71e854b4153d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:36.960545 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa672d5e-aacf-4904-8ab7-71e854b4153d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:36.961503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa672d5e-aacf-4904-8ab7-71e854b4153d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:36.965928 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa672d5e-aacf-4904-8ab7-71e854b4153d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:37.291855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d4118aca-1ece-431c-a9da-784fac02a86a tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:37.292626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d4118aca-1ece-431c-a9da-784fac02a86a tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] [instance: 50cd2f20-ca6b-4043-a2b5-a319aca9ed40] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:37.307956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4118aca-1ece-431c-a9da-784fac02a86a tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:37.308453 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4118aca-1ece-431c-a9da-784fac02a86a tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:37.309477 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4118aca-1ece-431c-a9da-784fac02a86a tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:37.309889 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4118aca-1ece-431c-a9da-784fac02a86a tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:37.482913 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fa672d5e-aacf-4904-8ab7-71e854b4153d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:37.493771 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fa672d5e-aacf-4904-8ab7-71e854b4153d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1278 microversion: 2.1 time: 0.587185 Jul 25 13:15:37.499004 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2939/5806] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:36 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1278 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:37.626844 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d4118aca-1ece-431c-a9da-784fac02a86a tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b739ba60fa354ff9a0ef9e6cc01d7772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecb63aa224445e6912175d7b9360ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:37.646263 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d4118aca-1ece-431c-a9da-784fac02a86a tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] 10.222.0.49 "GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40" status: 200 len: 1314 microversion: 2.1 time: 0.353507 Jul 25 13:15:37.652507 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2868/5807] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:37 2022] GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:38.242239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4055aba4-e6c0-43ec-8b21-1b428c8914fd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:15:38.243027 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4055aba4-e6c0-43ec-8b21-1b428c8914fd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:38.256568 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4055aba4-e6c0-43ec-8b21-1b428c8914fd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:38.263679 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4055aba4-e6c0-43ec-8b21-1b428c8914fd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:38.264675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4055aba4-e6c0-43ec-8b21-1b428c8914fd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:38.268276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4055aba4-e6c0-43ec-8b21-1b428c8914fd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:38.310538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-4055aba4-e6c0-43ec-8b21-1b428c8914fd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lazy-loading 'flavor' on Instance uuid 5ecfb163-569c-483d-9fbd-14c3b45d649e {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:15:38.407342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:15:38.520199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d272fdd0-56a3-461c-b605-0cf4b00ac360 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:38.521017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d272fdd0-56a3-461c-b605-0cf4b00ac360 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:38.538601 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d272fdd0-56a3-461c-b605-0cf4b00ac360 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:38.539926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d272fdd0-56a3-461c-b605-0cf4b00ac360 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:38.541500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d272fdd0-56a3-461c-b605-0cf4b00ac360 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:38.542005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d272fdd0-56a3-461c-b605-0cf4b00ac360 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:38.727779 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4055aba4-e6c0-43ec-8b21-1b428c8914fd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "POST /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e/action" status: 202 len: 0 microversion: 2.20 time: 0.488405 Jul 25 13:15:38.747497 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2940/5808] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Jul 25 13:15:38 2022] POST /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:15:38.782598 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-44a7ec45-8f6e-4792-af9d-08e6e7b1c841 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:38.783656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-44a7ec45-8f6e-4792-af9d-08e6e7b1c841 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] [instance: 50cd2f20-ca6b-4043-a2b5-a319aca9ed40] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:38.829665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44a7ec45-8f6e-4792-af9d-08e6e7b1c841 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:38.831949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44a7ec45-8f6e-4792-af9d-08e6e7b1c841 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:38.833446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44a7ec45-8f6e-4792-af9d-08e6e7b1c841 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:38.837863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-44a7ec45-8f6e-4792-af9d-08e6e7b1c841 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:38.952351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d272fdd0-56a3-461c-b605-0cf4b00ac360 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:38.966619 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d272fdd0-56a3-461c-b605-0cf4b00ac360 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1278 microversion: 2.1 time: 0.446614 Jul 25 13:15:38.967683 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2869/5809] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:38 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1278 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:38.997917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-20a1f5db-ab38-47f7-8d52-cc4f8fe05977 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:38.999479 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-20a1f5db-ab38-47f7-8d52-cc4f8fe05977 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:39.007295 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20a1f5db-ab38-47f7-8d52-cc4f8fe05977 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:39.008044 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20a1f5db-ab38-47f7-8d52-cc4f8fe05977 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:39.009011 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20a1f5db-ab38-47f7-8d52-cc4f8fe05977 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:39.009744 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20a1f5db-ab38-47f7-8d52-cc4f8fe05977 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:39.151623 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-44a7ec45-8f6e-4792-af9d-08e6e7b1c841 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b739ba60fa354ff9a0ef9e6cc01d7772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecb63aa224445e6912175d7b9360ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:39.174014 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-44a7ec45-8f6e-4792-af9d-08e6e7b1c841 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] 10.222.0.49 "GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40" status: 200 len: 1314 microversion: 2.1 time: 0.413110 Jul 25 13:15:39.174624 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2941/5810] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:38 2022] GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40 => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:39.292104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-20a1f5db-ab38-47f7-8d52-cc4f8fe05977 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:39.301743 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-20a1f5db-ab38-47f7-8d52-cc4f8fe05977 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:39.303599 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-20a1f5db-ab38-47f7-8d52-cc4f8fe05977 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:39.306717 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-20a1f5db-ab38-47f7-8d52-cc4f8fe05977 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1724 microversion: 2.20 time: 0.313053 Jul 25 13:15:39.308789 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2870/5811] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:15:38 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1724 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:15:39.977849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-d0fc9a7b-39b3-49b0-a099-1f036b9f354b req-1ece734d-462c-4f4d-b087-091f5730e378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50cd2f20-ca6b-4043-a2b5-a319aca9ed40", "name": "network-vif-plugged", "status": "completed", "tag": "8f42e6d9-db11-49b2-96eb-035f2a4b5f5a"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:15:39.988339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d2483e23-b53f-47b4-9712-3aabef47d8ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:39.988979 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d2483e23-b53f-47b4-9712-3aabef47d8ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:39.996429 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2483e23-b53f-47b4-9712-3aabef47d8ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:39.997312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2483e23-b53f-47b4-9712-3aabef47d8ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:39.998346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2483e23-b53f-47b4-9712-3aabef47d8ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:39.998975 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2483e23-b53f-47b4-9712-3aabef47d8ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:40.010743 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d0fc9a7b-39b3-49b0-a099-1f036b9f354b req-1ece734d-462c-4f4d-b087-091f5730e378 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:40.011197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d0fc9a7b-39b3-49b0-a099-1f036b9f354b req-1ece734d-462c-4f4d-b087-091f5730e378 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:40.039855 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-d0fc9a7b-39b3-49b0-a099-1f036b9f354b req-1ece734d-462c-4f4d-b087-091f5730e378 service nova] Creating event network-vif-plugged:8f42e6d9-db11-49b2-96eb-035f2a4b5f5a for instance 50cd2f20-ca6b-4043-a2b5-a319aca9ed40 on n-h2-848886-15 Jul 25 13:15:40.053808 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-d0fc9a7b-39b3-49b0-a099-1f036b9f354b req-1ece734d-462c-4f4d-b087-091f5730e378 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080745 Jul 25 13:15:40.054773 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2942/5812] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:15:40.196449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f89c9913-885c-43d7-a937-6e830585ff9d tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:40.197193 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f89c9913-885c-43d7-a937-6e830585ff9d tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] [instance: 50cd2f20-ca6b-4043-a2b5-a319aca9ed40] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:40.213716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f89c9913-885c-43d7-a937-6e830585ff9d tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:40.214210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f89c9913-885c-43d7-a937-6e830585ff9d tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:40.215005 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f89c9913-885c-43d7-a937-6e830585ff9d tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:40.231163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f89c9913-885c-43d7-a937-6e830585ff9d tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:40.442394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:15:40.464864 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d2483e23-b53f-47b4-9712-3aabef47d8ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:40.474199 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d2483e23-b53f-47b4-9712-3aabef47d8ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1278 microversion: 2.1 time: 0.489766 Jul 25 13:15:40.484316 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2871/5813] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:39 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1278 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:40.501200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-abe13ae1-f68d-4d9a-bb59-d63116e25332 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:40.501883 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-abe13ae1-f68d-4d9a-bb59-d63116e25332 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:40.532652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-abe13ae1-f68d-4d9a-bb59-d63116e25332 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:40.538101 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-abe13ae1-f68d-4d9a-bb59-d63116e25332 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:40.539345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-abe13ae1-f68d-4d9a-bb59-d63116e25332 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:40.545146 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-abe13ae1-f68d-4d9a-bb59-d63116e25332 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:40.562265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:15:40.675855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f89c9913-885c-43d7-a937-6e830585ff9d tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b739ba60fa354ff9a0ef9e6cc01d7772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecb63aa224445e6912175d7b9360ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:40.691369 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f89c9913-885c-43d7-a937-6e830585ff9d tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] 10.222.0.49 "GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40" status: 200 len: 1314 microversion: 2.1 time: 0.499475 Jul 25 13:15:40.692712 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2943/5814] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:40 2022] GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40 => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:15:40.802456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-abe13ae1-f68d-4d9a-bb59-d63116e25332 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:40.813591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-abe13ae1-f68d-4d9a-bb59-d63116e25332 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:40.815643 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-abe13ae1-f68d-4d9a-bb59-d63116e25332 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:40.817191 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-abe13ae1-f68d-4d9a-bb59-d63116e25332 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1724 microversion: 2.20 time: 0.331715 Jul 25 13:15:40.818620 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2872/5815] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:15:40 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1724 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:15:41.498298 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f48a64f3-7e37-4a7a-9dfa-b5c2bb040613 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:41.499014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f48a64f3-7e37-4a7a-9dfa-b5c2bb040613 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:41.504762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=14 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:15:41.520095 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f48a64f3-7e37-4a7a-9dfa-b5c2bb040613 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:41.523890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f48a64f3-7e37-4a7a-9dfa-b5c2bb040613 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:41.526736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f48a64f3-7e37-4a7a-9dfa-b5c2bb040613 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:41.528643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f48a64f3-7e37-4a7a-9dfa-b5c2bb040613 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:41.713177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-745f4b70-0cda-4705-beed-40992e7a9dd9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:41.713998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-745f4b70-0cda-4705-beed-40992e7a9dd9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] [instance: 50cd2f20-ca6b-4043-a2b5-a319aca9ed40] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:41.726305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-745f4b70-0cda-4705-beed-40992e7a9dd9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:41.732306 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-745f4b70-0cda-4705-beed-40992e7a9dd9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:41.734388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-745f4b70-0cda-4705-beed-40992e7a9dd9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:41.735484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-745f4b70-0cda-4705-beed-40992e7a9dd9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:41.941919 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f48a64f3-7e37-4a7a-9dfa-b5c2bb040613 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:41.967330 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f48a64f3-7e37-4a7a-9dfa-b5c2bb040613 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1278 microversion: 2.1 time: 0.460647 Jul 25 13:15:41.968234 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2944/5816] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:41 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1278 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:41.975418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-88ad7cae-214a-4ed7-a5a4-6fb6e682abf0 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:41.978289 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-88ad7cae-214a-4ed7-a5a4-6fb6e682abf0 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:41.997211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88ad7cae-214a-4ed7-a5a4-6fb6e682abf0 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:41.998351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88ad7cae-214a-4ed7-a5a4-6fb6e682abf0 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:42.001397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88ad7cae-214a-4ed7-a5a4-6fb6e682abf0 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:42.002212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88ad7cae-214a-4ed7-a5a4-6fb6e682abf0 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:42.040912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-745f4b70-0cda-4705-beed-40992e7a9dd9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b739ba60fa354ff9a0ef9e6cc01d7772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecb63aa224445e6912175d7b9360ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:42.057997 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-745f4b70-0cda-4705-beed-40992e7a9dd9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] 10.222.0.49 "GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40" status: 200 len: 1314 microversion: 2.1 time: 0.341014 Jul 25 13:15:42.058844 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2873/5817] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:41 2022] GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:42.242664 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-88ad7cae-214a-4ed7-a5a4-6fb6e682abf0 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:42.252714 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-88ad7cae-214a-4ed7-a5a4-6fb6e682abf0 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:42.255883 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-88ad7cae-214a-4ed7-a5a4-6fb6e682abf0 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:42.260537 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-88ad7cae-214a-4ed7-a5a4-6fb6e682abf0 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1724 microversion: 2.20 time: 0.290013 Jul 25 13:15:42.275345 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2945/5818] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:15:41 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1724 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:15:42.989345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-83f78eb9-99e3-4243-8f7d-a5f5ce64591b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:42.990032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-83f78eb9-99e3-4243-8f7d-a5f5ce64591b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:43.006837 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-83f78eb9-99e3-4243-8f7d-a5f5ce64591b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:43.007295 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-83f78eb9-99e3-4243-8f7d-a5f5ce64591b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:43.008303 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-83f78eb9-99e3-4243-8f7d-a5f5ce64591b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:43.008926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-83f78eb9-99e3-4243-8f7d-a5f5ce64591b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:43.079683 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ce511b9d-779d-45f4-b9a3-94fcec87cf80 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:43.081537 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ce511b9d-779d-45f4-b9a3-94fcec87cf80 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] [instance: 50cd2f20-ca6b-4043-a2b5-a319aca9ed40] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:43.090024 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ce511b9d-779d-45f4-b9a3-94fcec87cf80 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:43.090920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ce511b9d-779d-45f4-b9a3-94fcec87cf80 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:43.091941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ce511b9d-779d-45f4-b9a3-94fcec87cf80 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:43.092563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ce511b9d-779d-45f4-b9a3-94fcec87cf80 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:43.519289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-83f78eb9-99e3-4243-8f7d-a5f5ce64591b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:43.526529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ce511b9d-779d-45f4-b9a3-94fcec87cf80 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b739ba60fa354ff9a0ef9e6cc01d7772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecb63aa224445e6912175d7b9360ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:43.530969 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-83f78eb9-99e3-4243-8f7d-a5f5ce64591b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1266 microversion: 2.1 time: 0.546690 Jul 25 13:15:43.534367 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2874/5819] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:42 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1266 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:43.539257 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f5bd28c1-195f-4637-808d-c3258d1a9330 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:43.545780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f5bd28c1-195f-4637-808d-c3258d1a9330 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:43.552818 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ce511b9d-779d-45f4-b9a3-94fcec87cf80 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] 10.222.0.49 "GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40" status: 200 len: 1464 microversion: 2.1 time: 0.477003 Jul 25 13:15:43.554701 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2946/5820] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:43 2022] GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40 => generated 1464 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:15:43.568426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5bd28c1-195f-4637-808d-c3258d1a9330 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:43.568965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5bd28c1-195f-4637-808d-c3258d1a9330 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:43.569853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5bd28c1-195f-4637-808d-c3258d1a9330 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:43.570363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5bd28c1-195f-4637-808d-c3258d1a9330 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:43.583875 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2868ae21-3dc9-4703-8578-7e836724b43f tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d854b4b7-516b-41e2-b02d-2ebab2671f8f", "device": "/dev/sdb"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:15:43.591680 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2868ae21-3dc9-4703-8578-7e836724b43f tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] [instance: 50cd2f20-ca6b-4043-a2b5-a319aca9ed40] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:43.609919 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2868ae21-3dc9-4703-8578-7e836724b43f tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:43.611906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2868ae21-3dc9-4703-8578-7e836724b43f tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:43.613049 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2868ae21-3dc9-4703-8578-7e836724b43f tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:43.615251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2868ae21-3dc9-4703-8578-7e836724b43f tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:43.774989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f5bd28c1-195f-4637-808d-c3258d1a9330 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:43.784940 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f5bd28c1-195f-4637-808d-c3258d1a9330 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:43.787350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f5bd28c1-195f-4637-808d-c3258d1a9330 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:43.788948 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f5bd28c1-195f-4637-808d-c3258d1a9330 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1724 microversion: 2.20 time: 0.253553 Jul 25 13:15:43.789788 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2875/5821] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:15:43 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:15:43.935797 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2868ae21-3dc9-4703-8578-7e836724b43f tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] 10.222.0.49 "POST /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.360200 Jul 25 13:15:43.942016 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2947/5822] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Jul 25 13:15:43 2022] POST /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40/os-volume_attachments => generated 194 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:15:44.553024 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3d255546-743c-427b-89d6-fab5fea0e3c6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:44.553648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3d255546-743c-427b-89d6-fab5fea0e3c6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:44.565424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3d255546-743c-427b-89d6-fab5fea0e3c6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:44.569618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3d255546-743c-427b-89d6-fab5fea0e3c6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:44.573492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3d255546-743c-427b-89d6-fab5fea0e3c6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:44.574151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3d255546-743c-427b-89d6-fab5fea0e3c6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:44.813180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6094fb74-e1b1-49c3-8fe5-c93702cb996d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:44.814045 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6094fb74-e1b1-49c3-8fe5-c93702cb996d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:44.828776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3d255546-743c-427b-89d6-fab5fea0e3c6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:44.835676 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6094fb74-e1b1-49c3-8fe5-c93702cb996d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:44.836425 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6094fb74-e1b1-49c3-8fe5-c93702cb996d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:44.838806 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6094fb74-e1b1-49c3-8fe5-c93702cb996d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:44.839242 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3d255546-743c-427b-89d6-fab5fea0e3c6 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1266 microversion: 2.1 time: 0.290385 Jul 25 13:15:44.840678 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2876/5823] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:44 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1266 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:44.842662 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6094fb74-e1b1-49c3-8fe5-c93702cb996d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:45.112828 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6094fb74-e1b1-49c3-8fe5-c93702cb996d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:45.122446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6094fb74-e1b1-49c3-8fe5-c93702cb996d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:45.124620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6094fb74-e1b1-49c3-8fe5-c93702cb996d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:45.126111 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6094fb74-e1b1-49c3-8fe5-c93702cb996d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1724 microversion: 2.20 time: 0.318165 Jul 25 13:15:45.126942 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2948/5824] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:15:44 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1724 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:15:45.861143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9ade3c49-e26e-4f7f-927d-4f3e7d9cb756 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:45.861779 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9ade3c49-e26e-4f7f-927d-4f3e7d9cb756 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:45.875340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ade3c49-e26e-4f7f-927d-4f3e7d9cb756 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:45.876412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ade3c49-e26e-4f7f-927d-4f3e7d9cb756 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:45.877535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ade3c49-e26e-4f7f-927d-4f3e7d9cb756 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:45.878134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ade3c49-e26e-4f7f-927d-4f3e7d9cb756 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:46.151813 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c44c3acf-cdf4-4d33-a6b8-2f1591ed117d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:46.153602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c44c3acf-cdf4-4d33-a6b8-2f1591ed117d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:46.165200 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:15:46.178312 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c44c3acf-cdf4-4d33-a6b8-2f1591ed117d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:46.178784 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c44c3acf-cdf4-4d33-a6b8-2f1591ed117d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:46.179594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c44c3acf-cdf4-4d33-a6b8-2f1591ed117d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:46.180142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c44c3acf-cdf4-4d33-a6b8-2f1591ed117d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:46.320749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9ade3c49-e26e-4f7f-927d-4f3e7d9cb756 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:46.336691 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9ade3c49-e26e-4f7f-927d-4f3e7d9cb756 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1266 microversion: 2.1 time: 0.479460 Jul 25 13:15:46.337390 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2877/5825] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:45 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1266 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:46.473597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c44c3acf-cdf4-4d33-a6b8-2f1591ed117d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:46.488050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c44c3acf-cdf4-4d33-a6b8-2f1591ed117d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:46.489656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c44c3acf-cdf4-4d33-a6b8-2f1591ed117d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:46.491044 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c44c3acf-cdf4-4d33-a6b8-2f1591ed117d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1724 microversion: 2.20 time: 0.345667 Jul 25 13:15:46.491683 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2949/5826] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:15:46 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1724 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:15:47.359539 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d704cc61-288f-4770-bab0-e93191f67294 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:47.361329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d704cc61-288f-4770-bab0-e93191f67294 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:47.370849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=51 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:15:47.373107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d704cc61-288f-4770-bab0-e93191f67294 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:47.374010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d704cc61-288f-4770-bab0-e93191f67294 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:47.376847 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d704cc61-288f-4770-bab0-e93191f67294 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:47.378252 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d704cc61-288f-4770-bab0-e93191f67294 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:47.513750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0b13c2cd-c04e-41d5-85c8-169fd2752ebe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:47.515008 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0b13c2cd-c04e-41d5-85c8-169fd2752ebe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:47.536252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b13c2cd-c04e-41d5-85c8-169fd2752ebe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:47.537118 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b13c2cd-c04e-41d5-85c8-169fd2752ebe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:47.540317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b13c2cd-c04e-41d5-85c8-169fd2752ebe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:47.542058 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0b13c2cd-c04e-41d5-85c8-169fd2752ebe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:47.652192 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d704cc61-288f-4770-bab0-e93191f67294 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:47.666027 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d704cc61-288f-4770-bab0-e93191f67294 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1266 microversion: 2.1 time: 0.311380 Jul 25 13:15:47.677883 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2878/5827] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:47 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1266 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:47.804332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0b13c2cd-c04e-41d5-85c8-169fd2752ebe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:47.815693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0b13c2cd-c04e-41d5-85c8-169fd2752ebe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:47.823699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0b13c2cd-c04e-41d5-85c8-169fd2752ebe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:47.824975 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0b13c2cd-c04e-41d5-85c8-169fd2752ebe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1724 microversion: 2.20 time: 0.315599 Jul 25 13:15:47.825550 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2950/5828] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:15:47 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1724 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:15:48.690585 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0cb92494-b254-40a7-9ac0-c78f6568ec58 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:48.691957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0cb92494-b254-40a7-9ac0-c78f6568ec58 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:48.700699 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0cb92494-b254-40a7-9ac0-c78f6568ec58 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:48.702134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0cb92494-b254-40a7-9ac0-c78f6568ec58 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:48.703343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0cb92494-b254-40a7-9ac0-c78f6568ec58 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:48.704034 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0cb92494-b254-40a7-9ac0-c78f6568ec58 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:48.861583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ded4f1db-678a-4346-8dea-769d69677718 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:48.863699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ded4f1db-678a-4346-8dea-769d69677718 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:48.880046 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ded4f1db-678a-4346-8dea-769d69677718 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:48.880500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ded4f1db-678a-4346-8dea-769d69677718 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:48.881293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ded4f1db-678a-4346-8dea-769d69677718 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:48.881728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ded4f1db-678a-4346-8dea-769d69677718 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:48.928379 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0cb92494-b254-40a7-9ac0-c78f6568ec58 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:48.938765 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0cb92494-b254-40a7-9ac0-c78f6568ec58 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1266 microversion: 2.1 time: 0.252579 Jul 25 13:15:48.945639 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2879/5829] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:48 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:49.426131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ded4f1db-678a-4346-8dea-769d69677718 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:49.439498 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ded4f1db-678a-4346-8dea-769d69677718 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:49.445310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ded4f1db-678a-4346-8dea-769d69677718 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:49.448354 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ded4f1db-678a-4346-8dea-769d69677718 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1724 microversion: 2.20 time: 0.599168 Jul 25 13:15:49.449275 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2951/5830] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:15:48 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1724 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:15:49.964837 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-07493054-3cf6-4880-a940-1a6b2b8bbc26 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:49.965406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-07493054-3cf6-4880-a940-1a6b2b8bbc26 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:49.977432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07493054-3cf6-4880-a940-1a6b2b8bbc26 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:49.978147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07493054-3cf6-4880-a940-1a6b2b8bbc26 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:49.980781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07493054-3cf6-4880-a940-1a6b2b8bbc26 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:49.981431 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-07493054-3cf6-4880-a940-1a6b2b8bbc26 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:50.172108 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-07493054-3cf6-4880-a940-1a6b2b8bbc26 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:50.183262 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-07493054-3cf6-4880-a940-1a6b2b8bbc26 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1266 microversion: 2.1 time: 0.222494 Jul 25 13:15:50.184185 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2880/5831] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:49 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:50.472758 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7027dd11-b20f-4300-a9c4-89ce50ae4b60 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:50.474036 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7027dd11-b20f-4300-a9c4-89ce50ae4b60 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:50.481766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7027dd11-b20f-4300-a9c4-89ce50ae4b60 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:50.482508 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7027dd11-b20f-4300-a9c4-89ce50ae4b60 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:50.483734 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7027dd11-b20f-4300-a9c4-89ce50ae4b60 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:50.484233 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7027dd11-b20f-4300-a9c4-89ce50ae4b60 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:50.624372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7027dd11-b20f-4300-a9c4-89ce50ae4b60 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:50.652201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7027dd11-b20f-4300-a9c4-89ce50ae4b60 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:50.658061 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7027dd11-b20f-4300-a9c4-89ce50ae4b60 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:50.659434 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7027dd11-b20f-4300-a9c4-89ce50ae4b60 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1745 microversion: 2.20 time: 0.190698 Jul 25 13:15:50.660032 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2952/5832] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:15:50 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1745 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:15:51.204777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2d514f21-f601-4184-b1ac-f6579a638d81 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:51.205430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2d514f21-f601-4184-b1ac-f6579a638d81 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:51.219996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d514f21-f601-4184-b1ac-f6579a638d81 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:51.222858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d514f21-f601-4184-b1ac-f6579a638d81 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:51.223872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d514f21-f601-4184-b1ac-f6579a638d81 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:51.224818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d514f21-f601-4184-b1ac-f6579a638d81 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:51.476413 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2d514f21-f601-4184-b1ac-f6579a638d81 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:51.486061 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2d514f21-f601-4184-b1ac-f6579a638d81 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1266 microversion: 2.1 time: 0.285526 Jul 25 13:15:51.486662 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2881/5833] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:51 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:51.686350 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6a5da2ee-18cf-45fc-b7b7-89aa063b5347 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:51.688076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6a5da2ee-18cf-45fc-b7b7-89aa063b5347 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:51.705592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a5da2ee-18cf-45fc-b7b7-89aa063b5347 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:51.707102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a5da2ee-18cf-45fc-b7b7-89aa063b5347 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:51.709282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a5da2ee-18cf-45fc-b7b7-89aa063b5347 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:51.711031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a5da2ee-18cf-45fc-b7b7-89aa063b5347 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:51.994918 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6a5da2ee-18cf-45fc-b7b7-89aa063b5347 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:52.026430 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6a5da2ee-18cf-45fc-b7b7-89aa063b5347 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:52.038926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6a5da2ee-18cf-45fc-b7b7-89aa063b5347 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:52.042010 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6a5da2ee-18cf-45fc-b7b7-89aa063b5347 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1740 microversion: 2.20 time: 0.360156 Jul 25 13:15:52.059306 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2953/5834] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:15:51 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1740 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:15:52.509555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0332945c-b83f-4d83-abbb-a789788b744d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:52.510237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0332945c-b83f-4d83-abbb-a789788b744d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:52.543194 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0332945c-b83f-4d83-abbb-a789788b744d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:52.543715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0332945c-b83f-4d83-abbb-a789788b744d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:52.553986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0332945c-b83f-4d83-abbb-a789788b744d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:52.557865 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0332945c-b83f-4d83-abbb-a789788b744d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:53.074375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-09b2e4da-3dda-4c2c-8f57-11adeb90388f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:53.075181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-09b2e4da-3dda-4c2c-8f57-11adeb90388f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:53.087897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09b2e4da-3dda-4c2c-8f57-11adeb90388f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:53.088389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09b2e4da-3dda-4c2c-8f57-11adeb90388f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:53.089227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09b2e4da-3dda-4c2c-8f57-11adeb90388f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:53.089671 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09b2e4da-3dda-4c2c-8f57-11adeb90388f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:53.096796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0332945c-b83f-4d83-abbb-a789788b744d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:53.142288 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0332945c-b83f-4d83-abbb-a789788b744d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1266 microversion: 2.1 time: 0.609211 Jul 25 13:15:53.142288 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2882/5835] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:52 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1266 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:53.766696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-09b2e4da-3dda-4c2c-8f57-11adeb90388f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:53.777133 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-09b2e4da-3dda-4c2c-8f57-11adeb90388f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:53.779078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-09b2e4da-3dda-4c2c-8f57-11adeb90388f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:53.781095 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-09b2e4da-3dda-4c2c-8f57-11adeb90388f tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1740 microversion: 2.20 time: 0.713613 Jul 25 13:15:53.782548 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2954/5836] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:15:53 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1740 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:15:54.140918 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cb7147ba-0d4f-48ca-8770-3e0a7f7aaa5c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:54.142278 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cb7147ba-0d4f-48ca-8770-3e0a7f7aaa5c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:54.156845 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb7147ba-0d4f-48ca-8770-3e0a7f7aaa5c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:54.160100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb7147ba-0d4f-48ca-8770-3e0a7f7aaa5c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:54.163786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb7147ba-0d4f-48ca-8770-3e0a7f7aaa5c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:54.164949 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb7147ba-0d4f-48ca-8770-3e0a7f7aaa5c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:54.416999 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cb7147ba-0d4f-48ca-8770-3e0a7f7aaa5c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:54.426377 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cb7147ba-0d4f-48ca-8770-3e0a7f7aaa5c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1266 microversion: 2.1 time: 0.289512 Jul 25 13:15:54.430403 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2883/5837] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:54 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:54.818583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fdd5f6bb-941e-4ce0-8e4e-3a8d0c62f3c7 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:54.827615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fdd5f6bb-941e-4ce0-8e4e-3a8d0c62f3c7 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:54.835799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fdd5f6bb-941e-4ce0-8e4e-3a8d0c62f3c7 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:54.837537 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fdd5f6bb-941e-4ce0-8e4e-3a8d0c62f3c7 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:54.838749 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fdd5f6bb-941e-4ce0-8e4e-3a8d0c62f3c7 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:54.839324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fdd5f6bb-941e-4ce0-8e4e-3a8d0c62f3c7 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:55.146948 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fdd5f6bb-941e-4ce0-8e4e-3a8d0c62f3c7 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:55.163282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fdd5f6bb-941e-4ce0-8e4e-3a8d0c62f3c7 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:55.172592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fdd5f6bb-941e-4ce0-8e4e-3a8d0c62f3c7 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:55.174025 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fdd5f6bb-941e-4ce0-8e4e-3a8d0c62f3c7 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1740 microversion: 2.20 time: 0.370020 Jul 25 13:15:55.175832 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2955/5838] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:15:54 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1740 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:15:55.452971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8313284c-4390-4a05-bcc5-afda9a8028e3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:55.453591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8313284c-4390-4a05-bcc5-afda9a8028e3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:55.474996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8313284c-4390-4a05-bcc5-afda9a8028e3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:55.477445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8313284c-4390-4a05-bcc5-afda9a8028e3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:55.481301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8313284c-4390-4a05-bcc5-afda9a8028e3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:55.481764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8313284c-4390-4a05-bcc5-afda9a8028e3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:55.900715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-1e905454-9329-4d86-b4b5-b08649ce100c req-7b886a1a-74d5-438b-aa1f-8ae5c70fd0fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "122cf21d-eead-4a88-b0f5-0c7b839fd163", "name": "network-vif-plugged", "status": "completed", "tag": "411fe352-2a1f-4b6e-b77b-b0d11abcce56"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:15:55.924625 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-1e905454-9329-4d86-b4b5-b08649ce100c req-7b886a1a-74d5-438b-aa1f-8ae5c70fd0fb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:55.925309 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-1e905454-9329-4d86-b4b5-b08649ce100c req-7b886a1a-74d5-438b-aa1f-8ae5c70fd0fb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:55.953117 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-1e905454-9329-4d86-b4b5-b08649ce100c req-7b886a1a-74d5-438b-aa1f-8ae5c70fd0fb service nova] Creating event network-vif-plugged:411fe352-2a1f-4b6e-b77b-b0d11abcce56 for instance 122cf21d-eead-4a88-b0f5-0c7b839fd163 on n-h1-848886-15 Jul 25 13:15:55.971446 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-1e905454-9329-4d86-b4b5-b08649ce100c req-7b886a1a-74d5-438b-aa1f-8ae5c70fd0fb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078192 Jul 25 13:15:55.975419 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2956/5839] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 25 13:15:56.202909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-55092ccd-eff9-43e8-a028-48fa3e007f06 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:56.204151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-55092ccd-eff9-43e8-a028-48fa3e007f06 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:56.229491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-55092ccd-eff9-43e8-a028-48fa3e007f06 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:56.230139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-55092ccd-eff9-43e8-a028-48fa3e007f06 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:56.230979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-55092ccd-eff9-43e8-a028-48fa3e007f06 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:56.231418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-55092ccd-eff9-43e8-a028-48fa3e007f06 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:56.245420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:15:56.599732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-55092ccd-eff9-43e8-a028-48fa3e007f06 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:56.618341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-55092ccd-eff9-43e8-a028-48fa3e007f06 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:56.622562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-55092ccd-eff9-43e8-a028-48fa3e007f06 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:56.626791 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-55092ccd-eff9-43e8-a028-48fa3e007f06 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1740 microversion: 2.20 time: 0.429304 Jul 25 13:15:56.632990 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2957/5840] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:15:56 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1740 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:15:56.648120 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8313284c-4390-4a05-bcc5-afda9a8028e3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:56.677867 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8313284c-4390-4a05-bcc5-afda9a8028e3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1266 microversion: 2.1 time: 1.208655 Jul 25 13:15:56.677867 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2884/5841] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:55 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1266 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:57.656725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9cfdb493-412a-4b97-8016-186c69b37f0e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:57.657335 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9cfdb493-412a-4b97-8016-186c69b37f0e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:57.670765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9cfdb493-412a-4b97-8016-186c69b37f0e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:57.676056 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9cfdb493-412a-4b97-8016-186c69b37f0e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:57.679412 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9cfdb493-412a-4b97-8016-186c69b37f0e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:57.684660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9cfdb493-412a-4b97-8016-186c69b37f0e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:57.688788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e2353fa7-b34f-4edf-8910-4401c1adaeff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:57.690105 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e2353fa7-b34f-4edf-8910-4401c1adaeff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:57.703293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2353fa7-b34f-4edf-8910-4401c1adaeff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:57.704007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2353fa7-b34f-4edf-8910-4401c1adaeff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:57.707628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2353fa7-b34f-4edf-8910-4401c1adaeff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:57.709767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2353fa7-b34f-4edf-8910-4401c1adaeff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:58.154814 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e2353fa7-b34f-4edf-8910-4401c1adaeff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:58.178173 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e2353fa7-b34f-4edf-8910-4401c1adaeff tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1266 microversion: 2.1 time: 0.493291 Jul 25 13:15:58.193630 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2885/5842] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:57 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1266 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:15:58.216918 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-6d0bc837-7760-4e61-a354-3b4859f3e64d req-24fcf364-cb0f-49db-bf5b-8e53454071d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ecfb163-569c-483d-9fbd-14c3b45d649e", "name": "network-vif-plugged", "status": "completed", "tag": "6c96878c-7b90-42b3-b3aa-b61e8018fcee"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:15:58.227663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-6d0bc837-7760-4e61-a354-3b4859f3e64d req-24fcf364-cb0f-49db-bf5b-8e53454071d8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:58.228104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-6d0bc837-7760-4e61-a354-3b4859f3e64d req-24fcf364-cb0f-49db-bf5b-8e53454071d8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:58.268539 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-6d0bc837-7760-4e61-a354-3b4859f3e64d req-24fcf364-cb0f-49db-bf5b-8e53454071d8 service nova] Creating event network-vif-plugged:6c96878c-7b90-42b3-b3aa-b61e8018fcee for instance 5ecfb163-569c-483d-9fbd-14c3b45d649e on n-h1-848886-15 Jul 25 13:15:58.279066 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-6d0bc837-7760-4e61-a354-3b4859f3e64d req-24fcf364-cb0f-49db-bf5b-8e53454071d8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082940 Jul 25 13:15:58.279913 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2886/5843] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:15:58.302639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9cfdb493-412a-4b97-8016-186c69b37f0e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:58.315142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9cfdb493-412a-4b97-8016-186c69b37f0e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:58.316663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9cfdb493-412a-4b97-8016-186c69b37f0e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:58.331034 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9cfdb493-412a-4b97-8016-186c69b37f0e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1740 microversion: 2.20 time: 0.665169 Jul 25 13:15:58.332050 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2958/5844] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:15:57 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1740 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:15:59.218378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3fa2b550-fb88-4e04-943c-087d5abbf488 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:59.221413 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3fa2b550-fb88-4e04-943c-087d5abbf488 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:59.238853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3fa2b550-fb88-4e04-943c-087d5abbf488 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:59.247869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3fa2b550-fb88-4e04-943c-087d5abbf488 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:59.249705 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3fa2b550-fb88-4e04-943c-087d5abbf488 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:59.252548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3fa2b550-fb88-4e04-943c-087d5abbf488 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:59.384276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ebcab12e-de58-4d4d-bbd2-fb594f828e87 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:59.386142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ebcab12e-de58-4d4d-bbd2-fb594f828e87 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:59.416651 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ebcab12e-de58-4d4d-bbd2-fb594f828e87 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:59.417075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ebcab12e-de58-4d4d-bbd2-fb594f828e87 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:59.417946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ebcab12e-de58-4d4d-bbd2-fb594f828e87 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:59.418384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ebcab12e-de58-4d4d-bbd2-fb594f828e87 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:59.853085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3fa2b550-fb88-4e04-943c-087d5abbf488 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:59.868409 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3fa2b550-fb88-4e04-943c-087d5abbf488 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1453 microversion: 2.1 time: 0.657363 Jul 25 13:15:59.874244 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2887/5845] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:59 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1453 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:15:59.896791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-78a0095a-4f5a-414d-a062-70da82d17532 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:15:59.897713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-78a0095a-4f5a-414d-a062-70da82d17532 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:15:59.915904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78a0095a-4f5a-414d-a062-70da82d17532 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:59.922064 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78a0095a-4f5a-414d-a062-70da82d17532 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:59.922966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78a0095a-4f5a-414d-a062-70da82d17532 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:15:59.923434 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78a0095a-4f5a-414d-a062-70da82d17532 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:15:59.978360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ebcab12e-de58-4d4d-bbd2-fb594f828e87 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:59.990620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ebcab12e-de58-4d4d-bbd2-fb594f828e87 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:59.993163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ebcab12e-de58-4d4d-bbd2-fb594f828e87 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:15:59.995533 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ebcab12e-de58-4d4d-bbd2-fb594f828e87 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1740 microversion: 2.20 time: 0.619809 Jul 25 13:16:00.009458 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2959/5846] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:15:59 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1740 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:00.151826 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-78a0095a-4f5a-414d-a062-70da82d17532 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:00.161212 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-78a0095a-4f5a-414d-a062-70da82d17532 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1453 microversion: 2.1 time: 0.269194 Jul 25 13:16:00.168560 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2888/5847] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:15:59 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1453 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:16:01.021807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-68e53466-1bbe-4fb1-9a11-a559cf6642db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:01.022616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-68e53466-1bbe-4fb1-9a11-a559cf6642db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:01.036158 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68e53466-1bbe-4fb1-9a11-a559cf6642db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:01.045958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68e53466-1bbe-4fb1-9a11-a559cf6642db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:01.048366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68e53466-1bbe-4fb1-9a11-a559cf6642db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:01.053443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68e53466-1bbe-4fb1-9a11-a559cf6642db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:01.632976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-68e53466-1bbe-4fb1-9a11-a559cf6642db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:01.649957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-68e53466-1bbe-4fb1-9a11-a559cf6642db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:01.651935 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-68e53466-1bbe-4fb1-9a11-a559cf6642db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:01.653709 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-68e53466-1bbe-4fb1-9a11-a559cf6642db tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1740 microversion: 2.20 time: 0.636199 Jul 25 13:16:01.680010 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2960/5848] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:01 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1740 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:03.192899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4fa039c5-2e4c-43cd-9d19-f01e6392eb42 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:03.193730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4fa039c5-2e4c-43cd-9d19-f01e6392eb42 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:03.203896 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4fa039c5-2e4c-43cd-9d19-f01e6392eb42 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:03.206922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4fa039c5-2e4c-43cd-9d19-f01e6392eb42 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:03.207952 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4fa039c5-2e4c-43cd-9d19-f01e6392eb42 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:03.210515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4fa039c5-2e4c-43cd-9d19-f01e6392eb42 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:03.271452 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:16:03.711618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4fa039c5-2e4c-43cd-9d19-f01e6392eb42 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:03.723595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4fa039c5-2e4c-43cd-9d19-f01e6392eb42 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:03.727185 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4fa039c5-2e4c-43cd-9d19-f01e6392eb42 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:03.729405 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4fa039c5-2e4c-43cd-9d19-f01e6392eb42 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1740 microversion: 2.20 time: 1.046994 Jul 25 13:16:03.734150 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2889/5849] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:02 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1740 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:03.796198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-fee62b44-bb65-4b1c-bbae-9d16b5869ca0 req-a9d86795-e609-4a89-9fbc-4293378af928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "122cf21d-eead-4a88-b0f5-0c7b839fd163", "tag": "411fe352-2a1f-4b6e-b77b-b0d11abcce56"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:16:03.811677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fee62b44-bb65-4b1c-bbae-9d16b5869ca0 req-a9d86795-e609-4a89-9fbc-4293378af928 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:03.813325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fee62b44-bb65-4b1c-bbae-9d16b5869ca0 req-a9d86795-e609-4a89-9fbc-4293378af928 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:03.840976 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-fee62b44-bb65-4b1c-bbae-9d16b5869ca0 req-a9d86795-e609-4a89-9fbc-4293378af928 service nova] Creating event network-changed:411fe352-2a1f-4b6e-b77b-b0d11abcce56 for instance 122cf21d-eead-4a88-b0f5-0c7b839fd163 on n-h1-848886-15 Jul 25 13:16:03.853767 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-fee62b44-bb65-4b1c-bbae-9d16b5869ca0 req-a9d86795-e609-4a89-9fbc-4293378af928 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062694 Jul 25 13:16:03.857233 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2961/5850] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:16:04.756678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-56aa128f-5166-4d3d-b598-9a11c0a277e1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:04.757326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-56aa128f-5166-4d3d-b598-9a11c0a277e1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:04.776414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56aa128f-5166-4d3d-b598-9a11c0a277e1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:04.779509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56aa128f-5166-4d3d-b598-9a11c0a277e1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:04.783096 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56aa128f-5166-4d3d-b598-9a11c0a277e1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:04.788710 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56aa128f-5166-4d3d-b598-9a11c0a277e1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:05.088810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-56aa128f-5166-4d3d-b598-9a11c0a277e1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:05.098387 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-56aa128f-5166-4d3d-b598-9a11c0a277e1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:05.114208 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-56aa128f-5166-4d3d-b598-9a11c0a277e1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:05.115838 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-56aa128f-5166-4d3d-b598-9a11c0a277e1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1740 microversion: 2.20 time: 0.363786 Jul 25 13:16:05.123767 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2890/5851] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:04 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1740 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:06.152431 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-831cb377-8f70-4db1-87b4-7901ac368f87 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:06.153376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-831cb377-8f70-4db1-87b4-7901ac368f87 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:06.172519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-831cb377-8f70-4db1-87b4-7901ac368f87 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:06.182668 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-831cb377-8f70-4db1-87b4-7901ac368f87 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:06.185649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-831cb377-8f70-4db1-87b4-7901ac368f87 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:06.186894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-831cb377-8f70-4db1-87b4-7901ac368f87 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:06.537445 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-831cb377-8f70-4db1-87b4-7901ac368f87 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:06.549661 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-831cb377-8f70-4db1-87b4-7901ac368f87 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:06.551932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-831cb377-8f70-4db1-87b4-7901ac368f87 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:06.553401 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-831cb377-8f70-4db1-87b4-7901ac368f87 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1740 microversion: 2.20 time: 0.408346 Jul 25 13:16:06.566668 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2962/5852] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:06 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1740 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:07.577100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bcf1a1cc-feee-4d26-b6b5-356e4e6624fb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:07.577740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bcf1a1cc-feee-4d26-b6b5-356e4e6624fb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:07.594523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bcf1a1cc-feee-4d26-b6b5-356e4e6624fb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:07.596864 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bcf1a1cc-feee-4d26-b6b5-356e4e6624fb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:07.598665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bcf1a1cc-feee-4d26-b6b5-356e4e6624fb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:07.599467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bcf1a1cc-feee-4d26-b6b5-356e4e6624fb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:08.081485 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bcf1a1cc-feee-4d26-b6b5-356e4e6624fb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:08.094654 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bcf1a1cc-feee-4d26-b6b5-356e4e6624fb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:08.097702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bcf1a1cc-feee-4d26-b6b5-356e4e6624fb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:08.101305 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bcf1a1cc-feee-4d26-b6b5-356e4e6624fb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1740 microversion: 2.20 time: 0.528319 Jul 25 13:16:08.103015 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2891/5853] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:07 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1740 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:09.129058 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9867acd5-9dce-44e0-ba1d-98104f99f838 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:09.130573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9867acd5-9dce-44e0-ba1d-98104f99f838 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:09.151286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9867acd5-9dce-44e0-ba1d-98104f99f838 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:09.153075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9867acd5-9dce-44e0-ba1d-98104f99f838 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:09.155641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9867acd5-9dce-44e0-ba1d-98104f99f838 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:09.157180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9867acd5-9dce-44e0-ba1d-98104f99f838 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:09.490428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9867acd5-9dce-44e0-ba1d-98104f99f838 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:09.510870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9867acd5-9dce-44e0-ba1d-98104f99f838 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:09.513108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9867acd5-9dce-44e0-ba1d-98104f99f838 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:09.519880 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9867acd5-9dce-44e0-ba1d-98104f99f838 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1740 microversion: 2.20 time: 0.391239 Jul 25 13:16:09.533462 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2963/5854] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:09 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1740 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:10.552770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-905ebb37-be92-41b1-b860-b48307c74fb1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:10.553555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-905ebb37-be92-41b1-b860-b48307c74fb1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:10.564320 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-905ebb37-be92-41b1-b860-b48307c74fb1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:10.565656 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-905ebb37-be92-41b1-b860-b48307c74fb1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:10.567504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-905ebb37-be92-41b1-b860-b48307c74fb1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:10.568148 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-905ebb37-be92-41b1-b860-b48307c74fb1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:10.880917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-905ebb37-be92-41b1-b860-b48307c74fb1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:10.891688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-905ebb37-be92-41b1-b860-b48307c74fb1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:10.893275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-905ebb37-be92-41b1-b860-b48307c74fb1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:10.895529 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-905ebb37-be92-41b1-b860-b48307c74fb1 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1740 microversion: 2.20 time: 0.347265 Jul 25 13:16:10.895529 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2892/5855] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:10 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1740 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:11.929737 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-785be397-2b74-422d-a52b-563af374b168 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:11.930862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-785be397-2b74-422d-a52b-563af374b168 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:11.962210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-785be397-2b74-422d-a52b-563af374b168 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:11.962210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-785be397-2b74-422d-a52b-563af374b168 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:11.962210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-785be397-2b74-422d-a52b-563af374b168 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:11.962210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-785be397-2b74-422d-a52b-563af374b168 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:12.284376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-785be397-2b74-422d-a52b-563af374b168 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:12.294768 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-785be397-2b74-422d-a52b-563af374b168 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:12.302909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-785be397-2b74-422d-a52b-563af374b168 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:12.305944 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-785be397-2b74-422d-a52b-563af374b168 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1722 microversion: 2.20 time: 0.384582 Jul 25 13:16:12.314777 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2964/5856] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:11 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1722 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:13.339827 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6d692767-6dcc-4776-a470-342039d15ff2 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:13.341049 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6d692767-6dcc-4776-a470-342039d15ff2 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:13.358936 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6d692767-6dcc-4776-a470-342039d15ff2 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:13.359420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6d692767-6dcc-4776-a470-342039d15ff2 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:13.360218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6d692767-6dcc-4776-a470-342039d15ff2 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:13.362330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6d692767-6dcc-4776-a470-342039d15ff2 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:13.514755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6d692767-6dcc-4776-a470-342039d15ff2 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:13.523576 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6d692767-6dcc-4776-a470-342039d15ff2 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:13.525642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6d692767-6dcc-4776-a470-342039d15ff2 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:13.527686 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6d692767-6dcc-4776-a470-342039d15ff2 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1722 microversion: 2.20 time: 0.193965 Jul 25 13:16:13.528694 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2893/5857] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:13 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:14.552187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-663c9dd1-1664-4ab4-b429-cdae3977f0bd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:14.553420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-663c9dd1-1664-4ab4-b429-cdae3977f0bd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:14.559981 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-663c9dd1-1664-4ab4-b429-cdae3977f0bd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:14.560631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-663c9dd1-1664-4ab4-b429-cdae3977f0bd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:14.561415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-663c9dd1-1664-4ab4-b429-cdae3977f0bd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:14.562027 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-663c9dd1-1664-4ab4-b429-cdae3977f0bd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:14.772818 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-663c9dd1-1664-4ab4-b429-cdae3977f0bd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:14.781619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-663c9dd1-1664-4ab4-b429-cdae3977f0bd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:14.783767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-663c9dd1-1664-4ab4-b429-cdae3977f0bd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:14.785307 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-663c9dd1-1664-4ab4-b429-cdae3977f0bd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1725 microversion: 2.20 time: 0.237988 Jul 25 13:16:14.789885 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2965/5858] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:14 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1725 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:14.808953 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-311e27ea-8f2a-4376-b2d7-fb9a7d4ffbdc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae12f987-4c01-4dec-9f6d-1d72d40a8751"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:16:14.811606 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-311e27ea-8f2a-4376-b2d7-fb9a7d4ffbdc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:14.819473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-311e27ea-8f2a-4376-b2d7-fb9a7d4ffbdc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:14.820223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-311e27ea-8f2a-4376-b2d7-fb9a7d4ffbdc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:14.821199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-311e27ea-8f2a-4376-b2d7-fb9a7d4ffbdc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:14.821820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-311e27ea-8f2a-4376-b2d7-fb9a7d4ffbdc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:15.222251 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-311e27ea-8f2a-4376-b2d7-fb9a7d4ffbdc tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "POST /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.417053 Jul 25 13:16:15.224131 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2894/5859] 10.222.0.49 () {62 vars in 1364 bytes} [Mon Jul 25 13:16:14 2022] POST /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e/os-volume_attachments => generated 188 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:16:15.427943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-27111bbf-5dfa-4e89-8bd7-98db98d92862 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:15.428782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-27111bbf-5dfa-4e89-8bd7-98db98d92862 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:15.436795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27111bbf-5dfa-4e89-8bd7-98db98d92862 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:15.437246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27111bbf-5dfa-4e89-8bd7-98db98d92862 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:15.438207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27111bbf-5dfa-4e89-8bd7-98db98d92862 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:15.438780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27111bbf-5dfa-4e89-8bd7-98db98d92862 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:15.458400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-d497c772-e572-426b-9b1a-790c0a226fc8 req-d24d949e-c3c0-45ed-9b1b-9c1cdb3a3f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ecfb163-569c-483d-9fbd-14c3b45d649e", "name": "network-vif-unplugged", "status": "completed", "tag": "6c96878c-7b90-42b3-b3aa-b61e8018fcee"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:16:15.477424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d497c772-e572-426b-9b1a-790c0a226fc8 req-d24d949e-c3c0-45ed-9b1b-9c1cdb3a3f79 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:15.478071 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d497c772-e572-426b-9b1a-790c0a226fc8 req-d24d949e-c3c0-45ed-9b1b-9c1cdb3a3f79 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:15.517349 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.compute.server_external_events [req-d497c772-e572-426b-9b1a-790c0a226fc8 req-d24d949e-c3c0-45ed-9b1b-9c1cdb3a3f79 service nova] Unable to find a host for instance 5ecfb163-569c-483d-9fbd-14c3b45d649e. Dropping event network-vif-unplugged {{(pid=125883) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 13:16:15.521704 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-d497c772-e572-426b-9b1a-790c0a226fc8 req-d24d949e-c3c0-45ed-9b1b-9c1cdb3a3f79 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.067498 Jul 25 13:16:15.525617 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2895/5860] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 72 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 25 13:16:15.792700 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-27111bbf-5dfa-4e89-8bd7-98db98d92862 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e/os-volume_attachments/ae12f987-4c01-4dec-9f6d-1d72d40a8751" status: 202 len: 0 microversion: 2.20 time: 0.372975 Jul 25 13:16:15.793934 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2966/5861] 10.222.0.49 () {60 vars in 1457 bytes} [Mon Jul 25 13:16:15 2022] DELETE /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e/os-volume_attachments/ae12f987-4c01-4dec-9f6d-1d72d40a8751 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:16:15.981565 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c6641ea3-acae-44c3-8ca8-39f8640fcbca tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:16:15.984039 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c6641ea3-acae-44c3-8ca8-39f8640fcbca tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:16.010002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c6641ea3-acae-44c3-8ca8-39f8640fcbca tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:16.010862 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c6641ea3-acae-44c3-8ca8-39f8640fcbca tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:16.012048 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c6641ea3-acae-44c3-8ca8-39f8640fcbca tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:16.012626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c6641ea3-acae-44c3-8ca8-39f8640fcbca tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:16.344577 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c6641ea3-acae-44c3-8ca8-39f8640fcbca tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "POST /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e/action" status: 202 len: 0 microversion: 2.20 time: 0.372724 Jul 25 13:16:16.345786 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2896/5862] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Jul 25 13:16:15 2022] POST /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:16:16.356660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0fdd35d5-5a81-47ac-9626-cd7484fab128 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:16.360263 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0fdd35d5-5a81-47ac-9626-cd7484fab128 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:16.376945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=36 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:16:16.381710 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0fdd35d5-5a81-47ac-9626-cd7484fab128 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:16.381937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0fdd35d5-5a81-47ac-9626-cd7484fab128 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:16.382689 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0fdd35d5-5a81-47ac-9626-cd7484fab128 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:16.385342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0fdd35d5-5a81-47ac-9626-cd7484fab128 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:16.632068 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0fdd35d5-5a81-47ac-9626-cd7484fab128 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:16.646617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0fdd35d5-5a81-47ac-9626-cd7484fab128 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:16.648533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0fdd35d5-5a81-47ac-9626-cd7484fab128 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:16.649948 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0fdd35d5-5a81-47ac-9626-cd7484fab128 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1673 microversion: 2.20 time: 0.299773 Jul 25 13:16:16.651678 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2967/5863] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:16 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1673 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:17.674191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9e6cebab-a578-40b2-a704-45956a5b8a40 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:17.675566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9e6cebab-a578-40b2-a704-45956a5b8a40 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:17.678069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=40 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:16:17.693051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e6cebab-a578-40b2-a704-45956a5b8a40 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:17.695765 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e6cebab-a578-40b2-a704-45956a5b8a40 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:17.697002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e6cebab-a578-40b2-a704-45956a5b8a40 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:17.698691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e6cebab-a578-40b2-a704-45956a5b8a40 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:17.905199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9e6cebab-a578-40b2-a704-45956a5b8a40 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:17.916032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9e6cebab-a578-40b2-a704-45956a5b8a40 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:17.917813 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9e6cebab-a578-40b2-a704-45956a5b8a40 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:17.926777 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9e6cebab-a578-40b2-a704-45956a5b8a40 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1673 microversion: 2.20 time: 0.258104 Jul 25 13:16:17.927910 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2897/5864] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:17 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1673 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:18.949648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3ca9300f-b1d2-41dc-967a-5d5fe1d91a83 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:18.950317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3ca9300f-b1d2-41dc-967a-5d5fe1d91a83 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:18.957677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ca9300f-b1d2-41dc-967a-5d5fe1d91a83 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:18.958166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ca9300f-b1d2-41dc-967a-5d5fe1d91a83 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:18.959187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ca9300f-b1d2-41dc-967a-5d5fe1d91a83 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:18.959801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ca9300f-b1d2-41dc-967a-5d5fe1d91a83 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:19.183602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3ca9300f-b1d2-41dc-967a-5d5fe1d91a83 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:19.199133 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3ca9300f-b1d2-41dc-967a-5d5fe1d91a83 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:19.200553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3ca9300f-b1d2-41dc-967a-5d5fe1d91a83 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:19.202017 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3ca9300f-b1d2-41dc-967a-5d5fe1d91a83 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1731 microversion: 2.20 time: 0.255989 Jul 25 13:16:19.213716 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2968/5865] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:18 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1731 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:16:20.176874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-0e9a609d-e20d-4709-8e63-0b41f77a26ec req-de2bcf68-c6f3-41c0-96c7-81b48e74e999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ecfb163-569c-483d-9fbd-14c3b45d649e", "tag": "6c96878c-7b90-42b3-b3aa-b61e8018fcee"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:16:20.202619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0e9a609d-e20d-4709-8e63-0b41f77a26ec req-de2bcf68-c6f3-41c0-96c7-81b48e74e999 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:20.203482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0e9a609d-e20d-4709-8e63-0b41f77a26ec req-de2bcf68-c6f3-41c0-96c7-81b48e74e999 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:20.229366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-322a2552-d0f8-4f14-92ca-c8543053c1d3 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:20.229945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-322a2552-d0f8-4f14-92ca-c8543053c1d3 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:20.232111 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-0e9a609d-e20d-4709-8e63-0b41f77a26ec req-de2bcf68-c6f3-41c0-96c7-81b48e74e999 service nova] Creating event network-changed:6c96878c-7b90-42b3-b3aa-b61e8018fcee for instance 5ecfb163-569c-483d-9fbd-14c3b45d649e on n-h2-848886-15 Jul 25 13:16:20.240603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-322a2552-d0f8-4f14-92ca-c8543053c1d3 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:20.241056 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-322a2552-d0f8-4f14-92ca-c8543053c1d3 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:20.241857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-322a2552-d0f8-4f14-92ca-c8543053c1d3 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:20.242298 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-322a2552-d0f8-4f14-92ca-c8543053c1d3 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:20.246546 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-0e9a609d-e20d-4709-8e63-0b41f77a26ec req-de2bcf68-c6f3-41c0-96c7-81b48e74e999 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077181 Jul 25 13:16:20.247628 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2898/5866] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:16:20.867582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-322a2552-d0f8-4f14-92ca-c8543053c1d3 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:20.881487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-322a2552-d0f8-4f14-92ca-c8543053c1d3 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:20.883235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-322a2552-d0f8-4f14-92ca-c8543053c1d3 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:20.885711 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-322a2552-d0f8-4f14-92ca-c8543053c1d3 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1731 microversion: 2.20 time: 0.660302 Jul 25 13:16:20.903738 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2969/5867] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:20 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1731 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:16:21.913386 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-55e959d3-a2e2-4c99-ac40-93e43415ae1b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:21.914043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-55e959d3-a2e2-4c99-ac40-93e43415ae1b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:21.933628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55e959d3-a2e2-4c99-ac40-93e43415ae1b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:21.934885 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55e959d3-a2e2-4c99-ac40-93e43415ae1b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:21.937134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55e959d3-a2e2-4c99-ac40-93e43415ae1b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:21.938431 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55e959d3-a2e2-4c99-ac40-93e43415ae1b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:23.087472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-55e959d3-a2e2-4c99-ac40-93e43415ae1b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:23.108171 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-55e959d3-a2e2-4c99-ac40-93e43415ae1b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:23.109812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-55e959d3-a2e2-4c99-ac40-93e43415ae1b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:23.116185 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-55e959d3-a2e2-4c99-ac40-93e43415ae1b tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1731 microversion: 2.20 time: 1.207780 Jul 25 13:16:23.120531 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2899/5868] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:21 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1731 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:24.147606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a4e2e36d-c353-47e7-9648-4189895cff75 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:24.148588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a4e2e36d-c353-47e7-9648-4189895cff75 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:24.162730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4e2e36d-c353-47e7-9648-4189895cff75 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:24.163361 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4e2e36d-c353-47e7-9648-4189895cff75 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:24.164261 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4e2e36d-c353-47e7-9648-4189895cff75 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:24.165088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a4e2e36d-c353-47e7-9648-4189895cff75 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:24.549266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a4e2e36d-c353-47e7-9648-4189895cff75 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:24.570589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a4e2e36d-c353-47e7-9648-4189895cff75 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:24.607742 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a4e2e36d-c353-47e7-9648-4189895cff75 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:24.610324 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a4e2e36d-c353-47e7-9648-4189895cff75 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1731 microversion: 2.20 time: 0.468542 Jul 25 13:16:24.612525 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2970/5869] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:24 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1731 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:25.654432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-727e1331-7843-4056-962f-6e0d31316a18 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:25.655927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-727e1331-7843-4056-962f-6e0d31316a18 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:25.673532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-727e1331-7843-4056-962f-6e0d31316a18 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:25.679648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-727e1331-7843-4056-962f-6e0d31316a18 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:25.681685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-727e1331-7843-4056-962f-6e0d31316a18 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:25.694904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-727e1331-7843-4056-962f-6e0d31316a18 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:26.061455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-727e1331-7843-4056-962f-6e0d31316a18 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:26.077406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-727e1331-7843-4056-962f-6e0d31316a18 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:26.084125 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-727e1331-7843-4056-962f-6e0d31316a18 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:26.088784 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-727e1331-7843-4056-962f-6e0d31316a18 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1731 microversion: 2.20 time: 0.440726 Jul 25 13:16:26.094928 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2900/5870] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:25 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1731 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:27.118782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-adf41d2d-4365-4454-827f-903563032580 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:27.120455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-adf41d2d-4365-4454-827f-903563032580 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:27.159532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-adf41d2d-4365-4454-827f-903563032580 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:27.160343 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-adf41d2d-4365-4454-827f-903563032580 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:27.161327 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-adf41d2d-4365-4454-827f-903563032580 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:27.161814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-adf41d2d-4365-4454-827f-903563032580 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:27.185404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:16:27.626347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-adf41d2d-4365-4454-827f-903563032580 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:27.637589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-adf41d2d-4365-4454-827f-903563032580 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:27.639352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-adf41d2d-4365-4454-827f-903563032580 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:27.640603 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-adf41d2d-4365-4454-827f-903563032580 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1731 microversion: 2.20 time: 0.527117 Jul 25 13:16:27.641976 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2971/5871] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:27 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1731 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:28.670149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1639bf04-d195-416e-8a9a-96ef75322bcd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:28.670907 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1639bf04-d195-416e-8a9a-96ef75322bcd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:28.683860 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1639bf04-d195-416e-8a9a-96ef75322bcd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:28.690926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1639bf04-d195-416e-8a9a-96ef75322bcd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:28.692457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1639bf04-d195-416e-8a9a-96ef75322bcd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:28.693199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1639bf04-d195-416e-8a9a-96ef75322bcd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:29.039557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1639bf04-d195-416e-8a9a-96ef75322bcd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:29.051321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1639bf04-d195-416e-8a9a-96ef75322bcd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:29.052856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1639bf04-d195-416e-8a9a-96ef75322bcd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:29.054108 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1639bf04-d195-416e-8a9a-96ef75322bcd tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1731 microversion: 2.20 time: 0.388960 Jul 25 13:16:29.054832 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2901/5872] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:28 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1731 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:30.083503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ff80139f-e25c-4d6e-9b17-b2243e25fcde tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:30.084992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ff80139f-e25c-4d6e-9b17-b2243e25fcde tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:30.098684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff80139f-e25c-4d6e-9b17-b2243e25fcde tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:30.101972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff80139f-e25c-4d6e-9b17-b2243e25fcde tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:30.104109 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff80139f-e25c-4d6e-9b17-b2243e25fcde tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:30.107022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff80139f-e25c-4d6e-9b17-b2243e25fcde tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:30.351736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ff80139f-e25c-4d6e-9b17-b2243e25fcde tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:30.369164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ff80139f-e25c-4d6e-9b17-b2243e25fcde tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:30.371095 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ff80139f-e25c-4d6e-9b17-b2243e25fcde tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:30.376032 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ff80139f-e25c-4d6e-9b17-b2243e25fcde tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1731 microversion: 2.20 time: 0.298019 Jul 25 13:16:30.377219 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2972/5873] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:30 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1731 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:31.400206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-994c1294-c2da-44b0-a1be-6a2248f46f0a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:31.401822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-994c1294-c2da-44b0-a1be-6a2248f46f0a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:31.414788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-994c1294-c2da-44b0-a1be-6a2248f46f0a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:31.419552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-994c1294-c2da-44b0-a1be-6a2248f46f0a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:31.423042 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-994c1294-c2da-44b0-a1be-6a2248f46f0a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:31.423946 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-994c1294-c2da-44b0-a1be-6a2248f46f0a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:31.907757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-994c1294-c2da-44b0-a1be-6a2248f46f0a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:31.932455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-994c1294-c2da-44b0-a1be-6a2248f46f0a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:31.941213 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-994c1294-c2da-44b0-a1be-6a2248f46f0a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:31.947357 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-994c1294-c2da-44b0-a1be-6a2248f46f0a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1731 microversion: 2.20 time: 0.548743 Jul 25 13:16:31.952578 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2902/5874] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:31 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1731 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:32.976629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-239b75e6-4f95-4273-8703-864e46f77dc6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:32.977289 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-239b75e6-4f95-4273-8703-864e46f77dc6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:32.993634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-239b75e6-4f95-4273-8703-864e46f77dc6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:32.994294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-239b75e6-4f95-4273-8703-864e46f77dc6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:32.995514 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-239b75e6-4f95-4273-8703-864e46f77dc6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:32.995963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-239b75e6-4f95-4273-8703-864e46f77dc6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:33.271741 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-239b75e6-4f95-4273-8703-864e46f77dc6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:33.283826 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-239b75e6-4f95-4273-8703-864e46f77dc6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:33.285696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-239b75e6-4f95-4273-8703-864e46f77dc6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:33.287232 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-239b75e6-4f95-4273-8703-864e46f77dc6 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1731 microversion: 2.20 time: 0.314862 Jul 25 13:16:33.289075 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2973/5875] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:32 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1731 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:34.318361 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c7f25f64-d015-4554-ab26-b883844238a5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:34.319096 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c7f25f64-d015-4554-ab26-b883844238a5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:34.342249 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c7f25f64-d015-4554-ab26-b883844238a5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:34.343299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c7f25f64-d015-4554-ab26-b883844238a5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:34.344153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c7f25f64-d015-4554-ab26-b883844238a5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:34.344755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c7f25f64-d015-4554-ab26-b883844238a5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:34.349742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:16:34.520977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c7f25f64-d015-4554-ab26-b883844238a5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:34.532003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c7f25f64-d015-4554-ab26-b883844238a5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:34.534704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c7f25f64-d015-4554-ab26-b883844238a5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:34.541878 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c7f25f64-d015-4554-ab26-b883844238a5 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1731 microversion: 2.20 time: 0.228707 Jul 25 13:16:34.543260 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2903/5876] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:34 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1731 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:35.568337 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f9c33c4d-196f-4f91-a9ff-8df2ad3b9106 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:35.570257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f9c33c4d-196f-4f91-a9ff-8df2ad3b9106 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:35.577629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9c33c4d-196f-4f91-a9ff-8df2ad3b9106 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:35.578400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9c33c4d-196f-4f91-a9ff-8df2ad3b9106 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:35.579503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9c33c4d-196f-4f91-a9ff-8df2ad3b9106 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:35.580308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9c33c4d-196f-4f91-a9ff-8df2ad3b9106 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:35.816884 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f9c33c4d-196f-4f91-a9ff-8df2ad3b9106 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:35.826979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f9c33c4d-196f-4f91-a9ff-8df2ad3b9106 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:35.828850 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f9c33c4d-196f-4f91-a9ff-8df2ad3b9106 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:35.830682 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f9c33c4d-196f-4f91-a9ff-8df2ad3b9106 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1731 microversion: 2.20 time: 0.267098 Jul 25 13:16:35.842357 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2974/5877] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:35 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1731 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:36.856279 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-002f677f-d4bb-4b24-8f1a-6cab7d4a86ba tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:36.857836 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-002f677f-d4bb-4b24-8f1a-6cab7d4a86ba tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:36.865469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-002f677f-d4bb-4b24-8f1a-6cab7d4a86ba tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:36.866146 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-002f677f-d4bb-4b24-8f1a-6cab7d4a86ba tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:36.867087 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-002f677f-d4bb-4b24-8f1a-6cab7d4a86ba tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:36.868445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-002f677f-d4bb-4b24-8f1a-6cab7d4a86ba tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:37.017337 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-002f677f-d4bb-4b24-8f1a-6cab7d4a86ba tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:37.029978 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-002f677f-d4bb-4b24-8f1a-6cab7d4a86ba tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:37.032370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-002f677f-d4bb-4b24-8f1a-6cab7d4a86ba tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:37.034300 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-002f677f-d4bb-4b24-8f1a-6cab7d4a86ba tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1731 microversion: 2.20 time: 0.182549 Jul 25 13:16:37.034898 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2904/5878] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:36 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:38.058975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9d681663-6723-4881-b285-93cf5099d8e3 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:38.059552 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9d681663-6723-4881-b285-93cf5099d8e3 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:38.079123 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d681663-6723-4881-b285-93cf5099d8e3 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:38.079596 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d681663-6723-4881-b285-93cf5099d8e3 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:38.080454 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d681663-6723-4881-b285-93cf5099d8e3 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:38.080906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d681663-6723-4881-b285-93cf5099d8e3 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:38.431862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9d681663-6723-4881-b285-93cf5099d8e3 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:38.445448 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9d681663-6723-4881-b285-93cf5099d8e3 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:38.449278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9d681663-6723-4881-b285-93cf5099d8e3 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:38.450989 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9d681663-6723-4881-b285-93cf5099d8e3 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1731 microversion: 2.20 time: 0.396221 Jul 25 13:16:38.452052 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2975/5879] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:38 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1731 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:39.488479 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3cb4f4b1-dfd6-4d6e-ba9c-3815a0265542 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:39.495943 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3cb4f4b1-dfd6-4d6e-ba9c-3815a0265542 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:39.526935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3cb4f4b1-dfd6-4d6e-ba9c-3815a0265542 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:39.528040 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3cb4f4b1-dfd6-4d6e-ba9c-3815a0265542 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:39.530911 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3cb4f4b1-dfd6-4d6e-ba9c-3815a0265542 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:39.532177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3cb4f4b1-dfd6-4d6e-ba9c-3815a0265542 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:39.820000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3cb4f4b1-dfd6-4d6e-ba9c-3815a0265542 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:39.829079 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3cb4f4b1-dfd6-4d6e-ba9c-3815a0265542 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:39.830888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3cb4f4b1-dfd6-4d6e-ba9c-3815a0265542 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:39.832210 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3cb4f4b1-dfd6-4d6e-ba9c-3815a0265542 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1731 microversion: 2.20 time: 0.359269 Jul 25 13:16:39.837989 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2905/5880] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:39 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1731 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:40.164882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-87f86eb9-40c6-4a4b-a23f-7480fb004660 req-f74a67d0-7f3e-491b-9ccb-57e522781331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ecfb163-569c-483d-9fbd-14c3b45d649e", "name": "network-vif-plugged", "status": "completed", "tag": "6c96878c-7b90-42b3-b3aa-b61e8018fcee"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:16:40.184243 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-87f86eb9-40c6-4a4b-a23f-7480fb004660 req-f74a67d0-7f3e-491b-9ccb-57e522781331 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:40.185164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-87f86eb9-40c6-4a4b-a23f-7480fb004660 req-f74a67d0-7f3e-491b-9ccb-57e522781331 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:40.202922 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-87f86eb9-40c6-4a4b-a23f-7480fb004660 req-f74a67d0-7f3e-491b-9ccb-57e522781331 service nova] Creating event network-vif-plugged:6c96878c-7b90-42b3-b3aa-b61e8018fcee for instance 5ecfb163-569c-483d-9fbd-14c3b45d649e on n-h2-848886-15 Jul 25 13:16:40.208829 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-87f86eb9-40c6-4a4b-a23f-7480fb004660 req-f74a67d0-7f3e-491b-9ccb-57e522781331 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048622 Jul 25 13:16:40.209877 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2976/5881] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:16:40.866828 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-71d62cc1-8a44-4cab-aac1-3f7d3ea4856a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:40.868435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-71d62cc1-8a44-4cab-aac1-3f7d3ea4856a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:40.877662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-71d62cc1-8a44-4cab-aac1-3f7d3ea4856a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:40.878530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-71d62cc1-8a44-4cab-aac1-3f7d3ea4856a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:40.879555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-71d62cc1-8a44-4cab-aac1-3f7d3ea4856a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:40.880228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-71d62cc1-8a44-4cab-aac1-3f7d3ea4856a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:41.060040 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-71d62cc1-8a44-4cab-aac1-3f7d3ea4856a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:41.071695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-71d62cc1-8a44-4cab-aac1-3f7d3ea4856a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:41.073498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-71d62cc1-8a44-4cab-aac1-3f7d3ea4856a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:41.074906 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-71d62cc1-8a44-4cab-aac1-3f7d3ea4856a tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1731 microversion: 2.20 time: 0.213990 Jul 25 13:16:41.075974 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2906/5882] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:40 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1731 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:42.114249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-373beb03-e9db-4958-8a89-36002ae4ed29 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:42.117119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-373beb03-e9db-4958-8a89-36002ae4ed29 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:42.129794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-373beb03-e9db-4958-8a89-36002ae4ed29 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:42.130519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-373beb03-e9db-4958-8a89-36002ae4ed29 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:42.131327 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-373beb03-e9db-4958-8a89-36002ae4ed29 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:42.132364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-373beb03-e9db-4958-8a89-36002ae4ed29 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:42.379461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-373beb03-e9db-4958-8a89-36002ae4ed29 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:42.400006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-373beb03-e9db-4958-8a89-36002ae4ed29 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:42.402276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-373beb03-e9db-4958-8a89-36002ae4ed29 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:42.412842 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-373beb03-e9db-4958-8a89-36002ae4ed29 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1731 microversion: 2.20 time: 0.297044 Jul 25 13:16:42.413562 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2977/5883] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:42 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1731 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:16:43.439829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d2f8d2a1-4569-412c-90c0-4ed136daf377 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:16:43.440637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d2f8d2a1-4569-412c-90c0-4ed136daf377 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:16:43.450958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2f8d2a1-4569-412c-90c0-4ed136daf377 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:43.451982 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2f8d2a1-4569-412c-90c0-4ed136daf377 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:43.452994 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2f8d2a1-4569-412c-90c0-4ed136daf377 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:16:43.453463 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2f8d2a1-4569-412c-90c0-4ed136daf377 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:16:43.624122 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d2f8d2a1-4569-412c-90c0-4ed136daf377 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:43.636765 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d2f8d2a1-4569-412c-90c0-4ed136daf377 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:43.638630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d2f8d2a1-4569-412c-90c0-4ed136daf377 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:16:43.640481 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d2f8d2a1-4569-412c-90c0-4ed136daf377 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1718 microversion: 2.20 time: 0.205128 Jul 25 13:16:43.641877 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2907/5884] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:16:43 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1718 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:17:03.091783 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:17:03.092406 n-d-848886-15 devstack@n-api.service[125884]: Mon Jul 25 13:17:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:17:11.452155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-057ff978-5541-4203-8cc2-33ea563af700 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:11.452857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-057ff978-5541-4203-8cc2-33ea563af700 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] [instance: 50cd2f20-ca6b-4043-a2b5-a319aca9ed40] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:11.455255 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=21 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:17:11.455925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=37 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:17:11.462278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-057ff978-5541-4203-8cc2-33ea563af700 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:11.462727 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-057ff978-5541-4203-8cc2-33ea563af700 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:11.463489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-057ff978-5541-4203-8cc2-33ea563af700 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:11.463923 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-057ff978-5541-4203-8cc2-33ea563af700 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:11.547919 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-057ff978-5541-4203-8cc2-33ea563af700 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lazy-loading 'services' on Instance uuid 50cd2f20-ca6b-4043-a2b5-a319aca9ed40 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:17:11.631086 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-057ff978-5541-4203-8cc2-33ea563af700 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] 10.222.0.49 "DELETE /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40/os-volume_attachments/d854b4b7-516b-41e2-b02d-2ebab2671f8f" status: 202 len: 0 microversion: 2.1 time: 0.182352 Jul 25 13:17:11.632616 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2978/5885] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Jul 25 13:17:11 2022] DELETE /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40/os-volume_attachments/d854b4b7-516b-41e2-b02d-2ebab2671f8f => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:17:14.442193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1cad067d-cac3-4f5c-af0e-213df8d6bdcb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:14.444640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1cad067d-cac3-4f5c-af0e-213df8d6bdcb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:14.447401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=21 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:17:14.448414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=29 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:17:14.454544 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1cad067d-cac3-4f5c-af0e-213df8d6bdcb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:14.455062 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1cad067d-cac3-4f5c-af0e-213df8d6bdcb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:14.455852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1cad067d-cac3-4f5c-af0e-213df8d6bdcb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:14.456367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1cad067d-cac3-4f5c-af0e-213df8d6bdcb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:14.488423 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1cad067d-cac3-4f5c-af0e-213df8d6bdcb tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050588 Jul 25 13:17:14.489021 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2908/5886] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Jul 25 13:17:14 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:17:14.559167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-acd52db5-1481-4aca-9f5c-ab8a15cb8343 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:14.559839 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-acd52db5-1481-4aca-9f5c-ab8a15cb8343 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:14.566789 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acd52db5-1481-4aca-9f5c-ab8a15cb8343 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:14.567328 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acd52db5-1481-4aca-9f5c-ab8a15cb8343 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:14.568352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acd52db5-1481-4aca-9f5c-ab8a15cb8343 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:14.568860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acd52db5-1481-4aca-9f5c-ab8a15cb8343 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:14.597116 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-acd52db5-1481-4aca-9f5c-ab8a15cb8343 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:17:14.680478 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-acd52db5-1481-4aca-9f5c-ab8a15cb8343 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 204 len: 0 microversion: 2.20 time: 0.126297 Jul 25 13:17:14.681607 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2979/5887] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 13:17:14 2022] DELETE /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 13:17:14.690971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b1e82ade-f99c-48ae-b19f-ca632dfd3c05 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:14.691773 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b1e82ade-f99c-48ae-b19f-ca632dfd3c05 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:14.698359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b1e82ade-f99c-48ae-b19f-ca632dfd3c05 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:14.698895 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b1e82ade-f99c-48ae-b19f-ca632dfd3c05 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:14.699787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b1e82ade-f99c-48ae-b19f-ca632dfd3c05 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:14.700341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b1e82ade-f99c-48ae-b19f-ca632dfd3c05 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:14.837954 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b1e82ade-f99c-48ae-b19f-ca632dfd3c05 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:14.846832 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b1e82ade-f99c-48ae-b19f-ca632dfd3c05 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:14.849451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b1e82ade-f99c-48ae-b19f-ca632dfd3c05 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:14.850693 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b1e82ade-f99c-48ae-b19f-ca632dfd3c05 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1724 microversion: 2.20 time: 0.165036 Jul 25 13:17:14.851254 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2909/5888] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:17:14 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:17:15.875973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fb539022-9dfb-497c-a398-7c57acc8e675 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:15.877255 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fb539022-9dfb-497c-a398-7c57acc8e675 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:15.884795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb539022-9dfb-497c-a398-7c57acc8e675 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:15.885421 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb539022-9dfb-497c-a398-7c57acc8e675 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:15.886244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb539022-9dfb-497c-a398-7c57acc8e675 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:15.886677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb539022-9dfb-497c-a398-7c57acc8e675 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:16.091794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fb539022-9dfb-497c-a398-7c57acc8e675 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:16.101069 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fb539022-9dfb-497c-a398-7c57acc8e675 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:16.103053 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fb539022-9dfb-497c-a398-7c57acc8e675 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:16.104370 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fb539022-9dfb-497c-a398-7c57acc8e675 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1724 microversion: 2.20 time: 0.233273 Jul 25 13:17:16.120164 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2980/5889] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:17:15 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 13:17:16.900151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-35644215-55d1-4634-934b-d0a596ec5bd6 req-0f138d77-a57f-4e4d-97b6-19b3b57ec770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ecfb163-569c-483d-9fbd-14c3b45d649e", "name": "network-vif-deleted", "tag": "6c96878c-7b90-42b3-b3aa-b61e8018fcee"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:17:16.913088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-35644215-55d1-4634-934b-d0a596ec5bd6 req-0f138d77-a57f-4e4d-97b6-19b3b57ec770 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:16.913935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-35644215-55d1-4634-934b-d0a596ec5bd6 req-0f138d77-a57f-4e4d-97b6-19b3b57ec770 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:16.926190 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-35644215-55d1-4634-934b-d0a596ec5bd6 req-0f138d77-a57f-4e4d-97b6-19b3b57ec770 service nova] Creating event network-vif-deleted:6c96878c-7b90-42b3-b3aa-b61e8018fcee for instance 5ecfb163-569c-483d-9fbd-14c3b45d649e on n-h2-848886-15 Jul 25 13:17:16.932294 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-35644215-55d1-4634-934b-d0a596ec5bd6 req-0f138d77-a57f-4e4d-97b6-19b3b57ec770 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036102 Jul 25 13:17:16.933502 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2910/5890] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:17:17.046285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-eb101c0e-f233-4fdf-9f9f-505d8c81d7db tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:17.047713 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eb101c0e-f233-4fdf-9f9f-505d8c81d7db tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] [instance: 50cd2f20-ca6b-4043-a2b5-a319aca9ed40] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:17.056247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb101c0e-f233-4fdf-9f9f-505d8c81d7db tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:17.056980 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb101c0e-f233-4fdf-9f9f-505d8c81d7db tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:17.057761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb101c0e-f233-4fdf-9f9f-505d8c81d7db tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:17.058241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb101c0e-f233-4fdf-9f9f-505d8c81d7db tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:17.102171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eb101c0e-f233-4fdf-9f9f-505d8c81d7db tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] [instance: 50cd2f20-ca6b-4043-a2b5-a319aca9ed40] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:17:17.128770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bf38304f-d3a5-4208-8624-78bee4735d41 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:17.129650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bf38304f-d3a5-4208-8624-78bee4735d41 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:17.142595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf38304f-d3a5-4208-8624-78bee4735d41 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:17.145125 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf38304f-d3a5-4208-8624-78bee4735d41 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:17.147536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf38304f-d3a5-4208-8624-78bee4735d41 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:17.148324 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf38304f-d3a5-4208-8624-78bee4735d41 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:17.218396 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf38304f-d3a5-4208-8624-78bee4735d41 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:17.220168 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf38304f-d3a5-4208-8624-78bee4735d41 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:17.222061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-bf38304f-d3a5-4208-8624-78bee4735d41 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lazy-loading 'fault' on Instance uuid 5ecfb163-569c-483d-9fbd-14c3b45d649e {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:17:17.253814 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-eb101c0e-f233-4fdf-9f9f-505d8c81d7db tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] 10.222.0.49 "DELETE /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40" status: 204 len: 0 microversion: 2.1 time: 0.213120 Jul 25 13:17:17.255050 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2981/5891] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:17:17 2022] DELETE /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:17:17.269513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3e42d32d-c822-4c8e-9ea3-79efc69d68b8 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:17.271215 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3e42d32d-c822-4c8e-9ea3-79efc69d68b8 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] [instance: 50cd2f20-ca6b-4043-a2b5-a319aca9ed40] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:17.279369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e42d32d-c822-4c8e-9ea3-79efc69d68b8 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:17.280291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e42d32d-c822-4c8e-9ea3-79efc69d68b8 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:17.281373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e42d32d-c822-4c8e-9ea3-79efc69d68b8 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:17.282262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e42d32d-c822-4c8e-9ea3-79efc69d68b8 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:17.296990 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bf38304f-d3a5-4208-8624-78bee4735d41 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:17.306093 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bf38304f-d3a5-4208-8624-78bee4735d41 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:17.307865 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bf38304f-d3a5-4208-8624-78bee4735d41 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36608374ffcf47f389e1169f454b2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c757f689085487bbbfcbc5bdd365843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:17.309273 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bf38304f-d3a5-4208-8624-78bee4735d41 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 200 len: 1371 microversion: 2.20 time: 0.185008 Jul 25 13:17:17.310545 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2911/5892] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:17:17 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 13:17:17.760964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3e42d32d-c822-4c8e-9ea3-79efc69d68b8 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b739ba60fa354ff9a0ef9e6cc01d7772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecb63aa224445e6912175d7b9360ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:17.768871 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3e42d32d-c822-4c8e-9ea3-79efc69d68b8 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] 10.222.0.49 "GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40" status: 200 len: 1470 microversion: 2.1 time: 0.505645 Jul 25 13:17:17.769436 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2982/5893] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:17:17 2022] GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40 => generated 1470 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:17:18.333294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9a0bb714-d5dc-4732-8224-8cad43e240f8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:18.333977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9a0bb714-d5dc-4732-8224-8cad43e240f8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:18.341120 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a0bb714-d5dc-4732-8224-8cad43e240f8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:18.341486 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a0bb714-d5dc-4732-8224-8cad43e240f8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:18.342304 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a0bb714-d5dc-4732-8224-8cad43e240f8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:18.342775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a0bb714-d5dc-4732-8224-8cad43e240f8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:18.357672 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-9a0bb714-d5dc-4732-8224-8cad43e240f8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] HTTP exception thrown: Instance 5ecfb163-569c-483d-9fbd-14c3b45d649e could not be found. Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9a0bb714-d5dc-4732-8224-8cad43e240f8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Request method failure captured: Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e HTTP/1.1 Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pZlwsDLWPCrT8wHON_ekBxBFRhqHaz8o2_DkWQeSANKl_1AvmaypCHZ_skHHa_kgy83u_V2baEEF63dVMfXfQZz-EPPAWr64M4p0kAchxZIAYVGqpY3xI9Pek1MMMpkClDqEbjkBxNXIDnp1cyXs92dyDcWn-oxvVKs9-hlzZ5wsAk Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 7c757f689085487bbbfcbc5bdd365843 Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1281752976 Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7c757f689085487bbbfcbc5bdd365843", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7c757f689085487bbbfcbc5bdd365843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c757f689085487bbbfcbc5bdd365843"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c757f689085487bbbfcbc5bdd365843"}]}] Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1281752976 Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 7c757f689085487bbbfcbc5bdd365843 Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1281752976 Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AttachVolumeShelveTestJSON-1281752976-project Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 36608374ffcf47f389e1169f454b2d9b Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1281752976-project Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 5ecfb163-569c-483d-9fbd-14c3b45d649e could not be found. Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '5ecfb163-569c-483d-9fbd-14c3b45d649e'} Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ecfb163-569c-483d-9fbd-14c3b45d649e could not be found. Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ecfb163-569c-483d-9fbd-14c3b45d649e could not be found. Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:17:18.359520 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:17:18.363334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:17:18.363334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:17:18.363334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:17:18.363334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:17:18.363334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:17:18.363334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:17:18.363334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ecfb163-569c-483d-9fbd-14c3b45d649e could not be found. Jul 25 13:17:18.363334 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:17:18.363334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9a0bb714-d5dc-4732-8224-8cad43e240f8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Returning 404 to user: Instance 5ecfb163-569c-483d-9fbd-14c3b45d649e could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:17:18.363334 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9a0bb714-d5dc-4732-8224-8cad43e240f8 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 404 len: 111 microversion: 2.20 time: 0.032083 Jul 25 13:17:18.363334 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2912/5894] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:17:18 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:17:18.370519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dbf31feb-53b9-40c8-a66e-a8046ffea82c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '.version_select at 0x7efcf8e33940>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:18.396820 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dbf31feb-53b9-40c8-a66e-a8046ffea82c tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865226521" status: 204 len: 0 microversion: 2.20 time: 0.030229 Jul 25 13:17:18.397391 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2983/5895] 10.222.0.49 () {60 vars in 1262 bytes} [Mon Jul 25 13:17:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865226521 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 13:17:18.790455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f561cfb1-bef1-46a9-9939-ead707d59025 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:18.791405 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f561cfb1-bef1-46a9-9939-ead707d59025 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] [instance: 50cd2f20-ca6b-4043-a2b5-a319aca9ed40] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:18.798036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f561cfb1-bef1-46a9-9939-ead707d59025 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:18.798578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f561cfb1-bef1-46a9-9939-ead707d59025 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:18.806723 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f561cfb1-bef1-46a9-9939-ead707d59025 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:18.807607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f561cfb1-bef1-46a9-9939-ead707d59025 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:19.128546 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f561cfb1-bef1-46a9-9939-ead707d59025 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b739ba60fa354ff9a0ef9e6cc01d7772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecb63aa224445e6912175d7b9360ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:19.138474 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f561cfb1-bef1-46a9-9939-ead707d59025 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] 10.222.0.49 "GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40" status: 200 len: 1470 microversion: 2.1 time: 0.351919 Jul 25 13:17:19.139315 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2913/5896] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:17:18 2022] GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40 => generated 1470 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:17:19.480734 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-5ab5fecc-62fa-483f-8144-5efeba259bb7 req-6e3ee756-7ebb-41ff-94a4-6b7b24ca3096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50cd2f20-ca6b-4043-a2b5-a319aca9ed40", "name": "network-vif-deleted", "tag": "8f42e6d9-db11-49b2-96eb-035f2a4b5f5a"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:17:19.492485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5ab5fecc-62fa-483f-8144-5efeba259bb7 req-6e3ee756-7ebb-41ff-94a4-6b7b24ca3096 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:19.498481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5ab5fecc-62fa-483f-8144-5efeba259bb7 req-6e3ee756-7ebb-41ff-94a4-6b7b24ca3096 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:19.510202 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-5ab5fecc-62fa-483f-8144-5efeba259bb7 req-6e3ee756-7ebb-41ff-94a4-6b7b24ca3096 service nova] Creating event network-vif-deleted:8f42e6d9-db11-49b2-96eb-035f2a4b5f5a for instance 50cd2f20-ca6b-4043-a2b5-a319aca9ed40 on n-h2-848886-15 Jul 25 13:17:19.515273 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-5ab5fecc-62fa-483f-8144-5efeba259bb7 req-6e3ee756-7ebb-41ff-94a4-6b7b24ca3096 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039149 Jul 25 13:17:19.515985 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2984/5897] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:17:20.161026 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4a461d89-e905-4c63-80fa-1ab85ecc95e9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:20.161824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4a461d89-e905-4c63-80fa-1ab85ecc95e9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] [instance: 50cd2f20-ca6b-4043-a2b5-a319aca9ed40] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:20.169126 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a461d89-e905-4c63-80fa-1ab85ecc95e9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:20.169711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a461d89-e905-4c63-80fa-1ab85ecc95e9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:20.170666 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a461d89-e905-4c63-80fa-1ab85ecc95e9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:20.171216 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a461d89-e905-4c63-80fa-1ab85ecc95e9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:20.184643 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-4a461d89-e905-4c63-80fa-1ab85ecc95e9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] HTTP exception thrown: Instance 50cd2f20-ca6b-4043-a2b5-a319aca9ed40 could not be found. Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4a461d89-e905-4c63-80fa-1ab85ecc95e9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Request method failure captured: Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40 HTTP/1.1 Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pdnlXEF0zCIv2rY2q0fgQNxMddTSbiWg6pjMjEidqE6cs609_QMtYJHVj0o_nJ2RdWC9zBQ1GQ2TOoQ_iC2Wqnp-KNsy_8tLrHDEpryY--EdMfoHZQWxm0Ie5789aYrLBGGswEXoXDjVPrxWi7BvRE9Q6ChhMDcL-baB5TJypwonhY Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: aecb63aa224445e6912175d7b9360ae6 Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-VolumesBackupsTest-1222887717 Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aecb63aa224445e6912175d7b9360ae6", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aecb63aa224445e6912175d7b9360ae6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aecb63aa224445e6912175d7b9360ae6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aecb63aa224445e6912175d7b9360ae6"}]}] Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-VolumesBackupsTest-1222887717 Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: aecb63aa224445e6912175d7b9360ae6 Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-VolumesBackupsTest-1222887717 Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-VolumesBackupsTest-1222887717-project Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: b739ba60fa354ff9a0ef9e6cc01d7772 Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-VolumesBackupsTest-1222887717-project Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 50cd2f20-ca6b-4043-a2b5-a319aca9ed40 could not be found. Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '50cd2f20-ca6b-4043-a2b5-a319aca9ed40'} Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50cd2f20-ca6b-4043-a2b5-a319aca9ed40 could not be found. Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50cd2f20-ca6b-4043-a2b5-a319aca9ed40 could not be found. Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:17:20.186340 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:17:20.190700 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:17:20.190700 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:17:20.190700 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:17:20.190700 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:17:20.190700 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:17:20.190700 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50cd2f20-ca6b-4043-a2b5-a319aca9ed40 could not be found. Jul 25 13:17:20.190700 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:17:20.190700 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4a461d89-e905-4c63-80fa-1ab85ecc95e9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] Returning 404 to user: Instance 50cd2f20-ca6b-4043-a2b5-a319aca9ed40 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:17:20.192060 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4a461d89-e905-4c63-80fa-1ab85ecc95e9 tempest-VolumesBackupsTest-1222887717 tempest-VolumesBackupsTest-1222887717-project] 10.222.0.49 "GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40" status: 404 len: 111 microversion: 2.1 time: 0.035141 Jul 25 13:17:20.192913 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2914/5898] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:17:20 2022] GET /compute/v2.1/servers/50cd2f20-ca6b-4043-a2b5-a319aca9ed40 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:17:21.332180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-47dfd597-fcce-4b10-abd6-a3a4b37da3fe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:21.332771 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-47dfd597-fcce-4b10-abd6-a3a4b37da3fe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:21.342965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-47dfd597-fcce-4b10-abd6-a3a4b37da3fe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:21.344353 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-47dfd597-fcce-4b10-abd6-a3a4b37da3fe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:21.345460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-47dfd597-fcce-4b10-abd6-a3a4b37da3fe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:21.346144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-47dfd597-fcce-4b10-abd6-a3a4b37da3fe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:21.370443 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-47dfd597-fcce-4b10-abd6-a3a4b37da3fe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] HTTP exception thrown: Instance 5ecfb163-569c-483d-9fbd-14c3b45d649e could not be found. Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-47dfd597-fcce-4b10-abd6-a3a4b37da3fe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Request method failure captured: Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e HTTP/1.1 Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pZlwsDLWPCrT8wHON_ekBxBFRhqHaz8o2_DkWQeSANKl_1AvmaypCHZ_skHHa_kgy83u_V2baEEF63dVMfXfQZz-EPPAWr64M4p0kAchxZIAYVGqpY3xI9Pek1MMMpkClDqEbjkBxNXIDnp1cyXs92dyDcWn-oxvVKs9-hlzZ5wsAk Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 7c757f689085487bbbfcbc5bdd365843 Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1281752976 Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7c757f689085487bbbfcbc5bdd365843", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7c757f689085487bbbfcbc5bdd365843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c757f689085487bbbfcbc5bdd365843"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c757f689085487bbbfcbc5bdd365843"}]}] Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1281752976 Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 7c757f689085487bbbfcbc5bdd365843 Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1281752976 Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-AttachVolumeShelveTestJSON-1281752976-project Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 36608374ffcf47f389e1169f454b2d9b Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1281752976-project Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 5ecfb163-569c-483d-9fbd-14c3b45d649e could not be found. Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '5ecfb163-569c-483d-9fbd-14c3b45d649e'} Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ecfb163-569c-483d-9fbd-14c3b45d649e could not be found. Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:17:21.382473 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:17:21.386602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ecfb163-569c-483d-9fbd-14c3b45d649e could not be found. Jul 25 13:17:21.386602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:17:21.386602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:17:21.386602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:17:21.386602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:17:21.386602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:17:21.386602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:17:21.386602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:17:21.386602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:17:21.386602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ecfb163-569c-483d-9fbd-14c3b45d649e could not be found. Jul 25 13:17:21.386602 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:17:21.389707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-47dfd597-fcce-4b10-abd6-a3a4b37da3fe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Returning 404 to user: Instance 5ecfb163-569c-483d-9fbd-14c3b45d649e could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:17:21.390733 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-47dfd597-fcce-4b10-abd6-a3a4b37da3fe tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 404 len: 111 microversion: 2.20 time: 0.063000 Jul 25 13:17:21.394339 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2985/5899] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 13:17:21 2022] DELETE /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:17:21.400289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ddc07f45-668e-498c-ac4d-549a4ea3696e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:21.401072 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ddc07f45-668e-498c-ac4d-549a4ea3696e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 5ecfb163-569c-483d-9fbd-14c3b45d649e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:21.409348 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ddc07f45-668e-498c-ac4d-549a4ea3696e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:21.414159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ddc07f45-668e-498c-ac4d-549a4ea3696e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:21.419475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ddc07f45-668e-498c-ac4d-549a4ea3696e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:21.420105 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ddc07f45-668e-498c-ac4d-549a4ea3696e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:21.456427 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-ddc07f45-668e-498c-ac4d-549a4ea3696e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] HTTP exception thrown: Instance 5ecfb163-569c-483d-9fbd-14c3b45d649e could not be found. Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ddc07f45-668e-498c-ac4d-549a4ea3696e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Request method failure captured: Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e HTTP/1.1 Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pZlwsDLWPCrT8wHON_ekBxBFRhqHaz8o2_DkWQeSANKl_1AvmaypCHZ_skHHa_kgy83u_V2baEEF63dVMfXfQZz-EPPAWr64M4p0kAchxZIAYVGqpY3xI9Pek1MMMpkClDqEbjkBxNXIDnp1cyXs92dyDcWn-oxvVKs9-hlzZ5wsAk Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 7c757f689085487bbbfcbc5bdd365843 Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1281752976 Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7c757f689085487bbbfcbc5bdd365843", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7c757f689085487bbbfcbc5bdd365843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c757f689085487bbbfcbc5bdd365843"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c757f689085487bbbfcbc5bdd365843"}]}] Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1281752976 Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 7c757f689085487bbbfcbc5bdd365843 Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1281752976 Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AttachVolumeShelveTestJSON-1281752976-project Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 36608374ffcf47f389e1169f454b2d9b Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1281752976-project Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 5ecfb163-569c-483d-9fbd-14c3b45d649e could not be found. Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '5ecfb163-569c-483d-9fbd-14c3b45d649e'} Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ecfb163-569c-483d-9fbd-14c3b45d649e could not be found. Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ecfb163-569c-483d-9fbd-14c3b45d649e could not be found. Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:17:21.459084 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:17:21.462668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:17:21.462668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:17:21.462668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:17:21.462668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:17:21.462668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:17:21.462668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:17:21.462668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ecfb163-569c-483d-9fbd-14c3b45d649e could not be found. Jul 25 13:17:21.462668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:17:21.464890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ddc07f45-668e-498c-ac4d-549a4ea3696e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Returning 404 to user: Instance 5ecfb163-569c-483d-9fbd-14c3b45d649e could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:17:21.466491 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ddc07f45-668e-498c-ac4d-549a4ea3696e tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e" status: 404 len: 111 microversion: 2.20 time: 0.070775 Jul 25 13:17:21.467663 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2915/5900] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:17:21 2022] GET /compute/v2.1/servers/5ecfb163-569c-483d-9fbd-14c3b45d649e => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:17:24.867043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fe27a3dc-2786-4212-90a5-76f143da563d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:24.867695 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fe27a3dc-2786-4212-90a5-76f143da563d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:24.880566 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fe27a3dc-2786-4212-90a5-76f143da563d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:24.881095 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fe27a3dc-2786-4212-90a5-76f143da563d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:24.882004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fe27a3dc-2786-4212-90a5-76f143da563d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:24.889887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fe27a3dc-2786-4212-90a5-76f143da563d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:24.933943 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-fe27a3dc-2786-4212-90a5-76f143da563d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] HTTP exception thrown: Instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af could not be found. Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fe27a3dc-2786-4212-90a5-76f143da563d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Request method failure captured: Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af HTTP/1.1 Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pZlwsDLWPCrT8wHON_ekBxBFRhqHaz8o2_DkWQeSANKl_1AvmaypCHZ_skHHa_kgy83u_V2baEEF63dVMfXfQZz-EPPAWr64M4p0kAchxZIAYVGqpY3xI9Pek1MMMpkClDqEbjkBxNXIDnp1cyXs92dyDcWn-oxvVKs9-hlzZ5wsAk Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 7c757f689085487bbbfcbc5bdd365843 Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1281752976 Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7c757f689085487bbbfcbc5bdd365843", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7c757f689085487bbbfcbc5bdd365843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c757f689085487bbbfcbc5bdd365843"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c757f689085487bbbfcbc5bdd365843"}]}] Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1281752976 Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 7c757f689085487bbbfcbc5bdd365843 Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1281752976 Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-AttachVolumeShelveTestJSON-1281752976-project Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 36608374ffcf47f389e1169f454b2d9b Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1281752976-project Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af could not be found. Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '0ffd02cb-a0ad-4b1f-b129-6fee94dc57af'} Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af could not be found. Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:17:24.935932 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:17:24.939527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af could not be found. Jul 25 13:17:24.939527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:17:24.939527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:17:24.939527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:17:24.939527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:17:24.939527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:17:24.939527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:17:24.939527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:17:24.939527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:17:24.939527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af could not be found. Jul 25 13:17:24.939527 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:17:24.941610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fe27a3dc-2786-4212-90a5-76f143da563d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Returning 404 to user: Instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:17:24.943049 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fe27a3dc-2786-4212-90a5-76f143da563d tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 404 len: 111 microversion: 2.20 time: 0.081411 Jul 25 13:17:24.949907 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2986/5901] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Jul 25 13:17:24 2022] DELETE /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:17:24.954655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c920c060-4d3e-4c9f-92cc-95915d1330f4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:24.955289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c920c060-4d3e-4c9f-92cc-95915d1330f4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] [instance: 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:24.975636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c920c060-4d3e-4c9f-92cc-95915d1330f4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:24.976105 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c920c060-4d3e-4c9f-92cc-95915d1330f4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:24.976903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c920c060-4d3e-4c9f-92cc-95915d1330f4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:24.977348 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c920c060-4d3e-4c9f-92cc-95915d1330f4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:24.993698 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-c920c060-4d3e-4c9f-92cc-95915d1330f4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] HTTP exception thrown: Instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af could not be found. Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c920c060-4d3e-4c9f-92cc-95915d1330f4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Request method failure captured: Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af HTTP/1.1 Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pZlwsDLWPCrT8wHON_ekBxBFRhqHaz8o2_DkWQeSANKl_1AvmaypCHZ_skHHa_kgy83u_V2baEEF63dVMfXfQZz-EPPAWr64M4p0kAchxZIAYVGqpY3xI9Pek1MMMpkClDqEbjkBxNXIDnp1cyXs92dyDcWn-oxvVKs9-hlzZ5wsAk Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 7c757f689085487bbbfcbc5bdd365843 Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1281752976 Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7c757f689085487bbbfcbc5bdd365843", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7c757f689085487bbbfcbc5bdd365843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c757f689085487bbbfcbc5bdd365843"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c757f689085487bbbfcbc5bdd365843"}]}] Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1281752976 Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 7c757f689085487bbbfcbc5bdd365843 Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1281752976 Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AttachVolumeShelveTestJSON-1281752976-project Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 36608374ffcf47f389e1169f454b2d9b Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1281752976-project Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af could not be found. Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '0ffd02cb-a0ad-4b1f-b129-6fee94dc57af'} Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af could not be found. Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af could not be found. Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:17:24.995527 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:17:24.999593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:17:24.999593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:17:24.999593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:17:24.999593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:17:24.999593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:17:24.999593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:17:24.999593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af could not be found. Jul 25 13:17:24.999593 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:17:25.003127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c920c060-4d3e-4c9f-92cc-95915d1330f4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] Returning 404 to user: Instance 0ffd02cb-a0ad-4b1f-b129-6fee94dc57af could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:17:25.004226 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c920c060-4d3e-4c9f-92cc-95915d1330f4 tempest-AttachVolumeShelveTestJSON-1281752976 tempest-AttachVolumeShelveTestJSON-1281752976-project] 10.222.0.49 "GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af" status: 404 len: 111 microversion: 2.20 time: 0.055970 Jul 25 13:17:25.009297 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2916/5902] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 25 13:17:24 2022] GET /compute/v2.1/servers/0ffd02cb-a0ad-4b1f-b129-6fee94dc57af => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 25 13:17:35.713009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:17:35.715134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:17:35.873814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-94405cd6-e0f9-4af9-a4a6-bcbfa1a67ffe tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Action: 'create', calling method: .version_select at 0x7efcf91fb0d0>, body: {"keypair": {"name": "tempest-keypair-273732684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/POyEyxyyzgq5vq6tTGeew75dftg/T/VINmYQGP4x8hZn/GiWJVct7u5kGJA6skuc/0gY2kByUY1jz0dSrCCYR6U6UDOrduZyHfJEmRaWjtpfKzcI+5jz0dois24JGmA=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:17:35.895752 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-94405cd6-e0f9-4af9-a4a6-bcbfa1a67ffe tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Getting quotas for project 805811c2762b477cae7cb16377e12dac. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:17:35.904438 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-94405cd6-e0f9-4af9-a4a6-bcbfa1a67ffe tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Getting quotas for user 3092b4bfef6f4d778d52e9de3cd1b785 and project 805811c2762b477cae7cb16377e12dac. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:17:35.939693 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-94405cd6-e0f9-4af9-a4a6-bcbfa1a67ffe tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.240816 Jul 25 13:17:35.940316 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2987/5903] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:17:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:17:38.064659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b42bce9e-d499-4300-9cf2-a037171a9334 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-63768592", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e17217fe-ccfb-47ee-98dd-b05efd6867f9"}], "security_groups": [{"name": "tempest-securitygroup--421941160"}], "key_name": "tempest-keypair-273732684", "user_data": "}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:17:38.074872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=20 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:17:38.076600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=36 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:17:38.289041 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-b42bce9e-d499-4300-9cf2-a037171a9334 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] validate_networks() for [('e17217fe-ccfb-47ee-98dd-b05efd6867f9', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:17:38.928840 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-b42bce9e-d499-4300-9cf2-a037171a9334 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:17:38.929427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-b42bce9e-d499-4300-9cf2-a037171a9334 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:17:38.930169 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-b42bce9e-d499-4300-9cf2-a037171a9334 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:17:38.931684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-b42bce9e-d499-4300-9cf2-a037171a9334 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:17:38.932268 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-b42bce9e-d499-4300-9cf2-a037171a9334 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:17:38.943578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b42bce9e-d499-4300-9cf2-a037171a9334 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:38.944292 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b42bce9e-d499-4300-9cf2-a037171a9334 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:38.945653 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b42bce9e-d499-4300-9cf2-a037171a9334 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:38.946192 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b42bce9e-d499-4300-9cf2-a037171a9334 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:38.966931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-b42bce9e-d499-4300-9cf2-a037171a9334 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Getting quotas for project 805811c2762b477cae7cb16377e12dac. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:17:38.974822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-b42bce9e-d499-4300-9cf2-a037171a9334 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Getting quotas for user 3092b4bfef6f4d778d52e9de3cd1b785 and project 805811c2762b477cae7cb16377e12dac. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:17:38.990904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b42bce9e-d499-4300-9cf2-a037171a9334 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:17:38.994913 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b42bce9e-d499-4300-9cf2-a037171a9334 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:17:39.051181 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b42bce9e-d499-4300-9cf2-a037171a9334 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.991373 Jul 25 13:17:39.052469 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2917/5904] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:17:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:17:39.063852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-492d7c48-9135-4126-aaff-2d49003ab2ea tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:39.065132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-492d7c48-9135-4126-aaff-2d49003ab2ea tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:39.186982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-492d7c48-9135-4126-aaff-2d49003ab2ea tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:39.198934 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-492d7c48-9135-4126-aaff-2d49003ab2ea tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e" status: 200 len: 1239 microversion: 2.1 time: 0.136847 Jul 25 13:17:39.218232 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2988/5905] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:17:39 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e => generated 1239 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:17:40.239208 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-48a38894-9a3a-4f3e-b668-6a423895fb69 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:40.240694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-48a38894-9a3a-4f3e-b668-6a423895fb69 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:40.249557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48a38894-9a3a-4f3e-b668-6a423895fb69 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:40.250589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48a38894-9a3a-4f3e-b668-6a423895fb69 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:40.251661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48a38894-9a3a-4f3e-b668-6a423895fb69 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:40.252343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48a38894-9a3a-4f3e-b668-6a423895fb69 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:40.333434 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-48a38894-9a3a-4f3e-b668-6a423895fb69 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:40.343389 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-48a38894-9a3a-4f3e-b668-6a423895fb69 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e" status: 200 len: 1291 microversion: 2.1 time: 0.124333 Jul 25 13:17:40.344598 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2918/5906] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:17:40 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e => generated 1291 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:17:41.364900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5970f154-b2f5-4e8c-8381-cbc7f23f52d0 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:41.365538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5970f154-b2f5-4e8c-8381-cbc7f23f52d0 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:41.381098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5970f154-b2f5-4e8c-8381-cbc7f23f52d0 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:41.381466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5970f154-b2f5-4e8c-8381-cbc7f23f52d0 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:41.382495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5970f154-b2f5-4e8c-8381-cbc7f23f52d0 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:41.382934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5970f154-b2f5-4e8c-8381-cbc7f23f52d0 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:41.525603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5970f154-b2f5-4e8c-8381-cbc7f23f52d0 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:41.539237 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5970f154-b2f5-4e8c-8381-cbc7f23f52d0 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e" status: 200 len: 1297 microversion: 2.1 time: 0.174577 Jul 25 13:17:41.542598 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2989/5907] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:17:41 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e => generated 1297 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:17:42.563037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-eb34344c-bdfb-4b63-95cf-5e965eefefec tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:42.563959 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-eb34344c-bdfb-4b63-95cf-5e965eefefec tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:42.585931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb34344c-bdfb-4b63-95cf-5e965eefefec tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:42.586822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb34344c-bdfb-4b63-95cf-5e965eefefec tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:42.588145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb34344c-bdfb-4b63-95cf-5e965eefefec tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:42.589053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb34344c-bdfb-4b63-95cf-5e965eefefec tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:43.126234 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-eb34344c-bdfb-4b63-95cf-5e965eefefec tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:43.158653 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-eb34344c-bdfb-4b63-95cf-5e965eefefec tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e" status: 200 len: 1364 microversion: 2.1 time: 0.600042 Jul 25 13:17:43.159814 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2919/5908] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:17:42 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e => generated 1364 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:17:43.361197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-e2b610a4-3bf4-4e4f-8b0f-a4c7429c51fd req-46e16dca-e01b-4d68-a588-23f10c484e33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4492f180-6de9-4618-9d5f-28ca90f6db3e", "tag": "ff06fd1a-52c7-4760-93c4-60c69802b48f"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:17:43.388784 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e2b610a4-3bf4-4e4f-8b0f-a4c7429c51fd req-46e16dca-e01b-4d68-a588-23f10c484e33 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:43.389236 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e2b610a4-3bf4-4e4f-8b0f-a4c7429c51fd req-46e16dca-e01b-4d68-a588-23f10c484e33 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:43.430728 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-e2b610a4-3bf4-4e4f-8b0f-a4c7429c51fd req-46e16dca-e01b-4d68-a588-23f10c484e33 service nova] Creating event network-changed:ff06fd1a-52c7-4760-93c4-60c69802b48f for instance 4492f180-6de9-4618-9d5f-28ca90f6db3e on n-h2-848886-15 Jul 25 13:17:43.436085 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-e2b610a4-3bf4-4e4f-8b0f-a4c7429c51fd req-46e16dca-e01b-4d68-a588-23f10c484e33 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081997 Jul 25 13:17:43.436697 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2990/5909] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:17:44.180489 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1ebb6ec5-0908-4e16-9a1a-f539c037f690 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:44.181130 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1ebb6ec5-0908-4e16-9a1a-f539c037f690 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:44.191325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ebb6ec5-0908-4e16-9a1a-f539c037f690 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:44.191835 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ebb6ec5-0908-4e16-9a1a-f539c037f690 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:44.192975 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ebb6ec5-0908-4e16-9a1a-f539c037f690 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:44.193435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ebb6ec5-0908-4e16-9a1a-f539c037f690 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:44.377874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1ebb6ec5-0908-4e16-9a1a-f539c037f690 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:44.385927 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1ebb6ec5-0908-4e16-9a1a-f539c037f690 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e" status: 200 len: 1364 microversion: 2.1 time: 0.210086 Jul 25 13:17:44.386691 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2920/5910] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:17:44 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:17:45.413578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-68b7d1b8-47e4-405a-ab22-c6213ae6f837 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:45.414881 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-68b7d1b8-47e4-405a-ab22-c6213ae6f837 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:45.428356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68b7d1b8-47e4-405a-ab22-c6213ae6f837 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:45.432467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68b7d1b8-47e4-405a-ab22-c6213ae6f837 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:45.432467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68b7d1b8-47e4-405a-ab22-c6213ae6f837 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:45.432467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68b7d1b8-47e4-405a-ab22-c6213ae6f837 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:45.697464 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-68b7d1b8-47e4-405a-ab22-c6213ae6f837 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:45.708016 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-68b7d1b8-47e4-405a-ab22-c6213ae6f837 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e" status: 200 len: 1364 microversion: 2.1 time: 0.300045 Jul 25 13:17:45.722269 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2991/5911] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:17:45 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e => generated 1364 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:17:46.732737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-22e1599b-d60b-433c-b559-fa1987588c32 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:46.734121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-22e1599b-d60b-433c-b559-fa1987588c32 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:46.741912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22e1599b-d60b-433c-b559-fa1987588c32 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:46.742598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22e1599b-d60b-433c-b559-fa1987588c32 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:46.743554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22e1599b-d60b-433c-b559-fa1987588c32 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:46.744281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22e1599b-d60b-433c-b559-fa1987588c32 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:46.976946 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-22e1599b-d60b-433c-b559-fa1987588c32 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:46.988491 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-22e1599b-d60b-433c-b559-fa1987588c32 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e" status: 200 len: 1364 microversion: 2.1 time: 0.263423 Jul 25 13:17:46.989525 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2921/5912] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:17:46 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e => generated 1364 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:17:48.014610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-125e3f8b-0265-4367-a2ef-eb8a9c3bb40c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:48.020454 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-125e3f8b-0265-4367-a2ef-eb8a9c3bb40c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:48.033055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-125e3f8b-0265-4367-a2ef-eb8a9c3bb40c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:48.035289 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-125e3f8b-0265-4367-a2ef-eb8a9c3bb40c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:48.036267 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-125e3f8b-0265-4367-a2ef-eb8a9c3bb40c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:48.037268 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-125e3f8b-0265-4367-a2ef-eb8a9c3bb40c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:48.299888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-125e3f8b-0265-4367-a2ef-eb8a9c3bb40c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:48.313935 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-125e3f8b-0265-4367-a2ef-eb8a9c3bb40c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e" status: 200 len: 1364 microversion: 2.1 time: 0.304867 Jul 25 13:17:48.325068 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2992/5913] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:17:48 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e => generated 1364 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:17:49.350388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e4f3e594-be54-400e-9ada-5e81ef72424f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:49.351179 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e4f3e594-be54-400e-9ada-5e81ef72424f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:49.357971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:17:49.358713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:17:49.361229 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4f3e594-be54-400e-9ada-5e81ef72424f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:49.361609 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4f3e594-be54-400e-9ada-5e81ef72424f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:49.362435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4f3e594-be54-400e-9ada-5e81ef72424f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:49.362892 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4f3e594-be54-400e-9ada-5e81ef72424f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:49.531227 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e4f3e594-be54-400e-9ada-5e81ef72424f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:49.558560 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e4f3e594-be54-400e-9ada-5e81ef72424f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e" status: 200 len: 1364 microversion: 2.1 time: 0.213523 Jul 25 13:17:49.569168 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2922/5914] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:17:49 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:17:50.439057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-06dae635-36dc-4101-b55f-1f559e7ee6a1 req-5756e09f-0d39-44a2-b9b6-c4933ab39d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4492f180-6de9-4618-9d5f-28ca90f6db3e", "name": "network-vif-plugged", "status": "completed", "tag": "ff06fd1a-52c7-4760-93c4-60c69802b48f"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:17:50.454158 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:17:50.460338 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-06dae635-36dc-4101-b55f-1f559e7ee6a1 req-5756e09f-0d39-44a2-b9b6-c4933ab39d39 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:50.461295 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-06dae635-36dc-4101-b55f-1f559e7ee6a1 req-5756e09f-0d39-44a2-b9b6-c4933ab39d39 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:50.491832 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-06dae635-36dc-4101-b55f-1f559e7ee6a1 req-5756e09f-0d39-44a2-b9b6-c4933ab39d39 service nova] Creating event network-vif-plugged:ff06fd1a-52c7-4760-93c4-60c69802b48f for instance 4492f180-6de9-4618-9d5f-28ca90f6db3e on n-h2-848886-15 Jul 25 13:17:50.498260 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-06dae635-36dc-4101-b55f-1f559e7ee6a1 req-5756e09f-0d39-44a2-b9b6-c4933ab39d39 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062639 Jul 25 13:17:50.499519 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2993/5915] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:17:50.590358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a1dd2690-d07f-4821-bd34-d47051a4c73e tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:50.591962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a1dd2690-d07f-4821-bd34-d47051a4c73e tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:50.598900 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a1dd2690-d07f-4821-bd34-d47051a4c73e tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:50.602485 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a1dd2690-d07f-4821-bd34-d47051a4c73e tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:50.603752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a1dd2690-d07f-4821-bd34-d47051a4c73e tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:50.604228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a1dd2690-d07f-4821-bd34-d47051a4c73e tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:50.804628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a1dd2690-d07f-4821-bd34-d47051a4c73e tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:50.813085 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a1dd2690-d07f-4821-bd34-d47051a4c73e tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e" status: 200 len: 1364 microversion: 2.1 time: 0.234124 Jul 25 13:17:50.813717 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2923/5916] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:17:50 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:17:51.842747 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a6df47c7-2a74-47a8-8e2d-1a03849faac6 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:51.844091 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a6df47c7-2a74-47a8-8e2d-1a03849faac6 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:51.855262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a6df47c7-2a74-47a8-8e2d-1a03849faac6 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:51.856808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a6df47c7-2a74-47a8-8e2d-1a03849faac6 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:51.858852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a6df47c7-2a74-47a8-8e2d-1a03849faac6 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:51.860016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a6df47c7-2a74-47a8-8e2d-1a03849faac6 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:52.031185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a6df47c7-2a74-47a8-8e2d-1a03849faac6 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:52.048765 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a6df47c7-2a74-47a8-8e2d-1a03849faac6 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e" status: 200 len: 1555 microversion: 2.1 time: 0.216954 Jul 25 13:17:52.049368 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2994/5917] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:17:51 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e => generated 1555 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:17:52.071614 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cf99cce6-dc5b-4225-a683-011e8b5bc7e2 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:52.072835 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cf99cce6-dc5b-4225-a683-011e8b5bc7e2 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:52.079962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf99cce6-dc5b-4225-a683-011e8b5bc7e2 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:52.080505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf99cce6-dc5b-4225-a683-011e8b5bc7e2 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:52.081401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf99cce6-dc5b-4225-a683-011e8b5bc7e2 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:52.081975 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf99cce6-dc5b-4225-a683-011e8b5bc7e2 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:52.180012 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cf99cce6-dc5b-4225-a683-011e8b5bc7e2 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113626 Jul 25 13:17:52.180828 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2924/5918] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 13:17:52 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:17:52.739895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-75e10c24-0fc3-4a20-a420-8937964bd4ed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-483498671", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1436557910", "security_groups": [{"name": "tempest-secgroup-smoke-2026990488"}], "block_device_mapping_v2": [{"uuid": "e3d54741-beb2-4643-9565-f772857a37bc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2e9a011a-2cfb-4a86-9ca1-b23997eebbe8"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:17:53.224055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-75e10c24-0fc3-4a20-a420-8937964bd4ed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] validate_networks() for [('2e9a011a-2cfb-4a86-9ca1-b23997eebbe8', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:17:53.753997 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-4046fd09-5e56-46b0-ae5b-91cde620f0c6 req-ef1b1969-f3fa-4bbd-b5e0-d32883e5f670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4492f180-6de9-4618-9d5f-28ca90f6db3e", "tag": "ff06fd1a-52c7-4760-93c4-60c69802b48f"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:17:53.771870 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4046fd09-5e56-46b0-ae5b-91cde620f0c6 req-ef1b1969-f3fa-4bbd-b5e0-d32883e5f670 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:53.775479 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4046fd09-5e56-46b0-ae5b-91cde620f0c6 req-ef1b1969-f3fa-4bbd-b5e0-d32883e5f670 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:53.792238 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-4046fd09-5e56-46b0-ae5b-91cde620f0c6 req-ef1b1969-f3fa-4bbd-b5e0-d32883e5f670 service nova] Creating event network-changed:ff06fd1a-52c7-4760-93c4-60c69802b48f for instance 4492f180-6de9-4618-9d5f-28ca90f6db3e on n-h2-848886-15 Jul 25 13:17:53.799529 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-4046fd09-5e56-46b0-ae5b-91cde620f0c6 req-ef1b1969-f3fa-4bbd-b5e0-d32883e5f670 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050407 Jul 25 13:17:53.800872 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2925/5919] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:17:53.968956 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-75e10c24-0fc3-4a20-a420-8937964bd4ed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:17:53.969731 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-75e10c24-0fc3-4a20-a420-8937964bd4ed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:17:53.970548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-75e10c24-0fc3-4a20-a420-8937964bd4ed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:17:53.971298 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-75e10c24-0fc3-4a20-a420-8937964bd4ed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:17:53.972677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-75e10c24-0fc3-4a20-a420-8937964bd4ed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:17:53.986598 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75e10c24-0fc3-4a20-a420-8937964bd4ed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:53.987521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75e10c24-0fc3-4a20-a420-8937964bd4ed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:53.988533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75e10c24-0fc3-4a20-a420-8937964bd4ed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:53.989591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75e10c24-0fc3-4a20-a420-8937964bd4ed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:54.015204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-75e10c24-0fc3-4a20-a420-8937964bd4ed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Getting quotas for project b2fbd681752c41d0a24a9cf34ebc8389. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:17:54.021728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-75e10c24-0fc3-4a20-a420-8937964bd4ed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Getting quotas for user 9face2aaa9df430cb5d361c6e1fdf242 and project b2fbd681752c41d0a24a9cf34ebc8389. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:17:54.092620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-75e10c24-0fc3-4a20-a420-8937964bd4ed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:17:54.095491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-75e10c24-0fc3-4a20-a420-8937964bd4ed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e3d54741-beb2-4643-9565-f772857a37bc',volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:17:54.267932 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-75e10c24-0fc3-4a20-a420-8937964bd4ed tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.530991 Jul 25 13:17:54.271376 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2995/5920] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:17:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:17:54.311387 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-29e2dd95-a321-4843-9274-44fd2f8c63d0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:54.312867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-29e2dd95-a321-4843-9274-44fd2f8c63d0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:54.489225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-29e2dd95-a321-4843-9274-44fd2f8c63d0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:54.499936 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-29e2dd95-a321-4843-9274-44fd2f8c63d0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1094 microversion: 2.1 time: 0.220610 Jul 25 13:17:54.501033 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2926/5921] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:17:54 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1094 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:17:55.522427 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-053944e3-e812-4e5d-bc48-bd5802d34315 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:55.524520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-053944e3-e812-4e5d-bc48-bd5802d34315 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:55.535212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-053944e3-e812-4e5d-bc48-bd5802d34315 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:55.536012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-053944e3-e812-4e5d-bc48-bd5802d34315 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:55.537129 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-053944e3-e812-4e5d-bc48-bd5802d34315 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:55.537857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-053944e3-e812-4e5d-bc48-bd5802d34315 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:55.616912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-053944e3-e812-4e5d-bc48-bd5802d34315 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:55.625611 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-053944e3-e812-4e5d-bc48-bd5802d34315 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1210 microversion: 2.1 time: 0.108805 Jul 25 13:17:55.626926 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2996/5922] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:17:55 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1210 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:17:56.651527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-414e715e-d913-46d3-98ef-cb9850f32830 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:56.653035 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-414e715e-d913-46d3-98ef-cb9850f32830 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:56.663440 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-414e715e-d913-46d3-98ef-cb9850f32830 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:56.664277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-414e715e-d913-46d3-98ef-cb9850f32830 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:56.665688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-414e715e-d913-46d3-98ef-cb9850f32830 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:56.666407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-414e715e-d913-46d3-98ef-cb9850f32830 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:56.933351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-39e2b121-1686-46f6-978a-bd4a2289b243 req-2018ac84-2b6e-40d4-8fd7-49fa2b99da9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3abc70b2-e7d4-4985-ba77-4f3c7f38606a", "tag": "0e15fd89-0026-49cf-aa70-e8650f769fa6"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:17:56.934390 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-414e715e-d913-46d3-98ef-cb9850f32830 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:56.944074 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-414e715e-d913-46d3-98ef-cb9850f32830 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1278 microversion: 2.1 time: 0.300408 Jul 25 13:17:56.944601 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2927/5923] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:17:56 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1278 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:17:56.977504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-39e2b121-1686-46f6-978a-bd4a2289b243 req-2018ac84-2b6e-40d4-8fd7-49fa2b99da9f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:56.980154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-39e2b121-1686-46f6-978a-bd4a2289b243 req-2018ac84-2b6e-40d4-8fd7-49fa2b99da9f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:56.996263 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-39e2b121-1686-46f6-978a-bd4a2289b243 req-2018ac84-2b6e-40d4-8fd7-49fa2b99da9f service nova] Creating event network-changed:0e15fd89-0026-49cf-aa70-e8650f769fa6 for instance 3abc70b2-e7d4-4985-ba77-4f3c7f38606a on n-h1-848886-15 Jul 25 13:17:57.004885 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-39e2b121-1686-46f6-978a-bd4a2289b243 req-2018ac84-2b6e-40d4-8fd7-49fa2b99da9f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083437 Jul 25 13:17:57.006280 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2997/5924] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:17:57.897019 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:17:57.897820 n-d-848886-15 devstack@n-api.service[125883]: Mon Jul 25 13:17:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:17:57.965527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-154d0ed3-658e-46b0-ae20-8eb82a633ac0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:57.966158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-154d0ed3-658e-46b0-ae20-8eb82a633ac0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:57.974661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-154d0ed3-658e-46b0-ae20-8eb82a633ac0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:57.975119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-154d0ed3-658e-46b0-ae20-8eb82a633ac0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:57.975970 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-154d0ed3-658e-46b0-ae20-8eb82a633ac0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:57.976579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-154d0ed3-658e-46b0-ae20-8eb82a633ac0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:58.172484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-154d0ed3-658e-46b0-ae20-8eb82a633ac0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:58.180905 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-154d0ed3-658e-46b0-ae20-8eb82a633ac0 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1278 microversion: 2.1 time: 0.219280 Jul 25 13:17:58.182188 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2928/5925] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:17:57 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1278 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:17:59.204244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e2488d6b-4d06-4dd4-a029-39e8ac87e3ad tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:17:59.205224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e2488d6b-4d06-4dd4-a029-39e8ac87e3ad tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:17:59.212527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2488d6b-4d06-4dd4-a029-39e8ac87e3ad tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:59.213047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2488d6b-4d06-4dd4-a029-39e8ac87e3ad tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:59.213916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2488d6b-4d06-4dd4-a029-39e8ac87e3ad tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:17:59.214437 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e2488d6b-4d06-4dd4-a029-39e8ac87e3ad tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:17:59.378778 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e2488d6b-4d06-4dd4-a029-39e8ac87e3ad tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:17:59.387652 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e2488d6b-4d06-4dd4-a029-39e8ac87e3ad tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1278 microversion: 2.1 time: 0.188792 Jul 25 13:17:59.388375 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2998/5926] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:17:59 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1278 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:00.409564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7b8d6b65-d8e8-46f1-9a41-f49d2d342b0f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:00.411383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7b8d6b65-d8e8-46f1-9a41-f49d2d342b0f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:00.421338 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b8d6b65-d8e8-46f1-9a41-f49d2d342b0f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:00.421801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b8d6b65-d8e8-46f1-9a41-f49d2d342b0f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:00.422661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b8d6b65-d8e8-46f1-9a41-f49d2d342b0f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:00.423139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b8d6b65-d8e8-46f1-9a41-f49d2d342b0f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:00.575404 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7b8d6b65-d8e8-46f1-9a41-f49d2d342b0f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:00.586442 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7b8d6b65-d8e8-46f1-9a41-f49d2d342b0f tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1278 microversion: 2.1 time: 0.181257 Jul 25 13:18:00.594934 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2929/5927] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:00 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1278 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:01.616965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f53d4cbe-d843-42c7-b55f-d9e1820218b2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:01.618218 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f53d4cbe-d843-42c7-b55f-d9e1820218b2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:01.629369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f53d4cbe-d843-42c7-b55f-d9e1820218b2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:01.632181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f53d4cbe-d843-42c7-b55f-d9e1820218b2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:01.633195 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f53d4cbe-d843-42c7-b55f-d9e1820218b2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:01.634245 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f53d4cbe-d843-42c7-b55f-d9e1820218b2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:01.833037 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f53d4cbe-d843-42c7-b55f-d9e1820218b2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:01.847059 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f53d4cbe-d843-42c7-b55f-d9e1820218b2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1278 microversion: 2.1 time: 0.233706 Jul 25 13:18:01.848389 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 2999/5928] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:01 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1278 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:02.874599 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-33fd4481-8f28-4469-9102-2151524c955a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:02.875228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-33fd4481-8f28-4469-9102-2151524c955a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:02.893456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-33fd4481-8f28-4469-9102-2151524c955a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:02.894681 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-33fd4481-8f28-4469-9102-2151524c955a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:02.896835 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-33fd4481-8f28-4469-9102-2151524c955a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:02.900033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-33fd4481-8f28-4469-9102-2151524c955a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:03.089016 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-33fd4481-8f28-4469-9102-2151524c955a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:03.097803 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-33fd4481-8f28-4469-9102-2151524c955a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1278 microversion: 2.1 time: 0.227034 Jul 25 13:18:03.099345 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2930/5929] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:02 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1278 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:04.121262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-174939c8-8e52-45ff-a37f-b8e40dbf008b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:04.121916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-174939c8-8e52-45ff-a37f-b8e40dbf008b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:04.127234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:18:04.128215 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:18:04.133509 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-174939c8-8e52-45ff-a37f-b8e40dbf008b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:04.134772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-174939c8-8e52-45ff-a37f-b8e40dbf008b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:04.135628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-174939c8-8e52-45ff-a37f-b8e40dbf008b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:04.136453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-174939c8-8e52-45ff-a37f-b8e40dbf008b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:04.276070 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-174939c8-8e52-45ff-a37f-b8e40dbf008b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:04.284120 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-174939c8-8e52-45ff-a37f-b8e40dbf008b tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1266 microversion: 2.1 time: 0.166878 Jul 25 13:18:04.284706 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3000/5930] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:04 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:05.305211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-327c3fa6-296d-444e-8a88-8091dad73c64 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:05.305956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-327c3fa6-296d-444e-8a88-8091dad73c64 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:05.308788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:18:05.315368 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-327c3fa6-296d-444e-8a88-8091dad73c64 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:05.315923 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-327c3fa6-296d-444e-8a88-8091dad73c64 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:05.316775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-327c3fa6-296d-444e-8a88-8091dad73c64 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:05.317443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-327c3fa6-296d-444e-8a88-8091dad73c64 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:05.468318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-327c3fa6-296d-444e-8a88-8091dad73c64 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:05.475983 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-327c3fa6-296d-444e-8a88-8091dad73c64 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1266 microversion: 2.1 time: 0.175132 Jul 25 13:18:05.476564 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2931/5931] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:05 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:06.497721 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0104ef63-5f58-4153-9284-5efae35d350e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:06.498317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0104ef63-5f58-4153-9284-5efae35d350e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:06.501132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:18:06.506598 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0104ef63-5f58-4153-9284-5efae35d350e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:06.507057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0104ef63-5f58-4153-9284-5efae35d350e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:06.507835 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0104ef63-5f58-4153-9284-5efae35d350e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:06.508277 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0104ef63-5f58-4153-9284-5efae35d350e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:06.511442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=57 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:18:06.646001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0104ef63-5f58-4153-9284-5efae35d350e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:06.654923 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0104ef63-5f58-4153-9284-5efae35d350e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1266 microversion: 2.1 time: 0.160583 Jul 25 13:18:06.655694 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3001/5932] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:06 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:07.677034 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6f214c3b-71ac-418f-829f-1d182e043a13 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:07.678252 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6f214c3b-71ac-418f-829f-1d182e043a13 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:07.685321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f214c3b-71ac-418f-829f-1d182e043a13 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:07.685868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f214c3b-71ac-418f-829f-1d182e043a13 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:07.686705 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f214c3b-71ac-418f-829f-1d182e043a13 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:07.687325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f214c3b-71ac-418f-829f-1d182e043a13 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:07.870550 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6f214c3b-71ac-418f-829f-1d182e043a13 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:07.878422 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6f214c3b-71ac-418f-829f-1d182e043a13 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1266 microversion: 2.1 time: 0.205474 Jul 25 13:18:07.879001 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2932/5933] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:07 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:08.900442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ff903286-954f-48f9-ab15-8fb8ca30223a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:08.900843 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ff903286-954f-48f9-ab15-8fb8ca30223a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:08.908512 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff903286-954f-48f9-ab15-8fb8ca30223a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:08.909038 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff903286-954f-48f9-ab15-8fb8ca30223a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:08.910123 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff903286-954f-48f9-ab15-8fb8ca30223a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:08.910649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff903286-954f-48f9-ab15-8fb8ca30223a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:09.198792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ff903286-954f-48f9-ab15-8fb8ca30223a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:09.206858 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ff903286-954f-48f9-ab15-8fb8ca30223a tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1266 microversion: 2.1 time: 0.311018 Jul 25 13:18:09.213882 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3002/5934] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:08 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1266 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:10.228176 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-99414ca7-6419-4e4d-9cfd-8c45b03b085e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:10.229442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-99414ca7-6419-4e4d-9cfd-8c45b03b085e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:10.232515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:18:10.237996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-99414ca7-6419-4e4d-9cfd-8c45b03b085e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:10.238475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-99414ca7-6419-4e4d-9cfd-8c45b03b085e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:10.239235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-99414ca7-6419-4e4d-9cfd-8c45b03b085e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:10.239679 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-99414ca7-6419-4e4d-9cfd-8c45b03b085e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:10.244490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=81 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:18:10.383087 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-99414ca7-6419-4e4d-9cfd-8c45b03b085e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:10.392548 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-99414ca7-6419-4e4d-9cfd-8c45b03b085e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1266 microversion: 2.1 time: 0.168435 Jul 25 13:18:10.393313 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2933/5935] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:10 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:11.413617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-08395738-bd78-41bb-bd50-81095c0af650 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:11.414248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-08395738-bd78-41bb-bd50-81095c0af650 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:11.421534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-08395738-bd78-41bb-bd50-81095c0af650 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:11.421993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-08395738-bd78-41bb-bd50-81095c0af650 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:11.422864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-08395738-bd78-41bb-bd50-81095c0af650 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:11.423331 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-08395738-bd78-41bb-bd50-81095c0af650 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:11.568742 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-08395738-bd78-41bb-bd50-81095c0af650 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:11.579387 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-08395738-bd78-41bb-bd50-81095c0af650 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1266 microversion: 2.1 time: 0.169826 Jul 25 13:18:11.580200 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3003/5936] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:11 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:12.600146 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c8d369c7-c61b-425c-ad1b-9ee3eb19bbfc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:12.600779 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c8d369c7-c61b-425c-ad1b-9ee3eb19bbfc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:12.610614 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8d369c7-c61b-425c-ad1b-9ee3eb19bbfc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:12.611076 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8d369c7-c61b-425c-ad1b-9ee3eb19bbfc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:12.611874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8d369c7-c61b-425c-ad1b-9ee3eb19bbfc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:12.612317 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8d369c7-c61b-425c-ad1b-9ee3eb19bbfc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:12.828297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c8d369c7-c61b-425c-ad1b-9ee3eb19bbfc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:12.836281 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c8d369c7-c61b-425c-ad1b-9ee3eb19bbfc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1266 microversion: 2.1 time: 0.240425 Jul 25 13:18:12.837432 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2934/5937] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:12 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:13.857347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c705264c-ce25-49d8-8330-ff9a49ebfcdc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:13.858133 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c705264c-ce25-49d8-8330-ff9a49ebfcdc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:13.865359 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c705264c-ce25-49d8-8330-ff9a49ebfcdc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:13.865953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c705264c-ce25-49d8-8330-ff9a49ebfcdc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:13.866789 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c705264c-ce25-49d8-8330-ff9a49ebfcdc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:13.867349 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c705264c-ce25-49d8-8330-ff9a49ebfcdc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:14.071718 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c705264c-ce25-49d8-8330-ff9a49ebfcdc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:14.081718 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c705264c-ce25-49d8-8330-ff9a49ebfcdc tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1266 microversion: 2.1 time: 0.228708 Jul 25 13:18:14.082374 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3004/5938] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:13 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:14.292012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-e0192cd3-69bf-4654-b2e2-ea95ce2f3c77 req-caa6ee42-3a7d-4fe5-890f-77cc55db1186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3abc70b2-e7d4-4985-ba77-4f3c7f38606a", "name": "network-vif-plugged", "status": "completed", "tag": "0e15fd89-0026-49cf-aa70-e8650f769fa6"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:18:14.310956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e0192cd3-69bf-4654-b2e2-ea95ce2f3c77 req-caa6ee42-3a7d-4fe5-890f-77cc55db1186 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:14.311564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e0192cd3-69bf-4654-b2e2-ea95ce2f3c77 req-caa6ee42-3a7d-4fe5-890f-77cc55db1186 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:14.337474 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-e0192cd3-69bf-4654-b2e2-ea95ce2f3c77 req-caa6ee42-3a7d-4fe5-890f-77cc55db1186 service nova] Creating event network-vif-plugged:0e15fd89-0026-49cf-aa70-e8650f769fa6 for instance 3abc70b2-e7d4-4985-ba77-4f3c7f38606a on n-h1-848886-15 Jul 25 13:18:14.344052 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-e0192cd3-69bf-4654-b2e2-ea95ce2f3c77 req-caa6ee42-3a7d-4fe5-890f-77cc55db1186 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055681 Jul 25 13:18:14.345170 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2935/5939] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:18:15.104367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-217fd016-28f8-4a1f-b3d0-118ed345ffae tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:15.105004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-217fd016-28f8-4a1f-b3d0-118ed345ffae tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:15.114740 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-217fd016-28f8-4a1f-b3d0-118ed345ffae tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:15.115206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-217fd016-28f8-4a1f-b3d0-118ed345ffae tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:15.116284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-217fd016-28f8-4a1f-b3d0-118ed345ffae tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:15.116898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-217fd016-28f8-4a1f-b3d0-118ed345ffae tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:15.266839 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-217fd016-28f8-4a1f-b3d0-118ed345ffae tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:15.275298 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-217fd016-28f8-4a1f-b3d0-118ed345ffae tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1266 microversion: 2.1 time: 0.176356 Jul 25 13:18:15.275895 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3005/5940] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:15 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:16.298781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9547641b-37f6-4101-a17e-246869e00520 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:16.299743 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9547641b-37f6-4101-a17e-246869e00520 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:16.307598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9547641b-37f6-4101-a17e-246869e00520 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:16.308738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9547641b-37f6-4101-a17e-246869e00520 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:16.310187 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9547641b-37f6-4101-a17e-246869e00520 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:16.310884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9547641b-37f6-4101-a17e-246869e00520 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:16.462146 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9547641b-37f6-4101-a17e-246869e00520 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:16.472224 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9547641b-37f6-4101-a17e-246869e00520 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1453 microversion: 2.1 time: 0.177787 Jul 25 13:18:16.473156 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2936/5941] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:16 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1453 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:16.494809 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-073b04a8-ac39-43e4-a370-f0142986446d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:16.495376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-073b04a8-ac39-43e4-a370-f0142986446d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:16.503094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-073b04a8-ac39-43e4-a370-f0142986446d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:16.503758 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-073b04a8-ac39-43e4-a370-f0142986446d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:16.504560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-073b04a8-ac39-43e4-a370-f0142986446d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:16.504995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-073b04a8-ac39-43e4-a370-f0142986446d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:16.638606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-073b04a8-ac39-43e4-a370-f0142986446d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:16.648956 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-073b04a8-ac39-43e4-a370-f0142986446d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1453 microversion: 2.1 time: 0.158786 Jul 25 13:18:16.649567 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3006/5942] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:16 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:18.700600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-1b783f7b-97cc-437b-b1a7-6fdc5876727d req-f6fea7b1-56f8-4cf7-9e96-093fd778f204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3abc70b2-e7d4-4985-ba77-4f3c7f38606a", "tag": "0e15fd89-0026-49cf-aa70-e8650f769fa6"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:18:18.714048 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-1b783f7b-97cc-437b-b1a7-6fdc5876727d req-f6fea7b1-56f8-4cf7-9e96-093fd778f204 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:18.716095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-1b783f7b-97cc-437b-b1a7-6fdc5876727d req-f6fea7b1-56f8-4cf7-9e96-093fd778f204 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:18.728484 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-1b783f7b-97cc-437b-b1a7-6fdc5876727d req-f6fea7b1-56f8-4cf7-9e96-093fd778f204 service nova] Creating event network-changed:0e15fd89-0026-49cf-aa70-e8650f769fa6 for instance 3abc70b2-e7d4-4985-ba77-4f3c7f38606a on n-h1-848886-15 Jul 25 13:18:18.734780 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-1b783f7b-97cc-437b-b1a7-6fdc5876727d req-f6fea7b1-56f8-4cf7-9e96-093fd778f204 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038833 Jul 25 13:18:18.739414 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2937/5943] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:18:30.059859 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5318d8bd-ecb8-4b00-af53-b9a5b91b637f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:30.061069 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5318d8bd-ecb8-4b00-af53-b9a5b91b637f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:30.065900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=11 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:18:30.066768 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=35 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:18:30.072687 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5318d8bd-ecb8-4b00-af53-b9a5b91b637f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:30.073141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5318d8bd-ecb8-4b00-af53-b9a5b91b637f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:30.073981 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5318d8bd-ecb8-4b00-af53-b9a5b91b637f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:30.074425 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5318d8bd-ecb8-4b00-af53-b9a5b91b637f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:30.112752 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5318d8bd-ecb8-4b00-af53-b9a5b91b637f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e/ips" status: 200 len: 151 microversion: 2.1 time: 0.058782 Jul 25 13:18:30.120819 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3007/5944] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Jul 25 13:18:30 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e/ips => generated 151 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:18:32.590433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=9 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:18:32.591204 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=21 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:18:32.596261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0ab39cd0-30f3-412d-8b2b-e3c053da73c5 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c872a6d8-575a-41eb-a543-0c61668b6de7"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:18:32.599076 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0ab39cd0-30f3-412d-8b2b-e3c053da73c5 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:32.606803 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ab39cd0-30f3-412d-8b2b-e3c053da73c5 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:32.607291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ab39cd0-30f3-412d-8b2b-e3c053da73c5 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:32.608043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ab39cd0-30f3-412d-8b2b-e3c053da73c5 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:32.608504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ab39cd0-30f3-412d-8b2b-e3c053da73c5 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:32.879625 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0ab39cd0-30f3-412d-8b2b-e3c053da73c5 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "POST /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290882 Jul 25 13:18:32.880645 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2938/5945] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Jul 25 13:18:32 2022] POST /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:18:44.883632 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a8fd2594-919c-40aa-8420-c64f3c9e3166 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Action: 'create', calling method: .version_select at 0x7efcfed48af0>, body: {"keypair": {"name": "tempest-keypair-632685512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdXbG2mZPwrPl9KzX5JK8iuC48fuydEdPMhK+7MIfea5EZVtDVpYWjxNUhMPtpY/cmIoACN2zh1y7Mc4xfiKzb3nkTJgceb06LEdcabERIOVJ/aXrR4VbeCxwmwFpJg8g=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:18:44.889561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:18:44.890527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:18:44.904422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-a8fd2594-919c-40aa-8420-c64f3c9e3166 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Getting quotas for project 805811c2762b477cae7cb16377e12dac. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:18:44.910032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-a8fd2594-919c-40aa-8420-c64f3c9e3166 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Getting quotas for user 3092b4bfef6f4d778d52e9de3cd1b785 and project 805811c2762b477cae7cb16377e12dac. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:18:44.938123 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a8fd2594-919c-40aa-8420-c64f3c9e3166 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058415 Jul 25 13:18:44.938738 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3008/5946] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:18:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:18:46.393453 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:18:46.394807 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:18:46.399535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-78ce2841-b245-4436-a046-b1db08ac5c39 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1984873651", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e17217fe-ccfb-47ee-98dd-b05efd6867f9"}], "security_groups": [{"name": "tempest-securitygroup--508842734"}], "key_name": "tempest-keypair-632685512", "user_data": "}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:18:46.539435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-78ce2841-b245-4436-a046-b1db08ac5c39 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] validate_networks() for [('e17217fe-ccfb-47ee-98dd-b05efd6867f9', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:18:46.975673 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-78ce2841-b245-4436-a046-b1db08ac5c39 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:18:46.976107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-78ce2841-b245-4436-a046-b1db08ac5c39 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:18:46.976607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-78ce2841-b245-4436-a046-b1db08ac5c39 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:18:46.977026 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-78ce2841-b245-4436-a046-b1db08ac5c39 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:18:46.977453 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-78ce2841-b245-4436-a046-b1db08ac5c39 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:18:46.986989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78ce2841-b245-4436-a046-b1db08ac5c39 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:46.987457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78ce2841-b245-4436-a046-b1db08ac5c39 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:46.988267 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78ce2841-b245-4436-a046-b1db08ac5c39 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:46.988716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-78ce2841-b245-4436-a046-b1db08ac5c39 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:47.006575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-78ce2841-b245-4436-a046-b1db08ac5c39 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Getting quotas for project 805811c2762b477cae7cb16377e12dac. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:18:47.012167 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-78ce2841-b245-4436-a046-b1db08ac5c39 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Getting quotas for user 3092b4bfef6f4d778d52e9de3cd1b785 and project 805811c2762b477cae7cb16377e12dac. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:18:47.027440 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-78ce2841-b245-4436-a046-b1db08ac5c39 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:18:47.030056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-78ce2841-b245-4436-a046-b1db08ac5c39 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: f55e8c47-349f-430a-890e-6dfaeb6155b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:18:47.092424 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-78ce2841-b245-4436-a046-b1db08ac5c39 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.700606 Jul 25 13:18:47.094492 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2939/5947] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:18:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:18:47.106401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4647e0b2-09e3-4480-a3f6-c63a79f76387 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:47.107050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4647e0b2-09e3-4480-a3f6-c63a79f76387 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: f55e8c47-349f-430a-890e-6dfaeb6155b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:47.181111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4647e0b2-09e3-4480-a3f6-c63a79f76387 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:47.190897 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4647e0b2-09e3-4480-a3f6-c63a79f76387 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4" status: 200 len: 1241 microversion: 2.1 time: 0.087763 Jul 25 13:18:47.203712 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3009/5948] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:47 2022] GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4 => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:18:48.213318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-998f4652-724a-47a9-b80b-673e3aee4824 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:48.214634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-998f4652-724a-47a9-b80b-673e3aee4824 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: f55e8c47-349f-430a-890e-6dfaeb6155b4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:48.223788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-998f4652-724a-47a9-b80b-673e3aee4824 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:48.224523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-998f4652-724a-47a9-b80b-673e3aee4824 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:48.225648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-998f4652-724a-47a9-b80b-673e3aee4824 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:48.226282 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-998f4652-724a-47a9-b80b-673e3aee4824 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:48.318791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-998f4652-724a-47a9-b80b-673e3aee4824 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:48.330691 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-998f4652-724a-47a9-b80b-673e3aee4824 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4" status: 200 len: 1301 microversion: 2.1 time: 0.122830 Jul 25 13:18:48.331728 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2940/5949] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:48 2022] GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4 => generated 1301 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:49.355472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f97fe80a-5af0-4de1-8e27-b240b7919988 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:49.356950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f97fe80a-5af0-4de1-8e27-b240b7919988 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: f55e8c47-349f-430a-890e-6dfaeb6155b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:49.366792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f97fe80a-5af0-4de1-8e27-b240b7919988 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:49.368265 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f97fe80a-5af0-4de1-8e27-b240b7919988 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:49.369936 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f97fe80a-5af0-4de1-8e27-b240b7919988 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:49.370379 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f97fe80a-5af0-4de1-8e27-b240b7919988 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:49.617137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f97fe80a-5af0-4de1-8e27-b240b7919988 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:49.667226 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f97fe80a-5af0-4de1-8e27-b240b7919988 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4" status: 200 len: 1366 microversion: 2.1 time: 0.315794 Jul 25 13:18:49.672258 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3010/5950] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:49 2022] GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4 => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:49.940149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-b64bf209-c7f0-40f1-98b8-7f3beae854f1 req-b0512c73-9bd5-4e73-86e9-a694da551090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f55e8c47-349f-430a-890e-6dfaeb6155b4", "tag": "bd3ed842-0343-4c21-afd4-4a735a0a2eeb"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:18:49.987712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b64bf209-c7f0-40f1-98b8-7f3beae854f1 req-b0512c73-9bd5-4e73-86e9-a694da551090 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:49.988183 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b64bf209-c7f0-40f1-98b8-7f3beae854f1 req-b0512c73-9bd5-4e73-86e9-a694da551090 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:50.018587 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-b64bf209-c7f0-40f1-98b8-7f3beae854f1 req-b0512c73-9bd5-4e73-86e9-a694da551090 service nova] Creating event network-changed:bd3ed842-0343-4c21-afd4-4a735a0a2eeb for instance f55e8c47-349f-430a-890e-6dfaeb6155b4 on n-h2-848886-15 Jul 25 13:18:50.028679 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-b64bf209-c7f0-40f1-98b8-7f3beae854f1 req-b0512c73-9bd5-4e73-86e9-a694da551090 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093412 Jul 25 13:18:50.036220 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2941/5951] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:18:50.690377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-45bb8805-444f-48f5-ba6e-ed78bdbe1792 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:50.690970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-45bb8805-444f-48f5-ba6e-ed78bdbe1792 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: f55e8c47-349f-430a-890e-6dfaeb6155b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:50.698254 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45bb8805-444f-48f5-ba6e-ed78bdbe1792 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:50.698704 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45bb8805-444f-48f5-ba6e-ed78bdbe1792 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:50.699462 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45bb8805-444f-48f5-ba6e-ed78bdbe1792 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:50.699896 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45bb8805-444f-48f5-ba6e-ed78bdbe1792 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:50.860718 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-45bb8805-444f-48f5-ba6e-ed78bdbe1792 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:50.868694 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-45bb8805-444f-48f5-ba6e-ed78bdbe1792 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4" status: 200 len: 1366 microversion: 2.1 time: 0.182179 Jul 25 13:18:50.869438 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3011/5952] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:50 2022] GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:51.891398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-56d190e1-c427-41bb-b6c2-2e580f589409 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:51.892476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-56d190e1-c427-41bb-b6c2-2e580f589409 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: f55e8c47-349f-430a-890e-6dfaeb6155b4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:51.899246 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56d190e1-c427-41bb-b6c2-2e580f589409 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:51.899801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56d190e1-c427-41bb-b6c2-2e580f589409 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:51.900661 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56d190e1-c427-41bb-b6c2-2e580f589409 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:51.901220 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56d190e1-c427-41bb-b6c2-2e580f589409 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:52.053328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-56d190e1-c427-41bb-b6c2-2e580f589409 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:52.062854 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-56d190e1-c427-41bb-b6c2-2e580f589409 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4" status: 200 len: 1366 microversion: 2.1 time: 0.177329 Jul 25 13:18:52.069087 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2942/5953] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:51 2022] GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:53.085257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d384884d-3976-403b-af56-857a6eca632d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:53.085936 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d384884d-3976-403b-af56-857a6eca632d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: f55e8c47-349f-430a-890e-6dfaeb6155b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:53.094753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d384884d-3976-403b-af56-857a6eca632d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:53.095378 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d384884d-3976-403b-af56-857a6eca632d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:53.096496 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d384884d-3976-403b-af56-857a6eca632d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:53.096940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d384884d-3976-403b-af56-857a6eca632d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:53.237897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d384884d-3976-403b-af56-857a6eca632d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:53.245723 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d384884d-3976-403b-af56-857a6eca632d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4" status: 200 len: 1366 microversion: 2.1 time: 0.165206 Jul 25 13:18:53.246479 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3012/5954] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:53 2022] GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:54.267119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0558d03b-9c16-45b2-a802-503baf2d249f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:54.267908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0558d03b-9c16-45b2-a802-503baf2d249f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: f55e8c47-349f-430a-890e-6dfaeb6155b4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:54.275318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0558d03b-9c16-45b2-a802-503baf2d249f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:54.275791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0558d03b-9c16-45b2-a802-503baf2d249f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:54.276627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0558d03b-9c16-45b2-a802-503baf2d249f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:54.277081 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0558d03b-9c16-45b2-a802-503baf2d249f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:54.443240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0558d03b-9c16-45b2-a802-503baf2d249f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:54.481256 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0558d03b-9c16-45b2-a802-503baf2d249f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4" status: 200 len: 1366 microversion: 2.1 time: 0.188570 Jul 25 13:18:54.481256 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2943/5955] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:54 2022] GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:55.475127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b7fb3d8b-6268-4644-92a5-859a22d1b7ca tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:55.475844 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b7fb3d8b-6268-4644-92a5-859a22d1b7ca tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: f55e8c47-349f-430a-890e-6dfaeb6155b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:55.484253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7fb3d8b-6268-4644-92a5-859a22d1b7ca tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:55.484779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7fb3d8b-6268-4644-92a5-859a22d1b7ca tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:55.485623 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7fb3d8b-6268-4644-92a5-859a22d1b7ca tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:55.486099 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7fb3d8b-6268-4644-92a5-859a22d1b7ca tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:55.648798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b7fb3d8b-6268-4644-92a5-859a22d1b7ca tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:55.658082 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b7fb3d8b-6268-4644-92a5-859a22d1b7ca tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4" status: 200 len: 1366 microversion: 2.1 time: 0.187312 Jul 25 13:18:55.669379 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3013/5956] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:55 2022] GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:56.681591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2907c3b6-44b7-42e3-b1a7-27279365dc49 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:56.682580 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2907c3b6-44b7-42e3-b1a7-27279365dc49 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: f55e8c47-349f-430a-890e-6dfaeb6155b4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:56.708033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2907c3b6-44b7-42e3-b1a7-27279365dc49 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:56.708764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2907c3b6-44b7-42e3-b1a7-27279365dc49 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:56.710655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2907c3b6-44b7-42e3-b1a7-27279365dc49 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:56.711444 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2907c3b6-44b7-42e3-b1a7-27279365dc49 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:56.786833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-1acd9c63-0429-4796-812c-5be9dafed207 req-150406a8-7408-46f7-8d06-d3d81d12c54b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55e8c47-349f-430a-890e-6dfaeb6155b4", "name": "network-vif-plugged", "status": "completed", "tag": "bd3ed842-0343-4c21-afd4-4a735a0a2eeb"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:18:56.804204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-1acd9c63-0429-4796-812c-5be9dafed207 req-150406a8-7408-46f7-8d06-d3d81d12c54b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:56.804617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-1acd9c63-0429-4796-812c-5be9dafed207 req-150406a8-7408-46f7-8d06-d3d81d12c54b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:56.837179 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-1acd9c63-0429-4796-812c-5be9dafed207 req-150406a8-7408-46f7-8d06-d3d81d12c54b service nova] Creating event network-vif-plugged:bd3ed842-0343-4c21-afd4-4a735a0a2eeb for instance f55e8c47-349f-430a-890e-6dfaeb6155b4 on n-h2-848886-15 Jul 25 13:18:56.844382 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-1acd9c63-0429-4796-812c-5be9dafed207 req-150406a8-7408-46f7-8d06-d3d81d12c54b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061495 Jul 25 13:18:56.847309 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3014/5957] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:18:56.893518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2907c3b6-44b7-42e3-b1a7-27279365dc49 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:56.902749 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2907c3b6-44b7-42e3-b1a7-27279365dc49 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4" status: 200 len: 1366 microversion: 2.1 time: 0.225802 Jul 25 13:18:56.903577 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2944/5958] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:56 2022] GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:57.929115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c4d7281d-b7ea-45f6-8c96-ca0ba1051a44 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:57.930943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c4d7281d-b7ea-45f6-8c96-ca0ba1051a44 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: f55e8c47-349f-430a-890e-6dfaeb6155b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:57.945190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:18:57.949103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c4d7281d-b7ea-45f6-8c96-ca0ba1051a44 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:57.949628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c4d7281d-b7ea-45f6-8c96-ca0ba1051a44 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:57.950682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c4d7281d-b7ea-45f6-8c96-ca0ba1051a44 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:57.951439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c4d7281d-b7ea-45f6-8c96-ca0ba1051a44 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:58.174397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c4d7281d-b7ea-45f6-8c96-ca0ba1051a44 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:58.190161 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c4d7281d-b7ea-45f6-8c96-ca0ba1051a44 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4" status: 200 len: 1366 microversion: 2.1 time: 0.266466 Jul 25 13:18:58.204774 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3015/5959] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:57 2022] GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:59.211969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c2a832fd-897f-48fd-8c39-4e5642f83b05 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:59.212546 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c2a832fd-897f-48fd-8c39-4e5642f83b05 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: f55e8c47-349f-430a-890e-6dfaeb6155b4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:59.214742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:18:59.215818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:18:59.223329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2a832fd-897f-48fd-8c39-4e5642f83b05 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:59.223781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2a832fd-897f-48fd-8c39-4e5642f83b05 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:59.224608 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2a832fd-897f-48fd-8c39-4e5642f83b05 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:59.225056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c2a832fd-897f-48fd-8c39-4e5642f83b05 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:59.413425 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c2a832fd-897f-48fd-8c39-4e5642f83b05 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:18:59.426158 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c2a832fd-897f-48fd-8c39-4e5642f83b05 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4" status: 200 len: 1557 microversion: 2.1 time: 0.218069 Jul 25 13:18:59.426754 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2945/5960] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:18:59 2022] GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4 => generated 1557 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:18:59.451558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-61570a51-6156-4686-9d6e-8a2d287d1d3a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:18:59.454730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-61570a51-6156-4686-9d6e-8a2d287d1d3a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: f55e8c47-349f-430a-890e-6dfaeb6155b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:18:59.472822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-61570a51-6156-4686-9d6e-8a2d287d1d3a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:59.473111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-61570a51-6156-4686-9d6e-8a2d287d1d3a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:59.474532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-61570a51-6156-4686-9d6e-8a2d287d1d3a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:18:59.474838 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-61570a51-6156-4686-9d6e-8a2d287d1d3a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:18:59.570502 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-61570a51-6156-4686-9d6e-8a2d287d1d3a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.125850 Jul 25 13:18:59.571422 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3016/5961] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 13:18:59 2022] GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:19:00.686294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-b1da6725-ffbc-49b1-93ba-ad7c5c849663 req-fff48f80-8c3d-45cc-8e61-3a7c1269ac82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f55e8c47-349f-430a-890e-6dfaeb6155b4", "tag": "bd3ed842-0343-4c21-afd4-4a735a0a2eeb"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:19:00.707935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b1da6725-ffbc-49b1-93ba-ad7c5c849663 req-fff48f80-8c3d-45cc-8e61-3a7c1269ac82 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:00.708419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b1da6725-ffbc-49b1-93ba-ad7c5c849663 req-fff48f80-8c3d-45cc-8e61-3a7c1269ac82 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:00.729091 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-b1da6725-ffbc-49b1-93ba-ad7c5c849663 req-fff48f80-8c3d-45cc-8e61-3a7c1269ac82 service nova] Creating event network-changed:bd3ed842-0343-4c21-afd4-4a735a0a2eeb for instance f55e8c47-349f-430a-890e-6dfaeb6155b4 on n-h2-848886-15 Jul 25 13:19:00.734873 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-b1da6725-ffbc-49b1-93ba-ad7c5c849663 req-fff48f80-8c3d-45cc-8e61-3a7c1269ac82 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053346 Jul 25 13:19:00.736058 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2946/5962] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:19:34.735916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:19:34.736658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=36 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:19:34.741010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9bcd5334-89bd-4544-88ba-de50b8d5e223 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:34.741578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9bcd5334-89bd-4544-88ba-de50b8d5e223 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: f55e8c47-349f-430a-890e-6dfaeb6155b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:34.748984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9bcd5334-89bd-4544-88ba-de50b8d5e223 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:34.749446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9bcd5334-89bd-4544-88ba-de50b8d5e223 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:34.750251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9bcd5334-89bd-4544-88ba-de50b8d5e223 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:34.750698 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9bcd5334-89bd-4544-88ba-de50b8d5e223 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:34.778281 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9bcd5334-89bd-4544-88ba-de50b8d5e223 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4/ips" status: 200 len: 151 microversion: 2.1 time: 0.044320 Jul 25 13:19:34.778907 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3017/5963] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Jul 25 13:19:34 2022] GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:19:34.791650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:19:34.793078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=36 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:19:34.799286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7e51e36a-0464-4e85-879a-22907f2d76aa tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c872a6d8-575a-41eb-a543-0c61668b6de7"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:19:34.801756 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7e51e36a-0464-4e85-879a-22907f2d76aa tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: f55e8c47-349f-430a-890e-6dfaeb6155b4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:34.810171 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e51e36a-0464-4e85-879a-22907f2d76aa tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:34.810638 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e51e36a-0464-4e85-879a-22907f2d76aa tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:34.811590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e51e36a-0464-4e85-879a-22907f2d76aa tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:34.812056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e51e36a-0464-4e85-879a-22907f2d76aa tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:34.908467 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-7e51e36a-0464-4e85-879a-22907f2d76aa tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] HTTP exception thrown: Invalid volume: volume c872a6d8-575a-41eb-a543-0c61668b6de7 is already attached to instances: 4492f180-6de9-4618-9d5f-28ca90f6db3e Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7e51e36a-0464-4e85-879a-22907f2d76aa tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Request method failure captured: Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4/os-volume_attachments HTTP/1.1 Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 74 Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pfvdELBqc9ktGA5Lf40UAQ78535PWLYdV07ICt2wdq2RGB8ieRYQg1pW--wMG6xplNKDuvq-CZoEGzYXFP5IvXxGjkhJA3p-eAzNDkDVUaa03y9emRX7H5OKq6_lJxEVfuNLo8utSx2bi7m4uQFvPZDAYfj7NiFWNJBHuf2bTAGGbI Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_805811c2762b477cae7cb16377e12dac", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/805811c2762b477cae7cb16377e12dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}] Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 3092b4bfef6f4d778d52e9de3cd1b785 Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: {"volumeAttachment": {"volumeId": "c872a6d8-575a-41eb-a543-0c61668b6de7"}} Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid volume: volume c872a6d8-575a-41eb-a543-0c61668b6de7 is already attached to instances: 4492f180-6de9-4618-9d5f-28ca90f6db3e Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'server_id': 'f55e8c47-349f-430a-890e-6dfaeb6155b4', 'body': {'volumeAttachment': {'volumeId': 'c872a6d8-575a-41eb-a543-0c61668b6de7'}}} Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c872a6d8-575a-41eb-a543-0c61668b6de7 is already attached to instances: 4492f180-6de9-4618-9d5f-28ca90f6db3e Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:19:34.916298 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:19:34.920608 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:19:34.920608 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:19:34.920608 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 13:19:34.920608 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 13:19:34.920608 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c872a6d8-575a-41eb-a543-0c61668b6de7 is already attached to instances: 4492f180-6de9-4618-9d5f-28ca90f6db3e Jul 25 13:19:34.920608 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:19:34.920608 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:19:34.920608 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:19:34.920608 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:19:34.920608 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:19:34.920608 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:19:34.920608 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:19:34.920608 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:19:34.920608 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c872a6d8-575a-41eb-a543-0c61668b6de7 is already attached to instances: 4492f180-6de9-4618-9d5f-28ca90f6db3e Jul 25 13:19:34.920608 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:19:34.923160 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7e51e36a-0464-4e85-879a-22907f2d76aa tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Returning 400 to user: Invalid volume: volume c872a6d8-575a-41eb-a543-0c61668b6de7 is already attached to instances: 4492f180-6de9-4618-9d5f-28ca90f6db3e {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:19:34.925455 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7e51e36a-0464-4e85-879a-22907f2d76aa tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "POST /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.135153 Jul 25 13:19:34.926141 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2947/5964] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Jul 25 13:19:34 2022] POST /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4/os-volume_attachments => generated 174 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:19:34.934502 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e3cb42f9-ae3a-47e9-a8e0-fd7996f6e58b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:34.935159 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e3cb42f9-ae3a-47e9-a8e0-fd7996f6e58b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: f55e8c47-349f-430a-890e-6dfaeb6155b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:34.942115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e3cb42f9-ae3a-47e9-a8e0-fd7996f6e58b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:34.942559 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e3cb42f9-ae3a-47e9-a8e0-fd7996f6e58b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:34.943808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e3cb42f9-ae3a-47e9-a8e0-fd7996f6e58b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:34.944947 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e3cb42f9-ae3a-47e9-a8e0-fd7996f6e58b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:34.974087 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e3cb42f9-ae3a-47e9-a8e0-fd7996f6e58b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: f55e8c47-349f-430a-890e-6dfaeb6155b4] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:19:35.080661 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e3cb42f9-ae3a-47e9-a8e0-fd7996f6e58b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4" status: 204 len: 0 microversion: 2.1 time: 0.149682 Jul 25 13:19:35.082645 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3018/5965] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:19:34 2022] DELETE /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:19:35.093374 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e91e9eb5-6ccd-4ae4-a253-0b5e53219628 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:35.094462 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e91e9eb5-6ccd-4ae4-a253-0b5e53219628 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: f55e8c47-349f-430a-890e-6dfaeb6155b4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:35.102045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e91e9eb5-6ccd-4ae4-a253-0b5e53219628 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:35.102045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e91e9eb5-6ccd-4ae4-a253-0b5e53219628 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:35.104537 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e91e9eb5-6ccd-4ae4-a253-0b5e53219628 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:35.106751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e91e9eb5-6ccd-4ae4-a253-0b5e53219628 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:35.272428 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e91e9eb5-6ccd-4ae4-a253-0b5e53219628 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:19:35.284315 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e91e9eb5-6ccd-4ae4-a253-0b5e53219628 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4" status: 200 len: 1682 microversion: 2.1 time: 0.196774 Jul 25 13:19:35.285005 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2948/5966] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:19:35 2022] GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4 => generated 1682 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:19:36.310005 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-25212baf-6b94-4257-9fc0-5685c4bbee2e tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:36.310791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-25212baf-6b94-4257-9fc0-5685c4bbee2e tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: f55e8c47-349f-430a-890e-6dfaeb6155b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:36.325299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25212baf-6b94-4257-9fc0-5685c4bbee2e tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:36.325753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25212baf-6b94-4257-9fc0-5685c4bbee2e tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:36.328190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25212baf-6b94-4257-9fc0-5685c4bbee2e tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:36.329938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25212baf-6b94-4257-9fc0-5685c4bbee2e tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:36.513412 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-25212baf-6b94-4257-9fc0-5685c4bbee2e tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:19:36.521925 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-25212baf-6b94-4257-9fc0-5685c4bbee2e tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4" status: 200 len: 1682 microversion: 2.1 time: 0.218743 Jul 25 13:19:36.522716 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3019/5967] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:19:36 2022] GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4 => generated 1682 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:19:37.547139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2c468fdd-8b72-47ef-8333-79658ce49b37 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:37.548788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2c468fdd-8b72-47ef-8333-79658ce49b37 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: f55e8c47-349f-430a-890e-6dfaeb6155b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:37.567156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c468fdd-8b72-47ef-8333-79658ce49b37 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:37.567977 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c468fdd-8b72-47ef-8333-79658ce49b37 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:37.569197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c468fdd-8b72-47ef-8333-79658ce49b37 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:37.583162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c468fdd-8b72-47ef-8333-79658ce49b37 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:37.672059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c468fdd-8b72-47ef-8333-79658ce49b37 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:37.672631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c468fdd-8b72-47ef-8333-79658ce49b37 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:37.676213 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-2c468fdd-8b72-47ef-8333-79658ce49b37 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lazy-loading 'fault' on Instance uuid f55e8c47-349f-430a-890e-6dfaeb6155b4 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:19:37.708549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-a70a710f-d77b-40c4-b8ae-1920b66a3ce0 req-c8866d8a-a157-45a8-bb9a-28ca03cc5742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55e8c47-349f-430a-890e-6dfaeb6155b4", "name": "network-vif-deleted", "tag": "bd3ed842-0343-4c21-afd4-4a735a0a2eeb"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:19:37.721645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a70a710f-d77b-40c4-b8ae-1920b66a3ce0 req-c8866d8a-a157-45a8-bb9a-28ca03cc5742 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:37.722510 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a70a710f-d77b-40c4-b8ae-1920b66a3ce0 req-c8866d8a-a157-45a8-bb9a-28ca03cc5742 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:37.737675 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-a70a710f-d77b-40c4-b8ae-1920b66a3ce0 req-c8866d8a-a157-45a8-bb9a-28ca03cc5742 service nova] Creating event network-vif-deleted:bd3ed842-0343-4c21-afd4-4a735a0a2eeb for instance f55e8c47-349f-430a-890e-6dfaeb6155b4 on n-h2-848886-15 Jul 25 13:19:37.745093 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-a70a710f-d77b-40c4-b8ae-1920b66a3ce0 req-c8866d8a-a157-45a8-bb9a-28ca03cc5742 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.335907 Jul 25 13:19:37.746521 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2949/5968] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:19:37.772011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2c468fdd-8b72-47ef-8333-79658ce49b37 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:19:37.797028 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2c468fdd-8b72-47ef-8333-79658ce49b37 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4" status: 200 len: 1331 microversion: 2.1 time: 0.254886 Jul 25 13:19:37.810358 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3020/5969] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:19:37 2022] GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4 => generated 1331 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:19:38.825447 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-83504155-c88c-4607-8c85-68322597f5e4 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:38.826508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-83504155-c88c-4607-8c85-68322597f5e4 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: f55e8c47-349f-430a-890e-6dfaeb6155b4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:38.835855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-83504155-c88c-4607-8c85-68322597f5e4 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:38.836654 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-83504155-c88c-4607-8c85-68322597f5e4 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:38.837999 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-83504155-c88c-4607-8c85-68322597f5e4 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:38.838797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-83504155-c88c-4607-8c85-68322597f5e4 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:38.854747 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-83504155-c88c-4607-8c85-68322597f5e4 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] HTTP exception thrown: Instance f55e8c47-349f-430a-890e-6dfaeb6155b4 could not be found. Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-83504155-c88c-4607-8c85-68322597f5e4 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Request method failure captured: Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4 HTTP/1.1 Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pfvdELBqc9ktGA5Lf40UAQ78535PWLYdV07ICt2wdq2RGB8ieRYQg1pW--wMG6xplNKDuvq-CZoEGzYXFP5IvXxGjkhJA3p-eAzNDkDVUaa03y9emRX7H5OKq6_lJxEVfuNLo8utSx2bi7m4uQFvPZDAYfj7NiFWNJBHuf2bTAGGbI Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_805811c2762b477cae7cb16377e12dac", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/805811c2762b477cae7cb16377e12dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}] Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 3092b4bfef6f4d778d52e9de3cd1b785 Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance f55e8c47-349f-430a-890e-6dfaeb6155b4 could not be found. Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'f55e8c47-349f-430a-890e-6dfaeb6155b4'} Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f55e8c47-349f-430a-890e-6dfaeb6155b4 could not be found. Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f55e8c47-349f-430a-890e-6dfaeb6155b4 could not be found. Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:19:38.856532 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:19:38.861224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:19:38.861224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:19:38.861224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:19:38.861224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:19:38.861224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:19:38.861224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f55e8c47-349f-430a-890e-6dfaeb6155b4 could not be found. Jul 25 13:19:38.861224 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:19:38.861224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-83504155-c88c-4607-8c85-68322597f5e4 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Returning 404 to user: Instance f55e8c47-349f-430a-890e-6dfaeb6155b4 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:19:38.861224 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-83504155-c88c-4607-8c85-68322597f5e4 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4" status: 404 len: 111 microversion: 2.1 time: 0.040818 Jul 25 13:19:38.862519 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2950/5970] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:19:38 2022] GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:19:38.868122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a4064945-b702-419d-9037-fd80e51cd6c8 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '.version_select at 0x7efcf91b1a60>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:38.896679 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a4064945-b702-419d-9037-fd80e51cd6c8 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-632685512" status: 202 len: 0 microversion: 2.1 time: 0.032637 Jul 25 13:19:38.897607 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3021/5971] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Jul 25 13:19:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-632685512 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 13:19:39.756455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8b915825-6176-417d-9794-66dbbd67a694 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:39.756971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8b915825-6176-417d-9794-66dbbd67a694 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:39.763770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b915825-6176-417d-9794-66dbbd67a694 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:39.764237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b915825-6176-417d-9794-66dbbd67a694 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:39.765169 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b915825-6176-417d-9794-66dbbd67a694 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:39.765720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b915825-6176-417d-9794-66dbbd67a694 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:39.855502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-8b915825-6176-417d-9794-66dbbd67a694 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lazy-loading 'services' on Instance uuid 4492f180-6de9-4618-9d5f-28ca90f6db3e {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:19:39.939029 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8b915825-6176-417d-9794-66dbbd67a694 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e/os-volume_attachments/c872a6d8-575a-41eb-a543-0c61668b6de7" status: 202 len: 0 microversion: 2.1 time: 0.186905 Jul 25 13:19:39.942923 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2951/5972] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Jul 25 13:19:39 2022] DELETE /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e/os-volume_attachments/c872a6d8-575a-41eb-a543-0c61668b6de7 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:19:39.955153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-243c0f29-294f-4b08-8946-df972002289b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:39.957364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-243c0f29-294f-4b08-8946-df972002289b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:39.964235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-243c0f29-294f-4b08-8946-df972002289b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:39.964691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-243c0f29-294f-4b08-8946-df972002289b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:39.965493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-243c0f29-294f-4b08-8946-df972002289b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:39.965943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-243c0f29-294f-4b08-8946-df972002289b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:40.016087 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-243c0f29-294f-4b08-8946-df972002289b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071566 Jul 25 13:19:40.016728 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3022/5973] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:19:39 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:19:41.029975 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f6c511b6-b7f2-4ffe-8ae7-71d47b0bc937 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:41.032461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f6c511b6-b7f2-4ffe-8ae7-71d47b0bc937 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:41.039244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f6c511b6-b7f2-4ffe-8ae7-71d47b0bc937 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:41.039700 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f6c511b6-b7f2-4ffe-8ae7-71d47b0bc937 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:41.040488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f6c511b6-b7f2-4ffe-8ae7-71d47b0bc937 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:41.040932 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f6c511b6-b7f2-4ffe-8ae7-71d47b0bc937 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:41.072085 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f6c511b6-b7f2-4ffe-8ae7-71d47b0bc937 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047205 Jul 25 13:19:41.077202 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2952/5974] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:19:41 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:19:42.090902 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9f3abd57-6dc0-46b7-b2dd-c56752fd16ef tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:42.090902 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9f3abd57-6dc0-46b7-b2dd-c56752fd16ef tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:42.095411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f3abd57-6dc0-46b7-b2dd-c56752fd16ef tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:42.095835 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f3abd57-6dc0-46b7-b2dd-c56752fd16ef tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:42.096603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f3abd57-6dc0-46b7-b2dd-c56752fd16ef tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:42.097040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f3abd57-6dc0-46b7-b2dd-c56752fd16ef tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:42.135159 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9f3abd57-6dc0-46b7-b2dd-c56752fd16ef tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054775 Jul 25 13:19:42.139907 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3023/5975] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:19:42 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:19:43.147931 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3773db45-7f58-4717-b224-f061fa44d30a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:43.150208 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3773db45-7f58-4717-b224-f061fa44d30a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:43.157640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3773db45-7f58-4717-b224-f061fa44d30a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:43.158212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3773db45-7f58-4717-b224-f061fa44d30a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:43.159015 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3773db45-7f58-4717-b224-f061fa44d30a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:43.159466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3773db45-7f58-4717-b224-f061fa44d30a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:43.195426 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3773db45-7f58-4717-b224-f061fa44d30a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051546 Jul 25 13:19:43.196253 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2953/5976] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:19:43 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:19:44.207970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-965c67fa-a334-4c68-8c86-3352e206c039 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:44.210215 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-965c67fa-a334-4c68-8c86-3352e206c039 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:44.222516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-965c67fa-a334-4c68-8c86-3352e206c039 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:44.224507 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-965c67fa-a334-4c68-8c86-3352e206c039 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:44.226130 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-965c67fa-a334-4c68-8c86-3352e206c039 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:44.226794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-965c67fa-a334-4c68-8c86-3352e206c039 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:44.261960 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-965c67fa-a334-4c68-8c86-3352e206c039 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058112 Jul 25 13:19:44.262785 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3024/5977] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:19:44 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:19:45.275109 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-38d7cdb0-1c98-4c3b-abb3-ebdc3ca2c925 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:45.278916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-38d7cdb0-1c98-4c3b-abb3-ebdc3ca2c925 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:45.287082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-38d7cdb0-1c98-4c3b-abb3-ebdc3ca2c925 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:45.287839 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-38d7cdb0-1c98-4c3b-abb3-ebdc3ca2c925 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:45.288962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-38d7cdb0-1c98-4c3b-abb3-ebdc3ca2c925 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:45.289476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-38d7cdb0-1c98-4c3b-abb3-ebdc3ca2c925 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:45.321767 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-38d7cdb0-1c98-4c3b-abb3-ebdc3ca2c925 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050677 Jul 25 13:19:45.322371 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2954/5978] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:19:45 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 13:19:45.386701 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e37eece9-c8ad-48a3-afee-ec1a53377b86 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:45.387845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e37eece9-c8ad-48a3-afee-ec1a53377b86 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:45.396433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e37eece9-c8ad-48a3-afee-ec1a53377b86 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:45.396880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e37eece9-c8ad-48a3-afee-ec1a53377b86 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:45.397671 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e37eece9-c8ad-48a3-afee-ec1a53377b86 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:45.398154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e37eece9-c8ad-48a3-afee-ec1a53377b86 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:45.426994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e37eece9-c8ad-48a3-afee-ec1a53377b86 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:19:45.519057 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e37eece9-c8ad-48a3-afee-ec1a53377b86 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e" status: 204 len: 0 microversion: 2.1 time: 0.135457 Jul 25 13:19:45.519829 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3025/5979] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:19:45 2022] DELETE /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:19:45.528503 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4e3a5fe8-a844-4059-af66-ed27f85308ea tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:45.529168 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4e3a5fe8-a844-4059-af66-ed27f85308ea tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:45.535613 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e3a5fe8-a844-4059-af66-ed27f85308ea tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:45.536169 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e3a5fe8-a844-4059-af66-ed27f85308ea tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:45.536995 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e3a5fe8-a844-4059-af66-ed27f85308ea tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:45.537453 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e3a5fe8-a844-4059-af66-ed27f85308ea tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:45.676582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4e3a5fe8-a844-4059-af66-ed27f85308ea tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:19:45.684973 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4e3a5fe8-a844-4059-af66-ed27f85308ea tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e" status: 200 len: 1680 microversion: 2.1 time: 0.160863 Jul 25 13:19:45.685773 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2955/5980] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:19:45 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:19:46.707853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fc5a429e-474d-4e4b-abad-21368d65d607 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:46.708563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fc5a429e-474d-4e4b-abad-21368d65d607 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:46.716432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc5a429e-474d-4e4b-abad-21368d65d607 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:46.717015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc5a429e-474d-4e4b-abad-21368d65d607 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:46.717892 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc5a429e-474d-4e4b-abad-21368d65d607 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:46.718433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc5a429e-474d-4e4b-abad-21368d65d607 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:46.860158 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fc5a429e-474d-4e4b-abad-21368d65d607 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:19:46.868807 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fc5a429e-474d-4e4b-abad-21368d65d607 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e" status: 200 len: 1680 microversion: 2.1 time: 0.165473 Jul 25 13:19:46.869406 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3026/5981] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:19:46 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:19:47.539973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-106bd246-407d-4d45-a47d-42d2d1bdc8cc req-cd2057ba-97d6-495c-bcd7-155639d13a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3abc70b2-e7d4-4985-ba77-4f3c7f38606a", "tag": "0e15fd89-0026-49cf-aa70-e8650f769fa6"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:19:47.542359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-74cd9311-4f07-426b-a7b6-59943bc90c27 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:47.546054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-74cd9311-4f07-426b-a7b6-59943bc90c27 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:47.557862 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74cd9311-4f07-426b-a7b6-59943bc90c27 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:47.561979 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74cd9311-4f07-426b-a7b6-59943bc90c27 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:47.562996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74cd9311-4f07-426b-a7b6-59943bc90c27 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:47.563603 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-74cd9311-4f07-426b-a7b6-59943bc90c27 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:47.564543 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-106bd246-407d-4d45-a47d-42d2d1bdc8cc req-cd2057ba-97d6-495c-bcd7-155639d13a18 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:47.569690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-106bd246-407d-4d45-a47d-42d2d1bdc8cc req-cd2057ba-97d6-495c-bcd7-155639d13a18 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:47.591496 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-106bd246-407d-4d45-a47d-42d2d1bdc8cc req-cd2057ba-97d6-495c-bcd7-155639d13a18 service nova] Creating event network-changed:0e15fd89-0026-49cf-aa70-e8650f769fa6 for instance 3abc70b2-e7d4-4985-ba77-4f3c7f38606a on n-h1-848886-15 Jul 25 13:19:47.597701 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-106bd246-407d-4d45-a47d-42d2d1bdc8cc req-cd2057ba-97d6-495c-bcd7-155639d13a18 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061367 Jul 25 13:19:47.601939 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3027/5982] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:19:47.610619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-74cd9311-4f07-426b-a7b6-59943bc90c27 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:19:47.734976 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-74cd9311-4f07-426b-a7b6-59943bc90c27 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 204 len: 0 microversion: 2.1 time: 0.200825 Jul 25 13:19:47.736368 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2956/5983] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:19:47 2022] DELETE /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:19:47.747977 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-079dcda1-a1f4-4b29-9fc4-191ef9f4807c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:47.748695 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-079dcda1-a1f4-4b29-9fc4-191ef9f4807c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:47.755598 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-079dcda1-a1f4-4b29-9fc4-191ef9f4807c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:47.756060 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-079dcda1-a1f4-4b29-9fc4-191ef9f4807c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:47.756870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-079dcda1-a1f4-4b29-9fc4-191ef9f4807c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:47.757709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-079dcda1-a1f4-4b29-9fc4-191ef9f4807c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:47.892098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-109470f3-6a29-4a69-8505-33f96bd10f89 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:47.893104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-109470f3-6a29-4a69-8505-33f96bd10f89 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:47.907129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-109470f3-6a29-4a69-8505-33f96bd10f89 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:47.907810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-109470f3-6a29-4a69-8505-33f96bd10f89 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:47.908771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-109470f3-6a29-4a69-8505-33f96bd10f89 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:47.909383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-109470f3-6a29-4a69-8505-33f96bd10f89 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:48.100345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-109470f3-6a29-4a69-8505-33f96bd10f89 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:19:48.109304 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-109470f3-6a29-4a69-8505-33f96bd10f89 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e" status: 200 len: 1613 microversion: 2.1 time: 0.221463 Jul 25 13:19:48.113561 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2957/5984] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:19:47 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e => generated 1613 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:19:48.262906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-079dcda1-a1f4-4b29-9fc4-191ef9f4807c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:19:48.284825 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-079dcda1-a1f4-4b29-9fc4-191ef9f4807c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1578 microversion: 2.1 time: 0.544088 Jul 25 13:19:48.298107 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3028/5985] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:19:47 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1578 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:19:48.497554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-c842777d-00ca-48ae-8630-8ba946f14222 req-1ad6fe65-ea0f-43c1-833a-5345c23640c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4492f180-6de9-4618-9d5f-28ca90f6db3e", "name": "network-vif-deleted", "tag": "ff06fd1a-52c7-4760-93c4-60c69802b48f"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:19:48.512870 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c842777d-00ca-48ae-8630-8ba946f14222 req-1ad6fe65-ea0f-43c1-833a-5345c23640c8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:48.512870 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-c842777d-00ca-48ae-8630-8ba946f14222 req-1ad6fe65-ea0f-43c1-833a-5345c23640c8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:48.529384 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-c842777d-00ca-48ae-8630-8ba946f14222 req-1ad6fe65-ea0f-43c1-833a-5345c23640c8 service nova] Creating event network-vif-deleted:ff06fd1a-52c7-4760-93c4-60c69802b48f for instance 4492f180-6de9-4618-9d5f-28ca90f6db3e on n-h2-848886-15 Jul 25 13:19:48.537557 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-c842777d-00ca-48ae-8630-8ba946f14222 req-1ad6fe65-ea0f-43c1-833a-5345c23640c8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050704 Jul 25 13:19:48.538676 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2958/5986] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:19:49.136811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9089f1a9-3fcb-4edc-9961-1bf716d1d42c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:49.138035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9089f1a9-3fcb-4edc-9961-1bf716d1d42c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:49.149132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9089f1a9-3fcb-4edc-9961-1bf716d1d42c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:49.149600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9089f1a9-3fcb-4edc-9961-1bf716d1d42c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:49.150521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9089f1a9-3fcb-4edc-9961-1bf716d1d42c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:49.150962 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9089f1a9-3fcb-4edc-9961-1bf716d1d42c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:49.167953 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-9089f1a9-3fcb-4edc-9961-1bf716d1d42c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] HTTP exception thrown: Instance 4492f180-6de9-4618-9d5f-28ca90f6db3e could not be found. Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9089f1a9-3fcb-4edc-9961-1bf716d1d42c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Request method failure captured: Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e HTTP/1.1 Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pfvdELBqc9ktGA5Lf40UAQ78535PWLYdV07ICt2wdq2RGB8ieRYQg1pW--wMG6xplNKDuvq-CZoEGzYXFP5IvXxGjkhJA3p-eAzNDkDVUaa03y9emRX7H5OKq6_lJxEVfuNLo8utSx2bi7m4uQFvPZDAYfj7NiFWNJBHuf2bTAGGbI Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_805811c2762b477cae7cb16377e12dac", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/805811c2762b477cae7cb16377e12dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}] Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 3092b4bfef6f4d778d52e9de3cd1b785 Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 4492f180-6de9-4618-9d5f-28ca90f6db3e could not be found. Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '4492f180-6de9-4618-9d5f-28ca90f6db3e'} Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4492f180-6de9-4618-9d5f-28ca90f6db3e could not be found. Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4492f180-6de9-4618-9d5f-28ca90f6db3e could not be found. Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:19:49.170638 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:19:49.175531 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:19:49.175531 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:19:49.175531 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:19:49.175531 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:19:49.175531 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:19:49.175531 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4492f180-6de9-4618-9d5f-28ca90f6db3e could not be found. Jul 25 13:19:49.175531 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:19:49.183228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9089f1a9-3fcb-4edc-9961-1bf716d1d42c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Returning 404 to user: Instance 4492f180-6de9-4618-9d5f-28ca90f6db3e could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:19:49.184446 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9089f1a9-3fcb-4edc-9961-1bf716d1d42c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e" status: 404 len: 111 microversion: 2.1 time: 0.051566 Jul 25 13:19:49.185714 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3029/5987] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:19:49 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:19:49.201313 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-efbb6d6d-47f6-4f68-b569-f5a6c43c63e1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '.version_select at 0x7efcf98c7940>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:49.271718 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-efbb6d6d-47f6-4f68-b569-f5a6c43c63e1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-273732684" status: 202 len: 0 microversion: 2.1 time: 0.080973 Jul 25 13:19:49.272368 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2959/5988] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Jul 25 13:19:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-273732684 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:19:49.307646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0a175771-5f8b-4371-a4dd-c8fa572aef94 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:49.308266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0a175771-5f8b-4371-a4dd-c8fa572aef94 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:49.319780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a175771-5f8b-4371-a4dd-c8fa572aef94 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:49.320239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a175771-5f8b-4371-a4dd-c8fa572aef94 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:49.321426 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a175771-5f8b-4371-a4dd-c8fa572aef94 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:49.322268 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a175771-5f8b-4371-a4dd-c8fa572aef94 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:49.892602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0a175771-5f8b-4371-a4dd-c8fa572aef94 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:19:49.907173 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0a175771-5f8b-4371-a4dd-c8fa572aef94 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1578 microversion: 2.1 time: 0.600278 Jul 25 13:19:49.927413 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3030/5989] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:19:49 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1578 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:19:49.988535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-cc387142-1ed0-471c-a8f1-3c890754a28f req-92632c7c-3637-4d94-b7d9-8bdf4aa9e1ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3abc70b2-e7d4-4985-ba77-4f3c7f38606a", "name": "network-vif-deleted", "tag": "0e15fd89-0026-49cf-aa70-e8650f769fa6"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:19:50.005716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-cc387142-1ed0-471c-a8f1-3c890754a28f req-92632c7c-3637-4d94-b7d9-8bdf4aa9e1ca service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:50.006215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-cc387142-1ed0-471c-a8f1-3c890754a28f req-92632c7c-3637-4d94-b7d9-8bdf4aa9e1ca service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:50.023877 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-cc387142-1ed0-471c-a8f1-3c890754a28f req-92632c7c-3637-4d94-b7d9-8bdf4aa9e1ca service nova] Creating event network-vif-deleted:0e15fd89-0026-49cf-aa70-e8650f769fa6 for instance 3abc70b2-e7d4-4985-ba77-4f3c7f38606a on n-h1-848886-15 Jul 25 13:19:50.036570 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-cc387142-1ed0-471c-a8f1-3c890754a28f req-92632c7c-3637-4d94-b7d9-8bdf4aa9e1ca service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049207 Jul 25 13:19:50.037568 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2960/5990] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:19:50.744660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c15f5a1e-6471-4f33-a2f5-1574e41a834b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Action: 'create', calling method: .version_select at 0x7efcf9b92820>, body: {"keypair": {"name": "tempest-keypair-1945279103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcU/e8rPyKpJAfo2UqcePvstCsDLuKPg36xL3X6y+SdoQdne+dqCJjFwBBTN2m+DhuYwhmTrM52RSQU/zfClrleOt2Q6+BzhpinMM2bKz8VbMNRNhEeUxpY1B9a6TP1nw=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:19:50.764528 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-c15f5a1e-6471-4f33-a2f5-1574e41a834b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Getting quotas for project 805811c2762b477cae7cb16377e12dac. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:19:50.772475 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-c15f5a1e-6471-4f33-a2f5-1574e41a834b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Getting quotas for user 3092b4bfef6f4d778d52e9de3cd1b785 and project 805811c2762b477cae7cb16377e12dac. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:19:50.815304 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c15f5a1e-6471-4f33-a2f5-1574e41a834b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074412 Jul 25 13:19:50.816633 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3031/5991] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:19:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:19:50.932373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-efda53f8-6969-4e75-9ede-0d854aa844e2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:50.933226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-efda53f8-6969-4e75-9ede-0d854aa844e2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:50.966491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-efda53f8-6969-4e75-9ede-0d854aa844e2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:50.967188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-efda53f8-6969-4e75-9ede-0d854aa844e2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:50.976172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-efda53f8-6969-4e75-9ede-0d854aa844e2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:50.976902 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-efda53f8-6969-4e75-9ede-0d854aa844e2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:51.062430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-efda53f8-6969-4e75-9ede-0d854aa844e2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:19:51.070526 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-efda53f8-6969-4e75-9ede-0d854aa844e2 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1391 microversion: 2.1 time: 0.143626 Jul 25 13:19:51.071408 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2961/5992] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:19:50 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1391 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:19:52.096432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-10a6772a-6f69-4dab-b542-b7244feb77c8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:52.097735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-10a6772a-6f69-4dab-b542-b7244feb77c8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:52.126184 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10a6772a-6f69-4dab-b542-b7244feb77c8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:52.126882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10a6772a-6f69-4dab-b542-b7244feb77c8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:52.137262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10a6772a-6f69-4dab-b542-b7244feb77c8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:52.138467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10a6772a-6f69-4dab-b542-b7244feb77c8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:52.275950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-10a6772a-6f69-4dab-b542-b7244feb77c8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:19:52.291303 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-10a6772a-6f69-4dab-b542-b7244feb77c8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1391 microversion: 2.1 time: 0.199238 Jul 25 13:19:52.294516 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3032/5993] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:19:52 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1391 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:19:52.610905 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ff0a421c-21cb-49b5-9ea9-ae42f94d89e1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-653295484", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e17217fe-ccfb-47ee-98dd-b05efd6867f9"}], "security_groups": [{"name": "tempest-securitygroup--1819103346"}], "key_name": "tempest-keypair-1945279103", "user_data": "}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:19:52.746777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-ff0a421c-21cb-49b5-9ea9-ae42f94d89e1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] validate_networks() for [('e17217fe-ccfb-47ee-98dd-b05efd6867f9', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:19:53.232542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-ff0a421c-21cb-49b5-9ea9-ae42f94d89e1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:19:53.232984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-ff0a421c-21cb-49b5-9ea9-ae42f94d89e1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:19:53.233531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-ff0a421c-21cb-49b5-9ea9-ae42f94d89e1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:19:53.234020 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-ff0a421c-21cb-49b5-9ea9-ae42f94d89e1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:19:53.234634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-ff0a421c-21cb-49b5-9ea9-ae42f94d89e1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:19:53.245544 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff0a421c-21cb-49b5-9ea9-ae42f94d89e1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:53.246648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff0a421c-21cb-49b5-9ea9-ae42f94d89e1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:53.247740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff0a421c-21cb-49b5-9ea9-ae42f94d89e1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:53.248376 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ff0a421c-21cb-49b5-9ea9-ae42f94d89e1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:53.269662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-ff0a421c-21cb-49b5-9ea9-ae42f94d89e1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Getting quotas for project 805811c2762b477cae7cb16377e12dac. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:19:53.276536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-ff0a421c-21cb-49b5-9ea9-ae42f94d89e1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Getting quotas for user 3092b4bfef6f4d778d52e9de3cd1b785 and project 805811c2762b477cae7cb16377e12dac. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:19:53.292566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ff0a421c-21cb-49b5-9ea9-ae42f94d89e1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:19:53.296586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ff0a421c-21cb-49b5-9ea9-ae42f94d89e1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:19:53.316244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-42316465-309e-4ce4-a34a-e0c705af7d4e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:53.317906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-42316465-309e-4ce4-a34a-e0c705af7d4e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:53.325491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-42316465-309e-4ce4-a34a-e0c705af7d4e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:53.326273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-42316465-309e-4ce4-a34a-e0c705af7d4e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:53.327431 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-42316465-309e-4ce4-a34a-e0c705af7d4e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:53.328175 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-42316465-309e-4ce4-a34a-e0c705af7d4e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:53.353519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:19:53.370808 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ff0a421c-21cb-49b5-9ea9-ae42f94d89e1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.764507 Jul 25 13:19:53.378196 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2962/5994] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:19:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:19:53.383941 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-46b0ae04-9312-4d49-bbeb-3cbf96aa0088 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:53.384831 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-46b0ae04-9312-4d49-bbeb-3cbf96aa0088 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:53.430390 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-42316465-309e-4ce4-a34a-e0c705af7d4e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:19:53.443104 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-42316465-309e-4ce4-a34a-e0c705af7d4e tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1391 microversion: 2.1 time: 0.130604 Jul 25 13:19:53.443586 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3033/5995] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:19:53 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1391 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:19:53.491557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-46b0ae04-9312-4d49-bbeb-3cbf96aa0088 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:19:53.499402 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-46b0ae04-9312-4d49-bbeb-3cbf96aa0088 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019" status: 200 len: 1241 microversion: 2.1 time: 0.119467 Jul 25 13:19:53.500003 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2963/5996] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:19:53 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019 => generated 1241 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:19:54.465190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b494762d-7685-403c-8424-6a15cc2055f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:54.466149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b494762d-7685-403c-8424-6a15cc2055f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:54.474809 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b494762d-7685-403c-8424-6a15cc2055f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:54.475755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b494762d-7685-403c-8424-6a15cc2055f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:54.476712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b494762d-7685-403c-8424-6a15cc2055f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:54.477299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b494762d-7685-403c-8424-6a15cc2055f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:54.520648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-252e7ea0-92ff-4e27-a87e-3bd378b2d16d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:54.521612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-252e7ea0-92ff-4e27-a87e-3bd378b2d16d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:54.531570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-252e7ea0-92ff-4e27-a87e-3bd378b2d16d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:54.534567 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-252e7ea0-92ff-4e27-a87e-3bd378b2d16d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:54.535745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-252e7ea0-92ff-4e27-a87e-3bd378b2d16d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:54.536407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-252e7ea0-92ff-4e27-a87e-3bd378b2d16d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:54.552942 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b494762d-7685-403c-8424-6a15cc2055f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:19:54.562531 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b494762d-7685-403c-8424-6a15cc2055f9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1391 microversion: 2.1 time: 0.101783 Jul 25 13:19:54.563425 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3034/5997] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:19:54 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1391 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:19:54.614413 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-252e7ea0-92ff-4e27-a87e-3bd378b2d16d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:19:54.624129 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-252e7ea0-92ff-4e27-a87e-3bd378b2d16d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019" status: 200 len: 1293 microversion: 2.1 time: 0.107279 Jul 25 13:19:54.625225 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2964/5998] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:19:54 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019 => generated 1293 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:19:55.585981 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7ddfb678-2b81-417b-b920-112bfc5831db tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:55.586616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7ddfb678-2b81-417b-b920-112bfc5831db tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:55.594172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ddfb678-2b81-417b-b920-112bfc5831db tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:55.604476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ddfb678-2b81-417b-b920-112bfc5831db tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:55.606940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ddfb678-2b81-417b-b920-112bfc5831db tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:55.607603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7ddfb678-2b81-417b-b920-112bfc5831db tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:55.651550 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d9b66b17-7f4e-45b9-9505-67820f1394a7 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:55.653658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d9b66b17-7f4e-45b9-9505-67820f1394a7 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:55.671493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9b66b17-7f4e-45b9-9505-67820f1394a7 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:55.672834 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9b66b17-7f4e-45b9-9505-67820f1394a7 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:55.674656 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9b66b17-7f4e-45b9-9505-67820f1394a7 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:55.676832 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9b66b17-7f4e-45b9-9505-67820f1394a7 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:55.751930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7ddfb678-2b81-417b-b920-112bfc5831db tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:19:55.760192 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7ddfb678-2b81-417b-b920-112bfc5831db tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 200 len: 1391 microversion: 2.1 time: 0.181113 Jul 25 13:19:55.761046 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3035/5999] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:19:55 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:19:55.801355 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d9b66b17-7f4e-45b9-9505-67820f1394a7 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:19:55.813521 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d9b66b17-7f4e-45b9-9505-67820f1394a7 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019" status: 200 len: 1299 microversion: 2.1 time: 0.171121 Jul 25 13:19:55.814484 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2965/6000] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:19:55 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019 => generated 1299 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:19:56.781522 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3a2d0a57-b271-4c61-a4ae-1d0f92a3bff8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:56.782426 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3a2d0a57-b271-4c61-a4ae-1d0f92a3bff8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 3abc70b2-e7d4-4985-ba77-4f3c7f38606a] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:56.790727 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a2d0a57-b271-4c61-a4ae-1d0f92a3bff8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:56.791264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a2d0a57-b271-4c61-a4ae-1d0f92a3bff8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:56.792060 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a2d0a57-b271-4c61-a4ae-1d0f92a3bff8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:56.792492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a2d0a57-b271-4c61-a4ae-1d0f92a3bff8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:56.832752 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-3a2d0a57-b271-4c61-a4ae-1d0f92a3bff8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] HTTP exception thrown: Instance 3abc70b2-e7d4-4985-ba77-4f3c7f38606a could not be found. Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3a2d0a57-b271-4c61-a4ae-1d0f92a3bff8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Request method failure captured: Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a HTTP/1.1 Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pUsgUlyXXDFjpaxtInCA3ErKU2P2TTpSljieML2SSsbmedwjUWvmtCPv6cpRR2_rKwVTBeB1pN0R0PaQlKkP3JB2H_nZ9mFVhTCd_Xl4_Gcw-PsIj4Ff-CbWbJlbzuA6BFxmfwmUVgHks2P6PoEesxOn8j894_Z-5Z842qklFD2ecs Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b2fbd681752c41d0a24a9cf34ebc8389", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}] Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 9face2aaa9df430cb5d361c6e1fdf242 Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 3abc70b2-e7d4-4985-ba77-4f3c7f38606a could not be found. Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '3abc70b2-e7d4-4985-ba77-4f3c7f38606a'} Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3abc70b2-e7d4-4985-ba77-4f3c7f38606a could not be found. Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3abc70b2-e7d4-4985-ba77-4f3c7f38606a could not be found. Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:19:56.834479 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:19:56.838500 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:19:56.838500 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:19:56.838500 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:19:56.838500 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:19:56.838500 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:19:56.838500 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3abc70b2-e7d4-4985-ba77-4f3c7f38606a could not be found. Jul 25 13:19:56.838500 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:19:56.838500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3a2d0a57-b271-4c61-a4ae-1d0f92a3bff8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Returning 404 to user: Instance 3abc70b2-e7d4-4985-ba77-4f3c7f38606a could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:19:56.838500 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3a2d0a57-b271-4c61-a4ae-1d0f92a3bff8 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a" status: 404 len: 111 microversion: 2.1 time: 0.060421 Jul 25 13:19:56.838500 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3036/6001] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:19:56 2022] GET /compute/v2.1/servers/3abc70b2-e7d4-4985-ba77-4f3c7f38606a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:19:56.843998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b4ce83bf-d22c-4c08-8d6f-935517e5468b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:56.845302 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b4ce83bf-d22c-4c08-8d6f-935517e5468b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:56.852620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4ce83bf-d22c-4c08-8d6f-935517e5468b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:56.853150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4ce83bf-d22c-4c08-8d6f-935517e5468b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:56.854370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4ce83bf-d22c-4c08-8d6f-935517e5468b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:56.854881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4ce83bf-d22c-4c08-8d6f-935517e5468b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:56.886291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:19:57.243373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-7ed241b9-9f8c-4440-a666-742df9faac18 req-98a6486f-550a-4d50-99e2-3f23a23d0bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7de1f2c9-f6e9-438a-bf35-4f1783c6b019", "tag": "5aa7c212-ec0b-409b-9941-dc56f6515dea"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:19:57.256328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b4ce83bf-d22c-4c08-8d6f-935517e5468b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:19:57.270811 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b4ce83bf-d22c-4c08-8d6f-935517e5468b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019" status: 200 len: 1367 microversion: 2.1 time: 0.435752 Jul 25 13:19:57.282698 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2966/6002] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:19:56 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019 => generated 1367 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:19:57.288417 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-7ed241b9-9f8c-4440-a666-742df9faac18 req-98a6486f-550a-4d50-99e2-3f23a23d0bd6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:57.290158 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-7ed241b9-9f8c-4440-a666-742df9faac18 req-98a6486f-550a-4d50-99e2-3f23a23d0bd6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:57.323458 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-7ed241b9-9f8c-4440-a666-742df9faac18 req-98a6486f-550a-4d50-99e2-3f23a23d0bd6 service nova] Creating event network-changed:5aa7c212-ec0b-409b-9941-dc56f6515dea for instance 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 on n-h2-848886-15 Jul 25 13:19:57.329411 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-7ed241b9-9f8c-4440-a666-742df9faac18 req-98a6486f-550a-4d50-99e2-3f23a23d0bd6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097492 Jul 25 13:19:57.330388 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3037/6003] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:19:58.305393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4511b06b-92dd-4c42-a72f-ea357e6bb565 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:58.306430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4511b06b-92dd-4c42-a72f-ea357e6bb565 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:58.336463 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4511b06b-92dd-4c42-a72f-ea357e6bb565 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:58.340054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4511b06b-92dd-4c42-a72f-ea357e6bb565 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:58.341148 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4511b06b-92dd-4c42-a72f-ea357e6bb565 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:58.341975 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4511b06b-92dd-4c42-a72f-ea357e6bb565 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:58.557641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4511b06b-92dd-4c42-a72f-ea357e6bb565 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:19:58.568886 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4511b06b-92dd-4c42-a72f-ea357e6bb565 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019" status: 200 len: 1367 microversion: 2.1 time: 0.267515 Jul 25 13:19:58.583273 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2967/6004] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:19:58 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019 => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:19:59.590496 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-592b1eed-a994-4484-8a22-3e805da0da0d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:19:59.594460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-592b1eed-a994-4484-8a22-3e805da0da0d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:19:59.604265 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-592b1eed-a994-4484-8a22-3e805da0da0d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:59.605427 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-592b1eed-a994-4484-8a22-3e805da0da0d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:59.606453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-592b1eed-a994-4484-8a22-3e805da0da0d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:19:59.607260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-592b1eed-a994-4484-8a22-3e805da0da0d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:19:59.767851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-592b1eed-a994-4484-8a22-3e805da0da0d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:19:59.775901 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-592b1eed-a994-4484-8a22-3e805da0da0d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019" status: 200 len: 1367 microversion: 2.1 time: 0.189815 Jul 25 13:19:59.790406 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3038/6005] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:19:59 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:20:00.796652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f4a46b31-7dc9-4d88-8e07-6a991d4cb7e4 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:00.797886 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f4a46b31-7dc9-4d88-8e07-6a991d4cb7e4 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:00.805867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4a46b31-7dc9-4d88-8e07-6a991d4cb7e4 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:00.806572 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4a46b31-7dc9-4d88-8e07-6a991d4cb7e4 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:00.807691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4a46b31-7dc9-4d88-8e07-6a991d4cb7e4 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:00.808304 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4a46b31-7dc9-4d88-8e07-6a991d4cb7e4 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:00.992363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f4a46b31-7dc9-4d88-8e07-6a991d4cb7e4 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:20:01.017546 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f4a46b31-7dc9-4d88-8e07-6a991d4cb7e4 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019" status: 200 len: 1367 microversion: 2.1 time: 0.224673 Jul 25 13:20:01.030286 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2968/6006] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:20:00 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:20:02.049776 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4d52cba3-6ba5-4a79-bec7-18387e57ab15 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:02.050456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4d52cba3-6ba5-4a79-bec7-18387e57ab15 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:02.054721 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:20:02.060295 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d52cba3-6ba5-4a79-bec7-18387e57ab15 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:02.067865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d52cba3-6ba5-4a79-bec7-18387e57ab15 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:02.069078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d52cba3-6ba5-4a79-bec7-18387e57ab15 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:02.069928 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d52cba3-6ba5-4a79-bec7-18387e57ab15 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:02.258669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4d52cba3-6ba5-4a79-bec7-18387e57ab15 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:20:02.267833 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4d52cba3-6ba5-4a79-bec7-18387e57ab15 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019" status: 200 len: 1367 microversion: 2.1 time: 0.222516 Jul 25 13:20:02.269277 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3039/6007] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:20:02 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:20:03.258010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:20:03.291691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-532f3773-f174-495c-8687-797d0db99fe8 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:03.293536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-532f3773-f174-495c-8687-797d0db99fe8 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:03.301992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-532f3773-f174-495c-8687-797d0db99fe8 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:03.303028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-532f3773-f174-495c-8687-797d0db99fe8 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:03.304051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-532f3773-f174-495c-8687-797d0db99fe8 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:03.304765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-532f3773-f174-495c-8687-797d0db99fe8 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:03.374917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-13965efe-fb30-4eee-82ce-9a892f705cdc req-3ef10345-1686-4715-ae60-a2e482b580d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7de1f2c9-f6e9-438a-bf35-4f1783c6b019", "name": "network-vif-plugged", "status": "completed", "tag": "5aa7c212-ec0b-409b-9941-dc56f6515dea"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:20:03.385493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-13965efe-fb30-4eee-82ce-9a892f705cdc req-3ef10345-1686-4715-ae60-a2e482b580d4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:03.386358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-13965efe-fb30-4eee-82ce-9a892f705cdc req-3ef10345-1686-4715-ae60-a2e482b580d4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:03.398664 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-13965efe-fb30-4eee-82ce-9a892f705cdc req-3ef10345-1686-4715-ae60-a2e482b580d4 service nova] Creating event network-vif-plugged:5aa7c212-ec0b-409b-9941-dc56f6515dea for instance 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 on n-h2-848886-15 Jul 25 13:20:03.403997 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-13965efe-fb30-4eee-82ce-9a892f705cdc req-3ef10345-1686-4715-ae60-a2e482b580d4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.288186 Jul 25 13:20:03.404642 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2969/6008] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:20:03.543157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-532f3773-f174-495c-8687-797d0db99fe8 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:20:03.552736 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-532f3773-f174-495c-8687-797d0db99fe8 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019" status: 200 len: 1367 microversion: 2.1 time: 0.267620 Jul 25 13:20:03.566673 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3040/6009] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:20:03 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019 => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:20:04.573292 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=8 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:20:04.583151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e9ca31dd-8ab6-44ee-ac11-fdd9488c2d2c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:04.583954 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e9ca31dd-8ab6-44ee-ac11-fdd9488c2d2c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:04.596664 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c98a14b7-d5b8-492a-bd5e-a34aaaad7eb9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:04.598523 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c98a14b7-d5b8-492a-bd5e-a34aaaad7eb9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:04.614926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c98a14b7-d5b8-492a-bd5e-a34aaaad7eb9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:04.617381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c98a14b7-d5b8-492a-bd5e-a34aaaad7eb9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:04.618497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c98a14b7-d5b8-492a-bd5e-a34aaaad7eb9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:04.619551 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c98a14b7-d5b8-492a-bd5e-a34aaaad7eb9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:04.636652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e9ca31dd-8ab6-44ee-ac11-fdd9488c2d2c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:04.637375 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e9ca31dd-8ab6-44ee-ac11-fdd9488c2d2c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:04.638430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e9ca31dd-8ab6-44ee-ac11-fdd9488c2d2c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:04.639532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e9ca31dd-8ab6-44ee-ac11-fdd9488c2d2c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:04.654612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c98a14b7-d5b8-492a-bd5e-a34aaaad7eb9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:20:04.771664 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:20:04.791162 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c98a14b7-d5b8-492a-bd5e-a34aaaad7eb9 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "DELETE /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 204 len: 0 microversion: 2.1 time: 0.198816 Jul 25 13:20:04.791754 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3041/6010] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:20:04 2022] DELETE /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:20:04.890304 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e9ca31dd-8ab6-44ee-ac11-fdd9488c2d2c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:20:04.900639 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e9ca31dd-8ab6-44ee-ac11-fdd9488c2d2c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019" status: 200 len: 1367 microversion: 2.1 time: 0.328313 Jul 25 13:20:04.901952 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2970/6011] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:20:04 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019 => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:20:04.918216 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e4cc2d6a-1f8f-49f6-be98-b5aee2bb4722 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:04.919174 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e4cc2d6a-1f8f-49f6-be98-b5aee2bb4722 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:04.921284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:20:04.927634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4cc2d6a-1f8f-49f6-be98-b5aee2bb4722 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:04.929057 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4cc2d6a-1f8f-49f6-be98-b5aee2bb4722 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:04.930293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4cc2d6a-1f8f-49f6-be98-b5aee2bb4722 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:04.931342 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4cc2d6a-1f8f-49f6-be98-b5aee2bb4722 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:05.037446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-047baacb-9b06-4586-8400-0fc962f8ad48 req-503e8c0a-fba9-4fa5-924b-22e4f994a033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "122cf21d-eead-4a88-b0f5-0c7b839fd163", "tag": "411fe352-2a1f-4b6e-b77b-b0d11abcce56"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:20:05.047935 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-047baacb-9b06-4586-8400-0fc962f8ad48 req-503e8c0a-fba9-4fa5-924b-22e4f994a033 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:05.048631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-047baacb-9b06-4586-8400-0fc962f8ad48 req-503e8c0a-fba9-4fa5-924b-22e4f994a033 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:05.064837 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-047baacb-9b06-4586-8400-0fc962f8ad48 req-503e8c0a-fba9-4fa5-924b-22e4f994a033 service nova] Creating event network-changed:411fe352-2a1f-4b6e-b77b-b0d11abcce56 for instance 122cf21d-eead-4a88-b0f5-0c7b839fd163 on n-h1-848886-15 Jul 25 13:20:05.070503 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-047baacb-9b06-4586-8400-0fc962f8ad48 req-503e8c0a-fba9-4fa5-924b-22e4f994a033 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.277098 Jul 25 13:20:05.075621 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3042/6012] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:20:05.248552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e4cc2d6a-1f8f-49f6-be98-b5aee2bb4722 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:20:05.258396 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e4cc2d6a-1f8f-49f6-be98-b5aee2bb4722 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1577 microversion: 2.1 time: 0.355083 Jul 25 13:20:05.259629 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2971/6013] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:20:04 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1577 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:20:05.967131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e503a830-0c67-43bd-8793-b7e686bb9cfa tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:05.968067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e503a830-0c67-43bd-8793-b7e686bb9cfa tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:05.992011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e503a830-0c67-43bd-8793-b7e686bb9cfa tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:05.992530 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e503a830-0c67-43bd-8793-b7e686bb9cfa tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:05.993816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e503a830-0c67-43bd-8793-b7e686bb9cfa tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:05.994945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e503a830-0c67-43bd-8793-b7e686bb9cfa tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:06.288456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5345a8f0-ff51-4d1f-bc22-4672cc0efd07 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:06.289303 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5345a8f0-ff51-4d1f-bc22-4672cc0efd07 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:06.304136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e503a830-0c67-43bd-8793-b7e686bb9cfa tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:20:06.311551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5345a8f0-ff51-4d1f-bc22-4672cc0efd07 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:06.325289 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e503a830-0c67-43bd-8793-b7e686bb9cfa tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019" status: 200 len: 1557 microversion: 2.1 time: 0.399313 Jul 25 13:20:06.326298 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3043/6014] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:20:05 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019 => generated 1557 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:20:06.342401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5345a8f0-ff51-4d1f-bc22-4672cc0efd07 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:06.343810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5345a8f0-ff51-4d1f-bc22-4672cc0efd07 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:06.344691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5345a8f0-ff51-4d1f-bc22-4672cc0efd07 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:06.349341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-45d733b7-cc05-435b-a04c-8777c17ebf1b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:06.349931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-45d733b7-cc05-435b-a04c-8777c17ebf1b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:06.368830 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45d733b7-cc05-435b-a04c-8777c17ebf1b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:06.369509 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45d733b7-cc05-435b-a04c-8777c17ebf1b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:06.377038 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45d733b7-cc05-435b-a04c-8777c17ebf1b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:06.377760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45d733b7-cc05-435b-a04c-8777c17ebf1b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:06.549703 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-45d733b7-cc05-435b-a04c-8777c17ebf1b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.206793 Jul 25 13:20:06.551417 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3044/6015] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 13:20:06 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019/os-interface => generated 284 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:20:06.766207 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5345a8f0-ff51-4d1f-bc22-4672cc0efd07 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:20:06.777513 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5345a8f0-ff51-4d1f-bc22-4672cc0efd07 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1577 microversion: 2.1 time: 0.493660 Jul 25 13:20:06.778772 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2972/6016] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:20:06 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1577 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:20:07.801728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9a86ebb2-4fcf-4441-81d4-8554239aeb41 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:07.801728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9a86ebb2-4fcf-4441-81d4-8554239aeb41 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:07.820819 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9a86ebb2-4fcf-4441-81d4-8554239aeb41 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:07.821291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9a86ebb2-4fcf-4441-81d4-8554239aeb41 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:07.824398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9a86ebb2-4fcf-4441-81d4-8554239aeb41 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:07.825242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9a86ebb2-4fcf-4441-81d4-8554239aeb41 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:07.928867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9a86ebb2-4fcf-4441-81d4-8554239aeb41 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:20:07.938641 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9a86ebb2-4fcf-4441-81d4-8554239aeb41 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1391 microversion: 2.1 time: 0.143054 Jul 25 13:20:07.939492 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3045/6017] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:20:07 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1391 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:20:08.014849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-31a021fa-bed0-437a-81f6-df0d867ee108 req-5191d609-fd98-4be2-b07e-5a635bc6690a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "122cf21d-eead-4a88-b0f5-0c7b839fd163", "name": "network-vif-deleted", "tag": "411fe352-2a1f-4b6e-b77b-b0d11abcce56"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:20:08.026432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-31a021fa-bed0-437a-81f6-df0d867ee108 req-5191d609-fd98-4be2-b07e-5a635bc6690a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:08.027168 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-31a021fa-bed0-437a-81f6-df0d867ee108 req-5191d609-fd98-4be2-b07e-5a635bc6690a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:08.043146 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-31a021fa-bed0-437a-81f6-df0d867ee108 req-5191d609-fd98-4be2-b07e-5a635bc6690a service nova] Creating event network-vif-deleted:411fe352-2a1f-4b6e-b77b-b0d11abcce56 for instance 122cf21d-eead-4a88-b0f5-0c7b839fd163 on n-h1-848886-15 Jul 25 13:20:08.054790 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-31a021fa-bed0-437a-81f6-df0d867ee108 req-5191d609-fd98-4be2-b07e-5a635bc6690a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043818 Jul 25 13:20:08.057561 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2973/6018] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:20:08.961368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d29c5f24-02ae-4ef2-a475-5035ad07c3ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:08.962770 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d29c5f24-02ae-4ef2-a475-5035ad07c3ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:08.971730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d29c5f24-02ae-4ef2-a475-5035ad07c3ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:08.972540 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d29c5f24-02ae-4ef2-a475-5035ad07c3ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:08.973710 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d29c5f24-02ae-4ef2-a475-5035ad07c3ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:08.974415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d29c5f24-02ae-4ef2-a475-5035ad07c3ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:09.054822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d29c5f24-02ae-4ef2-a475-5035ad07c3ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:20:09.066291 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d29c5f24-02ae-4ef2-a475-5035ad07c3ba tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1225 microversion: 2.1 time: 0.109060 Jul 25 13:20:09.069296 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3046/6019] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:20:08 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:20:10.092018 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e3d0fff9-d820-4e70-809d-f7d7fba6b51c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:10.093946 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e3d0fff9-d820-4e70-809d-f7d7fba6b51c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:10.111439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3d0fff9-d820-4e70-809d-f7d7fba6b51c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:10.114156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3d0fff9-d820-4e70-809d-f7d7fba6b51c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:10.116553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3d0fff9-d820-4e70-809d-f7d7fba6b51c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:10.118817 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e3d0fff9-d820-4e70-809d-f7d7fba6b51c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:10.155556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-d694e503-43c1-4e2c-9d4e-b69b92ae664e req-7e414387-a707-48b7-8a7d-7d87cdbdf3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7de1f2c9-f6e9-438a-bf35-4f1783c6b019", "tag": "5aa7c212-ec0b-409b-9941-dc56f6515dea"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:20:10.174688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d694e503-43c1-4e2c-9d4e-b69b92ae664e req-7e414387-a707-48b7-8a7d-7d87cdbdf3d7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:10.175510 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d694e503-43c1-4e2c-9d4e-b69b92ae664e req-7e414387-a707-48b7-8a7d-7d87cdbdf3d7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:10.191120 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-d694e503-43c1-4e2c-9d4e-b69b92ae664e req-7e414387-a707-48b7-8a7d-7d87cdbdf3d7 service nova] Creating event network-changed:5aa7c212-ec0b-409b-9941-dc56f6515dea for instance 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 on n-h2-848886-15 Jul 25 13:20:10.200509 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-d694e503-43c1-4e2c-9d4e-b69b92ae664e req-7e414387-a707-48b7-8a7d-7d87cdbdf3d7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050856 Jul 25 13:20:10.201952 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3047/6020] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:20:10.368133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e3d0fff9-d820-4e70-809d-f7d7fba6b51c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:20:10.378221 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e3d0fff9-d820-4e70-809d-f7d7fba6b51c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1225 microversion: 2.1 time: 0.291534 Jul 25 13:20:10.378808 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2974/6021] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:20:10 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1225 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:20:11.406031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-79829aa2-d01d-416a-b95a-6d8ee1ca088c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:11.406407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-79829aa2-d01d-416a-b95a-6d8ee1ca088c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:11.417471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-79829aa2-d01d-416a-b95a-6d8ee1ca088c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:11.418038 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-79829aa2-d01d-416a-b95a-6d8ee1ca088c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:11.418843 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-79829aa2-d01d-416a-b95a-6d8ee1ca088c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:11.419294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-79829aa2-d01d-416a-b95a-6d8ee1ca088c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:11.575972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-79829aa2-d01d-416a-b95a-6d8ee1ca088c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:20:11.590032 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-79829aa2-d01d-416a-b95a-6d8ee1ca088c tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1225 microversion: 2.1 time: 0.193745 Jul 25 13:20:11.591571 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3048/6022] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:20:11 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1225 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:20:12.616255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-33243923-cda5-40e3-94c5-8de57d315d1d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:12.616881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-33243923-cda5-40e3-94c5-8de57d315d1d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:12.638345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-33243923-cda5-40e3-94c5-8de57d315d1d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:12.640567 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-33243923-cda5-40e3-94c5-8de57d315d1d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:12.643326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-33243923-cda5-40e3-94c5-8de57d315d1d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:12.643912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-33243923-cda5-40e3-94c5-8de57d315d1d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:12.835549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-33243923-cda5-40e3-94c5-8de57d315d1d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:20:12.845339 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-33243923-cda5-40e3-94c5-8de57d315d1d tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1225 microversion: 2.1 time: 0.234049 Jul 25 13:20:12.860590 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2975/6023] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:20:12 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1225 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:20:13.867903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b93c0c25-cb59-4812-832f-1f79b9c69607 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:13.870455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b93c0c25-cb59-4812-832f-1f79b9c69607 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:13.877660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b93c0c25-cb59-4812-832f-1f79b9c69607 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:13.878424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b93c0c25-cb59-4812-832f-1f79b9c69607 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:13.879422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b93c0c25-cb59-4812-832f-1f79b9c69607 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:13.880235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b93c0c25-cb59-4812-832f-1f79b9c69607 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:13.936964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b93c0c25-cb59-4812-832f-1f79b9c69607 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:13.937615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b93c0c25-cb59-4812-832f-1f79b9c69607 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:13.938287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-b93c0c25-cb59-4812-832f-1f79b9c69607 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lazy-loading 'fault' on Instance uuid 122cf21d-eead-4a88-b0f5-0c7b839fd163 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:20:14.014791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b93c0c25-cb59-4812-832f-1f79b9c69607 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9face2aaa9df430cb5d361c6e1fdf242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fbd681752c41d0a24a9cf34ebc8389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:20:14.030964 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b93c0c25-cb59-4812-832f-1f79b9c69607 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 200 len: 1230 microversion: 2.1 time: 0.167193 Jul 25 13:20:14.046434 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3049/6024] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:20:13 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 1230 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:20:15.052702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7f06d418-8188-45a3-bbe6-a97b1293a0d4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:15.053419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7f06d418-8188-45a3-bbe6-a97b1293a0d4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 122cf21d-eead-4a88-b0f5-0c7b839fd163] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:15.069899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7f06d418-8188-45a3-bbe6-a97b1293a0d4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:15.070630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7f06d418-8188-45a3-bbe6-a97b1293a0d4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:15.071631 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7f06d418-8188-45a3-bbe6-a97b1293a0d4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:15.072262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7f06d418-8188-45a3-bbe6-a97b1293a0d4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:15.097276 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-7f06d418-8188-45a3-bbe6-a97b1293a0d4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] HTTP exception thrown: Instance 122cf21d-eead-4a88-b0f5-0c7b839fd163 could not be found. Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7f06d418-8188-45a3-bbe6-a97b1293a0d4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Request method failure captured: Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 HTTP/1.1 Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pUsgUlyXXDFjpaxtInCA3ErKU2P2TTpSljieML2SSsbmedwjUWvmtCPv6cpRR2_rKwVTBeB1pN0R0PaQlKkP3JB2H_nZ9mFVhTCd_Xl4_Gcw-PsIj4Ff-CbWbJlbzuA6BFxmfwmUVgHks2P6PoEesxOn8j894_Z-5Z842qklFD2ecs Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b2fbd681752c41d0a24a9cf34ebc8389", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}] Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 9face2aaa9df430cb5d361c6e1fdf242 Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 122cf21d-eead-4a88-b0f5-0c7b839fd163 could not be found. Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '122cf21d-eead-4a88-b0f5-0c7b839fd163'} Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 122cf21d-eead-4a88-b0f5-0c7b839fd163 could not be found. Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 122cf21d-eead-4a88-b0f5-0c7b839fd163 could not be found. Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:20:15.099653 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:20:15.104476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:20:15.104476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:20:15.104476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:20:15.104476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:20:15.104476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:20:15.104476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 122cf21d-eead-4a88-b0f5-0c7b839fd163 could not be found. Jul 25 13:20:15.104476 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:20:15.106200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7f06d418-8188-45a3-bbe6-a97b1293a0d4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Returning 404 to user: Instance 122cf21d-eead-4a88-b0f5-0c7b839fd163 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:20:15.107394 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7f06d418-8188-45a3-bbe6-a97b1293a0d4 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163" status: 404 len: 111 microversion: 2.1 time: 0.058783 Jul 25 13:20:15.111747 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2976/6025] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:20:15 2022] GET /compute/v2.1/servers/122cf21d-eead-4a88-b0f5-0c7b839fd163 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:20:15.803048 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-327eeb56-519d-4520-92c0-6d8dcb0c8f32 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:15.805012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-327eeb56-519d-4520-92c0-6d8dcb0c8f32 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:15.816605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-327eeb56-519d-4520-92c0-6d8dcb0c8f32 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:15.817889 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-327eeb56-519d-4520-92c0-6d8dcb0c8f32 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:15.819959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-327eeb56-519d-4520-92c0-6d8dcb0c8f32 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:15.820587 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-327eeb56-519d-4520-92c0-6d8dcb0c8f32 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:15.844744 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-327eeb56-519d-4520-92c0-6d8dcb0c8f32 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] HTTP exception thrown: Instance 592f6a73-dce4-4a04-8aa8-c14fe0e324e2 could not be found. Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-327eeb56-519d-4520-92c0-6d8dcb0c8f32 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Request method failure captured: Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 HTTP/1.1 Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pUsgUlyXXDFjpaxtInCA3ErKU2P2TTpSljieML2SSsbmedwjUWvmtCPv6cpRR2_rKwVTBeB1pN0R0PaQlKkP3JB2H_nZ9mFVhTCd_Xl4_Gcw-PsIj4Ff-CbWbJlbzuA6BFxmfwmUVgHks2P6PoEesxOn8j894_Z-5Z842qklFD2ecs Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b2fbd681752c41d0a24a9cf34ebc8389", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}] Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 9face2aaa9df430cb5d361c6e1fdf242 Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 592f6a73-dce4-4a04-8aa8-c14fe0e324e2 could not be found. Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '592f6a73-dce4-4a04-8aa8-c14fe0e324e2'} Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 592f6a73-dce4-4a04-8aa8-c14fe0e324e2 could not be found. Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:20:15.848228 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:20:15.852499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 592f6a73-dce4-4a04-8aa8-c14fe0e324e2 could not be found. Jul 25 13:20:15.852499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:20:15.852499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:20:15.852499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:20:15.852499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:20:15.852499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:20:15.852499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:20:15.852499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:20:15.852499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:20:15.852499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 592f6a73-dce4-4a04-8aa8-c14fe0e324e2 could not be found. Jul 25 13:20:15.852499 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:20:15.855906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-327eeb56-519d-4520-92c0-6d8dcb0c8f32 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Returning 404 to user: Instance 592f6a73-dce4-4a04-8aa8-c14fe0e324e2 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:20:15.857298 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-327eeb56-519d-4520-92c0-6d8dcb0c8f32 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "DELETE /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 404 len: 111 microversion: 2.1 time: 0.058717 Jul 25 13:20:15.860178 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3050/6026] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:20:15 2022] DELETE /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:20:15.868491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f4dd5b6b-9c42-456b-9dc3-e4a838f73326 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:15.869273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f4dd5b6b-9c42-456b-9dc3-e4a838f73326 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] [instance: 592f6a73-dce4-4a04-8aa8-c14fe0e324e2] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:15.876517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4dd5b6b-9c42-456b-9dc3-e4a838f73326 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:15.877155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4dd5b6b-9c42-456b-9dc3-e4a838f73326 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:15.878107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4dd5b6b-9c42-456b-9dc3-e4a838f73326 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:15.878631 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4dd5b6b-9c42-456b-9dc3-e4a838f73326 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:15.894368 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-f4dd5b6b-9c42-456b-9dc3-e4a838f73326 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] HTTP exception thrown: Instance 592f6a73-dce4-4a04-8aa8-c14fe0e324e2 could not be found. Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f4dd5b6b-9c42-456b-9dc3-e4a838f73326 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Request method failure captured: Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 HTTP/1.1 Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pUsgUlyXXDFjpaxtInCA3ErKU2P2TTpSljieML2SSsbmedwjUWvmtCPv6cpRR2_rKwVTBeB1pN0R0PaQlKkP3JB2H_nZ9mFVhTCd_Xl4_Gcw-PsIj4Ff-CbWbJlbzuA6BFxmfwmUVgHks2P6PoEesxOn8j894_Z-5Z842qklFD2ecs Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b2fbd681752c41d0a24a9cf34ebc8389", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2fbd681752c41d0a24a9cf34ebc8389"}]}] Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: b2fbd681752c41d0a24a9cf34ebc8389 Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449663601 Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 9face2aaa9df430cb5d361c6e1fdf242 Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-TestVolumeBootPattern-1449663601-project Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 592f6a73-dce4-4a04-8aa8-c14fe0e324e2 could not be found. Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '592f6a73-dce4-4a04-8aa8-c14fe0e324e2'} Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 592f6a73-dce4-4a04-8aa8-c14fe0e324e2 could not be found. Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 592f6a73-dce4-4a04-8aa8-c14fe0e324e2 could not be found. Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:20:15.896466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:20:15.900255 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:20:15.900255 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:20:15.900255 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:20:15.900255 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:20:15.900255 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:20:15.900255 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 592f6a73-dce4-4a04-8aa8-c14fe0e324e2 could not be found. Jul 25 13:20:15.900255 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:20:15.900255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f4dd5b6b-9c42-456b-9dc3-e4a838f73326 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Returning 404 to user: Instance 592f6a73-dce4-4a04-8aa8-c14fe0e324e2 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:20:15.900255 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f4dd5b6b-9c42-456b-9dc3-e4a838f73326 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2" status: 404 len: 111 microversion: 2.1 time: 0.033801 Jul 25 13:20:15.917744 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2977/6027] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:20:15 2022] GET /compute/v2.1/servers/592f6a73-dce4-4a04-8aa8-c14fe0e324e2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:20:20.318110 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bb2b5090-677a-4690-98d1-cc26e173de34 tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-75374888", "availability_zone": "foo_zone"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:20:20.321325 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 13:20:20.321325 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 13:20:20.323031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.aggregate [None req-bb2b5090-677a-4690-98d1-cc26e173de34 tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] Generated uuid b0dad22c-a357-4cff-9f2b-224d8de0bc72 for aggregate {{(pid=125884) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 13:20:20.356792 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bb2b5090-677a-4690-98d1-cc26e173de34 tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 207 microversion: 2.1 time: 0.224212 Jul 25 13:20:20.357865 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3051/6028] 10.222.0.49 () {60 vars in 1164 bytes} [Mon Jul 25 13:20:20 2022] POST /compute/v2.1/os-aggregates => generated 207 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:20:20.372116 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-62207d0a-9562-40a5-87d5-68d64d60de8e tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:20:20.375711 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 13:20:20.375711 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 13:20:20.405069 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-62207d0a-9562-40a5-87d5-68d64d60de8e tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 317 microversion: 2.1 time: 0.037097 Jul 25 13:20:20.412178 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2978/6029] 10.222.0.49 () {60 vars in 1194 bytes} [Mon Jul 25 13:20:20 2022] POST /compute/v2.1/os-aggregates/19/action => generated 317 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:20:20.417465 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dccc1d1c-3f46-4eef-8e94-796a780ed75c tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:20.421152 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 13:20:20.421152 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 13:20:20.423669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dccc1d1c-3f46-4eef-8e94-796a780ed75c tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:20.424268 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dccc1d1c-3f46-4eef-8e94-796a780ed75c tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:20.425152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dccc1d1c-3f46-4eef-8e94-796a780ed75c tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:20.425818 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dccc1d1c-3f46-4eef-8e94-796a780ed75c tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:20.450683 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dccc1d1c-3f46-4eef-8e94-796a780ed75c tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.037183 Jul 25 13:20:20.451917 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3052/6030] 10.222.0.49 () {58 vars in 1176 bytes} [Mon Jul 25 13:20:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:20:20.463724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6e022707-3351-46b4-a2fc-720006249d9a tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:20.464549 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 13:20:20.464549 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 13:20:20.472347 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6e022707-3351-46b4-a2fc-720006249d9a tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 200 len: 296 microversion: 2.1 time: 0.012793 Jul 25 13:20:20.473119 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2979/6031] 10.222.0.49 () {58 vars in 1143 bytes} [Mon Jul 25 13:20:20 2022] GET /compute/v2.1/os-aggregates => generated 296 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:20:20.497572 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fdefbf30-0fa8-4569-abfc-a85b3d1e175d tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-848886-15"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:20:20.504560 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 13:20:20.504560 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 13:20:20.519055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fdefbf30-0fa8-4569-abfc-a85b3d1e175d tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:20.519596 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fdefbf30-0fa8-4569-abfc-a85b3d1e175d tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:20.564494 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:20:20.810292 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-08379dbd-2599-4b55-a688-03d592bffdf3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] Calling method '.version_select at 0x7efcfed2b4c0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:20.867026 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-08379dbd-2599-4b55-a688-03d592bffdf3 tempest-TestVolumeBootPattern-1449663601 tempest-TestVolumeBootPattern-1449663601-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1436557910" status: 202 len: 0 microversion: 2.1 time: 0.062993 Jul 25 13:20:20.872632 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2980/6032] 10.222.0.49 () {58 vars in 1263 bytes} [Mon Jul 25 13:20:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1436557910 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:20:20.912039 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fdefbf30-0fa8-4569-abfc-a85b3d1e175d tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.420177 Jul 25 13:20:20.914539 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3053/6033] 10.222.0.49 () {60 vars in 1194 bytes} [Mon Jul 25 13:20:20 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:20:20.928686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-03ae958c-22ce-48fa-96a9-01443db88a20 tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:20.930682 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 13:20:20.930682 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 13:20:20.947405 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-03ae958c-22ce-48fa-96a9-01443db88a20 tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.022417 Jul 25 13:20:20.950967 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2981/6034] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 13:20:20 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:20:20.961865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d7f546f0-49ef-4688-99a2-576c11ab2fe6 tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1197042679", "availability_zone": "foo_zone"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:20:21.067784 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 13:20:21.067784 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 13:20:21.162587 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d7f546f0-49ef-4688-99a2-576c11ab2fe6 tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.204914 Jul 25 13:20:21.164152 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3054/6035] 10.222.0.49 () {60 vars in 1173 bytes} [Mon Jul 25 13:20:20 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:20:21.175113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7f50d1d6-4401-4dc8-baa6-3a166a4dcc7b tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:20:21.178950 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 13:20:21.178950 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 13:20:21.208431 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7f50d1d6-4401-4dc8-baa6-3a166a4dcc7b tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.037658 Jul 25 13:20:21.221160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3cdf178c-a11f-4426-8567-b1833b780f66 tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:21.222187 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 13:20:21.222187 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 13:20:21.226466 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2982/6036] 10.222.0.49 () {60 vars in 1194 bytes} [Mon Jul 25 13:20:21 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:20:21.232279 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3cdf178c-a11f-4426-8567-b1833b780f66 tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.015197 Jul 25 13:20:21.244563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f1b7f753-2e89-44e4-bebe-93c024ead0de tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-848886-15"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:20:21.247586 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3055/6037] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 25 13:20:21 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:20:21.248069 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 13:20:21.248069 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 13:20:21.258067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f1b7f753-2e89-44e4-bebe-93c024ead0de tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:21.258861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f1b7f753-2e89-44e4-bebe-93c024ead0de tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:21.646275 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f1b7f753-2e89-44e4-bebe-93c024ead0de tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.405298 Jul 25 13:20:21.653629 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2983/6038] 10.222.0.49 () {60 vars in 1194 bytes} [Mon Jul 25 13:20:21 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:20:21.665456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-52d0ff97-aa99-4008-99a3-5d7913ae678c tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:21.666198 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 13:20:21.666198 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 13:20:21.712459 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-52d0ff97-aa99-4008-99a3-5d7913ae678c tempest-TestAggregatesBasicOps-1025603906 tempest-TestAggregatesBasicOps-1025603906-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.051359 Jul 25 13:20:21.713336 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3056/6039] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Jul 25 13:20:21 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 13:20:41.727083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=56 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:20:41.728694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:20:41.733955 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-93bba939-05a2-4e85-8770-630a813d88ee tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:41.734464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-93bba939-05a2-4e85-8770-630a813d88ee tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:41.741804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-93bba939-05a2-4e85-8770-630a813d88ee tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:41.742378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-93bba939-05a2-4e85-8770-630a813d88ee tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:41.743151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-93bba939-05a2-4e85-8770-630a813d88ee tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:41.743596 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-93bba939-05a2-4e85-8770-630a813d88ee tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:41.772915 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-93bba939-05a2-4e85-8770-630a813d88ee tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019/ips" status: 200 len: 150 microversion: 2.1 time: 0.048782 Jul 25 13:20:41.773546 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2984/6040] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Jul 25 13:20:41 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:20:43.128416 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fa95462a-2d77-4334-98ec-7e2ed7d66f9e tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db863fce-b77d-4e59-b5ac-597cf71f557f"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:20:43.130821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fa95462a-2d77-4334-98ec-7e2ed7d66f9e tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:43.134414 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:20:43.135208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:20:43.141560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa95462a-2d77-4334-98ec-7e2ed7d66f9e tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:43.142046 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa95462a-2d77-4334-98ec-7e2ed7d66f9e tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:43.142828 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa95462a-2d77-4334-98ec-7e2ed7d66f9e tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:43.143271 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa95462a-2d77-4334-98ec-7e2ed7d66f9e tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:43.409892 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fa95462a-2d77-4334-98ec-7e2ed7d66f9e tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "POST /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285389 Jul 25 13:20:43.415806 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3057/6041] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Jul 25 13:20:43 2022] POST /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:20:54.202644 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c3472fac-3d31-4270-89f4-a8a686c40886 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db863fce-b77d-4e59-b5ac-597cf71f557f"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:20:54.205150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c3472fac-3d31-4270-89f4-a8a686c40886 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:54.207832 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:20:54.208636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:20:54.214481 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3472fac-3d31-4270-89f4-a8a686c40886 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:54.214961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3472fac-3d31-4270-89f4-a8a686c40886 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:54.215734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3472fac-3d31-4270-89f4-a8a686c40886 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:54.216186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3472fac-3d31-4270-89f4-a8a686c40886 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:54.298452 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-c3472fac-3d31-4270-89f4-a8a686c40886 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] HTTP exception thrown: Invalid volume: volume db863fce-b77d-4e59-b5ac-597cf71f557f is already attached to instances: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c3472fac-3d31-4270-89f4-a8a686c40886 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Request method failure captured: Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019/os-volume_attachments HTTP/1.1 Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 74 Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pfvdELBqc9ktGA5Lf40UAQ78535PWLYdV07ICt2wdq2RGB8ieRYQg1pW--wMG6xplNKDuvq-CZoEGzYXFP5IvXxGjkhJA3p-eAzNDkDVUaa03y9emRX7H5OKq6_lJxEVfuNLo8utSx2bi7m4uQFvPZDAYfj7NiFWNJBHuf2bTAGGbI Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_805811c2762b477cae7cb16377e12dac", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/805811c2762b477cae7cb16377e12dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}] Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 3092b4bfef6f4d778d52e9de3cd1b785 Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: {"volumeAttachment": {"volumeId": "db863fce-b77d-4e59-b5ac-597cf71f557f"}} Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid volume: volume db863fce-b77d-4e59-b5ac-597cf71f557f is already attached to instances: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'server_id': '7de1f2c9-f6e9-438a-bf35-4f1783c6b019', 'body': {'volumeAttachment': {'volumeId': 'db863fce-b77d-4e59-b5ac-597cf71f557f'}}} Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume db863fce-b77d-4e59-b5ac-597cf71f557f is already attached to instances: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:20:54.300135 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:20:54.304436 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:20:54.304436 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:20:54.304436 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 13:20:54.304436 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 13:20:54.304436 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume db863fce-b77d-4e59-b5ac-597cf71f557f is already attached to instances: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 Jul 25 13:20:54.304436 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:20:54.304436 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:20:54.304436 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:20:54.304436 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:20:54.304436 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:20:54.304436 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:20:54.304436 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:20:54.304436 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:20:54.304436 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume db863fce-b77d-4e59-b5ac-597cf71f557f is already attached to instances: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 Jul 25 13:20:54.304436 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:20:54.304436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c3472fac-3d31-4270-89f4-a8a686c40886 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Returning 400 to user: Invalid volume: volume db863fce-b77d-4e59-b5ac-597cf71f557f is already attached to instances: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:20:54.304436 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c3472fac-3d31-4270-89f4-a8a686c40886 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "POST /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103459 Jul 25 13:20:54.304436 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2985/6042] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Jul 25 13:20:54 2022] POST /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:20:54.368324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a0d803df-a174-49c6-a053-0f80c791046c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:54.369028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a0d803df-a174-49c6-a053-0f80c791046c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:54.371784 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:20:54.372486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:20:54.378666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0d803df-a174-49c6-a053-0f80c791046c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:54.379143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0d803df-a174-49c6-a053-0f80c791046c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:54.379931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0d803df-a174-49c6-a053-0f80c791046c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:54.380361 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a0d803df-a174-49c6-a053-0f80c791046c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:54.466310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-a0d803df-a174-49c6-a053-0f80c791046c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lazy-loading 'services' on Instance uuid 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:20:54.548859 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a0d803df-a174-49c6-a053-0f80c791046c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019/os-volume_attachments/db863fce-b77d-4e59-b5ac-597cf71f557f" status: 202 len: 0 microversion: 2.1 time: 0.184885 Jul 25 13:20:54.549607 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3058/6043] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Jul 25 13:20:54 2022] DELETE /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019/os-volume_attachments/db863fce-b77d-4e59-b5ac-597cf71f557f => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:20:54.559640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-14c1e58b-15af-49bd-8f87-52327f042811 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:54.562205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-14c1e58b-15af-49bd-8f87-52327f042811 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:54.569000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14c1e58b-15af-49bd-8f87-52327f042811 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:54.570204 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14c1e58b-15af-49bd-8f87-52327f042811 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:54.570860 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14c1e58b-15af-49bd-8f87-52327f042811 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:54.571303 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14c1e58b-15af-49bd-8f87-52327f042811 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:54.629727 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-14c1e58b-15af-49bd-8f87-52327f042811 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075469 Jul 25 13:20:54.630675 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2986/6044] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:20:54 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:20:55.643903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-82fc57c7-9ae6-4de9-82d0-f4e5e3ed966d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:55.646593 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-82fc57c7-9ae6-4de9-82d0-f4e5e3ed966d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:55.653427 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82fc57c7-9ae6-4de9-82d0-f4e5e3ed966d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:55.653981 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82fc57c7-9ae6-4de9-82d0-f4e5e3ed966d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:55.654853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82fc57c7-9ae6-4de9-82d0-f4e5e3ed966d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:55.655350 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82fc57c7-9ae6-4de9-82d0-f4e5e3ed966d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:55.685993 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-82fc57c7-9ae6-4de9-82d0-f4e5e3ed966d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047434 Jul 25 13:20:55.686482 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3059/6045] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:20:55 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:20:56.698453 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-97e4c2b0-34c6-4e39-8461-b7fcea2214f3 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:56.700653 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-97e4c2b0-34c6-4e39-8461-b7fcea2214f3 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:56.708132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97e4c2b0-34c6-4e39-8461-b7fcea2214f3 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:56.708592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97e4c2b0-34c6-4e39-8461-b7fcea2214f3 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:56.709374 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97e4c2b0-34c6-4e39-8461-b7fcea2214f3 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:56.709856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97e4c2b0-34c6-4e39-8461-b7fcea2214f3 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:56.740881 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-97e4c2b0-34c6-4e39-8461-b7fcea2214f3 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046324 Jul 25 13:20:56.741359 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2987/6046] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:20:56 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:20:57.753063 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7e186a1d-64ba-44e0-b19d-6fa1a84925f1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:57.755477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7e186a1d-64ba-44e0-b19d-6fa1a84925f1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:57.762534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e186a1d-64ba-44e0-b19d-6fa1a84925f1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:57.762963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e186a1d-64ba-44e0-b19d-6fa1a84925f1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:57.763819 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e186a1d-64ba-44e0-b19d-6fa1a84925f1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:57.764229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e186a1d-64ba-44e0-b19d-6fa1a84925f1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:57.795669 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7e186a1d-64ba-44e0-b19d-6fa1a84925f1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046690 Jul 25 13:20:57.799570 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3060/6047] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:20:57 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:20:58.807763 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cc356da5-bb09-4231-8662-1cf8dba8b6d2 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:58.809863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cc356da5-bb09-4231-8662-1cf8dba8b6d2 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:58.817214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cc356da5-bb09-4231-8662-1cf8dba8b6d2 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:58.817673 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cc356da5-bb09-4231-8662-1cf8dba8b6d2 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:58.818487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cc356da5-bb09-4231-8662-1cf8dba8b6d2 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:58.818930 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cc356da5-bb09-4231-8662-1cf8dba8b6d2 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:58.849552 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cc356da5-bb09-4231-8662-1cf8dba8b6d2 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045896 Jul 25 13:20:58.850140 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2988/6048] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:20:58 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:20:59.862454 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c0035ea4-0c64-46e8-907a-1dce06bdb1b5 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:59.864794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c0035ea4-0c64-46e8-907a-1dce06bdb1b5 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:59.872263 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c0035ea4-0c64-46e8-907a-1dce06bdb1b5 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:59.872715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c0035ea4-0c64-46e8-907a-1dce06bdb1b5 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:59.873606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c0035ea4-0c64-46e8-907a-1dce06bdb1b5 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:59.874070 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c0035ea4-0c64-46e8-907a-1dce06bdb1b5 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:59.904753 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c0035ea4-0c64-46e8-907a-1dce06bdb1b5 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046158 Jul 25 13:20:59.905326 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3061/6049] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:20:59 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 13:20:59.971045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6a9f724a-dbfa-4058-bed6-608282e8c042 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:20:59.971598 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6a9f724a-dbfa-4058-bed6-608282e8c042 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:20:59.978960 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a9f724a-dbfa-4058-bed6-608282e8c042 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:59.979423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a9f724a-dbfa-4058-bed6-608282e8c042 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:20:59.980209 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a9f724a-dbfa-4058-bed6-608282e8c042 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:20:59.980659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a9f724a-dbfa-4058-bed6-608282e8c042 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:00.006980 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6a9f724a-dbfa-4058-bed6-608282e8c042 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:21:00.095368 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6a9f724a-dbfa-4058-bed6-608282e8c042 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019" status: 204 len: 0 microversion: 2.1 time: 0.127334 Jul 25 13:21:00.096190 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2989/6050] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:20:59 2022] DELETE /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:21:00.105740 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c92b8e5e-5f04-493e-a569-9659437f1e2f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:21:00.106380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c92b8e5e-5f04-493e-a569-9659437f1e2f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:21:00.113332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c92b8e5e-5f04-493e-a569-9659437f1e2f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:00.113480 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c92b8e5e-5f04-493e-a569-9659437f1e2f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:00.114237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c92b8e5e-5f04-493e-a569-9659437f1e2f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:00.114674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c92b8e5e-5f04-493e-a569-9659437f1e2f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:00.258404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c92b8e5e-5f04-493e-a569-9659437f1e2f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:21:00.266293 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c92b8e5e-5f04-493e-a569-9659437f1e2f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019" status: 200 len: 1682 microversion: 2.1 time: 0.165567 Jul 25 13:21:00.266875 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3062/6051] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:21:00 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:21:01.287973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2f5f3ba6-9486-480f-b6cd-4c9c9e80ab5a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:21:01.288586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2f5f3ba6-9486-480f-b6cd-4c9c9e80ab5a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:21:01.296464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f5f3ba6-9486-480f-b6cd-4c9c9e80ab5a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:01.296937 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f5f3ba6-9486-480f-b6cd-4c9c9e80ab5a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:01.297729 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f5f3ba6-9486-480f-b6cd-4c9c9e80ab5a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:01.298223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f5f3ba6-9486-480f-b6cd-4c9c9e80ab5a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:01.432263 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2f5f3ba6-9486-480f-b6cd-4c9c9e80ab5a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:21:01.440915 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2f5f3ba6-9486-480f-b6cd-4c9c9e80ab5a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019" status: 200 len: 1682 microversion: 2.1 time: 0.157079 Jul 25 13:21:01.441484 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2990/6052] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:21:01 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:21:02.462888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7a0ff3e7-0983-4d99-8e57-ee7c0a6d659a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:21:02.464508 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7a0ff3e7-0983-4d99-8e57-ee7c0a6d659a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:21:02.472830 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a0ff3e7-0983-4d99-8e57-ee7c0a6d659a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:02.473433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a0ff3e7-0983-4d99-8e57-ee7c0a6d659a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:02.474749 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a0ff3e7-0983-4d99-8e57-ee7c0a6d659a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:02.475625 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a0ff3e7-0983-4d99-8e57-ee7c0a6d659a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:02.537493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-edbf3749-634b-4ee3-b8a3-e24b43077590 req-94a559c4-fcb0-47ff-a822-8d80a5c5bad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7de1f2c9-f6e9-438a-bf35-4f1783c6b019", "name": "network-vif-deleted", "tag": "5aa7c212-ec0b-409b-9941-dc56f6515dea"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:21:02.552070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-edbf3749-634b-4ee3-b8a3-e24b43077590 req-94a559c4-fcb0-47ff-a822-8d80a5c5bad6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:02.552902 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-edbf3749-634b-4ee3-b8a3-e24b43077590 req-94a559c4-fcb0-47ff-a822-8d80a5c5bad6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:02.569313 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-edbf3749-634b-4ee3-b8a3-e24b43077590 req-94a559c4-fcb0-47ff-a822-8d80a5c5bad6 service nova] Creating event network-vif-deleted:5aa7c212-ec0b-409b-9941-dc56f6515dea for instance 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 on n-h2-848886-15 Jul 25 13:21:02.571127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7a0ff3e7-0983-4d99-8e57-ee7c0a6d659a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:21:02.575808 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-edbf3749-634b-4ee3-b8a3-e24b43077590 req-94a559c4-fcb0-47ff-a822-8d80a5c5bad6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043114 Jul 25 13:21:02.577508 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2991/6053] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:21:02.582913 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7a0ff3e7-0983-4d99-8e57-ee7c0a6d659a tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019" status: 200 len: 1614 microversion: 2.1 time: 0.124113 Jul 25 13:21:02.584057 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3063/6054] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:21:02 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019 => generated 1614 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:21:03.606803 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-26cfc965-dd18-4ac1-895b-f2a4e7a6642c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:21:03.607564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-26cfc965-dd18-4ac1-895b-f2a4e7a6642c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:21:03.614405 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26cfc965-dd18-4ac1-895b-f2a4e7a6642c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:03.614855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26cfc965-dd18-4ac1-895b-f2a4e7a6642c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:03.615648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26cfc965-dd18-4ac1-895b-f2a4e7a6642c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:03.616104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26cfc965-dd18-4ac1-895b-f2a4e7a6642c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:03.631533 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-26cfc965-dd18-4ac1-895b-f2a4e7a6642c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] HTTP exception thrown: Instance 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 could not be found. Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-26cfc965-dd18-4ac1-895b-f2a4e7a6642c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Request method failure captured: Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019 HTTP/1.1 Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pfvdELBqc9ktGA5Lf40UAQ78535PWLYdV07ICt2wdq2RGB8ieRYQg1pW--wMG6xplNKDuvq-CZoEGzYXFP5IvXxGjkhJA3p-eAzNDkDVUaa03y9emRX7H5OKq6_lJxEVfuNLo8utSx2bi7m4uQFvPZDAYfj7NiFWNJBHuf2bTAGGbI Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_805811c2762b477cae7cb16377e12dac", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/805811c2762b477cae7cb16377e12dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}] Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 3092b4bfef6f4d778d52e9de3cd1b785 Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 could not be found. Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '7de1f2c9-f6e9-438a-bf35-4f1783c6b019'} Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 could not be found. Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 could not be found. Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:21:03.633318 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:21:03.638210 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:21:03.638210 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:21:03.638210 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:21:03.638210 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:21:03.638210 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:21:03.638210 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 could not be found. Jul 25 13:21:03.638210 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:21:03.638210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-26cfc965-dd18-4ac1-895b-f2a4e7a6642c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Returning 404 to user: Instance 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:21:03.638210 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-26cfc965-dd18-4ac1-895b-f2a4e7a6642c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019" status: 404 len: 111 microversion: 2.1 time: 0.035568 Jul 25 13:21:03.638851 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2992/6055] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:21:03 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:21:03.647031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-72cfa3dc-0416-436f-9c9d-2e3f011c57d9 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '.version_select at 0x7efcf883a790>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:21:03.671142 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-72cfa3dc-0416-436f-9c9d-2e3f011c57d9 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1945279103" status: 202 len: 0 microversion: 2.1 time: 0.027996 Jul 25 13:21:03.672324 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3064/6056] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Jul 25 13:21:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1945279103 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:21:04.320830 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-695ba5eb-5220-4e8d-84bd-05f877e6e829 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Action: 'create', calling method: .version_select at 0x7efcf9a8f820>, body: {"keypair": {"name": "tempest-keypair-213951383", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPjtR7U5BA1M8Dx4P2TChZwN5kPb8XxDub884tGuwHIAt42o0y24oridfzpTCbVdPxCHYBTmIQhVcGlV+nuhEFnamHVlARQsLZvW6fKx8xzp19dL4747kwCmYiR8HgSsg=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:21:04.337752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-695ba5eb-5220-4e8d-84bd-05f877e6e829 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Getting quotas for project 805811c2762b477cae7cb16377e12dac. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:21:04.343944 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-695ba5eb-5220-4e8d-84bd-05f877e6e829 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Getting quotas for user 3092b4bfef6f4d778d52e9de3cd1b785 and project 805811c2762b477cae7cb16377e12dac. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:21:04.368432 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-695ba5eb-5220-4e8d-84bd-05f877e6e829 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051426 Jul 25 13:21:04.368972 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2993/6057] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:21:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:21:05.823262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-115f9145-cf4e-4c92-96ff-7e99edc21033 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1979998826", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e17217fe-ccfb-47ee-98dd-b05efd6867f9"}], "security_groups": [{"name": "tempest-securitygroup--1539515435"}], "key_name": "tempest-keypair-213951383", "user_data": "}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:21:05.946958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-115f9145-cf4e-4c92-96ff-7e99edc21033 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] validate_networks() for [('e17217fe-ccfb-47ee-98dd-b05efd6867f9', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:21:06.375472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-115f9145-cf4e-4c92-96ff-7e99edc21033 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:21:06.375898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-115f9145-cf4e-4c92-96ff-7e99edc21033 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:21:06.376372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-115f9145-cf4e-4c92-96ff-7e99edc21033 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:21:06.376783 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-115f9145-cf4e-4c92-96ff-7e99edc21033 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:21:06.377198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-115f9145-cf4e-4c92-96ff-7e99edc21033 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:21:06.386633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-115f9145-cf4e-4c92-96ff-7e99edc21033 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:06.387084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-115f9145-cf4e-4c92-96ff-7e99edc21033 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:06.387885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-115f9145-cf4e-4c92-96ff-7e99edc21033 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:06.388331 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-115f9145-cf4e-4c92-96ff-7e99edc21033 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:06.407059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-115f9145-cf4e-4c92-96ff-7e99edc21033 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Getting quotas for project 805811c2762b477cae7cb16377e12dac. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:21:06.412042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-115f9145-cf4e-4c92-96ff-7e99edc21033 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Getting quotas for user 3092b4bfef6f4d778d52e9de3cd1b785 and project 805811c2762b477cae7cb16377e12dac. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:21:06.425243 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-115f9145-cf4e-4c92-96ff-7e99edc21033 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:21:06.427648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-115f9145-cf4e-4c92-96ff-7e99edc21033 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:21:06.474791 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-115f9145-cf4e-4c92-96ff-7e99edc21033 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.658281 Jul 25 13:21:06.475782 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3065/6058] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:21:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:21:06.487388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7bb425f1-173c-44d5-bd2d-e3c0caf7b170 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:21:06.487992 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7bb425f1-173c-44d5-bd2d-e3c0caf7b170 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:21:06.555625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7bb425f1-173c-44d5-bd2d-e3c0caf7b170 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:21:06.564131 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7bb425f1-173c-44d5-bd2d-e3c0caf7b170 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718" status: 200 len: 1241 microversion: 2.1 time: 0.080727 Jul 25 13:21:06.577536 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2994/6059] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:21:06 2022] GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:21:07.586889 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5efad58a-335b-4688-91fe-421889cdb55f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:21:07.587471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5efad58a-335b-4688-91fe-421889cdb55f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:21:07.595351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5efad58a-335b-4688-91fe-421889cdb55f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:07.595808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5efad58a-335b-4688-91fe-421889cdb55f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:07.596589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5efad58a-335b-4688-91fe-421889cdb55f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:07.597024 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5efad58a-335b-4688-91fe-421889cdb55f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:07.677800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5efad58a-335b-4688-91fe-421889cdb55f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:21:07.692678 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5efad58a-335b-4688-91fe-421889cdb55f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718" status: 200 len: 1299 microversion: 2.1 time: 0.111055 Jul 25 13:21:07.699637 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3066/6060] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:21:07 2022] GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718 => generated 1299 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:21:08.721089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1d383373-d0f1-4bc3-8b5b-2cba11b50f26 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:21:08.721684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1d383373-d0f1-4bc3-8b5b-2cba11b50f26 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:21:08.730217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d383373-d0f1-4bc3-8b5b-2cba11b50f26 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:08.730622 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d383373-d0f1-4bc3-8b5b-2cba11b50f26 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:08.731432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d383373-d0f1-4bc3-8b5b-2cba11b50f26 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:08.731890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d383373-d0f1-4bc3-8b5b-2cba11b50f26 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:08.879815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1d383373-d0f1-4bc3-8b5b-2cba11b50f26 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:21:08.890812 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1d383373-d0f1-4bc3-8b5b-2cba11b50f26 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718" status: 200 len: 1367 microversion: 2.1 time: 0.174022 Jul 25 13:21:08.891679 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2995/6061] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:21:08 2022] GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:21:09.312154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-273a6da5-776a-4bbe-bcad-0f2bea44e70e req-18d24171-9aae-4b16-8eb4-40dff44e1eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a7f28c5-4e4a-45fa-882f-14c74a925718", "tag": "b6795853-7506-4f09-a051-7a1bf8f56437"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:21:09.328395 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-273a6da5-776a-4bbe-bcad-0f2bea44e70e req-18d24171-9aae-4b16-8eb4-40dff44e1eb4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:09.329930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-273a6da5-776a-4bbe-bcad-0f2bea44e70e req-18d24171-9aae-4b16-8eb4-40dff44e1eb4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:09.342852 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-273a6da5-776a-4bbe-bcad-0f2bea44e70e req-18d24171-9aae-4b16-8eb4-40dff44e1eb4 service nova] Creating event network-changed:b6795853-7506-4f09-a051-7a1bf8f56437 for instance 5a7f28c5-4e4a-45fa-882f-14c74a925718 on n-h1-848886-15 Jul 25 13:21:09.358918 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-273a6da5-776a-4bbe-bcad-0f2bea44e70e req-18d24171-9aae-4b16-8eb4-40dff44e1eb4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043026 Jul 25 13:21:09.361498 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3067/6062] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:21:09.912285 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5ebf12b1-3833-4ef3-a521-2093cfae2de5 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:21:09.913250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5ebf12b1-3833-4ef3-a521-2093cfae2de5 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:21:09.920922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ebf12b1-3833-4ef3-a521-2093cfae2de5 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:09.921393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ebf12b1-3833-4ef3-a521-2093cfae2de5 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:09.922210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ebf12b1-3833-4ef3-a521-2093cfae2de5 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:09.922650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5ebf12b1-3833-4ef3-a521-2093cfae2de5 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:10.074922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5ebf12b1-3833-4ef3-a521-2093cfae2de5 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:21:10.083147 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5ebf12b1-3833-4ef3-a521-2093cfae2de5 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718" status: 200 len: 1367 microversion: 2.1 time: 0.174980 Jul 25 13:21:10.083702 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2996/6063] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:21:09 2022] GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:21:11.105031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fd3bb155-c4e2-48c3-9a4c-420dc35ffb38 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:21:11.105755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fd3bb155-c4e2-48c3-9a4c-420dc35ffb38 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:21:11.113226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd3bb155-c4e2-48c3-9a4c-420dc35ffb38 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:11.113678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd3bb155-c4e2-48c3-9a4c-420dc35ffb38 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:11.115164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd3bb155-c4e2-48c3-9a4c-420dc35ffb38 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:11.118012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fd3bb155-c4e2-48c3-9a4c-420dc35ffb38 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:11.265034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fd3bb155-c4e2-48c3-9a4c-420dc35ffb38 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:21:11.272645 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fd3bb155-c4e2-48c3-9a4c-420dc35ffb38 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718" status: 200 len: 1367 microversion: 2.1 time: 0.172263 Jul 25 13:21:11.273231 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3068/6064] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:21:11 2022] GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:21:12.294697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-79d54c78-1c4b-42e4-9ecd-16cdffdc7b67 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:21:12.295716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-79d54c78-1c4b-42e4-9ecd-16cdffdc7b67 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:21:12.302996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79d54c78-1c4b-42e4-9ecd-16cdffdc7b67 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:12.303474 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79d54c78-1c4b-42e4-9ecd-16cdffdc7b67 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:12.304249 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79d54c78-1c4b-42e4-9ecd-16cdffdc7b67 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:12.304702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79d54c78-1c4b-42e4-9ecd-16cdffdc7b67 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:12.444322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-79d54c78-1c4b-42e4-9ecd-16cdffdc7b67 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:21:12.453767 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-79d54c78-1c4b-42e4-9ecd-16cdffdc7b67 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718" status: 200 len: 1367 microversion: 2.1 time: 0.163002 Jul 25 13:21:12.454470 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2997/6065] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:21:12 2022] GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:21:13.475588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ab05c833-ef8d-4b76-840e-692e84632981 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:21:13.476292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ab05c833-ef8d-4b76-840e-692e84632981 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:21:13.484123 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ab05c833-ef8d-4b76-840e-692e84632981 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:13.484513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ab05c833-ef8d-4b76-840e-692e84632981 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:13.485293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ab05c833-ef8d-4b76-840e-692e84632981 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:13.485738 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ab05c833-ef8d-4b76-840e-692e84632981 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:13.620997 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ab05c833-ef8d-4b76-840e-692e84632981 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:21:13.628866 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ab05c833-ef8d-4b76-840e-692e84632981 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718" status: 200 len: 1367 microversion: 2.1 time: 0.157514 Jul 25 13:21:13.629445 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3069/6066] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:21:13 2022] GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:21:14.650152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aaf1b422-388d-4917-8166-1b0453457a99 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:21:14.651196 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-aaf1b422-388d-4917-8166-1b0453457a99 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:21:14.658615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aaf1b422-388d-4917-8166-1b0453457a99 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:14.659155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aaf1b422-388d-4917-8166-1b0453457a99 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:14.660013 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aaf1b422-388d-4917-8166-1b0453457a99 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:14.660536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aaf1b422-388d-4917-8166-1b0453457a99 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:14.793652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-aaf1b422-388d-4917-8166-1b0453457a99 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:21:14.801301 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aaf1b422-388d-4917-8166-1b0453457a99 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718" status: 200 len: 1367 microversion: 2.1 time: 0.155137 Jul 25 13:21:14.801866 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2998/6067] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:21:14 2022] GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:21:15.011272 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-47fe75bd-5d36-4b2a-8779-77d33d71efb8 req-24c00571-a408-4ec6-956b-9b0d6370fb8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a7f28c5-4e4a-45fa-882f-14c74a925718", "name": "network-vif-plugged", "status": "completed", "tag": "b6795853-7506-4f09-a051-7a1bf8f56437"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:21:15.022992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-47fe75bd-5d36-4b2a-8779-77d33d71efb8 req-24c00571-a408-4ec6-956b-9b0d6370fb8c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:15.023542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-47fe75bd-5d36-4b2a-8779-77d33d71efb8 req-24c00571-a408-4ec6-956b-9b0d6370fb8c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:15.039528 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-47fe75bd-5d36-4b2a-8779-77d33d71efb8 req-24c00571-a408-4ec6-956b-9b0d6370fb8c service nova] Creating event network-vif-plugged:b6795853-7506-4f09-a051-7a1bf8f56437 for instance 5a7f28c5-4e4a-45fa-882f-14c74a925718 on n-h1-848886-15 Jul 25 13:21:15.046054 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-47fe75bd-5d36-4b2a-8779-77d33d71efb8 req-24c00571-a408-4ec6-956b-9b0d6370fb8c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037614 Jul 25 13:21:15.047103 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3070/6068] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:21:15.822483 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ffd1e3e3-8b3d-49b8-9d4e-be96e220398f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:21:15.823173 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ffd1e3e3-8b3d-49b8-9d4e-be96e220398f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:21:15.830047 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ffd1e3e3-8b3d-49b8-9d4e-be96e220398f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:15.830512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ffd1e3e3-8b3d-49b8-9d4e-be96e220398f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:15.831273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ffd1e3e3-8b3d-49b8-9d4e-be96e220398f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:15.831725 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ffd1e3e3-8b3d-49b8-9d4e-be96e220398f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:15.965388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ffd1e3e3-8b3d-49b8-9d4e-be96e220398f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:21:15.973289 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ffd1e3e3-8b3d-49b8-9d4e-be96e220398f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718" status: 200 len: 1367 microversion: 2.1 time: 0.154599 Jul 25 13:21:15.973889 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 2999/6069] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:21:15 2022] GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:21:16.995476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-73aa5739-1d1f-44a4-87ec-3eb39697739d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:21:16.996182 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-73aa5739-1d1f-44a4-87ec-3eb39697739d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:21:16.999211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:21:17.000394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:21:17.006851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-73aa5739-1d1f-44a4-87ec-3eb39697739d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:17.007286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-73aa5739-1d1f-44a4-87ec-3eb39697739d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:17.008284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-73aa5739-1d1f-44a4-87ec-3eb39697739d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:17.018261 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-73aa5739-1d1f-44a4-87ec-3eb39697739d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:17.153059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-73aa5739-1d1f-44a4-87ec-3eb39697739d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:21:17.160732 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-73aa5739-1d1f-44a4-87ec-3eb39697739d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718" status: 200 len: 1558 microversion: 2.1 time: 0.169939 Jul 25 13:21:17.175237 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3071/6070] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:21:16 2022] GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718 => generated 1558 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:21:17.182466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1dea0719-0cd4-4f1f-b4bc-caf6df88e494 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:21:17.183036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1dea0719-0cd4-4f1f-b4bc-caf6df88e494 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:21:17.184975 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:21:17.191439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1dea0719-0cd4-4f1f-b4bc-caf6df88e494 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:17.191914 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1dea0719-0cd4-4f1f-b4bc-caf6df88e494 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:17.192712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1dea0719-0cd4-4f1f-b4bc-caf6df88e494 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:17.193163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1dea0719-0cd4-4f1f-b4bc-caf6df88e494 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:17.269950 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1dea0719-0cd4-4f1f-b4bc-caf6df88e494 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091231 Jul 25 13:21:17.270636 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3000/6071] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 13:21:17 2022] GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:21:18.545286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-f9e52eb4-6c85-4d43-be42-c6b8ec1b2487 req-eb660b1a-3dff-490f-aeec-946701aac2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a7f28c5-4e4a-45fa-882f-14c74a925718", "tag": "b6795853-7506-4f09-a051-7a1bf8f56437"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:21:18.555591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f9e52eb4-6c85-4d43-be42-c6b8ec1b2487 req-eb660b1a-3dff-490f-aeec-946701aac2e4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:18.556015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f9e52eb4-6c85-4d43-be42-c6b8ec1b2487 req-eb660b1a-3dff-490f-aeec-946701aac2e4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:18.567350 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-f9e52eb4-6c85-4d43-be42-c6b8ec1b2487 req-eb660b1a-3dff-490f-aeec-946701aac2e4 service nova] Creating event network-changed:b6795853-7506-4f09-a051-7a1bf8f56437 for instance 5a7f28c5-4e4a-45fa-882f-14c74a925718 on n-h1-848886-15 Jul 25 13:21:18.572459 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-f9e52eb4-6c85-4d43-be42-c6b8ec1b2487 req-eb660b1a-3dff-490f-aeec-946701aac2e4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030915 Jul 25 13:21:18.573054 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3072/6072] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:21:48.057134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:21:48.058113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:21:48.062283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d959911d-bfa5-4419-a700-afa854f53f37 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:21:48.062821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d959911d-bfa5-4419-a700-afa854f53f37 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:21:48.070532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d959911d-bfa5-4419-a700-afa854f53f37 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:48.070984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d959911d-bfa5-4419-a700-afa854f53f37 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:48.071842 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d959911d-bfa5-4419-a700-afa854f53f37 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:48.072251 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d959911d-bfa5-4419-a700-afa854f53f37 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:48.097175 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d959911d-bfa5-4419-a700-afa854f53f37 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718/ips" status: 200 len: 151 microversion: 2.1 time: 0.041824 Jul 25 13:21:48.097768 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3001/6073] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Jul 25 13:21:48 2022] GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:21:49.450576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:21:49.451334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:21:49.455604 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-af096310-5ddf-4de1-abf1-2f3ad73e91da tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d307fdc-73cb-42f4-bf49-4058fd312665"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:21:49.458107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-af096310-5ddf-4de1-abf1-2f3ad73e91da tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:21:49.465904 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-af096310-5ddf-4de1-abf1-2f3ad73e91da tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:49.466360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-af096310-5ddf-4de1-abf1-2f3ad73e91da tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:49.467129 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-af096310-5ddf-4de1-abf1-2f3ad73e91da tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:21:49.467564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-af096310-5ddf-4de1-abf1-2f3ad73e91da tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:21:49.720607 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-af096310-5ddf-4de1-abf1-2f3ad73e91da tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "POST /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271912 Jul 25 13:21:49.721199 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3073/6074] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Jul 25 13:21:49 2022] POST /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:22:00.570046 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-af97740c-305c-42cd-971f-fd4109ee221b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:00.570648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-af97740c-305c-42cd-971f-fd4109ee221b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:00.573470 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:22:00.574371 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:22:00.580503 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af97740c-305c-42cd-971f-fd4109ee221b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:00.581031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af97740c-305c-42cd-971f-fd4109ee221b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:00.581907 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af97740c-305c-42cd-971f-fd4109ee221b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:00.582417 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af97740c-305c-42cd-971f-fd4109ee221b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:00.672603 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-af97740c-305c-42cd-971f-fd4109ee221b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lazy-loading 'services' on Instance uuid 5a7f28c5-4e4a-45fa-882f-14c74a925718 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:22:00.747128 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-af97740c-305c-42cd-971f-fd4109ee221b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718/os-volume_attachments/5d307fdc-73cb-42f4-bf49-4058fd312665" status: 202 len: 0 microversion: 2.1 time: 0.181059 Jul 25 13:22:00.747734 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3002/6075] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Jul 25 13:22:00 2022] DELETE /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718/os-volume_attachments/5d307fdc-73cb-42f4-bf49-4058fd312665 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:22:00.754798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:22:00.756352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:22:00.761311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4014a48a-e38b-45f3-af08-7e9e09e9e1a1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:00.764029 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4014a48a-e38b-45f3-af08-7e9e09e9e1a1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:00.772009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4014a48a-e38b-45f3-af08-7e9e09e9e1a1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:00.772489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4014a48a-e38b-45f3-af08-7e9e09e9e1a1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:00.773305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4014a48a-e38b-45f3-af08-7e9e09e9e1a1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:00.773742 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4014a48a-e38b-45f3-af08-7e9e09e9e1a1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:00.820765 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4014a48a-e38b-45f3-af08-7e9e09e9e1a1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068342 Jul 25 13:22:00.821562 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3074/6076] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:22:00 2022] GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:22:01.835028 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-97b979a9-99f9-4f98-8e90-efd5bc173184 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:01.837526 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-97b979a9-99f9-4f98-8e90-efd5bc173184 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:01.845962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97b979a9-99f9-4f98-8e90-efd5bc173184 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:01.846675 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97b979a9-99f9-4f98-8e90-efd5bc173184 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:01.847645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97b979a9-99f9-4f98-8e90-efd5bc173184 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:01.848095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97b979a9-99f9-4f98-8e90-efd5bc173184 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:01.878876 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-97b979a9-99f9-4f98-8e90-efd5bc173184 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049393 Jul 25 13:22:01.879438 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3003/6077] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:22:01 2022] GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:22:02.892016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c9786ac9-3022-4815-bb4c-4840f408869f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:02.895348 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c9786ac9-3022-4815-bb4c-4840f408869f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:02.902908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c9786ac9-3022-4815-bb4c-4840f408869f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:02.903770 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c9786ac9-3022-4815-bb4c-4840f408869f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:02.904583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c9786ac9-3022-4815-bb4c-4840f408869f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:02.905011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c9786ac9-3022-4815-bb4c-4840f408869f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:02.937339 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c9786ac9-3022-4815-bb4c-4840f408869f tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049681 Jul 25 13:22:02.942094 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3075/6078] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:22:02 2022] GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:22:03.950240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-79253227-e3d6-4560-998e-59b3a3a218eb tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:03.952753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-79253227-e3d6-4560-998e-59b3a3a218eb tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:03.960228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79253227-e3d6-4560-998e-59b3a3a218eb tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:03.960790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79253227-e3d6-4560-998e-59b3a3a218eb tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:03.961574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79253227-e3d6-4560-998e-59b3a3a218eb tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:03.962191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79253227-e3d6-4560-998e-59b3a3a218eb tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:03.993209 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-79253227-e3d6-4560-998e-59b3a3a218eb tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046962 Jul 25 13:22:03.993758 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3004/6079] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:22:03 2022] GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:22:05.005215 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-68872e3a-5f26-4bab-94b6-f4fea98d05a9 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:05.007485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-68872e3a-5f26-4bab-94b6-f4fea98d05a9 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:05.014908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68872e3a-5f26-4bab-94b6-f4fea98d05a9 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:05.015431 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68872e3a-5f26-4bab-94b6-f4fea98d05a9 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:05.016196 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68872e3a-5f26-4bab-94b6-f4fea98d05a9 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:05.016630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-68872e3a-5f26-4bab-94b6-f4fea98d05a9 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:05.050042 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-68872e3a-5f26-4bab-94b6-f4fea98d05a9 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048801 Jul 25 13:22:05.050630 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3076/6080] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:22:04 2022] GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:22:06.064405 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e2c6ec24-3061-4cb0-aac4-9ba36a05c2d6 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:06.066710 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e2c6ec24-3061-4cb0-aac4-9ba36a05c2d6 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:06.076036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2c6ec24-3061-4cb0-aac4-9ba36a05c2d6 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:06.076815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2c6ec24-3061-4cb0-aac4-9ba36a05c2d6 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:06.077697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2c6ec24-3061-4cb0-aac4-9ba36a05c2d6 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:06.078220 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e2c6ec24-3061-4cb0-aac4-9ba36a05c2d6 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:06.112714 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e2c6ec24-3061-4cb0-aac4-9ba36a05c2d6 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053531 Jul 25 13:22:06.113287 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3005/6081] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:22:06 2022] GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 13:22:06.180316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-400fd2a2-8a27-4a61-ab36-2f3c6af250f7 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:06.180816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-400fd2a2-8a27-4a61-ab36-2f3c6af250f7 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:06.187941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-400fd2a2-8a27-4a61-ab36-2f3c6af250f7 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:06.188384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-400fd2a2-8a27-4a61-ab36-2f3c6af250f7 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:06.189151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-400fd2a2-8a27-4a61-ab36-2f3c6af250f7 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:06.189589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-400fd2a2-8a27-4a61-ab36-2f3c6af250f7 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:06.214919 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-400fd2a2-8a27-4a61-ab36-2f3c6af250f7 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:22:06.296470 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-400fd2a2-8a27-4a61-ab36-2f3c6af250f7 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718" status: 204 len: 0 microversion: 2.1 time: 0.119700 Jul 25 13:22:06.297082 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3077/6082] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:22:06 2022] DELETE /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:22:06.306112 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3ae0a3e8-c6f7-42b5-9bf3-402cadc7480d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:06.306764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3ae0a3e8-c6f7-42b5-9bf3-402cadc7480d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:06.313295 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3ae0a3e8-c6f7-42b5-9bf3-402cadc7480d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:06.313756 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3ae0a3e8-c6f7-42b5-9bf3-402cadc7480d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:06.314553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3ae0a3e8-c6f7-42b5-9bf3-402cadc7480d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:06.315008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3ae0a3e8-c6f7-42b5-9bf3-402cadc7480d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:06.463680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3ae0a3e8-c6f7-42b5-9bf3-402cadc7480d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:22:06.471881 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3ae0a3e8-c6f7-42b5-9bf3-402cadc7480d tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718" status: 200 len: 1683 microversion: 2.1 time: 0.169911 Jul 25 13:22:06.472461 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3006/6083] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:22:06 2022] GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:22:07.494932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-12892d37-0d0c-4875-b522-8028d07ca60c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:07.495782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-12892d37-0d0c-4875-b522-8028d07ca60c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:07.505143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-12892d37-0d0c-4875-b522-8028d07ca60c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:07.505598 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-12892d37-0d0c-4875-b522-8028d07ca60c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:07.506414 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-12892d37-0d0c-4875-b522-8028d07ca60c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:07.506846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-12892d37-0d0c-4875-b522-8028d07ca60c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:07.643061 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-12892d37-0d0c-4875-b522-8028d07ca60c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:22:07.650951 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-12892d37-0d0c-4875-b522-8028d07ca60c tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718" status: 200 len: 1683 microversion: 2.1 time: 0.160369 Jul 25 13:22:07.651564 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3078/6084] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:22:07 2022] GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:22:08.612589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-bd6b7d52-4400-44de-b3b3-ea4991ae11df req-19a0a62c-ce56-4cfe-b15b-f33e6d9bc053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a7f28c5-4e4a-45fa-882f-14c74a925718", "name": "network-vif-deleted", "tag": "b6795853-7506-4f09-a051-7a1bf8f56437"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:22:08.625968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-bd6b7d52-4400-44de-b3b3-ea4991ae11df req-19a0a62c-ce56-4cfe-b15b-f33e6d9bc053 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:08.626624 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-bd6b7d52-4400-44de-b3b3-ea4991ae11df req-19a0a62c-ce56-4cfe-b15b-f33e6d9bc053 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:08.640051 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-bd6b7d52-4400-44de-b3b3-ea4991ae11df req-19a0a62c-ce56-4cfe-b15b-f33e6d9bc053 service nova] Creating event network-vif-deleted:b6795853-7506-4f09-a051-7a1bf8f56437 for instance 5a7f28c5-4e4a-45fa-882f-14c74a925718 on n-h1-848886-15 Jul 25 13:22:08.647431 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-bd6b7d52-4400-44de-b3b3-ea4991ae11df req-19a0a62c-ce56-4cfe-b15b-f33e6d9bc053 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038033 Jul 25 13:22:08.648549 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3007/6085] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:22:08.672673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-651636b6-6d9b-49ed-8bf5-75b26df90de1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:08.673220 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-651636b6-6d9b-49ed-8bf5-75b26df90de1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:08.681954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-651636b6-6d9b-49ed-8bf5-75b26df90de1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:08.682411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-651636b6-6d9b-49ed-8bf5-75b26df90de1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:08.683197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-651636b6-6d9b-49ed-8bf5-75b26df90de1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:08.686791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-651636b6-6d9b-49ed-8bf5-75b26df90de1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:08.812893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-651636b6-6d9b-49ed-8bf5-75b26df90de1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3092b4bfef6f4d778d52e9de3cd1b785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805811c2762b477cae7cb16377e12dac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:22:08.823490 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-651636b6-6d9b-49ed-8bf5-75b26df90de1 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718" status: 200 len: 1326 microversion: 2.1 time: 0.155102 Jul 25 13:22:08.824085 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3079/6086] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:22:08 2022] GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718 => generated 1326 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:22:09.845694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-866c9c4e-0b7a-4190-8e92-adf23a670a77 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:09.846609 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-866c9c4e-0b7a-4190-8e92-adf23a670a77 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:09.857924 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-866c9c4e-0b7a-4190-8e92-adf23a670a77 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:09.858331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-866c9c4e-0b7a-4190-8e92-adf23a670a77 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:09.859213 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-866c9c4e-0b7a-4190-8e92-adf23a670a77 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:09.859663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-866c9c4e-0b7a-4190-8e92-adf23a670a77 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:09.874963 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-866c9c4e-0b7a-4190-8e92-adf23a670a77 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] HTTP exception thrown: Instance 5a7f28c5-4e4a-45fa-882f-14c74a925718 could not be found. Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-866c9c4e-0b7a-4190-8e92-adf23a670a77 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Request method failure captured: Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718 HTTP/1.1 Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pfvdELBqc9ktGA5Lf40UAQ78535PWLYdV07ICt2wdq2RGB8ieRYQg1pW--wMG6xplNKDuvq-CZoEGzYXFP5IvXxGjkhJA3p-eAzNDkDVUaa03y9emRX7H5OKq6_lJxEVfuNLo8utSx2bi7m4uQFvPZDAYfj7NiFWNJBHuf2bTAGGbI Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_805811c2762b477cae7cb16377e12dac", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/805811c2762b477cae7cb16377e12dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}] Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 3092b4bfef6f4d778d52e9de3cd1b785 Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 5a7f28c5-4e4a-45fa-882f-14c74a925718 could not be found. Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '5a7f28c5-4e4a-45fa-882f-14c74a925718'} Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a7f28c5-4e4a-45fa-882f-14c74a925718 could not be found. Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a7f28c5-4e4a-45fa-882f-14c74a925718 could not be found. Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:09.876711 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:09.881655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:09.881655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:09.881655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:09.881655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:22:09.881655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:22:09.881655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a7f28c5-4e4a-45fa-882f-14c74a925718 could not be found. Jul 25 13:22:09.881655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:09.881655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-866c9c4e-0b7a-4190-8e92-adf23a670a77 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Returning 404 to user: Instance 5a7f28c5-4e4a-45fa-882f-14c74a925718 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:22:09.881655 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-866c9c4e-0b7a-4190-8e92-adf23a670a77 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718" status: 404 len: 111 microversion: 2.1 time: 0.037586 Jul 25 13:22:09.882716 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3008/6087] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:22:09 2022] GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:22:09.887670 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-94298473-9f6d-44f1-9c22-e49628094673 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '.version_select at 0x7efcf88c9d30>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:09.917554 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-94298473-9f6d-44f1-9c22-e49628094673 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-213951383" status: 202 len: 0 microversion: 2.1 time: 0.033641 Jul 25 13:22:09.923252 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3080/6088] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Jul 25 13:22:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-213951383 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:22:13.873606 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-67d55ae6-a9bc-4c7b-bafe-579425ce91d8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-296372531", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "b4d4062e-5d57-4fc3-afd0-ae7710683909"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:22:13.933189 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-67d55ae6-a9bc-4c7b-bafe-579425ce91d8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] validate_networks() for [('b4d4062e-5d57-4fc3-afd0-ae7710683909', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:22:14.293578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-350b8414-b6e2-4dad-9d5c-34a8243e3831 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:14.294227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-350b8414-b6e2-4dad-9d5c-34a8243e3831 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:14.302368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-350b8414-b6e2-4dad-9d5c-34a8243e3831 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:14.303065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-350b8414-b6e2-4dad-9d5c-34a8243e3831 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:14.304064 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-350b8414-b6e2-4dad-9d5c-34a8243e3831 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:14.304720 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-350b8414-b6e2-4dad-9d5c-34a8243e3831 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:14.318644 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-350b8414-b6e2-4dad-9d5c-34a8243e3831 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] HTTP exception thrown: Instance 5a7f28c5-4e4a-45fa-882f-14c74a925718 could not be found. Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-350b8414-b6e2-4dad-9d5c-34a8243e3831 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Request method failure captured: Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718 HTTP/1.1 Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pfvdELBqc9ktGA5Lf40UAQ78535PWLYdV07ICt2wdq2RGB8ieRYQg1pW--wMG6xplNKDuvq-CZoEGzYXFP5IvXxGjkhJA3p-eAzNDkDVUaa03y9emRX7H5OKq6_lJxEVfuNLo8utSx2bi7m4uQFvPZDAYfj7NiFWNJBHuf2bTAGGbI Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_805811c2762b477cae7cb16377e12dac", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/805811c2762b477cae7cb16377e12dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}] Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 3092b4bfef6f4d778d52e9de3cd1b785 Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 5a7f28c5-4e4a-45fa-882f-14c74a925718 could not be found. Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '5a7f28c5-4e4a-45fa-882f-14c74a925718'} Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a7f28c5-4e4a-45fa-882f-14c74a925718 could not be found. Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:22:14.320678 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:22:14.327312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a7f28c5-4e4a-45fa-882f-14c74a925718 could not be found. Jul 25 13:22:14.327312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:14.327312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:14.327312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:14.327312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:14.327312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:14.327312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:14.327312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:22:14.327312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:22:14.327312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a7f28c5-4e4a-45fa-882f-14c74a925718 could not be found. Jul 25 13:22:14.327312 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:14.327312 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-350b8414-b6e2-4dad-9d5c-34a8243e3831 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Returning 404 to user: Instance 5a7f28c5-4e4a-45fa-882f-14c74a925718 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:22:14.327312 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-350b8414-b6e2-4dad-9d5c-34a8243e3831 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718" status: 404 len: 111 microversion: 2.1 time: 0.033360 Jul 25 13:22:14.327312 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3081/6089] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:22:14 2022] DELETE /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 13:22:14.332689 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5272383d-5d7a-47ab-bef8-11cf17ad0f5b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:14.333323 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5272383d-5d7a-47ab-bef8-11cf17ad0f5b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 5a7f28c5-4e4a-45fa-882f-14c74a925718] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:14.339578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5272383d-5d7a-47ab-bef8-11cf17ad0f5b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:14.340039 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5272383d-5d7a-47ab-bef8-11cf17ad0f5b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:14.340888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5272383d-5d7a-47ab-bef8-11cf17ad0f5b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:14.341326 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5272383d-5d7a-47ab-bef8-11cf17ad0f5b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:14.355887 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-5272383d-5d7a-47ab-bef8-11cf17ad0f5b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] HTTP exception thrown: Instance 5a7f28c5-4e4a-45fa-882f-14c74a925718 could not be found. Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5272383d-5d7a-47ab-bef8-11cf17ad0f5b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Request method failure captured: Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718 HTTP/1.1 Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pfvdELBqc9ktGA5Lf40UAQ78535PWLYdV07ICt2wdq2RGB8ieRYQg1pW--wMG6xplNKDuvq-CZoEGzYXFP5IvXxGjkhJA3p-eAzNDkDVUaa03y9emRX7H5OKq6_lJxEVfuNLo8utSx2bi7m4uQFvPZDAYfj7NiFWNJBHuf2bTAGGbI Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_805811c2762b477cae7cb16377e12dac", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/805811c2762b477cae7cb16377e12dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}] Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 3092b4bfef6f4d778d52e9de3cd1b785 Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 5a7f28c5-4e4a-45fa-882f-14c74a925718 could not be found. Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '5a7f28c5-4e4a-45fa-882f-14c74a925718'} Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a7f28c5-4e4a-45fa-882f-14c74a925718 could not be found. Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a7f28c5-4e4a-45fa-882f-14c74a925718 could not be found. Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:14.357434 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:14.361931 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:14.361931 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:14.361931 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:14.361931 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:22:14.361931 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:22:14.361931 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a7f28c5-4e4a-45fa-882f-14c74a925718 could not be found. Jul 25 13:22:14.361931 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:14.361931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5272383d-5d7a-47ab-bef8-11cf17ad0f5b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Returning 404 to user: Instance 5a7f28c5-4e4a-45fa-882f-14c74a925718 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:22:14.361931 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5272383d-5d7a-47ab-bef8-11cf17ad0f5b tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718" status: 404 len: 111 microversion: 2.1 time: 0.030483 Jul 25 13:22:14.361931 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3082/6090] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:22:14 2022] GET /compute/v2.1/servers/5a7f28c5-4e4a-45fa-882f-14c74a925718 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:22:14.363010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-67d55ae6-a9bc-4c7b-bafe-579425ce91d8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:22:14.363010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-67d55ae6-a9bc-4c7b-bafe-579425ce91d8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:22:14.363010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-67d55ae6-a9bc-4c7b-bafe-579425ce91d8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:22:14.363010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-67d55ae6-a9bc-4c7b-bafe-579425ce91d8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:22:14.363010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-67d55ae6-a9bc-4c7b-bafe-579425ce91d8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:22:14.371760 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-67d55ae6-a9bc-4c7b-bafe-579425ce91d8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:14.372228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-67d55ae6-a9bc-4c7b-bafe-579425ce91d8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:14.373057 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-67d55ae6-a9bc-4c7b-bafe-579425ce91d8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:14.373502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-67d55ae6-a9bc-4c7b-bafe-579425ce91d8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:14.390794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-67d55ae6-a9bc-4c7b-bafe-579425ce91d8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Getting quotas for project e86a8c695cab4893b0ffd6054e5a0599. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:22:14.396229 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-67d55ae6-a9bc-4c7b-bafe-579425ce91d8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Getting quotas for user b8a63907b2654b91bc22eff4e0f5cd9d and project e86a8c695cab4893b0ffd6054e5a0599. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:22:14.412271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-67d55ae6-a9bc-4c7b-bafe-579425ce91d8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:22:14.415339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-67d55ae6-a9bc-4c7b-bafe-579425ce91d8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 70d6a555-5340-415e-ad2d-375389249937] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:22:14.479688 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-67d55ae6-a9bc-4c7b-bafe-579425ce91d8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608349 Jul 25 13:22:14.480934 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3009/6091] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:22:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:22:14.492339 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-06bb8421-2f60-4044-8d1e-dfa8b958b5f1 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:14.493092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-06bb8421-2f60-4044-8d1e-dfa8b958b5f1 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 70d6a555-5340-415e-ad2d-375389249937] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:14.550482 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-06bb8421-2f60-4044-8d1e-dfa8b958b5f1 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:22:14.557691 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-06bb8421-2f60-4044-8d1e-dfa8b958b5f1 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937" status: 200 len: 1218 microversion: 2.1 time: 0.069658 Jul 25 13:22:14.558290 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3083/6092] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:22:14 2022] GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:22:15.579275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-455f3f20-229e-4965-bf45-b85bcd7259a7 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:15.579882 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-455f3f20-229e-4965-bf45-b85bcd7259a7 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 70d6a555-5340-415e-ad2d-375389249937] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:15.640038 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-455f3f20-229e-4965-bf45-b85bcd7259a7 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:22:15.647316 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-455f3f20-229e-4965-bf45-b85bcd7259a7 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937" status: 200 len: 1218 microversion: 2.1 time: 0.072698 Jul 25 13:22:15.647987 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3010/6093] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:22:15 2022] GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:22:16.672773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8d9e0b4f-ac7d-448f-acce-0302b6518064 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:16.674578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8d9e0b4f-ac7d-448f-acce-0302b6518064 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 70d6a555-5340-415e-ad2d-375389249937] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:16.732614 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8d9e0b4f-ac7d-448f-acce-0302b6518064 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:22:16.739823 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8d9e0b4f-ac7d-448f-acce-0302b6518064 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937" status: 200 len: 1218 microversion: 2.1 time: 0.074067 Jul 25 13:22:16.740392 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3084/6094] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:22:16 2022] GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:22:17.622312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e21e9cd5-1060-4735-8cd0-d428899a4279 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:17.622841 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e21e9cd5-1060-4735-8cd0-d428899a4279 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:17.630408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e21e9cd5-1060-4735-8cd0-d428899a4279 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:17.630962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e21e9cd5-1060-4735-8cd0-d428899a4279 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:17.631832 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e21e9cd5-1060-4735-8cd0-d428899a4279 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:17.632388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e21e9cd5-1060-4735-8cd0-d428899a4279 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:17.646816 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-e21e9cd5-1060-4735-8cd0-d428899a4279 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] HTTP exception thrown: Instance 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 could not be found. Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e21e9cd5-1060-4735-8cd0-d428899a4279 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Request method failure captured: Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019 HTTP/1.1 Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pfvdELBqc9ktGA5Lf40UAQ78535PWLYdV07ICt2wdq2RGB8ieRYQg1pW--wMG6xplNKDuvq-CZoEGzYXFP5IvXxGjkhJA3p-eAzNDkDVUaa03y9emRX7H5OKq6_lJxEVfuNLo8utSx2bi7m4uQFvPZDAYfj7NiFWNJBHuf2bTAGGbI Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_805811c2762b477cae7cb16377e12dac", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/805811c2762b477cae7cb16377e12dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}] Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 3092b4bfef6f4d778d52e9de3cd1b785 Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 could not be found. Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '7de1f2c9-f6e9-438a-bf35-4f1783c6b019'} Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 could not be found. Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:22:17.648553 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:22:17.652794 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 could not be found. Jul 25 13:22:17.652794 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:17.652794 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:17.652794 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:17.652794 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:17.652794 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:17.652794 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:17.652794 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:22:17.652794 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:22:17.652794 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 could not be found. Jul 25 13:22:17.652794 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:17.652794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e21e9cd5-1060-4735-8cd0-d428899a4279 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Returning 404 to user: Instance 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:22:17.652794 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e21e9cd5-1060-4735-8cd0-d428899a4279 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019" status: 404 len: 111 microversion: 2.1 time: 0.032168 Jul 25 13:22:17.652794 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3011/6095] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:22:17 2022] DELETE /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:22:17.659299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5cb20a62-a764-46e5-ba5b-f7a8ef9ad1e9 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:17.659925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5cb20a62-a764-46e5-ba5b-f7a8ef9ad1e9 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 7de1f2c9-f6e9-438a-bf35-4f1783c6b019] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:17.666856 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5cb20a62-a764-46e5-ba5b-f7a8ef9ad1e9 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:17.667311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5cb20a62-a764-46e5-ba5b-f7a8ef9ad1e9 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:17.668092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5cb20a62-a764-46e5-ba5b-f7a8ef9ad1e9 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:17.668530 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5cb20a62-a764-46e5-ba5b-f7a8ef9ad1e9 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:17.686653 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-5cb20a62-a764-46e5-ba5b-f7a8ef9ad1e9 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] HTTP exception thrown: Instance 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 could not be found. Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5cb20a62-a764-46e5-ba5b-f7a8ef9ad1e9 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Request method failure captured: Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019 HTTP/1.1 Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pfvdELBqc9ktGA5Lf40UAQ78535PWLYdV07ICt2wdq2RGB8ieRYQg1pW--wMG6xplNKDuvq-CZoEGzYXFP5IvXxGjkhJA3p-eAzNDkDVUaa03y9emRX7H5OKq6_lJxEVfuNLo8utSx2bi7m4uQFvPZDAYfj7NiFWNJBHuf2bTAGGbI Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_805811c2762b477cae7cb16377e12dac", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/805811c2762b477cae7cb16377e12dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}] Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 3092b4bfef6f4d778d52e9de3cd1b785 Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 could not be found. Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '7de1f2c9-f6e9-438a-bf35-4f1783c6b019'} Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 could not be found. Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 could not be found. Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:17.688231 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:17.692935 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:17.692935 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:17.692935 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:17.692935 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:22:17.692935 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:22:17.692935 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 could not be found. Jul 25 13:22:17.692935 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:17.692935 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5cb20a62-a764-46e5-ba5b-f7a8ef9ad1e9 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Returning 404 to user: Instance 7de1f2c9-f6e9-438a-bf35-4f1783c6b019 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:22:17.692935 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5cb20a62-a764-46e5-ba5b-f7a8ef9ad1e9 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019" status: 404 len: 111 microversion: 2.1 time: 0.034548 Jul 25 13:22:17.692935 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3085/6096] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:22:17 2022] GET /compute/v2.1/servers/7de1f2c9-f6e9-438a-bf35-4f1783c6b019 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:22:17.698689 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fc29fbc7-127d-4991-8a9f-619bb0942bdc tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:17.699207 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fc29fbc7-127d-4991-8a9f-619bb0942bdc tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: f55e8c47-349f-430a-890e-6dfaeb6155b4] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:17.705490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fc29fbc7-127d-4991-8a9f-619bb0942bdc tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:17.705997 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fc29fbc7-127d-4991-8a9f-619bb0942bdc tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:17.706796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fc29fbc7-127d-4991-8a9f-619bb0942bdc tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:17.707247 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fc29fbc7-127d-4991-8a9f-619bb0942bdc tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:17.721580 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-fc29fbc7-127d-4991-8a9f-619bb0942bdc tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] HTTP exception thrown: Instance f55e8c47-349f-430a-890e-6dfaeb6155b4 could not be found. Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fc29fbc7-127d-4991-8a9f-619bb0942bdc tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Request method failure captured: Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4 HTTP/1.1 Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pfvdELBqc9ktGA5Lf40UAQ78535PWLYdV07ICt2wdq2RGB8ieRYQg1pW--wMG6xplNKDuvq-CZoEGzYXFP5IvXxGjkhJA3p-eAzNDkDVUaa03y9emRX7H5OKq6_lJxEVfuNLo8utSx2bi7m4uQFvPZDAYfj7NiFWNJBHuf2bTAGGbI Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_805811c2762b477cae7cb16377e12dac", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/805811c2762b477cae7cb16377e12dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}] Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 3092b4bfef6f4d778d52e9de3cd1b785 Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance f55e8c47-349f-430a-890e-6dfaeb6155b4 could not be found. Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'f55e8c47-349f-430a-890e-6dfaeb6155b4'} Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f55e8c47-349f-430a-890e-6dfaeb6155b4 could not be found. Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:22:17.723227 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:22:17.728597 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f55e8c47-349f-430a-890e-6dfaeb6155b4 could not be found. Jul 25 13:22:17.728597 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:17.728597 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:17.728597 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:17.728597 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:17.728597 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:17.728597 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:17.728597 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:22:17.728597 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:22:17.728597 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f55e8c47-349f-430a-890e-6dfaeb6155b4 could not be found. Jul 25 13:22:17.728597 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:17.728597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fc29fbc7-127d-4991-8a9f-619bb0942bdc tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Returning 404 to user: Instance f55e8c47-349f-430a-890e-6dfaeb6155b4 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:22:17.728597 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fc29fbc7-127d-4991-8a9f-619bb0942bdc tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4" status: 404 len: 111 microversion: 2.1 time: 0.030055 Jul 25 13:22:17.728597 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3012/6097] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:22:17 2022] DELETE /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:22:17.735675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a1aaf9b8-96c4-4726-913c-2a93be7abd76 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:17.736297 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a1aaf9b8-96c4-4726-913c-2a93be7abd76 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: f55e8c47-349f-430a-890e-6dfaeb6155b4] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:17.743134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1aaf9b8-96c4-4726-913c-2a93be7abd76 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:17.743574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1aaf9b8-96c4-4726-913c-2a93be7abd76 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:17.744398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1aaf9b8-96c4-4726-913c-2a93be7abd76 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:17.744906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1aaf9b8-96c4-4726-913c-2a93be7abd76 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:17.761262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b3d1b6a4-c1e5-479c-8c40-62fdfbecaba9 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:17.761535 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-a1aaf9b8-96c4-4726-913c-2a93be7abd76 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] HTTP exception thrown: Instance f55e8c47-349f-430a-890e-6dfaeb6155b4 could not be found. Jul 25 13:22:17.763215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b3d1b6a4-c1e5-479c-8c40-62fdfbecaba9 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 70d6a555-5340-415e-ad2d-375389249937] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a1aaf9b8-96c4-4726-913c-2a93be7abd76 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Request method failure captured: Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4 HTTP/1.1 Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pfvdELBqc9ktGA5Lf40UAQ78535PWLYdV07ICt2wdq2RGB8ieRYQg1pW--wMG6xplNKDuvq-CZoEGzYXFP5IvXxGjkhJA3p-eAzNDkDVUaa03y9emRX7H5OKq6_lJxEVfuNLo8utSx2bi7m4uQFvPZDAYfj7NiFWNJBHuf2bTAGGbI Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_805811c2762b477cae7cb16377e12dac", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/805811c2762b477cae7cb16377e12dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}] Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 3092b4bfef6f4d778d52e9de3cd1b785 Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance f55e8c47-349f-430a-890e-6dfaeb6155b4 could not be found. Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'f55e8c47-349f-430a-890e-6dfaeb6155b4'} Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f55e8c47-349f-430a-890e-6dfaeb6155b4 could not be found. Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f55e8c47-349f-430a-890e-6dfaeb6155b4 could not be found. Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:17.763378 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:17.769988 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:17.769988 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:17.769988 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:17.769988 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:22:17.769988 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:22:17.769988 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f55e8c47-349f-430a-890e-6dfaeb6155b4 could not be found. Jul 25 13:22:17.769988 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:17.769988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a1aaf9b8-96c4-4726-913c-2a93be7abd76 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Returning 404 to user: Instance f55e8c47-349f-430a-890e-6dfaeb6155b4 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:22:17.769988 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a1aaf9b8-96c4-4726-913c-2a93be7abd76 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4" status: 404 len: 111 microversion: 2.1 time: 0.033155 Jul 25 13:22:17.769988 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3086/6098] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:22:17 2022] GET /compute/v2.1/servers/f55e8c47-349f-430a-890e-6dfaeb6155b4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:22:17.846696 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b3d1b6a4-c1e5-479c-8c40-62fdfbecaba9 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:22:17.854144 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b3d1b6a4-c1e5-479c-8c40-62fdfbecaba9 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937" status: 200 len: 1218 microversion: 2.1 time: 0.096977 Jul 25 13:22:17.856477 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3013/6099] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:22:17 2022] GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:22:18.876644 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a5749423-334e-4c1f-b93f-38b81f24e174 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:18.877306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a5749423-334e-4c1f-b93f-38b81f24e174 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 70d6a555-5340-415e-ad2d-375389249937] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:18.884901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5749423-334e-4c1f-b93f-38b81f24e174 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:18.885354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5749423-334e-4c1f-b93f-38b81f24e174 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:18.886162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5749423-334e-4c1f-b93f-38b81f24e174 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:18.886602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5749423-334e-4c1f-b93f-38b81f24e174 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:18.949015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a5749423-334e-4c1f-b93f-38b81f24e174 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:22:18.957080 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a5749423-334e-4c1f-b93f-38b81f24e174 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937" status: 200 len: 1222 microversion: 2.1 time: 0.084357 Jul 25 13:22:18.961998 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3087/6100] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:22:18 2022] GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:22:19.984517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-654323fb-9bc1-4eab-aad8-e0284b5738ff tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:19.991322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-654323fb-9bc1-4eab-aad8-e0284b5738ff tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 70d6a555-5340-415e-ad2d-375389249937] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:20.015908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-654323fb-9bc1-4eab-aad8-e0284b5738ff tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:20.017225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-654323fb-9bc1-4eab-aad8-e0284b5738ff tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:20.018250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-654323fb-9bc1-4eab-aad8-e0284b5738ff tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:20.019296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-654323fb-9bc1-4eab-aad8-e0284b5738ff tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:20.104767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-654323fb-9bc1-4eab-aad8-e0284b5738ff tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:22:20.113395 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-654323fb-9bc1-4eab-aad8-e0284b5738ff tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937" status: 200 len: 1276 microversion: 2.1 time: 0.139066 Jul 25 13:22:20.114648 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3014/6101] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:22:19 2022] GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:22:20.938456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-34623c5c-6b4b-46c2-bf0b-86c675464fcf req-28cb1d86-f0e4-4fce-937d-d3aefed3036d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70d6a555-5340-415e-ad2d-375389249937", "tag": "73b1e610-8a0d-4ace-a939-64bd96e2c7e9"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:22:20.952669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-34623c5c-6b4b-46c2-bf0b-86c675464fcf req-28cb1d86-f0e4-4fce-937d-d3aefed3036d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:20.953265 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-34623c5c-6b4b-46c2-bf0b-86c675464fcf req-28cb1d86-f0e4-4fce-937d-d3aefed3036d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:20.966945 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-34623c5c-6b4b-46c2-bf0b-86c675464fcf req-28cb1d86-f0e4-4fce-937d-d3aefed3036d service nova] Creating event network-changed:73b1e610-8a0d-4ace-a939-64bd96e2c7e9 for instance 70d6a555-5340-415e-ad2d-375389249937 on n-h2-848886-15 Jul 25 13:22:20.974243 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-34623c5c-6b4b-46c2-bf0b-86c675464fcf req-28cb1d86-f0e4-4fce-937d-d3aefed3036d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039982 Jul 25 13:22:20.975019 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3088/6102] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:22:21.098468 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3a228274-26f4-4867-a966-88b57a241717 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:21.099188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3a228274-26f4-4867-a966-88b57a241717 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:21.106572 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a228274-26f4-4867-a966-88b57a241717 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:21.107116 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a228274-26f4-4867-a966-88b57a241717 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:21.107982 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a228274-26f4-4867-a966-88b57a241717 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:21.108435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a228274-26f4-4867-a966-88b57a241717 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:21.123700 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-3a228274-26f4-4867-a966-88b57a241717 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] HTTP exception thrown: Instance 4492f180-6de9-4618-9d5f-28ca90f6db3e could not be found. Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3a228274-26f4-4867-a966-88b57a241717 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Request method failure captured: Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e HTTP/1.1 Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pfvdELBqc9ktGA5Lf40UAQ78535PWLYdV07ICt2wdq2RGB8ieRYQg1pW--wMG6xplNKDuvq-CZoEGzYXFP5IvXxGjkhJA3p-eAzNDkDVUaa03y9emRX7H5OKq6_lJxEVfuNLo8utSx2bi7m4uQFvPZDAYfj7NiFWNJBHuf2bTAGGbI Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_805811c2762b477cae7cb16377e12dac", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/805811c2762b477cae7cb16377e12dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}] Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 3092b4bfef6f4d778d52e9de3cd1b785 Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 4492f180-6de9-4618-9d5f-28ca90f6db3e could not be found. Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '4492f180-6de9-4618-9d5f-28ca90f6db3e'} Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4492f180-6de9-4618-9d5f-28ca90f6db3e could not be found. Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:22:21.125590 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:22:21.130086 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4492f180-6de9-4618-9d5f-28ca90f6db3e could not be found. Jul 25 13:22:21.130086 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:21.130086 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:21.130086 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:21.130086 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:21.130086 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:21.130086 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:21.130086 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:22:21.130086 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:22:21.130086 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4492f180-6de9-4618-9d5f-28ca90f6db3e could not be found. Jul 25 13:22:21.130086 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:21.131911 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3a228274-26f4-4867-a966-88b57a241717 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Returning 404 to user: Instance 4492f180-6de9-4618-9d5f-28ca90f6db3e could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:22:21.132964 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3a228274-26f4-4867-a966-88b57a241717 tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e" status: 404 len: 111 microversion: 2.1 time: 0.038770 Jul 25 13:22:21.134082 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3015/6103] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:22:21 2022] DELETE /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:22:21.140303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2ded3dd3-db15-449d-8751-1ed28462fbe4 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:21.140984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2ded3dd3-db15-449d-8751-1ed28462fbe4 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 70d6a555-5340-415e-ad2d-375389249937] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:21.147165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-33d138e5-28be-4b5c-88f5-f301569c46ea tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:21.147798 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-33d138e5-28be-4b5c-88f5-f301569c46ea tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] [instance: 4492f180-6de9-4618-9d5f-28ca90f6db3e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:21.148754 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ded3dd3-db15-449d-8751-1ed28462fbe4 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:21.149401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ded3dd3-db15-449d-8751-1ed28462fbe4 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:21.150490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ded3dd3-db15-449d-8751-1ed28462fbe4 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:21.151088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2ded3dd3-db15-449d-8751-1ed28462fbe4 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:21.154172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-33d138e5-28be-4b5c-88f5-f301569c46ea tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:21.154640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-33d138e5-28be-4b5c-88f5-f301569c46ea tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:21.155480 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-33d138e5-28be-4b5c-88f5-f301569c46ea tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:21.155932 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-33d138e5-28be-4b5c-88f5-f301569c46ea tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:21.170487 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-33d138e5-28be-4b5c-88f5-f301569c46ea tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] HTTP exception thrown: Instance 4492f180-6de9-4618-9d5f-28ca90f6db3e could not be found. Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-33d138e5-28be-4b5c-88f5-f301569c46ea tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Request method failure captured: Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e HTTP/1.1 Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pfvdELBqc9ktGA5Lf40UAQ78535PWLYdV07ICt2wdq2RGB8ieRYQg1pW--wMG6xplNKDuvq-CZoEGzYXFP5IvXxGjkhJA3p-eAzNDkDVUaa03y9emRX7H5OKq6_lJxEVfuNLo8utSx2bi7m4uQFvPZDAYfj7NiFWNJBHuf2bTAGGbI Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_805811c2762b477cae7cb16377e12dac", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/805811c2762b477cae7cb16377e12dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/805811c2762b477cae7cb16377e12dac"}]}] Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 805811c2762b477cae7cb16377e12dac Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2116056753 Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 3092b4bfef6f4d778d52e9de3cd1b785 Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-AttachVolumeNegativeTest-2116056753-project Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 4492f180-6de9-4618-9d5f-28ca90f6db3e could not be found. Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '4492f180-6de9-4618-9d5f-28ca90f6db3e'} Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4492f180-6de9-4618-9d5f-28ca90f6db3e could not be found. Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4492f180-6de9-4618-9d5f-28ca90f6db3e could not be found. Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:21.172087 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:21.180203 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:21.180203 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:21.180203 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:21.180203 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:22:21.180203 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:22:21.180203 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4492f180-6de9-4618-9d5f-28ca90f6db3e could not be found. Jul 25 13:22:21.180203 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:21.180203 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-33d138e5-28be-4b5c-88f5-f301569c46ea tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] Returning 404 to user: Instance 4492f180-6de9-4618-9d5f-28ca90f6db3e could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:22:21.180203 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-33d138e5-28be-4b5c-88f5-f301569c46ea tempest-AttachVolumeNegativeTest-2116056753 tempest-AttachVolumeNegativeTest-2116056753-project] 10.222.0.49 "GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e" status: 404 len: 111 microversion: 2.1 time: 0.031734 Jul 25 13:22:21.180203 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3016/6104] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:22:21 2022] GET /compute/v2.1/servers/4492f180-6de9-4618-9d5f-28ca90f6db3e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:22:21.416457 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2ded3dd3-db15-449d-8751-1ed28462fbe4 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:22:21.430615 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2ded3dd3-db15-449d-8751-1ed28462fbe4 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937" status: 200 len: 1318 microversion: 2.1 time: 0.297711 Jul 25 13:22:21.442956 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3089/6105] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:22:21 2022] GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:22:22.453689 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-36989750-6da1-4c3f-adf1-08886f43f10d tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:22.454529 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-36989750-6da1-4c3f-adf1-08886f43f10d tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 70d6a555-5340-415e-ad2d-375389249937] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:22.461412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36989750-6da1-4c3f-adf1-08886f43f10d tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:22.461988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36989750-6da1-4c3f-adf1-08886f43f10d tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:22.462977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36989750-6da1-4c3f-adf1-08886f43f10d tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:22.463436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36989750-6da1-4c3f-adf1-08886f43f10d tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:22.718628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-36989750-6da1-4c3f-adf1-08886f43f10d tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:22:22.731640 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-36989750-6da1-4c3f-adf1-08886f43f10d tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937" status: 200 len: 1318 microversion: 2.1 time: 0.282805 Jul 25 13:22:22.746005 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3017/6106] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:22:22 2022] GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:22:23.753960 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b5271493-583b-4434-8a46-0da57f3982fa tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:23.754591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b5271493-583b-4434-8a46-0da57f3982fa tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 70d6a555-5340-415e-ad2d-375389249937] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:23.761755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5271493-583b-4434-8a46-0da57f3982fa tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:23.762233 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5271493-583b-4434-8a46-0da57f3982fa tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:23.763002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5271493-583b-4434-8a46-0da57f3982fa tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:23.763433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5271493-583b-4434-8a46-0da57f3982fa tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:23.963901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b5271493-583b-4434-8a46-0da57f3982fa tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:22:23.978023 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b5271493-583b-4434-8a46-0da57f3982fa tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937" status: 200 len: 1318 microversion: 2.1 time: 0.227355 Jul 25 13:22:23.979826 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3090/6107] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:22:23 2022] GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:22:25.001003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7459c54f-cff0-4289-88fd-ffa3f2dabb20 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:25.001686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7459c54f-cff0-4289-88fd-ffa3f2dabb20 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 70d6a555-5340-415e-ad2d-375389249937] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:25.004627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:22:25.010365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7459c54f-cff0-4289-88fd-ffa3f2dabb20 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:25.010826 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7459c54f-cff0-4289-88fd-ffa3f2dabb20 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:25.011573 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7459c54f-cff0-4289-88fd-ffa3f2dabb20 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:25.012080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7459c54f-cff0-4289-88fd-ffa3f2dabb20 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:25.164334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7459c54f-cff0-4289-88fd-ffa3f2dabb20 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:22:25.172995 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7459c54f-cff0-4289-88fd-ffa3f2dabb20 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937" status: 200 len: 1318 microversion: 2.1 time: 0.175782 Jul 25 13:22:25.173518 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3018/6108] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:22:24 2022] GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:22:25.556167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-32e2407c-334d-477e-830e-7dee2a2fc570 tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] Action: 'create', calling method: .version_select at 0x7efcf888bca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-655459612", "metadata": {"Type": "work"}}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-32e2407c-334d-477e-830e-7dee2a2fc570 tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] Request method failure captured: Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 121 Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pkRx5ijn2BnU146HdrCerMs6TMzwWa7p3MI9x3-6jPuCTPPlkCloSP905dlby5AtO8w8J1SVaXHzvxwNLqVAbJtDujMYOBjgpNfNnaTzbXkPir5FsrwGu3JpSWES7Jp2DhH0kRSP8WVG85XstAHIHKIm1PpZGokRh7hwJHbl45lTL4 Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: fd3d4f0b4d644ec09657eb521564378f Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-VolumesNegativeTest-621795966 Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd3d4f0b4d644ec09657eb521564378f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd3d4f0b4d644ec09657eb521564378f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd3d4f0b4d644ec09657eb521564378f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd3d4f0b4d644ec09657eb521564378f"}]}] Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-VolumesNegativeTest-621795966 Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: fd3d4f0b4d644ec09657eb521564378f Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-VolumesNegativeTest-621795966 Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-VolumesNegativeTest-621795966-project Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 09c390dc47664d82b747e3397638fc1f Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-VolumesNegativeTest-621795966-project Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-655459612", "metadata": {"Type": "work"}}} Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-655459612', 'metadata': {'Type': 'work'}}}} Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise error Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi '#$%' Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 13:22:25.562267 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 13:22:25.567204 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 13:22:25.567204 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.567204 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:25.567204 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.567204 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:25.567204 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:25.567204 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:25.567204 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 13:22:25.567204 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 13:22:25.567204 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 13:22:25.567204 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.567204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-32e2407c-334d-477e-830e-7dee2a2fc570 tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:22:25.567204 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-32e2407c-334d-477e-830e-7dee2a2fc570 tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.148649 Jul 25 13:22:25.567204 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3091/6109] 10.222.0.49 () {60 vars in 1156 bytes} [Mon Jul 25 13:22:25 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:22:25.573435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-eada9d84-2d2e-4f53-a14e-8c915f9a157a tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] Action: 'create', calling method: .version_select at 0x7efcf83b1790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-130659636", "metadata": {"Type": "work"}}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-eada9d84-2d2e-4f53-a14e-8c915f9a157a tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] Request method failure captured: Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 119 Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pkRx5ijn2BnU146HdrCerMs6TMzwWa7p3MI9x3-6jPuCTPPlkCloSP905dlby5AtO8w8J1SVaXHzvxwNLqVAbJtDujMYOBjgpNfNnaTzbXkPir5FsrwGu3JpSWES7Jp2DhH0kRSP8WVG85XstAHIHKIm1PpZGokRh7hwJHbl45lTL4 Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: fd3d4f0b4d644ec09657eb521564378f Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-VolumesNegativeTest-621795966 Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd3d4f0b4d644ec09657eb521564378f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd3d4f0b4d644ec09657eb521564378f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd3d4f0b4d644ec09657eb521564378f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd3d4f0b4d644ec09657eb521564378f"}]}] Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-VolumesNegativeTest-621795966 Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: fd3d4f0b4d644ec09657eb521564378f Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-VolumesNegativeTest-621795966 Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-VolumesNegativeTest-621795966-project Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 09c390dc47664d82b747e3397638fc1f Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-VolumesNegativeTest-621795966-project Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-130659636", "metadata": {"Type": "work"}}} Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-130659636', 'metadata': {'Type': 'work'}}}} Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise error Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi '0' Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 13:22:25.577258 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 13:22:25.582116 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 13:22:25.582116 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.582116 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:25.582116 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.582116 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:25.582116 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:25.582116 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:25.582116 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 13:22:25.582116 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 13:22:25.582116 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 13:22:25.582116 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.582116 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-eada9d84-2d2e-4f53-a14e-8c915f9a157a tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:22:25.582116 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-eada9d84-2d2e-4f53-a14e-8c915f9a157a tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009157 Jul 25 13:22:25.582116 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3019/6110] 10.222.0.49 () {60 vars in 1156 bytes} [Mon Jul 25 13:22:25 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:22:25.588143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-acdd5110-0ce1-4630-9ee0-61c2e987557a tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] Action: 'create', calling method: .version_select at 0x7efcf88c98b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-350502820", "metadata": {"Type": "work"}}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-acdd5110-0ce1-4630-9ee0-61c2e987557a tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] Request method failure captured: Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 118 Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pkRx5ijn2BnU146HdrCerMs6TMzwWa7p3MI9x3-6jPuCTPPlkCloSP905dlby5AtO8w8J1SVaXHzvxwNLqVAbJtDujMYOBjgpNfNnaTzbXkPir5FsrwGu3JpSWES7Jp2DhH0kRSP8WVG85XstAHIHKIm1PpZGokRh7hwJHbl45lTL4 Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: fd3d4f0b4d644ec09657eb521564378f Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-VolumesNegativeTest-621795966 Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd3d4f0b4d644ec09657eb521564378f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd3d4f0b4d644ec09657eb521564378f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd3d4f0b4d644ec09657eb521564378f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd3d4f0b4d644ec09657eb521564378f"}]}] Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-VolumesNegativeTest-621795966 Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: fd3d4f0b4d644ec09657eb521564378f Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-VolumesNegativeTest-621795966 Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-VolumesNegativeTest-621795966-project Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 09c390dc47664d82b747e3397638fc1f Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-VolumesNegativeTest-621795966-project Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-350502820", "metadata": {"Type": "work"}}} Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-350502820', 'metadata': {'Type': 'work'}}}} Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise error Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi '' Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 13:22:25.592739 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 13:22:25.599011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 13:22:25.599011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.599011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:25.599011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.599011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:25.599011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:25.599011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:25.599011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 13:22:25.599011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 13:22:25.599011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 13:22:25.599011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.599011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-acdd5110-0ce1-4630-9ee0-61c2e987557a tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:22:25.599011 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-acdd5110-0ce1-4630-9ee0-61c2e987557a tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011022 Jul 25 13:22:25.599011 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3092/6111] 10.222.0.49 () {60 vars in 1156 bytes} [Mon Jul 25 13:22:25 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 13:22:25.611903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d17fa2fe-2301-499f-8bc2-7f60e70db093 tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] Calling method '.version_select at 0x7efcf85ae310>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:25.647636 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-d17fa2fe-2301-499f-8bc2-7f60e70db093 tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] HTTP exception thrown: Volume tempest-invalid-822321288 could not be found. Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d17fa2fe-2301-499f-8bc2-7f60e70db093 tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] Request method failure captured: Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-822321288 HTTP/1.1 Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pkRx5ijn2BnU146HdrCerMs6TMzwWa7p3MI9x3-6jPuCTPPlkCloSP905dlby5AtO8w8J1SVaXHzvxwNLqVAbJtDujMYOBjgpNfNnaTzbXkPir5FsrwGu3JpSWES7Jp2DhH0kRSP8WVG85XstAHIHKIm1PpZGokRh7hwJHbl45lTL4 Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: fd3d4f0b4d644ec09657eb521564378f Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-VolumesNegativeTest-621795966 Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd3d4f0b4d644ec09657eb521564378f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd3d4f0b4d644ec09657eb521564378f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd3d4f0b4d644ec09657eb521564378f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd3d4f0b4d644ec09657eb521564378f"}]}] Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-VolumesNegativeTest-621795966 Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: fd3d4f0b4d644ec09657eb521564378f Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-VolumesNegativeTest-621795966 Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-VolumesNegativeTest-621795966-project Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 09c390dc47664d82b747e3397638fc1f Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-VolumesNegativeTest-621795966-project Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: exception: Volume tempest-invalid-822321288 could not be found. Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'tempest-invalid-822321288'} Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-822321288 could not be found. (HTTP 404) (Request-ID: req-fce46767-d3a5-4e37-8cfc-8185d2d5046e) Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 13:22:25.650615 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-822321288 could not be found. Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-822321288 could not be found. Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-822321288 could not be found. Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d17fa2fe-2301-499f-8bc2-7f60e70db093 tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] Returning 404 to user: Volume tempest-invalid-822321288 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d17fa2fe-2301-499f-8bc2-7f60e70db093 tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-822321288" status: 404 len: 98 microversion: 2.1 time: 0.048028 Jul 25 13:22:25.654889 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3020/6112] 10.222.0.49 () {58 vars in 1215 bytes} [Mon Jul 25 13:22:25 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-822321288 => generated 98 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 13:22:25.663128 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dc5b900f-6c5d-4006-bc32-a8e10d2abe07 tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003807 Jul 25 13:22:25.663628 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3093/6113] 10.222.0.49 () {58 vars in 1140 bytes} [Mon Jul 25 13:22:25 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 13:22:25.672546 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fede7a62-8f36-48d1-8a98-4c192eb2a06b tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003932 Jul 25 13:22:25.673025 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3021/6114] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Jul 25 13:22:25 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 13:22:25.681942 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a60a586c-6f0e-4765-87b7-edf6b6690d9d tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] Calling method '.version_select at 0x7efcf88d6700>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:25.710549 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-a60a586c-6f0e-4765-87b7-edf6b6690d9d tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] HTTP exception thrown: Volume beb30788-61e8-413e-b513-79a6cf0382fa could not be found. Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a60a586c-6f0e-4765-87b7-edf6b6690d9d tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] Request method failure captured: Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/os-volumes/beb30788-61e8-413e-b513-79a6cf0382fa HTTP/1.1 Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pkRx5ijn2BnU146HdrCerMs6TMzwWa7p3MI9x3-6jPuCTPPlkCloSP905dlby5AtO8w8J1SVaXHzvxwNLqVAbJtDujMYOBjgpNfNnaTzbXkPir5FsrwGu3JpSWES7Jp2DhH0kRSP8WVG85XstAHIHKIm1PpZGokRh7hwJHbl45lTL4 Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: fd3d4f0b4d644ec09657eb521564378f Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-VolumesNegativeTest-621795966 Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd3d4f0b4d644ec09657eb521564378f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd3d4f0b4d644ec09657eb521564378f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd3d4f0b4d644ec09657eb521564378f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd3d4f0b4d644ec09657eb521564378f"}]}] Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-VolumesNegativeTest-621795966 Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: fd3d4f0b4d644ec09657eb521564378f Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-VolumesNegativeTest-621795966 Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-VolumesNegativeTest-621795966-project Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 09c390dc47664d82b747e3397638fc1f Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-VolumesNegativeTest-621795966-project Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: method: Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: exception: Volume beb30788-61e8-413e-b513-79a6cf0382fa could not be found. Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'beb30788-61e8-413e-b513-79a6cf0382fa'} Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume beb30788-61e8-413e-b513-79a6cf0382fa could not be found. (HTTP 404) (Request-ID: req-d6e33ffc-e55f-44d1-b194-ba32fdda6d3b) Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 13:22:25.713032 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume beb30788-61e8-413e-b513-79a6cf0382fa could not be found. Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume beb30788-61e8-413e-b513-79a6cf0382fa could not be found. Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume beb30788-61e8-413e-b513-79a6cf0382fa could not be found. Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a60a586c-6f0e-4765-87b7-edf6b6690d9d tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] Returning 404 to user: Volume beb30788-61e8-413e-b513-79a6cf0382fa could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a60a586c-6f0e-4765-87b7-edf6b6690d9d tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/beb30788-61e8-413e-b513-79a6cf0382fa" status: 404 len: 109 microversion: 2.1 time: 0.036594 Jul 25 13:22:25.717112 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3094/6115] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Jul 25 13:22:25 2022] DELETE /compute/v2.1/os-volumes/beb30788-61e8-413e-b513-79a6cf0382fa => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:22:25.728600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7cd09ab5-7797-4848-8cee-95816ac7a122 tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] Calling method '.version_select at 0x7efcf83c50d0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:25.757992 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-7cd09ab5-7797-4848-8cee-95816ac7a122 tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] HTTP exception thrown: Volume fd92c49c-c18c-4235-a189-13903e8209cc could not be found. Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7cd09ab5-7797-4848-8cee-95816ac7a122 tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] Request method failure captured: Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/os-volumes/fd92c49c-c18c-4235-a189-13903e8209cc HTTP/1.1 Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pkRx5ijn2BnU146HdrCerMs6TMzwWa7p3MI9x3-6jPuCTPPlkCloSP905dlby5AtO8w8J1SVaXHzvxwNLqVAbJtDujMYOBjgpNfNnaTzbXkPir5FsrwGu3JpSWES7Jp2DhH0kRSP8WVG85XstAHIHKIm1PpZGokRh7hwJHbl45lTL4 Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: fd3d4f0b4d644ec09657eb521564378f Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-VolumesNegativeTest-621795966 Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd3d4f0b4d644ec09657eb521564378f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd3d4f0b4d644ec09657eb521564378f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd3d4f0b4d644ec09657eb521564378f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd3d4f0b4d644ec09657eb521564378f"}]}] Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-VolumesNegativeTest-621795966 Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: fd3d4f0b4d644ec09657eb521564378f Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-VolumesNegativeTest-621795966 Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-VolumesNegativeTest-621795966-project Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 09c390dc47664d82b747e3397638fc1f Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-VolumesNegativeTest-621795966-project Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: method: Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: exception: Volume fd92c49c-c18c-4235-a189-13903e8209cc could not be found. Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'fd92c49c-c18c-4235-a189-13903e8209cc'} Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fd92c49c-c18c-4235-a189-13903e8209cc could not be found. (HTTP 404) (Request-ID: req-6a9fe27b-42d3-47e2-a0d4-8e03b535d385) Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 13:22:25.760032 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fd92c49c-c18c-4235-a189-13903e8209cc could not be found. Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fd92c49c-c18c-4235-a189-13903e8209cc could not be found. Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fd92c49c-c18c-4235-a189-13903e8209cc could not be found. Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7cd09ab5-7797-4848-8cee-95816ac7a122 tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] Returning 404 to user: Volume fd92c49c-c18c-4235-a189-13903e8209cc could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7cd09ab5-7797-4848-8cee-95816ac7a122 tempest-VolumesNegativeTest-621795966 tempest-VolumesNegativeTest-621795966-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/fd92c49c-c18c-4235-a189-13903e8209cc" status: 404 len: 109 microversion: 2.1 time: 0.037241 Jul 25 13:22:25.764605 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3022/6116] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Jul 25 13:22:25 2022] GET /compute/v2.1/os-volumes/fd92c49c-c18c-4235-a189-13903e8209cc => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:22:26.194790 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-303f233e-6c29-4792-bc97-e5b57bcfa630 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:26.195587 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-303f233e-6c29-4792-bc97-e5b57bcfa630 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 70d6a555-5340-415e-ad2d-375389249937] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:26.201798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-303f233e-6c29-4792-bc97-e5b57bcfa630 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:26.202316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-303f233e-6c29-4792-bc97-e5b57bcfa630 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:26.203081 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-303f233e-6c29-4792-bc97-e5b57bcfa630 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:26.203549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-303f233e-6c29-4792-bc97-e5b57bcfa630 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:26.378589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-303f233e-6c29-4792-bc97-e5b57bcfa630 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:22:26.386306 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-303f233e-6c29-4792-bc97-e5b57bcfa630 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937" status: 200 len: 1318 microversion: 2.1 time: 0.196322 Jul 25 13:22:26.386904 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3095/6117] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:22:26 2022] GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:22:27.409442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6490ad36-ca1e-46c8-a70b-b7fe057e0608 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:27.410248 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6490ad36-ca1e-46c8-a70b-b7fe057e0608 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 70d6a555-5340-415e-ad2d-375389249937] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:27.418489 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6490ad36-ca1e-46c8-a70b-b7fe057e0608 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:27.418949 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6490ad36-ca1e-46c8-a70b-b7fe057e0608 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:27.419732 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6490ad36-ca1e-46c8-a70b-b7fe057e0608 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:27.420262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6490ad36-ca1e-46c8-a70b-b7fe057e0608 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:27.554557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6490ad36-ca1e-46c8-a70b-b7fe057e0608 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:22:27.562185 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6490ad36-ca1e-46c8-a70b-b7fe057e0608 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937" status: 200 len: 1318 microversion: 2.1 time: 0.158253 Jul 25 13:22:27.562742 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3023/6118] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:22:27 2022] GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:22:27.758541 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-5585858d-f657-4eaf-82c1-4a929eadc183 req-aa4d3905-3238-42c7-95c4-73ee4640bdc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d6a555-5340-415e-ad2d-375389249937", "name": "network-vif-plugged", "status": "completed", "tag": "73b1e610-8a0d-4ace-a939-64bd96e2c7e9"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:22:27.767775 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:22:27.774666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5585858d-f657-4eaf-82c1-4a929eadc183 req-aa4d3905-3238-42c7-95c4-73ee4640bdc8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:27.775573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5585858d-f657-4eaf-82c1-4a929eadc183 req-aa4d3905-3238-42c7-95c4-73ee4640bdc8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:27.789771 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-5585858d-f657-4eaf-82c1-4a929eadc183 req-aa4d3905-3238-42c7-95c4-73ee4640bdc8 service nova] Creating event network-vif-plugged:73b1e610-8a0d-4ace-a939-64bd96e2c7e9 for instance 70d6a555-5340-415e-ad2d-375389249937 on n-h2-848886-15 Jul 25 13:22:27.794761 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-5585858d-f657-4eaf-82c1-4a929eadc183 req-aa4d3905-3238-42c7-95c4-73ee4640bdc8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040101 Jul 25 13:22:27.795355 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3096/6119] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:22:28.583490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d5145a0a-cebf-4bc2-aa2c-e45b15022981 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:28.584150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d5145a0a-cebf-4bc2-aa2c-e45b15022981 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 70d6a555-5340-415e-ad2d-375389249937] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:28.586162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=10 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:22:28.595091 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d5145a0a-cebf-4bc2-aa2c-e45b15022981 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:28.595953 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d5145a0a-cebf-4bc2-aa2c-e45b15022981 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:28.598111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d5145a0a-cebf-4bc2-aa2c-e45b15022981 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:28.598933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d5145a0a-cebf-4bc2-aa2c-e45b15022981 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:28.739503 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d5145a0a-cebf-4bc2-aa2c-e45b15022981 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:22:28.747063 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d5145a0a-cebf-4bc2-aa2c-e45b15022981 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937" status: 200 len: 1318 microversion: 2.1 time: 0.167447 Jul 25 13:22:28.747650 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3024/6120] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:22:28 2022] GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:22:29.771867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8496a5fa-7609-4070-ab93-66ef527d869a tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:22:29.772960 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8496a5fa-7609-4070-ab93-66ef527d869a tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 70d6a555-5340-415e-ad2d-375389249937] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:29.780162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8496a5fa-7609-4070-ab93-66ef527d869a tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:29.780726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8496a5fa-7609-4070-ab93-66ef527d869a tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:29.781516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8496a5fa-7609-4070-ab93-66ef527d869a tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:29.781988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8496a5fa-7609-4070-ab93-66ef527d869a tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:29.916211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8496a5fa-7609-4070-ab93-66ef527d869a tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:22:29.926009 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8496a5fa-7609-4070-ab93-66ef527d869a tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937" status: 200 len: 1507 microversion: 2.1 time: 0.161317 Jul 25 13:22:29.926594 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3097/6121] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:22:29 2022] GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:22:45.146753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5991f8dd-1b7b-4acc-a48b-a38d0b880e7a tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "370d1bea-59c8-4553-ba3f-edc5b1a45dac", "device": "/dev/sdb"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:22:45.149249 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5991f8dd-1b7b-4acc-a48b-a38d0b880e7a tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 70d6a555-5340-415e-ad2d-375389249937] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:22:45.151915 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:22:45.152628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:22:45.158414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5991f8dd-1b7b-4acc-a48b-a38d0b880e7a tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:45.158874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5991f8dd-1b7b-4acc-a48b-a38d0b880e7a tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:45.159645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5991f8dd-1b7b-4acc-a48b-a38d0b880e7a tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:22:45.160089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5991f8dd-1b7b-4acc-a48b-a38d0b880e7a tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:22:45.416434 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5991f8dd-1b7b-4acc-a48b-a38d0b880e7a tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "POST /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273697 Jul 25 13:22:45.417287 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3025/6122] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Jul 25 13:22:45 2022] POST /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:23:09.386005 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dd23ceda-0388-4233-bbf6-d3050252d0a9 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:23:09.387207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dd23ceda-0388-4233-bbf6-d3050252d0a9 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 70d6a555-5340-415e-ad2d-375389249937] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:23:09.390906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:23:09.391911 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:23:09.395693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd23ceda-0388-4233-bbf6-d3050252d0a9 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:09.396137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd23ceda-0388-4233-bbf6-d3050252d0a9 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:09.397097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd23ceda-0388-4233-bbf6-d3050252d0a9 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:09.397527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd23ceda-0388-4233-bbf6-d3050252d0a9 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:09.680200 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-dd23ceda-0388-4233-bbf6-d3050252d0a9 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lazy-loading 'services' on Instance uuid 70d6a555-5340-415e-ad2d-375389249937 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:23:09.755451 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dd23ceda-0388-4233-bbf6-d3050252d0a9 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "DELETE /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937/os-volume_attachments/370d1bea-59c8-4553-ba3f-edc5b1a45dac" status: 202 len: 0 microversion: 2.1 time: 0.373242 Jul 25 13:23:09.756062 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3098/6123] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Jul 25 13:23:09 2022] DELETE /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937/os-volume_attachments/370d1bea-59c8-4553-ba3f-edc5b1a45dac => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:23:15.272519 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7c33b037-a77c-4a3e-a7dd-bc2d0d3874d9 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:23:15.273175 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7c33b037-a77c-4a3e-a7dd-bc2d0d3874d9 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 70d6a555-5340-415e-ad2d-375389249937] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:23:15.277144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:23:15.278183 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:23:15.284147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c33b037-a77c-4a3e-a7dd-bc2d0d3874d9 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:15.284616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c33b037-a77c-4a3e-a7dd-bc2d0d3874d9 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:15.285433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c33b037-a77c-4a3e-a7dd-bc2d0d3874d9 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:15.285895 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c33b037-a77c-4a3e-a7dd-bc2d0d3874d9 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:15.313720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7c33b037-a77c-4a3e-a7dd-bc2d0d3874d9 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 70d6a555-5340-415e-ad2d-375389249937] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:23:15.398128 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7c33b037-a77c-4a3e-a7dd-bc2d0d3874d9 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "DELETE /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937" status: 204 len: 0 microversion: 2.1 time: 0.132106 Jul 25 13:23:15.399009 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3026/6124] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:23:15 2022] DELETE /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:23:15.409502 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-de53039f-c9d2-45f7-b589-b4175cc05275 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:23:15.410239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-de53039f-c9d2-45f7-b589-b4175cc05275 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 70d6a555-5340-415e-ad2d-375389249937] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:23:15.416735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de53039f-c9d2-45f7-b589-b4175cc05275 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:15.417190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de53039f-c9d2-45f7-b589-b4175cc05275 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:15.417993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de53039f-c9d2-45f7-b589-b4175cc05275 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:15.418432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de53039f-c9d2-45f7-b589-b4175cc05275 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:15.638600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-de53039f-c9d2-45f7-b589-b4175cc05275 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:23:15.646419 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-de53039f-c9d2-45f7-b589-b4175cc05275 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937" status: 200 len: 1513 microversion: 2.1 time: 0.242237 Jul 25 13:23:15.647114 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3099/6125] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:23:15 2022] GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937 => generated 1513 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:23:16.669982 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-559b1c5b-5fee-4d34-94d6-7b52e5370ce0 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:23:16.670769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-559b1c5b-5fee-4d34-94d6-7b52e5370ce0 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 70d6a555-5340-415e-ad2d-375389249937] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:23:16.678255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-559b1c5b-5fee-4d34-94d6-7b52e5370ce0 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:16.678717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-559b1c5b-5fee-4d34-94d6-7b52e5370ce0 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:16.679500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-559b1c5b-5fee-4d34-94d6-7b52e5370ce0 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:16.679947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-559b1c5b-5fee-4d34-94d6-7b52e5370ce0 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:17.417765 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-559b1c5b-5fee-4d34-94d6-7b52e5370ce0 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:23:17.425933 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-559b1c5b-5fee-4d34-94d6-7b52e5370ce0 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937" status: 200 len: 1513 microversion: 2.1 time: 0.760613 Jul 25 13:23:17.426554 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3027/6126] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:23:16 2022] GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937 => generated 1513 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:23:17.902485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-d68d9e08-a3dd-41fa-8759-16c01b734dff req-45d4d20e-7780-44f8-99e4-73c07132f1cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d6a555-5340-415e-ad2d-375389249937", "name": "network-vif-deleted", "tag": "73b1e610-8a0d-4ace-a939-64bd96e2c7e9"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:23:17.921121 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d68d9e08-a3dd-41fa-8759-16c01b734dff req-45d4d20e-7780-44f8-99e4-73c07132f1cb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:17.921567 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d68d9e08-a3dd-41fa-8759-16c01b734dff req-45d4d20e-7780-44f8-99e4-73c07132f1cb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:17.935511 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-d68d9e08-a3dd-41fa-8759-16c01b734dff req-45d4d20e-7780-44f8-99e4-73c07132f1cb service nova] Creating event network-vif-deleted:73b1e610-8a0d-4ace-a939-64bd96e2c7e9 for instance 70d6a555-5340-415e-ad2d-375389249937 on n-h2-848886-15 Jul 25 13:23:17.942257 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-d68d9e08-a3dd-41fa-8759-16c01b734dff req-45d4d20e-7780-44f8-99e4-73c07132f1cb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047004 Jul 25 13:23:17.943298 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3100/6127] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:23:18.447977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9a087482-9602-46e5-8a6e-4a6d9d68dd7c tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:23:18.448781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9a087482-9602-46e5-8a6e-4a6d9d68dd7c tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 70d6a555-5340-415e-ad2d-375389249937] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:23:18.456491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a087482-9602-46e5-8a6e-4a6d9d68dd7c tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:18.456951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a087482-9602-46e5-8a6e-4a6d9d68dd7c tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:18.457767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a087482-9602-46e5-8a6e-4a6d9d68dd7c tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:18.458240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a087482-9602-46e5-8a6e-4a6d9d68dd7c tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:18.472391 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-9a087482-9602-46e5-8a6e-4a6d9d68dd7c tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] HTTP exception thrown: Instance 70d6a555-5340-415e-ad2d-375389249937 could not be found. Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9a087482-9602-46e5-8a6e-4a6d9d68dd7c tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Request method failure captured: Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937 HTTP/1.1 Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pjNFQjslIlOz8-zcZk3VRf7NJsQjRNhs7MYtFXCbEZoIpJx_l2w7yrSRxSkFXcy_lwlWyi3CQDBiKDSOZY2zF2b39RuXHlZd8p1EdgBj6Jsx3zLZ3jFiaCie0rYT7x6_xd9M35j-cgwNC4stN0IDs8IYFrBRYtYt_RhoymY_djIgrc Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: e86a8c695cab4893b0ffd6054e5a0599 Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-VolumesSnapshotTestJSON-162782514 Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e86a8c695cab4893b0ffd6054e5a0599", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e86a8c695cab4893b0ffd6054e5a0599"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e86a8c695cab4893b0ffd6054e5a0599"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e86a8c695cab4893b0ffd6054e5a0599"}]}] Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-VolumesSnapshotTestJSON-162782514 Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: e86a8c695cab4893b0ffd6054e5a0599 Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-162782514 Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-VolumesSnapshotTestJSON-162782514-project Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: b8a63907b2654b91bc22eff4e0f5cd9d Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-VolumesSnapshotTestJSON-162782514-project Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 70d6a555-5340-415e-ad2d-375389249937 could not be found. Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '70d6a555-5340-415e-ad2d-375389249937'} Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70d6a555-5340-415e-ad2d-375389249937 could not be found. Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70d6a555-5340-415e-ad2d-375389249937 could not be found. Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:23:18.474134 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:23:18.479722 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:23:18.479722 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:23:18.479722 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:23:18.479722 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:23:18.479722 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:23:18.479722 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70d6a555-5340-415e-ad2d-375389249937 could not be found. Jul 25 13:23:18.479722 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:23:18.479722 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9a087482-9602-46e5-8a6e-4a6d9d68dd7c tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Returning 404 to user: Instance 70d6a555-5340-415e-ad2d-375389249937 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:23:18.479722 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9a087482-9602-46e5-8a6e-4a6d9d68dd7c tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937" status: 404 len: 111 microversion: 2.1 time: 0.031857 Jul 25 13:23:18.479722 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3028/6128] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:23:18 2022] GET /compute/v2.1/servers/70d6a555-5340-415e-ad2d-375389249937 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:23:25.347352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-58628780-025d-4046-871e-32b09f7f0c17 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2093501989", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "b4d4062e-5d57-4fc3-afd0-ae7710683909"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:23:25.401659 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-58628780-025d-4046-871e-32b09f7f0c17 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] validate_networks() for [('b4d4062e-5d57-4fc3-afd0-ae7710683909', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:23:26.063391 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-58628780-025d-4046-871e-32b09f7f0c17 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:23:26.063900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-58628780-025d-4046-871e-32b09f7f0c17 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:23:26.064585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-58628780-025d-4046-871e-32b09f7f0c17 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:23:26.065015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-58628780-025d-4046-871e-32b09f7f0c17 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:23:26.065433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-58628780-025d-4046-871e-32b09f7f0c17 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:23:26.075317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58628780-025d-4046-871e-32b09f7f0c17 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:26.075777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58628780-025d-4046-871e-32b09f7f0c17 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:26.076619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58628780-025d-4046-871e-32b09f7f0c17 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:26.077085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58628780-025d-4046-871e-32b09f7f0c17 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:26.095016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-58628780-025d-4046-871e-32b09f7f0c17 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Getting quotas for project e86a8c695cab4893b0ffd6054e5a0599. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:23:26.101139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-58628780-025d-4046-871e-32b09f7f0c17 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Getting quotas for user b8a63907b2654b91bc22eff4e0f5cd9d and project e86a8c695cab4893b0ffd6054e5a0599. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:23:26.114600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-58628780-025d-4046-871e-32b09f7f0c17 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:23:26.116993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-58628780-025d-4046-871e-32b09f7f0c17 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 9713a420-9f4d-4de0-bcb7-874b63296008] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:23:26.164086 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-58628780-025d-4046-871e-32b09f7f0c17 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.820931 Jul 25 13:23:26.170558 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3101/6129] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:23:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:23:26.175875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-afa636d1-0f22-44ba-a3e6-51b1bb59fbdb tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:23:26.177060 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-afa636d1-0f22-44ba-a3e6-51b1bb59fbdb tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 9713a420-9f4d-4de0-bcb7-874b63296008] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:23:26.243084 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-afa636d1-0f22-44ba-a3e6-51b1bb59fbdb tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:23:26.251854 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-afa636d1-0f22-44ba-a3e6-51b1bb59fbdb tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008" status: 200 len: 1219 microversion: 2.1 time: 0.079007 Jul 25 13:23:26.252829 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3029/6130] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:23:26 2022] GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:23:27.274372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ee1765e8-c292-4f33-b535-2b7e2fc1c27f tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:23:27.275144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ee1765e8-c292-4f33-b535-2b7e2fc1c27f tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 9713a420-9f4d-4de0-bcb7-874b63296008] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:23:27.285815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee1765e8-c292-4f33-b535-2b7e2fc1c27f tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:27.286677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee1765e8-c292-4f33-b535-2b7e2fc1c27f tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:27.287681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee1765e8-c292-4f33-b535-2b7e2fc1c27f tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:27.288402 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ee1765e8-c292-4f33-b535-2b7e2fc1c27f tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:27.667576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ee1765e8-c292-4f33-b535-2b7e2fc1c27f tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:23:27.675668 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ee1765e8-c292-4f33-b535-2b7e2fc1c27f tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008" status: 200 len: 1277 microversion: 2.1 time: 0.407119 Jul 25 13:23:27.689150 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3102/6131] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:23:27 2022] GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008 => generated 1277 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:23:28.496784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-ea549b78-3711-4850-9373-f7e429c72db5 req-9371e5a7-c054-466c-8907-0d82e59ce33b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9713a420-9f4d-4de0-bcb7-874b63296008", "tag": "ab41a164-92cc-419b-b1a6-31bb566f1aaa"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:23:28.517849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:23:28.525334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ea549b78-3711-4850-9373-f7e429c72db5 req-9371e5a7-c054-466c-8907-0d82e59ce33b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:28.526036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ea549b78-3711-4850-9373-f7e429c72db5 req-9371e5a7-c054-466c-8907-0d82e59ce33b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:28.541277 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-ea549b78-3711-4850-9373-f7e429c72db5 req-9371e5a7-c054-466c-8907-0d82e59ce33b service nova] Creating event network-changed:ab41a164-92cc-419b-b1a6-31bb566f1aaa for instance 9713a420-9f4d-4de0-bcb7-874b63296008 on n-h1-848886-15 Jul 25 13:23:28.546804 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-ea549b78-3711-4850-9373-f7e429c72db5 req-9371e5a7-c054-466c-8907-0d82e59ce33b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056199 Jul 25 13:23:28.548174 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3030/6132] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:23:28.696716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aab3dd18-e97a-4fa2-8426-2bb012ad4f97 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:23:28.697285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-aab3dd18-e97a-4fa2-8426-2bb012ad4f97 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 9713a420-9f4d-4de0-bcb7-874b63296008] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:23:28.704262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aab3dd18-e97a-4fa2-8426-2bb012ad4f97 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:28.704710 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aab3dd18-e97a-4fa2-8426-2bb012ad4f97 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:28.705476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aab3dd18-e97a-4fa2-8426-2bb012ad4f97 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:28.705915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aab3dd18-e97a-4fa2-8426-2bb012ad4f97 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:28.909590 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-aab3dd18-e97a-4fa2-8426-2bb012ad4f97 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:23:28.917576 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-aab3dd18-e97a-4fa2-8426-2bb012ad4f97 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008" status: 200 len: 1319 microversion: 2.1 time: 0.224930 Jul 25 13:23:28.918166 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3103/6133] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:23:28 2022] GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:23:29.940311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0260e9b5-9b7a-4eb1-8099-1ca66e629f28 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:23:29.941033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0260e9b5-9b7a-4eb1-8099-1ca66e629f28 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 9713a420-9f4d-4de0-bcb7-874b63296008] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:23:29.949576 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0260e9b5-9b7a-4eb1-8099-1ca66e629f28 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:29.950083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0260e9b5-9b7a-4eb1-8099-1ca66e629f28 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:29.950879 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0260e9b5-9b7a-4eb1-8099-1ca66e629f28 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:29.951369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0260e9b5-9b7a-4eb1-8099-1ca66e629f28 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:30.088090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0260e9b5-9b7a-4eb1-8099-1ca66e629f28 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:23:30.096213 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0260e9b5-9b7a-4eb1-8099-1ca66e629f28 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008" status: 200 len: 1319 microversion: 2.1 time: 0.160555 Jul 25 13:23:30.096952 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3031/6134] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:23:29 2022] GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:23:31.118533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0cbed3fa-a201-4263-9918-fcdc051cfc2b tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:23:31.119368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0cbed3fa-a201-4263-9918-fcdc051cfc2b tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 9713a420-9f4d-4de0-bcb7-874b63296008] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:23:31.127111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0cbed3fa-a201-4263-9918-fcdc051cfc2b tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:31.127566 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0cbed3fa-a201-4263-9918-fcdc051cfc2b tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:31.128361 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0cbed3fa-a201-4263-9918-fcdc051cfc2b tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:31.128800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0cbed3fa-a201-4263-9918-fcdc051cfc2b tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:31.259617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0cbed3fa-a201-4263-9918-fcdc051cfc2b tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:23:31.267350 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0cbed3fa-a201-4263-9918-fcdc051cfc2b tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008" status: 200 len: 1319 microversion: 2.1 time: 0.152782 Jul 25 13:23:31.267940 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3104/6135] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:23:31 2022] GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:23:32.287894 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-86c33fa5-6ec1-4211-990d-2dc9014203e0 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:23:32.288442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-86c33fa5-6ec1-4211-990d-2dc9014203e0 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 9713a420-9f4d-4de0-bcb7-874b63296008] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:23:32.295517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86c33fa5-6ec1-4211-990d-2dc9014203e0 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:32.295984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86c33fa5-6ec1-4211-990d-2dc9014203e0 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:32.296779 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86c33fa5-6ec1-4211-990d-2dc9014203e0 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:32.297230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-86c33fa5-6ec1-4211-990d-2dc9014203e0 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:32.431244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-86c33fa5-6ec1-4211-990d-2dc9014203e0 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:23:32.439841 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-86c33fa5-6ec1-4211-990d-2dc9014203e0 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008" status: 200 len: 1319 microversion: 2.1 time: 0.155986 Jul 25 13:23:32.440770 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3032/6136] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:23:32 2022] GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:23:33.462229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4dc61884-f029-43d9-874c-ba258f4ae74b tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:23:33.462806 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4dc61884-f029-43d9-874c-ba258f4ae74b tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 9713a420-9f4d-4de0-bcb7-874b63296008] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:23:33.470161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4dc61884-f029-43d9-874c-ba258f4ae74b tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:33.470862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4dc61884-f029-43d9-874c-ba258f4ae74b tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:33.471827 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4dc61884-f029-43d9-874c-ba258f4ae74b tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:33.472243 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4dc61884-f029-43d9-874c-ba258f4ae74b tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:33.546190 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-2bbcd2bd-8c9f-4574-b53b-c8aa52116128 req-e36f5b31-4000-45d9-8187-c5b10a1aff12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9713a420-9f4d-4de0-bcb7-874b63296008", "name": "network-vif-plugged", "status": "completed", "tag": "ab41a164-92cc-419b-b1a6-31bb566f1aaa"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:23:33.569380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2bbcd2bd-8c9f-4574-b53b-c8aa52116128 req-e36f5b31-4000-45d9-8187-c5b10a1aff12 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:33.569925 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2bbcd2bd-8c9f-4574-b53b-c8aa52116128 req-e36f5b31-4000-45d9-8187-c5b10a1aff12 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:33.583567 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-2bbcd2bd-8c9f-4574-b53b-c8aa52116128 req-e36f5b31-4000-45d9-8187-c5b10a1aff12 service nova] Creating event network-vif-plugged:ab41a164-92cc-419b-b1a6-31bb566f1aaa for instance 9713a420-9f4d-4de0-bcb7-874b63296008 on n-h1-848886-15 Jul 25 13:23:33.590306 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-2bbcd2bd-8c9f-4574-b53b-c8aa52116128 req-e36f5b31-4000-45d9-8187-c5b10a1aff12 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047892 Jul 25 13:23:33.591726 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3033/6137] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:23:33.641425 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4dc61884-f029-43d9-874c-ba258f4ae74b tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:23:33.649952 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4dc61884-f029-43d9-874c-ba258f4ae74b tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008" status: 200 len: 1319 microversion: 2.1 time: 0.191524 Jul 25 13:23:33.650548 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3105/6138] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:23:33 2022] GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:23:34.673440 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6c605b74-796a-4f39-be54-16d26b8530b3 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:23:34.674132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6c605b74-796a-4f39-be54-16d26b8530b3 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 9713a420-9f4d-4de0-bcb7-874b63296008] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:23:34.681069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c605b74-796a-4f39-be54-16d26b8530b3 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:34.681540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c605b74-796a-4f39-be54-16d26b8530b3 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:34.682374 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c605b74-796a-4f39-be54-16d26b8530b3 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:34.682823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c605b74-796a-4f39-be54-16d26b8530b3 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:34.820215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6c605b74-796a-4f39-be54-16d26b8530b3 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:23:34.827793 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6c605b74-796a-4f39-be54-16d26b8530b3 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008" status: 200 len: 1319 microversion: 2.1 time: 0.160253 Jul 25 13:23:34.828365 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3034/6139] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:23:34 2022] GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:23:35.848925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-01c33f58-e5de-487e-a810-9d390c5f5795 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:23:35.849534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-01c33f58-e5de-487e-a810-9d390c5f5795 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 9713a420-9f4d-4de0-bcb7-874b63296008] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:23:35.857266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01c33f58-e5de-487e-a810-9d390c5f5795 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:35.857813 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01c33f58-e5de-487e-a810-9d390c5f5795 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:35.858637 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01c33f58-e5de-487e-a810-9d390c5f5795 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:35.859085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01c33f58-e5de-487e-a810-9d390c5f5795 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:35.993604 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-01c33f58-e5de-487e-a810-9d390c5f5795 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:23:36.003460 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-01c33f58-e5de-487e-a810-9d390c5f5795 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008" status: 200 len: 1508 microversion: 2.1 time: 0.158560 Jul 25 13:23:36.004049 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3106/6140] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:23:35 2022] GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:23:36.024666 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d2b1cc1e-5e94-4962-a67d-a7d7d7027a03 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fed3e04-367a-4891-ad21-05a72a94d83a", "device": "/dev/sdb"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:23:36.027100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d2b1cc1e-5e94-4962-a67d-a7d7d7027a03 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 9713a420-9f4d-4de0-bcb7-874b63296008] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:23:36.034198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2b1cc1e-5e94-4962-a67d-a7d7d7027a03 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:36.034662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2b1cc1e-5e94-4962-a67d-a7d7d7027a03 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:36.035451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2b1cc1e-5e94-4962-a67d-a7d7d7027a03 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:36.035908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d2b1cc1e-5e94-4962-a67d-a7d7d7027a03 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:36.247630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:23:36.290828 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d2b1cc1e-5e94-4962-a67d-a7d7d7027a03 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "POST /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270057 Jul 25 13:23:36.291490 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3035/6141] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Jul 25 13:23:36 2022] POST /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:23:57.999515 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-65c4831b-d72c-44a0-819c-0c0da10722e8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:23:58.000048 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-65c4831b-d72c-44a0-819c-0c0da10722e8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 9713a420-9f4d-4de0-bcb7-874b63296008] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:23:58.002102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:23:58.002884 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:23:58.003636 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:23:58.004356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:23:58.010688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65c4831b-d72c-44a0-819c-0c0da10722e8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:58.011137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65c4831b-d72c-44a0-819c-0c0da10722e8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:58.011906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65c4831b-d72c-44a0-819c-0c0da10722e8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:23:58.012345 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65c4831b-d72c-44a0-819c-0c0da10722e8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:23:58.114516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-65c4831b-d72c-44a0-819c-0c0da10722e8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lazy-loading 'services' on Instance uuid 9713a420-9f4d-4de0-bcb7-874b63296008 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:23:58.189720 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-65c4831b-d72c-44a0-819c-0c0da10722e8 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008/os-volume_attachments/8fed3e04-367a-4891-ad21-05a72a94d83a" status: 202 len: 0 microversion: 2.1 time: 0.194421 Jul 25 13:23:58.190561 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3107/6142] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Jul 25 13:23:57 2022] DELETE /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008/os-volume_attachments/8fed3e04-367a-4891-ad21-05a72a94d83a => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:24:03.702240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:24:03.703135 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:24:03.707237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7ab707a8-c2b9-4539-baf7-27aa1ced4a6d tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:24:03.707808 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7ab707a8-c2b9-4539-baf7-27aa1ced4a6d tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 9713a420-9f4d-4de0-bcb7-874b63296008] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:24:03.715925 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ab707a8-c2b9-4539-baf7-27aa1ced4a6d tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:03.716381 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ab707a8-c2b9-4539-baf7-27aa1ced4a6d tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:03.717153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ab707a8-c2b9-4539-baf7-27aa1ced4a6d tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:03.717699 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ab707a8-c2b9-4539-baf7-27aa1ced4a6d tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:03.744761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7ab707a8-c2b9-4539-baf7-27aa1ced4a6d tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 9713a420-9f4d-4de0-bcb7-874b63296008] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:24:03.823780 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7ab707a8-c2b9-4539-baf7-27aa1ced4a6d tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008" status: 204 len: 0 microversion: 2.1 time: 0.123111 Jul 25 13:24:03.824338 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3036/6143] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:24:03 2022] DELETE /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:24:03.833683 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bc5add90-e5f4-4901-8d77-abf37bc429fc tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:24:03.834413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bc5add90-e5f4-4901-8d77-abf37bc429fc tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 9713a420-9f4d-4de0-bcb7-874b63296008] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:24:03.842054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc5add90-e5f4-4901-8d77-abf37bc429fc tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:03.842506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc5add90-e5f4-4901-8d77-abf37bc429fc tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:03.843274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc5add90-e5f4-4901-8d77-abf37bc429fc tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:03.843712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bc5add90-e5f4-4901-8d77-abf37bc429fc tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:03.975982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bc5add90-e5f4-4901-8d77-abf37bc429fc tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:24:03.984035 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bc5add90-e5f4-4901-8d77-abf37bc429fc tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008" status: 200 len: 1514 microversion: 2.1 time: 0.154763 Jul 25 13:24:03.984612 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3108/6144] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:24:03 2022] GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:24:05.006196 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5d63f543-a32e-420a-a2d1-86c5e9892786 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:24:05.007195 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5d63f543-a32e-420a-a2d1-86c5e9892786 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 9713a420-9f4d-4de0-bcb7-874b63296008] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:24:05.014619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d63f543-a32e-420a-a2d1-86c5e9892786 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:05.015086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d63f543-a32e-420a-a2d1-86c5e9892786 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:05.015863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d63f543-a32e-420a-a2d1-86c5e9892786 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:05.016311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5d63f543-a32e-420a-a2d1-86c5e9892786 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:05.153820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5d63f543-a32e-420a-a2d1-86c5e9892786 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:24:05.161923 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5d63f543-a32e-420a-a2d1-86c5e9892786 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008" status: 200 len: 1514 microversion: 2.1 time: 0.160084 Jul 25 13:24:05.162767 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3037/6145] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:24:05 2022] GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:24:05.834336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-d1bb6509-8c3c-4b0a-bb01-9f4b0dd2965a req-49537ce7-659d-48e0-be39-b9e235a7492d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9713a420-9f4d-4de0-bcb7-874b63296008", "name": "network-vif-deleted", "tag": "ab41a164-92cc-419b-b1a6-31bb566f1aaa"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:24:05.847402 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d1bb6509-8c3c-4b0a-bb01-9f4b0dd2965a req-49537ce7-659d-48e0-be39-b9e235a7492d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:05.848143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d1bb6509-8c3c-4b0a-bb01-9f4b0dd2965a req-49537ce7-659d-48e0-be39-b9e235a7492d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:05.860786 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-d1bb6509-8c3c-4b0a-bb01-9f4b0dd2965a req-49537ce7-659d-48e0-be39-b9e235a7492d service nova] Creating event network-vif-deleted:ab41a164-92cc-419b-b1a6-31bb566f1aaa for instance 9713a420-9f4d-4de0-bcb7-874b63296008 on n-h1-848886-15 Jul 25 13:24:05.866764 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-d1bb6509-8c3c-4b0a-bb01-9f4b0dd2965a req-49537ce7-659d-48e0-be39-b9e235a7492d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036244 Jul 25 13:24:05.867390 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3109/6146] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:24:06.183702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9d866f1b-5a1f-47ed-b7aa-b300aa69c0e3 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:24:06.184924 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9d866f1b-5a1f-47ed-b7aa-b300aa69c0e3 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 9713a420-9f4d-4de0-bcb7-874b63296008] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:24:06.192112 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9d866f1b-5a1f-47ed-b7aa-b300aa69c0e3 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:06.192633 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9d866f1b-5a1f-47ed-b7aa-b300aa69c0e3 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:06.193406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9d866f1b-5a1f-47ed-b7aa-b300aa69c0e3 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:06.193852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9d866f1b-5a1f-47ed-b7aa-b300aa69c0e3 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:06.226381 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9d866f1b-5a1f-47ed-b7aa-b300aa69c0e3 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:06.226841 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9d866f1b-5a1f-47ed-b7aa-b300aa69c0e3 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:06.227329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-9d866f1b-5a1f-47ed-b7aa-b300aa69c0e3 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lazy-loading 'fault' on Instance uuid 9713a420-9f4d-4de0-bcb7-874b63296008 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:24:06.268599 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9d866f1b-5a1f-47ed-b7aa-b300aa69c0e3 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a63907b2654b91bc22eff4e0f5cd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86a8c695cab4893b0ffd6054e5a0599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:24:06.276561 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9d866f1b-5a1f-47ed-b7aa-b300aa69c0e3 tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008" status: 200 len: 1309 microversion: 2.1 time: 0.096668 Jul 25 13:24:06.277176 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3038/6147] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:24:06 2022] GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:24:07.298830 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bde94a36-cd09-4d68-be2b-e40d5082f25c tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:24:07.299582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bde94a36-cd09-4d68-be2b-e40d5082f25c tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] [instance: 9713a420-9f4d-4de0-bcb7-874b63296008] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:24:07.307013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bde94a36-cd09-4d68-be2b-e40d5082f25c tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:07.307490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bde94a36-cd09-4d68-be2b-e40d5082f25c tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:07.308358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bde94a36-cd09-4d68-be2b-e40d5082f25c tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:07.308784 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bde94a36-cd09-4d68-be2b-e40d5082f25c tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:07.325708 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-bde94a36-cd09-4d68-be2b-e40d5082f25c tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] HTTP exception thrown: Instance 9713a420-9f4d-4de0-bcb7-874b63296008 could not be found. Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bde94a36-cd09-4d68-be2b-e40d5082f25c tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Request method failure captured: Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008 HTTP/1.1 Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pjNFQjslIlOz8-zcZk3VRf7NJsQjRNhs7MYtFXCbEZoIpJx_l2w7yrSRxSkFXcy_lwlWyi3CQDBiKDSOZY2zF2b39RuXHlZd8p1EdgBj6Jsx3zLZ3jFiaCie0rYT7x6_xd9M35j-cgwNC4stN0IDs8IYFrBRYtYt_RhoymY_djIgrc Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: e86a8c695cab4893b0ffd6054e5a0599 Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-VolumesSnapshotTestJSON-162782514 Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e86a8c695cab4893b0ffd6054e5a0599", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e86a8c695cab4893b0ffd6054e5a0599"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e86a8c695cab4893b0ffd6054e5a0599"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e86a8c695cab4893b0ffd6054e5a0599"}]}] Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-VolumesSnapshotTestJSON-162782514 Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: e86a8c695cab4893b0ffd6054e5a0599 Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-162782514 Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-VolumesSnapshotTestJSON-162782514-project Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: b8a63907b2654b91bc22eff4e0f5cd9d Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-VolumesSnapshotTestJSON-162782514-project Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 9713a420-9f4d-4de0-bcb7-874b63296008 could not be found. Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '9713a420-9f4d-4de0-bcb7-874b63296008'} Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9713a420-9f4d-4de0-bcb7-874b63296008 could not be found. Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9713a420-9f4d-4de0-bcb7-874b63296008 could not be found. Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:24:07.327462 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:24:07.332207 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:24:07.332207 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:24:07.332207 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:24:07.332207 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:24:07.332207 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:24:07.332207 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9713a420-9f4d-4de0-bcb7-874b63296008 could not be found. Jul 25 13:24:07.332207 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:24:07.332207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bde94a36-cd09-4d68-be2b-e40d5082f25c tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] Returning 404 to user: Instance 9713a420-9f4d-4de0-bcb7-874b63296008 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:24:07.332207 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bde94a36-cd09-4d68-be2b-e40d5082f25c tempest-VolumesSnapshotTestJSON-162782514 tempest-VolumesSnapshotTestJSON-162782514-project] 10.222.0.49 "GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008" status: 404 len: 111 microversion: 2.1 time: 0.034181 Jul 25 13:24:07.333437 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3110/6148] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:24:07 2022] GET /compute/v2.1/servers/9713a420-9f4d-4de0-bcb7-874b63296008 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:24:13.854101 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-341d6a1a-51f1-442e-bc27-43bd2ba34f15 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-427064336", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "821b12e0-3d08-4413-b0da-d20ae0dea0a5"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:24:13.907985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-341d6a1a-51f1-442e-bc27-43bd2ba34f15 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] validate_networks() for [('821b12e0-3d08-4413-b0da-d20ae0dea0a5', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:24:14.256962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-341d6a1a-51f1-442e-bc27-43bd2ba34f15 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:24:14.257417 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-341d6a1a-51f1-442e-bc27-43bd2ba34f15 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:24:14.257981 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-341d6a1a-51f1-442e-bc27-43bd2ba34f15 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:24:14.258450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-341d6a1a-51f1-442e-bc27-43bd2ba34f15 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:24:14.258858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-341d6a1a-51f1-442e-bc27-43bd2ba34f15 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:24:14.268623 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-341d6a1a-51f1-442e-bc27-43bd2ba34f15 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:14.269144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-341d6a1a-51f1-442e-bc27-43bd2ba34f15 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:14.270007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-341d6a1a-51f1-442e-bc27-43bd2ba34f15 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:14.270628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-341d6a1a-51f1-442e-bc27-43bd2ba34f15 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:14.287884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-341d6a1a-51f1-442e-bc27-43bd2ba34f15 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Getting quotas for project 1a4a047a845543d5bca399f8ded24ba0. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:24:14.294267 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-341d6a1a-51f1-442e-bc27-43bd2ba34f15 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Getting quotas for user 99792f04f29d4ff289cd250cac75e16b and project 1a4a047a845543d5bca399f8ded24ba0. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:24:14.307107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-341d6a1a-51f1-442e-bc27-43bd2ba34f15 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:24:14.309401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-341d6a1a-51f1-442e-bc27-43bd2ba34f15 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] [instance: 0d4e79e3-8218-4b1d-9928-7fbba89400d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:24:14.356864 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-341d6a1a-51f1-442e-bc27-43bd2ba34f15 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.635900 Jul 25 13:24:14.358188 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3039/6149] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:24:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:24:14.369238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f875b66a-05f5-461e-a6ce-63ef4b59934c tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:24:14.371161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f875b66a-05f5-461e-a6ce-63ef4b59934c tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] [instance: 0d4e79e3-8218-4b1d-9928-7fbba89400d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:24:14.446999 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f875b66a-05f5-461e-a6ce-63ef4b59934c tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99792f04f29d4ff289cd250cac75e16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4a047a845543d5bca399f8ded24ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:24:14.458131 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f875b66a-05f5-461e-a6ce-63ef4b59934c tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5" status: 200 len: 1213 microversion: 2.1 time: 0.092402 Jul 25 13:24:14.459254 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3111/6150] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:24:14 2022] GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:24:15.481628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4589d100-9baa-404a-a5e6-8baacb1ffdde tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:24:15.482544 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4589d100-9baa-404a-a5e6-8baacb1ffdde tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] [instance: 0d4e79e3-8218-4b1d-9928-7fbba89400d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:24:15.500184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4589d100-9baa-404a-a5e6-8baacb1ffdde tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:15.502031 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4589d100-9baa-404a-a5e6-8baacb1ffdde tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:15.504713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4589d100-9baa-404a-a5e6-8baacb1ffdde tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:15.505810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4589d100-9baa-404a-a5e6-8baacb1ffdde tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:15.596362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4589d100-9baa-404a-a5e6-8baacb1ffdde tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99792f04f29d4ff289cd250cac75e16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4a047a845543d5bca399f8ded24ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:24:15.605920 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4589d100-9baa-404a-a5e6-8baacb1ffdde tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5" status: 200 len: 1271 microversion: 2.1 time: 0.129421 Jul 25 13:24:15.606754 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3040/6151] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:24:15 2022] GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5 => generated 1271 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:24:16.637251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ca586b8e-11a8-4e66-a3d0-03efc6a6b10b tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:24:16.639132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ca586b8e-11a8-4e66-a3d0-03efc6a6b10b tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] [instance: 0d4e79e3-8218-4b1d-9928-7fbba89400d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:24:16.646682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ca586b8e-11a8-4e66-a3d0-03efc6a6b10b tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:16.647128 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ca586b8e-11a8-4e66-a3d0-03efc6a6b10b tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:16.648074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ca586b8e-11a8-4e66-a3d0-03efc6a6b10b tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:16.648692 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ca586b8e-11a8-4e66-a3d0-03efc6a6b10b tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:17.122480 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ca586b8e-11a8-4e66-a3d0-03efc6a6b10b tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99792f04f29d4ff289cd250cac75e16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4a047a845543d5bca399f8ded24ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:24:17.131701 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ca586b8e-11a8-4e66-a3d0-03efc6a6b10b tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5" status: 200 len: 1313 microversion: 2.1 time: 0.500214 Jul 25 13:24:17.132936 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3112/6152] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:24:16 2022] GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5 => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:24:17.156688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-5c078364-fb05-4c67-ab4f-55d6e92a379f req-8db1b2eb-4486-4042-8361-da003dc2614d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d4e79e3-8218-4b1d-9928-7fbba89400d5", "tag": "f8dfb80d-fb62-4ee5-ab67-ac2c75c98ee8"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:24:17.171039 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-5c078364-fb05-4c67-ab4f-55d6e92a379f req-8db1b2eb-4486-4042-8361-da003dc2614d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:17.171842 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-5c078364-fb05-4c67-ab4f-55d6e92a379f req-8db1b2eb-4486-4042-8361-da003dc2614d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:17.184324 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-5c078364-fb05-4c67-ab4f-55d6e92a379f req-8db1b2eb-4486-4042-8361-da003dc2614d service nova] Creating event network-changed:f8dfb80d-fb62-4ee5-ab67-ac2c75c98ee8 for instance 0d4e79e3-8218-4b1d-9928-7fbba89400d5 on n-h1-848886-15 Jul 25 13:24:17.190781 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-5c078364-fb05-4c67-ab4f-55d6e92a379f req-8db1b2eb-4486-4042-8361-da003dc2614d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039778 Jul 25 13:24:17.192096 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3041/6153] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:24:18.152847 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0a749666-17b4-4ded-bc52-aa75060c74f5 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:24:18.153468 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0a749666-17b4-4ded-bc52-aa75060c74f5 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] [instance: 0d4e79e3-8218-4b1d-9928-7fbba89400d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:24:18.161437 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a749666-17b4-4ded-bc52-aa75060c74f5 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:18.161934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a749666-17b4-4ded-bc52-aa75060c74f5 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:18.162903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a749666-17b4-4ded-bc52-aa75060c74f5 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:18.164870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0a749666-17b4-4ded-bc52-aa75060c74f5 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:18.298983 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0a749666-17b4-4ded-bc52-aa75060c74f5 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99792f04f29d4ff289cd250cac75e16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4a047a845543d5bca399f8ded24ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:24:18.307139 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0a749666-17b4-4ded-bc52-aa75060c74f5 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5" status: 200 len: 1313 microversion: 2.1 time: 0.158255 Jul 25 13:24:18.307737 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3113/6154] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:24:18 2022] GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:24:19.330169 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8bb2fc47-bb46-4efc-bd92-40a483fe81e9 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:24:19.330910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8bb2fc47-bb46-4efc-bd92-40a483fe81e9 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] [instance: 0d4e79e3-8218-4b1d-9928-7fbba89400d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:24:19.338658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bb2fc47-bb46-4efc-bd92-40a483fe81e9 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:19.339121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bb2fc47-bb46-4efc-bd92-40a483fe81e9 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:19.339904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bb2fc47-bb46-4efc-bd92-40a483fe81e9 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:19.340353 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8bb2fc47-bb46-4efc-bd92-40a483fe81e9 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:19.481246 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8bb2fc47-bb46-4efc-bd92-40a483fe81e9 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99792f04f29d4ff289cd250cac75e16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4a047a845543d5bca399f8ded24ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:24:19.491351 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8bb2fc47-bb46-4efc-bd92-40a483fe81e9 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5" status: 200 len: 1313 microversion: 2.1 time: 0.166365 Jul 25 13:24:19.491947 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3042/6155] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:24:19 2022] GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:24:20.512832 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b4ff66bc-ef14-46d1-83f2-4a435b9b5588 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:24:20.513454 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b4ff66bc-ef14-46d1-83f2-4a435b9b5588 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] [instance: 0d4e79e3-8218-4b1d-9928-7fbba89400d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:24:20.521392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4ff66bc-ef14-46d1-83f2-4a435b9b5588 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:20.521863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4ff66bc-ef14-46d1-83f2-4a435b9b5588 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:20.522674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4ff66bc-ef14-46d1-83f2-4a435b9b5588 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:20.523110 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4ff66bc-ef14-46d1-83f2-4a435b9b5588 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:20.656332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b4ff66bc-ef14-46d1-83f2-4a435b9b5588 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99792f04f29d4ff289cd250cac75e16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4a047a845543d5bca399f8ded24ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:24:20.664184 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b4ff66bc-ef14-46d1-83f2-4a435b9b5588 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5" status: 200 len: 1313 microversion: 2.1 time: 0.155398 Jul 25 13:24:20.664761 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3114/6156] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:24:20 2022] GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:24:21.669648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-0cb1f305-3d3c-4a09-9478-e6e077c54dcc req-b690413f-99e3-4cbf-a1b0-3f751accb308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d4e79e3-8218-4b1d-9928-7fbba89400d5", "name": "network-vif-plugged", "status": "completed", "tag": "f8dfb80d-fb62-4ee5-ab67-ac2c75c98ee8"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:24:21.683496 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0cb1f305-3d3c-4a09-9478-e6e077c54dcc req-b690413f-99e3-4cbf-a1b0-3f751accb308 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:21.684219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0cb1f305-3d3c-4a09-9478-e6e077c54dcc req-b690413f-99e3-4cbf-a1b0-3f751accb308 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:21.685095 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-56fa9a64-db71-48e4-be67-548c930cf3e4 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:24:21.687480 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-56fa9a64-db71-48e4-be67-548c930cf3e4 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] [instance: 0d4e79e3-8218-4b1d-9928-7fbba89400d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:24:21.696277 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56fa9a64-db71-48e4-be67-548c930cf3e4 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:21.696988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56fa9a64-db71-48e4-be67-548c930cf3e4 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:21.697854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56fa9a64-db71-48e4-be67-548c930cf3e4 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:21.698526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-56fa9a64-db71-48e4-be67-548c930cf3e4 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:21.700024 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-0cb1f305-3d3c-4a09-9478-e6e077c54dcc req-b690413f-99e3-4cbf-a1b0-3f751accb308 service nova] Creating event network-vif-plugged:f8dfb80d-fb62-4ee5-ab67-ac2c75c98ee8 for instance 0d4e79e3-8218-4b1d-9928-7fbba89400d5 on n-h1-848886-15 Jul 25 13:24:21.706019 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-0cb1f305-3d3c-4a09-9478-e6e077c54dcc req-b690413f-99e3-4cbf-a1b0-3f751accb308 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040221 Jul 25 13:24:21.707204 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3043/6157] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:24:21.841941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-56fa9a64-db71-48e4-be67-548c930cf3e4 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99792f04f29d4ff289cd250cac75e16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4a047a845543d5bca399f8ded24ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:24:21.850993 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-56fa9a64-db71-48e4-be67-548c930cf3e4 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5" status: 200 len: 1313 microversion: 2.1 time: 0.170044 Jul 25 13:24:21.851841 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3115/6158] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:24:21 2022] GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:24:22.874830 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e8cc51ae-f66a-45aa-add7-70ef13d9b7b7 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:24:22.875650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e8cc51ae-f66a-45aa-add7-70ef13d9b7b7 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] [instance: 0d4e79e3-8218-4b1d-9928-7fbba89400d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:24:22.883126 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e8cc51ae-f66a-45aa-add7-70ef13d9b7b7 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:22.883723 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e8cc51ae-f66a-45aa-add7-70ef13d9b7b7 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:22.884688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e8cc51ae-f66a-45aa-add7-70ef13d9b7b7 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:22.885241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e8cc51ae-f66a-45aa-add7-70ef13d9b7b7 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:23.074793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e8cc51ae-f66a-45aa-add7-70ef13d9b7b7 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99792f04f29d4ff289cd250cac75e16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4a047a845543d5bca399f8ded24ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:24:23.087236 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e8cc51ae-f66a-45aa-add7-70ef13d9b7b7 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5" status: 200 len: 1313 microversion: 2.1 time: 0.217687 Jul 25 13:24:23.088079 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3044/6159] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:24:22 2022] GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:24:24.108942 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d2b15606-88f4-49b0-a6a9-8659ca89089a tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:24:24.109622 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d2b15606-88f4-49b0-a6a9-8659ca89089a tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] [instance: 0d4e79e3-8218-4b1d-9928-7fbba89400d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:24:24.117086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2b15606-88f4-49b0-a6a9-8659ca89089a tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:24.117535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2b15606-88f4-49b0-a6a9-8659ca89089a tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:24.118348 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2b15606-88f4-49b0-a6a9-8659ca89089a tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:24.118767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2b15606-88f4-49b0-a6a9-8659ca89089a tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:24.254970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d2b15606-88f4-49b0-a6a9-8659ca89089a tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99792f04f29d4ff289cd250cac75e16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4a047a845543d5bca399f8ded24ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:24:24.262756 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d2b15606-88f4-49b0-a6a9-8659ca89089a tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5" status: 200 len: 1497 microversion: 2.1 time: 0.157938 Jul 25 13:24:24.263318 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3116/6160] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:24:24 2022] GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5 => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:24:26.562672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-89c67a80-7dd1-44d1-89b6-942a19618e99 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:24:26.563224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-89c67a80-7dd1-44d1-89b6-942a19618e99 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] [instance: 0d4e79e3-8218-4b1d-9928-7fbba89400d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:24:26.566129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:24:26.567287 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:24:26.573579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89c67a80-7dd1-44d1-89b6-942a19618e99 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:26.574077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89c67a80-7dd1-44d1-89b6-942a19618e99 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:26.574846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89c67a80-7dd1-44d1-89b6-942a19618e99 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:26.575329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89c67a80-7dd1-44d1-89b6-942a19618e99 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:26.602876 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-89c67a80-7dd1-44d1-89b6-942a19618e99 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] [instance: 0d4e79e3-8218-4b1d-9928-7fbba89400d5] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:24:26.684994 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-89c67a80-7dd1-44d1-89b6-942a19618e99 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5" status: 204 len: 0 microversion: 2.1 time: 0.125912 Jul 25 13:24:26.685542 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3045/6161] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:24:26 2022] DELETE /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:24:26.695553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-de6e01fb-7883-4c6e-8490-38bfc53aae01 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:24:26.696837 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-de6e01fb-7883-4c6e-8490-38bfc53aae01 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] [instance: 0d4e79e3-8218-4b1d-9928-7fbba89400d5] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:24:26.703215 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:24:26.706524 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de6e01fb-7883-4c6e-8490-38bfc53aae01 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:26.707042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de6e01fb-7883-4c6e-8490-38bfc53aae01 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:26.708053 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de6e01fb-7883-4c6e-8490-38bfc53aae01 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:26.708571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-de6e01fb-7883-4c6e-8490-38bfc53aae01 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:26.853620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-de6e01fb-7883-4c6e-8490-38bfc53aae01 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99792f04f29d4ff289cd250cac75e16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4a047a845543d5bca399f8ded24ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:24:26.861558 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-de6e01fb-7883-4c6e-8490-38bfc53aae01 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5" status: 200 len: 1503 microversion: 2.1 time: 0.170797 Jul 25 13:24:26.862334 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3117/6162] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:24:26 2022] GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:24:27.883864 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e017a701-78c2-47d9-bd9b-b02641ffb2b5 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:24:27.885569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e017a701-78c2-47d9-bd9b-b02641ffb2b5 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] [instance: 0d4e79e3-8218-4b1d-9928-7fbba89400d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:24:27.895248 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e017a701-78c2-47d9-bd9b-b02641ffb2b5 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:27.896229 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e017a701-78c2-47d9-bd9b-b02641ffb2b5 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:27.897276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e017a701-78c2-47d9-bd9b-b02641ffb2b5 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:27.897725 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e017a701-78c2-47d9-bd9b-b02641ffb2b5 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:28.035707 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e017a701-78c2-47d9-bd9b-b02641ffb2b5 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99792f04f29d4ff289cd250cac75e16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4a047a845543d5bca399f8ded24ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:24:28.043960 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e017a701-78c2-47d9-bd9b-b02641ffb2b5 tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5" status: 200 len: 1503 microversion: 2.1 time: 0.164922 Jul 25 13:24:28.050348 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3046/6163] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:24:27 2022] GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:24:28.484785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-375586bc-6929-46fe-8711-011fb0c480f0 req-83b7bb18-0172-4a80-9349-66f3df7bfbe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d4e79e3-8218-4b1d-9928-7fbba89400d5", "name": "network-vif-deleted", "tag": "f8dfb80d-fb62-4ee5-ab67-ac2c75c98ee8"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:24:28.492094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=25 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:24:28.500471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-375586bc-6929-46fe-8711-011fb0c480f0 req-83b7bb18-0172-4a80-9349-66f3df7bfbe5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:28.500920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-375586bc-6929-46fe-8711-011fb0c480f0 req-83b7bb18-0172-4a80-9349-66f3df7bfbe5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:28.505123 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:24:28.517164 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-375586bc-6929-46fe-8711-011fb0c480f0 req-83b7bb18-0172-4a80-9349-66f3df7bfbe5 service nova] Creating event network-vif-deleted:f8dfb80d-fb62-4ee5-ab67-ac2c75c98ee8 for instance 0d4e79e3-8218-4b1d-9928-7fbba89400d5 on n-h1-848886-15 Jul 25 13:24:28.523771 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-375586bc-6929-46fe-8711-011fb0c480f0 req-83b7bb18-0172-4a80-9349-66f3df7bfbe5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043418 Jul 25 13:24:28.525234 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3118/6164] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:24:29.067687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5cbbdb23-955c-4d24-b4d6-4000b067335d tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:24:29.068289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5cbbdb23-955c-4d24-b4d6-4000b067335d tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] [instance: 0d4e79e3-8218-4b1d-9928-7fbba89400d5] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:24:29.076617 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cbbdb23-955c-4d24-b4d6-4000b067335d tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:29.077116 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cbbdb23-955c-4d24-b4d6-4000b067335d tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:29.078009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cbbdb23-955c-4d24-b4d6-4000b067335d tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:24:29.078449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5cbbdb23-955c-4d24-b4d6-4000b067335d tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:24:29.095649 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-5cbbdb23-955c-4d24-b4d6-4000b067335d tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] HTTP exception thrown: Instance 0d4e79e3-8218-4b1d-9928-7fbba89400d5 could not be found. Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5cbbdb23-955c-4d24-b4d6-4000b067335d tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Request method failure captured: Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5 HTTP/1.1 Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pl8jvTfmKhY56mBYSm0P-V56MIMYjjc3kEmLd07qVtTbhyqg7q43UjLWHbSBMdTAofSYXpcQTlt6nGhFIEAl6VbuqN5RBGLAegdDWvHmjrkkNbm4rAZR7yDZXG2s4QITcfLXwAuFFZonPo0aR8Bp00Ya1AN3AL_eCcnpXwPszskeSo Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 1a4a047a845543d5bca399f8ded24ba0 Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-VolumesActionsTest-722371947 Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1a4a047a845543d5bca399f8ded24ba0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1a4a047a845543d5bca399f8ded24ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a4a047a845543d5bca399f8ded24ba0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a4a047a845543d5bca399f8ded24ba0"}]}] Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-VolumesActionsTest-722371947 Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 1a4a047a845543d5bca399f8ded24ba0 Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-VolumesActionsTest-722371947 Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-VolumesActionsTest-722371947-project Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 99792f04f29d4ff289cd250cac75e16b Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-VolumesActionsTest-722371947-project Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 0d4e79e3-8218-4b1d-9928-7fbba89400d5 could not be found. Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '0d4e79e3-8218-4b1d-9928-7fbba89400d5'} Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d4e79e3-8218-4b1d-9928-7fbba89400d5 could not be found. Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d4e79e3-8218-4b1d-9928-7fbba89400d5 could not be found. Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:24:29.097329 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:24:29.102797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:24:29.102797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:24:29.102797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:24:29.102797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:24:29.102797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:24:29.102797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d4e79e3-8218-4b1d-9928-7fbba89400d5 could not be found. Jul 25 13:24:29.102797 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:24:29.102797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5cbbdb23-955c-4d24-b4d6-4000b067335d tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] Returning 404 to user: Instance 0d4e79e3-8218-4b1d-9928-7fbba89400d5 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:24:29.102797 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5cbbdb23-955c-4d24-b4d6-4000b067335d tempest-VolumesActionsTest-722371947 tempest-VolumesActionsTest-722371947-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5" status: 404 len: 111 microversion: 2.1 time: 0.035359 Jul 25 13:24:29.102797 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3047/6165] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:24:29 2022] GET /compute/v2.1/servers/0d4e79e3-8218-4b1d-9928-7fbba89400d5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:25:17.992567 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c452337f-6057-46d1-9885-ee8a9097c5c9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2134242440", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "c4a09743-80ae-4737-bd90-72f586418451"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:25:18.001438 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:25:18.049053 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-c452337f-6057-46d1-9885-ee8a9097c5c9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] validate_networks() for [('c4a09743-80ae-4737-bd90-72f586418451', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:25:18.473173 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-c452337f-6057-46d1-9885-ee8a9097c5c9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:25:18.474099 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-c452337f-6057-46d1-9885-ee8a9097c5c9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:25:18.475300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-c452337f-6057-46d1-9885-ee8a9097c5c9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:25:18.475945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-c452337f-6057-46d1-9885-ee8a9097c5c9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:25:18.476387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-c452337f-6057-46d1-9885-ee8a9097c5c9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:25:18.492043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c452337f-6057-46d1-9885-ee8a9097c5c9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:18.492797 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c452337f-6057-46d1-9885-ee8a9097c5c9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:18.494014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c452337f-6057-46d1-9885-ee8a9097c5c9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:18.494808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c452337f-6057-46d1-9885-ee8a9097c5c9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:18.514082 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-c452337f-6057-46d1-9885-ee8a9097c5c9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Getting quotas for project 3ddd5037be2f4c9f837cee2dcc0cf1ca. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:25:18.520299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-c452337f-6057-46d1-9885-ee8a9097c5c9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Getting quotas for user 044aae1313724b3285a9d81e5a6ae420 and project 3ddd5037be2f4c9f837cee2dcc0cf1ca. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:25:18.534842 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c452337f-6057-46d1-9885-ee8a9097c5c9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:25:18.537567 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c452337f-6057-46d1-9885-ee8a9097c5c9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 8f313507-a163-454b-9fcd-81e0091f963f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:25:18.583598 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c452337f-6057-46d1-9885-ee8a9097c5c9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595385 Jul 25 13:25:18.584264 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3119/6166] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:25:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:25:18.595525 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-983fd72c-6565-4c19-acb6-ed491e6e2eee tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:18.596406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-983fd72c-6565-4c19-acb6-ed491e6e2eee tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 8f313507-a163-454b-9fcd-81e0091f963f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:18.599630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:25:18.600581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:25:18.665169 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-983fd72c-6565-4c19-acb6-ed491e6e2eee tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:18.672764 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-983fd72c-6565-4c19-acb6-ed491e6e2eee tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f" status: 200 len: 1214 microversion: 2.1 time: 0.081458 Jul 25 13:25:18.673333 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3048/6167] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:18 2022] GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:19.695057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d8ec51b9-3c73-4560-90e8-de1515b6c5be tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:19.695807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d8ec51b9-3c73-4560-90e8-de1515b6c5be tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 8f313507-a163-454b-9fcd-81e0091f963f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:19.702946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8ec51b9-3c73-4560-90e8-de1515b6c5be tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:19.703510 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8ec51b9-3c73-4560-90e8-de1515b6c5be tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:19.704368 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8ec51b9-3c73-4560-90e8-de1515b6c5be tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:19.704899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d8ec51b9-3c73-4560-90e8-de1515b6c5be tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:19.793260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d8ec51b9-3c73-4560-90e8-de1515b6c5be tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:19.806889 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d8ec51b9-3c73-4560-90e8-de1515b6c5be tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f" status: 200 len: 1266 microversion: 2.1 time: 0.116454 Jul 25 13:25:19.819523 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3120/6168] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:19 2022] GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:20.830288 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-90bde5b8-4621-43c6-9764-b10a00aa5b8d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:20.831308 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-90bde5b8-4621-43c6-9764-b10a00aa5b8d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 8f313507-a163-454b-9fcd-81e0091f963f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:20.843917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-90bde5b8-4621-43c6-9764-b10a00aa5b8d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:20.843917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-90bde5b8-4621-43c6-9764-b10a00aa5b8d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:20.845143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-90bde5b8-4621-43c6-9764-b10a00aa5b8d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:20.845555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-90bde5b8-4621-43c6-9764-b10a00aa5b8d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:20.984996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-90bde5b8-4621-43c6-9764-b10a00aa5b8d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:20.992717 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-90bde5b8-4621-43c6-9764-b10a00aa5b8d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f" status: 200 len: 1314 microversion: 2.1 time: 0.166406 Jul 25 13:25:21.006405 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3049/6169] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:20 2022] GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:21.292994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-d6afd1a7-5793-4f8f-a35c-f7c7b555e92f req-e263d50c-9ee0-491d-a841-e43ffa3759ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f313507-a163-454b-9fcd-81e0091f963f", "tag": "c9dd6d72-8bc0-48f7-8344-ffc31ff8fa9e"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:25:21.303672 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d6afd1a7-5793-4f8f-a35c-f7c7b555e92f req-e263d50c-9ee0-491d-a841-e43ffa3759ce service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:21.304225 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-d6afd1a7-5793-4f8f-a35c-f7c7b555e92f req-e263d50c-9ee0-491d-a841-e43ffa3759ce service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:21.318856 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-d6afd1a7-5793-4f8f-a35c-f7c7b555e92f req-e263d50c-9ee0-491d-a841-e43ffa3759ce service nova] Creating event network-changed:c9dd6d72-8bc0-48f7-8344-ffc31ff8fa9e for instance 8f313507-a163-454b-9fcd-81e0091f963f on n-h1-848886-15 Jul 25 13:25:21.324958 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-d6afd1a7-5793-4f8f-a35c-f7c7b555e92f req-e263d50c-9ee0-491d-a841-e43ffa3759ce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175253 Jul 25 13:25:21.325984 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3121/6170] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:25:22.014415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-68dccfd2-a580-4e04-ab04-dc0150c155b0 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:22.014980 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-68dccfd2-a580-4e04-ab04-dc0150c155b0 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 8f313507-a163-454b-9fcd-81e0091f963f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:22.022350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68dccfd2-a580-4e04-ab04-dc0150c155b0 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:22.022820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68dccfd2-a580-4e04-ab04-dc0150c155b0 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:22.023607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68dccfd2-a580-4e04-ab04-dc0150c155b0 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:22.024054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-68dccfd2-a580-4e04-ab04-dc0150c155b0 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:22.158684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-68dccfd2-a580-4e04-ab04-dc0150c155b0 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:22.167113 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-68dccfd2-a580-4e04-ab04-dc0150c155b0 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f" status: 200 len: 1314 microversion: 2.1 time: 0.156674 Jul 25 13:25:22.167685 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3050/6171] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:22 2022] GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:23.108704 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:25:23.109294 n-d-848886-15 devstack@n-api.service[125884]: Mon Jul 25 13:25:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:25:23.188686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8c2afa2b-3aba-46f9-baab-3728c36ab492 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:23.189519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8c2afa2b-3aba-46f9-baab-3728c36ab492 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 8f313507-a163-454b-9fcd-81e0091f963f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:23.197268 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c2afa2b-3aba-46f9-baab-3728c36ab492 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:23.197725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c2afa2b-3aba-46f9-baab-3728c36ab492 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:23.198539 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c2afa2b-3aba-46f9-baab-3728c36ab492 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:23.198979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c2afa2b-3aba-46f9-baab-3728c36ab492 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:23.347527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8c2afa2b-3aba-46f9-baab-3728c36ab492 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:23.355599 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8c2afa2b-3aba-46f9-baab-3728c36ab492 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f" status: 200 len: 1314 microversion: 2.1 time: 0.171219 Jul 25 13:25:23.356172 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3122/6172] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:23 2022] GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:24.377217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2d3f63ac-151f-485f-9bb4-a6379e57eab6 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:24.377902 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2d3f63ac-151f-485f-9bb4-a6379e57eab6 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 8f313507-a163-454b-9fcd-81e0091f963f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:24.385874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d3f63ac-151f-485f-9bb4-a6379e57eab6 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:24.386356 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d3f63ac-151f-485f-9bb4-a6379e57eab6 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:24.387152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d3f63ac-151f-485f-9bb4-a6379e57eab6 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:24.387594 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d3f63ac-151f-485f-9bb4-a6379e57eab6 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:24.535916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2d3f63ac-151f-485f-9bb4-a6379e57eab6 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:24.544671 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2d3f63ac-151f-485f-9bb4-a6379e57eab6 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f" status: 200 len: 1314 microversion: 2.1 time: 0.171406 Jul 25 13:25:24.545177 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3051/6173] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:24 2022] GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:25.566766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-737e8c69-9970-48eb-b03f-f17a066c0683 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:25.567993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-737e8c69-9970-48eb-b03f-f17a066c0683 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 8f313507-a163-454b-9fcd-81e0091f963f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:25.575916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-737e8c69-9970-48eb-b03f-f17a066c0683 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:25.576472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-737e8c69-9970-48eb-b03f-f17a066c0683 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:25.577519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-737e8c69-9970-48eb-b03f-f17a066c0683 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:25.577981 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-737e8c69-9970-48eb-b03f-f17a066c0683 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:25.710959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-737e8c69-9970-48eb-b03f-f17a066c0683 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:25.718780 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-737e8c69-9970-48eb-b03f-f17a066c0683 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f" status: 200 len: 1314 microversion: 2.1 time: 0.157114 Jul 25 13:25:25.719325 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3123/6174] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:25 2022] GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:26.088373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-b0b158cc-80ce-4569-b653-21bcd64d26d8 req-92011def-e61e-4c38-ab5f-4b8b81f98437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f313507-a163-454b-9fcd-81e0091f963f", "name": "network-vif-plugged", "status": "completed", "tag": "c9dd6d72-8bc0-48f7-8344-ffc31ff8fa9e"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:25:26.098320 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b0b158cc-80ce-4569-b653-21bcd64d26d8 req-92011def-e61e-4c38-ab5f-4b8b81f98437 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:26.099157 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b0b158cc-80ce-4569-b653-21bcd64d26d8 req-92011def-e61e-4c38-ab5f-4b8b81f98437 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:26.110586 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-b0b158cc-80ce-4569-b653-21bcd64d26d8 req-92011def-e61e-4c38-ab5f-4b8b81f98437 service nova] Creating event network-vif-plugged:c9dd6d72-8bc0-48f7-8344-ffc31ff8fa9e for instance 8f313507-a163-454b-9fcd-81e0091f963f on n-h1-848886-15 Jul 25 13:25:26.115823 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-b0b158cc-80ce-4569-b653-21bcd64d26d8 req-92011def-e61e-4c38-ab5f-4b8b81f98437 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113506 Jul 25 13:25:26.116621 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3052/6175] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:25:26.740719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bd337e2a-0742-405d-8337-f1248d5a70a2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:26.741372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bd337e2a-0742-405d-8337-f1248d5a70a2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 8f313507-a163-454b-9fcd-81e0091f963f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:26.748916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd337e2a-0742-405d-8337-f1248d5a70a2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:26.749370 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd337e2a-0742-405d-8337-f1248d5a70a2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:26.750181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd337e2a-0742-405d-8337-f1248d5a70a2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:26.750622 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd337e2a-0742-405d-8337-f1248d5a70a2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:26.888589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bd337e2a-0742-405d-8337-f1248d5a70a2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:26.892077 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bd337e2a-0742-405d-8337-f1248d5a70a2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f" status: 200 len: 1314 microversion: 2.1 time: 0.155325 Jul 25 13:25:26.892739 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3124/6176] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:26 2022] GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:27.914122 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cf278c80-9841-45c8-8a19-d1be5ac210e9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:27.914868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cf278c80-9841-45c8-8a19-d1be5ac210e9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 8f313507-a163-454b-9fcd-81e0091f963f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:27.922645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf278c80-9841-45c8-8a19-d1be5ac210e9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:27.923264 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf278c80-9841-45c8-8a19-d1be5ac210e9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:27.924179 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf278c80-9841-45c8-8a19-d1be5ac210e9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:27.924666 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf278c80-9841-45c8-8a19-d1be5ac210e9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:28.077279 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cf278c80-9841-45c8-8a19-d1be5ac210e9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:28.085330 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cf278c80-9841-45c8-8a19-d1be5ac210e9 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f" status: 200 len: 1498 microversion: 2.1 time: 0.176324 Jul 25 13:25:28.085951 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3053/6177] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:27 2022] GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f => generated 1498 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:28.499578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b6e8158b-569b-4c10-96ef-38ed74c51a2d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:28.500224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b6e8158b-569b-4c10-96ef-38ed74c51a2d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 8f313507-a163-454b-9fcd-81e0091f963f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:28.502990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:25:28.508891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6e8158b-569b-4c10-96ef-38ed74c51a2d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:28.509346 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6e8158b-569b-4c10-96ef-38ed74c51a2d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:28.510146 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6e8158b-569b-4c10-96ef-38ed74c51a2d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:28.510597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6e8158b-569b-4c10-96ef-38ed74c51a2d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:28.528370 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:25:28.539617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b6e8158b-569b-4c10-96ef-38ed74c51a2d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 8f313507-a163-454b-9fcd-81e0091f963f] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:25:28.619594 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b6e8158b-569b-4c10-96ef-38ed74c51a2d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f" status: 204 len: 0 microversion: 2.1 time: 0.123822 Jul 25 13:25:28.620532 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3125/6178] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:25:28 2022] DELETE /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:25:28.629492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d38db284-7cfe-4877-af4b-419561b62333 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:28.630144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d38db284-7cfe-4877-af4b-419561b62333 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 8f313507-a163-454b-9fcd-81e0091f963f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:28.636765 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d38db284-7cfe-4877-af4b-419561b62333 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:28.637251 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d38db284-7cfe-4877-af4b-419561b62333 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:28.638071 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d38db284-7cfe-4877-af4b-419561b62333 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:28.638514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d38db284-7cfe-4877-af4b-419561b62333 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:28.670608 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:25:28.771521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d38db284-7cfe-4877-af4b-419561b62333 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:28.779347 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d38db284-7cfe-4877-af4b-419561b62333 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f" status: 200 len: 1504 microversion: 2.1 time: 0.154197 Jul 25 13:25:28.779924 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3054/6179] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:28 2022] GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:29.801258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-300924c9-3cef-4fc6-83eb-ad9f4de15a2d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:29.801994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-300924c9-3cef-4fc6-83eb-ad9f4de15a2d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 8f313507-a163-454b-9fcd-81e0091f963f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:29.809360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-300924c9-3cef-4fc6-83eb-ad9f4de15a2d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:29.809812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-300924c9-3cef-4fc6-83eb-ad9f4de15a2d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:29.810638 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-300924c9-3cef-4fc6-83eb-ad9f4de15a2d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:29.811076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-300924c9-3cef-4fc6-83eb-ad9f4de15a2d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:29.944232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-300924c9-3cef-4fc6-83eb-ad9f4de15a2d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:29.952349 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-300924c9-3cef-4fc6-83eb-ad9f4de15a2d tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f" status: 200 len: 1504 microversion: 2.1 time: 0.155426 Jul 25 13:25:29.952913 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3126/6180] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:29 2022] GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:30.506375 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-d89e809b-924d-4c4c-8517-4b33102e82e9 req-4f1b0fac-928a-460e-8a80-1878281022df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f313507-a163-454b-9fcd-81e0091f963f", "name": "network-vif-deleted", "tag": "c9dd6d72-8bc0-48f7-8344-ffc31ff8fa9e"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:25:30.517912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d89e809b-924d-4c4c-8517-4b33102e82e9 req-4f1b0fac-928a-460e-8a80-1878281022df service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:30.518656 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d89e809b-924d-4c4c-8517-4b33102e82e9 req-4f1b0fac-928a-460e-8a80-1878281022df service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:30.534574 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-d89e809b-924d-4c4c-8517-4b33102e82e9 req-4f1b0fac-928a-460e-8a80-1878281022df service nova] Creating event network-vif-deleted:c9dd6d72-8bc0-48f7-8344-ffc31ff8fa9e for instance 8f313507-a163-454b-9fcd-81e0091f963f on n-h1-848886-15 Jul 25 13:25:30.539902 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-d89e809b-924d-4c4c-8517-4b33102e82e9 req-4f1b0fac-928a-460e-8a80-1878281022df service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038152 Jul 25 13:25:30.540529 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3055/6181] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:25:30.972745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3b789233-6c8e-455a-817a-2b81f33ce8f6 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:30.974433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3b789233-6c8e-455a-817a-2b81f33ce8f6 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 8f313507-a163-454b-9fcd-81e0091f963f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:30.981603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b789233-6c8e-455a-817a-2b81f33ce8f6 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:30.982329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b789233-6c8e-455a-817a-2b81f33ce8f6 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:30.983111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b789233-6c8e-455a-817a-2b81f33ce8f6 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:30.983585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b789233-6c8e-455a-817a-2b81f33ce8f6 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:30.997581 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-3b789233-6c8e-455a-817a-2b81f33ce8f6 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] HTTP exception thrown: Instance 8f313507-a163-454b-9fcd-81e0091f963f could not be found. Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3b789233-6c8e-455a-817a-2b81f33ce8f6 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Request method failure captured: Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f HTTP/1.1 Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pm82hltFs_7pdUoiIe9N9zGpgtpFBbqtp6ehFYspLmq9u1CY6xjsosGfnGXOjDm3CApUYbU2NVK6i2yDuF4KhomY-NDQDIuDbASRHFQzn9ddNlOzEiMq_j4dK4b0pTeUTYc-vRfJwMc1VKtjMCxYyYF4xco8WnX5eLhL5p3SvC70-g Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 3ddd5037be2f4c9f837cee2dcc0cf1ca Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-VolumesActionsTest-999649132 Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3ddd5037be2f4c9f837cee2dcc0cf1ca", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3ddd5037be2f4c9f837cee2dcc0cf1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3ddd5037be2f4c9f837cee2dcc0cf1ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3ddd5037be2f4c9f837cee2dcc0cf1ca"}]}] Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-VolumesActionsTest-999649132 Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 3ddd5037be2f4c9f837cee2dcc0cf1ca Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-VolumesActionsTest-999649132 Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-VolumesActionsTest-999649132-project Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 044aae1313724b3285a9d81e5a6ae420 Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-VolumesActionsTest-999649132-project Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 8f313507-a163-454b-9fcd-81e0091f963f could not be found. Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '8f313507-a163-454b-9fcd-81e0091f963f'} Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f313507-a163-454b-9fcd-81e0091f963f could not be found. Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f313507-a163-454b-9fcd-81e0091f963f could not be found. Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:25:30.999339 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:25:31.014794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:25:31.014794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:25:31.014794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:25:31.014794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:25:31.014794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:25:31.014794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f313507-a163-454b-9fcd-81e0091f963f could not be found. Jul 25 13:25:31.014794 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:25:31.014794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3b789233-6c8e-455a-817a-2b81f33ce8f6 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Returning 404 to user: Instance 8f313507-a163-454b-9fcd-81e0091f963f could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:25:31.014794 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3b789233-6c8e-455a-817a-2b81f33ce8f6 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f" status: 404 len: 111 microversion: 2.1 time: 0.032076 Jul 25 13:25:31.014794 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3127/6182] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:30 2022] GET /compute/v2.1/servers/8f313507-a163-454b-9fcd-81e0091f963f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 13:25:31.058204 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c5e1c8c5-0b43-414f-9815-316515a2f5f2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-551944965", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "c4a09743-80ae-4737-bd90-72f586418451"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:25:31.110881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-c5e1c8c5-0b43-414f-9815-316515a2f5f2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] validate_networks() for [('c4a09743-80ae-4737-bd90-72f586418451', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:25:31.786759 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c5e1c8c5-0b43-414f-9815-316515a2f5f2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:25:31.787439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c5e1c8c5-0b43-414f-9815-316515a2f5f2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:25:31.787749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c5e1c8c5-0b43-414f-9815-316515a2f5f2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:25:31.788176 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c5e1c8c5-0b43-414f-9815-316515a2f5f2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:25:31.788605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-c5e1c8c5-0b43-414f-9815-316515a2f5f2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:25:31.798328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5e1c8c5-0b43-414f-9815-316515a2f5f2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:31.798793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5e1c8c5-0b43-414f-9815-316515a2f5f2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:31.799620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5e1c8c5-0b43-414f-9815-316515a2f5f2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:31.800052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c5e1c8c5-0b43-414f-9815-316515a2f5f2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:31.824452 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-c5e1c8c5-0b43-414f-9815-316515a2f5f2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Getting quotas for project 3ddd5037be2f4c9f837cee2dcc0cf1ca. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:25:31.830084 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-c5e1c8c5-0b43-414f-9815-316515a2f5f2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Getting quotas for user 044aae1313724b3285a9d81e5a6ae420 and project 3ddd5037be2f4c9f837cee2dcc0cf1ca. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:25:31.843142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c5e1c8c5-0b43-414f-9815-316515a2f5f2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:25:31.845558 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c5e1c8c5-0b43-414f-9815-316515a2f5f2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 9bca23f2-12df-43eb-9b1b-c816f012c66f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:25:31.890861 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c5e1c8c5-0b43-414f-9815-316515a2f5f2 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.837004 Jul 25 13:25:31.891523 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3056/6183] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:25:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:25:31.902701 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b53d52be-4971-40fb-b1c3-51d72e078190 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:31.903449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b53d52be-4971-40fb-b1c3-51d72e078190 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 9bca23f2-12df-43eb-9b1b-c816f012c66f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:31.973333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b53d52be-4971-40fb-b1c3-51d72e078190 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:31.983403 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b53d52be-4971-40fb-b1c3-51d72e078190 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f" status: 200 len: 1213 microversion: 2.1 time: 0.084657 Jul 25 13:25:31.984915 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3128/6184] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:31 2022] GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:33.005663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-563af11f-33f2-485f-be85-85920a445f76 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:33.006426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-563af11f-33f2-485f-be85-85920a445f76 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 9bca23f2-12df-43eb-9b1b-c816f012c66f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:33.013483 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-563af11f-33f2-485f-be85-85920a445f76 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:33.013982 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-563af11f-33f2-485f-be85-85920a445f76 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:33.014776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-563af11f-33f2-485f-be85-85920a445f76 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:33.015236 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-563af11f-33f2-485f-be85-85920a445f76 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:33.082842 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-563af11f-33f2-485f-be85-85920a445f76 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:33.094001 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-563af11f-33f2-485f-be85-85920a445f76 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f" status: 200 len: 1271 microversion: 2.1 time: 0.092933 Jul 25 13:25:33.095163 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3057/6185] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:32 2022] GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:34.117111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b50702f3-2554-4e21-9687-02c4642a6662 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:34.118147 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b50702f3-2554-4e21-9687-02c4642a6662 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 9bca23f2-12df-43eb-9b1b-c816f012c66f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:34.139979 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b50702f3-2554-4e21-9687-02c4642a6662 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:34.140439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b50702f3-2554-4e21-9687-02c4642a6662 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:34.141262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b50702f3-2554-4e21-9687-02c4642a6662 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:34.141711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b50702f3-2554-4e21-9687-02c4642a6662 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:34.245239 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-2d2d04dd-42c6-4bc2-8ff9-5dd0fac89470 req-410af5aa-0e99-4700-a05e-82c0e08e860e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bca23f2-12df-43eb-9b1b-c816f012c66f", "tag": "a1b1ddd9-387f-4d6e-ba42-7ad1011866db"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:25:34.259472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2d2d04dd-42c6-4bc2-8ff9-5dd0fac89470 req-410af5aa-0e99-4700-a05e-82c0e08e860e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:34.260340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2d2d04dd-42c6-4bc2-8ff9-5dd0fac89470 req-410af5aa-0e99-4700-a05e-82c0e08e860e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:34.283538 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-2d2d04dd-42c6-4bc2-8ff9-5dd0fac89470 req-410af5aa-0e99-4700-a05e-82c0e08e860e service nova] Creating event network-changed:a1b1ddd9-387f-4d6e-ba42-7ad1011866db for instance 9bca23f2-12df-43eb-9b1b-c816f012c66f on n-h1-848886-15 Jul 25 13:25:34.290494 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-2d2d04dd-42c6-4bc2-8ff9-5dd0fac89470 req-410af5aa-0e99-4700-a05e-82c0e08e860e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049978 Jul 25 13:25:34.292788 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3058/6186] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:25:34.312500 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b50702f3-2554-4e21-9687-02c4642a6662 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:34.323268 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b50702f3-2554-4e21-9687-02c4642a6662 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f" status: 200 len: 1313 microversion: 2.1 time: 0.211008 Jul 25 13:25:34.324448 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3129/6187] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:34 2022] GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:35.346022 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b944360d-60ca-4989-bdbd-16e4c0a76089 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:35.346727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b944360d-60ca-4989-bdbd-16e4c0a76089 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 9bca23f2-12df-43eb-9b1b-c816f012c66f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:35.353977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b944360d-60ca-4989-bdbd-16e4c0a76089 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:35.354437 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b944360d-60ca-4989-bdbd-16e4c0a76089 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:35.355210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b944360d-60ca-4989-bdbd-16e4c0a76089 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:35.355653 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b944360d-60ca-4989-bdbd-16e4c0a76089 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:35.493865 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b944360d-60ca-4989-bdbd-16e4c0a76089 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:35.503456 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b944360d-60ca-4989-bdbd-16e4c0a76089 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f" status: 200 len: 1313 microversion: 2.1 time: 0.162506 Jul 25 13:25:35.504331 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3059/6188] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:35 2022] GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:36.524574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-306d7f6a-3bbf-4a9b-8040-d547b461d72c tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:36.525194 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-306d7f6a-3bbf-4a9b-8040-d547b461d72c tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 9bca23f2-12df-43eb-9b1b-c816f012c66f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:36.532357 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-306d7f6a-3bbf-4a9b-8040-d547b461d72c tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:36.532808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-306d7f6a-3bbf-4a9b-8040-d547b461d72c tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:36.533569 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-306d7f6a-3bbf-4a9b-8040-d547b461d72c tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:36.534036 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-306d7f6a-3bbf-4a9b-8040-d547b461d72c tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:36.663594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-306d7f6a-3bbf-4a9b-8040-d547b461d72c tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:36.671408 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-306d7f6a-3bbf-4a9b-8040-d547b461d72c tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f" status: 200 len: 1313 microversion: 2.1 time: 0.150749 Jul 25 13:25:36.672015 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3130/6189] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:36 2022] GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:37.692476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8311d540-919a-4d9d-a96e-ef58e9b8f7fd tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:37.693150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8311d540-919a-4d9d-a96e-ef58e9b8f7fd tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 9bca23f2-12df-43eb-9b1b-c816f012c66f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:37.699878 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8311d540-919a-4d9d-a96e-ef58e9b8f7fd tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:37.700342 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8311d540-919a-4d9d-a96e-ef58e9b8f7fd tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:37.701120 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8311d540-919a-4d9d-a96e-ef58e9b8f7fd tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:37.701553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8311d540-919a-4d9d-a96e-ef58e9b8f7fd tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:37.831826 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8311d540-919a-4d9d-a96e-ef58e9b8f7fd tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:37.839518 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8311d540-919a-4d9d-a96e-ef58e9b8f7fd tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f" status: 200 len: 1313 microversion: 2.1 time: 0.151190 Jul 25 13:25:37.840193 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3060/6190] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:37 2022] GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:38.862266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b54c46a8-ce95-499f-8ea7-79fe7f3edb8f tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:38.862935 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b54c46a8-ce95-499f-8ea7-79fe7f3edb8f tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 9bca23f2-12df-43eb-9b1b-c816f012c66f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:38.870211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b54c46a8-ce95-499f-8ea7-79fe7f3edb8f tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:38.870697 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b54c46a8-ce95-499f-8ea7-79fe7f3edb8f tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:38.871441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b54c46a8-ce95-499f-8ea7-79fe7f3edb8f tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:38.871877 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b54c46a8-ce95-499f-8ea7-79fe7f3edb8f tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:39.011765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b54c46a8-ce95-499f-8ea7-79fe7f3edb8f tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:39.019541 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b54c46a8-ce95-499f-8ea7-79fe7f3edb8f tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f" status: 200 len: 1313 microversion: 2.1 time: 0.161818 Jul 25 13:25:39.020168 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3131/6191] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:38 2022] GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:40.046494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-34d64d3a-cea5-47b6-9107-74dc8081b3a4 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:40.047160 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-34d64d3a-cea5-47b6-9107-74dc8081b3a4 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 9bca23f2-12df-43eb-9b1b-c816f012c66f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:40.058691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-34d64d3a-cea5-47b6-9107-74dc8081b3a4 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:40.059336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-34d64d3a-cea5-47b6-9107-74dc8081b3a4 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:40.060477 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-34d64d3a-cea5-47b6-9107-74dc8081b3a4 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:40.060838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-34d64d3a-cea5-47b6-9107-74dc8081b3a4 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:40.083707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-fce6328a-b774-45aa-84c0-1c2e5f336d1d req-7d17ffa0-602a-4550-bebe-c0bea3265def service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bca23f2-12df-43eb-9b1b-c816f012c66f", "name": "network-vif-plugged", "status": "completed", "tag": "a1b1ddd9-387f-4d6e-ba42-7ad1011866db"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:25:40.101954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fce6328a-b774-45aa-84c0-1c2e5f336d1d req-7d17ffa0-602a-4550-bebe-c0bea3265def service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:40.102956 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fce6328a-b774-45aa-84c0-1c2e5f336d1d req-7d17ffa0-602a-4550-bebe-c0bea3265def service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:40.129415 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-fce6328a-b774-45aa-84c0-1c2e5f336d1d req-7d17ffa0-602a-4550-bebe-c0bea3265def service nova] Creating event network-vif-plugged:a1b1ddd9-387f-4d6e-ba42-7ad1011866db for instance 9bca23f2-12df-43eb-9b1b-c816f012c66f on n-h1-848886-15 Jul 25 13:25:40.141341 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-fce6328a-b774-45aa-84c0-1c2e5f336d1d req-7d17ffa0-602a-4550-bebe-c0bea3265def service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065360 Jul 25 13:25:40.142294 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3132/6192] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:25:40.240640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-34d64d3a-cea5-47b6-9107-74dc8081b3a4 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:40.250137 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-34d64d3a-cea5-47b6-9107-74dc8081b3a4 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f" status: 200 len: 1313 microversion: 2.1 time: 0.213151 Jul 25 13:25:40.250727 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3061/6193] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:40 2022] GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:41.272408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a7124132-ef7b-4411-a29a-baa76bd7f88c tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:41.273113 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a7124132-ef7b-4411-a29a-baa76bd7f88c tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 9bca23f2-12df-43eb-9b1b-c816f012c66f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:41.279821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7124132-ef7b-4411-a29a-baa76bd7f88c tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:41.280281 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7124132-ef7b-4411-a29a-baa76bd7f88c tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:41.281055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7124132-ef7b-4411-a29a-baa76bd7f88c tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:41.281482 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7124132-ef7b-4411-a29a-baa76bd7f88c tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:41.420220 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a7124132-ef7b-4411-a29a-baa76bd7f88c tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:41.427984 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a7124132-ef7b-4411-a29a-baa76bd7f88c tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f" status: 200 len: 1313 microversion: 2.1 time: 0.160817 Jul 25 13:25:41.428801 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3133/6194] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:41 2022] GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:42.449653 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a07064c8-2340-4841-be37-8acb57f128bf tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:42.450075 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a07064c8-2340-4841-be37-8acb57f128bf tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 9bca23f2-12df-43eb-9b1b-c816f012c66f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:42.453119 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:25:42.453897 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:25:42.460147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a07064c8-2340-4841-be37-8acb57f128bf tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:42.460611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a07064c8-2340-4841-be37-8acb57f128bf tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:42.461412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a07064c8-2340-4841-be37-8acb57f128bf tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:42.461875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a07064c8-2340-4841-be37-8acb57f128bf tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:42.596106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a07064c8-2340-4841-be37-8acb57f128bf tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:42.604239 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a07064c8-2340-4841-be37-8acb57f128bf tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f" status: 200 len: 1497 microversion: 2.1 time: 0.158996 Jul 25 13:25:42.604936 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3062/6195] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:42 2022] GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:43.035582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7025e205-8558-4dda-93d9-caa662b40c2b tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:43.036164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7025e205-8558-4dda-93d9-caa662b40c2b tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 9bca23f2-12df-43eb-9b1b-c816f012c66f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:43.038415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:25:43.045233 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7025e205-8558-4dda-93d9-caa662b40c2b tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:43.045688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7025e205-8558-4dda-93d9-caa662b40c2b tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:43.046534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7025e205-8558-4dda-93d9-caa662b40c2b tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:43.046976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7025e205-8558-4dda-93d9-caa662b40c2b tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:43.076517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7025e205-8558-4dda-93d9-caa662b40c2b tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 9bca23f2-12df-43eb-9b1b-c816f012c66f] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:25:43.170004 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7025e205-8558-4dda-93d9-caa662b40c2b tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f" status: 204 len: 0 microversion: 2.1 time: 0.138062 Jul 25 13:25:43.170602 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3134/6196] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:25:43 2022] DELETE /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:25:43.178697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-46eb80ca-806d-44cb-b97c-db2ed4da4673 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:43.179317 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-46eb80ca-806d-44cb-b97c-db2ed4da4673 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 9bca23f2-12df-43eb-9b1b-c816f012c66f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:43.185523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-46eb80ca-806d-44cb-b97c-db2ed4da4673 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:43.186024 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-46eb80ca-806d-44cb-b97c-db2ed4da4673 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:43.186910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-46eb80ca-806d-44cb-b97c-db2ed4da4673 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:43.187363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-46eb80ca-806d-44cb-b97c-db2ed4da4673 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:43.316274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-46eb80ca-806d-44cb-b97c-db2ed4da4673 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:43.324248 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-46eb80ca-806d-44cb-b97c-db2ed4da4673 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f" status: 200 len: 1503 microversion: 2.1 time: 0.149358 Jul 25 13:25:43.324803 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3063/6197] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:43 2022] GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:44.345383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0903f42c-89d7-468a-9729-9b316e1dd8c1 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:44.346127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0903f42c-89d7-468a-9729-9b316e1dd8c1 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 9bca23f2-12df-43eb-9b1b-c816f012c66f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:44.353589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0903f42c-89d7-468a-9729-9b316e1dd8c1 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:44.354082 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0903f42c-89d7-468a-9729-9b316e1dd8c1 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:44.354841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0903f42c-89d7-468a-9729-9b316e1dd8c1 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:44.355275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0903f42c-89d7-468a-9729-9b316e1dd8c1 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:44.494330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0903f42c-89d7-468a-9729-9b316e1dd8c1 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:44.496647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:25:44.508292 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0903f42c-89d7-468a-9729-9b316e1dd8c1 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f" status: 200 len: 1503 microversion: 2.1 time: 0.167095 Jul 25 13:25:44.508938 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3135/6198] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:44 2022] GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:45.243271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-4c95a55f-7176-4f1e-bb17-2a77d879f52a req-13628d42-b74b-43b8-b645-b5f77a12ca5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bca23f2-12df-43eb-9b1b-c816f012c66f", "name": "network-vif-deleted", "tag": "a1b1ddd9-387f-4d6e-ba42-7ad1011866db"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:25:45.254486 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4c95a55f-7176-4f1e-bb17-2a77d879f52a req-13628d42-b74b-43b8-b645-b5f77a12ca5b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:45.254961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4c95a55f-7176-4f1e-bb17-2a77d879f52a req-13628d42-b74b-43b8-b645-b5f77a12ca5b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:45.266742 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-4c95a55f-7176-4f1e-bb17-2a77d879f52a req-13628d42-b74b-43b8-b645-b5f77a12ca5b service nova] Creating event network-vif-deleted:a1b1ddd9-387f-4d6e-ba42-7ad1011866db for instance 9bca23f2-12df-43eb-9b1b-c816f012c66f on n-h1-848886-15 Jul 25 13:25:45.272354 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-4c95a55f-7176-4f1e-bb17-2a77d879f52a req-13628d42-b74b-43b8-b645-b5f77a12ca5b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032677 Jul 25 13:25:45.273008 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3064/6199] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:25:45.530495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-49c84731-102e-4647-9b40-b2f08965f28e tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:45.531128 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-49c84731-102e-4647-9b40-b2f08965f28e tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 9bca23f2-12df-43eb-9b1b-c816f012c66f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:45.538779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49c84731-102e-4647-9b40-b2f08965f28e tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:45.539236 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49c84731-102e-4647-9b40-b2f08965f28e tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:45.540008 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49c84731-102e-4647-9b40-b2f08965f28e tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:45.540445 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49c84731-102e-4647-9b40-b2f08965f28e tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:45.574144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49c84731-102e-4647-9b40-b2f08965f28e tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:45.574594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49c84731-102e-4647-9b40-b2f08965f28e tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:45.575102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-49c84731-102e-4647-9b40-b2f08965f28e tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lazy-loading 'fault' on Instance uuid 9bca23f2-12df-43eb-9b1b-c816f012c66f {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:25:45.622381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-49c84731-102e-4647-9b40-b2f08965f28e tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aae1313724b3285a9d81e5a6ae420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd5037be2f4c9f837cee2dcc0cf1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:25:45.630808 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-49c84731-102e-4647-9b40-b2f08965f28e tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f" status: 200 len: 1303 microversion: 2.1 time: 0.104906 Jul 25 13:25:45.631364 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3136/6200] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:45 2022] GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:25:46.653171 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-24f3923c-75aa-49f4-9d52-0e85113ca743 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:25:46.653904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-24f3923c-75aa-49f4-9d52-0e85113ca743 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] [instance: 9bca23f2-12df-43eb-9b1b-c816f012c66f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:25:46.660687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-24f3923c-75aa-49f4-9d52-0e85113ca743 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:46.661160 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-24f3923c-75aa-49f4-9d52-0e85113ca743 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:46.661974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-24f3923c-75aa-49f4-9d52-0e85113ca743 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:25:46.662432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-24f3923c-75aa-49f4-9d52-0e85113ca743 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:25:46.676647 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-24f3923c-75aa-49f4-9d52-0e85113ca743 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] HTTP exception thrown: Instance 9bca23f2-12df-43eb-9b1b-c816f012c66f could not be found. Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-24f3923c-75aa-49f4-9d52-0e85113ca743 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Request method failure captured: Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f HTTP/1.1 Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pm82hltFs_7pdUoiIe9N9zGpgtpFBbqtp6ehFYspLmq9u1CY6xjsosGfnGXOjDm3CApUYbU2NVK6i2yDuF4KhomY-NDQDIuDbASRHFQzn9ddNlOzEiMq_j4dK4b0pTeUTYc-vRfJwMc1VKtjMCxYyYF4xco8WnX5eLhL5p3SvC70-g Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 3ddd5037be2f4c9f837cee2dcc0cf1ca Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-VolumesActionsTest-999649132 Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3ddd5037be2f4c9f837cee2dcc0cf1ca", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3ddd5037be2f4c9f837cee2dcc0cf1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3ddd5037be2f4c9f837cee2dcc0cf1ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3ddd5037be2f4c9f837cee2dcc0cf1ca"}]}] Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-VolumesActionsTest-999649132 Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 3ddd5037be2f4c9f837cee2dcc0cf1ca Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-VolumesActionsTest-999649132 Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-VolumesActionsTest-999649132-project Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 044aae1313724b3285a9d81e5a6ae420 Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-VolumesActionsTest-999649132-project Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 9bca23f2-12df-43eb-9b1b-c816f012c66f could not be found. Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '9bca23f2-12df-43eb-9b1b-c816f012c66f'} Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bca23f2-12df-43eb-9b1b-c816f012c66f could not be found. Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bca23f2-12df-43eb-9b1b-c816f012c66f could not be found. Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:25:46.678478 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:25:46.683045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:25:46.683045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:25:46.683045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:25:46.683045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:25:46.683045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:25:46.683045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bca23f2-12df-43eb-9b1b-c816f012c66f could not be found. Jul 25 13:25:46.683045 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:25:46.683045 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-24f3923c-75aa-49f4-9d52-0e85113ca743 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] Returning 404 to user: Instance 9bca23f2-12df-43eb-9b1b-c816f012c66f could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:25:46.683045 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-24f3923c-75aa-49f4-9d52-0e85113ca743 tempest-VolumesActionsTest-999649132 tempest-VolumesActionsTest-999649132-project] 10.222.0.49 "GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f" status: 404 len: 111 microversion: 2.1 time: 0.032010 Jul 25 13:25:46.683045 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3065/6201] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:25:46 2022] GET /compute/v2.1/servers/9bca23f2-12df-43eb-9b1b-c816f012c66f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:26:17.914421 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:26:17.915737 n-d-848886-15 devstack@n-api.service[125883]: Mon Jul 25 13:26:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:27:02.341734 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:27:02.342516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=9 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:27:02.346717 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-428198f1-355b-49ba-b964-4421a9b97a6f tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Action: 'create', calling method: .version_select at 0x7efcf8969550>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1884331628", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTWweqWqG1Ezqi/1Yco/09mSdxp/BuKThqZ56mG8N06jpjtMnwbfTHHm5s9u9jjLH2wZYO7S2Iz2TFwCeaEGBAzryC2c+p6Tpj+lPnpudP+VcJurNLpvONiYzBs4vdXNw=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:27:02.365036 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-428198f1-355b-49ba-b964-4421a9b97a6f tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Getting quotas for project 27f978ba1b1e474ca46b33a1acb68c5c. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:27:02.370150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-428198f1-355b-49ba-b964-4421a9b97a6f tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Getting quotas for user ed612be4e5b04d8381060e51a368def7 and project 27f978ba1b1e474ca46b33a1acb68c5c. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:27:02.401260 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-428198f1-355b-49ba-b964-4421a9b97a6f tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.061024 Jul 25 13:27:02.402110 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3137/6202] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:27:02 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:27:03.442382 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:27:03.443256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=78 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:27:03.448753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2250df60-cb46-456e-9ba9-bd4a127eb72a tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-400516116", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "65957e2f-ccfc-4da0-b16d-ae37ba65252f", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1884331628", "security_groups": [{"name": "tempest-secgroup-smoke-1507106277"}], "networks": [{"uuid": "9ac6e802-552e-443c-b952-2bd703daac40"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:27:03.563939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-2250df60-cb46-456e-9ba9-bd4a127eb72a tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] validate_networks() for [('9ac6e802-552e-443c-b952-2bd703daac40', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:27:03.931072 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2250df60-cb46-456e-9ba9-bd4a127eb72a tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:27:03.931585 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2250df60-cb46-456e-9ba9-bd4a127eb72a tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:27:03.932166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2250df60-cb46-456e-9ba9-bd4a127eb72a tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:27:03.932563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2250df60-cb46-456e-9ba9-bd4a127eb72a tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:27:03.933013 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-2250df60-cb46-456e-9ba9-bd4a127eb72a tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:27:03.942708 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2250df60-cb46-456e-9ba9-bd4a127eb72a tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:03.943082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2250df60-cb46-456e-9ba9-bd4a127eb72a tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:03.943899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2250df60-cb46-456e-9ba9-bd4a127eb72a tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:03.944354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2250df60-cb46-456e-9ba9-bd4a127eb72a tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:03.961383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-2250df60-cb46-456e-9ba9-bd4a127eb72a tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Getting quotas for project 27f978ba1b1e474ca46b33a1acb68c5c. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:27:03.966795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-2250df60-cb46-456e-9ba9-bd4a127eb72a tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Getting quotas for user ed612be4e5b04d8381060e51a368def7 and project 27f978ba1b1e474ca46b33a1acb68c5c. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:27:04.033515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2250df60-cb46-456e-9ba9-bd4a127eb72a tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:27:04.035827 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2250df60-cb46-456e-9ba9-bd4a127eb72a tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='65957e2f-ccfc-4da0-b16d-ae37ba65252f',volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:27:04.176570 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2250df60-cb46-456e-9ba9-bd4a127eb72a tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.737258 Jul 25 13:27:04.177221 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3066/6203] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:27:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:27:04.189129 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-808092c0-ab52-4910-b945-3ae7d4ee963a tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:27:04.189709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-808092c0-ab52-4910-b945-3ae7d4ee963a tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:27:04.248357 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-808092c0-ab52-4910-b945-3ae7d4ee963a tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed612be4e5b04d8381060e51a368def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f978ba1b1e474ca46b33a1acb68c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:27:04.255476 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-808092c0-ab52-4910-b945-3ae7d4ee963a tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 200 len: 1098 microversion: 2.1 time: 0.071206 Jul 25 13:27:04.266682 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3138/6204] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:27:04 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 1098 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:27:05.278013 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d0b13fdf-5b33-4a04-b031-1827f06cf279 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:27:05.278829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d0b13fdf-5b33-4a04-b031-1827f06cf279 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:27:05.285792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d0b13fdf-5b33-4a04-b031-1827f06cf279 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:05.286404 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d0b13fdf-5b33-4a04-b031-1827f06cf279 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:05.287285 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d0b13fdf-5b33-4a04-b031-1827f06cf279 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:05.288103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d0b13fdf-5b33-4a04-b031-1827f06cf279 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:05.354256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d0b13fdf-5b33-4a04-b031-1827f06cf279 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed612be4e5b04d8381060e51a368def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f978ba1b1e474ca46b33a1acb68c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:27:05.362276 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d0b13fdf-5b33-4a04-b031-1827f06cf279 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 200 len: 1204 microversion: 2.1 time: 0.089782 Jul 25 13:27:05.363675 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3067/6205] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:27:05 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 1204 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:27:06.384613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a569afcc-5eb4-48bb-a1b1-24dca16aa0f7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:27:06.385338 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a569afcc-5eb4-48bb-a1b1-24dca16aa0f7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:27:06.393532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a569afcc-5eb4-48bb-a1b1-24dca16aa0f7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:06.393532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a569afcc-5eb4-48bb-a1b1-24dca16aa0f7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:06.393880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a569afcc-5eb4-48bb-a1b1-24dca16aa0f7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:06.394369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a569afcc-5eb4-48bb-a1b1-24dca16aa0f7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:06.570606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a569afcc-5eb4-48bb-a1b1-24dca16aa0f7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed612be4e5b04d8381060e51a368def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f978ba1b1e474ca46b33a1acb68c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:27:06.581917 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a569afcc-5eb4-48bb-a1b1-24dca16aa0f7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 200 len: 1282 microversion: 2.1 time: 0.201471 Jul 25 13:27:06.582820 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3139/6206] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:27:06 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 1282 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:27:06.692361 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-2537efe2-59bd-4a8f-bb49-9dd79616159b req-f79c3302-9e66-459f-a3fe-82a66cbf9a44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ad95073-d323-45ab-b385-7d63fb17701e", "tag": "ff697cb5-22c0-4780-b579-92a742080af1"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:27:06.726787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2537efe2-59bd-4a8f-bb49-9dd79616159b req-f79c3302-9e66-459f-a3fe-82a66cbf9a44 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:06.727256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2537efe2-59bd-4a8f-bb49-9dd79616159b req-f79c3302-9e66-459f-a3fe-82a66cbf9a44 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:06.751580 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-2537efe2-59bd-4a8f-bb49-9dd79616159b req-f79c3302-9e66-459f-a3fe-82a66cbf9a44 service nova] Creating event network-changed:ff697cb5-22c0-4780-b579-92a742080af1 for instance 8ad95073-d323-45ab-b385-7d63fb17701e on n-h1-848886-15 Jul 25 13:27:06.757550 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-2537efe2-59bd-4a8f-bb49-9dd79616159b req-f79c3302-9e66-459f-a3fe-82a66cbf9a44 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070593 Jul 25 13:27:06.758711 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3068/6207] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:27:07.604145 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-57cde291-bf9b-4205-afe6-1aae0469d337 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:27:07.605078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-57cde291-bf9b-4205-afe6-1aae0469d337 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:27:07.612450 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57cde291-bf9b-4205-afe6-1aae0469d337 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:07.613035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57cde291-bf9b-4205-afe6-1aae0469d337 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:07.613974 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57cde291-bf9b-4205-afe6-1aae0469d337 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:07.614527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57cde291-bf9b-4205-afe6-1aae0469d337 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:07.765144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-57cde291-bf9b-4205-afe6-1aae0469d337 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed612be4e5b04d8381060e51a368def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f978ba1b1e474ca46b33a1acb68c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:27:07.773142 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-57cde291-bf9b-4205-afe6-1aae0469d337 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 200 len: 1282 microversion: 2.1 time: 0.172944 Jul 25 13:27:07.773915 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3140/6208] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:27:07 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 1282 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:27:08.796395 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-71b75234-0809-48a1-9866-81a77451e7b7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:27:08.797106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-71b75234-0809-48a1-9866-81a77451e7b7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:27:08.803958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-71b75234-0809-48a1-9866-81a77451e7b7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:08.804423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-71b75234-0809-48a1-9866-81a77451e7b7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:08.805198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-71b75234-0809-48a1-9866-81a77451e7b7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:08.805642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-71b75234-0809-48a1-9866-81a77451e7b7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:08.937112 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-71b75234-0809-48a1-9866-81a77451e7b7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed612be4e5b04d8381060e51a368def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f978ba1b1e474ca46b33a1acb68c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:27:08.944915 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-71b75234-0809-48a1-9866-81a77451e7b7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 200 len: 1282 microversion: 2.1 time: 0.154095 Jul 25 13:27:08.945650 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3069/6209] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:27:08 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 1282 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:27:09.967369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c21dee64-85cc-4c5c-8bdf-1359fbba4f6c tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:27:09.967914 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c21dee64-85cc-4c5c-8bdf-1359fbba4f6c tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:27:09.975804 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c21dee64-85cc-4c5c-8bdf-1359fbba4f6c tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:09.976256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c21dee64-85cc-4c5c-8bdf-1359fbba4f6c tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:09.977046 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c21dee64-85cc-4c5c-8bdf-1359fbba4f6c tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:09.977485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c21dee64-85cc-4c5c-8bdf-1359fbba4f6c tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:10.116917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c21dee64-85cc-4c5c-8bdf-1359fbba4f6c tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed612be4e5b04d8381060e51a368def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f978ba1b1e474ca46b33a1acb68c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:27:10.124905 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c21dee64-85cc-4c5c-8bdf-1359fbba4f6c tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 200 len: 1282 microversion: 2.1 time: 0.162341 Jul 25 13:27:10.125576 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3141/6210] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:27:09 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 1282 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:27:11.150272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-05592c80-a092-4c87-bf28-700ca529af93 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:27:11.151326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-05592c80-a092-4c87-bf28-700ca529af93 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:27:11.159344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05592c80-a092-4c87-bf28-700ca529af93 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:11.159811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05592c80-a092-4c87-bf28-700ca529af93 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:11.160595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05592c80-a092-4c87-bf28-700ca529af93 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:11.161050 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-05592c80-a092-4c87-bf28-700ca529af93 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:11.298009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-05592c80-a092-4c87-bf28-700ca529af93 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed612be4e5b04d8381060e51a368def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f978ba1b1e474ca46b33a1acb68c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:27:11.305628 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-05592c80-a092-4c87-bf28-700ca529af93 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 200 len: 1270 microversion: 2.1 time: 0.162006 Jul 25 13:27:11.306236 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3070/6211] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:27:11 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:27:12.331266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9795c6e4-be88-4244-a43e-a4c607a0bdf9 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:27:12.332333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9795c6e4-be88-4244-a43e-a4c607a0bdf9 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:27:12.343888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9795c6e4-be88-4244-a43e-a4c607a0bdf9 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:12.344612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9795c6e4-be88-4244-a43e-a4c607a0bdf9 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:12.345913 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9795c6e4-be88-4244-a43e-a4c607a0bdf9 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:12.346845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9795c6e4-be88-4244-a43e-a4c607a0bdf9 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:12.483525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9795c6e4-be88-4244-a43e-a4c607a0bdf9 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed612be4e5b04d8381060e51a368def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f978ba1b1e474ca46b33a1acb68c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:27:12.491629 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9795c6e4-be88-4244-a43e-a4c607a0bdf9 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 200 len: 1270 microversion: 2.1 time: 0.167036 Jul 25 13:27:12.492214 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3142/6212] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:27:12 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:27:13.516597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-21927db0-7a62-4acc-b096-2bf35915db6f tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:27:13.517299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-21927db0-7a62-4acc-b096-2bf35915db6f tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:27:13.527316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-21927db0-7a62-4acc-b096-2bf35915db6f tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:13.527963 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-21927db0-7a62-4acc-b096-2bf35915db6f tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:13.528740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-21927db0-7a62-4acc-b096-2bf35915db6f tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:13.529218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-21927db0-7a62-4acc-b096-2bf35915db6f tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:13.676340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-21927db0-7a62-4acc-b096-2bf35915db6f tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed612be4e5b04d8381060e51a368def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f978ba1b1e474ca46b33a1acb68c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:27:13.684560 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-21927db0-7a62-4acc-b096-2bf35915db6f tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 200 len: 1270 microversion: 2.1 time: 0.173001 Jul 25 13:27:13.685293 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3071/6213] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:27:13 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 1270 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:27:14.706836 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9e62a70d-ca1c-4889-8971-858c55891e0c tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:27:14.707486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9e62a70d-ca1c-4889-8971-858c55891e0c tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:27:14.710717 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:27:14.718550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e62a70d-ca1c-4889-8971-858c55891e0c tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:14.719003 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e62a70d-ca1c-4889-8971-858c55891e0c tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:14.719783 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e62a70d-ca1c-4889-8971-858c55891e0c tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:14.720222 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e62a70d-ca1c-4889-8971-858c55891e0c tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:14.856372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9e62a70d-ca1c-4889-8971-858c55891e0c tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed612be4e5b04d8381060e51a368def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f978ba1b1e474ca46b33a1acb68c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:27:14.864313 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9e62a70d-ca1c-4889-8971-858c55891e0c tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 200 len: 1270 microversion: 2.1 time: 0.162806 Jul 25 13:27:14.864881 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3143/6214] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:27:14 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:27:15.885419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0842a78a-fcec-4b87-ae2a-28a40c226180 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:27:15.886103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0842a78a-fcec-4b87-ae2a-28a40c226180 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:27:15.888175 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:27:15.888852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:27:15.895734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0842a78a-fcec-4b87-ae2a-28a40c226180 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:15.896194 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0842a78a-fcec-4b87-ae2a-28a40c226180 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:15.897021 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0842a78a-fcec-4b87-ae2a-28a40c226180 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:15.897583 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0842a78a-fcec-4b87-ae2a-28a40c226180 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:16.050843 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0842a78a-fcec-4b87-ae2a-28a40c226180 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed612be4e5b04d8381060e51a368def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f978ba1b1e474ca46b33a1acb68c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:27:16.059096 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0842a78a-fcec-4b87-ae2a-28a40c226180 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 200 len: 1270 microversion: 2.1 time: 0.177727 Jul 25 13:27:16.059702 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3072/6215] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:27:15 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 1270 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:27:17.084154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7e2fd7ab-aa00-4936-ae75-a6900a2cdd32 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:27:17.085214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7e2fd7ab-aa00-4936-ae75-a6900a2cdd32 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:27:17.094417 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e2fd7ab-aa00-4936-ae75-a6900a2cdd32 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:17.094867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e2fd7ab-aa00-4936-ae75-a6900a2cdd32 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:17.095632 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e2fd7ab-aa00-4936-ae75-a6900a2cdd32 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:17.096067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7e2fd7ab-aa00-4936-ae75-a6900a2cdd32 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:17.229425 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7e2fd7ab-aa00-4936-ae75-a6900a2cdd32 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed612be4e5b04d8381060e51a368def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f978ba1b1e474ca46b33a1acb68c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:27:17.240885 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7e2fd7ab-aa00-4936-ae75-a6900a2cdd32 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 200 len: 1270 microversion: 2.1 time: 0.163050 Jul 25 13:27:17.241657 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3144/6216] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:27:17 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:27:18.268025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1c9ca102-e730-4df4-afb4-a1dc153d9098 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:27:18.268937 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1c9ca102-e730-4df4-afb4-a1dc153d9098 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:27:18.280882 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1c9ca102-e730-4df4-afb4-a1dc153d9098 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:18.281657 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1c9ca102-e730-4df4-afb4-a1dc153d9098 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:18.283005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1c9ca102-e730-4df4-afb4-a1dc153d9098 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:18.283760 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1c9ca102-e730-4df4-afb4-a1dc153d9098 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:18.422692 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1c9ca102-e730-4df4-afb4-a1dc153d9098 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed612be4e5b04d8381060e51a368def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f978ba1b1e474ca46b33a1acb68c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:27:18.430416 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1c9ca102-e730-4df4-afb4-a1dc153d9098 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 200 len: 1270 microversion: 2.1 time: 0.169220 Jul 25 13:27:18.430956 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3073/6217] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:27:18 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 1270 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:27:19.455629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fcb31504-147c-4bd1-a9ee-bc1b1ece7ac1 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:27:19.456543 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fcb31504-147c-4bd1-a9ee-bc1b1ece7ac1 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:27:19.467150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fcb31504-147c-4bd1-a9ee-bc1b1ece7ac1 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:19.467601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fcb31504-147c-4bd1-a9ee-bc1b1ece7ac1 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:19.468362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fcb31504-147c-4bd1-a9ee-bc1b1ece7ac1 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:19.468797 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fcb31504-147c-4bd1-a9ee-bc1b1ece7ac1 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:19.615001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fcb31504-147c-4bd1-a9ee-bc1b1ece7ac1 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed612be4e5b04d8381060e51a368def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f978ba1b1e474ca46b33a1acb68c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:27:19.623056 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fcb31504-147c-4bd1-a9ee-bc1b1ece7ac1 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 200 len: 1270 microversion: 2.1 time: 0.174027 Jul 25 13:27:19.623639 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3145/6218] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:27:19 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:27:20.547738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-0e17454b-ea4a-4779-87d7-f2047372ac48 req-14e796dd-6018-439c-a59b-44f45911bb43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad95073-d323-45ab-b385-7d63fb17701e", "name": "network-vif-plugged", "status": "completed", "tag": "ff697cb5-22c0-4780-b579-92a742080af1"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:27:20.559613 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0e17454b-ea4a-4779-87d7-f2047372ac48 req-14e796dd-6018-439c-a59b-44f45911bb43 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:20.560078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0e17454b-ea4a-4779-87d7-f2047372ac48 req-14e796dd-6018-439c-a59b-44f45911bb43 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:20.571662 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-0e17454b-ea4a-4779-87d7-f2047372ac48 req-14e796dd-6018-439c-a59b-44f45911bb43 service nova] Creating event network-vif-plugged:ff697cb5-22c0-4780-b579-92a742080af1 for instance 8ad95073-d323-45ab-b385-7d63fb17701e on n-h1-848886-15 Jul 25 13:27:20.576934 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-0e17454b-ea4a-4779-87d7-f2047372ac48 req-14e796dd-6018-439c-a59b-44f45911bb43 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033476 Jul 25 13:27:20.577795 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3074/6219] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:27:20.644435 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9f9d52bd-35c6-4a3d-bf2e-a0d9dbfbea7e tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:27:20.645624 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9f9d52bd-35c6-4a3d-bf2e-a0d9dbfbea7e tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:27:20.653214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f9d52bd-35c6-4a3d-bf2e-a0d9dbfbea7e tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:20.653654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f9d52bd-35c6-4a3d-bf2e-a0d9dbfbea7e tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:20.654456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f9d52bd-35c6-4a3d-bf2e-a0d9dbfbea7e tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:20.654882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9f9d52bd-35c6-4a3d-bf2e-a0d9dbfbea7e tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:20.786547 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9f9d52bd-35c6-4a3d-bf2e-a0d9dbfbea7e tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed612be4e5b04d8381060e51a368def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f978ba1b1e474ca46b33a1acb68c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:27:20.799026 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9f9d52bd-35c6-4a3d-bf2e-a0d9dbfbea7e tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 200 len: 1270 microversion: 2.1 time: 0.158398 Jul 25 13:27:20.799957 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3146/6220] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:27:20 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:27:21.822313 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c4c9275f-df12-4090-9edc-de5f0a209952 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:27:21.823019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c4c9275f-df12-4090-9edc-de5f0a209952 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:27:21.830363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4c9275f-df12-4090-9edc-de5f0a209952 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:21.830825 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4c9275f-df12-4090-9edc-de5f0a209952 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:21.831604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4c9275f-df12-4090-9edc-de5f0a209952 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:21.832049 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c4c9275f-df12-4090-9edc-de5f0a209952 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:21.976391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c4c9275f-df12-4090-9edc-de5f0a209952 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed612be4e5b04d8381060e51a368def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f978ba1b1e474ca46b33a1acb68c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:27:21.984427 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c4c9275f-df12-4090-9edc-de5f0a209952 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 200 len: 1459 microversion: 2.1 time: 0.167464 Jul 25 13:27:21.984994 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3075/6221] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:27:21 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 1459 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:27:22.012530 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4be3c617-93e1-467e-bbfc-9b135bdd92f5 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:27:22.013116 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4be3c617-93e1-467e-bbfc-9b135bdd92f5 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:27:22.020516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4be3c617-93e1-467e-bbfc-9b135bdd92f5 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:22.020963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4be3c617-93e1-467e-bbfc-9b135bdd92f5 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:22.021801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4be3c617-93e1-467e-bbfc-9b135bdd92f5 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:22.022283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4be3c617-93e1-467e-bbfc-9b135bdd92f5 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:22.165700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4be3c617-93e1-467e-bbfc-9b135bdd92f5 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed612be4e5b04d8381060e51a368def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f978ba1b1e474ca46b33a1acb68c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:27:22.173699 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4be3c617-93e1-467e-bbfc-9b135bdd92f5 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 200 len: 1459 microversion: 2.1 time: 0.165147 Jul 25 13:27:22.174315 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3147/6222] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:27:22 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 1459 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:27:24.047332 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-2640adab-4401-4e7c-b8e6-79b372c83e89 req-75066bfe-d7e6-4065-be95-f63d05cb850e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ad95073-d323-45ab-b385-7d63fb17701e", "tag": "ff697cb5-22c0-4780-b579-92a742080af1"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:27:24.059263 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2640adab-4401-4e7c-b8e6-79b372c83e89 req-75066bfe-d7e6-4065-be95-f63d05cb850e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:24.059822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2640adab-4401-4e7c-b8e6-79b372c83e89 req-75066bfe-d7e6-4065-be95-f63d05cb850e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:24.071606 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-2640adab-4401-4e7c-b8e6-79b372c83e89 req-75066bfe-d7e6-4065-be95-f63d05cb850e service nova] Creating event network-changed:ff697cb5-22c0-4780-b579-92a742080af1 for instance 8ad95073-d323-45ab-b385-7d63fb17701e on n-h1-848886-15 Jul 25 13:27:24.077316 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-2640adab-4401-4e7c-b8e6-79b372c83e89 req-75066bfe-d7e6-4065-be95-f63d05cb850e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033915 Jul 25 13:27:24.081687 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3076/6223] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:27:26.092353 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-295d2a05-f19c-4a50-b49b-02b0040d4f97 req-20c1240b-3180-43b4-89ac-81dfbf508eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ad95073-d323-45ab-b385-7d63fb17701e", "tag": "ff697cb5-22c0-4780-b579-92a742080af1"}, {"name": "network-changed", "server_uuid": "8ad95073-d323-45ab-b385-7d63fb17701e", "tag": "ff697cb5-22c0-4780-b579-92a742080af1"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:27:26.104505 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-295d2a05-f19c-4a50-b49b-02b0040d4f97 req-20c1240b-3180-43b4-89ac-81dfbf508eb7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:26.104927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-295d2a05-f19c-4a50-b49b-02b0040d4f97 req-20c1240b-3180-43b4-89ac-81dfbf508eb7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:26.116669 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-295d2a05-f19c-4a50-b49b-02b0040d4f97 req-20c1240b-3180-43b4-89ac-81dfbf508eb7 service nova] Creating event network-changed:ff697cb5-22c0-4780-b579-92a742080af1 for instance 8ad95073-d323-45ab-b385-7d63fb17701e on n-h1-848886-15 Jul 25 13:27:26.117569 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-295d2a05-f19c-4a50-b49b-02b0040d4f97 req-20c1240b-3180-43b4-89ac-81dfbf508eb7 service nova] Creating event network-changed:ff697cb5-22c0-4780-b579-92a742080af1 for instance 8ad95073-d323-45ab-b385-7d63fb17701e on n-h1-848886-15 Jul 25 13:27:26.123535 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-295d2a05-f19c-4a50-b49b-02b0040d4f97 req-20c1240b-3180-43b4-89ac-81dfbf508eb7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035116 Jul 25 13:27:26.124339 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3148/6224] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:27:59.464072 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:27:59.464973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=50 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:27:59.467736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:27:59.468594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=56 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:27:59.473552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fbf1d14f-4115-4cd1-aa28-3e705f3f0ace tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:27:59.474735 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fbf1d14f-4115-4cd1-aa28-3e705f3f0ace tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:27:59.485135 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fbf1d14f-4115-4cd1-aa28-3e705f3f0ace tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:59.485727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fbf1d14f-4115-4cd1-aa28-3e705f3f0ace tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:59.486617 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fbf1d14f-4115-4cd1-aa28-3e705f3f0ace tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:59.487143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fbf1d14f-4115-4cd1-aa28-3e705f3f0ace tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:59.517933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fbf1d14f-4115-4cd1-aa28-3e705f3f0ace tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:27:59.607200 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fbf1d14f-4115-4cd1-aa28-3e705f3f0ace tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 204 len: 0 microversion: 2.1 time: 0.145434 Jul 25 13:27:59.611890 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3077/6225] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:27:59 2022] DELETE /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:27:59.623006 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-13075a42-80f8-430f-93d2-71fb6d27dd16 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:27:59.623943 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-13075a42-80f8-430f-93d2-71fb6d27dd16 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:27:59.630985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13075a42-80f8-430f-93d2-71fb6d27dd16 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:59.631449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13075a42-80f8-430f-93d2-71fb6d27dd16 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:59.632355 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13075a42-80f8-430f-93d2-71fb6d27dd16 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:59.632877 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-13075a42-80f8-430f-93d2-71fb6d27dd16 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:59.648598 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-cde9474d-383f-4dc0-8884-490ebf421dcc req-5b96cd87-4c4f-4c7b-bdfa-cca83abda542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ad95073-d323-45ab-b385-7d63fb17701e", "tag": "ff697cb5-22c0-4780-b579-92a742080af1"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:27:59.659088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-cde9474d-383f-4dc0-8884-490ebf421dcc req-5b96cd87-4c4f-4c7b-bdfa-cca83abda542 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:27:59.659981 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-cde9474d-383f-4dc0-8884-490ebf421dcc req-5b96cd87-4c4f-4c7b-bdfa-cca83abda542 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:27:59.672297 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-cde9474d-383f-4dc0-8884-490ebf421dcc req-5b96cd87-4c4f-4c7b-bdfa-cca83abda542 service nova] Creating event network-changed:ff697cb5-22c0-4780-b579-92a742080af1 for instance 8ad95073-d323-45ab-b385-7d63fb17701e on n-h1-848886-15 Jul 25 13:27:59.678113 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-cde9474d-383f-4dc0-8884-490ebf421dcc req-5b96cd87-4c4f-4c7b-bdfa-cca83abda542 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215777 Jul 25 13:27:59.679087 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3149/6226] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:27:59.777585 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-13075a42-80f8-430f-93d2-71fb6d27dd16 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed612be4e5b04d8381060e51a368def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f978ba1b1e474ca46b33a1acb68c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:27:59.785889 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-13075a42-80f8-430f-93d2-71fb6d27dd16 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 200 len: 1582 microversion: 2.1 time: 0.172353 Jul 25 13:27:59.786529 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3078/6227] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:27:59 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 1582 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:00.811123 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1d77b200-48b6-4b16-8bf0-908152c84938 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:00.811938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1d77b200-48b6-4b16-8bf0-908152c84938 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:00.819069 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1d77b200-48b6-4b16-8bf0-908152c84938 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:00.819595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1d77b200-48b6-4b16-8bf0-908152c84938 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:00.820382 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1d77b200-48b6-4b16-8bf0-908152c84938 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:00.820815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1d77b200-48b6-4b16-8bf0-908152c84938 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:00.956360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1d77b200-48b6-4b16-8bf0-908152c84938 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed612be4e5b04d8381060e51a368def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f978ba1b1e474ca46b33a1acb68c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:00.964112 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1d77b200-48b6-4b16-8bf0-908152c84938 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 200 len: 1582 microversion: 2.1 time: 0.159059 Jul 25 13:28:00.964687 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3150/6228] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:00 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 1582 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:01.693566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-35e84296-70bd-47b8-ad14-0d95c696623e req-73950073-7ad1-4d3a-9dde-ae5df0c5b4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad95073-d323-45ab-b385-7d63fb17701e", "name": "network-vif-deleted", "tag": "ff697cb5-22c0-4780-b579-92a742080af1"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:28:01.704147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-35e84296-70bd-47b8-ad14-0d95c696623e req-73950073-7ad1-4d3a-9dde-ae5df0c5b4a6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:01.704605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-35e84296-70bd-47b8-ad14-0d95c696623e req-73950073-7ad1-4d3a-9dde-ae5df0c5b4a6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:01.715849 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-35e84296-70bd-47b8-ad14-0d95c696623e req-73950073-7ad1-4d3a-9dde-ae5df0c5b4a6 service nova] Creating event network-vif-deleted:ff697cb5-22c0-4780-b579-92a742080af1 for instance 8ad95073-d323-45ab-b385-7d63fb17701e on n-h1-848886-15 Jul 25 13:28:01.720863 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-35e84296-70bd-47b8-ad14-0d95c696623e req-73950073-7ad1-4d3a-9dde-ae5df0c5b4a6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031122 Jul 25 13:28:01.722021 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3079/6229] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:28:01.986558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1f83d931-6576-4096-a9c1-76323ea73065 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:01.987870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1f83d931-6576-4096-a9c1-76323ea73065 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:01.995428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f83d931-6576-4096-a9c1-76323ea73065 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:01.996010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f83d931-6576-4096-a9c1-76323ea73065 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:01.996858 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f83d931-6576-4096-a9c1-76323ea73065 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:01.997361 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f83d931-6576-4096-a9c1-76323ea73065 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:02.068536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1f83d931-6576-4096-a9c1-76323ea73065 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed612be4e5b04d8381060e51a368def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f978ba1b1e474ca46b33a1acb68c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:02.076761 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1f83d931-6576-4096-a9c1-76323ea73065 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 200 len: 1229 microversion: 2.1 time: 0.094520 Jul 25 13:28:02.077352 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3151/6230] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:01 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 1229 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:03.100103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0392a1e5-0ee0-4dab-8658-0051737072b8 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:03.100817 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0392a1e5-0ee0-4dab-8658-0051737072b8 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:03.107429 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0392a1e5-0ee0-4dab-8658-0051737072b8 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:03.107921 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0392a1e5-0ee0-4dab-8658-0051737072b8 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:03.108706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0392a1e5-0ee0-4dab-8658-0051737072b8 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:03.109173 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0392a1e5-0ee0-4dab-8658-0051737072b8 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:03.171835 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0392a1e5-0ee0-4dab-8658-0051737072b8 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed612be4e5b04d8381060e51a368def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f978ba1b1e474ca46b33a1acb68c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:03.179655 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0392a1e5-0ee0-4dab-8658-0051737072b8 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 200 len: 1229 microversion: 2.1 time: 0.085161 Jul 25 13:28:03.180463 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3080/6231] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:03 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 1229 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:03.955985 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:28:03.956590 n-d-848886-15 devstack@n-api.service[125884]: Mon Jul 25 13:28:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:28:04.201457 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1153daf9-f01d-4623-91c7-b73bddda8b39 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:04.202091 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1153daf9-f01d-4623-91c7-b73bddda8b39 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:04.209475 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1153daf9-f01d-4623-91c7-b73bddda8b39 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:04.209864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1153daf9-f01d-4623-91c7-b73bddda8b39 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:04.210946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1153daf9-f01d-4623-91c7-b73bddda8b39 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:04.211380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1153daf9-f01d-4623-91c7-b73bddda8b39 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:04.275889 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1153daf9-f01d-4623-91c7-b73bddda8b39 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed612be4e5b04d8381060e51a368def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f978ba1b1e474ca46b33a1acb68c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:04.284251 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1153daf9-f01d-4623-91c7-b73bddda8b39 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 200 len: 1229 microversion: 2.1 time: 0.086494 Jul 25 13:28:04.285070 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3152/6232] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:04 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 1229 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:05.305538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-14381be6-8a6d-4e66-ba09-ba80d7ac39a7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:05.306149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-14381be6-8a6d-4e66-ba09-ba80d7ac39a7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:05.313498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14381be6-8a6d-4e66-ba09-ba80d7ac39a7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:05.314000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14381be6-8a6d-4e66-ba09-ba80d7ac39a7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:05.314774 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14381be6-8a6d-4e66-ba09-ba80d7ac39a7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:05.315221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14381be6-8a6d-4e66-ba09-ba80d7ac39a7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:05.377259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-14381be6-8a6d-4e66-ba09-ba80d7ac39a7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed612be4e5b04d8381060e51a368def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f978ba1b1e474ca46b33a1acb68c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:05.384902 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-14381be6-8a6d-4e66-ba09-ba80d7ac39a7 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 200 len: 1229 microversion: 2.1 time: 0.083957 Jul 25 13:28:05.385465 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3081/6233] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:05 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 1229 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:06.410574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cda375d9-b1bd-4993-84aa-fe8e5f86109b tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:06.411667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cda375d9-b1bd-4993-84aa-fe8e5f86109b tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] [instance: 8ad95073-d323-45ab-b385-7d63fb17701e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:06.421498 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cda375d9-b1bd-4993-84aa-fe8e5f86109b tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:06.421976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cda375d9-b1bd-4993-84aa-fe8e5f86109b tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:06.422745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cda375d9-b1bd-4993-84aa-fe8e5f86109b tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:06.423180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cda375d9-b1bd-4993-84aa-fe8e5f86109b tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:06.436707 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-cda375d9-b1bd-4993-84aa-fe8e5f86109b tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] HTTP exception thrown: Instance 8ad95073-d323-45ab-b385-7d63fb17701e could not be found. Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cda375d9-b1bd-4993-84aa-fe8e5f86109b tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Request method failure captured: Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e HTTP/1.1 Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pmt_GV6y2jD1Hi9VCxAfddiU05n-5pMo9dJQAq3SgeagZCL3-BipzHh5RRJGxqBLQLzFAlirSYZ1WvfZO1AUwfQetRYaGAMymqN15R6dhDURJbvz-vafEyxMh20VJ3QZQxHzMUW1nfitOjSmp1UN1VmVnZv-RTKqjSgntNYKfrj8iw Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 27f978ba1b1e474ca46b33a1acb68c5c Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestVolumeBackupRestore-196512192 Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f978ba1b1e474ca46b33a1acb68c5c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f978ba1b1e474ca46b33a1acb68c5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f978ba1b1e474ca46b33a1acb68c5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f978ba1b1e474ca46b33a1acb68c5c"}]}] Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestVolumeBackupRestore-196512192 Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 27f978ba1b1e474ca46b33a1acb68c5c Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestVolumeBackupRestore-196512192 Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestVolumeBackupRestore-196512192-project Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: ed612be4e5b04d8381060e51a368def7 Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestVolumeBackupRestore-196512192-project Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 8ad95073-d323-45ab-b385-7d63fb17701e could not be found. Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '8ad95073-d323-45ab-b385-7d63fb17701e'} Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad95073-d323-45ab-b385-7d63fb17701e could not be found. Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad95073-d323-45ab-b385-7d63fb17701e could not be found. Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:28:06.438407 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:28:06.444124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:28:06.444124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:28:06.444124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:28:06.444124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:28:06.444124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:28:06.444124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad95073-d323-45ab-b385-7d63fb17701e could not be found. Jul 25 13:28:06.444124 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:28:06.444124 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cda375d9-b1bd-4993-84aa-fe8e5f86109b tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Returning 404 to user: Instance 8ad95073-d323-45ab-b385-7d63fb17701e could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:28:06.444124 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cda375d9-b1bd-4993-84aa-fe8e5f86109b tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e" status: 404 len: 111 microversion: 2.1 time: 0.035858 Jul 25 13:28:06.444124 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3153/6234] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:06 2022] GET /compute/v2.1/servers/8ad95073-d323-45ab-b385-7d63fb17701e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:28:06.613176 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-152a7f09-94da-4a04-9c55-102e33804ae8 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] Calling method '.version_select at 0x7efcf83b1160>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:06.639276 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-152a7f09-94da-4a04-9c55-102e33804ae8 tempest-TestVolumeBackupRestore-196512192 tempest-TestVolumeBackupRestore-196512192-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1884331628" status: 202 len: 0 microversion: 2.1 time: 0.030761 Jul 25 13:28:06.639961 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3082/6235] 10.222.0.49 () {58 vars in 1269 bytes} [Mon Jul 25 13:28:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1884331628 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:28:29.741055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=10 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:28:29.741792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=22 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:28:29.860776 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-eed26a2c-912b-4308-bc8b-7aa11c14f225 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-467178775", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:28:30.027303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-eed26a2c-912b-4308-bc8b-7aa11c14f225 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] validate_networks() for None {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:28:30.222547 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-eed26a2c-912b-4308-bc8b-7aa11c14f225 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:28:30.222973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-eed26a2c-912b-4308-bc8b-7aa11c14f225 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:28:30.223439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-eed26a2c-912b-4308-bc8b-7aa11c14f225 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:28:30.223852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-eed26a2c-912b-4308-bc8b-7aa11c14f225 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:28:30.224260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-eed26a2c-912b-4308-bc8b-7aa11c14f225 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:28:30.234167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eed26a2c-912b-4308-bc8b-7aa11c14f225 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:30.234606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eed26a2c-912b-4308-bc8b-7aa11c14f225 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:30.235404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eed26a2c-912b-4308-bc8b-7aa11c14f225 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:30.235898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eed26a2c-912b-4308-bc8b-7aa11c14f225 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:30.254038 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-eed26a2c-912b-4308-bc8b-7aa11c14f225 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Getting quotas for project 6fd18cb5301a4a9fb3bace3821d2013a. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:28:30.259477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-eed26a2c-912b-4308-bc8b-7aa11c14f225 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Getting quotas for user 122607685f244e0ab0c101f0323e6d70 and project 6fd18cb5301a4a9fb3bace3821d2013a. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:28:30.272207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eed26a2c-912b-4308-bc8b-7aa11c14f225 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:28:30.274468 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eed26a2c-912b-4308-bc8b-7aa11c14f225 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] [instance: 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:28:30.321503 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-eed26a2c-912b-4308-bc8b-7aa11c14f225 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585035 Jul 25 13:28:30.322158 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3154/6236] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:28:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:28:30.333532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:28:30.334748 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:28:30.339430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0a79fbef-5d12-4410-87a9-b27eb0133cdd tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:30.340751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0a79fbef-5d12-4410-87a9-b27eb0133cdd tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] [instance: 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:30.509326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0a79fbef-5d12-4410-87a9-b27eb0133cdd tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122607685f244e0ab0c101f0323e6d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd18cb5301a4a9fb3bace3821d2013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:30.516230 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0a79fbef-5d12-4410-87a9-b27eb0133cdd tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f" status: 200 len: 1221 microversion: 2.1 time: 0.185681 Jul 25 13:28:30.516802 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3083/6237] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:30 2022] GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f => generated 1221 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:31.536743 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-753c9f54-a911-45e6-80c1-e22aeea6a986 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:31.537392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-753c9f54-a911-45e6-80c1-e22aeea6a986 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] [instance: 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:31.544454 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-753c9f54-a911-45e6-80c1-e22aeea6a986 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:31.544928 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-753c9f54-a911-45e6-80c1-e22aeea6a986 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:31.545679 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-753c9f54-a911-45e6-80c1-e22aeea6a986 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:31.546141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-753c9f54-a911-45e6-80c1-e22aeea6a986 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:31.646816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-753c9f54-a911-45e6-80c1-e22aeea6a986 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122607685f244e0ab0c101f0323e6d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd18cb5301a4a9fb3bace3821d2013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:31.654760 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-753c9f54-a911-45e6-80c1-e22aeea6a986 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f" status: 200 len: 1279 microversion: 2.1 time: 0.122017 Jul 25 13:28:31.655425 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3155/6238] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:31 2022] GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f => generated 1279 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:32.678884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-af202f0a-8e09-44e6-83d9-87866f932b5f tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:32.679518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-af202f0a-8e09-44e6-83d9-87866f932b5f tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] [instance: 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:32.688886 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af202f0a-8e09-44e6-83d9-87866f932b5f tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:32.689586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af202f0a-8e09-44e6-83d9-87866f932b5f tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:32.690813 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af202f0a-8e09-44e6-83d9-87866f932b5f tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:32.691497 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-af202f0a-8e09-44e6-83d9-87866f932b5f tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:32.898784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-af202f0a-8e09-44e6-83d9-87866f932b5f tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122607685f244e0ab0c101f0323e6d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd18cb5301a4a9fb3bace3821d2013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:32.908277 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-af202f0a-8e09-44e6-83d9-87866f932b5f tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f" status: 200 len: 1321 microversion: 2.1 time: 0.234795 Jul 25 13:28:32.908880 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3084/6239] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:32 2022] GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:33.063405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-691b5879-b072-42fa-80c4-d4ce640bb6d1 req-f3014d3f-7be3-49ab-9d97-e191ed53df08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b3ae39b-34a1-4058-8e68-6c4a16b8b59f", "tag": "4792659d-2eda-45ac-a679-9d62e18f5852"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:28:33.085332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-691b5879-b072-42fa-80c4-d4ce640bb6d1 req-f3014d3f-7be3-49ab-9d97-e191ed53df08 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:33.089101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-691b5879-b072-42fa-80c4-d4ce640bb6d1 req-f3014d3f-7be3-49ab-9d97-e191ed53df08 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:33.101993 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-691b5879-b072-42fa-80c4-d4ce640bb6d1 req-f3014d3f-7be3-49ab-9d97-e191ed53df08 service nova] Creating event network-changed:4792659d-2eda-45ac-a679-9d62e18f5852 for instance 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f on n-h2-848886-15 Jul 25 13:28:33.109079 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-691b5879-b072-42fa-80c4-d4ce640bb6d1 req-f3014d3f-7be3-49ab-9d97-e191ed53df08 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055660 Jul 25 13:28:33.110400 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3156/6240] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:28:33.935476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c16eb5b3-8ea8-4259-a7ee-c0cafa5ae0b5 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:33.936480 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c16eb5b3-8ea8-4259-a7ee-c0cafa5ae0b5 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] [instance: 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:33.948346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c16eb5b3-8ea8-4259-a7ee-c0cafa5ae0b5 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:33.948990 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c16eb5b3-8ea8-4259-a7ee-c0cafa5ae0b5 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:33.949771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c16eb5b3-8ea8-4259-a7ee-c0cafa5ae0b5 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:33.950258 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c16eb5b3-8ea8-4259-a7ee-c0cafa5ae0b5 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:34.081523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c16eb5b3-8ea8-4259-a7ee-c0cafa5ae0b5 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122607685f244e0ab0c101f0323e6d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd18cb5301a4a9fb3bace3821d2013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:34.089232 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c16eb5b3-8ea8-4259-a7ee-c0cafa5ae0b5 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f" status: 200 len: 1321 microversion: 2.1 time: 0.160226 Jul 25 13:28:34.089814 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3085/6241] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:33 2022] GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:35.112415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-58f281fc-4d2f-449e-bc4b-72e3ad2e7844 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:35.113461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-58f281fc-4d2f-449e-bc4b-72e3ad2e7844 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] [instance: 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:35.121245 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58f281fc-4d2f-449e-bc4b-72e3ad2e7844 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:35.121667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58f281fc-4d2f-449e-bc4b-72e3ad2e7844 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:35.122761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58f281fc-4d2f-449e-bc4b-72e3ad2e7844 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:35.123305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-58f281fc-4d2f-449e-bc4b-72e3ad2e7844 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:35.256756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-58f281fc-4d2f-449e-bc4b-72e3ad2e7844 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122607685f244e0ab0c101f0323e6d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd18cb5301a4a9fb3bace3821d2013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:35.268327 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-58f281fc-4d2f-449e-bc4b-72e3ad2e7844 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f" status: 200 len: 1321 microversion: 2.1 time: 0.161270 Jul 25 13:28:35.269107 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3157/6242] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:35 2022] GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:36.295416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bc234dce-feb3-429d-a0ec-1031b777703d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:36.296452 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bc234dce-feb3-429d-a0ec-1031b777703d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] [instance: 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:36.308673 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc234dce-feb3-429d-a0ec-1031b777703d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:36.309433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc234dce-feb3-429d-a0ec-1031b777703d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:36.310933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc234dce-feb3-429d-a0ec-1031b777703d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:36.311713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bc234dce-feb3-429d-a0ec-1031b777703d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:36.455205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bc234dce-feb3-429d-a0ec-1031b777703d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122607685f244e0ab0c101f0323e6d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd18cb5301a4a9fb3bace3821d2013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:36.463094 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bc234dce-feb3-429d-a0ec-1031b777703d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f" status: 200 len: 1321 microversion: 2.1 time: 0.174373 Jul 25 13:28:36.463667 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3086/6243] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:36 2022] GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:37.484756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5f4aef3a-e413-4685-ac17-915022cd986d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:37.485356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5f4aef3a-e413-4685-ac17-915022cd986d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] [instance: 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:37.492868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5f4aef3a-e413-4685-ac17-915022cd986d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:37.493315 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5f4aef3a-e413-4685-ac17-915022cd986d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:37.494159 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5f4aef3a-e413-4685-ac17-915022cd986d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:37.494599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5f4aef3a-e413-4685-ac17-915022cd986d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:37.628209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5f4aef3a-e413-4685-ac17-915022cd986d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122607685f244e0ab0c101f0323e6d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd18cb5301a4a9fb3bace3821d2013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:37.638297 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5f4aef3a-e413-4685-ac17-915022cd986d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f" status: 200 len: 1321 microversion: 2.1 time: 0.157528 Jul 25 13:28:37.638811 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3158/6244] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:37 2022] GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:38.663490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1ca4e73b-331b-4a52-90bf-c4a6a72d663e tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:38.664464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1ca4e73b-331b-4a52-90bf-c4a6a72d663e tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] [instance: 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:38.672692 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ca4e73b-331b-4a52-90bf-c4a6a72d663e tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:38.673150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ca4e73b-331b-4a52-90bf-c4a6a72d663e tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:38.673947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ca4e73b-331b-4a52-90bf-c4a6a72d663e tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:38.674394 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ca4e73b-331b-4a52-90bf-c4a6a72d663e tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:38.807216 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1ca4e73b-331b-4a52-90bf-c4a6a72d663e tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122607685f244e0ab0c101f0323e6d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd18cb5301a4a9fb3bace3821d2013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:38.815532 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1ca4e73b-331b-4a52-90bf-c4a6a72d663e tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f" status: 200 len: 1321 microversion: 2.1 time: 0.158629 Jul 25 13:28:38.816148 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3087/6245] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:38 2022] GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:39.453460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-cf53bd10-7a98-44d5-9070-e8ea89cad906 req-caf766f2-2244-47c3-a9db-24ebfbe7771e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3ae39b-34a1-4058-8e68-6c4a16b8b59f", "name": "network-vif-plugged", "status": "completed", "tag": "4792659d-2eda-45ac-a679-9d62e18f5852"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:28:39.464431 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-cf53bd10-7a98-44d5-9070-e8ea89cad906 req-caf766f2-2244-47c3-a9db-24ebfbe7771e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:39.464871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-cf53bd10-7a98-44d5-9070-e8ea89cad906 req-caf766f2-2244-47c3-a9db-24ebfbe7771e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:39.476853 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-cf53bd10-7a98-44d5-9070-e8ea89cad906 req-caf766f2-2244-47c3-a9db-24ebfbe7771e service nova] Creating event network-vif-plugged:4792659d-2eda-45ac-a679-9d62e18f5852 for instance 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f on n-h2-848886-15 Jul 25 13:28:39.482000 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-cf53bd10-7a98-44d5-9070-e8ea89cad906 req-caf766f2-2244-47c3-a9db-24ebfbe7771e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032400 Jul 25 13:28:39.482768 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3159/6246] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:28:39.840290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b718e1ab-a4b7-47b6-9b00-be5cd27a5ec4 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:39.841002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b718e1ab-a4b7-47b6-9b00-be5cd27a5ec4 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] [instance: 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:39.849806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b718e1ab-a4b7-47b6-9b00-be5cd27a5ec4 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:39.850390 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b718e1ab-a4b7-47b6-9b00-be5cd27a5ec4 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:39.851303 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b718e1ab-a4b7-47b6-9b00-be5cd27a5ec4 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:39.851833 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b718e1ab-a4b7-47b6-9b00-be5cd27a5ec4 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:39.989441 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b718e1ab-a4b7-47b6-9b00-be5cd27a5ec4 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122607685f244e0ab0c101f0323e6d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd18cb5301a4a9fb3bace3821d2013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:39.997186 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b718e1ab-a4b7-47b6-9b00-be5cd27a5ec4 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f" status: 200 len: 1321 microversion: 2.1 time: 0.163205 Jul 25 13:28:39.997766 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3088/6247] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:39 2022] GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:41.017759 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:28:41.018844 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:28:41.026671 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-acc20bdb-b777-4fa8-a360-68dc2e1c01b6 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:41.027547 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-acc20bdb-b777-4fa8-a360-68dc2e1c01b6 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] [instance: 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:41.034852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acc20bdb-b777-4fa8-a360-68dc2e1c01b6 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:41.035303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acc20bdb-b777-4fa8-a360-68dc2e1c01b6 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:41.036067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acc20bdb-b777-4fa8-a360-68dc2e1c01b6 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:41.036501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acc20bdb-b777-4fa8-a360-68dc2e1c01b6 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:41.177580 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-acc20bdb-b777-4fa8-a360-68dc2e1c01b6 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122607685f244e0ab0c101f0323e6d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd18cb5301a4a9fb3bace3821d2013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:41.185755 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-acc20bdb-b777-4fa8-a360-68dc2e1c01b6 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f" status: 200 len: 1471 microversion: 2.1 time: 0.169870 Jul 25 13:28:41.186418 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3160/6248] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:41 2022] GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f => generated 1471 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:41.218235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:28:41.279206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-71ab787c-1bef-4ae8-9b58-7197a734023a tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Calling method '.version_select at 0x7efcf83b19d0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:41.348321 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-71ab787c-1bef-4ae8-9b58-7197a734023a tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/82e65f5380ae49eca17ce0d79e419738" status: 200 len: 371 microversion: 2.1 time: 0.134724 Jul 25 13:28:41.348898 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3089/6249] 10.222.0.49 () {58 vars in 1242 bytes} [Mon Jul 25 13:28:41 2022] GET /compute/v2.1/os-quota-sets/82e65f5380ae49eca17ce0d79e419738 => generated 371 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:28:41.360545 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b8ff7628-519d-47e6-a04d-7fd63c03a98a tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2084764872", "id": 575314747, "os-flavor-access:is_public": "True"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:28:41.363578 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 13:28:41.363578 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 13:28:41.380535 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b8ff7628-519d-47e6-a04d-7fd63c03a98a tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.023763 Jul 25 13:28:41.381126 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3161/6250] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:28:41 2022] POST /compute/v2.1/flavors => generated 435 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:28:41.393146 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5f3dc519-f849-414a-b7a3-27b19f2f72d6 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "575314747"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:28:41.395435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5f3dc519-f849-414a-b7a3-27b19f2f72d6 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] [instance: 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:41.402081 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f3dc519-f849-414a-b7a3-27b19f2f72d6 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:41.402554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f3dc519-f849-414a-b7a3-27b19f2f72d6 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:41.403356 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f3dc519-f849-414a-b7a3-27b19f2f72d6 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:41.403810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f3dc519-f849-414a-b7a3-27b19f2f72d6 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:41.550018 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5f3dc519-f849-414a-b7a3-27b19f2f72d6 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4a49a11930294f9092b4f4e4eabcf5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e65f5380ae49eca17ce0d79e419738', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:41.556670 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5f3dc519-f849-414a-b7a3-27b19f2f72d6 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] [instance: 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2084764872 {{(pid=125883) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 13:28:41.563221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f3dc519-f849-414a-b7a3-27b19f2f72d6 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:41.563682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f3dc519-f849-414a-b7a3-27b19f2f72d6 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:41.564495 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f3dc519-f849-414a-b7a3-27b19f2f72d6 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:41.564943 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5f3dc519-f849-414a-b7a3-27b19f2f72d6 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:41.586091 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-5f3dc519-f849-414a-b7a3-27b19f2f72d6 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Getting quotas for project 6fd18cb5301a4a9fb3bace3821d2013a. Resources: {'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:28:41.591538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-5f3dc519-f849-414a-b7a3-27b19f2f72d6 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Getting quotas for user 122607685f244e0ab0c101f0323e6d70 and project 6fd18cb5301a4a9fb3bace3821d2013a. Resources: {'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:28:41.604383 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.compute.api [None req-5f3dc519-f849-414a-b7a3-27b19f2f72d6 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] ram quota exceeded for 82e65f5380ae49eca17ce0d79e419738, tried to resize instance. Jul 25 13:28:41.605044 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-5f3dc519-f849-414a-b7a3-27b19f2f72d6 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5f3dc519-f849-414a-b7a3-27b19f2f72d6 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Request method failure captured: Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f/action HTTP/1.1 Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 38 Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pp9TsANDIYby9MNA6QXRkUA-NHVWIwACyOLKtQ5WTBj2H3QAioBFkff2Coz2wjUAGP7H8QCCpFOcXIzxuoTqI6U2Ps7NK1VkveTXCm7bDeq9FgEF9bTmmwvxxajiZ4MORLuX5Sbjaz4iKWaIf5z1NrPLePAq1xkDCaHnGC6kO9uIYU Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 82e65f5380ae49eca17ce0d79e419738 Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-546661149 Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,admin,member Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,admin,member Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_82e65f5380ae49eca17ce0d79e419738", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/82e65f5380ae49eca17ce0d79e419738"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/82e65f5380ae49eca17ce0d79e419738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/82e65f5380ae49eca17ce0d79e419738"}]}] Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersAdminNegativeTestJSON-546661149 Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 82e65f5380ae49eca17ce0d79e419738 Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-546661149 Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersAdminNegativeTestJSON-546661149-project-admin Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 4a49a11930294f9092b4f4e4eabcf5b4 Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersAdminNegativeTestJSON-546661149-project-admin Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: {"resize": {"flavorRef": "575314747"}} Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '9b3ae39b-34a1-4058-8e68-6c4a16b8b59f', 'body': {'resize': {'flavorRef': '575314747'}}} Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:28:41.607819 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5f3dc519-f849-414a-b7a3-27b19f2f72d6 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5f3dc519-f849-414a-b7a3-27b19f2f72d6 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f/action" status: 403 len: 118 microversion: 2.1 time: 0.220097 Jul 25 13:28:41.614403 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3090/6251] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:28:41 2022] POST /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f/action => generated 118 bytes in 221 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:28:41.618951 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0b3cc604-bc54-491e-a303-029bfa700b97 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:41.619707 n-d-848886-15 devstack@n-api.service[125884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 13:28:41.619707 n-d-848886-15 devstack@n-api.service[125884]: warnings.warn(msg) Jul 25 13:28:41.637266 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0b3cc604-bc54-491e-a303-029bfa700b97 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/575314747" status: 202 len: 0 microversion: 2.1 time: 0.021930 Jul 25 13:28:41.637872 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3162/6252] 10.222.0.49 () {58 vars in 1158 bytes} [Mon Jul 25 13:28:41 2022] DELETE /compute/v2.1/flavors/575314747 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:28:41.645885 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f31de91e-d37d-4d90-995c-3969959a63c1 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:41.666187 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f31de91e-d37d-4d90-995c-3969959a63c1 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023970 Jul 25 13:28:41.667001 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3091/6253] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 13:28:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:41.687069 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-30d86526-25b8-4876-b071-8d1a5a4590c8 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Calling method '.version_select at 0x7efcf884b280>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:41.759549 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-30d86526-25b8-4876-b071-8d1a5a4590c8 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/82e65f5380ae49eca17ce0d79e419738" status: 200 len: 371 microversion: 2.1 time: 0.076288 Jul 25 13:28:41.760165 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3163/6254] 10.222.0.49 () {58 vars in 1242 bytes} [Mon Jul 25 13:28:41 2022] GET /compute/v2.1/os-quota-sets/82e65f5380ae49eca17ce0d79e419738 => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:28:41.771378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-925d7bd2-3243-4a18-8f84-59bf1969510c tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1514861520", "id": 408482900, "os-flavor-access:is_public": "True"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:28:41.774413 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 13:28:41.774413 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 13:28:41.791377 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-925d7bd2-3243-4a18-8f84-59bf1969510c tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.023559 Jul 25 13:28:41.792134 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3092/6255] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:28:41 2022] POST /compute/v2.1/flavors => generated 434 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:28:41.803684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ce1a1e90-f06e-4e32-adb4-c2192e285c22 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "408482900"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:28:41.806407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ce1a1e90-f06e-4e32-adb4-c2192e285c22 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] [instance: 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:41.812727 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ce1a1e90-f06e-4e32-adb4-c2192e285c22 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:41.813190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ce1a1e90-f06e-4e32-adb4-c2192e285c22 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:41.813998 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ce1a1e90-f06e-4e32-adb4-c2192e285c22 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:41.814442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ce1a1e90-f06e-4e32-adb4-c2192e285c22 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:41.963508 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ce1a1e90-f06e-4e32-adb4-c2192e285c22 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4a49a11930294f9092b4f4e4eabcf5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e65f5380ae49eca17ce0d79e419738', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:41.970144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ce1a1e90-f06e-4e32-adb4-c2192e285c22 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] [instance: 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1514861520 {{(pid=125884) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 13:28:41.977053 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ce1a1e90-f06e-4e32-adb4-c2192e285c22 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:41.977504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ce1a1e90-f06e-4e32-adb4-c2192e285c22 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:41.978327 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ce1a1e90-f06e-4e32-adb4-c2192e285c22 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:41.978788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ce1a1e90-f06e-4e32-adb4-c2192e285c22 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:41.999111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-ce1a1e90-f06e-4e32-adb4-c2192e285c22 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Getting quotas for project 6fd18cb5301a4a9fb3bace3821d2013a. Resources: {'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:28:42.004292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-ce1a1e90-f06e-4e32-adb4-c2192e285c22 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Getting quotas for user 122607685f244e0ab0c101f0323e6d70 and project 6fd18cb5301a4a9fb3bace3821d2013a. Resources: {'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:28:42.016396 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.compute.api [None req-ce1a1e90-f06e-4e32-adb4-c2192e285c22 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] cores quota exceeded for 82e65f5380ae49eca17ce0d79e419738, tried to resize instance. Jul 25 13:28:42.017210 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-ce1a1e90-f06e-4e32-adb4-c2192e285c22 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ce1a1e90-f06e-4e32-adb4-c2192e285c22 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Request method failure captured: Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f/action HTTP/1.1 Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 38 Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pp9TsANDIYby9MNA6QXRkUA-NHVWIwACyOLKtQ5WTBj2H3QAioBFkff2Coz2wjUAGP7H8QCCpFOcXIzxuoTqI6U2Ps7NK1VkveTXCm7bDeq9FgEF9bTmmwvxxajiZ4MORLuX5Sbjaz4iKWaIf5z1NrPLePAq1xkDCaHnGC6kO9uIYU Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 82e65f5380ae49eca17ce0d79e419738 Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-546661149 Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,admin,member Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,admin,member Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_82e65f5380ae49eca17ce0d79e419738", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/82e65f5380ae49eca17ce0d79e419738"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/82e65f5380ae49eca17ce0d79e419738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/82e65f5380ae49eca17ce0d79e419738"}]}] Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersAdminNegativeTestJSON-546661149 Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 82e65f5380ae49eca17ce0d79e419738 Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-546661149 Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersAdminNegativeTestJSON-546661149-project-admin Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 4a49a11930294f9092b4f4e4eabcf5b4 Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersAdminNegativeTestJSON-546661149-project-admin Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: {"resize": {"flavorRef": "408482900"}} Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '9b3ae39b-34a1-4058-8e68-6c4a16b8b59f', 'body': {'resize': {'flavorRef': '408482900'}}} Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:28:42.020297 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ce1a1e90-f06e-4e32-adb4-c2192e285c22 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ce1a1e90-f06e-4e32-adb4-c2192e285c22 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f/action" status: 403 len: 113 microversion: 2.1 time: 0.221999 Jul 25 13:28:42.025777 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3164/6256] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:28:41 2022] POST /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f/action => generated 113 bytes in 223 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:28:42.034862 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7f70d3d5-f1a0-4d48-b187-7c7621a98dd6 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:42.035620 n-d-848886-15 devstack@n-api.service[125883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 13:28:42.035620 n-d-848886-15 devstack@n-api.service[125883]: warnings.warn(msg) Jul 25 13:28:42.055098 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7f70d3d5-f1a0-4d48-b187-7c7621a98dd6 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/408482900" status: 202 len: 0 microversion: 2.1 time: 0.024220 Jul 25 13:28:42.055607 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3093/6257] 10.222.0.49 () {58 vars in 1158 bytes} [Mon Jul 25 13:28:42 2022] DELETE /compute/v2.1/flavors/408482900 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:28:42.063909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e792cefe-c832-4539-86f9-c822089dde96 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:42.085181 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e792cefe-c832-4539-86f9-c822089dde96 tempest-ServersAdminNegativeTestJSON-546661149 tempest-ServersAdminNegativeTestJSON-546661149-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025041 Jul 25 13:28:42.085773 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3165/6258] 10.222.0.49 () {58 vars in 1146 bytes} [Mon Jul 25 13:28:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:42.105731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cf97a094-4714-4808-8ea1-808ed1f3ef2b tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:42.106284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cf97a094-4714-4808-8ea1-808ed1f3ef2b tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] [instance: 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:42.112509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf97a094-4714-4808-8ea1-808ed1f3ef2b tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:42.113041 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf97a094-4714-4808-8ea1-808ed1f3ef2b tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:42.113853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf97a094-4714-4808-8ea1-808ed1f3ef2b tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:42.114324 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cf97a094-4714-4808-8ea1-808ed1f3ef2b tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:42.143825 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cf97a094-4714-4808-8ea1-808ed1f3ef2b tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] [instance: 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:28:42.220352 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cf97a094-4714-4808-8ea1-808ed1f3ef2b tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f" status: 204 len: 0 microversion: 2.1 time: 0.118354 Jul 25 13:28:42.221335 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3094/6259] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:28:42 2022] DELETE /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:28:42.229690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8a361b39-871f-4d4c-b1af-1fbb849fd2d7 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:42.230343 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8a361b39-871f-4d4c-b1af-1fbb849fd2d7 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] [instance: 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:42.236495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a361b39-871f-4d4c-b1af-1fbb849fd2d7 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:42.236945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a361b39-871f-4d4c-b1af-1fbb849fd2d7 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:42.237712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a361b39-871f-4d4c-b1af-1fbb849fd2d7 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:42.238168 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a361b39-871f-4d4c-b1af-1fbb849fd2d7 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:42.371564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8a361b39-871f-4d4c-b1af-1fbb849fd2d7 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122607685f244e0ab0c101f0323e6d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd18cb5301a4a9fb3bace3821d2013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:42.379218 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8a361b39-871f-4d4c-b1af-1fbb849fd2d7 tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f" status: 200 len: 1477 microversion: 2.1 time: 0.153630 Jul 25 13:28:42.379764 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3166/6260] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:42 2022] GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f => generated 1477 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:43.404951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1fb55e47-ffe5-40e6-b63c-95551dc2f53c tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:43.405771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1fb55e47-ffe5-40e6-b63c-95551dc2f53c tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] [instance: 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:43.415255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1fb55e47-ffe5-40e6-b63c-95551dc2f53c tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:43.415876 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1fb55e47-ffe5-40e6-b63c-95551dc2f53c tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:43.416909 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1fb55e47-ffe5-40e6-b63c-95551dc2f53c tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:43.417514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1fb55e47-ffe5-40e6-b63c-95551dc2f53c tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:43.551085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1fb55e47-ffe5-40e6-b63c-95551dc2f53c tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122607685f244e0ab0c101f0323e6d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd18cb5301a4a9fb3bace3821d2013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:43.559088 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1fb55e47-ffe5-40e6-b63c-95551dc2f53c tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f" status: 200 len: 1477 microversion: 2.1 time: 0.160924 Jul 25 13:28:43.559640 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3095/6261] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:43 2022] GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f => generated 1477 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:44.255532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-f93b9d97-50da-4f8b-b194-b46f58ccbe8a req-b2301109-00a3-4322-ad7d-47e547c25bca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3ae39b-34a1-4058-8e68-6c4a16b8b59f", "name": "network-vif-deleted", "tag": "4792659d-2eda-45ac-a679-9d62e18f5852"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:28:44.268401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f93b9d97-50da-4f8b-b194-b46f58ccbe8a req-b2301109-00a3-4322-ad7d-47e547c25bca service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:44.268849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f93b9d97-50da-4f8b-b194-b46f58ccbe8a req-b2301109-00a3-4322-ad7d-47e547c25bca service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:44.282140 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-f93b9d97-50da-4f8b-b194-b46f58ccbe8a req-b2301109-00a3-4322-ad7d-47e547c25bca service nova] Creating event network-vif-deleted:4792659d-2eda-45ac-a679-9d62e18f5852 for instance 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f on n-h2-848886-15 Jul 25 13:28:44.288890 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-f93b9d97-50da-4f8b-b194-b46f58ccbe8a req-b2301109-00a3-4322-ad7d-47e547c25bca service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037318 Jul 25 13:28:44.289511 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3167/6262] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:28:44.584452 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0f727a09-c1f5-428d-932a-aa5cdb73f62a tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:44.585449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0f727a09-c1f5-428d-932a-aa5cdb73f62a tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] [instance: 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:44.597507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f727a09-c1f5-428d-932a-aa5cdb73f62a tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:44.598340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f727a09-c1f5-428d-932a-aa5cdb73f62a tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:44.599631 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f727a09-c1f5-428d-932a-aa5cdb73f62a tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:44.600383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f727a09-c1f5-428d-932a-aa5cdb73f62a tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:44.634196 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f727a09-c1f5-428d-932a-aa5cdb73f62a tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:44.634665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0f727a09-c1f5-428d-932a-aa5cdb73f62a tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:44.635127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-0f727a09-c1f5-428d-932a-aa5cdb73f62a tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lazy-loading 'fault' on Instance uuid 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:28:44.677911 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0f727a09-c1f5-428d-932a-aa5cdb73f62a tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122607685f244e0ab0c101f0323e6d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd18cb5301a4a9fb3bace3821d2013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:44.685519 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0f727a09-c1f5-428d-932a-aa5cdb73f62a tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f" status: 200 len: 1311 microversion: 2.1 time: 0.107728 Jul 25 13:28:44.686353 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3096/6263] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:44 2022] GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f => generated 1311 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:45.711347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2de52c5d-9fea-48f3-b38c-c5ce56c5208d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:45.712542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2de52c5d-9fea-48f3-b38c-c5ce56c5208d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] [instance: 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:45.721134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2de52c5d-9fea-48f3-b38c-c5ce56c5208d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:45.721562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2de52c5d-9fea-48f3-b38c-c5ce56c5208d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:45.722364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2de52c5d-9fea-48f3-b38c-c5ce56c5208d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:45.722803 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2de52c5d-9fea-48f3-b38c-c5ce56c5208d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:45.736743 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-2de52c5d-9fea-48f3-b38c-c5ce56c5208d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] HTTP exception thrown: Instance 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f could not be found. Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2de52c5d-9fea-48f3-b38c-c5ce56c5208d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Request method failure captured: Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f HTTP/1.1 Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pp9lK0Jw_Y4Dcc8YEBHGJ3cSWEhC0y5jdjaQtqnExODfCJXlRyUDeJq6M15H_O1_txJ0Kicbd4SUK8FVLIXmK1CByF8NE_5mEg0rdBC52_Ny21wRxJYnxi_BQ8KB_HYEBnkTQcjKHAFjiJoWPOx5_bFhBwneUVqSmXFrFjOXNS9Sic Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 6fd18cb5301a4a9fb3bace3821d2013a Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-318450300 Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6fd18cb5301a4a9fb3bace3821d2013a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6fd18cb5301a4a9fb3bace3821d2013a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6fd18cb5301a4a9fb3bace3821d2013a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6fd18cb5301a4a9fb3bace3821d2013a"}]}] Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersAdminNegativeTestJSON-318450300 Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 6fd18cb5301a4a9fb3bace3821d2013a Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-318450300 Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersAdminNegativeTestJSON-318450300-project Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 122607685f244e0ab0c101f0323e6d70 Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersAdminNegativeTestJSON-318450300-project Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f could not be found. Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '9b3ae39b-34a1-4058-8e68-6c4a16b8b59f'} Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f could not be found. Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f could not be found. Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:28:45.738400 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:28:45.746616 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:28:45.746616 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:28:45.746616 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:28:45.746616 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:28:45.746616 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:28:45.746616 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f could not be found. Jul 25 13:28:45.746616 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:28:45.746616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2de52c5d-9fea-48f3-b38c-c5ce56c5208d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] Returning 404 to user: Instance 9b3ae39b-34a1-4058-8e68-6c4a16b8b59f could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:28:45.746616 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2de52c5d-9fea-48f3-b38c-c5ce56c5208d tempest-ServersAdminNegativeTestJSON-318450300 tempest-ServersAdminNegativeTestJSON-318450300-project] 10.222.0.49 "GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f" status: 404 len: 111 microversion: 2.1 time: 0.035603 Jul 25 13:28:45.746616 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3168/6264] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:45 2022] GET /compute/v2.1/servers/9b3ae39b-34a1-4058-8e68-6c4a16b8b59f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:28:51.777323 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:28:51.778757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:28:51.897243 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-800e18cf-9656-4dde-8b89-18ad7ea13632 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-9263348", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "b31c96d9-ab8c-4a2a-8164-96513a3b5ffd"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:28:51.952751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-800e18cf-9656-4dde-8b89-18ad7ea13632 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] validate_networks() for [('b31c96d9-ab8c-4a2a-8164-96513a3b5ffd', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:28:52.351624 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-800e18cf-9656-4dde-8b89-18ad7ea13632 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:28:52.352091 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-800e18cf-9656-4dde-8b89-18ad7ea13632 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:28:52.352860 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-800e18cf-9656-4dde-8b89-18ad7ea13632 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:28:52.353351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-800e18cf-9656-4dde-8b89-18ad7ea13632 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:28:52.353864 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-800e18cf-9656-4dde-8b89-18ad7ea13632 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:28:52.363477 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-800e18cf-9656-4dde-8b89-18ad7ea13632 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:52.363945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-800e18cf-9656-4dde-8b89-18ad7ea13632 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:52.364767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-800e18cf-9656-4dde-8b89-18ad7ea13632 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:52.365222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-800e18cf-9656-4dde-8b89-18ad7ea13632 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:52.385881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-800e18cf-9656-4dde-8b89-18ad7ea13632 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Getting quotas for project 650b04ac3eb84719bcd04dc95bc7b637. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:28:52.391327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-800e18cf-9656-4dde-8b89-18ad7ea13632 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Getting quotas for user 7e044c6fce7b4fd68103fa5e41387f3e and project 650b04ac3eb84719bcd04dc95bc7b637. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:28:52.404086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-800e18cf-9656-4dde-8b89-18ad7ea13632 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:28:52.406507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-800e18cf-9656-4dde-8b89-18ad7ea13632 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:28:52.454838 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-800e18cf-9656-4dde-8b89-18ad7ea13632 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683243 Jul 25 13:28:52.461393 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3097/6265] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:28:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:28:52.467022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-80688ef3-d93d-4c66-9572-ebcb8723efac tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:52.467645 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-80688ef3-d93d-4c66-9572-ebcb8723efac tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:52.482426 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:28:52.483237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:28:52.551432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-80688ef3-d93d-4c66-9572-ebcb8723efac tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:52.563091 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-80688ef3-d93d-4c66-9572-ebcb8723efac tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1212 microversion: 2.1 time: 0.100174 Jul 25 13:28:52.563686 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3169/6266] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:52 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1212 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:53.584344 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ac94d151-10b1-482b-b2f0-c405e2fe5b96 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:53.585072 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ac94d151-10b1-482b-b2f0-c405e2fe5b96 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:53.592824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ac94d151-10b1-482b-b2f0-c405e2fe5b96 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:53.593414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ac94d151-10b1-482b-b2f0-c405e2fe5b96 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:53.594295 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ac94d151-10b1-482b-b2f0-c405e2fe5b96 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:53.594968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ac94d151-10b1-482b-b2f0-c405e2fe5b96 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:53.670749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ac94d151-10b1-482b-b2f0-c405e2fe5b96 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:53.679648 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ac94d151-10b1-482b-b2f0-c405e2fe5b96 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1270 microversion: 2.1 time: 0.100420 Jul 25 13:28:53.680585 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3098/6267] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:53 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:54.702119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-82102ab7-7035-4c55-b56d-e5369bef6bec tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:54.703019 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-82102ab7-7035-4c55-b56d-e5369bef6bec tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:54.719569 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82102ab7-7035-4c55-b56d-e5369bef6bec tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:54.721068 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82102ab7-7035-4c55-b56d-e5369bef6bec tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:54.723544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82102ab7-7035-4c55-b56d-e5369bef6bec tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:54.726045 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-82102ab7-7035-4c55-b56d-e5369bef6bec tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:55.010140 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-cf152bfc-dbd4-4567-8aa9-114cb5c5af74 req-d54dde25-bddc-446f-854b-c0ac46a35ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3948025-8303-41b5-8b9d-c064c82d3185", "tag": "02360568-d367-48a5-a7b3-de737e2cba1b"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:28:55.032372 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-cf152bfc-dbd4-4567-8aa9-114cb5c5af74 req-d54dde25-bddc-446f-854b-c0ac46a35ac0 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:55.034182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-cf152bfc-dbd4-4567-8aa9-114cb5c5af74 req-d54dde25-bddc-446f-854b-c0ac46a35ac0 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:55.066316 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-cf152bfc-dbd4-4567-8aa9-114cb5c5af74 req-d54dde25-bddc-446f-854b-c0ac46a35ac0 service nova] Creating event network-changed:02360568-d367-48a5-a7b3-de737e2cba1b for instance b3948025-8303-41b5-8b9d-c064c82d3185 on n-h1-848886-15 Jul 25 13:28:55.071822 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-cf152bfc-dbd4-4567-8aa9-114cb5c5af74 req-d54dde25-bddc-446f-854b-c0ac46a35ac0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070381 Jul 25 13:28:55.072631 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3099/6268] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:28:55.149330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-82102ab7-7035-4c55-b56d-e5369bef6bec tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:55.157254 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-82102ab7-7035-4c55-b56d-e5369bef6bec tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1312 microversion: 2.1 time: 0.460536 Jul 25 13:28:55.162273 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3170/6269] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:54 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1312 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:56.183295 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ad3c84d2-6f94-43ca-8a81-b62f20aa2fea tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:56.184002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ad3c84d2-6f94-43ca-8a81-b62f20aa2fea tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:56.191711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad3c84d2-6f94-43ca-8a81-b62f20aa2fea tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:56.192172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad3c84d2-6f94-43ca-8a81-b62f20aa2fea tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:56.192952 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad3c84d2-6f94-43ca-8a81-b62f20aa2fea tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:56.193393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad3c84d2-6f94-43ca-8a81-b62f20aa2fea tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:56.337083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ad3c84d2-6f94-43ca-8a81-b62f20aa2fea tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:56.346715 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ad3c84d2-6f94-43ca-8a81-b62f20aa2fea tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1312 microversion: 2.1 time: 0.167751 Jul 25 13:28:56.347471 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3100/6270] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:56 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1312 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:57.375085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6202ce90-0b73-4b69-a444-099c4359f7f5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:57.375704 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6202ce90-0b73-4b69-a444-099c4359f7f5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:57.383058 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6202ce90-0b73-4b69-a444-099c4359f7f5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:57.383535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6202ce90-0b73-4b69-a444-099c4359f7f5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:57.384314 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6202ce90-0b73-4b69-a444-099c4359f7f5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:57.384726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6202ce90-0b73-4b69-a444-099c4359f7f5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:57.528246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6202ce90-0b73-4b69-a444-099c4359f7f5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:57.536297 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6202ce90-0b73-4b69-a444-099c4359f7f5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1312 microversion: 2.1 time: 0.165171 Jul 25 13:28:57.536872 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3171/6271] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:57 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:58.558966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cd1f02a8-8e1a-41d7-a6a4-7360b3562dba tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:58.559595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cd1f02a8-8e1a-41d7-a6a4-7360b3562dba tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:58.566923 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd1f02a8-8e1a-41d7-a6a4-7360b3562dba tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:58.567393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd1f02a8-8e1a-41d7-a6a4-7360b3562dba tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:58.568181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd1f02a8-8e1a-41d7-a6a4-7360b3562dba tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:58.568624 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cd1f02a8-8e1a-41d7-a6a4-7360b3562dba tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:58.709149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cd1f02a8-8e1a-41d7-a6a4-7360b3562dba tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:58.716780 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cd1f02a8-8e1a-41d7-a6a4-7360b3562dba tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1312 microversion: 2.1 time: 0.163154 Jul 25 13:28:58.717354 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3101/6272] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:58 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:28:59.036862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-0f69e125-ea60-4052-94ac-0b092a4b952f req-e43886fa-32d8-4501-9fe2-afa0f61ca961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3948025-8303-41b5-8b9d-c064c82d3185", "name": "network-vif-plugged", "status": "completed", "tag": "02360568-d367-48a5-a7b3-de737e2cba1b"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:28:59.047534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-0f69e125-ea60-4052-94ac-0b092a4b952f req-e43886fa-32d8-4501-9fe2-afa0f61ca961 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:59.047975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-0f69e125-ea60-4052-94ac-0b092a4b952f req-e43886fa-32d8-4501-9fe2-afa0f61ca961 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:59.059254 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-0f69e125-ea60-4052-94ac-0b092a4b952f req-e43886fa-32d8-4501-9fe2-afa0f61ca961 service nova] Creating event network-vif-plugged:02360568-d367-48a5-a7b3-de737e2cba1b for instance b3948025-8303-41b5-8b9d-c064c82d3185 on n-h1-848886-15 Jul 25 13:28:59.064083 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-0f69e125-ea60-4052-94ac-0b092a4b952f req-e43886fa-32d8-4501-9fe2-afa0f61ca961 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030908 Jul 25 13:28:59.064669 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3172/6273] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:28:59.742411 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5861e475-6437-4599-b817-0084d1bbbf56 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:28:59.743429 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5861e475-6437-4599-b817-0084d1bbbf56 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:28:59.751432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5861e475-6437-4599-b817-0084d1bbbf56 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:59.751898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5861e475-6437-4599-b817-0084d1bbbf56 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:59.752675 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5861e475-6437-4599-b817-0084d1bbbf56 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:28:59.753126 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5861e475-6437-4599-b817-0084d1bbbf56 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:28:59.894457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5861e475-6437-4599-b817-0084d1bbbf56 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:28:59.896827 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:28:59.903714 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5861e475-6437-4599-b817-0084d1bbbf56 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1312 microversion: 2.1 time: 0.168031 Jul 25 13:28:59.904258 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3102/6274] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:28:59 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1312 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:00.926016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0be053a0-74a8-48d3-81b3-2496938600d2 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:00.926688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0be053a0-74a8-48d3-81b3-2496938600d2 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:00.928682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:29:00.934439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0be053a0-74a8-48d3-81b3-2496938600d2 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:00.934898 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0be053a0-74a8-48d3-81b3-2496938600d2 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:00.935666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0be053a0-74a8-48d3-81b3-2496938600d2 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:00.936105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0be053a0-74a8-48d3-81b3-2496938600d2 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:00.939533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=68 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:29:01.076921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0be053a0-74a8-48d3-81b3-2496938600d2 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:01.084890 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0be053a0-74a8-48d3-81b3-2496938600d2 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1498 microversion: 2.1 time: 0.164103 Jul 25 13:29:01.085466 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3173/6275] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:00 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1498 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:01.105738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-02b17a11-b82f-467c-a1d7-a7b040a74a40 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:29:01.108000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-02b17a11-b82f-467c-a1d7-a7b040a74a40 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:01.111279 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:29:01.119096 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02b17a11-b82f-467c-a1d7-a7b040a74a40 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:01.119681 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02b17a11-b82f-467c-a1d7-a7b040a74a40 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:01.120466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02b17a11-b82f-467c-a1d7-a7b040a74a40 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:01.120909 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02b17a11-b82f-467c-a1d7-a7b040a74a40 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:01.151345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-02b17a11-b82f-467c-a1d7-a7b040a74a40 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:01.157208 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-02b17a11-b82f-467c-a1d7-a7b040a74a40 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Old instance type m1.heat2, new instance type m1.heat {{(pid=125883) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 13:29:01.163458 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-02b17a11-b82f-467c-a1d7-a7b040a74a40 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:29:01.163905 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-02b17a11-b82f-467c-a1d7-a7b040a74a40 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:29:01.164419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-02b17a11-b82f-467c-a1d7-a7b040a74a40 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:29:01.164839 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-02b17a11-b82f-467c-a1d7-a7b040a74a40 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:29:01.165262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-02b17a11-b82f-467c-a1d7-a7b040a74a40 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:29:01.234813 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-02b17a11-b82f-467c-a1d7-a7b040a74a40 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "POST /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185/action" status: 202 len: 0 microversion: 2.1 time: 0.133037 Jul 25 13:29:01.235435 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3103/6276] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:29:01 2022] POST /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:29:01.243669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6cc53aa2-681f-4804-b280-87868378308e tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:01.244272 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6cc53aa2-681f-4804-b280-87868378308e tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:01.250563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cc53aa2-681f-4804-b280-87868378308e tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:01.251010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cc53aa2-681f-4804-b280-87868378308e tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:01.251767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cc53aa2-681f-4804-b280-87868378308e tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:01.252198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cc53aa2-681f-4804-b280-87868378308e tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:01.383985 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6cc53aa2-681f-4804-b280-87868378308e tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:01.391769 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6cc53aa2-681f-4804-b280-87868378308e tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1507 microversion: 2.1 time: 0.151985 Jul 25 13:29:01.392351 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3174/6277] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:01 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:29:02.411083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:29:02.411790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:29:02.415676 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0e4619c0-e6f6-41f5-a04f-32dd15973374 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:02.416305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0e4619c0-e6f6-41f5-a04f-32dd15973374 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:02.424202 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e4619c0-e6f6-41f5-a04f-32dd15973374 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:02.424669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e4619c0-e6f6-41f5-a04f-32dd15973374 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:02.425444 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e4619c0-e6f6-41f5-a04f-32dd15973374 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:02.425917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e4619c0-e6f6-41f5-a04f-32dd15973374 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:02.560622 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0e4619c0-e6f6-41f5-a04f-32dd15973374 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:02.572110 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0e4619c0-e6f6-41f5-a04f-32dd15973374 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1507 microversion: 2.1 time: 0.162539 Jul 25 13:29:02.572943 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3104/6278] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:02 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:03.595962 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2503b132-008d-415c-8b8a-55037b13248c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:03.596932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2503b132-008d-415c-8b8a-55037b13248c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:03.601283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:29:03.610379 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2503b132-008d-415c-8b8a-55037b13248c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:03.611137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2503b132-008d-415c-8b8a-55037b13248c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:03.612411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2503b132-008d-415c-8b8a-55037b13248c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:03.613149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2503b132-008d-415c-8b8a-55037b13248c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:04.054342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2503b132-008d-415c-8b8a-55037b13248c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:04.062151 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2503b132-008d-415c-8b8a-55037b13248c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1512 microversion: 2.1 time: 0.472980 Jul 25 13:29:04.062695 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3175/6279] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:03 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1512 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:05.087805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-171d3ebe-1bde-427b-8e50-b7209fc083dd tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:05.088883 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-171d3ebe-1bde-427b-8e50-b7209fc083dd tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:05.097735 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-171d3ebe-1bde-427b-8e50-b7209fc083dd tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:05.098319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-171d3ebe-1bde-427b-8e50-b7209fc083dd tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:05.099224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-171d3ebe-1bde-427b-8e50-b7209fc083dd tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:05.099750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-171d3ebe-1bde-427b-8e50-b7209fc083dd tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:05.233403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-171d3ebe-1bde-427b-8e50-b7209fc083dd tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:05.241321 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-171d3ebe-1bde-427b-8e50-b7209fc083dd tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1512 microversion: 2.1 time: 0.160114 Jul 25 13:29:05.241924 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3105/6280] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:05 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:06.266628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d0d24490-2d5b-49ee-be7e-6d566ded3308 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:06.267616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d0d24490-2d5b-49ee-be7e-6d566ded3308 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:06.279395 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d0d24490-2d5b-49ee-be7e-6d566ded3308 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:06.280152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d0d24490-2d5b-49ee-be7e-6d566ded3308 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:06.281422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d0d24490-2d5b-49ee-be7e-6d566ded3308 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:06.282196 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d0d24490-2d5b-49ee-be7e-6d566ded3308 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:06.420821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d0d24490-2d5b-49ee-be7e-6d566ded3308 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:06.432277 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d0d24490-2d5b-49ee-be7e-6d566ded3308 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1512 microversion: 2.1 time: 0.172009 Jul 25 13:29:06.433012 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3176/6281] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:06 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:07.462592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c3f5cfed-94fa-4a99-bdb7-aa83c248a0d9 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:07.463551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c3f5cfed-94fa-4a99-bdb7-aa83c248a0d9 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:07.470965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3f5cfed-94fa-4a99-bdb7-aa83c248a0d9 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:07.471439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3f5cfed-94fa-4a99-bdb7-aa83c248a0d9 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:07.472223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3f5cfed-94fa-4a99-bdb7-aa83c248a0d9 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:07.472677 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3f5cfed-94fa-4a99-bdb7-aa83c248a0d9 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:07.623631 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c3f5cfed-94fa-4a99-bdb7-aa83c248a0d9 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:07.631741 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c3f5cfed-94fa-4a99-bdb7-aa83c248a0d9 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1512 microversion: 2.1 time: 0.175893 Jul 25 13:29:07.632316 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3106/6282] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:07 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:08.656976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d3314daa-e3e3-433c-9b96-13913bb4a787 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:08.657982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d3314daa-e3e3-433c-9b96-13913bb4a787 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:08.668563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3314daa-e3e3-433c-9b96-13913bb4a787 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:08.669008 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3314daa-e3e3-433c-9b96-13913bb4a787 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:08.669784 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3314daa-e3e3-433c-9b96-13913bb4a787 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:08.670232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d3314daa-e3e3-433c-9b96-13913bb4a787 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:08.804544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d3314daa-e3e3-433c-9b96-13913bb4a787 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:08.812300 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d3314daa-e3e3-433c-9b96-13913bb4a787 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1512 microversion: 2.1 time: 0.161790 Jul 25 13:29:08.812869 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3177/6283] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:08 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:09.839480 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-eb78018d-8d27-4b67-b9e2-55cc8891bcd9 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:09.840410 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-eb78018d-8d27-4b67-b9e2-55cc8891bcd9 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:09.850809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb78018d-8d27-4b67-b9e2-55cc8891bcd9 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:09.851504 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb78018d-8d27-4b67-b9e2-55cc8891bcd9 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:09.852672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb78018d-8d27-4b67-b9e2-55cc8891bcd9 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:09.853341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb78018d-8d27-4b67-b9e2-55cc8891bcd9 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:09.995917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-eb78018d-8d27-4b67-b9e2-55cc8891bcd9 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:10.007515 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-eb78018d-8d27-4b67-b9e2-55cc8891bcd9 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1512 microversion: 2.1 time: 0.176677 Jul 25 13:29:10.008315 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3107/6284] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:09 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:11.033036 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b6359693-a0f5-4dcf-a1d6-c90902e92cb5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:11.034148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b6359693-a0f5-4dcf-a1d6-c90902e92cb5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:11.045889 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6359693-a0f5-4dcf-a1d6-c90902e92cb5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:11.046658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6359693-a0f5-4dcf-a1d6-c90902e92cb5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:11.047930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6359693-a0f5-4dcf-a1d6-c90902e92cb5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:11.048660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6359693-a0f5-4dcf-a1d6-c90902e92cb5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:11.194934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b6359693-a0f5-4dcf-a1d6-c90902e92cb5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:11.206658 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b6359693-a0f5-4dcf-a1d6-c90902e92cb5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1512 microversion: 2.1 time: 0.180110 Jul 25 13:29:11.207321 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3178/6285] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:11 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1512 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:12.230889 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d84e9eb1-9c9e-42d5-8b60-9872e34b34a5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:12.231635 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d84e9eb1-9c9e-42d5-8b60-9872e34b34a5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:12.238991 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d84e9eb1-9c9e-42d5-8b60-9872e34b34a5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:12.239456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d84e9eb1-9c9e-42d5-8b60-9872e34b34a5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:12.240237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d84e9eb1-9c9e-42d5-8b60-9872e34b34a5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:12.240682 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d84e9eb1-9c9e-42d5-8b60-9872e34b34a5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:12.376786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d84e9eb1-9c9e-42d5-8b60-9872e34b34a5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:12.384507 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d84e9eb1-9c9e-42d5-8b60-9872e34b34a5 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1512 microversion: 2.1 time: 0.157741 Jul 25 13:29:12.385420 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3108/6286] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:12 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:13.409728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-800b8226-149c-4e56-8bcf-1605c05a3eda tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:13.410683 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-800b8226-149c-4e56-8bcf-1605c05a3eda tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:13.422416 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-800b8226-149c-4e56-8bcf-1605c05a3eda tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:13.423168 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-800b8226-149c-4e56-8bcf-1605c05a3eda tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:13.424427 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-800b8226-149c-4e56-8bcf-1605c05a3eda tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:13.425159 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-800b8226-149c-4e56-8bcf-1605c05a3eda tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:13.558792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-800b8226-149c-4e56-8bcf-1605c05a3eda tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:13.566966 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-800b8226-149c-4e56-8bcf-1605c05a3eda tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1512 microversion: 2.1 time: 0.163971 Jul 25 13:29:13.567546 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3179/6287] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:13 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:14.589530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e92579bf-ce12-4985-9f8c-39bc85bdb310 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:14.590298 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e92579bf-ce12-4985-9f8c-39bc85bdb310 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:14.599349 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e92579bf-ce12-4985-9f8c-39bc85bdb310 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:14.599928 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e92579bf-ce12-4985-9f8c-39bc85bdb310 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:14.600845 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e92579bf-ce12-4985-9f8c-39bc85bdb310 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:14.601378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e92579bf-ce12-4985-9f8c-39bc85bdb310 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:14.736645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e92579bf-ce12-4985-9f8c-39bc85bdb310 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:14.746828 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e92579bf-ce12-4985-9f8c-39bc85bdb310 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1512 microversion: 2.1 time: 0.162161 Jul 25 13:29:14.747380 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3109/6288] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:14 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:15.772033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ae874369-7980-461a-a626-79c39f37781a tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:15.772932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ae874369-7980-461a-a626-79c39f37781a tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:15.781444 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae874369-7980-461a-a626-79c39f37781a tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:15.781937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae874369-7980-461a-a626-79c39f37781a tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:15.782707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae874369-7980-461a-a626-79c39f37781a tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:15.783146 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae874369-7980-461a-a626-79c39f37781a tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:15.914505 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ae874369-7980-461a-a626-79c39f37781a tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:15.922838 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ae874369-7980-461a-a626-79c39f37781a tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1512 microversion: 2.1 time: 0.157399 Jul 25 13:29:15.923440 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3180/6289] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:15 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:16.948156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c27c2cd5-5bf2-44e4-ae08-bd96721eff90 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:16.948963 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c27c2cd5-5bf2-44e4-ae08-bd96721eff90 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:16.957512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c27c2cd5-5bf2-44e4-ae08-bd96721eff90 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:16.958109 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c27c2cd5-5bf2-44e4-ae08-bd96721eff90 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:16.959028 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c27c2cd5-5bf2-44e4-ae08-bd96721eff90 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:16.959558 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c27c2cd5-5bf2-44e4-ae08-bd96721eff90 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:17.105140 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c27c2cd5-5bf2-44e4-ae08-bd96721eff90 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:17.113368 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c27c2cd5-5bf2-44e4-ae08-bd96721eff90 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1512 microversion: 2.1 time: 0.171871 Jul 25 13:29:17.113978 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3110/6290] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:16 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:18.134563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-04eb1608-9730-4c0c-8bcc-24f770a4dd6d tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:18.135299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-04eb1608-9730-4c0c-8bcc-24f770a4dd6d tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:18.142716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04eb1608-9730-4c0c-8bcc-24f770a4dd6d tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:18.143444 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04eb1608-9730-4c0c-8bcc-24f770a4dd6d tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:18.144410 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04eb1608-9730-4c0c-8bcc-24f770a4dd6d tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:18.144856 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04eb1608-9730-4c0c-8bcc-24f770a4dd6d tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:18.278284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-04eb1608-9730-4c0c-8bcc-24f770a4dd6d tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:18.286077 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-04eb1608-9730-4c0c-8bcc-24f770a4dd6d tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1512 microversion: 2.1 time: 0.155478 Jul 25 13:29:18.286651 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3181/6291] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:18 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:19.310516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-064e64bc-81eb-4d36-abb7-ff90a79a93a3 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:19.311206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-064e64bc-81eb-4d36-abb7-ff90a79a93a3 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:19.319744 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-064e64bc-81eb-4d36-abb7-ff90a79a93a3 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:19.320299 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-064e64bc-81eb-4d36-abb7-ff90a79a93a3 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:19.321221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-064e64bc-81eb-4d36-abb7-ff90a79a93a3 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:19.321759 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-064e64bc-81eb-4d36-abb7-ff90a79a93a3 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:19.460726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-064e64bc-81eb-4d36-abb7-ff90a79a93a3 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:19.468522 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-064e64bc-81eb-4d36-abb7-ff90a79a93a3 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1512 microversion: 2.1 time: 0.163548 Jul 25 13:29:19.469148 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3111/6292] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:19 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:20.501525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-14600c0a-1a5b-4775-97f6-51dfe949bd83 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:20.502484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-14600c0a-1a5b-4775-97f6-51dfe949bd83 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:20.512635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14600c0a-1a5b-4775-97f6-51dfe949bd83 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:20.513079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14600c0a-1a5b-4775-97f6-51dfe949bd83 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:20.513861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14600c0a-1a5b-4775-97f6-51dfe949bd83 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:20.514305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-14600c0a-1a5b-4775-97f6-51dfe949bd83 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:20.651340 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-14600c0a-1a5b-4775-97f6-51dfe949bd83 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:20.662581 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-14600c0a-1a5b-4775-97f6-51dfe949bd83 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1512 microversion: 2.1 time: 0.167306 Jul 25 13:29:20.663276 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3182/6293] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:20 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:21.687898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1785e1a4-1459-4e7a-a040-eced1be8a71c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:21.688731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1785e1a4-1459-4e7a-a040-eced1be8a71c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:21.699665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1785e1a4-1459-4e7a-a040-eced1be8a71c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:21.700361 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1785e1a4-1459-4e7a-a040-eced1be8a71c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:21.701584 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1785e1a4-1459-4e7a-a040-eced1be8a71c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:21.702328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1785e1a4-1459-4e7a-a040-eced1be8a71c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:21.833628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1785e1a4-1459-4e7a-a040-eced1be8a71c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:21.841367 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1785e1a4-1459-4e7a-a040-eced1be8a71c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1512 microversion: 2.1 time: 0.159954 Jul 25 13:29:21.841934 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3112/6294] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:21 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:22.862829 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-84fe0955-bf87-4770-9a40-a7b0dea672b2 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:22.863436 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-84fe0955-bf87-4770-9a40-a7b0dea672b2 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:22.871000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84fe0955-bf87-4770-9a40-a7b0dea672b2 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:22.871450 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84fe0955-bf87-4770-9a40-a7b0dea672b2 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:22.872216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84fe0955-bf87-4770-9a40-a7b0dea672b2 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:22.872651 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84fe0955-bf87-4770-9a40-a7b0dea672b2 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:23.024782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-84fe0955-bf87-4770-9a40-a7b0dea672b2 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:23.032957 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-84fe0955-bf87-4770-9a40-a7b0dea672b2 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1512 microversion: 2.1 time: 0.174049 Jul 25 13:29:23.033542 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3183/6295] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:22 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:24.057972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6c318bf6-3185-467b-8808-a3e609a30238 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:24.058813 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6c318bf6-3185-467b-8808-a3e609a30238 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:24.068247 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c318bf6-3185-467b-8808-a3e609a30238 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:24.068870 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c318bf6-3185-467b-8808-a3e609a30238 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:24.069949 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c318bf6-3185-467b-8808-a3e609a30238 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:24.070556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6c318bf6-3185-467b-8808-a3e609a30238 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:24.209310 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6c318bf6-3185-467b-8808-a3e609a30238 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:24.221143 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6c318bf6-3185-467b-8808-a3e609a30238 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1512 microversion: 2.1 time: 0.169508 Jul 25 13:29:24.221862 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3113/6296] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:24 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:25.245486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2299bcf9-6f27-474a-84bf-7a9c67f40e26 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:25.246255 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2299bcf9-6f27-474a-84bf-7a9c67f40e26 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:25.253447 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2299bcf9-6f27-474a-84bf-7a9c67f40e26 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:25.253929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2299bcf9-6f27-474a-84bf-7a9c67f40e26 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:25.254703 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2299bcf9-6f27-474a-84bf-7a9c67f40e26 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:25.255147 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2299bcf9-6f27-474a-84bf-7a9c67f40e26 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:25.392186 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2299bcf9-6f27-474a-84bf-7a9c67f40e26 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:25.399842 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2299bcf9-6f27-474a-84bf-7a9c67f40e26 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1512 microversion: 2.1 time: 0.158376 Jul 25 13:29:25.400423 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3184/6297] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:25 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:26.432182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d65680d7-cbbe-4e9e-ba6f-90f51755da47 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:26.433210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d65680d7-cbbe-4e9e-ba6f-90f51755da47 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:26.445068 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d65680d7-cbbe-4e9e-ba6f-90f51755da47 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:26.445897 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d65680d7-cbbe-4e9e-ba6f-90f51755da47 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:26.447335 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d65680d7-cbbe-4e9e-ba6f-90f51755da47 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:26.447957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d65680d7-cbbe-4e9e-ba6f-90f51755da47 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:26.582594 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d65680d7-cbbe-4e9e-ba6f-90f51755da47 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:26.591303 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d65680d7-cbbe-4e9e-ba6f-90f51755da47 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1512 microversion: 2.1 time: 0.165730 Jul 25 13:29:26.591912 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3114/6298] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:26 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:27.620613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cccd87f9-21eb-4d4b-be20-4c681d1ea856 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:27.621369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cccd87f9-21eb-4d4b-be20-4c681d1ea856 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:27.630366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cccd87f9-21eb-4d4b-be20-4c681d1ea856 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:27.630943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cccd87f9-21eb-4d4b-be20-4c681d1ea856 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:27.631908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cccd87f9-21eb-4d4b-be20-4c681d1ea856 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:27.632457 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cccd87f9-21eb-4d4b-be20-4c681d1ea856 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:27.777376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cccd87f9-21eb-4d4b-be20-4c681d1ea856 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:27.785703 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cccd87f9-21eb-4d4b-be20-4c681d1ea856 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1512 microversion: 2.1 time: 0.171496 Jul 25 13:29:27.786349 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3185/6299] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:27 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:28.811113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aa9522a3-1d4a-45c7-a608-231e4018a78e tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:28.812408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-aa9522a3-1d4a-45c7-a608-231e4018a78e tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:28.825432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa9522a3-1d4a-45c7-a608-231e4018a78e tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:28.826178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa9522a3-1d4a-45c7-a608-231e4018a78e tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:28.827382 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa9522a3-1d4a-45c7-a608-231e4018a78e tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:28.828108 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aa9522a3-1d4a-45c7-a608-231e4018a78e tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:28.984156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-aa9522a3-1d4a-45c7-a608-231e4018a78e tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:28.994747 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aa9522a3-1d4a-45c7-a608-231e4018a78e tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1512 microversion: 2.1 time: 0.189953 Jul 25 13:29:28.995328 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3115/6300] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:28 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1512 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:30.019226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7998060e-c05e-4086-a489-ac5cd303c64c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:30.020238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7998060e-c05e-4086-a489-ac5cd303c64c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:30.030305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7998060e-c05e-4086-a489-ac5cd303c64c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:30.030756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7998060e-c05e-4086-a489-ac5cd303c64c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:30.031533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7998060e-c05e-4086-a489-ac5cd303c64c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:30.031972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7998060e-c05e-4086-a489-ac5cd303c64c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:30.175628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7998060e-c05e-4086-a489-ac5cd303c64c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:30.183359 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7998060e-c05e-4086-a489-ac5cd303c64c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1512 microversion: 2.1 time: 0.170726 Jul 25 13:29:30.183946 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3186/6301] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:30 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:30.679201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-dd258dfe-bd7a-4c67-ae16-a5c026e8a0ed req-44263d4f-401b-42a2-9737-a1b90de83e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3948025-8303-41b5-8b9d-c064c82d3185", "name": "network-vif-unplugged", "status": "completed", "tag": "02360568-d367-48a5-a7b3-de737e2cba1b"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:29:30.690140 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-dd258dfe-bd7a-4c67-ae16-a5c026e8a0ed req-44263d4f-401b-42a2-9737-a1b90de83e6a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:30.690701 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-dd258dfe-bd7a-4c67-ae16-a5c026e8a0ed req-44263d4f-401b-42a2-9737-a1b90de83e6a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:30.703220 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-dd258dfe-bd7a-4c67-ae16-a5c026e8a0ed req-44263d4f-401b-42a2-9737-a1b90de83e6a service nova] Creating event network-vif-unplugged:02360568-d367-48a5-a7b3-de737e2cba1b for instance b3948025-8303-41b5-8b9d-c064c82d3185 on n-h2-848886-15 Jul 25 13:29:30.708824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [req-dd258dfe-bd7a-4c67-ae16-a5c026e8a0ed req-44263d4f-401b-42a2-9737-a1b90de83e6a service nova] Instance b3948025-8303-41b5-8b9d-c064c82d3185 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125883) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:29:30.720537 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-dd258dfe-bd7a-4c67-ae16-a5c026e8a0ed req-44263d4f-401b-42a2-9737-a1b90de83e6a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044765 Jul 25 13:29:30.721338 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3116/6302] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:29:31.206334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9e2ec7e7-871a-47e0-85bc-a9f67a52f494 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:31.207039 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9e2ec7e7-871a-47e0-85bc-a9f67a52f494 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:31.209872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=28 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:29:31.216843 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e2ec7e7-871a-47e0-85bc-a9f67a52f494 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:31.217542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e2ec7e7-871a-47e0-85bc-a9f67a52f494 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:31.218773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e2ec7e7-871a-47e0-85bc-a9f67a52f494 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:31.219433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9e2ec7e7-871a-47e0-85bc-a9f67a52f494 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:31.223719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=84 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:29:31.429970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9e2ec7e7-871a-47e0-85bc-a9f67a52f494 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:31.437875 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9e2ec7e7-871a-47e0-85bc-a9f67a52f494 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1511 microversion: 2.1 time: 0.235697 Jul 25 13:29:31.438651 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3187/6303] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:31 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1511 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:32.461115 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c838e88f-2f46-46d1-a190-8fb0d3e75571 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:32.461822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c838e88f-2f46-46d1-a190-8fb0d3e75571 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:32.463823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=32 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:29:32.470764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c838e88f-2f46-46d1-a190-8fb0d3e75571 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:32.471230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c838e88f-2f46-46d1-a190-8fb0d3e75571 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:32.472019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c838e88f-2f46-46d1-a190-8fb0d3e75571 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:32.472468 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c838e88f-2f46-46d1-a190-8fb0d3e75571 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:32.476357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:29:32.611978 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c838e88f-2f46-46d1-a190-8fb0d3e75571 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:32.622611 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c838e88f-2f46-46d1-a190-8fb0d3e75571 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1509 microversion: 2.1 time: 0.166272 Jul 25 13:29:32.623433 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3117/6304] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:32 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:32.738322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-6d57b6c2-389d-4ed4-bf49-79b7819b5e08 req-5167cd1d-44db-4332-80c5-c055a07f90f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3948025-8303-41b5-8b9d-c064c82d3185", "tag": "02360568-d367-48a5-a7b3-de737e2cba1b"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:29:32.750795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6d57b6c2-389d-4ed4-bf49-79b7819b5e08 req-5167cd1d-44db-4332-80c5-c055a07f90f8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:32.751232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6d57b6c2-389d-4ed4-bf49-79b7819b5e08 req-5167cd1d-44db-4332-80c5-c055a07f90f8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:32.765350 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-6d57b6c2-389d-4ed4-bf49-79b7819b5e08 req-5167cd1d-44db-4332-80c5-c055a07f90f8 service nova] Creating event network-changed:02360568-d367-48a5-a7b3-de737e2cba1b for instance b3948025-8303-41b5-8b9d-c064c82d3185 on n-h2-848886-15 Jul 25 13:29:32.770834 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [req-6d57b6c2-389d-4ed4-bf49-79b7819b5e08 req-5167cd1d-44db-4332-80c5-c055a07f90f8 service nova] Instance b3948025-8303-41b5-8b9d-c064c82d3185 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:29:32.781582 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-6d57b6c2-389d-4ed4-bf49-79b7819b5e08 req-5167cd1d-44db-4332-80c5-c055a07f90f8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048522 Jul 25 13:29:32.782431 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3188/6305] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:29:33.648769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-55a9fd27-b7fe-4b25-842c-5daebaf0997d tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:33.649365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-55a9fd27-b7fe-4b25-842c-5daebaf0997d tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:33.656689 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55a9fd27-b7fe-4b25-842c-5daebaf0997d tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:33.657161 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55a9fd27-b7fe-4b25-842c-5daebaf0997d tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:33.657969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55a9fd27-b7fe-4b25-842c-5daebaf0997d tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:33.658451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55a9fd27-b7fe-4b25-842c-5daebaf0997d tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:33.791771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-55a9fd27-b7fe-4b25-842c-5daebaf0997d tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:33.800793 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-55a9fd27-b7fe-4b25-842c-5daebaf0997d tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1506 microversion: 2.1 time: 0.156106 Jul 25 13:29:33.801372 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3118/6306] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:33 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:33.822697 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7168f132-0c46-42e9-bc94-e9bf09f2c4ef tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:33.823297 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7168f132-0c46-42e9-bc94-e9bf09f2c4ef tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:33.829524 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7168f132-0c46-42e9-bc94-e9bf09f2c4ef tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:33.830012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7168f132-0c46-42e9-bc94-e9bf09f2c4ef tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:33.830777 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7168f132-0c46-42e9-bc94-e9bf09f2c4ef tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:33.831183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7168f132-0c46-42e9-bc94-e9bf09f2c4ef tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:33.857207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7168f132-0c46-42e9-bc94-e9bf09f2c4ef tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:29:33.908462 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.compute.api [None req-7168f132-0c46-42e9-bc94-e9bf09f2c4ef tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Found an unconfirmed migration during delete, id: 16, status: finished Jul 25 13:29:35.306139 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7168f132-0c46-42e9-bc94-e9bf09f2c4ef tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 204 len: 0 microversion: 2.1 time: 1.488301 Jul 25 13:29:35.307622 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3189/6307] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:29:33 2022] DELETE /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 0 bytes in 1491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:29:35.316063 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-55c69738-13ad-44db-a0d6-b26b0fcc349c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:35.316578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-55c69738-13ad-44db-a0d6-b26b0fcc349c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:35.323913 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55c69738-13ad-44db-a0d6-b26b0fcc349c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:35.324382 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55c69738-13ad-44db-a0d6-b26b0fcc349c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:35.325154 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55c69738-13ad-44db-a0d6-b26b0fcc349c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:35.325641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55c69738-13ad-44db-a0d6-b26b0fcc349c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:35.472689 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-55c69738-13ad-44db-a0d6-b26b0fcc349c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:35.482255 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-55c69738-13ad-44db-a0d6-b26b0fcc349c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1498 microversion: 2.1 time: 0.170226 Jul 25 13:29:35.482836 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3119/6308] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:35 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1498 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:35.736375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-290223c7-8b26-4db4-87bf-511342fb60d1 req-5b547c7f-39c7-4071-8d5f-26df5b1a4a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3948025-8303-41b5-8b9d-c064c82d3185", "name": "network-vif-plugged", "status": "completed", "tag": "02360568-d367-48a5-a7b3-de737e2cba1b"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:29:35.746714 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-290223c7-8b26-4db4-87bf-511342fb60d1 req-5b547c7f-39c7-4071-8d5f-26df5b1a4a0f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:35.747327 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-290223c7-8b26-4db4-87bf-511342fb60d1 req-5b547c7f-39c7-4071-8d5f-26df5b1a4a0f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:35.759122 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-290223c7-8b26-4db4-87bf-511342fb60d1 req-5b547c7f-39c7-4071-8d5f-26df5b1a4a0f service nova] Creating event network-vif-plugged:02360568-d367-48a5-a7b3-de737e2cba1b for instance b3948025-8303-41b5-8b9d-c064c82d3185 on n-h2-848886-15 Jul 25 13:29:35.764582 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-290223c7-8b26-4db4-87bf-511342fb60d1 req-5b547c7f-39c7-4071-8d5f-26df5b1a4a0f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032265 Jul 25 13:29:35.765461 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3190/6309] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:29:36.503314 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0ffc7e87-a723-4510-a3c7-2accebcdfee8 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:36.503898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0ffc7e87-a723-4510-a3c7-2accebcdfee8 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:36.511335 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ffc7e87-a723-4510-a3c7-2accebcdfee8 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:36.511801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ffc7e87-a723-4510-a3c7-2accebcdfee8 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:36.512590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ffc7e87-a723-4510-a3c7-2accebcdfee8 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:36.513042 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ffc7e87-a723-4510-a3c7-2accebcdfee8 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:36.702133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0ffc7e87-a723-4510-a3c7-2accebcdfee8 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e044c6fce7b4fd68103fa5e41387f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650b04ac3eb84719bcd04dc95bc7b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:36.709824 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0ffc7e87-a723-4510-a3c7-2accebcdfee8 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 200 len: 1498 microversion: 2.1 time: 0.210593 Jul 25 13:29:36.710413 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3120/6310] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:36 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 1498 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:37.391070 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-c331fc6b-3e85-4b0e-be62-02c17e03d929 req-37ab4200-c4d3-48e5-919a-d807a76f67af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3948025-8303-41b5-8b9d-c064c82d3185", "name": "network-vif-deleted", "tag": "02360568-d367-48a5-a7b3-de737e2cba1b"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:29:37.401705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c331fc6b-3e85-4b0e-be62-02c17e03d929 req-37ab4200-c4d3-48e5-919a-d807a76f67af service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:37.402193 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c331fc6b-3e85-4b0e-be62-02c17e03d929 req-37ab4200-c4d3-48e5-919a-d807a76f67af service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:37.413725 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-c331fc6b-3e85-4b0e-be62-02c17e03d929 req-37ab4200-c4d3-48e5-919a-d807a76f67af service nova] Creating event network-vif-deleted:02360568-d367-48a5-a7b3-de737e2cba1b for instance b3948025-8303-41b5-8b9d-c064c82d3185 on n-h2-848886-15 Jul 25 13:29:37.418652 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-c331fc6b-3e85-4b0e-be62-02c17e03d929 req-37ab4200-c4d3-48e5-919a-d807a76f67af service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032477 Jul 25 13:29:37.419318 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3191/6311] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:29:37.731670 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-84b2a27f-40ce-47fc-be17-2ba841ab195c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:37.732354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-84b2a27f-40ce-47fc-be17-2ba841ab195c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:37.739915 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-84b2a27f-40ce-47fc-be17-2ba841ab195c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:37.740387 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-84b2a27f-40ce-47fc-be17-2ba841ab195c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:37.741163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-84b2a27f-40ce-47fc-be17-2ba841ab195c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:37.741620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-84b2a27f-40ce-47fc-be17-2ba841ab195c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:37.757056 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-84b2a27f-40ce-47fc-be17-2ba841ab195c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] HTTP exception thrown: Instance b3948025-8303-41b5-8b9d-c064c82d3185 could not be found. Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-84b2a27f-40ce-47fc-be17-2ba841ab195c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Request method failure captured: Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 HTTP/1.1 Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pqTFdJNDdlOibBbin6H26RRgf8Pl4XwgDrbrrivu6hw0FJxbb5GsYxnquaRSO9gAneP1WFAbqJE80cOCJSkLWqYwI5_IdS9p3IO-K9IfQRf6WCHUvxXDHDJYvd1jW8k7L4DosXb0SALSJZcEfEAdPiG-xTpHhCKQlCgqeYZRqH87Jc Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 650b04ac3eb84719bcd04dc95bc7b637 Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-DeleteServersTestJSON-802762156 Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_650b04ac3eb84719bcd04dc95bc7b637", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/650b04ac3eb84719bcd04dc95bc7b637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/650b04ac3eb84719bcd04dc95bc7b637"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/650b04ac3eb84719bcd04dc95bc7b637"}]}] Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-DeleteServersTestJSON-802762156 Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 650b04ac3eb84719bcd04dc95bc7b637 Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-DeleteServersTestJSON-802762156 Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-DeleteServersTestJSON-802762156-project Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 7e044c6fce7b4fd68103fa5e41387f3e Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-DeleteServersTestJSON-802762156-project Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance b3948025-8303-41b5-8b9d-c064c82d3185 could not be found. Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'b3948025-8303-41b5-8b9d-c064c82d3185'} Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3948025-8303-41b5-8b9d-c064c82d3185 could not be found. Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3948025-8303-41b5-8b9d-c064c82d3185 could not be found. Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:29:37.758799 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:29:37.764225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:29:37.764225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:29:37.764225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:29:37.764225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:29:37.764225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:29:37.764225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3948025-8303-41b5-8b9d-c064c82d3185 could not be found. Jul 25 13:29:37.764225 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:29:37.764225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-84b2a27f-40ce-47fc-be17-2ba841ab195c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Returning 404 to user: Instance b3948025-8303-41b5-8b9d-c064c82d3185 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:29:37.764225 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-84b2a27f-40ce-47fc-be17-2ba841ab195c tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 404 len: 111 microversion: 2.1 time: 0.032943 Jul 25 13:29:37.765094 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3121/6312] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:37 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:29:37.774322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a39e5f52-a8a8-4a17-87c0-62bf62f5cc34 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:37.774920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a39e5f52-a8a8-4a17-87c0-62bf62f5cc34 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:37.781606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a39e5f52-a8a8-4a17-87c0-62bf62f5cc34 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:37.782122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a39e5f52-a8a8-4a17-87c0-62bf62f5cc34 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:37.782873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a39e5f52-a8a8-4a17-87c0-62bf62f5cc34 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:37.783312 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a39e5f52-a8a8-4a17-87c0-62bf62f5cc34 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:37.797523 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-a39e5f52-a8a8-4a17-87c0-62bf62f5cc34 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] HTTP exception thrown: Instance b3948025-8303-41b5-8b9d-c064c82d3185 could not be found. Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a39e5f52-a8a8-4a17-87c0-62bf62f5cc34 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Request method failure captured: Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 HTTP/1.1 Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pqTFdJNDdlOibBbin6H26RRgf8Pl4XwgDrbrrivu6hw0FJxbb5GsYxnquaRSO9gAneP1WFAbqJE80cOCJSkLWqYwI5_IdS9p3IO-K9IfQRf6WCHUvxXDHDJYvd1jW8k7L4DosXb0SALSJZcEfEAdPiG-xTpHhCKQlCgqeYZRqH87Jc Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 650b04ac3eb84719bcd04dc95bc7b637 Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-DeleteServersTestJSON-802762156 Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_650b04ac3eb84719bcd04dc95bc7b637", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/650b04ac3eb84719bcd04dc95bc7b637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/650b04ac3eb84719bcd04dc95bc7b637"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/650b04ac3eb84719bcd04dc95bc7b637"}]}] Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-DeleteServersTestJSON-802762156 Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 650b04ac3eb84719bcd04dc95bc7b637 Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-DeleteServersTestJSON-802762156 Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-DeleteServersTestJSON-802762156-project Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 7e044c6fce7b4fd68103fa5e41387f3e Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-DeleteServersTestJSON-802762156-project Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance b3948025-8303-41b5-8b9d-c064c82d3185 could not be found. Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'b3948025-8303-41b5-8b9d-c064c82d3185'} Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3948025-8303-41b5-8b9d-c064c82d3185 could not be found. Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:29:37.799301 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:29:37.804769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3948025-8303-41b5-8b9d-c064c82d3185 could not be found. Jul 25 13:29:37.804769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:29:37.804769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:29:37.804769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:29:37.804769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:29:37.804769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:29:37.804769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:29:37.804769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:29:37.804769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:29:37.804769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3948025-8303-41b5-8b9d-c064c82d3185 could not be found. Jul 25 13:29:37.804769 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:29:37.804769 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a39e5f52-a8a8-4a17-87c0-62bf62f5cc34 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Returning 404 to user: Instance b3948025-8303-41b5-8b9d-c064c82d3185 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:29:37.804769 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a39e5f52-a8a8-4a17-87c0-62bf62f5cc34 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 404 len: 111 microversion: 2.1 time: 0.031428 Jul 25 13:29:37.804769 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3192/6313] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:29:37 2022] DELETE /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:29:37.809292 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4c9bad62-f777-4b6c-ba1c-8d0f328f8886 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:37.809956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4c9bad62-f777-4b6c-ba1c-8d0f328f8886 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] [instance: b3948025-8303-41b5-8b9d-c064c82d3185] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:37.824493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c9bad62-f777-4b6c-ba1c-8d0f328f8886 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:37.825066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c9bad62-f777-4b6c-ba1c-8d0f328f8886 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:37.826022 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c9bad62-f777-4b6c-ba1c-8d0f328f8886 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:37.826535 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c9bad62-f777-4b6c-ba1c-8d0f328f8886 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:37.842151 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-4c9bad62-f777-4b6c-ba1c-8d0f328f8886 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] HTTP exception thrown: Instance b3948025-8303-41b5-8b9d-c064c82d3185 could not be found. Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4c9bad62-f777-4b6c-ba1c-8d0f328f8886 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Request method failure captured: Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 HTTP/1.1 Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pqTFdJNDdlOibBbin6H26RRgf8Pl4XwgDrbrrivu6hw0FJxbb5GsYxnquaRSO9gAneP1WFAbqJE80cOCJSkLWqYwI5_IdS9p3IO-K9IfQRf6WCHUvxXDHDJYvd1jW8k7L4DosXb0SALSJZcEfEAdPiG-xTpHhCKQlCgqeYZRqH87Jc Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 650b04ac3eb84719bcd04dc95bc7b637 Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-DeleteServersTestJSON-802762156 Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_650b04ac3eb84719bcd04dc95bc7b637", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/650b04ac3eb84719bcd04dc95bc7b637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/650b04ac3eb84719bcd04dc95bc7b637"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/650b04ac3eb84719bcd04dc95bc7b637"}]}] Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-DeleteServersTestJSON-802762156 Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 650b04ac3eb84719bcd04dc95bc7b637 Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-DeleteServersTestJSON-802762156 Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-DeleteServersTestJSON-802762156-project Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 7e044c6fce7b4fd68103fa5e41387f3e Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-DeleteServersTestJSON-802762156-project Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance b3948025-8303-41b5-8b9d-c064c82d3185 could not be found. Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'b3948025-8303-41b5-8b9d-c064c82d3185'} Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3948025-8303-41b5-8b9d-c064c82d3185 could not be found. Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3948025-8303-41b5-8b9d-c064c82d3185 could not be found. Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:29:37.843730 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:29:37.849117 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:29:37.849117 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:29:37.849117 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:29:37.849117 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:29:37.849117 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:29:37.849117 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3948025-8303-41b5-8b9d-c064c82d3185 could not be found. Jul 25 13:29:37.849117 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:29:37.849117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4c9bad62-f777-4b6c-ba1c-8d0f328f8886 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] Returning 404 to user: Instance b3948025-8303-41b5-8b9d-c064c82d3185 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:29:37.849117 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4c9bad62-f777-4b6c-ba1c-8d0f328f8886 tempest-DeleteServersTestJSON-802762156 tempest-DeleteServersTestJSON-802762156-project] 10.222.0.49 "GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185" status: 404 len: 111 microversion: 2.1 time: 0.040066 Jul 25 13:29:37.849117 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3122/6314] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:37 2022] GET /compute/v2.1/servers/b3948025-8303-41b5-8b9d-c064c82d3185 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:29:46.226934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ef1295e7-b4e8-4873-9c8b-2d75cdcdb1b5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-861698100", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "5ca445a8-ed4e-46b1-8bba-152c715fb464"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:29:46.283409 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-ef1295e7-b4e8-4873-9c8b-2d75cdcdb1b5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] validate_networks() for [('5ca445a8-ed4e-46b1-8bba-152c715fb464', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:29:46.658061 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ef1295e7-b4e8-4873-9c8b-2d75cdcdb1b5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:29:46.658486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ef1295e7-b4e8-4873-9c8b-2d75cdcdb1b5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:29:46.658961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ef1295e7-b4e8-4873-9c8b-2d75cdcdb1b5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:29:46.659366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ef1295e7-b4e8-4873-9c8b-2d75cdcdb1b5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:29:46.659772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-ef1295e7-b4e8-4873-9c8b-2d75cdcdb1b5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:29:46.669284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef1295e7-b4e8-4873-9c8b-2d75cdcdb1b5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:46.669731 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef1295e7-b4e8-4873-9c8b-2d75cdcdb1b5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:46.670562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef1295e7-b4e8-4873-9c8b-2d75cdcdb1b5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:46.671015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef1295e7-b4e8-4873-9c8b-2d75cdcdb1b5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:46.688550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-ef1295e7-b4e8-4873-9c8b-2d75cdcdb1b5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Getting quotas for project 0602e8402bb9431db2aa4a23b922485c. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:29:46.693900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-ef1295e7-b4e8-4873-9c8b-2d75cdcdb1b5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Getting quotas for user 7db6b00886db4135920274558cb06091 and project 0602e8402bb9431db2aa4a23b922485c. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:29:46.706742 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ef1295e7-b4e8-4873-9c8b-2d75cdcdb1b5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:29:46.708989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ef1295e7-b4e8-4873-9c8b-2d75cdcdb1b5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:29:46.756350 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ef1295e7-b4e8-4873-9c8b-2d75cdcdb1b5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.650905 Jul 25 13:29:46.756991 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3193/6315] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:29:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 13:29:46.767899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c7c8d063-b870-4d1b-af4a-0305cb0e0eeb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:46.768521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c7c8d063-b870-4d1b-af4a-0305cb0e0eeb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:46.840439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c7c8d063-b870-4d1b-af4a-0305cb0e0eeb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:46.849516 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c7c8d063-b870-4d1b-af4a-0305cb0e0eeb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1217 microversion: 2.1 time: 0.085412 Jul 25 13:29:46.866670 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3123/6316] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:46 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:47.872682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b0549cff-1c21-40ff-b2df-e3f255dbbfb7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:47.873900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b0549cff-1c21-40ff-b2df-e3f255dbbfb7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:47.883009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0549cff-1c21-40ff-b2df-e3f255dbbfb7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:47.883853 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0549cff-1c21-40ff-b2df-e3f255dbbfb7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:47.884935 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0549cff-1c21-40ff-b2df-e3f255dbbfb7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:47.885576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0549cff-1c21-40ff-b2df-e3f255dbbfb7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:47.992033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b0549cff-1c21-40ff-b2df-e3f255dbbfb7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:48.000935 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b0549cff-1c21-40ff-b2df-e3f255dbbfb7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1275 microversion: 2.1 time: 0.134427 Jul 25 13:29:48.002430 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3194/6317] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:47 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1275 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:49.023133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5bb48e42-69d8-46b1-a37f-f4f649de5d10 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:49.026841 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5bb48e42-69d8-46b1-a37f-f4f649de5d10 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:49.031416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=27 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:29:49.042081 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5bb48e42-69d8-46b1-a37f-f4f649de5d10 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:49.043142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5bb48e42-69d8-46b1-a37f-f4f649de5d10 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:49.045233 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5bb48e42-69d8-46b1-a37f-f4f649de5d10 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:49.045963 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5bb48e42-69d8-46b1-a37f-f4f649de5d10 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:49.294929 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5bb48e42-69d8-46b1-a37f-f4f649de5d10 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:49.304768 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5bb48e42-69d8-46b1-a37f-f4f649de5d10 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1317 microversion: 2.1 time: 0.285643 Jul 25 13:29:49.305968 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3124/6318] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:49 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:49.375165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-4d41961e-919d-4919-aff0-9a8631c26c7c req-4c5f3540-dcff-4962-84ab-106a6d962702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65dbd38-8144-4078-94a1-3fc955f98d46", "tag": "a06101e7-ead1-4f50-9432-6f57a9b29008"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:29:49.390590 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4d41961e-919d-4919-aff0-9a8631c26c7c req-4c5f3540-dcff-4962-84ab-106a6d962702 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:49.391022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4d41961e-919d-4919-aff0-9a8631c26c7c req-4c5f3540-dcff-4962-84ab-106a6d962702 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:49.405858 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-4d41961e-919d-4919-aff0-9a8631c26c7c req-4c5f3540-dcff-4962-84ab-106a6d962702 service nova] Creating event network-changed:a06101e7-ead1-4f50-9432-6f57a9b29008 for instance e65dbd38-8144-4078-94a1-3fc955f98d46 on n-h1-848886-15 Jul 25 13:29:49.412500 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-4d41961e-919d-4919-aff0-9a8631c26c7c req-4c5f3540-dcff-4962-84ab-106a6d962702 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040914 Jul 25 13:29:49.413615 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3195/6319] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:29:50.328928 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-47a0c64e-5e26-4f8d-b3ee-7551713f45cb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:50.331107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-47a0c64e-5e26-4f8d-b3ee-7551713f45cb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:50.342249 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47a0c64e-5e26-4f8d-b3ee-7551713f45cb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:50.342718 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47a0c64e-5e26-4f8d-b3ee-7551713f45cb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:50.343515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47a0c64e-5e26-4f8d-b3ee-7551713f45cb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:50.343993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47a0c64e-5e26-4f8d-b3ee-7551713f45cb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:50.484017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-47a0c64e-5e26-4f8d-b3ee-7551713f45cb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:50.491854 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-47a0c64e-5e26-4f8d-b3ee-7551713f45cb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1317 microversion: 2.1 time: 0.169251 Jul 25 13:29:50.492412 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3125/6320] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:50 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:51.518762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-85336667-4b78-4262-80a6-22997128301c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:51.520414 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-85336667-4b78-4262-80a6-22997128301c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:51.528460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85336667-4b78-4262-80a6-22997128301c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:51.528909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85336667-4b78-4262-80a6-22997128301c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:51.529687 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85336667-4b78-4262-80a6-22997128301c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:51.530152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85336667-4b78-4262-80a6-22997128301c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:51.665596 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-85336667-4b78-4262-80a6-22997128301c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:51.673201 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-85336667-4b78-4262-80a6-22997128301c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1317 microversion: 2.1 time: 0.163438 Jul 25 13:29:51.673776 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3196/6321] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:51 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:52.697859 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a0452e2e-e902-45a4-bea2-259daa752b97 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:52.698515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a0452e2e-e902-45a4-bea2-259daa752b97 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:52.705749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a0452e2e-e902-45a4-bea2-259daa752b97 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:52.706248 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a0452e2e-e902-45a4-bea2-259daa752b97 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:52.707027 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a0452e2e-e902-45a4-bea2-259daa752b97 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:52.707481 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a0452e2e-e902-45a4-bea2-259daa752b97 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:52.837082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a0452e2e-e902-45a4-bea2-259daa752b97 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:52.845563 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a0452e2e-e902-45a4-bea2-259daa752b97 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1317 microversion: 2.1 time: 0.153922 Jul 25 13:29:52.846192 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3126/6322] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:52 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:53.301187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-9520186e-963a-47b4-a1db-db9bb8bcb484 req-d49ef494-a538-442a-93a9-75d470a09c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65dbd38-8144-4078-94a1-3fc955f98d46", "name": "network-vif-plugged", "status": "completed", "tag": "a06101e7-ead1-4f50-9432-6f57a9b29008"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:29:53.311879 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9520186e-963a-47b4-a1db-db9bb8bcb484 req-d49ef494-a538-442a-93a9-75d470a09c2f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:53.312334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9520186e-963a-47b4-a1db-db9bb8bcb484 req-d49ef494-a538-442a-93a9-75d470a09c2f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:53.323504 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-9520186e-963a-47b4-a1db-db9bb8bcb484 req-d49ef494-a538-442a-93a9-75d470a09c2f service nova] Creating event network-vif-plugged:a06101e7-ead1-4f50-9432-6f57a9b29008 for instance e65dbd38-8144-4078-94a1-3fc955f98d46 on n-h1-848886-15 Jul 25 13:29:53.328379 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-9520186e-963a-47b4-a1db-db9bb8bcb484 req-d49ef494-a538-442a-93a9-75d470a09c2f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030899 Jul 25 13:29:53.328958 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3197/6323] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:29:53.873463 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e0bd601f-4ae7-4ee7-bc9a-67fd1f4dc5ac tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:53.874574 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e0bd601f-4ae7-4ee7-bc9a-67fd1f4dc5ac tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:53.886244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e0bd601f-4ae7-4ee7-bc9a-67fd1f4dc5ac tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:53.887050 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e0bd601f-4ae7-4ee7-bc9a-67fd1f4dc5ac tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:53.888289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e0bd601f-4ae7-4ee7-bc9a-67fd1f4dc5ac tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:53.889074 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e0bd601f-4ae7-4ee7-bc9a-67fd1f4dc5ac tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:54.032514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e0bd601f-4ae7-4ee7-bc9a-67fd1f4dc5ac tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:54.044367 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e0bd601f-4ae7-4ee7-bc9a-67fd1f4dc5ac tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1317 microversion: 2.1 time: 0.177409 Jul 25 13:29:54.045322 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3127/6324] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:53 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:55.074824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bd57bb83-165e-4c3f-b16d-78c74f057b0f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:55.075433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bd57bb83-165e-4c3f-b16d-78c74f057b0f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:55.082781 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd57bb83-165e-4c3f-b16d-78c74f057b0f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:55.083238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd57bb83-165e-4c3f-b16d-78c74f057b0f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:55.084015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd57bb83-165e-4c3f-b16d-78c74f057b0f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:55.084490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd57bb83-165e-4c3f-b16d-78c74f057b0f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:55.218548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bd57bb83-165e-4c3f-b16d-78c74f057b0f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:55.226817 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bd57bb83-165e-4c3f-b16d-78c74f057b0f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1507 microversion: 2.1 time: 0.159226 Jul 25 13:29:55.227405 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3198/6325] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:55 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:55.246914 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dd74ff5b-572b-484f-bdc6-ddae751e300b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:55.247545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dd74ff5b-572b-484f-bdc6-ddae751e300b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:55.254707 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dd74ff5b-572b-484f-bdc6-ddae751e300b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:55.255177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dd74ff5b-572b-484f-bdc6-ddae751e300b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:55.255923 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dd74ff5b-572b-484f-bdc6-ddae751e300b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:55.256373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dd74ff5b-572b-484f-bdc6-ddae751e300b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:55.716762 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dd74ff5b-572b-484f-bdc6-ddae751e300b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:55.724869 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dd74ff5b-572b-484f-bdc6-ddae751e300b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1507 microversion: 2.1 time: 0.481950 Jul 25 13:29:55.725450 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3128/6326] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:55 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1507 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:55.745091 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-be2eda7f-c017-4528-8a0e-0de4ddb5f034 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:29:55.747579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-be2eda7f-c017-4528-8a0e-0de4ddb5f034 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:55.754134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be2eda7f-c017-4528-8a0e-0de4ddb5f034 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:55.754594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be2eda7f-c017-4528-8a0e-0de4ddb5f034 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:55.755473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be2eda7f-c017-4528-8a0e-0de4ddb5f034 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:55.755909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be2eda7f-c017-4528-8a0e-0de4ddb5f034 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:55.831063 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-be2eda7f-c017-4528-8a0e-0de4ddb5f034 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "PUT /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1079 microversion: 2.1 time: 0.089832 Jul 25 13:29:55.831667 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3199/6327] 10.222.0.49 () {60 vars in 1256 bytes} [Mon Jul 25 13:29:55 2022] PUT /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1079 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:55.849271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1b81bbc3-de8d-442a-970f-1e3b3b788990 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:55.849917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1b81bbc3-de8d-442a-970f-1e3b3b788990 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:55.856235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b81bbc3-de8d-442a-970f-1e3b3b788990 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:55.856691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b81bbc3-de8d-442a-970f-1e3b3b788990 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:55.857457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b81bbc3-de8d-442a-970f-1e3b3b788990 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:55.857940 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b81bbc3-de8d-442a-970f-1e3b3b788990 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:55.999617 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1b81bbc3-de8d-442a-970f-1e3b3b788990 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:56.010973 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1b81bbc3-de8d-442a-970f-1e3b3b788990 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1505 microversion: 2.1 time: 0.165306 Jul 25 13:29:56.011754 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3129/6328] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:55 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:56.035496 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9842023a-c297-40a7-991f-bd165db4a7eb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:56.036112 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9842023a-c297-40a7-991f-bd165db4a7eb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:56.042367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9842023a-c297-40a7-991f-bd165db4a7eb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:56.042811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9842023a-c297-40a7-991f-bd165db4a7eb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:56.043562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9842023a-c297-40a7-991f-bd165db4a7eb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:56.043990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9842023a-c297-40a7-991f-bd165db4a7eb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:56.173863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9842023a-c297-40a7-991f-bd165db4a7eb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:56.181882 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9842023a-c297-40a7-991f-bd165db4a7eb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1505 microversion: 2.1 time: 0.150295 Jul 25 13:29:56.182479 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3200/6329] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:56 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:56.201718 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-17afadc0-8ff3-402c-aca3-487596d138a7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:29:56.204094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-17afadc0-8ff3-402c-aca3-487596d138a7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:56.210448 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-17afadc0-8ff3-402c-aca3-487596d138a7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:56.210912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-17afadc0-8ff3-402c-aca3-487596d138a7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:56.211695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-17afadc0-8ff3-402c-aca3-487596d138a7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:56.212144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-17afadc0-8ff3-402c-aca3-487596d138a7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:56.240503 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-17afadc0-8ff3-402c-aca3-487596d138a7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:56.246656 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-17afadc0-8ff3-402c-aca3-487596d138a7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Old instance type m1.heat2, new instance type m1.heat {{(pid=125883) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 13:29:56.253859 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-17afadc0-8ff3-402c-aca3-487596d138a7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:29:56.254454 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-17afadc0-8ff3-402c-aca3-487596d138a7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:29:56.254800 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-17afadc0-8ff3-402c-aca3-487596d138a7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:29:56.255224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-17afadc0-8ff3-402c-aca3-487596d138a7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:29:56.255644 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-17afadc0-8ff3-402c-aca3-487596d138a7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:29:56.322325 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-17afadc0-8ff3-402c-aca3-487596d138a7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "POST /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46/action" status: 202 len: 0 microversion: 2.1 time: 0.124445 Jul 25 13:29:56.322935 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3130/6330] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:29:56 2022] POST /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:29:56.331135 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1ceb619a-688a-473f-985c-8e4135853f72 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:56.331819 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1ceb619a-688a-473f-985c-8e4135853f72 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:56.338262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ceb619a-688a-473f-985c-8e4135853f72 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:56.338713 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ceb619a-688a-473f-985c-8e4135853f72 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:56.339471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ceb619a-688a-473f-985c-8e4135853f72 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:56.339904 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1ceb619a-688a-473f-985c-8e4135853f72 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:56.475893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1ceb619a-688a-473f-985c-8e4135853f72 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:56.484292 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1ceb619a-688a-473f-985c-8e4135853f72 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1516 microversion: 2.1 time: 0.157127 Jul 25 13:29:56.484861 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3201/6331] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:56 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:57.501759 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:29:57.506735 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-85186659-ffea-45b7-b33e-832069ac1d4f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:57.507357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-85186659-ffea-45b7-b33e-832069ac1d4f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:57.513795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-85186659-ffea-45b7-b33e-832069ac1d4f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:57.514279 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-85186659-ffea-45b7-b33e-832069ac1d4f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:57.515043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-85186659-ffea-45b7-b33e-832069ac1d4f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:57.515467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-85186659-ffea-45b7-b33e-832069ac1d4f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:57.650668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-85186659-ffea-45b7-b33e-832069ac1d4f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:57.658548 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-85186659-ffea-45b7-b33e-832069ac1d4f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1516 microversion: 2.1 time: 0.157612 Jul 25 13:29:57.659359 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3131/6332] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:57 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:58.683741 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e495ac89-a488-48be-900d-5445dab78ec6 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:58.684730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e495ac89-a488-48be-900d-5445dab78ec6 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:58.687832 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:29:58.689069 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:29:58.699726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e495ac89-a488-48be-900d-5445dab78ec6 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:58.700181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e495ac89-a488-48be-900d-5445dab78ec6 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:58.700953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e495ac89-a488-48be-900d-5445dab78ec6 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:58.701391 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e495ac89-a488-48be-900d-5445dab78ec6 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:58.837392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e495ac89-a488-48be-900d-5445dab78ec6 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:29:58.845516 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e495ac89-a488-48be-900d-5445dab78ec6 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.168325 Jul 25 13:29:58.846130 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3202/6333] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:58 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:29:59.867032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ec798f86-587f-4aaa-acd8-40df00da7213 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:29:59.867672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ec798f86-587f-4aaa-acd8-40df00da7213 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:29:59.875142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec798f86-587f-4aaa-acd8-40df00da7213 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:59.875611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec798f86-587f-4aaa-acd8-40df00da7213 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:29:59.876389 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec798f86-587f-4aaa-acd8-40df00da7213 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:29:59.876833 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec798f86-587f-4aaa-acd8-40df00da7213 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:00.008133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ec798f86-587f-4aaa-acd8-40df00da7213 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:00.016094 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ec798f86-587f-4aaa-acd8-40df00da7213 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.152981 Jul 25 13:30:00.016674 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3132/6334] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:29:59 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:01.041546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b03ee3bc-fc71-4b5e-a354-a901d289408e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:01.042411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b03ee3bc-fc71-4b5e-a354-a901d289408e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:01.051273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b03ee3bc-fc71-4b5e-a354-a901d289408e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:01.051825 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b03ee3bc-fc71-4b5e-a354-a901d289408e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:01.052764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b03ee3bc-fc71-4b5e-a354-a901d289408e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:01.053299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b03ee3bc-fc71-4b5e-a354-a901d289408e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:01.202565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b03ee3bc-fc71-4b5e-a354-a901d289408e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:01.214628 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b03ee3bc-fc71-4b5e-a354-a901d289408e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.179294 Jul 25 13:30:01.215363 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3203/6335] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:01 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:02.244619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d7363659-66c1-4f2b-82a6-cfc1507a7235 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:02.246072 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d7363659-66c1-4f2b-82a6-cfc1507a7235 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:02.254282 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d7363659-66c1-4f2b-82a6-cfc1507a7235 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:02.254802 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d7363659-66c1-4f2b-82a6-cfc1507a7235 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:02.255667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d7363659-66c1-4f2b-82a6-cfc1507a7235 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:02.256168 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d7363659-66c1-4f2b-82a6-cfc1507a7235 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:02.388824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d7363659-66c1-4f2b-82a6-cfc1507a7235 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:02.400825 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d7363659-66c1-4f2b-82a6-cfc1507a7235 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.162173 Jul 25 13:30:02.401642 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3133/6336] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:02 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:03.430669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e5fc7ccf-5904-47a9-bd8c-5e942552e178 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:03.431490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e5fc7ccf-5904-47a9-bd8c-5e942552e178 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:03.435797 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:30:03.444832 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5fc7ccf-5904-47a9-bd8c-5e942552e178 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:03.445577 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5fc7ccf-5904-47a9-bd8c-5e942552e178 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:03.446976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5fc7ccf-5904-47a9-bd8c-5e942552e178 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:03.447413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e5fc7ccf-5904-47a9-bd8c-5e942552e178 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:03.450855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:30:03.585133 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e5fc7ccf-5904-47a9-bd8c-5e942552e178 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:03.593491 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e5fc7ccf-5904-47a9-bd8c-5e942552e178 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.169508 Jul 25 13:30:03.594094 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3204/6337] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:03 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:04.619136 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8fecd758-8485-420d-a2e3-4cab8eb104fd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:04.619743 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8fecd758-8485-420d-a2e3-4cab8eb104fd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:04.622497 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=40 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:30:04.628039 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8fecd758-8485-420d-a2e3-4cab8eb104fd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:04.628496 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8fecd758-8485-420d-a2e3-4cab8eb104fd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:04.629272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8fecd758-8485-420d-a2e3-4cab8eb104fd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:04.629713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8fecd758-8485-420d-a2e3-4cab8eb104fd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:04.762170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8fecd758-8485-420d-a2e3-4cab8eb104fd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:04.771719 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8fecd758-8485-420d-a2e3-4cab8eb104fd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.159107 Jul 25 13:30:04.772437 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3134/6338] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:04 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:05.796679 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5b3e5bad-f2e4-4aad-80a5-af7dabae121b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:05.797641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5b3e5bad-f2e4-4aad-80a5-af7dabae121b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:05.808307 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b3e5bad-f2e4-4aad-80a5-af7dabae121b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:05.808757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b3e5bad-f2e4-4aad-80a5-af7dabae121b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:05.809514 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b3e5bad-f2e4-4aad-80a5-af7dabae121b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:05.809984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b3e5bad-f2e4-4aad-80a5-af7dabae121b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:05.954006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5b3e5bad-f2e4-4aad-80a5-af7dabae121b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:05.961595 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5b3e5bad-f2e4-4aad-80a5-af7dabae121b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.171474 Jul 25 13:30:05.962197 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3205/6339] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:05 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:06.983970 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2056046c-89f0-45c6-aece-bc6f56be55c5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:06.984584 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2056046c-89f0-45c6-aece-bc6f56be55c5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:06.991815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2056046c-89f0-45c6-aece-bc6f56be55c5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:06.992271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2056046c-89f0-45c6-aece-bc6f56be55c5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:06.993114 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2056046c-89f0-45c6-aece-bc6f56be55c5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:06.993795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2056046c-89f0-45c6-aece-bc6f56be55c5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:07.136635 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2056046c-89f0-45c6-aece-bc6f56be55c5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:07.144297 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2056046c-89f0-45c6-aece-bc6f56be55c5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.164342 Jul 25 13:30:07.144958 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3135/6340] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:06 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:08.165136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4e094da4-0621-4542-9cbb-3ce69c2ff02c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:08.165780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4e094da4-0621-4542-9cbb-3ce69c2ff02c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:08.173155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e094da4-0621-4542-9cbb-3ce69c2ff02c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:08.173638 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e094da4-0621-4542-9cbb-3ce69c2ff02c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:08.174473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e094da4-0621-4542-9cbb-3ce69c2ff02c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:08.174901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e094da4-0621-4542-9cbb-3ce69c2ff02c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:08.308165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4e094da4-0621-4542-9cbb-3ce69c2ff02c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:08.315871 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4e094da4-0621-4542-9cbb-3ce69c2ff02c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.154724 Jul 25 13:30:08.316452 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3206/6341] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:08 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:09.339025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e24cef5c-1341-4dbd-824f-45495b5e0355 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:09.339785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e24cef5c-1341-4dbd-824f-45495b5e0355 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:09.349326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e24cef5c-1341-4dbd-824f-45495b5e0355 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:09.349918 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e24cef5c-1341-4dbd-824f-45495b5e0355 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:09.350946 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e24cef5c-1341-4dbd-824f-45495b5e0355 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:09.351508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e24cef5c-1341-4dbd-824f-45495b5e0355 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:09.502161 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e24cef5c-1341-4dbd-824f-45495b5e0355 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:09.510476 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e24cef5c-1341-4dbd-824f-45495b5e0355 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.176508 Jul 25 13:30:09.511058 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3136/6342] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:09 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:10.532402 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-804979de-9e81-4fc7-909f-a982070e29da tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:10.533056 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-804979de-9e81-4fc7-909f-a982070e29da tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:10.541256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-804979de-9e81-4fc7-909f-a982070e29da tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:10.541774 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-804979de-9e81-4fc7-909f-a982070e29da tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:10.542626 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-804979de-9e81-4fc7-909f-a982070e29da tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:10.543119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-804979de-9e81-4fc7-909f-a982070e29da tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:10.683642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-804979de-9e81-4fc7-909f-a982070e29da tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:10.691705 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-804979de-9e81-4fc7-909f-a982070e29da tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.163647 Jul 25 13:30:10.692302 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3207/6343] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:10 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:11.716814 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fbd35a6f-402d-4c68-9197-07f3b4cbf08d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:11.717882 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fbd35a6f-402d-4c68-9197-07f3b4cbf08d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:11.729289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fbd35a6f-402d-4c68-9197-07f3b4cbf08d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:11.729801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fbd35a6f-402d-4c68-9197-07f3b4cbf08d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:11.730623 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fbd35a6f-402d-4c68-9197-07f3b4cbf08d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:11.731077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fbd35a6f-402d-4c68-9197-07f3b4cbf08d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:11.866054 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fbd35a6f-402d-4c68-9197-07f3b4cbf08d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:11.873935 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fbd35a6f-402d-4c68-9197-07f3b4cbf08d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.163683 Jul 25 13:30:11.874491 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3137/6344] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:11 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:12.895312 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fa469fe3-45ff-435c-946f-d7558a682cea tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:12.895880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fa469fe3-45ff-435c-946f-d7558a682cea tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:12.903550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa469fe3-45ff-435c-946f-d7558a682cea tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:12.904006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa469fe3-45ff-435c-946f-d7558a682cea tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:12.904818 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa469fe3-45ff-435c-946f-d7558a682cea tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:12.905240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa469fe3-45ff-435c-946f-d7558a682cea tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:13.042899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fa469fe3-45ff-435c-946f-d7558a682cea tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:13.050576 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fa469fe3-45ff-435c-946f-d7558a682cea tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.159208 Jul 25 13:30:13.051150 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3208/6345] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:12 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:14.075679 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5a26d32e-10b5-4cb5-b315-de4c43580b1e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:14.076649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5a26d32e-10b5-4cb5-b315-de4c43580b1e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:14.088167 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a26d32e-10b5-4cb5-b315-de4c43580b1e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:14.088668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a26d32e-10b5-4cb5-b315-de4c43580b1e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:14.089445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a26d32e-10b5-4cb5-b315-de4c43580b1e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:14.089898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a26d32e-10b5-4cb5-b315-de4c43580b1e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:14.220552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5a26d32e-10b5-4cb5-b315-de4c43580b1e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:14.232488 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5a26d32e-10b5-4cb5-b315-de4c43580b1e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.163020 Jul 25 13:30:14.233355 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3138/6346] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:14 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:15.263338 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-85b5d7b9-f650-490a-8da4-4350396a421f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:15.264280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-85b5d7b9-f650-490a-8da4-4350396a421f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:15.275808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85b5d7b9-f650-490a-8da4-4350396a421f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:15.276562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85b5d7b9-f650-490a-8da4-4350396a421f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:15.277870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85b5d7b9-f650-490a-8da4-4350396a421f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:15.278627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-85b5d7b9-f650-490a-8da4-4350396a421f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:15.424826 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-85b5d7b9-f650-490a-8da4-4350396a421f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:15.436472 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-85b5d7b9-f650-490a-8da4-4350396a421f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.180974 Jul 25 13:30:15.437216 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3209/6347] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:15 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:16.465525 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7b6cc25a-b7fc-48b9-ab20-1f3e4d5c04f2 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:16.466480 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7b6cc25a-b7fc-48b9-ab20-1f3e4d5c04f2 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:16.478607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b6cc25a-b7fc-48b9-ab20-1f3e4d5c04f2 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:16.479383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b6cc25a-b7fc-48b9-ab20-1f3e4d5c04f2 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:16.480663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b6cc25a-b7fc-48b9-ab20-1f3e4d5c04f2 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:16.481407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7b6cc25a-b7fc-48b9-ab20-1f3e4d5c04f2 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:16.488122 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:30:16.622877 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7b6cc25a-b7fc-48b9-ab20-1f3e4d5c04f2 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:16.630578 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7b6cc25a-b7fc-48b9-ab20-1f3e4d5c04f2 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.171787 Jul 25 13:30:16.631170 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3139/6348] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:16 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:17.656485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cee347c4-18b7-4a4e-bb1b-5e17d13c6ea0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:17.657676 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cee347c4-18b7-4a4e-bb1b-5e17d13c6ea0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:17.667999 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cee347c4-18b7-4a4e-bb1b-5e17d13c6ea0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:17.668453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cee347c4-18b7-4a4e-bb1b-5e17d13c6ea0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:17.669232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cee347c4-18b7-4a4e-bb1b-5e17d13c6ea0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:17.669669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cee347c4-18b7-4a4e-bb1b-5e17d13c6ea0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:17.809152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cee347c4-18b7-4a4e-bb1b-5e17d13c6ea0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:17.816862 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cee347c4-18b7-4a4e-bb1b-5e17d13c6ea0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.166975 Jul 25 13:30:17.817447 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3210/6349] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:17 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:18.840321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3adb239b-6136-4bd5-ac7a-fe2d38b63474 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:18.840941 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3adb239b-6136-4bd5-ac7a-fe2d38b63474 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:18.848745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3adb239b-6136-4bd5-ac7a-fe2d38b63474 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:18.849205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3adb239b-6136-4bd5-ac7a-fe2d38b63474 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:18.850022 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3adb239b-6136-4bd5-ac7a-fe2d38b63474 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:18.850465 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3adb239b-6136-4bd5-ac7a-fe2d38b63474 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:18.984326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3adb239b-6136-4bd5-ac7a-fe2d38b63474 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:18.992167 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3adb239b-6136-4bd5-ac7a-fe2d38b63474 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.156682 Jul 25 13:30:18.992743 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3140/6350] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:18 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:20.017208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1dde1254-5162-464d-aae0-0bc34cba9fc7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:20.018276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1dde1254-5162-464d-aae0-0bc34cba9fc7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:20.028054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dde1254-5162-464d-aae0-0bc34cba9fc7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:20.028502 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dde1254-5162-464d-aae0-0bc34cba9fc7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:20.029271 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dde1254-5162-464d-aae0-0bc34cba9fc7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:20.029707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dde1254-5162-464d-aae0-0bc34cba9fc7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:20.168714 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1dde1254-5162-464d-aae0-0bc34cba9fc7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:20.176534 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1dde1254-5162-464d-aae0-0bc34cba9fc7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.165807 Jul 25 13:30:20.177107 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3211/6351] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:20 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:21.199544 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-09a0a730-8e76-4c40-b4ea-6987ee118fa0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:21.200166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-09a0a730-8e76-4c40-b4ea-6987ee118fa0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:21.207996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09a0a730-8e76-4c40-b4ea-6987ee118fa0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:21.208538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09a0a730-8e76-4c40-b4ea-6987ee118fa0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:21.209396 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09a0a730-8e76-4c40-b4ea-6987ee118fa0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:21.209870 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09a0a730-8e76-4c40-b4ea-6987ee118fa0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:21.352645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-09a0a730-8e76-4c40-b4ea-6987ee118fa0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:21.360754 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-09a0a730-8e76-4c40-b4ea-6987ee118fa0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.166631 Jul 25 13:30:21.361330 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3141/6352] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:21 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:22.383748 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0596fe01-87e9-4576-93e4-f5dda7118538 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:22.384531 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0596fe01-87e9-4576-93e4-f5dda7118538 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:22.394217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0596fe01-87e9-4576-93e4-f5dda7118538 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:22.394814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0596fe01-87e9-4576-93e4-f5dda7118538 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:22.395816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0596fe01-87e9-4576-93e4-f5dda7118538 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:22.396390 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0596fe01-87e9-4576-93e4-f5dda7118538 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:22.529215 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0596fe01-87e9-4576-93e4-f5dda7118538 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:22.537478 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0596fe01-87e9-4576-93e4-f5dda7118538 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.158839 Jul 25 13:30:22.538063 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3212/6353] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:22 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:23.563429 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-48bfc6d5-2a5c-40d6-aaa6-f0fc7b470acc tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:23.564307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-48bfc6d5-2a5c-40d6-aaa6-f0fc7b470acc tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:23.574422 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48bfc6d5-2a5c-40d6-aaa6-f0fc7b470acc tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:23.574881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48bfc6d5-2a5c-40d6-aaa6-f0fc7b470acc tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:23.575651 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48bfc6d5-2a5c-40d6-aaa6-f0fc7b470acc tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:23.576098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48bfc6d5-2a5c-40d6-aaa6-f0fc7b470acc tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:23.719782 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-48bfc6d5-2a5c-40d6-aaa6-f0fc7b470acc tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:23.727622 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-48bfc6d5-2a5c-40d6-aaa6-f0fc7b470acc tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.171043 Jul 25 13:30:23.728296 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3142/6354] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:23 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:24.752924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0cc5dc82-b663-4aeb-94f6-7c5aad22b658 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:24.753874 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0cc5dc82-b663-4aeb-94f6-7c5aad22b658 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:24.765596 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0cc5dc82-b663-4aeb-94f6-7c5aad22b658 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:24.766408 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0cc5dc82-b663-4aeb-94f6-7c5aad22b658 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:24.767677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0cc5dc82-b663-4aeb-94f6-7c5aad22b658 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:24.768396 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0cc5dc82-b663-4aeb-94f6-7c5aad22b658 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:24.909941 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0cc5dc82-b663-4aeb-94f6-7c5aad22b658 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:24.919237 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0cc5dc82-b663-4aeb-94f6-7c5aad22b658 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.172791 Jul 25 13:30:24.919800 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3213/6355] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:24 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:25.944377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-56a62548-5b28-4ef5-bde8-d5dd1543e1ba tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:25.945355 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-56a62548-5b28-4ef5-bde8-d5dd1543e1ba tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:25.953451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56a62548-5b28-4ef5-bde8-d5dd1543e1ba tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:25.953967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56a62548-5b28-4ef5-bde8-d5dd1543e1ba tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:25.954775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56a62548-5b28-4ef5-bde8-d5dd1543e1ba tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:25.955239 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-56a62548-5b28-4ef5-bde8-d5dd1543e1ba tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:26.384183 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-56a62548-5b28-4ef5-bde8-d5dd1543e1ba tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:26.392086 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-56a62548-5b28-4ef5-bde8-d5dd1543e1ba tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.454259 Jul 25 13:30:26.392637 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3143/6356] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:25 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:27.416965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4cdede06-587d-43c2-b9b0-2ab5580d8963 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:27.417697 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4cdede06-587d-43c2-b9b0-2ab5580d8963 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:27.426330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4cdede06-587d-43c2-b9b0-2ab5580d8963 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:27.426897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4cdede06-587d-43c2-b9b0-2ab5580d8963 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:27.427852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4cdede06-587d-43c2-b9b0-2ab5580d8963 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:27.428404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4cdede06-587d-43c2-b9b0-2ab5580d8963 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:27.826575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4cdede06-587d-43c2-b9b0-2ab5580d8963 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:27.834358 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4cdede06-587d-43c2-b9b0-2ab5580d8963 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.423660 Jul 25 13:30:27.834943 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3214/6357] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:27 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:28.858637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-516bf10b-e2f4-4b17-ba26-a34ad996e8f9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:28.859374 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-516bf10b-e2f4-4b17-ba26-a34ad996e8f9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:28.869959 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-516bf10b-e2f4-4b17-ba26-a34ad996e8f9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:28.870664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-516bf10b-e2f4-4b17-ba26-a34ad996e8f9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:28.871867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-516bf10b-e2f4-4b17-ba26-a34ad996e8f9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:28.872558 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-516bf10b-e2f4-4b17-ba26-a34ad996e8f9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:29.025624 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-516bf10b-e2f4-4b17-ba26-a34ad996e8f9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:29.033542 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-516bf10b-e2f4-4b17-ba26-a34ad996e8f9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.179980 Jul 25 13:30:29.034138 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3144/6358] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:28 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:30.056257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fbb4325b-492a-4682-bb44-401e095dc055 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:30.056950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fbb4325b-492a-4682-bb44-401e095dc055 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:30.064084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fbb4325b-492a-4682-bb44-401e095dc055 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:30.064533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fbb4325b-492a-4682-bb44-401e095dc055 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:30.065308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fbb4325b-492a-4682-bb44-401e095dc055 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:30.065724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fbb4325b-492a-4682-bb44-401e095dc055 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:30.201612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fbb4325b-492a-4682-bb44-401e095dc055 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:30.209964 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fbb4325b-492a-4682-bb44-401e095dc055 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1521 microversion: 2.1 time: 0.157570 Jul 25 13:30:30.216730 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3215/6359] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:30 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:30.677362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-3da86b17-15b4-4eaa-a6c2-13b8934506e2 req-82c097e7-81c3-4aca-8424-b9605e705604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65dbd38-8144-4078-94a1-3fc955f98d46", "name": "network-vif-unplugged", "status": "completed", "tag": "a06101e7-ead1-4f50-9432-6f57a9b29008"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:30:30.690266 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-3da86b17-15b4-4eaa-a6c2-13b8934506e2 req-82c097e7-81c3-4aca-8424-b9605e705604 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:30.690740 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-3da86b17-15b4-4eaa-a6c2-13b8934506e2 req-82c097e7-81c3-4aca-8424-b9605e705604 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:30.705634 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-3da86b17-15b4-4eaa-a6c2-13b8934506e2 req-82c097e7-81c3-4aca-8424-b9605e705604 service nova] Creating event network-vif-unplugged:a06101e7-ead1-4f50-9432-6f57a9b29008 for instance e65dbd38-8144-4078-94a1-3fc955f98d46 on n-h2-848886-15 Jul 25 13:30:30.712194 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [req-3da86b17-15b4-4eaa-a6c2-13b8934506e2 req-82c097e7-81c3-4aca-8424-b9605e705604 service nova] Instance e65dbd38-8144-4078-94a1-3fc955f98d46 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125883) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:30:30.724301 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-3da86b17-15b4-4eaa-a6c2-13b8934506e2 req-82c097e7-81c3-4aca-8424-b9605e705604 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051313 Jul 25 13:30:30.740091 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3145/6360] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:30:31.231737 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bfe18bca-be66-48d7-ad4e-38da1769516c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:31.232361 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bfe18bca-be66-48d7-ad4e-38da1769516c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:31.239648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bfe18bca-be66-48d7-ad4e-38da1769516c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:31.240098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bfe18bca-be66-48d7-ad4e-38da1769516c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:31.240863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bfe18bca-be66-48d7-ad4e-38da1769516c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:31.241295 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bfe18bca-be66-48d7-ad4e-38da1769516c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:31.440971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bfe18bca-be66-48d7-ad4e-38da1769516c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:31.450083 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bfe18bca-be66-48d7-ad4e-38da1769516c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1520 microversion: 2.1 time: 0.222270 Jul 25 13:30:31.450960 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3216/6361] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:31 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:32.486631 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-229b06f7-b3dd-43fb-add6-fb582512d686 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:32.487785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-229b06f7-b3dd-43fb-add6-fb582512d686 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:32.498600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-229b06f7-b3dd-43fb-add6-fb582512d686 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:32.499374 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-229b06f7-b3dd-43fb-add6-fb582512d686 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:32.500665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-229b06f7-b3dd-43fb-add6-fb582512d686 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:32.501398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-229b06f7-b3dd-43fb-add6-fb582512d686 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:32.639445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-229b06f7-b3dd-43fb-add6-fb582512d686 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:32.650953 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-229b06f7-b3dd-43fb-add6-fb582512d686 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1518 microversion: 2.1 time: 0.172978 Jul 25 13:30:32.651714 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3146/6362] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:32 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:32.760397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-c7e009e7-6ef3-467f-8100-b4e308af4ef4 req-894813bf-e705-4df1-9536-bcb585a83fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65dbd38-8144-4078-94a1-3fc955f98d46", "tag": "a06101e7-ead1-4f50-9432-6f57a9b29008"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:30:32.776551 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c7e009e7-6ef3-467f-8100-b4e308af4ef4 req-894813bf-e705-4df1-9536-bcb585a83fe5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:32.777003 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c7e009e7-6ef3-467f-8100-b4e308af4ef4 req-894813bf-e705-4df1-9536-bcb585a83fe5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:32.788895 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-c7e009e7-6ef3-467f-8100-b4e308af4ef4 req-894813bf-e705-4df1-9536-bcb585a83fe5 service nova] Creating event network-changed:a06101e7-ead1-4f50-9432-6f57a9b29008 for instance e65dbd38-8144-4078-94a1-3fc955f98d46 on n-h2-848886-15 Jul 25 13:30:32.794624 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [req-c7e009e7-6ef3-467f-8100-b4e308af4ef4 req-894813bf-e705-4df1-9536-bcb585a83fe5 service nova] Instance e65dbd38-8144-4078-94a1-3fc955f98d46 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:30:32.805488 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-c7e009e7-6ef3-467f-8100-b4e308af4ef4 req-894813bf-e705-4df1-9536-bcb585a83fe5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051408 Jul 25 13:30:32.806206 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3217/6363] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:30:33.676795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2eec66f5-6bcc-4e90-9420-ac93ed29490d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:33.677403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2eec66f5-6bcc-4e90-9420-ac93ed29490d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:33.684719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2eec66f5-6bcc-4e90-9420-ac93ed29490d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:33.685219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2eec66f5-6bcc-4e90-9420-ac93ed29490d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:33.686026 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2eec66f5-6bcc-4e90-9420-ac93ed29490d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:33.686498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2eec66f5-6bcc-4e90-9420-ac93ed29490d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:33.824192 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2eec66f5-6bcc-4e90-9420-ac93ed29490d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:33.831940 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2eec66f5-6bcc-4e90-9420-ac93ed29490d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1515 microversion: 2.1 time: 0.159109 Jul 25 13:30:33.832506 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3147/6364] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:33 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:33.854039 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-88908934-bc7c-417c-84a1-d86b32fb68df tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:30:33.854642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-88908934-bc7c-417c-84a1-d86b32fb68df tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:33.856606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=28 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:30:33.862492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88908934-bc7c-417c-84a1-d86b32fb68df tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:33.862960 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88908934-bc7c-417c-84a1-d86b32fb68df tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:33.863760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88908934-bc7c-417c-84a1-d86b32fb68df tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:33.864197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88908934-bc7c-417c-84a1-d86b32fb68df tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:33.867065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=82 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:30:33.925185 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-88908934-bc7c-417c-84a1-d86b32fb68df tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "POST /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46/action" status: 204 len: 0 microversion: 2.1 time: 0.076459 Jul 25 13:30:33.925716 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3218/6365] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:30:33 2022] POST /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:30:33.934017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-70361194-5772-493b-988e-f2f6da11e52a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:33.934668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-70361194-5772-493b-988e-f2f6da11e52a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:33.941102 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-70361194-5772-493b-988e-f2f6da11e52a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:33.941746 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-70361194-5772-493b-988e-f2f6da11e52a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:33.942463 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-70361194-5772-493b-988e-f2f6da11e52a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:33.942809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-70361194-5772-493b-988e-f2f6da11e52a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:34.153109 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-70361194-5772-493b-988e-f2f6da11e52a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:34.160986 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-70361194-5772-493b-988e-f2f6da11e52a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1515 microversion: 2.1 time: 0.231021 Jul 25 13:30:34.161572 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3148/6366] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:33 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1515 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:35.184940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9b9a15af-bf14-4687-a133-fe55504de0a8 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:35.185668 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9b9a15af-bf14-4687-a133-fe55504de0a8 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:35.192032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b9a15af-bf14-4687-a133-fe55504de0a8 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:35.192486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b9a15af-bf14-4687-a133-fe55504de0a8 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:35.193246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b9a15af-bf14-4687-a133-fe55504de0a8 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:35.193722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b9a15af-bf14-4687-a133-fe55504de0a8 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:35.640763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9b9a15af-bf14-4687-a133-fe55504de0a8 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:35.651816 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9b9a15af-bf14-4687-a133-fe55504de0a8 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1507 microversion: 2.1 time: 0.473042 Jul 25 13:30:35.653146 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3219/6367] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:35 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1507 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:35.675246 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1869377e-a550-46f5-a4f6-98ad61b56842 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:35.675922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1869377e-a550-46f5-a4f6-98ad61b56842 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:35.679211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=30 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:30:35.685229 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1869377e-a550-46f5-a4f6-98ad61b56842 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:35.685689 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1869377e-a550-46f5-a4f6-98ad61b56842 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:35.686515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1869377e-a550-46f5-a4f6-98ad61b56842 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:35.686971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1869377e-a550-46f5-a4f6-98ad61b56842 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:35.819814 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1869377e-a550-46f5-a4f6-98ad61b56842 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:35.827797 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1869377e-a550-46f5-a4f6-98ad61b56842 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1507 microversion: 2.1 time: 0.156639 Jul 25 13:30:35.828371 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3149/6368] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:35 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:30:35.852251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-09d85d41-72ed-4166-bef3-617e7dc39847 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Action: 'create', calling method: .version_select at 0x7efcf8846160>, body: {"keypair": {"name": "tempest-keypair-1842367589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIdLFsD0BQ3I6OLgyPse4QwLfbvvGcgGZmUWWOH3SbO0ZC/HQ2j+uL5ZVulWoBPjnnT9XXQI5aRWpDUkIdDGrf8oBMevmmkv8bRvyUmL3Fyu+w8OQWCgOI55/Bo8C7hpQ=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:30:35.868434 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-09d85d41-72ed-4166-bef3-617e7dc39847 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Getting quotas for project 0602e8402bb9431db2aa4a23b922485c. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:30:35.874162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-09d85d41-72ed-4166-bef3-617e7dc39847 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Getting quotas for user 7db6b00886db4135920274558cb06091 and project 0602e8402bb9431db2aa4a23b922485c. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:30:35.900992 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-09d85d41-72ed-4166-bef3-617e7dc39847 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052547 Jul 25 13:30:35.901509 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3220/6369] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:30:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:30:36.124422 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-b39cc713-3d47-4398-8d2d-ac36d3dd0208 req-a6e51144-b428-4a11-a862-7c05a2d8e389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65dbd38-8144-4078-94a1-3fc955f98d46", "name": "network-vif-plugged", "status": "completed", "tag": "a06101e7-ead1-4f50-9432-6f57a9b29008"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:30:36.134910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b39cc713-3d47-4398-8d2d-ac36d3dd0208 req-a6e51144-b428-4a11-a862-7c05a2d8e389 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:36.135531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b39cc713-3d47-4398-8d2d-ac36d3dd0208 req-a6e51144-b428-4a11-a862-7c05a2d8e389 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:36.149370 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-b39cc713-3d47-4398-8d2d-ac36d3dd0208 req-a6e51144-b428-4a11-a862-7c05a2d8e389 service nova] Creating event network-vif-plugged:a06101e7-ead1-4f50-9432-6f57a9b29008 for instance e65dbd38-8144-4078-94a1-3fc955f98d46 on n-h2-848886-15 Jul 25 13:30:36.155070 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-b39cc713-3d47-4398-8d2d-ac36d3dd0208 req-a6e51144-b428-4a11-a862-7c05a2d8e389 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126063 Jul 25 13:30:36.155813 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3150/6370] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:30:37.127769 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1f608dfb-90cf-4001-bd4b-5647d1b22d09 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:37.128524 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1f608dfb-90cf-4001-bd4b-5647d1b22d09 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:37.138003 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f608dfb-90cf-4001-bd4b-5647d1b22d09 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:37.138486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f608dfb-90cf-4001-bd4b-5647d1b22d09 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:37.139260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f608dfb-90cf-4001-bd4b-5647d1b22d09 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:37.139702 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f608dfb-90cf-4001-bd4b-5647d1b22d09 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:37.269293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1f608dfb-90cf-4001-bd4b-5647d1b22d09 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:37.279144 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1f608dfb-90cf-4001-bd4b-5647d1b22d09 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 200 len: 1507 microversion: 2.1 time: 0.156191 Jul 25 13:30:37.279736 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3221/6371] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:37 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:37.303910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7aff04d0-ec24-4f93-8638-f31faa6f1d77 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:37.304505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7aff04d0-ec24-4f93-8638-f31faa6f1d77 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:37.311878 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7aff04d0-ec24-4f93-8638-f31faa6f1d77 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:37.312343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7aff04d0-ec24-4f93-8638-f31faa6f1d77 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:37.313132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7aff04d0-ec24-4f93-8638-f31faa6f1d77 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:37.313582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7aff04d0-ec24-4f93-8638-f31faa6f1d77 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:37.344856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7aff04d0-ec24-4f93-8638-f31faa6f1d77 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:30:37.425159 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7aff04d0-ec24-4f93-8638-f31faa6f1d77 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 204 len: 0 microversion: 2.1 time: 0.128649 Jul 25 13:30:37.425758 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3151/6372] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:30:37 2022] DELETE /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:30:37.482724 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-92974ac4-7153-4a27-bf26-71ce0b0140e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-500894748", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "5ca445a8-ed4e-46b1-8bba-152c715fb464"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:30:37.536539 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-92974ac4-7153-4a27-bf26-71ce0b0140e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] validate_networks() for [('5ca445a8-ed4e-46b1-8bba-152c715fb464', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:30:37.937867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-92974ac4-7153-4a27-bf26-71ce0b0140e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:30:37.938299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-92974ac4-7153-4a27-bf26-71ce0b0140e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:30:37.938798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-92974ac4-7153-4a27-bf26-71ce0b0140e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:30:37.939237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-92974ac4-7153-4a27-bf26-71ce0b0140e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:30:37.939672 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-92974ac4-7153-4a27-bf26-71ce0b0140e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:30:37.950659 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-92974ac4-7153-4a27-bf26-71ce0b0140e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:37.951105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-92974ac4-7153-4a27-bf26-71ce0b0140e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:37.951903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-92974ac4-7153-4a27-bf26-71ce0b0140e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:37.952334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-92974ac4-7153-4a27-bf26-71ce0b0140e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:37.970256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-92974ac4-7153-4a27-bf26-71ce0b0140e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Getting quotas for project 0602e8402bb9431db2aa4a23b922485c. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:30:37.975716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-92974ac4-7153-4a27-bf26-71ce0b0140e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Getting quotas for user 7db6b00886db4135920274558cb06091 and project 0602e8402bb9431db2aa4a23b922485c. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:30:37.988605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-92974ac4-7153-4a27-bf26-71ce0b0140e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:30:37.990884 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-92974ac4-7153-4a27-bf26-71ce0b0140e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:30:38.036046 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-92974ac4-7153-4a27-bf26-71ce0b0140e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557184 Jul 25 13:30:38.036712 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3222/6373] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:30:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:30:38.048429 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-61771b62-f99d-448f-867d-cd381d539c3c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:38.049146 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-61771b62-f99d-448f-867d-cd381d539c3c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:38.104784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-61771b62-f99d-448f-867d-cd381d539c3c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:38.111814 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-61771b62-f99d-448f-867d-cd381d539c3c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1217 microversion: 2.1 time: 0.067636 Jul 25 13:30:38.125046 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3152/6374] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:38 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:39.132641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d29b88fc-5e2b-45cf-971f-3f3d00198317 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:39.133998 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d29b88fc-5e2b-45cf-971f-3f3d00198317 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:39.141982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d29b88fc-5e2b-45cf-971f-3f3d00198317 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:39.142444 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d29b88fc-5e2b-45cf-971f-3f3d00198317 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:39.143248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d29b88fc-5e2b-45cf-971f-3f3d00198317 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:39.143648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d29b88fc-5e2b-45cf-971f-3f3d00198317 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:39.261104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d29b88fc-5e2b-45cf-971f-3f3d00198317 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:39.269808 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d29b88fc-5e2b-45cf-971f-3f3d00198317 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1275 microversion: 2.1 time: 0.141043 Jul 25 13:30:39.270425 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3223/6375] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:39 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1275 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:39.431543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-435f94c6-938e-4da3-9fb4-a572242d226a req-f6e32f7e-367b-44b6-a15f-7271c00b1bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65dbd38-8144-4078-94a1-3fc955f98d46", "name": "network-vif-deleted", "tag": "a06101e7-ead1-4f50-9432-6f57a9b29008"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:30:39.446549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-435f94c6-938e-4da3-9fb4-a572242d226a req-f6e32f7e-367b-44b6-a15f-7271c00b1bad service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:39.447003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-435f94c6-938e-4da3-9fb4-a572242d226a req-f6e32f7e-367b-44b6-a15f-7271c00b1bad service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:39.464717 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-435f94c6-938e-4da3-9fb4-a572242d226a req-f6e32f7e-367b-44b6-a15f-7271c00b1bad service nova] Creating event network-vif-deleted:a06101e7-ead1-4f50-9432-6f57a9b29008 for instance e65dbd38-8144-4078-94a1-3fc955f98d46 on n-h2-848886-15 Jul 25 13:30:39.470623 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-435f94c6-938e-4da3-9fb4-a572242d226a req-f6e32f7e-367b-44b6-a15f-7271c00b1bad service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042696 Jul 25 13:30:39.471844 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3153/6376] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:30:40.291112 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f5b973d4-8e95-47fd-8edc-e56a8f33b100 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:40.291735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f5b973d4-8e95-47fd-8edc-e56a8f33b100 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:40.299396 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5b973d4-8e95-47fd-8edc-e56a8f33b100 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:40.299817 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5b973d4-8e95-47fd-8edc-e56a8f33b100 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:40.301068 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5b973d4-8e95-47fd-8edc-e56a8f33b100 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:40.301578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5b973d4-8e95-47fd-8edc-e56a8f33b100 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:40.499197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f5b973d4-8e95-47fd-8edc-e56a8f33b100 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:40.507393 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f5b973d4-8e95-47fd-8edc-e56a8f33b100 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1317 microversion: 2.1 time: 0.220238 Jul 25 13:30:40.508012 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3224/6377] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:40 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:41.496960 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-0627b5e1-b836-4fdb-a03f-390df38adb4c req-7b9dadc5-aca6-466f-afd3-926e1d4fbca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21517950-0349-4dc2-8ba6-8a4e7c9ca594", "tag": "69c7f67d-d816-4745-938d-d2894c2360bc"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:30:41.511546 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0627b5e1-b836-4fdb-a03f-390df38adb4c req-7b9dadc5-aca6-466f-afd3-926e1d4fbca7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:41.512015 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-0627b5e1-b836-4fdb-a03f-390df38adb4c req-7b9dadc5-aca6-466f-afd3-926e1d4fbca7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:41.523238 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-0627b5e1-b836-4fdb-a03f-390df38adb4c req-7b9dadc5-aca6-466f-afd3-926e1d4fbca7 service nova] Creating event network-changed:69c7f67d-d816-4745-938d-d2894c2360bc for instance 21517950-0349-4dc2-8ba6-8a4e7c9ca594 on n-h1-848886-15 Jul 25 13:30:41.528218 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-0627b5e1-b836-4fdb-a03f-390df38adb4c req-7b9dadc5-aca6-466f-afd3-926e1d4fbca7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039607 Jul 25 13:30:41.528743 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-28d4be51-73dc-41ba-86e4-d641f017f9ab tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:41.529232 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3154/6378] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:30:41.529361 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-28d4be51-73dc-41ba-86e4-d641f017f9ab tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:41.536594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-28d4be51-73dc-41ba-86e4-d641f017f9ab tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:41.537212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-28d4be51-73dc-41ba-86e4-d641f017f9ab tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:41.537813 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-28d4be51-73dc-41ba-86e4-d641f017f9ab tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:41.538283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-28d4be51-73dc-41ba-86e4-d641f017f9ab tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:41.666084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-28d4be51-73dc-41ba-86e4-d641f017f9ab tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:41.674078 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-28d4be51-73dc-41ba-86e4-d641f017f9ab tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1317 microversion: 2.1 time: 0.149222 Jul 25 13:30:41.674652 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3225/6379] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:41 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:42.701706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a7310174-293a-44bd-b58f-42c28c992607 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:42.702941 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a7310174-293a-44bd-b58f-42c28c992607 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:42.713006 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7310174-293a-44bd-b58f-42c28c992607 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:42.713479 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7310174-293a-44bd-b58f-42c28c992607 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:42.714322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7310174-293a-44bd-b58f-42c28c992607 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:42.714778 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7310174-293a-44bd-b58f-42c28c992607 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:42.849287 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a7310174-293a-44bd-b58f-42c28c992607 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:42.857196 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a7310174-293a-44bd-b58f-42c28c992607 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1317 microversion: 2.1 time: 0.164341 Jul 25 13:30:42.857741 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3155/6380] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:42 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:43.882246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f943cb22-a42d-4e71-884f-23add89d788d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:43.883224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f943cb22-a42d-4e71-884f-23add89d788d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:43.890453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f943cb22-a42d-4e71-884f-23add89d788d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:43.890903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f943cb22-a42d-4e71-884f-23add89d788d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:43.891675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f943cb22-a42d-4e71-884f-23add89d788d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:43.892079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f943cb22-a42d-4e71-884f-23add89d788d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:44.022126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f943cb22-a42d-4e71-884f-23add89d788d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:44.029863 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f943cb22-a42d-4e71-884f-23add89d788d tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1317 microversion: 2.1 time: 0.154366 Jul 25 13:30:44.030449 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3226/6381] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:43 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:45.054867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2e04e96f-fb57-410b-8095-a83f82f83f77 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:45.055838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2e04e96f-fb57-410b-8095-a83f82f83f77 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:45.063697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e04e96f-fb57-410b-8095-a83f82f83f77 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:45.064159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e04e96f-fb57-410b-8095-a83f82f83f77 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:45.064942 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e04e96f-fb57-410b-8095-a83f82f83f77 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:45.065392 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e04e96f-fb57-410b-8095-a83f82f83f77 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:45.201019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2e04e96f-fb57-410b-8095-a83f82f83f77 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:45.212736 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2e04e96f-fb57-410b-8095-a83f82f83f77 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1317 microversion: 2.1 time: 0.164130 Jul 25 13:30:45.213514 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3156/6382] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:45 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:45.641043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-e395a0a9-5c92-494b-b55a-4b3bc6f59913 req-387ae049-676f-4ee8-a508-ca52488e3cef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21517950-0349-4dc2-8ba6-8a4e7c9ca594", "name": "network-vif-plugged", "status": "completed", "tag": "69c7f67d-d816-4745-938d-d2894c2360bc"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:30:45.652688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e395a0a9-5c92-494b-b55a-4b3bc6f59913 req-387ae049-676f-4ee8-a508-ca52488e3cef service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:45.653135 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e395a0a9-5c92-494b-b55a-4b3bc6f59913 req-387ae049-676f-4ee8-a508-ca52488e3cef service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:45.664753 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-e395a0a9-5c92-494b-b55a-4b3bc6f59913 req-387ae049-676f-4ee8-a508-ca52488e3cef service nova] Creating event network-vif-plugged:69c7f67d-d816-4745-938d-d2894c2360bc for instance 21517950-0349-4dc2-8ba6-8a4e7c9ca594 on n-h1-848886-15 Jul 25 13:30:45.669911 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-e395a0a9-5c92-494b-b55a-4b3bc6f59913 req-387ae049-676f-4ee8-a508-ca52488e3cef service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032677 Jul 25 13:30:45.670547 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3227/6383] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:30:46.238337 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e9264f32-80fe-4843-858e-b29b898e8f84 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:46.239322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e9264f32-80fe-4843-858e-b29b898e8f84 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:46.248075 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e9264f32-80fe-4843-858e-b29b898e8f84 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:46.248536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e9264f32-80fe-4843-858e-b29b898e8f84 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:46.249316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e9264f32-80fe-4843-858e-b29b898e8f84 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:46.249761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e9264f32-80fe-4843-858e-b29b898e8f84 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:46.269697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:30:46.383822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e9264f32-80fe-4843-858e-b29b898e8f84 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:46.396541 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e9264f32-80fe-4843-858e-b29b898e8f84 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1317 microversion: 2.1 time: 0.164626 Jul 25 13:30:46.397438 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3157/6384] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:46 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:47.424983 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-94f5333c-219b-4e61-9c58-9fd2274bae9b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:47.426078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-94f5333c-219b-4e61-9c58-9fd2274bae9b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:47.436599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94f5333c-219b-4e61-9c58-9fd2274bae9b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:47.437348 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94f5333c-219b-4e61-9c58-9fd2274bae9b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:47.438654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94f5333c-219b-4e61-9c58-9fd2274bae9b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:47.439390 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-94f5333c-219b-4e61-9c58-9fd2274bae9b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:47.580440 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-94f5333c-219b-4e61-9c58-9fd2274bae9b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:47.591705 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-94f5333c-219b-4e61-9c58-9fd2274bae9b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1507 microversion: 2.1 time: 0.175125 Jul 25 13:30:47.592718 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3228/6385] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:47 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:47.612358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-702f868f-02d8-4646-a60f-f9216e23e15a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:47.612990 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-702f868f-02d8-4646-a60f-f9216e23e15a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:47.620527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-702f868f-02d8-4646-a60f-f9216e23e15a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:47.621047 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-702f868f-02d8-4646-a60f-f9216e23e15a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:47.621858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-702f868f-02d8-4646-a60f-f9216e23e15a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:47.622357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-702f868f-02d8-4646-a60f-f9216e23e15a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:47.749407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-702f868f-02d8-4646-a60f-f9216e23e15a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:47.757061 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-702f868f-02d8-4646-a60f-f9216e23e15a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1507 microversion: 2.1 time: 0.148637 Jul 25 13:30:47.757634 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3158/6386] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:47 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:47.777723 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6dd2f802-4dd2-47ad-9517-8bedac0d2d86 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:30:47.780147 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6dd2f802-4dd2-47ad-9517-8bedac0d2d86 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:47.786362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6dd2f802-4dd2-47ad-9517-8bedac0d2d86 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:47.786818 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6dd2f802-4dd2-47ad-9517-8bedac0d2d86 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:47.787583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6dd2f802-4dd2-47ad-9517-8bedac0d2d86 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:47.788024 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6dd2f802-4dd2-47ad-9517-8bedac0d2d86 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:47.816234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6dd2f802-4dd2-47ad-9517-8bedac0d2d86 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:47.822305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6dd2f802-4dd2-47ad-9517-8bedac0d2d86 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Old instance type m1.heat2, new instance type m1.heat {{(pid=125884) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 13:30:47.828745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-6dd2f802-4dd2-47ad-9517-8bedac0d2d86 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:30:47.829167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-6dd2f802-4dd2-47ad-9517-8bedac0d2d86 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:30:47.829641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-6dd2f802-4dd2-47ad-9517-8bedac0d2d86 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:30:47.830086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-6dd2f802-4dd2-47ad-9517-8bedac0d2d86 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:30:47.830501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-6dd2f802-4dd2-47ad-9517-8bedac0d2d86 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:30:47.899285 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6dd2f802-4dd2-47ad-9517-8bedac0d2d86 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "POST /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594/action" status: 202 len: 0 microversion: 2.1 time: 0.126082 Jul 25 13:30:47.899953 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3229/6387] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:30:47 2022] POST /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:30:47.908316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c7c4f1ab-ab39-4eff-8041-7104684c9af1 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:47.908946 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c7c4f1ab-ab39-4eff-8041-7104684c9af1 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:47.915401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c7c4f1ab-ab39-4eff-8041-7104684c9af1 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:47.915871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c7c4f1ab-ab39-4eff-8041-7104684c9af1 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:47.916664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c7c4f1ab-ab39-4eff-8041-7104684c9af1 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:47.917100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c7c4f1ab-ab39-4eff-8041-7104684c9af1 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:48.058936 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c7c4f1ab-ab39-4eff-8041-7104684c9af1 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:48.068205 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c7c4f1ab-ab39-4eff-8041-7104684c9af1 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1514 microversion: 2.1 time: 0.163837 Jul 25 13:30:48.075042 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3159/6388] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:47 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:49.090400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:30:49.091886 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=10 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:30:49.099900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-df58c1f7-56d8-4537-a6b7-60ff54288724 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:49.101053 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-df58c1f7-56d8-4537-a6b7-60ff54288724 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:49.108732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-df58c1f7-56d8-4537-a6b7-60ff54288724 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:49.109207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-df58c1f7-56d8-4537-a6b7-60ff54288724 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:49.110133 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-df58c1f7-56d8-4537-a6b7-60ff54288724 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:49.110700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-df58c1f7-56d8-4537-a6b7-60ff54288724 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:49.318092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-df58c1f7-56d8-4537-a6b7-60ff54288724 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:49.326150 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-df58c1f7-56d8-4537-a6b7-60ff54288724 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1514 microversion: 2.1 time: 0.237299 Jul 25 13:30:49.326853 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3230/6389] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:49 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1514 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:50.351991 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9ba8f156-9df3-4c0e-9bf3-9f9f36f5e8ef tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:50.353061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9ba8f156-9df3-4c0e-9bf3-9f9f36f5e8ef tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:50.355994 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:30:50.366021 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ba8f156-9df3-4c0e-9bf3-9f9f36f5e8ef tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:50.366831 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ba8f156-9df3-4c0e-9bf3-9f9f36f5e8ef tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:50.368153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ba8f156-9df3-4c0e-9bf3-9f9f36f5e8ef tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:50.368605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ba8f156-9df3-4c0e-9bf3-9f9f36f5e8ef tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:50.506845 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9ba8f156-9df3-4c0e-9bf3-9f9f36f5e8ef tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:50.515174 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9ba8f156-9df3-4c0e-9bf3-9f9f36f5e8ef tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1519 microversion: 2.1 time: 0.169769 Jul 25 13:30:50.515753 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3160/6390] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:50 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:51.541104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9722a85b-ab16-4d2f-9af7-093852c52883 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:51.542014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9722a85b-ab16-4d2f-9af7-093852c52883 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:51.553271 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9722a85b-ab16-4d2f-9af7-093852c52883 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:51.554096 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9722a85b-ab16-4d2f-9af7-093852c52883 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:51.555519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9722a85b-ab16-4d2f-9af7-093852c52883 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:51.555964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9722a85b-ab16-4d2f-9af7-093852c52883 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:51.695130 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9722a85b-ab16-4d2f-9af7-093852c52883 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:51.702951 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9722a85b-ab16-4d2f-9af7-093852c52883 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1519 microversion: 2.1 time: 0.168683 Jul 25 13:30:51.703543 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3231/6391] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:51 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:52.728325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b05ef0a5-a3ac-4451-9c8e-d73436d354ca tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:52.728951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b05ef0a5-a3ac-4451-9c8e-d73436d354ca tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:52.736288 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b05ef0a5-a3ac-4451-9c8e-d73436d354ca tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:52.736762 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b05ef0a5-a3ac-4451-9c8e-d73436d354ca tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:52.737540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b05ef0a5-a3ac-4451-9c8e-d73436d354ca tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:52.738029 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b05ef0a5-a3ac-4451-9c8e-d73436d354ca tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:52.878810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b05ef0a5-a3ac-4451-9c8e-d73436d354ca tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:52.886725 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b05ef0a5-a3ac-4451-9c8e-d73436d354ca tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1519 microversion: 2.1 time: 0.164653 Jul 25 13:30:52.887299 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3161/6392] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:52 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:53.912001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7aa88086-96de-47ac-a3b1-cf505659ea6f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:53.913073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7aa88086-96de-47ac-a3b1-cf505659ea6f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:53.924924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7aa88086-96de-47ac-a3b1-cf505659ea6f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:53.925681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7aa88086-96de-47ac-a3b1-cf505659ea6f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:53.927002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7aa88086-96de-47ac-a3b1-cf505659ea6f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:53.927733 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7aa88086-96de-47ac-a3b1-cf505659ea6f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:54.064841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7aa88086-96de-47ac-a3b1-cf505659ea6f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:54.075285 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7aa88086-96de-47ac-a3b1-cf505659ea6f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1519 microversion: 2.1 time: 0.170095 Jul 25 13:30:54.075863 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3232/6393] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:53 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:55.100479 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-510cf490-4454-4f26-8609-93db52881c5b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:55.101387 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-510cf490-4454-4f26-8609-93db52881c5b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:55.110006 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-510cf490-4454-4f26-8609-93db52881c5b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:55.110480 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-510cf490-4454-4f26-8609-93db52881c5b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:55.111265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-510cf490-4454-4f26-8609-93db52881c5b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:55.111720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-510cf490-4454-4f26-8609-93db52881c5b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:55.254893 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-510cf490-4454-4f26-8609-93db52881c5b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:55.262567 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-510cf490-4454-4f26-8609-93db52881c5b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1519 microversion: 2.1 time: 0.169172 Jul 25 13:30:55.263118 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3162/6394] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:55 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:56.287861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ed0936bf-0d57-4714-9a60-0df15ecce75c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:56.288875 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ed0936bf-0d57-4714-9a60-0df15ecce75c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:56.300976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed0936bf-0d57-4714-9a60-0df15ecce75c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:56.301725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed0936bf-0d57-4714-9a60-0df15ecce75c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:56.303033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed0936bf-0d57-4714-9a60-0df15ecce75c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:56.303761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ed0936bf-0d57-4714-9a60-0df15ecce75c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:56.443083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ed0936bf-0d57-4714-9a60-0df15ecce75c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:56.451197 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ed0936bf-0d57-4714-9a60-0df15ecce75c tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1519 microversion: 2.1 time: 0.170078 Jul 25 13:30:56.451747 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3233/6395] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:56 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:57.472989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-066c36c6-7061-46a7-934f-9f05cdf73996 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:57.473583 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-066c36c6-7061-46a7-934f-9f05cdf73996 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:57.481679 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-066c36c6-7061-46a7-934f-9f05cdf73996 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:57.482340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-066c36c6-7061-46a7-934f-9f05cdf73996 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:57.483153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-066c36c6-7061-46a7-934f-9f05cdf73996 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:57.483614 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-066c36c6-7061-46a7-934f-9f05cdf73996 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:57.617041 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-066c36c6-7061-46a7-934f-9f05cdf73996 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:57.624974 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-066c36c6-7061-46a7-934f-9f05cdf73996 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1519 microversion: 2.1 time: 0.156432 Jul 25 13:30:57.625548 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3163/6396] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:57 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:58.647689 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e27cc61a-0c3e-4eec-bdaf-ce588a3e185a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:58.648376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e27cc61a-0c3e-4eec-bdaf-ce588a3e185a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:58.656439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e27cc61a-0c3e-4eec-bdaf-ce588a3e185a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:58.656966 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e27cc61a-0c3e-4eec-bdaf-ce588a3e185a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:58.657875 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e27cc61a-0c3e-4eec-bdaf-ce588a3e185a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:58.658405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e27cc61a-0c3e-4eec-bdaf-ce588a3e185a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:58.677922 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:30:58.800748 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e27cc61a-0c3e-4eec-bdaf-ce588a3e185a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:58.808405 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e27cc61a-0c3e-4eec-bdaf-ce588a3e185a tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1519 microversion: 2.1 time: 0.165560 Jul 25 13:30:58.808981 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3234/6397] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:58 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:30:59.833912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e20e1a14-bf2a-4e7b-9054-f42db60401eb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:30:59.834774 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e20e1a14-bf2a-4e7b-9054-f42db60401eb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:30:59.843555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e20e1a14-bf2a-4e7b-9054-f42db60401eb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:59.844034 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e20e1a14-bf2a-4e7b-9054-f42db60401eb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:59.844824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e20e1a14-bf2a-4e7b-9054-f42db60401eb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:30:59.845273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e20e1a14-bf2a-4e7b-9054-f42db60401eb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:30:59.976843 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e20e1a14-bf2a-4e7b-9054-f42db60401eb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:30:59.984604 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e20e1a14-bf2a-4e7b-9054-f42db60401eb tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1519 microversion: 2.1 time: 0.157305 Jul 25 13:30:59.985182 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3164/6398] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:30:59 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:01.010360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aadc79a6-1188-4395-b92f-d6681495942f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:01.011337 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-aadc79a6-1188-4395-b92f-d6681495942f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:01.023318 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aadc79a6-1188-4395-b92f-d6681495942f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:01.024079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aadc79a6-1188-4395-b92f-d6681495942f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:01.025404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aadc79a6-1188-4395-b92f-d6681495942f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:01.026257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aadc79a6-1188-4395-b92f-d6681495942f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:01.177165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-aadc79a6-1188-4395-b92f-d6681495942f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:01.185265 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-aadc79a6-1188-4395-b92f-d6681495942f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1519 microversion: 2.1 time: 0.181426 Jul 25 13:31:01.185864 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3235/6399] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:01 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:02.215107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-51615853-27e0-4e62-b372-6bdc35f1b8a7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:02.216085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-51615853-27e0-4e62-b372-6bdc35f1b8a7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:02.228217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-51615853-27e0-4e62-b372-6bdc35f1b8a7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:02.228883 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-51615853-27e0-4e62-b372-6bdc35f1b8a7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:02.229669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-51615853-27e0-4e62-b372-6bdc35f1b8a7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:02.230157 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-51615853-27e0-4e62-b372-6bdc35f1b8a7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:02.674257 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-51615853-27e0-4e62-b372-6bdc35f1b8a7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:02.682577 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-51615853-27e0-4e62-b372-6bdc35f1b8a7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1519 microversion: 2.1 time: 0.474231 Jul 25 13:31:02.683370 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3165/6400] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:02 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1519 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:03.707969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a176d590-aa5d-428d-9e4e-db8a959954f6 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:03.709162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a176d590-aa5d-428d-9e4e-db8a959954f6 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:03.721462 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a176d590-aa5d-428d-9e4e-db8a959954f6 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:03.722308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a176d590-aa5d-428d-9e4e-db8a959954f6 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:03.723599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a176d590-aa5d-428d-9e4e-db8a959954f6 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:03.724338 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a176d590-aa5d-428d-9e4e-db8a959954f6 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:03.853764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a176d590-aa5d-428d-9e4e-db8a959954f6 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:03.861794 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a176d590-aa5d-428d-9e4e-db8a959954f6 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1519 microversion: 2.1 time: 0.160480 Jul 25 13:31:03.862421 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3236/6401] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:03 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:04.884153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8c9a1723-b4e4-412e-a4bf-104f0a1f88dd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:04.884856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8c9a1723-b4e4-412e-a4bf-104f0a1f88dd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:04.893079 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c9a1723-b4e4-412e-a4bf-104f0a1f88dd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:04.893603 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c9a1723-b4e4-412e-a4bf-104f0a1f88dd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:04.894530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c9a1723-b4e4-412e-a4bf-104f0a1f88dd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:04.895029 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8c9a1723-b4e4-412e-a4bf-104f0a1f88dd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:05.031915 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8c9a1723-b4e4-412e-a4bf-104f0a1f88dd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:05.040190 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8c9a1723-b4e4-412e-a4bf-104f0a1f88dd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1519 microversion: 2.1 time: 0.160481 Jul 25 13:31:05.040806 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3166/6402] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:04 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:06.063358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a6405bbc-b606-4d0a-a5c2-b429da7a3eb5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:06.064017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a6405bbc-b606-4d0a-a5c2-b429da7a3eb5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:06.066890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:31:06.072685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a6405bbc-b606-4d0a-a5c2-b429da7a3eb5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:06.073177 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a6405bbc-b606-4d0a-a5c2-b429da7a3eb5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:06.074004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a6405bbc-b606-4d0a-a5c2-b429da7a3eb5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:06.074466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a6405bbc-b606-4d0a-a5c2-b429da7a3eb5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:06.212193 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a6405bbc-b606-4d0a-a5c2-b429da7a3eb5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:06.222945 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a6405bbc-b606-4d0a-a5c2-b429da7a3eb5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1519 microversion: 2.1 time: 0.163862 Jul 25 13:31:06.223525 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3237/6403] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:06 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:07.248691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-92e400f7-2130-464b-bf23-6a11c7a50a50 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:07.249695 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-92e400f7-2130-464b-bf23-6a11c7a50a50 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:07.253432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:31:07.262322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92e400f7-2130-464b-bf23-6a11c7a50a50 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:07.262792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92e400f7-2130-464b-bf23-6a11c7a50a50 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:07.263583 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92e400f7-2130-464b-bf23-6a11c7a50a50 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:07.264041 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92e400f7-2130-464b-bf23-6a11c7a50a50 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:07.394880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-92e400f7-2130-464b-bf23-6a11c7a50a50 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:07.402619 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-92e400f7-2130-464b-bf23-6a11c7a50a50 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1519 microversion: 2.1 time: 0.161045 Jul 25 13:31:07.403196 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3167/6404] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:07 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:08.427959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-04afcac7-6eea-48e8-bea3-05222344f9d5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:08.428842 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-04afcac7-6eea-48e8-bea3-05222344f9d5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:08.438111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04afcac7-6eea-48e8-bea3-05222344f9d5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:08.438574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04afcac7-6eea-48e8-bea3-05222344f9d5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:08.439336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04afcac7-6eea-48e8-bea3-05222344f9d5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:08.439769 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-04afcac7-6eea-48e8-bea3-05222344f9d5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:08.574306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-04afcac7-6eea-48e8-bea3-05222344f9d5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:08.585546 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-04afcac7-6eea-48e8-bea3-05222344f9d5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1519 microversion: 2.1 time: 0.164335 Jul 25 13:31:08.586350 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3238/6405] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:08 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:09.610311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-eccc417e-e3a5-41a5-8f24-a8efdb7c87e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:09.611158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-eccc417e-e3a5-41a5-8f24-a8efdb7c87e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:09.620719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eccc417e-e3a5-41a5-8f24-a8efdb7c87e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:09.621353 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eccc417e-e3a5-41a5-8f24-a8efdb7c87e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:09.622455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eccc417e-e3a5-41a5-8f24-a8efdb7c87e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:09.623648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eccc417e-e3a5-41a5-8f24-a8efdb7c87e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:09.758958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-eccc417e-e3a5-41a5-8f24-a8efdb7c87e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:09.766836 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-eccc417e-e3a5-41a5-8f24-a8efdb7c87e9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1519 microversion: 2.1 time: 0.162005 Jul 25 13:31:09.767463 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3168/6406] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:09 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:10.792347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bd4f9ac4-51be-429b-93dc-89643368e47b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:10.793339 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bd4f9ac4-51be-429b-93dc-89643368e47b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:10.805086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd4f9ac4-51be-429b-93dc-89643368e47b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:10.805746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd4f9ac4-51be-429b-93dc-89643368e47b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:10.807069 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd4f9ac4-51be-429b-93dc-89643368e47b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:10.807803 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd4f9ac4-51be-429b-93dc-89643368e47b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:10.943122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bd4f9ac4-51be-429b-93dc-89643368e47b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:10.952862 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bd4f9ac4-51be-429b-93dc-89643368e47b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1519 microversion: 2.1 time: 0.167209 Jul 25 13:31:10.953430 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3239/6407] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:10 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:11.980976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-26669e4e-ad8b-4c1e-b714-42876ecf6237 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:11.981599 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-26669e4e-ad8b-4c1e-b714-42876ecf6237 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:11.988975 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26669e4e-ad8b-4c1e-b714-42876ecf6237 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:11.989447 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26669e4e-ad8b-4c1e-b714-42876ecf6237 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:11.990292 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26669e4e-ad8b-4c1e-b714-42876ecf6237 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:11.990717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-26669e4e-ad8b-4c1e-b714-42876ecf6237 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:12.128966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-26669e4e-ad8b-4c1e-b714-42876ecf6237 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:12.138074 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-26669e4e-ad8b-4c1e-b714-42876ecf6237 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1519 microversion: 2.1 time: 0.165679 Jul 25 13:31:12.138972 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3169/6408] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:11 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:13.159324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-47a037d8-b061-4ba5-9c8f-f5a07bc5e5e2 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:13.160751 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-47a037d8-b061-4ba5-9c8f-f5a07bc5e5e2 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:13.168085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-47a037d8-b061-4ba5-9c8f-f5a07bc5e5e2 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:13.168519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-47a037d8-b061-4ba5-9c8f-f5a07bc5e5e2 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:13.169401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-47a037d8-b061-4ba5-9c8f-f5a07bc5e5e2 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:13.169868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-47a037d8-b061-4ba5-9c8f-f5a07bc5e5e2 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:13.305995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-47a037d8-b061-4ba5-9c8f-f5a07bc5e5e2 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:13.313720 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-47a037d8-b061-4ba5-9c8f-f5a07bc5e5e2 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1519 microversion: 2.1 time: 0.158280 Jul 25 13:31:13.314349 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3240/6409] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:13 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:14.340096 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b98dc70b-28e7-41c6-833e-b065741572f0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:14.340796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b98dc70b-28e7-41c6-833e-b065741572f0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:14.349900 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b98dc70b-28e7-41c6-833e-b065741572f0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:14.350475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b98dc70b-28e7-41c6-833e-b065741572f0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:14.351395 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b98dc70b-28e7-41c6-833e-b065741572f0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:14.351920 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b98dc70b-28e7-41c6-833e-b065741572f0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:14.486815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b98dc70b-28e7-41c6-833e-b065741572f0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:14.494405 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b98dc70b-28e7-41c6-833e-b065741572f0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1519 microversion: 2.1 time: 0.161587 Jul 25 13:31:14.494955 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3170/6410] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:14 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:15.527862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4a9486fd-0e19-4685-b38e-e857d2c15f32 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:15.528758 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4a9486fd-0e19-4685-b38e-e857d2c15f32 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:15.540008 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a9486fd-0e19-4685-b38e-e857d2c15f32 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:15.540774 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a9486fd-0e19-4685-b38e-e857d2c15f32 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:15.542119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a9486fd-0e19-4685-b38e-e857d2c15f32 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:15.543124 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a9486fd-0e19-4685-b38e-e857d2c15f32 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:15.679035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4a9486fd-0e19-4685-b38e-e857d2c15f32 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:15.690095 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4a9486fd-0e19-4685-b38e-e857d2c15f32 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1519 microversion: 2.1 time: 0.169232 Jul 25 13:31:15.690910 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3241/6411] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:15 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:16.714774 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b81aea1d-6535-479d-ac76-7421c4b39fe9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:16.715584 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b81aea1d-6535-479d-ac76-7421c4b39fe9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:16.722584 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b81aea1d-6535-479d-ac76-7421c4b39fe9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:16.723053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b81aea1d-6535-479d-ac76-7421c4b39fe9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:16.723844 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b81aea1d-6535-479d-ac76-7421c4b39fe9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:16.724301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b81aea1d-6535-479d-ac76-7421c4b39fe9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:16.727025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=81 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:31:16.945223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b81aea1d-6535-479d-ac76-7421c4b39fe9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:16.953243 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b81aea1d-6535-479d-ac76-7421c4b39fe9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1518 microversion: 2.1 time: 0.242588 Jul 25 13:31:16.953873 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3171/6412] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:16 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1518 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:17.244163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-08151b5b-7e8f-43e6-a948-338fff860a4e req-110b744a-1bba-4c1d-bd70-255f14250a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21517950-0349-4dc2-8ba6-8a4e7c9ca594", "name": "network-vif-unplugged", "status": "completed", "tag": "69c7f67d-d816-4745-938d-d2894c2360bc"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:31:17.256083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-08151b5b-7e8f-43e6-a948-338fff860a4e req-110b744a-1bba-4c1d-bd70-255f14250a30 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:17.256958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-08151b5b-7e8f-43e6-a948-338fff860a4e req-110b744a-1bba-4c1d-bd70-255f14250a30 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:17.270229 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-08151b5b-7e8f-43e6-a948-338fff860a4e req-110b744a-1bba-4c1d-bd70-255f14250a30 service nova] Creating event network-vif-unplugged:69c7f67d-d816-4745-938d-d2894c2360bc for instance 21517950-0349-4dc2-8ba6-8a4e7c9ca594 on n-h2-848886-15 Jul 25 13:31:17.275781 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [req-08151b5b-7e8f-43e6-a948-338fff860a4e req-110b744a-1bba-4c1d-bd70-255f14250a30 service nova] Instance 21517950-0349-4dc2-8ba6-8a4e7c9ca594 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:31:17.286986 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-08151b5b-7e8f-43e6-a948-338fff860a4e req-110b744a-1bba-4c1d-bd70-255f14250a30 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047020 Jul 25 13:31:17.287597 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3242/6413] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:31:17.926922 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:31:17.926922 n-d-848886-15 devstack@n-api.service[125883]: Mon Jul 25 13:31:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:31:17.974768 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4f0d38b2-25c7-4d31-b1b1-3cd306ca5063 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:17.975398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4f0d38b2-25c7-4d31-b1b1-3cd306ca5063 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:17.982818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4f0d38b2-25c7-4d31-b1b1-3cd306ca5063 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:17.983680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4f0d38b2-25c7-4d31-b1b1-3cd306ca5063 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:17.984479 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4f0d38b2-25c7-4d31-b1b1-3cd306ca5063 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:17.985009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4f0d38b2-25c7-4d31-b1b1-3cd306ca5063 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:18.142111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4f0d38b2-25c7-4d31-b1b1-3cd306ca5063 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:18.150166 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4f0d38b2-25c7-4d31-b1b1-3cd306ca5063 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1518 microversion: 2.1 time: 0.179206 Jul 25 13:31:18.150977 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3172/6414] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:17 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:19.172366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d2d6adb5-a9bb-4c27-b7c9-aad6c7333d82 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:19.173072 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d2d6adb5-a9bb-4c27-b7c9-aad6c7333d82 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:19.179778 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2d6adb5-a9bb-4c27-b7c9-aad6c7333d82 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:19.180243 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2d6adb5-a9bb-4c27-b7c9-aad6c7333d82 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:19.181015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2d6adb5-a9bb-4c27-b7c9-aad6c7333d82 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:19.181460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2d6adb5-a9bb-4c27-b7c9-aad6c7333d82 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:19.305781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-87df0df5-cdd8-4d1a-9ea4-3ecbf627c10f req-7a274e22-7b71-4cf7-9f9f-1f928b230aea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21517950-0349-4dc2-8ba6-8a4e7c9ca594", "tag": "69c7f67d-d816-4745-938d-d2894c2360bc"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:31:19.316533 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-87df0df5-cdd8-4d1a-9ea4-3ecbf627c10f req-7a274e22-7b71-4cf7-9f9f-1f928b230aea service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:19.316998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-87df0df5-cdd8-4d1a-9ea4-3ecbf627c10f req-7a274e22-7b71-4cf7-9f9f-1f928b230aea service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:19.317452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d2d6adb5-a9bb-4c27-b7c9-aad6c7333d82 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:19.325414 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d2d6adb5-a9bb-4c27-b7c9-aad6c7333d82 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1516 microversion: 2.1 time: 0.158375 Jul 25 13:31:19.326020 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3243/6415] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:19 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:19.329212 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-87df0df5-cdd8-4d1a-9ea4-3ecbf627c10f req-7a274e22-7b71-4cf7-9f9f-1f928b230aea service nova] Creating event network-changed:69c7f67d-d816-4745-938d-d2894c2360bc for instance 21517950-0349-4dc2-8ba6-8a4e7c9ca594 on n-h2-848886-15 Jul 25 13:31:19.335049 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [req-87df0df5-cdd8-4d1a-9ea4-3ecbf627c10f req-7a274e22-7b71-4cf7-9f9f-1f928b230aea service nova] Instance 21517950-0349-4dc2-8ba6-8a4e7c9ca594 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125883) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:31:19.346394 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-87df0df5-cdd8-4d1a-9ea4-3ecbf627c10f req-7a274e22-7b71-4cf7-9f9f-1f928b230aea service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044403 Jul 25 13:31:19.346988 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3173/6416] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:31:20.347176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-791b7d48-689b-4560-84d5-f2ce61e9ddb7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:20.347884 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-791b7d48-689b-4560-84d5-f2ce61e9ddb7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:20.354965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-791b7d48-689b-4560-84d5-f2ce61e9ddb7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:20.355441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-791b7d48-689b-4560-84d5-f2ce61e9ddb7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:20.356206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-791b7d48-689b-4560-84d5-f2ce61e9ddb7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:20.356642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-791b7d48-689b-4560-84d5-f2ce61e9ddb7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:20.506488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-791b7d48-689b-4560-84d5-f2ce61e9ddb7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:20.520395 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-791b7d48-689b-4560-84d5-f2ce61e9ddb7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1513 microversion: 2.1 time: 0.171585 Jul 25 13:31:20.520395 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3244/6417] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:20 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:20.536472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-25561373-2313-4205-9953-6442d65b0d5b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:31:20.537139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-25561373-2313-4205-9953-6442d65b0d5b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:20.545046 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-25561373-2313-4205-9953-6442d65b0d5b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:20.545687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-25561373-2313-4205-9953-6442d65b0d5b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:20.546641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-25561373-2313-4205-9953-6442d65b0d5b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:20.547820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-25561373-2313-4205-9953-6442d65b0d5b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:20.608522 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-25561373-2313-4205-9953-6442d65b0d5b tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "POST /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594/action" status: 204 len: 0 microversion: 2.1 time: 0.077177 Jul 25 13:31:20.609178 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3174/6418] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:31:20 2022] POST /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:31:20.617604 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a69a9a3a-fc01-4d2d-b2b4-498160089cb8 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:20.618366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a69a9a3a-fc01-4d2d-b2b4-498160089cb8 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:20.625461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a69a9a3a-fc01-4d2d-b2b4-498160089cb8 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:20.626083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a69a9a3a-fc01-4d2d-b2b4-498160089cb8 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:20.626924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a69a9a3a-fc01-4d2d-b2b4-498160089cb8 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:20.627605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a69a9a3a-fc01-4d2d-b2b4-498160089cb8 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:20.840550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a69a9a3a-fc01-4d2d-b2b4-498160089cb8 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:20.849058 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a69a9a3a-fc01-4d2d-b2b4-498160089cb8 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1513 microversion: 2.1 time: 0.235480 Jul 25 13:31:20.849728 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3245/6419] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:20 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:21.871585 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-872027c2-8647-4b2d-a764-9f2f04b90fe9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:21.872202 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-872027c2-8647-4b2d-a764-9f2f04b90fe9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:21.878629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-872027c2-8647-4b2d-a764-9f2f04b90fe9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:21.879097 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-872027c2-8647-4b2d-a764-9f2f04b90fe9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:21.879877 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-872027c2-8647-4b2d-a764-9f2f04b90fe9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:21.880311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-872027c2-8647-4b2d-a764-9f2f04b90fe9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:22.031300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-872027c2-8647-4b2d-a764-9f2f04b90fe9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:22.039700 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-872027c2-8647-4b2d-a764-9f2f04b90fe9 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1505 microversion: 2.1 time: 0.173516 Jul 25 13:31:22.040404 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3175/6420] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:21 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:22.069360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-34350300-b011-4f52-aeb6-56a4376eb68e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:22.070407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-34350300-b011-4f52-aeb6-56a4376eb68e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:22.081943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-34350300-b011-4f52-aeb6-56a4376eb68e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:22.082682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-34350300-b011-4f52-aeb6-56a4376eb68e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:22.083986 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-34350300-b011-4f52-aeb6-56a4376eb68e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:22.084660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-34350300-b011-4f52-aeb6-56a4376eb68e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:22.225032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-34350300-b011-4f52-aeb6-56a4376eb68e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:22.232840 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-34350300-b011-4f52-aeb6-56a4376eb68e tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1505 microversion: 2.1 time: 0.170258 Jul 25 13:31:22.233502 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3246/6421] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:22 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:22.252660 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3b76898d-b4cf-4a11-919f-21cca0bad08f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:22.253281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3b76898d-b4cf-4a11-919f-21cca0bad08f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:22.259632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b76898d-b4cf-4a11-919f-21cca0bad08f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:22.260092 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b76898d-b4cf-4a11-919f-21cca0bad08f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:22.260867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b76898d-b4cf-4a11-919f-21cca0bad08f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:22.261347 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b76898d-b4cf-4a11-919f-21cca0bad08f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:22.292905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-32c599ef-7e72-4dda-bc19-edeb9014f6e7 req-33f39b1e-8e9b-4a8e-98f0-1b740a464b0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21517950-0349-4dc2-8ba6-8a4e7c9ca594", "name": "network-vif-plugged", "status": "completed", "tag": "69c7f67d-d816-4745-938d-d2894c2360bc"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:31:22.306497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-32c599ef-7e72-4dda-bc19-edeb9014f6e7 req-33f39b1e-8e9b-4a8e-98f0-1b740a464b0b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:22.306944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-32c599ef-7e72-4dda-bc19-edeb9014f6e7 req-33f39b1e-8e9b-4a8e-98f0-1b740a464b0b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:22.318821 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-32c599ef-7e72-4dda-bc19-edeb9014f6e7 req-33f39b1e-8e9b-4a8e-98f0-1b740a464b0b service nova] Creating event network-vif-plugged:69c7f67d-d816-4745-938d-d2894c2360bc for instance 21517950-0349-4dc2-8ba6-8a4e7c9ca594 on n-h2-848886-15 Jul 25 13:31:22.324058 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-32c599ef-7e72-4dda-bc19-edeb9014f6e7 req-33f39b1e-8e9b-4a8e-98f0-1b740a464b0b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035160 Jul 25 13:31:22.324663 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3247/6422] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:31:22.402367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3b76898d-b4cf-4a11-919f-21cca0bad08f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:22.410358 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3b76898d-b4cf-4a11-919f-21cca0bad08f tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1505 microversion: 2.1 time: 0.161453 Jul 25 13:31:22.410926 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3176/6423] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:22 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:22.430748 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-eb89344a-cf55-41a2-8377-f23926d01684 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:22.431331 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eb89344a-cf55-41a2-8377-f23926d01684 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:22.437693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb89344a-cf55-41a2-8377-f23926d01684 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:22.438172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb89344a-cf55-41a2-8377-f23926d01684 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:22.438926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb89344a-cf55-41a2-8377-f23926d01684 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:22.439362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eb89344a-cf55-41a2-8377-f23926d01684 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:22.464054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eb89344a-cf55-41a2-8377-f23926d01684 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:31:22.540371 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-eb89344a-cf55-41a2-8377-f23926d01684 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "DELETE /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 204 len: 0 microversion: 2.1 time: 0.113518 Jul 25 13:31:22.541109 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3248/6424] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:31:22 2022] DELETE /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:31:22.557050 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8a139ab8-fafb-441f-8f12-2f8f261950b7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:22.557577 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8a139ab8-fafb-441f-8f12-2f8f261950b7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:22.564191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8a139ab8-fafb-441f-8f12-2f8f261950b7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:22.564663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8a139ab8-fafb-441f-8f12-2f8f261950b7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:22.565451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8a139ab8-fafb-441f-8f12-2f8f261950b7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:22.565948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8a139ab8-fafb-441f-8f12-2f8f261950b7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:22.590790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8a139ab8-fafb-441f-8f12-2f8f261950b7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:31:22.638716 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.compute.api [None req-8a139ab8-fafb-441f-8f12-2f8f261950b7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Instance is already in deleting state, ignoring this request Jul 25 13:31:22.639569 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8a139ab8-fafb-441f-8f12-2f8f261950b7 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "DELETE /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 204 len: 0 microversion: 2.1 time: 0.086568 Jul 25 13:31:22.640108 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3177/6425] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:31:22 2022] DELETE /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:31:22.648669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0d5162cd-d3bf-4489-b9dc-7ec3f1c70b74 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:22.649377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0d5162cd-d3bf-4489-b9dc-7ec3f1c70b74 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:22.656039 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d5162cd-d3bf-4489-b9dc-7ec3f1c70b74 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:22.656412 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d5162cd-d3bf-4489-b9dc-7ec3f1c70b74 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:22.657186 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d5162cd-d3bf-4489-b9dc-7ec3f1c70b74 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:22.657624 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0d5162cd-d3bf-4489-b9dc-7ec3f1c70b74 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:22.804281 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0d5162cd-d3bf-4489-b9dc-7ec3f1c70b74 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:22.812327 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0d5162cd-d3bf-4489-b9dc-7ec3f1c70b74 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1511 microversion: 2.1 time: 0.167851 Jul 25 13:31:22.812904 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3249/6426] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:22 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:23.837457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-219e1378-a14a-4b18-b641-e0ce580898a0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:23.838520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-219e1378-a14a-4b18-b641-e0ce580898a0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:23.851442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-219e1378-a14a-4b18-b641-e0ce580898a0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:23.852211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-219e1378-a14a-4b18-b641-e0ce580898a0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:23.853508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-219e1378-a14a-4b18-b641-e0ce580898a0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:23.854314 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-219e1378-a14a-4b18-b641-e0ce580898a0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:24.066317 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-219e1378-a14a-4b18-b641-e0ce580898a0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db6b00886db4135920274558cb06091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0602e8402bb9431db2aa4a23b922485c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:24.074237 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-219e1378-a14a-4b18-b641-e0ce580898a0 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 200 len: 1511 microversion: 2.1 time: 0.243254 Jul 25 13:31:24.074760 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3178/6427] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:23 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 1511 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:24.448704 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-be4de49d-394c-4cc8-8565-183a51f08839 req-3cb63ae8-50c4-4f7e-b20c-498e5affada9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21517950-0349-4dc2-8ba6-8a4e7c9ca594", "name": "network-vif-deleted", "tag": "69c7f67d-d816-4745-938d-d2894c2360bc"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:31:24.459757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-be4de49d-394c-4cc8-8565-183a51f08839 req-3cb63ae8-50c4-4f7e-b20c-498e5affada9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:24.460208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-be4de49d-394c-4cc8-8565-183a51f08839 req-3cb63ae8-50c4-4f7e-b20c-498e5affada9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:24.471828 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-be4de49d-394c-4cc8-8565-183a51f08839 req-3cb63ae8-50c4-4f7e-b20c-498e5affada9 service nova] Creating event network-vif-deleted:69c7f67d-d816-4745-938d-d2894c2360bc for instance 21517950-0349-4dc2-8ba6-8a4e7c9ca594 on n-h2-848886-15 Jul 25 13:31:24.476586 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-be4de49d-394c-4cc8-8565-183a51f08839 req-3cb63ae8-50c4-4f7e-b20c-498e5affada9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035581 Jul 25 13:31:24.477183 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3250/6428] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:31:25.101875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4a5027fb-c478-4958-bf70-a3a66f624b33 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:25.103450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4a5027fb-c478-4958-bf70-a3a66f624b33 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: 21517950-0349-4dc2-8ba6-8a4e7c9ca594] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:25.120229 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a5027fb-c478-4958-bf70-a3a66f624b33 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:25.121298 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a5027fb-c478-4958-bf70-a3a66f624b33 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:25.122515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a5027fb-c478-4958-bf70-a3a66f624b33 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:25.123191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4a5027fb-c478-4958-bf70-a3a66f624b33 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:25.143113 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-4a5027fb-c478-4958-bf70-a3a66f624b33 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] HTTP exception thrown: Instance 21517950-0349-4dc2-8ba6-8a4e7c9ca594 could not be found. Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4a5027fb-c478-4958-bf70-a3a66f624b33 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Request method failure captured: Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 HTTP/1.1 Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3prJfdbhoBH4Z4XAt69oHbV191Ty-WCGJMar5iZ2JYZ13l_A5iXTpcBu2O20P3NP5cFV8r7SlQXdmTUo3pGexS8H7fJPdaqfLALh0FBzeYsmx3r_iUMCMBXmGJ2vRmvh4B-D15FAHmFt7PSFv65m8BpDvnjqUfB-ArgUB6-aRcMy9-Q Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 0602e8402bb9431db2aa4a23b922485c Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerDiskConfigTestJSON-569841258 Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0602e8402bb9431db2aa4a23b922485c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0602e8402bb9431db2aa4a23b922485c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0602e8402bb9431db2aa4a23b922485c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0602e8402bb9431db2aa4a23b922485c"}]}] Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerDiskConfigTestJSON-569841258 Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 0602e8402bb9431db2aa4a23b922485c Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-569841258 Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerDiskConfigTestJSON-569841258-project Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 7db6b00886db4135920274558cb06091 Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerDiskConfigTestJSON-569841258-project Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 21517950-0349-4dc2-8ba6-8a4e7c9ca594 could not be found. Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '21517950-0349-4dc2-8ba6-8a4e7c9ca594'} Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21517950-0349-4dc2-8ba6-8a4e7c9ca594 could not be found. Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21517950-0349-4dc2-8ba6-8a4e7c9ca594 could not be found. Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:31:25.145073 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:31:25.151399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:31:25.151399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:31:25.151399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:31:25.151399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:31:25.151399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:31:25.151399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21517950-0349-4dc2-8ba6-8a4e7c9ca594 could not be found. Jul 25 13:31:25.151399 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:31:25.151399 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4a5027fb-c478-4958-bf70-a3a66f624b33 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Returning 404 to user: Instance 21517950-0349-4dc2-8ba6-8a4e7c9ca594 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:31:25.151399 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4a5027fb-c478-4958-bf70-a3a66f624b33 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594" status: 404 len: 111 microversion: 2.1 time: 0.053888 Jul 25 13:31:25.151399 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3179/6429] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:25 2022] GET /compute/v2.1/servers/21517950-0349-4dc2-8ba6-8a4e7c9ca594 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:31:25.157449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c1eb9d80-0375-4682-9b03-5df922bfd902 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '.version_select at 0x7efcf896e790>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:25.182747 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c1eb9d80-0375-4682-9b03-5df922bfd902 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1842367589" status: 202 len: 0 microversion: 2.1 time: 0.029560 Jul 25 13:31:25.183358 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3251/6430] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Jul 25 13:31:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1842367589 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:31:25.800071 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-98693da9-0205-4998-9814-ee5c4c400cfd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:25.800584 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-98693da9-0205-4998-9814-ee5c4c400cfd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:25.806885 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98693da9-0205-4998-9814-ee5c4c400cfd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:25.807365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98693da9-0205-4998-9814-ee5c4c400cfd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:25.808162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98693da9-0205-4998-9814-ee5c4c400cfd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:25.808636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98693da9-0205-4998-9814-ee5c4c400cfd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:25.822248 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-98693da9-0205-4998-9814-ee5c4c400cfd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] HTTP exception thrown: Instance e65dbd38-8144-4078-94a1-3fc955f98d46 could not be found. Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-98693da9-0205-4998-9814-ee5c4c400cfd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Request method failure captured: Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 HTTP/1.1 Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3prJfdbhoBH4Z4XAt69oHbV191Ty-WCGJMar5iZ2JYZ13l_A5iXTpcBu2O20P3NP5cFV8r7SlQXdmTUo3pGexS8H7fJPdaqfLALh0FBzeYsmx3r_iUMCMBXmGJ2vRmvh4B-D15FAHmFt7PSFv65m8BpDvnjqUfB-ArgUB6-aRcMy9-Q Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 0602e8402bb9431db2aa4a23b922485c Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerDiskConfigTestJSON-569841258 Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0602e8402bb9431db2aa4a23b922485c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0602e8402bb9431db2aa4a23b922485c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0602e8402bb9431db2aa4a23b922485c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0602e8402bb9431db2aa4a23b922485c"}]}] Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerDiskConfigTestJSON-569841258 Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 0602e8402bb9431db2aa4a23b922485c Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-569841258 Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerDiskConfigTestJSON-569841258-project Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 7db6b00886db4135920274558cb06091 Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerDiskConfigTestJSON-569841258-project Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance e65dbd38-8144-4078-94a1-3fc955f98d46 could not be found. Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'e65dbd38-8144-4078-94a1-3fc955f98d46'} Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e65dbd38-8144-4078-94a1-3fc955f98d46 could not be found. Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:31:25.823815 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:31:25.829113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e65dbd38-8144-4078-94a1-3fc955f98d46 could not be found. Jul 25 13:31:25.829113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:31:25.829113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:31:25.829113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:31:25.829113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:31:25.829113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:31:25.829113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:31:25.829113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:31:25.829113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:31:25.829113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e65dbd38-8144-4078-94a1-3fc955f98d46 could not be found. Jul 25 13:31:25.829113 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:31:25.829113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-98693da9-0205-4998-9814-ee5c4c400cfd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Returning 404 to user: Instance e65dbd38-8144-4078-94a1-3fc955f98d46 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:31:25.829113 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-98693da9-0205-4998-9814-ee5c4c400cfd tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 404 len: 111 microversion: 2.1 time: 0.029212 Jul 25 13:31:25.829113 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3180/6431] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:31:25 2022] DELETE /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:31:25.834088 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-16307550-2c89-4807-a0a3-1db6e2032ad5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:25.834824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-16307550-2c89-4807-a0a3-1db6e2032ad5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] [instance: e65dbd38-8144-4078-94a1-3fc955f98d46] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:25.842591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16307550-2c89-4807-a0a3-1db6e2032ad5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:25.843359 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16307550-2c89-4807-a0a3-1db6e2032ad5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:25.844116 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16307550-2c89-4807-a0a3-1db6e2032ad5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:25.844509 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-16307550-2c89-4807-a0a3-1db6e2032ad5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:25.848576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:31:25.859467 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-16307550-2c89-4807-a0a3-1db6e2032ad5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] HTTP exception thrown: Instance e65dbd38-8144-4078-94a1-3fc955f98d46 could not be found. Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-16307550-2c89-4807-a0a3-1db6e2032ad5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Request method failure captured: Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 HTTP/1.1 Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3prJfdbhoBH4Z4XAt69oHbV191Ty-WCGJMar5iZ2JYZ13l_A5iXTpcBu2O20P3NP5cFV8r7SlQXdmTUo3pGexS8H7fJPdaqfLALh0FBzeYsmx3r_iUMCMBXmGJ2vRmvh4B-D15FAHmFt7PSFv65m8BpDvnjqUfB-ArgUB6-aRcMy9-Q Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 0602e8402bb9431db2aa4a23b922485c Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerDiskConfigTestJSON-569841258 Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0602e8402bb9431db2aa4a23b922485c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0602e8402bb9431db2aa4a23b922485c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0602e8402bb9431db2aa4a23b922485c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0602e8402bb9431db2aa4a23b922485c"}]}] Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerDiskConfigTestJSON-569841258 Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 0602e8402bb9431db2aa4a23b922485c Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-569841258 Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerDiskConfigTestJSON-569841258-project Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 7db6b00886db4135920274558cb06091 Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerDiskConfigTestJSON-569841258-project Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance e65dbd38-8144-4078-94a1-3fc955f98d46 could not be found. Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'e65dbd38-8144-4078-94a1-3fc955f98d46'} Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e65dbd38-8144-4078-94a1-3fc955f98d46 could not be found. Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e65dbd38-8144-4078-94a1-3fc955f98d46 could not be found. Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:31:25.861216 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:31:25.866382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:31:25.866382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:31:25.866382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:31:25.866382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:31:25.866382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:31:25.866382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e65dbd38-8144-4078-94a1-3fc955f98d46 could not be found. Jul 25 13:31:25.866382 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:31:25.866382 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-16307550-2c89-4807-a0a3-1db6e2032ad5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] Returning 404 to user: Instance e65dbd38-8144-4078-94a1-3fc955f98d46 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:31:25.866382 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-16307550-2c89-4807-a0a3-1db6e2032ad5 tempest-ServerDiskConfigTestJSON-569841258 tempest-ServerDiskConfigTestJSON-569841258-project] 10.222.0.49 "GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46" status: 404 len: 111 microversion: 2.1 time: 0.032518 Jul 25 13:31:25.866382 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3252/6432] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:25 2022] GET /compute/v2.1/servers/e65dbd38-8144-4078-94a1-3fc955f98d46 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:31:34.489683 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e0c73dc7-3d77-48a0-907b-60766513c23c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Action: 'create', calling method: .version_select at 0x7efcf82900d0>, body: {"keypair": {"name": "tempest-keypair-1831216923", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKErGYrpH8j3l+oZY28Sq7j2Tn7gIEnUkfoSvbDzMMOdDKM7URdzY3TIoLRY7K5WegzvI9CXTLKDLRodl/NWEEQ+V+paob/JK7CmuNlkvhSAPdkMGehbphQ9GC5OLx6Eg=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:31:34.505467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-e0c73dc7-3d77-48a0-907b-60766513c23c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Getting quotas for project c79a68ef003f4f3faf0a2d4551c6d5ee. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:31:34.510873 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-e0c73dc7-3d77-48a0-907b-60766513c23c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Getting quotas for user 269643d1d0eb465ea092599c11480b71 and project c79a68ef003f4f3faf0a2d4551c6d5ee. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:31:34.540252 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e0c73dc7-3d77-48a0-907b-60766513c23c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.179575 Jul 25 13:31:34.540770 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3181/6433] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:31:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:31:35.879279 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8dc38368-5629-4101-9e81-2c3c4105d04e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1764924622", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "670c2cbc-4b35-45bb-8ba5-a59e7bb64759"}], "security_groups": [{"name": "tempest-securitygroup--395676127"}], "key_name": "tempest-keypair-1831216923", "user_data": "}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:31:35.888775 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:31:35.988136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-8dc38368-5629-4101-9e81-2c3c4105d04e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] validate_networks() for [('670c2cbc-4b35-45bb-8ba5-a59e7bb64759', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:31:36.688481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-8dc38368-5629-4101-9e81-2c3c4105d04e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:31:36.688915 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-8dc38368-5629-4101-9e81-2c3c4105d04e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:31:36.689397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-8dc38368-5629-4101-9e81-2c3c4105d04e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:31:36.689812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-8dc38368-5629-4101-9e81-2c3c4105d04e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:31:36.690256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-8dc38368-5629-4101-9e81-2c3c4105d04e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:31:36.699609 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8dc38368-5629-4101-9e81-2c3c4105d04e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:36.700063 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8dc38368-5629-4101-9e81-2c3c4105d04e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:36.700887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8dc38368-5629-4101-9e81-2c3c4105d04e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:36.701328 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8dc38368-5629-4101-9e81-2c3c4105d04e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:36.719565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-8dc38368-5629-4101-9e81-2c3c4105d04e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Getting quotas for project c79a68ef003f4f3faf0a2d4551c6d5ee. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:31:36.725090 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-8dc38368-5629-4101-9e81-2c3c4105d04e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Getting quotas for user 269643d1d0eb465ea092599c11480b71 and project c79a68ef003f4f3faf0a2d4551c6d5ee. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:31:36.737779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8dc38368-5629-4101-9e81-2c3c4105d04e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:31:36.740142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8dc38368-5629-4101-9e81-2c3c4105d04e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:31:36.786368 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8dc38368-5629-4101-9e81-2c3c4105d04e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.913078 Jul 25 13:31:36.787354 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3253/6434] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:31:35 2022] POST /compute/v2.1/servers => generated 408 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:31:36.798324 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6be9fab4-8e01-4e7e-a0e2-8a1da34f283d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:36.800040 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6be9fab4-8e01-4e7e-a0e2-8a1da34f283d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:36.804551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:31:36.862603 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6be9fab4-8e01-4e7e-a0e2-8a1da34f283d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:36.872378 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6be9fab4-8e01-4e7e-a0e2-8a1da34f283d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1239 microversion: 2.1 time: 0.077882 Jul 25 13:31:36.873594 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3182/6435] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:36 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1239 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:31:37.894991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9830ec26-f30e-443f-b88e-ab014940b298 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:37.895597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9830ec26-f30e-443f-b88e-ab014940b298 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:37.907292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9830ec26-f30e-443f-b88e-ab014940b298 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:37.907997 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9830ec26-f30e-443f-b88e-ab014940b298 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:37.909236 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9830ec26-f30e-443f-b88e-ab014940b298 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:37.910098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9830ec26-f30e-443f-b88e-ab014940b298 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:37.990715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9830ec26-f30e-443f-b88e-ab014940b298 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:37.998568 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9830ec26-f30e-443f-b88e-ab014940b298 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1309 microversion: 2.1 time: 0.109133 Jul 25 13:31:37.999129 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3254/6436] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:37 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:39.020817 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-77708c5b-a535-4520-9154-1001556786b9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:39.021846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-77708c5b-a535-4520-9154-1001556786b9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:39.025383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:31:39.033310 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77708c5b-a535-4520-9154-1001556786b9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:39.034223 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77708c5b-a535-4520-9154-1001556786b9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:39.035212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77708c5b-a535-4520-9154-1001556786b9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:39.035839 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-77708c5b-a535-4520-9154-1001556786b9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:39.254898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-77708c5b-a535-4520-9154-1001556786b9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:39.262993 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-77708c5b-a535-4520-9154-1001556786b9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1364 microversion: 2.1 time: 0.246414 Jul 25 13:31:39.263717 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3183/6437] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:39 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:39.366599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-3bf987d7-0e19-4408-94ae-aaf7520f42f9 req-af233419-01ea-49a6-85b7-bf327aa248a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13a8f09-73e9-48b6-8e92-1949b4004ecf", "tag": "b29ad078-a121-4289-9538-1e57ef763be3"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:31:39.408793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3bf987d7-0e19-4408-94ae-aaf7520f42f9 req-af233419-01ea-49a6-85b7-bf327aa248a9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:39.409522 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3bf987d7-0e19-4408-94ae-aaf7520f42f9 req-af233419-01ea-49a6-85b7-bf327aa248a9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:39.423360 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-3bf987d7-0e19-4408-94ae-aaf7520f42f9 req-af233419-01ea-49a6-85b7-bf327aa248a9 service nova] Creating event network-changed:b29ad078-a121-4289-9538-1e57ef763be3 for instance e13a8f09-73e9-48b6-8e92-1949b4004ecf on n-h1-848886-15 Jul 25 13:31:39.429911 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-3bf987d7-0e19-4408-94ae-aaf7520f42f9 req-af233419-01ea-49a6-85b7-bf327aa248a9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067540 Jul 25 13:31:39.430627 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3255/6438] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:31:40.284017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cda07702-be1b-4a84-b9a5-4c410d0c34a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:40.284605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cda07702-be1b-4a84-b9a5-4c410d0c34a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:40.292149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cda07702-be1b-4a84-b9a5-4c410d0c34a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:40.292701 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cda07702-be1b-4a84-b9a5-4c410d0c34a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:40.293489 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cda07702-be1b-4a84-b9a5-4c410d0c34a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:40.293977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cda07702-be1b-4a84-b9a5-4c410d0c34a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:40.431151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cda07702-be1b-4a84-b9a5-4c410d0c34a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:40.442680 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cda07702-be1b-4a84-b9a5-4c410d0c34a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1364 microversion: 2.1 time: 0.162290 Jul 25 13:31:40.443377 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3184/6439] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:40 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:41.470576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e0148cf9-9889-4cb6-ac78-0fefe36e166c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:41.471312 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e0148cf9-9889-4cb6-ac78-0fefe36e166c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:41.479735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0148cf9-9889-4cb6-ac78-0fefe36e166c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:41.480306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0148cf9-9889-4cb6-ac78-0fefe36e166c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:41.481266 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0148cf9-9889-4cb6-ac78-0fefe36e166c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:41.481811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0148cf9-9889-4cb6-ac78-0fefe36e166c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:41.621647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e0148cf9-9889-4cb6-ac78-0fefe36e166c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:41.629766 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e0148cf9-9889-4cb6-ac78-0fefe36e166c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1364 microversion: 2.1 time: 0.166517 Jul 25 13:31:41.630390 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3256/6440] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:41 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:42.653886 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-310a3a51-6703-4ce4-8031-317e85457b38 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:42.654919 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-310a3a51-6703-4ce4-8031-317e85457b38 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:42.666594 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-310a3a51-6703-4ce4-8031-317e85457b38 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:42.667470 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-310a3a51-6703-4ce4-8031-317e85457b38 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:42.668293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-310a3a51-6703-4ce4-8031-317e85457b38 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:42.668741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-310a3a51-6703-4ce4-8031-317e85457b38 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:42.800982 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-310a3a51-6703-4ce4-8031-317e85457b38 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:42.808907 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-310a3a51-6703-4ce4-8031-317e85457b38 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1364 microversion: 2.1 time: 0.161595 Jul 25 13:31:42.809507 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3185/6441] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:42 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:43.829978 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-73d79069-60de-4ebf-9b16-3958545914a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:43.830621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-73d79069-60de-4ebf-9b16-3958545914a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:43.837988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-73d79069-60de-4ebf-9b16-3958545914a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:43.838511 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-73d79069-60de-4ebf-9b16-3958545914a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:43.839434 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-73d79069-60de-4ebf-9b16-3958545914a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:43.839871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-73d79069-60de-4ebf-9b16-3958545914a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:43.907934 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-a0f1f6fa-9d6c-4540-9cbe-3e744c4e94aa req-520a9c8b-f3e5-4a01-b9de-b9570cb08693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13a8f09-73e9-48b6-8e92-1949b4004ecf", "name": "network-vif-plugged", "status": "completed", "tag": "b29ad078-a121-4289-9538-1e57ef763be3"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:31:43.919668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a0f1f6fa-9d6c-4540-9cbe-3e744c4e94aa req-520a9c8b-f3e5-4a01-b9de-b9570cb08693 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:43.921021 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a0f1f6fa-9d6c-4540-9cbe-3e744c4e94aa req-520a9c8b-f3e5-4a01-b9de-b9570cb08693 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:43.932846 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-a0f1f6fa-9d6c-4540-9cbe-3e744c4e94aa req-520a9c8b-f3e5-4a01-b9de-b9570cb08693 service nova] Creating event network-vif-plugged:b29ad078-a121-4289-9538-1e57ef763be3 for instance e13a8f09-73e9-48b6-8e92-1949b4004ecf on n-h1-848886-15 Jul 25 13:31:43.938547 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-a0f1f6fa-9d6c-4540-9cbe-3e744c4e94aa req-520a9c8b-f3e5-4a01-b9de-b9570cb08693 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034299 Jul 25 13:31:43.939746 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3186/6442] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:31:43.982892 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-73d79069-60de-4ebf-9b16-3958545914a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:43.991171 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-73d79069-60de-4ebf-9b16-3958545914a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1364 microversion: 2.1 time: 0.165155 Jul 25 13:31:43.992118 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3257/6443] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:43 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:45.016247 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-01ff1cc6-2470-4efa-9450-99bb5388268d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:45.017186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-01ff1cc6-2470-4efa-9450-99bb5388268d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:45.027012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01ff1cc6-2470-4efa-9450-99bb5388268d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:45.027629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01ff1cc6-2470-4efa-9450-99bb5388268d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:45.028669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01ff1cc6-2470-4efa-9450-99bb5388268d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:45.029266 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01ff1cc6-2470-4efa-9450-99bb5388268d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:45.177766 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-01ff1cc6-2470-4efa-9450-99bb5388268d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:45.185939 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-01ff1cc6-2470-4efa-9450-99bb5388268d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1364 microversion: 2.1 time: 0.175842 Jul 25 13:31:45.186534 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3187/6444] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:45 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:46.211398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8ef4aa4a-9c37-4fe5-8e07-2ca7ed17b22b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:46.212422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8ef4aa4a-9c37-4fe5-8e07-2ca7ed17b22b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:46.224746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ef4aa4a-9c37-4fe5-8e07-2ca7ed17b22b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:46.225495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ef4aa4a-9c37-4fe5-8e07-2ca7ed17b22b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:46.226821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ef4aa4a-9c37-4fe5-8e07-2ca7ed17b22b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:46.227546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ef4aa4a-9c37-4fe5-8e07-2ca7ed17b22b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:46.363653 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8ef4aa4a-9c37-4fe5-8e07-2ca7ed17b22b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:31:46.371659 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8ef4aa4a-9c37-4fe5-8e07-2ca7ed17b22b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1550 microversion: 2.1 time: 0.166864 Jul 25 13:31:46.372234 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3258/6445] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:31:46 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1550 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:31:46.392531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8665bb5f-37d6-4dbd-b4f1-a483a852d442 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:31:46.393068 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8665bb5f-37d6-4dbd-b4f1-a483a852d442 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:31:46.400529 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8665bb5f-37d6-4dbd-b4f1-a483a852d442 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:46.401008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8665bb5f-37d6-4dbd-b4f1-a483a852d442 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:46.401818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8665bb5f-37d6-4dbd-b4f1-a483a852d442 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:46.402296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8665bb5f-37d6-4dbd-b4f1-a483a852d442 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:46.485247 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8665bb5f-37d6-4dbd-b4f1-a483a852d442 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096758 Jul 25 13:31:46.486028 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3188/6446] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 13:31:46 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:31:47.440756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-b0f6d2bb-a5bb-4737-a28d-dcb89ac81b0d req-8af6bc7d-275d-457b-8bce-ed3096d6b985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13a8f09-73e9-48b6-8e92-1949b4004ecf", "tag": "b29ad078-a121-4289-9538-1e57ef763be3"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:31:47.446288 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:31:47.447104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:31:47.455810 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b0f6d2bb-a5bb-4737-a28d-dcb89ac81b0d req-8af6bc7d-275d-457b-8bce-ed3096d6b985 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:31:47.456254 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b0f6d2bb-a5bb-4737-a28d-dcb89ac81b0d req-8af6bc7d-275d-457b-8bce-ed3096d6b985 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:31:47.467244 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-b0f6d2bb-a5bb-4737-a28d-dcb89ac81b0d req-8af6bc7d-275d-457b-8bce-ed3096d6b985 service nova] Creating event network-changed:b29ad078-a121-4289-9538-1e57ef763be3 for instance e13a8f09-73e9-48b6-8e92-1949b4004ecf on n-h1-848886-15 Jul 25 13:31:47.472832 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-b0f6d2bb-a5bb-4737-a28d-dcb89ac81b0d req-8af6bc7d-275d-457b-8bce-ed3096d6b985 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035889 Jul 25 13:31:47.473795 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3259/6447] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:32:21.228513 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:32:21.231641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=11 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:32:21.232690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=30 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:32:21.239460 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-97ae6d4d-0a67-47e6-88e3-5a84cd14096f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:21.240502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-97ae6d4d-0a67-47e6-88e3-5a84cd14096f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:21.249788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97ae6d4d-0a67-47e6-88e3-5a84cd14096f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:21.250276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97ae6d4d-0a67-47e6-88e3-5a84cd14096f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:21.251051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97ae6d4d-0a67-47e6-88e3-5a84cd14096f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:21.251503 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97ae6d4d-0a67-47e6-88e3-5a84cd14096f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:21.382705 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-97ae6d4d-0a67-47e6-88e3-5a84cd14096f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:21.394760 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-97ae6d4d-0a67-47e6-88e3-5a84cd14096f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1669 microversion: 2.1 time: 0.167547 Jul 25 13:32:21.395609 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3189/6448] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:21 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1669 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:21.417683 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:32:21.418579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=30 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:32:21.422885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3dcac266-51b3-483f-b971-3a8651429b2e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:21.423595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3dcac266-51b3-483f-b971-3a8651429b2e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:21.431588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3dcac266-51b3-483f-b971-3a8651429b2e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:21.432043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3dcac266-51b3-483f-b971-3a8651429b2e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:21.432814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3dcac266-51b3-483f-b971-3a8651429b2e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:21.433255 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3dcac266-51b3-483f-b971-3a8651429b2e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:21.571461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3dcac266-51b3-483f-b971-3a8651429b2e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:21.580195 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3dcac266-51b3-483f-b971-3a8651429b2e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1669 microversion: 2.1 time: 0.164532 Jul 25 13:32:21.580779 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3260/6449] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:21 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1669 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:21.600825 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bfa1b086-a79f-4e29-a23d-3fb3d15f6100 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:21.601456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bfa1b086-a79f-4e29-a23d-3fb3d15f6100 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:21.607947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bfa1b086-a79f-4e29-a23d-3fb3d15f6100 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:21.608415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bfa1b086-a79f-4e29-a23d-3fb3d15f6100 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:21.609188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bfa1b086-a79f-4e29-a23d-3fb3d15f6100 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:21.609637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bfa1b086-a79f-4e29-a23d-3fb3d15f6100 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:21.741022 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bfa1b086-a79f-4e29-a23d-3fb3d15f6100 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:21.752202 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bfa1b086-a79f-4e29-a23d-3fb3d15f6100 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1669 microversion: 2.1 time: 0.155115 Jul 25 13:32:21.752904 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3190/6450] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:21 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:21.775498 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1f35ce8e-7faa-44c2-a8b2-2b1af6b8299c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:32:21.777855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1f35ce8e-7faa-44c2-a8b2-2b1af6b8299c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:21.784481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f35ce8e-7faa-44c2-a8b2-2b1af6b8299c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:21.784930 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f35ce8e-7faa-44c2-a8b2-2b1af6b8299c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:21.785695 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f35ce8e-7faa-44c2-a8b2-2b1af6b8299c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:21.786163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f35ce8e-7faa-44c2-a8b2-2b1af6b8299c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:21.817875 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1f35ce8e-7faa-44c2-a8b2-2b1af6b8299c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:21.823728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1f35ce8e-7faa-44c2-a8b2-2b1af6b8299c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Old instance type m1.heat2, new instance type m1.heat {{(pid=125884) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 13:32:21.830150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-1f35ce8e-7faa-44c2-a8b2-2b1af6b8299c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:32:21.830567 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-1f35ce8e-7faa-44c2-a8b2-2b1af6b8299c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:32:21.831035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-1f35ce8e-7faa-44c2-a8b2-2b1af6b8299c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:32:21.831439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-1f35ce8e-7faa-44c2-a8b2-2b1af6b8299c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:32:21.831841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-1f35ce8e-7faa-44c2-a8b2-2b1af6b8299c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:32:21.899221 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1f35ce8e-7faa-44c2-a8b2-2b1af6b8299c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "POST /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf/action" status: 202 len: 0 microversion: 2.1 time: 0.127648 Jul 25 13:32:21.899845 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3261/6451] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:32:21 2022] POST /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:32:21.908093 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-30f892c0-d764-477f-bd6e-0c6d4ab7f905 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:21.908728 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-30f892c0-d764-477f-bd6e-0c6d4ab7f905 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:21.915039 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30f892c0-d764-477f-bd6e-0c6d4ab7f905 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:21.915521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30f892c0-d764-477f-bd6e-0c6d4ab7f905 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:21.916293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30f892c0-d764-477f-bd6e-0c6d4ab7f905 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:21.916737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-30f892c0-d764-477f-bd6e-0c6d4ab7f905 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:22.056209 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-30f892c0-d764-477f-bd6e-0c6d4ab7f905 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:22.064083 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-30f892c0-d764-477f-bd6e-0c6d4ab7f905 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1678 microversion: 2.1 time: 0.159822 Jul 25 13:32:22.064659 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3191/6452] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:21 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:23.085261 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9ffdc2c7-4bc0-43e2-95a7-262c8e7b2193 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:23.085933 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9ffdc2c7-4bc0-43e2-95a7-262c8e7b2193 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:23.093316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ffdc2c7-4bc0-43e2-95a7-262c8e7b2193 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:23.093763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ffdc2c7-4bc0-43e2-95a7-262c8e7b2193 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:23.094555 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ffdc2c7-4bc0-43e2-95a7-262c8e7b2193 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:23.094991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ffdc2c7-4bc0-43e2-95a7-262c8e7b2193 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:23.626328 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9ffdc2c7-4bc0-43e2-95a7-262c8e7b2193 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:23.634942 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9ffdc2c7-4bc0-43e2-95a7-262c8e7b2193 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1678 microversion: 2.1 time: 0.553663 Jul 25 13:32:23.635523 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3262/6453] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:23 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1678 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:24.660675 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-afc19232-5f86-4cfe-9221-dfc6618de3dc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:24.661673 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-afc19232-5f86-4cfe-9221-dfc6618de3dc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:24.671193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afc19232-5f86-4cfe-9221-dfc6618de3dc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:24.671662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afc19232-5f86-4cfe-9221-dfc6618de3dc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:24.672441 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afc19232-5f86-4cfe-9221-dfc6618de3dc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:24.672895 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-afc19232-5f86-4cfe-9221-dfc6618de3dc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:24.806425 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-afc19232-5f86-4cfe-9221-dfc6618de3dc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:24.814783 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-afc19232-5f86-4cfe-9221-dfc6618de3dc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1683 microversion: 2.1 time: 0.160730 Jul 25 13:32:24.815371 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3192/6454] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:24 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:25.840367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5034cb3c-f0a9-4ab2-8a1b-f264b348c4b2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:25.841064 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5034cb3c-f0a9-4ab2-8a1b-f264b348c4b2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:25.849957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5034cb3c-f0a9-4ab2-8a1b-f264b348c4b2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:25.850492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5034cb3c-f0a9-4ab2-8a1b-f264b348c4b2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:25.851381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5034cb3c-f0a9-4ab2-8a1b-f264b348c4b2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:25.851895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5034cb3c-f0a9-4ab2-8a1b-f264b348c4b2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:25.988360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5034cb3c-f0a9-4ab2-8a1b-f264b348c4b2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:25.999955 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5034cb3c-f0a9-4ab2-8a1b-f264b348c4b2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1683 microversion: 2.1 time: 0.165799 Jul 25 13:32:26.000755 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3263/6455] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:25 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:27.028972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4cdace52-845e-40b5-9996-5e52b47e7125 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:27.029611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4cdace52-845e-40b5-9996-5e52b47e7125 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:27.037275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4cdace52-845e-40b5-9996-5e52b47e7125 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:27.037743 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4cdace52-845e-40b5-9996-5e52b47e7125 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:27.038557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4cdace52-845e-40b5-9996-5e52b47e7125 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:27.039000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4cdace52-845e-40b5-9996-5e52b47e7125 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:27.176485 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4cdace52-845e-40b5-9996-5e52b47e7125 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:27.184570 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4cdace52-845e-40b5-9996-5e52b47e7125 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1683 microversion: 2.1 time: 0.161151 Jul 25 13:32:27.185144 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3193/6456] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:27 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:28.209796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4ed456c0-4e84-4cb9-9582-dd4f69d57da4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:28.210845 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4ed456c0-4e84-4cb9-9582-dd4f69d57da4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:28.222559 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4ed456c0-4e84-4cb9-9582-dd4f69d57da4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:28.223301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4ed456c0-4e84-4cb9-9582-dd4f69d57da4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:28.224558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4ed456c0-4e84-4cb9-9582-dd4f69d57da4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:28.225278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4ed456c0-4e84-4cb9-9582-dd4f69d57da4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:28.361473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4ed456c0-4e84-4cb9-9582-dd4f69d57da4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:28.369246 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4ed456c0-4e84-4cb9-9582-dd4f69d57da4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1683 microversion: 2.1 time: 0.166027 Jul 25 13:32:28.369850 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3264/6457] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:28 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:29.394700 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-854b14fd-305d-4c62-a4ba-5089c1621d21 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:29.395792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-854b14fd-305d-4c62-a4ba-5089c1621d21 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:29.405481 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-854b14fd-305d-4c62-a4ba-5089c1621d21 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:29.405977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-854b14fd-305d-4c62-a4ba-5089c1621d21 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:29.406764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-854b14fd-305d-4c62-a4ba-5089c1621d21 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:29.407218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-854b14fd-305d-4c62-a4ba-5089c1621d21 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:29.551744 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-854b14fd-305d-4c62-a4ba-5089c1621d21 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:29.560083 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-854b14fd-305d-4c62-a4ba-5089c1621d21 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1683 microversion: 2.1 time: 0.172138 Jul 25 13:32:29.560683 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3194/6458] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:29 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:30.584627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b5715ec8-c95f-4855-9480-56f2d12b66ed tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:30.585600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b5715ec8-c95f-4855-9480-56f2d12b66ed tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:30.597154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5715ec8-c95f-4855-9480-56f2d12b66ed tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:30.597925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5715ec8-c95f-4855-9480-56f2d12b66ed tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:30.599199 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5715ec8-c95f-4855-9480-56f2d12b66ed tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:30.599864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b5715ec8-c95f-4855-9480-56f2d12b66ed tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:30.738520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b5715ec8-c95f-4855-9480-56f2d12b66ed tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:30.750508 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b5715ec8-c95f-4855-9480-56f2d12b66ed tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1683 microversion: 2.1 time: 0.172042 Jul 25 13:32:30.751262 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3265/6459] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:30 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:31.776365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b4575fa9-795a-4b13-87cd-6e8085a21a54 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:31.777365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b4575fa9-795a-4b13-87cd-6e8085a21a54 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:31.785854 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4575fa9-795a-4b13-87cd-6e8085a21a54 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:31.786362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4575fa9-795a-4b13-87cd-6e8085a21a54 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:31.787235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4575fa9-795a-4b13-87cd-6e8085a21a54 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:31.787742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b4575fa9-795a-4b13-87cd-6e8085a21a54 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:31.924614 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b4575fa9-795a-4b13-87cd-6e8085a21a54 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:31.936845 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b4575fa9-795a-4b13-87cd-6e8085a21a54 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1683 microversion: 2.1 time: 0.167008 Jul 25 13:32:31.937736 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3195/6460] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:31 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:32.958952 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3fd4bb6f-c6dd-4d87-a2e6-9443144c7f9c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:32.959556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3fd4bb6f-c6dd-4d87-a2e6-9443144c7f9c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:32.967609 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3fd4bb6f-c6dd-4d87-a2e6-9443144c7f9c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:32.968063 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3fd4bb6f-c6dd-4d87-a2e6-9443144c7f9c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:32.968831 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3fd4bb6f-c6dd-4d87-a2e6-9443144c7f9c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:32.969272 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3fd4bb6f-c6dd-4d87-a2e6-9443144c7f9c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:33.102811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3fd4bb6f-c6dd-4d87-a2e6-9443144c7f9c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:33.111104 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3fd4bb6f-c6dd-4d87-a2e6-9443144c7f9c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1683 microversion: 2.1 time: 0.156095 Jul 25 13:32:33.111686 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3266/6461] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:32 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:34.138841 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-caa01788-1239-4b9f-8ef4-c0a9e7a0f401 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:34.139521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-caa01788-1239-4b9f-8ef4-c0a9e7a0f401 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:34.147080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-caa01788-1239-4b9f-8ef4-c0a9e7a0f401 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:34.147558 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-caa01788-1239-4b9f-8ef4-c0a9e7a0f401 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:34.148350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-caa01788-1239-4b9f-8ef4-c0a9e7a0f401 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:34.148806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-caa01788-1239-4b9f-8ef4-c0a9e7a0f401 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:34.289722 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-caa01788-1239-4b9f-8ef4-c0a9e7a0f401 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:34.297861 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-caa01788-1239-4b9f-8ef4-c0a9e7a0f401 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1683 microversion: 2.1 time: 0.164163 Jul 25 13:32:34.298486 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3196/6462] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:34 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:35.323480 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-283dce23-9839-4d41-8d9b-845cd9c53a27 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:35.324400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-283dce23-9839-4d41-8d9b-845cd9c53a27 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:35.335949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-283dce23-9839-4d41-8d9b-845cd9c53a27 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:35.336704 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-283dce23-9839-4d41-8d9b-845cd9c53a27 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:35.338026 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-283dce23-9839-4d41-8d9b-845cd9c53a27 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:35.338763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-283dce23-9839-4d41-8d9b-845cd9c53a27 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:35.479504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-283dce23-9839-4d41-8d9b-845cd9c53a27 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:35.487856 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-283dce23-9839-4d41-8d9b-845cd9c53a27 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1683 microversion: 2.1 time: 0.171148 Jul 25 13:32:35.488447 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3267/6463] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:35 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:36.416290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-5628493d-9356-4dd4-95b1-03d8a71d2dc9 req-a5163edf-784b-4676-aced-ff547f9aff81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13a8f09-73e9-48b6-8e92-1949b4004ecf", "name": "network-vif-unplugged", "status": "completed", "tag": "b29ad078-a121-4289-9538-1e57ef763be3"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:32:36.430387 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-5628493d-9356-4dd4-95b1-03d8a71d2dc9 req-a5163edf-784b-4676-aced-ff547f9aff81 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:36.430868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-5628493d-9356-4dd4-95b1-03d8a71d2dc9 req-a5163edf-784b-4676-aced-ff547f9aff81 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:36.443246 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-5628493d-9356-4dd4-95b1-03d8a71d2dc9 req-a5163edf-784b-4676-aced-ff547f9aff81 service nova] Creating event network-vif-unplugged:b29ad078-a121-4289-9538-1e57ef763be3 for instance e13a8f09-73e9-48b6-8e92-1949b4004ecf on n-h2-848886-15 Jul 25 13:32:36.448966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [req-5628493d-9356-4dd4-95b1-03d8a71d2dc9 req-a5163edf-784b-4676-aced-ff547f9aff81 service nova] Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125883) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:32:36.461400 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-5628493d-9356-4dd4-95b1-03d8a71d2dc9 req-a5163edf-784b-4676-aced-ff547f9aff81 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049840 Jul 25 13:32:36.462241 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3197/6464] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:32:36.509322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dd6da262-a486-46f2-95a5-7d287884c1f1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:36.510122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dd6da262-a486-46f2-95a5-7d287884c1f1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:36.517641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd6da262-a486-46f2-95a5-7d287884c1f1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:36.518105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd6da262-a486-46f2-95a5-7d287884c1f1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:36.519017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd6da262-a486-46f2-95a5-7d287884c1f1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:36.519328 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dd6da262-a486-46f2-95a5-7d287884c1f1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:36.752211 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dd6da262-a486-46f2-95a5-7d287884c1f1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:36.760297 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dd6da262-a486-46f2-95a5-7d287884c1f1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1682 microversion: 2.1 time: 0.255043 Jul 25 13:32:36.760919 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3268/6465] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:36 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1682 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:37.786993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8fbb0a5c-edf8-455f-b56a-8a554377b4f4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:37.788052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8fbb0a5c-edf8-455f-b56a-8a554377b4f4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:37.799772 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8fbb0a5c-edf8-455f-b56a-8a554377b4f4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:37.800553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8fbb0a5c-edf8-455f-b56a-8a554377b4f4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:37.801879 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8fbb0a5c-edf8-455f-b56a-8a554377b4f4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:37.802643 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8fbb0a5c-edf8-455f-b56a-8a554377b4f4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:37.940570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8fbb0a5c-edf8-455f-b56a-8a554377b4f4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:37.948700 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8fbb0a5c-edf8-455f-b56a-8a554377b4f4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1680 microversion: 2.1 time: 0.169076 Jul 25 13:32:37.949332 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3198/6466] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:37 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:38.482291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-6c431823-c0cd-4e77-8478-4df7b7b165bd req-15e26347-df6e-46d5-9335-ebde6e962f34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13a8f09-73e9-48b6-8e92-1949b4004ecf", "tag": "b29ad078-a121-4289-9538-1e57ef763be3"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:32:38.498407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6c431823-c0cd-4e77-8478-4df7b7b165bd req-15e26347-df6e-46d5-9335-ebde6e962f34 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:38.498856 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6c431823-c0cd-4e77-8478-4df7b7b165bd req-15e26347-df6e-46d5-9335-ebde6e962f34 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:38.511256 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-6c431823-c0cd-4e77-8478-4df7b7b165bd req-15e26347-df6e-46d5-9335-ebde6e962f34 service nova] Creating event network-changed:b29ad078-a121-4289-9538-1e57ef763be3 for instance e13a8f09-73e9-48b6-8e92-1949b4004ecf on n-h2-848886-15 Jul 25 13:32:38.517005 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [req-6c431823-c0cd-4e77-8478-4df7b7b165bd req-15e26347-df6e-46d5-9335-ebde6e962f34 service nova] Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:32:38.528012 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-6c431823-c0cd-4e77-8478-4df7b7b165bd req-15e26347-df6e-46d5-9335-ebde6e962f34 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050702 Jul 25 13:32:38.528600 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3269/6467] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:32:38.970824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2170e268-9344-4612-b084-52067a7e7307 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:38.971456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2170e268-9344-4612-b084-52067a7e7307 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:38.978613 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2170e268-9344-4612-b084-52067a7e7307 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:38.979080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2170e268-9344-4612-b084-52067a7e7307 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:38.980075 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2170e268-9344-4612-b084-52067a7e7307 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:38.980824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2170e268-9344-4612-b084-52067a7e7307 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:39.289869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2170e268-9344-4612-b084-52067a7e7307 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:39.298447 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2170e268-9344-4612-b084-52067a7e7307 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1680 microversion: 2.1 time: 0.331761 Jul 25 13:32:39.299045 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3199/6468] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:38 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1680 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:40.325486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-84522c8d-94d2-4028-bafa-a21d08bbafc9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:40.326180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-84522c8d-94d2-4028-bafa-a21d08bbafc9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:40.333503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84522c8d-94d2-4028-bafa-a21d08bbafc9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:40.334057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84522c8d-94d2-4028-bafa-a21d08bbafc9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:40.334908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84522c8d-94d2-4028-bafa-a21d08bbafc9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:40.335394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-84522c8d-94d2-4028-bafa-a21d08bbafc9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:40.477514 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-84522c8d-94d2-4028-bafa-a21d08bbafc9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:40.485709 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-84522c8d-94d2-4028-bafa-a21d08bbafc9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1677 microversion: 2.1 time: 0.168304 Jul 25 13:32:40.486330 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3270/6469] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:40 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:40.506573 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1c28f175-917b-4788-b2a5-7d6ae8f23013 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:32:40.507140 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1c28f175-917b-4788-b2a5-7d6ae8f23013 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:40.514584 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1c28f175-917b-4788-b2a5-7d6ae8f23013 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:40.515312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1c28f175-917b-4788-b2a5-7d6ae8f23013 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:40.516138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1c28f175-917b-4788-b2a5-7d6ae8f23013 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:40.516589 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1c28f175-917b-4788-b2a5-7d6ae8f23013 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:40.577252 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1c28f175-917b-4788-b2a5-7d6ae8f23013 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "POST /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf/action" status: 204 len: 0 microversion: 2.1 time: 0.074228 Jul 25 13:32:40.577428 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3200/6470] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:32:40 2022] POST /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:32:40.586698 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-35fae915-c623-42b3-a677-36de8cd7ba5c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:40.587642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-35fae915-c623-42b3-a677-36de8cd7ba5c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:40.594764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-35fae915-c623-42b3-a677-36de8cd7ba5c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:40.595485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-35fae915-c623-42b3-a677-36de8cd7ba5c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:40.596405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-35fae915-c623-42b3-a677-36de8cd7ba5c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:40.596862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-35fae915-c623-42b3-a677-36de8cd7ba5c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:40.801677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-35fae915-c623-42b3-a677-36de8cd7ba5c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:40.810392 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-35fae915-c623-42b3-a677-36de8cd7ba5c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1677 microversion: 2.1 time: 0.228398 Jul 25 13:32:40.810945 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3271/6471] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:40 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1677 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:41.834555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2b5285ee-9a08-4750-a17c-94ae01306b88 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:41.835426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2b5285ee-9a08-4750-a17c-94ae01306b88 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:41.842760 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b5285ee-9a08-4750-a17c-94ae01306b88 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:41.843318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b5285ee-9a08-4750-a17c-94ae01306b88 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:41.844366 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b5285ee-9a08-4750-a17c-94ae01306b88 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:41.844838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2b5285ee-9a08-4750-a17c-94ae01306b88 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:41.988175 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2b5285ee-9a08-4750-a17c-94ae01306b88 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:41.996031 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2b5285ee-9a08-4750-a17c-94ae01306b88 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1669 microversion: 2.1 time: 0.166899 Jul 25 13:32:41.996658 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3201/6472] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:41 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1669 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:42.017572 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-36cf217f-d94e-4ed7-b721-15fa564af313 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:42.018255 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-36cf217f-d94e-4ed7-b721-15fa564af313 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:42.025430 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36cf217f-d94e-4ed7-b721-15fa564af313 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:42.025879 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36cf217f-d94e-4ed7-b721-15fa564af313 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:42.026677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36cf217f-d94e-4ed7-b721-15fa564af313 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:42.027112 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-36cf217f-d94e-4ed7-b721-15fa564af313 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:42.164323 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-36cf217f-d94e-4ed7-b721-15fa564af313 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:42.172306 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-36cf217f-d94e-4ed7-b721-15fa564af313 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1669 microversion: 2.1 time: 0.158688 Jul 25 13:32:42.172919 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3272/6473] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:42 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:42.192594 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-49198c4d-5ba8-4981-abf0-ee18cc4cf718 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:42.193233 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-49198c4d-5ba8-4981-abf0-ee18cc4cf718 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:42.203440 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-49198c4d-5ba8-4981-abf0-ee18cc4cf718 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:42.204020 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-49198c4d-5ba8-4981-abf0-ee18cc4cf718 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:42.205288 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-49198c4d-5ba8-4981-abf0-ee18cc4cf718 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:42.205996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-49198c4d-5ba8-4981-abf0-ee18cc4cf718 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:42.346629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-49198c4d-5ba8-4981-abf0-ee18cc4cf718 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:42.355163 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-49198c4d-5ba8-4981-abf0-ee18cc4cf718 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1669 microversion: 2.1 time: 0.166549 Jul 25 13:32:42.355830 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3202/6474] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:42 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1669 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:42.375994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fc283e25-08c2-4a58-9fb3-8a9cc08e5a7a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:42.376506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fc283e25-08c2-4a58-9fb3-8a9cc08e5a7a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:42.382844 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc283e25-08c2-4a58-9fb3-8a9cc08e5a7a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:42.383301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc283e25-08c2-4a58-9fb3-8a9cc08e5a7a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:42.384065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc283e25-08c2-4a58-9fb3-8a9cc08e5a7a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:42.384507 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc283e25-08c2-4a58-9fb3-8a9cc08e5a7a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:42.410816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fc283e25-08c2-4a58-9fb3-8a9cc08e5a7a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:32:42.465347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:32:42.497993 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fc283e25-08c2-4a58-9fb3-8a9cc08e5a7a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 204 len: 0 microversion: 2.1 time: 0.125546 Jul 25 13:32:42.498959 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3273/6475] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:32:42 2022] DELETE /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:32:42.507121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-71d84504-ac27-45da-9e25-6965b97414f2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:42.507749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-71d84504-ac27-45da-9e25-6965b97414f2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:42.514590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-71d84504-ac27-45da-9e25-6965b97414f2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:42.515118 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-71d84504-ac27-45da-9e25-6965b97414f2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:42.515970 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-71d84504-ac27-45da-9e25-6965b97414f2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:42.516470 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-71d84504-ac27-45da-9e25-6965b97414f2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:42.625176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-dc26d815-f833-45c3-958f-0c8aff6de2c6 req-8671cc33-c3d5-49a6-8dcb-692eea3481b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13a8f09-73e9-48b6-8e92-1949b4004ecf", "name": "network-vif-plugged", "status": "completed", "tag": "b29ad078-a121-4289-9538-1e57ef763be3"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:32:42.636179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-dc26d815-f833-45c3-958f-0c8aff6de2c6 req-8671cc33-c3d5-49a6-8dcb-692eea3481b6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:42.636667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-dc26d815-f833-45c3-958f-0c8aff6de2c6 req-8671cc33-c3d5-49a6-8dcb-692eea3481b6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:42.649082 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-dc26d815-f833-45c3-958f-0c8aff6de2c6 req-8671cc33-c3d5-49a6-8dcb-692eea3481b6 service nova] Creating event network-vif-plugged:b29ad078-a121-4289-9538-1e57ef763be3 for instance e13a8f09-73e9-48b6-8e92-1949b4004ecf on n-h2-848886-15 Jul 25 13:32:42.654097 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-dc26d815-f833-45c3-958f-0c8aff6de2c6 req-8671cc33-c3d5-49a6-8dcb-692eea3481b6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033023 Jul 25 13:32:42.654695 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3274/6476] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:32:42.668393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-71d84504-ac27-45da-9e25-6965b97414f2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:42.676211 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-71d84504-ac27-45da-9e25-6965b97414f2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1675 microversion: 2.1 time: 0.172980 Jul 25 13:32:42.676795 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3203/6477] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:42 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:43.698458 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b13970f6-ef59-4440-9e45-3c96b0aa3de2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:43.699129 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b13970f6-ef59-4440-9e45-3c96b0aa3de2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:43.705810 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b13970f6-ef59-4440-9e45-3c96b0aa3de2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:43.706293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b13970f6-ef59-4440-9e45-3c96b0aa3de2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:43.707065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b13970f6-ef59-4440-9e45-3c96b0aa3de2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:43.707506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b13970f6-ef59-4440-9e45-3c96b0aa3de2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:43.876184 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b13970f6-ef59-4440-9e45-3c96b0aa3de2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:43.885019 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b13970f6-ef59-4440-9e45-3c96b0aa3de2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1675 microversion: 2.1 time: 0.191881 Jul 25 13:32:43.885635 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3275/6478] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:43 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1675 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:44.907156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f8327f91-9ef1-4036-aee7-3eb2a9a9f3bc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:44.907773 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f8327f91-9ef1-4036-aee7-3eb2a9a9f3bc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:44.915061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8327f91-9ef1-4036-aee7-3eb2a9a9f3bc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:44.915498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8327f91-9ef1-4036-aee7-3eb2a9a9f3bc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:44.916648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8327f91-9ef1-4036-aee7-3eb2a9a9f3bc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:44.917312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8327f91-9ef1-4036-aee7-3eb2a9a9f3bc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:44.979183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-1809fb6d-bc6c-405f-90f5-dd0a5e90def6 req-628721b1-a844-4420-b60a-f64e449dd366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13a8f09-73e9-48b6-8e92-1949b4004ecf", "name": "network-vif-deleted", "tag": "b29ad078-a121-4289-9538-1e57ef763be3"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:32:44.993925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-1809fb6d-bc6c-405f-90f5-dd0a5e90def6 req-628721b1-a844-4420-b60a-f64e449dd366 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:44.994963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-1809fb6d-bc6c-405f-90f5-dd0a5e90def6 req-628721b1-a844-4420-b60a-f64e449dd366 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:45.007719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f8327f91-9ef1-4036-aee7-3eb2a9a9f3bc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:45.010065 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-1809fb6d-bc6c-405f-90f5-dd0a5e90def6 req-628721b1-a844-4420-b60a-f64e449dd366 service nova] Creating event network-vif-deleted:b29ad078-a121-4289-9538-1e57ef763be3 for instance e13a8f09-73e9-48b6-8e92-1949b4004ecf on n-h2-848886-15 Jul 25 13:32:45.013170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:32:45.016770 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-1809fb6d-bc6c-405f-90f5-dd0a5e90def6 req-628721b1-a844-4420-b60a-f64e449dd366 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043109 Jul 25 13:32:45.018067 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3276/6479] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:32:45.022777 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f8327f91-9ef1-4036-aee7-3eb2a9a9f3bc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 200 len: 1608 microversion: 2.1 time: 0.119620 Jul 25 13:32:45.023677 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3204/6480] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:44 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 1608 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:46.045055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a8218bf9-4908-4074-b3a9-c4cf577f1dec tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:46.045801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a8218bf9-4908-4074-b3a9-c4cf577f1dec tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:46.053505 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a8218bf9-4908-4074-b3a9-c4cf577f1dec tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:46.054010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a8218bf9-4908-4074-b3a9-c4cf577f1dec tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:46.054798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a8218bf9-4908-4074-b3a9-c4cf577f1dec tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:46.055218 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a8218bf9-4908-4074-b3a9-c4cf577f1dec tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:46.069999 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-a8218bf9-4908-4074-b3a9-c4cf577f1dec tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] HTTP exception thrown: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a8218bf9-4908-4074-b3a9-c4cf577f1dec tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Request method failure captured: Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf HTTP/1.1 Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3ps2uAMwWcs8JWVJ4Y1EH4DEH-xcoDZUXcQ2SMYQDuHJ6xKZtzlY3crBbh33knI4BRq4-7REpa8QxZBYFHDFdQ0jv_t5oHli9ALSiUgThfzEZ87ovY8e2_XTSuFqSPJM6fPlLXFDiUl-NS1IB6R5YsiH4-NrInN3mZHwxCC9W0hJaI8 Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c79a68ef003f4f3faf0a2d4551c6d5ee", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}] Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 269643d1d0eb465ea092599c11480b71 Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'e13a8f09-73e9-48b6-8e92-1949b4004ecf'} Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:32:46.071617 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:32:46.080174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:32:46.080174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:32:46.080174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:32:46.080174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:32:46.080174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:32:46.080174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. Jul 25 13:32:46.080174 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:32:46.080174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a8218bf9-4908-4074-b3a9-c4cf577f1dec tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Returning 404 to user: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:32:46.080174 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a8218bf9-4908-4074-b3a9-c4cf577f1dec tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 404 len: 111 microversion: 2.1 time: 0.032417 Jul 25 13:32:46.080174 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3277/6481] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:46 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:32:46.090833 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2a705dfe-7795-4570-999d-6e1eeea5a994 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:46.092148 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2a705dfe-7795-4570-999d-6e1eeea5a994 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:46.100143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2a705dfe-7795-4570-999d-6e1eeea5a994 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:46.100707 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2a705dfe-7795-4570-999d-6e1eeea5a994 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:46.101473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2a705dfe-7795-4570-999d-6e1eeea5a994 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:46.102128 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2a705dfe-7795-4570-999d-6e1eeea5a994 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:46.118057 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-2a705dfe-7795-4570-999d-6e1eeea5a994 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] HTTP exception thrown: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2a705dfe-7795-4570-999d-6e1eeea5a994 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Request method failure captured: Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf HTTP/1.1 Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3ps2uAMwWcs8JWVJ4Y1EH4DEH-xcoDZUXcQ2SMYQDuHJ6xKZtzlY3crBbh33knI4BRq4-7REpa8QxZBYFHDFdQ0jv_t5oHli9ALSiUgThfzEZ87ovY8e2_XTSuFqSPJM6fPlLXFDiUl-NS1IB6R5YsiH4-NrInN3mZHwxCC9W0hJaI8 Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c79a68ef003f4f3faf0a2d4551c6d5ee", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}] Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 269643d1d0eb465ea092599c11480b71 Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'e13a8f09-73e9-48b6-8e92-1949b4004ecf'} Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:32:46.119838 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:32:46.125273 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:32:46.125273 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:32:46.125273 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:32:46.125273 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:32:46.125273 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:32:46.125273 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. Jul 25 13:32:46.125273 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:32:46.125273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2a705dfe-7795-4570-999d-6e1eeea5a994 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Returning 404 to user: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:32:46.125273 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2a705dfe-7795-4570-999d-6e1eeea5a994 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 404 len: 111 microversion: 2.1 time: 0.039411 Jul 25 13:32:46.126505 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3205/6482] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:46 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:32:46.172484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c5c0e229-5ebe-4e83-b1d3-1ede6d662a2b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1155593634", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "670c2cbc-4b35-45bb-8ba5-a59e7bb64759"}], "security_groups": [{"name": "tempest-securitygroup--395676127"}], "key_name": "tempest-keypair-1831216923", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:32:46.286161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-c5c0e229-5ebe-4e83-b1d3-1ede6d662a2b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] validate_networks() for [('670c2cbc-4b35-45bb-8ba5-a59e7bb64759', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:32:46.670547 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-c5c0e229-5ebe-4e83-b1d3-1ede6d662a2b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:32:46.670998 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-c5c0e229-5ebe-4e83-b1d3-1ede6d662a2b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:32:46.671469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-c5c0e229-5ebe-4e83-b1d3-1ede6d662a2b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:32:46.671875 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-c5c0e229-5ebe-4e83-b1d3-1ede6d662a2b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:32:46.672304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-c5c0e229-5ebe-4e83-b1d3-1ede6d662a2b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:32:46.681694 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5c0e229-5ebe-4e83-b1d3-1ede6d662a2b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:46.682831 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5c0e229-5ebe-4e83-b1d3-1ede6d662a2b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:46.683645 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5c0e229-5ebe-4e83-b1d3-1ede6d662a2b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:46.684483 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5c0e229-5ebe-4e83-b1d3-1ede6d662a2b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:46.702030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-c5c0e229-5ebe-4e83-b1d3-1ede6d662a2b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Getting quotas for project c79a68ef003f4f3faf0a2d4551c6d5ee. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:32:46.707508 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-c5c0e229-5ebe-4e83-b1d3-1ede6d662a2b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Getting quotas for user 269643d1d0eb465ea092599c11480b71 and project c79a68ef003f4f3faf0a2d4551c6d5ee. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:32:46.720689 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c5c0e229-5ebe-4e83-b1d3-1ede6d662a2b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:32:46.723007 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c5c0e229-5ebe-4e83-b1d3-1ede6d662a2b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:32:46.771906 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c5c0e229-5ebe-4e83-b1d3-1ede6d662a2b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.603466 Jul 25 13:32:46.772546 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3278/6483] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:32:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 13:32:46.783567 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c4886f7c-78db-4a1a-b6aa-e5f3ab9dca0f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:46.784194 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c4886f7c-78db-4a1a-b6aa-e5f3ab9dca0f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:46.836410 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c4886f7c-78db-4a1a-b6aa-e5f3ab9dca0f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:46.843786 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c4886f7c-78db-4a1a-b6aa-e5f3ab9dca0f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1239 microversion: 2.1 time: 0.064090 Jul 25 13:32:46.844371 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3206/6484] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:46 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1239 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:47.866142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8c75d287-93e2-47d6-9796-b8fb32757460 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:47.866817 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8c75d287-93e2-47d6-9796-b8fb32757460 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:47.874980 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c75d287-93e2-47d6-9796-b8fb32757460 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:47.875425 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c75d287-93e2-47d6-9796-b8fb32757460 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:47.876193 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c75d287-93e2-47d6-9796-b8fb32757460 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:47.876632 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c75d287-93e2-47d6-9796-b8fb32757460 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:47.949291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8c75d287-93e2-47d6-9796-b8fb32757460 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:47.959850 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8c75d287-93e2-47d6-9796-b8fb32757460 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1299 microversion: 2.1 time: 0.097725 Jul 25 13:32:47.960434 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3279/6485] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:47 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:48.982789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-09d2f080-5ba2-4dcc-b1fc-4269ee16454e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:48.983421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-09d2f080-5ba2-4dcc-b1fc-4269ee16454e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:48.991316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09d2f080-5ba2-4dcc-b1fc-4269ee16454e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:48.991778 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09d2f080-5ba2-4dcc-b1fc-4269ee16454e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:48.992554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09d2f080-5ba2-4dcc-b1fc-4269ee16454e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:48.993002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-09d2f080-5ba2-4dcc-b1fc-4269ee16454e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:49.220146 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-09d2f080-5ba2-4dcc-b1fc-4269ee16454e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:49.228611 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-09d2f080-5ba2-4dcc-b1fc-4269ee16454e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1364 microversion: 2.1 time: 0.249609 Jul 25 13:32:49.229225 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3207/6486] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:48 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1364 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:49.574335 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-c8745cfd-18dd-4dea-915d-82956080f781 req-f62cddaa-9212-492e-b8fd-33f24c13af6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d76d04c-a42c-4802-96ad-5e56d80f07f3", "tag": "a7c91f89-8f83-458b-bda8-ab64e791ff4d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:32:49.592388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c8745cfd-18dd-4dea-915d-82956080f781 req-f62cddaa-9212-492e-b8fd-33f24c13af6c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:49.593115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c8745cfd-18dd-4dea-915d-82956080f781 req-f62cddaa-9212-492e-b8fd-33f24c13af6c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:49.624774 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-c8745cfd-18dd-4dea-915d-82956080f781 req-f62cddaa-9212-492e-b8fd-33f24c13af6c service nova] Creating event network-changed:a7c91f89-8f83-458b-bda8-ab64e791ff4d for instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 on n-h2-848886-15 Jul 25 13:32:49.629926 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-c8745cfd-18dd-4dea-915d-82956080f781 req-f62cddaa-9212-492e-b8fd-33f24c13af6c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061385 Jul 25 13:32:49.630783 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3280/6487] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:32:50.255178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-55d2d80b-9005-4bb7-8925-99241e83b885 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:50.256062 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-55d2d80b-9005-4bb7-8925-99241e83b885 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:50.267454 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55d2d80b-9005-4bb7-8925-99241e83b885 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:50.268234 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55d2d80b-9005-4bb7-8925-99241e83b885 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:50.269515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55d2d80b-9005-4bb7-8925-99241e83b885 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:50.270326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55d2d80b-9005-4bb7-8925-99241e83b885 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:50.410122 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-55d2d80b-9005-4bb7-8925-99241e83b885 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:50.417975 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-55d2d80b-9005-4bb7-8925-99241e83b885 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1364 microversion: 2.1 time: 0.169530 Jul 25 13:32:50.418556 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3208/6488] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:50 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:51.445033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e9c5c3ce-1e8b-44ca-8f4d-7fd4d626a945 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:51.446158 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e9c5c3ce-1e8b-44ca-8f4d-7fd4d626a945 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:51.449171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:32:51.455371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9c5c3ce-1e8b-44ca-8f4d-7fd4d626a945 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:51.455824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9c5c3ce-1e8b-44ca-8f4d-7fd4d626a945 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:51.456601 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9c5c3ce-1e8b-44ca-8f4d-7fd4d626a945 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:51.457042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9c5c3ce-1e8b-44ca-8f4d-7fd4d626a945 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:51.591400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e9c5c3ce-1e8b-44ca-8f4d-7fd4d626a945 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:51.599575 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e9c5c3ce-1e8b-44ca-8f4d-7fd4d626a945 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1364 microversion: 2.1 time: 0.163349 Jul 25 13:32:51.600148 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3281/6489] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:51 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:52.621061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7f89b855-834f-442a-9282-1de0bf0c7123 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:52.621698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7f89b855-834f-442a-9282-1de0bf0c7123 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:52.625694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=43 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:32:52.629636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7f89b855-834f-442a-9282-1de0bf0c7123 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:52.630128 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7f89b855-834f-442a-9282-1de0bf0c7123 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:52.630917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7f89b855-834f-442a-9282-1de0bf0c7123 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:52.631368 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7f89b855-834f-442a-9282-1de0bf0c7123 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:52.769714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7f89b855-834f-442a-9282-1de0bf0c7123 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:52.777721 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7f89b855-834f-442a-9282-1de0bf0c7123 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1364 microversion: 2.1 time: 0.160778 Jul 25 13:32:52.778606 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3209/6490] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:52 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:53.799332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b6ec6f29-ac5b-4254-9371-062a454b36ef tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:53.799973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b6ec6f29-ac5b-4254-9371-062a454b36ef tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:53.807577 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6ec6f29-ac5b-4254-9371-062a454b36ef tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:53.808041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6ec6f29-ac5b-4254-9371-062a454b36ef tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:53.808826 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6ec6f29-ac5b-4254-9371-062a454b36ef tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:53.809264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6ec6f29-ac5b-4254-9371-062a454b36ef tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:53.951681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b6ec6f29-ac5b-4254-9371-062a454b36ef tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:53.959890 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b6ec6f29-ac5b-4254-9371-062a454b36ef tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1364 microversion: 2.1 time: 0.164620 Jul 25 13:32:53.960519 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3282/6491] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:53 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:54.696610 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-7e279d93-5324-437f-9b4e-f87e6e31ec1a req-f5877743-02b5-47b9-976b-facd7a478c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d76d04c-a42c-4802-96ad-5e56d80f07f3", "name": "network-vif-plugged", "status": "completed", "tag": "a7c91f89-8f83-458b-bda8-ab64e791ff4d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:32:54.708498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-7e279d93-5324-437f-9b4e-f87e6e31ec1a req-f5877743-02b5-47b9-976b-facd7a478c04 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:54.708951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-7e279d93-5324-437f-9b4e-f87e6e31ec1a req-f5877743-02b5-47b9-976b-facd7a478c04 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:54.720778 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-7e279d93-5324-437f-9b4e-f87e6e31ec1a req-f5877743-02b5-47b9-976b-facd7a478c04 service nova] Creating event network-vif-plugged:a7c91f89-8f83-458b-bda8-ab64e791ff4d for instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 on n-h2-848886-15 Jul 25 13:32:54.725980 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-7e279d93-5324-437f-9b4e-f87e6e31ec1a req-f5877743-02b5-47b9-976b-facd7a478c04 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033126 Jul 25 13:32:54.726867 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3210/6492] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:32:54.992611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-63d16fbd-1aba-40ce-b0d9-ed7e3c72bcb4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:54.993618 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-63d16fbd-1aba-40ce-b0d9-ed7e3c72bcb4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:55.002308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-63d16fbd-1aba-40ce-b0d9-ed7e3c72bcb4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:55.002757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-63d16fbd-1aba-40ce-b0d9-ed7e3c72bcb4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:55.003520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-63d16fbd-1aba-40ce-b0d9-ed7e3c72bcb4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:55.003956 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-63d16fbd-1aba-40ce-b0d9-ed7e3c72bcb4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:55.140341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-63d16fbd-1aba-40ce-b0d9-ed7e3c72bcb4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:55.148069 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-63d16fbd-1aba-40ce-b0d9-ed7e3c72bcb4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1364 microversion: 2.1 time: 0.162064 Jul 25 13:32:55.148653 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3283/6493] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:54 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:56.172901 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-941fb86e-5b8a-46ca-bdde-605ce6a2b17c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:56.173616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-941fb86e-5b8a-46ca-bdde-605ce6a2b17c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:56.180615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-941fb86e-5b8a-46ca-bdde-605ce6a2b17c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:56.181081 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-941fb86e-5b8a-46ca-bdde-605ce6a2b17c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:56.181880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-941fb86e-5b8a-46ca-bdde-605ce6a2b17c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:56.182345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-941fb86e-5b8a-46ca-bdde-605ce6a2b17c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:56.318413 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-941fb86e-5b8a-46ca-bdde-605ce6a2b17c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:32:56.326086 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-941fb86e-5b8a-46ca-bdde-605ce6a2b17c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1550 microversion: 2.1 time: 0.159428 Jul 25 13:32:56.326635 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3211/6494] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:32:56 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1550 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:32:56.347921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-19f822d4-4af1-43f8-9050-c68ee54d8607 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:32:56.348468 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-19f822d4-4af1-43f8-9050-c68ee54d8607 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:32:56.355659 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-19f822d4-4af1-43f8-9050-c68ee54d8607 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:56.356114 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-19f822d4-4af1-43f8-9050-c68ee54d8607 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:56.356879 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-19f822d4-4af1-43f8-9050-c68ee54d8607 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:56.357310 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-19f822d4-4af1-43f8-9050-c68ee54d8607 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:56.439203 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-19f822d4-4af1-43f8-9050-c68ee54d8607 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094908 Jul 25 13:32:56.440053 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3284/6495] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 13:32:56 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:32:57.398015 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:32:57.482543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-1028f6d6-337d-4794-bad5-9c2322c2a396 req-4df3f405-7150-4366-bc01-16729ff55ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d76d04c-a42c-4802-96ad-5e56d80f07f3", "tag": "a7c91f89-8f83-458b-bda8-ab64e791ff4d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:32:57.492605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-1028f6d6-337d-4794-bad5-9c2322c2a396 req-4df3f405-7150-4366-bc01-16729ff55ac3 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:32:57.493064 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-1028f6d6-337d-4794-bad5-9c2322c2a396 req-4df3f405-7150-4366-bc01-16729ff55ac3 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:32:57.505343 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-1028f6d6-337d-4794-bad5-9c2322c2a396 req-4df3f405-7150-4366-bc01-16729ff55ac3 service nova] Creating event network-changed:a7c91f89-8f83-458b-bda8-ab64e791ff4d for instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 on n-h2-848886-15 Jul 25 13:32:57.512392 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-1028f6d6-337d-4794-bad5-9c2322c2a396 req-4df3f405-7150-4366-bc01-16729ff55ac3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118868 Jul 25 13:32:57.513316 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3212/6496] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:32:57.961804 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:32:57.962082 n-d-848886-15 devstack@n-api.service[125883]: Mon Jul 25 13:32:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:33:27.717253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:33:27.718079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:33:27.719782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=7 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:33:27.720559 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=44 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:33:27.724608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ea9426b1-a048-47a9-91d2-8cca2be68403 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:33:27.733004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea9426b1-a048-47a9-91d2-8cca2be68403 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:27.733455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea9426b1-a048-47a9-91d2-8cca2be68403 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:27.759764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ea9426b1-a048-47a9-91d2-8cca2be68403 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Going to try to stop instance {{(pid=125884) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 13:33:27.808958 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ea9426b1-a048-47a9-91d2-8cca2be68403 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "POST /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3/action" status: 202 len: 0 microversion: 2.1 time: 0.092448 Jul 25 13:33:27.809609 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3285/6497] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:33:27 2022] POST /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:33:27.817153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=7 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:33:27.818334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=31 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:33:27.823733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-87ef41ea-a380-4ce7-aff1-e3e50997448a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:27.824489 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-87ef41ea-a380-4ce7-aff1-e3e50997448a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:27.836434 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87ef41ea-a380-4ce7-aff1-e3e50997448a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:27.836923 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87ef41ea-a380-4ce7-aff1-e3e50997448a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:27.837742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87ef41ea-a380-4ce7-aff1-e3e50997448a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:27.838222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-87ef41ea-a380-4ce7-aff1-e3e50997448a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:27.981082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-87ef41ea-a380-4ce7-aff1-e3e50997448a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:27.989436 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-87ef41ea-a380-4ce7-aff1-e3e50997448a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1679 microversion: 2.1 time: 0.174547 Jul 25 13:33:27.990083 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3213/6498] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:27 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:29.013443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6ecd5e13-d5a9-403f-ab9e-2137edaefd41 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:29.014243 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6ecd5e13-d5a9-403f-ab9e-2137edaefd41 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:29.021238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ecd5e13-d5a9-403f-ab9e-2137edaefd41 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:29.021691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ecd5e13-d5a9-403f-ab9e-2137edaefd41 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:29.022520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ecd5e13-d5a9-403f-ab9e-2137edaefd41 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:29.022967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6ecd5e13-d5a9-403f-ab9e-2137edaefd41 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:29.161399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6ecd5e13-d5a9-403f-ab9e-2137edaefd41 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:29.169778 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6ecd5e13-d5a9-403f-ab9e-2137edaefd41 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1679 microversion: 2.1 time: 0.161660 Jul 25 13:33:29.170395 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3286/6499] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:29 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:30.193863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-941ef2fb-f6d6-428a-b9ad-e1e4e11e8c88 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:30.194513 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-941ef2fb-f6d6-428a-b9ad-e1e4e11e8c88 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:30.204172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-941ef2fb-f6d6-428a-b9ad-e1e4e11e8c88 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:30.204772 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-941ef2fb-f6d6-428a-b9ad-e1e4e11e8c88 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:30.205612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-941ef2fb-f6d6-428a-b9ad-e1e4e11e8c88 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:30.206139 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-941ef2fb-f6d6-428a-b9ad-e1e4e11e8c88 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:30.423965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-941ef2fb-f6d6-428a-b9ad-e1e4e11e8c88 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:30.433132 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-941ef2fb-f6d6-428a-b9ad-e1e4e11e8c88 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1679 microversion: 2.1 time: 0.245230 Jul 25 13:33:30.434064 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3214/6500] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:30 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1679 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:31.455846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-906e05f1-09e3-47d9-b5b6-0b5ad3dc3f39 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:31.456494 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-906e05f1-09e3-47d9-b5b6-0b5ad3dc3f39 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:31.464015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-906e05f1-09e3-47d9-b5b6-0b5ad3dc3f39 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:31.464464 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-906e05f1-09e3-47d9-b5b6-0b5ad3dc3f39 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:31.465377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-906e05f1-09e3-47d9-b5b6-0b5ad3dc3f39 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:31.465816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-906e05f1-09e3-47d9-b5b6-0b5ad3dc3f39 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:31.675336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-906e05f1-09e3-47d9-b5b6-0b5ad3dc3f39 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:31.685300 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-906e05f1-09e3-47d9-b5b6-0b5ad3dc3f39 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1679 microversion: 2.1 time: 0.233388 Jul 25 13:33:31.686100 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3287/6501] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:31 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1679 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:32.714673 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9a4ffe30-bc85-4d43-bd4e-4ef6c6b9100b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:32.715309 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9a4ffe30-bc85-4d43-bd4e-4ef6c6b9100b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:32.722799 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a4ffe30-bc85-4d43-bd4e-4ef6c6b9100b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:32.723800 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a4ffe30-bc85-4d43-bd4e-4ef6c6b9100b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:32.724763 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a4ffe30-bc85-4d43-bd4e-4ef6c6b9100b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:32.725214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9a4ffe30-bc85-4d43-bd4e-4ef6c6b9100b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:32.864365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9a4ffe30-bc85-4d43-bd4e-4ef6c6b9100b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:32.872530 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9a4ffe30-bc85-4d43-bd4e-4ef6c6b9100b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1679 microversion: 2.1 time: 0.162003 Jul 25 13:33:32.873109 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3215/6502] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:32 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:33.894607 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-be5ab232-fdbe-458c-b9c8-02598e14c18c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:33.895284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-be5ab232-fdbe-458c-b9c8-02598e14c18c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:33.903521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be5ab232-fdbe-458c-b9c8-02598e14c18c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:33.903984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be5ab232-fdbe-458c-b9c8-02598e14c18c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:33.904785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be5ab232-fdbe-458c-b9c8-02598e14c18c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:33.905229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-be5ab232-fdbe-458c-b9c8-02598e14c18c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:34.067059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-be5ab232-fdbe-458c-b9c8-02598e14c18c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:34.075002 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-be5ab232-fdbe-458c-b9c8-02598e14c18c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1679 microversion: 2.1 time: 0.184528 Jul 25 13:33:34.075590 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3288/6503] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:33 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:35.099385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-da0a3a80-b03a-4060-b5fd-d293089fe25a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:35.100261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-da0a3a80-b03a-4060-b5fd-d293089fe25a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:35.109246 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da0a3a80-b03a-4060-b5fd-d293089fe25a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:35.109708 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da0a3a80-b03a-4060-b5fd-d293089fe25a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:35.110531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da0a3a80-b03a-4060-b5fd-d293089fe25a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:35.110998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da0a3a80-b03a-4060-b5fd-d293089fe25a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:35.260177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-da0a3a80-b03a-4060-b5fd-d293089fe25a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:35.268220 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-da0a3a80-b03a-4060-b5fd-d293089fe25a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1679 microversion: 2.1 time: 0.175323 Jul 25 13:33:35.268835 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3216/6504] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:35 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:36.289762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a88e3d55-ef1f-4d16-8678-cf367d9d5b24 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:36.290446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a88e3d55-ef1f-4d16-8678-cf367d9d5b24 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:36.297990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a88e3d55-ef1f-4d16-8678-cf367d9d5b24 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:36.298433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a88e3d55-ef1f-4d16-8678-cf367d9d5b24 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:36.299197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a88e3d55-ef1f-4d16-8678-cf367d9d5b24 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:36.299633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a88e3d55-ef1f-4d16-8678-cf367d9d5b24 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:36.439566 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a88e3d55-ef1f-4d16-8678-cf367d9d5b24 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:36.449853 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a88e3d55-ef1f-4d16-8678-cf367d9d5b24 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1679 microversion: 2.1 time: 0.163872 Jul 25 13:33:36.450464 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3289/6505] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:36 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:37.476200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6b030f2d-6981-4e73-a705-1283ca0c67af tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:37.477214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6b030f2d-6981-4e73-a705-1283ca0c67af tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:37.485378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b030f2d-6981-4e73-a705-1283ca0c67af tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:37.485860 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b030f2d-6981-4e73-a705-1283ca0c67af tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:37.486646 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b030f2d-6981-4e73-a705-1283ca0c67af tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:37.487130 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6b030f2d-6981-4e73-a705-1283ca0c67af tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:37.633595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6b030f2d-6981-4e73-a705-1283ca0c67af tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:37.641998 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6b030f2d-6981-4e73-a705-1283ca0c67af tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1679 microversion: 2.1 time: 0.172141 Jul 25 13:33:37.642613 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3217/6506] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:37 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:38.664912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3aa308d1-5a13-4be6-9dff-c6aa9064ab3d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:38.665559 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3aa308d1-5a13-4be6-9dff-c6aa9064ab3d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:38.673257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3aa308d1-5a13-4be6-9dff-c6aa9064ab3d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:38.673711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3aa308d1-5a13-4be6-9dff-c6aa9064ab3d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:38.674597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3aa308d1-5a13-4be6-9dff-c6aa9064ab3d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:38.675036 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3aa308d1-5a13-4be6-9dff-c6aa9064ab3d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:38.811366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3aa308d1-5a13-4be6-9dff-c6aa9064ab3d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:38.820114 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3aa308d1-5a13-4be6-9dff-c6aa9064ab3d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1656 microversion: 2.1 time: 0.159233 Jul 25 13:33:38.820697 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3290/6507] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:38 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1656 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:38.841330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d207d102-7934-4cde-b786-e50022ed07bf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:33:38.843727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d207d102-7934-4cde-b786-e50022ed07bf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:38.851052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d207d102-7934-4cde-b786-e50022ed07bf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:38.851515 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d207d102-7934-4cde-b786-e50022ed07bf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:38.852296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d207d102-7934-4cde-b786-e50022ed07bf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:38.852747 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d207d102-7934-4cde-b786-e50022ed07bf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:38.881715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d207d102-7934-4cde-b786-e50022ed07bf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:38.888367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d207d102-7934-4cde-b786-e50022ed07bf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Old instance type m1.heat2, new instance type m1.heat {{(pid=125883) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 13:33:38.894917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-d207d102-7934-4cde-b786-e50022ed07bf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:33:38.895357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-d207d102-7934-4cde-b786-e50022ed07bf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:33:38.895846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-d207d102-7934-4cde-b786-e50022ed07bf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:33:38.896271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-d207d102-7934-4cde-b786-e50022ed07bf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:33:38.896708 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-d207d102-7934-4cde-b786-e50022ed07bf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:33:38.966359 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d207d102-7934-4cde-b786-e50022ed07bf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "POST /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3/action" status: 202 len: 0 microversion: 2.1 time: 0.128927 Jul 25 13:33:38.967204 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3218/6508] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:33:38 2022] POST /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:33:38.975402 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-74cd5e7a-cdf4-4061-8bda-e6b7ce13a21e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:38.976096 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-74cd5e7a-cdf4-4061-8bda-e6b7ce13a21e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:38.982548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-74cd5e7a-cdf4-4061-8bda-e6b7ce13a21e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:38.982995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-74cd5e7a-cdf4-4061-8bda-e6b7ce13a21e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:38.983790 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-74cd5e7a-cdf4-4061-8bda-e6b7ce13a21e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:38.984229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-74cd5e7a-cdf4-4061-8bda-e6b7ce13a21e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:39.120816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-74cd5e7a-cdf4-4061-8bda-e6b7ce13a21e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:39.129128 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-74cd5e7a-cdf4-4061-8bda-e6b7ce13a21e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1679 microversion: 2.1 time: 0.157752 Jul 25 13:33:39.129712 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3291/6509] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:38 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:40.155034 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d98d9f79-4346-463d-847e-304449dc9d18 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:40.155662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d98d9f79-4346-463d-847e-304449dc9d18 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:40.162235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d98d9f79-4346-463d-847e-304449dc9d18 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:40.162706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d98d9f79-4346-463d-847e-304449dc9d18 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:40.163494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d98d9f79-4346-463d-847e-304449dc9d18 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:40.163948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d98d9f79-4346-463d-847e-304449dc9d18 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:40.311172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d98d9f79-4346-463d-847e-304449dc9d18 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:40.325020 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d98d9f79-4346-463d-847e-304449dc9d18 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1679 microversion: 2.1 time: 0.174358 Jul 25 13:33:40.325613 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3219/6510] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:40 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:41.348204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-997b1484-2ea0-43ba-b974-752a042bb2a1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:41.349169 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-997b1484-2ea0-43ba-b974-752a042bb2a1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:41.359910 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-997b1484-2ea0-43ba-b974-752a042bb2a1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:41.360535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-997b1484-2ea0-43ba-b974-752a042bb2a1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:41.361788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-997b1484-2ea0-43ba-b974-752a042bb2a1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:41.362406 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-997b1484-2ea0-43ba-b974-752a042bb2a1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:41.513216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-997b1484-2ea0-43ba-b974-752a042bb2a1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:41.522451 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-997b1484-2ea0-43ba-b974-752a042bb2a1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1679 microversion: 2.1 time: 0.179327 Jul 25 13:33:41.523056 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3292/6511] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:41 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:42.544281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a111e3a3-2c49-43fb-85c8-a8f1655d7f8d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:42.544865 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a111e3a3-2c49-43fb-85c8-a8f1655d7f8d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:42.552214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a111e3a3-2c49-43fb-85c8-a8f1655d7f8d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:42.552683 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a111e3a3-2c49-43fb-85c8-a8f1655d7f8d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:42.553471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a111e3a3-2c49-43fb-85c8-a8f1655d7f8d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:42.553958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a111e3a3-2c49-43fb-85c8-a8f1655d7f8d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:42.696340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a111e3a3-2c49-43fb-85c8-a8f1655d7f8d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:42.705024 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a111e3a3-2c49-43fb-85c8-a8f1655d7f8d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1684 microversion: 2.1 time: 0.164689 Jul 25 13:33:42.705636 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3220/6512] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:42 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:43.732800 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2f62d1c8-aca8-466b-9cdf-8d3faeaa51c3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:43.733587 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2f62d1c8-aca8-466b-9cdf-8d3faeaa51c3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:43.743218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f62d1c8-aca8-466b-9cdf-8d3faeaa51c3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:43.743760 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f62d1c8-aca8-466b-9cdf-8d3faeaa51c3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:43.744723 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f62d1c8-aca8-466b-9cdf-8d3faeaa51c3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:43.745295 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f62d1c8-aca8-466b-9cdf-8d3faeaa51c3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:43.834079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-6e236d70-0451-4d38-9e71-69b7a5eb65d8 req-db1fcf09-64c6-4ad0-aa4c-0c16a4c201e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d76d04c-a42c-4802-96ad-5e56d80f07f3", "name": "network-vif-unplugged", "status": "completed", "tag": "a7c91f89-8f83-458b-bda8-ab64e791ff4d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:33:43.846244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6e236d70-0451-4d38-9e71-69b7a5eb65d8 req-db1fcf09-64c6-4ad0-aa4c-0c16a4c201e4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:43.847000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6e236d70-0451-4d38-9e71-69b7a5eb65d8 req-db1fcf09-64c6-4ad0-aa4c-0c16a4c201e4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:43.861249 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-6e236d70-0451-4d38-9e71-69b7a5eb65d8 req-db1fcf09-64c6-4ad0-aa4c-0c16a4c201e4 service nova] Creating event network-vif-unplugged:a7c91f89-8f83-458b-bda8-ab64e791ff4d for instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 on n-h1-848886-15 Jul 25 13:33:43.868478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [req-6e236d70-0451-4d38-9e71-69b7a5eb65d8 req-db1fcf09-64c6-4ad0-aa4c-0c16a4c201e4 service nova] Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:33:43.880954 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-6e236d70-0451-4d38-9e71-69b7a5eb65d8 req-db1fcf09-64c6-4ad0-aa4c-0c16a4c201e4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154604 Jul 25 13:33:43.881616 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3293/6513] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:33:44.052473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2f62d1c8-aca8-466b-9cdf-8d3faeaa51c3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:44.060736 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2f62d1c8-aca8-466b-9cdf-8d3faeaa51c3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1683 microversion: 2.1 time: 0.331831 Jul 25 13:33:44.061426 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3221/6514] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:43 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1683 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:45.084143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-61d1af2e-8629-423b-866d-53ae37a517b9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:45.084850 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-61d1af2e-8629-423b-866d-53ae37a517b9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:45.091925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-61d1af2e-8629-423b-866d-53ae37a517b9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:45.092378 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-61d1af2e-8629-423b-866d-53ae37a517b9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:45.093147 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-61d1af2e-8629-423b-866d-53ae37a517b9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:45.093583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-61d1af2e-8629-423b-866d-53ae37a517b9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:45.243084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-61d1af2e-8629-423b-866d-53ae37a517b9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:45.251199 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-61d1af2e-8629-423b-866d-53ae37a517b9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1681 microversion: 2.1 time: 0.172267 Jul 25 13:33:45.251750 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3294/6515] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:45 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:45.904500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-2bd5ec88-2fae-4aaa-b508-0ea7146910fe req-724b09ad-3099-4c1d-b8b3-ff385b296edd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d76d04c-a42c-4802-96ad-5e56d80f07f3", "tag": "a7c91f89-8f83-458b-bda8-ab64e791ff4d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:33:45.917555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2bd5ec88-2fae-4aaa-b508-0ea7146910fe req-724b09ad-3099-4c1d-b8b3-ff385b296edd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:45.918587 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2bd5ec88-2fae-4aaa-b508-0ea7146910fe req-724b09ad-3099-4c1d-b8b3-ff385b296edd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:45.936551 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-2bd5ec88-2fae-4aaa-b508-0ea7146910fe req-724b09ad-3099-4c1d-b8b3-ff385b296edd service nova] Creating event network-changed:a7c91f89-8f83-458b-bda8-ab64e791ff4d for instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 on n-h1-848886-15 Jul 25 13:33:45.942897 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [req-2bd5ec88-2fae-4aaa-b508-0ea7146910fe req-724b09ad-3099-4c1d-b8b3-ff385b296edd service nova] Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125883) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:33:45.963128 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-2bd5ec88-2fae-4aaa-b508-0ea7146910fe req-724b09ad-3099-4c1d-b8b3-ff385b296edd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062360 Jul 25 13:33:45.963755 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3222/6516] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:33:46.272852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b6805c15-49c0-4a6d-9835-62d9136c0df6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:46.274162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b6805c15-49c0-4a6d-9835-62d9136c0df6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:46.281854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6805c15-49c0-4a6d-9835-62d9136c0df6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:46.282353 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6805c15-49c0-4a6d-9835-62d9136c0df6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:46.283156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6805c15-49c0-4a6d-9835-62d9136c0df6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:46.283589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6805c15-49c0-4a6d-9835-62d9136c0df6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:46.588900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b6805c15-49c0-4a6d-9835-62d9136c0df6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:46.598318 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b6805c15-49c0-4a6d-9835-62d9136c0df6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1677 microversion: 2.1 time: 0.329331 Jul 25 13:33:46.599135 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3295/6517] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:46 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1677 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:46.621341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0a705c97-94ef-4375-9212-6d950270aa7c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:33:46.622591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0a705c97-94ef-4375-9212-6d950270aa7c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:46.630863 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a705c97-94ef-4375-9212-6d950270aa7c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:46.631419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a705c97-94ef-4375-9212-6d950270aa7c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:46.632473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a705c97-94ef-4375-9212-6d950270aa7c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:46.633000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0a705c97-94ef-4375-9212-6d950270aa7c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:46.706804 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0a705c97-94ef-4375-9212-6d950270aa7c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "POST /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3/action" status: 204 len: 0 microversion: 2.1 time: 0.089764 Jul 25 13:33:46.707398 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3223/6518] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:33:46 2022] POST /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3/action => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:33:46.717482 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-253fce32-b76e-43e6-a473-81321f46d8b0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:46.718598 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-253fce32-b76e-43e6-a473-81321f46d8b0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:46.728624 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-253fce32-b76e-43e6-a473-81321f46d8b0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:46.730355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-253fce32-b76e-43e6-a473-81321f46d8b0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:46.731956 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-253fce32-b76e-43e6-a473-81321f46d8b0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:46.732940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-253fce32-b76e-43e6-a473-81321f46d8b0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:47.055892 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-253fce32-b76e-43e6-a473-81321f46d8b0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:47.065013 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-253fce32-b76e-43e6-a473-81321f46d8b0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1677 microversion: 2.1 time: 0.352998 Jul 25 13:33:47.065618 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3296/6519] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:46 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1677 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:48.088331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-716ddd20-622c-48a5-9bb5-b9e36c7b9cd4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:48.089091 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-716ddd20-622c-48a5-9bb5-b9e36c7b9cd4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:48.096428 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-716ddd20-622c-48a5-9bb5-b9e36c7b9cd4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:48.096896 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-716ddd20-622c-48a5-9bb5-b9e36c7b9cd4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:48.097699 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-716ddd20-622c-48a5-9bb5-b9e36c7b9cd4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:48.098178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-716ddd20-622c-48a5-9bb5-b9e36c7b9cd4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:48.231263 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-716ddd20-622c-48a5-9bb5-b9e36c7b9cd4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:48.239202 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-716ddd20-622c-48a5-9bb5-b9e36c7b9cd4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1677 microversion: 2.1 time: 0.156395 Jul 25 13:33:48.239789 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3224/6520] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:48 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:48.548625 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-994ae61f-d42d-4ce0-a8d0-ed6faf4a758d req-e7942150-50cf-4b41-a680-1082c32870a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d76d04c-a42c-4802-96ad-5e56d80f07f3", "name": "network-vif-plugged", "status": "completed", "tag": "a7c91f89-8f83-458b-bda8-ab64e791ff4d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:33:48.562965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-994ae61f-d42d-4ce0-a8d0-ed6faf4a758d req-e7942150-50cf-4b41-a680-1082c32870a8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:48.563532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-994ae61f-d42d-4ce0-a8d0-ed6faf4a758d req-e7942150-50cf-4b41-a680-1082c32870a8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:48.575796 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-994ae61f-d42d-4ce0-a8d0-ed6faf4a758d req-e7942150-50cf-4b41-a680-1082c32870a8 service nova] Creating event network-vif-plugged:a7c91f89-8f83-458b-bda8-ab64e791ff4d for instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 on n-h1-848886-15 Jul 25 13:33:48.581771 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-994ae61f-d42d-4ce0-a8d0-ed6faf4a758d req-e7942150-50cf-4b41-a680-1082c32870a8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037513 Jul 25 13:33:48.582741 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3297/6521] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:33:49.261000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bbeff4d2-e590-4bf5-a554-5e3cc922b5b3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:49.261668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bbeff4d2-e590-4bf5-a554-5e3cc922b5b3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:49.269192 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbeff4d2-e590-4bf5-a554-5e3cc922b5b3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:49.269655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbeff4d2-e590-4bf5-a554-5e3cc922b5b3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:49.270498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbeff4d2-e590-4bf5-a554-5e3cc922b5b3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:49.270950 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbeff4d2-e590-4bf5-a554-5e3cc922b5b3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:49.410215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bbeff4d2-e590-4bf5-a554-5e3cc922b5b3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:49.418321 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bbeff4d2-e590-4bf5-a554-5e3cc922b5b3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1656 microversion: 2.1 time: 0.161322 Jul 25 13:33:49.418918 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3225/6522] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:49 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1656 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:49.439731 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6306e86a-21fa-450e-bd04-b043587f3a05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:49.440456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6306e86a-21fa-450e-bd04-b043587f3a05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:49.447504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6306e86a-21fa-450e-bd04-b043587f3a05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:49.447950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6306e86a-21fa-450e-bd04-b043587f3a05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:49.448719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6306e86a-21fa-450e-bd04-b043587f3a05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:49.449300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6306e86a-21fa-450e-bd04-b043587f3a05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:49.581050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6306e86a-21fa-450e-bd04-b043587f3a05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:49.589185 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6306e86a-21fa-450e-bd04-b043587f3a05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1656 microversion: 2.1 time: 0.153869 Jul 25 13:33:49.589866 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3298/6523] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:49 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1656 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:49.609713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a66d27f0-15dc-4a91-af3c-8cf2ab151d80 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:33:49.616606 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a66d27f0-15dc-4a91-af3c-8cf2ab151d80 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:49.617076 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a66d27f0-15dc-4a91-af3c-8cf2ab151d80 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:49.640712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a66d27f0-15dc-4a91-af3c-8cf2ab151d80 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Going to try to start instance {{(pid=125883) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 13:33:49.665193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:33:49.685748 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a66d27f0-15dc-4a91-af3c-8cf2ab151d80 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "POST /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3/action" status: 202 len: 0 microversion: 2.1 time: 0.079577 Jul 25 13:33:49.686437 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3226/6524] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:33:49 2022] POST /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:33:49.694975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c7232987-cec5-4d39-9496-5730e81ba96d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:49.695653 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c7232987-cec5-4d39-9496-5730e81ba96d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:49.702467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7232987-cec5-4d39-9496-5730e81ba96d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:49.702921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7232987-cec5-4d39-9496-5730e81ba96d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:49.703698 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7232987-cec5-4d39-9496-5730e81ba96d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:49.704347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7232987-cec5-4d39-9496-5730e81ba96d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:49.975613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c7232987-cec5-4d39-9496-5730e81ba96d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:49.983810 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c7232987-cec5-4d39-9496-5730e81ba96d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1665 microversion: 2.1 time: 0.292849 Jul 25 13:33:49.984398 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3299/6525] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:49 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1665 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:51.006008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-70630707-1385-497a-b8c0-51452c36936c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:51.006829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-70630707-1385-497a-b8c0-51452c36936c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:51.014510 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-70630707-1385-497a-b8c0-51452c36936c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:51.015206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-70630707-1385-497a-b8c0-51452c36936c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:51.015967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-70630707-1385-497a-b8c0-51452c36936c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:51.016421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-70630707-1385-497a-b8c0-51452c36936c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:51.175430 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-70630707-1385-497a-b8c0-51452c36936c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:51.185338 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-70630707-1385-497a-b8c0-51452c36936c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1669 microversion: 2.1 time: 0.183970 Jul 25 13:33:51.185980 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3227/6526] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:50 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1669 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:51.208958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-602ec068-546f-49e2-8d59-1b1dd58f7764 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:51.209627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-602ec068-546f-49e2-8d59-1b1dd58f7764 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:51.218910 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-602ec068-546f-49e2-8d59-1b1dd58f7764 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:51.219361 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-602ec068-546f-49e2-8d59-1b1dd58f7764 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:51.220179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-602ec068-546f-49e2-8d59-1b1dd58f7764 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:51.220762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-602ec068-546f-49e2-8d59-1b1dd58f7764 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:51.247440 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-602ec068-546f-49e2-8d59-1b1dd58f7764 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:33:51.280953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:33:51.335802 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-602ec068-546f-49e2-8d59-1b1dd58f7764 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 204 len: 0 microversion: 2.1 time: 0.132700 Jul 25 13:33:51.336458 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3300/6527] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:33:51 2022] DELETE /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:33:51.345319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bbfdf20e-5523-4c11-8b71-ed0e64f11623 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:51.345991 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bbfdf20e-5523-4c11-8b71-ed0e64f11623 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:51.352453 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbfdf20e-5523-4c11-8b71-ed0e64f11623 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:51.352904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbfdf20e-5523-4c11-8b71-ed0e64f11623 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:51.353691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbfdf20e-5523-4c11-8b71-ed0e64f11623 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:51.354170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bbfdf20e-5523-4c11-8b71-ed0e64f11623 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:51.499775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bbfdf20e-5523-4c11-8b71-ed0e64f11623 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:51.507644 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bbfdf20e-5523-4c11-8b71-ed0e64f11623 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1675 microversion: 2.1 time: 0.166643 Jul 25 13:33:51.508225 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3228/6528] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:51 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:52.531527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1511f2f8-1649-4837-904e-137ed0c70444 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:52.532215 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1511f2f8-1649-4837-904e-137ed0c70444 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:52.539659 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1511f2f8-1649-4837-904e-137ed0c70444 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:52.540108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1511f2f8-1649-4837-904e-137ed0c70444 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:52.540890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1511f2f8-1649-4837-904e-137ed0c70444 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:52.541313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1511f2f8-1649-4837-904e-137ed0c70444 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:52.789974 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1511f2f8-1649-4837-904e-137ed0c70444 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:52.801681 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1511f2f8-1649-4837-904e-137ed0c70444 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1675 microversion: 2.1 time: 0.275942 Jul 25 13:33:52.802333 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3301/6529] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:52 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1675 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:53.703217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-3b774760-efa0-4699-9742-ff51db14aa5b req-d79c5745-f473-4b03-9952-bb9d13286cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d76d04c-a42c-4802-96ad-5e56d80f07f3", "name": "network-vif-deleted", "tag": "a7c91f89-8f83-458b-bda8-ab64e791ff4d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:33:53.716277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-3b774760-efa0-4699-9742-ff51db14aa5b req-d79c5745-f473-4b03-9952-bb9d13286cce service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:53.725869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-3b774760-efa0-4699-9742-ff51db14aa5b req-d79c5745-f473-4b03-9952-bb9d13286cce service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:53.740316 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-3b774760-efa0-4699-9742-ff51db14aa5b req-d79c5745-f473-4b03-9952-bb9d13286cce service nova] Creating event network-vif-deleted:a7c91f89-8f83-458b-bda8-ab64e791ff4d for instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 on n-h1-848886-15 Jul 25 13:33:53.745781 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-3b774760-efa0-4699-9742-ff51db14aa5b req-d79c5745-f473-4b03-9952-bb9d13286cce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046819 Jul 25 13:33:53.746489 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3229/6530] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:33:53.827954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-91c441b2-92cb-4e00-87a6-c3f79849262e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:53.829009 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-91c441b2-92cb-4e00-87a6-c3f79849262e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:53.838611 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91c441b2-92cb-4e00-87a6-c3f79849262e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:53.839727 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91c441b2-92cb-4e00-87a6-c3f79849262e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:53.840814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91c441b2-92cb-4e00-87a6-c3f79849262e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:53.841269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91c441b2-92cb-4e00-87a6-c3f79849262e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:53.877291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91c441b2-92cb-4e00-87a6-c3f79849262e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:53.877756 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91c441b2-92cb-4e00-87a6-c3f79849262e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:53.878254 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-91c441b2-92cb-4e00-87a6-c3f79849262e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lazy-loading 'fault' on Instance uuid 8d76d04c-a42c-4802-96ad-5e56d80f07f3 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:33:53.924456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-91c441b2-92cb-4e00-87a6-c3f79849262e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:53.932372 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-91c441b2-92cb-4e00-87a6-c3f79849262e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 200 len: 1329 microversion: 2.1 time: 0.108935 Jul 25 13:33:53.932993 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3302/6531] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:53 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 1329 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:54.956295 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-21a1f055-e3a6-41e0-867c-2da99148d434 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:54.957000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-21a1f055-e3a6-41e0-867c-2da99148d434 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:54.963640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-21a1f055-e3a6-41e0-867c-2da99148d434 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:54.964102 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-21a1f055-e3a6-41e0-867c-2da99148d434 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:54.964936 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-21a1f055-e3a6-41e0-867c-2da99148d434 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:54.965374 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-21a1f055-e3a6-41e0-867c-2da99148d434 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:54.981425 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-21a1f055-e3a6-41e0-867c-2da99148d434 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] HTTP exception thrown: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-21a1f055-e3a6-41e0-867c-2da99148d434 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Request method failure captured: Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 HTTP/1.1 Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3ps2uAMwWcs8JWVJ4Y1EH4DEH-xcoDZUXcQ2SMYQDuHJ6xKZtzlY3crBbh33knI4BRq4-7REpa8QxZBYFHDFdQ0jv_t5oHli9ALSiUgThfzEZ87ovY8e2_XTSuFqSPJM6fPlLXFDiUl-NS1IB6R5YsiH4-NrInN3mZHwxCC9W0hJaI8 Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c79a68ef003f4f3faf0a2d4551c6d5ee", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}] Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 269643d1d0eb465ea092599c11480b71 Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '8d76d04c-a42c-4802-96ad-5e56d80f07f3'} Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:33:54.983456 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:33:54.990289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:33:54.990289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:33:54.990289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:33:54.990289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:33:54.990289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:33:54.990289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. Jul 25 13:33:54.990289 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:33:54.990289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-21a1f055-e3a6-41e0-867c-2da99148d434 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Returning 404 to user: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:33:54.990289 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-21a1f055-e3a6-41e0-867c-2da99148d434 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 404 len: 111 microversion: 2.1 time: 0.033809 Jul 25 13:33:54.990289 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3230/6532] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:54 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:33:55.000169 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d9efe463-8f32-4d42-a781-366b67645960 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:55.000758 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d9efe463-8f32-4d42-a781-366b67645960 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:55.008180 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9efe463-8f32-4d42-a781-366b67645960 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:55.008619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9efe463-8f32-4d42-a781-366b67645960 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:55.009439 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9efe463-8f32-4d42-a781-366b67645960 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:55.009928 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9efe463-8f32-4d42-a781-366b67645960 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:55.024026 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-d9efe463-8f32-4d42-a781-366b67645960 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] HTTP exception thrown: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d9efe463-8f32-4d42-a781-366b67645960 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Request method failure captured: Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 HTTP/1.1 Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3ps2uAMwWcs8JWVJ4Y1EH4DEH-xcoDZUXcQ2SMYQDuHJ6xKZtzlY3crBbh33knI4BRq4-7REpa8QxZBYFHDFdQ0jv_t5oHli9ALSiUgThfzEZ87ovY8e2_XTSuFqSPJM6fPlLXFDiUl-NS1IB6R5YsiH4-NrInN3mZHwxCC9W0hJaI8 Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c79a68ef003f4f3faf0a2d4551c6d5ee", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}] Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 269643d1d0eb465ea092599c11480b71 Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '8d76d04c-a42c-4802-96ad-5e56d80f07f3'} Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:33:55.025730 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:33:55.031232 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:33:55.031232 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:33:55.031232 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:33:55.031232 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:33:55.031232 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:33:55.031232 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. Jul 25 13:33:55.031232 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:33:55.031232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d9efe463-8f32-4d42-a781-366b67645960 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Returning 404 to user: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:33:55.031232 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d9efe463-8f32-4d42-a781-366b67645960 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 404 len: 111 microversion: 2.1 time: 0.031151 Jul 25 13:33:55.031232 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3303/6533] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:54 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 13:33:55.078450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-357fda01-889b-4acf-b61e-782272530440 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2106391987", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "670c2cbc-4b35-45bb-8ba5-a59e7bb64759"}], "security_groups": [{"name": "tempest-securitygroup--395676127"}], "key_name": "tempest-keypair-1831216923", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:33:55.187552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-357fda01-889b-4acf-b61e-782272530440 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] validate_networks() for [('670c2cbc-4b35-45bb-8ba5-a59e7bb64759', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:33:55.647009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-357fda01-889b-4acf-b61e-782272530440 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:33:55.647445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-357fda01-889b-4acf-b61e-782272530440 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:33:55.647954 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-357fda01-889b-4acf-b61e-782272530440 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:33:55.648357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-357fda01-889b-4acf-b61e-782272530440 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:33:55.648779 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-357fda01-889b-4acf-b61e-782272530440 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:33:55.658884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-357fda01-889b-4acf-b61e-782272530440 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:55.659341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-357fda01-889b-4acf-b61e-782272530440 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:55.660147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-357fda01-889b-4acf-b61e-782272530440 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:55.660590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-357fda01-889b-4acf-b61e-782272530440 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:55.678074 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-357fda01-889b-4acf-b61e-782272530440 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Getting quotas for project c79a68ef003f4f3faf0a2d4551c6d5ee. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:33:55.684170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-357fda01-889b-4acf-b61e-782272530440 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Getting quotas for user 269643d1d0eb465ea092599c11480b71 and project c79a68ef003f4f3faf0a2d4551c6d5ee. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:33:55.698484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-357fda01-889b-4acf-b61e-782272530440 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:33:55.700881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-357fda01-889b-4acf-b61e-782272530440 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:33:55.748154 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-357fda01-889b-4acf-b61e-782272530440 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.673926 Jul 25 13:33:55.748803 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3231/6534] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:33:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:33:55.760388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e05157d9-399a-4f79-9d2e-fef38b68b0a0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:55.761020 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e05157d9-399a-4f79-9d2e-fef38b68b0a0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:55.814897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e05157d9-399a-4f79-9d2e-fef38b68b0a0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:55.821668 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e05157d9-399a-4f79-9d2e-fef38b68b0a0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1239 microversion: 2.1 time: 0.065576 Jul 25 13:33:55.822274 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3304/6535] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:55 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:56.844371 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-27d0b620-a732-476f-8bc7-b483ff5ec78a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:56.845003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-27d0b620-a732-476f-8bc7-b483ff5ec78a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:56.853603 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27d0b620-a732-476f-8bc7-b483ff5ec78a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:56.854107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27d0b620-a732-476f-8bc7-b483ff5ec78a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:56.854921 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27d0b620-a732-476f-8bc7-b483ff5ec78a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:56.855493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-27d0b620-a732-476f-8bc7-b483ff5ec78a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:56.960655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-27d0b620-a732-476f-8bc7-b483ff5ec78a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:56.969145 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-27d0b620-a732-476f-8bc7-b483ff5ec78a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1297 microversion: 2.1 time: 0.130071 Jul 25 13:33:56.969728 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3232/6536] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:56 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1297 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:57.992897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9fe36662-7bbc-478a-8bdf-89c2222db2b1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:57.993512 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9fe36662-7bbc-478a-8bdf-89c2222db2b1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:58.000614 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:33:58.002925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9fe36662-7bbc-478a-8bdf-89c2222db2b1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:58.003343 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9fe36662-7bbc-478a-8bdf-89c2222db2b1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:58.004261 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9fe36662-7bbc-478a-8bdf-89c2222db2b1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:58.004731 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9fe36662-7bbc-478a-8bdf-89c2222db2b1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:58.229459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9fe36662-7bbc-478a-8bdf-89c2222db2b1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:58.237986 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9fe36662-7bbc-478a-8bdf-89c2222db2b1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1364 microversion: 2.1 time: 0.249187 Jul 25 13:33:58.239329 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3305/6537] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:57 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1364 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:33:58.283579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-ced57807-e06d-4a5f-953b-4d0badd0fb88 req-87fb811e-3259-4c51-acb6-0a38f8728b23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30dd612e-3eb1-44e8-aba8-97c8623283ac", "tag": "c8e496de-c973-474f-a6fb-06ff6a15a253"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:33:58.294343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:33:58.300327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ced57807-e06d-4a5f-953b-4d0badd0fb88 req-87fb811e-3259-4c51-acb6-0a38f8728b23 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:58.301004 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ced57807-e06d-4a5f-953b-4d0badd0fb88 req-87fb811e-3259-4c51-acb6-0a38f8728b23 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:58.321926 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-ced57807-e06d-4a5f-953b-4d0badd0fb88 req-87fb811e-3259-4c51-acb6-0a38f8728b23 service nova] Creating event network-changed:c8e496de-c973-474f-a6fb-06ff6a15a253 for instance 30dd612e-3eb1-44e8-aba8-97c8623283ac on n-h2-848886-15 Jul 25 13:33:58.328079 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-ced57807-e06d-4a5f-953b-4d0badd0fb88 req-87fb811e-3259-4c51-acb6-0a38f8728b23 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048882 Jul 25 13:33:58.328649 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3233/6538] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:33:59.260442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e11cb5ef-2bd5-4287-a781-1ffd222a0ea0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:33:59.261029 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e11cb5ef-2bd5-4287-a781-1ffd222a0ea0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:33:59.268731 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e11cb5ef-2bd5-4287-a781-1ffd222a0ea0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:59.269192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e11cb5ef-2bd5-4287-a781-1ffd222a0ea0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:59.270043 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e11cb5ef-2bd5-4287-a781-1ffd222a0ea0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:33:59.270484 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e11cb5ef-2bd5-4287-a781-1ffd222a0ea0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:33:59.410442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e11cb5ef-2bd5-4287-a781-1ffd222a0ea0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:33:59.422414 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e11cb5ef-2bd5-4287-a781-1ffd222a0ea0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1364 microversion: 2.1 time: 0.165795 Jul 25 13:33:59.423191 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3306/6539] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:33:59 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:34:00.445858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3ef80fd0-e892-4c91-bf51-014e7c8ff057 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:34:00.446448 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3ef80fd0-e892-4c91-bf51-014e7c8ff057 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:34:00.453282 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3ef80fd0-e892-4c91-bf51-014e7c8ff057 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:00.453741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3ef80fd0-e892-4c91-bf51-014e7c8ff057 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:00.454569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3ef80fd0-e892-4c91-bf51-014e7c8ff057 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:00.455017 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3ef80fd0-e892-4c91-bf51-014e7c8ff057 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:00.589107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3ef80fd0-e892-4c91-bf51-014e7c8ff057 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:34:00.597223 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3ef80fd0-e892-4c91-bf51-014e7c8ff057 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1364 microversion: 2.1 time: 0.156689 Jul 25 13:34:00.597782 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3234/6540] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:34:00 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:34:01.620890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ea2fdc75-659b-4b33-a74a-5c787d589b04 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:34:01.621621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ea2fdc75-659b-4b33-a74a-5c787d589b04 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:34:01.630929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea2fdc75-659b-4b33-a74a-5c787d589b04 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:01.631495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea2fdc75-659b-4b33-a74a-5c787d589b04 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:01.632451 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea2fdc75-659b-4b33-a74a-5c787d589b04 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:01.632975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea2fdc75-659b-4b33-a74a-5c787d589b04 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:01.769317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ea2fdc75-659b-4b33-a74a-5c787d589b04 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:34:01.777322 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ea2fdc75-659b-4b33-a74a-5c787d589b04 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1364 microversion: 2.1 time: 0.161416 Jul 25 13:34:01.777932 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3307/6541] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:34:01 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:34:02.803201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-049f1fa4-0302-4b05-8ce4-e4b5731357cb tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:34:02.804329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-049f1fa4-0302-4b05-8ce4-e4b5731357cb tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:34:02.815997 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-049f1fa4-0302-4b05-8ce4-e4b5731357cb tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:02.816763 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-049f1fa4-0302-4b05-8ce4-e4b5731357cb tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:02.818088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-049f1fa4-0302-4b05-8ce4-e4b5731357cb tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:02.818834 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-049f1fa4-0302-4b05-8ce4-e4b5731357cb tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:02.957673 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-049f1fa4-0302-4b05-8ce4-e4b5731357cb tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:34:02.966454 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-049f1fa4-0302-4b05-8ce4-e4b5731357cb tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1364 microversion: 2.1 time: 0.169891 Jul 25 13:34:02.967066 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3235/6542] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:34:02 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:34:03.060687 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-e125eac9-e7fb-4500-9470-508c49147c1c req-1b39f437-75f9-431c-8249-90ef85bb9cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30dd612e-3eb1-44e8-aba8-97c8623283ac", "name": "network-vif-plugged", "status": "completed", "tag": "c8e496de-c973-474f-a6fb-06ff6a15a253"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:34:03.072649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e125eac9-e7fb-4500-9470-508c49147c1c req-1b39f437-75f9-431c-8249-90ef85bb9cee service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:03.073096 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e125eac9-e7fb-4500-9470-508c49147c1c req-1b39f437-75f9-431c-8249-90ef85bb9cee service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:03.084725 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-e125eac9-e7fb-4500-9470-508c49147c1c req-1b39f437-75f9-431c-8249-90ef85bb9cee service nova] Creating event network-vif-plugged:c8e496de-c973-474f-a6fb-06ff6a15a253 for instance 30dd612e-3eb1-44e8-aba8-97c8623283ac on n-h2-848886-15 Jul 25 13:34:03.090128 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-e125eac9-e7fb-4500-9470-508c49147c1c req-1b39f437-75f9-431c-8249-90ef85bb9cee service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033514 Jul 25 13:34:03.091494 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3308/6543] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:34:03.992290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3b61abbd-5f2f-49de-bedc-48ee173faf7f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:34:03.993302 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3b61abbd-5f2f-49de-bedc-48ee173faf7f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:34:04.001630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b61abbd-5f2f-49de-bedc-48ee173faf7f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:04.002125 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b61abbd-5f2f-49de-bedc-48ee173faf7f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:04.002903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b61abbd-5f2f-49de-bedc-48ee173faf7f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:04.003349 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b61abbd-5f2f-49de-bedc-48ee173faf7f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:04.138103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3b61abbd-5f2f-49de-bedc-48ee173faf7f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:34:04.145843 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3b61abbd-5f2f-49de-bedc-48ee173faf7f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1364 microversion: 2.1 time: 0.160208 Jul 25 13:34:04.146469 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3236/6544] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:34:03 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:34:05.169615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-28fd16d3-0edc-4430-a7b7-bb7dd2e58f4a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:34:05.170355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-28fd16d3-0edc-4430-a7b7-bb7dd2e58f4a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:34:05.179633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-28fd16d3-0edc-4430-a7b7-bb7dd2e58f4a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:05.180104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-28fd16d3-0edc-4430-a7b7-bb7dd2e58f4a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:05.180870 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-28fd16d3-0edc-4430-a7b7-bb7dd2e58f4a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:05.181300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-28fd16d3-0edc-4430-a7b7-bb7dd2e58f4a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:05.318829 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-28fd16d3-0edc-4430-a7b7-bb7dd2e58f4a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:34:05.326962 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-28fd16d3-0edc-4430-a7b7-bb7dd2e58f4a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1550 microversion: 2.1 time: 0.163348 Jul 25 13:34:05.327550 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3309/6545] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:34:05 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1550 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:34:05.352800 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7533f70e-82be-44f2-8f03-0114a7c27fa8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:34:05.353339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7533f70e-82be-44f2-8f03-0114a7c27fa8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:34:05.360602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7533f70e-82be-44f2-8f03-0114a7c27fa8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:05.361070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7533f70e-82be-44f2-8f03-0114a7c27fa8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:05.361879 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7533f70e-82be-44f2-8f03-0114a7c27fa8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:05.362365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7533f70e-82be-44f2-8f03-0114a7c27fa8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:05.453180 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7533f70e-82be-44f2-8f03-0114a7c27fa8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104259 Jul 25 13:34:05.453788 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3237/6546] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 13:34:05 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:34:06.717099 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-b41b5c18-7e21-4a45-aaef-38947fa2ad01 req-59e57c53-2c9c-4576-ad2c-f696a7123f5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30dd612e-3eb1-44e8-aba8-97c8623283ac", "tag": "c8e496de-c973-474f-a6fb-06ff6a15a253"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:34:06.721972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:34:06.728459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b41b5c18-7e21-4a45-aaef-38947fa2ad01 req-59e57c53-2c9c-4576-ad2c-f696a7123f5c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:06.728920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b41b5c18-7e21-4a45-aaef-38947fa2ad01 req-59e57c53-2c9c-4576-ad2c-f696a7123f5c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:06.740227 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-b41b5c18-7e21-4a45-aaef-38947fa2ad01 req-59e57c53-2c9c-4576-ad2c-f696a7123f5c service nova] Creating event network-changed:c8e496de-c973-474f-a6fb-06ff6a15a253 for instance 30dd612e-3eb1-44e8-aba8-97c8623283ac on n-h2-848886-15 Jul 25 13:34:06.745167 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-b41b5c18-7e21-4a45-aaef-38947fa2ad01 req-59e57c53-2c9c-4576-ad2c-f696a7123f5c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032162 Jul 25 13:34:06.745854 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3310/6547] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:34:37.936517 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:34:37.937104 n-d-848886-15 devstack@n-api.service[125883]: Mon Jul 25 13:34:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:34:41.037271 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:34:41.038622 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:34:41.041339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=9 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:34:41.042458 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=50,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:34:41.048634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-92db0cd5-69c0-4601-8f01-a918d14899c9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:34:41.051015 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-92db0cd5-69c0-4601-8f01-a918d14899c9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:34:41.059968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92db0cd5-69c0-4601-8f01-a918d14899c9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:41.060436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92db0cd5-69c0-4601-8f01-a918d14899c9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:41.061214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92db0cd5-69c0-4601-8f01-a918d14899c9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:41.061667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92db0cd5-69c0-4601-8f01-a918d14899c9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:41.089066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-92db0cd5-69c0-4601-8f01-a918d14899c9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:34:41.095627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-92db0cd5-69c0-4601-8f01-a918d14899c9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Old instance type m1.heat2, new instance type m1.heat {{(pid=125883) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 13:34:41.102161 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-92db0cd5-69c0-4601-8f01-a918d14899c9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:34:41.102596 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-92db0cd5-69c0-4601-8f01-a918d14899c9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:34:41.103084 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-92db0cd5-69c0-4601-8f01-a918d14899c9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:34:41.103507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-92db0cd5-69c0-4601-8f01-a918d14899c9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:34:41.103932 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-92db0cd5-69c0-4601-8f01-a918d14899c9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:34:41.169904 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-92db0cd5-69c0-4601-8f01-a918d14899c9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "POST /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac/action" status: 202 len: 0 microversion: 2.1 time: 0.133801 Jul 25 13:34:41.170443 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3238/6548] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:34:41 2022] POST /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:34:41.176911 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=11 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:34:41.177634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=48,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:34:41.182051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2d9ffee9-9021-4cd6-b4d1-af00b91eb1ef tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:34:41.182732 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2d9ffee9-9021-4cd6-b4d1-af00b91eb1ef tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:34:41.190931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d9ffee9-9021-4cd6-b4d1-af00b91eb1ef tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:41.191421 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d9ffee9-9021-4cd6-b4d1-af00b91eb1ef tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:41.192174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d9ffee9-9021-4cd6-b4d1-af00b91eb1ef tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:41.192654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d9ffee9-9021-4cd6-b4d1-af00b91eb1ef tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:41.328938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2d9ffee9-9021-4cd6-b4d1-af00b91eb1ef tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:34:41.337358 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2d9ffee9-9021-4cd6-b4d1-af00b91eb1ef tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1678 microversion: 2.1 time: 0.162110 Jul 25 13:34:41.337956 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3311/6549] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:34:41 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:34:42.360632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c90ec52a-fc3c-45fe-bdd8-4d8aa115c778 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:34:42.361249 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c90ec52a-fc3c-45fe-bdd8-4d8aa115c778 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:34:42.367794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c90ec52a-fc3c-45fe-bdd8-4d8aa115c778 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:42.368270 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c90ec52a-fc3c-45fe-bdd8-4d8aa115c778 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:42.369053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c90ec52a-fc3c-45fe-bdd8-4d8aa115c778 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:42.369500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c90ec52a-fc3c-45fe-bdd8-4d8aa115c778 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:42.530168 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c90ec52a-fc3c-45fe-bdd8-4d8aa115c778 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:34:42.538078 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c90ec52a-fc3c-45fe-bdd8-4d8aa115c778 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1678 microversion: 2.1 time: 0.183083 Jul 25 13:34:42.538640 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3239/6550] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:34:42 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:34:43.564229 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ae8165dd-59e1-47bd-a8aa-c13df323ea89 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:34:43.564946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ae8165dd-59e1-47bd-a8aa-c13df323ea89 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:34:43.573522 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae8165dd-59e1-47bd-a8aa-c13df323ea89 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:43.574106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae8165dd-59e1-47bd-a8aa-c13df323ea89 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:43.575024 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae8165dd-59e1-47bd-a8aa-c13df323ea89 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:43.575546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ae8165dd-59e1-47bd-a8aa-c13df323ea89 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:43.716619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ae8165dd-59e1-47bd-a8aa-c13df323ea89 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:34:43.724675 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ae8165dd-59e1-47bd-a8aa-c13df323ea89 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1683 microversion: 2.1 time: 0.166686 Jul 25 13:34:43.725266 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3312/6551] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:34:43 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:34:44.750218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b175dacf-e58a-475c-a223-c9df4e009e16 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:34:44.751180 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b175dacf-e58a-475c-a223-c9df4e009e16 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:34:44.763162 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b175dacf-e58a-475c-a223-c9df4e009e16 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:44.763944 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b175dacf-e58a-475c-a223-c9df4e009e16 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:44.765251 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b175dacf-e58a-475c-a223-c9df4e009e16 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:44.766051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b175dacf-e58a-475c-a223-c9df4e009e16 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:44.907714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b175dacf-e58a-475c-a223-c9df4e009e16 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:34:44.915655 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b175dacf-e58a-475c-a223-c9df4e009e16 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1683 microversion: 2.1 time: 0.172041 Jul 25 13:34:44.916234 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3240/6552] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:34:44 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:34:45.940951 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a12724dc-0beb-4eda-9ca1-ed3f41d81599 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:34:45.943556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a12724dc-0beb-4eda-9ca1-ed3f41d81599 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:34:45.948993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a12724dc-0beb-4eda-9ca1-ed3f41d81599 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:45.949457 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a12724dc-0beb-4eda-9ca1-ed3f41d81599 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:45.950285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a12724dc-0beb-4eda-9ca1-ed3f41d81599 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:45.950729 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a12724dc-0beb-4eda-9ca1-ed3f41d81599 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:46.083260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a12724dc-0beb-4eda-9ca1-ed3f41d81599 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:34:46.091731 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a12724dc-0beb-4eda-9ca1-ed3f41d81599 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1683 microversion: 2.1 time: 0.156225 Jul 25 13:34:46.092291 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3313/6553] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:34:45 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:34:47.113053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-43096d20-fcf1-4af6-94be-114bb0c2ffed tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:34:47.113639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-43096d20-fcf1-4af6-94be-114bb0c2ffed tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:34:47.121118 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43096d20-fcf1-4af6-94be-114bb0c2ffed tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:47.121626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43096d20-fcf1-4af6-94be-114bb0c2ffed tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:47.122461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43096d20-fcf1-4af6-94be-114bb0c2ffed tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:47.123143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-43096d20-fcf1-4af6-94be-114bb0c2ffed tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:47.263545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-43096d20-fcf1-4af6-94be-114bb0c2ffed tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:34:47.274444 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-43096d20-fcf1-4af6-94be-114bb0c2ffed tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1683 microversion: 2.1 time: 0.165204 Jul 25 13:34:47.275295 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3241/6554] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:34:47 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:34:48.300412 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-29af3d27-5752-4d4f-ba75-bd213ec29002 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:34:48.300981 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-29af3d27-5752-4d4f-ba75-bd213ec29002 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:34:48.308589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29af3d27-5752-4d4f-ba75-bd213ec29002 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:48.309038 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29af3d27-5752-4d4f-ba75-bd213ec29002 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:48.309804 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29af3d27-5752-4d4f-ba75-bd213ec29002 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:48.310269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-29af3d27-5752-4d4f-ba75-bd213ec29002 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:48.440000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-29af3d27-5752-4d4f-ba75-bd213ec29002 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:34:48.447676 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-29af3d27-5752-4d4f-ba75-bd213ec29002 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1683 microversion: 2.1 time: 0.153779 Jul 25 13:34:48.448218 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3314/6555] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:34:48 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:34:49.472909 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6cfd702b-40d5-4650-8176-eed9ce8216e1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:34:49.473648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6cfd702b-40d5-4650-8176-eed9ce8216e1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:34:49.482787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6cfd702b-40d5-4650-8176-eed9ce8216e1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:49.483370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6cfd702b-40d5-4650-8176-eed9ce8216e1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:49.484341 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6cfd702b-40d5-4650-8176-eed9ce8216e1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:49.484905 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6cfd702b-40d5-4650-8176-eed9ce8216e1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:49.628396 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6cfd702b-40d5-4650-8176-eed9ce8216e1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:34:49.636700 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6cfd702b-40d5-4650-8176-eed9ce8216e1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1683 microversion: 2.1 time: 0.170027 Jul 25 13:34:49.637318 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3242/6556] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:34:49 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:34:50.662531 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b275c325-a318-498c-80f4-260cdd23f8e2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:34:50.663520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b275c325-a318-498c-80f4-260cdd23f8e2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:34:50.675051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b275c325-a318-498c-80f4-260cdd23f8e2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:50.675509 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b275c325-a318-498c-80f4-260cdd23f8e2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:50.676279 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b275c325-a318-498c-80f4-260cdd23f8e2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:50.676715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b275c325-a318-498c-80f4-260cdd23f8e2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:50.809556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b275c325-a318-498c-80f4-260cdd23f8e2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:34:50.817408 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b275c325-a318-498c-80f4-260cdd23f8e2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1683 microversion: 2.1 time: 0.161501 Jul 25 13:34:50.818016 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3315/6557] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:34:50 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:34:51.843436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-339d0957-e875-458a-ac84-302c9cadad80 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:34:51.844551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-339d0957-e875-458a-ac84-302c9cadad80 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:34:51.852467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-339d0957-e875-458a-ac84-302c9cadad80 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:51.852929 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-339d0957-e875-458a-ac84-302c9cadad80 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:51.853709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-339d0957-e875-458a-ac84-302c9cadad80 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:51.854198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-339d0957-e875-458a-ac84-302c9cadad80 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:51.982262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-339d0957-e875-458a-ac84-302c9cadad80 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:34:51.990188 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-339d0957-e875-458a-ac84-302c9cadad80 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1683 microversion: 2.1 time: 0.153856 Jul 25 13:34:51.990776 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3243/6558] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:34:51 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:34:53.016169 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-570dfaca-1fde-4e0a-a35b-d1bf16bb7c3d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:34:53.017232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-570dfaca-1fde-4e0a-a35b-d1bf16bb7c3d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:34:53.025136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-570dfaca-1fde-4e0a-a35b-d1bf16bb7c3d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:53.025586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-570dfaca-1fde-4e0a-a35b-d1bf16bb7c3d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:53.026384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-570dfaca-1fde-4e0a-a35b-d1bf16bb7c3d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:53.026812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-570dfaca-1fde-4e0a-a35b-d1bf16bb7c3d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:53.168865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-570dfaca-1fde-4e0a-a35b-d1bf16bb7c3d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:34:53.180507 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-570dfaca-1fde-4e0a-a35b-d1bf16bb7c3d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1683 microversion: 2.1 time: 0.170726 Jul 25 13:34:53.181223 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3316/6559] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:34:53 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:34:54.209121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-910346a1-1047-4f2c-8fed-5446005273a9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:34:54.210202 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-910346a1-1047-4f2c-8fed-5446005273a9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:34:54.222019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-910346a1-1047-4f2c-8fed-5446005273a9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:54.222517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-910346a1-1047-4f2c-8fed-5446005273a9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:54.223286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-910346a1-1047-4f2c-8fed-5446005273a9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:54.223735 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-910346a1-1047-4f2c-8fed-5446005273a9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:54.363051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-910346a1-1047-4f2c-8fed-5446005273a9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:34:54.370909 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-910346a1-1047-4f2c-8fed-5446005273a9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1683 microversion: 2.1 time: 0.168255 Jul 25 13:34:54.371489 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3244/6560] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:34:54 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:34:55.396336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4f858c79-420d-43da-89b9-ed96eaa4836d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:34:55.397276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4f858c79-420d-43da-89b9-ed96eaa4836d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:34:55.409121 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f858c79-420d-43da-89b9-ed96eaa4836d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:55.409570 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f858c79-420d-43da-89b9-ed96eaa4836d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:55.410373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f858c79-420d-43da-89b9-ed96eaa4836d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:55.410807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f858c79-420d-43da-89b9-ed96eaa4836d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:55.556566 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4f858c79-420d-43da-89b9-ed96eaa4836d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:34:55.564460 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4f858c79-420d-43da-89b9-ed96eaa4836d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1683 microversion: 2.1 time: 0.174761 Jul 25 13:34:55.565140 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3317/6561] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:34:55 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:34:56.587862 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f9239e4d-6b78-49fe-ad65-bf975af87c60 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:34:56.588545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f9239e4d-6b78-49fe-ad65-bf975af87c60 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:34:56.597581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9239e4d-6b78-49fe-ad65-bf975af87c60 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:56.598177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9239e4d-6b78-49fe-ad65-bf975af87c60 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:56.599101 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9239e4d-6b78-49fe-ad65-bf975af87c60 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:56.599634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9239e4d-6b78-49fe-ad65-bf975af87c60 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:56.740222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f9239e4d-6b78-49fe-ad65-bf975af87c60 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:34:56.748846 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f9239e4d-6b78-49fe-ad65-bf975af87c60 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1683 microversion: 2.1 time: 0.165819 Jul 25 13:34:56.749432 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3245/6562] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:34:56 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:34:57.770737 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e1028a27-e841-471b-909e-99a996b92746 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:34:57.771343 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e1028a27-e841-471b-909e-99a996b92746 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:34:57.778382 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1028a27-e841-471b-909e-99a996b92746 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:57.778833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1028a27-e841-471b-909e-99a996b92746 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:57.779605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1028a27-e841-471b-909e-99a996b92746 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:57.780038 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1028a27-e841-471b-909e-99a996b92746 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:57.911502 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e1028a27-e841-471b-909e-99a996b92746 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:34:57.919442 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e1028a27-e841-471b-909e-99a996b92746 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1683 microversion: 2.1 time: 0.153017 Jul 25 13:34:57.920014 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3318/6563] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:34:57 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:34:58.945286 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e1757cb0-9f61-44f7-a1f1-5e2b047859f8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:34:58.946358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e1757cb0-9f61-44f7-a1f1-5e2b047859f8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:34:58.957458 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1757cb0-9f61-44f7-a1f1-5e2b047859f8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:58.957927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1757cb0-9f61-44f7-a1f1-5e2b047859f8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:58.958729 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1757cb0-9f61-44f7-a1f1-5e2b047859f8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:34:58.959175 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e1757cb0-9f61-44f7-a1f1-5e2b047859f8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:34:59.103939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e1757cb0-9f61-44f7-a1f1-5e2b047859f8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:34:59.112467 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e1757cb0-9f61-44f7-a1f1-5e2b047859f8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1683 microversion: 2.1 time: 0.174045 Jul 25 13:34:59.113043 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3246/6564] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:34:58 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:00.136400 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-09d5205b-c49c-4816-8a55-e499d090911d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:00.137158 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-09d5205b-c49c-4816-8a55-e499d090911d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:00.145725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09d5205b-c49c-4816-8a55-e499d090911d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:00.146194 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09d5205b-c49c-4816-8a55-e499d090911d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:00.147032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09d5205b-c49c-4816-8a55-e499d090911d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:00.147477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09d5205b-c49c-4816-8a55-e499d090911d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:00.366115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-09d5205b-c49c-4816-8a55-e499d090911d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:00.374246 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-09d5205b-c49c-4816-8a55-e499d090911d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1682 microversion: 2.1 time: 0.241853 Jul 25 13:35:00.374768 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3319/6565] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:00 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1682 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:00.602339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-1828d776-cf3f-4bcd-844a-e135622ba6ba req-6a8ac44a-3eae-4b9d-8cab-226efa3044c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30dd612e-3eb1-44e8-aba8-97c8623283ac", "name": "network-vif-unplugged", "status": "completed", "tag": "c8e496de-c973-474f-a6fb-06ff6a15a253"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:35:00.613890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-1828d776-cf3f-4bcd-844a-e135622ba6ba req-6a8ac44a-3eae-4b9d-8cab-226efa3044c7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:00.614367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-1828d776-cf3f-4bcd-844a-e135622ba6ba req-6a8ac44a-3eae-4b9d-8cab-226efa3044c7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:00.628126 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-1828d776-cf3f-4bcd-844a-e135622ba6ba req-6a8ac44a-3eae-4b9d-8cab-226efa3044c7 service nova] Creating event network-vif-unplugged:c8e496de-c973-474f-a6fb-06ff6a15a253 for instance 30dd612e-3eb1-44e8-aba8-97c8623283ac on n-h1-848886-15 Jul 25 13:35:00.633630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [req-1828d776-cf3f-4bcd-844a-e135622ba6ba req-6a8ac44a-3eae-4b9d-8cab-226efa3044c7 service nova] Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125883) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:35:00.645115 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-1828d776-cf3f-4bcd-844a-e135622ba6ba req-6a8ac44a-3eae-4b9d-8cab-226efa3044c7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046471 Jul 25 13:35:00.645736 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3247/6566] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:35:01.395990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d2906bfb-715b-4d7a-9dfc-bfcc1bc1361f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:01.396583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d2906bfb-715b-4d7a-9dfc-bfcc1bc1361f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:01.403790 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2906bfb-715b-4d7a-9dfc-bfcc1bc1361f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:01.404238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2906bfb-715b-4d7a-9dfc-bfcc1bc1361f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:01.405005 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2906bfb-715b-4d7a-9dfc-bfcc1bc1361f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:01.405437 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d2906bfb-715b-4d7a-9dfc-bfcc1bc1361f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:01.601982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d2906bfb-715b-4d7a-9dfc-bfcc1bc1361f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:01.610762 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d2906bfb-715b-4d7a-9dfc-bfcc1bc1361f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1682 microversion: 2.1 time: 0.218796 Jul 25 13:35:01.611346 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3320/6567] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:01 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:02.638935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1944d348-8f07-4c83-87f7-e9f350505253 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:02.640105 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1944d348-8f07-4c83-87f7-e9f350505253 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:02.648082 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1944d348-8f07-4c83-87f7-e9f350505253 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:02.648551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1944d348-8f07-4c83-87f7-e9f350505253 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:02.649340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1944d348-8f07-4c83-87f7-e9f350505253 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:02.649805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1944d348-8f07-4c83-87f7-e9f350505253 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:02.662048 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-53ea772d-ac82-495d-a216-b63082eca1dd req-919affb0-69ee-44a9-9e29-6a863dcfe61d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30dd612e-3eb1-44e8-aba8-97c8623283ac", "tag": "c8e496de-c973-474f-a6fb-06ff6a15a253"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:35:02.672523 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-53ea772d-ac82-495d-a216-b63082eca1dd req-919affb0-69ee-44a9-9e29-6a863dcfe61d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:02.672964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-53ea772d-ac82-495d-a216-b63082eca1dd req-919affb0-69ee-44a9-9e29-6a863dcfe61d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:02.685694 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-53ea772d-ac82-495d-a216-b63082eca1dd req-919affb0-69ee-44a9-9e29-6a863dcfe61d service nova] Creating event network-changed:c8e496de-c973-474f-a6fb-06ff6a15a253 for instance 30dd612e-3eb1-44e8-aba8-97c8623283ac on n-h1-848886-15 Jul 25 13:35:02.691735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [req-53ea772d-ac82-495d-a216-b63082eca1dd req-919affb0-69ee-44a9-9e29-6a863dcfe61d service nova] Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:35:02.704376 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-53ea772d-ac82-495d-a216-b63082eca1dd req-919affb0-69ee-44a9-9e29-6a863dcfe61d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046002 Jul 25 13:35:02.705248 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3321/6568] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:35:03.276212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1944d348-8f07-4c83-87f7-e9f350505253 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:03.284406 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1944d348-8f07-4c83-87f7-e9f350505253 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1680 microversion: 2.1 time: 0.654345 Jul 25 13:35:03.285127 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3248/6569] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:02 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1680 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:04.312855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0bd907fe-a1b6-4c29-8057-e52b948e39b4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:04.314048 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0bd907fe-a1b6-4c29-8057-e52b948e39b4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:04.325023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0bd907fe-a1b6-4c29-8057-e52b948e39b4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:04.325896 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0bd907fe-a1b6-4c29-8057-e52b948e39b4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:04.327306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0bd907fe-a1b6-4c29-8057-e52b948e39b4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:04.328100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0bd907fe-a1b6-4c29-8057-e52b948e39b4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:04.473385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0bd907fe-a1b6-4c29-8057-e52b948e39b4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:04.481164 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0bd907fe-a1b6-4c29-8057-e52b948e39b4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1677 microversion: 2.1 time: 0.177108 Jul 25 13:35:04.481764 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3322/6570] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:04 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:04.512212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-202e3bb4-a89e-4afe-8930-9f4f492e1d1a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:35:04.512742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-202e3bb4-a89e-4afe-8930-9f4f492e1d1a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:04.523423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-202e3bb4-a89e-4afe-8930-9f4f492e1d1a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:04.524020 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-202e3bb4-a89e-4afe-8930-9f4f492e1d1a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:04.525218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-202e3bb4-a89e-4afe-8930-9f4f492e1d1a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:04.525893 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-202e3bb4-a89e-4afe-8930-9f4f492e1d1a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:04.565855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-202e3bb4-a89e-4afe-8930-9f4f492e1d1a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:04.566327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-202e3bb4-a89e-4afe-8930-9f4f492e1d1a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:04.567136 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-202e3bb4-a89e-4afe-8930-9f4f492e1d1a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:04.567593 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-202e3bb4-a89e-4afe-8930-9f4f492e1d1a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:04.588774 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-202e3bb4-a89e-4afe-8930-9f4f492e1d1a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Getting quotas for project c79a68ef003f4f3faf0a2d4551c6d5ee. Resources: {'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:35:04.594806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-202e3bb4-a89e-4afe-8930-9f4f492e1d1a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Getting quotas for user 269643d1d0eb465ea092599c11480b71 and project c79a68ef003f4f3faf0a2d4551c6d5ee. Resources: {'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:35:04.702593 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-202e3bb4-a89e-4afe-8930-9f4f492e1d1a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "POST /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac/action" status: 202 len: 0 microversion: 2.1 time: 0.196662 Jul 25 13:35:04.703497 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3249/6571] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:35:04 2022] POST /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:35:04.713313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-02964325-8997-408d-9b59-08dc558f8f74 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:04.713988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-02964325-8997-408d-9b59-08dc558f8f74 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:04.720729 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02964325-8997-408d-9b59-08dc558f8f74 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:04.721237 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02964325-8997-408d-9b59-08dc558f8f74 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:04.722285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02964325-8997-408d-9b59-08dc558f8f74 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:04.722794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-02964325-8997-408d-9b59-08dc558f8f74 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:04.878244 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-58b65187-47db-44ec-8878-f0599d0d0adb req-e506715c-af03-4235-a486-39f5b2e495bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30dd612e-3eb1-44e8-aba8-97c8623283ac", "name": "network-vif-plugged", "status": "completed", "tag": "c8e496de-c973-474f-a6fb-06ff6a15a253"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:35:04.889716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-58b65187-47db-44ec-8878-f0599d0d0adb req-e506715c-af03-4235-a486-39f5b2e495bd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:04.890647 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-58b65187-47db-44ec-8878-f0599d0d0adb req-e506715c-af03-4235-a486-39f5b2e495bd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:04.902132 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-58b65187-47db-44ec-8878-f0599d0d0adb req-e506715c-af03-4235-a486-39f5b2e495bd service nova] Creating event network-vif-plugged:c8e496de-c973-474f-a6fb-06ff6a15a253 for instance 30dd612e-3eb1-44e8-aba8-97c8623283ac on n-h1-848886-15 Jul 25 13:35:04.904898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:35:04.908978 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [req-58b65187-47db-44ec-8878-f0599d0d0adb req-e506715c-af03-4235-a486-39f5b2e495bd service nova] Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125883) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:35:04.919184 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-02964325-8997-408d-9b59-08dc558f8f74 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:04.927503 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-02964325-8997-408d-9b59-08dc558f8f74 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1676 microversion: 2.1 time: 0.219450 Jul 25 13:35:04.931147 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3323/6572] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:04 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1676 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:04.931938 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-58b65187-47db-44ec-8878-f0599d0d0adb req-e506715c-af03-4235-a486-39f5b2e495bd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058142 Jul 25 13:35:04.932634 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3250/6573] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:35:05.955542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-62142663-45da-4d38-817f-d9d38eb05fd1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:05.956558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-62142663-45da-4d38-817f-d9d38eb05fd1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:05.968790 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-62142663-45da-4d38-817f-d9d38eb05fd1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:05.969549 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-62142663-45da-4d38-817f-d9d38eb05fd1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:05.970883 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-62142663-45da-4d38-817f-d9d38eb05fd1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:05.971551 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-62142663-45da-4d38-817f-d9d38eb05fd1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:06.115344 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-62142663-45da-4d38-817f-d9d38eb05fd1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:06.123548 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-62142663-45da-4d38-817f-d9d38eb05fd1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1676 microversion: 2.1 time: 0.174717 Jul 25 13:35:06.124158 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3324/6574] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:05 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:07.146895 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-038c1c41-5e5f-4177-bf8d-788dded579d1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:07.147862 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-038c1c41-5e5f-4177-bf8d-788dded579d1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:07.156549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-038c1c41-5e5f-4177-bf8d-788dded579d1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:07.157000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-038c1c41-5e5f-4177-bf8d-788dded579d1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:07.157800 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-038c1c41-5e5f-4177-bf8d-788dded579d1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:07.158272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-038c1c41-5e5f-4177-bf8d-788dded579d1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:07.296528 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-038c1c41-5e5f-4177-bf8d-788dded579d1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:07.304288 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-038c1c41-5e5f-4177-bf8d-788dded579d1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1676 microversion: 2.1 time: 0.163277 Jul 25 13:35:07.305096 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3251/6575] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:07 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:07.807988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-cb65a7bc-1dfb-412e-a6b4-1eb035399b9c req-285aa360-950f-48d3-8450-5014d733ec59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30dd612e-3eb1-44e8-aba8-97c8623283ac", "name": "network-vif-unplugged", "status": "completed", "tag": "c8e496de-c973-474f-a6fb-06ff6a15a253"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:35:07.819537 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-cb65a7bc-1dfb-412e-a6b4-1eb035399b9c req-285aa360-950f-48d3-8450-5014d733ec59 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:07.819985 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-cb65a7bc-1dfb-412e-a6b4-1eb035399b9c req-285aa360-950f-48d3-8450-5014d733ec59 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:07.832775 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-cb65a7bc-1dfb-412e-a6b4-1eb035399b9c req-285aa360-950f-48d3-8450-5014d733ec59 service nova] Creating event network-vif-unplugged:c8e496de-c973-474f-a6fb-06ff6a15a253 for instance 30dd612e-3eb1-44e8-aba8-97c8623283ac on n-h2-848886-15 Jul 25 13:35:07.839140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [req-cb65a7bc-1dfb-412e-a6b4-1eb035399b9c req-285aa360-950f-48d3-8450-5014d733ec59 service nova] Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:35:07.853981 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-cb65a7bc-1dfb-412e-a6b4-1eb035399b9c req-285aa360-950f-48d3-8450-5014d733ec59 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049570 Jul 25 13:35:07.855513 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3325/6576] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:35:08.325013 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5120492b-462d-457d-92d2-a58554632df2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:08.326314 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5120492b-462d-457d-92d2-a58554632df2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:08.334464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5120492b-462d-457d-92d2-a58554632df2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:08.334929 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5120492b-462d-457d-92d2-a58554632df2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:08.335719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5120492b-462d-457d-92d2-a58554632df2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:08.336186 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5120492b-462d-457d-92d2-a58554632df2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:08.556579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5120492b-462d-457d-92d2-a58554632df2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:08.564772 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5120492b-462d-457d-92d2-a58554632df2 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1676 microversion: 2.1 time: 0.243898 Jul 25 13:35:08.565370 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3252/6577] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:08 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1676 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:09.589109 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-422ac97c-1d9b-4e74-b932-443303288fb9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:09.590276 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-422ac97c-1d9b-4e74-b932-443303288fb9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:09.598128 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-422ac97c-1d9b-4e74-b932-443303288fb9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:09.598668 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-422ac97c-1d9b-4e74-b932-443303288fb9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:09.599581 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-422ac97c-1d9b-4e74-b932-443303288fb9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:09.600101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-422ac97c-1d9b-4e74-b932-443303288fb9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:09.746241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-422ac97c-1d9b-4e74-b932-443303288fb9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:09.754240 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-422ac97c-1d9b-4e74-b932-443303288fb9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1676 microversion: 2.1 time: 0.171211 Jul 25 13:35:09.754823 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3326/6578] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:09 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:09.879832 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-bc02701a-a0ab-4e56-933d-c86bcc5c8da1 req-ae67ba41-1c10-4ac0-bfa4-e672575b0149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30dd612e-3eb1-44e8-aba8-97c8623283ac", "tag": "c8e496de-c973-474f-a6fb-06ff6a15a253"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:35:09.890543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-bc02701a-a0ab-4e56-933d-c86bcc5c8da1 req-ae67ba41-1c10-4ac0-bfa4-e672575b0149 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:09.891003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-bc02701a-a0ab-4e56-933d-c86bcc5c8da1 req-ae67ba41-1c10-4ac0-bfa4-e672575b0149 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:09.902961 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-bc02701a-a0ab-4e56-933d-c86bcc5c8da1 req-ae67ba41-1c10-4ac0-bfa4-e672575b0149 service nova] Creating event network-changed:c8e496de-c973-474f-a6fb-06ff6a15a253 for instance 30dd612e-3eb1-44e8-aba8-97c8623283ac on n-h2-848886-15 Jul 25 13:35:09.908896 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [req-bc02701a-a0ab-4e56-933d-c86bcc5c8da1 req-ae67ba41-1c10-4ac0-bfa4-e672575b0149 service nova] Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125883) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:35:09.919751 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-bc02701a-a0ab-4e56-933d-c86bcc5c8da1 req-ae67ba41-1c10-4ac0-bfa4-e672575b0149 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044962 Jul 25 13:35:09.920341 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3253/6579] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:35:10.777081 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-81599775-afbb-4d27-87d9-3677f1ec0fbd tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:10.777706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-81599775-afbb-4d27-87d9-3677f1ec0fbd tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:10.784402 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-81599775-afbb-4d27-87d9-3677f1ec0fbd tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:10.785033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-81599775-afbb-4d27-87d9-3677f1ec0fbd tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:10.785905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-81599775-afbb-4d27-87d9-3677f1ec0fbd tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:10.786600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-81599775-afbb-4d27-87d9-3677f1ec0fbd tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:11.191583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-81599775-afbb-4d27-87d9-3677f1ec0fbd tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:11.199512 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-81599775-afbb-4d27-87d9-3677f1ec0fbd tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1669 microversion: 2.1 time: 0.427720 Jul 25 13:35:11.200093 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3327/6580] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:10 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1669 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:11.222132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2c1b550b-511f-4092-868f-8215fbe72567 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:11.222841 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2c1b550b-511f-4092-868f-8215fbe72567 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:11.224829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:35:11.230453 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c1b550b-511f-4092-868f-8215fbe72567 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:11.230921 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c1b550b-511f-4092-868f-8215fbe72567 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:11.231690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c1b550b-511f-4092-868f-8215fbe72567 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:11.232137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c1b550b-511f-4092-868f-8215fbe72567 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:11.368089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2c1b550b-511f-4092-868f-8215fbe72567 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:11.376236 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2c1b550b-511f-4092-868f-8215fbe72567 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1669 microversion: 2.1 time: 0.159296 Jul 25 13:35:11.376922 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3254/6581] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:11 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:11.396526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f3821bc5-0148-47e5-b4c8-ed1372f0dd21 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:11.396990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f3821bc5-0148-47e5-b4c8-ed1372f0dd21 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:11.399176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=35 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:35:11.405212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f3821bc5-0148-47e5-b4c8-ed1372f0dd21 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:11.405779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f3821bc5-0148-47e5-b4c8-ed1372f0dd21 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:11.406692 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f3821bc5-0148-47e5-b4c8-ed1372f0dd21 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:11.407195 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f3821bc5-0148-47e5-b4c8-ed1372f0dd21 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:11.410245 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=99 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:35:11.548490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f3821bc5-0148-47e5-b4c8-ed1372f0dd21 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:11.556326 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f3821bc5-0148-47e5-b4c8-ed1372f0dd21 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1669 microversion: 2.1 time: 0.163987 Jul 25 13:35:11.556876 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3328/6582] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:11 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1669 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:11.577254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2a013294-c2f3-4f98-b330-d17406239697 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:11.577777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2a013294-c2f3-4f98-b330-d17406239697 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:11.584207 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2a013294-c2f3-4f98-b330-d17406239697 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:11.584678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2a013294-c2f3-4f98-b330-d17406239697 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:11.585457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2a013294-c2f3-4f98-b330-d17406239697 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:11.585943 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2a013294-c2f3-4f98-b330-d17406239697 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:11.615517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2a013294-c2f3-4f98-b330-d17406239697 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:35:11.696864 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2a013294-c2f3-4f98-b330-d17406239697 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "DELETE /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 204 len: 0 microversion: 2.1 time: 0.123158 Jul 25 13:35:11.697490 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3255/6583] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:35:11 2022] DELETE /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:35:11.706727 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9ab9e414-6bc6-4d56-8741-f29549abfe09 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:11.706727 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9ab9e414-6bc6-4d56-8741-f29549abfe09 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:11.713089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ab9e414-6bc6-4d56-8741-f29549abfe09 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:11.713212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ab9e414-6bc6-4d56-8741-f29549abfe09 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:11.713978 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ab9e414-6bc6-4d56-8741-f29549abfe09 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:11.714727 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ab9e414-6bc6-4d56-8741-f29549abfe09 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:11.844640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9ab9e414-6bc6-4d56-8741-f29549abfe09 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:11.852502 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9ab9e414-6bc6-4d56-8741-f29549abfe09 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1675 microversion: 2.1 time: 0.150437 Jul 25 13:35:11.853072 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3329/6584] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:11 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:12.875704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6a7e2c76-91f1-4691-9b3e-3988ac2b0a79 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:12.876484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6a7e2c76-91f1-4691-9b3e-3988ac2b0a79 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:12.883843 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a7e2c76-91f1-4691-9b3e-3988ac2b0a79 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:12.884320 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a7e2c76-91f1-4691-9b3e-3988ac2b0a79 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:12.885090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a7e2c76-91f1-4691-9b3e-3988ac2b0a79 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:12.885536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6a7e2c76-91f1-4691-9b3e-3988ac2b0a79 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:13.096710 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6a7e2c76-91f1-4691-9b3e-3988ac2b0a79 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:13.106927 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6a7e2c76-91f1-4691-9b3e-3988ac2b0a79 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1675 microversion: 2.1 time: 0.235681 Jul 25 13:35:13.107809 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3256/6585] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:12 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1675 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:13.441783 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-5daed962-5b3a-4e80-bb20-fe3aeea716f5 req-2d46a613-82bf-4eb4-9e12-8359dbfd6c90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30dd612e-3eb1-44e8-aba8-97c8623283ac", "name": "network-vif-plugged", "status": "completed", "tag": "c8e496de-c973-474f-a6fb-06ff6a15a253"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:35:13.465110 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5daed962-5b3a-4e80-bb20-fe3aeea716f5 req-2d46a613-82bf-4eb4-9e12-8359dbfd6c90 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:13.465803 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5daed962-5b3a-4e80-bb20-fe3aeea716f5 req-2d46a613-82bf-4eb4-9e12-8359dbfd6c90 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:13.479430 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-5daed962-5b3a-4e80-bb20-fe3aeea716f5 req-2d46a613-82bf-4eb4-9e12-8359dbfd6c90 service nova] Creating event network-vif-plugged:c8e496de-c973-474f-a6fb-06ff6a15a253 for instance 30dd612e-3eb1-44e8-aba8-97c8623283ac on n-h2-848886-15 Jul 25 13:35:13.485735 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-5daed962-5b3a-4e80-bb20-fe3aeea716f5 req-2d46a613-82bf-4eb4-9e12-8359dbfd6c90 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048120 Jul 25 13:35:13.487653 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3330/6586] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:35:13.869145 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-2965ff75-f3c3-422c-97a0-b36769cfc912 req-78771caf-af79-4201-b005-04c98f58ed79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30dd612e-3eb1-44e8-aba8-97c8623283ac", "name": "network-vif-deleted", "tag": "c8e496de-c973-474f-a6fb-06ff6a15a253"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:35:13.884141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2965ff75-f3c3-422c-97a0-b36769cfc912 req-78771caf-af79-4201-b005-04c98f58ed79 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:13.884767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2965ff75-f3c3-422c-97a0-b36769cfc912 req-78771caf-af79-4201-b005-04c98f58ed79 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:13.896850 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-2965ff75-f3c3-422c-97a0-b36769cfc912 req-78771caf-af79-4201-b005-04c98f58ed79 service nova] Creating event network-vif-deleted:c8e496de-c973-474f-a6fb-06ff6a15a253 for instance 30dd612e-3eb1-44e8-aba8-97c8623283ac on n-h2-848886-15 Jul 25 13:35:13.903964 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-2965ff75-f3c3-422c-97a0-b36769cfc912 req-78771caf-af79-4201-b005-04c98f58ed79 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038398 Jul 25 13:35:13.904839 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3257/6587] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:35:14.133866 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-57b238e3-29da-4d47-be6e-929d7952f300 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:14.134642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-57b238e3-29da-4d47-be6e-929d7952f300 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:14.141513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57b238e3-29da-4d47-be6e-929d7952f300 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:14.142007 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57b238e3-29da-4d47-be6e-929d7952f300 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:14.142795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57b238e3-29da-4d47-be6e-929d7952f300 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:14.143234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57b238e3-29da-4d47-be6e-929d7952f300 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:14.174983 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57b238e3-29da-4d47-be6e-929d7952f300 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:14.175448 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57b238e3-29da-4d47-be6e-929d7952f300 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:14.175905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-57b238e3-29da-4d47-be6e-929d7952f300 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lazy-loading 'fault' on Instance uuid 30dd612e-3eb1-44e8-aba8-97c8623283ac {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:35:14.221676 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-57b238e3-29da-4d47-be6e-929d7952f300 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:14.229457 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-57b238e3-29da-4d47-be6e-929d7952f300 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 200 len: 1329 microversion: 2.1 time: 0.103013 Jul 25 13:35:14.230039 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3331/6588] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:14 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 1329 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:15.250674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:35:15.257260 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c0adc709-7b07-47bd-95bf-61efc55192c8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:15.258143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c0adc709-7b07-47bd-95bf-61efc55192c8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:15.266220 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0adc709-7b07-47bd-95bf-61efc55192c8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:15.266770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0adc709-7b07-47bd-95bf-61efc55192c8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:15.267690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0adc709-7b07-47bd-95bf-61efc55192c8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:15.268243 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0adc709-7b07-47bd-95bf-61efc55192c8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:15.281868 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-c0adc709-7b07-47bd-95bf-61efc55192c8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] HTTP exception thrown: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c0adc709-7b07-47bd-95bf-61efc55192c8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Request method failure captured: Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac HTTP/1.1 Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3ps2uAMwWcs8JWVJ4Y1EH4DEH-xcoDZUXcQ2SMYQDuHJ6xKZtzlY3crBbh33knI4BRq4-7REpa8QxZBYFHDFdQ0jv_t5oHli9ALSiUgThfzEZ87ovY8e2_XTSuFqSPJM6fPlLXFDiUl-NS1IB6R5YsiH4-NrInN3mZHwxCC9W0hJaI8 Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c79a68ef003f4f3faf0a2d4551c6d5ee", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}] Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 269643d1d0eb465ea092599c11480b71 Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '30dd612e-3eb1-44e8-aba8-97c8623283ac'} Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:35:15.283668 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:35:15.287166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:35:15.287166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:35:15.287166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:35:15.287166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:35:15.287166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:35:15.287166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. Jul 25 13:35:15.287166 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:35:15.287166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c0adc709-7b07-47bd-95bf-61efc55192c8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Returning 404 to user: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:35:15.287166 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c0adc709-7b07-47bd-95bf-61efc55192c8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 404 len: 111 microversion: 2.1 time: 0.036490 Jul 25 13:35:15.287166 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3258/6589] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:15 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:35:15.304164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5c4fe715-dd2f-41d9-b309-ab54c782d21e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:15.304805 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5c4fe715-dd2f-41d9-b309-ab54c782d21e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:15.313652 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c4fe715-dd2f-41d9-b309-ab54c782d21e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:15.314134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c4fe715-dd2f-41d9-b309-ab54c782d21e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:15.314909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c4fe715-dd2f-41d9-b309-ab54c782d21e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:15.315341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c4fe715-dd2f-41d9-b309-ab54c782d21e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:15.334548 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-5c4fe715-dd2f-41d9-b309-ab54c782d21e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] HTTP exception thrown: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5c4fe715-dd2f-41d9-b309-ab54c782d21e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Request method failure captured: Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac HTTP/1.1 Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3ps2uAMwWcs8JWVJ4Y1EH4DEH-xcoDZUXcQ2SMYQDuHJ6xKZtzlY3crBbh33knI4BRq4-7REpa8QxZBYFHDFdQ0jv_t5oHli9ALSiUgThfzEZ87ovY8e2_XTSuFqSPJM6fPlLXFDiUl-NS1IB6R5YsiH4-NrInN3mZHwxCC9W0hJaI8 Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c79a68ef003f4f3faf0a2d4551c6d5ee", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}] Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 269643d1d0eb465ea092599c11480b71 Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '30dd612e-3eb1-44e8-aba8-97c8623283ac'} Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:35:15.336263 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:35:15.340112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:35:15.340112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:35:15.340112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:35:15.340112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:35:15.340112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:35:15.340112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. Jul 25 13:35:15.340112 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:35:15.340112 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5c4fe715-dd2f-41d9-b309-ab54c782d21e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Returning 404 to user: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:35:15.340112 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5c4fe715-dd2f-41d9-b309-ab54c782d21e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 404 len: 111 microversion: 2.1 time: 0.038622 Jul 25 13:35:15.340112 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3332/6590] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:15 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:35:15.466859 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-60a1e7d6-30c0-49b8-b755-fbf8e08c0c5e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1412590389", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "670c2cbc-4b35-45bb-8ba5-a59e7bb64759"}], "security_groups": [{"name": "tempest-securitygroup--395676127"}], "key_name": "tempest-keypair-1831216923", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:35:15.590142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-60a1e7d6-30c0-49b8-b755-fbf8e08c0c5e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] validate_networks() for [('670c2cbc-4b35-45bb-8ba5-a59e7bb64759', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:35:15.972340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-60a1e7d6-30c0-49b8-b755-fbf8e08c0c5e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:35:15.972774 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-60a1e7d6-30c0-49b8-b755-fbf8e08c0c5e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:35:15.973263 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-60a1e7d6-30c0-49b8-b755-fbf8e08c0c5e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:35:15.973683 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-60a1e7d6-30c0-49b8-b755-fbf8e08c0c5e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:35:15.974142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-60a1e7d6-30c0-49b8-b755-fbf8e08c0c5e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:35:15.983678 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-60a1e7d6-30c0-49b8-b755-fbf8e08c0c5e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:15.984142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-60a1e7d6-30c0-49b8-b755-fbf8e08c0c5e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:15.984949 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-60a1e7d6-30c0-49b8-b755-fbf8e08c0c5e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:15.985400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-60a1e7d6-30c0-49b8-b755-fbf8e08c0c5e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:16.002945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-60a1e7d6-30c0-49b8-b755-fbf8e08c0c5e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Getting quotas for project c79a68ef003f4f3faf0a2d4551c6d5ee. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:35:16.008585 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-60a1e7d6-30c0-49b8-b755-fbf8e08c0c5e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Getting quotas for user 269643d1d0eb465ea092599c11480b71 and project c79a68ef003f4f3faf0a2d4551c6d5ee. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:35:16.021481 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-60a1e7d6-30c0-49b8-b755-fbf8e08c0c5e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:35:16.023812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-60a1e7d6-30c0-49b8-b755-fbf8e08c0c5e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:35:16.071542 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-60a1e7d6-30c0-49b8-b755-fbf8e08c0c5e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.612190 Jul 25 13:35:16.072180 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3259/6591] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:35:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:35:16.083588 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-70a0cbff-5208-484e-a18c-a1a24d39c7cf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:16.084240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-70a0cbff-5208-484e-a18c-a1a24d39c7cf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:16.140386 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-70a0cbff-5208-484e-a18c-a1a24d39c7cf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:16.148926 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-70a0cbff-5208-484e-a18c-a1a24d39c7cf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1239 microversion: 2.1 time: 0.069270 Jul 25 13:35:16.149531 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3333/6592] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:16 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:17.170669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2fd5e34b-d6ff-475f-bc7a-753d7bf7c3bb tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:17.171294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2fd5e34b-d6ff-475f-bc7a-753d7bf7c3bb tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:17.179469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fd5e34b-d6ff-475f-bc7a-753d7bf7c3bb tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:17.179926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fd5e34b-d6ff-475f-bc7a-753d7bf7c3bb tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:17.180703 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fd5e34b-d6ff-475f-bc7a-753d7bf7c3bb tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:17.181150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2fd5e34b-d6ff-475f-bc7a-753d7bf7c3bb tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:17.261103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2fd5e34b-d6ff-475f-bc7a-753d7bf7c3bb tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:17.268972 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2fd5e34b-d6ff-475f-bc7a-753d7bf7c3bb tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1297 microversion: 2.1 time: 0.102391 Jul 25 13:35:17.269546 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3260/6593] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:17 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1297 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:18.290619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b9f9b70b-a686-4c30-9a2a-960ebf51cf4a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:18.291207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b9f9b70b-a686-4c30-9a2a-960ebf51cf4a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:18.300100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b9f9b70b-a686-4c30-9a2a-960ebf51cf4a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:18.300842 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b9f9b70b-a686-4c30-9a2a-960ebf51cf4a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:18.301623 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b9f9b70b-a686-4c30-9a2a-960ebf51cf4a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:18.302263 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b9f9b70b-a686-4c30-9a2a-960ebf51cf4a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:18.473939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-a4363ba6-e805-4858-a50e-addd5215f22d req-21f01707-0491-4f43-86e4-a05e95c217d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba901a84-2cab-4507-ad36-a80b00240642", "tag": "49d985f5-5ced-4401-be27-7c2818233f49"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:35:18.493383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a4363ba6-e805-4858-a50e-addd5215f22d req-21f01707-0491-4f43-86e4-a05e95c217d6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:18.494134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-a4363ba6-e805-4858-a50e-addd5215f22d req-21f01707-0491-4f43-86e4-a05e95c217d6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:18.507005 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-a4363ba6-e805-4858-a50e-addd5215f22d req-21f01707-0491-4f43-86e4-a05e95c217d6 service nova] Creating event network-changed:49d985f5-5ced-4401-be27-7c2818233f49 for instance ba901a84-2cab-4507-ad36-a80b00240642 on n-h1-848886-15 Jul 25 13:35:18.512941 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-a4363ba6-e805-4858-a50e-addd5215f22d req-21f01707-0491-4f43-86e4-a05e95c217d6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043349 Jul 25 13:35:18.514163 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3261/6594] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:35:18.563389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b9f9b70b-a686-4c30-9a2a-960ebf51cf4a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:18.572239 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b9f9b70b-a686-4c30-9a2a-960ebf51cf4a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1364 microversion: 2.1 time: 0.285393 Jul 25 13:35:18.572830 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3334/6595] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:18 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1364 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:19.598846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9ddf8d29-c8fd-4a02-9268-fe3ab6fdc8d0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:19.599603 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9ddf8d29-c8fd-4a02-9268-fe3ab6fdc8d0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:19.606391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ddf8d29-c8fd-4a02-9268-fe3ab6fdc8d0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:19.606852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ddf8d29-c8fd-4a02-9268-fe3ab6fdc8d0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:19.607628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ddf8d29-c8fd-4a02-9268-fe3ab6fdc8d0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:19.608073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ddf8d29-c8fd-4a02-9268-fe3ab6fdc8d0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:19.816602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9ddf8d29-c8fd-4a02-9268-fe3ab6fdc8d0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:19.825524 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9ddf8d29-c8fd-4a02-9268-fe3ab6fdc8d0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1364 microversion: 2.1 time: 0.233530 Jul 25 13:35:19.826336 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3262/6596] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:19 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:20.848273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a5f00382-f6a9-4e92-96ff-4ab75ecabac9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:20.848865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a5f00382-f6a9-4e92-96ff-4ab75ecabac9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:20.856267 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5f00382-f6a9-4e92-96ff-4ab75ecabac9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:20.856726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5f00382-f6a9-4e92-96ff-4ab75ecabac9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:20.857518 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5f00382-f6a9-4e92-96ff-4ab75ecabac9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:20.857967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a5f00382-f6a9-4e92-96ff-4ab75ecabac9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:21.000527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a5f00382-f6a9-4e92-96ff-4ab75ecabac9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:21.008870 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a5f00382-f6a9-4e92-96ff-4ab75ecabac9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1364 microversion: 2.1 time: 0.164756 Jul 25 13:35:21.009460 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3335/6597] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:20 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:22.032038 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-04247432-58f7-404f-a9c9-cd9633791c74 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:22.032667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-04247432-58f7-404f-a9c9-cd9633791c74 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:22.040968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-04247432-58f7-404f-a9c9-cd9633791c74 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:22.041435 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-04247432-58f7-404f-a9c9-cd9633791c74 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:22.042240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-04247432-58f7-404f-a9c9-cd9633791c74 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:22.042683 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-04247432-58f7-404f-a9c9-cd9633791c74 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:22.191319 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-04247432-58f7-404f-a9c9-cd9633791c74 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:22.199616 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-04247432-58f7-404f-a9c9-cd9633791c74 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1364 microversion: 2.1 time: 0.171852 Jul 25 13:35:22.200182 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3263/6598] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:22 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:22.947661 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-8efc5888-7829-45c1-8a0e-f682ea047edd req-82bbd6df-e6ff-456a-8d35-13ceeb3cd7df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba901a84-2cab-4507-ad36-a80b00240642", "name": "network-vif-plugged", "status": "completed", "tag": "49d985f5-5ced-4401-be27-7c2818233f49"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:35:22.959319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-8efc5888-7829-45c1-8a0e-f682ea047edd req-82bbd6df-e6ff-456a-8d35-13ceeb3cd7df service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:22.959836 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-8efc5888-7829-45c1-8a0e-f682ea047edd req-82bbd6df-e6ff-456a-8d35-13ceeb3cd7df service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:22.972053 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-8efc5888-7829-45c1-8a0e-f682ea047edd req-82bbd6df-e6ff-456a-8d35-13ceeb3cd7df service nova] Creating event network-vif-plugged:49d985f5-5ced-4401-be27-7c2818233f49 for instance ba901a84-2cab-4507-ad36-a80b00240642 on n-h1-848886-15 Jul 25 13:35:22.977079 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-8efc5888-7829-45c1-8a0e-f682ea047edd req-82bbd6df-e6ff-456a-8d35-13ceeb3cd7df service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033277 Jul 25 13:35:22.977714 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3336/6599] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:35:23.223127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-39e88a2f-c757-4a10-95f3-72bd538f01ba tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:23.223763 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-39e88a2f-c757-4a10-95f3-72bd538f01ba tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:23.232348 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39e88a2f-c757-4a10-95f3-72bd538f01ba tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:23.232978 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39e88a2f-c757-4a10-95f3-72bd538f01ba tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:23.234043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39e88a2f-c757-4a10-95f3-72bd538f01ba tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:23.234500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39e88a2f-c757-4a10-95f3-72bd538f01ba tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:23.380980 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-39e88a2f-c757-4a10-95f3-72bd538f01ba tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:23.392419 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-39e88a2f-c757-4a10-95f3-72bd538f01ba tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1364 microversion: 2.1 time: 0.173718 Jul 25 13:35:23.392999 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3264/6600] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:23 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:24.422338 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1dd39276-063b-4111-bd7f-be46aab1bb38 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:24.422954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1dd39276-063b-4111-bd7f-be46aab1bb38 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:24.430280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dd39276-063b-4111-bd7f-be46aab1bb38 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:24.431119 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dd39276-063b-4111-bd7f-be46aab1bb38 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:24.432032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dd39276-063b-4111-bd7f-be46aab1bb38 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:24.432497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dd39276-063b-4111-bd7f-be46aab1bb38 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:24.576275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1dd39276-063b-4111-bd7f-be46aab1bb38 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:24.584913 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1dd39276-063b-4111-bd7f-be46aab1bb38 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1550 microversion: 2.1 time: 0.169798 Jul 25 13:35:24.585512 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3337/6601] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:24 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1550 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:24.611771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b7fca7f5-82c0-433f-b0d3-884cf50fef6e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:24.612275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b7fca7f5-82c0-433f-b0d3-884cf50fef6e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:24.619275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b7fca7f5-82c0-433f-b0d3-884cf50fef6e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:24.619736 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b7fca7f5-82c0-433f-b0d3-884cf50fef6e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:24.620520 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b7fca7f5-82c0-433f-b0d3-884cf50fef6e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:24.620966 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b7fca7f5-82c0-433f-b0d3-884cf50fef6e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:24.709691 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b7fca7f5-82c0-433f-b0d3-884cf50fef6e tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102330 Jul 25 13:35:24.710303 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3265/6602] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 13:35:24 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:35:26.040501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-933497f8-394f-4928-915c-619f57bfb466 req-33041f4d-023f-4bb3-887e-740b1dde157d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba901a84-2cab-4507-ad36-a80b00240642", "tag": "49d985f5-5ced-4401-be27-7c2818233f49"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:35:26.051635 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-933497f8-394f-4928-915c-619f57bfb466 req-33041f4d-023f-4bb3-887e-740b1dde157d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:26.052085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-933497f8-394f-4928-915c-619f57bfb466 req-33041f4d-023f-4bb3-887e-740b1dde157d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:26.063611 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-933497f8-394f-4928-915c-619f57bfb466 req-33041f4d-023f-4bb3-887e-740b1dde157d service nova] Creating event network-changed:49d985f5-5ced-4401-be27-7c2818233f49 for instance ba901a84-2cab-4507-ad36-a80b00240642 on n-h1-848886-15 Jul 25 13:35:26.068621 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-933497f8-394f-4928-915c-619f57bfb466 req-33041f4d-023f-4bb3-887e-740b1dde157d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031917 Jul 25 13:35:26.069309 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3338/6603] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:35:57.887238 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:35:57.888171 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:35:57.888922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:35:57.889556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:35:57.893729 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-84010156-16bf-49a9-a67c-bd5c7d4b1769 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:35:57.894385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-84010156-16bf-49a9-a67c-bd5c7d4b1769 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:57.903632 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-84010156-16bf-49a9-a67c-bd5c7d4b1769 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:57.904093 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-84010156-16bf-49a9-a67c-bd5c7d4b1769 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:57.904871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-84010156-16bf-49a9-a67c-bd5c7d4b1769 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:57.905316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-84010156-16bf-49a9-a67c-bd5c7d4b1769 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:58.136808 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-84010156-16bf-49a9-a67c-bd5c7d4b1769 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:35:58.144707 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-84010156-16bf-49a9-a67c-bd5c7d4b1769 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1669 microversion: 2.1 time: 0.259593 Jul 25 13:35:58.145291 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3266/6604] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:35:57 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1669 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:35:58.162554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:35:58.165067 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=25 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:35:58.165736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=45 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:35:58.170842 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f78b6357-c31c-4e7b-9bd7-f8794fc7f010 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d71ca4ac-1541-471a-b7f0-c63eb12dfec8"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:35:58.173294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f78b6357-c31c-4e7b-9bd7-f8794fc7f010 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:35:58.180884 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f78b6357-c31c-4e7b-9bd7-f8794fc7f010 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:58.181341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f78b6357-c31c-4e7b-9bd7-f8794fc7f010 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:58.182165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f78b6357-c31c-4e7b-9bd7-f8794fc7f010 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:35:58.182599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f78b6357-c31c-4e7b-9bd7-f8794fc7f010 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:35:58.500954 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f78b6357-c31c-4e7b-9bd7-f8794fc7f010 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "POST /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.339108 Jul 25 13:35:58.501694 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3339/6605] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Jul 25 13:35:58 2022] POST /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:36:09.486339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ec2e247e-a3a9-45b0-96aa-11b4406f39d7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:36:09.488687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ec2e247e-a3a9-45b0-96aa-11b4406f39d7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:09.491310 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:36:09.492097 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:36:09.498144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec2e247e-a3a9-45b0-96aa-11b4406f39d7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:09.498612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec2e247e-a3a9-45b0-96aa-11b4406f39d7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:09.499408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec2e247e-a3a9-45b0-96aa-11b4406f39d7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:09.499991 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ec2e247e-a3a9-45b0-96aa-11b4406f39d7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:09.533012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ec2e247e-a3a9-45b0-96aa-11b4406f39d7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:09.540078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ec2e247e-a3a9-45b0-96aa-11b4406f39d7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Old instance type m1.heat2, new instance type m1.heat {{(pid=125883) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 13:36:09.547694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-ec2e247e-a3a9-45b0-96aa-11b4406f39d7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:36:09.548127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-ec2e247e-a3a9-45b0-96aa-11b4406f39d7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:36:09.548717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-ec2e247e-a3a9-45b0-96aa-11b4406f39d7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:36:09.549394 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-ec2e247e-a3a9-45b0-96aa-11b4406f39d7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:36:09.549394 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-ec2e247e-a3a9-45b0-96aa-11b4406f39d7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:36:09.618268 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ec2e247e-a3a9-45b0-96aa-11b4406f39d7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "POST /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642/action" status: 202 len: 0 microversion: 2.1 time: 0.135907 Jul 25 13:36:09.618955 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3267/6606] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:36:09 2022] POST /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:36:09.625449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:36:09.626593 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:36:09.632070 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fc5f7db6-993c-43e7-a26b-579745abf001 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:09.632920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fc5f7db6-993c-43e7-a26b-579745abf001 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:09.641710 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc5f7db6-993c-43e7-a26b-579745abf001 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:09.642258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc5f7db6-993c-43e7-a26b-579745abf001 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:09.643222 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc5f7db6-993c-43e7-a26b-579745abf001 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:09.643709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc5f7db6-993c-43e7-a26b-579745abf001 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:09.950426 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fc5f7db6-993c-43e7-a26b-579745abf001 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:09.958730 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fc5f7db6-993c-43e7-a26b-579745abf001 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1724 microversion: 2.1 time: 0.335175 Jul 25 13:36:09.959313 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3340/6607] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:09 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1724 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:10.981207 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-936a500e-7d96-43be-8afc-67d6ace417f4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:10.982439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-936a500e-7d96-43be-8afc-67d6ace417f4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:10.990377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-936a500e-7d96-43be-8afc-67d6ace417f4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:10.990987 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-936a500e-7d96-43be-8afc-67d6ace417f4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:10.991831 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-936a500e-7d96-43be-8afc-67d6ace417f4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:10.992404 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-936a500e-7d96-43be-8afc-67d6ace417f4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:11.319106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-936a500e-7d96-43be-8afc-67d6ace417f4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:11.327882 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-936a500e-7d96-43be-8afc-67d6ace417f4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1724 microversion: 2.1 time: 0.350983 Jul 25 13:36:11.328485 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3268/6608] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:10 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1724 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:12.350048 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b579ae32-338d-4ac5-9a40-da092e808348 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:12.350675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b579ae32-338d-4ac5-9a40-da092e808348 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:12.358839 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b579ae32-338d-4ac5-9a40-da092e808348 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:12.359293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b579ae32-338d-4ac5-9a40-da092e808348 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:12.360206 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b579ae32-338d-4ac5-9a40-da092e808348 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:12.360691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b579ae32-338d-4ac5-9a40-da092e808348 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:12.506346 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b579ae32-338d-4ac5-9a40-da092e808348 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:12.516055 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b579ae32-338d-4ac5-9a40-da092e808348 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1729 microversion: 2.1 time: 0.170937 Jul 25 13:36:12.516640 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3341/6609] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:12 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:13.540468 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-82d565b6-aec8-44d0-844c-65e8aeaf2e34 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:13.541933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-82d565b6-aec8-44d0-844c-65e8aeaf2e34 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:13.549455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82d565b6-aec8-44d0-844c-65e8aeaf2e34 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:13.550210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82d565b6-aec8-44d0-844c-65e8aeaf2e34 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:13.551390 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82d565b6-aec8-44d0-844c-65e8aeaf2e34 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:13.552048 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-82d565b6-aec8-44d0-844c-65e8aeaf2e34 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:13.706047 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-82d565b6-aec8-44d0-844c-65e8aeaf2e34 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:13.717426 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-82d565b6-aec8-44d0-844c-65e8aeaf2e34 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1729 microversion: 2.1 time: 0.180913 Jul 25 13:36:13.718020 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3269/6610] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:13 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:14.740535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b974d5c5-90b6-4bf1-85cf-a4acd6c0ae84 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:14.741162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b974d5c5-90b6-4bf1-85cf-a4acd6c0ae84 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:14.748838 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b974d5c5-90b6-4bf1-85cf-a4acd6c0ae84 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:14.749323 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b974d5c5-90b6-4bf1-85cf-a4acd6c0ae84 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:14.750194 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b974d5c5-90b6-4bf1-85cf-a4acd6c0ae84 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:14.750641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b974d5c5-90b6-4bf1-85cf-a4acd6c0ae84 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:14.896031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b974d5c5-90b6-4bf1-85cf-a4acd6c0ae84 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:14.905013 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b974d5c5-90b6-4bf1-85cf-a4acd6c0ae84 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1729 microversion: 2.1 time: 0.169011 Jul 25 13:36:14.905621 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3342/6611] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:14 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:15.927275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a308e856-12c7-49ad-966f-cb3349caeb58 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:15.927877 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a308e856-12c7-49ad-966f-cb3349caeb58 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:15.935436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a308e856-12c7-49ad-966f-cb3349caeb58 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:15.935900 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a308e856-12c7-49ad-966f-cb3349caeb58 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:15.936693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a308e856-12c7-49ad-966f-cb3349caeb58 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:15.937140 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a308e856-12c7-49ad-966f-cb3349caeb58 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:16.077516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a308e856-12c7-49ad-966f-cb3349caeb58 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:16.086185 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a308e856-12c7-49ad-966f-cb3349caeb58 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1729 microversion: 2.1 time: 0.163205 Jul 25 13:36:16.086790 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3270/6612] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:15 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:17.124136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c2c58293-d5da-461a-a691-0f5981230249 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:17.124542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c2c58293-d5da-461a-a691-0f5981230249 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:17.132364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c2c58293-d5da-461a-a691-0f5981230249 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:17.132821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c2c58293-d5da-461a-a691-0f5981230249 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:17.133586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c2c58293-d5da-461a-a691-0f5981230249 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:17.134134 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c2c58293-d5da-461a-a691-0f5981230249 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:17.275376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c2c58293-d5da-461a-a691-0f5981230249 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:17.286623 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c2c58293-d5da-461a-a691-0f5981230249 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1729 microversion: 2.1 time: 0.166261 Jul 25 13:36:17.287669 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3343/6613] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:17 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:18.310142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-20811328-de0d-465a-8d78-56dbd3bc8f3b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:18.310826 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-20811328-de0d-465a-8d78-56dbd3bc8f3b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:18.318711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20811328-de0d-465a-8d78-56dbd3bc8f3b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:18.319192 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20811328-de0d-465a-8d78-56dbd3bc8f3b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:18.319979 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20811328-de0d-465a-8d78-56dbd3bc8f3b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:18.320421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20811328-de0d-465a-8d78-56dbd3bc8f3b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:18.458638 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-20811328-de0d-465a-8d78-56dbd3bc8f3b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:18.467212 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-20811328-de0d-465a-8d78-56dbd3bc8f3b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1729 microversion: 2.1 time: 0.161573 Jul 25 13:36:18.467788 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3271/6614] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:18 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:19.492158 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e11e962b-4ef8-4bb4-a215-7d7f7ab25f36 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:19.492774 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e11e962b-4ef8-4bb4-a215-7d7f7ab25f36 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:19.503556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e11e962b-4ef8-4bb4-a215-7d7f7ab25f36 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:19.504020 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e11e962b-4ef8-4bb4-a215-7d7f7ab25f36 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:19.504871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e11e962b-4ef8-4bb4-a215-7d7f7ab25f36 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:19.505355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e11e962b-4ef8-4bb4-a215-7d7f7ab25f36 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:19.656156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e11e962b-4ef8-4bb4-a215-7d7f7ab25f36 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:19.665472 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e11e962b-4ef8-4bb4-a215-7d7f7ab25f36 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1729 microversion: 2.1 time: 0.179302 Jul 25 13:36:19.666139 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3344/6615] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:19 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:20.690126 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-711b3de8-899d-4b9a-b2a9-707fe019e7b3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:20.690789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-711b3de8-899d-4b9a-b2a9-707fe019e7b3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:20.698503 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-711b3de8-899d-4b9a-b2a9-707fe019e7b3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:20.698973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-711b3de8-899d-4b9a-b2a9-707fe019e7b3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:20.699761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-711b3de8-899d-4b9a-b2a9-707fe019e7b3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:20.700211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-711b3de8-899d-4b9a-b2a9-707fe019e7b3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:20.845009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-711b3de8-899d-4b9a-b2a9-707fe019e7b3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:20.857430 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-711b3de8-899d-4b9a-b2a9-707fe019e7b3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1729 microversion: 2.1 time: 0.172680 Jul 25 13:36:20.858247 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3272/6616] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:20 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:21.886419 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5c8de3c3-8226-4917-afba-058cd4819a05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:21.887117 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5c8de3c3-8226-4917-afba-058cd4819a05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:21.896902 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c8de3c3-8226-4917-afba-058cd4819a05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:21.897345 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c8de3c3-8226-4917-afba-058cd4819a05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:21.898177 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c8de3c3-8226-4917-afba-058cd4819a05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:21.898621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c8de3c3-8226-4917-afba-058cd4819a05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:22.058955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5c8de3c3-8226-4917-afba-058cd4819a05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:22.069571 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5c8de3c3-8226-4917-afba-058cd4819a05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1729 microversion: 2.1 time: 0.189383 Jul 25 13:36:22.070290 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3345/6617] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:21 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:23.092012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-21f3116b-9d8c-4bca-85eb-a5dbe9f24c5c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:23.092604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-21f3116b-9d8c-4bca-85eb-a5dbe9f24c5c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:23.099777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-21f3116b-9d8c-4bca-85eb-a5dbe9f24c5c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:23.100236 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-21f3116b-9d8c-4bca-85eb-a5dbe9f24c5c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:23.100989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-21f3116b-9d8c-4bca-85eb-a5dbe9f24c5c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:23.101432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-21f3116b-9d8c-4bca-85eb-a5dbe9f24c5c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:23.262305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-21f3116b-9d8c-4bca-85eb-a5dbe9f24c5c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:23.273700 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-21f3116b-9d8c-4bca-85eb-a5dbe9f24c5c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1729 microversion: 2.1 time: 0.185748 Jul 25 13:36:23.274439 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3273/6618] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:23 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:24.296562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f16cb672-7ac2-4515-b796-5d2b1ef33dde tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:24.297195 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f16cb672-7ac2-4515-b796-5d2b1ef33dde tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:24.306768 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f16cb672-7ac2-4515-b796-5d2b1ef33dde tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:24.307539 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f16cb672-7ac2-4515-b796-5d2b1ef33dde tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:24.308536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f16cb672-7ac2-4515-b796-5d2b1ef33dde tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:24.309136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f16cb672-7ac2-4515-b796-5d2b1ef33dde tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:24.467784 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f16cb672-7ac2-4515-b796-5d2b1ef33dde tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:24.477706 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f16cb672-7ac2-4515-b796-5d2b1ef33dde tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1729 microversion: 2.1 time: 0.185389 Jul 25 13:36:24.478405 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3346/6619] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:24 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:25.500900 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e7abc5b1-5f2e-422e-8341-8e00cd17d8f0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:25.501801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e7abc5b1-5f2e-422e-8341-8e00cd17d8f0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:25.510195 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e7abc5b1-5f2e-422e-8341-8e00cd17d8f0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:25.510668 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e7abc5b1-5f2e-422e-8341-8e00cd17d8f0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:25.511498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e7abc5b1-5f2e-422e-8341-8e00cd17d8f0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:25.511944 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e7abc5b1-5f2e-422e-8341-8e00cd17d8f0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:25.665219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e7abc5b1-5f2e-422e-8341-8e00cd17d8f0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:25.675370 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e7abc5b1-5f2e-422e-8341-8e00cd17d8f0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1729 microversion: 2.1 time: 0.178702 Jul 25 13:36:25.676022 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3274/6620] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:25 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:26.706046 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0e6098b9-bcd1-4418-b21a-1178b9715307 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:26.706798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0e6098b9-bcd1-4418-b21a-1178b9715307 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:26.716524 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e6098b9-bcd1-4418-b21a-1178b9715307 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:26.716997 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e6098b9-bcd1-4418-b21a-1178b9715307 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:26.724479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e6098b9-bcd1-4418-b21a-1178b9715307 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:26.724479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e6098b9-bcd1-4418-b21a-1178b9715307 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:26.866814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0e6098b9-bcd1-4418-b21a-1178b9715307 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:26.875728 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0e6098b9-bcd1-4418-b21a-1178b9715307 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1729 microversion: 2.1 time: 0.174981 Jul 25 13:36:26.876318 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3347/6621] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:26 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:27.902602 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bcaebc78-b2f2-4233-981b-d8d7833d3d64 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:27.903250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bcaebc78-b2f2-4233-981b-d8d7833d3d64 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:27.911478 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bcaebc78-b2f2-4233-981b-d8d7833d3d64 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:27.911953 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bcaebc78-b2f2-4233-981b-d8d7833d3d64 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:27.912790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bcaebc78-b2f2-4233-981b-d8d7833d3d64 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:27.913238 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bcaebc78-b2f2-4233-981b-d8d7833d3d64 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:28.087345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bcaebc78-b2f2-4233-981b-d8d7833d3d64 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:28.097713 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bcaebc78-b2f2-4233-981b-d8d7833d3d64 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1729 microversion: 2.1 time: 0.199427 Jul 25 13:36:28.098433 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3275/6622] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:27 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:29.121757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9ebdad23-a297-4b9b-b6ca-38f63ed89c4d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:29.123231 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9ebdad23-a297-4b9b-b6ca-38f63ed89c4d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:29.131000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ebdad23-a297-4b9b-b6ca-38f63ed89c4d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:29.131459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ebdad23-a297-4b9b-b6ca-38f63ed89c4d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:29.132254 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ebdad23-a297-4b9b-b6ca-38f63ed89c4d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:29.132744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ebdad23-a297-4b9b-b6ca-38f63ed89c4d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:29.278024 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9ebdad23-a297-4b9b-b6ca-38f63ed89c4d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:29.287350 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9ebdad23-a297-4b9b-b6ca-38f63ed89c4d tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1729 microversion: 2.1 time: 0.170555 Jul 25 13:36:29.288262 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3348/6623] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:29 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:30.309051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8b3148b4-c232-41e1-a432-347cda8a259f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:30.309619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8b3148b4-c232-41e1-a432-347cda8a259f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:30.318578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b3148b4-c232-41e1-a432-347cda8a259f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:30.319036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b3148b4-c232-41e1-a432-347cda8a259f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:30.319839 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b3148b4-c232-41e1-a432-347cda8a259f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:30.320278 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b3148b4-c232-41e1-a432-347cda8a259f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:30.473685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8b3148b4-c232-41e1-a432-347cda8a259f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:30.482551 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8b3148b4-c232-41e1-a432-347cda8a259f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1729 microversion: 2.1 time: 0.177687 Jul 25 13:36:30.483134 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3276/6624] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:30 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:31.509809 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a7673c68-9415-4d98-b910-533b0a42dc56 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:31.510880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a7673c68-9415-4d98-b910-533b0a42dc56 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:31.519389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7673c68-9415-4d98-b910-533b0a42dc56 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:31.520162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7673c68-9415-4d98-b910-533b0a42dc56 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:31.520620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7673c68-9415-4d98-b910-533b0a42dc56 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:31.521284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7673c68-9415-4d98-b910-533b0a42dc56 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:31.753226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a7673c68-9415-4d98-b910-533b0a42dc56 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:31.762464 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a7673c68-9415-4d98-b910-533b0a42dc56 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1728 microversion: 2.1 time: 0.260756 Jul 25 13:36:31.763355 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3349/6625] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:31 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1728 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:31.826875 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-3e7deb38-4196-4d7c-a142-4c16f529f389 req-9a230499-d144-4aec-855f-8c9b373b69e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba901a84-2cab-4507-ad36-a80b00240642", "name": "network-vif-unplugged", "status": "completed", "tag": "49d985f5-5ced-4401-be27-7c2818233f49"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:36:31.842850 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-3e7deb38-4196-4d7c-a142-4c16f529f389 req-9a230499-d144-4aec-855f-8c9b373b69e8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:31.843340 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-3e7deb38-4196-4d7c-a142-4c16f529f389 req-9a230499-d144-4aec-855f-8c9b373b69e8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:31.857446 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-3e7deb38-4196-4d7c-a142-4c16f529f389 req-9a230499-d144-4aec-855f-8c9b373b69e8 service nova] Creating event network-vif-unplugged:49d985f5-5ced-4401-be27-7c2818233f49 for instance ba901a84-2cab-4507-ad36-a80b00240642 on n-h2-848886-15 Jul 25 13:36:31.863787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [req-3e7deb38-4196-4d7c-a142-4c16f529f389 req-9a230499-d144-4aec-855f-8c9b373b69e8 service nova] Instance ba901a84-2cab-4507-ad36-a80b00240642 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125883) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:36:31.876124 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-3e7deb38-4196-4d7c-a142-4c16f529f389 req-9a230499-d144-4aec-855f-8c9b373b69e8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054123 Jul 25 13:36:31.876763 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3277/6626] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:36:32.786824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cbbcab99-8f81-4510-a21a-0eb2bb61df90 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:32.787506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cbbcab99-8f81-4510-a21a-0eb2bb61df90 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:32.794801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cbbcab99-8f81-4510-a21a-0eb2bb61df90 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:32.795256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cbbcab99-8f81-4510-a21a-0eb2bb61df90 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:32.796035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cbbcab99-8f81-4510-a21a-0eb2bb61df90 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:32.796548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cbbcab99-8f81-4510-a21a-0eb2bb61df90 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:33.033636 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cbbcab99-8f81-4510-a21a-0eb2bb61df90 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:33.046753 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cbbcab99-8f81-4510-a21a-0eb2bb61df90 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1728 microversion: 2.1 time: 0.265134 Jul 25 13:36:33.047443 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3350/6627] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:32 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1728 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:33.895388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-dda1ad06-f8ec-45e8-a638-bff52228e0b1 req-6084ea0a-2329-4393-9aef-6e12ef6de3fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba901a84-2cab-4507-ad36-a80b00240642", "tag": "49d985f5-5ced-4401-be27-7c2818233f49"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:36:33.906467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-dda1ad06-f8ec-45e8-a638-bff52228e0b1 req-6084ea0a-2329-4393-9aef-6e12ef6de3fa service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:33.907107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-dda1ad06-f8ec-45e8-a638-bff52228e0b1 req-6084ea0a-2329-4393-9aef-6e12ef6de3fa service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:33.920783 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-dda1ad06-f8ec-45e8-a638-bff52228e0b1 req-6084ea0a-2329-4393-9aef-6e12ef6de3fa service nova] Creating event network-changed:49d985f5-5ced-4401-be27-7c2818233f49 for instance ba901a84-2cab-4507-ad36-a80b00240642 on n-h2-848886-15 Jul 25 13:36:33.927367 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [req-dda1ad06-f8ec-45e8-a638-bff52228e0b1 req-6084ea0a-2329-4393-9aef-6e12ef6de3fa service nova] Instance ba901a84-2cab-4507-ad36-a80b00240642 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125883) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:36:33.938961 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-dda1ad06-f8ec-45e8-a638-bff52228e0b1 req-6084ea0a-2329-4393-9aef-6e12ef6de3fa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049141 Jul 25 13:36:33.939936 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3278/6628] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:36:34.071258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-01349dcf-487e-4dc3-a683-ffbeaaef526a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:34.071922 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-01349dcf-487e-4dc3-a683-ffbeaaef526a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:34.084406 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01349dcf-487e-4dc3-a683-ffbeaaef526a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:34.085133 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01349dcf-487e-4dc3-a683-ffbeaaef526a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:34.086442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01349dcf-487e-4dc3-a683-ffbeaaef526a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:34.087328 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01349dcf-487e-4dc3-a683-ffbeaaef526a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:34.898565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-01349dcf-487e-4dc3-a683-ffbeaaef526a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:34.912471 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-01349dcf-487e-4dc3-a683-ffbeaaef526a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1726 microversion: 2.1 time: 0.845134 Jul 25 13:36:34.913737 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3351/6629] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:34 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1726 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:35.940002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-06b38858-de95-43f5-b2b3-9473f10a9828 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:35.940841 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-06b38858-de95-43f5-b2b3-9473f10a9828 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:35.948538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06b38858-de95-43f5-b2b3-9473f10a9828 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:35.949009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06b38858-de95-43f5-b2b3-9473f10a9828 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:35.949874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06b38858-de95-43f5-b2b3-9473f10a9828 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:35.950301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-06b38858-de95-43f5-b2b3-9473f10a9828 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:36.123792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-06b38858-de95-43f5-b2b3-9473f10a9828 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:36.129705 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-06b38858-de95-43f5-b2b3-9473f10a9828 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1726 microversion: 2.1 time: 0.195069 Jul 25 13:36:36.130674 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3279/6630] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:35 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1726 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:37.152197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-562fa1c9-fa0d-41fd-a88b-a77f4f42ec1a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:37.152861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-562fa1c9-fa0d-41fd-a88b-a77f4f42ec1a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:37.163950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-562fa1c9-fa0d-41fd-a88b-a77f4f42ec1a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:37.164411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-562fa1c9-fa0d-41fd-a88b-a77f4f42ec1a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:37.165219 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-562fa1c9-fa0d-41fd-a88b-a77f4f42ec1a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:37.165670 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-562fa1c9-fa0d-41fd-a88b-a77f4f42ec1a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:37.308691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-562fa1c9-fa0d-41fd-a88b-a77f4f42ec1a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:37.320792 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-562fa1c9-fa0d-41fd-a88b-a77f4f42ec1a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1726 microversion: 2.1 time: 0.172756 Jul 25 13:36:37.330720 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3352/6631] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:37 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:38.345513 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3657b542-22cf-46f8-9f91-7d7fa4850b15 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:38.346160 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3657b542-22cf-46f8-9f91-7d7fa4850b15 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:38.353488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3657b542-22cf-46f8-9f91-7d7fa4850b15 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:38.354011 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3657b542-22cf-46f8-9f91-7d7fa4850b15 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:38.354812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3657b542-22cf-46f8-9f91-7d7fa4850b15 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:38.355265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3657b542-22cf-46f8-9f91-7d7fa4850b15 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:38.498493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3657b542-22cf-46f8-9f91-7d7fa4850b15 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:38.507194 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3657b542-22cf-46f8-9f91-7d7fa4850b15 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1726 microversion: 2.1 time: 0.165701 Jul 25 13:36:38.507784 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3280/6632] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:38 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:39.530148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-10ded5d2-cac7-4116-98c8-bf0d2e793ec9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:39.530790 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-10ded5d2-cac7-4116-98c8-bf0d2e793ec9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:39.538577 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10ded5d2-cac7-4116-98c8-bf0d2e793ec9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:39.539034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10ded5d2-cac7-4116-98c8-bf0d2e793ec9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:39.539815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10ded5d2-cac7-4116-98c8-bf0d2e793ec9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:39.540247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-10ded5d2-cac7-4116-98c8-bf0d2e793ec9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:39.679617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-10ded5d2-cac7-4116-98c8-bf0d2e793ec9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:39.682104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=83 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:36:39.690474 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-10ded5d2-cac7-4116-98c8-bf0d2e793ec9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1726 microversion: 2.1 time: 0.165078 Jul 25 13:36:39.691051 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3353/6633] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:39 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:40.715241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e72e2cff-9331-4055-b11a-fd2d0d737f84 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:40.715885 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e72e2cff-9331-4055-b11a-fd2d0d737f84 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:40.718937 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=33 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:36:40.724880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e72e2cff-9331-4055-b11a-fd2d0d737f84 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:40.725345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e72e2cff-9331-4055-b11a-fd2d0d737f84 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:40.726177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e72e2cff-9331-4055-b11a-fd2d0d737f84 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:40.726649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e72e2cff-9331-4055-b11a-fd2d0d737f84 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:40.729707 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:36:40.880226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e72e2cff-9331-4055-b11a-fd2d0d737f84 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:40.889293 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e72e2cff-9331-4055-b11a-fd2d0d737f84 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1726 microversion: 2.1 time: 0.178430 Jul 25 13:36:40.889920 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3281/6634] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:40 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:41.911021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e7ed4c12-841d-48d3-b36c-fdfbde26d5e8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:41.911619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e7ed4c12-841d-48d3-b36c-fdfbde26d5e8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:41.914495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=29 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:36:41.920130 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e7ed4c12-841d-48d3-b36c-fdfbde26d5e8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:41.920579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e7ed4c12-841d-48d3-b36c-fdfbde26d5e8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:41.921358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e7ed4c12-841d-48d3-b36c-fdfbde26d5e8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:41.921795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e7ed4c12-841d-48d3-b36c-fdfbde26d5e8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:42.065189 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e7ed4c12-841d-48d3-b36c-fdfbde26d5e8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:42.074252 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e7ed4c12-841d-48d3-b36c-fdfbde26d5e8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1726 microversion: 2.1 time: 0.167211 Jul 25 13:36:42.075077 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3354/6635] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:41 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:43.097905 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e63ef6da-d569-4dab-b2a4-4591486016f0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:43.098904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e63ef6da-d569-4dab-b2a4-4591486016f0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:43.110359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e63ef6da-d569-4dab-b2a4-4591486016f0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:43.111274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e63ef6da-d569-4dab-b2a4-4591486016f0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:43.119104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e63ef6da-d569-4dab-b2a4-4591486016f0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:43.119104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e63ef6da-d569-4dab-b2a4-4591486016f0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:43.262916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e63ef6da-d569-4dab-b2a4-4591486016f0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:43.271477 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e63ef6da-d569-4dab-b2a4-4591486016f0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1726 microversion: 2.1 time: 0.179382 Jul 25 13:36:43.272065 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3282/6636] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:43 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1726 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:44.293722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-88d79d7a-82fd-44de-a13f-fffee8ea37c9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:44.294380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-88d79d7a-82fd-44de-a13f-fffee8ea37c9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:44.302360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88d79d7a-82fd-44de-a13f-fffee8ea37c9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:44.302811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88d79d7a-82fd-44de-a13f-fffee8ea37c9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:44.303630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88d79d7a-82fd-44de-a13f-fffee8ea37c9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:44.304068 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88d79d7a-82fd-44de-a13f-fffee8ea37c9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:44.442913 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-88d79d7a-82fd-44de-a13f-fffee8ea37c9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:44.454354 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-88d79d7a-82fd-44de-a13f-fffee8ea37c9 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1726 microversion: 2.1 time: 0.164580 Jul 25 13:36:44.454939 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3355/6637] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:44 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:45.475788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7fe000cf-2019-4f7e-b43d-eaf4777c2b19 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:45.476448 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7fe000cf-2019-4f7e-b43d-eaf4777c2b19 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:45.483830 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7fe000cf-2019-4f7e-b43d-eaf4777c2b19 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:45.484294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7fe000cf-2019-4f7e-b43d-eaf4777c2b19 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:45.485070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7fe000cf-2019-4f7e-b43d-eaf4777c2b19 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:45.485519 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7fe000cf-2019-4f7e-b43d-eaf4777c2b19 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:45.624871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7fe000cf-2019-4f7e-b43d-eaf4777c2b19 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:45.633378 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7fe000cf-2019-4f7e-b43d-eaf4777c2b19 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1723 microversion: 2.1 time: 0.161698 Jul 25 13:36:45.634023 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3283/6638] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:45 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:45.655205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8a9ddcd1-fecc-42e4-8c15-79fab6dc449c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:36:45.655768 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8a9ddcd1-fecc-42e4-8c15-79fab6dc449c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:45.663076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a9ddcd1-fecc-42e4-8c15-79fab6dc449c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:45.663613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a9ddcd1-fecc-42e4-8c15-79fab6dc449c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:45.664323 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a9ddcd1-fecc-42e4-8c15-79fab6dc449c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:45.664765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a9ddcd1-fecc-42e4-8c15-79fab6dc449c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:45.706677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a9ddcd1-fecc-42e4-8c15-79fab6dc449c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:45.707132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a9ddcd1-fecc-42e4-8c15-79fab6dc449c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:45.707933 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a9ddcd1-fecc-42e4-8c15-79fab6dc449c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:45.708375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a9ddcd1-fecc-42e4-8c15-79fab6dc449c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:45.730436 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-8a9ddcd1-fecc-42e4-8c15-79fab6dc449c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Getting quotas for project c79a68ef003f4f3faf0a2d4551c6d5ee. Resources: {'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:36:45.735850 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-8a9ddcd1-fecc-42e4-8c15-79fab6dc449c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Getting quotas for user 269643d1d0eb465ea092599c11480b71 and project c79a68ef003f4f3faf0a2d4551c6d5ee. Resources: {'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:36:45.859716 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8a9ddcd1-fecc-42e4-8c15-79fab6dc449c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "POST /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642/action" status: 202 len: 0 microversion: 2.1 time: 0.208885 Jul 25 13:36:45.860586 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3356/6639] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:36:45 2022] POST /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:36:45.870653 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-070ce409-2f6e-4b88-a40a-037c14b95041 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:45.871272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-070ce409-2f6e-4b88-a40a-037c14b95041 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:45.881209 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-070ce409-2f6e-4b88-a40a-037c14b95041 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:45.882536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-070ce409-2f6e-4b88-a40a-037c14b95041 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:45.884131 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-070ce409-2f6e-4b88-a40a-037c14b95041 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:45.885262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-070ce409-2f6e-4b88-a40a-037c14b95041 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:46.089909 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-070ce409-2f6e-4b88-a40a-037c14b95041 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:46.099010 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-070ce409-2f6e-4b88-a40a-037c14b95041 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1722 microversion: 2.1 time: 0.233767 Jul 25 13:36:46.099602 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3284/6640] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:45 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:47.124503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6b99acb9-713c-4ccb-9c0c-a0e0deee2178 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:47.125101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6b99acb9-713c-4ccb-9c0c-a0e0deee2178 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:47.131779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b99acb9-713c-4ccb-9c0c-a0e0deee2178 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:47.132235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b99acb9-713c-4ccb-9c0c-a0e0deee2178 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:47.133014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b99acb9-713c-4ccb-9c0c-a0e0deee2178 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:47.133452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6b99acb9-713c-4ccb-9c0c-a0e0deee2178 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:47.267027 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6b99acb9-713c-4ccb-9c0c-a0e0deee2178 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:47.275573 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6b99acb9-713c-4ccb-9c0c-a0e0deee2178 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1722 microversion: 2.1 time: 0.156426 Jul 25 13:36:47.276200 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3357/6641] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:47 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:47.871316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-9e29c0d0-198d-4ce6-a4bf-5c2d26710eee req-522dbccf-906e-4d49-9444-b653967b94e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba901a84-2cab-4507-ad36-a80b00240642", "name": "network-vif-plugged", "status": "completed", "tag": "49d985f5-5ced-4401-be27-7c2818233f49"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:36:47.881326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-9e29c0d0-198d-4ce6-a4bf-5c2d26710eee req-522dbccf-906e-4d49-9444-b653967b94e9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:47.881789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-9e29c0d0-198d-4ce6-a4bf-5c2d26710eee req-522dbccf-906e-4d49-9444-b653967b94e9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:47.894028 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-9e29c0d0-198d-4ce6-a4bf-5c2d26710eee req-522dbccf-906e-4d49-9444-b653967b94e9 service nova] Creating event network-vif-plugged:49d985f5-5ced-4401-be27-7c2818233f49 for instance ba901a84-2cab-4507-ad36-a80b00240642 on n-h2-848886-15 Jul 25 13:36:47.899807 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [req-9e29c0d0-198d-4ce6-a4bf-5c2d26710eee req-522dbccf-906e-4d49-9444-b653967b94e9 service nova] Instance ba901a84-2cab-4507-ad36-a80b00240642 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125883) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:36:47.912780 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-9e29c0d0-198d-4ce6-a4bf-5c2d26710eee req-522dbccf-906e-4d49-9444-b653967b94e9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100175 Jul 25 13:36:47.913621 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3285/6642] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:36:48.296846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-870f71fa-2b34-461a-a5a1-6565f9e7a962 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:48.297539 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-870f71fa-2b34-461a-a5a1-6565f9e7a962 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:48.304926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-870f71fa-2b34-461a-a5a1-6565f9e7a962 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:48.305377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-870f71fa-2b34-461a-a5a1-6565f9e7a962 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:48.306176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-870f71fa-2b34-461a-a5a1-6565f9e7a962 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:48.306614 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-870f71fa-2b34-461a-a5a1-6565f9e7a962 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:48.465137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-870f71fa-2b34-461a-a5a1-6565f9e7a962 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:48.474142 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-870f71fa-2b34-461a-a5a1-6565f9e7a962 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1722 microversion: 2.1 time: 0.181279 Jul 25 13:36:48.474739 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3358/6643] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:48 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:49.497408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9caced65-68f3-4aa4-9b77-df745f796477 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:49.498075 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9caced65-68f3-4aa4-9b77-df745f796477 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:49.506176 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9caced65-68f3-4aa4-9b77-df745f796477 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:49.506655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9caced65-68f3-4aa4-9b77-df745f796477 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:49.507460 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9caced65-68f3-4aa4-9b77-df745f796477 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:49.507920 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9caced65-68f3-4aa4-9b77-df745f796477 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:49.649198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9caced65-68f3-4aa4-9b77-df745f796477 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:49.658315 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9caced65-68f3-4aa4-9b77-df745f796477 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1722 microversion: 2.1 time: 0.166136 Jul 25 13:36:49.658940 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3286/6644] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:49 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:50.680628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d484560e-4d13-4f01-8afd-6d8edb6cc552 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:50.681278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d484560e-4d13-4f01-8afd-6d8edb6cc552 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:50.689233 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d484560e-4d13-4f01-8afd-6d8edb6cc552 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:50.689695 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d484560e-4d13-4f01-8afd-6d8edb6cc552 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:50.690523 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d484560e-4d13-4f01-8afd-6d8edb6cc552 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:50.690963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d484560e-4d13-4f01-8afd-6d8edb6cc552 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:50.830115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d484560e-4d13-4f01-8afd-6d8edb6cc552 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:50.838950 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d484560e-4d13-4f01-8afd-6d8edb6cc552 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1722 microversion: 2.1 time: 0.162475 Jul 25 13:36:50.839558 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3359/6645] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:50 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:51.299474 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-092bb969-2d9d-4050-b9ae-37f3c3207f12 req-729deb18-a0de-400f-be25-bf4c3e46c500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba901a84-2cab-4507-ad36-a80b00240642", "name": "network-vif-unplugged", "status": "completed", "tag": "49d985f5-5ced-4401-be27-7c2818233f49"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:36:51.310802 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-092bb969-2d9d-4050-b9ae-37f3c3207f12 req-729deb18-a0de-400f-be25-bf4c3e46c500 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:51.311359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-092bb969-2d9d-4050-b9ae-37f3c3207f12 req-729deb18-a0de-400f-be25-bf4c3e46c500 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:51.324926 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-092bb969-2d9d-4050-b9ae-37f3c3207f12 req-729deb18-a0de-400f-be25-bf4c3e46c500 service nova] Creating event network-vif-unplugged:49d985f5-5ced-4401-be27-7c2818233f49 for instance ba901a84-2cab-4507-ad36-a80b00240642 on n-h1-848886-15 Jul 25 13:36:51.330889 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [req-092bb969-2d9d-4050-b9ae-37f3c3207f12 req-729deb18-a0de-400f-be25-bf4c3e46c500 service nova] Instance ba901a84-2cab-4507-ad36-a80b00240642 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125883) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:36:51.344416 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-092bb969-2d9d-4050-b9ae-37f3c3207f12 req-729deb18-a0de-400f-be25-bf4c3e46c500 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049028 Jul 25 13:36:51.345267 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3287/6646] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:36:51.863385 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-69b0758c-a609-49bd-b3c8-162fdb9e37a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:51.864273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-69b0758c-a609-49bd-b3c8-162fdb9e37a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:51.873302 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-69b0758c-a609-49bd-b3c8-162fdb9e37a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:51.874016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-69b0758c-a609-49bd-b3c8-162fdb9e37a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:51.875066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-69b0758c-a609-49bd-b3c8-162fdb9e37a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:51.875558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-69b0758c-a609-49bd-b3c8-162fdb9e37a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:52.106912 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-69b0758c-a609-49bd-b3c8-162fdb9e37a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:52.121468 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-69b0758c-a609-49bd-b3c8-162fdb9e37a6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1722 microversion: 2.1 time: 0.262300 Jul 25 13:36:52.133080 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3360/6647] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:51 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:53.143965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6e8649f2-5e25-4a78-bd92-e89fb254cee4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:53.145427 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6e8649f2-5e25-4a78-bd92-e89fb254cee4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:53.153270 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6e8649f2-5e25-4a78-bd92-e89fb254cee4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:53.153917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6e8649f2-5e25-4a78-bd92-e89fb254cee4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:53.154720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6e8649f2-5e25-4a78-bd92-e89fb254cee4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:53.155177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6e8649f2-5e25-4a78-bd92-e89fb254cee4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:53.295370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6e8649f2-5e25-4a78-bd92-e89fb254cee4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:53.304004 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6e8649f2-5e25-4a78-bd92-e89fb254cee4 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1722 microversion: 2.1 time: 0.164376 Jul 25 13:36:53.304607 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3288/6648] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:53 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:53.366643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-6a76c72f-8ce8-4e14-a15a-5df1f50a81ea req-c5c1cfdf-6787-4acf-85c6-3fb42af545e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba901a84-2cab-4507-ad36-a80b00240642", "tag": "49d985f5-5ced-4401-be27-7c2818233f49"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:36:53.377693 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6a76c72f-8ce8-4e14-a15a-5df1f50a81ea req-c5c1cfdf-6787-4acf-85c6-3fb42af545e5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:53.378178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6a76c72f-8ce8-4e14-a15a-5df1f50a81ea req-c5c1cfdf-6787-4acf-85c6-3fb42af545e5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:53.391388 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-6a76c72f-8ce8-4e14-a15a-5df1f50a81ea req-c5c1cfdf-6787-4acf-85c6-3fb42af545e5 service nova] Creating event network-changed:49d985f5-5ced-4401-be27-7c2818233f49 for instance ba901a84-2cab-4507-ad36-a80b00240642 on n-h1-848886-15 Jul 25 13:36:53.397705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [req-6a76c72f-8ce8-4e14-a15a-5df1f50a81ea req-c5c1cfdf-6787-4acf-85c6-3fb42af545e5 service nova] Instance ba901a84-2cab-4507-ad36-a80b00240642 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:36:53.408904 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-6a76c72f-8ce8-4e14-a15a-5df1f50a81ea req-c5c1cfdf-6787-4acf-85c6-3fb42af545e5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046088 Jul 25 13:36:53.409541 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3361/6649] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:36:54.328231 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7e9a83f2-bc29-4243-b19d-c24acede0717 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:54.329189 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7e9a83f2-bc29-4243-b19d-c24acede0717 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:54.340423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e9a83f2-bc29-4243-b19d-c24acede0717 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:54.341143 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e9a83f2-bc29-4243-b19d-c24acede0717 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:54.342074 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e9a83f2-bc29-4243-b19d-c24acede0717 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:54.342720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7e9a83f2-bc29-4243-b19d-c24acede0717 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:54.723172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7e9a83f2-bc29-4243-b19d-c24acede0717 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:54.732297 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7e9a83f2-bc29-4243-b19d-c24acede0717 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1722 microversion: 2.1 time: 0.409415 Jul 25 13:36:54.733130 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3289/6650] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:54 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1722 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:55.752225 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:36:55.756670 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-75f99495-adf1-4cda-8cd4-0ae8056a3fc7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:55.757421 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-75f99495-adf1-4cda-8cd4-0ae8056a3fc7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:55.764913 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75f99495-adf1-4cda-8cd4-0ae8056a3fc7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:55.765366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75f99495-adf1-4cda-8cd4-0ae8056a3fc7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:55.766199 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75f99495-adf1-4cda-8cd4-0ae8056a3fc7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:55.766613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-75f99495-adf1-4cda-8cd4-0ae8056a3fc7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:55.926063 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-75f99495-adf1-4cda-8cd4-0ae8056a3fc7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:55.935003 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-75f99495-adf1-4cda-8cd4-0ae8056a3fc7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1722 microversion: 2.1 time: 0.184553 Jul 25 13:36:55.935588 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3362/6651] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:55 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:56.956859 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-75955a34-3774-40b1-b25f-5a8d64968daa tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:56.958417 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-75955a34-3774-40b1-b25f-5a8d64968daa tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:56.967338 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-75955a34-3774-40b1-b25f-5a8d64968daa tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:56.968053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-75955a34-3774-40b1-b25f-5a8d64968daa tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:56.969005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-75955a34-3774-40b1-b25f-5a8d64968daa tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:56.969532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-75955a34-3774-40b1-b25f-5a8d64968daa tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:57.122229 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-75955a34-3774-40b1-b25f-5a8d64968daa tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:57.135110 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-75955a34-3774-40b1-b25f-5a8d64968daa tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1722 microversion: 2.1 time: 0.182046 Jul 25 13:36:57.135953 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3290/6652] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:56 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:58.157125 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9eab2a25-4972-41da-9f03-b72fcd48372f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:58.157716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9eab2a25-4972-41da-9f03-b72fcd48372f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:58.165143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9eab2a25-4972-41da-9f03-b72fcd48372f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:58.165605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9eab2a25-4972-41da-9f03-b72fcd48372f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:58.166432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9eab2a25-4972-41da-9f03-b72fcd48372f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:58.166882 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9eab2a25-4972-41da-9f03-b72fcd48372f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:58.317160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9eab2a25-4972-41da-9f03-b72fcd48372f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:58.325779 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9eab2a25-4972-41da-9f03-b72fcd48372f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1722 microversion: 2.1 time: 0.172802 Jul 25 13:36:58.326409 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3363/6653] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:58 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:36:59.348073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-65902b96-5512-4ba7-8607-bb0e9304cd90 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:36:59.348748 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-65902b96-5512-4ba7-8607-bb0e9304cd90 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:36:59.356133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65902b96-5512-4ba7-8607-bb0e9304cd90 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:59.356686 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65902b96-5512-4ba7-8607-bb0e9304cd90 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:59.357521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65902b96-5512-4ba7-8607-bb0e9304cd90 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:36:59.358004 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-65902b96-5512-4ba7-8607-bb0e9304cd90 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:36:59.501296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-65902b96-5512-4ba7-8607-bb0e9304cd90 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:36:59.510111 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-65902b96-5512-4ba7-8607-bb0e9304cd90 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1722 microversion: 2.1 time: 0.166325 Jul 25 13:36:59.510715 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3291/6654] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:36:59 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:00.532146 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-daa8b2c8-8533-4db1-927a-986001a1833b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:00.532683 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-daa8b2c8-8533-4db1-927a-986001a1833b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:00.539981 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-daa8b2c8-8533-4db1-927a-986001a1833b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:00.540419 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-daa8b2c8-8533-4db1-927a-986001a1833b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:00.541205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-daa8b2c8-8533-4db1-927a-986001a1833b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:00.541634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-daa8b2c8-8533-4db1-927a-986001a1833b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:00.679452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-daa8b2c8-8533-4db1-927a-986001a1833b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:00.688115 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-daa8b2c8-8533-4db1-927a-986001a1833b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1722 microversion: 2.1 time: 0.160137 Jul 25 13:37:00.688708 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3364/6655] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:00 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:01.710005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8be5e90d-f8c0-46bb-975c-4d1eb72f71bc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:01.710694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8be5e90d-f8c0-46bb-975c-4d1eb72f71bc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:01.719097 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8be5e90d-f8c0-46bb-975c-4d1eb72f71bc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:01.719567 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8be5e90d-f8c0-46bb-975c-4d1eb72f71bc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:01.720368 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8be5e90d-f8c0-46bb-975c-4d1eb72f71bc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:01.720829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8be5e90d-f8c0-46bb-975c-4d1eb72f71bc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:01.892782 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8be5e90d-f8c0-46bb-975c-4d1eb72f71bc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:01.903446 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8be5e90d-f8c0-46bb-975c-4d1eb72f71bc tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1722 microversion: 2.1 time: 0.197404 Jul 25 13:37:01.904079 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3292/6656] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:01 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:02.928494 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1b7ca333-fd51-4444-8931-79bd759122be tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:02.929092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1b7ca333-fd51-4444-8931-79bd759122be tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:02.936725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b7ca333-fd51-4444-8931-79bd759122be tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:02.937174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b7ca333-fd51-4444-8931-79bd759122be tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:02.937970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b7ca333-fd51-4444-8931-79bd759122be tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:02.938407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1b7ca333-fd51-4444-8931-79bd759122be tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:03.086004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1b7ca333-fd51-4444-8931-79bd759122be tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:03.095517 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1b7ca333-fd51-4444-8931-79bd759122be tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1722 microversion: 2.1 time: 0.171034 Jul 25 13:37:03.096173 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3365/6657] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:02 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:03.130653 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:37:03.130793 n-d-848886-15 devstack@n-api.service[125884]: Mon Jul 25 13:37:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:37:04.123190 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-95f1f8f9-6d8c-46f5-aae8-819b8403f918 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:04.123721 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-95f1f8f9-6d8c-46f5-aae8-819b8403f918 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:04.131391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-95f1f8f9-6d8c-46f5-aae8-819b8403f918 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:04.131836 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-95f1f8f9-6d8c-46f5-aae8-819b8403f918 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:04.132637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-95f1f8f9-6d8c-46f5-aae8-819b8403f918 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:04.133117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-95f1f8f9-6d8c-46f5-aae8-819b8403f918 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:04.281043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-95f1f8f9-6d8c-46f5-aae8-819b8403f918 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:04.289355 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-95f1f8f9-6d8c-46f5-aae8-819b8403f918 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1722 microversion: 2.1 time: 0.172759 Jul 25 13:37:04.289969 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3293/6658] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:04 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:05.313242 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c9b24ddf-6c96-41d4-b99c-70a2f29715a7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:05.314280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c9b24ddf-6c96-41d4-b99c-70a2f29715a7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:05.323318 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c9b24ddf-6c96-41d4-b99c-70a2f29715a7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:05.323773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c9b24ddf-6c96-41d4-b99c-70a2f29715a7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:05.324551 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c9b24ddf-6c96-41d4-b99c-70a2f29715a7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:05.324986 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c9b24ddf-6c96-41d4-b99c-70a2f29715a7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:05.462878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c9b24ddf-6c96-41d4-b99c-70a2f29715a7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:05.471664 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c9b24ddf-6c96-41d4-b99c-70a2f29715a7 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1715 microversion: 2.1 time: 0.162742 Jul 25 13:37:05.472272 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3366/6659] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:05 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1715 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:05.495592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3d05c2bc-a141-4a6d-bbf9-99319ba367e8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:05.496217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3d05c2bc-a141-4a6d-bbf9-99319ba367e8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:05.503325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3d05c2bc-a141-4a6d-bbf9-99319ba367e8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:05.503797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3d05c2bc-a141-4a6d-bbf9-99319ba367e8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:05.504716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3d05c2bc-a141-4a6d-bbf9-99319ba367e8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:05.505231 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3d05c2bc-a141-4a6d-bbf9-99319ba367e8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:05.647109 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3d05c2bc-a141-4a6d-bbf9-99319ba367e8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:05.656891 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3d05c2bc-a141-4a6d-bbf9-99319ba367e8 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1715 microversion: 2.1 time: 0.165287 Jul 25 13:37:05.657743 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3294/6660] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:05 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1715 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:05.679779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-12b3d9c9-4207-459f-b8fe-1e6f4ccb15a1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:05.680643 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-12b3d9c9-4207-459f-b8fe-1e6f4ccb15a1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:05.688412 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-12b3d9c9-4207-459f-b8fe-1e6f4ccb15a1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:05.688868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-12b3d9c9-4207-459f-b8fe-1e6f4ccb15a1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:05.689642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-12b3d9c9-4207-459f-b8fe-1e6f4ccb15a1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:05.690157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-12b3d9c9-4207-459f-b8fe-1e6f4ccb15a1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:05.826013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-12b3d9c9-4207-459f-b8fe-1e6f4ccb15a1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:05.828508 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:37:05.840074 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-12b3d9c9-4207-459f-b8fe-1e6f4ccb15a1 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1715 microversion: 2.1 time: 0.165943 Jul 25 13:37:05.840693 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3367/6661] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:05 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1715 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:05.860688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3a3b0901-d6e6-4d94-b1f0-83ff59fc9780 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:05.861193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3a3b0901-d6e6-4d94-b1f0-83ff59fc9780 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:05.867252 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a3b0901-d6e6-4d94-b1f0-83ff59fc9780 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:05.867712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a3b0901-d6e6-4d94-b1f0-83ff59fc9780 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:05.868514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a3b0901-d6e6-4d94-b1f0-83ff59fc9780 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:05.868961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a3b0901-d6e6-4d94-b1f0-83ff59fc9780 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:05.911796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3a3b0901-d6e6-4d94-b1f0-83ff59fc9780 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:37:05.997486 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3a3b0901-d6e6-4d94-b1f0-83ff59fc9780 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 204 len: 0 microversion: 2.1 time: 0.140575 Jul 25 13:37:05.998182 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3295/6662] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:37:05 2022] DELETE /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:37:06.006835 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9b9e7a21-f7b1-4290-b4b9-8181fdc8cfbf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:06.007600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9b9e7a21-f7b1-4290-b4b9-8181fdc8cfbf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:06.015066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b9e7a21-f7b1-4290-b4b9-8181fdc8cfbf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:06.015512 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b9e7a21-f7b1-4290-b4b9-8181fdc8cfbf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:06.016279 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b9e7a21-f7b1-4290-b4b9-8181fdc8cfbf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:06.016716 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9b9e7a21-f7b1-4290-b4b9-8181fdc8cfbf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:06.156304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9b9e7a21-f7b1-4290-b4b9-8181fdc8cfbf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:06.167900 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9b9e7a21-f7b1-4290-b4b9-8181fdc8cfbf tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1721 microversion: 2.1 time: 0.164665 Jul 25 13:37:06.168620 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3368/6663] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:06 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:37:07.190193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5873819e-5928-46e8-83af-a9dbdac804b6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:07.191060 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5873819e-5928-46e8-83af-a9dbdac804b6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:07.198003 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5873819e-5928-46e8-83af-a9dbdac804b6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:07.198496 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5873819e-5928-46e8-83af-a9dbdac804b6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:07.199284 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5873819e-5928-46e8-83af-a9dbdac804b6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:07.199737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5873819e-5928-46e8-83af-a9dbdac804b6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:07.337178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5873819e-5928-46e8-83af-a9dbdac804b6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:07.339882 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:37:07.346884 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5873819e-5928-46e8-83af-a9dbdac804b6 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1721 microversion: 2.1 time: 0.161631 Jul 25 13:37:07.347449 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3296/6664] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:07 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:07.482190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-137fbfd2-330d-4884-bdb0-19ca865fa401 req-33a8329f-2ed2-4a04-81f0-8ea028d4d913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba901a84-2cab-4507-ad36-a80b00240642", "name": "network-vif-plugged", "status": "completed", "tag": "49d985f5-5ced-4401-be27-7c2818233f49"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:37:07.493374 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-137fbfd2-330d-4884-bdb0-19ca865fa401 req-33a8329f-2ed2-4a04-81f0-8ea028d4d913 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:07.493847 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-137fbfd2-330d-4884-bdb0-19ca865fa401 req-33a8329f-2ed2-4a04-81f0-8ea028d4d913 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:07.506163 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-137fbfd2-330d-4884-bdb0-19ca865fa401 req-33a8329f-2ed2-4a04-81f0-8ea028d4d913 service nova] Creating event network-vif-plugged:49d985f5-5ced-4401-be27-7c2818233f49 for instance ba901a84-2cab-4507-ad36-a80b00240642 on n-h1-848886-15 Jul 25 13:37:07.511515 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-137fbfd2-330d-4884-bdb0-19ca865fa401 req-33a8329f-2ed2-4a04-81f0-8ea028d4d913 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033458 Jul 25 13:37:07.512358 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3369/6665] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:37:08.369234 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-234824c3-bde9-40a6-86ba-93623c22c0a3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:08.369888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-234824c3-bde9-40a6-86ba-93623c22c0a3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:08.379092 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-234824c3-bde9-40a6-86ba-93623c22c0a3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:08.379719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-234824c3-bde9-40a6-86ba-93623c22c0a3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:08.380892 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-234824c3-bde9-40a6-86ba-93623c22c0a3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:08.381506 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-234824c3-bde9-40a6-86ba-93623c22c0a3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:08.478606 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-234824c3-bde9-40a6-86ba-93623c22c0a3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:08.501529 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-234824c3-bde9-40a6-86ba-93623c22c0a3 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1654 microversion: 2.1 time: 0.136406 Jul 25 13:37:08.522139 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3297/6666] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:08 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1654 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:08.593015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-1bd6fd9e-844c-4821-b722-0b0dc0f6ed30 req-64410be3-9a73-420a-9f53-587f134ace73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba901a84-2cab-4507-ad36-a80b00240642", "name": "network-vif-deleted", "tag": "49d985f5-5ced-4401-be27-7c2818233f49"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:37:08.605210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-1bd6fd9e-844c-4821-b722-0b0dc0f6ed30 req-64410be3-9a73-420a-9f53-587f134ace73 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:08.605726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-1bd6fd9e-844c-4821-b722-0b0dc0f6ed30 req-64410be3-9a73-420a-9f53-587f134ace73 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:08.618470 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-1bd6fd9e-844c-4821-b722-0b0dc0f6ed30 req-64410be3-9a73-420a-9f53-587f134ace73 service nova] Creating event network-vif-deleted:49d985f5-5ced-4401-be27-7c2818233f49 for instance ba901a84-2cab-4507-ad36-a80b00240642 on n-h1-848886-15 Jul 25 13:37:08.624495 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-1bd6fd9e-844c-4821-b722-0b0dc0f6ed30 req-64410be3-9a73-420a-9f53-587f134ace73 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095047 Jul 25 13:37:08.630229 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3370/6667] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:37:09.524416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f38abec1-9991-4922-acd4-910a201ba77c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:09.524935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f38abec1-9991-4922-acd4-910a201ba77c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:09.535547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f38abec1-9991-4922-acd4-910a201ba77c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:09.536023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f38abec1-9991-4922-acd4-910a201ba77c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:09.536858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f38abec1-9991-4922-acd4-910a201ba77c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:09.537381 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f38abec1-9991-4922-acd4-910a201ba77c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:09.620924 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f38abec1-9991-4922-acd4-910a201ba77c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:09.631456 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f38abec1-9991-4922-acd4-910a201ba77c tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1370 microversion: 2.1 time: 0.111461 Jul 25 13:37:09.632155 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3298/6668] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:09 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1370 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:10.654739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f7e43d50-ba39-4ea1-af14-bfcd245e1e4f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:10.655995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f7e43d50-ba39-4ea1-af14-bfcd245e1e4f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:10.663545 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7e43d50-ba39-4ea1-af14-bfcd245e1e4f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:10.664102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7e43d50-ba39-4ea1-af14-bfcd245e1e4f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:10.664997 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7e43d50-ba39-4ea1-af14-bfcd245e1e4f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:10.665712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f7e43d50-ba39-4ea1-af14-bfcd245e1e4f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:10.758608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f7e43d50-ba39-4ea1-af14-bfcd245e1e4f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:10.769124 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f7e43d50-ba39-4ea1-af14-bfcd245e1e4f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1370 microversion: 2.1 time: 0.120175 Jul 25 13:37:10.770005 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3371/6669] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:10 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1370 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:11.793235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f736af57-379a-4119-9c84-2c262adb6729 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:11.793911 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f736af57-379a-4119-9c84-2c262adb6729 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:11.796776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:37:11.803180 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f736af57-379a-4119-9c84-2c262adb6729 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:11.803566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f736af57-379a-4119-9c84-2c262adb6729 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:11.804357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f736af57-379a-4119-9c84-2c262adb6729 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:11.804812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f736af57-379a-4119-9c84-2c262adb6729 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:11.869909 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f736af57-379a-4119-9c84-2c262adb6729 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:11.878989 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f736af57-379a-4119-9c84-2c262adb6729 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1370 microversion: 2.1 time: 0.089769 Jul 25 13:37:11.879593 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3299/6670] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:11 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1370 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:12.901231 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a1ecb54c-0325-46c1-a35e-025c520e15c0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:12.902179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a1ecb54c-0325-46c1-a35e-025c520e15c0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:12.911142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:37:12.919639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1ecb54c-0325-46c1-a35e-025c520e15c0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:12.920316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1ecb54c-0325-46c1-a35e-025c520e15c0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:12.921290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1ecb54c-0325-46c1-a35e-025c520e15c0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:12.922138 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1ecb54c-0325-46c1-a35e-025c520e15c0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:12.959298 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1ecb54c-0325-46c1-a35e-025c520e15c0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:12.959746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a1ecb54c-0325-46c1-a35e-025c520e15c0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:12.960201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-a1ecb54c-0325-46c1-a35e-025c520e15c0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lazy-loading 'fault' on Instance uuid ba901a84-2cab-4507-ad36-a80b00240642 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:37:13.011594 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a1ecb54c-0325-46c1-a35e-025c520e15c0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269643d1d0eb465ea092599c11480b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79a68ef003f4f3faf0a2d4551c6d5ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:13.021247 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a1ecb54c-0325-46c1-a35e-025c520e15c0 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 200 len: 1329 microversion: 2.1 time: 0.124891 Jul 25 13:37:13.021909 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3372/6671] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:12 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 1329 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:14.046961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8d9668d2-a6ac-4e2b-a012-32fa37539e9b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:14.047689 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8d9668d2-a6ac-4e2b-a012-32fa37539e9b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:14.058547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d9668d2-a6ac-4e2b-a012-32fa37539e9b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:14.059107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d9668d2-a6ac-4e2b-a012-32fa37539e9b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:14.060346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d9668d2-a6ac-4e2b-a012-32fa37539e9b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:14.060796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8d9668d2-a6ac-4e2b-a012-32fa37539e9b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:14.074880 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-8d9668d2-a6ac-4e2b-a012-32fa37539e9b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] HTTP exception thrown: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8d9668d2-a6ac-4e2b-a012-32fa37539e9b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Request method failure captured: Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 HTTP/1.1 Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3ps2uAMwWcs8JWVJ4Y1EH4DEH-xcoDZUXcQ2SMYQDuHJ6xKZtzlY3crBbh33knI4BRq4-7REpa8QxZBYFHDFdQ0jv_t5oHli9ALSiUgThfzEZ87ovY8e2_XTSuFqSPJM6fPlLXFDiUl-NS1IB6R5YsiH4-NrInN3mZHwxCC9W0hJaI8 Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c79a68ef003f4f3faf0a2d4551c6d5ee", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}] Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 269643d1d0eb465ea092599c11480b71 Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'ba901a84-2cab-4507-ad36-a80b00240642'} Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:14.076591 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:14.080041 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:14.080041 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:14.080041 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:14.080041 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:37:14.080041 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:37:14.080041 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. Jul 25 13:37:14.080041 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:14.080041 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8d9668d2-a6ac-4e2b-a012-32fa37539e9b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Returning 404 to user: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:37:14.080041 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8d9668d2-a6ac-4e2b-a012-32fa37539e9b tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 404 len: 111 microversion: 2.1 time: 0.037679 Jul 25 13:37:14.080041 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3300/6672] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:14 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:37:14.141846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-329db5e0-e1cb-4cc3-8b57-c75fadd3b1cd tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:14.143996 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-329db5e0-e1cb-4cc3-8b57-c75fadd3b1cd tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:14.150762 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-329db5e0-e1cb-4cc3-8b57-c75fadd3b1cd tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:14.151214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-329db5e0-e1cb-4cc3-8b57-c75fadd3b1cd tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:14.151978 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-329db5e0-e1cb-4cc3-8b57-c75fadd3b1cd tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:14.152416 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-329db5e0-e1cb-4cc3-8b57-c75fadd3b1cd tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:14.167000 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-329db5e0-e1cb-4cc3-8b57-c75fadd3b1cd tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] HTTP exception thrown: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-329db5e0-e1cb-4cc3-8b57-c75fadd3b1cd tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Request method failure captured: Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642/os-volume_attachments HTTP/1.1 Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3ps2uAMwWcs8JWVJ4Y1EH4DEH-xcoDZUXcQ2SMYQDuHJ6xKZtzlY3crBbh33knI4BRq4-7REpa8QxZBYFHDFdQ0jv_t5oHli9ALSiUgThfzEZ87ovY8e2_XTSuFqSPJM6fPlLXFDiUl-NS1IB6R5YsiH4-NrInN3mZHwxCC9W0hJaI8 Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c79a68ef003f4f3faf0a2d4551c6d5ee", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}] Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 269643d1d0eb465ea092599c11480b71 Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'server_id': 'ba901a84-2cab-4507-ad36-a80b00240642'} Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:37:14.168696 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:37:14.172036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. Jul 25 13:37:14.172036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:14.172036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:14.172036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:14.172036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:14.172036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:14.172036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:14.172036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:37:14.172036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:37:14.172036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. Jul 25 13:37:14.172036 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:14.172036 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-329db5e0-e1cb-4cc3-8b57-c75fadd3b1cd tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Returning 404 to user: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:37:14.172036 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-329db5e0-e1cb-4cc3-8b57-c75fadd3b1cd tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032630 Jul 25 13:37:14.172036 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3373/6673] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:37:14 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:37:17.515926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4e9d5808-1dc5-42cf-aad0-a4e63718d4af tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:17.516440 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4e9d5808-1dc5-42cf-aad0-a4e63718d4af tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:17.523880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e9d5808-1dc5-42cf-aad0-a4e63718d4af tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:17.524346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e9d5808-1dc5-42cf-aad0-a4e63718d4af tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:17.525128 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e9d5808-1dc5-42cf-aad0-a4e63718d4af tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:17.525582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e9d5808-1dc5-42cf-aad0-a4e63718d4af tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:17.540528 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-4e9d5808-1dc5-42cf-aad0-a4e63718d4af tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] HTTP exception thrown: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4e9d5808-1dc5-42cf-aad0-a4e63718d4af tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Request method failure captured: Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 HTTP/1.1 Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3ps2uAMwWcs8JWVJ4Y1EH4DEH-xcoDZUXcQ2SMYQDuHJ6xKZtzlY3crBbh33knI4BRq4-7REpa8QxZBYFHDFdQ0jv_t5oHli9ALSiUgThfzEZ87ovY8e2_XTSuFqSPJM6fPlLXFDiUl-NS1IB6R5YsiH4-NrInN3mZHwxCC9W0hJaI8 Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c79a68ef003f4f3faf0a2d4551c6d5ee", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}] Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 269643d1d0eb465ea092599c11480b71 Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'ba901a84-2cab-4507-ad36-a80b00240642'} Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:37:17.542160 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:37:17.548989 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. Jul 25 13:37:17.548989 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.548989 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:17.548989 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.548989 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.548989 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:17.548989 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:17.548989 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:37:17.548989 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:37:17.548989 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. Jul 25 13:37:17.548989 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.548989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4e9d5808-1dc5-42cf-aad0-a4e63718d4af tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Returning 404 to user: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:37:17.548989 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4e9d5808-1dc5-42cf-aad0-a4e63718d4af tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 404 len: 111 microversion: 2.1 time: 0.031888 Jul 25 13:37:17.548989 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3301/6674] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:37:17 2022] DELETE /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:37:17.553686 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aca4a02d-d829-4a4d-ae75-43c35e5b12db tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:17.554575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-aca4a02d-d829-4a4d-ae75-43c35e5b12db tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: ba901a84-2cab-4507-ad36-a80b00240642] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:17.562068 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aca4a02d-d829-4a4d-ae75-43c35e5b12db tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:17.562525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aca4a02d-d829-4a4d-ae75-43c35e5b12db tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:17.563307 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aca4a02d-d829-4a4d-ae75-43c35e5b12db tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:17.563750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-aca4a02d-d829-4a4d-ae75-43c35e5b12db tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:17.579498 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-aca4a02d-d829-4a4d-ae75-43c35e5b12db tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] HTTP exception thrown: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aca4a02d-d829-4a4d-ae75-43c35e5b12db tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Request method failure captured: Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 HTTP/1.1 Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3ps2uAMwWcs8JWVJ4Y1EH4DEH-xcoDZUXcQ2SMYQDuHJ6xKZtzlY3crBbh33knI4BRq4-7REpa8QxZBYFHDFdQ0jv_t5oHli9ALSiUgThfzEZ87ovY8e2_XTSuFqSPJM6fPlLXFDiUl-NS1IB6R5YsiH4-NrInN3mZHwxCC9W0hJaI8 Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c79a68ef003f4f3faf0a2d4551c6d5ee", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}] Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 269643d1d0eb465ea092599c11480b71 Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'ba901a84-2cab-4507-ad36-a80b00240642'} Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:17.581106 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.585563 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.585563 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:17.585563 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:17.585563 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:37:17.585563 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:37:17.585563 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. Jul 25 13:37:17.585563 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.585563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aca4a02d-d829-4a4d-ae75-43c35e5b12db tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Returning 404 to user: Instance ba901a84-2cab-4507-ad36-a80b00240642 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:37:17.585563 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-aca4a02d-d829-4a4d-ae75-43c35e5b12db tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642" status: 404 len: 111 microversion: 2.1 time: 0.033314 Jul 25 13:37:17.585563 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3374/6675] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:17 2022] GET /compute/v2.1/servers/ba901a84-2cab-4507-ad36-a80b00240642 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:37:17.592775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-49563035-12e3-48d3-8d41-e8df0eeaf31f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:17.593294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-49563035-12e3-48d3-8d41-e8df0eeaf31f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:17.599984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-49563035-12e3-48d3-8d41-e8df0eeaf31f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:17.600458 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-49563035-12e3-48d3-8d41-e8df0eeaf31f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:17.601248 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-49563035-12e3-48d3-8d41-e8df0eeaf31f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:17.601689 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-49563035-12e3-48d3-8d41-e8df0eeaf31f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:17.617191 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-49563035-12e3-48d3-8d41-e8df0eeaf31f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] HTTP exception thrown: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-49563035-12e3-48d3-8d41-e8df0eeaf31f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Request method failure captured: Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac HTTP/1.1 Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3ps2uAMwWcs8JWVJ4Y1EH4DEH-xcoDZUXcQ2SMYQDuHJ6xKZtzlY3crBbh33knI4BRq4-7REpa8QxZBYFHDFdQ0jv_t5oHli9ALSiUgThfzEZ87ovY8e2_XTSuFqSPJM6fPlLXFDiUl-NS1IB6R5YsiH4-NrInN3mZHwxCC9W0hJaI8 Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c79a68ef003f4f3faf0a2d4551c6d5ee", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}] Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 269643d1d0eb465ea092599c11480b71 Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '30dd612e-3eb1-44e8-aba8-97c8623283ac'} Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:37:17.618831 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:37:17.622642 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. Jul 25 13:37:17.622642 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.622642 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:17.622642 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.622642 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.622642 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:17.622642 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:17.622642 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:37:17.622642 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:37:17.622642 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. Jul 25 13:37:17.622642 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.622642 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-49563035-12e3-48d3-8d41-e8df0eeaf31f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Returning 404 to user: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:37:17.622642 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-49563035-12e3-48d3-8d41-e8df0eeaf31f tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "DELETE /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 404 len: 111 microversion: 2.1 time: 0.031595 Jul 25 13:37:17.622642 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3302/6676] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:37:17 2022] DELETE /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:37:17.629407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-49532676-2d1b-411e-b0aa-9e70fdf32b60 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:17.630109 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-49532676-2d1b-411e-b0aa-9e70fdf32b60 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 30dd612e-3eb1-44e8-aba8-97c8623283ac] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:17.636474 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49532676-2d1b-411e-b0aa-9e70fdf32b60 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:17.636931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49532676-2d1b-411e-b0aa-9e70fdf32b60 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:17.637715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49532676-2d1b-411e-b0aa-9e70fdf32b60 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:17.638212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-49532676-2d1b-411e-b0aa-9e70fdf32b60 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:17.654070 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-49532676-2d1b-411e-b0aa-9e70fdf32b60 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] HTTP exception thrown: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-49532676-2d1b-411e-b0aa-9e70fdf32b60 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Request method failure captured: Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac HTTP/1.1 Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3ps2uAMwWcs8JWVJ4Y1EH4DEH-xcoDZUXcQ2SMYQDuHJ6xKZtzlY3crBbh33knI4BRq4-7REpa8QxZBYFHDFdQ0jv_t5oHli9ALSiUgThfzEZ87ovY8e2_XTSuFqSPJM6fPlLXFDiUl-NS1IB6R5YsiH4-NrInN3mZHwxCC9W0hJaI8 Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c79a68ef003f4f3faf0a2d4551c6d5ee", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}] Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 269643d1d0eb465ea092599c11480b71 Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '30dd612e-3eb1-44e8-aba8-97c8623283ac'} Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:17.655695 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.659102 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.659102 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:17.659102 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:17.659102 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:37:17.659102 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:37:17.659102 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. Jul 25 13:37:17.659102 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.659102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-49532676-2d1b-411e-b0aa-9e70fdf32b60 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Returning 404 to user: Instance 30dd612e-3eb1-44e8-aba8-97c8623283ac could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:37:17.659102 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-49532676-2d1b-411e-b0aa-9e70fdf32b60 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac" status: 404 len: 111 microversion: 2.1 time: 0.031889 Jul 25 13:37:17.659102 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3375/6677] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:17 2022] GET /compute/v2.1/servers/30dd612e-3eb1-44e8-aba8-97c8623283ac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:37:17.666329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-88224bf5-4b13-45da-8070-0354afbfae65 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:17.667002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-88224bf5-4b13-45da-8070-0354afbfae65 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:17.674147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-88224bf5-4b13-45da-8070-0354afbfae65 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:17.674721 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-88224bf5-4b13-45da-8070-0354afbfae65 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:17.675621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-88224bf5-4b13-45da-8070-0354afbfae65 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:17.676157 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-88224bf5-4b13-45da-8070-0354afbfae65 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:17.692028 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-88224bf5-4b13-45da-8070-0354afbfae65 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] HTTP exception thrown: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-88224bf5-4b13-45da-8070-0354afbfae65 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Request method failure captured: Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 HTTP/1.1 Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3ps2uAMwWcs8JWVJ4Y1EH4DEH-xcoDZUXcQ2SMYQDuHJ6xKZtzlY3crBbh33knI4BRq4-7REpa8QxZBYFHDFdQ0jv_t5oHli9ALSiUgThfzEZ87ovY8e2_XTSuFqSPJM6fPlLXFDiUl-NS1IB6R5YsiH4-NrInN3mZHwxCC9W0hJaI8 Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c79a68ef003f4f3faf0a2d4551c6d5ee", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}] Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 269643d1d0eb465ea092599c11480b71 Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '8d76d04c-a42c-4802-96ad-5e56d80f07f3'} Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:37:17.693699 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:37:17.697384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. Jul 25 13:37:17.697384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.697384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:17.697384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.697384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.697384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:17.697384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:17.697384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:37:17.697384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:37:17.697384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. Jul 25 13:37:17.697384 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.697384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-88224bf5-4b13-45da-8070-0354afbfae65 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Returning 404 to user: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:37:17.697384 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-88224bf5-4b13-45da-8070-0354afbfae65 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 404 len: 111 microversion: 2.1 time: 0.032952 Jul 25 13:37:17.697384 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3303/6678] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:37:17 2022] DELETE /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:37:17.705050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-00a48376-873b-428f-b976-0eb17e6d4015 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:17.705675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-00a48376-873b-428f-b976-0eb17e6d4015 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: 8d76d04c-a42c-4802-96ad-5e56d80f07f3] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:17.712708 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-00a48376-873b-428f-b976-0eb17e6d4015 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:17.713198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-00a48376-873b-428f-b976-0eb17e6d4015 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:17.714028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-00a48376-873b-428f-b976-0eb17e6d4015 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:17.714476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-00a48376-873b-428f-b976-0eb17e6d4015 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:17.729378 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-00a48376-873b-428f-b976-0eb17e6d4015 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] HTTP exception thrown: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-00a48376-873b-428f-b976-0eb17e6d4015 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Request method failure captured: Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 HTTP/1.1 Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3ps2uAMwWcs8JWVJ4Y1EH4DEH-xcoDZUXcQ2SMYQDuHJ6xKZtzlY3crBbh33knI4BRq4-7REpa8QxZBYFHDFdQ0jv_t5oHli9ALSiUgThfzEZ87ovY8e2_XTSuFqSPJM6fPlLXFDiUl-NS1IB6R5YsiH4-NrInN3mZHwxCC9W0hJaI8 Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c79a68ef003f4f3faf0a2d4551c6d5ee", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}] Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 269643d1d0eb465ea092599c11480b71 Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '8d76d04c-a42c-4802-96ad-5e56d80f07f3'} Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:17.731011 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.735337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.735337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:17.735337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:17.735337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:37:17.735337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:37:17.735337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. Jul 25 13:37:17.735337 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.735337 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-00a48376-873b-428f-b976-0eb17e6d4015 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Returning 404 to user: Instance 8d76d04c-a42c-4802-96ad-5e56d80f07f3 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:37:17.735337 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-00a48376-873b-428f-b976-0eb17e6d4015 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3" status: 404 len: 111 microversion: 2.1 time: 0.032221 Jul 25 13:37:17.736179 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3376/6679] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:17 2022] GET /compute/v2.1/servers/8d76d04c-a42c-4802-96ad-5e56d80f07f3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:37:17.741806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3280129e-c4bd-461c-826a-97f3ff00dc05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:17.742510 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3280129e-c4bd-461c-826a-97f3ff00dc05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:17.750058 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3280129e-c4bd-461c-826a-97f3ff00dc05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:17.750531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3280129e-c4bd-461c-826a-97f3ff00dc05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:17.751448 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3280129e-c4bd-461c-826a-97f3ff00dc05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:17.751860 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3280129e-c4bd-461c-826a-97f3ff00dc05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:17.768254 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-3280129e-c4bd-461c-826a-97f3ff00dc05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] HTTP exception thrown: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3280129e-c4bd-461c-826a-97f3ff00dc05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Request method failure captured: Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf HTTP/1.1 Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3ps2uAMwWcs8JWVJ4Y1EH4DEH-xcoDZUXcQ2SMYQDuHJ6xKZtzlY3crBbh33knI4BRq4-7REpa8QxZBYFHDFdQ0jv_t5oHli9ALSiUgThfzEZ87ovY8e2_XTSuFqSPJM6fPlLXFDiUl-NS1IB6R5YsiH4-NrInN3mZHwxCC9W0hJaI8 Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c79a68ef003f4f3faf0a2d4551c6d5ee", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}] Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 269643d1d0eb465ea092599c11480b71 Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'e13a8f09-73e9-48b6-8e92-1949b4004ecf'} Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:37:17.769664 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:37:17.773026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. Jul 25 13:37:17.773026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.773026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:17.773026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.773026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.773026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:17.773026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:17.773026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:37:17.773026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:37:17.773026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. Jul 25 13:37:17.773026 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.773026 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3280129e-c4bd-461c-826a-97f3ff00dc05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Returning 404 to user: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:37:17.773026 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3280129e-c4bd-461c-826a-97f3ff00dc05 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 404 len: 111 microversion: 2.1 time: 0.033380 Jul 25 13:37:17.773026 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3304/6680] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:37:17 2022] DELETE /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:37:17.779923 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-50298a2b-c5cd-4bbb-b979-1f8b6fd19101 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:17.780531 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-50298a2b-c5cd-4bbb-b979-1f8b6fd19101 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] [instance: e13a8f09-73e9-48b6-8e92-1949b4004ecf] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:17.787360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50298a2b-c5cd-4bbb-b979-1f8b6fd19101 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:17.787812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50298a2b-c5cd-4bbb-b979-1f8b6fd19101 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:17.788579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50298a2b-c5cd-4bbb-b979-1f8b6fd19101 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:17.789011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-50298a2b-c5cd-4bbb-b979-1f8b6fd19101 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:17.804242 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-50298a2b-c5cd-4bbb-b979-1f8b6fd19101 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] HTTP exception thrown: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-50298a2b-c5cd-4bbb-b979-1f8b6fd19101 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Request method failure captured: Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf HTTP/1.1 Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3ps2uAMwWcs8JWVJ4Y1EH4DEH-xcoDZUXcQ2SMYQDuHJ6xKZtzlY3crBbh33knI4BRq4-7REpa8QxZBYFHDFdQ0jv_t5oHli9ALSiUgThfzEZ87ovY8e2_XTSuFqSPJM6fPlLXFDiUl-NS1IB6R5YsiH4-NrInN3mZHwxCC9W0hJaI8 Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c79a68ef003f4f3faf0a2d4551c6d5ee", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c79a68ef003f4f3faf0a2d4551c6d5ee"}]}] Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: c79a68ef003f4f3faf0a2d4551c6d5ee Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServerActionsTestJSON-1916079540 Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 269643d1d0eb465ea092599c11480b71 Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServerActionsTestJSON-1916079540-project Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'e13a8f09-73e9-48b6-8e92-1949b4004ecf'} Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:17.805951 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.810178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:17.810178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:17.810178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:17.810178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:37:17.810178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:37:17.810178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. Jul 25 13:37:17.810178 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:17.810178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-50298a2b-c5cd-4bbb-b979-1f8b6fd19101 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Returning 404 to user: Instance e13a8f09-73e9-48b6-8e92-1949b4004ecf could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:37:17.810178 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-50298a2b-c5cd-4bbb-b979-1f8b6fd19101 tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf" status: 404 len: 111 microversion: 2.1 time: 0.031542 Jul 25 13:37:17.810178 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3377/6681] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:17 2022] GET /compute/v2.1/servers/e13a8f09-73e9-48b6-8e92-1949b4004ecf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 13:37:17.816606 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-31e73ee2-a759-4f9c-b687-bdb52749181a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] Calling method '.version_select at 0x7efcf970e940>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:17.843063 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-31e73ee2-a759-4f9c-b687-bdb52749181a tempest-ServerActionsTestJSON-1916079540 tempest-ServerActionsTestJSON-1916079540-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1831216923" status: 202 len: 0 microversion: 2.1 time: 0.030347 Jul 25 13:37:17.843820 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3305/6682] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Jul 25 13:37:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1831216923 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:37:27.685975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4e29a539-2774-47ae-8fff-4a59f81a7f3c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-76021320", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "8dfb35ca-7981-4e33-9b60-37d73c726fa0"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:37:27.744042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-4e29a539-2774-47ae-8fff-4a59f81a7f3c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] validate_networks() for [('8dfb35ca-7981-4e33-9b60-37d73c726fa0', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:37:27.794277 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=35 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:37:28.225553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-4e29a539-2774-47ae-8fff-4a59f81a7f3c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:37:28.226012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-4e29a539-2774-47ae-8fff-4a59f81a7f3c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:37:28.226501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-4e29a539-2774-47ae-8fff-4a59f81a7f3c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:37:28.226919 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-4e29a539-2774-47ae-8fff-4a59f81a7f3c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:37:28.227342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-4e29a539-2774-47ae-8fff-4a59f81a7f3c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:37:28.239433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e29a539-2774-47ae-8fff-4a59f81a7f3c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:28.239886 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e29a539-2774-47ae-8fff-4a59f81a7f3c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:28.240720 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e29a539-2774-47ae-8fff-4a59f81a7f3c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:28.241156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e29a539-2774-47ae-8fff-4a59f81a7f3c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:28.261144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-4e29a539-2774-47ae-8fff-4a59f81a7f3c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Getting quotas for project 5e7d8321c7f043b8baedf9c1dce84fd2. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:37:28.266520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-4e29a539-2774-47ae-8fff-4a59f81a7f3c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Getting quotas for user 974e4bb05ea1467a8c3bfec8528c0a3b and project 5e7d8321c7f043b8baedf9c1dce84fd2. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:37:28.279173 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4e29a539-2774-47ae-8fff-4a59f81a7f3c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:37:28.281468 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4e29a539-2774-47ae-8fff-4a59f81a7f3c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:37:28.324990 n-d-848886-15 devstack@n-api.service[125884]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4e29a539-2774-47ae-8fff-4a59f81a7f3c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [1438c73f-50f7-4f8d-b941-051fecb408cd] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 13:37:29.332897 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [None req-4e29a539-2774-47ae-8fff-4a59f81a7f3c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [1438c73f-50f7-4f8d-b941-051fecb408cd] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 45832. Jul 25 13:37:29.338304 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4e29a539-2774-47ae-8fff-4a59f81a7f3c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.805326 Jul 25 13:37:29.339037 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3378/6683] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:37:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:37:29.348038 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=29 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:37:29.348937 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:37:29.354277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0db49d59-8c51-41d0-b22f-d9722091b373 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:29.355111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0db49d59-8c51-41d0-b22f-d9722091b373 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:29.411483 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0db49d59-8c51-41d0-b22f-d9722091b373 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:29.421380 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0db49d59-8c51-41d0-b22f-d9722091b373 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811" status: 200 len: 1215 microversion: 2.1 time: 0.075262 Jul 25 13:37:29.422072 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3306/6684] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:29 2022] GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811 => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:30.443631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-91ac56da-35f8-47f5-8cd3-ee9150cc5740 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:30.444330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-91ac56da-35f8-47f5-8cd3-ee9150cc5740 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:30.505167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-91ac56da-35f8-47f5-8cd3-ee9150cc5740 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:30.512442 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-91ac56da-35f8-47f5-8cd3-ee9150cc5740 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811" status: 200 len: 1215 microversion: 2.1 time: 0.074003 Jul 25 13:37:30.513014 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3379/6685] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:30 2022] GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811 => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:31.533037 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-29674233-8fed-4e8e-93ad-79de695fc478 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:31.533764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-29674233-8fed-4e8e-93ad-79de695fc478 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:31.593979 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-29674233-8fed-4e8e-93ad-79de695fc478 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:31.602760 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-29674233-8fed-4e8e-93ad-79de695fc478 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811" status: 200 len: 1215 microversion: 2.1 time: 0.073672 Jul 25 13:37:31.603353 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3307/6686] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:31 2022] GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811 => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:32.625617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f157f0e7-b1ea-407e-b2d9-cb150a512f43 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:32.626420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f157f0e7-b1ea-407e-b2d9-cb150a512f43 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:32.690616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f157f0e7-b1ea-407e-b2d9-cb150a512f43 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:32.708695 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f157f0e7-b1ea-407e-b2d9-cb150a512f43 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811" status: 200 len: 1215 microversion: 2.1 time: 0.087280 Jul 25 13:37:32.709585 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3380/6687] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:32 2022] GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:33.742744 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dbea39e4-502b-4251-85d7-e88b825a8efe tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:33.743480 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dbea39e4-502b-4251-85d7-e88b825a8efe tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:33.753724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbea39e4-502b-4251-85d7-e88b825a8efe tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:33.754207 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbea39e4-502b-4251-85d7-e88b825a8efe tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:33.755043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbea39e4-502b-4251-85d7-e88b825a8efe tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:33.755495 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbea39e4-502b-4251-85d7-e88b825a8efe tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:33.835912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dbea39e4-502b-4251-85d7-e88b825a8efe tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:33.844150 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dbea39e4-502b-4251-85d7-e88b825a8efe tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811" status: 200 len: 1219 microversion: 2.1 time: 0.107745 Jul 25 13:37:33.844662 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3308/6688] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:33 2022] GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811 => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:34.865039 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a9fa6017-e6c1-471a-9d3d-16e1a453c16c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:34.865727 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a9fa6017-e6c1-471a-9d3d-16e1a453c16c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:34.874375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a9fa6017-e6c1-471a-9d3d-16e1a453c16c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:34.874827 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a9fa6017-e6c1-471a-9d3d-16e1a453c16c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:34.875624 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a9fa6017-e6c1-471a-9d3d-16e1a453c16c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:34.876087 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a9fa6017-e6c1-471a-9d3d-16e1a453c16c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:34.956612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a9fa6017-e6c1-471a-9d3d-16e1a453c16c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:34.972030 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a9fa6017-e6c1-471a-9d3d-16e1a453c16c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811" status: 200 len: 1273 microversion: 2.1 time: 0.110600 Jul 25 13:37:34.973091 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3381/6689] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:34 2022] GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811 => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:36.009867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d826fe2e-ac2b-4ca6-89e6-33552e2c9bbd tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:36.012335 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d826fe2e-ac2b-4ca6-89e6-33552e2c9bbd tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:36.024717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d826fe2e-ac2b-4ca6-89e6-33552e2c9bbd tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:36.025567 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d826fe2e-ac2b-4ca6-89e6-33552e2c9bbd tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:36.026958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d826fe2e-ac2b-4ca6-89e6-33552e2c9bbd tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:36.028237 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d826fe2e-ac2b-4ca6-89e6-33552e2c9bbd tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:36.275403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-3d173b9e-3d09-4929-b68d-9ea90780bdb8 req-2ac55e7b-ed85-461b-a5c8-dd02387657b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e29634ba-0f8b-4966-985e-6daed434d811", "tag": "545a7a58-f58e-445c-aa71-86de7e426711"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:37:36.291825 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d826fe2e-ac2b-4ca6-89e6-33552e2c9bbd tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:36.299453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3d173b9e-3d09-4929-b68d-9ea90780bdb8 req-2ac55e7b-ed85-461b-a5c8-dd02387657b8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:36.300283 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3d173b9e-3d09-4929-b68d-9ea90780bdb8 req-2ac55e7b-ed85-461b-a5c8-dd02387657b8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:36.310576 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d826fe2e-ac2b-4ca6-89e6-33552e2c9bbd tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811" status: 200 len: 1315 microversion: 2.1 time: 0.308138 Jul 25 13:37:36.319654 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3309/6690] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:36 2022] GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:36.321446 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-3d173b9e-3d09-4929-b68d-9ea90780bdb8 req-2ac55e7b-ed85-461b-a5c8-dd02387657b8 service nova] Creating event network-changed:545a7a58-f58e-445c-aa71-86de7e426711 for instance e29634ba-0f8b-4966-985e-6daed434d811 on n-h2-848886-15 Jul 25 13:37:36.329347 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-3d173b9e-3d09-4929-b68d-9ea90780bdb8 req-2ac55e7b-ed85-461b-a5c8-dd02387657b8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064381 Jul 25 13:37:36.330026 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3382/6691] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:37:37.333951 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e111fb2f-d381-4c40-b556-533263954c0e tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:37.335033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e111fb2f-d381-4c40-b556-533263954c0e tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:37.350014 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e111fb2f-d381-4c40-b556-533263954c0e tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:37.350786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e111fb2f-d381-4c40-b556-533263954c0e tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:37.352255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e111fb2f-d381-4c40-b556-533263954c0e tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:37.352782 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e111fb2f-d381-4c40-b556-533263954c0e tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:37.532392 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e111fb2f-d381-4c40-b556-533263954c0e tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:37.543126 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e111fb2f-d381-4c40-b556-533263954c0e tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811" status: 200 len: 1315 microversion: 2.1 time: 0.215017 Jul 25 13:37:37.543772 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3310/6692] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:37 2022] GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:38.568319 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-17d66b57-3a5e-433c-91e9-f2e14aa55a21 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:38.569378 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-17d66b57-3a5e-433c-91e9-f2e14aa55a21 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:38.574174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:37:38.582292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-17d66b57-3a5e-433c-91e9-f2e14aa55a21 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:38.583095 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-17d66b57-3a5e-433c-91e9-f2e14aa55a21 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:38.584279 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-17d66b57-3a5e-433c-91e9-f2e14aa55a21 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:38.584943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-17d66b57-3a5e-433c-91e9-f2e14aa55a21 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:38.746352 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-17d66b57-3a5e-433c-91e9-f2e14aa55a21 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:38.758319 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-17d66b57-3a5e-433c-91e9-f2e14aa55a21 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811" status: 200 len: 1315 microversion: 2.1 time: 0.196134 Jul 25 13:37:38.759257 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3383/6693] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:38 2022] GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:37:39.789493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b636fcf3-78bb-4517-b046-119fe95f7c61 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:39.790277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b636fcf3-78bb-4517-b046-119fe95f7c61 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:39.798758 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b636fcf3-78bb-4517-b046-119fe95f7c61 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:39.799228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b636fcf3-78bb-4517-b046-119fe95f7c61 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:39.800028 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b636fcf3-78bb-4517-b046-119fe95f7c61 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:39.800471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b636fcf3-78bb-4517-b046-119fe95f7c61 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:39.956336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b636fcf3-78bb-4517-b046-119fe95f7c61 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:39.965357 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b636fcf3-78bb-4517-b046-119fe95f7c61 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811" status: 200 len: 1315 microversion: 2.1 time: 0.179754 Jul 25 13:37:39.966033 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3311/6694] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:39 2022] GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:40.014477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-05536194-5329-4e12-8cd3-0eb3d0158d32 req-8cbd7713-e687-439a-a3e4-faac7f72142d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29634ba-0f8b-4966-985e-6daed434d811", "name": "network-vif-plugged", "status": "completed", "tag": "545a7a58-f58e-445c-aa71-86de7e426711"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:37:40.025534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-05536194-5329-4e12-8cd3-0eb3d0158d32 req-8cbd7713-e687-439a-a3e4-faac7f72142d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:40.026044 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-05536194-5329-4e12-8cd3-0eb3d0158d32 req-8cbd7713-e687-439a-a3e4-faac7f72142d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:40.038294 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-05536194-5329-4e12-8cd3-0eb3d0158d32 req-8cbd7713-e687-439a-a3e4-faac7f72142d service nova] Creating event network-vif-plugged:545a7a58-f58e-445c-aa71-86de7e426711 for instance e29634ba-0f8b-4966-985e-6daed434d811 on n-h2-848886-15 Jul 25 13:37:40.043884 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-05536194-5329-4e12-8cd3-0eb3d0158d32 req-8cbd7713-e687-439a-a3e4-faac7f72142d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033237 Jul 25 13:37:40.044697 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3384/6695] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:37:40.986755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3b3ac912-e6fb-44bd-be78-73511ecd331e tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:40.987455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3b3ac912-e6fb-44bd-be78-73511ecd331e tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:40.994921 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b3ac912-e6fb-44bd-be78-73511ecd331e tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:40.995392 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b3ac912-e6fb-44bd-be78-73511ecd331e tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:40.996198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b3ac912-e6fb-44bd-be78-73511ecd331e tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:40.996651 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b3ac912-e6fb-44bd-be78-73511ecd331e tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:41.148331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3b3ac912-e6fb-44bd-be78-73511ecd331e tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:41.156523 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3b3ac912-e6fb-44bd-be78-73511ecd331e tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811" status: 200 len: 1315 microversion: 2.1 time: 0.173943 Jul 25 13:37:41.157127 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3312/6696] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:40 2022] GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:42.183000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d482f92f-efb8-4e21-a0aa-43cf532bd5da tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:42.184083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d482f92f-efb8-4e21-a0aa-43cf532bd5da tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:42.193330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d482f92f-efb8-4e21-a0aa-43cf532bd5da tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:42.194082 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d482f92f-efb8-4e21-a0aa-43cf532bd5da tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:42.195353 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d482f92f-efb8-4e21-a0aa-43cf532bd5da tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:42.196161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d482f92f-efb8-4e21-a0aa-43cf532bd5da tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:42.344547 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d482f92f-efb8-4e21-a0aa-43cf532bd5da tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:42.353241 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d482f92f-efb8-4e21-a0aa-43cf532bd5da tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811" status: 200 len: 1504 microversion: 2.1 time: 0.177639 Jul 25 13:37:42.353948 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3385/6697] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:42 2022] GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:37:42.416189 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8121a18b-c4c1-4624-b5d4-9ee29643622d tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-607253968", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "8dfb35ca-7981-4e33-9b60-37d73c726fa0"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:37:42.427775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:37:42.482256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-8121a18b-c4c1-4624-b5d4-9ee29643622d tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] validate_networks() for [('8dfb35ca-7981-4e33-9b60-37d73c726fa0', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:37:42.962741 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-8121a18b-c4c1-4624-b5d4-9ee29643622d tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:37:42.963207 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-8121a18b-c4c1-4624-b5d4-9ee29643622d tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:37:42.963696 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-8121a18b-c4c1-4624-b5d4-9ee29643622d tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:37:42.964126 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-8121a18b-c4c1-4624-b5d4-9ee29643622d tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:37:42.964559 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-8121a18b-c4c1-4624-b5d4-9ee29643622d tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:37:42.978722 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8121a18b-c4c1-4624-b5d4-9ee29643622d tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:42.979185 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8121a18b-c4c1-4624-b5d4-9ee29643622d tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:42.979996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8121a18b-c4c1-4624-b5d4-9ee29643622d tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:42.980498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8121a18b-c4c1-4624-b5d4-9ee29643622d tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:43.005652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-8121a18b-c4c1-4624-b5d4-9ee29643622d tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Getting quotas for project 5e7d8321c7f043b8baedf9c1dce84fd2. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:37:43.013258 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-8121a18b-c4c1-4624-b5d4-9ee29643622d tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Getting quotas for user 974e4bb05ea1467a8c3bfec8528c0a3b and project 5e7d8321c7f043b8baedf9c1dce84fd2. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:37:43.028536 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8121a18b-c4c1-4624-b5d4-9ee29643622d tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:37:43.031122 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8121a18b-c4c1-4624-b5d4-9ee29643622d tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:37:43.081772 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8121a18b-c4c1-4624-b5d4-9ee29643622d tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671194 Jul 25 13:37:43.082460 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3313/6698] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:37:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:37:43.093717 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e94f1243-5d21-4f51-a36d-e896db9a0683 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:43.094365 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e94f1243-5d21-4f51-a36d-e896db9a0683 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:43.096533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=10 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:37:43.097292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:37:43.160568 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e94f1243-5d21-4f51-a36d-e896db9a0683 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:43.167810 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e94f1243-5d21-4f51-a36d-e896db9a0683 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d" status: 200 len: 1216 microversion: 2.1 time: 0.078106 Jul 25 13:37:43.168400 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3386/6699] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:43 2022] GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d => generated 1216 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:44.192640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c3ec51f5-420c-4e19-a89d-d32cebee309b tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:44.193655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c3ec51f5-420c-4e19-a89d-d32cebee309b tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:44.202159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3ec51f5-420c-4e19-a89d-d32cebee309b tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:44.202709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3ec51f5-420c-4e19-a89d-d32cebee309b tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:44.204970 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3ec51f5-420c-4e19-a89d-d32cebee309b tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:44.204970 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3ec51f5-420c-4e19-a89d-d32cebee309b tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:44.618370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c3ec51f5-420c-4e19-a89d-d32cebee309b tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:44.632543 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c3ec51f5-420c-4e19-a89d-d32cebee309b tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d" status: 200 len: 1286 microversion: 2.1 time: 0.446229 Jul 25 13:37:44.633353 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3314/6700] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:44 2022] GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d => generated 1286 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:45.658123 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c7b77518-f904-4c4a-a65c-4f489f810579 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:45.659059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c7b77518-f904-4c4a-a65c-4f489f810579 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:45.666796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7b77518-f904-4c4a-a65c-4f489f810579 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:45.667253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7b77518-f904-4c4a-a65c-4f489f810579 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:45.668068 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7b77518-f904-4c4a-a65c-4f489f810579 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:45.668510 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c7b77518-f904-4c4a-a65c-4f489f810579 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:45.901284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c7b77518-f904-4c4a-a65c-4f489f810579 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:45.909349 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c7b77518-f904-4c4a-a65c-4f489f810579 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d" status: 200 len: 1316 microversion: 2.1 time: 0.257244 Jul 25 13:37:45.910284 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3387/6701] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:45 2022] GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d => generated 1316 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:46.028067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-fbbeee05-edaf-48f1-b2e2-ca57a5645b24 req-4e5564b7-044a-48f8-9e1f-1c31ae51f9ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d", "tag": "860b8931-16a0-4b8b-9740-3f33d780b9a1"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:37:46.048487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fbbeee05-edaf-48f1-b2e2-ca57a5645b24 req-4e5564b7-044a-48f8-9e1f-1c31ae51f9ea service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:46.049235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fbbeee05-edaf-48f1-b2e2-ca57a5645b24 req-4e5564b7-044a-48f8-9e1f-1c31ae51f9ea service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:46.069081 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-fbbeee05-edaf-48f1-b2e2-ca57a5645b24 req-4e5564b7-044a-48f8-9e1f-1c31ae51f9ea service nova] Creating event network-changed:860b8931-16a0-4b8b-9740-3f33d780b9a1 for instance 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d on n-h1-848886-15 Jul 25 13:37:46.077491 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-fbbeee05-edaf-48f1-b2e2-ca57a5645b24 req-4e5564b7-044a-48f8-9e1f-1c31ae51f9ea service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058012 Jul 25 13:37:46.079558 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3315/6702] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:37:46.933107 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-20a53c3b-a4dd-42da-918e-71f550536507 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:46.934572 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-20a53c3b-a4dd-42da-918e-71f550536507 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:46.940627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20a53c3b-a4dd-42da-918e-71f550536507 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:46.941091 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20a53c3b-a4dd-42da-918e-71f550536507 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:46.941867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20a53c3b-a4dd-42da-918e-71f550536507 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:46.942321 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20a53c3b-a4dd-42da-918e-71f550536507 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:47.082554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-20a53c3b-a4dd-42da-918e-71f550536507 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:47.092119 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-20a53c3b-a4dd-42da-918e-71f550536507 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d" status: 200 len: 1316 microversion: 2.1 time: 0.163952 Jul 25 13:37:47.092702 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3388/6703] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:46 2022] GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:48.115065 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-61d0289b-2e43-4aaf-9b88-2e41bf9809e1 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:48.115792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-61d0289b-2e43-4aaf-9b88-2e41bf9809e1 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:48.122921 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-61d0289b-2e43-4aaf-9b88-2e41bf9809e1 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:48.123772 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-61d0289b-2e43-4aaf-9b88-2e41bf9809e1 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:48.124182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-61d0289b-2e43-4aaf-9b88-2e41bf9809e1 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:48.124684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-61d0289b-2e43-4aaf-9b88-2e41bf9809e1 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:48.280593 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-61d0289b-2e43-4aaf-9b88-2e41bf9809e1 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:48.291349 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-61d0289b-2e43-4aaf-9b88-2e41bf9809e1 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d" status: 200 len: 1316 microversion: 2.1 time: 0.182013 Jul 25 13:37:48.292095 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3316/6704] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:48 2022] GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d => generated 1316 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:49.312909 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7a4449fc-7f19-4f45-a691-1d4216cf9602 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:49.313545 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7a4449fc-7f19-4f45-a691-1d4216cf9602 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:49.321566 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a4449fc-7f19-4f45-a691-1d4216cf9602 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:49.321967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a4449fc-7f19-4f45-a691-1d4216cf9602 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:49.322746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a4449fc-7f19-4f45-a691-1d4216cf9602 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:49.323178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a4449fc-7f19-4f45-a691-1d4216cf9602 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:49.460998 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7a4449fc-7f19-4f45-a691-1d4216cf9602 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:49.469158 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7a4449fc-7f19-4f45-a691-1d4216cf9602 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d" status: 200 len: 1316 microversion: 2.1 time: 0.160226 Jul 25 13:37:49.469744 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3389/6705] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:49 2022] GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:50.492361 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e5b641ac-779c-48c3-8c06-bf4d85267d50 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:50.492911 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e5b641ac-779c-48c3-8c06-bf4d85267d50 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:50.500972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e5b641ac-779c-48c3-8c06-bf4d85267d50 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:50.501442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e5b641ac-779c-48c3-8c06-bf4d85267d50 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:50.502349 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e5b641ac-779c-48c3-8c06-bf4d85267d50 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:50.502802 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e5b641ac-779c-48c3-8c06-bf4d85267d50 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:50.651287 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e5b641ac-779c-48c3-8c06-bf4d85267d50 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:50.659691 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e5b641ac-779c-48c3-8c06-bf4d85267d50 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d" status: 200 len: 1316 microversion: 2.1 time: 0.173112 Jul 25 13:37:50.660286 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3317/6706] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:50 2022] GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:51.627775 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-dcf66356-cc20-4343-9c0a-bec9980fee3a req-5a6662e1-7d73-449f-a52f-dc0b27e25f7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d", "name": "network-vif-plugged", "status": "completed", "tag": "860b8931-16a0-4b8b-9740-3f33d780b9a1"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:37:51.638574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-dcf66356-cc20-4343-9c0a-bec9980fee3a req-5a6662e1-7d73-449f-a52f-dc0b27e25f7f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:51.639019 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-dcf66356-cc20-4343-9c0a-bec9980fee3a req-5a6662e1-7d73-449f-a52f-dc0b27e25f7f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:51.651099 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-dcf66356-cc20-4343-9c0a-bec9980fee3a req-5a6662e1-7d73-449f-a52f-dc0b27e25f7f service nova] Creating event network-vif-plugged:860b8931-16a0-4b8b-9740-3f33d780b9a1 for instance 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d on n-h1-848886-15 Jul 25 13:37:51.656376 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-dcf66356-cc20-4343-9c0a-bec9980fee3a req-5a6662e1-7d73-449f-a52f-dc0b27e25f7f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032610 Jul 25 13:37:51.656982 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3390/6707] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:37:51.680980 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f4e51935-b641-4187-8c1b-619aae77a876 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:51.681612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f4e51935-b641-4187-8c1b-619aae77a876 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:51.690555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4e51935-b641-4187-8c1b-619aae77a876 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:51.691022 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4e51935-b641-4187-8c1b-619aae77a876 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:51.691829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4e51935-b641-4187-8c1b-619aae77a876 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:51.692281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f4e51935-b641-4187-8c1b-619aae77a876 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:51.883053 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f4e51935-b641-4187-8c1b-619aae77a876 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:51.891243 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f4e51935-b641-4187-8c1b-619aae77a876 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d" status: 200 len: 1316 microversion: 2.1 time: 0.214451 Jul 25 13:37:51.891816 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3318/6708] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:51 2022] GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:52.913938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-95ee5e6a-9525-498a-97fb-5e10042dd745 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:52.914800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-95ee5e6a-9525-498a-97fb-5e10042dd745 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:52.921772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95ee5e6a-9525-498a-97fb-5e10042dd745 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:52.922258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95ee5e6a-9525-498a-97fb-5e10042dd745 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:52.923042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95ee5e6a-9525-498a-97fb-5e10042dd745 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:52.923478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95ee5e6a-9525-498a-97fb-5e10042dd745 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:53.068261 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-95ee5e6a-9525-498a-97fb-5e10042dd745 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:53.077514 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-95ee5e6a-9525-498a-97fb-5e10042dd745 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d" status: 200 len: 1316 microversion: 2.1 time: 0.168548 Jul 25 13:37:53.078338 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3391/6709] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:52 2022] GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:54.104357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1abbe77d-6891-4b50-8611-6b2d412719a6 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:54.104950 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1abbe77d-6891-4b50-8611-6b2d412719a6 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:54.107957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:37:54.108645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:37:54.114910 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1abbe77d-6891-4b50-8611-6b2d412719a6 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:54.115363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1abbe77d-6891-4b50-8611-6b2d412719a6 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:54.116171 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1abbe77d-6891-4b50-8611-6b2d412719a6 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:54.116604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1abbe77d-6891-4b50-8611-6b2d412719a6 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:54.263618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1abbe77d-6891-4b50-8611-6b2d412719a6 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:54.273248 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1abbe77d-6891-4b50-8611-6b2d412719a6 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d" status: 200 len: 1504 microversion: 2.1 time: 0.172737 Jul 25 13:37:54.274365 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3319/6710] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:54 2022] GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:54.295348 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-72d4ef74-9418-4e82-81fb-c6cffc39553a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:54.296036 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-72d4ef74-9418-4e82-81fb-c6cffc39553a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:54.298187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:37:54.304745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-72d4ef74-9418-4e82-81fb-c6cffc39553a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:54.305202 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-72d4ef74-9418-4e82-81fb-c6cffc39553a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:54.306062 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-72d4ef74-9418-4e82-81fb-c6cffc39553a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:54.306507 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-72d4ef74-9418-4e82-81fb-c6cffc39553a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:54.335042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-72d4ef74-9418-4e82-81fb-c6cffc39553a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:37:54.431142 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-72d4ef74-9418-4e82-81fb-c6cffc39553a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d" status: 204 len: 0 microversion: 2.1 time: 0.139143 Jul 25 13:37:54.431874 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3392/6711] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:37:54 2022] DELETE /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:37:54.441254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-14492a4d-4d9a-4164-b989-64e795eda1c7 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:54.442212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-14492a4d-4d9a-4164-b989-64e795eda1c7 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:54.449081 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14492a4d-4d9a-4164-b989-64e795eda1c7 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:54.449719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14492a4d-4d9a-4164-b989-64e795eda1c7 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:54.450628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14492a4d-4d9a-4164-b989-64e795eda1c7 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:54.451048 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-14492a4d-4d9a-4164-b989-64e795eda1c7 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:54.596473 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-14492a4d-4d9a-4164-b989-64e795eda1c7 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:54.605118 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-14492a4d-4d9a-4164-b989-64e795eda1c7 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d" status: 200 len: 1510 microversion: 2.1 time: 0.167827 Jul 25 13:37:54.605711 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3320/6712] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:54 2022] GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:55.636629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1555a547-b378-4975-8c8d-699c8460d2f4 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:55.637806 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1555a547-b378-4975-8c8d-699c8460d2f4 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:55.648116 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1555a547-b378-4975-8c8d-699c8460d2f4 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:55.648872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1555a547-b378-4975-8c8d-699c8460d2f4 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:55.650299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1555a547-b378-4975-8c8d-699c8460d2f4 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:55.651024 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1555a547-b378-4975-8c8d-699c8460d2f4 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:55.891675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1555a547-b378-4975-8c8d-699c8460d2f4 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:55.901901 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1555a547-b378-4975-8c8d-699c8460d2f4 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d" status: 200 len: 1510 microversion: 2.1 time: 0.270918 Jul 25 13:37:55.902441 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3393/6713] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:55 2022] GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d => generated 1510 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:56.281241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-904d19ca-9e7e-4e2f-be8c-99e1bfafe7e2 req-d915ef58-eb7a-4a56-89c6-8a7a39ceba1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d", "name": "network-vif-deleted", "tag": "860b8931-16a0-4b8b-9740-3f33d780b9a1"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:37:56.293789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-904d19ca-9e7e-4e2f-be8c-99e1bfafe7e2 req-d915ef58-eb7a-4a56-89c6-8a7a39ceba1f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:56.294283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-904d19ca-9e7e-4e2f-be8c-99e1bfafe7e2 req-d915ef58-eb7a-4a56-89c6-8a7a39ceba1f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:56.308756 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-904d19ca-9e7e-4e2f-be8c-99e1bfafe7e2 req-d915ef58-eb7a-4a56-89c6-8a7a39ceba1f service nova] Creating event network-vif-deleted:860b8931-16a0-4b8b-9740-3f33d780b9a1 for instance 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d on n-h1-848886-15 Jul 25 13:37:56.315287 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-904d19ca-9e7e-4e2f-be8c-99e1bfafe7e2 req-d915ef58-eb7a-4a56-89c6-8a7a39ceba1f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038866 Jul 25 13:37:56.316109 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3321/6714] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:37:56.930624 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a7c301ad-8b16-43ab-9785-3b80096988a4 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:56.931278 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a7c301ad-8b16-43ab-9785-3b80096988a4 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:56.938606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7c301ad-8b16-43ab-9785-3b80096988a4 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:56.939217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7c301ad-8b16-43ab-9785-3b80096988a4 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:56.939830 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7c301ad-8b16-43ab-9785-3b80096988a4 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:56.940273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7c301ad-8b16-43ab-9785-3b80096988a4 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:56.959367 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-a7c301ad-8b16-43ab-9785-3b80096988a4 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] HTTP exception thrown: Instance 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d could not be found. Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a7c301ad-8b16-43ab-9785-3b80096988a4 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Request method failure captured: Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d HTTP/1.1 Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pyXW51pDN4ePh4mIcyc34pOSCm086bcu6ih0chU6N09bUHCH6F6N3SDODko8C8dlfl89ILwlnKO5Uh3JH9ncqhmh4qwwQ7BprVP6JEVIdrJlWA1czebnd7vHJqcyiMhtZ2uzMhmK2bDB1wiVzloBULwBBTMjgjGgzePDMFE61_CSGE Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5e7d8321c7f043b8baedf9c1dce84fd2 Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-2040542413 Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5e7d8321c7f043b8baedf9c1dce84fd2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5e7d8321c7f043b8baedf9c1dce84fd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e7d8321c7f043b8baedf9c1dce84fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e7d8321c7f043b8baedf9c1dce84fd2"}]}] Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-2040542413 Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5e7d8321c7f043b8baedf9c1dce84fd2 Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2040542413 Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-2040542413-project Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 974e4bb05ea1467a8c3bfec8528c0a3b Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-2040542413-project Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d could not be found. Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d'} Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d could not be found. Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d could not be found. Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:56.961064 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:56.966520 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:56.966520 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:56.966520 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:56.966520 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:37:56.966520 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:37:56.966520 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d could not be found. Jul 25 13:37:56.966520 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:56.966520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a7c301ad-8b16-43ab-9785-3b80096988a4 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Returning 404 to user: Instance 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:37:56.966520 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a7c301ad-8b16-43ab-9785-3b80096988a4 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d" status: 404 len: 111 microversion: 2.1 time: 0.037452 Jul 25 13:37:56.966520 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3394/6715] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:56 2022] GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:37:56.973163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2e68c120-7e02-433e-b35f-30fb59e9e166 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:56.974243 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2e68c120-7e02-433e-b35f-30fb59e9e166 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:56.981028 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e68c120-7e02-433e-b35f-30fb59e9e166 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:56.981617 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e68c120-7e02-433e-b35f-30fb59e9e166 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:56.982432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e68c120-7e02-433e-b35f-30fb59e9e166 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:56.982880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2e68c120-7e02-433e-b35f-30fb59e9e166 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:57.151826 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2e68c120-7e02-433e-b35f-30fb59e9e166 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:57.162248 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2e68c120-7e02-433e-b35f-30fb59e9e166 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811" status: 200 len: 1504 microversion: 2.1 time: 0.193106 Jul 25 13:37:57.163246 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3322/6716] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:56 2022] GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811 => generated 1504 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:57.192846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0d0b3a82-42a3-48f6-a661-7da74d1243de tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:37:57.196526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0d0b3a82-42a3-48f6-a661-7da74d1243de tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: 499abae8-9801-4d28-9dc7-03b3f57b9869] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:57.206285 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-0d0b3a82-42a3-48f6-a661-7da74d1243de tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] HTTP exception thrown: Instance 499abae8-9801-4d28-9dc7-03b3f57b9869 could not be found. Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0d0b3a82-42a3-48f6-a661-7da74d1243de tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Request method failure captured: Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/499abae8-9801-4d28-9dc7-03b3f57b9869/action HTTP/1.1 Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 32 Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pyXW51pDN4ePh4mIcyc34pOSCm086bcu6ih0chU6N09bUHCH6F6N3SDODko8C8dlfl89ILwlnKO5Uh3JH9ncqhmh4qwwQ7BprVP6JEVIdrJlWA1czebnd7vHJqcyiMhtZ2uzMhmK2bDB1wiVzloBULwBBTMjgjGgzePDMFE61_CSGE Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5e7d8321c7f043b8baedf9c1dce84fd2 Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-2040542413 Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5e7d8321c7f043b8baedf9c1dce84fd2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5e7d8321c7f043b8baedf9c1dce84fd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e7d8321c7f043b8baedf9c1dce84fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e7d8321c7f043b8baedf9c1dce84fd2"}]}] Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-2040542413 Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5e7d8321c7f043b8baedf9c1dce84fd2 Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2040542413 Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-2040542413-project Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 974e4bb05ea1467a8c3bfec8528c0a3b Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-2040542413-project Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: {"resize": {"flavorRef": "452"}} Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 499abae8-9801-4d28-9dc7-03b3f57b9869 could not be found. Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '499abae8-9801-4d28-9dc7-03b3f57b9869', 'body': {'resize': {'flavorRef': '452'}}} Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 499abae8-9801-4d28-9dc7-03b3f57b9869 could not be found. Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:37:57.209163 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:37:57.216664 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 499abae8-9801-4d28-9dc7-03b3f57b9869 could not be found. Jul 25 13:37:57.216664 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:57.216664 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:57.216664 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:57.216664 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:57.216664 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:57.216664 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:57.216664 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:37:57.216664 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:37:57.216664 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 499abae8-9801-4d28-9dc7-03b3f57b9869 could not be found. Jul 25 13:37:57.216664 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:57.216664 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0d0b3a82-42a3-48f6-a661-7da74d1243de tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Returning 404 to user: Instance 499abae8-9801-4d28-9dc7-03b3f57b9869 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:37:57.216664 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0d0b3a82-42a3-48f6-a661-7da74d1243de tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "POST /compute/v2.1/servers/499abae8-9801-4d28-9dc7-03b3f57b9869/action" status: 404 len: 111 microversion: 2.1 time: 0.025246 Jul 25 13:37:57.216664 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3395/6717] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:37:57 2022] POST /compute/v2.1/servers/499abae8-9801-4d28-9dc7-03b3f57b9869/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:37:57.224638 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-258ef2f4-fa19-4a66-a119-7f72cfcfeaf6 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:57.225570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-258ef2f4-fa19-4a66-a119-7f72cfcfeaf6 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:57.235147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-258ef2f4-fa19-4a66-a119-7f72cfcfeaf6 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:57.235679 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-258ef2f4-fa19-4a66-a119-7f72cfcfeaf6 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:57.236884 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-258ef2f4-fa19-4a66-a119-7f72cfcfeaf6 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:57.237396 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-258ef2f4-fa19-4a66-a119-7f72cfcfeaf6 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:57.419733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-258ef2f4-fa19-4a66-a119-7f72cfcfeaf6 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:57.428242 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-258ef2f4-fa19-4a66-a119-7f72cfcfeaf6 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811" status: 200 len: 1504 microversion: 2.1 time: 0.209155 Jul 25 13:37:57.428839 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3323/6718] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:57 2022] GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811 => generated 1504 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:57.452214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-af3bd3ce-c20e-4545-a926-6f0dccddd84c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:57.453217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-af3bd3ce-c20e-4545-a926-6f0dccddd84c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:57.464849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-af3bd3ce-c20e-4545-a926-6f0dccddd84c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:57.465652 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-af3bd3ce-c20e-4545-a926-6f0dccddd84c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:57.466966 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-af3bd3ce-c20e-4545-a926-6f0dccddd84c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:57.467684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-af3bd3ce-c20e-4545-a926-6f0dccddd84c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:57.642054 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-af3bd3ce-c20e-4545-a926-6f0dccddd84c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:57.652813 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-af3bd3ce-c20e-4545-a926-6f0dccddd84c tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811" status: 200 len: 1504 microversion: 2.1 time: 0.207129 Jul 25 13:37:57.653876 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3396/6719] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:57 2022] GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811 => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:57.682507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ad1cd9ae-87dc-4531-93e7-e51c20cd03b5 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "d92299eb-52fd-42f1-bcbc-9fec4a545186"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:37:57.684956 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ad1cd9ae-87dc-4531-93e7-e51c20cd03b5 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:57.691762 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad1cd9ae-87dc-4531-93e7-e51c20cd03b5 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:57.692231 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad1cd9ae-87dc-4531-93e7-e51c20cd03b5 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:57.693047 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad1cd9ae-87dc-4531-93e7-e51c20cd03b5 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:57.693511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ad1cd9ae-87dc-4531-93e7-e51c20cd03b5 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:57.724727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ad1cd9ae-87dc-4531-93e7-e51c20cd03b5 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:57.730666 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-ad1cd9ae-87dc-4531-93e7-e51c20cd03b5 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] HTTP exception thrown: Flavor d92299eb-52fd-42f1-bcbc-9fec4a545186 could not be found. Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ad1cd9ae-87dc-4531-93e7-e51c20cd03b5 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Request method failure captured: Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: request: POST /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811/action HTTP/1.1 Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 65 Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pyXW51pDN4ePh4mIcyc34pOSCm086bcu6ih0chU6N09bUHCH6F6N3SDODko8C8dlfl89ILwlnKO5Uh3JH9ncqhmh4qwwQ7BprVP6JEVIdrJlWA1czebnd7vHJqcyiMhtZ2uzMhmK2bDB1wiVzloBULwBBTMjgjGgzePDMFE61_CSGE Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 5e7d8321c7f043b8baedf9c1dce84fd2 Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-2040542413 Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5e7d8321c7f043b8baedf9c1dce84fd2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5e7d8321c7f043b8baedf9c1dce84fd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e7d8321c7f043b8baedf9c1dce84fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e7d8321c7f043b8baedf9c1dce84fd2"}]}] Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-2040542413 Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 5e7d8321c7f043b8baedf9c1dce84fd2 Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2040542413 Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-2040542413-project Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 974e4bb05ea1467a8c3bfec8528c0a3b Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-2040542413-project Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: {"resize": {"flavorRef": "d92299eb-52fd-42f1-bcbc-9fec4a545186"}} Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: exception: Flavor d92299eb-52fd-42f1-bcbc-9fec4a545186 could not be found. Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'e29634ba-0f8b-4966-985e-6daed434d811', 'body': {'resize': {'flavorRef': 'd92299eb-52fd-42f1-bcbc-9fec4a545186'}}} Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 13:37:57.739851 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor d92299eb-52fd-42f1-bcbc-9fec4a545186 could not be found. Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor d92299eb-52fd-42f1-bcbc-9fec4a545186 could not be found. Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor d92299eb-52fd-42f1-bcbc-9fec4a545186 could not be found. Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ad1cd9ae-87dc-4531-93e7-e51c20cd03b5 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Returning 400 to user: Flavor d92299eb-52fd-42f1-bcbc-9fec4a545186 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ad1cd9ae-87dc-4531-93e7-e51c20cd03b5 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "POST /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811/action" status: 400 len: 107 microversion: 2.1 time: 0.064723 Jul 25 13:37:57.743259 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3324/6720] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:37:57 2022] POST /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811/action => generated 107 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:37:57.752317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bb3923c3-4169-4629-baef-f6be617f73f7 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:57.753265 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bb3923c3-4169-4629-baef-f6be617f73f7 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:57.764077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bb3923c3-4169-4629-baef-f6be617f73f7 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:57.764642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bb3923c3-4169-4629-baef-f6be617f73f7 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:57.765498 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bb3923c3-4169-4629-baef-f6be617f73f7 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:57.766039 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bb3923c3-4169-4629-baef-f6be617f73f7 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:57.934746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bb3923c3-4169-4629-baef-f6be617f73f7 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:57.937613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:37:57.945753 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bb3923c3-4169-4629-baef-f6be617f73f7 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811" status: 200 len: 1504 microversion: 2.1 time: 0.197879 Jul 25 13:37:57.946472 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3397/6721] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:57 2022] GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811 => generated 1504 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:57.970985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8dca601a-2ba0-4e5a-8847-cba385dc0d94 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:57.972171 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8dca601a-2ba0-4e5a-8847-cba385dc0d94 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:57.981582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8dca601a-2ba0-4e5a-8847-cba385dc0d94 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:57.982077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8dca601a-2ba0-4e5a-8847-cba385dc0d94 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:57.982963 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8dca601a-2ba0-4e5a-8847-cba385dc0d94 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:57.983494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8dca601a-2ba0-4e5a-8847-cba385dc0d94 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:58.130397 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8dca601a-2ba0-4e5a-8847-cba385dc0d94 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:58.141159 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8dca601a-2ba0-4e5a-8847-cba385dc0d94 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811" status: 200 len: 1504 microversion: 2.1 time: 0.175864 Jul 25 13:37:58.141898 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3325/6722] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:57 2022] GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811 => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:58.163466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-368f9f84-cda3-4c94-847d-915e1b39142a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-368f9f84-cda3-4c94-847d-915e1b39142a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Request method failure captured: Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: request: POST /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811/action HTTP/1.1 Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 29 Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pyXW51pDN4ePh4mIcyc34pOSCm086bcu6ih0chU6N09bUHCH6F6N3SDODko8C8dlfl89ILwlnKO5Uh3JH9ncqhmh4qwwQ7BprVP6JEVIdrJlWA1czebnd7vHJqcyiMhtZ2uzMhmK2bDB1wiVzloBULwBBTMjgjGgzePDMFE61_CSGE Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5e7d8321c7f043b8baedf9c1dce84fd2 Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-2040542413 Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5e7d8321c7f043b8baedf9c1dce84fd2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5e7d8321c7f043b8baedf9c1dce84fd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e7d8321c7f043b8baedf9c1dce84fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e7d8321c7f043b8baedf9c1dce84fd2"}]}] Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-2040542413 Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5e7d8321c7f043b8baedf9c1dce84fd2 Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2040542413 Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-2040542413-project Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 974e4bb05ea1467a8c3bfec8528c0a3b Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-2040542413-project Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: {"resize": {"flavorRef": ""}} Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'e29634ba-0f8b-4966-985e-6daed434d811', 'body': {'resize': {'flavorRef': ''}}} Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise error Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi '' Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:58.167192 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:58.176165 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:58.176165 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:58.176165 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:58.176165 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:58.176165 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 13:37:58.176165 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 13:37:58.176165 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 25 13:37:58.176165 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:58.176165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-368f9f84-cda3-4c94-847d-915e1b39142a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:37:58.176165 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-368f9f84-cda3-4c94-847d-915e1b39142a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "POST /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811/action" status: 400 len: 113 microversion: 2.1 time: 0.010441 Jul 25 13:37:58.178310 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-01994bc8-c93e-4b9b-8b17-a9dc52db4704 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:58.178996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-01994bc8-c93e-4b9b-8b17-a9dc52db4704 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:58.181977 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3398/6723] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:37:58 2022] POST /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811/action => generated 113 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 13:37:58.185932 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01994bc8-c93e-4b9b-8b17-a9dc52db4704 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:58.186479 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01994bc8-c93e-4b9b-8b17-a9dc52db4704 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:58.187292 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01994bc8-c93e-4b9b-8b17-a9dc52db4704 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:58.187755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-01994bc8-c93e-4b9b-8b17-a9dc52db4704 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:58.335585 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-01994bc8-c93e-4b9b-8b17-a9dc52db4704 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:58.339880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=100 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:37:58.345869 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-01994bc8-c93e-4b9b-8b17-a9dc52db4704 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811" status: 200 len: 1504 microversion: 2.1 time: 0.171102 Jul 25 13:37:58.346152 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3326/6724] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:58 2022] GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:58.380238 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e1d43a58-d24d-46fa-9715-e548a870b64a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:58.381055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e1d43a58-d24d-46fa-9715-e548a870b64a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:58.396250 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1d43a58-d24d-46fa-9715-e548a870b64a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:58.396998 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1d43a58-d24d-46fa-9715-e548a870b64a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:58.398348 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1d43a58-d24d-46fa-9715-e548a870b64a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:58.399083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1d43a58-d24d-46fa-9715-e548a870b64a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:58.420022 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-e1d43a58-d24d-46fa-9715-e548a870b64a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] HTTP exception thrown: Instance 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d could not be found. Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e1d43a58-d24d-46fa-9715-e548a870b64a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Request method failure captured: Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d HTTP/1.1 Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pyXW51pDN4ePh4mIcyc34pOSCm086bcu6ih0chU6N09bUHCH6F6N3SDODko8C8dlfl89ILwlnKO5Uh3JH9ncqhmh4qwwQ7BprVP6JEVIdrJlWA1czebnd7vHJqcyiMhtZ2uzMhmK2bDB1wiVzloBULwBBTMjgjGgzePDMFE61_CSGE Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5e7d8321c7f043b8baedf9c1dce84fd2 Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-2040542413 Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5e7d8321c7f043b8baedf9c1dce84fd2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5e7d8321c7f043b8baedf9c1dce84fd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e7d8321c7f043b8baedf9c1dce84fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e7d8321c7f043b8baedf9c1dce84fd2"}]}] Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-2040542413 Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5e7d8321c7f043b8baedf9c1dce84fd2 Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2040542413 Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-2040542413-project Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 974e4bb05ea1467a8c3bfec8528c0a3b Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-2040542413-project Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d could not be found. Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d'} Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d could not be found. Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:37:58.421662 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:37:58.426826 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d could not be found. Jul 25 13:37:58.426826 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:58.426826 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:58.426826 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:58.426826 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:58.426826 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:58.426826 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:58.426826 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:37:58.426826 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:37:58.426826 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d could not be found. Jul 25 13:37:58.426826 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:37:58.426826 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e1d43a58-d24d-46fa-9715-e548a870b64a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Returning 404 to user: Instance 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:37:58.426826 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e1d43a58-d24d-46fa-9715-e548a870b64a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d" status: 404 len: 111 microversion: 2.1 time: 0.049418 Jul 25 13:37:58.426826 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3399/6725] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:37:58 2022] DELETE /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:37:58.436466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4c444603-ca05-4a21-a52e-c034c886ff2a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:58.437323 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4c444603-ca05-4a21-a52e-c034c886ff2a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:58.450738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c444603-ca05-4a21-a52e-c034c886ff2a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:58.451458 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c444603-ca05-4a21-a52e-c034c886ff2a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:58.452507 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c444603-ca05-4a21-a52e-c034c886ff2a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:58.453308 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c444603-ca05-4a21-a52e-c034c886ff2a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:58.471856 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-4c444603-ca05-4a21-a52e-c034c886ff2a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] HTTP exception thrown: Instance 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d could not be found. Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4c444603-ca05-4a21-a52e-c034c886ff2a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Request method failure captured: Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d HTTP/1.1 Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pyXW51pDN4ePh4mIcyc34pOSCm086bcu6ih0chU6N09bUHCH6F6N3SDODko8C8dlfl89ILwlnKO5Uh3JH9ncqhmh4qwwQ7BprVP6JEVIdrJlWA1czebnd7vHJqcyiMhtZ2uzMhmK2bDB1wiVzloBULwBBTMjgjGgzePDMFE61_CSGE Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 5e7d8321c7f043b8baedf9c1dce84fd2 Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-ServersNegativeTestJSON-2040542413 Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5e7d8321c7f043b8baedf9c1dce84fd2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5e7d8321c7f043b8baedf9c1dce84fd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e7d8321c7f043b8baedf9c1dce84fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e7d8321c7f043b8baedf9c1dce84fd2"}]}] Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-ServersNegativeTestJSON-2040542413 Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 5e7d8321c7f043b8baedf9c1dce84fd2 Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2040542413 Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-ServersNegativeTestJSON-2040542413-project Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 974e4bb05ea1467a8c3bfec8528c0a3b Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-ServersNegativeTestJSON-2040542413-project Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d could not be found. Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d'} Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d could not be found. Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d could not be found. Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:37:58.473560 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:58.479781 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:37:58.479781 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:37:58.479781 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:37:58.479781 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:37:58.479781 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:37:58.479781 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d could not be found. Jul 25 13:37:58.479781 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:37:58.479781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4c444603-ca05-4a21-a52e-c034c886ff2a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Returning 404 to user: Instance 2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:37:58.479781 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4c444603-ca05-4a21-a52e-c034c886ff2a tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d" status: 404 len: 111 microversion: 2.1 time: 0.045701 Jul 25 13:37:58.479781 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3327/6726] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:58 2022] GET /compute/v2.1/servers/2c82f3ae-d1ef-46c3-a29c-fc9cfab0790d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:37:58.485147 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1904216e-eac2-48d5-b48d-e9d123a770ac tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:58.485664 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1904216e-eac2-48d5-b48d-e9d123a770ac tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:58.497017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1904216e-eac2-48d5-b48d-e9d123a770ac tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:58.497476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1904216e-eac2-48d5-b48d-e9d123a770ac tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:58.498318 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1904216e-eac2-48d5-b48d-e9d123a770ac tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:58.498765 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1904216e-eac2-48d5-b48d-e9d123a770ac tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:58.527563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1904216e-eac2-48d5-b48d-e9d123a770ac tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:37:58.634558 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1904216e-eac2-48d5-b48d-e9d123a770ac tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811" status: 204 len: 0 microversion: 2.1 time: 0.152964 Jul 25 13:37:58.635504 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3400/6727] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:37:58 2022] DELETE /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:37:58.648326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dd583f76-11b4-4de1-b78e-3747d14af280 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:58.649483 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dd583f76-11b4-4de1-b78e-3747d14af280 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:58.660377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dd583f76-11b4-4de1-b78e-3747d14af280 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:58.661141 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dd583f76-11b4-4de1-b78e-3747d14af280 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:58.662564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dd583f76-11b4-4de1-b78e-3747d14af280 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:58.663348 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dd583f76-11b4-4de1-b78e-3747d14af280 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:58.842547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dd583f76-11b4-4de1-b78e-3747d14af280 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:37:58.853629 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dd583f76-11b4-4de1-b78e-3747d14af280 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811" status: 200 len: 1510 microversion: 2.1 time: 0.212659 Jul 25 13:37:58.854426 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3328/6728] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:58 2022] GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811 => generated 1510 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:37:59.881659 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-eeb4c33b-f5c1-4182-9af1-7e1bbc245aa5 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:37:59.883068 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-eeb4c33b-f5c1-4182-9af1-7e1bbc245aa5 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:37:59.890937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eeb4c33b-f5c1-4182-9af1-7e1bbc245aa5 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:59.891397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eeb4c33b-f5c1-4182-9af1-7e1bbc245aa5 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:37:59.892216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eeb4c33b-f5c1-4182-9af1-7e1bbc245aa5 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:37:59.892653 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-eeb4c33b-f5c1-4182-9af1-7e1bbc245aa5 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:00.089431 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-eeb4c33b-f5c1-4182-9af1-7e1bbc245aa5 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e4bb05ea1467a8c3bfec8528c0a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d8321c7f043b8baedf9c1dce84fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:38:00.100248 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-eeb4c33b-f5c1-4182-9af1-7e1bbc245aa5 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811" status: 200 len: 1510 microversion: 2.1 time: 0.222896 Jul 25 13:38:00.101016 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3401/6729] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:37:59 2022] GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811 => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:38:00.565247 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-b053b961-0dc0-4a31-b2f6-176444021f9a req-30b8083c-86ad-4534-bfc3-4502e8898700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29634ba-0f8b-4966-985e-6daed434d811", "name": "network-vif-deleted", "tag": "545a7a58-f58e-445c-aa71-86de7e426711"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:38:00.574722 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:38:00.584675 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b053b961-0dc0-4a31-b2f6-176444021f9a req-30b8083c-86ad-4534-bfc3-4502e8898700 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:00.585743 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b053b961-0dc0-4a31-b2f6-176444021f9a req-30b8083c-86ad-4534-bfc3-4502e8898700 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:00.607808 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-b053b961-0dc0-4a31-b2f6-176444021f9a req-30b8083c-86ad-4534-bfc3-4502e8898700 service nova] Creating event network-vif-deleted:545a7a58-f58e-445c-aa71-86de7e426711 for instance e29634ba-0f8b-4966-985e-6daed434d811 on n-h2-848886-15 Jul 25 13:38:00.613202 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-b053b961-0dc0-4a31-b2f6-176444021f9a req-30b8083c-86ad-4534-bfc3-4502e8898700 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054155 Jul 25 13:38:00.613847 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3329/6730] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:38:01.122236 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-167c90be-7447-4abf-9a3f-f01c58c27279 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:38:01.123285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-167c90be-7447-4abf-9a3f-f01c58c27279 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] [instance: e29634ba-0f8b-4966-985e-6daed434d811] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:38:01.131497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-167c90be-7447-4abf-9a3f-f01c58c27279 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:01.131977 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-167c90be-7447-4abf-9a3f-f01c58c27279 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:01.132820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-167c90be-7447-4abf-9a3f-f01c58c27279 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:01.133265 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-167c90be-7447-4abf-9a3f-f01c58c27279 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:01.148539 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-167c90be-7447-4abf-9a3f-f01c58c27279 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] HTTP exception thrown: Instance e29634ba-0f8b-4966-985e-6daed434d811 could not be found. Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-167c90be-7447-4abf-9a3f-f01c58c27279 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Request method failure captured: Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811 HTTP/1.1 Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pyXW51pDN4ePh4mIcyc34pOSCm086bcu6ih0chU6N09bUHCH6F6N3SDODko8C8dlfl89ILwlnKO5Uh3JH9ncqhmh4qwwQ7BprVP6JEVIdrJlWA1czebnd7vHJqcyiMhtZ2uzMhmK2bDB1wiVzloBULwBBTMjgjGgzePDMFE61_CSGE Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5e7d8321c7f043b8baedf9c1dce84fd2 Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-ServersNegativeTestJSON-2040542413 Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5e7d8321c7f043b8baedf9c1dce84fd2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5e7d8321c7f043b8baedf9c1dce84fd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e7d8321c7f043b8baedf9c1dce84fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e7d8321c7f043b8baedf9c1dce84fd2"}]}] Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-ServersNegativeTestJSON-2040542413 Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5e7d8321c7f043b8baedf9c1dce84fd2 Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2040542413 Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-ServersNegativeTestJSON-2040542413-project Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 974e4bb05ea1467a8c3bfec8528c0a3b Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-ServersNegativeTestJSON-2040542413-project Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance e29634ba-0f8b-4966-985e-6daed434d811 could not be found. Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'e29634ba-0f8b-4966-985e-6daed434d811'} Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e29634ba-0f8b-4966-985e-6daed434d811 could not be found. Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e29634ba-0f8b-4966-985e-6daed434d811 could not be found. Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:38:01.150538 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:38:01.156001 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:38:01.156001 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:38:01.156001 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:38:01.156001 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:38:01.156001 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:38:01.156001 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e29634ba-0f8b-4966-985e-6daed434d811 could not be found. Jul 25 13:38:01.156001 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:38:01.156001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-167c90be-7447-4abf-9a3f-f01c58c27279 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] Returning 404 to user: Instance e29634ba-0f8b-4966-985e-6daed434d811 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:38:01.156001 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-167c90be-7447-4abf-9a3f-f01c58c27279 tempest-ServersNegativeTestJSON-2040542413 tempest-ServersNegativeTestJSON-2040542413-project] 10.222.0.49 "GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811" status: 404 len: 111 microversion: 2.1 time: 0.034105 Jul 25 13:38:01.156001 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3402/6731] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:38:01 2022] GET /compute/v2.1/servers/e29634ba-0f8b-4966-985e-6daed434d811 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:38:33.996789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=10 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:38:33.997704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:38:34.241020 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-56ae87c1-9713-4905-9b4f-18cb64d28dd1 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Action: 'create', calling method: .version_select at 0x7efcf905c940>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-116724940", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrjX3kEbcoCaQ3E9S03w2Fh/xEMas5Y/drm7Z3kijA0kE6+UaW56ZPOIyvjzb32C/hhYEDG1NVh+P/nG2Zhu2RVHsb474cQAPPVF0pyMaZghRY1wOqUSa+IoD1jf0krMg=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:38:34.258561 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-56ae87c1-9713-4905-9b4f-18cb64d28dd1 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Getting quotas for project 5c10e0474d594d0780fe4f1205c8a574. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:38:34.264582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-56ae87c1-9713-4905-9b4f-18cb64d28dd1 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Getting quotas for user f1e5a87c23b8404e9e9965beee9d42fa and project 5c10e0474d594d0780fe4f1205c8a574. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:38:34.293165 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-56ae87c1-9713-4905-9b4f-18cb64d28dd1 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.298924 Jul 25 13:38:34.293945 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3330/6732] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:38:33 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:38:34.367889 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7a571ef4-f2ba-43e8-aa02-e78d784def08 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1214221401", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-116724940", "networks": [{"uuid": "dd2cbb33-90db-4b00-b651-b64b4b66ced6"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:38:34.377438 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:38:34.378145 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:38:34.432478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-7a571ef4-f2ba-43e8-aa02-e78d784def08 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] validate_networks() for [('dd2cbb33-90db-4b00-b651-b64b4b66ced6', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:38:34.841501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-7a571ef4-f2ba-43e8-aa02-e78d784def08 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:38:34.841963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-7a571ef4-f2ba-43e8-aa02-e78d784def08 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:38:34.842443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-7a571ef4-f2ba-43e8-aa02-e78d784def08 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:38:34.842856 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-7a571ef4-f2ba-43e8-aa02-e78d784def08 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:38:34.843273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-7a571ef4-f2ba-43e8-aa02-e78d784def08 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:38:34.852899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a571ef4-f2ba-43e8-aa02-e78d784def08 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:34.853348 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a571ef4-f2ba-43e8-aa02-e78d784def08 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:34.854189 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a571ef4-f2ba-43e8-aa02-e78d784def08 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:34.854630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7a571ef4-f2ba-43e8-aa02-e78d784def08 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:34.877143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-7a571ef4-f2ba-43e8-aa02-e78d784def08 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Getting quotas for project 5c10e0474d594d0780fe4f1205c8a574. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:38:34.882779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-7a571ef4-f2ba-43e8-aa02-e78d784def08 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Getting quotas for user f1e5a87c23b8404e9e9965beee9d42fa and project 5c10e0474d594d0780fe4f1205c8a574. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:38:34.896951 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7a571ef4-f2ba-43e8-aa02-e78d784def08 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:38:34.899315 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7a571ef4-f2ba-43e8-aa02-e78d784def08 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:38:34.958132 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7a571ef4-f2ba-43e8-aa02-e78d784def08 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596702 Jul 25 13:38:34.965871 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3403/6733] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:38:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:38:34.971785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-716864e1-65af-4290-8770-45a77fe8fa9e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:38:34.972909 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-716864e1-65af-4290-8770-45a77fe8fa9e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:38:35.049371 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-716864e1-65af-4290-8770-45a77fe8fa9e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:38:35.056566 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-716864e1-65af-4290-8770-45a77fe8fa9e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44" status: 200 len: 1262 microversion: 2.1 time: 0.090372 Jul 25 13:38:35.057536 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3331/6734] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:38:34 2022] GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 => generated 1262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:38:36.078872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f5625a2d-ccb6-442d-80b9-41ea6971251f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:38:36.079603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f5625a2d-ccb6-442d-80b9-41ea6971251f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:38:36.089451 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5625a2d-ccb6-442d-80b9-41ea6971251f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:36.090431 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5625a2d-ccb6-442d-80b9-41ea6971251f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:36.092098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5625a2d-ccb6-442d-80b9-41ea6971251f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:36.092906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f5625a2d-ccb6-442d-80b9-41ea6971251f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:36.222096 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f5625a2d-ccb6-442d-80b9-41ea6971251f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:38:36.231354 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f5625a2d-ccb6-442d-80b9-41ea6971251f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44" status: 200 len: 1322 microversion: 2.1 time: 0.156611 Jul 25 13:38:36.232412 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3404/6735] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:38:36 2022] GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:38:37.253432 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-39808713-cca5-4411-8703-a62aa1e6ed2d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:38:37.254122 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-39808713-cca5-4411-8703-a62aa1e6ed2d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:38:37.263466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39808713-cca5-4411-8703-a62aa1e6ed2d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:37.264198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39808713-cca5-4411-8703-a62aa1e6ed2d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:37.265206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39808713-cca5-4411-8703-a62aa1e6ed2d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:37.265811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39808713-cca5-4411-8703-a62aa1e6ed2d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:37.872797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-39808713-cca5-4411-8703-a62aa1e6ed2d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:38:37.884480 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-39808713-cca5-4411-8703-a62aa1e6ed2d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44" status: 200 len: 1362 microversion: 2.1 time: 0.634855 Jul 25 13:38:37.887296 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3332/6736] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:38:37 2022] GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 => generated 1362 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:38:38.226602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-58d51fef-e310-4f1d-bb97-6e03c6619a97 req-c82f27ca-f4ab-423e-8e71-1f0f4f682dab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f0e8ff-8574-49e2-bd69-28a7d9a36f44", "tag": "414f595c-2c78-41b1-ba08-41eefa1a5b10"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:38:38.256445 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-58d51fef-e310-4f1d-bb97-6e03c6619a97 req-c82f27ca-f4ab-423e-8e71-1f0f4f682dab service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:38.256669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-58d51fef-e310-4f1d-bb97-6e03c6619a97 req-c82f27ca-f4ab-423e-8e71-1f0f4f682dab service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:38.288909 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-58d51fef-e310-4f1d-bb97-6e03c6619a97 req-c82f27ca-f4ab-423e-8e71-1f0f4f682dab service nova] Creating event network-changed:414f595c-2c78-41b1-ba08-41eefa1a5b10 for instance d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 on n-h1-848886-15 Jul 25 13:38:38.300077 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-58d51fef-e310-4f1d-bb97-6e03c6619a97 req-c82f27ca-f4ab-423e-8e71-1f0f4f682dab service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078056 Jul 25 13:38:38.302306 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3405/6737] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:38:38.919470 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-518b26c2-5157-4aa9-823f-22e8868c9f1e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:38:38.920028 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-518b26c2-5157-4aa9-823f-22e8868c9f1e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:38:38.927438 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-518b26c2-5157-4aa9-823f-22e8868c9f1e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:38.927904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-518b26c2-5157-4aa9-823f-22e8868c9f1e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:38.928710 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-518b26c2-5157-4aa9-823f-22e8868c9f1e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:38.929163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-518b26c2-5157-4aa9-823f-22e8868c9f1e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:39.069879 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-518b26c2-5157-4aa9-823f-22e8868c9f1e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:38:39.079115 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-518b26c2-5157-4aa9-823f-22e8868c9f1e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44" status: 200 len: 1362 microversion: 2.1 time: 0.163687 Jul 25 13:38:39.079725 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3333/6738] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:38:38 2022] GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:38:40.109812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-83970129-e3d2-4ec3-b5c2-f77bac4e08c5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:38:40.110518 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-83970129-e3d2-4ec3-b5c2-f77bac4e08c5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:38:40.118424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-83970129-e3d2-4ec3-b5c2-f77bac4e08c5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:40.118842 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-83970129-e3d2-4ec3-b5c2-f77bac4e08c5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:40.119626 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-83970129-e3d2-4ec3-b5c2-f77bac4e08c5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:40.120308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-83970129-e3d2-4ec3-b5c2-f77bac4e08c5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:40.269655 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-83970129-e3d2-4ec3-b5c2-f77bac4e08c5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:38:40.277558 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-83970129-e3d2-4ec3-b5c2-f77bac4e08c5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44" status: 200 len: 1362 microversion: 2.1 time: 0.172497 Jul 25 13:38:40.278197 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3406/6739] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:38:40 2022] GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:38:41.298543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9ea4d08e-708d-4335-aa21-0a9b3ec6fe52 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:38:41.299158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9ea4d08e-708d-4335-aa21-0a9b3ec6fe52 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:38:41.306856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ea4d08e-708d-4335-aa21-0a9b3ec6fe52 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:41.307327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ea4d08e-708d-4335-aa21-0a9b3ec6fe52 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:41.308113 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ea4d08e-708d-4335-aa21-0a9b3ec6fe52 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:41.308556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ea4d08e-708d-4335-aa21-0a9b3ec6fe52 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:41.443796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9ea4d08e-708d-4335-aa21-0a9b3ec6fe52 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:38:41.451890 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9ea4d08e-708d-4335-aa21-0a9b3ec6fe52 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44" status: 200 len: 1362 microversion: 2.1 time: 0.157371 Jul 25 13:38:41.452487 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3334/6740] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:38:41 2022] GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:38:42.473333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-76b8c11e-f35d-4070-819f-72cdddb05881 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:38:42.473972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-76b8c11e-f35d-4070-819f-72cdddb05881 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:38:42.481818 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76b8c11e-f35d-4070-819f-72cdddb05881 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:42.482299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76b8c11e-f35d-4070-819f-72cdddb05881 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:42.483078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76b8c11e-f35d-4070-819f-72cdddb05881 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:42.483524 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76b8c11e-f35d-4070-819f-72cdddb05881 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:42.623239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-76b8c11e-f35d-4070-819f-72cdddb05881 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:38:42.631206 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-76b8c11e-f35d-4070-819f-72cdddb05881 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44" status: 200 len: 1362 microversion: 2.1 time: 0.162192 Jul 25 13:38:42.631784 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3407/6741] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:38:42 2022] GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:38:43.652659 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3a6ec9b0-e613-4ec1-b58b-a4eb1903ffbb tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:38:43.653227 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3a6ec9b0-e613-4ec1-b58b-a4eb1903ffbb tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:38:43.660820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a6ec9b0-e613-4ec1-b58b-a4eb1903ffbb tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:43.661278 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a6ec9b0-e613-4ec1-b58b-a4eb1903ffbb tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:43.662110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a6ec9b0-e613-4ec1-b58b-a4eb1903ffbb tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:43.662557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3a6ec9b0-e613-4ec1-b58b-a4eb1903ffbb tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:43.801506 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3a6ec9b0-e613-4ec1-b58b-a4eb1903ffbb tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:38:43.810046 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3a6ec9b0-e613-4ec1-b58b-a4eb1903ffbb tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44" status: 200 len: 1362 microversion: 2.1 time: 0.161581 Jul 25 13:38:43.810649 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3335/6742] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:38:43 2022] GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:38:43.838711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-706365d3-c802-4afb-9804-7c8fc6a72235 req-118abe6b-45bc-4f40-99e9-423aba8f4790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f0e8ff-8574-49e2-bd69-28a7d9a36f44", "name": "network-vif-plugged", "status": "completed", "tag": "414f595c-2c78-41b1-ba08-41eefa1a5b10"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:38:43.851111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-706365d3-c802-4afb-9804-7c8fc6a72235 req-118abe6b-45bc-4f40-99e9-423aba8f4790 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:43.851559 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-706365d3-c802-4afb-9804-7c8fc6a72235 req-118abe6b-45bc-4f40-99e9-423aba8f4790 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:43.865187 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-706365d3-c802-4afb-9804-7c8fc6a72235 req-118abe6b-45bc-4f40-99e9-423aba8f4790 service nova] Creating event network-vif-plugged:414f595c-2c78-41b1-ba08-41eefa1a5b10 for instance d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 on n-h1-848886-15 Jul 25 13:38:43.870684 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-706365d3-c802-4afb-9804-7c8fc6a72235 req-118abe6b-45bc-4f40-99e9-423aba8f4790 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036119 Jul 25 13:38:43.871525 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3408/6743] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:38:44.831445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-286bed97-2d42-4267-80bc-174c194443fe tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:38:44.832121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-286bed97-2d42-4267-80bc-174c194443fe tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:38:44.840155 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-286bed97-2d42-4267-80bc-174c194443fe tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:44.840626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-286bed97-2d42-4267-80bc-174c194443fe tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:44.841420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-286bed97-2d42-4267-80bc-174c194443fe tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:44.841864 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-286bed97-2d42-4267-80bc-174c194443fe tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:45.000127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-286bed97-2d42-4267-80bc-174c194443fe tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:38:45.008347 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-286bed97-2d42-4267-80bc-174c194443fe tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44" status: 200 len: 1362 microversion: 2.1 time: 0.180837 Jul 25 13:38:45.009321 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3336/6744] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:38:44 2022] GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:38:46.027645 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:38:46.028453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:38:46.032785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3ed732d1-777f-4579-ac24-f45b7dea29fb tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:38:46.033504 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3ed732d1-777f-4579-ac24-f45b7dea29fb tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:38:46.041157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ed732d1-777f-4579-ac24-f45b7dea29fb tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:46.041595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ed732d1-777f-4579-ac24-f45b7dea29fb tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:46.042444 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ed732d1-777f-4579-ac24-f45b7dea29fb tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:46.042942 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ed732d1-777f-4579-ac24-f45b7dea29fb tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:46.180286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3ed732d1-777f-4579-ac24-f45b7dea29fb tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:38:46.188736 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3ed732d1-777f-4579-ac24-f45b7dea29fb tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44" status: 200 len: 1554 microversion: 2.1 time: 0.163253 Jul 25 13:38:46.189335 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3409/6745] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:38:46 2022] GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:38:46.209591 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5c595fa3-e501-4e12-897a-a02e9cdf0bae tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:38:46.210282 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5c595fa3-e501-4e12-897a-a02e9cdf0bae tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:38:46.212578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:38:46.219320 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c595fa3-e501-4e12-897a-a02e9cdf0bae tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:46.219760 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c595fa3-e501-4e12-897a-a02e9cdf0bae tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:46.220563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c595fa3-e501-4e12-897a-a02e9cdf0bae tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:46.221014 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5c595fa3-e501-4e12-897a-a02e9cdf0bae tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:46.357239 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5c595fa3-e501-4e12-897a-a02e9cdf0bae tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:38:46.367154 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5c595fa3-e501-4e12-897a-a02e9cdf0bae tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44" status: 200 len: 1554 microversion: 2.1 time: 0.161482 Jul 25 13:38:46.367756 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3337/6746] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:38:46 2022] GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:38:48.130931 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-46a96163-cf48-4eb0-8b0a-04fdfd3743de tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f7e58fd-bb2f-4e39-84ba-de527f1854c7"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:38:48.135239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-46a96163-cf48-4eb0-8b0a-04fdfd3743de tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:38:48.147624 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-46a96163-cf48-4eb0-8b0a-04fdfd3743de tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:48.148075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-46a96163-cf48-4eb0-8b0a-04fdfd3743de tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:48.148864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-46a96163-cf48-4eb0-8b0a-04fdfd3743de tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:38:48.149292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-46a96163-cf48-4eb0-8b0a-04fdfd3743de tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:38:48.442263 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-46a96163-cf48-4eb0-8b0a-04fdfd3743de tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "POST /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318472 Jul 25 13:38:48.442931 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3410/6747] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Jul 25 13:38:48 2022] POST /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:39:00.348677 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1162ae87-a8e2-4d54-bed5-b9ef3f436edf tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:00.349283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1162ae87-a8e2-4d54-bed5-b9ef3f436edf tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:00.351841 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:39:00.352588 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=36 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:39:00.360116 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1162ae87-a8e2-4d54-bed5-b9ef3f436edf tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:00.360588 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1162ae87-a8e2-4d54-bed5-b9ef3f436edf tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:00.361431 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1162ae87-a8e2-4d54-bed5-b9ef3f436edf tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:00.361908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1162ae87-a8e2-4d54-bed5-b9ef3f436edf tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:00.456355 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-1162ae87-a8e2-4d54-bed5-b9ef3f436edf tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lazy-loading 'services' on Instance uuid d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:39:00.538720 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1162ae87-a8e2-4d54-bed5-b9ef3f436edf tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44/os-volume_attachments/0f7e58fd-bb2f-4e39-84ba-de527f1854c7" status: 202 len: 0 microversion: 2.1 time: 0.193875 Jul 25 13:39:00.539355 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3338/6748] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Jul 25 13:39:00 2022] DELETE /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44/os-volume_attachments/0f7e58fd-bb2f-4e39-84ba-de527f1854c7 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:39:00.547557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:39:00.548417 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:39:00.554256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-70ec86ca-d4ca-41cb-994d-a5b4c5132935 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:00.557218 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-70ec86ca-d4ca-41cb-994d-a5b4c5132935 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:00.570423 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70ec86ca-d4ca-41cb-994d-a5b4c5132935 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:00.571010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70ec86ca-d4ca-41cb-994d-a5b4c5132935 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:00.571810 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70ec86ca-d4ca-41cb-994d-a5b4c5132935 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:00.572284 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-70ec86ca-d4ca-41cb-994d-a5b4c5132935 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:00.613174 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-70ec86ca-d4ca-41cb-994d-a5b4c5132935 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067468 Jul 25 13:39:00.613792 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3411/6749] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:39:00 2022] GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:39:01.630380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-573f9884-afe8-4e00-9b5e-da9fb6e482f5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:01.632836 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-573f9884-afe8-4e00-9b5e-da9fb6e482f5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:01.639994 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-573f9884-afe8-4e00-9b5e-da9fb6e482f5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:01.640472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-573f9884-afe8-4e00-9b5e-da9fb6e482f5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:01.641275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-573f9884-afe8-4e00-9b5e-da9fb6e482f5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:01.641720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-573f9884-afe8-4e00-9b5e-da9fb6e482f5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:01.675112 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-573f9884-afe8-4e00-9b5e-da9fb6e482f5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049956 Jul 25 13:39:01.675624 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3339/6750] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:39:01 2022] GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:39:02.687784 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3906e8ea-9a6a-4d1c-8b29-c8c3a731a34f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:02.690197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3906e8ea-9a6a-4d1c-8b29-c8c3a731a34f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:02.697737 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3906e8ea-9a6a-4d1c-8b29-c8c3a731a34f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:02.698243 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3906e8ea-9a6a-4d1c-8b29-c8c3a731a34f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:02.699042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3906e8ea-9a6a-4d1c-8b29-c8c3a731a34f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:02.699580 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3906e8ea-9a6a-4d1c-8b29-c8c3a731a34f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:02.735873 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3906e8ea-9a6a-4d1c-8b29-c8c3a731a34f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052166 Jul 25 13:39:02.736474 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3412/6751] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:39:02 2022] GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:39:03.749235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c1372efa-282a-4267-88ca-25afbff93266 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:03.751964 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c1372efa-282a-4267-88ca-25afbff93266 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:03.759641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c1372efa-282a-4267-88ca-25afbff93266 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:03.760107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c1372efa-282a-4267-88ca-25afbff93266 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:03.760968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c1372efa-282a-4267-88ca-25afbff93266 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:03.761418 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c1372efa-282a-4267-88ca-25afbff93266 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:03.796234 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c1372efa-282a-4267-88ca-25afbff93266 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051306 Jul 25 13:39:03.797203 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3340/6752] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:39:03 2022] GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:39:04.810744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e383e893-d414-48e6-bb5d-c89274d7c612 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:04.812873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e383e893-d414-48e6-bb5d-c89274d7c612 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:04.821066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e383e893-d414-48e6-bb5d-c89274d7c612 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:04.821526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e383e893-d414-48e6-bb5d-c89274d7c612 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:04.822364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e383e893-d414-48e6-bb5d-c89274d7c612 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:04.822814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e383e893-d414-48e6-bb5d-c89274d7c612 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:04.856833 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e383e893-d414-48e6-bb5d-c89274d7c612 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050359 Jul 25 13:39:04.857695 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3413/6753] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:39:04 2022] GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:39:05.871936 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d3c776d8-f604-4587-97fa-e90f99f30a2b tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:05.874862 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d3c776d8-f604-4587-97fa-e90f99f30a2b tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:05.883852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d3c776d8-f604-4587-97fa-e90f99f30a2b tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:05.883852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d3c776d8-f604-4587-97fa-e90f99f30a2b tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:05.884649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d3c776d8-f604-4587-97fa-e90f99f30a2b tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:05.885094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d3c776d8-f604-4587-97fa-e90f99f30a2b tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:05.924251 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d3c776d8-f604-4587-97fa-e90f99f30a2b tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057599 Jul 25 13:39:05.924894 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3341/6754] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:39:05 2022] GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 13:39:05.937695 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1319bd5a-bba4-4a2a-8243-5607eb8e2b86 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:05.938361 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1319bd5a-bba4-4a2a-8243-5607eb8e2b86 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:05.947124 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1319bd5a-bba4-4a2a-8243-5607eb8e2b86 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:05.947582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1319bd5a-bba4-4a2a-8243-5607eb8e2b86 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:05.948384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1319bd5a-bba4-4a2a-8243-5607eb8e2b86 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:05.948866 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1319bd5a-bba4-4a2a-8243-5607eb8e2b86 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:06.050939 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-1319bd5a-bba4-4a2a-8243-5607eb8e2b86 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] HTTP exception thrown: Instance d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 is not attached to volume 0f7e58fd-bb2f-4e39-84ba-de527f1854c7 Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1319bd5a-bba4-4a2a-8243-5607eb8e2b86 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Request method failure captured: Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44/os-volume_attachments/0f7e58fd-bb2f-4e39-84ba-de527f1854c7 HTTP/1.1 Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pzU2BnWN5TpfpsKrH9JKowoQgJbpTZxO6DTAYowcplglHhpe6nEY1dWTQqdMjoroTg2rMBal2TtjW_C9jUgCz90CPBP1g_DjkFXcm5MIyfaapeMOpZkmqrVoImI-X2blduXaUI1zTcjxgEOHD5ksKLMmMi-qdyeEv6zc3mJ0ZDjlJY Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5c10e0474d594d0780fe4f1205c8a574 Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestEncryptedCinderVolumes-695528988 Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5c10e0474d594d0780fe4f1205c8a574", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5c10e0474d594d0780fe4f1205c8a574"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c10e0474d594d0780fe4f1205c8a574"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c10e0474d594d0780fe4f1205c8a574"}]}] Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestEncryptedCinderVolumes-695528988 Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5c10e0474d594d0780fe4f1205c8a574 Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-695528988 Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestEncryptedCinderVolumes-695528988-project Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: f1e5a87c23b8404e9e9965beee9d42fa Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestEncryptedCinderVolumes-695528988-project Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 is not attached to volume 0f7e58fd-bb2f-4e39-84ba-de527f1854c7 Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'server_id': 'd5f0e8ff-8574-49e2-bd69-28a7d9a36f44', 'id': '0f7e58fd-bb2f-4e39-84ba-de527f1854c7'} Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0f7e58fd-bb2f-4e39-84ba-de527f1854c7. Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 is not attached to volume 0f7e58fd-bb2f-4e39-84ba-de527f1854c7 Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:39:06.068030 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:39:06.072474 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:39:06.072474 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:39:06.072474 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 is not attached to volume 0f7e58fd-bb2f-4e39-84ba-de527f1854c7 Jul 25 13:39:06.072474 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:39:06.072474 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1319bd5a-bba4-4a2a-8243-5607eb8e2b86 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Returning 404 to user: Instance d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 is not attached to volume 0f7e58fd-bb2f-4e39-84ba-de527f1854c7 {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:39:06.072474 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1319bd5a-bba4-4a2a-8243-5607eb8e2b86 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44/os-volume_attachments/0f7e58fd-bb2f-4e39-84ba-de527f1854c7" status: 404 len: 154 microversion: 2.1 time: 0.137218 Jul 25 13:39:06.072474 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3414/6755] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Jul 25 13:39:05 2022] DELETE /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44/os-volume_attachments/0f7e58fd-bb2f-4e39-84ba-de527f1854c7 => generated 154 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:39:09.489619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-627a5174-1cdf-46ac-9087-987d290535ba tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:09.490210 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-627a5174-1cdf-46ac-9087-987d290535ba tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:09.497846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-627a5174-1cdf-46ac-9087-987d290535ba tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:09.498337 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-627a5174-1cdf-46ac-9087-987d290535ba tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:09.499148 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-627a5174-1cdf-46ac-9087-987d290535ba tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:09.499600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-627a5174-1cdf-46ac-9087-987d290535ba tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:09.529062 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-627a5174-1cdf-46ac-9087-987d290535ba tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:39:09.620580 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-627a5174-1cdf-46ac-9087-987d290535ba tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44" status: 204 len: 0 microversion: 2.1 time: 0.135023 Jul 25 13:39:09.621410 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3342/6756] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:39:09 2022] DELETE /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 13:39:09.629888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-595a3edb-58c8-40c7-928d-cedfb9615dbc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:09.630507 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-595a3edb-58c8-40c7-928d-cedfb9615dbc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:09.641794 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-595a3edb-58c8-40c7-928d-cedfb9615dbc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:09.642507 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-595a3edb-58c8-40c7-928d-cedfb9615dbc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:09.643513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-595a3edb-58c8-40c7-928d-cedfb9615dbc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:09.644065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-595a3edb-58c8-40c7-928d-cedfb9615dbc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:09.799007 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-595a3edb-58c8-40c7-928d-cedfb9615dbc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:39:09.809323 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-595a3edb-58c8-40c7-928d-cedfb9615dbc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44" status: 200 len: 1560 microversion: 2.1 time: 0.181919 Jul 25 13:39:09.811548 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3415/6757] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:39:09 2022] GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:39:10.834287 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8ecd3292-5868-4a99-a59c-ee4dcf4961ba tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:10.835036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8ecd3292-5868-4a99-a59c-ee4dcf4961ba tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:10.842823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ecd3292-5868-4a99-a59c-ee4dcf4961ba tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:10.843289 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ecd3292-5868-4a99-a59c-ee4dcf4961ba tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:10.844070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ecd3292-5868-4a99-a59c-ee4dcf4961ba tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:10.844518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ecd3292-5868-4a99-a59c-ee4dcf4961ba tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:11.007245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8ecd3292-5868-4a99-a59c-ee4dcf4961ba tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:39:11.017232 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8ecd3292-5868-4a99-a59c-ee4dcf4961ba tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44" status: 200 len: 1560 microversion: 2.1 time: 0.187035 Jul 25 13:39:11.017815 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3343/6758] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:39:10 2022] GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 => generated 1560 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:39:11.738428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-f69f41f0-5419-4370-b9d1-e974a31f26cc req-0b6aa589-ad31-4100-a0c3-edb8891a4650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f0e8ff-8574-49e2-bd69-28a7d9a36f44", "name": "network-vif-deleted", "tag": "414f595c-2c78-41b1-ba08-41eefa1a5b10"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:39:11.750207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f69f41f0-5419-4370-b9d1-e974a31f26cc req-0b6aa589-ad31-4100-a0c3-edb8891a4650 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:11.750757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f69f41f0-5419-4370-b9d1-e974a31f26cc req-0b6aa589-ad31-4100-a0c3-edb8891a4650 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:11.766555 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-f69f41f0-5419-4370-b9d1-e974a31f26cc req-0b6aa589-ad31-4100-a0c3-edb8891a4650 service nova] Creating event network-vif-deleted:414f595c-2c78-41b1-ba08-41eefa1a5b10 for instance d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 on n-h1-848886-15 Jul 25 13:39:11.771546 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-f69f41f0-5419-4370-b9d1-e974a31f26cc req-0b6aa589-ad31-4100-a0c3-edb8891a4650 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036870 Jul 25 13:39:11.772197 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3416/6759] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:39:12.042293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-569cad0c-b687-47c1-8075-e1d568cc36b5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:12.043174 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-569cad0c-b687-47c1-8075-e1d568cc36b5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:12.051249 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-569cad0c-b687-47c1-8075-e1d568cc36b5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:12.051734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-569cad0c-b687-47c1-8075-e1d568cc36b5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:12.052551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-569cad0c-b687-47c1-8075-e1d568cc36b5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:12.052986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-569cad0c-b687-47c1-8075-e1d568cc36b5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:12.101137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-569cad0c-b687-47c1-8075-e1d568cc36b5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:12.101581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-569cad0c-b687-47c1-8075-e1d568cc36b5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:12.102290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-569cad0c-b687-47c1-8075-e1d568cc36b5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lazy-loading 'fault' on Instance uuid d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:39:12.160148 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-569cad0c-b687-47c1-8075-e1d568cc36b5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:39:12.169032 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-569cad0c-b687-47c1-8075-e1d568cc36b5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44" status: 200 len: 1352 microversion: 2.1 time: 0.130958 Jul 25 13:39:12.169657 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3344/6760] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:39:12 2022] GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 => generated 1352 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:39:13.192506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1442fe46-5ba3-4272-8047-fc36c187ff93 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:13.193192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1442fe46-5ba3-4272-8047-fc36c187ff93 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: d5f0e8ff-8574-49e2-bd69-28a7d9a36f44] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:13.200303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1442fe46-5ba3-4272-8047-fc36c187ff93 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:13.200736 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1442fe46-5ba3-4272-8047-fc36c187ff93 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:13.201566 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1442fe46-5ba3-4272-8047-fc36c187ff93 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:13.202052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1442fe46-5ba3-4272-8047-fc36c187ff93 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:13.216265 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-1442fe46-5ba3-4272-8047-fc36c187ff93 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] HTTP exception thrown: Instance d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 could not be found. Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1442fe46-5ba3-4272-8047-fc36c187ff93 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Request method failure captured: Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 HTTP/1.1 Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pzU2BnWN5TpfpsKrH9JKowoQgJbpTZxO6DTAYowcplglHhpe6nEY1dWTQqdMjoroTg2rMBal2TtjW_C9jUgCz90CPBP1g_DjkFXcm5MIyfaapeMOpZkmqrVoImI-X2blduXaUI1zTcjxgEOHD5ksKLMmMi-qdyeEv6zc3mJ0ZDjlJY Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5c10e0474d594d0780fe4f1205c8a574 Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestEncryptedCinderVolumes-695528988 Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5c10e0474d594d0780fe4f1205c8a574", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5c10e0474d594d0780fe4f1205c8a574"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c10e0474d594d0780fe4f1205c8a574"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c10e0474d594d0780fe4f1205c8a574"}]}] Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestEncryptedCinderVolumes-695528988 Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5c10e0474d594d0780fe4f1205c8a574 Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-695528988 Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestEncryptedCinderVolumes-695528988-project Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: f1e5a87c23b8404e9e9965beee9d42fa Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestEncryptedCinderVolumes-695528988-project Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 could not be found. Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'd5f0e8ff-8574-49e2-bd69-28a7d9a36f44'} Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 could not be found. Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 could not be found. Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:39:13.217926 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:39:13.222252 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:39:13.222252 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:39:13.222252 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:39:13.222252 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:39:13.222252 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:39:13.222252 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 could not be found. Jul 25 13:39:13.222252 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:39:13.222252 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1442fe46-5ba3-4272-8047-fc36c187ff93 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Returning 404 to user: Instance d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:39:13.222252 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1442fe46-5ba3-4272-8047-fc36c187ff93 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44" status: 404 len: 111 microversion: 2.1 time: 0.032097 Jul 25 13:39:13.222252 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3417/6761] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:39:13 2022] GET /compute/v2.1/servers/d5f0e8ff-8574-49e2-bd69-28a7d9a36f44 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:39:13.228538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5b2ff1e9-c752-4814-91fe-59cd284948b5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '.version_select at 0x7efcf9e0df70>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:13.251910 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5b2ff1e9-c752-4814-91fe-59cd284948b5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-116724940" status: 202 len: 0 microversion: 2.1 time: 0.027303 Jul 25 13:39:13.252517 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3345/6762] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 13:39:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-116724940 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:39:13.270200 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e71ca72d-428a-4b77-b0fb-a62de0b5b773 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Action: 'create', calling method: .version_select at 0x7efcf9bac430>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-315204088", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoG4ZVmPGULx36JNSNLnApMrzRos6tlGWUw82cyFcwooqoKtrqLaVr913ARkA2s9KACIrEb9JLMhveACiWnnm5GpkSp4URqITH7Qldhgb7WP6jFDMTZOKy83LGKLPGLUA=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:39:13.288040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-e71ca72d-428a-4b77-b0fb-a62de0b5b773 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Getting quotas for project 5c10e0474d594d0780fe4f1205c8a574. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:39:13.294993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-e71ca72d-428a-4b77-b0fb-a62de0b5b773 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Getting quotas for user f1e5a87c23b8404e9e9965beee9d42fa and project 5c10e0474d594d0780fe4f1205c8a574. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:39:13.324363 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e71ca72d-428a-4b77-b0fb-a62de0b5b773 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.058151 Jul 25 13:39:13.325018 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3418/6763] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:39:13 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:39:13.377727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-80edae2d-e625-498c-a525-390e28dfb51b tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1388048185", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-315204088", "networks": [{"uuid": "dd2cbb33-90db-4b00-b651-b64b4b66ced6"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:39:13.436072 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-80edae2d-e625-498c-a525-390e28dfb51b tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] validate_networks() for [('dd2cbb33-90db-4b00-b651-b64b4b66ced6', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:39:13.815375 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-80edae2d-e625-498c-a525-390e28dfb51b tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:39:13.815812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-80edae2d-e625-498c-a525-390e28dfb51b tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:39:13.816303 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-80edae2d-e625-498c-a525-390e28dfb51b tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:39:13.816724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-80edae2d-e625-498c-a525-390e28dfb51b tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:39:13.817149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-80edae2d-e625-498c-a525-390e28dfb51b tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:39:13.826476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80edae2d-e625-498c-a525-390e28dfb51b tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:13.826948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80edae2d-e625-498c-a525-390e28dfb51b tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:13.827778 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80edae2d-e625-498c-a525-390e28dfb51b tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:13.828235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-80edae2d-e625-498c-a525-390e28dfb51b tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:13.849379 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-80edae2d-e625-498c-a525-390e28dfb51b tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Getting quotas for project 5c10e0474d594d0780fe4f1205c8a574. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:39:13.855127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-80edae2d-e625-498c-a525-390e28dfb51b tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Getting quotas for user f1e5a87c23b8404e9e9965beee9d42fa and project 5c10e0474d594d0780fe4f1205c8a574. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:39:13.868377 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-80edae2d-e625-498c-a525-390e28dfb51b tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:39:13.870816 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-80edae2d-e625-498c-a525-390e28dfb51b tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:39:13.917285 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-80edae2d-e625-498c-a525-390e28dfb51b tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543725 Jul 25 13:39:13.917982 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3346/6764] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:39:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:39:13.929322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2676c54a-4e8c-4fdb-b2e4-ca1fbf07b93e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:13.929983 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2676c54a-4e8c-4fdb-b2e4-ca1fbf07b93e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:13.986432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2676c54a-4e8c-4fdb-b2e4-ca1fbf07b93e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:39:13.994138 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2676c54a-4e8c-4fdb-b2e4-ca1fbf07b93e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d" status: 200 len: 1262 microversion: 2.1 time: 0.068792 Jul 25 13:39:13.994940 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3419/6765] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:39:13 2022] GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d => generated 1262 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:39:15.018206 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5e703ef1-185a-40fe-b667-e42cd8327b2f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:15.019147 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5e703ef1-185a-40fe-b667-e42cd8327b2f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:15.027972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5e703ef1-185a-40fe-b667-e42cd8327b2f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:15.028789 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5e703ef1-185a-40fe-b667-e42cd8327b2f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:15.029617 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5e703ef1-185a-40fe-b667-e42cd8327b2f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:15.030094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5e703ef1-185a-40fe-b667-e42cd8327b2f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:15.158262 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5e703ef1-185a-40fe-b667-e42cd8327b2f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:39:15.166932 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5e703ef1-185a-40fe-b667-e42cd8327b2f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d" status: 200 len: 1332 microversion: 2.1 time: 0.155332 Jul 25 13:39:15.168109 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3347/6766] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:39:15 2022] GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d => generated 1332 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:39:16.195061 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ea5d0b03-3645-4613-a092-8007bce6addc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:16.196313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ea5d0b03-3645-4613-a092-8007bce6addc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:16.214388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea5d0b03-3645-4613-a092-8007bce6addc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:16.215334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea5d0b03-3645-4613-a092-8007bce6addc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:16.217084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea5d0b03-3645-4613-a092-8007bce6addc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:16.218375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ea5d0b03-3645-4613-a092-8007bce6addc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:16.466639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ea5d0b03-3645-4613-a092-8007bce6addc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:39:16.479172 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ea5d0b03-3645-4613-a092-8007bce6addc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d" status: 200 len: 1362 microversion: 2.1 time: 0.292571 Jul 25 13:39:16.479833 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3420/6767] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:39:16 2022] GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:39:16.584459 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-6d64de73-a767-4bae-9360-8180ad45e1d4 req-d68e23f2-f777-42ee-975a-94b1db9359c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "221a9ba6-6e66-4b39-9a55-acff04f7785d", "tag": "103052b5-5bfa-469d-9b74-24b3a833dbfe"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:39:16.601567 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-6d64de73-a767-4bae-9360-8180ad45e1d4 req-d68e23f2-f777-42ee-975a-94b1db9359c4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:16.602059 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-6d64de73-a767-4bae-9360-8180ad45e1d4 req-d68e23f2-f777-42ee-975a-94b1db9359c4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:16.624823 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-6d64de73-a767-4bae-9360-8180ad45e1d4 req-d68e23f2-f777-42ee-975a-94b1db9359c4 service nova] Creating event network-changed:103052b5-5bfa-469d-9b74-24b3a833dbfe for instance 221a9ba6-6e66-4b39-9a55-acff04f7785d on n-h1-848886-15 Jul 25 13:39:16.632595 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-6d64de73-a767-4bae-9360-8180ad45e1d4 req-d68e23f2-f777-42ee-975a-94b1db9359c4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056524 Jul 25 13:39:16.633397 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3348/6768] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:39:17.507654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-966c9786-d964-4f41-a43c-f72abc13e864 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:17.508265 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-966c9786-d964-4f41-a43c-f72abc13e864 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:17.519811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-966c9786-d964-4f41-a43c-f72abc13e864 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:17.520268 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-966c9786-d964-4f41-a43c-f72abc13e864 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:17.521066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-966c9786-d964-4f41-a43c-f72abc13e864 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:17.521510 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-966c9786-d964-4f41-a43c-f72abc13e864 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:17.660306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-966c9786-d964-4f41-a43c-f72abc13e864 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:39:17.668900 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-966c9786-d964-4f41-a43c-f72abc13e864 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d" status: 200 len: 1362 microversion: 2.1 time: 0.164828 Jul 25 13:39:17.669389 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3421/6769] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:39:17 2022] GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:39:18.691492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f5634665-83cd-49ee-beed-d50a398c330f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:18.692368 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f5634665-83cd-49ee-beed-d50a398c330f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:18.699511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5634665-83cd-49ee-beed-d50a398c330f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:18.699977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5634665-83cd-49ee-beed-d50a398c330f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:18.700777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5634665-83cd-49ee-beed-d50a398c330f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:18.701226 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5634665-83cd-49ee-beed-d50a398c330f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:18.848437 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f5634665-83cd-49ee-beed-d50a398c330f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:39:18.857053 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f5634665-83cd-49ee-beed-d50a398c330f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d" status: 200 len: 1362 microversion: 2.1 time: 0.170801 Jul 25 13:39:18.857682 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3349/6770] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:39:18 2022] GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:39:19.882721 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-620fe7ae-daaf-4d8a-b71d-fbcfaf5c0c62 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:19.884021 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-620fe7ae-daaf-4d8a-b71d-fbcfaf5c0c62 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:19.896958 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-620fe7ae-daaf-4d8a-b71d-fbcfaf5c0c62 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:19.897812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-620fe7ae-daaf-4d8a-b71d-fbcfaf5c0c62 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:19.899348 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-620fe7ae-daaf-4d8a-b71d-fbcfaf5c0c62 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:19.900508 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-620fe7ae-daaf-4d8a-b71d-fbcfaf5c0c62 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:20.076192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-620fe7ae-daaf-4d8a-b71d-fbcfaf5c0c62 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:39:20.084928 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-620fe7ae-daaf-4d8a-b71d-fbcfaf5c0c62 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d" status: 200 len: 1362 microversion: 2.1 time: 0.209734 Jul 25 13:39:20.086241 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3422/6771] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:39:19 2022] GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:39:21.107399 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1b316b0a-3368-4c05-a765-7fe010bf6853 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:21.108021 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1b316b0a-3368-4c05-a765-7fe010bf6853 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:21.115522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b316b0a-3368-4c05-a765-7fe010bf6853 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:21.115996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b316b0a-3368-4c05-a765-7fe010bf6853 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:21.116816 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b316b0a-3368-4c05-a765-7fe010bf6853 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:21.117270 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1b316b0a-3368-4c05-a765-7fe010bf6853 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:21.260715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1b316b0a-3368-4c05-a765-7fe010bf6853 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:39:21.269040 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1b316b0a-3368-4c05-a765-7fe010bf6853 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d" status: 200 len: 1362 microversion: 2.1 time: 0.165991 Jul 25 13:39:21.269640 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3350/6772] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:39:21 2022] GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:39:22.008740 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-339e3975-05b8-4e3f-8519-e175663ed78d req-0bc36f22-ddf4-408c-9cdd-b44f3b50b722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "221a9ba6-6e66-4b39-9a55-acff04f7785d", "name": "network-vif-plugged", "status": "completed", "tag": "103052b5-5bfa-469d-9b74-24b3a833dbfe"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:39:22.020209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-339e3975-05b8-4e3f-8519-e175663ed78d req-0bc36f22-ddf4-408c-9cdd-b44f3b50b722 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:22.020764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-339e3975-05b8-4e3f-8519-e175663ed78d req-0bc36f22-ddf4-408c-9cdd-b44f3b50b722 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:22.036901 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-339e3975-05b8-4e3f-8519-e175663ed78d req-0bc36f22-ddf4-408c-9cdd-b44f3b50b722 service nova] Creating event network-vif-plugged:103052b5-5bfa-469d-9b74-24b3a833dbfe for instance 221a9ba6-6e66-4b39-9a55-acff04f7785d on n-h1-848886-15 Jul 25 13:39:22.042735 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-339e3975-05b8-4e3f-8519-e175663ed78d req-0bc36f22-ddf4-408c-9cdd-b44f3b50b722 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037917 Jul 25 13:39:22.043495 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3423/6773] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:39:22.294962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0d3fa527-1c7d-48c1-8a27-8ea29274a697 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:22.296164 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0d3fa527-1c7d-48c1-8a27-8ea29274a697 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:22.309068 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d3fa527-1c7d-48c1-8a27-8ea29274a697 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:22.309930 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d3fa527-1c7d-48c1-8a27-8ea29274a697 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:22.311199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d3fa527-1c7d-48c1-8a27-8ea29274a697 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:22.311848 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0d3fa527-1c7d-48c1-8a27-8ea29274a697 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:22.476156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0d3fa527-1c7d-48c1-8a27-8ea29274a697 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:39:22.484549 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0d3fa527-1c7d-48c1-8a27-8ea29274a697 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d" status: 200 len: 1362 microversion: 2.1 time: 0.196977 Jul 25 13:39:22.485159 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3351/6774] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:39:22 2022] GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:39:23.508202 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-058c894a-9f76-40d6-a3e0-cbabb015bb7f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:23.508932 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-058c894a-9f76-40d6-a3e0-cbabb015bb7f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:23.516900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-058c894a-9f76-40d6-a3e0-cbabb015bb7f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:23.517355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-058c894a-9f76-40d6-a3e0-cbabb015bb7f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:23.518221 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-058c894a-9f76-40d6-a3e0-cbabb015bb7f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:23.518671 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-058c894a-9f76-40d6-a3e0-cbabb015bb7f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:23.685698 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-058c894a-9f76-40d6-a3e0-cbabb015bb7f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:39:23.694366 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-058c894a-9f76-40d6-a3e0-cbabb015bb7f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d" status: 200 len: 1555 microversion: 2.1 time: 0.191403 Jul 25 13:39:23.695390 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3424/6775] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:39:23 2022] GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d => generated 1555 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:39:23.717526 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-47fc4784-bdc6-4cd0-9088-426565ee2fcc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:23.718263 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-47fc4784-bdc6-4cd0-9088-426565ee2fcc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:23.726901 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47fc4784-bdc6-4cd0-9088-426565ee2fcc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:23.727355 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47fc4784-bdc6-4cd0-9088-426565ee2fcc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:23.728376 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47fc4784-bdc6-4cd0-9088-426565ee2fcc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:23.728823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-47fc4784-bdc6-4cd0-9088-426565ee2fcc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:23.835846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:39:23.862923 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:39:23.898949 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-47fc4784-bdc6-4cd0-9088-426565ee2fcc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:39:23.907800 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-47fc4784-bdc6-4cd0-9088-426565ee2fcc tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d" status: 200 len: 1555 microversion: 2.1 time: 0.194705 Jul 25 13:39:23.908463 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3352/6776] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:39:23 2022] GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d => generated 1555 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:39:25.519026 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1a2eb083-b57a-4392-b5d8-551c2593c388 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1800bc3c-082d-4bed-b4f8-5afef1819c6e"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:39:25.522212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1a2eb083-b57a-4392-b5d8-551c2593c388 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:25.524670 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:39:25.534098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a2eb083-b57a-4392-b5d8-551c2593c388 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:25.534432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a2eb083-b57a-4392-b5d8-551c2593c388 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:25.535397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a2eb083-b57a-4392-b5d8-551c2593c388 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:25.535851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a2eb083-b57a-4392-b5d8-551c2593c388 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:25.838752 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1a2eb083-b57a-4392-b5d8-551c2593c388 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "POST /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324155 Jul 25 13:39:25.839999 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3425/6777] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Jul 25 13:39:25 2022] POST /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:39:36.635538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-10ec2d03-c97e-40e5-80ee-5d757e76e53e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:36.636205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-10ec2d03-c97e-40e5-80ee-5d757e76e53e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:36.639648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:39:36.640469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:39:36.648381 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10ec2d03-c97e-40e5-80ee-5d757e76e53e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:36.648838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10ec2d03-c97e-40e5-80ee-5d757e76e53e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:36.649669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10ec2d03-c97e-40e5-80ee-5d757e76e53e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:36.650127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-10ec2d03-c97e-40e5-80ee-5d757e76e53e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:36.748339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-10ec2d03-c97e-40e5-80ee-5d757e76e53e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lazy-loading 'services' on Instance uuid 221a9ba6-6e66-4b39-9a55-acff04f7785d {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:39:36.828468 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-10ec2d03-c97e-40e5-80ee-5d757e76e53e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "DELETE /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d/os-volume_attachments/1800bc3c-082d-4bed-b4f8-5afef1819c6e" status: 202 len: 0 microversion: 2.1 time: 0.196995 Jul 25 13:39:36.829100 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3353/6778] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Jul 25 13:39:36 2022] DELETE /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d/os-volume_attachments/1800bc3c-082d-4bed-b4f8-5afef1819c6e => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:39:36.839201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2f0600a6-286d-4d0d-b6ce-8129e84f7e38 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:36.842004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2f0600a6-286d-4d0d-b6ce-8129e84f7e38 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:36.845495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:39:36.846235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:39:36.853632 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2f0600a6-286d-4d0d-b6ce-8129e84f7e38 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:36.854163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2f0600a6-286d-4d0d-b6ce-8129e84f7e38 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:36.855017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2f0600a6-286d-4d0d-b6ce-8129e84f7e38 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:36.855467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2f0600a6-286d-4d0d-b6ce-8129e84f7e38 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:36.892163 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2f0600a6-286d-4d0d-b6ce-8129e84f7e38 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057735 Jul 25 13:39:36.894492 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3426/6779] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:39:36 2022] GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:39:37.907743 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1ca6282d-8496-46c5-992c-0aa270598a08 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:37.912519 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1ca6282d-8496-46c5-992c-0aa270598a08 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:37.922381 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ca6282d-8496-46c5-992c-0aa270598a08 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:37.922844 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ca6282d-8496-46c5-992c-0aa270598a08 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:37.923928 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ca6282d-8496-46c5-992c-0aa270598a08 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:37.924456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1ca6282d-8496-46c5-992c-0aa270598a08 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:37.966700 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1ca6282d-8496-46c5-992c-0aa270598a08 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065237 Jul 25 13:39:37.967293 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3354/6780] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:39:37 2022] GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:39:38.980031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-32423df3-3c88-49c9-bdeb-9c8c24a9065e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:38.982571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-32423df3-3c88-49c9-bdeb-9c8c24a9065e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:38.990796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32423df3-3c88-49c9-bdeb-9c8c24a9065e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:38.991345 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32423df3-3c88-49c9-bdeb-9c8c24a9065e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:38.992172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32423df3-3c88-49c9-bdeb-9c8c24a9065e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:38.992610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32423df3-3c88-49c9-bdeb-9c8c24a9065e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:39.037944 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-32423df3-3c88-49c9-bdeb-9c8c24a9065e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061826 Jul 25 13:39:39.039043 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3427/6781] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:39:38 2022] GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:39:40.052134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-66012e31-b7a9-4afe-8f11-b73e0d89d1f6 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:40.054857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-66012e31-b7a9-4afe-8f11-b73e0d89d1f6 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:40.063478 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66012e31-b7a9-4afe-8f11-b73e0d89d1f6 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:40.063976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66012e31-b7a9-4afe-8f11-b73e0d89d1f6 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:40.064919 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66012e31-b7a9-4afe-8f11-b73e0d89d1f6 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:40.065405 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66012e31-b7a9-4afe-8f11-b73e0d89d1f6 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:40.103809 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-66012e31-b7a9-4afe-8f11-b73e0d89d1f6 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056023 Jul 25 13:39:40.104451 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3355/6782] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:39:40 2022] GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:39:41.119605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b4dae75d-6c14-40bb-b9a9-631a74c1376e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:41.122492 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b4dae75d-6c14-40bb-b9a9-631a74c1376e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:41.131445 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4dae75d-6c14-40bb-b9a9-631a74c1376e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:41.131903 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4dae75d-6c14-40bb-b9a9-631a74c1376e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:41.132725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4dae75d-6c14-40bb-b9a9-631a74c1376e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:41.133164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4dae75d-6c14-40bb-b9a9-631a74c1376e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:41.168326 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b4dae75d-6c14-40bb-b9a9-631a74c1376e tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055304 Jul 25 13:39:41.168690 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3428/6783] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:39:41 2022] GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:39:42.181313 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3d045ff5-4bb4-4c03-a321-4757a4c57bfd tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:42.183739 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3d045ff5-4bb4-4c03-a321-4757a4c57bfd tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:42.191968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3d045ff5-4bb4-4c03-a321-4757a4c57bfd tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:42.192533 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3d045ff5-4bb4-4c03-a321-4757a4c57bfd tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:42.193866 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3d045ff5-4bb4-4c03-a321-4757a4c57bfd tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:42.194652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3d045ff5-4bb4-4c03-a321-4757a4c57bfd tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:42.237590 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3d045ff5-4bb4-4c03-a321-4757a4c57bfd tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060203 Jul 25 13:39:42.238501 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3356/6784] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:39:42 2022] GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 13:39:42.250525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-07463bad-cd9c-41b2-9376-990e6af4e64d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:42.251101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-07463bad-cd9c-41b2-9376-990e6af4e64d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:42.258787 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07463bad-cd9c-41b2-9376-990e6af4e64d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:42.259249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07463bad-cd9c-41b2-9376-990e6af4e64d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:42.260000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07463bad-cd9c-41b2-9376-990e6af4e64d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:42.260456 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07463bad-cd9c-41b2-9376-990e6af4e64d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:42.361227 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-07463bad-cd9c-41b2-9376-990e6af4e64d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] HTTP exception thrown: Instance 221a9ba6-6e66-4b39-9a55-acff04f7785d is not attached to volume 1800bc3c-082d-4bed-b4f8-5afef1819c6e Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-07463bad-cd9c-41b2-9376-990e6af4e64d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Request method failure captured: Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d/os-volume_attachments/1800bc3c-082d-4bed-b4f8-5afef1819c6e HTTP/1.1 Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3pzU2BnWN5TpfpsKrH9JKowoQgJbpTZxO6DTAYowcplglHhpe6nEY1dWTQqdMjoroTg2rMBal2TtjW_C9jUgCz90CPBP1g_DjkFXcm5MIyfaapeMOpZkmqrVoImI-X2blduXaUI1zTcjxgEOHD5ksKLMmMi-qdyeEv6zc3mJ0ZDjlJY Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 5c10e0474d594d0780fe4f1205c8a574 Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestEncryptedCinderVolumes-695528988 Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5c10e0474d594d0780fe4f1205c8a574", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5c10e0474d594d0780fe4f1205c8a574"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c10e0474d594d0780fe4f1205c8a574"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c10e0474d594d0780fe4f1205c8a574"}]}] Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestEncryptedCinderVolumes-695528988 Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 5c10e0474d594d0780fe4f1205c8a574 Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-695528988 Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestEncryptedCinderVolumes-695528988-project Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: f1e5a87c23b8404e9e9965beee9d42fa Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestEncryptedCinderVolumes-695528988-project Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 221a9ba6-6e66-4b39-9a55-acff04f7785d is not attached to volume 1800bc3c-082d-4bed-b4f8-5afef1819c6e Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'server_id': '221a9ba6-6e66-4b39-9a55-acff04f7785d', 'id': '1800bc3c-082d-4bed-b4f8-5afef1819c6e'} Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1800bc3c-082d-4bed-b4f8-5afef1819c6e. Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 221a9ba6-6e66-4b39-9a55-acff04f7785d is not attached to volume 1800bc3c-082d-4bed-b4f8-5afef1819c6e Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:39:42.363334 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:39:42.367189 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:39:42.367189 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:39:42.367189 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 221a9ba6-6e66-4b39-9a55-acff04f7785d is not attached to volume 1800bc3c-082d-4bed-b4f8-5afef1819c6e Jul 25 13:39:42.367189 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:39:42.367189 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-07463bad-cd9c-41b2-9376-990e6af4e64d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Returning 404 to user: Instance 221a9ba6-6e66-4b39-9a55-acff04f7785d is not attached to volume 1800bc3c-082d-4bed-b4f8-5afef1819c6e {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:39:42.367189 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-07463bad-cd9c-41b2-9376-990e6af4e64d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "DELETE /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d/os-volume_attachments/1800bc3c-082d-4bed-b4f8-5afef1819c6e" status: 404 len: 154 microversion: 2.1 time: 0.120266 Jul 25 13:39:42.367189 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3429/6785] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Jul 25 13:39:42 2022] DELETE /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d/os-volume_attachments/1800bc3c-082d-4bed-b4f8-5afef1819c6e => generated 154 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:39:45.811320 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-692aa183-2748-417d-a5fa-88fff34b70aa tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:45.812219 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-692aa183-2748-417d-a5fa-88fff34b70aa tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:45.821525 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-692aa183-2748-417d-a5fa-88fff34b70aa tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:45.822033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-692aa183-2748-417d-a5fa-88fff34b70aa tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:45.822832 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-692aa183-2748-417d-a5fa-88fff34b70aa tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:45.823282 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-692aa183-2748-417d-a5fa-88fff34b70aa tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:45.855394 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-692aa183-2748-417d-a5fa-88fff34b70aa tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:39:45.950097 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-692aa183-2748-417d-a5fa-88fff34b70aa tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "DELETE /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d" status: 204 len: 0 microversion: 2.1 time: 0.144740 Jul 25 13:39:45.959035 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3357/6786] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:39:45 2022] DELETE /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:39:45.969367 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-878f5399-5352-4057-95de-3baede5d074d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:45.970520 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-878f5399-5352-4057-95de-3baede5d074d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:45.982920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-878f5399-5352-4057-95de-3baede5d074d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:45.983713 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-878f5399-5352-4057-95de-3baede5d074d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:45.985059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-878f5399-5352-4057-95de-3baede5d074d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:45.985796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-878f5399-5352-4057-95de-3baede5d074d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:46.164241 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-878f5399-5352-4057-95de-3baede5d074d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:39:46.175633 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-878f5399-5352-4057-95de-3baede5d074d tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d" status: 200 len: 1561 microversion: 2.1 time: 0.213683 Jul 25 13:39:46.176458 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3430/6787] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:39:45 2022] GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d => generated 1561 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:39:47.198817 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-90fa0faa-4fd3-4413-9fb8-c204881ddc14 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:47.199630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-90fa0faa-4fd3-4413-9fb8-c204881ddc14 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:47.209109 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-90fa0faa-4fd3-4413-9fb8-c204881ddc14 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:47.209699 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-90fa0faa-4fd3-4413-9fb8-c204881ddc14 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:47.211168 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-90fa0faa-4fd3-4413-9fb8-c204881ddc14 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:47.211793 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-90fa0faa-4fd3-4413-9fb8-c204881ddc14 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:47.379374 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-90fa0faa-4fd3-4413-9fb8-c204881ddc14 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:39:47.391110 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-90fa0faa-4fd3-4413-9fb8-c204881ddc14 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d" status: 200 len: 1561 microversion: 2.1 time: 0.197582 Jul 25 13:39:47.391811 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3358/6788] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:39:47 2022] GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d => generated 1561 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:39:48.413214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-732e431a-de0b-4d84-ab49-2bb486ad1a8f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:48.413940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-732e431a-de0b-4d84-ab49-2bb486ad1a8f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:48.421702 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-732e431a-de0b-4d84-ab49-2bb486ad1a8f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:48.422269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-732e431a-de0b-4d84-ab49-2bb486ad1a8f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:48.423140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-732e431a-de0b-4d84-ab49-2bb486ad1a8f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:48.423646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-732e431a-de0b-4d84-ab49-2bb486ad1a8f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:48.452684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-898f080e-73c8-49b3-90ed-83a2726774e4 req-c12af75d-75d0-4d1f-846c-aef85ee0d88c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "221a9ba6-6e66-4b39-9a55-acff04f7785d", "name": "network-vif-deleted", "tag": "103052b5-5bfa-469d-9b74-24b3a833dbfe"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:39:48.465120 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-898f080e-73c8-49b3-90ed-83a2726774e4 req-c12af75d-75d0-4d1f-846c-aef85ee0d88c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:48.465590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-898f080e-73c8-49b3-90ed-83a2726774e4 req-c12af75d-75d0-4d1f-846c-aef85ee0d88c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:48.482742 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-898f080e-73c8-49b3-90ed-83a2726774e4 req-c12af75d-75d0-4d1f-846c-aef85ee0d88c service nova] Creating event network-vif-deleted:103052b5-5bfa-469d-9b74-24b3a833dbfe for instance 221a9ba6-6e66-4b39-9a55-acff04f7785d on n-h1-848886-15 Jul 25 13:39:48.490235 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-898f080e-73c8-49b3-90ed-83a2726774e4 req-c12af75d-75d0-4d1f-846c-aef85ee0d88c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041256 Jul 25 13:39:48.491151 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3359/6789] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:39:48.505260 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-732e431a-de0b-4d84-ab49-2bb486ad1a8f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e5a87c23b8404e9e9965beee9d42fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c10e0474d594d0780fe4f1205c8a574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:39:48.513383 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-732e431a-de0b-4d84-ab49-2bb486ad1a8f tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d" status: 200 len: 1519 microversion: 2.1 time: 0.104206 Jul 25 13:39:48.513925 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3431/6790] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:39:48 2022] GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d => generated 1519 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:39:49.536322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3babc2c8-3baf-46de-96ce-936ec9ee4ad5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:49.537149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3babc2c8-3baf-46de-96ce-936ec9ee4ad5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] [instance: 221a9ba6-6e66-4b39-9a55-acff04f7785d] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:39:49.545667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3babc2c8-3baf-46de-96ce-936ec9ee4ad5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:49.546178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3babc2c8-3baf-46de-96ce-936ec9ee4ad5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:49.546963 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3babc2c8-3baf-46de-96ce-936ec9ee4ad5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:39:49.547414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3babc2c8-3baf-46de-96ce-936ec9ee4ad5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:39:49.562321 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-3babc2c8-3baf-46de-96ce-936ec9ee4ad5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] HTTP exception thrown: Instance 221a9ba6-6e66-4b39-9a55-acff04f7785d could not be found. Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3babc2c8-3baf-46de-96ce-936ec9ee4ad5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Request method failure captured: Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d HTTP/1.1 Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3pzU2BnWN5TpfpsKrH9JKowoQgJbpTZxO6DTAYowcplglHhpe6nEY1dWTQqdMjoroTg2rMBal2TtjW_C9jUgCz90CPBP1g_DjkFXcm5MIyfaapeMOpZkmqrVoImI-X2blduXaUI1zTcjxgEOHD5ksKLMmMi-qdyeEv6zc3mJ0ZDjlJY Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 5c10e0474d594d0780fe4f1205c8a574 Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-TestEncryptedCinderVolumes-695528988 Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5c10e0474d594d0780fe4f1205c8a574", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5c10e0474d594d0780fe4f1205c8a574"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c10e0474d594d0780fe4f1205c8a574"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c10e0474d594d0780fe4f1205c8a574"}]}] Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-TestEncryptedCinderVolumes-695528988 Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 5c10e0474d594d0780fe4f1205c8a574 Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-695528988 Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-TestEncryptedCinderVolumes-695528988-project Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: f1e5a87c23b8404e9e9965beee9d42fa Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-TestEncryptedCinderVolumes-695528988-project Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 221a9ba6-6e66-4b39-9a55-acff04f7785d could not be found. Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '221a9ba6-6e66-4b39-9a55-acff04f7785d'} Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 221a9ba6-6e66-4b39-9a55-acff04f7785d could not be found. Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 221a9ba6-6e66-4b39-9a55-acff04f7785d could not be found. Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:39:49.564128 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:39:49.568698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:39:49.568698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:39:49.568698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:39:49.568698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:39:49.568698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:39:49.568698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 221a9ba6-6e66-4b39-9a55-acff04f7785d could not be found. Jul 25 13:39:49.568698 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:39:49.568698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3babc2c8-3baf-46de-96ce-936ec9ee4ad5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Returning 404 to user: Instance 221a9ba6-6e66-4b39-9a55-acff04f7785d could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:39:49.568698 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3babc2c8-3baf-46de-96ce-936ec9ee4ad5 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d" status: 404 len: 111 microversion: 2.1 time: 0.033994 Jul 25 13:39:49.568698 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3360/6791] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:39:49 2022] GET /compute/v2.1/servers/221a9ba6-6e66-4b39-9a55-acff04f7785d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:39:49.575695 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9c586987-38b8-4fe5-b0cc-8b484ac1cf76 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] Calling method '.version_select at 0x7efcfedffd30>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:39:49.600261 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9c586987-38b8-4fe5-b0cc-8b484ac1cf76 tempest-TestEncryptedCinderVolumes-695528988 tempest-TestEncryptedCinderVolumes-695528988-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-315204088" status: 202 len: 0 microversion: 2.1 time: 0.028729 Jul 25 13:39:49.601181 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3432/6792] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Jul 25 13:39:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-315204088 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:40:19.941769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a8dcad7d-90d0-4b28-b526-a0b4f3635cdd tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Action: 'create', calling method: .version_select at 0x7efcf990edc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-749825414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtd1WTQkaEyYMag2G0WzfEetkPSUMWeNLPwUtWLcObWy8ulJHM0pcpgiG1SRow0QuFOu8bQ41hQzP+XqvYTpk3/lOUX5qDuppW+S5vrOX83kim3KIESzV9T6bJPrHZjmA=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:40:19.950773 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:40:19.951472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:40:19.971485 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-a8dcad7d-90d0-4b28-b526-a0b4f3635cdd tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Getting quotas for project aa9afc929da94c579e696ed23d1964d3. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:40:19.977596 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-a8dcad7d-90d0-4b28-b526-a0b4f3635cdd tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Getting quotas for user 114282760b914b30bf98a17b61b59569 and project aa9afc929da94c579e696ed23d1964d3. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:40:20.006161 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a8dcad7d-90d0-4b28-b526-a0b4f3635cdd tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.069435 Jul 25 13:40:20.006785 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3361/6793] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:40:19 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:40:20.067977 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=36 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:40:20.069381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:40:20.074568 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-20ad8f04-958d-46b6-bacc-3a5899e08d59 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1214063968", "imageRef": "e7c43d1f-77a3-4d63-8f77-65dfc57a2263", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-749825414", "networks": [{"uuid": "2cabf8a2-04e6-4930-93de-c78ecb08058a"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:40:20.141540 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-20ad8f04-958d-46b6-bacc-3a5899e08d59 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] validate_networks() for [('2cabf8a2-04e6-4930-93de-c78ecb08058a', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:40:20.562798 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-20ad8f04-958d-46b6-bacc-3a5899e08d59 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:40:20.563222 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-20ad8f04-958d-46b6-bacc-3a5899e08d59 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:40:20.563703 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-20ad8f04-958d-46b6-bacc-3a5899e08d59 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:40:20.564150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-20ad8f04-958d-46b6-bacc-3a5899e08d59 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:40:20.564558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-20ad8f04-958d-46b6-bacc-3a5899e08d59 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:40:20.574445 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20ad8f04-958d-46b6-bacc-3a5899e08d59 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:20.574921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20ad8f04-958d-46b6-bacc-3a5899e08d59 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:20.575730 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20ad8f04-958d-46b6-bacc-3a5899e08d59 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:20.576248 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20ad8f04-958d-46b6-bacc-3a5899e08d59 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:20.597555 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-20ad8f04-958d-46b6-bacc-3a5899e08d59 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Getting quotas for project aa9afc929da94c579e696ed23d1964d3. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:40:20.604272 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-20ad8f04-958d-46b6-bacc-3a5899e08d59 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Getting quotas for user 114282760b914b30bf98a17b61b59569 and project aa9afc929da94c579e696ed23d1964d3. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:40:20.623325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-20ad8f04-958d-46b6-bacc-3a5899e08d59 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:40:20.625631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-20ad8f04-958d-46b6-bacc-3a5899e08d59 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e7c43d1f-77a3-4d63-8f77-65dfc57a2263',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:40:20.680056 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-20ad8f04-958d-46b6-bacc-3a5899e08d59 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614456 Jul 25 13:40:20.680929 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3433/6794] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:40:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:40:20.694795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c547284a-448b-40f2-9a6d-38c3af8d2112 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:40:20.696217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c547284a-448b-40f2-9a6d-38c3af8d2112 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:40:20.777715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c547284a-448b-40f2-9a6d-38c3af8d2112 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:40:20.792500 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c547284a-448b-40f2-9a6d-38c3af8d2112 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 200 len: 1258 microversion: 2.1 time: 0.103136 Jul 25 13:40:20.794282 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3362/6795] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:40:20 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 1258 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:40:21.820962 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7d924375-7a57-4a51-ab9d-d18bdf114965 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:40:21.821982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7d924375-7a57-4a51-ab9d-d18bdf114965 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:40:21.832449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d924375-7a57-4a51-ab9d-d18bdf114965 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:21.832955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d924375-7a57-4a51-ab9d-d18bdf114965 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:21.833851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d924375-7a57-4a51-ab9d-d18bdf114965 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:21.834694 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d924375-7a57-4a51-ab9d-d18bdf114965 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:21.993563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7d924375-7a57-4a51-ab9d-d18bdf114965 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:40:22.006144 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7d924375-7a57-4a51-ab9d-d18bdf114965 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 200 len: 1318 microversion: 2.1 time: 0.190011 Jul 25 13:40:22.007739 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3434/6796] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:40:21 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:40:23.033063 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-08bd6a2b-108a-451f-8fc5-9e15e04f1fd0 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:40:23.034051 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-08bd6a2b-108a-451f-8fc5-9e15e04f1fd0 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:40:23.045639 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-08bd6a2b-108a-451f-8fc5-9e15e04f1fd0 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:23.046630 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-08bd6a2b-108a-451f-8fc5-9e15e04f1fd0 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:23.047905 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-08bd6a2b-108a-451f-8fc5-9e15e04f1fd0 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:23.048733 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-08bd6a2b-108a-451f-8fc5-9e15e04f1fd0 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:23.456369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-08bd6a2b-108a-451f-8fc5-9e15e04f1fd0 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:40:23.476958 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-08bd6a2b-108a-451f-8fc5-9e15e04f1fd0 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 200 len: 1358 microversion: 2.1 time: 0.448520 Jul 25 13:40:23.485474 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3363/6797] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:40:23 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 1358 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:40:24.534479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fa2d0b59-1ca7-4451-b3bb-976cb65ede83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:40:24.536050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fa2d0b59-1ca7-4451-b3bb-976cb65ede83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:40:24.557429 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa2d0b59-1ca7-4451-b3bb-976cb65ede83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:24.558430 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa2d0b59-1ca7-4451-b3bb-976cb65ede83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:24.563513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa2d0b59-1ca7-4451-b3bb-976cb65ede83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:24.564300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fa2d0b59-1ca7-4451-b3bb-976cb65ede83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:24.946055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fa2d0b59-1ca7-4451-b3bb-976cb65ede83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:40:24.972506 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fa2d0b59-1ca7-4451-b3bb-976cb65ede83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 200 len: 1358 microversion: 2.1 time: 0.442437 Jul 25 13:40:24.975351 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3435/6798] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:40:24 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 1358 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:40:25.012464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-8350da90-44c4-4eb2-a26f-bc1e72127a2b req-8686c1ef-b8c1-4449-adf7-7d6430d5468d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5743a171-c0fe-4b66-a8a0-29ca894a002b", "tag": "103ef968-cc2f-4b4c-853f-270d538e873c"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:40:25.043306 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-8350da90-44c4-4eb2-a26f-bc1e72127a2b req-8686c1ef-b8c1-4449-adf7-7d6430d5468d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:25.043980 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-8350da90-44c4-4eb2-a26f-bc1e72127a2b req-8686c1ef-b8c1-4449-adf7-7d6430d5468d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:25.081523 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-8350da90-44c4-4eb2-a26f-bc1e72127a2b req-8686c1ef-b8c1-4449-adf7-7d6430d5468d service nova] Creating event network-changed:103ef968-cc2f-4b4c-853f-270d538e873c for instance 5743a171-c0fe-4b66-a8a0-29ca894a002b on n-h2-848886-15 Jul 25 13:40:25.091120 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-8350da90-44c4-4eb2-a26f-bc1e72127a2b req-8686c1ef-b8c1-4449-adf7-7d6430d5468d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084863 Jul 25 13:40:25.094871 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3364/6799] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:40:26.006330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1206f977-11f3-4884-8e04-244f17cb18c6 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:40:26.009014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1206f977-11f3-4884-8e04-244f17cb18c6 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:40:26.025891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1206f977-11f3-4884-8e04-244f17cb18c6 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:26.026763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1206f977-11f3-4884-8e04-244f17cb18c6 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:26.027968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1206f977-11f3-4884-8e04-244f17cb18c6 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:26.028566 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1206f977-11f3-4884-8e04-244f17cb18c6 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:26.246304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1206f977-11f3-4884-8e04-244f17cb18c6 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:40:26.264400 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1206f977-11f3-4884-8e04-244f17cb18c6 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 200 len: 1358 microversion: 2.1 time: 0.263548 Jul 25 13:40:26.268939 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3436/6800] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:40:25 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:40:27.306810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f0782542-0998-4e20-bbdf-4f3cfec35f71 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:40:27.308159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f0782542-0998-4e20-bbdf-4f3cfec35f71 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:40:27.320903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0782542-0998-4e20-bbdf-4f3cfec35f71 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:27.321375 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0782542-0998-4e20-bbdf-4f3cfec35f71 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:27.322259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0782542-0998-4e20-bbdf-4f3cfec35f71 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:27.322720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f0782542-0998-4e20-bbdf-4f3cfec35f71 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:27.536337 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f0782542-0998-4e20-bbdf-4f3cfec35f71 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:40:27.547873 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f0782542-0998-4e20-bbdf-4f3cfec35f71 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 200 len: 1358 microversion: 2.1 time: 0.249533 Jul 25 13:40:27.548677 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3365/6801] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:40:27 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:40:28.570582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-57bb8b27-3543-4678-a99b-01794a95686b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:40:28.571410 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-57bb8b27-3543-4678-a99b-01794a95686b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:40:28.582933 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57bb8b27-3543-4678-a99b-01794a95686b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:28.583531 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57bb8b27-3543-4678-a99b-01794a95686b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:28.584754 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57bb8b27-3543-4678-a99b-01794a95686b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:28.585197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57bb8b27-3543-4678-a99b-01794a95686b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:28.784976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-57bb8b27-3543-4678-a99b-01794a95686b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:40:28.794694 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-57bb8b27-3543-4678-a99b-01794a95686b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 200 len: 1358 microversion: 2.1 time: 0.228181 Jul 25 13:40:28.795496 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3437/6802] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:40:28 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:40:29.818485 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-98c68d0b-87ca-45fa-9bac-b9ba1a7e9ab5 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:40:29.819057 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-98c68d0b-87ca-45fa-9bac-b9ba1a7e9ab5 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:40:29.830297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98c68d0b-87ca-45fa-9bac-b9ba1a7e9ab5 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:29.830780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98c68d0b-87ca-45fa-9bac-b9ba1a7e9ab5 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:29.831645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98c68d0b-87ca-45fa-9bac-b9ba1a7e9ab5 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:29.832464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98c68d0b-87ca-45fa-9bac-b9ba1a7e9ab5 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:30.056212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-98c68d0b-87ca-45fa-9bac-b9ba1a7e9ab5 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:40:30.064862 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-98c68d0b-87ca-45fa-9bac-b9ba1a7e9ab5 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 200 len: 1358 microversion: 2.1 time: 0.250314 Jul 25 13:40:30.065492 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3366/6803] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:40:29 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:40:31.089668 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-333ad405-ed7c-49af-bd0a-112bb767e155 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:40:31.090361 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-333ad405-ed7c-49af-bd0a-112bb767e155 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:40:31.093102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:40:31.093783 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:40:31.099993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-333ad405-ed7c-49af-bd0a-112bb767e155 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:31.100438 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-333ad405-ed7c-49af-bd0a-112bb767e155 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:31.101226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-333ad405-ed7c-49af-bd0a-112bb767e155 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:31.101657 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-333ad405-ed7c-49af-bd0a-112bb767e155 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:31.261535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-333ad405-ed7c-49af-bd0a-112bb767e155 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:40:31.269764 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-333ad405-ed7c-49af-bd0a-112bb767e155 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 200 len: 1358 microversion: 2.1 time: 0.184103 Jul 25 13:40:31.270299 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3438/6804] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:40:31 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:40:32.291699 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-022c3030-8a21-4e79-9d73-7ed7a9f38179 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:40:32.292306 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-022c3030-8a21-4e79-9d73-7ed7a9f38179 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:40:32.294383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:40:32.300725 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-022c3030-8a21-4e79-9d73-7ed7a9f38179 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:32.301191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-022c3030-8a21-4e79-9d73-7ed7a9f38179 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:32.302049 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-022c3030-8a21-4e79-9d73-7ed7a9f38179 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:32.302514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-022c3030-8a21-4e79-9d73-7ed7a9f38179 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:32.442805 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-022c3030-8a21-4e79-9d73-7ed7a9f38179 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:40:32.451041 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-022c3030-8a21-4e79-9d73-7ed7a9f38179 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 200 len: 1358 microversion: 2.1 time: 0.163290 Jul 25 13:40:32.451648 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3367/6805] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:40:32 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:40:33.482130 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cfdf38d0-4328-4516-9ba9-6f9385181cbb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:40:33.483292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cfdf38d0-4328-4516-9ba9-6f9385181cbb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:40:33.491933 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cfdf38d0-4328-4516-9ba9-6f9385181cbb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:33.492380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cfdf38d0-4328-4516-9ba9-6f9385181cbb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:33.493166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cfdf38d0-4328-4516-9ba9-6f9385181cbb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:33.493602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cfdf38d0-4328-4516-9ba9-6f9385181cbb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:33.641315 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cfdf38d0-4328-4516-9ba9-6f9385181cbb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:40:33.649400 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cfdf38d0-4328-4516-9ba9-6f9385181cbb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 200 len: 1358 microversion: 2.1 time: 0.174750 Jul 25 13:40:33.650019 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3439/6806] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:40:33 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:40:34.671384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ab3025bb-c698-4590-bbf3-6838271e6159 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:40:34.672012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ab3025bb-c698-4590-bbf3-6838271e6159 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:40:34.679749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ab3025bb-c698-4590-bbf3-6838271e6159 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:34.680229 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ab3025bb-c698-4590-bbf3-6838271e6159 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:34.681025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ab3025bb-c698-4590-bbf3-6838271e6159 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:34.681482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ab3025bb-c698-4590-bbf3-6838271e6159 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:34.836142 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ab3025bb-c698-4590-bbf3-6838271e6159 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:40:34.845226 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ab3025bb-c698-4590-bbf3-6838271e6159 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 200 len: 1358 microversion: 2.1 time: 0.178100 Jul 25 13:40:34.846135 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3368/6807] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:40:34 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:40:34.875759 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-185aeae3-ccf1-4066-9815-3e5ed47d14e4 req-b43e5a17-1daa-452b-a263-6151832c2673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5743a171-c0fe-4b66-a8a0-29ca894a002b", "name": "network-vif-plugged", "status": "completed", "tag": "103ef968-cc2f-4b4c-853f-270d538e873c"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:40:34.887143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-185aeae3-ccf1-4066-9815-3e5ed47d14e4 req-b43e5a17-1daa-452b-a263-6151832c2673 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:34.887606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-185aeae3-ccf1-4066-9815-3e5ed47d14e4 req-b43e5a17-1daa-452b-a263-6151832c2673 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:34.903074 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-185aeae3-ccf1-4066-9815-3e5ed47d14e4 req-b43e5a17-1daa-452b-a263-6151832c2673 service nova] Creating event network-vif-plugged:103ef968-cc2f-4b4c-853f-270d538e873c for instance 5743a171-c0fe-4b66-a8a0-29ca894a002b on n-h2-848886-15 Jul 25 13:40:34.908622 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-185aeae3-ccf1-4066-9815-3e5ed47d14e4 req-b43e5a17-1daa-452b-a263-6151832c2673 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036653 Jul 25 13:40:34.909232 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3440/6808] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:40:35.866880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a8d53229-4e0b-461d-ad99-7d7d830ea875 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:40:35.867494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a8d53229-4e0b-461d-ad99-7d7d830ea875 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:40:35.875150 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a8d53229-4e0b-461d-ad99-7d7d830ea875 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:35.875619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a8d53229-4e0b-461d-ad99-7d7d830ea875 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:35.876415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a8d53229-4e0b-461d-ad99-7d7d830ea875 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:35.876869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a8d53229-4e0b-461d-ad99-7d7d830ea875 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:36.017808 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a8d53229-4e0b-461d-ad99-7d7d830ea875 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:40:36.027112 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a8d53229-4e0b-461d-ad99-7d7d830ea875 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 200 len: 1358 microversion: 2.1 time: 0.164093 Jul 25 13:40:36.027945 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3369/6809] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:40:35 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:40:37.050318 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bd287dff-4220-4d90-8b27-f3be427c92cb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:40:37.051046 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-bd287dff-4220-4d90-8b27-f3be427c92cb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:40:37.058104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd287dff-4220-4d90-8b27-f3be427c92cb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:37.058564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd287dff-4220-4d90-8b27-f3be427c92cb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:37.059356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd287dff-4220-4d90-8b27-f3be427c92cb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:37.059825 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-bd287dff-4220-4d90-8b27-f3be427c92cb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:37.196282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-bd287dff-4220-4d90-8b27-f3be427c92cb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:40:37.204295 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bd287dff-4220-4d90-8b27-f3be427c92cb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 200 len: 1548 microversion: 2.1 time: 0.159511 Jul 25 13:40:37.204925 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3441/6810] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:40:37 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:40:37.225823 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c0b30b2a-5320-4b74-8ee9-ceb621ae2145 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:40:37.226475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c0b30b2a-5320-4b74-8ee9-ceb621ae2145 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:40:37.233731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0b30b2a-5320-4b74-8ee9-ceb621ae2145 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:37.234240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0b30b2a-5320-4b74-8ee9-ceb621ae2145 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:37.235026 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0b30b2a-5320-4b74-8ee9-ceb621ae2145 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:37.235478 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c0b30b2a-5320-4b74-8ee9-ceb621ae2145 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:37.371663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c0b30b2a-5320-4b74-8ee9-ceb621ae2145 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:40:37.379600 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c0b30b2a-5320-4b74-8ee9-ceb621ae2145 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 200 len: 1548 microversion: 2.1 time: 0.158161 Jul 25 13:40:37.380194 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3370/6811] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:40:37 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:40:37.399418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-72988e86-aa2c-43ae-a6e1-c8d674f4ee0e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:40:37.404051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-72988e86-aa2c-43ae-a6e1-c8d674f4ee0e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:40:37.404830 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-72988e86-aa2c-43ae-a6e1-c8d674f4ee0e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Searching by: {'deleted': False, 'project_id': 'aa9afc929da94c579e696ed23d1964d3'} {{(pid=125884) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:40:37.410696 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-72988e86-aa2c-43ae-a6e1-c8d674f4ee0e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:37.411136 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-72988e86-aa2c-43ae-a6e1-c8d674f4ee0e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:37.411929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-72988e86-aa2c-43ae-a6e1-c8d674f4ee0e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:37.412362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-72988e86-aa2c-43ae-a6e1-c8d674f4ee0e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:37.437687 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.multi_cell_list [None req-72988e86-aa2c-43ae-a6e1-c8d674f4ee0e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:40:37.465897 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-72988e86-aa2c-43ae-a6e1-c8d674f4ee0e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070282 Jul 25 13:40:37.466897 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3442/6812] 10.222.0.49 () {58 vars in 1125 bytes} [Mon Jul 25 13:40:37 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:40:37.477941 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e20faaef-718a-4f1a-803c-5b582850da57 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:40:37.478588 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e20faaef-718a-4f1a-803c-5b582850da57 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:40:37.485197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e20faaef-718a-4f1a-803c-5b582850da57 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:37.485652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e20faaef-718a-4f1a-803c-5b582850da57 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:37.486465 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e20faaef-718a-4f1a-803c-5b582850da57 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:37.486917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e20faaef-718a-4f1a-803c-5b582850da57 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:37.624995 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e20faaef-718a-4f1a-803c-5b582850da57 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:40:37.632965 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e20faaef-718a-4f1a-803c-5b582850da57 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 200 len: 1548 microversion: 2.1 time: 0.158986 Jul 25 13:40:37.633557 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3371/6813] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:40:37 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:40:39.251584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-605d024f-192b-4541-99ca-7bed4579a964 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96f75a3f-e893-4684-ac49-9ea023ffb557"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:40:39.254128 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-605d024f-192b-4541-99ca-7bed4579a964 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:40:39.262834 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-605d024f-192b-4541-99ca-7bed4579a964 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:39.263292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-605d024f-192b-4541-99ca-7bed4579a964 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:39.264129 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-605d024f-192b-4541-99ca-7bed4579a964 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:39.264546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-605d024f-192b-4541-99ca-7bed4579a964 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:39.551488 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-605d024f-192b-4541-99ca-7bed4579a964 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "POST /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304489 Jul 25 13:40:39.552143 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3443/6814] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Jul 25 13:40:39 2022] POST /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:40:52.726391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-54ed4883-f4a2-4f98-92be-23d2aeb4984e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:40:52.727041 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-54ed4883-f4a2-4f98-92be-23d2aeb4984e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:40:52.730439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:40:52.731083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=50 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:40:52.738850 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54ed4883-f4a2-4f98-92be-23d2aeb4984e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:52.739316 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54ed4883-f4a2-4f98-92be-23d2aeb4984e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:52.740133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54ed4883-f4a2-4f98-92be-23d2aeb4984e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:52.740580 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54ed4883-f4a2-4f98-92be-23d2aeb4984e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:52.883833 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-54ed4883-f4a2-4f98-92be-23d2aeb4984e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:40:52.892577 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-54ed4883-f4a2-4f98-92be-23d2aeb4984e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 200 len: 1594 microversion: 2.1 time: 0.170456 Jul 25 13:40:52.893182 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3372/6815] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:40:52 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 1594 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:40:55.056200 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:40:55.057422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:40:55.058150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:40:55.062627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-8661a463-0117-4ec1-93bc-02ed9c75f26f req-b95da321-9a00-4bd2-87c0-4ccb1202f64e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5743a171-c0fe-4b66-a8a0-29ca894a002b", "tag": "103ef968-cc2f-4b4c-853f-270d538e873c"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:40:55.075124 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-8661a463-0117-4ec1-93bc-02ed9c75f26f req-b95da321-9a00-4bd2-87c0-4ccb1202f64e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:55.075574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-8661a463-0117-4ec1-93bc-02ed9c75f26f req-b95da321-9a00-4bd2-87c0-4ccb1202f64e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:55.089803 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-8661a463-0117-4ec1-93bc-02ed9c75f26f req-b95da321-9a00-4bd2-87c0-4ccb1202f64e service nova] Creating event network-changed:103ef968-cc2f-4b4c-853f-270d538e873c for instance 5743a171-c0fe-4b66-a8a0-29ca894a002b on n-h2-848886-15 Jul 25 13:40:55.095182 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-8661a463-0117-4ec1-93bc-02ed9c75f26f req-b95da321-9a00-4bd2-87c0-4ccb1202f64e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040940 Jul 25 13:40:55.095860 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3444/6816] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:40:56.250378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-20ef0713-268d-4996-8ce1-92c292ccf5c2 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1868665242"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:40:56.250942 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-20ef0713-268d-4996-8ce1-92c292ccf5c2 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:40:56.258704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20ef0713-268d-4996-8ce1-92c292ccf5c2 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:56.259161 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20ef0713-268d-4996-8ce1-92c292ccf5c2 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:56.259970 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20ef0713-268d-4996-8ce1-92c292ccf5c2 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:56.260420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20ef0713-268d-4996-8ce1-92c292ccf5c2 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:56.395181 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.network.security_group_api [None req-20ef0713-268d-4996-8ce1-92c292ccf5c2 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Adding security group 7bd8949f-fe2e-4173-8090-03d361a37351 to port 103ef968-cc2f-4b4c-853f-270d538e873c Jul 25 13:40:56.780940 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-20ef0713-268d-4996-8ce1-92c292ccf5c2 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "POST /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/action" status: 202 len: 0 microversion: 2.1 time: 0.534742 Jul 25 13:40:56.782500 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3373/6817] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:40:56 2022] POST /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 13:40:56.794682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cc21e2d1-7343-49e9-afbf-482bf1e27109 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:40:56.795705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cc21e2d1-7343-49e9-afbf-482bf1e27109 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:40:56.809010 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc21e2d1-7343-49e9-afbf-482bf1e27109 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:56.809896 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc21e2d1-7343-49e9-afbf-482bf1e27109 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:56.811255 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc21e2d1-7343-49e9-afbf-482bf1e27109 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:56.811995 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc21e2d1-7343-49e9-afbf-482bf1e27109 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:57.009012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cc21e2d1-7343-49e9-afbf-482bf1e27109 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:40:57.020024 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cc21e2d1-7343-49e9-afbf-482bf1e27109 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 200 len: 1759 microversion: 2.1 time: 0.233056 Jul 25 13:40:57.021378 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3445/6818] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:40:56 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 1759 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:40:57.111399 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-4b55de88-3374-4af3-a4b8-3d1a6bf0e3ee req-b8019e1b-4bd8-4689-921a-a216a55a8996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5743a171-c0fe-4b66-a8a0-29ca894a002b", "tag": "103ef968-cc2f-4b4c-853f-270d538e873c"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:40:57.133416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4b55de88-3374-4af3-a4b8-3d1a6bf0e3ee req-b8019e1b-4bd8-4689-921a-a216a55a8996 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:40:57.134167 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4b55de88-3374-4af3-a4b8-3d1a6bf0e3ee req-b8019e1b-4bd8-4689-921a-a216a55a8996 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:40:57.148959 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-4b55de88-3374-4af3-a4b8-3d1a6bf0e3ee req-b8019e1b-4bd8-4689-921a-a216a55a8996 service nova] Creating event network-changed:103ef968-cc2f-4b4c-853f-270d538e873c for instance 5743a171-c0fe-4b66-a8a0-29ca894a002b on n-h2-848886-15 Jul 25 13:40:57.154658 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-4b55de88-3374-4af3-a4b8-3d1a6bf0e3ee req-b8019e1b-4bd8-4689-921a-a216a55a8996 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047110 Jul 25 13:40:57.155553 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3374/6819] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:42:03.143173 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:42:03.143877 n-d-848886-15 devstack@n-api.service[125884]: Mon Jul 25 13:42:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:42:34.663942 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:42:34.664720 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=8 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:42:34.670128 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5d4ef45d-c847-426e-bb06-6dd87ddef222 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:42:34.671904 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5d4ef45d-c847-426e-bb06-6dd87ddef222 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:42:34.679304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d4ef45d-c847-426e-bb06-6dd87ddef222 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:42:34.679740 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d4ef45d-c847-426e-bb06-6dd87ddef222 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:42:34.680518 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d4ef45d-c847-426e-bb06-6dd87ddef222 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:42:34.680947 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d4ef45d-c847-426e-bb06-6dd87ddef222 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:42:34.761163 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5d4ef45d-c847-426e-bb06-6dd87ddef222 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "POST /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/action" status: 202 len: 0 microversion: 2.1 time: 0.098871 Jul 25 13:42:34.761846 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3446/6820] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:42:34 2022] POST /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:42:34.770371 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:42:34.771134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=12 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:42:34.776907 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1f19f079-3141-403c-a455-b17ee402380e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:42:34.777641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1f19f079-3141-403c-a455-b17ee402380e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:42:34.785790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1f19f079-3141-403c-a455-b17ee402380e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:42:34.786294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1f19f079-3141-403c-a455-b17ee402380e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:42:34.787099 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1f19f079-3141-403c-a455-b17ee402380e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:42:34.787564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1f19f079-3141-403c-a455-b17ee402380e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:42:35.240797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1f19f079-3141-403c-a455-b17ee402380e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:42:35.249644 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1f19f079-3141-403c-a455-b17ee402380e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 200 len: 1761 microversion: 2.1 time: 0.481926 Jul 25 13:42:35.250283 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3375/6821] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:42:34 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 1761 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:42:36.273628 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e53321f1-b8a0-4776-8961-fd47780465a6 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:42:36.274666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e53321f1-b8a0-4776-8961-fd47780465a6 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:42:36.281612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e53321f1-b8a0-4776-8961-fd47780465a6 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:42:36.282096 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e53321f1-b8a0-4776-8961-fd47780465a6 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:42:36.282895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e53321f1-b8a0-4776-8961-fd47780465a6 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:42:36.283333 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e53321f1-b8a0-4776-8961-fd47780465a6 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:42:36.510810 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e53321f1-b8a0-4776-8961-fd47780465a6 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:42:36.519041 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e53321f1-b8a0-4776-8961-fd47780465a6 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 200 len: 1759 microversion: 2.1 time: 0.251109 Jul 25 13:42:36.519715 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3447/6822] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:42:36 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 1759 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:42:57.962039 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:42:57.962672 n-d-848886-15 devstack@n-api.service[125883]: Mon Jul 25 13:42:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:43:03.979033 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:43:03.979673 n-d-848886-15 devstack@n-api.service[125884]: Mon Jul 25 13:43:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:43:15.494996 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:43:15.495574 n-d-848886-15 devstack@n-api.service[125883]: Mon Jul 25 13:43:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:43:50.188839 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:43:50.189608 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:43:50.194510 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-95939dd0-d75c-4e47-ae3e-a7c384ac3ac1 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1868665242"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:43:50.195069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-95939dd0-d75c-4e47-ae3e-a7c384ac3ac1 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:43:50.202442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-95939dd0-d75c-4e47-ae3e-a7c384ac3ac1 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:43:50.202900 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-95939dd0-d75c-4e47-ae3e-a7c384ac3ac1 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:43:50.203684 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-95939dd0-d75c-4e47-ae3e-a7c384ac3ac1 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:43:50.204130 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-95939dd0-d75c-4e47-ae3e-a7c384ac3ac1 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:43:50.374104 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.network.security_group_api [None req-95939dd0-d75c-4e47-ae3e-a7c384ac3ac1 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Removing security group 7bd8949f-fe2e-4173-8090-03d361a37351 from port 103ef968-cc2f-4b4c-853f-270d538e873c Jul 25 13:43:50.435510 n-d-848886-15 devstack@n-api.service[125883]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34360325-f0fe-440a-9621-399cd8a3ecbe] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 13:43:50.768057 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-95939dd0-d75c-4e47-ae3e-a7c384ac3ac1 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "POST /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/action" status: 202 len: 0 microversion: 2.1 time: 0.581079 Jul 25 13:43:50.769352 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3376/6823] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:43:50 2022] POST /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/action => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:43:50.782488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:43:50.783336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:43:50.895984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-67e77712-b493-4f8e-a2f9-36497d84695b req-7d9060a6-5eb6-4db6-9fd4-03b08aa4b548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5743a171-c0fe-4b66-a8a0-29ca894a002b", "tag": "103ef968-cc2f-4b4c-853f-270d538e873c"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:43:50.912650 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-67e77712-b493-4f8e-a2f9-36497d84695b req-7d9060a6-5eb6-4db6-9fd4-03b08aa4b548 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:43:50.913192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-67e77712-b493-4f8e-a2f9-36497d84695b req-7d9060a6-5eb6-4db6-9fd4-03b08aa4b548 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:43:50.929212 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-67e77712-b493-4f8e-a2f9-36497d84695b req-7d9060a6-5eb6-4db6-9fd4-03b08aa4b548 service nova] Creating event network-changed:103ef968-cc2f-4b4c-853f-270d538e873c for instance 5743a171-c0fe-4b66-a8a0-29ca894a002b on n-h2-848886-15 Jul 25 13:43:50.936984 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-67e77712-b493-4f8e-a2f9-36497d84695b req-7d9060a6-5eb6-4db6-9fd4-03b08aa4b548 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155328 Jul 25 13:43:50.941158 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3448/6824] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:43:52.653416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-31243cb2-62a6-4250-8b19-af8c38d1f690 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:43:52.654136 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-31243cb2-62a6-4250-8b19-af8c38d1f690 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:43:52.662359 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31243cb2-62a6-4250-8b19-af8c38d1f690 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:43:52.662943 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31243cb2-62a6-4250-8b19-af8c38d1f690 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:43:52.663802 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31243cb2-62a6-4250-8b19-af8c38d1f690 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:43:52.664311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-31243cb2-62a6-4250-8b19-af8c38d1f690 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:43:52.670915 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] [34360325-f0fe-440a-9621-399cd8a3ecbe] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 47022. Jul 25 13:43:52.757446 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-31243cb2-62a6-4250-8b19-af8c38d1f690 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lazy-loading 'services' on Instance uuid 5743a171-c0fe-4b66-a8a0-29ca894a002b {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:43:52.839881 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-31243cb2-62a6-4250-8b19-af8c38d1f690 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/os-volume_attachments/96f75a3f-e893-4684-ac49-9ea023ffb557" status: 202 len: 0 microversion: 2.1 time: 0.194002 Jul 25 13:43:52.840814 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3377/6825] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Jul 25 13:43:52 2022] DELETE /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/os-volume_attachments/96f75a3f-e893-4684-ac49-9ea023ffb557 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:43:52.850988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c06867ca-2a5f-4ff1-b244-65da5c9d9977 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:43:52.853908 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c06867ca-2a5f-4ff1-b244-65da5c9d9977 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:43:52.863261 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c06867ca-2a5f-4ff1-b244-65da5c9d9977 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:43:52.864070 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c06867ca-2a5f-4ff1-b244-65da5c9d9977 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:43:52.865195 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c06867ca-2a5f-4ff1-b244-65da5c9d9977 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:43:52.865818 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c06867ca-2a5f-4ff1-b244-65da5c9d9977 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:43:52.908816 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c06867ca-2a5f-4ff1-b244-65da5c9d9977 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062793 Jul 25 13:43:52.909426 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3449/6826] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:43:52 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:43:52.954530 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-43920f40-2b0d-42c8-abf6-6626cb363d16 req-4caf8acc-6c4c-4b0d-b5ca-5b24aac6248d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5743a171-c0fe-4b66-a8a0-29ca894a002b", "tag": "103ef968-cc2f-4b4c-853f-270d538e873c"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:43:52.966313 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-43920f40-2b0d-42c8-abf6-6626cb363d16 req-4caf8acc-6c4c-4b0d-b5ca-5b24aac6248d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:43:52.966881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-43920f40-2b0d-42c8-abf6-6626cb363d16 req-4caf8acc-6c4c-4b0d-b5ca-5b24aac6248d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:43:52.982403 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-43920f40-2b0d-42c8-abf6-6626cb363d16 req-4caf8acc-6c4c-4b0d-b5ca-5b24aac6248d service nova] Creating event network-changed:103ef968-cc2f-4b4c-853f-270d538e873c for instance 5743a171-c0fe-4b66-a8a0-29ca894a002b on n-h2-848886-15 Jul 25 13:43:52.989779 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-43920f40-2b0d-42c8-abf6-6626cb363d16 req-4caf8acc-6c4c-4b0d-b5ca-5b24aac6248d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039274 Jul 25 13:43:52.991311 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3378/6827] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:43:53.922250 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7d4642af-73b1-4dec-a512-c4f16fe0e371 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:43:53.924443 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7d4642af-73b1-4dec-a512-c4f16fe0e371 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:43:53.932289 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d4642af-73b1-4dec-a512-c4f16fe0e371 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:43:53.932739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d4642af-73b1-4dec-a512-c4f16fe0e371 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:43:53.933526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d4642af-73b1-4dec-a512-c4f16fe0e371 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:43:53.934023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d4642af-73b1-4dec-a512-c4f16fe0e371 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:43:53.967956 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7d4642af-73b1-4dec-a512-c4f16fe0e371 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049550 Jul 25 13:43:53.968753 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3450/6828] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:43:53 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:43:54.982985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a0f21248-ab68-4f8a-9d79-b9143ac8ca97 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:43:54.985403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a0f21248-ab68-4f8a-9d79-b9143ac8ca97 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:43:54.992616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a0f21248-ab68-4f8a-9d79-b9143ac8ca97 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:43:54.993080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a0f21248-ab68-4f8a-9d79-b9143ac8ca97 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:43:54.993898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a0f21248-ab68-4f8a-9d79-b9143ac8ca97 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:43:54.995543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a0f21248-ab68-4f8a-9d79-b9143ac8ca97 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:43:55.030913 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a0f21248-ab68-4f8a-9d79-b9143ac8ca97 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053611 Jul 25 13:43:55.031493 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3379/6829] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:43:54 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:43:56.043788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8c3e7636-dfd4-425b-8495-13b2745d4bc2 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:43:56.046046 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8c3e7636-dfd4-425b-8495-13b2745d4bc2 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:43:56.053351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c3e7636-dfd4-425b-8495-13b2745d4bc2 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:43:56.053802 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c3e7636-dfd4-425b-8495-13b2745d4bc2 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:43:56.054571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c3e7636-dfd4-425b-8495-13b2745d4bc2 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:43:56.055033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8c3e7636-dfd4-425b-8495-13b2745d4bc2 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:43:56.091633 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8c3e7636-dfd4-425b-8495-13b2745d4bc2 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051889 Jul 25 13:43:56.092435 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3451/6830] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:43:56 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:43:57.104804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-79a23dcf-a3ed-4e6f-af4c-ee60880a3b7c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:43:57.107533 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-79a23dcf-a3ed-4e6f-af4c-ee60880a3b7c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:43:57.115425 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79a23dcf-a3ed-4e6f-af4c-ee60880a3b7c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:43:57.115876 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79a23dcf-a3ed-4e6f-af4c-ee60880a3b7c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:43:57.121588 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79a23dcf-a3ed-4e6f-af4c-ee60880a3b7c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:43:57.122099 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-79a23dcf-a3ed-4e6f-af4c-ee60880a3b7c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:43:57.159912 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-79a23dcf-a3ed-4e6f-af4c-ee60880a3b7c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059336 Jul 25 13:43:57.164695 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3380/6831] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:43:57 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:43:58.172011 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-567314f1-d0b8-47e6-a567-03904b75d0e1 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:43:58.174245 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-567314f1-d0b8-47e6-a567-03904b75d0e1 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:43:58.181688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-567314f1-d0b8-47e6-a567-03904b75d0e1 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:43:58.182530 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-567314f1-d0b8-47e6-a567-03904b75d0e1 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:43:58.183585 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-567314f1-d0b8-47e6-a567-03904b75d0e1 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:43:58.184089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-567314f1-d0b8-47e6-a567-03904b75d0e1 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:43:58.214669 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-567314f1-d0b8-47e6-a567-03904b75d0e1 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046863 Jul 25 13:43:58.215228 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3452/6832] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:43:58 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 13:43:58.226168 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-55b0a52e-30c2-4ead-8432-824727f55f02 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:43:58.226739 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-55b0a52e-30c2-4ead-8432-824727f55f02 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:43:58.233957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55b0a52e-30c2-4ead-8432-824727f55f02 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:43:58.234424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55b0a52e-30c2-4ead-8432-824727f55f02 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:43:58.235204 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55b0a52e-30c2-4ead-8432-824727f55f02 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:43:58.235649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-55b0a52e-30c2-4ead-8432-824727f55f02 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:43:58.327059 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-55b0a52e-30c2-4ead-8432-824727f55f02 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] HTTP exception thrown: Instance 5743a171-c0fe-4b66-a8a0-29ca894a002b is not attached to volume 96f75a3f-e893-4684-ac49-9ea023ffb557 Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-55b0a52e-30c2-4ead-8432-824727f55f02 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Request method failure captured: Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: request: DELETE /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/os-volume_attachments/96f75a3f-e893-4684-ac49-9ea023ffb557 HTTP/1.1 Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3p0zVSIM2UreUkUikCnAvL4djGCFm2w4z7jiMMoa85Swm_2mnYMLWpuqNlPDeY3LHhPYQT97_yWrDwupLRD6ifSR5i0Cy3wdv0mf5IPnEmugINCAXXgQdNbQ3tLlzq554eHcFnE3rzDc6C-Cyg3jsFln0akLX8dUpTQAnJjDKdl4pQc Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: aa9afc929da94c579e696ed23d1964d3 Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-TestMinimumBasicScenario-1802355901 Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aa9afc929da94c579e696ed23d1964d3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aa9afc929da94c579e696ed23d1964d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa9afc929da94c579e696ed23d1964d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa9afc929da94c579e696ed23d1964d3"}]}] Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-TestMinimumBasicScenario-1802355901 Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: aa9afc929da94c579e696ed23d1964d3 Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1802355901 Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-TestMinimumBasicScenario-1802355901-project Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 114282760b914b30bf98a17b61b59569 Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-TestMinimumBasicScenario-1802355901-project Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 5743a171-c0fe-4b66-a8a0-29ca894a002b is not attached to volume 96f75a3f-e893-4684-ac49-9ea023ffb557 Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'server_id': '5743a171-c0fe-4b66-a8a0-29ca894a002b', 'id': '96f75a3f-e893-4684-ac49-9ea023ffb557'} Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 96f75a3f-e893-4684-ac49-9ea023ffb557. Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5743a171-c0fe-4b66-a8a0-29ca894a002b is not attached to volume 96f75a3f-e893-4684-ac49-9ea023ffb557 Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:43:58.329030 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:43:58.333900 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:43:58.333900 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:43:58.333900 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5743a171-c0fe-4b66-a8a0-29ca894a002b is not attached to volume 96f75a3f-e893-4684-ac49-9ea023ffb557 Jul 25 13:43:58.333900 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:43:58.333900 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-55b0a52e-30c2-4ead-8432-824727f55f02 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Returning 404 to user: Instance 5743a171-c0fe-4b66-a8a0-29ca894a002b is not attached to volume 96f75a3f-e893-4684-ac49-9ea023ffb557 {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:43:58.333900 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-55b0a52e-30c2-4ead-8432-824727f55f02 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/os-volume_attachments/96f75a3f-e893-4684-ac49-9ea023ffb557" status: 404 len: 154 microversion: 2.1 time: 0.108797 Jul 25 13:43:58.333900 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3381/6833] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Jul 25 13:43:58 2022] DELETE /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b/os-volume_attachments/96f75a3f-e893-4684-ac49-9ea023ffb557 => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:44:01.600547 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5b986803-61e4-47e1-9b74-75e2ecf347ab tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:01.601055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5b986803-61e4-47e1-9b74-75e2ecf347ab tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:01.608575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b986803-61e4-47e1-9b74-75e2ecf347ab tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:01.609033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b986803-61e4-47e1-9b74-75e2ecf347ab tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:01.609802 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b986803-61e4-47e1-9b74-75e2ecf347ab tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:01.610274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b986803-61e4-47e1-9b74-75e2ecf347ab tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:01.635570 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5b986803-61e4-47e1-9b74-75e2ecf347ab tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:44:01.727162 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5b986803-61e4-47e1-9b74-75e2ecf347ab tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 204 len: 0 microversion: 2.1 time: 0.130500 Jul 25 13:44:01.727765 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3453/6834] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:44:01 2022] DELETE /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:44:01.736378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d1438039-dfdd-4a29-bf42-6cb182132a2b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:01.737008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d1438039-dfdd-4a29-bf42-6cb182132a2b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:01.746866 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1438039-dfdd-4a29-bf42-6cb182132a2b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:01.747384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1438039-dfdd-4a29-bf42-6cb182132a2b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:01.748213 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1438039-dfdd-4a29-bf42-6cb182132a2b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:01.748671 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1438039-dfdd-4a29-bf42-6cb182132a2b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:01.898088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d1438039-dfdd-4a29-bf42-6cb182132a2b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:01.908545 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d1438039-dfdd-4a29-bf42-6cb182132a2b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 200 len: 1554 microversion: 2.1 time: 0.176213 Jul 25 13:44:01.909139 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3382/6835] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:01 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:44:02.932028 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b170ef5a-eba1-4c8f-baec-bdccdd668d83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:02.932859 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b170ef5a-eba1-4c8f-baec-bdccdd668d83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:02.941083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b170ef5a-eba1-4c8f-baec-bdccdd668d83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:02.941623 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b170ef5a-eba1-4c8f-baec-bdccdd668d83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:02.942490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b170ef5a-eba1-4c8f-baec-bdccdd668d83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:02.943081 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b170ef5a-eba1-4c8f-baec-bdccdd668d83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:03.084176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b170ef5a-eba1-4c8f-baec-bdccdd668d83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:03.092817 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b170ef5a-eba1-4c8f-baec-bdccdd668d83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 200 len: 1554 microversion: 2.1 time: 0.165684 Jul 25 13:44:03.093420 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3454/6836] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:02 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:44:03.786117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-bcb9c598-2d2c-43a1-aafd-029e90740b31 req-92b33ddd-86a6-4cca-96ac-92ef1955cb43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5743a171-c0fe-4b66-a8a0-29ca894a002b", "name": "network-vif-deleted", "tag": "103ef968-cc2f-4b4c-853f-270d538e873c"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:44:03.801399 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-bcb9c598-2d2c-43a1-aafd-029e90740b31 req-92b33ddd-86a6-4cca-96ac-92ef1955cb43 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:03.801890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-bcb9c598-2d2c-43a1-aafd-029e90740b31 req-92b33ddd-86a6-4cca-96ac-92ef1955cb43 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:03.815648 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-bcb9c598-2d2c-43a1-aafd-029e90740b31 req-92b33ddd-86a6-4cca-96ac-92ef1955cb43 service nova] Creating event network-vif-deleted:103ef968-cc2f-4b4c-853f-270d538e873c for instance 5743a171-c0fe-4b66-a8a0-29ca894a002b on n-h2-848886-15 Jul 25 13:44:03.820687 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-bcb9c598-2d2c-43a1-aafd-029e90740b31 req-92b33ddd-86a6-4cca-96ac-92ef1955cb43 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040085 Jul 25 13:44:03.821340 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3383/6837] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:44:04.113952 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f799134e-07a4-45ed-ad2e-535b584887b8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:04.114650 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f799134e-07a4-45ed-ad2e-535b584887b8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:04.123715 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f799134e-07a4-45ed-ad2e-535b584887b8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:04.124174 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f799134e-07a4-45ed-ad2e-535b584887b8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:04.125182 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f799134e-07a4-45ed-ad2e-535b584887b8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:04.125598 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f799134e-07a4-45ed-ad2e-535b584887b8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:04.161618 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f799134e-07a4-45ed-ad2e-535b584887b8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:04.162096 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f799134e-07a4-45ed-ad2e-535b584887b8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:04.162555 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-f799134e-07a4-45ed-ad2e-535b584887b8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lazy-loading 'fault' on Instance uuid 5743a171-c0fe-4b66-a8a0-29ca894a002b {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:44:04.209688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f799134e-07a4-45ed-ad2e-535b584887b8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:04.217493 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f799134e-07a4-45ed-ad2e-535b584887b8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 200 len: 1348 microversion: 2.1 time: 0.107502 Jul 25 13:44:04.226109 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3455/6838] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:04 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 1348 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:44:05.240125 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-54778aa3-b91f-4769-9040-7b50b942beb0 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:05.240841 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-54778aa3-b91f-4769-9040-7b50b942beb0 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: 5743a171-c0fe-4b66-a8a0-29ca894a002b] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:05.248553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54778aa3-b91f-4769-9040-7b50b942beb0 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:05.249016 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54778aa3-b91f-4769-9040-7b50b942beb0 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:05.249791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54778aa3-b91f-4769-9040-7b50b942beb0 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:05.250274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-54778aa3-b91f-4769-9040-7b50b942beb0 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:05.263941 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-54778aa3-b91f-4769-9040-7b50b942beb0 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] HTTP exception thrown: Instance 5743a171-c0fe-4b66-a8a0-29ca894a002b could not be found. Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-54778aa3-b91f-4769-9040-7b50b942beb0 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Request method failure captured: Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b HTTP/1.1 Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3p0zVSIM2UreUkUikCnAvL4djGCFm2w4z7jiMMoa85Swm_2mnYMLWpuqNlPDeY3LHhPYQT97_yWrDwupLRD6ifSR5i0Cy3wdv0mf5IPnEmugINCAXXgQdNbQ3tLlzq554eHcFnE3rzDc6C-Cyg3jsFln0akLX8dUpTQAnJjDKdl4pQc Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: aa9afc929da94c579e696ed23d1964d3 Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-TestMinimumBasicScenario-1802355901 Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aa9afc929da94c579e696ed23d1964d3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aa9afc929da94c579e696ed23d1964d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa9afc929da94c579e696ed23d1964d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa9afc929da94c579e696ed23d1964d3"}]}] Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-TestMinimumBasicScenario-1802355901 Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: aa9afc929da94c579e696ed23d1964d3 Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1802355901 Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-TestMinimumBasicScenario-1802355901-project Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: 114282760b914b30bf98a17b61b59569 Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-TestMinimumBasicScenario-1802355901-project Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 5743a171-c0fe-4b66-a8a0-29ca894a002b could not be found. Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '5743a171-c0fe-4b66-a8a0-29ca894a002b'} Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5743a171-c0fe-4b66-a8a0-29ca894a002b could not be found. Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5743a171-c0fe-4b66-a8a0-29ca894a002b could not be found. Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:44:05.265604 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:44:05.269647 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:44:05.269647 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:44:05.269647 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:44:05.269647 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:44:05.269647 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:44:05.269647 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5743a171-c0fe-4b66-a8a0-29ca894a002b could not be found. Jul 25 13:44:05.269647 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:44:05.269647 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-54778aa3-b91f-4769-9040-7b50b942beb0 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Returning 404 to user: Instance 5743a171-c0fe-4b66-a8a0-29ca894a002b could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:44:05.269647 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-54778aa3-b91f-4769-9040-7b50b942beb0 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b" status: 404 len: 111 microversion: 2.1 time: 0.031304 Jul 25 13:44:05.269647 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3384/6839] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:05 2022] GET /compute/v2.1/servers/5743a171-c0fe-4b66-a8a0-29ca894a002b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:44:05.276289 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c4d86598-60f4-484c-91f5-61b3d02e13e8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '.version_select at 0x7efcf8e755e0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:05.342242 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c4d86598-60f4-484c-91f5-61b3d02e13e8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-749825414" status: 202 len: 0 microversion: 2.1 time: 0.069730 Jul 25 13:44:05.342833 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3456/6840] 10.222.0.49 () {58 vars in 1269 bytes} [Mon Jul 25 13:44:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-749825414 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:44:14.209460 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-91fbf561-a98f-4ef6-9b3a-29fab770c4d6 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Action: 'create', calling method: .version_select at 0x7efcf8e163a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2040626073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIq0i4v6sZ57A9in+AOSRd92M5jYUSOtp2dWTWjVqJVmnHFXIW8ivXUTT8rleJ+TnPdmFtR6TB8QNRW+zg7Rq7ukENJwRkRKXlnEnv48fjuw1R8An5zp6YLK1/H6LwzVtg=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:44:14.226203 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-91fbf561-a98f-4ef6-9b3a-29fab770c4d6 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Getting quotas for project aa9afc929da94c579e696ed23d1964d3. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:44:14.233099 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-91fbf561-a98f-4ef6-9b3a-29fab770c4d6 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Getting quotas for user 114282760b914b30bf98a17b61b59569 and project aa9afc929da94c579e696ed23d1964d3. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:44:14.262283 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-91fbf561-a98f-4ef6-9b3a-29fab770c4d6 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.057259 Jul 25 13:44:14.262906 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3385/6841] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:44:14 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:44:14.314620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:44:14.318801 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f858a9b4-a0eb-4e9b-8bf0-de14712b40d3 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-701194437", "imageRef": "bbb23b6f-a4dd-403a-8b54-373935cd5ba0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2040626073", "networks": [{"uuid": "2cabf8a2-04e6-4930-93de-c78ecb08058a"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:44:14.372453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-f858a9b4-a0eb-4e9b-8bf0-de14712b40d3 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] validate_networks() for [('2cabf8a2-04e6-4930-93de-c78ecb08058a', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:44:14.817961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-f858a9b4-a0eb-4e9b-8bf0-de14712b40d3 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:44:14.818386 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-f858a9b4-a0eb-4e9b-8bf0-de14712b40d3 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:44:14.818866 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-f858a9b4-a0eb-4e9b-8bf0-de14712b40d3 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:44:14.819282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-f858a9b4-a0eb-4e9b-8bf0-de14712b40d3 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:44:14.819700 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-f858a9b4-a0eb-4e9b-8bf0-de14712b40d3 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:44:14.829524 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f858a9b4-a0eb-4e9b-8bf0-de14712b40d3 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:14.830019 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f858a9b4-a0eb-4e9b-8bf0-de14712b40d3 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:14.831149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f858a9b4-a0eb-4e9b-8bf0-de14712b40d3 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:14.831579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f858a9b4-a0eb-4e9b-8bf0-de14712b40d3 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:14.849388 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-f858a9b4-a0eb-4e9b-8bf0-de14712b40d3 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Getting quotas for project aa9afc929da94c579e696ed23d1964d3. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:44:14.855108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-f858a9b4-a0eb-4e9b-8bf0-de14712b40d3 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Getting quotas for user 114282760b914b30bf98a17b61b59569 and project aa9afc929da94c579e696ed23d1964d3. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:44:14.868530 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f858a9b4-a0eb-4e9b-8bf0-de14712b40d3 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:44:14.870788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f858a9b4-a0eb-4e9b-8bf0-de14712b40d3 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbb23b6f-a4dd-403a-8b54-373935cd5ba0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:44:14.918848 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f858a9b4-a0eb-4e9b-8bf0-de14712b40d3 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605977 Jul 25 13:44:14.919580 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3457/6842] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:44:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:44:14.933040 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-afc33e14-8798-41da-ab81-c6a2e61dd978 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:14.934225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-afc33e14-8798-41da-ab81-c6a2e61dd978 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:14.995362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-afc33e14-8798-41da-ab81-c6a2e61dd978 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:15.002608 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-afc33e14-8798-41da-ab81-c6a2e61dd978 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1258 microversion: 2.1 time: 0.075630 Jul 25 13:44:15.003181 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3386/6843] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:14 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1258 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:44:16.025190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dc0c39cf-36bf-4534-a76f-1633b6e1849f tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:16.026867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dc0c39cf-36bf-4534-a76f-1633b6e1849f tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:16.037355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc0c39cf-36bf-4534-a76f-1633b6e1849f tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:16.037806 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc0c39cf-36bf-4534-a76f-1633b6e1849f tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:16.038619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc0c39cf-36bf-4534-a76f-1633b6e1849f tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:16.039049 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc0c39cf-36bf-4534-a76f-1633b6e1849f tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:16.116590 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dc0c39cf-36bf-4534-a76f-1633b6e1849f tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:16.125694 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dc0c39cf-36bf-4534-a76f-1633b6e1849f tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1318 microversion: 2.1 time: 0.105050 Jul 25 13:44:16.138066 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3458/6844] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:16 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1318 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:44:17.148407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a8a286fc-2776-44e0-8573-5f102b316abf tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:17.149131 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a8a286fc-2776-44e0-8573-5f102b316abf tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:17.153600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:44:17.167848 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a8a286fc-2776-44e0-8573-5f102b316abf tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:17.168502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a8a286fc-2776-44e0-8573-5f102b316abf tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:17.169498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a8a286fc-2776-44e0-8573-5f102b316abf tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:17.170128 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a8a286fc-2776-44e0-8573-5f102b316abf tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:17.333934 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a8a286fc-2776-44e0-8573-5f102b316abf tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:17.342785 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a8a286fc-2776-44e0-8573-5f102b316abf tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1358 microversion: 2.1 time: 0.198166 Jul 25 13:44:17.353379 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3387/6845] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:17 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:44:18.366255 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-573d6e21-d87d-41c0-9ea9-6d9f94c9e3e1 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:18.366841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-573d6e21-d87d-41c0-9ea9-6d9f94c9e3e1 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:18.374428 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-573d6e21-d87d-41c0-9ea9-6d9f94c9e3e1 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:18.374815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-573d6e21-d87d-41c0-9ea9-6d9f94c9e3e1 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:18.375578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-573d6e21-d87d-41c0-9ea9-6d9f94c9e3e1 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:18.376005 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-573d6e21-d87d-41c0-9ea9-6d9f94c9e3e1 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:18.514779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-573d6e21-d87d-41c0-9ea9-6d9f94c9e3e1 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:18.523246 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-573d6e21-d87d-41c0-9ea9-6d9f94c9e3e1 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1358 microversion: 2.1 time: 0.161030 Jul 25 13:44:18.523927 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3459/6846] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:18 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:44:19.544995 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6fa7ffe3-5a58-45ca-b862-9f6577fed41c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:19.545542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6fa7ffe3-5a58-45ca-b862-9f6577fed41c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:19.553004 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6fa7ffe3-5a58-45ca-b862-9f6577fed41c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:19.553469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6fa7ffe3-5a58-45ca-b862-9f6577fed41c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:19.554306 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6fa7ffe3-5a58-45ca-b862-9f6577fed41c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:19.554750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6fa7ffe3-5a58-45ca-b862-9f6577fed41c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:19.719577 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6fa7ffe3-5a58-45ca-b862-9f6577fed41c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:19.727936 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6fa7ffe3-5a58-45ca-b862-9f6577fed41c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1358 microversion: 2.1 time: 0.186949 Jul 25 13:44:19.728541 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3388/6847] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:19 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:44:20.750163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-88203606-f18d-4138-9257-7400507216f4 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:20.750772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-88203606-f18d-4138-9257-7400507216f4 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:20.757944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88203606-f18d-4138-9257-7400507216f4 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:20.758396 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88203606-f18d-4138-9257-7400507216f4 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:20.759157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88203606-f18d-4138-9257-7400507216f4 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:20.759590 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-88203606-f18d-4138-9257-7400507216f4 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:20.906013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-88203606-f18d-4138-9257-7400507216f4 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:20.914611 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-88203606-f18d-4138-9257-7400507216f4 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1358 microversion: 2.1 time: 0.168359 Jul 25 13:44:20.915196 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3460/6848] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:20 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:44:21.936746 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a3257315-b0f8-45fb-b429-21d0bea56d53 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:21.937537 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a3257315-b0f8-45fb-b429-21d0bea56d53 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:21.939669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:44:21.946955 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a3257315-b0f8-45fb-b429-21d0bea56d53 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:21.947298 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a3257315-b0f8-45fb-b429-21d0bea56d53 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:21.948385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a3257315-b0f8-45fb-b429-21d0bea56d53 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:21.948912 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a3257315-b0f8-45fb-b429-21d0bea56d53 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:22.100408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a3257315-b0f8-45fb-b429-21d0bea56d53 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:22.109001 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a3257315-b0f8-45fb-b429-21d0bea56d53 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1358 microversion: 2.1 time: 0.177137 Jul 25 13:44:22.109867 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3389/6849] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:21 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:44:23.131290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4e3e0265-77a2-499a-931f-acb47f1678ea tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:23.132152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4e3e0265-77a2-499a-931f-acb47f1678ea tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:23.135038 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:44:23.141273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e3e0265-77a2-499a-931f-acb47f1678ea tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:23.141720 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e3e0265-77a2-499a-931f-acb47f1678ea tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:23.142555 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e3e0265-77a2-499a-931f-acb47f1678ea tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:23.142992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4e3e0265-77a2-499a-931f-acb47f1678ea tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:23.289103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4e3e0265-77a2-499a-931f-acb47f1678ea tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:23.299475 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4e3e0265-77a2-499a-931f-acb47f1678ea tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1358 microversion: 2.1 time: 0.172296 Jul 25 13:44:23.300410 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3461/6850] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:23 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:44:24.321115 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7da24bf5-f37b-41f4-a94a-bf4100ad8e1b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:24.321758 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7da24bf5-f37b-41f4-a94a-bf4100ad8e1b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:24.329273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7da24bf5-f37b-41f4-a94a-bf4100ad8e1b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:24.329742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7da24bf5-f37b-41f4-a94a-bf4100ad8e1b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:24.330936 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7da24bf5-f37b-41f4-a94a-bf4100ad8e1b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:24.331380 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7da24bf5-f37b-41f4-a94a-bf4100ad8e1b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:24.588512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7da24bf5-f37b-41f4-a94a-bf4100ad8e1b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:24.598829 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7da24bf5-f37b-41f4-a94a-bf4100ad8e1b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1358 microversion: 2.1 time: 0.281727 Jul 25 13:44:24.599525 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3390/6851] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:24 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1358 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:44:24.976172 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-3e28785b-4b16-40dc-9f27-6ab81eb8f575 req-83a0885c-dffb-45bf-b6db-3cb90546121a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa83aa1c-0814-4d11-83bd-2c5a878e093e", "tag": "9bf6f144-b617-408a-8347-1f95afdea4f8"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:44:24.988015 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:44:24.997816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:44:25.004069 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3e28785b-4b16-40dc-9f27-6ab81eb8f575 req-83a0885c-dffb-45bf-b6db-3cb90546121a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:25.004876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3e28785b-4b16-40dc-9f27-6ab81eb8f575 req-83a0885c-dffb-45bf-b6db-3cb90546121a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:25.021912 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-3e28785b-4b16-40dc-9f27-6ab81eb8f575 req-83a0885c-dffb-45bf-b6db-3cb90546121a service nova] Creating event network-changed:9bf6f144-b617-408a-8347-1f95afdea4f8 for instance aa83aa1c-0814-4d11-83bd-2c5a878e093e on n-h1-848886-15 Jul 25 13:44:25.027922 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-3e28785b-4b16-40dc-9f27-6ab81eb8f575 req-83a0885c-dffb-45bf-b6db-3cb90546121a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058144 Jul 25 13:44:25.028926 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3462/6852] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:44:25.620709 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4e4d8d28-0f46-48fe-8e4a-5ae2bedd4e13 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:25.621332 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4e4d8d28-0f46-48fe-8e4a-5ae2bedd4e13 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:25.623259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:44:25.629939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e4d8d28-0f46-48fe-8e4a-5ae2bedd4e13 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:25.630563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e4d8d28-0f46-48fe-8e4a-5ae2bedd4e13 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:25.631522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e4d8d28-0f46-48fe-8e4a-5ae2bedd4e13 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:25.631973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4e4d8d28-0f46-48fe-8e4a-5ae2bedd4e13 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:25.767056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4e4d8d28-0f46-48fe-8e4a-5ae2bedd4e13 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:25.776894 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4e4d8d28-0f46-48fe-8e4a-5ae2bedd4e13 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1358 microversion: 2.1 time: 0.160136 Jul 25 13:44:25.777494 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3391/6853] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:25 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:44:26.800596 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ec130c89-c0ec-4ab3-9ddc-ace021263495 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:26.801373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ec130c89-c0ec-4ab3-9ddc-ace021263495 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:26.809148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ec130c89-c0ec-4ab3-9ddc-ace021263495 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:26.809675 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ec130c89-c0ec-4ab3-9ddc-ace021263495 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:26.810615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ec130c89-c0ec-4ab3-9ddc-ace021263495 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:26.811131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ec130c89-c0ec-4ab3-9ddc-ace021263495 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:26.955251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ec130c89-c0ec-4ab3-9ddc-ace021263495 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:26.968867 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ec130c89-c0ec-4ab3-9ddc-ace021263495 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1358 microversion: 2.1 time: 0.173690 Jul 25 13:44:26.970892 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3463/6854] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:26 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:44:27.996796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0c3834dc-e100-40ad-97f7-c1ae916f2ca8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:27.997506 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0c3834dc-e100-40ad-97f7-c1ae916f2ca8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:28.007089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c3834dc-e100-40ad-97f7-c1ae916f2ca8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:28.007720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c3834dc-e100-40ad-97f7-c1ae916f2ca8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:28.008720 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c3834dc-e100-40ad-97f7-c1ae916f2ca8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:28.009280 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c3834dc-e100-40ad-97f7-c1ae916f2ca8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:28.160408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0c3834dc-e100-40ad-97f7-c1ae916f2ca8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:28.171262 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0c3834dc-e100-40ad-97f7-c1ae916f2ca8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1358 microversion: 2.1 time: 0.179473 Jul 25 13:44:28.172131 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3392/6855] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:27 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:44:29.194363 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8937603c-72ce-4c2b-a21b-c2502b107c8d tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:29.194968 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8937603c-72ce-4c2b-a21b-c2502b107c8d tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:29.202656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8937603c-72ce-4c2b-a21b-c2502b107c8d tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:29.203105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8937603c-72ce-4c2b-a21b-c2502b107c8d tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:29.203880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8937603c-72ce-4c2b-a21b-c2502b107c8d tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:29.204321 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8937603c-72ce-4c2b-a21b-c2502b107c8d tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:29.341008 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8937603c-72ce-4c2b-a21b-c2502b107c8d tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:29.348966 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8937603c-72ce-4c2b-a21b-c2502b107c8d tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1358 microversion: 2.1 time: 0.158573 Jul 25 13:44:29.349483 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3464/6856] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:29 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:44:30.369712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4b0ad982-52bb-49bd-a1eb-d47a336faafd tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:30.370347 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4b0ad982-52bb-49bd-a1eb-d47a336faafd tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:30.377783 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b0ad982-52bb-49bd-a1eb-d47a336faafd tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:30.378228 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b0ad982-52bb-49bd-a1eb-d47a336faafd tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:30.379014 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b0ad982-52bb-49bd-a1eb-d47a336faafd tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:30.379461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b0ad982-52bb-49bd-a1eb-d47a336faafd tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:30.525109 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4b0ad982-52bb-49bd-a1eb-d47a336faafd tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:30.532886 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4b0ad982-52bb-49bd-a1eb-d47a336faafd tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1358 microversion: 2.1 time: 0.167182 Jul 25 13:44:30.533436 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3393/6857] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:30 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:44:31.465133 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-5a92dcea-110c-4a63-b7ca-952a219ea05e req-9b633c44-b761-4496-8f70-bb4f9937124b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa83aa1c-0814-4d11-83bd-2c5a878e093e", "name": "network-vif-plugged", "status": "completed", "tag": "9bf6f144-b617-408a-8347-1f95afdea4f8"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:44:31.475020 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5a92dcea-110c-4a63-b7ca-952a219ea05e req-9b633c44-b761-4496-8f70-bb4f9937124b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:31.475466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5a92dcea-110c-4a63-b7ca-952a219ea05e req-9b633c44-b761-4496-8f70-bb4f9937124b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:31.489746 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-5a92dcea-110c-4a63-b7ca-952a219ea05e req-9b633c44-b761-4496-8f70-bb4f9937124b service nova] Creating event network-vif-plugged:9bf6f144-b617-408a-8347-1f95afdea4f8 for instance aa83aa1c-0814-4d11-83bd-2c5a878e093e on n-h1-848886-15 Jul 25 13:44:31.495758 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-5a92dcea-110c-4a63-b7ca-952a219ea05e req-9b633c44-b761-4496-8f70-bb4f9937124b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094880 Jul 25 13:44:31.496377 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3465/6858] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:44:31.555224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5e5818bc-e4f2-40a9-853d-435665066e44 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:31.555881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5e5818bc-e4f2-40a9-853d-435665066e44 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:31.563357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5e5818bc-e4f2-40a9-853d-435665066e44 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:31.563830 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5e5818bc-e4f2-40a9-853d-435665066e44 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:31.564629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5e5818bc-e4f2-40a9-853d-435665066e44 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:31.565257 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5e5818bc-e4f2-40a9-853d-435665066e44 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:31.726518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5e5818bc-e4f2-40a9-853d-435665066e44 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:31.735049 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5e5818bc-e4f2-40a9-853d-435665066e44 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1358 microversion: 2.1 time: 0.186076 Jul 25 13:44:31.735616 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3394/6859] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:31 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:44:32.762899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f34f9eb0-1285-4b3f-bba7-b627cd4017a2 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:32.763820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f34f9eb0-1285-4b3f-bba7-b627cd4017a2 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:32.773085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f34f9eb0-1285-4b3f-bba7-b627cd4017a2 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:32.773726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f34f9eb0-1285-4b3f-bba7-b627cd4017a2 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:32.775532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f34f9eb0-1285-4b3f-bba7-b627cd4017a2 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:32.775532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f34f9eb0-1285-4b3f-bba7-b627cd4017a2 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:32.913564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f34f9eb0-1285-4b3f-bba7-b627cd4017a2 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:32.921650 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f34f9eb0-1285-4b3f-bba7-b627cd4017a2 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1547 microversion: 2.1 time: 0.165829 Jul 25 13:44:32.922278 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3466/6860] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:32 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1547 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:44:32.950749 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d74a8efa-b948-41c4-b5df-14fdf64b0802 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:32.951378 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d74a8efa-b948-41c4-b5df-14fdf64b0802 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:32.959133 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d74a8efa-b948-41c4-b5df-14fdf64b0802 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:32.959803 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d74a8efa-b948-41c4-b5df-14fdf64b0802 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:32.960566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d74a8efa-b948-41c4-b5df-14fdf64b0802 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:32.961039 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d74a8efa-b948-41c4-b5df-14fdf64b0802 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:33.109570 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d74a8efa-b948-41c4-b5df-14fdf64b0802 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:33.117443 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d74a8efa-b948-41c4-b5df-14fdf64b0802 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1547 microversion: 2.1 time: 0.170656 Jul 25 13:44:33.118053 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3395/6861] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:32 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1547 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:44:33.138026 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-00d5533d-22dd-49f0-80c7-d85f1c3d0f7c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:33.142787 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-00d5533d-22dd-49f0-80c7-d85f1c3d0f7c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:33.143586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-00d5533d-22dd-49f0-80c7-d85f1c3d0f7c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Searching by: {'deleted': False, 'project_id': 'aa9afc929da94c579e696ed23d1964d3'} {{(pid=125884) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 13:44:33.149753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-00d5533d-22dd-49f0-80c7-d85f1c3d0f7c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:33.150262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-00d5533d-22dd-49f0-80c7-d85f1c3d0f7c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:33.151092 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-00d5533d-22dd-49f0-80c7-d85f1c3d0f7c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:33.151532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-00d5533d-22dd-49f0-80c7-d85f1c3d0f7c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:33.177374 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.multi_cell_list [None req-00d5533d-22dd-49f0-80c7-d85f1c3d0f7c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 13:44:33.206969 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-00d5533d-22dd-49f0-80c7-d85f1c3d0f7c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.072911 Jul 25 13:44:33.207561 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3467/6862] 10.222.0.49 () {58 vars in 1125 bytes} [Mon Jul 25 13:44:33 2022] GET /compute/v2.1/servers => generated 342 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:44:33.222381 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-22a2c09c-d0c4-40ff-a643-dd905f11453f tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:33.223343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-22a2c09c-d0c4-40ff-a643-dd905f11453f tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:33.233198 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22a2c09c-d0c4-40ff-a643-dd905f11453f tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:33.233900 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22a2c09c-d0c4-40ff-a643-dd905f11453f tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:33.235080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22a2c09c-d0c4-40ff-a643-dd905f11453f tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:33.235751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22a2c09c-d0c4-40ff-a643-dd905f11453f tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:33.373809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-22a2c09c-d0c4-40ff-a643-dd905f11453f tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:33.381900 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-22a2c09c-d0c4-40ff-a643-dd905f11453f tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1547 microversion: 2.1 time: 0.165971 Jul 25 13:44:33.382541 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3396/6863] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:33 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1547 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:44:34.909614 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e74140fa-e1bf-4e5a-bff0-e3744cafd133 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e40e630a-a645-4f9c-af21-7eb7cdea8a16"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:44:34.912402 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e74140fa-e1bf-4e5a-bff0-e3744cafd133 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:34.919751 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e74140fa-e1bf-4e5a-bff0-e3744cafd133 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:34.920201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e74140fa-e1bf-4e5a-bff0-e3744cafd133 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:34.920960 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e74140fa-e1bf-4e5a-bff0-e3744cafd133 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:34.921405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e74140fa-e1bf-4e5a-bff0-e3744cafd133 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:35.178682 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e74140fa-e1bf-4e5a-bff0-e3744cafd133 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "POST /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273149 Jul 25 13:44:35.179328 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3468/6864] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Jul 25 13:44:34 2022] POST /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:44:37.981527 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:44:37.982141 n-d-848886-15 devstack@n-api.service[125883]: Mon Jul 25 13:44:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:44:46.055380 n-d-848886-15 devstack@n-api.service[125883]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6a05e146-f3af-4d5e-94b9-7bc7c984fd44] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 13:44:46.059105 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c98a66f2-7d22-4722-b693-0581d14d3202 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:46.059743 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c98a66f2-7d22-4722-b693-0581d14d3202 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:46.062540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=15 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:44:46.063256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=60 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:44:46.069857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c98a66f2-7d22-4722-b693-0581d14d3202 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:46.070402 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c98a66f2-7d22-4722-b693-0581d14d3202 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:46.071265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c98a66f2-7d22-4722-b693-0581d14d3202 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:46.071724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c98a66f2-7d22-4722-b693-0581d14d3202 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:46.215788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c98a66f2-7d22-4722-b693-0581d14d3202 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:46.226963 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c98a66f2-7d22-4722-b693-0581d14d3202 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1593 microversion: 2.1 time: 0.173034 Jul 25 13:44:46.227552 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3397/6865] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:46 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1593 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:44:48.215118 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:44:48.215888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=15 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:44:48.216622 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:44:48.220899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-3aac2c7e-a033-4913-a03c-0bcae208ee4e req-13630cf2-fb12-427c-85cd-314dac5934f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa83aa1c-0814-4d11-83bd-2c5a878e093e", "tag": "9bf6f144-b617-408a-8347-1f95afdea4f8"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:44:48.232775 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3aac2c7e-a033-4913-a03c-0bcae208ee4e req-13630cf2-fb12-427c-85cd-314dac5934f2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:48.233214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-3aac2c7e-a033-4913-a03c-0bcae208ee4e req-13630cf2-fb12-427c-85cd-314dac5934f2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:48.245935 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-3aac2c7e-a033-4913-a03c-0bcae208ee4e req-13630cf2-fb12-427c-85cd-314dac5934f2 service nova] Creating event network-changed:9bf6f144-b617-408a-8347-1f95afdea4f8 for instance aa83aa1c-0814-4d11-83bd-2c5a878e093e on n-h1-848886-15 Jul 25 13:44:48.251254 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-3aac2c7e-a033-4913-a03c-0bcae208ee4e req-13630cf2-fb12-427c-85cd-314dac5934f2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037838 Jul 25 13:44:48.251895 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3469/6866] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:44:49.325036 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dbad5b20-7056-488a-b4dc-c5057bc96c42 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1008559924"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:44:49.325607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dbad5b20-7056-488a-b4dc-c5057bc96c42 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:49.338586 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] [6a05e146-f3af-4d5e-94b9-7bc7c984fd44] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 47328. Jul 25 13:44:49.341064 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbad5b20-7056-488a-b4dc-c5057bc96c42 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:49.341527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbad5b20-7056-488a-b4dc-c5057bc96c42 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:49.342368 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbad5b20-7056-488a-b4dc-c5057bc96c42 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:49.342821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dbad5b20-7056-488a-b4dc-c5057bc96c42 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:49.470747 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.network.security_group_api [None req-dbad5b20-7056-488a-b4dc-c5057bc96c42 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Adding security group 030115bb-119e-4861-abaa-e2000e0c52d7 to port 9bf6f144-b617-408a-8347-1f95afdea4f8 Jul 25 13:44:49.839134 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dbad5b20-7056-488a-b4dc-c5057bc96c42 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "POST /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/action" status: 202 len: 0 microversion: 2.1 time: 0.518344 Jul 25 13:44:49.840007 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3398/6867] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:44:49 2022] POST /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:44:49.852013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ff94bce0-8e21-467d-8837-b813b1464553 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:44:49.852013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ff94bce0-8e21-467d-8837-b813b1464553 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:44:49.859413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff94bce0-8e21-467d-8837-b813b1464553 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:49.859950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff94bce0-8e21-467d-8837-b813b1464553 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:49.860796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff94bce0-8e21-467d-8837-b813b1464553 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:49.861231 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ff94bce0-8e21-467d-8837-b813b1464553 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:50.041251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ff94bce0-8e21-467d-8837-b813b1464553 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:44:50.050742 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ff94bce0-8e21-467d-8837-b813b1464553 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1759 microversion: 2.1 time: 0.205375 Jul 25 13:44:50.051662 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3470/6868] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:44:49 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1759 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:44:50.267072 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-e13063a0-8db1-4043-9c15-e38b41204f2b req-dc069e08-39d9-48d1-8e54-a126843ad977 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa83aa1c-0814-4d11-83bd-2c5a878e093e", "tag": "9bf6f144-b617-408a-8347-1f95afdea4f8"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:44:50.277010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e13063a0-8db1-4043-9c15-e38b41204f2b req-dc069e08-39d9-48d1-8e54-a126843ad977 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:44:50.277727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e13063a0-8db1-4043-9c15-e38b41204f2b req-dc069e08-39d9-48d1-8e54-a126843ad977 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:44:50.290020 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-e13063a0-8db1-4043-9c15-e38b41204f2b req-dc069e08-39d9-48d1-8e54-a126843ad977 service nova] Creating event network-changed:9bf6f144-b617-408a-8347-1f95afdea4f8 for instance aa83aa1c-0814-4d11-83bd-2c5a878e093e on n-h1-848886-15 Jul 25 13:44:50.296280 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-e13063a0-8db1-4043-9c15-e38b41204f2b req-dc069e08-39d9-48d1-8e54-a126843ad977 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032949 Jul 25 13:44:50.297206 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3399/6869] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:45:06.891372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1a6d11b3-df31-4113-892b-e699c35cb47c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:45:06.893709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1a6d11b3-df31-4113-892b-e699c35cb47c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:45:06.897483 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:45:06.898167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=8 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:45:06.905324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a6d11b3-df31-4113-892b-e699c35cb47c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:06.905775 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a6d11b3-df31-4113-892b-e699c35cb47c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:06.906587 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a6d11b3-df31-4113-892b-e699c35cb47c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:06.907014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1a6d11b3-df31-4113-892b-e699c35cb47c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:06.986832 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1a6d11b3-df31-4113-892b-e699c35cb47c tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "POST /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/action" status: 202 len: 0 microversion: 2.1 time: 0.099326 Jul 25 13:45:06.987844 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3471/6870] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:45:06 2022] POST /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:45:06.994751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:45:06.995534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=12 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:45:07.000021 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d4384187-b69f-4071-87dc-9ea967577094 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:45:07.000743 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d4384187-b69f-4071-87dc-9ea967577094 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:45:07.010078 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4384187-b69f-4071-87dc-9ea967577094 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:07.010745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4384187-b69f-4071-87dc-9ea967577094 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:07.011896 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4384187-b69f-4071-87dc-9ea967577094 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:07.012350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d4384187-b69f-4071-87dc-9ea967577094 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:07.238184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d4384187-b69f-4071-87dc-9ea967577094 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:45:07.246901 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d4384187-b69f-4071-87dc-9ea967577094 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1751 microversion: 2.1 time: 0.254279 Jul 25 13:45:07.247491 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3400/6871] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:45:06 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1751 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:45:08.273205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b7ff7786-c3cf-4443-a920-5e5ccb8ed9a8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:45:08.274354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b7ff7786-c3cf-4443-a920-5e5ccb8ed9a8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:45:08.286335 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7ff7786-c3cf-4443-a920-5e5ccb8ed9a8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:08.286785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7ff7786-c3cf-4443-a920-5e5ccb8ed9a8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:08.287552 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7ff7786-c3cf-4443-a920-5e5ccb8ed9a8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:08.287985 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b7ff7786-c3cf-4443-a920-5e5ccb8ed9a8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:08.444774 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b7ff7786-c3cf-4443-a920-5e5ccb8ed9a8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:45:08.457865 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b7ff7786-c3cf-4443-a920-5e5ccb8ed9a8 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1756 microversion: 2.1 time: 0.191458 Jul 25 13:45:08.458462 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3472/6872] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:45:08 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:45:09.480260 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-22df638a-a610-48b4-9d96-49aa1a20e4e5 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:45:09.480845 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-22df638a-a610-48b4-9d96-49aa1a20e4e5 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:45:09.488706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22df638a-a610-48b4-9d96-49aa1a20e4e5 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:09.489454 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22df638a-a610-48b4-9d96-49aa1a20e4e5 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:09.490820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22df638a-a610-48b4-9d96-49aa1a20e4e5 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:09.491497 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-22df638a-a610-48b4-9d96-49aa1a20e4e5 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:09.651691 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-22df638a-a610-48b4-9d96-49aa1a20e4e5 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:45:09.662903 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-22df638a-a610-48b4-9d96-49aa1a20e4e5 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1756 microversion: 2.1 time: 0.186812 Jul 25 13:45:09.663489 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3401/6873] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:45:09 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:45:10.746725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-76cd6a28-216c-4554-afb4-484c6428ff83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:45:10.747345 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-76cd6a28-216c-4554-afb4-484c6428ff83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:45:10.753808 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76cd6a28-216c-4554-afb4-484c6428ff83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:10.754300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76cd6a28-216c-4554-afb4-484c6428ff83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:10.755066 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76cd6a28-216c-4554-afb4-484c6428ff83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:10.755503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-76cd6a28-216c-4554-afb4-484c6428ff83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:10.903257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-76cd6a28-216c-4554-afb4-484c6428ff83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:45:10.911999 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-76cd6a28-216c-4554-afb4-484c6428ff83 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1756 microversion: 2.1 time: 0.230057 Jul 25 13:45:10.912548 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3473/6874] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:45:10 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1756 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:45:11.937499 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2c61168d-8a49-483b-96f9-ddad306a40ff tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:45:11.938400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2c61168d-8a49-483b-96f9-ddad306a40ff tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:45:11.947232 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c61168d-8a49-483b-96f9-ddad306a40ff tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:11.947702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c61168d-8a49-483b-96f9-ddad306a40ff tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:11.948490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c61168d-8a49-483b-96f9-ddad306a40ff tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:11.948944 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2c61168d-8a49-483b-96f9-ddad306a40ff tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:12.123182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2c61168d-8a49-483b-96f9-ddad306a40ff tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:45:12.131220 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2c61168d-8a49-483b-96f9-ddad306a40ff tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1756 microversion: 2.1 time: 0.200463 Jul 25 13:45:12.131843 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3402/6875] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:45:11 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1756 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:45:13.154712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-20426f81-7e9e-4d02-bd69-997cbdfa7018 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:45:13.155334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-20426f81-7e9e-4d02-bd69-997cbdfa7018 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:45:13.162813 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20426f81-7e9e-4d02-bd69-997cbdfa7018 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:13.163268 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20426f81-7e9e-4d02-bd69-997cbdfa7018 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:13.164706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20426f81-7e9e-4d02-bd69-997cbdfa7018 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:13.165152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-20426f81-7e9e-4d02-bd69-997cbdfa7018 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:13.310132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-20426f81-7e9e-4d02-bd69-997cbdfa7018 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:45:13.318682 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-20426f81-7e9e-4d02-bd69-997cbdfa7018 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1756 microversion: 2.1 time: 0.168002 Jul 25 13:45:13.319237 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3474/6876] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:45:13 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:45:14.343469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4745f05d-665a-4fff-a49b-a2940b8ff54b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:45:14.344358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4745f05d-665a-4fff-a49b-a2940b8ff54b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:45:14.354755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4745f05d-665a-4fff-a49b-a2940b8ff54b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:14.355399 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4745f05d-665a-4fff-a49b-a2940b8ff54b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:14.356547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4745f05d-665a-4fff-a49b-a2940b8ff54b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:14.357190 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4745f05d-665a-4fff-a49b-a2940b8ff54b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:14.514268 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4745f05d-665a-4fff-a49b-a2940b8ff54b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:45:14.522593 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4745f05d-665a-4fff-a49b-a2940b8ff54b tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1756 microversion: 2.1 time: 0.184783 Jul 25 13:45:14.523174 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3403/6877] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:45:14 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:45:15.548467 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d9504110-43d7-421c-87fb-d459487912fd tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:45:15.549312 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d9504110-43d7-421c-87fb-d459487912fd tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:45:15.560513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9504110-43d7-421c-87fb-d459487912fd tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:15.561262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9504110-43d7-421c-87fb-d459487912fd tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:15.562576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9504110-43d7-421c-87fb-d459487912fd tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:15.563299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d9504110-43d7-421c-87fb-d459487912fd tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:15.724152 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d9504110-43d7-421c-87fb-d459487912fd tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:45:15.732464 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d9504110-43d7-421c-87fb-d459487912fd tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1756 microversion: 2.1 time: 0.190916 Jul 25 13:45:15.733042 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3475/6878] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:45:15 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:45:16.759424 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bf5654a7-2448-4fb6-9c25-5230e502d353 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:45:16.760457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bf5654a7-2448-4fb6-9c25-5230e502d353 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:45:16.771565 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf5654a7-2448-4fb6-9c25-5230e502d353 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:16.772027 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf5654a7-2448-4fb6-9c25-5230e502d353 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:16.772808 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf5654a7-2448-4fb6-9c25-5230e502d353 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:16.773258 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf5654a7-2448-4fb6-9c25-5230e502d353 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:16.922335 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bf5654a7-2448-4fb6-9c25-5230e502d353 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:45:16.932040 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bf5654a7-2448-4fb6-9c25-5230e502d353 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1756 microversion: 2.1 time: 0.179897 Jul 25 13:45:16.932623 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3404/6879] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:45:16 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:45:17.957934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3ec9ef81-ad34-412c-b8cd-9f1f72c11974 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:45:17.958790 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3ec9ef81-ad34-412c-b8cd-9f1f72c11974 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:45:17.970866 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ec9ef81-ad34-412c-b8cd-9f1f72c11974 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:17.971606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ec9ef81-ad34-412c-b8cd-9f1f72c11974 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:17.972872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ec9ef81-ad34-412c-b8cd-9f1f72c11974 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:17.973515 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3ec9ef81-ad34-412c-b8cd-9f1f72c11974 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:18.131250 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3ec9ef81-ad34-412c-b8cd-9f1f72c11974 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:45:18.139755 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3ec9ef81-ad34-412c-b8cd-9f1f72c11974 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1756 microversion: 2.1 time: 0.188754 Jul 25 13:45:18.140293 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3476/6880] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:45:17 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:45:19.163620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b6626c9a-66c9-45cc-a183-e6e205ce7617 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:45:19.164509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b6626c9a-66c9-45cc-a183-e6e205ce7617 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:45:19.175619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b6626c9a-66c9-45cc-a183-e6e205ce7617 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:19.176227 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b6626c9a-66c9-45cc-a183-e6e205ce7617 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:19.177181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b6626c9a-66c9-45cc-a183-e6e205ce7617 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:19.177626 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b6626c9a-66c9-45cc-a183-e6e205ce7617 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:19.335363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b6626c9a-66c9-45cc-a183-e6e205ce7617 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:45:19.348576 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b6626c9a-66c9-45cc-a183-e6e205ce7617 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1759 microversion: 2.1 time: 0.190712 Jul 25 13:45:19.349179 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3405/6881] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:45:19 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1759 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:45:51.808749 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c11a6d71-447d-4194-9928-ca87ee5e67ef tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1008559924"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:45:51.809656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c11a6d71-447d-4194-9928-ca87ee5e67ef tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:45:51.813214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=12 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:45:51.814308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:45:51.824081 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c11a6d71-447d-4194-9928-ca87ee5e67ef tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:51.824829 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c11a6d71-447d-4194-9928-ca87ee5e67ef tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:51.825769 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c11a6d71-447d-4194-9928-ca87ee5e67ef tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:51.826253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c11a6d71-447d-4194-9928-ca87ee5e67ef tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:51.978433 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.network.security_group_api [None req-c11a6d71-447d-4194-9928-ca87ee5e67ef tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Removing security group 030115bb-119e-4861-abaa-e2000e0c52d7 from port 9bf6f144-b617-408a-8347-1f95afdea4f8 Jul 25 13:45:52.351828 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c11a6d71-447d-4194-9928-ca87ee5e67ef tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "POST /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/action" status: 202 len: 0 microversion: 2.1 time: 0.550947 Jul 25 13:45:52.358453 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3477/6882] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:45:51 2022] POST /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/action => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:45:52.372088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-72374dd2-7c2f-4ba0-b960-26f96c8dafa6 req-89c8144f-1f31-489b-bc0c-394767318782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa83aa1c-0814-4d11-83bd-2c5a878e093e", "tag": "9bf6f144-b617-408a-8347-1f95afdea4f8"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:45:52.392232 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=12 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:45:52.393645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=36 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:45:52.405680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-72374dd2-7c2f-4ba0-b960-26f96c8dafa6 req-89c8144f-1f31-489b-bc0c-394767318782 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:52.406551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-72374dd2-7c2f-4ba0-b960-26f96c8dafa6 req-89c8144f-1f31-489b-bc0c-394767318782 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:52.436168 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-72374dd2-7c2f-4ba0-b960-26f96c8dafa6 req-89c8144f-1f31-489b-bc0c-394767318782 service nova] Creating event network-changed:9bf6f144-b617-408a-8347-1f95afdea4f8 for instance aa83aa1c-0814-4d11-83bd-2c5a878e093e on n-h1-848886-15 Jul 25 13:45:52.463233 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-72374dd2-7c2f-4ba0-b960-26f96c8dafa6 req-89c8144f-1f31-489b-bc0c-394767318782 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099588 Jul 25 13:45:52.474575 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3406/6883] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:45:54.144776 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-52d54b15-2a06-4fae-91fc-2457a57cb94e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:45:54.145620 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-52d54b15-2a06-4fae-91fc-2457a57cb94e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:45:54.152711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-52d54b15-2a06-4fae-91fc-2457a57cb94e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:54.153148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-52d54b15-2a06-4fae-91fc-2457a57cb94e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:54.153978 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-52d54b15-2a06-4fae-91fc-2457a57cb94e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:54.154392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-52d54b15-2a06-4fae-91fc-2457a57cb94e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:54.261377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-52d54b15-2a06-4fae-91fc-2457a57cb94e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lazy-loading 'services' on Instance uuid aa83aa1c-0814-4d11-83bd-2c5a878e093e {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:45:54.341130 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-52d54b15-2a06-4fae-91fc-2457a57cb94e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "DELETE /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/os-volume_attachments/e40e630a-a645-4f9c-af21-7eb7cdea8a16" status: 202 len: 0 microversion: 2.1 time: 0.201388 Jul 25 13:45:54.342050 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3478/6884] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Jul 25 13:45:54 2022] DELETE /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/os-volume_attachments/e40e630a-a645-4f9c-af21-7eb7cdea8a16 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 13:45:54.358440 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aaabe661-9959-462a-b739-0beb339d28ba tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:45:54.362205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-aaabe661-9959-462a-b739-0beb339d28ba tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:45:54.375372 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aaabe661-9959-462a-b739-0beb339d28ba tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:54.376190 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aaabe661-9959-462a-b739-0beb339d28ba tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:54.377611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aaabe661-9959-462a-b739-0beb339d28ba tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:54.378401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aaabe661-9959-462a-b739-0beb339d28ba tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:54.433394 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aaabe661-9959-462a-b739-0beb339d28ba tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083949 Jul 25 13:45:54.437976 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3407/6885] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:45:54 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:45:54.493576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-b3f02a20-b02a-4b0d-8a96-67304ec905aa req-b07c0b9f-b39f-4347-b325-6f6c60b76300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa83aa1c-0814-4d11-83bd-2c5a878e093e", "tag": "9bf6f144-b617-408a-8347-1f95afdea4f8"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:45:54.503587 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b3f02a20-b02a-4b0d-8a96-67304ec905aa req-b07c0b9f-b39f-4347-b325-6f6c60b76300 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:54.504303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b3f02a20-b02a-4b0d-8a96-67304ec905aa req-b07c0b9f-b39f-4347-b325-6f6c60b76300 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:54.515633 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-b3f02a20-b02a-4b0d-8a96-67304ec905aa req-b07c0b9f-b39f-4347-b325-6f6c60b76300 service nova] Creating event network-changed:9bf6f144-b617-408a-8347-1f95afdea4f8 for instance aa83aa1c-0814-4d11-83bd-2c5a878e093e on n-h1-848886-15 Jul 25 13:45:54.520816 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-b3f02a20-b02a-4b0d-8a96-67304ec905aa req-b07c0b9f-b39f-4347-b325-6f6c60b76300 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031920 Jul 25 13:45:54.521648 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3479/6886] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:45:55.453373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-16d3cbd0-1ca5-437c-a321-496159a5818e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:45:55.456083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-16d3cbd0-1ca5-437c-a321-496159a5818e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:45:55.464304 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16d3cbd0-1ca5-437c-a321-496159a5818e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:55.464783 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16d3cbd0-1ca5-437c-a321-496159a5818e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:55.465815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16d3cbd0-1ca5-437c-a321-496159a5818e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:55.466294 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-16d3cbd0-1ca5-437c-a321-496159a5818e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:55.498457 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-16d3cbd0-1ca5-437c-a321-496159a5818e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049620 Jul 25 13:45:55.499096 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3408/6887] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:45:55 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:45:56.512451 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-132659f7-b4fe-4c37-abdc-0b1464483b3a tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:45:56.514989 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-132659f7-b4fe-4c37-abdc-0b1464483b3a tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:45:56.521857 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-132659f7-b4fe-4c37-abdc-0b1464483b3a tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:56.522346 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-132659f7-b4fe-4c37-abdc-0b1464483b3a tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:56.523148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-132659f7-b4fe-4c37-abdc-0b1464483b3a tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:56.523621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-132659f7-b4fe-4c37-abdc-0b1464483b3a tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:56.556365 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-132659f7-b4fe-4c37-abdc-0b1464483b3a tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049160 Jul 25 13:45:56.556916 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3480/6888] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:45:56 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:45:57.571848 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-89f6c5da-aea2-4862-bba3-cd80b35c733a tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:45:57.574828 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-89f6c5da-aea2-4862-bba3-cd80b35c733a tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:45:57.585059 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89f6c5da-aea2-4862-bba3-cd80b35c733a tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:57.585822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89f6c5da-aea2-4862-bba3-cd80b35c733a tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:57.587261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89f6c5da-aea2-4862-bba3-cd80b35c733a tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:57.588034 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-89f6c5da-aea2-4862-bba3-cd80b35c733a tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:57.627536 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-89f6c5da-aea2-4862-bba3-cd80b35c733a tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061247 Jul 25 13:45:57.629708 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3409/6889] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:45:57 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:45:58.647660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-57211fa3-f468-4bc4-916a-08197ce73f95 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:45:58.650226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-57211fa3-f468-4bc4-916a-08197ce73f95 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:45:58.659253 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57211fa3-f468-4bc4-916a-08197ce73f95 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:58.659697 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57211fa3-f468-4bc4-916a-08197ce73f95 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:58.660526 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57211fa3-f468-4bc4-916a-08197ce73f95 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:58.660970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-57211fa3-f468-4bc4-916a-08197ce73f95 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:58.694451 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-57211fa3-f468-4bc4-916a-08197ce73f95 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055704 Jul 25 13:45:58.695138 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3481/6890] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:45:58 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:45:59.708702 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-067753d7-ab5f-4b3d-b7a2-2d2d2def7e6d tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:45:59.711047 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-067753d7-ab5f-4b3d-b7a2-2d2d2def7e6d tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:45:59.718954 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-067753d7-ab5f-4b3d-b7a2-2d2d2def7e6d tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:59.719509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-067753d7-ab5f-4b3d-b7a2-2d2d2def7e6d tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:59.720314 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-067753d7-ab5f-4b3d-b7a2-2d2d2def7e6d tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:59.720774 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-067753d7-ab5f-4b3d-b7a2-2d2d2def7e6d tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:59.755296 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-067753d7-ab5f-4b3d-b7a2-2d2d2def7e6d tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051162 Jul 25 13:45:59.755885 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3410/6891] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Jul 25 13:45:59 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 13:45:59.766592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5a3a2a87-733a-4ce2-a3a1-399f50dbf20e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:45:59.767144 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5a3a2a87-733a-4ce2-a3a1-399f50dbf20e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:45:59.774235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a3a2a87-733a-4ce2-a3a1-399f50dbf20e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:59.774691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a3a2a87-733a-4ce2-a3a1-399f50dbf20e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:59.775474 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a3a2a87-733a-4ce2-a3a1-399f50dbf20e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:45:59.775916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a3a2a87-733a-4ce2-a3a1-399f50dbf20e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:45:59.854635 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-5a3a2a87-733a-4ce2-a3a1-399f50dbf20e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] HTTP exception thrown: Instance aa83aa1c-0814-4d11-83bd-2c5a878e093e is not attached to volume e40e630a-a645-4f9c-af21-7eb7cdea8a16 Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5a3a2a87-733a-4ce2-a3a1-399f50dbf20e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Request method failure captured: Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: request: DELETE /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/os-volume_attachments/e40e630a-a645-4f9c-af21-7eb7cdea8a16 HTTP/1.1 Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3p0zVSIM2UreUkUikCnAvL4djGCFm2w4z7jiMMoa85Swm_2mnYMLWpuqNlPDeY3LHhPYQT97_yWrDwupLRD6ifSR5i0Cy3wdv0mf5IPnEmugINCAXXgQdNbQ3tLlzq554eHcFnE3rzDc6C-Cyg3jsFln0akLX8dUpTQAnJjDKdl4pQc Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: aa9afc929da94c579e696ed23d1964d3 Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestMinimumBasicScenario-1802355901 Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aa9afc929da94c579e696ed23d1964d3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aa9afc929da94c579e696ed23d1964d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa9afc929da94c579e696ed23d1964d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa9afc929da94c579e696ed23d1964d3"}]}] Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestMinimumBasicScenario-1802355901 Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: aa9afc929da94c579e696ed23d1964d3 Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1802355901 Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestMinimumBasicScenario-1802355901-project Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 114282760b914b30bf98a17b61b59569 Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestMinimumBasicScenario-1802355901-project Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance aa83aa1c-0814-4d11-83bd-2c5a878e093e is not attached to volume e40e630a-a645-4f9c-af21-7eb7cdea8a16 Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'server_id': 'aa83aa1c-0814-4d11-83bd-2c5a878e093e', 'id': 'e40e630a-a645-4f9c-af21-7eb7cdea8a16'} Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e40e630a-a645-4f9c-af21-7eb7cdea8a16. Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa83aa1c-0814-4d11-83bd-2c5a878e093e is not attached to volume e40e630a-a645-4f9c-af21-7eb7cdea8a16 Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:45:59.856293 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:45:59.860246 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:45:59.860246 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:45:59.860246 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa83aa1c-0814-4d11-83bd-2c5a878e093e is not attached to volume e40e630a-a645-4f9c-af21-7eb7cdea8a16 Jul 25 13:45:59.860246 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:45:59.860246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5a3a2a87-733a-4ce2-a3a1-399f50dbf20e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Returning 404 to user: Instance aa83aa1c-0814-4d11-83bd-2c5a878e093e is not attached to volume e40e630a-a645-4f9c-af21-7eb7cdea8a16 {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:45:59.860246 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5a3a2a87-733a-4ce2-a3a1-399f50dbf20e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "DELETE /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/os-volume_attachments/e40e630a-a645-4f9c-af21-7eb7cdea8a16" status: 404 len: 154 microversion: 2.1 time: 0.095291 Jul 25 13:45:59.860246 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3482/6892] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Jul 25 13:45:59 2022] DELETE /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e/os-volume_attachments/e40e630a-a645-4f9c-af21-7eb7cdea8a16 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:46:03.114493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8b5ddba7-2975-4366-a010-7b348153c288 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:46:03.115008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8b5ddba7-2975-4366-a010-7b348153c288 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:46:03.124511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b5ddba7-2975-4366-a010-7b348153c288 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:03.124982 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b5ddba7-2975-4366-a010-7b348153c288 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:03.125776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b5ddba7-2975-4366-a010-7b348153c288 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:03.126270 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b5ddba7-2975-4366-a010-7b348153c288 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:03.152970 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8b5ddba7-2975-4366-a010-7b348153c288 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:46:03.238763 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8b5ddba7-2975-4366-a010-7b348153c288 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "DELETE /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 204 len: 0 microversion: 2.1 time: 0.127827 Jul 25 13:46:03.239545 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3411/6893] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:46:03 2022] DELETE /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:46:03.247799 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cfed256c-123f-45df-829b-2eba9254c7fb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:46:03.248414 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cfed256c-123f-45df-829b-2eba9254c7fb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:46:03.256887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cfed256c-123f-45df-829b-2eba9254c7fb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:03.257641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cfed256c-123f-45df-829b-2eba9254c7fb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:03.258442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cfed256c-123f-45df-829b-2eba9254c7fb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:03.258885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cfed256c-123f-45df-829b-2eba9254c7fb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:03.394709 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cfed256c-123f-45df-829b-2eba9254c7fb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:46:03.402713 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cfed256c-123f-45df-829b-2eba9254c7fb tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1553 microversion: 2.1 time: 0.158665 Jul 25 13:46:03.403300 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3483/6894] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:46:03 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:46:04.427117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-61aaff46-029b-4f84-8591-4aa6e4c4309e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:46:04.428111 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-61aaff46-029b-4f84-8591-4aa6e4c4309e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:46:04.438972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-61aaff46-029b-4f84-8591-4aa6e4c4309e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:04.439573 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-61aaff46-029b-4f84-8591-4aa6e4c4309e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:04.440609 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-61aaff46-029b-4f84-8591-4aa6e4c4309e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:04.441325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-61aaff46-029b-4f84-8591-4aa6e4c4309e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:04.579846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-61aaff46-029b-4f84-8591-4aa6e4c4309e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:46:04.587804 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-61aaff46-029b-4f84-8591-4aa6e4c4309e tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1553 microversion: 2.1 time: 0.166473 Jul 25 13:46:04.588426 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3412/6895] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:46:04 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:46:05.356707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-2019ee86-bfa9-46a2-87de-feae07f069c2 req-8747c125-073f-4ee9-8977-834d9d112b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa83aa1c-0814-4d11-83bd-2c5a878e093e", "name": "network-vif-deleted", "tag": "9bf6f144-b617-408a-8347-1f95afdea4f8"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:46:05.371442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-2019ee86-bfa9-46a2-87de-feae07f069c2 req-8747c125-073f-4ee9-8977-834d9d112b9c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:05.371895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-2019ee86-bfa9-46a2-87de-feae07f069c2 req-8747c125-073f-4ee9-8977-834d9d112b9c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:05.388542 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-2019ee86-bfa9-46a2-87de-feae07f069c2 req-8747c125-073f-4ee9-8977-834d9d112b9c service nova] Creating event network-vif-deleted:9bf6f144-b617-408a-8347-1f95afdea4f8 for instance aa83aa1c-0814-4d11-83bd-2c5a878e093e on n-h1-848886-15 Jul 25 13:46:05.395486 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-2019ee86-bfa9-46a2-87de-feae07f069c2 req-8747c125-073f-4ee9-8977-834d9d112b9c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042249 Jul 25 13:46:05.396101 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3484/6896] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:46:05.609100 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ca7dde35-8197-40c9-baa7-29b382426322 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:46:05.609718 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ca7dde35-8197-40c9-baa7-29b382426322 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:46:05.617016 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca7dde35-8197-40c9-baa7-29b382426322 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:05.617483 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca7dde35-8197-40c9-baa7-29b382426322 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:05.618306 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca7dde35-8197-40c9-baa7-29b382426322 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:05.618760 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca7dde35-8197-40c9-baa7-29b382426322 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:05.652490 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca7dde35-8197-40c9-baa7-29b382426322 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:05.652976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ca7dde35-8197-40c9-baa7-29b382426322 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:05.653446 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-ca7dde35-8197-40c9-baa7-29b382426322 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lazy-loading 'fault' on Instance uuid aa83aa1c-0814-4d11-83bd-2c5a878e093e {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:46:05.698751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ca7dde35-8197-40c9-baa7-29b382426322 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114282760b914b30bf98a17b61b59569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9afc929da94c579e696ed23d1964d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:46:05.709056 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ca7dde35-8197-40c9-baa7-29b382426322 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 200 len: 1348 microversion: 2.1 time: 0.103922 Jul 25 13:46:05.710074 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3413/6897] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:46:05 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 1348 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:46:06.737128 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e27feaf9-6982-4ae3-84fe-6f38cc27f170 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:46:06.738247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e27feaf9-6982-4ae3-84fe-6f38cc27f170 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] [instance: aa83aa1c-0814-4d11-83bd-2c5a878e093e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:46:06.751214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e27feaf9-6982-4ae3-84fe-6f38cc27f170 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:06.751926 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e27feaf9-6982-4ae3-84fe-6f38cc27f170 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:06.753961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e27feaf9-6982-4ae3-84fe-6f38cc27f170 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:06.754415 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e27feaf9-6982-4ae3-84fe-6f38cc27f170 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:06.768415 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-e27feaf9-6982-4ae3-84fe-6f38cc27f170 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] HTTP exception thrown: Instance aa83aa1c-0814-4d11-83bd-2c5a878e093e could not be found. Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e27feaf9-6982-4ae3-84fe-6f38cc27f170 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Request method failure captured: Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e HTTP/1.1 Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3p0zVSIM2UreUkUikCnAvL4djGCFm2w4z7jiMMoa85Swm_2mnYMLWpuqNlPDeY3LHhPYQT97_yWrDwupLRD6ifSR5i0Cy3wdv0mf5IPnEmugINCAXXgQdNbQ3tLlzq554eHcFnE3rzDc6C-Cyg3jsFln0akLX8dUpTQAnJjDKdl4pQc Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: aa9afc929da94c579e696ed23d1964d3 Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestMinimumBasicScenario-1802355901 Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aa9afc929da94c579e696ed23d1964d3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aa9afc929da94c579e696ed23d1964d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa9afc929da94c579e696ed23d1964d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa9afc929da94c579e696ed23d1964d3"}]}] Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestMinimumBasicScenario-1802355901 Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: aa9afc929da94c579e696ed23d1964d3 Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1802355901 Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestMinimumBasicScenario-1802355901-project Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 114282760b914b30bf98a17b61b59569 Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestMinimumBasicScenario-1802355901-project Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance aa83aa1c-0814-4d11-83bd-2c5a878e093e could not be found. Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'aa83aa1c-0814-4d11-83bd-2c5a878e093e'} Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa83aa1c-0814-4d11-83bd-2c5a878e093e could not be found. Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa83aa1c-0814-4d11-83bd-2c5a878e093e could not be found. Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:46:06.770097 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:46:06.774763 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:46:06.774763 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:46:06.774763 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:46:06.774763 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:46:06.774763 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:46:06.774763 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa83aa1c-0814-4d11-83bd-2c5a878e093e could not be found. Jul 25 13:46:06.774763 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:46:06.774763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e27feaf9-6982-4ae3-84fe-6f38cc27f170 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Returning 404 to user: Instance aa83aa1c-0814-4d11-83bd-2c5a878e093e could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:46:06.774763 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e27feaf9-6982-4ae3-84fe-6f38cc27f170 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e" status: 404 len: 111 microversion: 2.1 time: 0.041656 Jul 25 13:46:06.774763 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3485/6898] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:46:06 2022] GET /compute/v2.1/servers/aa83aa1c-0814-4d11-83bd-2c5a878e093e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:46:06.780488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-383e5635-c3b1-4202-971c-0c700ea5d205 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] Calling method '.version_select at 0x7efcf8e16dc0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:46:06.803793 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-383e5635-c3b1-4202-971c-0c700ea5d205 tempest-TestMinimumBasicScenario-1802355901 tempest-TestMinimumBasicScenario-1802355901-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2040626073" status: 202 len: 0 microversion: 2.1 time: 0.027152 Jul 25 13:46:06.804379 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3414/6899] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Jul 25 13:46:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2040626073 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:46:16.150975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f68aa3e7-e27b-435b-8f03-2a9235d6fa24 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'create', calling method: .version_select at 0x7efcf92fe8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2143093308", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCW48+DLPBd5w12XMrVSbDVtrWjfoxBnp55UdNC9VJ0hcx6BE2jayIGUL+OImeaJHcdHPSPdAvUGtScna16qLW/AiuTbj2WEkcPoCbYG1A3X9G3ZszHQSAB6lt5tpsGg3A=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:46:16.167435 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-f68aa3e7-e27b-435b-8f03-2a9235d6fa24 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Getting quotas for project 2a3ff31102b0437aba77c5efe779af7a. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:46:16.173199 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-f68aa3e7-e27b-435b-8f03-2a9235d6fa24 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Getting quotas for user bc97a7b925de4cca981fe1d714f5e986 and project 2a3ff31102b0437aba77c5efe779af7a. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:46:16.202756 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f68aa3e7-e27b-435b-8f03-2a9235d6fa24 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.232021 Jul 25 13:46:16.203391 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3486/6900] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:46:15 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:46:22.367312 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f717bcfd-43c7-4892-aecb-651dadbb867c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1528574811", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "8a16ec15-e4d2-431e-9017-24ce1f23a85d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2143093308", "security_groups": [{"name": "tempest-secgroup-smoke-476347979"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:46:22.384860 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:46:22.386681 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:46:22.494655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-f717bcfd-43c7-4892-aecb-651dadbb867c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] validate_networks() for [('8a16ec15-e4d2-431e-9017-24ce1f23a85d', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:46:22.960090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-f717bcfd-43c7-4892-aecb-651dadbb867c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:46:22.960531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-f717bcfd-43c7-4892-aecb-651dadbb867c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:46:22.961023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-f717bcfd-43c7-4892-aecb-651dadbb867c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:46:22.961451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-f717bcfd-43c7-4892-aecb-651dadbb867c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:46:22.961993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-f717bcfd-43c7-4892-aecb-651dadbb867c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:46:22.972129 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f717bcfd-43c7-4892-aecb-651dadbb867c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:22.972597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f717bcfd-43c7-4892-aecb-651dadbb867c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:22.973421 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f717bcfd-43c7-4892-aecb-651dadbb867c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:22.973906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f717bcfd-43c7-4892-aecb-651dadbb867c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:22.992067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-f717bcfd-43c7-4892-aecb-651dadbb867c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Getting quotas for project 2a3ff31102b0437aba77c5efe779af7a. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:46:22.998362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-f717bcfd-43c7-4892-aecb-651dadbb867c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Getting quotas for user bc97a7b925de4cca981fe1d714f5e986 and project 2a3ff31102b0437aba77c5efe779af7a. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:46:23.012728 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f717bcfd-43c7-4892-aecb-651dadbb867c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:46:23.015116 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f717bcfd-43c7-4892-aecb-651dadbb867c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:46:23.066589 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f717bcfd-43c7-4892-aecb-651dadbb867c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.704159 Jul 25 13:46:23.072929 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3415/6901] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:46:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:46:23.076224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:46:23.082895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ec739785-64c6-4742-93ee-ef9d3ec2491d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:46:23.083517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ec739785-64c6-4742-93ee-ef9d3ec2491d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:46:23.085678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:46:23.150116 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ec739785-64c6-4742-93ee-ef9d3ec2491d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:46:23.157398 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ec739785-64c6-4742-93ee-ef9d3ec2491d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 200 len: 1267 microversion: 2.1 time: 0.082359 Jul 25 13:46:23.158242 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3487/6902] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:46:23 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:46:24.179767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-08fdb338-eda7-4e92-9e6b-9d05c5e568ac tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:46:24.181060 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-08fdb338-eda7-4e92-9e6b-9d05c5e568ac tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:46:24.276663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-08fdb338-eda7-4e92-9e6b-9d05c5e568ac tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:46:24.295763 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-08fdb338-eda7-4e92-9e6b-9d05c5e568ac tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 200 len: 1267 microversion: 2.1 time: 0.121613 Jul 25 13:46:24.301928 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3416/6903] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:46:24 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 1267 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:46:25.322458 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-630108c5-7fbc-4afb-bb43-59c3ee4eb380 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:46:25.323035 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-630108c5-7fbc-4afb-bb43-59c3ee4eb380 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:46:25.380881 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-630108c5-7fbc-4afb-bb43-59c3ee4eb380 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:46:25.389350 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-630108c5-7fbc-4afb-bb43-59c3ee4eb380 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 200 len: 1267 microversion: 2.1 time: 0.070857 Jul 25 13:46:25.390158 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3488/6904] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:46:25 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 1267 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:46:26.414454 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6c9e87f2-3412-4fdc-b56b-cc70170503ef tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:46:26.415331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6c9e87f2-3412-4fdc-b56b-cc70170503ef tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:46:26.476317 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6c9e87f2-3412-4fdc-b56b-cc70170503ef tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:46:26.484245 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6c9e87f2-3412-4fdc-b56b-cc70170503ef tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 200 len: 1267 microversion: 2.1 time: 0.076815 Jul 25 13:46:26.484831 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3417/6905] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:46:26 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 1267 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:46:27.508108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f96fe634-045e-42c0-8a36-372ee209518f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:46:27.508782 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f96fe634-045e-42c0-8a36-372ee209518f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:46:27.516921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f96fe634-045e-42c0-8a36-372ee209518f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:27.517426 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f96fe634-045e-42c0-8a36-372ee209518f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:27.518317 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f96fe634-045e-42c0-8a36-372ee209518f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:27.518982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f96fe634-045e-42c0-8a36-372ee209518f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:27.588720 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f96fe634-045e-42c0-8a36-372ee209518f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:46:27.596821 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f96fe634-045e-42c0-8a36-372ee209518f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 200 len: 1271 microversion: 2.1 time: 0.093660 Jul 25 13:46:27.597506 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3489/6906] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:46:27 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:46:28.618059 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b09a5e1c-cf8d-4167-8728-bcc10d84b069 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:46:28.618757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b09a5e1c-cf8d-4167-8728-bcc10d84b069 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:46:28.625788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b09a5e1c-cf8d-4167-8728-bcc10d84b069 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:28.626314 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b09a5e1c-cf8d-4167-8728-bcc10d84b069 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:28.627107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b09a5e1c-cf8d-4167-8728-bcc10d84b069 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:28.627558 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b09a5e1c-cf8d-4167-8728-bcc10d84b069 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:28.704140 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b09a5e1c-cf8d-4167-8728-bcc10d84b069 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:46:28.712174 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b09a5e1c-cf8d-4167-8728-bcc10d84b069 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 200 len: 1325 microversion: 2.1 time: 0.098137 Jul 25 13:46:28.712890 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3418/6907] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:46:28 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 1325 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:46:29.732957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0320fa5f-2ec7-48a0-af82-18ca01b35cdc tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:46:29.733678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0320fa5f-2ec7-48a0-af82-18ca01b35cdc tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:46:29.741702 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0320fa5f-2ec7-48a0-af82-18ca01b35cdc tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:29.742332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0320fa5f-2ec7-48a0-af82-18ca01b35cdc tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:29.743246 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0320fa5f-2ec7-48a0-af82-18ca01b35cdc tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:29.743785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0320fa5f-2ec7-48a0-af82-18ca01b35cdc tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:30.020627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0320fa5f-2ec7-48a0-af82-18ca01b35cdc tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:46:30.029004 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0320fa5f-2ec7-48a0-af82-18ca01b35cdc tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 200 len: 1392 microversion: 2.1 time: 0.299982 Jul 25 13:46:30.029586 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3490/6908] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:46:29 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 1392 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:46:30.127310 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-d1536da0-2e0d-49f1-b75f-4454e9bba126 req-0a05d268-2a25-48c3-9dad-ed2017864e5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50ac26a6-e8b9-42c0-b3f6-d77ef068c18e", "tag": "10c77780-dfc8-4701-86cb-285afd88e83f"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:46:30.167326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d1536da0-2e0d-49f1-b75f-4454e9bba126 req-0a05d268-2a25-48c3-9dad-ed2017864e5f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:30.167976 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d1536da0-2e0d-49f1-b75f-4454e9bba126 req-0a05d268-2a25-48c3-9dad-ed2017864e5f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:30.181629 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-d1536da0-2e0d-49f1-b75f-4454e9bba126 req-0a05d268-2a25-48c3-9dad-ed2017864e5f service nova] Creating event network-changed:10c77780-dfc8-4701-86cb-285afd88e83f for instance 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e on n-h2-848886-15 Jul 25 13:46:30.187920 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-d1536da0-2e0d-49f1-b75f-4454e9bba126 req-0a05d268-2a25-48c3-9dad-ed2017864e5f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064507 Jul 25 13:46:30.188764 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3419/6909] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:46:31.051346 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6c632eac-4822-49f9-ae2c-75556e5f1ab2 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:46:31.052060 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6c632eac-4822-49f9-ae2c-75556e5f1ab2 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:46:31.061423 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c632eac-4822-49f9-ae2c-75556e5f1ab2 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:31.062032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c632eac-4822-49f9-ae2c-75556e5f1ab2 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:31.062984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c632eac-4822-49f9-ae2c-75556e5f1ab2 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:31.063527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6c632eac-4822-49f9-ae2c-75556e5f1ab2 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:31.207269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6c632eac-4822-49f9-ae2c-75556e5f1ab2 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:46:31.215395 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6c632eac-4822-49f9-ae2c-75556e5f1ab2 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 200 len: 1392 microversion: 2.1 time: 0.169069 Jul 25 13:46:31.216047 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3491/6910] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:46:31 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:46:32.239790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-686b5d77-29ec-4f6c-acf3-f492c8462b35 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:46:32.241165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-686b5d77-29ec-4f6c-acf3-f492c8462b35 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:46:32.251355 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-686b5d77-29ec-4f6c-acf3-f492c8462b35 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:32.252096 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-686b5d77-29ec-4f6c-acf3-f492c8462b35 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:32.253287 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-686b5d77-29ec-4f6c-acf3-f492c8462b35 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:32.253771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-686b5d77-29ec-4f6c-acf3-f492c8462b35 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:32.400524 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-686b5d77-29ec-4f6c-acf3-f492c8462b35 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:46:32.410645 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-686b5d77-29ec-4f6c-acf3-f492c8462b35 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 200 len: 1392 microversion: 2.1 time: 0.176661 Jul 25 13:46:32.411544 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3420/6911] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:46:32 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:46:33.435616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2d68dec5-4875-47a9-87e3-9c679b8e0255 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:46:33.436193 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2d68dec5-4875-47a9-87e3-9c679b8e0255 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:46:33.443523 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d68dec5-4875-47a9-87e3-9c679b8e0255 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:33.443977 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d68dec5-4875-47a9-87e3-9c679b8e0255 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:33.444753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d68dec5-4875-47a9-87e3-9c679b8e0255 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:33.445199 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2d68dec5-4875-47a9-87e3-9c679b8e0255 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:33.593462 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2d68dec5-4875-47a9-87e3-9c679b8e0255 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:46:33.601285 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2d68dec5-4875-47a9-87e3-9c679b8e0255 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 200 len: 1392 microversion: 2.1 time: 0.169764 Jul 25 13:46:33.602148 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3492/6912] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:46:33 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:46:34.622755 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2790455d-3693-47d6-9c16-d4324408ca5d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:46:34.623382 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2790455d-3693-47d6-9c16-d4324408ca5d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:46:34.625576 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:46:34.632253 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2790455d-3693-47d6-9c16-d4324408ca5d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:34.632714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2790455d-3693-47d6-9c16-d4324408ca5d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:34.633497 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2790455d-3693-47d6-9c16-d4324408ca5d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:34.633969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2790455d-3693-47d6-9c16-d4324408ca5d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:34.771849 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2790455d-3693-47d6-9c16-d4324408ca5d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:46:34.779774 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2790455d-3693-47d6-9c16-d4324408ca5d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 200 len: 1392 microversion: 2.1 time: 0.161084 Jul 25 13:46:34.780384 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3421/6913] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:46:34 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:46:35.803044 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6a51a802-a427-4f93-b768-d47e928a6c4d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:46:35.803824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6a51a802-a427-4f93-b768-d47e928a6c4d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:46:35.807481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=8 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:46:35.815341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a51a802-a427-4f93-b768-d47e928a6c4d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:35.815993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a51a802-a427-4f93-b768-d47e928a6c4d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:35.816820 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a51a802-a427-4f93-b768-d47e928a6c4d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:35.817264 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6a51a802-a427-4f93-b768-d47e928a6c4d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:35.970155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6a51a802-a427-4f93-b768-d47e928a6c4d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:46:35.978259 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6a51a802-a427-4f93-b768-d47e928a6c4d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 200 len: 1392 microversion: 2.1 time: 0.180532 Jul 25 13:46:35.978891 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3493/6914] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:46:35 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:46:36.679242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-d46e1336-cb6b-4697-842c-784aa008410f req-c4312fbc-e6b1-49cc-b96e-b2f21aa054cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50ac26a6-e8b9-42c0-b3f6-d77ef068c18e", "name": "network-vif-plugged", "status": "completed", "tag": "10c77780-dfc8-4701-86cb-285afd88e83f"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:46:36.684936 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=10 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:46:36.691118 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d46e1336-cb6b-4697-842c-784aa008410f req-c4312fbc-e6b1-49cc-b96e-b2f21aa054cd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:36.691582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d46e1336-cb6b-4697-842c-784aa008410f req-c4312fbc-e6b1-49cc-b96e-b2f21aa054cd service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:36.703212 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-d46e1336-cb6b-4697-842c-784aa008410f req-c4312fbc-e6b1-49cc-b96e-b2f21aa054cd service nova] Creating event network-vif-plugged:10c77780-dfc8-4701-86cb-285afd88e83f for instance 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e on n-h2-848886-15 Jul 25 13:46:36.708953 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-d46e1336-cb6b-4697-842c-784aa008410f req-c4312fbc-e6b1-49cc-b96e-b2f21aa054cd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033463 Jul 25 13:46:36.709575 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3422/6915] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:46:37.003267 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-824b50a3-c68c-4f1e-9430-974062711150 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:46:37.004422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-824b50a3-c68c-4f1e-9430-974062711150 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:46:37.015949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-824b50a3-c68c-4f1e-9430-974062711150 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:37.016699 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-824b50a3-c68c-4f1e-9430-974062711150 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:37.018012 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-824b50a3-c68c-4f1e-9430-974062711150 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:37.018824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-824b50a3-c68c-4f1e-9430-974062711150 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:37.168139 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-824b50a3-c68c-4f1e-9430-974062711150 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:46:37.178254 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-824b50a3-c68c-4f1e-9430-974062711150 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 200 len: 1392 microversion: 2.1 time: 0.181583 Jul 25 13:46:37.178808 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3494/6916] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:46:36 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:46:38.201988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a8f55ae6-fbf3-4dd7-aeaa-3f7fff3a4ac9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:46:38.202874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a8f55ae6-fbf3-4dd7-aeaa-3f7fff3a4ac9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:46:38.210840 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a8f55ae6-fbf3-4dd7-aeaa-3f7fff3a4ac9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:38.211338 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a8f55ae6-fbf3-4dd7-aeaa-3f7fff3a4ac9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:38.212138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a8f55ae6-fbf3-4dd7-aeaa-3f7fff3a4ac9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:38.212674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a8f55ae6-fbf3-4dd7-aeaa-3f7fff3a4ac9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:38.353575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a8f55ae6-fbf3-4dd7-aeaa-3f7fff3a4ac9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:46:38.361813 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a8f55ae6-fbf3-4dd7-aeaa-3f7fff3a4ac9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 200 len: 1563 microversion: 2.1 time: 0.166081 Jul 25 13:46:38.362517 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3423/6917] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:46:38 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:46:38.382034 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f6298067-ee9f-4d33-b3cf-f88507b5bc72 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:46:38.382550 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f6298067-ee9f-4d33-b3cf-f88507b5bc72 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:46:38.389928 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f6298067-ee9f-4d33-b3cf-f88507b5bc72 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:38.390373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f6298067-ee9f-4d33-b3cf-f88507b5bc72 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:38.391129 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f6298067-ee9f-4d33-b3cf-f88507b5bc72 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:38.391556 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f6298067-ee9f-4d33-b3cf-f88507b5bc72 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:38.534655 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f6298067-ee9f-4d33-b3cf-f88507b5bc72 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:46:38.546707 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f6298067-ee9f-4d33-b3cf-f88507b5bc72 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 200 len: 1563 microversion: 2.1 time: 0.168159 Jul 25 13:46:38.547301 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3495/6918] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:46:38 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:46:40.207272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9af83ab8-8053-439f-83b9-936fa2057245 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:46:40.208406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9af83ab8-8053-439f-83b9-936fa2057245 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:46:40.215534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9af83ab8-8053-439f-83b9-936fa2057245 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:40.216291 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9af83ab8-8053-439f-83b9-936fa2057245 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:40.217095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9af83ab8-8053-439f-83b9-936fa2057245 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:40.217569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9af83ab8-8053-439f-83b9-936fa2057245 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:40.340279 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-07031bde-1914-4dfb-999d-988fb781176e req-ea6b1b8f-8ced-45b1-a386-9de4746ee1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50ac26a6-e8b9-42c0-b3f6-d77ef068c18e", "tag": "10c77780-dfc8-4701-86cb-285afd88e83f"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:46:40.350666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-07031bde-1914-4dfb-999d-988fb781176e req-ea6b1b8f-8ced-45b1-a386-9de4746ee1b2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:46:40.351118 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-07031bde-1914-4dfb-999d-988fb781176e req-ea6b1b8f-8ced-45b1-a386-9de4746ee1b2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:46:40.362933 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-07031bde-1914-4dfb-999d-988fb781176e req-ea6b1b8f-8ced-45b1-a386-9de4746ee1b2 service nova] Creating event network-changed:10c77780-dfc8-4701-86cb-285afd88e83f for instance 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e on n-h2-848886-15 Jul 25 13:46:40.368216 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9af83ab8-8053-439f-83b9-936fa2057245 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:46:40.369068 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-07031bde-1914-4dfb-999d-988fb781176e req-ea6b1b8f-8ced-45b1-a386-9de4746ee1b2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093221 Jul 25 13:46:40.374163 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3496/6919] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:46:40.383952 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9af83ab8-8053-439f-83b9-936fa2057245 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 200 len: 1563 microversion: 2.1 time: 0.181535 Jul 25 13:46:40.384552 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3424/6920] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:46:40 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 1563 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:47:01.659234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=23 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:47:01.659954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=44 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:47:01.668674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cb160fc9-6756-4187-9c0c-50fb35e82f8a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:47:01.668674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cb160fc9-6756-4187-9c0c-50fb35e82f8a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:01.675084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb160fc9-6756-4187-9c0c-50fb35e82f8a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:01.675534 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb160fc9-6756-4187-9c0c-50fb35e82f8a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:01.676411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb160fc9-6756-4187-9c0c-50fb35e82f8a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:01.676849 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cb160fc9-6756-4187-9c0c-50fb35e82f8a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:01.730823 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cb160fc9-6756-4187-9c0c-50fb35e82f8a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e/action" status: 200 len: 24568 microversion: 2.1 time: 0.073506 Jul 25 13:47:01.731489 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3497/6921] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:47:01 2022] POST /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e/action => generated 24568 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:47:12.806389 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-00bf77b6-9fc8-4f9f-91ea-8849f47f5d5a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:47:12.807008 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-00bf77b6-9fc8-4f9f-91ea-8849f47f5d5a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:12.809673 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:47:12.810561 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=36 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:47:12.817698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00bf77b6-9fc8-4f9f-91ea-8849f47f5d5a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:12.818328 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00bf77b6-9fc8-4f9f-91ea-8849f47f5d5a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:12.819815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00bf77b6-9fc8-4f9f-91ea-8849f47f5d5a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:12.820368 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00bf77b6-9fc8-4f9f-91ea-8849f47f5d5a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:12.896153 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-00bf77b6-9fc8-4f9f-91ea-8849f47f5d5a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e/action" status: 202 len: 0 microversion: 2.1 time: 0.094807 Jul 25 13:47:12.896808 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3425/6922] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:47:12 2022] POST /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:47:12.905925 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b8395ff5-95c3-4da2-9e6b-3a80c81b7ffb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:47:12.906622 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b8395ff5-95c3-4da2-9e6b-3a80c81b7ffb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:12.909554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:47:12.912507 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:47:12.920171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8395ff5-95c3-4da2-9e6b-3a80c81b7ffb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:12.920623 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8395ff5-95c3-4da2-9e6b-3a80c81b7ffb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:12.921390 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8395ff5-95c3-4da2-9e6b-3a80c81b7ffb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:12.921851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b8395ff5-95c3-4da2-9e6b-3a80c81b7ffb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:13.066056 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b8395ff5-95c3-4da2-9e6b-3a80c81b7ffb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:47:13.073913 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b8395ff5-95c3-4da2-9e6b-3a80c81b7ffb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 200 len: 1687 microversion: 2.1 time: 0.172292 Jul 25 13:47:13.074497 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3498/6923] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:47:12 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:47:14.100557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6d87e8d2-8b34-4c8b-bb08-96e85a902b3b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:47:14.101268 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6d87e8d2-8b34-4c8b-bb08-96e85a902b3b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:14.108208 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6d87e8d2-8b34-4c8b-bb08-96e85a902b3b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:14.108674 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6d87e8d2-8b34-4c8b-bb08-96e85a902b3b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:14.109462 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6d87e8d2-8b34-4c8b-bb08-96e85a902b3b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:14.109940 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6d87e8d2-8b34-4c8b-bb08-96e85a902b3b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:14.248242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6d87e8d2-8b34-4c8b-bb08-96e85a902b3b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:47:14.256289 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6d87e8d2-8b34-4c8b-bb08-96e85a902b3b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 200 len: 1667 microversion: 2.1 time: 0.163006 Jul 25 13:47:14.256818 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3426/6924] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:47:14 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 1667 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:47:15.363795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6cb27639-ad20-4205-bfab-dd626a85db74 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:47:15.366041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6cb27639-ad20-4205-bfab-dd626a85db74 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:15.374167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cb27639-ad20-4205-bfab-dd626a85db74 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:15.374619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cb27639-ad20-4205-bfab-dd626a85db74 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:15.375402 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cb27639-ad20-4205-bfab-dd626a85db74 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:15.375842 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6cb27639-ad20-4205-bfab-dd626a85db74 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:15.431149 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6cb27639-ad20-4205-bfab-dd626a85db74 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e/action" status: 200 len: 32641 microversion: 2.1 time: 0.073241 Jul 25 13:47:15.431955 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3499/6925] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:47:15 2022] POST /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e/action => generated 32641 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:47:15.444213 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9ea0b231-7169-491e-9ae4-1bff9f2eef6f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:47:15.444847 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9ea0b231-7169-491e-9ae4-1bff9f2eef6f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:15.452307 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ea0b231-7169-491e-9ae4-1bff9f2eef6f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:15.452803 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ea0b231-7169-491e-9ae4-1bff9f2eef6f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:15.453980 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ea0b231-7169-491e-9ae4-1bff9f2eef6f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:15.454761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9ea0b231-7169-491e-9ae4-1bff9f2eef6f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:15.531564 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9ea0b231-7169-491e-9ae4-1bff9f2eef6f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e/action" status: 202 len: 0 microversion: 2.1 time: 0.090889 Jul 25 13:47:15.532338 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3427/6926] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:47:15 2022] POST /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:47:15.541612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-610f305e-42fd-46fb-b123-c012cc5e35f3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:47:15.542355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-610f305e-42fd-46fb-b123-c012cc5e35f3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:15.549600 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-610f305e-42fd-46fb-b123-c012cc5e35f3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:15.550091 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-610f305e-42fd-46fb-b123-c012cc5e35f3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:15.550921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-610f305e-42fd-46fb-b123-c012cc5e35f3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:15.551358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-610f305e-42fd-46fb-b123-c012cc5e35f3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:15.696108 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-610f305e-42fd-46fb-b123-c012cc5e35f3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:47:15.704784 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-610f305e-42fd-46fb-b123-c012cc5e35f3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 200 len: 1674 microversion: 2.1 time: 0.167410 Jul 25 13:47:15.705592 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3500/6927] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:47:15 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:47:16.733455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4b261fea-0375-4f91-b545-7eb1a7d64cef tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:47:16.734669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4b261fea-0375-4f91-b545-7eb1a7d64cef tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:16.742898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b261fea-0375-4f91-b545-7eb1a7d64cef tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:16.744062 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b261fea-0375-4f91-b545-7eb1a7d64cef tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:16.744225 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b261fea-0375-4f91-b545-7eb1a7d64cef tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:16.744558 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4b261fea-0375-4f91-b545-7eb1a7d64cef tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:16.890165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4b261fea-0375-4f91-b545-7eb1a7d64cef tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:47:16.898126 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4b261fea-0375-4f91-b545-7eb1a7d64cef tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 200 len: 1682 microversion: 2.1 time: 0.173229 Jul 25 13:47:16.898793 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3428/6928] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:47:16 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:47:17.010525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-45285be3-0565-4303-83e3-b846393a867a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:47:17.012781 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-45285be3-0565-4303-83e3-b846393a867a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:17.020868 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45285be3-0565-4303-83e3-b846393a867a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:17.021362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45285be3-0565-4303-83e3-b846393a867a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:17.022179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45285be3-0565-4303-83e3-b846393a867a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:17.022616 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-45285be3-0565-4303-83e3-b846393a867a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:17.072286 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-45285be3-0565-4303-83e3-b846393a867a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e/action" status: 200 len: 38459 microversion: 2.1 time: 0.066148 Jul 25 13:47:17.072963 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3501/6929] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:47:17 2022] POST /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e/action => generated 38459 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:47:18.111205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-277eb06c-d230-4feb-b7f1-dc629bdeb523 req-3717edb0-59b8-44d1-81f2-217a712e7639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50ac26a6-e8b9-42c0-b3f6-d77ef068c18e", "tag": "10c77780-dfc8-4701-86cb-285afd88e83f"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:47:18.120563 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ce13be65-be22-4fe0-8067-1a73f5d8551d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:47:18.121059 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ce13be65-be22-4fe0-8067-1a73f5d8551d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:18.133846 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ce13be65-be22-4fe0-8067-1a73f5d8551d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:18.134990 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ce13be65-be22-4fe0-8067-1a73f5d8551d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:18.136050 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ce13be65-be22-4fe0-8067-1a73f5d8551d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:18.136502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ce13be65-be22-4fe0-8067-1a73f5d8551d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:18.138275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-277eb06c-d230-4feb-b7f1-dc629bdeb523 req-3717edb0-59b8-44d1-81f2-217a712e7639 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:18.138719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-277eb06c-d230-4feb-b7f1-dc629bdeb523 req-3717edb0-59b8-44d1-81f2-217a712e7639 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:18.150801 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-277eb06c-d230-4feb-b7f1-dc629bdeb523 req-3717edb0-59b8-44d1-81f2-217a712e7639 service nova] Creating event network-changed:10c77780-dfc8-4701-86cb-285afd88e83f for instance 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e on n-h2-848886-15 Jul 25 13:47:18.156158 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-277eb06c-d230-4feb-b7f1-dc629bdeb523 req-3717edb0-59b8-44d1-81f2-217a712e7639 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048913 Jul 25 13:47:18.157192 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3502/6930] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:47:18.165920 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ce13be65-be22-4fe0-8067-1a73f5d8551d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:47:18.247199 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ce13be65-be22-4fe0-8067-1a73f5d8551d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "DELETE /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 204 len: 0 microversion: 2.1 time: 0.142523 Jul 25 13:47:18.251398 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3429/6931] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:47:18 2022] DELETE /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:47:18.259051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-65e9b743-b703-4728-969a-4a83f85186fb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:47:18.260191 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-65e9b743-b703-4728-969a-4a83f85186fb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:18.267244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65e9b743-b703-4728-969a-4a83f85186fb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:18.267772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65e9b743-b703-4728-969a-4a83f85186fb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:18.268633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65e9b743-b703-4728-969a-4a83f85186fb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:18.269204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-65e9b743-b703-4728-969a-4a83f85186fb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:18.435967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-65e9b743-b703-4728-969a-4a83f85186fb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:47:18.443810 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-65e9b743-b703-4728-969a-4a83f85186fb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 200 len: 1688 microversion: 2.1 time: 0.190686 Jul 25 13:47:18.444393 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3503/6932] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:47:18 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 1688 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:47:19.470581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-85d8266d-74ba-42a6-8fe8-66f85e27db04 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:47:19.471663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-85d8266d-74ba-42a6-8fe8-66f85e27db04 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:19.479658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-85d8266d-74ba-42a6-8fe8-66f85e27db04 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:19.480124 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-85d8266d-74ba-42a6-8fe8-66f85e27db04 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:19.480926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-85d8266d-74ba-42a6-8fe8-66f85e27db04 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:19.481385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-85d8266d-74ba-42a6-8fe8-66f85e27db04 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:19.671373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-85d8266d-74ba-42a6-8fe8-66f85e27db04 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:47:19.679581 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-85d8266d-74ba-42a6-8fe8-66f85e27db04 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 200 len: 1688 microversion: 2.1 time: 0.216524 Jul 25 13:47:19.680170 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3430/6933] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:47:19 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 1688 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:47:20.257126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-77375905-cba6-4edb-8d63-93f812499237 req-e7b6b50c-61cf-4aec-ae68-920de3da4f16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50ac26a6-e8b9-42c0-b3f6-d77ef068c18e", "name": "network-vif-deleted", "tag": "10c77780-dfc8-4701-86cb-285afd88e83f"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:47:20.268442 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-77375905-cba6-4edb-8d63-93f812499237 req-e7b6b50c-61cf-4aec-ae68-920de3da4f16 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:20.268887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-77375905-cba6-4edb-8d63-93f812499237 req-e7b6b50c-61cf-4aec-ae68-920de3da4f16 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:20.281075 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-77375905-cba6-4edb-8d63-93f812499237 req-e7b6b50c-61cf-4aec-ae68-920de3da4f16 service nova] Creating event network-vif-deleted:10c77780-dfc8-4701-86cb-285afd88e83f for instance 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e on n-h2-848886-15 Jul 25 13:47:20.286067 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-77375905-cba6-4edb-8d63-93f812499237 req-e7b6b50c-61cf-4aec-ae68-920de3da4f16 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032914 Jul 25 13:47:20.286653 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3504/6934] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:47:20.701260 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dfcbbbe9-e179-47b2-a94f-28c40ea6d5e3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:47:20.702184 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dfcbbbe9-e179-47b2-a94f-28c40ea6d5e3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:20.709778 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dfcbbbe9-e179-47b2-a94f-28c40ea6d5e3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:20.710516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dfcbbbe9-e179-47b2-a94f-28c40ea6d5e3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:20.711311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dfcbbbe9-e179-47b2-a94f-28c40ea6d5e3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:20.711769 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dfcbbbe9-e179-47b2-a94f-28c40ea6d5e3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:20.748002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dfcbbbe9-e179-47b2-a94f-28c40ea6d5e3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:20.748475 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dfcbbbe9-e179-47b2-a94f-28c40ea6d5e3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:20.748940 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-dfcbbbe9-e179-47b2-a94f-28c40ea6d5e3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lazy-loading 'fault' on Instance uuid 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:47:20.789439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dfcbbbe9-e179-47b2-a94f-28c40ea6d5e3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:47:20.796735 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dfcbbbe9-e179-47b2-a94f-28c40ea6d5e3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 200 len: 1357 microversion: 2.1 time: 0.099489 Jul 25 13:47:20.797313 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3431/6935] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:47:20 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 1357 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:47:21.824321 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-223c17c7-acfd-469e-96a2-deb688ac2f11 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:47:21.825447 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-223c17c7-acfd-469e-96a2-deb688ac2f11 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:21.835451 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-223c17c7-acfd-469e-96a2-deb688ac2f11 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:21.835902 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-223c17c7-acfd-469e-96a2-deb688ac2f11 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:21.836665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-223c17c7-acfd-469e-96a2-deb688ac2f11 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:21.837098 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-223c17c7-acfd-469e-96a2-deb688ac2f11 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:21.850736 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-223c17c7-acfd-469e-96a2-deb688ac2f11 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] HTTP exception thrown: Instance 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e could not be found. Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-223c17c7-acfd-469e-96a2-deb688ac2f11 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Request method failure captured: Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e HTTP/1.1 Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3p6nyr1k_mFa4TokFEOlsou6AutFycw2kIO61UeF99u26RQ-4tpsrMhICbgi-9flg72p_U8OM5XgKZ6LQr4j4tb8J14QULHs7ajP_ZgmomWC6pW8wz9n9aS-w6knWlaT3jwDpfYXaMI8wyO7_qrSx4IpgYN7bXoMCpzogGqHy3JVQbs Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 2a3ff31102b0437aba77c5efe779af7a Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1441249113 Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2a3ff31102b0437aba77c5efe779af7a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2a3ff31102b0437aba77c5efe779af7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2a3ff31102b0437aba77c5efe779af7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2a3ff31102b0437aba77c5efe779af7a"}]}] Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1441249113 Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 2a3ff31102b0437aba77c5efe779af7a Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1441249113 Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestNetworkAdvancedServerOps-1441249113-project Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: bc97a7b925de4cca981fe1d714f5e986 Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1441249113-project Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e could not be found. Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '50ac26a6-e8b9-42c0-b3f6-d77ef068c18e'} Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e could not be found. Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e could not be found. Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:47:21.852354 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:47:21.857052 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:47:21.857052 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:47:21.857052 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:47:21.857052 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:47:21.857052 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:47:21.857052 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:47:21.857052 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e could not be found. Jul 25 13:47:21.857052 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:47:21.857052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-223c17c7-acfd-469e-96a2-deb688ac2f11 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Returning 404 to user: Instance 50ac26a6-e8b9-42c0-b3f6-d77ef068c18e could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:47:21.857052 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-223c17c7-acfd-469e-96a2-deb688ac2f11 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e" status: 404 len: 111 microversion: 2.1 time: 0.037853 Jul 25 13:47:21.857052 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3505/6936] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:47:21 2022] GET /compute/v2.1/servers/50ac26a6-e8b9-42c0-b3f6-d77ef068c18e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:47:25.152886 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5219daca-1ef2-483f-8199-80880cc81276 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '.version_select at 0x7efcf97f1ca0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:47:25.174790 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5219daca-1ef2-483f-8199-80880cc81276 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2143093308" status: 202 len: 0 microversion: 2.1 time: 0.025849 Jul 25 13:47:25.176052 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3432/6937] 10.222.0.49 () {58 vars in 1284 bytes} [Mon Jul 25 13:47:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2143093308 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:47:25.200773 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7e15182d-226d-42f4-9e4b-42358364650f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'create', calling method: .version_select at 0x7efcf92e3310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1781118237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXkL7Bxoff7/f10S/cluLKfXQ+cpjQNccZihVYjk6hZK+j+27KRinZGjmwG6EDnz7Q8gHP9Yf0PvFRm/k23Pqm+7wlvQaAORbtMpn62pzp1WBWMu9/9SU9T1Rn0o7bf0w=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:47:25.218532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-7e15182d-226d-42f4-9e4b-42358364650f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Getting quotas for project 2a3ff31102b0437aba77c5efe779af7a. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:47:25.223634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-7e15182d-226d-42f4-9e4b-42358364650f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Getting quotas for user bc97a7b925de4cca981fe1d714f5e986 and project 2a3ff31102b0437aba77c5efe779af7a. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:47:25.247868 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7e15182d-226d-42f4-9e4b-42358364650f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050940 Jul 25 13:47:25.253949 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3506/6938] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:47:25 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:47:30.883407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-eb57569d-199b-42e0-8450-1c60c9280d8a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-768433891", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "0586f3b6-7c1d-4135-9633-6921fd377e62"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1781118237", "security_groups": [{"name": "tempest-secgroup-smoke-1788247146"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:47:30.901581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:47:31.017508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-eb57569d-199b-42e0-8450-1c60c9280d8a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] validate_networks() for [('0586f3b6-7c1d-4135-9633-6921fd377e62', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:47:31.469132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-eb57569d-199b-42e0-8450-1c60c9280d8a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:47:31.469776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-eb57569d-199b-42e0-8450-1c60c9280d8a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:47:31.470513 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-eb57569d-199b-42e0-8450-1c60c9280d8a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:47:31.471016 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-eb57569d-199b-42e0-8450-1c60c9280d8a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:47:31.471495 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-eb57569d-199b-42e0-8450-1c60c9280d8a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:47:31.484106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb57569d-199b-42e0-8450-1c60c9280d8a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:31.484580 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb57569d-199b-42e0-8450-1c60c9280d8a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:31.485405 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb57569d-199b-42e0-8450-1c60c9280d8a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:31.485882 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb57569d-199b-42e0-8450-1c60c9280d8a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:31.504338 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-eb57569d-199b-42e0-8450-1c60c9280d8a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Getting quotas for project 2a3ff31102b0437aba77c5efe779af7a. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:47:31.510495 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-eb57569d-199b-42e0-8450-1c60c9280d8a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Getting quotas for user bc97a7b925de4cca981fe1d714f5e986 and project 2a3ff31102b0437aba77c5efe779af7a. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:47:31.525708 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-eb57569d-199b-42e0-8450-1c60c9280d8a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:47:31.529388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-eb57569d-199b-42e0-8450-1c60c9280d8a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:47:31.587411 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-eb57569d-199b-42e0-8450-1c60c9280d8a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.708386 Jul 25 13:47:31.588393 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3433/6939] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:47:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:47:31.603235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e499d683-0cc9-4e54-a3a5-d05a62e321f1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:47:31.604452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e499d683-0cc9-4e54-a3a5-d05a62e321f1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:31.675496 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e499d683-0cc9-4e54-a3a5-d05a62e321f1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:47:31.685525 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e499d683-0cc9-4e54-a3a5-d05a62e321f1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1266 microversion: 2.1 time: 0.088187 Jul 25 13:47:31.702205 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3507/6940] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:47:31 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:47:32.714764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a38fdfe5-eb99-46cb-a4f8-381e35f7c1d1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:47:32.716200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a38fdfe5-eb99-46cb-a4f8-381e35f7c1d1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:32.724212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a38fdfe5-eb99-46cb-a4f8-381e35f7c1d1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:32.725313 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a38fdfe5-eb99-46cb-a4f8-381e35f7c1d1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:32.726441 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a38fdfe5-eb99-46cb-a4f8-381e35f7c1d1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:32.727048 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a38fdfe5-eb99-46cb-a4f8-381e35f7c1d1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:32.845866 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a38fdfe5-eb99-46cb-a4f8-381e35f7c1d1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:47:32.854886 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a38fdfe5-eb99-46cb-a4f8-381e35f7c1d1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1326 microversion: 2.1 time: 0.145760 Jul 25 13:47:32.869003 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3434/6941] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:47:32 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1326 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:47:33.876445 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f335e217-7b01-4136-9769-ce9a7150493a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:47:33.877075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f335e217-7b01-4136-9769-ce9a7150493a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:33.886303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=32 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:47:33.894405 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f335e217-7b01-4136-9769-ce9a7150493a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:33.895073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f335e217-7b01-4136-9769-ce9a7150493a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:33.895946 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f335e217-7b01-4136-9769-ce9a7150493a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:33.896554 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f335e217-7b01-4136-9769-ce9a7150493a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:34.134321 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f335e217-7b01-4136-9769-ce9a7150493a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:47:34.152004 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f335e217-7b01-4136-9769-ce9a7150493a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1392 microversion: 2.1 time: 0.279265 Jul 25 13:47:34.153156 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3508/6942] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:47:33 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1392 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:47:34.414547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-017f2ec6-19f3-44a1-a07b-9da39701653b req-502cb583-a321-42b6-8505-cc73bdd44c8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08d60199-e00d-4423-8411-4ff4d7976d34", "tag": "99ee4793-cb21-419b-89db-bf3aaf86cdde"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:47:34.434554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-017f2ec6-19f3-44a1-a07b-9da39701653b req-502cb583-a321-42b6-8505-cc73bdd44c8e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:34.435030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-017f2ec6-19f3-44a1-a07b-9da39701653b req-502cb583-a321-42b6-8505-cc73bdd44c8e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:34.448601 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-017f2ec6-19f3-44a1-a07b-9da39701653b req-502cb583-a321-42b6-8505-cc73bdd44c8e service nova] Creating event network-changed:99ee4793-cb21-419b-89db-bf3aaf86cdde for instance 08d60199-e00d-4423-8411-4ff4d7976d34 on n-h1-848886-15 Jul 25 13:47:34.460274 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-017f2ec6-19f3-44a1-a07b-9da39701653b req-502cb583-a321-42b6-8505-cc73bdd44c8e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060554 Jul 25 13:47:34.461546 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3435/6943] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:47:35.179498 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dea366bc-f841-4929-a79c-460f91728863 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:47:35.180258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dea366bc-f841-4929-a79c-460f91728863 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:35.188754 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dea366bc-f841-4929-a79c-460f91728863 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:35.189287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dea366bc-f841-4929-a79c-460f91728863 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:35.190256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dea366bc-f841-4929-a79c-460f91728863 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:35.190770 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dea366bc-f841-4929-a79c-460f91728863 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:35.334843 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-dea366bc-f841-4929-a79c-460f91728863 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:47:35.342675 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dea366bc-f841-4929-a79c-460f91728863 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1392 microversion: 2.1 time: 0.167981 Jul 25 13:47:35.343260 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3509/6944] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:47:35 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:47:36.365543 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d42158d3-7d0f-4eec-bbba-ded4a6bfd645 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:47:36.366373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d42158d3-7d0f-4eec-bbba-ded4a6bfd645 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:36.373248 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d42158d3-7d0f-4eec-bbba-ded4a6bfd645 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:36.373714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d42158d3-7d0f-4eec-bbba-ded4a6bfd645 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:36.374531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d42158d3-7d0f-4eec-bbba-ded4a6bfd645 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:36.374979 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d42158d3-7d0f-4eec-bbba-ded4a6bfd645 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:36.572408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d42158d3-7d0f-4eec-bbba-ded4a6bfd645 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:47:36.580800 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d42158d3-7d0f-4eec-bbba-ded4a6bfd645 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1392 microversion: 2.1 time: 0.220746 Jul 25 13:47:36.581626 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3436/6945] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:47:36 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1392 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:47:37.602412 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-21f2c4b6-1faa-4583-98f1-faf2bb2c51df tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:47:37.602973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-21f2c4b6-1faa-4583-98f1-faf2bb2c51df tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:37.610398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-21f2c4b6-1faa-4583-98f1-faf2bb2c51df tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:37.610848 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-21f2c4b6-1faa-4583-98f1-faf2bb2c51df tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:37.611612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-21f2c4b6-1faa-4583-98f1-faf2bb2c51df tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:37.612046 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-21f2c4b6-1faa-4583-98f1-faf2bb2c51df tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:37.803074 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-21f2c4b6-1faa-4583-98f1-faf2bb2c51df tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:47:37.810990 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-21f2c4b6-1faa-4583-98f1-faf2bb2c51df tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1392 microversion: 2.1 time: 0.212610 Jul 25 13:47:37.811566 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3510/6946] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:47:37 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1392 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:47:38.832102 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ea59219f-d8b5-40fb-b30e-2f5a3094d4d8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:47:38.832750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ea59219f-d8b5-40fb-b30e-2f5a3094d4d8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:38.840002 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea59219f-d8b5-40fb-b30e-2f5a3094d4d8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:38.840502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea59219f-d8b5-40fb-b30e-2f5a3094d4d8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:38.841332 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea59219f-d8b5-40fb-b30e-2f5a3094d4d8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:38.841821 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ea59219f-d8b5-40fb-b30e-2f5a3094d4d8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:38.998455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ea59219f-d8b5-40fb-b30e-2f5a3094d4d8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:47:39.006469 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ea59219f-d8b5-40fb-b30e-2f5a3094d4d8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1392 microversion: 2.1 time: 0.178945 Jul 25 13:47:39.007065 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3437/6947] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:47:38 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:47:40.029167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8a30839d-82ff-4075-aa42-70d3da567cd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:47:40.029759 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8a30839d-82ff-4075-aa42-70d3da567cd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:40.041792 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a30839d-82ff-4075-aa42-70d3da567cd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:40.042274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a30839d-82ff-4075-aa42-70d3da567cd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:40.043059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a30839d-82ff-4075-aa42-70d3da567cd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:40.045341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8a30839d-82ff-4075-aa42-70d3da567cd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:40.181812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8a30839d-82ff-4075-aa42-70d3da567cd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:47:40.189537 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8a30839d-82ff-4075-aa42-70d3da567cd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1392 microversion: 2.1 time: 0.164471 Jul 25 13:47:40.190146 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3511/6948] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:47:40 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:47:40.422801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-2b677ea1-ce33-476c-9ad3-258992ddf5fe req-62c8d060-6f1a-440e-b9c6-2b956cd8975d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08d60199-e00d-4423-8411-4ff4d7976d34", "name": "network-vif-plugged", "status": "completed", "tag": "99ee4793-cb21-419b-89db-bf3aaf86cdde"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:47:40.434534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2b677ea1-ce33-476c-9ad3-258992ddf5fe req-62c8d060-6f1a-440e-b9c6-2b956cd8975d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:40.435164 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2b677ea1-ce33-476c-9ad3-258992ddf5fe req-62c8d060-6f1a-440e-b9c6-2b956cd8975d service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:40.447533 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-2b677ea1-ce33-476c-9ad3-258992ddf5fe req-62c8d060-6f1a-440e-b9c6-2b956cd8975d service nova] Creating event network-vif-plugged:99ee4793-cb21-419b-89db-bf3aaf86cdde for instance 08d60199-e00d-4423-8411-4ff4d7976d34 on n-h1-848886-15 Jul 25 13:47:40.453200 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-2b677ea1-ce33-476c-9ad3-258992ddf5fe req-62c8d060-6f1a-440e-b9c6-2b956cd8975d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033867 Jul 25 13:47:40.453924 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3438/6949] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:47:41.210422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5bb911d6-dd2b-45e8-b02b-074a744d73bd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:47:41.211051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5bb911d6-dd2b-45e8-b02b-074a744d73bd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:41.218114 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5bb911d6-dd2b-45e8-b02b-074a744d73bd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:41.218561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5bb911d6-dd2b-45e8-b02b-074a744d73bd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:41.219321 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5bb911d6-dd2b-45e8-b02b-074a744d73bd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:41.219759 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5bb911d6-dd2b-45e8-b02b-074a744d73bd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:41.377667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5bb911d6-dd2b-45e8-b02b-074a744d73bd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:47:41.385779 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5bb911d6-dd2b-45e8-b02b-074a744d73bd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1392 microversion: 2.1 time: 0.179567 Jul 25 13:47:41.386395 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3512/6950] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:47:41 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:47:42.405453 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:47:42.406265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:47:42.410901 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-48f577d2-33b9-4eca-8291-72118590d1b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:47:42.411707 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-48f577d2-33b9-4eca-8291-72118590d1b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:42.419013 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48f577d2-33b9-4eca-8291-72118590d1b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:42.419476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48f577d2-33b9-4eca-8291-72118590d1b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:42.420266 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48f577d2-33b9-4eca-8291-72118590d1b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:42.420715 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-48f577d2-33b9-4eca-8291-72118590d1b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:42.558974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-48f577d2-33b9-4eca-8291-72118590d1b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:47:42.568920 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-48f577d2-33b9-4eca-8291-72118590d1b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1563 microversion: 2.1 time: 0.165098 Jul 25 13:47:42.569715 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3439/6951] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:47:42 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:47:42.590970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cc5b8d5b-5a1e-4c02-9a80-ca5ecc0d778f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:47:42.591814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cc5b8d5b-5a1e-4c02-9a80-ca5ecc0d778f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:42.593999 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:47:42.601583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc5b8d5b-5a1e-4c02-9a80-ca5ecc0d778f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:42.602109 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc5b8d5b-5a1e-4c02-9a80-ca5ecc0d778f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:42.602988 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc5b8d5b-5a1e-4c02-9a80-ca5ecc0d778f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:42.603497 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cc5b8d5b-5a1e-4c02-9a80-ca5ecc0d778f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:42.751321 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cc5b8d5b-5a1e-4c02-9a80-ca5ecc0d778f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:47:42.761361 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cc5b8d5b-5a1e-4c02-9a80-ca5ecc0d778f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1563 microversion: 2.1 time: 0.175402 Jul 25 13:47:42.761972 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3513/6952] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:47:42 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1563 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:47:44.760192 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a937a2ea-20bc-43aa-b2e9-4378fab21c01 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:47:44.765992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-170a711c-9323-46e1-b79a-60abca3a0516 req-5474b1a7-25d1-4029-acd7-ac0c1d8ba22e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08d60199-e00d-4423-8411-4ff4d7976d34", "tag": "99ee4793-cb21-419b-89db-bf3aaf86cdde"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:47:44.769005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a937a2ea-20bc-43aa-b2e9-4378fab21c01 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:47:44.772156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:47:44.776341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:47:44.780618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a937a2ea-20bc-43aa-b2e9-4378fab21c01 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:44.781217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a937a2ea-20bc-43aa-b2e9-4378fab21c01 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:44.782170 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a937a2ea-20bc-43aa-b2e9-4378fab21c01 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:44.782564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-170a711c-9323-46e1-b79a-60abca3a0516 req-5474b1a7-25d1-4029-acd7-ac0c1d8ba22e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:47:44.783031 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-170a711c-9323-46e1-b79a-60abca3a0516 req-5474b1a7-25d1-4029-acd7-ac0c1d8ba22e service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:44.783224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a937a2ea-20bc-43aa-b2e9-4378fab21c01 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:47:44.798990 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-170a711c-9323-46e1-b79a-60abca3a0516 req-5474b1a7-25d1-4029-acd7-ac0c1d8ba22e service nova] Creating event network-changed:99ee4793-cb21-419b-89db-bf3aaf86cdde for instance 08d60199-e00d-4423-8411-4ff4d7976d34 on n-h1-848886-15 Jul 25 13:47:44.805151 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-170a711c-9323-46e1-b79a-60abca3a0516 req-5474b1a7-25d1-4029-acd7-ac0c1d8ba22e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042889 Jul 25 13:47:44.806400 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3514/6953] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:47:45.026693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a937a2ea-20bc-43aa-b2e9-4378fab21c01 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:47:45.035595 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a937a2ea-20bc-43aa-b2e9-4378fab21c01 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1563 microversion: 2.1 time: 0.279542 Jul 25 13:47:45.039076 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3440/6954] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:47:44 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1563 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:48:06.293079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=38 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:48:06.293822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:48:06.298387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e4d478db-8339-4b93-8721-6316681aa11f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:48:06.300654 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e4d478db-8339-4b93-8721-6316681aa11f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:48:06.308051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4d478db-8339-4b93-8721-6316681aa11f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:06.308424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4d478db-8339-4b93-8721-6316681aa11f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:06.309181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4d478db-8339-4b93-8721-6316681aa11f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:06.309618 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e4d478db-8339-4b93-8721-6316681aa11f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:06.362336 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e4d478db-8339-4b93-8721-6316681aa11f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34/action" status: 200 len: 24574 microversion: 2.1 time: 0.071009 Jul 25 13:48:06.363033 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3515/6955] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:48:06 2022] POST /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34/action => generated 24574 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:48:17.440878 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ac11f56b-11d8-437c-a102-5e0f83cab95b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:48:17.443158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ac11f56b-11d8-437c-a102-5e0f83cab95b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:48:17.445238 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:48:17.445903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=36 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:48:17.453096 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ac11f56b-11d8-437c-a102-5e0f83cab95b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:17.453555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ac11f56b-11d8-437c-a102-5e0f83cab95b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:17.454477 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ac11f56b-11d8-437c-a102-5e0f83cab95b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:17.454992 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ac11f56b-11d8-437c-a102-5e0f83cab95b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:17.536420 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ac11f56b-11d8-437c-a102-5e0f83cab95b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34/action" status: 202 len: 0 microversion: 2.1 time: 0.099285 Jul 25 13:48:17.537436 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3441/6956] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:48:17 2022] POST /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:48:17.548503 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3b966e60-202e-4940-9549-b193b5efdf99 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:48:17.549630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3b966e60-202e-4940-9549-b193b5efdf99 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:48:17.553179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:48:17.554051 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:48:17.562680 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b966e60-202e-4940-9549-b193b5efdf99 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:17.563339 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b966e60-202e-4940-9549-b193b5efdf99 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:17.564712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b966e60-202e-4940-9549-b193b5efdf99 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:17.565464 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b966e60-202e-4940-9549-b193b5efdf99 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:17.877285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3b966e60-202e-4940-9549-b193b5efdf99 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:48:17.886332 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3b966e60-202e-4940-9549-b193b5efdf99 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1674 microversion: 2.1 time: 0.342787 Jul 25 13:48:17.887134 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3516/6957] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:48:17 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1674 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:48:18.910759 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1d612f3b-df14-4500-8406-85874444dea1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:48:18.911521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1d612f3b-df14-4500-8406-85874444dea1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:48:18.918474 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d612f3b-df14-4500-8406-85874444dea1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:18.918934 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d612f3b-df14-4500-8406-85874444dea1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:18.919704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d612f3b-df14-4500-8406-85874444dea1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:18.920146 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1d612f3b-df14-4500-8406-85874444dea1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:19.058021 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1d612f3b-df14-4500-8406-85874444dea1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:48:19.066222 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1d612f3b-df14-4500-8406-85874444dea1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1679 microversion: 2.1 time: 0.161170 Jul 25 13:48:19.066819 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3442/6958] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:48:18 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:48:20.089441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1df31b6f-69f2-45db-a682-0688b92da7c6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:48:20.090212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1df31b6f-69f2-45db-a682-0688b92da7c6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:48:20.098722 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1df31b6f-69f2-45db-a682-0688b92da7c6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:20.099178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1df31b6f-69f2-45db-a682-0688b92da7c6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:20.099956 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1df31b6f-69f2-45db-a682-0688b92da7c6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:20.100394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1df31b6f-69f2-45db-a682-0688b92da7c6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:20.239897 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1df31b6f-69f2-45db-a682-0688b92da7c6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:48:20.247919 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1df31b6f-69f2-45db-a682-0688b92da7c6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1679 microversion: 2.1 time: 0.162676 Jul 25 13:48:20.248500 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3517/6959] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:48:20 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:48:21.270483 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-574991e3-cc15-41d1-a742-eb3593727826 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:48:21.271086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-574991e3-cc15-41d1-a742-eb3593727826 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:48:21.278245 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-574991e3-cc15-41d1-a742-eb3593727826 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:21.278706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-574991e3-cc15-41d1-a742-eb3593727826 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:21.279488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-574991e3-cc15-41d1-a742-eb3593727826 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:21.279935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-574991e3-cc15-41d1-a742-eb3593727826 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:21.414354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-574991e3-cc15-41d1-a742-eb3593727826 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:48:21.422346 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-574991e3-cc15-41d1-a742-eb3593727826 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1679 microversion: 2.1 time: 0.156192 Jul 25 13:48:21.422933 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3443/6960] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:48:21 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:48:22.445104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9da04287-b991-44cf-8b68-52a87032d29a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:48:22.446202 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9da04287-b991-44cf-8b68-52a87032d29a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:48:22.453982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9da04287-b991-44cf-8b68-52a87032d29a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:22.454437 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9da04287-b991-44cf-8b68-52a87032d29a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:22.455218 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9da04287-b991-44cf-8b68-52a87032d29a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:22.455660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9da04287-b991-44cf-8b68-52a87032d29a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:22.594318 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9da04287-b991-44cf-8b68-52a87032d29a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:48:22.602510 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9da04287-b991-44cf-8b68-52a87032d29a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1679 microversion: 2.1 time: 0.161747 Jul 25 13:48:22.603098 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3518/6961] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:48:22 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:48:23.625083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4ffdc7d4-9a09-4796-ac9d-6fb94978e8a3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:48:23.625690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4ffdc7d4-9a09-4796-ac9d-6fb94978e8a3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:48:23.633044 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ffdc7d4-9a09-4796-ac9d-6fb94978e8a3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:23.633505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ffdc7d4-9a09-4796-ac9d-6fb94978e8a3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:23.634334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ffdc7d4-9a09-4796-ac9d-6fb94978e8a3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:23.634776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4ffdc7d4-9a09-4796-ac9d-6fb94978e8a3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:23.773400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4ffdc7d4-9a09-4796-ac9d-6fb94978e8a3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:48:23.781218 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4ffdc7d4-9a09-4796-ac9d-6fb94978e8a3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1679 microversion: 2.1 time: 0.160409 Jul 25 13:48:23.781799 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3444/6962] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:48:23 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:48:24.802627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-908bef7c-5584-4aa3-9fe3-12310957be37 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:48:24.803314 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-908bef7c-5584-4aa3-9fe3-12310957be37 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:48:24.810950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-908bef7c-5584-4aa3-9fe3-12310957be37 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:24.811403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-908bef7c-5584-4aa3-9fe3-12310957be37 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:24.812190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-908bef7c-5584-4aa3-9fe3-12310957be37 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:24.812630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-908bef7c-5584-4aa3-9fe3-12310957be37 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:24.949508 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-908bef7c-5584-4aa3-9fe3-12310957be37 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:48:24.958234 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-908bef7c-5584-4aa3-9fe3-12310957be37 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1679 microversion: 2.1 time: 0.159658 Jul 25 13:48:24.958854 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3519/6963] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:48:24 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:48:25.979680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5611fc08-28a5-45c1-846e-a9b9588fa26d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:48:25.980283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5611fc08-28a5-45c1-846e-a9b9588fa26d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:48:25.987811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5611fc08-28a5-45c1-846e-a9b9588fa26d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:25.988277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5611fc08-28a5-45c1-846e-a9b9588fa26d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:25.989085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5611fc08-28a5-45c1-846e-a9b9588fa26d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:25.989557 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5611fc08-28a5-45c1-846e-a9b9588fa26d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:26.131611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5611fc08-28a5-45c1-846e-a9b9588fa26d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:48:26.139772 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5611fc08-28a5-45c1-846e-a9b9588fa26d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1679 microversion: 2.1 time: 0.164055 Jul 25 13:48:26.140392 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3445/6964] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:48:25 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:48:27.162121 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a35bffa1-e671-4123-88c2-59a22df4b383 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:48:27.162748 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a35bffa1-e671-4123-88c2-59a22df4b383 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:48:27.170163 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a35bffa1-e671-4123-88c2-59a22df4b383 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:27.170608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a35bffa1-e671-4123-88c2-59a22df4b383 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:27.171379 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a35bffa1-e671-4123-88c2-59a22df4b383 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:27.171815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a35bffa1-e671-4123-88c2-59a22df4b383 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:27.306605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a35bffa1-e671-4123-88c2-59a22df4b383 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:48:27.314354 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a35bffa1-e671-4123-88c2-59a22df4b383 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1679 microversion: 2.1 time: 0.156280 Jul 25 13:48:27.314932 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3520/6965] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:48:27 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:48:28.336540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bfc3348d-5fd4-45ec-8e82-de8e459bd669 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:48:28.337163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bfc3348d-5fd4-45ec-8e82-de8e459bd669 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:48:28.344814 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bfc3348d-5fd4-45ec-8e82-de8e459bd669 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:28.345580 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bfc3348d-5fd4-45ec-8e82-de8e459bd669 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:28.346767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bfc3348d-5fd4-45ec-8e82-de8e459bd669 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:28.347310 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bfc3348d-5fd4-45ec-8e82-de8e459bd669 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:28.483961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bfc3348d-5fd4-45ec-8e82-de8e459bd669 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:48:28.491839 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bfc3348d-5fd4-45ec-8e82-de8e459bd669 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1679 microversion: 2.1 time: 0.159320 Jul 25 13:48:28.492415 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3446/6966] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:48:28 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:48:29.512982 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-91eb36ea-05c4-4e25-b9a8-1a164eff3107 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:48:29.513633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-91eb36ea-05c4-4e25-b9a8-1a164eff3107 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:48:29.521261 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91eb36ea-05c4-4e25-b9a8-1a164eff3107 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:29.521720 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91eb36ea-05c4-4e25-b9a8-1a164eff3107 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:29.522527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91eb36ea-05c4-4e25-b9a8-1a164eff3107 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:29.522964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-91eb36ea-05c4-4e25-b9a8-1a164eff3107 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:29.658214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-91eb36ea-05c4-4e25-b9a8-1a164eff3107 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:48:29.666850 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-91eb36ea-05c4-4e25-b9a8-1a164eff3107 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1679 microversion: 2.1 time: 0.157911 Jul 25 13:48:29.667453 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3521/6967] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:48:29 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:48:30.688731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-eb471668-4672-4faf-9d9f-2a0e3c032c67 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:48:30.689346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-eb471668-4672-4faf-9d9f-2a0e3c032c67 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:48:30.696918 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb471668-4672-4faf-9d9f-2a0e3c032c67 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:30.697385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb471668-4672-4faf-9d9f-2a0e3c032c67 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:30.698211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb471668-4672-4faf-9d9f-2a0e3c032c67 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:30.698665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb471668-4672-4faf-9d9f-2a0e3c032c67 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:30.831484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-eb471668-4672-4faf-9d9f-2a0e3c032c67 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:48:30.840105 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-eb471668-4672-4faf-9d9f-2a0e3c032c67 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1679 microversion: 2.1 time: 0.155374 Jul 25 13:48:30.840684 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3447/6968] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:48:30 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:48:31.861746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-11138938-e4ac-4d3a-bb16-7778cc1f56aa tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:48:31.862396 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-11138938-e4ac-4d3a-bb16-7778cc1f56aa tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:48:31.869977 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11138938-e4ac-4d3a-bb16-7778cc1f56aa tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:31.870482 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11138938-e4ac-4d3a-bb16-7778cc1f56aa tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:31.871411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11138938-e4ac-4d3a-bb16-7778cc1f56aa tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:31.871876 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-11138938-e4ac-4d3a-bb16-7778cc1f56aa tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:32.013685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-11138938-e4ac-4d3a-bb16-7778cc1f56aa tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:48:32.021454 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-11138938-e4ac-4d3a-bb16-7778cc1f56aa tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1679 microversion: 2.1 time: 0.163788 Jul 25 13:48:32.022086 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3522/6969] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:48:31 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:48:33.043013 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c8510c69-ca33-42b2-9f7d-c2070ea52547 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:48:33.043651 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c8510c69-ca33-42b2-9f7d-c2070ea52547 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:48:33.051797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8510c69-ca33-42b2-9f7d-c2070ea52547 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:33.052269 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8510c69-ca33-42b2-9f7d-c2070ea52547 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:33.053066 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8510c69-ca33-42b2-9f7d-c2070ea52547 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:33.053523 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c8510c69-ca33-42b2-9f7d-c2070ea52547 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:33.192436 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c8510c69-ca33-42b2-9f7d-c2070ea52547 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:48:33.200254 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c8510c69-ca33-42b2-9f7d-c2070ea52547 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1679 microversion: 2.1 time: 0.161220 Jul 25 13:48:33.200842 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3448/6970] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:48:33 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:48:34.221807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-896012e0-65fd-4f93-8b22-6bb7c47e2e14 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:48:34.222464 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-896012e0-65fd-4f93-8b22-6bb7c47e2e14 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:48:34.230167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-896012e0-65fd-4f93-8b22-6bb7c47e2e14 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:34.230623 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-896012e0-65fd-4f93-8b22-6bb7c47e2e14 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:34.231397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-896012e0-65fd-4f93-8b22-6bb7c47e2e14 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:34.231840 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-896012e0-65fd-4f93-8b22-6bb7c47e2e14 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:34.376273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-896012e0-65fd-4f93-8b22-6bb7c47e2e14 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:48:34.385300 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-896012e0-65fd-4f93-8b22-6bb7c47e2e14 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1682 microversion: 2.1 time: 0.167444 Jul 25 13:48:34.385892 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3523/6971] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:48:34 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:48:58.616259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a0a1d18e-8d4b-4a1d-8e60-2d35dcaa3c9b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:48:58.618572 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a0a1d18e-8d4b-4a1d-8e60-2d35dcaa3c9b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:48:58.621099 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=16 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:48:58.621775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:48:58.627588 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a0a1d18e-8d4b-4a1d-8e60-2d35dcaa3c9b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:58.628038 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a0a1d18e-8d4b-4a1d-8e60-2d35dcaa3c9b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:58.628857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a0a1d18e-8d4b-4a1d-8e60-2d35dcaa3c9b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:48:58.629300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a0a1d18e-8d4b-4a1d-8e60-2d35dcaa3c9b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:48:58.695728 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a0a1d18e-8d4b-4a1d-8e60-2d35dcaa3c9b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34/action" status: 200 len: 69007 microversion: 2.1 time: 0.083791 Jul 25 13:48:58.696580 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3449/6972] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:48:58 2022] POST /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34/action => generated 69007 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:49:06.230334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-52f85893-f071-4ba5-90bf-2e1252be7dc0 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:49:06.230872 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-52f85893-f071-4ba5-90bf-2e1252be7dc0 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:49:06.233232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=16 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:49:06.233906 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=48 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:49:06.246052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-52f85893-f071-4ba5-90bf-2e1252be7dc0 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:06.246780 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-52f85893-f071-4ba5-90bf-2e1252be7dc0 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:06.247815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-52f85893-f071-4ba5-90bf-2e1252be7dc0 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:06.248458 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-52f85893-f071-4ba5-90bf-2e1252be7dc0 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:06.275336 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-52f85893-f071-4ba5-90bf-2e1252be7dc0 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:49:06.322860 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-043bd5ed-283f-4ab3-9837-9457960513ac req-9a09c59b-7da7-4b95-b36b-d26896799c33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08d60199-e00d-4423-8411-4ff4d7976d34", "tag": "99ee4793-cb21-419b-89db-bf3aaf86cdde"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:49:06.334011 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-043bd5ed-283f-4ab3-9837-9457960513ac req-9a09c59b-7da7-4b95-b36b-d26896799c33 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:06.334491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-043bd5ed-283f-4ab3-9837-9457960513ac req-9a09c59b-7da7-4b95-b36b-d26896799c33 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:06.345781 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-043bd5ed-283f-4ab3-9837-9457960513ac req-9a09c59b-7da7-4b95-b36b-d26896799c33 service nova] Creating event network-changed:99ee4793-cb21-419b-89db-bf3aaf86cdde for instance 08d60199-e00d-4423-8411-4ff4d7976d34 on n-h1-848886-15 Jul 25 13:49:06.361824 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-043bd5ed-283f-4ab3-9837-9457960513ac req-9a09c59b-7da7-4b95-b36b-d26896799c33 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124836 Jul 25 13:49:06.362507 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3450/6973] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:49:06.369207 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-52f85893-f071-4ba5-90bf-2e1252be7dc0 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "DELETE /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 204 len: 0 microversion: 2.1 time: 0.142709 Jul 25 13:49:06.370002 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3524/6974] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:49:06 2022] DELETE /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:49:06.380274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-455e3ec9-eef3-4e14-adc1-755cd300dd25 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:49:06.381121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-455e3ec9-eef3-4e14-adc1-755cd300dd25 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:49:06.387856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-455e3ec9-eef3-4e14-adc1-755cd300dd25 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:06.388551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-455e3ec9-eef3-4e14-adc1-755cd300dd25 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:06.389330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-455e3ec9-eef3-4e14-adc1-755cd300dd25 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:06.389971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-455e3ec9-eef3-4e14-adc1-755cd300dd25 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:06.535445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-455e3ec9-eef3-4e14-adc1-755cd300dd25 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:49:06.543954 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-455e3ec9-eef3-4e14-adc1-755cd300dd25 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1688 microversion: 2.1 time: 0.169304 Jul 25 13:49:06.544568 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3451/6975] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:49:06 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:49:07.568855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5d002493-f33b-4416-89e8-f833288d4501 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:49:07.569434 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5d002493-f33b-4416-89e8-f833288d4501 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:49:07.579573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d002493-f33b-4416-89e8-f833288d4501 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:07.580030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d002493-f33b-4416-89e8-f833288d4501 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:07.580807 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d002493-f33b-4416-89e8-f833288d4501 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:07.581247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d002493-f33b-4416-89e8-f833288d4501 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:07.810256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5d002493-f33b-4416-89e8-f833288d4501 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:49:07.824954 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5d002493-f33b-4416-89e8-f833288d4501 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1688 microversion: 2.1 time: 0.261370 Jul 25 13:49:07.825470 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3525/6976] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:49:07 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1688 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:49:08.472865 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-fb02f0d9-f3e6-4a7b-b767-d6a5eb446743 req-b86cc0e8-08a6-4408-b1b6-69880c4bcadc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08d60199-e00d-4423-8411-4ff4d7976d34", "name": "network-vif-deleted", "tag": "99ee4793-cb21-419b-89db-bf3aaf86cdde"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:49:08.489815 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fb02f0d9-f3e6-4a7b-b767-d6a5eb446743 req-b86cc0e8-08a6-4408-b1b6-69880c4bcadc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:08.490383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fb02f0d9-f3e6-4a7b-b767-d6a5eb446743 req-b86cc0e8-08a6-4408-b1b6-69880c4bcadc service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:08.505824 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-fb02f0d9-f3e6-4a7b-b767-d6a5eb446743 req-b86cc0e8-08a6-4408-b1b6-69880c4bcadc service nova] Creating event network-vif-deleted:99ee4793-cb21-419b-89db-bf3aaf86cdde for instance 08d60199-e00d-4423-8411-4ff4d7976d34 on n-h1-848886-15 Jul 25 13:49:08.511285 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-fb02f0d9-f3e6-4a7b-b767-d6a5eb446743 req-b86cc0e8-08a6-4408-b1b6-69880c4bcadc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043966 Jul 25 13:49:08.511953 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3452/6977] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:49:08.849624 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4a69a5b7-eb6b-454e-8476-5799b5d52d85 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:49:08.850964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4a69a5b7-eb6b-454e-8476-5799b5d52d85 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:49:08.860004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a69a5b7-eb6b-454e-8476-5799b5d52d85 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:08.860591 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a69a5b7-eb6b-454e-8476-5799b5d52d85 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:08.861394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a69a5b7-eb6b-454e-8476-5799b5d52d85 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:08.861855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a69a5b7-eb6b-454e-8476-5799b5d52d85 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:08.896751 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a69a5b7-eb6b-454e-8476-5799b5d52d85 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:08.897216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a69a5b7-eb6b-454e-8476-5799b5d52d85 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:08.897690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-4a69a5b7-eb6b-454e-8476-5799b5d52d85 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lazy-loading 'fault' on Instance uuid 08d60199-e00d-4423-8411-4ff4d7976d34 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:49:08.942033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4a69a5b7-eb6b-454e-8476-5799b5d52d85 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:49:08.949649 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4a69a5b7-eb6b-454e-8476-5799b5d52d85 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 200 len: 1356 microversion: 2.1 time: 0.104278 Jul 25 13:49:08.950276 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3526/6978] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:49:08 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:49:09.973579 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dd589ae9-805a-479a-827c-d5d49ea8af0d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:49:09.974391 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dd589ae9-805a-479a-827c-d5d49ea8af0d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 08d60199-e00d-4423-8411-4ff4d7976d34] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:49:09.984048 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dd589ae9-805a-479a-827c-d5d49ea8af0d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:09.984618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dd589ae9-805a-479a-827c-d5d49ea8af0d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:09.985644 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dd589ae9-805a-479a-827c-d5d49ea8af0d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:09.986212 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-dd589ae9-805a-479a-827c-d5d49ea8af0d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:10.001726 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-dd589ae9-805a-479a-827c-d5d49ea8af0d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] HTTP exception thrown: Instance 08d60199-e00d-4423-8411-4ff4d7976d34 could not be found. Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dd589ae9-805a-479a-827c-d5d49ea8af0d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Request method failure captured: Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 HTTP/1.1 Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3p6nyr1k_mFa4TokFEOlsou6AutFycw2kIO61UeF99u26RQ-4tpsrMhICbgi-9flg72p_U8OM5XgKZ6LQr4j4tb8J14QULHs7ajP_ZgmomWC6pW8wz9n9aS-w6knWlaT3jwDpfYXaMI8wyO7_qrSx4IpgYN7bXoMCpzogGqHy3JVQbs Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 2a3ff31102b0437aba77c5efe779af7a Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1441249113 Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2a3ff31102b0437aba77c5efe779af7a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2a3ff31102b0437aba77c5efe779af7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2a3ff31102b0437aba77c5efe779af7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2a3ff31102b0437aba77c5efe779af7a"}]}] Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1441249113 Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 2a3ff31102b0437aba77c5efe779af7a Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1441249113 Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-TestNetworkAdvancedServerOps-1441249113-project Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: bc97a7b925de4cca981fe1d714f5e986 Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1441249113-project Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 08d60199-e00d-4423-8411-4ff4d7976d34 could not be found. Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '08d60199-e00d-4423-8411-4ff4d7976d34'} Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08d60199-e00d-4423-8411-4ff4d7976d34 could not be found. Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08d60199-e00d-4423-8411-4ff4d7976d34 could not be found. Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:49:10.003385 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:49:10.007972 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:49:10.007972 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:49:10.007972 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:49:10.007972 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:49:10.007972 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:49:10.007972 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:49:10.007972 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08d60199-e00d-4423-8411-4ff4d7976d34 could not be found. Jul 25 13:49:10.007972 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:49:10.007972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dd589ae9-805a-479a-827c-d5d49ea8af0d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Returning 404 to user: Instance 08d60199-e00d-4423-8411-4ff4d7976d34 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:49:10.007972 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dd589ae9-805a-479a-827c-d5d49ea8af0d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34" status: 404 len: 111 microversion: 2.1 time: 0.037154 Jul 25 13:49:10.007972 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3453/6979] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:49:09 2022] GET /compute/v2.1/servers/08d60199-e00d-4423-8411-4ff4d7976d34 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:49:13.273176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-bd90ae0a-15ce-427b-853a-6d1205789cc4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '.version_select at 0x7efcf92fe8b0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:49:13.296616 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-bd90ae0a-15ce-427b-853a-6d1205789cc4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1781118237" status: 202 len: 0 microversion: 2.1 time: 0.027179 Jul 25 13:49:13.297438 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3527/6980] 10.222.0.49 () {58 vars in 1284 bytes} [Mon Jul 25 13:49:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1781118237 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:49:13.330972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-74400d70-2cb1-4621-87df-8f44996783bd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'create', calling method: .version_select at 0x7efcf904d670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1397824396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl+0gvVflehCHJ1Ze7Xecds3ViFUt3rBYfGpSUYqzo/tQJWuJYWhGlHl0NVb4IU3Yw71Rh+S8YhlDytfB00U7sUGZ1U6yd0bvzg7N3yBBoWcfm3flTID+LJxLwWaswd1A=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:49:13.347786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-74400d70-2cb1-4621-87df-8f44996783bd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Getting quotas for project 2a3ff31102b0437aba77c5efe779af7a. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:49:13.353758 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-74400d70-2cb1-4621-87df-8f44996783bd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Getting quotas for user bc97a7b925de4cca981fe1d714f5e986 and project 2a3ff31102b0437aba77c5efe779af7a. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:49:13.379722 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-74400d70-2cb1-4621-87df-8f44996783bd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053451 Jul 25 13:49:13.380247 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3454/6981] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:49:13 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:49:18.853445 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b101b885-8d7f-4371-951f-837f042f7335 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1784275367", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "9a60d725-21e0-4a17-b192-45332b1648c9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1397824396", "security_groups": [{"name": "tempest-secgroup-smoke-12802192"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:49:18.946472 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:49:18.967258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-b101b885-8d7f-4371-951f-837f042f7335 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] validate_networks() for [('9a60d725-21e0-4a17-b192-45332b1648c9', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:49:19.479404 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-b101b885-8d7f-4371-951f-837f042f7335 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:49:19.480126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-b101b885-8d7f-4371-951f-837f042f7335 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:49:19.480770 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-b101b885-8d7f-4371-951f-837f042f7335 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:49:19.481187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-b101b885-8d7f-4371-951f-837f042f7335 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:49:19.481610 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-b101b885-8d7f-4371-951f-837f042f7335 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:49:19.493244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b101b885-8d7f-4371-951f-837f042f7335 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:19.494042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b101b885-8d7f-4371-951f-837f042f7335 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:19.495466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b101b885-8d7f-4371-951f-837f042f7335 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:19.496082 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b101b885-8d7f-4371-951f-837f042f7335 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:19.515227 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-b101b885-8d7f-4371-951f-837f042f7335 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Getting quotas for project 2a3ff31102b0437aba77c5efe779af7a. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:49:19.521000 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-b101b885-8d7f-4371-951f-837f042f7335 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Getting quotas for user bc97a7b925de4cca981fe1d714f5e986 and project 2a3ff31102b0437aba77c5efe779af7a. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:49:19.534536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b101b885-8d7f-4371-951f-837f042f7335 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:49:19.537208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b101b885-8d7f-4371-951f-837f042f7335 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:49:19.594217 n-d-848886-15 devstack@n-api.service[125884]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b101b885-8d7f-4371-951f-837f042f7335 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [1438c73f-50f7-4f8d-b941-051fecb408cd] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 13:49:20.602987 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [None req-b101b885-8d7f-4371-951f-837f042f7335 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [1438c73f-50f7-4f8d-b941-051fecb408cd] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 48006. Jul 25 13:49:20.607457 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b101b885-8d7f-4371-951f-837f042f7335 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.759395 Jul 25 13:49:20.610764 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3528/6982] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:49:18 2022] POST /compute/v2.1/servers => generated 404 bytes in 1761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:49:20.617939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=16 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:49:20.623414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7e236c34-ed13-421a-b225-5db401f6ca86 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:49:20.624188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7e236c34-ed13-421a-b225-5db401f6ca86 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:49:20.692255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7e236c34-ed13-421a-b225-5db401f6ca86 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:49:20.703168 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7e236c34-ed13-421a-b225-5db401f6ca86 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1267 microversion: 2.1 time: 0.087059 Jul 25 13:49:20.704150 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3455/6983] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:49:20 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:49:21.726800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f108f419-5ac9-4f25-a94a-e83a0034a758 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:49:21.727763 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f108f419-5ac9-4f25-a94a-e83a0034a758 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:49:21.736574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f108f419-5ac9-4f25-a94a-e83a0034a758 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:21.738691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f108f419-5ac9-4f25-a94a-e83a0034a758 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:21.739833 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f108f419-5ac9-4f25-a94a-e83a0034a758 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:21.740453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f108f419-5ac9-4f25-a94a-e83a0034a758 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:21.811814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f108f419-5ac9-4f25-a94a-e83a0034a758 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:49:21.820566 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f108f419-5ac9-4f25-a94a-e83a0034a758 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1325 microversion: 2.1 time: 0.099491 Jul 25 13:49:21.821522 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3529/6984] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:49:21 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1325 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:49:22.843445 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b53d5d7b-125a-4147-af7a-1247d793350c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:49:22.844205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b53d5d7b-125a-4147-af7a-1247d793350c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:49:22.852071 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b53d5d7b-125a-4147-af7a-1247d793350c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:22.852623 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b53d5d7b-125a-4147-af7a-1247d793350c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:22.853493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b53d5d7b-125a-4147-af7a-1247d793350c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:22.854062 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b53d5d7b-125a-4147-af7a-1247d793350c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:23.006352 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b53d5d7b-125a-4147-af7a-1247d793350c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:49:23.014853 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b53d5d7b-125a-4147-af7a-1247d793350c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1391 microversion: 2.1 time: 0.175602 Jul 25 13:49:23.015486 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3456/6985] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:49:22 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:49:23.483731 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-6d4400e8-3799-4a54-ac3e-544bedc20a00 req-ed28bc08-9f54-4558-9977-b3b7118fcf5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e74826f6-549c-4568-9d4f-75797db4a7ff", "tag": "cc136040-9126-47d4-a8f9-2b4ae0238768"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:49:23.495167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6d4400e8-3799-4a54-ac3e-544bedc20a00 req-ed28bc08-9f54-4558-9977-b3b7118fcf5f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:23.507673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-6d4400e8-3799-4a54-ac3e-544bedc20a00 req-ed28bc08-9f54-4558-9977-b3b7118fcf5f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:23.522643 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-6d4400e8-3799-4a54-ac3e-544bedc20a00 req-ed28bc08-9f54-4558-9977-b3b7118fcf5f service nova] Creating event network-changed:cc136040-9126-47d4-a8f9-2b4ae0238768 for instance e74826f6-549c-4568-9d4f-75797db4a7ff on n-h2-848886-15 Jul 25 13:49:23.529039 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-6d4400e8-3799-4a54-ac3e-544bedc20a00 req-ed28bc08-9f54-4558-9977-b3b7118fcf5f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051243 Jul 25 13:49:23.530008 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3530/6986] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:49:24.036303 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aba8f22e-db8e-4010-99e2-9f9d27d04ae6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:49:24.036897 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-aba8f22e-db8e-4010-99e2-9f9d27d04ae6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:49:24.045348 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aba8f22e-db8e-4010-99e2-9f9d27d04ae6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:24.045871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aba8f22e-db8e-4010-99e2-9f9d27d04ae6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:24.046770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aba8f22e-db8e-4010-99e2-9f9d27d04ae6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:24.047266 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aba8f22e-db8e-4010-99e2-9f9d27d04ae6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:24.194101 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-aba8f22e-db8e-4010-99e2-9f9d27d04ae6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:49:24.202356 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aba8f22e-db8e-4010-99e2-9f9d27d04ae6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1391 microversion: 2.1 time: 0.170626 Jul 25 13:49:24.202936 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3457/6987] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:49:24 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:49:25.224959 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1f71d0ae-d154-40b9-922e-aeb7050144de tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:49:25.225576 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1f71d0ae-d154-40b9-922e-aeb7050144de tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:49:25.233330 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f71d0ae-d154-40b9-922e-aeb7050144de tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:25.234118 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f71d0ae-d154-40b9-922e-aeb7050144de tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:25.234887 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f71d0ae-d154-40b9-922e-aeb7050144de tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:25.235313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1f71d0ae-d154-40b9-922e-aeb7050144de tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:25.367839 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1f71d0ae-d154-40b9-922e-aeb7050144de tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:49:25.375754 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1f71d0ae-d154-40b9-922e-aeb7050144de tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1391 microversion: 2.1 time: 0.156009 Jul 25 13:49:25.376370 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3531/6988] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:49:25 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:49:26.398242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-be46ab87-4283-49bb-9f25-3f92357ee4e8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:49:26.398767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-be46ab87-4283-49bb-9f25-3f92357ee4e8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:49:26.406278 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-be46ab87-4283-49bb-9f25-3f92357ee4e8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:26.406758 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-be46ab87-4283-49bb-9f25-3f92357ee4e8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:26.407537 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-be46ab87-4283-49bb-9f25-3f92357ee4e8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:26.407989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-be46ab87-4283-49bb-9f25-3f92357ee4e8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:26.552687 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-be46ab87-4283-49bb-9f25-3f92357ee4e8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:49:26.560503 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-be46ab87-4283-49bb-9f25-3f92357ee4e8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1391 microversion: 2.1 time: 0.166723 Jul 25 13:49:26.561072 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3458/6989] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:49:26 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:49:27.582103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c810b7f4-b1bb-4a60-9741-f50f573ccfd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:49:27.582728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c810b7f4-b1bb-4a60-9741-f50f573ccfd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:49:27.590528 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c810b7f4-b1bb-4a60-9741-f50f573ccfd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:27.590978 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c810b7f4-b1bb-4a60-9741-f50f573ccfd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:27.591737 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c810b7f4-b1bb-4a60-9741-f50f573ccfd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:27.592171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c810b7f4-b1bb-4a60-9741-f50f573ccfd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:27.739037 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c810b7f4-b1bb-4a60-9741-f50f573ccfd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:49:27.747095 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c810b7f4-b1bb-4a60-9741-f50f573ccfd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1391 microversion: 2.1 time: 0.169088 Jul 25 13:49:27.747776 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3532/6990] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:49:27 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:49:28.771297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-50fa9a43-c00e-44c1-ad66-02ab06ae217c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:49:28.771972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-50fa9a43-c00e-44c1-ad66-02ab06ae217c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:49:28.774712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:49:28.780272 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50fa9a43-c00e-44c1-ad66-02ab06ae217c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:28.780745 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50fa9a43-c00e-44c1-ad66-02ab06ae217c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:28.781513 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50fa9a43-c00e-44c1-ad66-02ab06ae217c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:28.781992 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-50fa9a43-c00e-44c1-ad66-02ab06ae217c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:28.924493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-50fa9a43-c00e-44c1-ad66-02ab06ae217c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:49:28.935334 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-50fa9a43-c00e-44c1-ad66-02ab06ae217c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1391 microversion: 2.1 time: 0.169225 Jul 25 13:49:28.935916 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3459/6991] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:49:28 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:49:29.457873 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-4faeb350-cee2-44fa-a5b8-7bb6dbd1fee1 req-5888e280-2b9d-4a09-8d85-03f63269c47a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e74826f6-549c-4568-9d4f-75797db4a7ff", "name": "network-vif-plugged", "status": "completed", "tag": "cc136040-9126-47d4-a8f9-2b4ae0238768"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:49:29.469524 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4faeb350-cee2-44fa-a5b8-7bb6dbd1fee1 req-5888e280-2b9d-4a09-8d85-03f63269c47a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:29.469997 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-4faeb350-cee2-44fa-a5b8-7bb6dbd1fee1 req-5888e280-2b9d-4a09-8d85-03f63269c47a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:29.481523 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-4faeb350-cee2-44fa-a5b8-7bb6dbd1fee1 req-5888e280-2b9d-4a09-8d85-03f63269c47a service nova] Creating event network-vif-plugged:cc136040-9126-47d4-a8f9-2b4ae0238768 for instance e74826f6-549c-4568-9d4f-75797db4a7ff on n-h2-848886-15 Jul 25 13:49:29.488829 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-4faeb350-cee2-44fa-a5b8-7bb6dbd1fee1 req-5888e280-2b9d-4a09-8d85-03f63269c47a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033478 Jul 25 13:49:29.488829 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3533/6992] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:49:29.960393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cb49a4ed-938e-4c13-acf9-633450a85ac5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:49:29.961437 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cb49a4ed-938e-4c13-acf9-633450a85ac5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:49:29.973070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb49a4ed-938e-4c13-acf9-633450a85ac5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:29.973545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb49a4ed-938e-4c13-acf9-633450a85ac5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:29.974369 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb49a4ed-938e-4c13-acf9-633450a85ac5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:29.974811 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cb49a4ed-938e-4c13-acf9-633450a85ac5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:30.135908 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cb49a4ed-938e-4c13-acf9-633450a85ac5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:49:30.143895 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cb49a4ed-938e-4c13-acf9-633450a85ac5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1391 microversion: 2.1 time: 0.190226 Jul 25 13:49:30.144484 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3460/6993] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:49:29 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1391 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:49:31.165929 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5a027f6f-7155-431e-ac3d-68545b053cda tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:49:31.166633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5a027f6f-7155-431e-ac3d-68545b053cda tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:49:31.168609 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:49:31.169286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:49:31.176363 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a027f6f-7155-431e-ac3d-68545b053cda tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:31.176811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a027f6f-7155-431e-ac3d-68545b053cda tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:31.177584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a027f6f-7155-431e-ac3d-68545b053cda tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:31.178050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5a027f6f-7155-431e-ac3d-68545b053cda tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:31.308555 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5a027f6f-7155-431e-ac3d-68545b053cda tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:49:31.316389 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5a027f6f-7155-431e-ac3d-68545b053cda tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1564 microversion: 2.1 time: 0.154822 Jul 25 13:49:31.316971 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3534/6994] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:49:31 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:49:31.340318 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fcd5a18b-bd25-4aa3-95b4-d841e6d46175 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:49:31.340928 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fcd5a18b-bd25-4aa3-95b4-d841e6d46175 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:49:31.343327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:49:31.349751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fcd5a18b-bd25-4aa3-95b4-d841e6d46175 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:31.350234 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fcd5a18b-bd25-4aa3-95b4-d841e6d46175 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:31.351013 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fcd5a18b-bd25-4aa3-95b4-d841e6d46175 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:31.351456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fcd5a18b-bd25-4aa3-95b4-d841e6d46175 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:31.502330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fcd5a18b-bd25-4aa3-95b4-d841e6d46175 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:49:31.510724 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fcd5a18b-bd25-4aa3-95b4-d841e6d46175 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1564 microversion: 2.1 time: 0.175519 Jul 25 13:49:31.511249 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3461/6995] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:49:31 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1564 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:49:33.171944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-71250c44-0300-4eea-b84f-c9a4df1770a8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:49:33.177547 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-086b005b-f42c-4082-b721-d698d1d230a0 req-b94b8311-4e17-4a64-a0f4-443f1b42a79a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e74826f6-549c-4568-9d4f-75797db4a7ff", "tag": "cc136040-9126-47d4-a8f9-2b4ae0238768"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:49:33.184307 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-71250c44-0300-4eea-b84f-c9a4df1770a8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:49:33.188696 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-086b005b-f42c-4082-b721-d698d1d230a0 req-b94b8311-4e17-4a64-a0f4-443f1b42a79a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:33.189154 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-086b005b-f42c-4082-b721-d698d1d230a0 req-b94b8311-4e17-4a64-a0f4-443f1b42a79a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:33.191590 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71250c44-0300-4eea-b84f-c9a4df1770a8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:33.192114 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71250c44-0300-4eea-b84f-c9a4df1770a8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:33.192977 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71250c44-0300-4eea-b84f-c9a4df1770a8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:33.193480 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-71250c44-0300-4eea-b84f-c9a4df1770a8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:33.201303 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-086b005b-f42c-4082-b721-d698d1d230a0 req-b94b8311-4e17-4a64-a0f4-443f1b42a79a service nova] Creating event network-changed:cc136040-9126-47d4-a8f9-2b4ae0238768 for instance e74826f6-549c-4568-9d4f-75797db4a7ff on n-h2-848886-15 Jul 25 13:49:33.206731 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-086b005b-f42c-4082-b721-d698d1d230a0 req-b94b8311-4e17-4a64-a0f4-443f1b42a79a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032827 Jul 25 13:49:33.207703 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3462/6996] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:49:33.338825 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-71250c44-0300-4eea-b84f-c9a4df1770a8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:49:33.348691 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-71250c44-0300-4eea-b84f-c9a4df1770a8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1564 microversion: 2.1 time: 0.180834 Jul 25 13:49:33.349915 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3535/6997] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:49:33 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1564 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:49:37.993670 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:49:37.994268 n-d-848886-15 devstack@n-api.service[125883]: Mon Jul 25 13:49:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:49:54.638555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=7 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:49:54.639297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=38 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:49:54.643798 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ba39ef64-f22f-4bb3-b65d-6c1c2606b087 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:49:54.646127 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ba39ef64-f22f-4bb3-b65d-6c1c2606b087 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:49:54.653331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba39ef64-f22f-4bb3-b65d-6c1c2606b087 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:54.653795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba39ef64-f22f-4bb3-b65d-6c1c2606b087 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:54.654616 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba39ef64-f22f-4bb3-b65d-6c1c2606b087 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:49:54.655068 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ba39ef64-f22f-4bb3-b65d-6c1c2606b087 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:49:54.708016 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ba39ef64-f22f-4bb3-b65d-6c1c2606b087 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff/action" status: 200 len: 24569 microversion: 2.1 time: 0.071234 Jul 25 13:49:54.708675 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3463/6998] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:49:54 2022] POST /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff/action => generated 24569 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:50:05.417764 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-831713d0-9a41-41ae-b8e5-b7e893f4bfbf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:50:05.420459 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-831713d0-9a41-41ae-b8e5-b7e893f4bfbf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:05.423193 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:50:05.423993 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=36 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:50:05.431003 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-831713d0-9a41-41ae-b8e5-b7e893f4bfbf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:05.431617 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-831713d0-9a41-41ae-b8e5-b7e893f4bfbf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:05.432399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-831713d0-9a41-41ae-b8e5-b7e893f4bfbf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:05.432831 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-831713d0-9a41-41ae-b8e5-b7e893f4bfbf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:05.481023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-831713d0-9a41-41ae-b8e5-b7e893f4bfbf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:05.487612 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-831713d0-9a41-41ae-b8e5-b7e893f4bfbf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Old instance type m1.heat2, new instance type m1.heat {{(pid=125884) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 13:50:05.494137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-831713d0-9a41-41ae-b8e5-b7e893f4bfbf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:50:05.494557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-831713d0-9a41-41ae-b8e5-b7e893f4bfbf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:50:05.495032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-831713d0-9a41-41ae-b8e5-b7e893f4bfbf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:50:05.495441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-831713d0-9a41-41ae-b8e5-b7e893f4bfbf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:50:05.495856 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-831713d0-9a41-41ae-b8e5-b7e893f4bfbf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:50:05.566454 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-831713d0-9a41-41ae-b8e5-b7e893f4bfbf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff/action" status: 202 len: 0 microversion: 2.1 time: 0.153996 Jul 25 13:50:05.567420 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3536/6999] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:50:05 2022] POST /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:50:05.576577 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-df8f35b1-ea79-4580-9b1b-87c6c507a2f4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:05.577509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-df8f35b1-ea79-4580-9b1b-87c6c507a2f4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:05.580605 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:50:05.581296 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=4 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:50:05.588919 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-df8f35b1-ea79-4580-9b1b-87c6c507a2f4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:05.589516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-df8f35b1-ea79-4580-9b1b-87c6c507a2f4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:05.590484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-df8f35b1-ea79-4580-9b1b-87c6c507a2f4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:05.590869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-df8f35b1-ea79-4580-9b1b-87c6c507a2f4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:05.731195 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-df8f35b1-ea79-4580-9b1b-87c6c507a2f4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:05.739864 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-df8f35b1-ea79-4580-9b1b-87c6c507a2f4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1692 microversion: 2.1 time: 0.168139 Jul 25 13:50:05.740502 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3464/7000] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:05 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:50:06.762901 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f8079895-3aef-4766-8ef3-c24e8650dc2f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:06.763607 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f8079895-3aef-4766-8ef3-c24e8650dc2f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:06.770581 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8079895-3aef-4766-8ef3-c24e8650dc2f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:06.771091 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8079895-3aef-4766-8ef3-c24e8650dc2f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:06.771891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8079895-3aef-4766-8ef3-c24e8650dc2f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:06.772589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f8079895-3aef-4766-8ef3-c24e8650dc2f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:06.915375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f8079895-3aef-4766-8ef3-c24e8650dc2f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:06.926789 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f8079895-3aef-4766-8ef3-c24e8650dc2f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1692 microversion: 2.1 time: 0.169730 Jul 25 13:50:06.927355 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3537/7001] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:06 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:50:07.953649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-72a57fe4-eef5-4cc4-b7c5-9c1519c0818a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:07.954331 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-72a57fe4-eef5-4cc4-b7c5-9c1519c0818a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:07.964830 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-72a57fe4-eef5-4cc4-b7c5-9c1519c0818a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:07.965365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-72a57fe4-eef5-4cc4-b7c5-9c1519c0818a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:07.966467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-72a57fe4-eef5-4cc4-b7c5-9c1519c0818a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:07.967047 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-72a57fe4-eef5-4cc4-b7c5-9c1519c0818a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:08.111986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-72a57fe4-eef5-4cc4-b7c5-9c1519c0818a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:08.122822 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-72a57fe4-eef5-4cc4-b7c5-9c1519c0818a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1697 microversion: 2.1 time: 0.175256 Jul 25 13:50:08.123593 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3465/7002] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:07 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1697 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:50:09.145586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1dadb98e-c40c-408e-9952-6a47748c301e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:09.146231 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1dadb98e-c40c-408e-9952-6a47748c301e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:09.154844 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dadb98e-c40c-408e-9952-6a47748c301e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:09.155293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dadb98e-c40c-408e-9952-6a47748c301e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:09.156055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dadb98e-c40c-408e-9952-6a47748c301e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:09.156490 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1dadb98e-c40c-408e-9952-6a47748c301e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:09.300429 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1dadb98e-c40c-408e-9952-6a47748c301e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:09.308287 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1dadb98e-c40c-408e-9952-6a47748c301e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1697 microversion: 2.1 time: 0.167022 Jul 25 13:50:09.308850 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3538/7003] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:09 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:50:10.329790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-658de23c-668a-43af-ad4d-d7b89d9fcb51 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:10.330522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-658de23c-668a-43af-ad4d-d7b89d9fcb51 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:10.338801 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-658de23c-668a-43af-ad4d-d7b89d9fcb51 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:10.339270 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-658de23c-668a-43af-ad4d-d7b89d9fcb51 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:10.340132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-658de23c-668a-43af-ad4d-d7b89d9fcb51 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:10.340716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-658de23c-668a-43af-ad4d-d7b89d9fcb51 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:10.483181 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-658de23c-668a-43af-ad4d-d7b89d9fcb51 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:10.491015 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-658de23c-668a-43af-ad4d-d7b89d9fcb51 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1697 microversion: 2.1 time: 0.165639 Jul 25 13:50:10.491595 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3466/7004] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:10 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:50:11.513434 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-18008b56-d57f-4e03-acd9-8b7be6f7dad1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:11.514025 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-18008b56-d57f-4e03-acd9-8b7be6f7dad1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:11.521435 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-18008b56-d57f-4e03-acd9-8b7be6f7dad1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:11.521964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-18008b56-d57f-4e03-acd9-8b7be6f7dad1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:11.522682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-18008b56-d57f-4e03-acd9-8b7be6f7dad1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:11.523122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-18008b56-d57f-4e03-acd9-8b7be6f7dad1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:12.012719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-18008b56-d57f-4e03-acd9-8b7be6f7dad1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:12.022473 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-18008b56-d57f-4e03-acd9-8b7be6f7dad1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1697 microversion: 2.1 time: 0.513193 Jul 25 13:50:12.023091 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3539/7005] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:11 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1697 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:50:13.044163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7709c349-b8d5-4987-a219-30d93b3664a5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:13.044861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7709c349-b8d5-4987-a219-30d93b3664a5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:13.052222 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7709c349-b8d5-4987-a219-30d93b3664a5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:13.052719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7709c349-b8d5-4987-a219-30d93b3664a5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:13.053494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7709c349-b8d5-4987-a219-30d93b3664a5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:13.053972 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7709c349-b8d5-4987-a219-30d93b3664a5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:13.196461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7709c349-b8d5-4987-a219-30d93b3664a5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:13.205052 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7709c349-b8d5-4987-a219-30d93b3664a5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1697 microversion: 2.1 time: 0.164853 Jul 25 13:50:13.205639 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3467/7006] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:13 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:50:14.227494 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7d61814c-e5fc-4085-9a21-77c2bfbaed40 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:14.228100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7d61814c-e5fc-4085-9a21-77c2bfbaed40 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:14.235128 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d61814c-e5fc-4085-9a21-77c2bfbaed40 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:14.235584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d61814c-e5fc-4085-9a21-77c2bfbaed40 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:14.236354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d61814c-e5fc-4085-9a21-77c2bfbaed40 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:14.236952 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d61814c-e5fc-4085-9a21-77c2bfbaed40 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:14.379949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7d61814c-e5fc-4085-9a21-77c2bfbaed40 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:14.387680 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7d61814c-e5fc-4085-9a21-77c2bfbaed40 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1697 microversion: 2.1 time: 0.164370 Jul 25 13:50:14.388280 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3540/7007] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:14 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:50:15.411131 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-713c0181-f5f6-4da0-add1-95b67cb03525 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:15.411834 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-713c0181-f5f6-4da0-add1-95b67cb03525 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:15.420958 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-713c0181-f5f6-4da0-add1-95b67cb03525 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:15.421548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-713c0181-f5f6-4da0-add1-95b67cb03525 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:15.422575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-713c0181-f5f6-4da0-add1-95b67cb03525 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:15.423227 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-713c0181-f5f6-4da0-add1-95b67cb03525 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:15.565792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-713c0181-f5f6-4da0-add1-95b67cb03525 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:15.573565 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-713c0181-f5f6-4da0-add1-95b67cb03525 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1697 microversion: 2.1 time: 0.167524 Jul 25 13:50:15.574153 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3468/7008] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:15 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:50:16.599077 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-edd27a9f-10db-43fd-9621-57b9ea15f7ab tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:16.600178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-edd27a9f-10db-43fd-9621-57b9ea15f7ab tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:16.611256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-edd27a9f-10db-43fd-9621-57b9ea15f7ab tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:16.611864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-edd27a9f-10db-43fd-9621-57b9ea15f7ab tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:16.612645 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-edd27a9f-10db-43fd-9621-57b9ea15f7ab tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:16.613065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-edd27a9f-10db-43fd-9621-57b9ea15f7ab tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:16.756944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-edd27a9f-10db-43fd-9621-57b9ea15f7ab tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:16.767498 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-edd27a9f-10db-43fd-9621-57b9ea15f7ab tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1697 microversion: 2.1 time: 0.174101 Jul 25 13:50:16.768221 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3541/7009] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:16 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1697 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:50:17.788923 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2403384e-a4f2-4d86-a5e7-8a242e0acb64 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:17.789521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2403384e-a4f2-4d86-a5e7-8a242e0acb64 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:17.796943 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2403384e-a4f2-4d86-a5e7-8a242e0acb64 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:17.797400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2403384e-a4f2-4d86-a5e7-8a242e0acb64 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:17.798204 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2403384e-a4f2-4d86-a5e7-8a242e0acb64 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:17.798708 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2403384e-a4f2-4d86-a5e7-8a242e0acb64 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:17.946947 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2403384e-a4f2-4d86-a5e7-8a242e0acb64 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:17.956202 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2403384e-a4f2-4d86-a5e7-8a242e0acb64 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1697 microversion: 2.1 time: 0.171249 Jul 25 13:50:17.956784 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3469/7010] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:17 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:50:18.979292 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-960be348-5767-44e3-b6cb-06e4755042f1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:18.980022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-960be348-5767-44e3-b6cb-06e4755042f1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:18.989127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-960be348-5767-44e3-b6cb-06e4755042f1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:18.989582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-960be348-5767-44e3-b6cb-06e4755042f1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:18.990424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-960be348-5767-44e3-b6cb-06e4755042f1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:18.990846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-960be348-5767-44e3-b6cb-06e4755042f1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:19.134435 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-960be348-5767-44e3-b6cb-06e4755042f1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:19.142589 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-960be348-5767-44e3-b6cb-06e4755042f1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1697 microversion: 2.1 time: 0.168741 Jul 25 13:50:19.143239 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3542/7011] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:18 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1697 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:50:20.168191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8a8c86bc-1bd9-4c38-8735-b79ca14ca8d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:20.168854 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8a8c86bc-1bd9-4c38-8735-b79ca14ca8d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:20.176410 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8a8c86bc-1bd9-4c38-8735-b79ca14ca8d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:20.176880 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8a8c86bc-1bd9-4c38-8735-b79ca14ca8d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:20.177662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8a8c86bc-1bd9-4c38-8735-b79ca14ca8d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:20.178252 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8a8c86bc-1bd9-4c38-8735-b79ca14ca8d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:20.320166 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8a8c86bc-1bd9-4c38-8735-b79ca14ca8d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:20.332060 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8a8c86bc-1bd9-4c38-8735-b79ca14ca8d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1697 microversion: 2.1 time: 0.167956 Jul 25 13:50:20.332714 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3470/7012] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:20 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:50:21.354154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0e514808-d0d5-4cd1-825a-c50fe9c794fd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:21.354910 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0e514808-d0d5-4cd1-825a-c50fe9c794fd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:21.362424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e514808-d0d5-4cd1-825a-c50fe9c794fd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:21.362871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e514808-d0d5-4cd1-825a-c50fe9c794fd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:21.363785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e514808-d0d5-4cd1-825a-c50fe9c794fd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:21.364224 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0e514808-d0d5-4cd1-825a-c50fe9c794fd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:21.502689 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0e514808-d0d5-4cd1-825a-c50fe9c794fd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:21.510944 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0e514808-d0d5-4cd1-825a-c50fe9c794fd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1697 microversion: 2.1 time: 0.160812 Jul 25 13:50:21.511527 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3543/7013] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:21 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:50:22.535918 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-39271dcf-770c-4554-9637-4336e208bbbb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:22.536629 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-39271dcf-770c-4554-9637-4336e208bbbb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:22.547814 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39271dcf-770c-4554-9637-4336e208bbbb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:22.548554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39271dcf-770c-4554-9637-4336e208bbbb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:22.549607 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39271dcf-770c-4554-9637-4336e208bbbb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:22.550086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-39271dcf-770c-4554-9637-4336e208bbbb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:22.698218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-39271dcf-770c-4554-9637-4336e208bbbb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:22.708003 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-39271dcf-770c-4554-9637-4336e208bbbb tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1697 microversion: 2.1 time: 0.178410 Jul 25 13:50:22.708587 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3471/7014] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:22 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:50:23.729465 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d5782336-9db7-49e9-b88d-bc6bff1458d4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:23.730192 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d5782336-9db7-49e9-b88d-bc6bff1458d4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:23.737860 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5782336-9db7-49e9-b88d-bc6bff1458d4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:23.738325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5782336-9db7-49e9-b88d-bc6bff1458d4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:23.739099 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5782336-9db7-49e9-b88d-bc6bff1458d4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:23.739533 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5782336-9db7-49e9-b88d-bc6bff1458d4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:23.894651 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d5782336-9db7-49e9-b88d-bc6bff1458d4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:23.907032 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d5782336-9db7-49e9-b88d-bc6bff1458d4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1697 microversion: 2.1 time: 0.181262 Jul 25 13:50:23.907861 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3544/7015] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:23 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1697 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:50:24.928283 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fbab5b99-4b93-4edd-8c52-087d32683bc3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:24.928989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fbab5b99-4b93-4edd-8c52-087d32683bc3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:24.936627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fbab5b99-4b93-4edd-8c52-087d32683bc3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:24.937099 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fbab5b99-4b93-4edd-8c52-087d32683bc3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:24.937914 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fbab5b99-4b93-4edd-8c52-087d32683bc3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:24.938366 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fbab5b99-4b93-4edd-8c52-087d32683bc3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:25.076326 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fbab5b99-4b93-4edd-8c52-087d32683bc3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:25.084518 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fbab5b99-4b93-4edd-8c52-087d32683bc3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1696 microversion: 2.1 time: 0.160277 Jul 25 13:50:25.085155 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3472/7016] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:24 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:50:25.582440 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-1f51e8d1-d6fa-4b47-9b45-9155d95e4f20 req-6ce138bb-6bc9-4837-8375-6a28b5590114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e74826f6-549c-4568-9d4f-75797db4a7ff", "name": "network-vif-unplugged", "status": "completed", "tag": "cc136040-9126-47d4-a8f9-2b4ae0238768"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:50:25.592890 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-1f51e8d1-d6fa-4b47-9b45-9155d95e4f20 req-6ce138bb-6bc9-4837-8375-6a28b5590114 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:25.593387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-1f51e8d1-d6fa-4b47-9b45-9155d95e4f20 req-6ce138bb-6bc9-4837-8375-6a28b5590114 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:25.606289 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-1f51e8d1-d6fa-4b47-9b45-9155d95e4f20 req-6ce138bb-6bc9-4837-8375-6a28b5590114 service nova] Creating event network-vif-unplugged:cc136040-9126-47d4-a8f9-2b4ae0238768 for instance e74826f6-549c-4568-9d4f-75797db4a7ff on n-h1-848886-15 Jul 25 13:50:25.612409 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [req-1f51e8d1-d6fa-4b47-9b45-9155d95e4f20 req-6ce138bb-6bc9-4837-8375-6a28b5590114 service nova] Instance e74826f6-549c-4568-9d4f-75797db4a7ff is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:50:25.623362 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-1f51e8d1-d6fa-4b47-9b45-9155d95e4f20 req-6ce138bb-6bc9-4837-8375-6a28b5590114 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045043 Jul 25 13:50:25.624337 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3545/7017] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:50:26.106694 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7c63e2e8-1e26-4094-ad54-e771c8cb9daf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:26.107942 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7c63e2e8-1e26-4094-ad54-e771c8cb9daf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:26.115290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c63e2e8-1e26-4094-ad54-e771c8cb9daf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:26.115748 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c63e2e8-1e26-4094-ad54-e771c8cb9daf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:26.121943 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c63e2e8-1e26-4094-ad54-e771c8cb9daf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:26.122652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7c63e2e8-1e26-4094-ad54-e771c8cb9daf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:26.272999 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7c63e2e8-1e26-4094-ad54-e771c8cb9daf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:26.281119 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7c63e2e8-1e26-4094-ad54-e771c8cb9daf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1696 microversion: 2.1 time: 0.178473 Jul 25 13:50:26.281690 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3473/7018] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:26 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:50:27.309491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-30a07736-d61c-4896-bc04-c534df2e7c52 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:27.310507 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-30a07736-d61c-4896-bc04-c534df2e7c52 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:27.321684 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-30a07736-d61c-4896-bc04-c534df2e7c52 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:27.322422 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-30a07736-d61c-4896-bc04-c534df2e7c52 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:27.323573 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-30a07736-d61c-4896-bc04-c534df2e7c52 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:27.324240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-30a07736-d61c-4896-bc04-c534df2e7c52 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:27.473452 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-30a07736-d61c-4896-bc04-c534df2e7c52 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:27.481858 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-30a07736-d61c-4896-bc04-c534df2e7c52 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1694 microversion: 2.1 time: 0.180503 Jul 25 13:50:27.481858 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3546/7019] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:27 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1694 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:50:27.643656 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-1729f094-6a3b-4776-8339-b8c50f51f859 req-06dc1fcf-7bbb-4327-9da5-18b778656b59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e74826f6-549c-4568-9d4f-75797db4a7ff", "tag": "cc136040-9126-47d4-a8f9-2b4ae0238768"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:50:27.659672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-1729f094-6a3b-4776-8339-b8c50f51f859 req-06dc1fcf-7bbb-4327-9da5-18b778656b59 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:27.660062 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-1729f094-6a3b-4776-8339-b8c50f51f859 req-06dc1fcf-7bbb-4327-9da5-18b778656b59 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:27.671974 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-1729f094-6a3b-4776-8339-b8c50f51f859 req-06dc1fcf-7bbb-4327-9da5-18b778656b59 service nova] Creating event network-changed:cc136040-9126-47d4-a8f9-2b4ae0238768 for instance e74826f6-549c-4568-9d4f-75797db4a7ff on n-h1-848886-15 Jul 25 13:50:27.678461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [req-1729f094-6a3b-4776-8339-b8c50f51f859 req-06dc1fcf-7bbb-4327-9da5-18b778656b59 service nova] Instance e74826f6-549c-4568-9d4f-75797db4a7ff is migrating within the same cell, copying events to all relevant hosts: {'n-h1-848886-15', 'n-h2-848886-15'} {{(pid=125883) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 13:50:27.689681 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-1729f094-6a3b-4776-8339-b8c50f51f859 req-06dc1fcf-7bbb-4327-9da5-18b778656b59 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052298 Jul 25 13:50:27.690556 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3474/7020] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:50:28.503776 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1064f569-0eb2-4fb5-9e98-c3294e79cab6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:28.504393 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1064f569-0eb2-4fb5-9e98-c3294e79cab6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:28.511719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1064f569-0eb2-4fb5-9e98-c3294e79cab6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:28.512195 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1064f569-0eb2-4fb5-9e98-c3294e79cab6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:28.512964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1064f569-0eb2-4fb5-9e98-c3294e79cab6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:28.513401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1064f569-0eb2-4fb5-9e98-c3294e79cab6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:28.660366 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1064f569-0eb2-4fb5-9e98-c3294e79cab6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:28.671889 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1064f569-0eb2-4fb5-9e98-c3294e79cab6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1691 microversion: 2.1 time: 0.172636 Jul 25 13:50:28.672493 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3547/7021] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:28 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:50:28.693094 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ee24a368-7441-4fbb-89e7-027de772aae6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:50:28.693724 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ee24a368-7441-4fbb-89e7-027de772aae6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:28.701672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee24a368-7441-4fbb-89e7-027de772aae6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:28.702167 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee24a368-7441-4fbb-89e7-027de772aae6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:28.702948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee24a368-7441-4fbb-89e7-027de772aae6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:28.703403 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ee24a368-7441-4fbb-89e7-027de772aae6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:28.767909 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ee24a368-7441-4fbb-89e7-027de772aae6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff/action" status: 204 len: 0 microversion: 2.1 time: 0.078083 Jul 25 13:50:28.768500 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3475/7022] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:50:28 2022] POST /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:50:28.776888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0ec2ab57-44ed-410b-a7af-b0bec8d4ce06 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:28.777603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0ec2ab57-44ed-410b-a7af-b0bec8d4ce06 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:28.784024 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ec2ab57-44ed-410b-a7af-b0bec8d4ce06 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:28.784615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ec2ab57-44ed-410b-a7af-b0bec8d4ce06 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:28.785436 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ec2ab57-44ed-410b-a7af-b0bec8d4ce06 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:28.785973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0ec2ab57-44ed-410b-a7af-b0bec8d4ce06 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:28.922424 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0ec2ab57-44ed-410b-a7af-b0bec8d4ce06 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:28.930178 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0ec2ab57-44ed-410b-a7af-b0bec8d4ce06 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1691 microversion: 2.1 time: 0.157239 Jul 25 13:50:28.930746 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3548/7023] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:28 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:50:28.951922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-29b88b28-f7de-4995-87fa-dd8bd3425886 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:28.952644 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-29b88b28-f7de-4995-87fa-dd8bd3425886 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:28.960070 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29b88b28-f7de-4995-87fa-dd8bd3425886 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:28.960545 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29b88b28-f7de-4995-87fa-dd8bd3425886 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:28.961342 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29b88b28-f7de-4995-87fa-dd8bd3425886 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:28.961796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29b88b28-f7de-4995-87fa-dd8bd3425886 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:29.105658 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-29b88b28-f7de-4995-87fa-dd8bd3425886 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:29.113983 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-29b88b28-f7de-4995-87fa-dd8bd3425886 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1691 microversion: 2.1 time: 0.166800 Jul 25 13:50:29.114585 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3476/7024] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:28 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:50:30.136623 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-32fdc782-95b9-461e-8884-3dfed0c178b1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:30.137230 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-32fdc782-95b9-461e-8884-3dfed0c178b1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:30.144712 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32fdc782-95b9-461e-8884-3dfed0c178b1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:30.145169 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32fdc782-95b9-461e-8884-3dfed0c178b1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:30.145972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32fdc782-95b9-461e-8884-3dfed0c178b1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:30.146411 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-32fdc782-95b9-461e-8884-3dfed0c178b1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:30.293064 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-32fdc782-95b9-461e-8884-3dfed0c178b1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:50:30.301292 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-32fdc782-95b9-461e-8884-3dfed0c178b1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1683 microversion: 2.1 time: 0.168741 Jul 25 13:50:30.301868 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3549/7025] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:30 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:50:31.265419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-d88290e7-2358-4fe4-9442-b3358750e15e req-2b538997-e8da-43e1-8656-8b6db0c4908c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e74826f6-549c-4568-9d4f-75797db4a7ff", "name": "network-vif-plugged", "status": "completed", "tag": "cc136040-9126-47d4-a8f9-2b4ae0238768"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:50:31.275907 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d88290e7-2358-4fe4-9442-b3358750e15e req-2b538997-e8da-43e1-8656-8b6db0c4908c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:31.275907 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-d88290e7-2358-4fe4-9442-b3358750e15e req-2b538997-e8da-43e1-8656-8b6db0c4908c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:31.287714 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-d88290e7-2358-4fe4-9442-b3358750e15e req-2b538997-e8da-43e1-8656-8b6db0c4908c service nova] Creating event network-vif-plugged:cc136040-9126-47d4-a8f9-2b4ae0238768 for instance e74826f6-549c-4568-9d4f-75797db4a7ff on n-h1-848886-15 Jul 25 13:50:31.293198 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-d88290e7-2358-4fe4-9442-b3358750e15e req-2b538997-e8da-43e1-8656-8b6db0c4908c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094635 Jul 25 13:50:31.293805 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3477/7026] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:50:52.513316 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d5c2c494-e18b-496a-96ab-8acb3a96cc16 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:50:52.515579 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d5c2c494-e18b-496a-96ab-8acb3a96cc16 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:52.518707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=32 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:50:52.519285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:50:52.525679 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5c2c494-e18b-496a-96ab-8acb3a96cc16 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:52.526153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5c2c494-e18b-496a-96ab-8acb3a96cc16 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:52.526924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5c2c494-e18b-496a-96ab-8acb3a96cc16 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:52.527365 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d5c2c494-e18b-496a-96ab-8acb3a96cc16 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:52.581397 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d5c2c494-e18b-496a-96ab-8acb3a96cc16 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff/action" status: 200 len: 24573 microversion: 2.1 time: 0.071874 Jul 25 13:50:52.582141 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3550/7027] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:50:52 2022] POST /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff/action => generated 24573 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:50:59.782505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=28 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:50:59.783561 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:50:59.787928 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4db0adad-06ea-44d4-9315-57ed64095530 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:59.788624 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4db0adad-06ea-44d4-9315-57ed64095530 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:59.790818 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-74af5fa1-ee15-4774-b49e-735b0ebf2bf1 req-573d2351-e258-49cc-848d-270b6f3fbeac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e74826f6-549c-4568-9d4f-75797db4a7ff", "tag": "cc136040-9126-47d4-a8f9-2b4ae0238768"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:50:59.806059 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-74af5fa1-ee15-4774-b49e-735b0ebf2bf1 req-573d2351-e258-49cc-848d-270b6f3fbeac service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:59.806296 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-74af5fa1-ee15-4774-b49e-735b0ebf2bf1 req-573d2351-e258-49cc-848d-270b6f3fbeac service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:59.810907 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4db0adad-06ea-44d4-9315-57ed64095530 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:59.811446 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4db0adad-06ea-44d4-9315-57ed64095530 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:59.812712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4db0adad-06ea-44d4-9315-57ed64095530 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:59.812712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4db0adad-06ea-44d4-9315-57ed64095530 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:59.835837 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-74af5fa1-ee15-4774-b49e-735b0ebf2bf1 req-573d2351-e258-49cc-848d-270b6f3fbeac service nova] Creating event network-changed:cc136040-9126-47d4-a8f9-2b4ae0238768 for instance e74826f6-549c-4568-9d4f-75797db4a7ff on n-h1-848886-15 Jul 25 13:50:59.851018 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4db0adad-06ea-44d4-9315-57ed64095530 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:50:59.859803 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-74af5fa1-ee15-4774-b49e-735b0ebf2bf1 req-573d2351-e258-49cc-848d-270b6f3fbeac service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081316 Jul 25 13:50:59.861113 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3551/7028] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:50:59.936601 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4db0adad-06ea-44d4-9315-57ed64095530 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 204 len: 0 microversion: 2.1 time: 0.161527 Jul 25 13:50:59.939521 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3478/7029] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:50:59 2022] DELETE /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:50:59.950455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7df6a704-7998-436e-a010-c442a9756c0a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:50:59.951460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7df6a704-7998-436e-a010-c442a9756c0a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:50:59.960156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7df6a704-7998-436e-a010-c442a9756c0a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:59.960603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7df6a704-7998-436e-a010-c442a9756c0a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:50:59.961376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7df6a704-7998-436e-a010-c442a9756c0a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:50:59.961812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7df6a704-7998-436e-a010-c442a9756c0a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:00.121605 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7df6a704-7998-436e-a010-c442a9756c0a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:51:00.130252 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7df6a704-7998-436e-a010-c442a9756c0a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1689 microversion: 2.1 time: 0.185514 Jul 25 13:51:00.131136 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3552/7030] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:50:59 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1689 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:51:01.153617 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-98a61a70-ec90-40a9-bdad-8f4097b12b98 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:51:01.154350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-98a61a70-ec90-40a9-bdad-8f4097b12b98 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:51:01.161752 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98a61a70-ec90-40a9-bdad-8f4097b12b98 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:01.162274 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98a61a70-ec90-40a9-bdad-8f4097b12b98 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:01.163044 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98a61a70-ec90-40a9-bdad-8f4097b12b98 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:01.163488 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98a61a70-ec90-40a9-bdad-8f4097b12b98 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:01.299334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-98a61a70-ec90-40a9-bdad-8f4097b12b98 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:51:01.307098 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-98a61a70-ec90-40a9-bdad-8f4097b12b98 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 200 len: 1689 microversion: 2.1 time: 0.157837 Jul 25 13:51:01.307709 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3479/7031] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:51:01 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:51:01.876030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-03957714-938f-49de-9039-0ece50458235 req-22f2bc02-74e4-445a-8f97-dc98a9a538e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e74826f6-549c-4568-9d4f-75797db4a7ff", "name": "network-vif-deleted", "tag": "cc136040-9126-47d4-a8f9-2b4ae0238768"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:51:01.887752 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-03957714-938f-49de-9039-0ece50458235 req-22f2bc02-74e4-445a-8f97-dc98a9a538e1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:01.888203 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-03957714-938f-49de-9039-0ece50458235 req-22f2bc02-74e4-445a-8f97-dc98a9a538e1 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:01.900807 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-03957714-938f-49de-9039-0ece50458235 req-22f2bc02-74e4-445a-8f97-dc98a9a538e1 service nova] Creating event network-vif-deleted:cc136040-9126-47d4-a8f9-2b4ae0238768 for instance e74826f6-549c-4568-9d4f-75797db4a7ff on n-h1-848886-15 Jul 25 13:51:01.905700 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-03957714-938f-49de-9039-0ece50458235 req-22f2bc02-74e4-445a-8f97-dc98a9a538e1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033812 Jul 25 13:51:01.907810 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3553/7032] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:51:02.329059 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-949e6441-511d-4eda-b902-85aa731d29a1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:51:02.329772 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-949e6441-511d-4eda-b902-85aa731d29a1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: e74826f6-549c-4568-9d4f-75797db4a7ff] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:51:02.337130 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-949e6441-511d-4eda-b902-85aa731d29a1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:02.337597 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-949e6441-511d-4eda-b902-85aa731d29a1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:02.338423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-949e6441-511d-4eda-b902-85aa731d29a1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:02.338874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-949e6441-511d-4eda-b902-85aa731d29a1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:02.353844 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-949e6441-511d-4eda-b902-85aa731d29a1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] HTTP exception thrown: Instance e74826f6-549c-4568-9d4f-75797db4a7ff could not be found. Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-949e6441-511d-4eda-b902-85aa731d29a1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Request method failure captured: Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff HTTP/1.1 Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3p6nyr1k_mFa4TokFEOlsou6AutFycw2kIO61UeF99u26RQ-4tpsrMhICbgi-9flg72p_U8OM5XgKZ6LQr4j4tb8J14QULHs7ajP_ZgmomWC6pW8wz9n9aS-w6knWlaT3jwDpfYXaMI8wyO7_qrSx4IpgYN7bXoMCpzogGqHy3JVQbs Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 2a3ff31102b0437aba77c5efe779af7a Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1441249113 Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2a3ff31102b0437aba77c5efe779af7a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2a3ff31102b0437aba77c5efe779af7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2a3ff31102b0437aba77c5efe779af7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2a3ff31102b0437aba77c5efe779af7a"}]}] Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1441249113 Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 2a3ff31102b0437aba77c5efe779af7a Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1441249113 Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-TestNetworkAdvancedServerOps-1441249113-project Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: bc97a7b925de4cca981fe1d714f5e986 Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1441249113-project Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance e74826f6-549c-4568-9d4f-75797db4a7ff could not be found. Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'e74826f6-549c-4568-9d4f-75797db4a7ff'} Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e74826f6-549c-4568-9d4f-75797db4a7ff could not be found. Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e74826f6-549c-4568-9d4f-75797db4a7ff could not be found. Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:51:02.355558 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:51:02.360540 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:51:02.360540 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:51:02.360540 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:51:02.360540 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:51:02.360540 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:51:02.360540 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:51:02.360540 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e74826f6-549c-4568-9d4f-75797db4a7ff could not be found. Jul 25 13:51:02.360540 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:51:02.360540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-949e6441-511d-4eda-b902-85aa731d29a1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Returning 404 to user: Instance e74826f6-549c-4568-9d4f-75797db4a7ff could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:51:02.360540 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-949e6441-511d-4eda-b902-85aa731d29a1 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff" status: 404 len: 111 microversion: 2.1 time: 0.032418 Jul 25 13:51:02.360540 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3480/7033] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:51:02 2022] GET /compute/v2.1/servers/e74826f6-549c-4568-9d4f-75797db4a7ff => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:51:05.660240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-709f42bd-265d-423a-9241-f0e4ebf69155 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '.version_select at 0x7efcf91b19d0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:51:05.682296 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-709f42bd-265d-423a-9241-f0e4ebf69155 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1397824396" status: 202 len: 0 microversion: 2.1 time: 0.026314 Jul 25 13:51:05.682902 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3554/7034] 10.222.0.49 () {58 vars in 1284 bytes} [Mon Jul 25 13:51:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1397824396 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:51:05.703866 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8a028e25-e699-482b-b387-80d89a4c44cf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'create', calling method: .version_select at 0x7efcf8cf45e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-461560783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/SFpKleGFclx1J6c88UQaXaav9rfJcE6ZOCgSgBB3glEdWg8870zojwT9N7tbRS/Wd1THOJ0ASvvy3UyPYB3ITde0H0fZv93VNl8PbMiaRtQQTPjZGlpQGy+KPr5SmrA=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:51:05.721386 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-8a028e25-e699-482b-b387-80d89a4c44cf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Getting quotas for project 2a3ff31102b0437aba77c5efe779af7a. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:51:05.727518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-8a028e25-e699-482b-b387-80d89a4c44cf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Getting quotas for user bc97a7b925de4cca981fe1d714f5e986 and project 2a3ff31102b0437aba77c5efe779af7a. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:51:05.754753 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8a028e25-e699-482b-b387-80d89a4c44cf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.055053 Jul 25 13:51:05.760850 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3481/7035] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:51:05 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:51:11.406148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e9b4da31-75bd-4ade-b4ad-e179fab1f9b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1674589657", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "6e203fb4-34e1-4ee0-a5ad-f01923465c14"}], "key_name": "tempest-TestNetworkAdvancedServerOps-461560783", "security_groups": [{"name": "tempest-secgroup-smoke-391738545"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:51:11.534356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-e9b4da31-75bd-4ade-b4ad-e179fab1f9b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] validate_networks() for [('6e203fb4-34e1-4ee0-a5ad-f01923465c14', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:51:11.894263 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=14 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:51:11.925135 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e9b4da31-75bd-4ade-b4ad-e179fab1f9b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:51:11.925555 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e9b4da31-75bd-4ade-b4ad-e179fab1f9b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:51:11.926071 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e9b4da31-75bd-4ade-b4ad-e179fab1f9b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:51:11.926481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e9b4da31-75bd-4ade-b4ad-e179fab1f9b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:51:11.926893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-e9b4da31-75bd-4ade-b4ad-e179fab1f9b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:51:11.936481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9b4da31-75bd-4ade-b4ad-e179fab1f9b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:11.937440 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9b4da31-75bd-4ade-b4ad-e179fab1f9b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:11.938303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9b4da31-75bd-4ade-b4ad-e179fab1f9b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:11.939300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e9b4da31-75bd-4ade-b4ad-e179fab1f9b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:11.957914 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-e9b4da31-75bd-4ade-b4ad-e179fab1f9b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Getting quotas for project 2a3ff31102b0437aba77c5efe779af7a. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:51:11.963293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-e9b4da31-75bd-4ade-b4ad-e179fab1f9b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Getting quotas for user bc97a7b925de4cca981fe1d714f5e986 and project 2a3ff31102b0437aba77c5efe779af7a. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:51:11.976714 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e9b4da31-75bd-4ade-b4ad-e179fab1f9b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:51:11.979127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e9b4da31-75bd-4ade-b4ad-e179fab1f9b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:51:12.025134 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e9b4da31-75bd-4ade-b4ad-e179fab1f9b4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.624059 Jul 25 13:51:12.031756 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3555/7036] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:51:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:51:12.037109 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-dcb5c22e-f723-49c5-854c-e4199ef60a1c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:51:12.037810 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-dcb5c22e-f723-49c5-854c-e4199ef60a1c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:51:12.116888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-dcb5c22e-f723-49c5-854c-e4199ef60a1c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:51:12.129797 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-dcb5c22e-f723-49c5-854c-e4199ef60a1c tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1266 microversion: 2.1 time: 0.096232 Jul 25 13:51:12.138670 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3482/7037] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:51:12 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:51:13.152479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b59a3371-39c5-463e-848d-86ab999f5d11 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:51:13.153109 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b59a3371-39c5-463e-848d-86ab999f5d11 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:51:13.161022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b59a3371-39c5-463e-848d-86ab999f5d11 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:13.161381 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b59a3371-39c5-463e-848d-86ab999f5d11 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:13.162197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b59a3371-39c5-463e-848d-86ab999f5d11 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:13.162633 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b59a3371-39c5-463e-848d-86ab999f5d11 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:13.248426 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b59a3371-39c5-463e-848d-86ab999f5d11 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:51:13.257734 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b59a3371-39c5-463e-848d-86ab999f5d11 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1336 microversion: 2.1 time: 0.110574 Jul 25 13:51:13.259725 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3556/7038] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:51:13 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1336 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:51:14.280385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5424c346-4d9c-4d33-b9ca-29a2b65fc472 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:51:14.281685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5424c346-4d9c-4d33-b9ca-29a2b65fc472 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:51:14.287673 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:51:14.290559 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5424c346-4d9c-4d33-b9ca-29a2b65fc472 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:14.291241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5424c346-4d9c-4d33-b9ca-29a2b65fc472 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:14.292238 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5424c346-4d9c-4d33-b9ca-29a2b65fc472 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:14.293098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5424c346-4d9c-4d33-b9ca-29a2b65fc472 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:14.443379 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5424c346-4d9c-4d33-b9ca-29a2b65fc472 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:51:14.452410 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5424c346-4d9c-4d33-b9ca-29a2b65fc472 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1391 microversion: 2.1 time: 0.175771 Jul 25 13:51:14.453168 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3483/7039] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:51:14 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:51:14.827663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-c10b358d-128e-42bd-a7cd-667ddd3ff5e5 req-8a226d93-cb9e-4862-a431-bb33a6776d00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48a9ac69-efd1-40ab-b752-fb933e387aa8", "tag": "8529b203-e772-420b-8653-aca82fce686d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:51:14.842753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c10b358d-128e-42bd-a7cd-667ddd3ff5e5 req-8a226d93-cb9e-4862-a431-bb33a6776d00 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:14.843964 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c10b358d-128e-42bd-a7cd-667ddd3ff5e5 req-8a226d93-cb9e-4862-a431-bb33a6776d00 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:14.868200 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-c10b358d-128e-42bd-a7cd-667ddd3ff5e5 req-8a226d93-cb9e-4862-a431-bb33a6776d00 service nova] Creating event network-changed:8529b203-e772-420b-8653-aca82fce686d for instance 48a9ac69-efd1-40ab-b752-fb933e387aa8 on n-h1-848886-15 Jul 25 13:51:14.873950 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-c10b358d-128e-42bd-a7cd-667ddd3ff5e5 req-8a226d93-cb9e-4862-a431-bb33a6776d00 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052276 Jul 25 13:51:14.875106 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3557/7040] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:51:15.475384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8ec2bbee-c316-481a-84f6-0e3355da250f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:51:15.475982 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8ec2bbee-c316-481a-84f6-0e3355da250f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:51:15.483493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ec2bbee-c316-481a-84f6-0e3355da250f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:15.483953 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ec2bbee-c316-481a-84f6-0e3355da250f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:15.484727 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ec2bbee-c316-481a-84f6-0e3355da250f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:15.485175 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8ec2bbee-c316-481a-84f6-0e3355da250f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:15.636110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8ec2bbee-c316-481a-84f6-0e3355da250f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:51:15.648019 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8ec2bbee-c316-481a-84f6-0e3355da250f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1391 microversion: 2.1 time: 0.176355 Jul 25 13:51:15.648656 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3484/7041] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:51:15 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:51:16.728627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ac7cba03-4414-4c88-8093-f17351e2f976 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:51:16.729360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ac7cba03-4414-4c88-8093-f17351e2f976 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:51:16.736072 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac7cba03-4414-4c88-8093-f17351e2f976 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:16.736511 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac7cba03-4414-4c88-8093-f17351e2f976 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:16.737279 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac7cba03-4414-4c88-8093-f17351e2f976 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:16.737721 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac7cba03-4414-4c88-8093-f17351e2f976 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:16.872418 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ac7cba03-4414-4c88-8093-f17351e2f976 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:51:16.881358 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ac7cba03-4414-4c88-8093-f17351e2f976 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1391 microversion: 2.1 time: 0.211696 Jul 25 13:51:16.881975 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3558/7042] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:51:16 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1391 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:51:17.910772 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-20f463ef-c68d-4b26-ba4e-1d9d700f9ac4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:51:17.911397 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-20f463ef-c68d-4b26-ba4e-1d9d700f9ac4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:51:17.918835 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20f463ef-c68d-4b26-ba4e-1d9d700f9ac4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:17.919302 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20f463ef-c68d-4b26-ba4e-1d9d700f9ac4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:17.920088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20f463ef-c68d-4b26-ba4e-1d9d700f9ac4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:17.920538 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-20f463ef-c68d-4b26-ba4e-1d9d700f9ac4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:18.062440 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-20f463ef-c68d-4b26-ba4e-1d9d700f9ac4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:51:18.074371 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-20f463ef-c68d-4b26-ba4e-1d9d700f9ac4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1391 microversion: 2.1 time: 0.167828 Jul 25 13:51:18.075148 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3485/7043] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:51:17 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:51:19.095407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3addf6f1-1e31-4cbe-950f-b0dbc25e0c3f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:51:19.095997 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3addf6f1-1e31-4cbe-950f-b0dbc25e0c3f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:51:19.103728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3addf6f1-1e31-4cbe-950f-b0dbc25e0c3f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:19.104466 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3addf6f1-1e31-4cbe-950f-b0dbc25e0c3f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:19.105731 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3addf6f1-1e31-4cbe-950f-b0dbc25e0c3f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:19.106470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3addf6f1-1e31-4cbe-950f-b0dbc25e0c3f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:19.245821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3addf6f1-1e31-4cbe-950f-b0dbc25e0c3f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:51:19.253925 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3addf6f1-1e31-4cbe-950f-b0dbc25e0c3f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1391 microversion: 2.1 time: 0.162508 Jul 25 13:51:19.254595 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3559/7044] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:51:19 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:51:19.340258 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-2a209778-3ef8-454a-aebc-f8b6ccde547f req-c80893ee-5d44-49a2-a64c-5afe1371c4be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a9ac69-efd1-40ab-b752-fb933e387aa8", "name": "network-vif-plugged", "status": "completed", "tag": "8529b203-e772-420b-8653-aca82fce686d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:51:19.352364 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2a209778-3ef8-454a-aebc-f8b6ccde547f req-c80893ee-5d44-49a2-a64c-5afe1371c4be service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:19.352824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-2a209778-3ef8-454a-aebc-f8b6ccde547f req-c80893ee-5d44-49a2-a64c-5afe1371c4be service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:19.374203 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-2a209778-3ef8-454a-aebc-f8b6ccde547f req-c80893ee-5d44-49a2-a64c-5afe1371c4be service nova] Creating event network-vif-plugged:8529b203-e772-420b-8653-aca82fce686d for instance 48a9ac69-efd1-40ab-b752-fb933e387aa8 on n-h1-848886-15 Jul 25 13:51:19.374203 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-2a209778-3ef8-454a-aebc-f8b6ccde547f req-c80893ee-5d44-49a2-a64c-5afe1371c4be service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037176 Jul 25 13:51:19.374719 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3486/7045] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:51:20.279280 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8b7122c6-5b0d-412a-900c-4faab35c8d54 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:51:20.280329 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8b7122c6-5b0d-412a-900c-4faab35c8d54 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:51:20.292151 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b7122c6-5b0d-412a-900c-4faab35c8d54 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:20.292922 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b7122c6-5b0d-412a-900c-4faab35c8d54 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:20.294226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b7122c6-5b0d-412a-900c-4faab35c8d54 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:20.294954 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b7122c6-5b0d-412a-900c-4faab35c8d54 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:20.429725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8b7122c6-5b0d-412a-900c-4faab35c8d54 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:51:20.438339 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8b7122c6-5b0d-412a-900c-4faab35c8d54 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1391 microversion: 2.1 time: 0.165702 Jul 25 13:51:20.438900 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3560/7046] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:51:20 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:51:21.463794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6ecd097c-3c18-4fa1-a358-aa4b4b8fefd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:51:21.464932 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6ecd097c-3c18-4fa1-a358-aa4b4b8fefd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:51:21.474153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6ecd097c-3c18-4fa1-a358-aa4b4b8fefd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:21.474648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6ecd097c-3c18-4fa1-a358-aa4b4b8fefd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:21.475413 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6ecd097c-3c18-4fa1-a358-aa4b4b8fefd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:21.475861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6ecd097c-3c18-4fa1-a358-aa4b4b8fefd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:21.621276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6ecd097c-3c18-4fa1-a358-aa4b4b8fefd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:51:21.630545 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6ecd097c-3c18-4fa1-a358-aa4b4b8fefd3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1563 microversion: 2.1 time: 0.173303 Jul 25 13:51:21.631034 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3487/7047] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:51:21 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1563 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:51:21.651448 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cd5ea781-90b9-4273-b24b-62c95bf8b844 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:51:21.652071 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cd5ea781-90b9-4273-b24b-62c95bf8b844 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:51:21.659517 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cd5ea781-90b9-4273-b24b-62c95bf8b844 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:21.659975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cd5ea781-90b9-4273-b24b-62c95bf8b844 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:21.660746 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cd5ea781-90b9-4273-b24b-62c95bf8b844 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:21.661186 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cd5ea781-90b9-4273-b24b-62c95bf8b844 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:21.798636 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cd5ea781-90b9-4273-b24b-62c95bf8b844 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:51:21.806908 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cd5ea781-90b9-4273-b24b-62c95bf8b844 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1563 microversion: 2.1 time: 0.159340 Jul 25 13:51:21.807489 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3561/7048] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:51:21 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:51:23.571933 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-eb6f5c8d-8c13-4be2-b6af-78bc9cc2c44e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:51:23.572681 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-eb6f5c8d-8c13-4be2-b6af-78bc9cc2c44e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:51:23.573818 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-48e4eea7-61dc-40d7-b386-8fa5ecb29b15 req-8b52c38f-dda1-42a5-812f-13fefbfc23eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48a9ac69-efd1-40ab-b752-fb933e387aa8", "tag": "8529b203-e772-420b-8653-aca82fce686d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:51:23.576859 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:51:23.581766 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb6f5c8d-8c13-4be2-b6af-78bc9cc2c44e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:23.582240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:51:23.582383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb6f5c8d-8c13-4be2-b6af-78bc9cc2c44e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:23.582919 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:51:23.584056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb6f5c8d-8c13-4be2-b6af-78bc9cc2c44e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:23.584578 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eb6f5c8d-8c13-4be2-b6af-78bc9cc2c44e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:23.585647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:51:23.597198 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-48e4eea7-61dc-40d7-b386-8fa5ecb29b15 req-8b52c38f-dda1-42a5-812f-13fefbfc23eb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:23.597760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-48e4eea7-61dc-40d7-b386-8fa5ecb29b15 req-8b52c38f-dda1-42a5-812f-13fefbfc23eb service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:23.613965 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-48e4eea7-61dc-40d7-b386-8fa5ecb29b15 req-8b52c38f-dda1-42a5-812f-13fefbfc23eb service nova] Creating event network-changed:8529b203-e772-420b-8653-aca82fce686d for instance 48a9ac69-efd1-40ab-b752-fb933e387aa8 on n-h1-848886-15 Jul 25 13:51:23.620802 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-48e4eea7-61dc-40d7-b386-8fa5ecb29b15 req-8b52c38f-dda1-42a5-812f-13fefbfc23eb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050854 Jul 25 13:51:23.621689 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3562/7049] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:51:23.735620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-eb6f5c8d-8c13-4be2-b6af-78bc9cc2c44e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:51:23.744048 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-eb6f5c8d-8c13-4be2-b6af-78bc9cc2c44e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1563 microversion: 2.1 time: 0.176431 Jul 25 13:51:23.745374 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3488/7050] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:51:23 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1563 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:51:45.018209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=36 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:51:45.019001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:51:45.023738 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ef860576-4725-4cfb-995c-6f6c41727184 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:51:45.026487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ef860576-4725-4cfb-995c-6f6c41727184 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:51:45.033812 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef860576-4725-4cfb-995c-6f6c41727184 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:45.034337 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef860576-4725-4cfb-995c-6f6c41727184 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:45.035213 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef860576-4725-4cfb-995c-6f6c41727184 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:45.035685 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ef860576-4725-4cfb-995c-6f6c41727184 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:45.091818 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ef860576-4725-4cfb-995c-6f6c41727184 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8/action" status: 200 len: 24563 microversion: 2.1 time: 0.075496 Jul 25 13:51:45.092368 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3563/7051] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:51:45 2022] POST /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8/action => generated 24563 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:51:56.152832 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c3b94a1e-eab5-41b0-a486-4d5c606c7b62 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:51:56.155250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:51:56.155974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=32 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:51:56.164263 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3b94a1e-eab5-41b0-a486-4d5c606c7b62 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:56.164899 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c3b94a1e-eab5-41b0-a486-4d5c606c7b62 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:56.190471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c3b94a1e-eab5-41b0-a486-4d5c606c7b62 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Going to try to stop instance {{(pid=125883) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 13:51:56.237198 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c3b94a1e-eab5-41b0-a486-4d5c606c7b62 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.088301 Jul 25 13:51:56.237809 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3489/7052] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:51:56 2022] POST /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:51:56.246558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c5268c91-1e51-4ecd-8fd5-37dadd9597c6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:51:56.247531 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c5268c91-1e51-4ecd-8fd5-37dadd9597c6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:51:56.250244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:51:56.251020 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:51:56.256705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5268c91-1e51-4ecd-8fd5-37dadd9597c6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:56.257165 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5268c91-1e51-4ecd-8fd5-37dadd9597c6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:56.257965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5268c91-1e51-4ecd-8fd5-37dadd9597c6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:56.258401 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c5268c91-1e51-4ecd-8fd5-37dadd9597c6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:56.416613 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c5268c91-1e51-4ecd-8fd5-37dadd9597c6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:51:56.424887 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c5268c91-1e51-4ecd-8fd5-37dadd9597c6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1692 microversion: 2.1 time: 0.182526 Jul 25 13:51:56.425470 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3564/7053] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:51:56 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1692 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:51:57.449459 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-45acd6b0-9b42-4fd4-be05-e41d7ac1723d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:51:57.450211 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-45acd6b0-9b42-4fd4-be05-e41d7ac1723d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:51:57.457618 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-45acd6b0-9b42-4fd4-be05-e41d7ac1723d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:57.458108 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-45acd6b0-9b42-4fd4-be05-e41d7ac1723d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:57.458903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-45acd6b0-9b42-4fd4-be05-e41d7ac1723d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:57.459353 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-45acd6b0-9b42-4fd4-be05-e41d7ac1723d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:57.596601 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-45acd6b0-9b42-4fd4-be05-e41d7ac1723d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:51:57.605443 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-45acd6b0-9b42-4fd4-be05-e41d7ac1723d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1692 microversion: 2.1 time: 0.161580 Jul 25 13:51:57.606178 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3490/7054] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:51:57 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:51:58.627023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0bde7e0a-c810-4002-8ed1-26f5316f6f5f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:51:58.627673 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0bde7e0a-c810-4002-8ed1-26f5316f6f5f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:51:58.635153 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0bde7e0a-c810-4002-8ed1-26f5316f6f5f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:58.635599 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0bde7e0a-c810-4002-8ed1-26f5316f6f5f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:58.636358 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0bde7e0a-c810-4002-8ed1-26f5316f6f5f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:58.636785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0bde7e0a-c810-4002-8ed1-26f5316f6f5f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:58.777290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0bde7e0a-c810-4002-8ed1-26f5316f6f5f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:51:58.791999 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0bde7e0a-c810-4002-8ed1-26f5316f6f5f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1692 microversion: 2.1 time: 0.168675 Jul 25 13:51:58.792859 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3565/7055] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:51:58 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:51:59.816482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3ed6efce-b954-430b-8322-cc98e2227312 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:51:59.817081 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3ed6efce-b954-430b-8322-cc98e2227312 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:51:59.824771 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3ed6efce-b954-430b-8322-cc98e2227312 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:59.825254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3ed6efce-b954-430b-8322-cc98e2227312 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:59.826089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3ed6efce-b954-430b-8322-cc98e2227312 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:51:59.826561 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3ed6efce-b954-430b-8322-cc98e2227312 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:51:59.961824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3ed6efce-b954-430b-8322-cc98e2227312 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:51:59.969966 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3ed6efce-b954-430b-8322-cc98e2227312 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1692 microversion: 2.1 time: 0.157536 Jul 25 13:51:59.970545 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3491/7056] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:51:59 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:52:00.997318 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6dd73abd-7cf0-4a1b-ab34-33aba21e8531 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:52:00.998322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6dd73abd-7cf0-4a1b-ab34-33aba21e8531 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:52:01.010271 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6dd73abd-7cf0-4a1b-ab34-33aba21e8531 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:01.011019 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6dd73abd-7cf0-4a1b-ab34-33aba21e8531 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:01.012300 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6dd73abd-7cf0-4a1b-ab34-33aba21e8531 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:01.013032 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6dd73abd-7cf0-4a1b-ab34-33aba21e8531 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:01.161558 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6dd73abd-7cf0-4a1b-ab34-33aba21e8531 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:52:01.169624 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6dd73abd-7cf0-4a1b-ab34-33aba21e8531 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1692 microversion: 2.1 time: 0.178876 Jul 25 13:52:01.170264 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3566/7057] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:52:00 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1692 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:52:02.191080 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f9a0ea9b-1527-4ee9-a4c8-27eee0defaca tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:52:02.191663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f9a0ea9b-1527-4ee9-a4c8-27eee0defaca tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:52:02.199729 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9a0ea9b-1527-4ee9-a4c8-27eee0defaca tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:02.200191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9a0ea9b-1527-4ee9-a4c8-27eee0defaca tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:02.200975 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9a0ea9b-1527-4ee9-a4c8-27eee0defaca tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:02.201426 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9a0ea9b-1527-4ee9-a4c8-27eee0defaca tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:02.351573 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f9a0ea9b-1527-4ee9-a4c8-27eee0defaca tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:52:02.359825 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f9a0ea9b-1527-4ee9-a4c8-27eee0defaca tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1692 microversion: 2.1 time: 0.172606 Jul 25 13:52:02.361255 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3492/7058] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:52:02 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:52:03.381561 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4f4ca758-d681-4720-8650-802c8d10001a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:52:03.382179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4f4ca758-d681-4720-8650-802c8d10001a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:52:03.389936 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f4ca758-d681-4720-8650-802c8d10001a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:03.390399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f4ca758-d681-4720-8650-802c8d10001a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:03.391201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f4ca758-d681-4720-8650-802c8d10001a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:03.391669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4f4ca758-d681-4720-8650-802c8d10001a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:03.546691 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4f4ca758-d681-4720-8650-802c8d10001a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:52:03.554532 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4f4ca758-d681-4720-8650-802c8d10001a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1692 microversion: 2.1 time: 0.177024 Jul 25 13:52:03.555124 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3567/7059] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:52:03 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:52:04.579137 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-720b2711-7ede-4b99-ab3c-7e265f481cfd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:52:04.579738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-720b2711-7ede-4b99-ab3c-7e265f481cfd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:52:04.587074 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-720b2711-7ede-4b99-ab3c-7e265f481cfd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:04.587542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-720b2711-7ede-4b99-ab3c-7e265f481cfd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:04.588320 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-720b2711-7ede-4b99-ab3c-7e265f481cfd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:04.588767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-720b2711-7ede-4b99-ab3c-7e265f481cfd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:04.726731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-720b2711-7ede-4b99-ab3c-7e265f481cfd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:52:04.735086 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-720b2711-7ede-4b99-ab3c-7e265f481cfd tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1692 microversion: 2.1 time: 0.159839 Jul 25 13:52:04.735648 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3493/7060] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:52:04 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:52:05.757755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5c539287-fabc-4234-a8a4-587a79fee80b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:52:05.758425 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5c539287-fabc-4234-a8a4-587a79fee80b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:52:05.765924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c539287-fabc-4234-a8a4-587a79fee80b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:05.766387 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c539287-fabc-4234-a8a4-587a79fee80b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:05.767156 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c539287-fabc-4234-a8a4-587a79fee80b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:05.767622 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5c539287-fabc-4234-a8a4-587a79fee80b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:05.901927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5c539287-fabc-4234-a8a4-587a79fee80b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:52:05.910096 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5c539287-fabc-4234-a8a4-587a79fee80b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1692 microversion: 2.1 time: 0.156352 Jul 25 13:52:05.910681 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3568/7061] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:52:05 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:52:06.934736 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a3f9b52c-0a87-4388-830b-2645c76e9c67 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:52:06.935416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a3f9b52c-0a87-4388-830b-2645c76e9c67 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:52:06.946046 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a3f9b52c-0a87-4388-830b-2645c76e9c67 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:06.946746 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a3f9b52c-0a87-4388-830b-2645c76e9c67 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:06.947796 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a3f9b52c-0a87-4388-830b-2645c76e9c67 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:06.948757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a3f9b52c-0a87-4388-830b-2645c76e9c67 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:07.104834 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a3f9b52c-0a87-4388-830b-2645c76e9c67 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:52:07.114474 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a3f9b52c-0a87-4388-830b-2645c76e9c67 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1692 microversion: 2.1 time: 0.185836 Jul 25 13:52:07.115289 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3494/7062] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:52:06 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1692 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:52:08.135682 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2c44a298-0e19-4f1f-bccd-8b41e25a2f81 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:52:08.136376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2c44a298-0e19-4f1f-bccd-8b41e25a2f81 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:52:08.144399 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c44a298-0e19-4f1f-bccd-8b41e25a2f81 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:08.144965 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c44a298-0e19-4f1f-bccd-8b41e25a2f81 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:08.145784 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c44a298-0e19-4f1f-bccd-8b41e25a2f81 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:08.146288 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c44a298-0e19-4f1f-bccd-8b41e25a2f81 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:08.287769 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2c44a298-0e19-4f1f-bccd-8b41e25a2f81 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:52:08.298883 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2c44a298-0e19-4f1f-bccd-8b41e25a2f81 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1692 microversion: 2.1 time: 0.167556 Jul 25 13:52:08.299481 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3569/7063] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:52:08 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:52:09.320788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bba1665b-08cf-4b96-9de7-7de1e5173756 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:52:09.321383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bba1665b-08cf-4b96-9de7-7de1e5173756 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:52:09.329327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bba1665b-08cf-4b96-9de7-7de1e5173756 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:09.329783 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bba1665b-08cf-4b96-9de7-7de1e5173756 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:09.330595 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bba1665b-08cf-4b96-9de7-7de1e5173756 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:09.331056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bba1665b-08cf-4b96-9de7-7de1e5173756 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:09.466026 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bba1665b-08cf-4b96-9de7-7de1e5173756 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:52:09.474258 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bba1665b-08cf-4b96-9de7-7de1e5173756 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1692 microversion: 2.1 time: 0.157366 Jul 25 13:52:09.474829 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3495/7064] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:52:09 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:52:10.496047 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7d6cc28e-87ef-4d15-9e24-4f2c62e3a978 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:52:10.496626 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7d6cc28e-87ef-4d15-9e24-4f2c62e3a978 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:52:10.504482 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d6cc28e-87ef-4d15-9e24-4f2c62e3a978 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:10.505301 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d6cc28e-87ef-4d15-9e24-4f2c62e3a978 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:10.506299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d6cc28e-87ef-4d15-9e24-4f2c62e3a978 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:10.506760 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7d6cc28e-87ef-4d15-9e24-4f2c62e3a978 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:10.656027 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7d6cc28e-87ef-4d15-9e24-4f2c62e3a978 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:52:10.666753 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7d6cc28e-87ef-4d15-9e24-4f2c62e3a978 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1692 microversion: 2.1 time: 0.174744 Jul 25 13:52:10.667591 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3570/7065] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:52:10 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1692 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:52:11.691121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d11105f8-9fa1-44bf-9634-32f20d057d0d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:52:11.692408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d11105f8-9fa1-44bf-9634-32f20d057d0d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:52:11.700551 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d11105f8-9fa1-44bf-9634-32f20d057d0d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:11.701023 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d11105f8-9fa1-44bf-9634-32f20d057d0d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:11.701812 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d11105f8-9fa1-44bf-9634-32f20d057d0d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:11.702290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d11105f8-9fa1-44bf-9634-32f20d057d0d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:11.856476 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d11105f8-9fa1-44bf-9634-32f20d057d0d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:52:11.864539 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d11105f8-9fa1-44bf-9634-32f20d057d0d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1669 microversion: 2.1 time: 0.177640 Jul 25 13:52:11.865157 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3496/7066] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:52:11 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1669 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:52:12.968183 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-acbe695a-0ab8-408e-8846-946b4270eca7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:52:12.971789 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-acbe695a-0ab8-408e-8846-946b4270eca7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:52:12.983394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acbe695a-0ab8-408e-8846-946b4270eca7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:12.984149 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acbe695a-0ab8-408e-8846-946b4270eca7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:12.985247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acbe695a-0ab8-408e-8846-946b4270eca7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:12.985697 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-acbe695a-0ab8-408e-8846-946b4270eca7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:13.034328 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-acbe695a-0ab8-408e-8846-946b4270eca7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8/action" status: 200 len: 38373 microversion: 2.1 time: 0.072701 Jul 25 13:52:13.034967 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3571/7067] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:52:12 2022] POST /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8/action => generated 38373 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:52:13.050673 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-46500233-58df-4470-94e0-3a4b1be95b4d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:52:13.058134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-46500233-58df-4470-94e0-3a4b1be95b4d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:13.058627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-46500233-58df-4470-94e0-3a4b1be95b4d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:13.082190 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-46500233-58df-4470-94e0-3a4b1be95b4d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Going to try to start instance {{(pid=125883) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 13:52:13.128740 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-46500233-58df-4470-94e0-3a4b1be95b4d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.081926 Jul 25 13:52:13.129381 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3497/7068] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:52:13 2022] POST /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:52:13.138551 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2871581a-3af7-4ede-b706-1eb9518aca2b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:52:13.139249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2871581a-3af7-4ede-b706-1eb9518aca2b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:52:13.146627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2871581a-3af7-4ede-b706-1eb9518aca2b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:13.147116 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2871581a-3af7-4ede-b706-1eb9518aca2b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:13.147992 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2871581a-3af7-4ede-b706-1eb9518aca2b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:13.148592 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2871581a-3af7-4ede-b706-1eb9518aca2b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:13.282924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2871581a-3af7-4ede-b706-1eb9518aca2b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:52:13.290842 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2871581a-3af7-4ede-b706-1eb9518aca2b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1678 microversion: 2.1 time: 0.156654 Jul 25 13:52:13.291433 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3572/7069] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:52:13 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:52:14.313762 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-845ee45c-2796-4ea5-93e2-e0c92062155e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:52:14.314415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-845ee45c-2796-4ea5-93e2-e0c92062155e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:52:14.321895 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-845ee45c-2796-4ea5-93e2-e0c92062155e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:14.322370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-845ee45c-2796-4ea5-93e2-e0c92062155e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:14.323471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-845ee45c-2796-4ea5-93e2-e0c92062155e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:14.323927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-845ee45c-2796-4ea5-93e2-e0c92062155e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:14.464788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-845ee45c-2796-4ea5-93e2-e0c92062155e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:52:14.477602 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-845ee45c-2796-4ea5-93e2-e0c92062155e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1682 microversion: 2.1 time: 0.167937 Jul 25 13:52:14.478434 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3498/7070] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:52:14 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:52:38.719725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e7a84ecd-2295-477f-beab-5d21993e86c8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:52:38.721983 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e7a84ecd-2295-477f-beab-5d21993e86c8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:52:38.724843 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=18 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:52:38.725506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=52 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:52:38.731850 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e7a84ecd-2295-477f-beab-5d21993e86c8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:38.732307 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e7a84ecd-2295-477f-beab-5d21993e86c8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:38.733085 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e7a84ecd-2295-477f-beab-5d21993e86c8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:38.733527 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e7a84ecd-2295-477f-beab-5d21993e86c8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:38.788052 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e7a84ecd-2295-477f-beab-5d21993e86c8 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8/action" status: 200 len: 62933 microversion: 2.1 time: 0.072237 Jul 25 13:52:38.788708 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3573/7071] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:52:38 2022] POST /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8/action => generated 62933 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:52:45.885508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6892389f-b2b4-4c52-83f5-4b70b8779bad tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:52:45.886071 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6892389f-b2b4-4c52-83f5-4b70b8779bad tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:52:45.888225 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-8ca1ee01-c122-4988-a81f-e72ba471abe2 req-69dedb19-3510-43d5-92b7-249368469a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48a9ac69-efd1-40ab-b752-fb933e387aa8", "tag": "8529b203-e772-420b-8653-aca82fce686d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:52:45.890090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=20 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:52:45.891609 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:52:45.895717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6892389f-b2b4-4c52-83f5-4b70b8779bad tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:45.896322 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6892389f-b2b4-4c52-83f5-4b70b8779bad tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:45.897125 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6892389f-b2b4-4c52-83f5-4b70b8779bad tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:45.897569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6892389f-b2b4-4c52-83f5-4b70b8779bad tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:45.898671 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-8ca1ee01-c122-4988-a81f-e72ba471abe2 req-69dedb19-3510-43d5-92b7-249368469a92 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:45.899101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-8ca1ee01-c122-4988-a81f-e72ba471abe2 req-69dedb19-3510-43d5-92b7-249368469a92 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:45.912142 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-8ca1ee01-c122-4988-a81f-e72ba471abe2 req-69dedb19-3510-43d5-92b7-249368469a92 service nova] Creating event network-changed:8529b203-e772-420b-8653-aca82fce686d for instance 48a9ac69-efd1-40ab-b752-fb933e387aa8 on n-h1-848886-15 Jul 25 13:52:45.917176 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-8ca1ee01-c122-4988-a81f-e72ba471abe2 req-69dedb19-3510-43d5-92b7-249368469a92 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033013 Jul 25 13:52:45.918626 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3574/7072] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:52:45.929516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6892389f-b2b4-4c52-83f5-4b70b8779bad tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:52:46.013753 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6892389f-b2b4-4c52-83f5-4b70b8779bad tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "DELETE /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 204 len: 0 microversion: 2.1 time: 0.132368 Jul 25 13:52:46.017486 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3499/7073] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:52:45 2022] DELETE /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:52:46.025725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-03e806e8-459b-45b4-a2fd-1ae23ee5c18a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:52:46.026725 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-03e806e8-459b-45b4-a2fd-1ae23ee5c18a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:52:46.033865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-03e806e8-459b-45b4-a2fd-1ae23ee5c18a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:46.034544 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-03e806e8-459b-45b4-a2fd-1ae23ee5c18a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:46.035491 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-03e806e8-459b-45b4-a2fd-1ae23ee5c18a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:46.036082 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-03e806e8-459b-45b4-a2fd-1ae23ee5c18a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:46.222486 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-03e806e8-459b-45b4-a2fd-1ae23ee5c18a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:52:46.230658 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-03e806e8-459b-45b4-a2fd-1ae23ee5c18a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1688 microversion: 2.1 time: 0.211366 Jul 25 13:52:46.231208 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3575/7074] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:52:46 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1688 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:52:47.256386 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5aadb768-a907-47a8-a6ce-e5e883202baf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:52:47.257311 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5aadb768-a907-47a8-a6ce-e5e883202baf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:52:47.266625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5aadb768-a907-47a8-a6ce-e5e883202baf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:47.267104 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5aadb768-a907-47a8-a6ce-e5e883202baf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:47.267893 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5aadb768-a907-47a8-a6ce-e5e883202baf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:47.268357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5aadb768-a907-47a8-a6ce-e5e883202baf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:47.459339 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5aadb768-a907-47a8-a6ce-e5e883202baf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:52:47.467116 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5aadb768-a907-47a8-a6ce-e5e883202baf tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 200 len: 1688 microversion: 2.1 time: 0.216567 Jul 25 13:52:47.467693 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3500/7075] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:52:47 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 1688 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:52:48.039437 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-bc4991c5-9c25-4163-96d1-cb0adf2ee208 req-d82ae3d2-17f0-4899-b1bf-d9ee4134da44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a9ac69-efd1-40ab-b752-fb933e387aa8", "name": "network-vif-deleted", "tag": "8529b203-e772-420b-8653-aca82fce686d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:52:48.051159 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-bc4991c5-9c25-4163-96d1-cb0adf2ee208 req-d82ae3d2-17f0-4899-b1bf-d9ee4134da44 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:48.051679 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-bc4991c5-9c25-4163-96d1-cb0adf2ee208 req-d82ae3d2-17f0-4899-b1bf-d9ee4134da44 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:48.066421 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-bc4991c5-9c25-4163-96d1-cb0adf2ee208 req-d82ae3d2-17f0-4899-b1bf-d9ee4134da44 service nova] Creating event network-vif-deleted:8529b203-e772-420b-8653-aca82fce686d for instance 48a9ac69-efd1-40ab-b752-fb933e387aa8 on n-h1-848886-15 Jul 25 13:52:48.071229 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-bc4991c5-9c25-4163-96d1-cb0adf2ee208 req-d82ae3d2-17f0-4899-b1bf-d9ee4134da44 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035722 Jul 25 13:52:48.072007 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3576/7076] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:52:48.488728 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a7f4b1db-0486-4284-88eb-9a0d9796c84d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:52:48.489450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a7f4b1db-0486-4284-88eb-9a0d9796c84d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: 48a9ac69-efd1-40ab-b752-fb933e387aa8] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:52:48.496631 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7f4b1db-0486-4284-88eb-9a0d9796c84d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:48.497164 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7f4b1db-0486-4284-88eb-9a0d9796c84d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:48.498073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7f4b1db-0486-4284-88eb-9a0d9796c84d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:48.498518 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a7f4b1db-0486-4284-88eb-9a0d9796c84d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:48.512615 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-a7f4b1db-0486-4284-88eb-9a0d9796c84d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] HTTP exception thrown: Instance 48a9ac69-efd1-40ab-b752-fb933e387aa8 could not be found. Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a7f4b1db-0486-4284-88eb-9a0d9796c84d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Request method failure captured: Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 HTTP/1.1 Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3p6nyr1k_mFa4TokFEOlsou6AutFycw2kIO61UeF99u26RQ-4tpsrMhICbgi-9flg72p_U8OM5XgKZ6LQr4j4tb8J14QULHs7ajP_ZgmomWC6pW8wz9n9aS-w6knWlaT3jwDpfYXaMI8wyO7_qrSx4IpgYN7bXoMCpzogGqHy3JVQbs Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 2a3ff31102b0437aba77c5efe779af7a Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1441249113 Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2a3ff31102b0437aba77c5efe779af7a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2a3ff31102b0437aba77c5efe779af7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2a3ff31102b0437aba77c5efe779af7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2a3ff31102b0437aba77c5efe779af7a"}]}] Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1441249113 Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 2a3ff31102b0437aba77c5efe779af7a Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1441249113 Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-TestNetworkAdvancedServerOps-1441249113-project Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: bc97a7b925de4cca981fe1d714f5e986 Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1441249113-project Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance 48a9ac69-efd1-40ab-b752-fb933e387aa8 could not be found. Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': '48a9ac69-efd1-40ab-b752-fb933e387aa8'} Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48a9ac69-efd1-40ab-b752-fb933e387aa8 could not be found. Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48a9ac69-efd1-40ab-b752-fb933e387aa8 could not be found. Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:52:48.514345 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:52:48.519293 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:52:48.519293 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:52:48.519293 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:52:48.519293 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:52:48.519293 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:52:48.519293 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:52:48.519293 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48a9ac69-efd1-40ab-b752-fb933e387aa8 could not be found. Jul 25 13:52:48.519293 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:52:48.519293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a7f4b1db-0486-4284-88eb-9a0d9796c84d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Returning 404 to user: Instance 48a9ac69-efd1-40ab-b752-fb933e387aa8 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:52:48.519293 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a7f4b1db-0486-4284-88eb-9a0d9796c84d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8" status: 404 len: 111 microversion: 2.1 time: 0.030993 Jul 25 13:52:48.519293 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3501/7077] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:52:48 2022] GET /compute/v2.1/servers/48a9ac69-efd1-40ab-b752-fb933e387aa8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:52:51.871521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fe1e46df-941a-4ea3-848a-f4e97c6cb317 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '.version_select at 0x7efcf92bc5e0>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:52:51.904651 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fe1e46df-941a-4ea3-848a-f4e97c6cb317 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-461560783" status: 202 len: 0 microversion: 2.1 time: 0.038386 Jul 25 13:52:51.905233 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3577/7078] 10.222.0.49 () {58 vars in 1281 bytes} [Mon Jul 25 13:52:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-461560783 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:52:51.933364 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-37ae6eb9-2311-4527-bce6-29e3eb38146e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'create', calling method: .version_select at 0x7efcf83c5700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-981040012", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAczfcnCsWDzx7T4Ts63d2XZZ6jvZoC55Jb6Z1CHDWREEfFvWTMPUx39U47tUIXfxqUT5gQBxdw5bJ02sfOn6wsHQTwnpN2SvctR/85fTo9BBD/LscE38pbjL0jXcYYIkg=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:52:51.950239 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-37ae6eb9-2311-4527-bce6-29e3eb38146e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Getting quotas for project 2a3ff31102b0437aba77c5efe779af7a. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:52:51.956957 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-37ae6eb9-2311-4527-bce6-29e3eb38146e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Getting quotas for user bc97a7b925de4cca981fe1d714f5e986 and project 2a3ff31102b0437aba77c5efe779af7a. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:52:51.981897 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-37ae6eb9-2311-4527-bce6-29e3eb38146e tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052449 Jul 25 13:52:51.982441 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3502/7079] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:52:51 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:52:57.602778 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0131f6c3-a310-4c37-b0b9-c02c0181b0a7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1311046437", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "networks": [{"uuid": "f8b39c36-6ede-478f-9ce1-ddcf823035e4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-981040012", "security_groups": [{"name": "tempest-secgroup-smoke-530291289"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:52:57.742996 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-0131f6c3-a310-4c37-b0b9-c02c0181b0a7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] validate_networks() for [('f8b39c36-6ede-478f-9ce1-ddcf823035e4', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:52:58.005372 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:52:58.005921 n-d-848886-15 devstack@n-api.service[125883]: Mon Jul 25 13:52:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:52:58.059838 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=14 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:52:58.242829 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-0131f6c3-a310-4c37-b0b9-c02c0181b0a7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:52:58.243463 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-0131f6c3-a310-4c37-b0b9-c02c0181b0a7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:52:58.243939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-0131f6c3-a310-4c37-b0b9-c02c0181b0a7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:52:58.244355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-0131f6c3-a310-4c37-b0b9-c02c0181b0a7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:52:58.244772 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-0131f6c3-a310-4c37-b0b9-c02c0181b0a7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:52:58.254960 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0131f6c3-a310-4c37-b0b9-c02c0181b0a7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:58.255390 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0131f6c3-a310-4c37-b0b9-c02c0181b0a7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:58.256562 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0131f6c3-a310-4c37-b0b9-c02c0181b0a7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:52:58.256994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0131f6c3-a310-4c37-b0b9-c02c0181b0a7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:52:58.276481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-0131f6c3-a310-4c37-b0b9-c02c0181b0a7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Getting quotas for project 2a3ff31102b0437aba77c5efe779af7a. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:52:58.282994 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-0131f6c3-a310-4c37-b0b9-c02c0181b0a7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Getting quotas for user bc97a7b925de4cca981fe1d714f5e986 and project 2a3ff31102b0437aba77c5efe779af7a. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:52:58.306128 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0131f6c3-a310-4c37-b0b9-c02c0181b0a7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:52:58.309040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0131f6c3-a310-4c37-b0b9-c02c0181b0a7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:52:58.405203 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0131f6c3-a310-4c37-b0b9-c02c0181b0a7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.804138 Jul 25 13:52:58.417385 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3578/7080] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:52:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:52:58.424399 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0faa9ca7-485c-4672-9d93-fd339b36dde3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:52:58.424828 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0faa9ca7-485c-4672-9d93-fd339b36dde3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:52:58.505060 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0faa9ca7-485c-4672-9d93-fd339b36dde3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:52:58.512794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:52:58.518573 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0faa9ca7-485c-4672-9d93-fd339b36dde3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 200 len: 1266 microversion: 2.1 time: 0.104528 Jul 25 13:52:58.521335 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3503/7081] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:52:58 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:52:59.540593 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5e5f1203-9c7b-4d9d-89e0-8b4b49c853ab tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:52:59.542232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5e5f1203-9c7b-4d9d-89e0-8b4b49c853ab tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:52:59.610190 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5e5f1203-9c7b-4d9d-89e0-8b4b49c853ab tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:52:59.618932 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5e5f1203-9c7b-4d9d-89e0-8b4b49c853ab tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 200 len: 1266 microversion: 2.1 time: 0.083385 Jul 25 13:52:59.621874 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3579/7082] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:52:59 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:53:00.641498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-90612ad3-7b42-49e4-ad93-0230b980f6ad tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:53:00.642333 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-90612ad3-7b42-49e4-ad93-0230b980f6ad tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:00.706256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-90612ad3-7b42-49e4-ad93-0230b980f6ad tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:53:00.713416 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-90612ad3-7b42-49e4-ad93-0230b980f6ad tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 200 len: 1266 microversion: 2.1 time: 0.076387 Jul 25 13:53:00.714033 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3504/7083] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:53:00 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 1266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:53:01.735924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0fce7798-9ee0-4f18-8158-4a6da1c7ce6f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:53:01.736511 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0fce7798-9ee0-4f18-8158-4a6da1c7ce6f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:01.791636 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0fce7798-9ee0-4f18-8158-4a6da1c7ce6f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:53:01.798846 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0fce7798-9ee0-4f18-8158-4a6da1c7ce6f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 200 len: 1266 microversion: 2.1 time: 0.067033 Jul 25 13:53:01.799628 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3580/7084] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:53:01 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 1266 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:53:02.820001 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2f57c046-6a4e-4404-863d-4ceb3f49c3c9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:53:02.820620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2f57c046-6a4e-4404-863d-4ceb3f49c3c9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:02.828470 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f57c046-6a4e-4404-863d-4ceb3f49c3c9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:02.828926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f57c046-6a4e-4404-863d-4ceb3f49c3c9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:02.829776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f57c046-6a4e-4404-863d-4ceb3f49c3c9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:02.830255 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f57c046-6a4e-4404-863d-4ceb3f49c3c9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:02.895049 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2f57c046-6a4e-4404-863d-4ceb3f49c3c9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:53:02.903520 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2f57c046-6a4e-4404-863d-4ceb3f49c3c9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 200 len: 1270 microversion: 2.1 time: 0.087919 Jul 25 13:53:02.904110 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3505/7085] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:53:02 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:53:03.925022 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-246d612c-568a-4671-9ffd-a87f5655306d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:53:03.926377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-246d612c-568a-4671-9ffd-a87f5655306d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:03.935513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-246d612c-568a-4671-9ffd-a87f5655306d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:03.936105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-246d612c-568a-4671-9ffd-a87f5655306d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:03.936905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-246d612c-568a-4671-9ffd-a87f5655306d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:03.937356 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-246d612c-568a-4671-9ffd-a87f5655306d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:04.003351 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-246d612c-568a-4671-9ffd-a87f5655306d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:53:04.012131 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-246d612c-568a-4671-9ffd-a87f5655306d tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 200 len: 1324 microversion: 2.1 time: 0.091110 Jul 25 13:53:04.012731 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3581/7086] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:53:03 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 1324 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:53:05.042247 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-061319b2-bb66-439b-9b45-bfd7ec5601d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:53:05.042927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-061319b2-bb66-439b-9b45-bfd7ec5601d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:05.052179 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-061319b2-bb66-439b-9b45-bfd7ec5601d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:05.052636 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-061319b2-bb66-439b-9b45-bfd7ec5601d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:05.053615 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-061319b2-bb66-439b-9b45-bfd7ec5601d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:05.054244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-061319b2-bb66-439b-9b45-bfd7ec5601d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:05.092443 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-4a2dbdc9-d2a5-4f41-b288-35c5533355bf req-c7d9cc95-3e82-402b-b585-849deab08739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d729d385-2f98-4b68-9f26-ac940ff56a90", "tag": "9957129a-e890-42d6-b063-83be22cd1f56"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:53:05.106621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4a2dbdc9-d2a5-4f41-b288-35c5533355bf req-c7d9cc95-3e82-402b-b585-849deab08739 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:05.107346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-4a2dbdc9-d2a5-4f41-b288-35c5533355bf req-c7d9cc95-3e82-402b-b585-849deab08739 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:05.124453 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-4a2dbdc9-d2a5-4f41-b288-35c5533355bf req-c7d9cc95-3e82-402b-b585-849deab08739 service nova] Creating event network-changed:9957129a-e890-42d6-b063-83be22cd1f56 for instance d729d385-2f98-4b68-9f26-ac940ff56a90 on n-h2-848886-15 Jul 25 13:53:05.130110 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-4a2dbdc9-d2a5-4f41-b288-35c5533355bf req-c7d9cc95-3e82-402b-b585-849deab08739 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118276 Jul 25 13:53:05.131053 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3506/7087] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:53:05.225733 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-061319b2-bb66-439b-9b45-bfd7ec5601d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:53:05.234558 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-061319b2-bb66-439b-9b45-bfd7ec5601d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 200 len: 1391 microversion: 2.1 time: 0.199296 Jul 25 13:53:05.235112 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3582/7088] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:53:05 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 1391 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:53:06.256927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-71d22d72-acf6-4c1a-85f5-9441ff2c7343 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:53:06.257665 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-71d22d72-acf6-4c1a-85f5-9441ff2c7343 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:06.264663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-71d22d72-acf6-4c1a-85f5-9441ff2c7343 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:06.265199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-71d22d72-acf6-4c1a-85f5-9441ff2c7343 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:06.266035 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-71d22d72-acf6-4c1a-85f5-9441ff2c7343 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:06.266494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-71d22d72-acf6-4c1a-85f5-9441ff2c7343 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:06.402826 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-71d22d72-acf6-4c1a-85f5-9441ff2c7343 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:53:06.412640 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-71d22d72-acf6-4c1a-85f5-9441ff2c7343 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 200 len: 1391 microversion: 2.1 time: 0.160814 Jul 25 13:53:06.413283 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3507/7089] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:53:06 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:53:07.436433 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0131026b-fe21-4464-a17a-16017ce21d48 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:53:07.437244 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0131026b-fe21-4464-a17a-16017ce21d48 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:07.444513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0131026b-fe21-4464-a17a-16017ce21d48 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:07.444956 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0131026b-fe21-4464-a17a-16017ce21d48 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:07.445720 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0131026b-fe21-4464-a17a-16017ce21d48 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:07.446201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0131026b-fe21-4464-a17a-16017ce21d48 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:07.598306 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0131026b-fe21-4464-a17a-16017ce21d48 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:53:07.608934 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0131026b-fe21-4464-a17a-16017ce21d48 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 200 len: 1391 microversion: 2.1 time: 0.176307 Jul 25 13:53:07.609445 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3583/7090] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:53:07 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:53:08.630615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-66eae703-a127-47d1-bae2-1b4e06593f30 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:53:08.631224 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-66eae703-a127-47d1-bae2-1b4e06593f30 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:08.638994 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66eae703-a127-47d1-bae2-1b4e06593f30 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:08.639467 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66eae703-a127-47d1-bae2-1b4e06593f30 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:08.640267 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66eae703-a127-47d1-bae2-1b4e06593f30 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:08.640726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-66eae703-a127-47d1-bae2-1b4e06593f30 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:08.785471 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-66eae703-a127-47d1-bae2-1b4e06593f30 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:53:08.794035 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-66eae703-a127-47d1-bae2-1b4e06593f30 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 200 len: 1391 microversion: 2.1 time: 0.167303 Jul 25 13:53:08.794701 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3508/7091] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:53:08 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:53:09.815714 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-48db61bd-45b1-41a3-9594-f42e8c75764b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:53:09.816275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-48db61bd-45b1-41a3-9594-f42e8c75764b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:09.818235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:53:09.819776 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:53:09.826207 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48db61bd-45b1-41a3-9594-f42e8c75764b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:09.826660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48db61bd-45b1-41a3-9594-f42e8c75764b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:09.827502 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48db61bd-45b1-41a3-9594-f42e8c75764b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:09.828364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-48db61bd-45b1-41a3-9594-f42e8c75764b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:09.965590 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-48db61bd-45b1-41a3-9594-f42e8c75764b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:53:09.973571 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-48db61bd-45b1-41a3-9594-f42e8c75764b tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 200 len: 1391 microversion: 2.1 time: 0.161891 Jul 25 13:53:09.974217 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3584/7092] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:53:09 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:53:10.372191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-8c0c2c78-4fcf-4794-a006-45b362b90a99 req-e6892259-149d-4f27-88d6-d7da8451fbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d729d385-2f98-4b68-9f26-ac940ff56a90", "name": "network-vif-plugged", "status": "completed", "tag": "9957129a-e890-42d6-b063-83be22cd1f56"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:53:10.383666 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-8c0c2c78-4fcf-4794-a006-45b362b90a99 req-e6892259-149d-4f27-88d6-d7da8451fbf9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:10.384218 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-8c0c2c78-4fcf-4794-a006-45b362b90a99 req-e6892259-149d-4f27-88d6-d7da8451fbf9 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:10.396851 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-8c0c2c78-4fcf-4794-a006-45b362b90a99 req-e6892259-149d-4f27-88d6-d7da8451fbf9 service nova] Creating event network-vif-plugged:9957129a-e890-42d6-b063-83be22cd1f56 for instance d729d385-2f98-4b68-9f26-ac940ff56a90 on n-h2-848886-15 Jul 25 13:53:10.402008 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-8c0c2c78-4fcf-4794-a006-45b362b90a99 req-e6892259-149d-4f27-88d6-d7da8451fbf9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033608 Jul 25 13:53:10.402668 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3509/7093] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:53:10.998766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-932fadff-23f7-4e12-8036-c7303a82607a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:53:10.999630 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-932fadff-23f7-4e12-8036-c7303a82607a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:11.007122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-932fadff-23f7-4e12-8036-c7303a82607a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:11.007574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-932fadff-23f7-4e12-8036-c7303a82607a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:11.008360 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-932fadff-23f7-4e12-8036-c7303a82607a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:11.009895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-932fadff-23f7-4e12-8036-c7303a82607a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:11.157469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-932fadff-23f7-4e12-8036-c7303a82607a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:53:11.165285 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-932fadff-23f7-4e12-8036-c7303a82607a tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 200 len: 1391 microversion: 2.1 time: 0.170745 Jul 25 13:53:11.165900 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3585/7094] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:53:10 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:53:12.184253 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=8 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:53:12.190297 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9e3ef9f4-fcb8-4197-add6-b61ad69cd594 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:53:12.191144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9e3ef9f4-fcb8-4197-add6-b61ad69cd594 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:12.199581 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e3ef9f4-fcb8-4197-add6-b61ad69cd594 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:12.200061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e3ef9f4-fcb8-4197-add6-b61ad69cd594 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:12.200854 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e3ef9f4-fcb8-4197-add6-b61ad69cd594 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:12.201301 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e3ef9f4-fcb8-4197-add6-b61ad69cd594 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:12.358593 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9e3ef9f4-fcb8-4197-add6-b61ad69cd594 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:53:12.367562 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9e3ef9f4-fcb8-4197-add6-b61ad69cd594 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 200 len: 1563 microversion: 2.1 time: 0.184419 Jul 25 13:53:12.368186 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3510/7095] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:53:12 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 1563 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:53:12.389019 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-593cfda9-7095-440b-b8fd-f92af833e4d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:53:12.389642 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-593cfda9-7095-440b-b8fd-f92af833e4d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:12.391767 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=10 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:53:12.398197 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-593cfda9-7095-440b-b8fd-f92af833e4d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:12.398648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-593cfda9-7095-440b-b8fd-f92af833e4d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:12.399420 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-593cfda9-7095-440b-b8fd-f92af833e4d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:12.399894 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-593cfda9-7095-440b-b8fd-f92af833e4d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:12.539016 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-593cfda9-7095-440b-b8fd-f92af833e4d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:53:12.547114 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-593cfda9-7095-440b-b8fd-f92af833e4d9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 200 len: 1563 microversion: 2.1 time: 0.162604 Jul 25 13:53:12.547697 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3586/7096] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:53:12 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:53:14.231592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-493107f0-c917-4a42-a48c-0a8fa10afb59 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:53:14.236955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-5186b246-8aaf-41a7-9520-81c1da44bd83 req-00b1de7d-8a78-4092-a9d6-fdf286eaf5ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d729d385-2f98-4b68-9f26-ac940ff56a90", "tag": "9957129a-e890-42d6-b063-83be22cd1f56"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:53:14.242648 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-493107f0-c917-4a42-a48c-0a8fa10afb59 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:14.252321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-493107f0-c917-4a42-a48c-0a8fa10afb59 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:14.252794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-493107f0-c917-4a42-a48c-0a8fa10afb59 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:14.253140 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5186b246-8aaf-41a7-9520-81c1da44bd83 req-00b1de7d-8a78-4092-a9d6-fdf286eaf5ea service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:14.253619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-493107f0-c917-4a42-a48c-0a8fa10afb59 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:14.253984 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5186b246-8aaf-41a7-9520-81c1da44bd83 req-00b1de7d-8a78-4092-a9d6-fdf286eaf5ea service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:14.254101 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-493107f0-c917-4a42-a48c-0a8fa10afb59 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:14.266633 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-5186b246-8aaf-41a7-9520-81c1da44bd83 req-00b1de7d-8a78-4092-a9d6-fdf286eaf5ea service nova] Creating event network-changed:9957129a-e890-42d6-b063-83be22cd1f56 for instance d729d385-2f98-4b68-9f26-ac940ff56a90 on n-h2-848886-15 Jul 25 13:53:14.272736 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-5186b246-8aaf-41a7-9520-81c1da44bd83 req-00b1de7d-8a78-4092-a9d6-fdf286eaf5ea service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039542 Jul 25 13:53:14.273609 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3587/7097] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:53:14.413124 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-493107f0-c917-4a42-a48c-0a8fa10afb59 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:53:14.422881 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-493107f0-c917-4a42-a48c-0a8fa10afb59 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 200 len: 1563 microversion: 2.1 time: 0.195264 Jul 25 13:53:14.431930 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3511/7098] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:53:14 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 1563 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:53:35.709210 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=7 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:53:35.710052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=40 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:53:35.715235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dac42440-5b23-4e2d-b26e-300b6a9d08a4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:53:35.718470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dac42440-5b23-4e2d-b26e-300b6a9d08a4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:35.725485 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dac42440-5b23-4e2d-b26e-300b6a9d08a4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:35.725967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dac42440-5b23-4e2d-b26e-300b6a9d08a4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:35.726726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dac42440-5b23-4e2d-b26e-300b6a9d08a4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:35.727158 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dac42440-5b23-4e2d-b26e-300b6a9d08a4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:35.782614 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dac42440-5b23-4e2d-b26e-300b6a9d08a4 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90/action" status: 200 len: 24573 microversion: 2.1 time: 0.075089 Jul 25 13:53:35.783294 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3588/7099] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:53:35 2022] POST /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90/action => generated 24573 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:53:46.846573 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2733eb02-33ad-4c0d-a75e-f385d684df52 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:53:46.847241 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2733eb02-33ad-4c0d-a75e-f385d684df52 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:46.849376 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:53:46.850069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=34 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:53:46.856107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2733eb02-33ad-4c0d-a75e-f385d684df52 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:46.856575 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2733eb02-33ad-4c0d-a75e-f385d684df52 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:46.857343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2733eb02-33ad-4c0d-a75e-f385d684df52 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:46.857845 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2733eb02-33ad-4c0d-a75e-f385d684df52 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:46.883945 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-2733eb02-33ad-4c0d-a75e-f385d684df52 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lazy-loading 'flavor' on Instance uuid d729d385-2f98-4b68-9f26-ac940ff56a90 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:53:46.958772 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2733eb02-33ad-4c0d-a75e-f385d684df52 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90/action" status: 202 len: 0 microversion: 2.1 time: 0.116535 Jul 25 13:53:46.959439 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3512/7100] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:53:46 2022] POST /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:53:46.968862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3e7832ce-f321-47bc-9e5c-994fdf5002c9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:53:46.969543 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3e7832ce-f321-47bc-9e5c-994fdf5002c9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:46.972199 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:53:46.972971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:53:46.987275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e7832ce-f321-47bc-9e5c-994fdf5002c9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:46.987557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e7832ce-f321-47bc-9e5c-994fdf5002c9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:46.988269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e7832ce-f321-47bc-9e5c-994fdf5002c9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:46.988711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3e7832ce-f321-47bc-9e5c-994fdf5002c9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:47.137593 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3e7832ce-f321-47bc-9e5c-994fdf5002c9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:53:47.148152 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3e7832ce-f321-47bc-9e5c-994fdf5002c9 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 200 len: 1689 microversion: 2.1 time: 0.183765 Jul 25 13:53:47.148730 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3589/7101] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:53:46 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:53:48.171888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4c508ebf-ac8c-4228-a6f0-98a21819fa82 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:53:48.172614 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4c508ebf-ac8c-4228-a6f0-98a21819fa82 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:48.179329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c508ebf-ac8c-4228-a6f0-98a21819fa82 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:48.179781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c508ebf-ac8c-4228-a6f0-98a21819fa82 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:48.180592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c508ebf-ac8c-4228-a6f0-98a21819fa82 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:48.181043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c508ebf-ac8c-4228-a6f0-98a21819fa82 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:48.328712 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4c508ebf-ac8c-4228-a6f0-98a21819fa82 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:53:48.337003 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4c508ebf-ac8c-4228-a6f0-98a21819fa82 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 200 len: 1672 microversion: 2.1 time: 0.170336 Jul 25 13:53:48.337580 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3513/7102] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:53:48 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:53:49.436750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-09f6ce87-35cc-497e-8008-048a56d28464 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:53:49.438940 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-09f6ce87-35cc-497e-8008-048a56d28464 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:49.446294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09f6ce87-35cc-497e-8008-048a56d28464 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:49.447073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09f6ce87-35cc-497e-8008-048a56d28464 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:49.447815 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09f6ce87-35cc-497e-8008-048a56d28464 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:49.448249 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-09f6ce87-35cc-497e-8008-048a56d28464 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:49.501716 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-09f6ce87-35cc-497e-8008-048a56d28464 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90/action" status: 200 len: 38378 microversion: 2.1 time: 0.069036 Jul 25 13:53:49.503196 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3590/7103] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:53:49 2022] POST /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90/action => generated 38378 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:53:49.515444 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c560ffcd-52ba-479a-b009-70b8f33711a3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:53:49.515997 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c560ffcd-52ba-479a-b009-70b8f33711a3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:49.523117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c560ffcd-52ba-479a-b009-70b8f33711a3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:49.523576 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c560ffcd-52ba-479a-b009-70b8f33711a3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:49.524354 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c560ffcd-52ba-479a-b009-70b8f33711a3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:49.524799 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c560ffcd-52ba-479a-b009-70b8f33711a3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:49.594907 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c560ffcd-52ba-479a-b009-70b8f33711a3 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90/action" status: 202 len: 0 microversion: 2.1 time: 0.083401 Jul 25 13:53:49.595822 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3514/7104] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:53:49 2022] POST /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:53:49.606473 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3b043f3d-7c77-47f6-9e9e-e5bf4b3fa6b6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:53:49.607168 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3b043f3d-7c77-47f6-9e9e-e5bf4b3fa6b6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:49.615258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b043f3d-7c77-47f6-9e9e-e5bf4b3fa6b6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:49.615711 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b043f3d-7c77-47f6-9e9e-e5bf4b3fa6b6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:49.616516 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b043f3d-7c77-47f6-9e9e-e5bf4b3fa6b6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:49.616956 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3b043f3d-7c77-47f6-9e9e-e5bf4b3fa6b6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:49.772837 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3b043f3d-7c77-47f6-9e9e-e5bf4b3fa6b6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:53:49.780764 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3b043f3d-7c77-47f6-9e9e-e5bf4b3fa6b6 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 200 len: 1678 microversion: 2.1 time: 0.178567 Jul 25 13:53:49.781345 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3591/7105] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:53:49 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:53:50.803419 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e676e1c7-67c9-48c2-bf2f-aaa21f301320 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:53:50.804134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e676e1c7-67c9-48c2-bf2f-aaa21f301320 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:50.812742 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e676e1c7-67c9-48c2-bf2f-aaa21f301320 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:50.813252 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e676e1c7-67c9-48c2-bf2f-aaa21f301320 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:50.814081 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e676e1c7-67c9-48c2-bf2f-aaa21f301320 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:50.814553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e676e1c7-67c9-48c2-bf2f-aaa21f301320 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:50.960934 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e676e1c7-67c9-48c2-bf2f-aaa21f301320 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:53:50.969051 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e676e1c7-67c9-48c2-bf2f-aaa21f301320 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 200 len: 1678 microversion: 2.1 time: 0.169965 Jul 25 13:53:50.969638 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3515/7106] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:53:50 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:53:51.991391 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ca778ec0-8efd-4b4d-b38f-14ee2c450efa tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:53:51.991990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ca778ec0-8efd-4b4d-b38f-14ee2c450efa tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:52.003216 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ca778ec0-8efd-4b4d-b38f-14ee2c450efa tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:52.003671 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ca778ec0-8efd-4b4d-b38f-14ee2c450efa tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:52.004457 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ca778ec0-8efd-4b4d-b38f-14ee2c450efa tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:52.004895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ca778ec0-8efd-4b4d-b38f-14ee2c450efa tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:52.172851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ca778ec0-8efd-4b4d-b38f-14ee2c450efa tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:53:52.180763 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ca778ec0-8efd-4b4d-b38f-14ee2c450efa tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 200 len: 1681 microversion: 2.1 time: 0.193433 Jul 25 13:53:52.181420 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3592/7107] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:53:51 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 1681 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:53:52.281327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-047fafa3-3c24-40b2-938c-f2e21e54eccc tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:53:52.283652 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-047fafa3-3c24-40b2-938c-f2e21e54eccc tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:52.291196 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-047fafa3-3c24-40b2-938c-f2e21e54eccc tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:52.291664 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-047fafa3-3c24-40b2-938c-f2e21e54eccc tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:52.292468 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-047fafa3-3c24-40b2-938c-f2e21e54eccc tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:52.292925 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-047fafa3-3c24-40b2-938c-f2e21e54eccc tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:52.339951 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-047fafa3-3c24-40b2-938c-f2e21e54eccc tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "POST /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90/action" status: 200 len: 38378 microversion: 2.1 time: 0.063745 Jul 25 13:53:52.340870 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3516/7108] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:53:52 2022] POST /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90/action => generated 38378 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 13:53:53.391493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a7c8b1fb-14f4-4c19-b04d-07b4acff4a4f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:53:53.392121 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a7c8b1fb-14f4-4c19-b04d-07b4acff4a4f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:53.394138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-fc402df4-5035-43f5-9b7f-de1bb546743a req-445460b0-57d1-4be4-90b2-12c65cb5ce9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d729d385-2f98-4b68-9f26-ac940ff56a90", "tag": "9957129a-e890-42d6-b063-83be22cd1f56"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:53:53.400659 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7c8b1fb-14f4-4c19-b04d-07b4acff4a4f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:53.401446 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7c8b1fb-14f4-4c19-b04d-07b4acff4a4f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:53.402476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7c8b1fb-14f4-4c19-b04d-07b4acff4a4f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:53.403118 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a7c8b1fb-14f4-4c19-b04d-07b4acff4a4f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:53.404967 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fc402df4-5035-43f5-9b7f-de1bb546743a req-445460b0-57d1-4be4-90b2-12c65cb5ce9f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:53.405649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-fc402df4-5035-43f5-9b7f-de1bb546743a req-445460b0-57d1-4be4-90b2-12c65cb5ce9f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:53.419295 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-fc402df4-5035-43f5-9b7f-de1bb546743a req-445460b0-57d1-4be4-90b2-12c65cb5ce9f service nova] Creating event network-changed:9957129a-e890-42d6-b063-83be22cd1f56 for instance d729d385-2f98-4b68-9f26-ac940ff56a90 on n-h2-848886-15 Jul 25 13:53:53.425330 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-fc402df4-5035-43f5-9b7f-de1bb546743a req-445460b0-57d1-4be4-90b2-12c65cb5ce9f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035559 Jul 25 13:53:53.426447 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3517/7109] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:53:53.434943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a7c8b1fb-14f4-4c19-b04d-07b4acff4a4f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:53:53.527184 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a7c8b1fb-14f4-4c19-b04d-07b4acff4a4f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 204 len: 0 microversion: 2.1 time: 0.139569 Jul 25 13:53:53.528206 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3593/7110] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:53:53 2022] DELETE /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:53:53.540567 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9bf90d32-edab-42db-8565-77d10736af9f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:53:53.541693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9bf90d32-edab-42db-8565-77d10736af9f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:53.550330 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9bf90d32-edab-42db-8565-77d10736af9f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:53.551360 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9bf90d32-edab-42db-8565-77d10736af9f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:53.552487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9bf90d32-edab-42db-8565-77d10736af9f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:53.553373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9bf90d32-edab-42db-8565-77d10736af9f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:53.698824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9bf90d32-edab-42db-8565-77d10736af9f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:53:53.708131 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9bf90d32-edab-42db-8565-77d10736af9f tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 200 len: 1687 microversion: 2.1 time: 0.173300 Jul 25 13:53:53.708733 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3518/7111] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:53:53 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:53:54.731386 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8b83d450-4928-4ea3-b197-d1959640fcf5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:53:54.732053 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8b83d450-4928-4ea3-b197-d1959640fcf5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:54.739653 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b83d450-4928-4ea3-b197-d1959640fcf5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:54.740155 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b83d450-4928-4ea3-b197-d1959640fcf5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:54.740934 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b83d450-4928-4ea3-b197-d1959640fcf5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:54.741373 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8b83d450-4928-4ea3-b197-d1959640fcf5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:54.894209 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8b83d450-4928-4ea3-b197-d1959640fcf5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:53:54.903717 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8b83d450-4928-4ea3-b197-d1959640fcf5 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 200 len: 1687 microversion: 2.1 time: 0.176595 Jul 25 13:53:54.904621 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3594/7112] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:53:54 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:53:55.515856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-e808ca72-eb50-41aa-bc52-0c95dbbf0aaf req-4ccd7c5e-f8f4-4eb2-af26-3f64dee2e922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d729d385-2f98-4b68-9f26-ac940ff56a90", "name": "network-vif-deleted", "tag": "9957129a-e890-42d6-b063-83be22cd1f56"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:53:55.528459 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e808ca72-eb50-41aa-bc52-0c95dbbf0aaf req-4ccd7c5e-f8f4-4eb2-af26-3f64dee2e922 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:55.528923 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-e808ca72-eb50-41aa-bc52-0c95dbbf0aaf req-4ccd7c5e-f8f4-4eb2-af26-3f64dee2e922 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:55.542291 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-e808ca72-eb50-41aa-bc52-0c95dbbf0aaf req-4ccd7c5e-f8f4-4eb2-af26-3f64dee2e922 service nova] Creating event network-vif-deleted:9957129a-e890-42d6-b063-83be22cd1f56 for instance d729d385-2f98-4b68-9f26-ac940ff56a90 on n-h2-848886-15 Jul 25 13:53:55.549426 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-e808ca72-eb50-41aa-bc52-0c95dbbf0aaf req-4ccd7c5e-f8f4-4eb2-af26-3f64dee2e922 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036752 Jul 25 13:53:55.550581 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3519/7113] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:53:55.928972 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e1586a55-25c0-4d1b-973f-84bf1349f0a2 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:53:55.929824 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e1586a55-25c0-4d1b-973f-84bf1349f0a2 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:55.941083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1586a55-25c0-4d1b-973f-84bf1349f0a2 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:55.942013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1586a55-25c0-4d1b-973f-84bf1349f0a2 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:55.943162 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1586a55-25c0-4d1b-973f-84bf1349f0a2 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:55.943928 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1586a55-25c0-4d1b-973f-84bf1349f0a2 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:55.978889 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1586a55-25c0-4d1b-973f-84bf1349f0a2 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:55.979347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e1586a55-25c0-4d1b-973f-84bf1349f0a2 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:55.979811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.objects.instance [None req-e1586a55-25c0-4d1b-973f-84bf1349f0a2 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lazy-loading 'fault' on Instance uuid d729d385-2f98-4b68-9f26-ac940ff56a90 {{(pid=125884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:53:56.029115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e1586a55-25c0-4d1b-973f-84bf1349f0a2 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97a7b925de4cca981fe1d714f5e986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3ff31102b0437aba77c5efe779af7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:53:56.038248 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e1586a55-25c0-4d1b-973f-84bf1349f0a2 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 200 len: 1356 microversion: 2.1 time: 0.113134 Jul 25 13:53:56.038996 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3595/7114] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:53:55 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 1356 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:53:57.060852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-946e916b-579e-49d8-9748-972ed9f616f7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:53:57.061565 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-946e916b-579e-49d8-9748-972ed9f616f7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] [instance: d729d385-2f98-4b68-9f26-ac940ff56a90] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:53:57.068498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-946e916b-579e-49d8-9748-972ed9f616f7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:57.068961 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-946e916b-579e-49d8-9748-972ed9f616f7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:57.069753 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-946e916b-579e-49d8-9748-972ed9f616f7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:53:57.070200 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-946e916b-579e-49d8-9748-972ed9f616f7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:53:57.084933 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.wsgi [None req-946e916b-579e-49d8-9748-972ed9f616f7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] HTTP exception thrown: Instance d729d385-2f98-4b68-9f26-ac940ff56a90 could not be found. Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-946e916b-579e-49d8-9748-972ed9f616f7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Request method failure captured: Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: request: GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 HTTP/1.1 Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: Accept: application/json Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: Accept-Encoding: identity Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: Connection: close Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: Content-Length: 0 Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: Content-Type: application/json Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: Host: 10.222.0.49 Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: Openstack-System-Scope: None Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: User-Agent: python-urllib3/1.26.10 Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: X-Auth-Token: gAAAAABi3p6nyr1k_mFa4TokFEOlsou6AutFycw2kIO61UeF99u26RQ-4tpsrMhICbgi-9flg72p_U8OM5XgKZ6LQr4j4tb8J14QULHs7ajP_ZgmomWC6pW8wz9n9aS-w6knWlaT3jwDpfYXaMI8wyO7_qrSx4IpgYN7bXoMCpzogGqHy3JVQbs Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Id: None Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: X-Domain-Name: None Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: X-Identity-Status: Confirmed Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: X-Is-Admin-Project: True Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Id: default Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Domain-Name: Default Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Id: 2a3ff31102b0437aba77c5efe779af7a Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1441249113 Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: X-Role: reader,member Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: X-Roles: reader,member Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2a3ff31102b0437aba77c5efe779af7a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2a3ff31102b0437aba77c5efe779af7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2a3ff31102b0437aba77c5efe779af7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2a3ff31102b0437aba77c5efe779af7a"}]}] Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1441249113 Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Id: 2a3ff31102b0437aba77c5efe779af7a Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1441249113 Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: X-User: tempest-TestNetworkAdvancedServerOps-1441249113-project Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Id: default Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: X-User-Domain-Name: Default Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: X-User-Id: bc97a7b925de4cca981fe1d714f5e986 Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1441249113-project Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: method: > Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: exception: Instance d729d385-2f98-4b68-9f26-ac940ff56a90 could not be found. Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: action_args: {'id': 'd729d385-2f98-4b68-9f26-ac940ff56a90'} Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d729d385-2f98-4b68-9f26-ac940ff56a90 could not be found. Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d729d385-2f98-4b68-9f26-ac940ff56a90 could not be found. Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:53:57.086655 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:53:57.094466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:53:57.094466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:53:57.094466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:53:57.094466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:53:57.094466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:53:57.094466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:53:57.094466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d729d385-2f98-4b68-9f26-ac940ff56a90 could not be found. Jul 25 13:53:57.094466 n-d-848886-15 devstack@n-api.service[125883]: ERROR nova.api.openstack.wsgi Jul 25 13:53:57.094466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-946e916b-579e-49d8-9748-972ed9f616f7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Returning 404 to user: Instance d729d385-2f98-4b68-9f26-ac940ff56a90 could not be found. {{(pid=125883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:53:57.094466 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-946e916b-579e-49d8-9748-972ed9f616f7 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90" status: 404 len: 111 microversion: 2.1 time: 0.032649 Jul 25 13:53:57.094466 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3520/7115] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:53:57 2022] GET /compute/v2.1/servers/d729d385-2f98-4b68-9f26-ac940ff56a90 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:54:00.684148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-aecc897f-158f-4608-ad3d-294cb491b1a2 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] Calling method '.version_select at 0x7efcf9b40c10>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:54:00.709711 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-aecc897f-158f-4608-ad3d-294cb491b1a2 tempest-TestNetworkAdvancedServerOps-1441249113 tempest-TestNetworkAdvancedServerOps-1441249113-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-981040012" status: 202 len: 0 microversion: 2.1 time: 0.029328 Jul 25 13:54:00.711037 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3596/7116] 10.222.0.49 () {58 vars in 1281 bytes} [Mon Jul 25 13:54:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-981040012 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:54:12.717612 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=18 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:54:12.718558 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:54:12.926698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b3f14f30-1630-4b66-8e13-6271c30f971e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Action: 'create', calling method: .version_select at 0x7efcf8d22ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1752807540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt8F+iTgyz25xZQhEB4IHXPPLxkHFTyMI04vC+lLx3vknzihGxMOE+c81uQS6huCMcg+B3M9LGG8utlghPNv255Lys7KugAEgB6JK6OFA7qgQE9W7ZI7irufB5x80obCQ=="}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:54:12.943719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-b3f14f30-1630-4b66-8e13-6271c30f971e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Getting quotas for project 952fff45e4574565b432d43745b1f4b2. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:54:12.950750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-b3f14f30-1630-4b66-8e13-6271c30f971e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Getting quotas for user 10ad8c74d82d4166850eadcd222dd0bc and project 952fff45e4574565b432d43745b1f4b2. Resources: {'key_pairs'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:54:12.978789 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b3f14f30-1630-4b66-8e13-6271c30f971e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.269785 Jul 25 13:54:12.985565 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3521/7117] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:54:12 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:54:14.142862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5e0e4c51-4c81-45e6-b1d5-99551e5bb3a5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-934512501", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1752807540", "security_groups": [{"name": "tempest-secgroup-smoke-1923707328"}], "networks": [{"uuid": "90553bf2-a438-4ab8-978a-1bb761757676"}]}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:54:14.152871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:54:14.153648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:54:14.278494 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.network.neutron [None req-5e0e4c51-4c81-45e6-b1d5-99551e5bb3a5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] validate_networks() for [('90553bf2-a438-4ab8-978a-1bb761757676', None, None, None, None, None)] {{(pid=125884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:54:14.693859 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-5e0e4c51-4c81-45e6-b1d5-99551e5bb3a5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Flavor limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:54:14.694604 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-5e0e4c51-4c81-45e6-b1d5-99551e5bb3a5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Image limits 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:54:14.695522 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-5e0e4c51-4c81-45e6-b1d5-99551e5bb3a5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Flavor pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:54:14.696580 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-5e0e4c51-4c81-45e6-b1d5-99551e5bb3a5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Image pref 0:0:0 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:54:14.697382 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.virt.hardware [None req-5e0e4c51-4c81-45e6-b1d5-99551e5bb3a5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:54:14.710714 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e0e4c51-4c81-45e6-b1d5-99551e5bb3a5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:14.711288 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e0e4c51-4c81-45e6-b1d5-99551e5bb3a5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:14.712154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e0e4c51-4c81-45e6-b1d5-99551e5bb3a5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:14.712821 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5e0e4c51-4c81-45e6-b1d5-99551e5bb3a5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:14.730705 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-5e0e4c51-4c81-45e6-b1d5-99551e5bb3a5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Getting quotas for project 952fff45e4574565b432d43745b1f4b2. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:54:14.736374 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-5e0e4c51-4c81-45e6-b1d5-99551e5bb3a5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Getting quotas for user 10ad8c74d82d4166850eadcd222dd0bc and project 952fff45e4574565b432d43745b1f4b2. Resources: {'instances', 'cores', 'ram'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:54:14.752656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5e0e4c51-4c81-45e6-b1d5-99551e5bb3a5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Going to run 1 instances... {{(pid=125884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:54:14.756676 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5e0e4c51-4c81-45e6-b1d5-99551e5bb3a5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:54:14.811805 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5e0e4c51-4c81-45e6-b1d5-99551e5bb3a5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.673172 Jul 25 13:54:14.812623 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3597/7118] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:54:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:54:14.824807 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-14e2b99b-3a24-47da-9430-eaff428e77a6 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:54:14.825433 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-14e2b99b-3a24-47da-9430-eaff428e77a6 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:54:14.896105 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-14e2b99b-3a24-47da-9430-eaff428e77a6 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:54:14.906351 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-14e2b99b-3a24-47da-9430-eaff428e77a6 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1246 microversion: 2.1 time: 0.086405 Jul 25 13:54:14.907232 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3522/7119] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:54:14 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:54:15.929057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3839c66c-6b5f-40b5-9de9-1fccdde6a996 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:54:15.930619 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3839c66c-6b5f-40b5-9de9-1fccdde6a996 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:54:15.937377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3839c66c-6b5f-40b5-9de9-1fccdde6a996 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:15.937953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3839c66c-6b5f-40b5-9de9-1fccdde6a996 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:15.938963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3839c66c-6b5f-40b5-9de9-1fccdde6a996 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:15.939477 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3839c66c-6b5f-40b5-9de9-1fccdde6a996 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:16.037681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3839c66c-6b5f-40b5-9de9-1fccdde6a996 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:54:16.050228 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3839c66c-6b5f-40b5-9de9-1fccdde6a996 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1298 microversion: 2.1 time: 0.125863 Jul 25 13:54:16.050944 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3598/7120] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:54:15 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1298 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:54:17.071818 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fcae3cf0-0920-466f-9ba2-a83065731dda tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:54:17.072464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fcae3cf0-0920-466f-9ba2-a83065731dda tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:54:17.081042 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fcae3cf0-0920-466f-9ba2-a83065731dda tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:17.081907 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fcae3cf0-0920-466f-9ba2-a83065731dda tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:17.082874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fcae3cf0-0920-466f-9ba2-a83065731dda tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:17.083305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fcae3cf0-0920-466f-9ba2-a83065731dda tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:17.319508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fcae3cf0-0920-466f-9ba2-a83065731dda tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:54:17.328068 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fcae3cf0-0920-466f-9ba2-a83065731dda tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1372 microversion: 2.1 time: 0.260555 Jul 25 13:54:17.328880 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3523/7121] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:54:17 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1372 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:54:18.139618 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-5e3f8249-d09b-494f-b67d-88153c1e650e req-9dc70138-6365-48fc-a710-e73e8d6aed84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03fb7fcf-cdb3-427d-8cc5-726564db3154", "tag": "8c1358b0-223c-4f94-97da-920dd71e5573"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:54:18.150181 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5e3f8249-d09b-494f-b67d-88153c1e650e req-9dc70138-6365-48fc-a710-e73e8d6aed84 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:18.154658 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-5e3f8249-d09b-494f-b67d-88153c1e650e req-9dc70138-6365-48fc-a710-e73e8d6aed84 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:18.171427 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-5e3f8249-d09b-494f-b67d-88153c1e650e req-9dc70138-6365-48fc-a710-e73e8d6aed84 service nova] Creating event network-changed:8c1358b0-223c-4f94-97da-920dd71e5573 for instance 03fb7fcf-cdb3-427d-8cc5-726564db3154 on n-h1-848886-15 Jul 25 13:54:18.177903 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-5e3f8249-d09b-494f-b67d-88153c1e650e req-9dc70138-6365-48fc-a710-e73e8d6aed84 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129336 Jul 25 13:54:18.179124 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3599/7122] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:54:18.350650 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7a4bbc36-fe59-4d62-ade1-7af49ace4044 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:54:18.351361 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7a4bbc36-fe59-4d62-ade1-7af49ace4044 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:54:18.360009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a4bbc36-fe59-4d62-ade1-7af49ace4044 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:18.361398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a4bbc36-fe59-4d62-ade1-7af49ace4044 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:18.362449 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a4bbc36-fe59-4d62-ade1-7af49ace4044 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:18.362973 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7a4bbc36-fe59-4d62-ade1-7af49ace4044 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:18.581265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7a4bbc36-fe59-4d62-ade1-7af49ace4044 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:54:18.589717 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7a4bbc36-fe59-4d62-ade1-7af49ace4044 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1372 microversion: 2.1 time: 0.243115 Jul 25 13:54:18.604602 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3524/7123] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:54:18 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1372 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:54:19.613450 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4d0c83e7-bbdb-440f-9a3c-615988a5f5bd tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:54:19.614128 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4d0c83e7-bbdb-440f-9a3c-615988a5f5bd tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:54:19.621667 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d0c83e7-bbdb-440f-9a3c-615988a5f5bd tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:19.622095 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d0c83e7-bbdb-440f-9a3c-615988a5f5bd tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:19.622893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d0c83e7-bbdb-440f-9a3c-615988a5f5bd tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:19.623331 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4d0c83e7-bbdb-440f-9a3c-615988a5f5bd tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:19.852781 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4d0c83e7-bbdb-440f-9a3c-615988a5f5bd tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:54:19.861094 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4d0c83e7-bbdb-440f-9a3c-615988a5f5bd tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1372 microversion: 2.1 time: 0.251969 Jul 25 13:54:19.861688 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3600/7124] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:54:19 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1372 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:54:20.882321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ab811d48-3c18-456c-8deb-f3512e7b8527 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:54:20.882927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ab811d48-3c18-456c-8deb-f3512e7b8527 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:54:20.890457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ab811d48-3c18-456c-8deb-f3512e7b8527 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:20.890926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ab811d48-3c18-456c-8deb-f3512e7b8527 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:20.891708 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ab811d48-3c18-456c-8deb-f3512e7b8527 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:20.892159 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ab811d48-3c18-456c-8deb-f3512e7b8527 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:21.028180 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ab811d48-3c18-456c-8deb-f3512e7b8527 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:54:21.036182 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ab811d48-3c18-456c-8deb-f3512e7b8527 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1372 microversion: 2.1 time: 0.158072 Jul 25 13:54:21.036785 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3525/7125] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:54:20 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:54:22.058168 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b4cfbc8c-ab32-41f9-b4c1-7ef89986d5e0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:54:22.058814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b4cfbc8c-ab32-41f9-b4c1-7ef89986d5e0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:54:22.066522 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4cfbc8c-ab32-41f9-b4c1-7ef89986d5e0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:22.066974 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4cfbc8c-ab32-41f9-b4c1-7ef89986d5e0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:22.067759 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4cfbc8c-ab32-41f9-b4c1-7ef89986d5e0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:22.068188 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b4cfbc8c-ab32-41f9-b4c1-7ef89986d5e0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:22.226745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b4cfbc8c-ab32-41f9-b4c1-7ef89986d5e0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:54:22.235135 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b4cfbc8c-ab32-41f9-b4c1-7ef89986d5e0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1372 microversion: 2.1 time: 0.180912 Jul 25 13:54:22.235734 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3601/7126] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:54:22 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:54:23.260935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-bf2e67c4-73f1-4a37-8fc5-eff19ffb497c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:54:23.261565 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-bf2e67c4-73f1-4a37-8fc5-eff19ffb497c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:54:23.269242 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf2e67c4-73f1-4a37-8fc5-eff19ffb497c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:23.269698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf2e67c4-73f1-4a37-8fc5-eff19ffb497c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:23.270517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf2e67c4-73f1-4a37-8fc5-eff19ffb497c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:23.270960 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-bf2e67c4-73f1-4a37-8fc5-eff19ffb497c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:23.408270 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-bf2e67c4-73f1-4a37-8fc5-eff19ffb497c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:54:23.417096 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-bf2e67c4-73f1-4a37-8fc5-eff19ffb497c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1372 microversion: 2.1 time: 0.161027 Jul 25 13:54:23.417696 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3526/7127] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:54:23 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:54:24.249768 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-9e7580bd-a758-4cd1-ba67-e0655140277d req-480ff542-82de-4e2d-94e7-b17ddf97cd37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03fb7fcf-cdb3-427d-8cc5-726564db3154", "name": "network-vif-plugged", "status": "completed", "tag": "8c1358b0-223c-4f94-97da-920dd71e5573"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:54:24.261462 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9e7580bd-a758-4cd1-ba67-e0655140277d req-480ff542-82de-4e2d-94e7-b17ddf97cd37 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:24.261937 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-9e7580bd-a758-4cd1-ba67-e0655140277d req-480ff542-82de-4e2d-94e7-b17ddf97cd37 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:24.273965 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-9e7580bd-a758-4cd1-ba67-e0655140277d req-480ff542-82de-4e2d-94e7-b17ddf97cd37 service nova] Creating event network-vif-plugged:8c1358b0-223c-4f94-97da-920dd71e5573 for instance 03fb7fcf-cdb3-427d-8cc5-726564db3154 on n-h1-848886-15 Jul 25 13:54:24.279262 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-9e7580bd-a758-4cd1-ba67-e0655140277d req-480ff542-82de-4e2d-94e7-b17ddf97cd37 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033447 Jul 25 13:54:24.279897 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3602/7128] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:54:24.439358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f356b946-0099-44d5-b2d0-0341f431c70f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:54:24.440025 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f356b946-0099-44d5-b2d0-0341f431c70f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:54:24.447556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f356b946-0099-44d5-b2d0-0341f431c70f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:24.448024 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f356b946-0099-44d5-b2d0-0341f431c70f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:24.448814 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f356b946-0099-44d5-b2d0-0341f431c70f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:24.449265 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f356b946-0099-44d5-b2d0-0341f431c70f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:24.594804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f356b946-0099-44d5-b2d0-0341f431c70f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:54:24.603186 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f356b946-0099-44d5-b2d0-0341f431c70f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1372 microversion: 2.1 time: 0.168026 Jul 25 13:54:24.603823 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3527/7129] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:54:24 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:54:25.622143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:54:25.622961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:54:25.627862 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-07319a64-fd98-41cd-b2f3-4f17da4d78c7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:54:25.628626 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-07319a64-fd98-41cd-b2f3-4f17da4d78c7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:54:25.635841 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07319a64-fd98-41cd-b2f3-4f17da4d78c7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:25.636285 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07319a64-fd98-41cd-b2f3-4f17da4d78c7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:25.637050 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07319a64-fd98-41cd-b2f3-4f17da4d78c7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:25.637487 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-07319a64-fd98-41cd-b2f3-4f17da4d78c7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:25.779584 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-07319a64-fd98-41cd-b2f3-4f17da4d78c7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:54:25.788345 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-07319a64-fd98-41cd-b2f3-4f17da4d78c7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1556 microversion: 2.1 time: 0.167141 Jul 25 13:54:25.788915 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3603/7130] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:54:25 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:54:25.809052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-734a4943-c851-4504-b277-dcc3ddd07341 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:54:25.809685 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-734a4943-c851-4504-b277-dcc3ddd07341 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:54:25.811690 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:54:25.818524 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-734a4943-c851-4504-b277-dcc3ddd07341 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:25.818999 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-734a4943-c851-4504-b277-dcc3ddd07341 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:25.819794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-734a4943-c851-4504-b277-dcc3ddd07341 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:25.820248 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-734a4943-c851-4504-b277-dcc3ddd07341 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:25.964231 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-734a4943-c851-4504-b277-dcc3ddd07341 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:54:25.972465 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-734a4943-c851-4504-b277-dcc3ddd07341 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1556 microversion: 2.1 time: 0.167331 Jul 25 13:54:25.972980 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3528/7131] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:54:25 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:54:27.750935 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-87517ce1-f8e9-4339-8f3b-581f8b1f24cf req-ccd190a0-c991-4b8a-a937-cf3b94aea562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03fb7fcf-cdb3-427d-8cc5-726564db3154", "tag": "8c1358b0-223c-4f94-97da-920dd71e5573"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:54:27.762542 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-87517ce1-f8e9-4339-8f3b-581f8b1f24cf req-ccd190a0-c991-4b8a-a937-cf3b94aea562 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:54:27.762990 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-87517ce1-f8e9-4339-8f3b-581f8b1f24cf req-ccd190a0-c991-4b8a-a937-cf3b94aea562 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:54:27.774611 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-87517ce1-f8e9-4339-8f3b-581f8b1f24cf req-ccd190a0-c991-4b8a-a937-cf3b94aea562 service nova] Creating event network-changed:8c1358b0-223c-4f94-97da-920dd71e5573 for instance 03fb7fcf-cdb3-427d-8cc5-726564db3154 on n-h1-848886-15 Jul 25 13:54:27.779962 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-87517ce1-f8e9-4339-8f3b-581f8b1f24cf req-ccd190a0-c991-4b8a-a937-cf3b94aea562 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032940 Jul 25 13:54:27.780601 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3604/7132] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:56:18.014952 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:56:18.015610 n-d-848886-15 devstack@n-api.service[125883]: Mon Jul 25 13:56:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:56:20.455166 n-d-848886-15 devstack@n-api.service[125883]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34360325-f0fe-440a-9621-399cd8a3ecbe] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 13:56:20.456010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:56:20.456820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=36 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:56:20.460881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-903e25b5-4ab3-4d9a-9016-c7cbf0b62eab tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:56:20.461434 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-903e25b5-4ab3-4d9a-9016-c7cbf0b62eab tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:20.468672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-903e25b5-4ab3-4d9a-9016-c7cbf0b62eab tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:20.469138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-903e25b5-4ab3-4d9a-9016-c7cbf0b62eab tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:20.469949 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-903e25b5-4ab3-4d9a-9016-c7cbf0b62eab tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:20.470398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-903e25b5-4ab3-4d9a-9016-c7cbf0b62eab tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:20.494681 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-903e25b5-4ab3-4d9a-9016-c7cbf0b62eab tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lazy-loading 'flavor' on Instance uuid 03fb7fcf-cdb3-427d-8cc5-726564db3154 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 13:56:20.676709 n-d-848886-15 devstack@n-api.service[125883]: ERROR oslo.messaging._drivers.impl_rabbit [None req-903e25b5-4ab3-4d9a-9016-c7cbf0b62eab tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [d19a7b74-6754-4bae-8d58-328d95b0fd17] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 13:56:21.465191 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] [34360325-f0fe-440a-9621-399cd8a3ecbe] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 48780. Jul 25 13:56:21.687152 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [None req-903e25b5-4ab3-4d9a-9016-c7cbf0b62eab tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [d19a7b74-6754-4bae-8d58-328d95b0fd17] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 48782. Jul 25 13:56:21.691078 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-903e25b5-4ab3-4d9a-9016-c7cbf0b62eab tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "POST /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154/action" status: 202 len: 0 microversion: 2.1 time: 1.238020 Jul 25 13:56:21.691679 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3529/7133] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:56:20 2022] POST /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154/action => generated 0 bytes in 1239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:56:21.699353 n-d-848886-15 devstack@n-api.service[125884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7bc01c6a-70b5-4524-8a8d-4de2decdc49e] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 13:56:21.699967 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:56:21.700996 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=32 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:56:21.705471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-876c9196-a3d5-43bd-9db6-f624fa8225e4 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:21.706204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-876c9196-a3d5-43bd-9db6-f624fa8225e4 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:21.714314 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-876c9196-a3d5-43bd-9db6-f624fa8225e4 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:21.714856 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-876c9196-a3d5-43bd-9db6-f624fa8225e4 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:21.715939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-876c9196-a3d5-43bd-9db6-f624fa8225e4 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:21.716347 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-876c9196-a3d5-43bd-9db6-f624fa8225e4 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:21.853441 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-876c9196-a3d5-43bd-9db6-f624fa8225e4 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:21.861520 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-876c9196-a3d5-43bd-9db6-f624fa8225e4 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1680 microversion: 2.1 time: 0.164600 Jul 25 13:56:21.862122 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3605/7134] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:21 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:22.885615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-aba28f9b-a08e-4411-b3ac-e919f333d857 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:22.886383 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-aba28f9b-a08e-4411-b3ac-e919f333d857 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:22.893497 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aba28f9b-a08e-4411-b3ac-e919f333d857 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:22.893993 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aba28f9b-a08e-4411-b3ac-e919f333d857 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:22.894778 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aba28f9b-a08e-4411-b3ac-e919f333d857 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:22.895232 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-aba28f9b-a08e-4411-b3ac-e919f333d857 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:23.035792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-aba28f9b-a08e-4411-b3ac-e919f333d857 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:23.044359 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-aba28f9b-a08e-4411-b3ac-e919f333d857 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1680 microversion: 2.1 time: 0.164842 Jul 25 13:56:23.044944 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3530/7135] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:22 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:23.999068 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:56:23.999666 n-d-848886-15 devstack@n-api.service[125884]: Mon Jul 25 13:56:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:56:24.066660 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b0aee367-f377-459d-bf6b-2a24290a1599 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:24.067362 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b0aee367-f377-459d-bf6b-2a24290a1599 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:24.076761 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0aee367-f377-459d-bf6b-2a24290a1599 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:24.077236 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0aee367-f377-459d-bf6b-2a24290a1599 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:24.078105 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0aee367-f377-459d-bf6b-2a24290a1599 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:24.078571 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b0aee367-f377-459d-bf6b-2a24290a1599 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:24.101129 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] [7bc01c6a-70b5-4524-8a8d-4de2decdc49e] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 48794. Jul 25 13:56:24.223376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b0aee367-f377-459d-bf6b-2a24290a1599 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:24.231589 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b0aee367-f377-459d-bf6b-2a24290a1599 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1680 microversion: 2.1 time: 0.169067 Jul 25 13:56:24.232181 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3606/7136] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:24 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:25.256034 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-75acf562-7aa9-4583-8707-c85d249e01ad tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:25.256750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-75acf562-7aa9-4583-8707-c85d249e01ad tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:25.264924 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-75acf562-7aa9-4583-8707-c85d249e01ad tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:25.265385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-75acf562-7aa9-4583-8707-c85d249e01ad tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:25.266246 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-75acf562-7aa9-4583-8707-c85d249e01ad tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:25.266700 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-75acf562-7aa9-4583-8707-c85d249e01ad tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:25.419705 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-75acf562-7aa9-4583-8707-c85d249e01ad tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:25.428304 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-75acf562-7aa9-4583-8707-c85d249e01ad tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1680 microversion: 2.1 time: 0.178355 Jul 25 13:56:25.428868 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3531/7137] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:25 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:26.451065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-52241deb-c242-472d-b460-1ef7af1edc1a tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:26.451687 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-52241deb-c242-472d-b460-1ef7af1edc1a tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:26.458855 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-52241deb-c242-472d-b460-1ef7af1edc1a tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:26.459302 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-52241deb-c242-472d-b460-1ef7af1edc1a tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:26.460056 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-52241deb-c242-472d-b460-1ef7af1edc1a tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:26.460621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-52241deb-c242-472d-b460-1ef7af1edc1a tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:26.599493 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-52241deb-c242-472d-b460-1ef7af1edc1a tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:26.607790 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-52241deb-c242-472d-b460-1ef7af1edc1a tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1680 microversion: 2.1 time: 0.160740 Jul 25 13:56:26.608374 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3607/7138] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:26 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:27.629916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d1aac689-8f43-4b0d-b1f8-7241d0c7b954 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:27.630562 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d1aac689-8f43-4b0d-b1f8-7241d0c7b954 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:27.638250 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1aac689-8f43-4b0d-b1f8-7241d0c7b954 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:27.638718 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1aac689-8f43-4b0d-b1f8-7241d0c7b954 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:27.639775 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1aac689-8f43-4b0d-b1f8-7241d0c7b954 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:27.640370 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d1aac689-8f43-4b0d-b1f8-7241d0c7b954 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:27.785478 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d1aac689-8f43-4b0d-b1f8-7241d0c7b954 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:27.793708 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d1aac689-8f43-4b0d-b1f8-7241d0c7b954 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1680 microversion: 2.1 time: 0.167666 Jul 25 13:56:27.794452 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3532/7139] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:27 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:28.817091 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8cae1cb3-53ee-46a9-bf66-b8876508437a tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:28.817796 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8cae1cb3-53ee-46a9-bf66-b8876508437a tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:28.825863 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8cae1cb3-53ee-46a9-bf66-b8876508437a tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:28.826322 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8cae1cb3-53ee-46a9-bf66-b8876508437a tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:28.827122 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8cae1cb3-53ee-46a9-bf66-b8876508437a tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:28.827543 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8cae1cb3-53ee-46a9-bf66-b8876508437a tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:28.967948 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8cae1cb3-53ee-46a9-bf66-b8876508437a tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:28.977144 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8cae1cb3-53ee-46a9-bf66-b8876508437a tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1680 microversion: 2.1 time: 0.164086 Jul 25 13:56:28.977768 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3608/7140] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:28 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:29.999217 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f2446be0-8085-447e-94f0-7e2f5bf7bb23 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:29.999842 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f2446be0-8085-447e-94f0-7e2f5bf7bb23 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:30.008317 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f2446be0-8085-447e-94f0-7e2f5bf7bb23 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:30.008804 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f2446be0-8085-447e-94f0-7e2f5bf7bb23 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:30.009713 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f2446be0-8085-447e-94f0-7e2f5bf7bb23 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:30.010196 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f2446be0-8085-447e-94f0-7e2f5bf7bb23 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:30.146640 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f2446be0-8085-447e-94f0-7e2f5bf7bb23 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:30.154937 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f2446be0-8085-447e-94f0-7e2f5bf7bb23 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1680 microversion: 2.1 time: 0.159986 Jul 25 13:56:30.155518 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3533/7141] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:29 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:31.176771 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0c7ecd82-1098-4475-a07a-8b2d30dd4477 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:31.177383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0c7ecd82-1098-4475-a07a-8b2d30dd4477 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:31.185511 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0c7ecd82-1098-4475-a07a-8b2d30dd4477 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:31.186001 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0c7ecd82-1098-4475-a07a-8b2d30dd4477 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:31.186805 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0c7ecd82-1098-4475-a07a-8b2d30dd4477 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:31.187394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0c7ecd82-1098-4475-a07a-8b2d30dd4477 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:31.339646 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0c7ecd82-1098-4475-a07a-8b2d30dd4477 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:31.348487 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0c7ecd82-1098-4475-a07a-8b2d30dd4477 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1680 microversion: 2.1 time: 0.175474 Jul 25 13:56:31.349083 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3609/7142] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:31 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:32.370260 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-a9feb307-8c4f-4146-9313-86d44c95432b tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:32.370885 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-a9feb307-8c4f-4146-9313-86d44c95432b tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:32.378493 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9feb307-8c4f-4146-9313-86d44c95432b tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:32.378964 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9feb307-8c4f-4146-9313-86d44c95432b tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:32.379750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9feb307-8c4f-4146-9313-86d44c95432b tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:32.380197 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-a9feb307-8c4f-4146-9313-86d44c95432b tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:32.519916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-a9feb307-8c4f-4146-9313-86d44c95432b tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:32.528404 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-a9feb307-8c4f-4146-9313-86d44c95432b tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1701 microversion: 2.1 time: 0.162017 Jul 25 13:56:32.528963 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3534/7143] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:32 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1701 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:33.550900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-25062182-44f8-4a31-8323-14d72dc20286 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:33.551470 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-25062182-44f8-4a31-8323-14d72dc20286 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:33.559372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25062182-44f8-4a31-8323-14d72dc20286 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:33.559811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25062182-44f8-4a31-8323-14d72dc20286 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:33.560586 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25062182-44f8-4a31-8323-14d72dc20286 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:33.561017 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-25062182-44f8-4a31-8323-14d72dc20286 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:33.697999 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-25062182-44f8-4a31-8323-14d72dc20286 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:33.708943 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-25062182-44f8-4a31-8323-14d72dc20286 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1701 microversion: 2.1 time: 0.162186 Jul 25 13:56:33.709542 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3610/7144] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:33 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1701 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:34.733336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4c4d5702-eddd-488d-babe-87e0c19a5d41 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:34.734762 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4c4d5702-eddd-488d-babe-87e0c19a5d41 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:34.742848 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c4d5702-eddd-488d-babe-87e0c19a5d41 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:34.743409 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c4d5702-eddd-488d-babe-87e0c19a5d41 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:34.744275 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c4d5702-eddd-488d-babe-87e0c19a5d41 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:34.744906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4c4d5702-eddd-488d-babe-87e0c19a5d41 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:35.269277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4c4d5702-eddd-488d-babe-87e0c19a5d41 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:35.277482 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4c4d5702-eddd-488d-babe-87e0c19a5d41 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1696 microversion: 2.1 time: 0.548110 Jul 25 13:56:35.278487 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3535/7145] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:34 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1696 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:36.301430 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b6da028e-e2b8-41b9-a61f-4f5610d796ca tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:36.302727 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b6da028e-e2b8-41b9-a61f-4f5610d796ca tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:36.310040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6da028e-e2b8-41b9-a61f-4f5610d796ca tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:36.310843 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6da028e-e2b8-41b9-a61f-4f5610d796ca tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:36.314086 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6da028e-e2b8-41b9-a61f-4f5610d796ca tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:36.314719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b6da028e-e2b8-41b9-a61f-4f5610d796ca tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:36.464083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b6da028e-e2b8-41b9-a61f-4f5610d796ca tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:36.473273 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b6da028e-e2b8-41b9-a61f-4f5610d796ca tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1696 microversion: 2.1 time: 0.176325 Jul 25 13:56:36.473886 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3611/7146] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:36 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1696 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:36.905273 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-ea2af6ab-eacf-4454-b478-ed8298c6863a req-2e9729b5-c13a-4f0d-8a6a-8b1ee50f446f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03fb7fcf-cdb3-427d-8cc5-726564db3154", "name": "network-vif-plugged", "status": "completed", "tag": "8c1358b0-223c-4f94-97da-920dd71e5573"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:56:36.928235 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ea2af6ab-eacf-4454-b478-ed8298c6863a req-2e9729b5-c13a-4f0d-8a6a-8b1ee50f446f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:36.929121 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-ea2af6ab-eacf-4454-b478-ed8298c6863a req-2e9729b5-c13a-4f0d-8a6a-8b1ee50f446f service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:36.949655 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-ea2af6ab-eacf-4454-b478-ed8298c6863a req-2e9729b5-c13a-4f0d-8a6a-8b1ee50f446f service nova] Creating event network-vif-plugged:8c1358b0-223c-4f94-97da-920dd71e5573 for instance 03fb7fcf-cdb3-427d-8cc5-726564db3154 on n-h1-848886-15 Jul 25 13:56:36.956040 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-ea2af6ab-eacf-4454-b478-ed8298c6863a req-2e9729b5-c13a-4f0d-8a6a-8b1ee50f446f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128090 Jul 25 13:56:36.957083 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3536/7147] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:56:37.495340 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-c6db9176-eaf6-471c-b873-fe660978d94e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:37.496282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-c6db9176-eaf6-471c-b873-fe660978d94e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:37.504187 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c6db9176-eaf6-471c-b873-fe660978d94e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:37.505052 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c6db9176-eaf6-471c-b873-fe660978d94e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:37.505864 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c6db9176-eaf6-471c-b873-fe660978d94e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:37.506282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-c6db9176-eaf6-471c-b873-fe660978d94e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:37.657394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-c6db9176-eaf6-471c-b873-fe660978d94e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:37.665628 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-c6db9176-eaf6-471c-b873-fe660978d94e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1696 microversion: 2.1 time: 0.174556 Jul 25 13:56:37.678073 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3612/7148] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:37 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1696 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:38.687965 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c34aeca6-5bae-459f-8083-46e631fa8733 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:38.689463 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c34aeca6-5bae-459f-8083-46e631fa8733 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:38.697814 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c34aeca6-5bae-459f-8083-46e631fa8733 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:38.698714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c34aeca6-5bae-459f-8083-46e631fa8733 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:38.699998 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c34aeca6-5bae-459f-8083-46e631fa8733 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:38.700641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c34aeca6-5bae-459f-8083-46e631fa8733 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:38.861491 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c34aeca6-5bae-459f-8083-46e631fa8733 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:38.870780 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c34aeca6-5bae-459f-8083-46e631fa8733 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1696 microversion: 2.1 time: 0.187463 Jul 25 13:56:38.871753 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3537/7149] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:38 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:56:39.896094 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-78ede069-332e-43d5-827a-698d6ebe94e7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:39.897624 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-78ede069-332e-43d5-827a-698d6ebe94e7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:39.905980 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-78ede069-332e-43d5-827a-698d6ebe94e7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:39.907458 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-78ede069-332e-43d5-827a-698d6ebe94e7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:39.908835 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-78ede069-332e-43d5-827a-698d6ebe94e7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:39.909461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-78ede069-332e-43d5-827a-698d6ebe94e7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:40.060275 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-78ede069-332e-43d5-827a-698d6ebe94e7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:40.068488 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-78ede069-332e-43d5-827a-698d6ebe94e7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1696 microversion: 2.1 time: 0.176185 Jul 25 13:56:40.070568 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3613/7150] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:39 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:41.092940 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-6f6c62cb-4879-4d9c-9200-26cd492c6e61 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:41.094158 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-6f6c62cb-4879-4d9c-9200-26cd492c6e61 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:41.101540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f6c62cb-4879-4d9c-9200-26cd492c6e61 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:41.102033 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f6c62cb-4879-4d9c-9200-26cd492c6e61 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:41.102988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f6c62cb-4879-4d9c-9200-26cd492c6e61 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:41.105088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-6f6c62cb-4879-4d9c-9200-26cd492c6e61 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:41.272059 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-6f6c62cb-4879-4d9c-9200-26cd492c6e61 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:41.280242 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-6f6c62cb-4879-4d9c-9200-26cd492c6e61 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1696 microversion: 2.1 time: 0.191720 Jul 25 13:56:41.280935 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3538/7151] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:41 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1696 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:42.304499 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ac29ad5b-dd2c-411c-b218-1c9f6d7b8bc0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:42.305170 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ac29ad5b-dd2c-411c-b218-1c9f6d7b8bc0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:42.313455 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac29ad5b-dd2c-411c-b218-1c9f6d7b8bc0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:42.313914 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac29ad5b-dd2c-411c-b218-1c9f6d7b8bc0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:42.314880 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac29ad5b-dd2c-411c-b218-1c9f6d7b8bc0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:42.315565 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ac29ad5b-dd2c-411c-b218-1c9f6d7b8bc0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:42.476895 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ac29ad5b-dd2c-411c-b218-1c9f6d7b8bc0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:42.485182 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ac29ad5b-dd2c-411c-b218-1c9f6d7b8bc0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1696 microversion: 2.1 time: 0.184981 Jul 25 13:56:42.498197 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3614/7152] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:42 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1696 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:43.508182 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f8a2dd3c-8f7b-4179-8930-88cd675b21b8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:43.508851 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f8a2dd3c-8f7b-4179-8930-88cd675b21b8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:43.516867 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8a2dd3c-8f7b-4179-8930-88cd675b21b8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:43.517351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8a2dd3c-8f7b-4179-8930-88cd675b21b8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:43.518327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8a2dd3c-8f7b-4179-8930-88cd675b21b8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:43.518781 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f8a2dd3c-8f7b-4179-8930-88cd675b21b8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:43.668216 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f8a2dd3c-8f7b-4179-8930-88cd675b21b8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:43.678173 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f8a2dd3c-8f7b-4179-8930-88cd675b21b8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1696 microversion: 2.1 time: 0.174036 Jul 25 13:56:43.679027 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3539/7153] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:43 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:44.700766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f9eeed32-69b8-4b07-9673-5e8e0c55634f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:44.701413 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f9eeed32-69b8-4b07-9673-5e8e0c55634f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:44.708911 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9eeed32-69b8-4b07-9673-5e8e0c55634f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:44.709372 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9eeed32-69b8-4b07-9673-5e8e0c55634f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:44.710193 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9eeed32-69b8-4b07-9673-5e8e0c55634f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:44.710677 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f9eeed32-69b8-4b07-9673-5e8e0c55634f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:44.892131 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f9eeed32-69b8-4b07-9673-5e8e0c55634f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:44.899882 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f9eeed32-69b8-4b07-9673-5e8e0c55634f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1678 microversion: 2.1 time: 0.203160 Jul 25 13:56:44.900439 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3615/7154] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:44 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1678 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:45.922178 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-549ec46c-4d2d-4ada-996e-3abac0e5c601 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:45.922824 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-549ec46c-4d2d-4ada-996e-3abac0e5c601 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:45.930388 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-549ec46c-4d2d-4ada-996e-3abac0e5c601 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:45.930858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-549ec46c-4d2d-4ada-996e-3abac0e5c601 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:45.931649 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-549ec46c-4d2d-4ada-996e-3abac0e5c601 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:45.932106 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-549ec46c-4d2d-4ada-996e-3abac0e5c601 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:46.071450 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-549ec46c-4d2d-4ada-996e-3abac0e5c601 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:46.080684 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-549ec46c-4d2d-4ada-996e-3abac0e5c601 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1678 microversion: 2.1 time: 0.162517 Jul 25 13:56:46.081284 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3540/7155] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:45 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:47.101687 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-93952706-e4a6-456e-a14a-1fd91ac465b5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:47.102375 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-93952706-e4a6-456e-a14a-1fd91ac465b5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:47.110089 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93952706-e4a6-456e-a14a-1fd91ac465b5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:47.110546 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93952706-e4a6-456e-a14a-1fd91ac465b5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:47.111313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93952706-e4a6-456e-a14a-1fd91ac465b5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:47.111744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-93952706-e4a6-456e-a14a-1fd91ac465b5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:47.249007 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-93952706-e4a6-456e-a14a-1fd91ac465b5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:47.256920 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-93952706-e4a6-456e-a14a-1fd91ac465b5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1621 microversion: 2.1 time: 0.159213 Jul 25 13:56:47.257506 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3616/7156] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:47 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1621 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:47.278112 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cc52b536-9d3e-4f86-8893-9eb8c3fdfe74 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:56:47.278723 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cc52b536-9d3e-4f86-8893-9eb8c3fdfe74 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:47.286293 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cc52b536-9d3e-4f86-8893-9eb8c3fdfe74 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:47.286761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cc52b536-9d3e-4f86-8893-9eb8c3fdfe74 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:47.287556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cc52b536-9d3e-4f86-8893-9eb8c3fdfe74 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:47.288007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cc52b536-9d3e-4f86-8893-9eb8c3fdfe74 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:47.430972 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cc52b536-9d3e-4f86-8893-9eb8c3fdfe74 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "POST /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154/action" status: 202 len: 0 microversion: 2.1 time: 0.156812 Jul 25 13:56:47.431615 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3541/7157] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 13:56:47 2022] POST /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:56:47.440030 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e64348d1-2103-4c8f-8bf2-f06e91416408 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:47.440735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e64348d1-2103-4c8f-8bf2-f06e91416408 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:47.447739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e64348d1-2103-4c8f-8bf2-f06e91416408 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:47.448128 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e64348d1-2103-4c8f-8bf2-f06e91416408 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:47.448899 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e64348d1-2103-4c8f-8bf2-f06e91416408 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:47.449417 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e64348d1-2103-4c8f-8bf2-f06e91416408 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:47.588417 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e64348d1-2103-4c8f-8bf2-f06e91416408 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:47.596114 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e64348d1-2103-4c8f-8bf2-f06e91416408 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1629 microversion: 2.1 time: 0.160124 Jul 25 13:56:47.596682 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3617/7158] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:47 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1629 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:48.617350 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-834e5c04-d5cc-4d1a-9f25-09dff5202321 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:48.618012 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-834e5c04-d5cc-4d1a-9f25-09dff5202321 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:48.625499 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-834e5c04-d5cc-4d1a-9f25-09dff5202321 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:48.625994 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-834e5c04-d5cc-4d1a-9f25-09dff5202321 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:48.626782 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-834e5c04-d5cc-4d1a-9f25-09dff5202321 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:48.627254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-834e5c04-d5cc-4d1a-9f25-09dff5202321 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:48.795983 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-51ebe285-af3c-49b3-b529-08c155602580 req-c22ab19d-9687-4afa-9e2f-0320200a53d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03fb7fcf-cdb3-427d-8cc5-726564db3154", "name": "network-vif-unplugged", "status": "completed", "tag": "8c1358b0-223c-4f94-97da-920dd71e5573"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:56:48.801981 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-834e5c04-d5cc-4d1a-9f25-09dff5202321 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:48.808102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-51ebe285-af3c-49b3-b529-08c155602580 req-c22ab19d-9687-4afa-9e2f-0320200a53d3 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:48.808649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-51ebe285-af3c-49b3-b529-08c155602580 req-c22ab19d-9687-4afa-9e2f-0320200a53d3 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:48.821031 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-51ebe285-af3c-49b3-b529-08c155602580 req-c22ab19d-9687-4afa-9e2f-0320200a53d3 service nova] Creating event network-vif-unplugged:8c1358b0-223c-4f94-97da-920dd71e5573 for instance 03fb7fcf-cdb3-427d-8cc5-726564db3154 on n-h1-848886-15 Jul 25 13:56:48.825319 n-d-848886-15 devstack@n-api.service[125884]: ERROR oslo.messaging._drivers.impl_rabbit [req-51ebe285-af3c-49b3-b529-08c155602580 req-c22ab19d-9687-4afa-9e2f-0320200a53d3 service nova] [215a1302-9f33-4812-9d97-4cb8be73aa4b] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 13:56:48.826714 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-834e5c04-d5cc-4d1a-9f25-09dff5202321 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1687 microversion: 2.1 time: 0.213319 Jul 25 13:56:48.827366 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3542/7159] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:48 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1687 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:49.836723 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [req-51ebe285-af3c-49b3-b529-08c155602580 req-c22ab19d-9687-4afa-9e2f-0320200a53d3 service nova] [215a1302-9f33-4812-9d97-4cb8be73aa4b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 48950. Jul 25 13:56:49.841745 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-51ebe285-af3c-49b3-b529-08c155602580 req-c22ab19d-9687-4afa-9e2f-0320200a53d3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.051008 Jul 25 13:56:49.842687 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3618/7160] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:56:49.849555 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5e9609d4-839b-4af8-b73f-94001fcbfbb9 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:49.850302 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5e9609d4-839b-4af8-b73f-94001fcbfbb9 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:49.858651 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5e9609d4-839b-4af8-b73f-94001fcbfbb9 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:49.859397 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5e9609d4-839b-4af8-b73f-94001fcbfbb9 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:49.860393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5e9609d4-839b-4af8-b73f-94001fcbfbb9 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:49.861000 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5e9609d4-839b-4af8-b73f-94001fcbfbb9 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:49.878069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:56:50.023512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5e9609d4-839b-4af8-b73f-94001fcbfbb9 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:50.031712 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5e9609d4-839b-4af8-b73f-94001fcbfbb9 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1687 microversion: 2.1 time: 0.186626 Jul 25 13:56:50.032308 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3543/7161] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:49 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1687 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:56:51.058160 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6e1e75cc-9b9e-4c12-9959-e88e1423ba07 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:51.059536 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6e1e75cc-9b9e-4c12-9959-e88e1423ba07 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:51.070509 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e1e75cc-9b9e-4c12-9959-e88e1423ba07 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:51.071389 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e1e75cc-9b9e-4c12-9959-e88e1423ba07 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:51.072257 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e1e75cc-9b9e-4c12-9959-e88e1423ba07 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:51.072770 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6e1e75cc-9b9e-4c12-9959-e88e1423ba07 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:51.220681 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6e1e75cc-9b9e-4c12-9959-e88e1423ba07 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:51.229320 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6e1e75cc-9b9e-4c12-9959-e88e1423ba07 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1687 microversion: 2.1 time: 0.176330 Jul 25 13:56:51.230267 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3619/7162] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:51 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:52.257787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-eee7f99a-4d0e-431d-890d-20aac76cad08 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:52.258922 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-eee7f99a-4d0e-431d-890d-20aac76cad08 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:52.263509 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=33 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:56:52.270683 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eee7f99a-4d0e-431d-890d-20aac76cad08 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:52.271373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eee7f99a-4d0e-431d-890d-20aac76cad08 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:52.272375 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eee7f99a-4d0e-431d-890d-20aac76cad08 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:52.272941 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-eee7f99a-4d0e-431d-890d-20aac76cad08 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:52.423890 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-eee7f99a-4d0e-431d-890d-20aac76cad08 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:52.432466 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-eee7f99a-4d0e-431d-890d-20aac76cad08 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1687 microversion: 2.1 time: 0.180928 Jul 25 13:56:52.433873 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3544/7163] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:52 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1687 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:53.456161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2528bfcf-f174-4468-884b-fe6583fa4e6c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:53.456745 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2528bfcf-f174-4468-884b-fe6583fa4e6c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:53.459553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=31 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:56:53.465273 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2528bfcf-f174-4468-884b-fe6583fa4e6c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:53.465728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2528bfcf-f174-4468-884b-fe6583fa4e6c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:53.466540 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2528bfcf-f174-4468-884b-fe6583fa4e6c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:53.466962 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2528bfcf-f174-4468-884b-fe6583fa4e6c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:53.470519 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=87 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:56:53.609501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2528bfcf-f174-4468-884b-fe6583fa4e6c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:53.617790 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2528bfcf-f174-4468-884b-fe6583fa4e6c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1687 microversion: 2.1 time: 0.165683 Jul 25 13:56:53.618636 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3620/7164] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:53 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:54.640074 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c21fa361-4e9a-4bdf-919b-2675fd2e988f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:54.640820 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c21fa361-4e9a-4bdf-919b-2675fd2e988f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:54.648750 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c21fa361-4e9a-4bdf-919b-2675fd2e988f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:54.649201 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c21fa361-4e9a-4bdf-919b-2675fd2e988f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:54.650041 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c21fa361-4e9a-4bdf-919b-2675fd2e988f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:54.650492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c21fa361-4e9a-4bdf-919b-2675fd2e988f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:54.797465 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c21fa361-4e9a-4bdf-919b-2675fd2e988f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:54.805858 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c21fa361-4e9a-4bdf-919b-2675fd2e988f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1687 microversion: 2.1 time: 0.169719 Jul 25 13:56:54.806726 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3545/7165] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:54 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:55.828451 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-037de1ce-056b-44b7-9b74-9ee4bd43c67e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:55.829135 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-037de1ce-056b-44b7-9b74-9ee4bd43c67e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:55.836668 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-037de1ce-056b-44b7-9b74-9ee4bd43c67e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:55.837126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-037de1ce-056b-44b7-9b74-9ee4bd43c67e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:55.837944 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-037de1ce-056b-44b7-9b74-9ee4bd43c67e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:55.838393 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-037de1ce-056b-44b7-9b74-9ee4bd43c67e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:56.002629 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-037de1ce-056b-44b7-9b74-9ee4bd43c67e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:56.010718 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-037de1ce-056b-44b7-9b74-9ee4bd43c67e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1687 microversion: 2.1 time: 0.186477 Jul 25 13:56:56.023652 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3621/7166] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:55 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1687 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:57.032439 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4711beca-2f2e-451c-8388-259895e474b8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:57.033067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4711beca-2f2e-451c-8388-259895e474b8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:57.040756 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4711beca-2f2e-451c-8388-259895e474b8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:57.041199 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4711beca-2f2e-451c-8388-259895e474b8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:57.042050 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4711beca-2f2e-451c-8388-259895e474b8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:57.042479 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4711beca-2f2e-451c-8388-259895e474b8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:57.188599 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4711beca-2f2e-451c-8388-259895e474b8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:57.196867 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4711beca-2f2e-451c-8388-259895e474b8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1687 microversion: 2.1 time: 0.168367 Jul 25 13:56:57.197425 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3546/7167] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:57 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:58.220328 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-ec3b28e3-5d2c-487c-a342-ef2a8419c102 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:58.220950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-ec3b28e3-5d2c-487c-a342-ef2a8419c102 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:58.227771 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ec3b28e3-5d2c-487c-a342-ef2a8419c102 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:58.228364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ec3b28e3-5d2c-487c-a342-ef2a8419c102 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:58.229423 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ec3b28e3-5d2c-487c-a342-ef2a8419c102 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:58.229971 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-ec3b28e3-5d2c-487c-a342-ef2a8419c102 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:58.370797 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-ec3b28e3-5d2c-487c-a342-ef2a8419c102 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:58.379112 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-ec3b28e3-5d2c-487c-a342-ef2a8419c102 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1687 microversion: 2.1 time: 0.164302 Jul 25 13:56:58.379679 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3622/7168] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:58 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:56:59.401075 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d9fbf8b8-6961-4608-ac57-312e0008c1f5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:56:59.401731 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d9fbf8b8-6961-4608-ac57-312e0008c1f5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:56:59.409474 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9fbf8b8-6961-4608-ac57-312e0008c1f5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:59.409984 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9fbf8b8-6961-4608-ac57-312e0008c1f5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:59.410794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9fbf8b8-6961-4608-ac57-312e0008c1f5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:56:59.411246 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d9fbf8b8-6961-4608-ac57-312e0008c1f5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:56:59.546501 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d9fbf8b8-6961-4608-ac57-312e0008c1f5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:56:59.554815 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d9fbf8b8-6961-4608-ac57-312e0008c1f5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1687 microversion: 2.1 time: 0.157814 Jul 25 13:56:59.555386 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3547/7169] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:56:59 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:57:00.576639 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3a737247-cfad-460e-98fa-e2e65917d6c0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:57:00.577272 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3a737247-cfad-460e-98fa-e2e65917d6c0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:57:00.584668 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a737247-cfad-460e-98fa-e2e65917d6c0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:57:00.585110 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a737247-cfad-460e-98fa-e2e65917d6c0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:57:00.585885 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a737247-cfad-460e-98fa-e2e65917d6c0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:57:00.586328 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a737247-cfad-460e-98fa-e2e65917d6c0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:57:00.727083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3a737247-cfad-460e-98fa-e2e65917d6c0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:57:00.735502 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3a737247-cfad-460e-98fa-e2e65917d6c0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1687 microversion: 2.1 time: 0.162783 Jul 25 13:57:00.736411 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3623/7170] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:57:00 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:57:01.756928 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c9a74359-26f5-4168-8a89-e467588ac195 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:57:01.757621 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-c9a74359-26f5-4168-8a89-e467588ac195 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:57:01.765315 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c9a74359-26f5-4168-8a89-e467588ac195 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:57:01.766532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c9a74359-26f5-4168-8a89-e467588ac195 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:57:01.767345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c9a74359-26f5-4168-8a89-e467588ac195 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:57:01.767797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-c9a74359-26f5-4168-8a89-e467588ac195 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:57:02.008014 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-c9a74359-26f5-4168-8a89-e467588ac195 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:57:02.016526 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c9a74359-26f5-4168-8a89-e467588ac195 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1687 microversion: 2.1 time: 0.263562 Jul 25 13:57:02.017229 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3548/7171] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:57:01 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1687 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:57:02.891662 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-c1ce5185-f73b-4333-ba4d-37a72338685c req-e666a40f-bc75-4be0-9b67-b04192a1be52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03fb7fcf-cdb3-427d-8cc5-726564db3154", "name": "network-vif-plugged", "status": "completed", "tag": "8c1358b0-223c-4f94-97da-920dd71e5573"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:57:02.902951 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c1ce5185-f73b-4333-ba4d-37a72338685c req-e666a40f-bc75-4be0-9b67-b04192a1be52 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:57:02.903406 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-c1ce5185-f73b-4333-ba4d-37a72338685c req-e666a40f-bc75-4be0-9b67-b04192a1be52 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:57:02.915328 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-c1ce5185-f73b-4333-ba4d-37a72338685c req-e666a40f-bc75-4be0-9b67-b04192a1be52 service nova] Creating event network-vif-plugged:8c1358b0-223c-4f94-97da-920dd71e5573 for instance 03fb7fcf-cdb3-427d-8cc5-726564db3154 on n-h1-848886-15 Jul 25 13:57:02.920681 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-c1ce5185-f73b-4333-ba4d-37a72338685c req-e666a40f-bc75-4be0-9b67-b04192a1be52 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032878 Jul 25 13:57:02.921376 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3624/7172] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:57:03.038904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2f09683f-e1de-43a6-a58d-8810c3e5677c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:57:03.039517 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2f09683f-e1de-43a6-a58d-8810c3e5677c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:57:03.047177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f09683f-e1de-43a6-a58d-8810c3e5677c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:57:03.047688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f09683f-e1de-43a6-a58d-8810c3e5677c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:57:03.048540 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f09683f-e1de-43a6-a58d-8810c3e5677c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:57:03.049010 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2f09683f-e1de-43a6-a58d-8810c3e5677c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:57:03.167981 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:57:03.168306 n-d-848886-15 devstack@n-api.service[125884]: Mon Jul 25 13:57:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:57:03.221469 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2f09683f-e1de-43a6-a58d-8810c3e5677c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:57:03.229343 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2f09683f-e1de-43a6-a58d-8810c3e5677c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1687 microversion: 2.1 time: 0.194540 Jul 25 13:57:03.230024 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3549/7173] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:57:03 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1687 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:57:04.253274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4ef9efc9-127c-4e6b-b691-040d7bfc77bc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:57:04.254065 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4ef9efc9-127c-4e6b-b691-040d7bfc77bc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:57:04.260842 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4ef9efc9-127c-4e6b-b691-040d7bfc77bc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:57:04.261291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4ef9efc9-127c-4e6b-b691-040d7bfc77bc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:57:04.262272 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4ef9efc9-127c-4e6b-b691-040d7bfc77bc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:57:04.262726 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4ef9efc9-127c-4e6b-b691-040d7bfc77bc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:57:04.410379 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4ef9efc9-127c-4e6b-b691-040d7bfc77bc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:57:04.418416 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4ef9efc9-127c-4e6b-b691-040d7bfc77bc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1687 microversion: 2.1 time: 0.170238 Jul 25 13:57:04.419917 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3625/7174] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:57:04 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:57:05.442604 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-02c8b092-3b07-49e3-b6d9-d267427fd983 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:57:05.443172 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-02c8b092-3b07-49e3-b6d9-d267427fd983 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:57:05.451233 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02c8b092-3b07-49e3-b6d9-d267427fd983 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:57:05.451705 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02c8b092-3b07-49e3-b6d9-d267427fd983 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:57:05.452519 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02c8b092-3b07-49e3-b6d9-d267427fd983 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:57:05.452974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02c8b092-3b07-49e3-b6d9-d267427fd983 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:57:05.595838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-02c8b092-3b07-49e3-b6d9-d267427fd983 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:57:05.603652 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-02c8b092-3b07-49e3-b6d9-d267427fd983 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1674 microversion: 2.1 time: 0.165270 Jul 25 13:57:05.604230 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3550/7175] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:57:05 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:58:15.476679 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=11 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:58:15.477766 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=31 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:58:15.478677 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=13 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:58:15.479699 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=46 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:58:15.483341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2a006de1-01b3-4de2-958c-c406078a972f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:58:15.483977 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2a006de1-01b3-4de2-958c-c406078a972f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:58:15.492471 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a006de1-01b3-4de2-958c-c406078a972f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:15.492920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a006de1-01b3-4de2-958c-c406078a972f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:15.493706 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a006de1-01b3-4de2-958c-c406078a972f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:15.494167 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a006de1-01b3-4de2-958c-c406078a972f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:15.522811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2a006de1-01b3-4de2-958c-c406078a972f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:58:15.550777 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-dae6361a-b33d-44cf-be3e-cdefe5ab8983 req-cd0d1e76-506a-4e13-9602-9a42396860d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03fb7fcf-cdb3-427d-8cc5-726564db3154", "tag": "8c1358b0-223c-4f94-97da-920dd71e5573"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:58:15.561909 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-dae6361a-b33d-44cf-be3e-cdefe5ab8983 req-cd0d1e76-506a-4e13-9602-9a42396860d4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:15.562407 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-dae6361a-b33d-44cf-be3e-cdefe5ab8983 req-cd0d1e76-506a-4e13-9602-9a42396860d4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:15.574677 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-dae6361a-b33d-44cf-be3e-cdefe5ab8983 req-cd0d1e76-506a-4e13-9602-9a42396860d4 service nova] Creating event network-changed:8c1358b0-223c-4f94-97da-920dd71e5573 for instance 03fb7fcf-cdb3-427d-8cc5-726564db3154 on n-h1-848886-15 Jul 25 13:58:15.580928 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-dae6361a-b33d-44cf-be3e-cdefe5ab8983 req-cd0d1e76-506a-4e13-9602-9a42396860d4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103173 Jul 25 13:58:15.581873 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3551/7176] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:58:15.625950 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2a006de1-01b3-4de2-958c-c406078a972f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "DELETE /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 204 len: 0 microversion: 2.1 time: 0.151030 Jul 25 13:58:15.627018 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3626/7177] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 13:58:15 2022] DELETE /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:58:15.635977 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3afdaf37-ee1b-4dfe-ab73-84182c68bf8c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:58:15.636792 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3afdaf37-ee1b-4dfe-ab73-84182c68bf8c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:58:15.644940 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3afdaf37-ee1b-4dfe-ab73-84182c68bf8c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:15.645404 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3afdaf37-ee1b-4dfe-ab73-84182c68bf8c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:15.646303 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3afdaf37-ee1b-4dfe-ab73-84182c68bf8c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:15.646751 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3afdaf37-ee1b-4dfe-ab73-84182c68bf8c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:15.846996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3afdaf37-ee1b-4dfe-ab73-84182c68bf8c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:58:15.856490 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3afdaf37-ee1b-4dfe-ab73-84182c68bf8c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1680 microversion: 2.1 time: 0.224668 Jul 25 13:58:15.857402 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3552/7178] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:58:15 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1680 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:58:16.880315 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4c5352f2-9053-4791-a43e-0591fa2c72b6 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:58:16.881185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4c5352f2-9053-4791-a43e-0591fa2c72b6 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:58:16.888961 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c5352f2-9053-4791-a43e-0591fa2c72b6 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:16.889384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c5352f2-9053-4791-a43e-0591fa2c72b6 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:16.890243 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c5352f2-9053-4791-a43e-0591fa2c72b6 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:16.891364 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4c5352f2-9053-4791-a43e-0591fa2c72b6 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:17.170376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4c5352f2-9053-4791-a43e-0591fa2c72b6 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:58:17.179608 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4c5352f2-9053-4791-a43e-0591fa2c72b6 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 200 len: 1680 microversion: 2.1 time: 0.303476 Jul 25 13:58:17.187689 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3627/7179] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:58:16 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 1680 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:58:17.661847 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-877ef54b-a3eb-475b-a247-720be14a205e req-3769ac15-7a60-42f6-ba5b-494e6cb53e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03fb7fcf-cdb3-427d-8cc5-726564db3154", "name": "network-vif-deleted", "tag": "8c1358b0-223c-4f94-97da-920dd71e5573"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:58:17.672999 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-877ef54b-a3eb-475b-a247-720be14a205e req-3769ac15-7a60-42f6-ba5b-494e6cb53e74 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:17.673358 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-877ef54b-a3eb-475b-a247-720be14a205e req-3769ac15-7a60-42f6-ba5b-494e6cb53e74 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:17.686104 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-877ef54b-a3eb-475b-a247-720be14a205e req-3769ac15-7a60-42f6-ba5b-494e6cb53e74 service nova] Creating event network-vif-deleted:8c1358b0-223c-4f94-97da-920dd71e5573 for instance 03fb7fcf-cdb3-427d-8cc5-726564db3154 on n-h1-848886-15 Jul 25 13:58:17.692138 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-877ef54b-a3eb-475b-a247-720be14a205e req-3769ac15-7a60-42f6-ba5b-494e6cb53e74 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033909 Jul 25 13:58:17.692778 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3553/7180] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:58:18.202448 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-161f0cd9-9820-40d1-878a-4fc7a6e836df tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:58:18.203042 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-161f0cd9-9820-40d1-878a-4fc7a6e836df tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 03fb7fcf-cdb3-427d-8cc5-726564db3154] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:58:18.210090 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-161f0cd9-9820-40d1-878a-4fc7a6e836df tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:18.210532 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-161f0cd9-9820-40d1-878a-4fc7a6e836df tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:18.211282 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-161f0cd9-9820-40d1-878a-4fc7a6e836df tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:18.211719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-161f0cd9-9820-40d1-878a-4fc7a6e836df tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:18.225341 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-161f0cd9-9820-40d1-878a-4fc7a6e836df tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] HTTP exception thrown: Instance 03fb7fcf-cdb3-427d-8cc5-726564db3154 could not be found. Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-161f0cd9-9820-40d1-878a-4fc7a6e836df tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Request method failure captured: Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 HTTP/1.1 Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3qB_e67csfpVNDceK5cB4JGk6LNiVL74-3stgS6kXwm045PMEGPSjQ4BMoEotgEfhIA5fnhAFV2u5NCA5Ts3DttcQA08GWEvBXqyFEOIhvhXjnltAWAtu-4uOE2GvAEPsKguAKwtEVSU4Wt9pIfOSlYejbmkZZc-nZd_D2aTqyw3jUg Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 952fff45e4574565b432d43745b1f4b2 Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestShelveInstance-2083165822 Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_952fff45e4574565b432d43745b1f4b2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/952fff45e4574565b432d43745b1f4b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/952fff45e4574565b432d43745b1f4b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/952fff45e4574565b432d43745b1f4b2"}]}] Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestShelveInstance-2083165822 Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 952fff45e4574565b432d43745b1f4b2 Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestShelveInstance-2083165822 Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestShelveInstance-2083165822-project Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 10ad8c74d82d4166850eadcd222dd0bc Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestShelveInstance-2083165822-project Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 03fb7fcf-cdb3-427d-8cc5-726564db3154 could not be found. Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '03fb7fcf-cdb3-427d-8cc5-726564db3154'} Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03fb7fcf-cdb3-427d-8cc5-726564db3154 could not be found. Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03fb7fcf-cdb3-427d-8cc5-726564db3154 could not be found. Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:58:18.227055 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:58:18.231380 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:58:18.231380 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:58:18.231380 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:58:18.231380 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:58:18.231380 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:58:18.231380 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03fb7fcf-cdb3-427d-8cc5-726564db3154 could not be found. Jul 25 13:58:18.231380 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 13:58:18.231380 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-161f0cd9-9820-40d1-878a-4fc7a6e836df tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Returning 404 to user: Instance 03fb7fcf-cdb3-427d-8cc5-726564db3154 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:58:18.231380 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-161f0cd9-9820-40d1-878a-4fc7a6e836df tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154" status: 404 len: 111 microversion: 2.1 time: 0.030279 Jul 25 13:58:18.231380 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3628/7181] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:58:18 2022] GET /compute/v2.1/servers/03fb7fcf-cdb3-427d-8cc5-726564db3154 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:58:18.407482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-c57b2e91-0b2c-429a-a118-fb01c7244202 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '.version_select at 0x7efcf9a99550>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:58:18.439448 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-c57b2e91-0b2c-429a-a118-fb01c7244202 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1752807540" status: 202 len: 0 microversion: 2.1 time: 0.036164 Jul 25 13:58:18.440580 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3554/7182] 10.222.0.49 () {58 vars in 1254 bytes} [Mon Jul 25 13:58:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1752807540 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:58:18.465026 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-31cf5d86-6a4e-46fd-aec6-cc94986ae0f0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Action: 'create', calling method: .version_select at 0x7efcf9bd9670>, body: {"keypair": {"name": "tempest-TestShelveInstance-2040845473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBa97RbjNUEZodEhfHHXLy0Q1Dog0M5WUinEUmcbYJ0nXUkQ74EfZJVlZfa2ls4RMPJFvqkwDETtkN08KY825mnqlywkN2dyQL6kyXTeNzM34bu1iSbJJOd7aD+TwoMO3w=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:58:18.482106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-31cf5d86-6a4e-46fd-aec6-cc94986ae0f0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Getting quotas for project 952fff45e4574565b432d43745b1f4b2. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:58:18.487239 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-31cf5d86-6a4e-46fd-aec6-cc94986ae0f0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Getting quotas for user 10ad8c74d82d4166850eadcd222dd0bc and project 952fff45e4574565b432d43745b1f4b2. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:58:18.515152 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-31cf5d86-6a4e-46fd-aec6-cc94986ae0f0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.054295 Jul 25 13:58:18.515753 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3629/7183] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 13:58:18 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:58:35.836738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=10 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:58:35.837502 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:58:35.841627 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5eba32f3-4d87-42c8-95d9-e82dfcfcdcdc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-153695008", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2040845473", "security_groups": [{"name": "tempest-secgroup-smoke-418008649"}], "networks": [{"uuid": "90553bf2-a438-4ab8-978a-1bb761757676"}], "block_device_mapping_v2": [{"uuid": "3f5c0ddd-a573-43fd-9f27-518e36f78cc8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:58:35.960352 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-5eba32f3-4d87-42c8-95d9-e82dfcfcdcdc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] validate_networks() for [('90553bf2-a438-4ab8-978a-1bb761757676', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:58:36.383853 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5eba32f3-4d87-42c8-95d9-e82dfcfcdcdc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:58:36.384415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5eba32f3-4d87-42c8-95d9-e82dfcfcdcdc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:58:36.384916 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5eba32f3-4d87-42c8-95d9-e82dfcfcdcdc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:58:36.385394 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5eba32f3-4d87-42c8-95d9-e82dfcfcdcdc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:58:36.385785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-5eba32f3-4d87-42c8-95d9-e82dfcfcdcdc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:58:36.397722 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5eba32f3-4d87-42c8-95d9-e82dfcfcdcdc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:36.398548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5eba32f3-4d87-42c8-95d9-e82dfcfcdcdc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:36.399734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5eba32f3-4d87-42c8-95d9-e82dfcfcdcdc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:36.400329 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5eba32f3-4d87-42c8-95d9-e82dfcfcdcdc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:36.423641 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-5eba32f3-4d87-42c8-95d9-e82dfcfcdcdc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Getting quotas for project 952fff45e4574565b432d43745b1f4b2. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:58:36.433697 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-5eba32f3-4d87-42c8-95d9-e82dfcfcdcdc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Getting quotas for user 10ad8c74d82d4166850eadcd222dd0bc and project 952fff45e4574565b432d43745b1f4b2. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:58:36.499985 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5eba32f3-4d87-42c8-95d9-e82dfcfcdcdc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:58:36.502519 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5eba32f3-4d87-42c8-95d9-e82dfcfcdcdc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f5c0ddd-a573-43fd-9f27-518e36f78cc8',volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:58:36.657309 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5eba32f3-4d87-42c8-95d9-e82dfcfcdcdc tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.822161 Jul 25 13:58:36.657935 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3555/7184] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 13:58:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:58:36.667132 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:58:36.667976 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=4 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:58:36.668688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:58:36.672735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-01ad509b-f2e2-4e2a-8d84-1ffda7b9c83c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:58:36.673334 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-01ad509b-f2e2-4e2a-8d84-1ffda7b9c83c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:58:36.737563 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-01ad509b-f2e2-4e2a-8d84-1ffda7b9c83c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:58:36.745346 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-01ad509b-f2e2-4e2a-8d84-1ffda7b9c83c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1088 microversion: 2.1 time: 0.080324 Jul 25 13:58:36.745998 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3630/7185] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:58:36 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1088 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:58:37.767373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7623f914-ef24-4029-bb75-0a4537a76bc8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:58:37.768757 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7623f914-ef24-4029-bb75-0a4537a76bc8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:58:37.775759 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7623f914-ef24-4029-bb75-0a4537a76bc8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:37.776461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7623f914-ef24-4029-bb75-0a4537a76bc8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:37.777254 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7623f914-ef24-4029-bb75-0a4537a76bc8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:37.777898 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7623f914-ef24-4029-bb75-0a4537a76bc8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:37.852193 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7623f914-ef24-4029-bb75-0a4537a76bc8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:58:37.861330 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7623f914-ef24-4029-bb75-0a4537a76bc8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1204 microversion: 2.1 time: 0.098699 Jul 25 13:58:37.861916 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3556/7186] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:58:37 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1204 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:58:38.884969 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-43f10e84-fea8-4d43-a5ff-f4dfea339c9e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:58:38.885991 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-43f10e84-fea8-4d43-a5ff-f4dfea339c9e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:58:38.895861 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-43f10e84-fea8-4d43-a5ff-f4dfea339c9e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:38.896469 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-43f10e84-fea8-4d43-a5ff-f4dfea339c9e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:38.897757 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-43f10e84-fea8-4d43-a5ff-f4dfea339c9e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:38.898235 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-43f10e84-fea8-4d43-a5ff-f4dfea339c9e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:39.393130 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-43f10e84-fea8-4d43-a5ff-f4dfea339c9e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:58:39.406088 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-43f10e84-fea8-4d43-a5ff-f4dfea339c9e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1271 microversion: 2.1 time: 0.525539 Jul 25 13:58:39.420085 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3631/7187] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:58:38 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1271 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:58:39.576521 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-14a680ae-3c56-4ccd-8ca9-4a4fc94f6c42 req-ad12ef72-2f1a-44ca-80c2-12879f5c280a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a76866-851c-4497-87e1-7b1856fcd808", "tag": "582357fe-3b95-46f5-a317-acd20a0eeb67"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:58:39.590625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-14a680ae-3c56-4ccd-8ca9-4a4fc94f6c42 req-ad12ef72-2f1a-44ca-80c2-12879f5c280a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:39.591423 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-14a680ae-3c56-4ccd-8ca9-4a4fc94f6c42 req-ad12ef72-2f1a-44ca-80c2-12879f5c280a service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:39.608801 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-14a680ae-3c56-4ccd-8ca9-4a4fc94f6c42 req-ad12ef72-2f1a-44ca-80c2-12879f5c280a service nova] Creating event network-changed:582357fe-3b95-46f5-a317-acd20a0eeb67 for instance 89a76866-851c-4497-87e1-7b1856fcd808 on n-h2-848886-15 Jul 25 13:58:39.615527 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-14a680ae-3c56-4ccd-8ca9-4a4fc94f6c42 req-ad12ef72-2f1a-44ca-80c2-12879f5c280a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043152 Jul 25 13:58:39.616118 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3557/7188] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:58:40.427226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-90640452-16da-4164-8641-3563e7e10c68 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:58:40.428125 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-90640452-16da-4164-8641-3563e7e10c68 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:58:40.435867 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90640452-16da-4164-8641-3563e7e10c68 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:40.436461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90640452-16da-4164-8641-3563e7e10c68 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:40.437371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90640452-16da-4164-8641-3563e7e10c68 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:40.437950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90640452-16da-4164-8641-3563e7e10c68 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:40.672938 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-90640452-16da-4164-8641-3563e7e10c68 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:58:40.681184 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-90640452-16da-4164-8641-3563e7e10c68 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1271 microversion: 2.1 time: 0.257764 Jul 25 13:58:40.681881 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3632/7189] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:58:40 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1271 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:58:41.704511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7ea284e9-f318-4ee6-aae4-a2bd3fdd5f56 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:58:41.705472 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7ea284e9-f318-4ee6-aae4-a2bd3fdd5f56 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:58:41.713009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ea284e9-f318-4ee6-aae4-a2bd3fdd5f56 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:41.713565 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ea284e9-f318-4ee6-aae4-a2bd3fdd5f56 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:41.714395 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ea284e9-f318-4ee6-aae4-a2bd3fdd5f56 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:41.714843 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7ea284e9-f318-4ee6-aae4-a2bd3fdd5f56 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:41.861788 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7ea284e9-f318-4ee6-aae4-a2bd3fdd5f56 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:58:41.869762 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7ea284e9-f318-4ee6-aae4-a2bd3fdd5f56 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1271 microversion: 2.1 time: 0.169547 Jul 25 13:58:41.870407 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3558/7190] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:58:41 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1271 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:58:42.890656 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b57dbbf4-6637-442e-becd-ef3596276fbe tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:58:42.891392 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b57dbbf4-6637-442e-becd-ef3596276fbe tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:58:42.900141 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b57dbbf4-6637-442e-becd-ef3596276fbe tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:42.900840 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b57dbbf4-6637-442e-becd-ef3596276fbe tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:42.902148 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b57dbbf4-6637-442e-becd-ef3596276fbe tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:42.902848 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b57dbbf4-6637-442e-becd-ef3596276fbe tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:43.060987 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b57dbbf4-6637-442e-becd-ef3596276fbe tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:58:43.069445 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b57dbbf4-6637-442e-becd-ef3596276fbe tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1259 microversion: 2.1 time: 0.182811 Jul 25 13:58:43.070059 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3633/7191] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:58:42 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:58:44.091422 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-51d98980-46ea-46b7-bfea-b27d78421299 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:58:44.092096 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-51d98980-46ea-46b7-bfea-b27d78421299 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:58:44.099633 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-51d98980-46ea-46b7-bfea-b27d78421299 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:44.100357 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-51d98980-46ea-46b7-bfea-b27d78421299 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:44.100868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-51d98980-46ea-46b7-bfea-b27d78421299 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:44.101343 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-51d98980-46ea-46b7-bfea-b27d78421299 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:44.250774 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-51d98980-46ea-46b7-bfea-b27d78421299 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:58:44.263146 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-51d98980-46ea-46b7-bfea-b27d78421299 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1259 microversion: 2.1 time: 0.175751 Jul 25 13:58:44.263739 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3559/7192] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:58:44 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:58:45.285103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5db44b44-d827-4298-a309-efd0c0bd8e82 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:58:45.285728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5db44b44-d827-4298-a309-efd0c0bd8e82 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:58:45.293376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5db44b44-d827-4298-a309-efd0c0bd8e82 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:45.293878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5db44b44-d827-4298-a309-efd0c0bd8e82 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:45.294758 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5db44b44-d827-4298-a309-efd0c0bd8e82 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:45.295213 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5db44b44-d827-4298-a309-efd0c0bd8e82 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:45.439402 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5db44b44-d827-4298-a309-efd0c0bd8e82 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:58:45.449753 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5db44b44-d827-4298-a309-efd0c0bd8e82 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1259 microversion: 2.1 time: 0.168934 Jul 25 13:58:45.450471 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3634/7193] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:58:45 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:58:46.474714 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-da18b462-d557-4ac6-b834-91ab1bd51eb2 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:58:46.475282 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-da18b462-d557-4ac6-b834-91ab1bd51eb2 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:58:46.478089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:58:46.478785 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:58:46.485090 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da18b462-d557-4ac6-b834-91ab1bd51eb2 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:46.485556 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da18b462-d557-4ac6-b834-91ab1bd51eb2 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:46.486381 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da18b462-d557-4ac6-b834-91ab1bd51eb2 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:46.486831 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-da18b462-d557-4ac6-b834-91ab1bd51eb2 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:46.622306 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-da18b462-d557-4ac6-b834-91ab1bd51eb2 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:58:46.630269 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-da18b462-d557-4ac6-b834-91ab1bd51eb2 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1259 microversion: 2.1 time: 0.159582 Jul 25 13:58:46.630823 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3560/7194] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:58:46 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:58:47.656506 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-74124374-f201-4160-83b7-d249affb558e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:58:47.657126 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-74124374-f201-4160-83b7-d249affb558e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:58:47.659916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:58:47.666383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-74124374-f201-4160-83b7-d249affb558e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:47.666916 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-74124374-f201-4160-83b7-d249affb558e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:47.667641 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-74124374-f201-4160-83b7-d249affb558e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:47.668079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-74124374-f201-4160-83b7-d249affb558e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:47.823320 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-74124374-f201-4160-83b7-d249affb558e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:58:47.834248 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-74124374-f201-4160-83b7-d249affb558e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1259 microversion: 2.1 time: 0.181486 Jul 25 13:58:47.835048 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3635/7195] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:58:47 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:58:48.858468 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ac54384c-8451-4282-8987-e18b07051c1d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:58:48.859052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ac54384c-8451-4282-8987-e18b07051c1d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:58:48.866795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ac54384c-8451-4282-8987-e18b07051c1d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:48.867392 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ac54384c-8451-4282-8987-e18b07051c1d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:48.868259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ac54384c-8451-4282-8987-e18b07051c1d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:48.869415 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ac54384c-8451-4282-8987-e18b07051c1d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:49.004335 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ac54384c-8451-4282-8987-e18b07051c1d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:58:49.013099 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ac54384c-8451-4282-8987-e18b07051c1d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1259 microversion: 2.1 time: 0.158937 Jul 25 13:58:49.013724 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3561/7196] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:58:48 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:58:50.033665 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-7174f08c-a179-4477-9554-3c8d311f07d8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:58:50.034287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-7174f08c-a179-4477-9554-3c8d311f07d8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:58:50.041622 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7174f08c-a179-4477-9554-3c8d311f07d8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:50.042111 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7174f08c-a179-4477-9554-3c8d311f07d8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:50.042888 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7174f08c-a179-4477-9554-3c8d311f07d8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:50.043324 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-7174f08c-a179-4477-9554-3c8d311f07d8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:50.185595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-7174f08c-a179-4477-9554-3c8d311f07d8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:58:50.195210 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-7174f08c-a179-4477-9554-3c8d311f07d8 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1259 microversion: 2.1 time: 0.165249 Jul 25 13:58:50.196178 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3636/7197] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:58:50 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:58:51.227858 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8aafb996-d889-4507-9355-d3decd6523d0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:58:51.228508 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8aafb996-d889-4507-9355-d3decd6523d0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:58:51.235790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8aafb996-d889-4507-9355-d3decd6523d0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:51.236257 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8aafb996-d889-4507-9355-d3decd6523d0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:51.237052 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8aafb996-d889-4507-9355-d3decd6523d0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:51.237505 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8aafb996-d889-4507-9355-d3decd6523d0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:51.378611 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8aafb996-d889-4507-9355-d3decd6523d0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:58:51.386496 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8aafb996-d889-4507-9355-d3decd6523d0 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1259 microversion: 2.1 time: 0.163375 Jul 25 13:58:51.387087 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3562/7198] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:58:51 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:58:52.407631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-511e49f7-fef2-43e9-8fb8-6aa39f4d41cb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:58:52.408212 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-511e49f7-fef2-43e9-8fb8-6aa39f4d41cb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:58:52.415272 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-511e49f7-fef2-43e9-8fb8-6aa39f4d41cb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:52.415719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-511e49f7-fef2-43e9-8fb8-6aa39f4d41cb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:52.416476 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-511e49f7-fef2-43e9-8fb8-6aa39f4d41cb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:52.416883 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-511e49f7-fef2-43e9-8fb8-6aa39f4d41cb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:52.564997 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-511e49f7-fef2-43e9-8fb8-6aa39f4d41cb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:58:52.573407 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-511e49f7-fef2-43e9-8fb8-6aa39f4d41cb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1259 microversion: 2.1 time: 0.169691 Jul 25 13:58:52.575271 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3637/7199] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:58:52 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:58:53.596444 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-3b513b41-c720-48b3-b700-11064ff2062f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:58:53.597065 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-3b513b41-c720-48b3-b700-11064ff2062f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:58:53.605168 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b513b41-c720-48b3-b700-11064ff2062f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:53.605628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b513b41-c720-48b3-b700-11064ff2062f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:53.606455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b513b41-c720-48b3-b700-11064ff2062f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:53.606903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-3b513b41-c720-48b3-b700-11064ff2062f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:53.772590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-3b513b41-c720-48b3-b700-11064ff2062f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:58:53.781885 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-3b513b41-c720-48b3-b700-11064ff2062f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1259 microversion: 2.1 time: 0.189714 Jul 25 13:58:53.782467 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3563/7200] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:58:53 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1259 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:58:53.860924 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-b2c269fb-4e8b-4ca5-ab8e-0cfdde61097f req-39ee4e44-7753-4466-be60-a0a1e0f52b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a76866-851c-4497-87e1-7b1856fcd808", "name": "network-vif-plugged", "status": "completed", "tag": "582357fe-3b95-46f5-a317-acd20a0eeb67"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:58:53.872406 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b2c269fb-4e8b-4ca5-ab8e-0cfdde61097f req-39ee4e44-7753-4466-be60-a0a1e0f52b4b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:53.872851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b2c269fb-4e8b-4ca5-ab8e-0cfdde61097f req-39ee4e44-7753-4466-be60-a0a1e0f52b4b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:53.885583 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-b2c269fb-4e8b-4ca5-ab8e-0cfdde61097f req-39ee4e44-7753-4466-be60-a0a1e0f52b4b service nova] Creating event network-vif-plugged:582357fe-3b95-46f5-a317-acd20a0eeb67 for instance 89a76866-851c-4497-87e1-7b1856fcd808 on n-h2-848886-15 Jul 25 13:58:53.891191 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-b2c269fb-4e8b-4ca5-ab8e-0cfdde61097f req-39ee4e44-7753-4466-be60-a0a1e0f52b4b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034565 Jul 25 13:58:53.892301 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3638/7201] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:58:54.803079 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b9d035c7-1ee1-4303-808b-5325977a1971 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:58:54.803662 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b9d035c7-1ee1-4303-808b-5325977a1971 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:58:54.811527 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b9d035c7-1ee1-4303-808b-5325977a1971 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:54.811989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b9d035c7-1ee1-4303-808b-5325977a1971 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:54.812770 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b9d035c7-1ee1-4303-808b-5325977a1971 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:54.813214 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b9d035c7-1ee1-4303-808b-5325977a1971 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:54.960462 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b9d035c7-1ee1-4303-808b-5325977a1971 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:58:54.972322 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b9d035c7-1ee1-4303-808b-5325977a1971 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1259 microversion: 2.1 time: 0.172656 Jul 25 13:58:54.973727 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3564/7202] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:58:54 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:58:55.998973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2c4986c3-f7ad-4749-bbd7-95cd5e3adc63 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:58:55.999744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2c4986c3-f7ad-4749-bbd7-95cd5e3adc63 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:58:56.006963 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c4986c3-f7ad-4749-bbd7-95cd5e3adc63 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:56.007449 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c4986c3-f7ad-4749-bbd7-95cd5e3adc63 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:56.008226 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c4986c3-f7ad-4749-bbd7-95cd5e3adc63 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:56.008669 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2c4986c3-f7ad-4749-bbd7-95cd5e3adc63 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:56.163905 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2c4986c3-f7ad-4749-bbd7-95cd5e3adc63 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:58:56.171598 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2c4986c3-f7ad-4749-bbd7-95cd5e3adc63 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1444 microversion: 2.1 time: 0.177250 Jul 25 13:58:56.172165 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3639/7203] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:58:55 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1444 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:58:56.192152 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-18c65950-d7ac-4114-bb43-ccf1789d9b89 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:58:56.192790 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-18c65950-d7ac-4114-bb43-ccf1789d9b89 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:58:56.200404 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18c65950-d7ac-4114-bb43-ccf1789d9b89 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:56.200872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18c65950-d7ac-4114-bb43-ccf1789d9b89 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:56.201663 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18c65950-d7ac-4114-bb43-ccf1789d9b89 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:56.202153 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-18c65950-d7ac-4114-bb43-ccf1789d9b89 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:56.339653 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-18c65950-d7ac-4114-bb43-ccf1789d9b89 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:58:56.347503 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-18c65950-d7ac-4114-bb43-ccf1789d9b89 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1444 microversion: 2.1 time: 0.159233 Jul 25 13:58:56.348084 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3565/7204] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 13:58:56 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:58:58.037293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-8d48f5b0-bfbd-4d8f-b05b-d0504b8c5ddb req-70eb7314-e67d-4255-846e-a74d43a981f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a76866-851c-4497-87e1-7b1856fcd808", "tag": "582357fe-3b95-46f5-a317-acd20a0eeb67"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:58:58.048379 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-8d48f5b0-bfbd-4d8f-b05b-d0504b8c5ddb req-70eb7314-e67d-4255-846e-a74d43a981f6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:58:58.048819 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-8d48f5b0-bfbd-4d8f-b05b-d0504b8c5ddb req-70eb7314-e67d-4255-846e-a74d43a981f6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:58:58.064933 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-8d48f5b0-bfbd-4d8f-b05b-d0504b8c5ddb req-70eb7314-e67d-4255-846e-a74d43a981f6 service nova] Creating event network-changed:582357fe-3b95-46f5-a317-acd20a0eeb67 for instance 89a76866-851c-4497-87e1-7b1856fcd808 on n-h2-848886-15 Jul 25 13:58:58.073736 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-8d48f5b0-bfbd-4d8f-b05b-d0504b8c5ddb req-70eb7314-e67d-4255-846e-a74d43a981f6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039980 Jul 25 13:58:58.074891 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3640/7205] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 13:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:59:44.011463 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:59:44.012570 n-d-848886-15 devstack@n-api.service[125884]: Mon Jul 25 13:59:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 14:00:55.521367 n-d-848886-15 devstack@n-api.service[125883]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6a05e146-f3af-4d5e-94b9-7bc7c984fd44] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 14:00:55.522174 n-d-848886-15 devstack@n-api.service[125883]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34360325-f0fe-440a-9621-399cd8a3ecbe] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 14:00:55.522759 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:00:55.523512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=58 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:00:55.587088 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e9a16d3a-8c90-45b7-9129-e344120dee0e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:00:55.587636 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e9a16d3a-8c90-45b7-9129-e344120dee0e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:00:55.594038 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e9a16d3a-8c90-45b7-9129-e344120dee0e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:00:55.594497 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e9a16d3a-8c90-45b7-9129-e344120dee0e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:00:55.595277 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e9a16d3a-8c90-45b7-9129-e344120dee0e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:00:55.595728 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e9a16d3a-8c90-45b7-9129-e344120dee0e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:00:55.619829 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-e9a16d3a-8c90-45b7-9129-e344120dee0e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lazy-loading 'flavor' on Instance uuid 89a76866-851c-4497-87e1-7b1856fcd808 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:00:55.698889 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e9a16d3a-8c90-45b7-9129-e344120dee0e tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "POST /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808/action" status: 202 len: 0 microversion: 2.1 time: 0.179521 Jul 25 14:00:55.699514 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3566/7206] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 14:00:55 2022] POST /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:00:55.706923 n-d-848886-15 devstack@n-api.service[125884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7bc01c6a-70b5-4524-8a8d-4de2decdc49e] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 14:00:55.708066 n-d-848886-15 devstack@n-api.service[125884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b863d7c2-21ea-4c3e-8cfe-a7e1397e12fa] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 14:00:55.708690 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=24 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:00:55.709453 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=52 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:00:55.714142 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9ef27f54-e648-4db4-a75e-99b1621e3dce tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:00:55.714865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9ef27f54-e648-4db4-a75e-99b1621e3dce tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:00:55.723721 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ef27f54-e648-4db4-a75e-99b1621e3dce tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:00:55.724171 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ef27f54-e648-4db4-a75e-99b1621e3dce tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:00:55.724921 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ef27f54-e648-4db4-a75e-99b1621e3dce tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:00:55.725384 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9ef27f54-e648-4db4-a75e-99b1621e3dce tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:00:55.877201 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9ef27f54-e648-4db4-a75e-99b1621e3dce tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:00:55.885049 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9ef27f54-e648-4db4-a75e-99b1621e3dce tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1569 microversion: 2.1 time: 0.180892 Jul 25 14:00:55.885614 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3641/7207] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:00:55 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:00:56.915392 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-fb0121b8-e41d-4749-ae6e-f63e6120b255 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:00:56.916451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-fb0121b8-e41d-4749-ae6e-f63e6120b255 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:00:56.930995 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb0121b8-e41d-4749-ae6e-f63e6120b255 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:00:56.931460 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb0121b8-e41d-4749-ae6e-f63e6120b255 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:00:56.932261 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb0121b8-e41d-4749-ae6e-f63e6120b255 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:00:56.932711 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-fb0121b8-e41d-4749-ae6e-f63e6120b255 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:00:56.937958 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] [6a05e146-f3af-4d5e-94b9-7bc7c984fd44] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 49330. Jul 25 14:00:56.938736 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] [34360325-f0fe-440a-9621-399cd8a3ecbe] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 49332. Jul 25 14:00:57.074707 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-fb0121b8-e41d-4749-ae6e-f63e6120b255 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:00:57.082837 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-fb0121b8-e41d-4749-ae6e-f63e6120b255 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1569 microversion: 2.1 time: 0.178277 Jul 25 14:00:57.083612 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3567/7208] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:00:56 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:00:58.104816 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-cd7e9298-9d49-45ca-b5cc-8f38d459200d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:00:58.105438 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-cd7e9298-9d49-45ca-b5cc-8f38d459200d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:00:58.115488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cd7e9298-9d49-45ca-b5cc-8f38d459200d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:00:58.115936 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cd7e9298-9d49-45ca-b5cc-8f38d459200d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:00:58.116719 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cd7e9298-9d49-45ca-b5cc-8f38d459200d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:00:58.117157 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-cd7e9298-9d49-45ca-b5cc-8f38d459200d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:00:58.121295 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] [b863d7c2-21ea-4c3e-8cfe-a7e1397e12fa] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 49338. Jul 25 14:00:58.125062 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] [7bc01c6a-70b5-4524-8a8d-4de2decdc49e] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 49336. Jul 25 14:00:58.256217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-cd7e9298-9d49-45ca-b5cc-8f38d459200d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:00:58.265332 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-cd7e9298-9d49-45ca-b5cc-8f38d459200d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1569 microversion: 2.1 time: 0.164645 Jul 25 14:00:58.265921 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3642/7209] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:00:58 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:00:59.287019 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-d5b002c5-4aa5-4011-89b0-f39cd85ea72b tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:00:59.287634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-d5b002c5-4aa5-4011-89b0-f39cd85ea72b tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:00:59.295163 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d5b002c5-4aa5-4011-89b0-f39cd85ea72b tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:00:59.295634 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d5b002c5-4aa5-4011-89b0-f39cd85ea72b tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:00:59.296428 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d5b002c5-4aa5-4011-89b0-f39cd85ea72b tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:00:59.296871 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-d5b002c5-4aa5-4011-89b0-f39cd85ea72b tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:00:59.428531 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-d5b002c5-4aa5-4011-89b0-f39cd85ea72b tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:00:59.436554 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-d5b002c5-4aa5-4011-89b0-f39cd85ea72b tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1569 microversion: 2.1 time: 0.153519 Jul 25 14:00:59.437144 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3568/7210] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:00:59 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:00.461041 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-df980df1-521e-4726-9389-0f453203813c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:00.461666 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-df980df1-521e-4726-9389-0f453203813c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:00.469104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-df980df1-521e-4726-9389-0f453203813c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:00.469479 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-df980df1-521e-4726-9389-0f453203813c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:00.470289 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-df980df1-521e-4726-9389-0f453203813c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:00.470728 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-df980df1-521e-4726-9389-0f453203813c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:00.606325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-df980df1-521e-4726-9389-0f453203813c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:00.614495 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-df980df1-521e-4726-9389-0f453203813c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1569 microversion: 2.1 time: 0.157543 Jul 25 14:01:00.615081 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3643/7211] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:00 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:01.636366 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-51881928-7a98-4e6e-9bbb-ecc63a26b89d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:01.636991 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-51881928-7a98-4e6e-9bbb-ecc63a26b89d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:01.644451 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-51881928-7a98-4e6e-9bbb-ecc63a26b89d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:01.644926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-51881928-7a98-4e6e-9bbb-ecc63a26b89d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:01.645717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-51881928-7a98-4e6e-9bbb-ecc63a26b89d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:01.646205 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-51881928-7a98-4e6e-9bbb-ecc63a26b89d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:01.779638 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-51881928-7a98-4e6e-9bbb-ecc63a26b89d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:01.787716 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-51881928-7a98-4e6e-9bbb-ecc63a26b89d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1569 microversion: 2.1 time: 0.155422 Jul 25 14:01:01.788269 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3569/7212] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:01 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:02.809578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9d4a1d33-b6b9-4a19-9a93-6b8523fff96c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:02.810269 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9d4a1d33-b6b9-4a19-9a93-6b8523fff96c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:02.817770 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d4a1d33-b6b9-4a19-9a93-6b8523fff96c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:02.818254 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d4a1d33-b6b9-4a19-9a93-6b8523fff96c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:02.819024 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d4a1d33-b6b9-4a19-9a93-6b8523fff96c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:02.819460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9d4a1d33-b6b9-4a19-9a93-6b8523fff96c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:02.956640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9d4a1d33-b6b9-4a19-9a93-6b8523fff96c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:02.964790 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9d4a1d33-b6b9-4a19-9a93-6b8523fff96c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1569 microversion: 2.1 time: 0.159320 Jul 25 14:01:02.965348 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3644/7213] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:02 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:03.986806 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e7d6c7b1-8d6d-442e-8060-f56d45af1582 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:03.987442 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e7d6c7b1-8d6d-442e-8060-f56d45af1582 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:03.994935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e7d6c7b1-8d6d-442e-8060-f56d45af1582 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:03.995393 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e7d6c7b1-8d6d-442e-8060-f56d45af1582 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:03.996174 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e7d6c7b1-8d6d-442e-8060-f56d45af1582 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:03.996620 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e7d6c7b1-8d6d-442e-8060-f56d45af1582 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:04.474698 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e7d6c7b1-8d6d-442e-8060-f56d45af1582 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:04.482811 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e7d6c7b1-8d6d-442e-8060-f56d45af1582 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1569 microversion: 2.1 time: 0.499950 Jul 25 14:01:04.483406 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3570/7214] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:03 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1569 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:05.504240 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-95f814f3-a6e2-4cad-8c77-bfac0c084be4 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:05.504828 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-95f814f3-a6e2-4cad-8c77-bfac0c084be4 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:05.512120 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95f814f3-a6e2-4cad-8c77-bfac0c084be4 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:05.512564 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95f814f3-a6e2-4cad-8c77-bfac0c084be4 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:05.513325 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95f814f3-a6e2-4cad-8c77-bfac0c084be4 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:05.513753 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-95f814f3-a6e2-4cad-8c77-bfac0c084be4 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:05.656100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-95f814f3-a6e2-4cad-8c77-bfac0c084be4 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:05.666924 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-95f814f3-a6e2-4cad-8c77-bfac0c084be4 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1569 microversion: 2.1 time: 0.166669 Jul 25 14:01:05.667513 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3645/7215] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:05 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:06.693737 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-97ccea38-8f05-4292-89be-add46fa85d08 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:06.694397 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-97ccea38-8f05-4292-89be-add46fa85d08 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:06.702134 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97ccea38-8f05-4292-89be-add46fa85d08 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:06.702601 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97ccea38-8f05-4292-89be-add46fa85d08 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:06.703400 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97ccea38-8f05-4292-89be-add46fa85d08 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:06.703856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-97ccea38-8f05-4292-89be-add46fa85d08 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:06.846086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-97ccea38-8f05-4292-89be-add46fa85d08 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:06.854845 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-97ccea38-8f05-4292-89be-add46fa85d08 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1569 microversion: 2.1 time: 0.165547 Jul 25 14:01:06.855431 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3571/7216] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:06 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:07.876421 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fec41551-1033-44f1-8bb9-749bf7ff67be tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:07.877078 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fec41551-1033-44f1-8bb9-749bf7ff67be tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:07.886608 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fec41551-1033-44f1-8bb9-749bf7ff67be tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:07.887071 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fec41551-1033-44f1-8bb9-749bf7ff67be tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:07.887865 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fec41551-1033-44f1-8bb9-749bf7ff67be tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:07.889775 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fec41551-1033-44f1-8bb9-749bf7ff67be tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:08.038645 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fec41551-1033-44f1-8bb9-749bf7ff67be tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:08.046965 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fec41551-1033-44f1-8bb9-749bf7ff67be tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1569 microversion: 2.1 time: 0.174496 Jul 25 14:01:08.047552 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3646/7217] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:07 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:09.069269 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0ed417da-ebae-4593-b3b7-398ab0ca3cbb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:09.069881 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0ed417da-ebae-4593-b3b7-398ab0ca3cbb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:09.077628 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ed417da-ebae-4593-b3b7-398ab0ca3cbb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:09.078146 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ed417da-ebae-4593-b3b7-398ab0ca3cbb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:09.078939 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ed417da-ebae-4593-b3b7-398ab0ca3cbb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:09.079392 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0ed417da-ebae-4593-b3b7-398ab0ca3cbb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:09.222258 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0ed417da-ebae-4593-b3b7-398ab0ca3cbb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:09.230566 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0ed417da-ebae-4593-b3b7-398ab0ca3cbb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1569 microversion: 2.1 time: 0.165841 Jul 25 14:01:09.231160 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3572/7218] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:09 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:10.252951 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a302c93e-2ab8-4b2e-8502-4e10e2e890d2 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:10.253572 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a302c93e-2ab8-4b2e-8502-4e10e2e890d2 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:10.260749 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a302c93e-2ab8-4b2e-8502-4e10e2e890d2 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:10.261208 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a302c93e-2ab8-4b2e-8502-4e10e2e890d2 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:10.262013 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a302c93e-2ab8-4b2e-8502-4e10e2e890d2 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:10.262465 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a302c93e-2ab8-4b2e-8502-4e10e2e890d2 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:10.396432 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a302c93e-2ab8-4b2e-8502-4e10e2e890d2 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:10.404525 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a302c93e-2ab8-4b2e-8502-4e10e2e890d2 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1510 microversion: 2.1 time: 0.155598 Jul 25 14:01:10.405110 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3647/7219] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:10 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:10.425027 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8b61a0b9-6a57-4613-83e7-8c3f72c37a84 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:01:10.425569 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8b61a0b9-6a57-4613-83e7-8c3f72c37a84 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:10.432906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b61a0b9-6a57-4613-83e7-8c3f72c37a84 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:10.433368 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b61a0b9-6a57-4613-83e7-8c3f72c37a84 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:10.434195 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b61a0b9-6a57-4613-83e7-8c3f72c37a84 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:10.434644 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8b61a0b9-6a57-4613-83e7-8c3f72c37a84 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:10.512734 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8b61a0b9-6a57-4613-83e7-8c3f72c37a84 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "POST /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808/action" status: 202 len: 0 microversion: 2.1 time: 0.091604 Jul 25 14:01:10.513569 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3573/7220] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 14:01:10 2022] POST /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:01:10.521661 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-190dde84-74cc-44f1-a773-212c8a0c94b5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:10.522326 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-190dde84-74cc-44f1-a773-212c8a0c94b5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:10.528489 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-190dde84-74cc-44f1-a773-212c8a0c94b5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:10.528939 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-190dde84-74cc-44f1-a773-212c8a0c94b5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:10.529920 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-190dde84-74cc-44f1-a773-212c8a0c94b5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:10.530393 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-190dde84-74cc-44f1-a773-212c8a0c94b5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:10.708795 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-190dde84-74cc-44f1-a773-212c8a0c94b5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:10.717423 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-190dde84-74cc-44f1-a773-212c8a0c94b5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1518 microversion: 2.1 time: 0.199526 Jul 25 14:01:10.719185 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3648/7221] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:10 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1518 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:11.741681 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e4e3f2f3-3884-4cb0-a17e-e262616f2bce tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:11.742267 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e4e3f2f3-3884-4cb0-a17e-e262616f2bce tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:11.748856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4e3f2f3-3884-4cb0-a17e-e262616f2bce tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:11.749332 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4e3f2f3-3884-4cb0-a17e-e262616f2bce tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:11.750148 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4e3f2f3-3884-4cb0-a17e-e262616f2bce tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:11.750613 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e4e3f2f3-3884-4cb0-a17e-e262616f2bce tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:11.915776 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e4e3f2f3-3884-4cb0-a17e-e262616f2bce tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:11.925295 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e4e3f2f3-3884-4cb0-a17e-e262616f2bce tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1520 microversion: 2.1 time: 0.188654 Jul 25 14:01:11.925910 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3574/7222] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:11 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:12.641454 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-e1d3ebf0-4547-4acf-ba07-a53ed8d9822d req-64bc4a82-3b8e-48d6-9a9a-4903657d10f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a76866-851c-4497-87e1-7b1856fcd808", "name": "network-vif-unplugged", "status": "completed", "tag": "582357fe-3b95-46f5-a317-acd20a0eeb67"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:01:12.655597 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e1d3ebf0-4547-4acf-ba07-a53ed8d9822d req-64bc4a82-3b8e-48d6-9a9a-4903657d10f2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:12.656127 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-e1d3ebf0-4547-4acf-ba07-a53ed8d9822d req-64bc4a82-3b8e-48d6-9a9a-4903657d10f2 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:12.669004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.compute.server_external_events [req-e1d3ebf0-4547-4acf-ba07-a53ed8d9822d req-64bc4a82-3b8e-48d6-9a9a-4903657d10f2 service nova] Unable to find a host for instance 89a76866-851c-4497-87e1-7b1856fcd808. Dropping event network-vif-unplugged {{(pid=125884) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 14:01:12.670093 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-e1d3ebf0-4547-4acf-ba07-a53ed8d9822d req-64bc4a82-3b8e-48d6-9a9a-4903657d10f2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032566 Jul 25 14:01:12.671066 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3649/7223] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 14:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 25 14:01:12.948971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-36778ddb-b1cd-4859-aa5c-d790d7e95bae tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:12.949522 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-36778ddb-b1cd-4859-aa5c-d790d7e95bae tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:12.957039 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36778ddb-b1cd-4859-aa5c-d790d7e95bae tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:12.957461 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36778ddb-b1cd-4859-aa5c-d790d7e95bae tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:12.958281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36778ddb-b1cd-4859-aa5c-d790d7e95bae tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:12.958726 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-36778ddb-b1cd-4859-aa5c-d790d7e95bae tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:13.098619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-36778ddb-b1cd-4859-aa5c-d790d7e95bae tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:13.106714 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-36778ddb-b1cd-4859-aa5c-d790d7e95bae tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1520 microversion: 2.1 time: 0.162046 Jul 25 14:01:13.107292 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3575/7224] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:12 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:14.129076 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-6272ae63-6b42-4028-a3ad-8711576f7acf tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:14.129714 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-6272ae63-6b42-4028-a3ad-8711576f7acf tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:14.137810 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6272ae63-6b42-4028-a3ad-8711576f7acf tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:14.138303 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6272ae63-6b42-4028-a3ad-8711576f7acf tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:14.139102 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6272ae63-6b42-4028-a3ad-8711576f7acf tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:14.139548 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-6272ae63-6b42-4028-a3ad-8711576f7acf tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:14.278768 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-6272ae63-6b42-4028-a3ad-8711576f7acf tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:14.286572 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-6272ae63-6b42-4028-a3ad-8711576f7acf tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1520 microversion: 2.1 time: 0.161710 Jul 25 14:01:14.287198 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3650/7225] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:14 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:15.308455 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-29e00b8c-e9ef-42ee-b246-28f828f5dcc6 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:15.309027 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-29e00b8c-e9ef-42ee-b246-28f828f5dcc6 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:15.316838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29e00b8c-e9ef-42ee-b246-28f828f5dcc6 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:15.317305 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29e00b8c-e9ef-42ee-b246-28f828f5dcc6 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:15.318156 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29e00b8c-e9ef-42ee-b246-28f828f5dcc6 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:15.318583 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-29e00b8c-e9ef-42ee-b246-28f828f5dcc6 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:15.456138 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-29e00b8c-e9ef-42ee-b246-28f828f5dcc6 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:15.464278 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-29e00b8c-e9ef-42ee-b246-28f828f5dcc6 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1520 microversion: 2.1 time: 0.159993 Jul 25 14:01:15.464950 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3576/7226] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:15 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:16.487593 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-1e1fde7b-88e6-4295-b4b8-9140fdd8f66d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:16.488177 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-1e1fde7b-88e6-4295-b4b8-9140fdd8f66d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:16.496083 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1e1fde7b-88e6-4295-b4b8-9140fdd8f66d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:16.496538 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1e1fde7b-88e6-4295-b4b8-9140fdd8f66d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:16.497315 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1e1fde7b-88e6-4295-b4b8-9140fdd8f66d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:16.497750 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-1e1fde7b-88e6-4295-b4b8-9140fdd8f66d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:16.632797 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-1e1fde7b-88e6-4295-b4b8-9140fdd8f66d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:16.640964 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-1e1fde7b-88e6-4295-b4b8-9140fdd8f66d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1576 microversion: 2.1 time: 0.158775 Jul 25 14:01:16.641546 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3651/7227] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:16 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:17.299353 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-b9863d83-0a7d-43c2-93c9-26e2cc80c18a req-df2d85ac-be30-47bd-b8f7-187c3c24da65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a76866-851c-4497-87e1-7b1856fcd808", "tag": "582357fe-3b95-46f5-a317-acd20a0eeb67"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:01:17.312256 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b9863d83-0a7d-43c2-93c9-26e2cc80c18a req-df2d85ac-be30-47bd-b8f7-187c3c24da65 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:17.312721 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-b9863d83-0a7d-43c2-93c9-26e2cc80c18a req-df2d85ac-be30-47bd-b8f7-187c3c24da65 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:17.326517 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-b9863d83-0a7d-43c2-93c9-26e2cc80c18a req-df2d85ac-be30-47bd-b8f7-187c3c24da65 service nova] Creating event network-changed:582357fe-3b95-46f5-a317-acd20a0eeb67 for instance 89a76866-851c-4497-87e1-7b1856fcd808 on n-h1-848886-15 Jul 25 14:01:17.334088 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-b9863d83-0a7d-43c2-93c9-26e2cc80c18a req-df2d85ac-be30-47bd-b8f7-187c3c24da65 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038739 Jul 25 14:01:17.336413 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3577/7228] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 14:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:01:17.662397 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-27c92dbd-0d1d-402d-85ac-16bb85d6872d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:17.663004 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-27c92dbd-0d1d-402d-85ac-16bb85d6872d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:17.670293 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27c92dbd-0d1d-402d-85ac-16bb85d6872d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:17.670739 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27c92dbd-0d1d-402d-85ac-16bb85d6872d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:17.671514 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27c92dbd-0d1d-402d-85ac-16bb85d6872d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:17.671945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-27c92dbd-0d1d-402d-85ac-16bb85d6872d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:17.811689 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-27c92dbd-0d1d-402d-85ac-16bb85d6872d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:17.820293 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-27c92dbd-0d1d-402d-85ac-16bb85d6872d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1576 microversion: 2.1 time: 0.161665 Jul 25 14:01:17.821074 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3652/7229] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:17 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:17.999241 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 14:01:17.999542 n-d-848886-15 devstack@n-api.service[125883]: Mon Jul 25 14:01:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 14:01:18.842032 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-92d92a6b-9313-4171-8722-cfee16c1e344 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:18.842744 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-92d92a6b-9313-4171-8722-cfee16c1e344 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:18.854230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92d92a6b-9313-4171-8722-cfee16c1e344 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:18.854680 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92d92a6b-9313-4171-8722-cfee16c1e344 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:18.855514 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92d92a6b-9313-4171-8722-cfee16c1e344 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:18.855969 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-92d92a6b-9313-4171-8722-cfee16c1e344 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:18.999148 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-92d92a6b-9313-4171-8722-cfee16c1e344 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:19.008413 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-92d92a6b-9313-4171-8722-cfee16c1e344 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1576 microversion: 2.1 time: 0.170469 Jul 25 14:01:19.009049 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3578/7230] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:18 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:20.030222 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d871f6fe-8291-4e5d-9b9f-3a887837e817 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:20.030917 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d871f6fe-8291-4e5d-9b9f-3a887837e817 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:20.038274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d871f6fe-8291-4e5d-9b9f-3a887837e817 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:20.038659 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d871f6fe-8291-4e5d-9b9f-3a887837e817 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:20.039429 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d871f6fe-8291-4e5d-9b9f-3a887837e817 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:20.039935 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d871f6fe-8291-4e5d-9b9f-3a887837e817 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:20.185116 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d871f6fe-8291-4e5d-9b9f-3a887837e817 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:20.193385 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d871f6fe-8291-4e5d-9b9f-3a887837e817 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1576 microversion: 2.1 time: 0.167078 Jul 25 14:01:20.194020 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3653/7231] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:20 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:21.217766 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5750d40d-62df-49fa-ab60-cfd924469130 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:21.218414 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5750d40d-62df-49fa-ab60-cfd924469130 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:21.227633 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5750d40d-62df-49fa-ab60-cfd924469130 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:21.228098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5750d40d-62df-49fa-ab60-cfd924469130 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:21.228874 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5750d40d-62df-49fa-ab60-cfd924469130 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:21.229324 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5750d40d-62df-49fa-ab60-cfd924469130 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:21.370516 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5750d40d-62df-49fa-ab60-cfd924469130 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:21.378312 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5750d40d-62df-49fa-ab60-cfd924469130 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1576 microversion: 2.1 time: 0.166527 Jul 25 14:01:21.378820 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3579/7232] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:21 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:22.399525 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-e0a6c94c-8795-479a-9bf3-58512285b8e9 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:22.400080 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-e0a6c94c-8795-479a-9bf3-58512285b8e9 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:22.409403 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0a6c94c-8795-479a-9bf3-58512285b8e9 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:22.410143 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0a6c94c-8795-479a-9bf3-58512285b8e9 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:22.411299 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0a6c94c-8795-479a-9bf3-58512285b8e9 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:22.411953 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-e0a6c94c-8795-479a-9bf3-58512285b8e9 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:22.554569 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-e0a6c94c-8795-479a-9bf3-58512285b8e9 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:22.562398 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-e0a6c94c-8795-479a-9bf3-58512285b8e9 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1576 microversion: 2.1 time: 0.167027 Jul 25 14:01:22.562970 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3654/7233] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:22 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:23.585086 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-85e843c2-ae5f-484e-a59a-51af97d7eb7f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:23.585717 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-85e843c2-ae5f-484e-a59a-51af97d7eb7f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:23.594132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-85e843c2-ae5f-484e-a59a-51af97d7eb7f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:23.594132 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-85e843c2-ae5f-484e-a59a-51af97d7eb7f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:23.594532 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-85e843c2-ae5f-484e-a59a-51af97d7eb7f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:23.594989 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-85e843c2-ae5f-484e-a59a-51af97d7eb7f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:23.599056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:01:23.747608 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-85e843c2-ae5f-484e-a59a-51af97d7eb7f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:23.758644 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-85e843c2-ae5f-484e-a59a-51af97d7eb7f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1576 microversion: 2.1 time: 0.177416 Jul 25 14:01:23.759337 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3580/7234] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:23 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:24.784622 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-206a13b8-8de9-46ee-bcd4-7ee27a9cd66c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:24.785230 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-206a13b8-8de9-46ee-bcd4-7ee27a9cd66c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:24.792688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-206a13b8-8de9-46ee-bcd4-7ee27a9cd66c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:24.793137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-206a13b8-8de9-46ee-bcd4-7ee27a9cd66c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:24.793936 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-206a13b8-8de9-46ee-bcd4-7ee27a9cd66c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:24.794377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-206a13b8-8de9-46ee-bcd4-7ee27a9cd66c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:24.955147 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-206a13b8-8de9-46ee-bcd4-7ee27a9cd66c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:24.962961 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-206a13b8-8de9-46ee-bcd4-7ee27a9cd66c tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1576 microversion: 2.1 time: 0.182297 Jul 25 14:01:24.963544 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3655/7235] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:24 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:25.989784 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5a6bf8dc-bac8-497b-98cf-e84cdb85f8d1 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:25.990406 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5a6bf8dc-bac8-497b-98cf-e84cdb85f8d1 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:25.993257 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=33 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:01:25.999196 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a6bf8dc-bac8-497b-98cf-e84cdb85f8d1 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:25.999738 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a6bf8dc-bac8-497b-98cf-e84cdb85f8d1 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:26.000552 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a6bf8dc-bac8-497b-98cf-e84cdb85f8d1 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:26.001007 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5a6bf8dc-bac8-497b-98cf-e84cdb85f8d1 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:26.143321 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5a6bf8dc-bac8-497b-98cf-e84cdb85f8d1 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:26.151509 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5a6bf8dc-bac8-497b-98cf-e84cdb85f8d1 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1576 microversion: 2.1 time: 0.165715 Jul 25 14:01:26.152087 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3581/7236] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:25 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:27.173023 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fc92ee3d-92b0-40dd-821d-48354e95495d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:27.173609 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fc92ee3d-92b0-40dd-821d-48354e95495d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:27.176461 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=31 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:01:27.183578 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc92ee3d-92b0-40dd-821d-48354e95495d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:27.184346 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc92ee3d-92b0-40dd-821d-48354e95495d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:27.185398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc92ee3d-92b0-40dd-821d-48354e95495d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:27.186037 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fc92ee3d-92b0-40dd-821d-48354e95495d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:27.190758 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=87 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:01:27.328166 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fc92ee3d-92b0-40dd-821d-48354e95495d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:27.336748 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fc92ee3d-92b0-40dd-821d-48354e95495d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1576 microversion: 2.1 time: 0.167768 Jul 25 14:01:27.337356 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3656/7237] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:27 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:28.359704 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4cf4c386-94dd-47a5-a0d5-84228667ca56 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:28.360994 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4cf4c386-94dd-47a5-a0d5-84228667ca56 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:28.367484 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4cf4c386-94dd-47a5-a0d5-84228667ca56 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:28.368073 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4cf4c386-94dd-47a5-a0d5-84228667ca56 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:28.368856 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4cf4c386-94dd-47a5-a0d5-84228667ca56 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:28.369353 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4cf4c386-94dd-47a5-a0d5-84228667ca56 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:28.407251 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-cb75abcb-4e5e-4033-96f0-e4f346762bf9 req-cd7821a5-1cb2-4d49-99b4-79fcecdac7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a76866-851c-4497-87e1-7b1856fcd808", "name": "network-vif-plugged", "status": "completed", "tag": "582357fe-3b95-46f5-a317-acd20a0eeb67"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:01:28.418006 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-cb75abcb-4e5e-4033-96f0-e4f346762bf9 req-cd7821a5-1cb2-4d49-99b4-79fcecdac7b8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:28.418602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-cb75abcb-4e5e-4033-96f0-e4f346762bf9 req-cd7821a5-1cb2-4d49-99b4-79fcecdac7b8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:28.432884 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-cb75abcb-4e5e-4033-96f0-e4f346762bf9 req-cd7821a5-1cb2-4d49-99b4-79fcecdac7b8 service nova] Creating event network-vif-plugged:582357fe-3b95-46f5-a317-acd20a0eeb67 for instance 89a76866-851c-4497-87e1-7b1856fcd808 on n-h1-848886-15 Jul 25 14:01:28.439130 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-cb75abcb-4e5e-4033-96f0-e4f346762bf9 req-cd7821a5-1cb2-4d49-99b4-79fcecdac7b8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035635 Jul 25 14:01:28.439755 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3657/7238] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 14:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:01:28.524760 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4cf4c386-94dd-47a5-a0d5-84228667ca56 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:28.533106 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4cf4c386-94dd-47a5-a0d5-84228667ca56 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1576 microversion: 2.1 time: 0.177432 Jul 25 14:01:28.533819 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3582/7239] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:28 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:29.555371 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-01788430-0104-440a-af06-cf1fa50bee75 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:29.555975 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-01788430-0104-440a-af06-cf1fa50bee75 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:29.564949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01788430-0104-440a-af06-cf1fa50bee75 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:29.565502 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01788430-0104-440a-af06-cf1fa50bee75 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:29.566950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01788430-0104-440a-af06-cf1fa50bee75 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:29.567495 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-01788430-0104-440a-af06-cf1fa50bee75 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:29.709707 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-01788430-0104-440a-af06-cf1fa50bee75 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:29.718185 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-01788430-0104-440a-af06-cf1fa50bee75 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1576 microversion: 2.1 time: 0.167099 Jul 25 14:01:29.719095 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3658/7240] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:29 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:01:30.743807 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-2d2ac9e4-0c14-42b7-a518-a369938c41aa tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:01:30.744647 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-2d2ac9e4-0c14-42b7-a518-a369938c41aa tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:01:30.753081 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d2ac9e4-0c14-42b7-a518-a369938c41aa tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:30.753534 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d2ac9e4-0c14-42b7-a518-a369938c41aa tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:30.754401 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d2ac9e4-0c14-42b7-a518-a369938c41aa tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:01:30.754941 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-2d2ac9e4-0c14-42b7-a518-a369938c41aa tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:01:30.898247 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-2d2ac9e4-0c14-42b7-a518-a369938c41aa tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:01:30.907070 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-2d2ac9e4-0c14-42b7-a518-a369938c41aa tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1563 microversion: 2.1 time: 0.167921 Jul 25 14:01:30.907372 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3583/7241] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:01:30 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:02:47.615420 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=5 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:02:47.617649 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=5 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:02:47.618345 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=22 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:02:47.624391 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=13 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:02:47.628814 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2238aa1a-1140-4d62-a9a3-b14b38b539bb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:02:47.629323 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2238aa1a-1140-4d62-a9a3-b14b38b539bb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:02:47.639154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2238aa1a-1140-4d62-a9a3-b14b38b539bb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:02:47.639154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2238aa1a-1140-4d62-a9a3-b14b38b539bb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:02:47.639154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2238aa1a-1140-4d62-a9a3-b14b38b539bb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:02:47.639154 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2238aa1a-1140-4d62-a9a3-b14b38b539bb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:02:47.665631 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2238aa1a-1140-4d62-a9a3-b14b38b539bb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:02:47.678039 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-377b1d6b-ae2c-4f1f-8c26-55d0758820d0 req-955777e3-0f52-436d-95d1-c5f03ff88410 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a76866-851c-4497-87e1-7b1856fcd808", "tag": "582357fe-3b95-46f5-a317-acd20a0eeb67"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:02:47.687948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-377b1d6b-ae2c-4f1f-8c26-55d0758820d0 req-955777e3-0f52-436d-95d1-c5f03ff88410 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:02:47.688464 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-377b1d6b-ae2c-4f1f-8c26-55d0758820d0 req-955777e3-0f52-436d-95d1-c5f03ff88410 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:02:47.704327 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-377b1d6b-ae2c-4f1f-8c26-55d0758820d0 req-955777e3-0f52-436d-95d1-c5f03ff88410 service nova] Creating event network-changed:582357fe-3b95-46f5-a317-acd20a0eeb67 for instance 89a76866-851c-4497-87e1-7b1856fcd808 on n-h1-848886-15 Jul 25 14:02:47.709531 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-377b1d6b-ae2c-4f1f-8c26-55d0758820d0 req-955777e3-0f52-436d-95d1-c5f03ff88410 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095783 Jul 25 14:02:47.710499 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3584/7242] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 14:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:02:47.778771 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2238aa1a-1140-4d62-a9a3-b14b38b539bb tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "DELETE /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 204 len: 0 microversion: 2.1 time: 0.167047 Jul 25 14:02:47.780247 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3659/7243] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 14:02:47 2022] DELETE /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:02:47.792290 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-209f5485-70cb-4644-b90e-3bef1576662f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:02:47.793083 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-209f5485-70cb-4644-b90e-3bef1576662f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:02:47.800528 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-209f5485-70cb-4644-b90e-3bef1576662f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:02:47.800996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-209f5485-70cb-4644-b90e-3bef1576662f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:02:47.801786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-209f5485-70cb-4644-b90e-3bef1576662f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:02:47.802259 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-209f5485-70cb-4644-b90e-3bef1576662f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:02:47.938567 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-209f5485-70cb-4644-b90e-3bef1576662f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:02:47.946952 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-209f5485-70cb-4644-b90e-3bef1576662f tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1569 microversion: 2.1 time: 0.161172 Jul 25 14:02:47.947523 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3585/7244] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:02:47 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:02:48.969421 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-4a7d493a-f438-44a2-8dc2-50ded4919040 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:02:48.970168 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-4a7d493a-f438-44a2-8dc2-50ded4919040 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:02:48.977800 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a7d493a-f438-44a2-8dc2-50ded4919040 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:02:48.978376 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a7d493a-f438-44a2-8dc2-50ded4919040 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:02:48.979158 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a7d493a-f438-44a2-8dc2-50ded4919040 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:02:48.979574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-4a7d493a-f438-44a2-8dc2-50ded4919040 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:02:49.118106 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-4a7d493a-f438-44a2-8dc2-50ded4919040 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:02:49.126280 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-4a7d493a-f438-44a2-8dc2-50ded4919040 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1569 microversion: 2.1 time: 0.161155 Jul 25 14:02:49.127179 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3660/7245] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:02:48 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:02:49.725056 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-95bd9584-1b0b-4270-a3b8-21eb656c42cf req-9478f41d-49b6-4aee-a9eb-d5c8398fccb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a76866-851c-4497-87e1-7b1856fcd808", "name": "network-vif-deleted", "tag": "582357fe-3b95-46f5-a317-acd20a0eeb67"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:02:49.738758 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-95bd9584-1b0b-4270-a3b8-21eb656c42cf req-9478f41d-49b6-4aee-a9eb-d5c8398fccb6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:02:49.739263 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-95bd9584-1b0b-4270-a3b8-21eb656c42cf req-9478f41d-49b6-4aee-a9eb-d5c8398fccb6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:02:49.753217 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-95bd9584-1b0b-4270-a3b8-21eb656c42cf req-9478f41d-49b6-4aee-a9eb-d5c8398fccb6 service nova] Creating event network-vif-deleted:582357fe-3b95-46f5-a317-acd20a0eeb67 for instance 89a76866-851c-4497-87e1-7b1856fcd808 on n-h1-848886-15 Jul 25 14:02:49.758921 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-95bd9584-1b0b-4270-a3b8-21eb656c42cf req-9478f41d-49b6-4aee-a9eb-d5c8398fccb6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037707 Jul 25 14:02:49.759749 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3586/7246] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 14:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:02:50.148305 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-9008f3df-46a6-45b7-bacb-512e377c8287 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:02:50.148970 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-9008f3df-46a6-45b7-bacb-512e377c8287 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:02:50.156758 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9008f3df-46a6-45b7-bacb-512e377c8287 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:02:50.157341 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9008f3df-46a6-45b7-bacb-512e377c8287 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:02:50.158314 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9008f3df-46a6-45b7-bacb-512e377c8287 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:02:50.158900 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-9008f3df-46a6-45b7-bacb-512e377c8287 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:02:50.226574 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-9008f3df-46a6-45b7-bacb-512e377c8287 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:02:50.234492 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-9008f3df-46a6-45b7-bacb-512e377c8287 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1219 microversion: 2.1 time: 0.090015 Jul 25 14:02:50.235108 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3661/7247] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:02:50 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:02:51.259230 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0c108e5e-d317-4b63-becd-613d6df262a7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:02:51.259919 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0c108e5e-d317-4b63-becd-613d6df262a7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:02:51.267240 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c108e5e-d317-4b63-becd-613d6df262a7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:02:51.269110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c108e5e-d317-4b63-becd-613d6df262a7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:02:51.269110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c108e5e-d317-4b63-becd-613d6df262a7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:02:51.269110 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0c108e5e-d317-4b63-becd-613d6df262a7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:02:51.335600 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-0c108e5e-d317-4b63-becd-613d6df262a7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:02:51.343667 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0c108e5e-d317-4b63-becd-613d6df262a7 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1219 microversion: 2.1 time: 0.090387 Jul 25 14:02:51.344257 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3587/7248] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:02:51 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:02:52.369474 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5d0a0360-cbaf-4900-a50f-af3b5fcad811 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:02:52.370100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5d0a0360-cbaf-4900-a50f-af3b5fcad811 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:02:52.377217 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d0a0360-cbaf-4900-a50f-af3b5fcad811 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:02:52.377606 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d0a0360-cbaf-4900-a50f-af3b5fcad811 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:02:52.378394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d0a0360-cbaf-4900-a50f-af3b5fcad811 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:02:52.378828 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d0a0360-cbaf-4900-a50f-af3b5fcad811 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:02:52.440553 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5d0a0360-cbaf-4900-a50f-af3b5fcad811 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:02:52.448306 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5d0a0360-cbaf-4900-a50f-af3b5fcad811 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1219 microversion: 2.1 time: 0.087287 Jul 25 14:02:52.448886 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3662/7249] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:02:52 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:02:53.469187 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-e0912825-93c1-4f92-a8b5-265cf2ef509d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:02:53.469794 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-e0912825-93c1-4f92-a8b5-265cf2ef509d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:02:53.477734 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e0912825-93c1-4f92-a8b5-265cf2ef509d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:02:53.478227 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e0912825-93c1-4f92-a8b5-265cf2ef509d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:02:53.479009 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e0912825-93c1-4f92-a8b5-265cf2ef509d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:02:53.479457 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-e0912825-93c1-4f92-a8b5-265cf2ef509d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:02:53.541920 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-e0912825-93c1-4f92-a8b5-265cf2ef509d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ad8c74d82d4166850eadcd222dd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952fff45e4574565b432d43745b1f4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:02:53.550237 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-e0912825-93c1-4f92-a8b5-265cf2ef509d tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 200 len: 1219 microversion: 2.1 time: 0.085186 Jul 25 14:02:53.550828 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3588/7250] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:02:53 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:02:54.572053 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-52caaa75-5132-4732-a176-6f442d70f878 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:02:54.572672 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-52caaa75-5132-4732-a176-6f442d70f878 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] [instance: 89a76866-851c-4497-87e1-7b1856fcd808] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:02:54.580081 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-52caaa75-5132-4732-a176-6f442d70f878 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:02:54.580529 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-52caaa75-5132-4732-a176-6f442d70f878 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:02:54.581308 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-52caaa75-5132-4732-a176-6f442d70f878 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:02:54.581740 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-52caaa75-5132-4732-a176-6f442d70f878 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:02:54.596342 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-52caaa75-5132-4732-a176-6f442d70f878 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] HTTP exception thrown: Instance 89a76866-851c-4497-87e1-7b1856fcd808 could not be found. Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-52caaa75-5132-4732-a176-6f442d70f878 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Request method failure captured: Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 HTTP/1.1 Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3qB_e67csfpVNDceK5cB4JGk6LNiVL74-3stgS6kXwm045PMEGPSjQ4BMoEotgEfhIA5fnhAFV2u5NCA5Ts3DttcQA08GWEvBXqyFEOIhvhXjnltAWAtu-4uOE2GvAEPsKguAKwtEVSU4Wt9pIfOSlYejbmkZZc-nZd_D2aTqyw3jUg Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: 952fff45e4574565b432d43745b1f4b2 Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestShelveInstance-2083165822 Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_952fff45e4574565b432d43745b1f4b2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/952fff45e4574565b432d43745b1f4b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/952fff45e4574565b432d43745b1f4b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/952fff45e4574565b432d43745b1f4b2"}]}] Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestShelveInstance-2083165822 Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: 952fff45e4574565b432d43745b1f4b2 Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestShelveInstance-2083165822 Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestShelveInstance-2083165822-project Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 10ad8c74d82d4166850eadcd222dd0bc Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestShelveInstance-2083165822-project Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance 89a76866-851c-4497-87e1-7b1856fcd808 could not be found. Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': '89a76866-851c-4497-87e1-7b1856fcd808'} Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89a76866-851c-4497-87e1-7b1856fcd808 could not be found. Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89a76866-851c-4497-87e1-7b1856fcd808 could not be found. Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:02:54.598100 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 14:02:54.606793 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:02:54.606793 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:02:54.606793 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:02:54.606793 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:02:54.606793 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:02:54.606793 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89a76866-851c-4497-87e1-7b1856fcd808 could not be found. Jul 25 14:02:54.606793 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 14:02:54.606793 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-52caaa75-5132-4732-a176-6f442d70f878 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Returning 404 to user: Instance 89a76866-851c-4497-87e1-7b1856fcd808 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:02:54.606793 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-52caaa75-5132-4732-a176-6f442d70f878 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808" status: 404 len: 111 microversion: 2.1 time: 0.031551 Jul 25 14:02:54.606793 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3663/7251] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:02:54 2022] GET /compute/v2.1/servers/89a76866-851c-4497-87e1-7b1856fcd808 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:02:54.784351 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-84a92c4b-775b-46cb-9b26-e4bf85039bb5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] Calling method '.version_select at 0x7efcf8c4c5e0>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:02:54.811440 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-84a92c4b-775b-46cb-9b26-e4bf85039bb5 tempest-TestShelveInstance-2083165822 tempest-TestShelveInstance-2083165822-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2040845473" status: 202 len: 0 microversion: 2.1 time: 0.031133 Jul 25 14:02:54.812136 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3589/7252] 10.222.0.49 () {58 vars in 1254 bytes} [Mon Jul 25 14:02:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2040845473 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:03:04.021633 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 14:03:04.022356 n-d-848886-15 devstack@n-api.service[125884]: Mon Jul 25 14:03:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 14:03:12.928104 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:03:12.929647 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:03:13.116188 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d35061e3-8e74-4e3e-8f11-1da706a2e60a tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Action: 'create', calling method: .version_select at 0x7efcf87a5a60>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1866138768", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAVUpNZYxgvLuwvpZAYWeCNk9KlfZtIGT2eNz2VKjq9YL2E+F6q/W/XDKoJCmQy0MGD+VvywR+l0nSbnERuMla7M/3enPsheRZ5wljOIG/DVPXm6bpW1k/ifVVUUL+eww=="}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:03:13.133079 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-d35061e3-8e74-4e3e-8f11-1da706a2e60a tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Getting quotas for project a79a678ff2ed4b70ad3a0e340d5dcc8e. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:03:13.139557 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.quota [None req-d35061e3-8e74-4e3e-8f11-1da706a2e60a tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Getting quotas for user 1379fa6698114fbea5dec6ca63d2cf0d and project a79a678ff2ed4b70ad3a0e340d5dcc8e. Resources: {'key_pairs'} {{(pid=125884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:03:13.153785 n-d-848886-15 devstack@n-api.service[125884]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d35061e3-8e74-4e3e-8f11-1da706a2e60a tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [137ed58a-c793-4517-8518-e348d9484177] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 14:03:14.162261 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [None req-d35061e3-8e74-4e3e-8f11-1da706a2e60a tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [137ed58a-c793-4517-8518-e348d9484177] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 49594. Jul 25 14:03:14.181192 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d35061e3-8e74-4e3e-8f11-1da706a2e60a tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 1.258249 Jul 25 14:03:14.181951 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3664/7253] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Jul 25 14:03:12 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:03:15.228336 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=22 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:03:15.229095 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:03:15.233935 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8716b0d2-1294-416f-ad0d-3234a5bad178 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-813872898", "imageRef": "97beeed7-7564-4203-abda-feef7e93cd98", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1866138768", "security_groups": [{"name": "tempest-secgroup-smoke-949077633"}], "networks": [{"uuid": "8c06947a-f996-4635-bcd4-34eb8b240530"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:03:15.454656 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-8716b0d2-1294-416f-ad0d-3234a5bad178 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] validate_networks() for [('8c06947a-f996-4635-bcd4-34eb8b240530', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:03:15.956496 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-8716b0d2-1294-416f-ad0d-3234a5bad178 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:03:15.957165 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-8716b0d2-1294-416f-ad0d-3234a5bad178 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:03:15.957927 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-8716b0d2-1294-416f-ad0d-3234a5bad178 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:03:15.958441 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-8716b0d2-1294-416f-ad0d-3234a5bad178 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:03:15.958791 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-8716b0d2-1294-416f-ad0d-3234a5bad178 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:03:15.967953 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8716b0d2-1294-416f-ad0d-3234a5bad178 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:03:15.968672 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8716b0d2-1294-416f-ad0d-3234a5bad178 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:03:15.969492 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8716b0d2-1294-416f-ad0d-3234a5bad178 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:03:15.969983 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8716b0d2-1294-416f-ad0d-3234a5bad178 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:03:15.988005 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-8716b0d2-1294-416f-ad0d-3234a5bad178 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Getting quotas for project a79a678ff2ed4b70ad3a0e340d5dcc8e. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:03:15.994160 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-8716b0d2-1294-416f-ad0d-3234a5bad178 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Getting quotas for user 1379fa6698114fbea5dec6ca63d2cf0d and project a79a678ff2ed4b70ad3a0e340d5dcc8e. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:03:16.006926 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8716b0d2-1294-416f-ad0d-3234a5bad178 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:03:16.009300 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8716b0d2-1294-416f-ad0d-3234a5bad178 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: f19ad795-cec0-407b-b2d5-1eb5b0f19b76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97beeed7-7564-4203-abda-feef7e93cd98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:03:16.055595 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8716b0d2-1294-416f-ad0d-3234a5bad178 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.829039 Jul 25 14:03:16.056257 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3590/7254] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 14:03:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:03:16.067214 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-af20bc3d-b64d-4a65-9aab-3bf2df898581 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:03:16.068583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-af20bc3d-b64d-4a65-9aab-3bf2df898581 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: f19ad795-cec0-407b-b2d5-1eb5b0f19b76] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:03:16.132788 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-af20bc3d-b64d-4a65-9aab-3bf2df898581 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:03:16.140623 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-af20bc3d-b64d-4a65-9aab-3bf2df898581 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76" status: 200 len: 1248 microversion: 2.1 time: 0.077456 Jul 25 14:03:16.145993 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3665/7255] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:03:16 2022] GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76 => generated 1248 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:03:17.161763 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-694dce37-1e19-4bd2-b5b3-36d287576655 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:03:17.162447 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-694dce37-1e19-4bd2-b5b3-36d287576655 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: f19ad795-cec0-407b-b2d5-1eb5b0f19b76] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:03:17.169822 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-694dce37-1e19-4bd2-b5b3-36d287576655 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:03:17.170325 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-694dce37-1e19-4bd2-b5b3-36d287576655 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:03:17.171107 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-694dce37-1e19-4bd2-b5b3-36d287576655 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:03:17.171553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-694dce37-1e19-4bd2-b5b3-36d287576655 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:03:17.238809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-694dce37-1e19-4bd2-b5b3-36d287576655 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:03:17.247765 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-694dce37-1e19-4bd2-b5b3-36d287576655 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76" status: 200 len: 1300 microversion: 2.1 time: 0.090715 Jul 25 14:03:17.248697 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3591/7256] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:03:17 2022] GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76 => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:03:18.269286 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-2a893def-a464-40f3-b177-b23e05b9afb4 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:03:18.269996 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-2a893def-a464-40f3-b177-b23e05b9afb4 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: f19ad795-cec0-407b-b2d5-1eb5b0f19b76] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:03:18.278950 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a893def-a464-40f3-b177-b23e05b9afb4 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:03:18.279508 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a893def-a464-40f3-b177-b23e05b9afb4 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:03:18.280383 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a893def-a464-40f3-b177-b23e05b9afb4 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:03:18.281084 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-2a893def-a464-40f3-b177-b23e05b9afb4 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:03:18.564488 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-2a893def-a464-40f3-b177-b23e05b9afb4 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:03:18.575915 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-2a893def-a464-40f3-b177-b23e05b9afb4 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76" status: 200 len: 1373 microversion: 2.1 time: 0.310091 Jul 25 14:03:18.576871 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3666/7257] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:03:18 2022] GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76 => generated 1373 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:03:18.792216 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-199403d4-4534-4eeb-be4a-b91b0b572b26 req-214a1484-edff-4e8c-ba3d-3322f29be6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f19ad795-cec0-407b-b2d5-1eb5b0f19b76", "tag": "9e4c1b6c-d4f2-461f-a774-1d2f820b5352"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:03:18.824157 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-199403d4-4534-4eeb-be4a-b91b0b572b26 req-214a1484-edff-4e8c-ba3d-3322f29be6d5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:03:18.824952 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-199403d4-4534-4eeb-be4a-b91b0b572b26 req-214a1484-edff-4e8c-ba3d-3322f29be6d5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:03:18.838206 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-199403d4-4534-4eeb-be4a-b91b0b572b26 req-214a1484-edff-4e8c-ba3d-3322f29be6d5 service nova] Creating event network-changed:9e4c1b6c-d4f2-461f-a774-1d2f820b5352 for instance f19ad795-cec0-407b-b2d5-1eb5b0f19b76 on n-h2-848886-15 Jul 25 14:03:18.848758 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-199403d4-4534-4eeb-be4a-b91b0b572b26 req-214a1484-edff-4e8c-ba3d-3322f29be6d5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070873 Jul 25 14:03:18.849554 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3592/7258] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 14:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:03:19.596947 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8663db4e-6c1c-4c3b-abbb-e3a4588aeec6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:03:19.597569 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8663db4e-6c1c-4c3b-abbb-e3a4588aeec6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: f19ad795-cec0-407b-b2d5-1eb5b0f19b76] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:03:19.604943 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8663db4e-6c1c-4c3b-abbb-e3a4588aeec6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:03:19.605398 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8663db4e-6c1c-4c3b-abbb-e3a4588aeec6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:03:19.606205 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8663db4e-6c1c-4c3b-abbb-e3a4588aeec6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:03:19.606640 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8663db4e-6c1c-4c3b-abbb-e3a4588aeec6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:03:19.743742 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-8663db4e-6c1c-4c3b-abbb-e3a4588aeec6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:03:19.752231 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8663db4e-6c1c-4c3b-abbb-e3a4588aeec6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76" status: 200 len: 1373 microversion: 2.1 time: 0.159236 Jul 25 14:03:19.752853 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3667/7259] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:03:19 2022] GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:03:20.775478 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-5b2ec24e-6450-4a53-a3eb-7508f037e1d0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:03:20.776068 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-5b2ec24e-6450-4a53-a3eb-7508f037e1d0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: f19ad795-cec0-407b-b2d5-1eb5b0f19b76] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:03:20.783117 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5b2ec24e-6450-4a53-a3eb-7508f037e1d0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:03:20.783592 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5b2ec24e-6450-4a53-a3eb-7508f037e1d0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:03:20.784398 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5b2ec24e-6450-4a53-a3eb-7508f037e1d0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:03:20.784852 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-5b2ec24e-6450-4a53-a3eb-7508f037e1d0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:03:20.931903 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-5b2ec24e-6450-4a53-a3eb-7508f037e1d0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:03:20.940577 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-5b2ec24e-6450-4a53-a3eb-7508f037e1d0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76" status: 200 len: 1373 microversion: 2.1 time: 0.170570 Jul 25 14:03:20.941196 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3593/7260] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:03:20 2022] GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:03:21.961949 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-fb762387-4fe7-4f95-ba8b-b6b3fc1dbd20 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:03:21.962570 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-fb762387-4fe7-4f95-ba8b-b6b3fc1dbd20 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: f19ad795-cec0-407b-b2d5-1eb5b0f19b76] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:03:21.970501 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb762387-4fe7-4f95-ba8b-b6b3fc1dbd20 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:03:21.970957 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb762387-4fe7-4f95-ba8b-b6b3fc1dbd20 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:03:21.971755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb762387-4fe7-4f95-ba8b-b6b3fc1dbd20 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:03:21.972194 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-fb762387-4fe7-4f95-ba8b-b6b3fc1dbd20 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:03:22.108478 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-fb762387-4fe7-4f95-ba8b-b6b3fc1dbd20 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:03:22.117405 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-fb762387-4fe7-4f95-ba8b-b6b3fc1dbd20 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76" status: 200 len: 1373 microversion: 2.1 time: 0.159204 Jul 25 14:03:22.130262 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3668/7261] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:03:21 2022] GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76 => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:03:23.138992 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-ce830058-0ed1-4ea8-ae3c-0d4a1a7db6c6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:03:23.139619 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-ce830058-0ed1-4ea8-ae3c-0d4a1a7db6c6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: f19ad795-cec0-407b-b2d5-1eb5b0f19b76] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:03:23.146539 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ce830058-0ed1-4ea8-ae3c-0d4a1a7db6c6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:03:23.147085 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ce830058-0ed1-4ea8-ae3c-0d4a1a7db6c6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:03:23.147919 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ce830058-0ed1-4ea8-ae3c-0d4a1a7db6c6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:03:23.148365 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-ce830058-0ed1-4ea8-ae3c-0d4a1a7db6c6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:03:23.290417 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-ce830058-0ed1-4ea8-ae3c-0d4a1a7db6c6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:03:23.298368 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-ce830058-0ed1-4ea8-ae3c-0d4a1a7db6c6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76" status: 200 len: 1373 microversion: 2.1 time: 0.163174 Jul 25 14:03:23.298925 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3594/7262] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:03:23 2022] GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:03:23.309164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-a006bdc9-d50d-4f91-80c0-3ca9d5071d60 req-5c051ce0-a629-4cd9-9d80-aade83cfc518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f19ad795-cec0-407b-b2d5-1eb5b0f19b76", "name": "network-vif-plugged", "status": "completed", "tag": "9e4c1b6c-d4f2-461f-a774-1d2f820b5352"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:03:23.321779 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a006bdc9-d50d-4f91-80c0-3ca9d5071d60 req-5c051ce0-a629-4cd9-9d80-aade83cfc518 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:03:23.322294 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-a006bdc9-d50d-4f91-80c0-3ca9d5071d60 req-5c051ce0-a629-4cd9-9d80-aade83cfc518 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:03:23.333721 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-a006bdc9-d50d-4f91-80c0-3ca9d5071d60 req-5c051ce0-a629-4cd9-9d80-aade83cfc518 service nova] Creating event network-vif-plugged:9e4c1b6c-d4f2-461f-a774-1d2f820b5352 for instance f19ad795-cec0-407b-b2d5-1eb5b0f19b76 on n-h2-848886-15 Jul 25 14:03:23.338895 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-a006bdc9-d50d-4f91-80c0-3ca9d5071d60 req-5c051ce0-a629-4cd9-9d80-aade83cfc518 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094852 Jul 25 14:03:23.339497 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3669/7263] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 14:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:03:24.320645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-8133f3b0-6a0c-4352-9458-d144f3a697c7 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:03:24.321269 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-8133f3b0-6a0c-4352-9458-d144f3a697c7 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: f19ad795-cec0-407b-b2d5-1eb5b0f19b76] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:03:24.328692 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8133f3b0-6a0c-4352-9458-d144f3a697c7 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:03:24.329151 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8133f3b0-6a0c-4352-9458-d144f3a697c7 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:03:24.329968 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8133f3b0-6a0c-4352-9458-d144f3a697c7 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:03:24.330416 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-8133f3b0-6a0c-4352-9458-d144f3a697c7 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:03:24.467177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-8133f3b0-6a0c-4352-9458-d144f3a697c7 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:03:24.475262 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-8133f3b0-6a0c-4352-9458-d144f3a697c7 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76" status: 200 len: 1373 microversion: 2.1 time: 0.158931 Jul 25 14:03:24.476062 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3595/7264] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:03:24 2022] GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:03:25.496447 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5d69265f-0f3a-4814-b21a-a34a93627ab1 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:03:25.497137 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5d69265f-0f3a-4814-b21a-a34a93627ab1 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: f19ad795-cec0-407b-b2d5-1eb5b0f19b76] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:03:25.505014 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d69265f-0f3a-4814-b21a-a34a93627ab1 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:03:25.505460 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d69265f-0f3a-4814-b21a-a34a93627ab1 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:03:25.506378 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d69265f-0f3a-4814-b21a-a34a93627ab1 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:03:25.507040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5d69265f-0f3a-4814-b21a-a34a93627ab1 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:03:26.003560 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5d69265f-0f3a-4814-b21a-a34a93627ab1 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:03:26.011492 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5d69265f-0f3a-4814-b21a-a34a93627ab1 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76" status: 200 len: 1559 microversion: 2.1 time: 0.519565 Jul 25 14:03:26.012065 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3670/7265] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:03:25 2022] GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76 => generated 1559 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:03:26.032482 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-760a8809-e87e-468b-a72d-3720ec496b59 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:03:26.033114 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-760a8809-e87e-468b-a72d-3720ec496b59 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: f19ad795-cec0-407b-b2d5-1eb5b0f19b76] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:03:26.035981 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:03:26.036706 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:03:26.043091 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-760a8809-e87e-468b-a72d-3720ec496b59 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:03:26.043586 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-760a8809-e87e-468b-a72d-3720ec496b59 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:03:26.044385 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-760a8809-e87e-468b-a72d-3720ec496b59 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:03:26.044838 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-760a8809-e87e-468b-a72d-3720ec496b59 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:03:26.186202 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-760a8809-e87e-468b-a72d-3720ec496b59 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:03:26.194998 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-760a8809-e87e-468b-a72d-3720ec496b59 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76" status: 200 len: 1559 microversion: 2.1 time: 0.166531 Jul 25 14:03:26.195594 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3596/7266] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:03:26 2022] GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:03:27.925583 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-97937c41-16da-4e69-83be-b01760845973 req-869993a2-e036-42f5-a483-96231f36ade4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f19ad795-cec0-407b-b2d5-1eb5b0f19b76", "tag": "9e4c1b6c-d4f2-461f-a774-1d2f820b5352"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:03:27.931071 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=6 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:03:27.937394 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-97937c41-16da-4e69-83be-b01760845973 req-869993a2-e036-42f5-a483-96231f36ade4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:03:27.937851 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-97937c41-16da-4e69-83be-b01760845973 req-869993a2-e036-42f5-a483-96231f36ade4 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:03:27.950970 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-97937c41-16da-4e69-83be-b01760845973 req-869993a2-e036-42f5-a483-96231f36ade4 service nova] Creating event network-changed:9e4c1b6c-d4f2-461f-a774-1d2f820b5352 for instance f19ad795-cec0-407b-b2d5-1eb5b0f19b76 on n-h2-848886-15 Jul 25 14:03:27.956266 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-97937c41-16da-4e69-83be-b01760845973 req-869993a2-e036-42f5-a483-96231f36ade4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034339 Jul 25 14:03:27.956887 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3671/7267] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 14:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:05:25.581063 n-d-848886-15 devstack@n-api.service[125883]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34360325-f0fe-440a-9621-399cd8a3ecbe] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 14:05:25.582444 n-d-848886-15 devstack@n-api.service[125883]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6a05e146-f3af-4d5e-94b9-7bc7c984fd44] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 14:05:25.583115 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:05:25.583988 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=34 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:05:25.589177 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-0e23a971-a1a7-45dd-9fe4-87c10f2c0935 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1807806336"}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:05:25.592786 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-0e23a971-a1a7-45dd-9fe4-87c10f2c0935 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: f19ad795-cec0-407b-b2d5-1eb5b0f19b76] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:05:25.601861 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e23a971-a1a7-45dd-9fe4-87c10f2c0935 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:25.602360 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e23a971-a1a7-45dd-9fe4-87c10f2c0935 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:25.603146 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e23a971-a1a7-45dd-9fe4-87c10f2c0935 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:25.603615 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-0e23a971-a1a7-45dd-9fe4-87c10f2c0935 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:25.818729 n-d-848886-15 devstack@n-api.service[125883]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0e23a971-a1a7-45dd-9fe4-87c10f2c0935 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [d19a7b74-6754-4bae-8d58-328d95b0fd17] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 14:05:26.591513 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] [34360325-f0fe-440a-9621-399cd8a3ecbe] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 49722. Jul 25 14:05:26.592280 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] [6a05e146-f3af-4d5e-94b9-7bc7c984fd44] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 49724. Jul 25 14:05:26.826450 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [None req-0e23a971-a1a7-45dd-9fe4-87c10f2c0935 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [d19a7b74-6754-4bae-8d58-328d95b0fd17] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 49726. Jul 25 14:05:26.833799 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-0e23a971-a1a7-45dd-9fe4-87c10f2c0935 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "POST /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76/action" status: 202 len: 0 microversion: 2.1 time: 1.255824 Jul 25 14:05:26.834489 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3597/7268] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 14:05:25 2022] POST /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76/action => generated 0 bytes in 1258 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 14:05:33.744878 n-d-848886-15 devstack@n-api.service[125884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b863d7c2-21ea-4c3e-8cfe-a7e1397e12fa] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 14:05:33.746047 n-d-848886-15 devstack@n-api.service[125884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7bc01c6a-70b5-4524-8a8d-4de2decdc49e] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 14:05:33.746822 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:05:33.747928 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=28 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:05:33.754355 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-0cba82e7-ce36-45fd-93cb-7ab3b95af07b req-ef078bf5-9054-4ebe-9b16-16c7154132d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f19ad795-cec0-407b-b2d5-1eb5b0f19b76", "name": "network-vif-plugged", "status": "completed", "tag": "9e4c1b6c-d4f2-461f-a774-1d2f820b5352"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:05:33.767910 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-0cba82e7-ce36-45fd-93cb-7ab3b95af07b req-ef078bf5-9054-4ebe-9b16-16c7154132d6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:33.768645 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-0cba82e7-ce36-45fd-93cb-7ab3b95af07b req-ef078bf5-9054-4ebe-9b16-16c7154132d6 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:33.812913 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-0cba82e7-ce36-45fd-93cb-7ab3b95af07b req-ef078bf5-9054-4ebe-9b16-16c7154132d6 service nova] Creating event network-vif-plugged:9e4c1b6c-d4f2-461f-a774-1d2f820b5352 for instance f19ad795-cec0-407b-b2d5-1eb5b0f19b76 on n-h2-848886-15 Jul 25 14:05:33.823167 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-0cba82e7-ce36-45fd-93cb-7ab3b95af07b req-ef078bf5-9054-4ebe-9b16-16c7154132d6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077593 Jul 25 14:05:33.824388 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3672/7269] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 14:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:05:40.428236 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:05:40.429361 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:05:40.434795 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-24b491d5-5018-4bc5-8acc-dbeb7c976f22 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1051738930", "imageRef": "6b338675-42ac-4755-ba34-25acb44784ef", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1866138768", "security_groups": [{"name": "tempest-secgroup-smoke-949077633"}], "networks": [{"uuid": "8c06947a-f996-4635-bcd4-34eb8b240530"}]}} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:05:40.542429 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.network.neutron [None req-24b491d5-5018-4bc5-8acc-dbeb7c976f22 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] validate_networks() for [('8c06947a-f996-4635-bcd4-34eb8b240530', None, None, None, None, None)] {{(pid=125883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:05:40.935366 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-24b491d5-5018-4bc5-8acc-dbeb7c976f22 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Flavor limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:05:40.935799 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-24b491d5-5018-4bc5-8acc-dbeb7c976f22 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Image limits 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:05:40.936651 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-24b491d5-5018-4bc5-8acc-dbeb7c976f22 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Flavor pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:05:40.937077 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-24b491d5-5018-4bc5-8acc-dbeb7c976f22 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Image pref 0:0:0 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:05:40.937498 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.virt.hardware [None req-24b491d5-5018-4bc5-8acc-dbeb7c976f22 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:05:40.947512 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-24b491d5-5018-4bc5-8acc-dbeb7c976f22 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:40.947971 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-24b491d5-5018-4bc5-8acc-dbeb7c976f22 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:40.948774 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-24b491d5-5018-4bc5-8acc-dbeb7c976f22 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:40.949252 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-24b491d5-5018-4bc5-8acc-dbeb7c976f22 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:40.970878 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-24b491d5-5018-4bc5-8acc-dbeb7c976f22 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Getting quotas for project a79a678ff2ed4b70ad3a0e340d5dcc8e. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:05:40.977081 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.quota [None req-24b491d5-5018-4bc5-8acc-dbeb7c976f22 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Getting quotas for user 1379fa6698114fbea5dec6ca63d2cf0d and project a79a678ff2ed4b70ad3a0e340d5dcc8e. Resources: {'instances', 'cores', 'ram'} {{(pid=125883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:05:40.990456 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-24b491d5-5018-4bc5-8acc-dbeb7c976f22 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Going to run 1 instances... {{(pid=125883) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:05:40.992974 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-24b491d5-5018-4bc5-8acc-dbeb7c976f22 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b338675-42ac-4755-ba34-25acb44784ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:05:41.037463 n-d-848886-15 devstack@n-api.service[125883]: ERROR oslo.messaging._drivers.impl_rabbit [None req-24b491d5-5018-4bc5-8acc-dbeb7c976f22 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [14f670bf-b659-4055-abb8-1a1ce6e0e2be] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 14:05:42.046809 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [None req-24b491d5-5018-4bc5-8acc-dbeb7c976f22 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [14f670bf-b659-4055-abb8-1a1ce6e0e2be] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 49858. Jul 25 14:05:42.051660 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-24b491d5-5018-4bc5-8acc-dbeb7c976f22 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.625236 Jul 25 14:05:42.052743 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3598/7270] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Jul 25 14:05:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 1627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:05:42.072884 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-15854776-ab17-4f94-a26b-28efe092963e tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:05:42.073575 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-15854776-ab17-4f94-a26b-28efe092963e tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:05:42.085699 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] [b863d7c2-21ea-4c3e-8cfe-a7e1397e12fa] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 49862. Jul 25 14:05:42.088538 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] [7bc01c6a-70b5-4524-8a8d-4de2decdc49e] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 49864. Jul 25 14:05:42.137268 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-15854776-ab17-4f94-a26b-28efe092963e tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:05:42.145645 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-15854776-ab17-4f94-a26b-28efe092963e tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1" status: 200 len: 1249 microversion: 2.1 time: 0.081155 Jul 25 14:05:42.146518 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3673/7271] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:05:42 2022] GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:05:43.167948 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f5ef0009-e49b-4242-ae49-47a0e902379f tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:05:43.168568 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f5ef0009-e49b-4242-ae49-47a0e902379f tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:05:43.176454 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5ef0009-e49b-4242-ae49-47a0e902379f tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:43.176917 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5ef0009-e49b-4242-ae49-47a0e902379f tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:43.177700 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5ef0009-e49b-4242-ae49-47a0e902379f tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:43.178191 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f5ef0009-e49b-4242-ae49-47a0e902379f tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:43.253028 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f5ef0009-e49b-4242-ae49-47a0e902379f tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:05:43.261223 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f5ef0009-e49b-4242-ae49-47a0e902379f tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1" status: 200 len: 1319 microversion: 2.1 time: 0.098072 Jul 25 14:05:43.262013 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3599/7272] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:05:43 2022] GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 => generated 1319 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:05:43.819828 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-561dfbaf-9b27-46eb-9ec8-5338a81dbed6 req-7ad40df7-478f-49ec-93e6-7d93bdf15371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f19ad795-cec0-407b-b2d5-1eb5b0f19b76", "name": "network-vif-unplugged", "status": "completed", "tag": "9e4c1b6c-d4f2-461f-a774-1d2f820b5352"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:05:43.825670 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:05:43.843609 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-561dfbaf-9b27-46eb-9ec8-5338a81dbed6 req-7ad40df7-478f-49ec-93e6-7d93bdf15371 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:43.848582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-561dfbaf-9b27-46eb-9ec8-5338a81dbed6 req-7ad40df7-478f-49ec-93e6-7d93bdf15371 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:43.875547 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-561dfbaf-9b27-46eb-9ec8-5338a81dbed6 req-7ad40df7-478f-49ec-93e6-7d93bdf15371 service nova] Creating event network-vif-unplugged:9e4c1b6c-d4f2-461f-a774-1d2f820b5352 for instance f19ad795-cec0-407b-b2d5-1eb5b0f19b76 on n-h2-848886-15 Jul 25 14:05:43.884673 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-561dfbaf-9b27-46eb-9ec8-5338a81dbed6 req-7ad40df7-478f-49ec-93e6-7d93bdf15371 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070684 Jul 25 14:05:43.886097 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3674/7273] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 14:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:05:44.283183 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-9e7d057b-6924-4480-8443-ec5be6a8b517 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:05:44.283809 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-9e7d057b-6924-4480-8443-ec5be6a8b517 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:05:44.291384 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e7d057b-6924-4480-8443-ec5be6a8b517 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:44.291855 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e7d057b-6924-4480-8443-ec5be6a8b517 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:44.292645 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e7d057b-6924-4480-8443-ec5be6a8b517 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:44.293089 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-9e7d057b-6924-4480-8443-ec5be6a8b517 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:44.450888 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-9e7d057b-6924-4480-8443-ec5be6a8b517 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:05:44.458686 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-9e7d057b-6924-4480-8443-ec5be6a8b517 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1" status: 200 len: 1374 microversion: 2.1 time: 0.179364 Jul 25 14:05:44.469769 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3600/7274] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:05:44 2022] GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 => generated 1374 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:05:45.480674 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-0062dd85-270d-4628-9a29-32783ef2867b tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:05:45.481258 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-0062dd85-270d-4628-9a29-32783ef2867b tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:05:45.489135 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0062dd85-270d-4628-9a29-32783ef2867b tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:45.489603 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0062dd85-270d-4628-9a29-32783ef2867b tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:45.490417 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0062dd85-270d-4628-9a29-32783ef2867b tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:45.490854 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-0062dd85-270d-4628-9a29-32783ef2867b tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:45.640670 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-0062dd85-270d-4628-9a29-32783ef2867b tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:05:45.650218 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-0062dd85-270d-4628-9a29-32783ef2867b tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1" status: 200 len: 1374 microversion: 2.1 time: 0.173824 Jul 25 14:05:45.650816 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3675/7275] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:05:45 2022] GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:05:46.671346 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-4073cae2-2f39-43a5-9253-460d509ee0b8 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:05:46.671963 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-4073cae2-2f39-43a5-9253-460d509ee0b8 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:05:46.680118 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4073cae2-2f39-43a5-9253-460d509ee0b8 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:46.681046 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4073cae2-2f39-43a5-9253-460d509ee0b8 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:46.681913 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4073cae2-2f39-43a5-9253-460d509ee0b8 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:46.682374 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-4073cae2-2f39-43a5-9253-460d509ee0b8 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:46.830774 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-4073cae2-2f39-43a5-9253-460d509ee0b8 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:05:46.838787 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-4073cae2-2f39-43a5-9253-460d509ee0b8 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1" status: 200 len: 1374 microversion: 2.1 time: 0.171346 Jul 25 14:05:46.845528 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3601/7276] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:05:46 2022] GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:05:47.861559 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-5b238e98-5740-4f19-8d0b-b46ecbda8e4a tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:05:47.862335 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-5b238e98-5740-4f19-8d0b-b46ecbda8e4a tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:05:47.870204 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b238e98-5740-4f19-8d0b-b46ecbda8e4a tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:47.870776 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b238e98-5740-4f19-8d0b-b46ecbda8e4a tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:47.871621 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b238e98-5740-4f19-8d0b-b46ecbda8e4a tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:47.872123 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-5b238e98-5740-4f19-8d0b-b46ecbda8e4a tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:48.013103 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-5b238e98-5740-4f19-8d0b-b46ecbda8e4a tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:05:48.021879 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-5b238e98-5740-4f19-8d0b-b46ecbda8e4a tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1" status: 200 len: 1374 microversion: 2.1 time: 0.164209 Jul 25 14:05:48.022461 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3676/7277] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:05:47 2022] GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:05:49.051069 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f1eccf53-25da-466d-bbfe-14faef1f4671 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:05:49.051797 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f1eccf53-25da-466d-bbfe-14faef1f4671 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:05:49.070511 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f1eccf53-25da-466d-bbfe-14faef1f4671 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:49.072590 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f1eccf53-25da-466d-bbfe-14faef1f4671 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:49.073688 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f1eccf53-25da-466d-bbfe-14faef1f4671 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:49.074412 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f1eccf53-25da-466d-bbfe-14faef1f4671 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:49.234396 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-f1eccf53-25da-466d-bbfe-14faef1f4671 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:05:49.242209 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f1eccf53-25da-466d-bbfe-14faef1f4671 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1" status: 200 len: 1374 microversion: 2.1 time: 0.196657 Jul 25 14:05:49.243000 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3602/7278] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:05:49 2022] GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 => generated 1374 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:05:50.263948 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-3a8197e1-823c-4f1e-b8c6-b3fc558fc294 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:05:50.264634 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-3a8197e1-823c-4f1e-b8c6-b3fc558fc294 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:05:50.275678 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a8197e1-823c-4f1e-b8c6-b3fc558fc294 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:50.280743 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a8197e1-823c-4f1e-b8c6-b3fc558fc294 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:50.282582 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a8197e1-823c-4f1e-b8c6-b3fc558fc294 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:50.283150 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-3a8197e1-823c-4f1e-b8c6-b3fc558fc294 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:50.441448 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-3a8197e1-823c-4f1e-b8c6-b3fc558fc294 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:05:50.449969 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-3a8197e1-823c-4f1e-b8c6-b3fc558fc294 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1" status: 200 len: 1374 microversion: 2.1 time: 0.190133 Jul 25 14:05:50.450848 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3677/7279] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:05:50 2022] GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 => generated 1374 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:05:51.472981 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-1a8e03d0-f49c-4959-a6ee-41b84fea1f11 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:05:51.473625 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-1a8e03d0-f49c-4959-a6ee-41b84fea1f11 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:05:51.476268 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=2 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:05:51.476932 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell0:SELECT=6 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:05:51.483324 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a8e03d0-f49c-4959-a6ee-41b84fea1f11 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:51.483787 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a8e03d0-f49c-4959-a6ee-41b84fea1f11 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:51.484572 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a8e03d0-f49c-4959-a6ee-41b84fea1f11 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:51.485030 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-1a8e03d0-f49c-4959-a6ee-41b84fea1f11 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:51.679904 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-1a8e03d0-f49c-4959-a6ee-41b84fea1f11 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:05:51.688366 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-1a8e03d0-f49c-4959-a6ee-41b84fea1f11 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1" status: 200 len: 1374 microversion: 2.1 time: 0.219177 Jul 25 14:05:51.688959 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3603/7280] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:05:51 2022] GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 => generated 1374 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:05:51.999161 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-fd510bf9-3aa7-4ba0-bb50-4b076cc36a6d req-e7bab1a2-429e-4033-ab1f-70a79004d78b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1", "tag": "17643518-fc49-4bf7-b496-b88b8d52386d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:05:52.011648 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fd510bf9-3aa7-4ba0-bb50-4b076cc36a6d req-e7bab1a2-429e-4033-ab1f-70a79004d78b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:52.012176 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-fd510bf9-3aa7-4ba0-bb50-4b076cc36a6d req-e7bab1a2-429e-4033-ab1f-70a79004d78b service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:52.025744 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-fd510bf9-3aa7-4ba0-bb50-4b076cc36a6d req-e7bab1a2-429e-4033-ab1f-70a79004d78b service nova] Creating event network-changed:17643518-fc49-4bf7-b496-b88b8d52386d for instance e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 on n-h1-848886-15 Jul 25 14:05:52.040765 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-fd510bf9-3aa7-4ba0-bb50-4b076cc36a6d req-e7bab1a2-429e-4033-ab1f-70a79004d78b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045041 Jul 25 14:05:52.041910 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3678/7281] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 14:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:05:52.709500 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-cdb7bab4-081e-4808-9e69-7fd16efacc82 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:05:52.710144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-cdb7bab4-081e-4808-9e69-7fd16efacc82 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:05:52.717566 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cdb7bab4-081e-4808-9e69-7fd16efacc82 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:52.718067 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cdb7bab4-081e-4808-9e69-7fd16efacc82 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:52.718872 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cdb7bab4-081e-4808-9e69-7fd16efacc82 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:52.719327 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-cdb7bab4-081e-4808-9e69-7fd16efacc82 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:52.865646 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-cdb7bab4-081e-4808-9e69-7fd16efacc82 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:05:52.873569 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-cdb7bab4-081e-4808-9e69-7fd16efacc82 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1" status: 200 len: 1374 microversion: 2.1 time: 0.168002 Jul 25 14:05:52.874229 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3604/7282] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:05:52 2022] GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:05:53.892543 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell0:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:05:53.898304 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-d1d4f8a4-1ac9-4edd-97a8-58e34dec7a82 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:05:53.899002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-d1d4f8a4-1ac9-4edd-97a8-58e34dec7a82 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:05:53.905595 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1d4f8a4-1ac9-4edd-97a8-58e34dec7a82 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:53.906082 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1d4f8a4-1ac9-4edd-97a8-58e34dec7a82 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:53.906852 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1d4f8a4-1ac9-4edd-97a8-58e34dec7a82 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:53.907287 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-d1d4f8a4-1ac9-4edd-97a8-58e34dec7a82 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:54.049759 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-d1d4f8a4-1ac9-4edd-97a8-58e34dec7a82 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:05:54.057461 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-d1d4f8a4-1ac9-4edd-97a8-58e34dec7a82 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1" status: 200 len: 1374 microversion: 2.1 time: 0.166063 Jul 25 14:05:54.058070 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3679/7283] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:05:53 2022] GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:05:55.079281 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-02e6f5c4-b617-430f-a167-91429d6fb550 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:05:55.079896 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-02e6f5c4-b617-430f-a167-91429d6fb550 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:05:55.087308 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02e6f5c4-b617-430f-a167-91429d6fb550 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:55.087780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02e6f5c4-b617-430f-a167-91429d6fb550 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:55.088564 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02e6f5c4-b617-430f-a167-91429d6fb550 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:55.089041 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-02e6f5c4-b617-430f-a167-91429d6fb550 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:55.220906 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-02e6f5c4-b617-430f-a167-91429d6fb550 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:05:55.229328 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-02e6f5c4-b617-430f-a167-91429d6fb550 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1" status: 200 len: 1374 microversion: 2.1 time: 0.153927 Jul 25 14:05:55.229950 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3605/7284] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:05:55 2022] GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:05:56.254290 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f52c0333-148f-49e1-a573-7470370cf0f6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:05:56.254927 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f52c0333-148f-49e1-a573-7470370cf0f6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:05:56.262438 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f52c0333-148f-49e1-a573-7470370cf0f6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:56.262893 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f52c0333-148f-49e1-a573-7470370cf0f6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:56.263659 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f52c0333-148f-49e1-a573-7470370cf0f6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:56.264101 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f52c0333-148f-49e1-a573-7470370cf0f6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:56.748430 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-f52c0333-148f-49e1-a573-7470370cf0f6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:05:56.760238 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f52c0333-148f-49e1-a573-7470370cf0f6 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1" status: 200 len: 1374 microversion: 2.1 time: 0.512243 Jul 25 14:05:56.761161 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3680/7285] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:05:56 2022] GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 => generated 1374 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:05:57.665487 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-bff5de82-1326-4915-917d-802266b479f5 req-3724c326-d3aa-495a-b344-10757ba5173c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "17643518-fc49-4bf7-b496-b88b8d52386d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:05:57.677719 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-bff5de82-1326-4915-917d-802266b479f5 req-3724c326-d3aa-495a-b344-10757ba5173c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:57.678276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-bff5de82-1326-4915-917d-802266b479f5 req-3724c326-d3aa-495a-b344-10757ba5173c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:57.697947 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-bff5de82-1326-4915-917d-802266b479f5 req-3724c326-d3aa-495a-b344-10757ba5173c service nova] Creating event network-vif-plugged:17643518-fc49-4bf7-b496-b88b8d52386d for instance e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 on n-h1-848886-15 Jul 25 14:05:57.703200 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-bff5de82-1326-4915-917d-802266b479f5 req-3724c326-d3aa-495a-b344-10757ba5173c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043918 Jul 25 14:05:57.704007 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3606/7286] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 14:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:05:57.785057 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-a33c14f3-deec-4e0b-9392-4918d5900da0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:05:57.785698 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-a33c14f3-deec-4e0b-9392-4918d5900da0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:05:57.793232 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a33c14f3-deec-4e0b-9392-4918d5900da0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:57.794354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a33c14f3-deec-4e0b-9392-4918d5900da0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:57.795274 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a33c14f3-deec-4e0b-9392-4918d5900da0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:57.795955 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-a33c14f3-deec-4e0b-9392-4918d5900da0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:57.951262 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-a33c14f3-deec-4e0b-9392-4918d5900da0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:05:57.961628 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-a33c14f3-deec-4e0b-9392-4918d5900da0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1" status: 200 len: 1374 microversion: 2.1 time: 0.180761 Jul 25 14:05:57.962306 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3681/7287] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:05:57 2022] GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:05:58.985637 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-754b2854-e87b-414a-bd79-ef4520ea497f tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:05:58.986362 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-754b2854-e87b-414a-bd79-ef4520ea497f tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:05:58.993043 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-754b2854-e87b-414a-bd79-ef4520ea497f tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:58.993510 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-754b2854-e87b-414a-bd79-ef4520ea497f tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:58.994366 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-754b2854-e87b-414a-bd79-ef4520ea497f tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:58.994868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-754b2854-e87b-414a-bd79-ef4520ea497f tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:59.131857 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-754b2854-e87b-414a-bd79-ef4520ea497f tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:05:59.139713 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-754b2854-e87b-414a-bd79-ef4520ea497f tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1" status: 200 len: 1559 microversion: 2.1 time: 0.159200 Jul 25 14:05:59.140362 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3607/7288] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:05:58 2022] GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:05:59.160311 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-b9b55f1d-d9c7-43fa-8f32-ef4454ef3e23 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:05:59.160891 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-b9b55f1d-d9c7-43fa-8f32-ef4454ef3e23 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:05:59.168128 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b9b55f1d-d9c7-43fa-8f32-ef4454ef3e23 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:59.168589 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b9b55f1d-d9c7-43fa-8f32-ef4454ef3e23 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:59.169342 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b9b55f1d-d9c7-43fa-8f32-ef4454ef3e23 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:05:59.169785 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-b9b55f1d-d9c7-43fa-8f32-ef4454ef3e23 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:05:59.309663 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-b9b55f1d-d9c7-43fa-8f32-ef4454ef3e23 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:05:59.318123 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-b9b55f1d-d9c7-43fa-8f32-ef4454ef3e23 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1" status: 200 len: 1559 microversion: 2.1 time: 0.161706 Jul 25 14:05:59.318706 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3682/7289] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:05:59 2022] GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:06:00.931548 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-9b4f7b30-d70b-4226-b497-5e9a5810b17d req-01044cca-c53c-4007-894a-ab5831180229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1", "tag": "17643518-fc49-4bf7-b496-b88b8d52386d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:06:00.942375 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-9b4f7b30-d70b-4226-b497-5e9a5810b17d req-01044cca-c53c-4007-894a-ab5831180229 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:06:00.942827 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-9b4f7b30-d70b-4226-b497-5e9a5810b17d req-01044cca-c53c-4007-894a-ab5831180229 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:06:00.954260 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-9b4f7b30-d70b-4226-b497-5e9a5810b17d req-01044cca-c53c-4007-894a-ab5831180229 service nova] Creating event network-changed:17643518-fc49-4bf7-b496-b88b8d52386d for instance e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 on n-h1-848886-15 Jul 25 14:06:00.959264 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-9b4f7b30-d70b-4226-b497-5e9a5810b17d req-01044cca-c53c-4007-894a-ab5831180229 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031439 Jul 25 14:06:00.960043 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3608/7290] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 14:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:06:24.031127 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 14:06:24.031876 n-d-848886-15 devstack@n-api.service[125884]: Mon Jul 25 14:06:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 14:07:28.181983 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=24 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:07:28.182744 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=46 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:07:28.187033 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-8ed0f6f1-c3a7-43ea-b054-de30aac809cb tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1777260530"}} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:07:28.189332 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-8ed0f6f1-c3a7-43ea-b054-de30aac809cb tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:07:28.196313 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ed0f6f1-c3a7-43ea-b054-de30aac809cb tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:28.196755 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ed0f6f1-c3a7-43ea-b054-de30aac809cb tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:28.197521 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ed0f6f1-c3a7-43ea-b054-de30aac809cb tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:28.198002 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-8ed0f6f1-c3a7-43ea-b054-de30aac809cb tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:28.403001 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-8ed0f6f1-c3a7-43ea-b054-de30aac809cb tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "POST /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1/action" status: 202 len: 0 microversion: 2.1 time: 0.222771 Jul 25 14:07:28.403653 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3683/7291] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Jul 25 14:07:28 2022] POST /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 14:07:34.169408 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:07:34.171098 n-d-848886-15 devstack@n-api.service[125883]: DEBUG dbcounter [-] [125883] Writing DB stats nova_cell1:SELECT=54 {{(pid=125883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:07:34.178657 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-253f507a-08ad-4b2a-aa60-3966a2e8d1a1 req-b563302c-90e2-45c8-b0ce-4aad72fba716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "17643518-fc49-4bf7-b496-b88b8d52386d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:07:34.196756 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-253f507a-08ad-4b2a-aa60-3966a2e8d1a1 req-b563302c-90e2-45c8-b0ce-4aad72fba716 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:34.197554 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-253f507a-08ad-4b2a-aa60-3966a2e8d1a1 req-b563302c-90e2-45c8-b0ce-4aad72fba716 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:34.212293 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-253f507a-08ad-4b2a-aa60-3966a2e8d1a1 req-b563302c-90e2-45c8-b0ce-4aad72fba716 service nova] Creating event network-vif-plugged:17643518-fc49-4bf7-b496-b88b8d52386d for instance e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 on n-h1-848886-15 Jul 25 14:07:34.218768 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-253f507a-08ad-4b2a-aa60-3966a2e8d1a1 req-b563302c-90e2-45c8-b0ce-4aad72fba716 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051933 Jul 25 14:07:34.219851 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3609/7292] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 14:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:07:43.506291 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_api:SELECT=2 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:07:43.507688 n-d-848886-15 devstack@n-api.service[125884]: DEBUG dbcounter [-] [125884] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:07:43.511542 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [req-349701ef-2cbd-41af-8e5d-17cc5413fb32 req-7c14ea96-df4c-4b4f-b5e4-7b705c9f3c1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1", "tag": "17643518-fc49-4bf7-b496-b88b8d52386d"}]} {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:07:43.513199 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-f1fd6861-95a4-4c8b-9c8b-727fe7e5162d tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:07:43.514025 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f1fd6861-95a4-4c8b-9c8b-727fe7e5162d tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:07:43.521693 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-349701ef-2cbd-41af-8e5d-17cc5413fb32 req-7c14ea96-df4c-4b4f-b5e4-7b705c9f3c1c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:43.522188 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [req-349701ef-2cbd-41af-8e5d-17cc5413fb32 req-7c14ea96-df4c-4b4f-b5e4-7b705c9f3c1c service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:43.522444 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f1fd6861-95a4-4c8b-9c8b-727fe7e5162d tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:43.522945 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f1fd6861-95a4-4c8b-9c8b-727fe7e5162d tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:43.523973 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f1fd6861-95a4-4c8b-9c8b-727fe7e5162d tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:43.524627 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-f1fd6861-95a4-4c8b-9c8b-727fe7e5162d tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:43.534046 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.compute.server_external_events [req-349701ef-2cbd-41af-8e5d-17cc5413fb32 req-7c14ea96-df4c-4b4f-b5e4-7b705c9f3c1c service nova] Creating event network-changed:17643518-fc49-4bf7-b496-b88b8d52386d for instance e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 on n-h1-848886-15 Jul 25 14:07:43.540059 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [req-349701ef-2cbd-41af-8e5d-17cc5413fb32 req-7c14ea96-df4c-4b4f-b5e4-7b705c9f3c1c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033949 Jul 25 14:07:43.540734 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3610/7293] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 14:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:07:43.556513 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-f1fd6861-95a4-4c8b-9c8b-727fe7e5162d tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] Going to try to terminate instance {{(pid=125884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:07:43.644037 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-f1fd6861-95a4-4c8b-9c8b-727fe7e5162d tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1" status: 204 len: 0 microversion: 2.1 time: 0.140583 Jul 25 14:07:43.648279 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3684/7294] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 14:07:43 2022] DELETE /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:07:43.655679 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-98a0abab-9b54-47bc-84c3-baa05730b5e0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:07:43.656651 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-98a0abab-9b54-47bc-84c3-baa05730b5e0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:07:43.663553 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98a0abab-9b54-47bc-84c3-baa05730b5e0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:43.664013 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98a0abab-9b54-47bc-84c3-baa05730b5e0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:43.665103 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98a0abab-9b54-47bc-84c3-baa05730b5e0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:43.665549 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-98a0abab-9b54-47bc-84c3-baa05730b5e0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:43.824179 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-98a0abab-9b54-47bc-84c3-baa05730b5e0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:07:43.831953 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-98a0abab-9b54-47bc-84c3-baa05730b5e0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1" status: 200 len: 1684 microversion: 2.1 time: 0.181866 Jul 25 14:07:43.832532 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3611/7295] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:07:43 2022] GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 => generated 1684 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:07:44.097751 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-f4b7422b-0553-497e-9bd3-a954e58c61be req-042b8f2e-a117-4a90-afcc-11c3a28274c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1", "name": "network-vif-unplugged", "status": "completed", "tag": "17643518-fc49-4bf7-b496-b88b8d52386d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:07:44.108046 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f4b7422b-0553-497e-9bd3-a954e58c61be req-042b8f2e-a117-4a90-afcc-11c3a28274c7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:44.108552 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-f4b7422b-0553-497e-9bd3-a954e58c61be req-042b8f2e-a117-4a90-afcc-11c3a28274c7 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:44.120652 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-f4b7422b-0553-497e-9bd3-a954e58c61be req-042b8f2e-a117-4a90-afcc-11c3a28274c7 service nova] Creating event network-vif-unplugged:17643518-fc49-4bf7-b496-b88b8d52386d for instance e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 on n-h1-848886-15 Jul 25 14:07:44.126508 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-f4b7422b-0553-497e-9bd3-a954e58c61be req-042b8f2e-a117-4a90-afcc-11c3a28274c7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032538 Jul 25 14:07:44.127536 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3685/7296] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 14:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:07:44.852986 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-b16b334c-acec-4486-8a74-b2c428b41b78 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:07:44.853609 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-b16b334c-acec-4486-8a74-b2c428b41b78 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:07:44.860767 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b16b334c-acec-4486-8a74-b2c428b41b78 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:44.861232 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b16b334c-acec-4486-8a74-b2c428b41b78 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:44.862313 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b16b334c-acec-4486-8a74-b2c428b41b78 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:44.862761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-b16b334c-acec-4486-8a74-b2c428b41b78 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:45.080334 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-b16b334c-acec-4486-8a74-b2c428b41b78 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:07:45.088552 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-b16b334c-acec-4486-8a74-b2c428b41b78 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1" status: 200 len: 1684 microversion: 2.1 time: 0.239704 Jul 25 14:07:45.089180 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3612/7297] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:07:44 2022] GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 => generated 1684 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:07:45.794535 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-7ad19ca4-e70a-42c7-9028-84ac23e92f33 req-53d8e9f4-b90f-4ed7-9716-7b145baf8ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1", "name": "network-vif-deleted", "tag": "17643518-fc49-4bf7-b496-b88b8d52386d"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:07:45.805742 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-7ad19ca4-e70a-42c7-9028-84ac23e92f33 req-53d8e9f4-b90f-4ed7-9716-7b145baf8ee5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:45.806377 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-7ad19ca4-e70a-42c7-9028-84ac23e92f33 req-53d8e9f4-b90f-4ed7-9716-7b145baf8ee5 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:45.818671 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-7ad19ca4-e70a-42c7-9028-84ac23e92f33 req-53d8e9f4-b90f-4ed7-9716-7b145baf8ee5 service nova] Creating event network-vif-deleted:17643518-fc49-4bf7-b496-b88b8d52386d for instance e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 on n-h1-848886-15 Jul 25 14:07:45.823533 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-7ad19ca4-e70a-42c7-9028-84ac23e92f33 req-53d8e9f4-b90f-4ed7-9716-7b145baf8ee5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106992 Jul 25 14:07:45.824538 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3686/7298] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 14:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:07:46.113154 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-692cc0dd-b76c-4adb-8dd9-2caa589ad90b tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:07:46.113766 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-692cc0dd-b76c-4adb-8dd9-2caa589ad90b tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:07:46.122716 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-692cc0dd-b76c-4adb-8dd9-2caa589ad90b tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:46.123495 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-692cc0dd-b76c-4adb-8dd9-2caa589ad90b tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:46.123936 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-692cc0dd-b76c-4adb-8dd9-2caa589ad90b tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:46.124778 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-692cc0dd-b76c-4adb-8dd9-2caa589ad90b tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:46.167836 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-692cc0dd-b76c-4adb-8dd9-2caa589ad90b tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:46.168389 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-692cc0dd-b76c-4adb-8dd9-2caa589ad90b tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:46.168869 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-692cc0dd-b76c-4adb-8dd9-2caa589ad90b tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lazy-loading 'fault' on Instance uuid e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:07:46.214411 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-692cc0dd-b76c-4adb-8dd9-2caa589ad90b tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:07:46.222700 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-692cc0dd-b76c-4adb-8dd9-2caa589ad90b tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1" status: 200 len: 1339 microversion: 2.1 time: 0.113645 Jul 25 14:07:46.223550 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3613/7299] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:07:46 2022] GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 => generated 1339 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:07:47.247481 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dc1f69db-0a8e-4b1a-a7b3-eb9f612df993 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:07:47.248178 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-dc1f69db-0a8e-4b1a-a7b3-eb9f612df993 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:07:47.255185 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc1f69db-0a8e-4b1a-a7b3-eb9f612df993 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:47.255602 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc1f69db-0a8e-4b1a-a7b3-eb9f612df993 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:47.256361 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc1f69db-0a8e-4b1a-a7b3-eb9f612df993 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:47.256791 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-dc1f69db-0a8e-4b1a-a7b3-eb9f612df993 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:47.270624 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-dc1f69db-0a8e-4b1a-a7b3-eb9f612df993 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] HTTP exception thrown: Instance e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 could not be found. Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dc1f69db-0a8e-4b1a-a7b3-eb9f612df993 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Request method failure captured: Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 HTTP/1.1 Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3qKbLZKyzCgvkLFlsvZyZdSrKyowmThQdqFe7tMpDAM_073hbEtBkz5iBwVTijWMTIdPmJJhQ03J_Tmx9xTsrQlOa3vN1uTqAgH3YvGHMoQYfOSwSHDpUgHsYLfXZem9GH1TpR09Wo5Z6i8Hfown6m0fjYDgrUUjLCwKWSvCHts-JLg Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: a79a678ff2ed4b70ad3a0e340d5dcc8e Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestSnapshotPattern-61044114 Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a79a678ff2ed4b70ad3a0e340d5dcc8e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a79a678ff2ed4b70ad3a0e340d5dcc8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a79a678ff2ed4b70ad3a0e340d5dcc8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a79a678ff2ed4b70ad3a0e340d5dcc8e"}]}] Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestSnapshotPattern-61044114 Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: a79a678ff2ed4b70ad3a0e340d5dcc8e Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestSnapshotPattern-61044114 Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestSnapshotPattern-61044114-project Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 1379fa6698114fbea5dec6ca63d2cf0d Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestSnapshotPattern-61044114-project Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 could not be found. Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1'} Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 could not be found. Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 could not be found. Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:07:47.272256 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 14:07:47.276701 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:07:47.276701 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:07:47.276701 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:07:47.276701 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:07:47.276701 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:07:47.276701 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 could not be found. Jul 25 14:07:47.276701 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 14:07:47.276701 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-dc1f69db-0a8e-4b1a-a7b3-eb9f612df993 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Returning 404 to user: Instance e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:07:47.276701 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-dc1f69db-0a8e-4b1a-a7b3-eb9f612df993 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1" status: 404 len: 111 microversion: 2.1 time: 0.032136 Jul 25 14:07:47.276701 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3687/7300] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:07:47 2022] GET /compute/v2.1/servers/e5f6e2e3-fa0d-47ae-b86c-e62866e7b6c1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:07:48.757582 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-f9aa65bf-7f08-4d2c-8ad7-9d06539b4d52 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:07:48.758667 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f9aa65bf-7f08-4d2c-8ad7-9d06539b4d52 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: f19ad795-cec0-407b-b2d5-1eb5b0f19b76] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:07:48.771215 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9aa65bf-7f08-4d2c-8ad7-9d06539b4d52 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:48.772061 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9aa65bf-7f08-4d2c-8ad7-9d06539b4d52 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:48.773494 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9aa65bf-7f08-4d2c-8ad7-9d06539b4d52 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:48.774363 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-f9aa65bf-7f08-4d2c-8ad7-9d06539b4d52 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:48.812437 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-820e18fb-d301-4e96-bca0-c5ee34491620 req-0756faeb-202d-47e4-8b18-2011f37bce09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f19ad795-cec0-407b-b2d5-1eb5b0f19b76", "tag": "9e4c1b6c-d4f2-461f-a774-1d2f820b5352"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:07:48.823308 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-f9aa65bf-7f08-4d2c-8ad7-9d06539b4d52 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: f19ad795-cec0-407b-b2d5-1eb5b0f19b76] Going to try to terminate instance {{(pid=125883) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:07:48.824369 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-820e18fb-d301-4e96-bca0-c5ee34491620 req-0756faeb-202d-47e4-8b18-2011f37bce09 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:48.824811 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-820e18fb-d301-4e96-bca0-c5ee34491620 req-0756faeb-202d-47e4-8b18-2011f37bce09 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:48.838208 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-820e18fb-d301-4e96-bca0-c5ee34491620 req-0756faeb-202d-47e4-8b18-2011f37bce09 service nova] Creating event network-changed:9e4c1b6c-d4f2-461f-a774-1d2f820b5352 for instance f19ad795-cec0-407b-b2d5-1eb5b0f19b76 on n-h2-848886-15 Jul 25 14:07:48.844732 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-820e18fb-d301-4e96-bca0-c5ee34491620 req-0756faeb-202d-47e4-8b18-2011f37bce09 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094656 Jul 25 14:07:48.845618 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3688/7301] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 14:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:07:48.944333 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-f9aa65bf-7f08-4d2c-8ad7-9d06539b4d52 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76" status: 204 len: 0 microversion: 2.1 time: 0.195849 Jul 25 14:07:48.945028 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3614/7302] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Jul 25 14:07:48 2022] DELETE /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:07:48.955038 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-124b47b0-fb14-4e5e-b2da-789a1ee27cf0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:07:48.955781 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-124b47b0-fb14-4e5e-b2da-789a1ee27cf0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: f19ad795-cec0-407b-b2d5-1eb5b0f19b76] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:07:48.963735 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-124b47b0-fb14-4e5e-b2da-789a1ee27cf0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:48.964354 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-124b47b0-fb14-4e5e-b2da-789a1ee27cf0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:48.965234 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-124b47b0-fb14-4e5e-b2da-789a1ee27cf0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:48.965768 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-124b47b0-fb14-4e5e-b2da-789a1ee27cf0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:49.113073 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.policy [None req-124b47b0-fb14-4e5e-b2da-789a1ee27cf0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:07:49.126349 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-124b47b0-fb14-4e5e-b2da-789a1ee27cf0 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76" status: 200 len: 1684 microversion: 2.1 time: 0.175262 Jul 25 14:07:49.127446 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3689/7303] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:07:48 2022] GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76 => generated 1684 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:07:50.163149 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-00709fcd-5e5a-4fbb-a139-004aafaf9c79 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:07:50.163868 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-00709fcd-5e5a-4fbb-a139-004aafaf9c79 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: f19ad795-cec0-407b-b2d5-1eb5b0f19b76] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:07:50.171276 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00709fcd-5e5a-4fbb-a139-004aafaf9c79 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:50.171780 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00709fcd-5e5a-4fbb-a139-004aafaf9c79 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:50.172558 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00709fcd-5e5a-4fbb-a139-004aafaf9c79 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:50.172999 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-00709fcd-5e5a-4fbb-a139-004aafaf9c79 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:50.307996 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-00709fcd-5e5a-4fbb-a139-004aafaf9c79 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:07:50.316368 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-00709fcd-5e5a-4fbb-a139-004aafaf9c79 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76" status: 200 len: 1684 microversion: 2.1 time: 0.157515 Jul 25 14:07:50.316939 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3615/7304] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:07:50 2022] GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:07:51.151075 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [req-b5e48f73-ae8c-474a-9e83-c318ba71b080 req-a85a1ace-2357-4c6c-aba0-ca8823a69de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f19ad795-cec0-407b-b2d5-1eb5b0f19b76", "name": "network-vif-deleted", "tag": "9e4c1b6c-d4f2-461f-a774-1d2f820b5352"}]} {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:07:51.162407 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b5e48f73-ae8c-474a-9e83-c318ba71b080 req-a85a1ace-2357-4c6c-aba0-ca8823a69de8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:51.162846 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [req-b5e48f73-ae8c-474a-9e83-c318ba71b080 req-a85a1ace-2357-4c6c-aba0-ca8823a69de8 service nova] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:51.175361 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.compute.server_external_events [req-b5e48f73-ae8c-474a-9e83-c318ba71b080 req-a85a1ace-2357-4c6c-aba0-ca8823a69de8 service nova] Creating event network-vif-deleted:9e4c1b6c-d4f2-461f-a774-1d2f820b5352 for instance f19ad795-cec0-407b-b2d5-1eb5b0f19b76 on n-h2-848886-15 Jul 25 14:07:51.180197 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [req-b5e48f73-ae8c-474a-9e83-c318ba71b080 req-a85a1ace-2357-4c6c-aba0-ca8823a69de8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032808 Jul 25 14:07:51.180794 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3690/7305] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 25 14:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:07:51.337764 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-7bbab9cd-dba1-4b67-ae94-70656ff3eddf tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:07:51.338466 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.compute.api [None req-7bbab9cd-dba1-4b67-ae94-70656ff3eddf tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: f19ad795-cec0-407b-b2d5-1eb5b0f19b76] Fetching instance by UUID {{(pid=125883) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:07:51.345761 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7bbab9cd-dba1-4b67-ae94-70656ff3eddf tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:51.346373 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7bbab9cd-dba1-4b67-ae94-70656ff3eddf tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:51.347144 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7bbab9cd-dba1-4b67-ae94-70656ff3eddf tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:51.347587 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7bbab9cd-dba1-4b67-ae94-70656ff3eddf tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:51.379808 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7bbab9cd-dba1-4b67-ae94-70656ff3eddf tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:51.380221 n-d-848886-15 devstack@n-api.service[125883]: DEBUG oslo_concurrency.lockutils [None req-7bbab9cd-dba1-4b67-ae94-70656ff3eddf tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:51.380669 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.objects.instance [None req-7bbab9cd-dba1-4b67-ae94-70656ff3eddf tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lazy-loading 'fault' on Instance uuid f19ad795-cec0-407b-b2d5-1eb5b0f19b76 {{(pid=125883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:07:51.422854 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.policy [None req-7bbab9cd-dba1-4b67-ae94-70656ff3eddf tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1379fa6698114fbea5dec6ca63d2cf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79a678ff2ed4b70ad3a0e340d5dcc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125883) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:07:51.430858 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-7bbab9cd-dba1-4b67-ae94-70656ff3eddf tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76" status: 200 len: 1338 microversion: 2.1 time: 0.096898 Jul 25 14:07:51.431424 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3616/7306] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:07:51 2022] GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76 => generated 1338 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:07:52.454164 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-90892f82-772e-4448-8126-b53421f4ea17 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '>' {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:07:52.454878 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.compute.api [None req-90892f82-772e-4448-8126-b53421f4ea17 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [instance: f19ad795-cec0-407b-b2d5-1eb5b0f19b76] Fetching instance by UUID {{(pid=125884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:07:52.461871 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90892f82-772e-4448-8126-b53421f4ea17 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:52.462348 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90892f82-772e-4448-8126-b53421f4ea17 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:52.463115 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90892f82-772e-4448-8126-b53421f4ea17 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:07:52.463545 n-d-848886-15 devstack@n-api.service[125884]: DEBUG oslo_concurrency.lockutils [None req-90892f82-772e-4448-8126-b53421f4ea17 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Lock "44375b4d-91c4-48bf-9056-56d6e14223f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:07:52.478066 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.wsgi [None req-90892f82-772e-4448-8126-b53421f4ea17 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] HTTP exception thrown: Instance f19ad795-cec0-407b-b2d5-1eb5b0f19b76 could not be found. Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-90892f82-772e-4448-8126-b53421f4ea17 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Request method failure captured: Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: request: GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76 HTTP/1.1 Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: Accept: application/json Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: Accept-Encoding: identity Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: Connection: close Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: Content-Length: 0 Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: Content-Type: application/json Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: Host: 10.222.0.49 Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: Openstack-System-Scope: None Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: User-Agent: python-urllib3/1.26.10 Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: X-Auth-Token: gAAAAABi3qKbLZKyzCgvkLFlsvZyZdSrKyowmThQdqFe7tMpDAM_073hbEtBkz5iBwVTijWMTIdPmJJhQ03J_Tmx9xTsrQlOa3vN1uTqAgH3YvGHMoQYfOSwSHDpUgHsYLfXZem9GH1TpR09Wo5Z6i8Hfown6m0fjYDgrUUjLCwKWSvCHts-JLg Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Id: None Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: X-Domain-Name: None Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: X-Identity-Status: Confirmed Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: X-Is-Admin-Project: True Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Id: default Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Domain-Name: Default Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Id: a79a678ff2ed4b70ad3a0e340d5dcc8e Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: X-Project-Name: tempest-TestSnapshotPattern-61044114 Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: X-Role: reader,member Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: X-Roles: reader,member Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a79a678ff2ed4b70ad3a0e340d5dcc8e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a79a678ff2ed4b70ad3a0e340d5dcc8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a79a678ff2ed4b70ad3a0e340d5dcc8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a79a678ff2ed4b70ad3a0e340d5dcc8e"}]}] Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant: tempest-TestSnapshotPattern-61044114 Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Id: a79a678ff2ed4b70ad3a0e340d5dcc8e Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: X-Tenant-Name: tempest-TestSnapshotPattern-61044114 Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: X-User: tempest-TestSnapshotPattern-61044114-project Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Id: default Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: X-User-Domain-Name: Default Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: X-User-Id: 1379fa6698114fbea5dec6ca63d2cf0d Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: X-User-Name: tempest-TestSnapshotPattern-61044114-project Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: method: > Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: exception: Instance f19ad795-cec0-407b-b2d5-1eb5b0f19b76 could not be found. Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: action_args: {'id': 'f19ad795-cec0-407b-b2d5-1eb5b0f19b76'} Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: {{(pid=125884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f19ad795-cec0-407b-b2d5-1eb5b0f19b76 could not be found. Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f19ad795-cec0-407b-b2d5-1eb5b0f19b76 could not be found. Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:07:52.479717 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 14:07:52.485040 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:07:52.485040 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:07:52.485040 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:07:52.485040 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:07:52.485040 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:07:52.485040 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f19ad795-cec0-407b-b2d5-1eb5b0f19b76 could not be found. Jul 25 14:07:52.485040 n-d-848886-15 devstack@n-api.service[125884]: ERROR nova.api.openstack.wsgi Jul 25 14:07:52.485040 n-d-848886-15 devstack@n-api.service[125884]: DEBUG nova.api.openstack.wsgi [None req-90892f82-772e-4448-8126-b53421f4ea17 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Returning 404 to user: Instance f19ad795-cec0-407b-b2d5-1eb5b0f19b76 could not be found. {{(pid=125884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:07:52.485040 n-d-848886-15 devstack@n-api.service[125884]: INFO nova.api.openstack.requestlog [None req-90892f82-772e-4448-8126-b53421f4ea17 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76" status: 404 len: 111 microversion: 2.1 time: 0.032076 Jul 25 14:07:52.485040 n-d-848886-15 devstack@n-api.service[125884]: [pid: 125884|app: 0|req: 3691/7307] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Jul 25 14:07:52 2022] GET /compute/v2.1/servers/f19ad795-cec0-407b-b2d5-1eb5b0f19b76 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:07:52.651962 n-d-848886-15 devstack@n-api.service[125883]: DEBUG nova.api.openstack.wsgi [None req-76e48c27-8195-4a6f-b37d-5ec80787cd86 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] Calling method '.version_select at 0x7efcf82acf70>' {{(pid=125883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:07:52.656568 n-d-848886-15 devstack@n-api.service[125883]: ERROR oslo.messaging._drivers.impl_rabbit [None req-76e48c27-8195-4a6f-b37d-5ec80787cd86 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [89d26934-5c76-41fd-a21c-3bc08c3f5e0b] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 14:07:53.665626 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [None req-76e48c27-8195-4a6f-b37d-5ec80787cd86 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] [89d26934-5c76-41fd-a21c-3bc08c3f5e0b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 50220. Jul 25 14:07:53.687951 n-d-848886-15 devstack@n-api.service[125883]: INFO nova.api.openstack.requestlog [None req-76e48c27-8195-4a6f-b37d-5ec80787cd86 tempest-TestSnapshotPattern-61044114 tempest-TestSnapshotPattern-61044114-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1866138768" status: 202 len: 0 microversion: 2.1 time: 1.039768 Jul 25 14:07:53.688518 n-d-848886-15 devstack@n-api.service[125883]: [pid: 125883|app: 0|req: 3617/7308] 10.222.0.49 () {58 vars in 1257 bytes} [Mon Jul 25 14:07:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1866138768 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:08:43.187708 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 14:08:43.188351 n-d-848886-15 devstack@n-api.service[125884]: Mon Jul 25 14:08:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 14:09:44.040914 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 14:09:44.041707 n-d-848886-15 devstack@n-api.service[125884]: Mon Jul 25 14:09:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 14:11:18.036419 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 14:11:18.037367 n-d-848886-15 devstack@n-api.service[125883]: Mon Jul 25 14:11:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 14:12:03.197216 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 14:12:03.197892 n-d-848886-15 devstack@n-api.service[125884]: Mon Jul 25 14:12:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 14:12:58.018538 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 14:12:58.019160 n-d-848886-15 devstack@n-api.service[125883]: Mon Jul 25 14:12:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 14:13:04.050459 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 14:13:04.050459 n-d-848886-15 devstack@n-api.service[125884]: Mon Jul 25 14:13:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 14:13:15.532948 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 14:13:15.533556 n-d-848886-15 devstack@n-api.service[125883]: Mon Jul 25 14:13:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 14:13:36.797993 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 14:13:36.798662 n-d-848886-15 devstack@n-api.service[125884]: Mon Jul 25 14:13:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 14:14:38.046505 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 14:14:38.047195 n-d-848886-15 devstack@n-api.service[125883]: Mon Jul 25 14:14:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 14:15:23.206631 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 14:15:23.207263 n-d-848886-15 devstack@n-api.service[125884]: Mon Jul 25 14:15:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 14:16:18.028337 n-d-848886-15 devstack@n-api.service[125883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 14:16:18.029092 n-d-848886-15 devstack@n-api.service[125883]: Mon Jul 25 14:16:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 14:16:24.060116 n-d-848886-15 devstack@n-api.service[125884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 14:16:24.060816 n-d-848886-15 devstack@n-api.service[125884]: Mon Jul 25 14:16:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!